| tonyb | I'm trying to understand how the workbooks in tripleo-common get called / given to mistral. I'm specifically interested in baremetal.yaml (the configure_boot action) Any pointers very welcome | 00:01 |
|---|---|---|
| *** achadha has joined #tripleo | 00:02 | |
| *** lblanchard has quit IRC | 00:05 | |
| *** lblanchard has joined #tripleo | 00:05 | |
| *** achadha has quit IRC | 00:06 | |
| thrash | pabelanger: the mistral/undercloud idempotency thing... | 00:06 |
| thrash | pabelanger: still an issue I assume? | 00:06 |
| fultonj | tonyb: when the undercloud is installed the workbooks in trippleo-common are created. `mistral workbook-list | grep bare` should show that you have the workbook in question. | 00:06 |
| tonyb | fultonj: Thanks. | 00:07 |
| *** rlandy|bbl is now known as rlandy | 00:08 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 00:10 |
| *** rlandy has quit IRC | 00:10 | |
| tonyb | fultonj: Now to work out where they're call and see if I can influence the args ... I may be ahead of myself | 00:10 |
| fultonj | tonyb: 'mistral execution-list | grep tripleo.baremetal.v1' would show if it was run | 00:11 |
| tonyb | fultonj: Thanks. I'm pretty sure it hasn't (nor should it) have been run I've only just done undercloud install | 00:11 |
| fultonj | after a deployment you would see results | 00:12 |
| *** tongl has quit IRC | 00:12 | |
| tonyb | fultonj: I'm tryign to see if I can use soerhting otehr than the default bm-deploy.* images on specific machines | 00:12 |
| fultonj | why not just modify the image to have what you need it to have | 00:15 |
| tonyb | fultonj: It isn't possible :( | 00:20 |
| tonyb | fultonj: so it *looks* like I can use openstack overcloud node configure after I've added the nodes but befoer I do the introspection does that sound right? | 00:21 |
| fultonj | tonyb: you can run it before and after introspection | 00:22 |
| tonyb | fultonj: okay I think I can just add the second image to the undercloud glance and then use configure to manually set it for the right image | 00:23 |
| tonyb | fultonj: Thanks. | 00:23 |
| fultonj | tonyb: in my case i run it to assign a kernel the first time and then introspect, then when i get introspection data i run it again to set the disk i want to be used to container the root fs | 00:23 |
| tonyb | fultonj: perfect! | 00:24 |
| tonyb | fultonj: Are you going to be at the PTG? | 00:24 |
| fultonj | yes | 00:24 |
| fultonj | you? | 00:24 |
| tonyb | fultonj: cool. I'll buy you $beverage :) | 00:24 |
| tonyb | fultonj: yup | 00:24 |
| fultonj | ok, thanks | 00:24 |
| fultonj | https://specs.openstack.org/openstack/ironic-specs/specs/kilo-implemented/root-device-hints.html | 00:25 |
| fultonj | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/root_device.html | 00:26 |
| fultonj | tonyb: that's the example i was talking about ^ | 00:26 |
| fultonj | after introspection figures out the wwn of the disk, per machine, i use root device hints | 00:26 |
| fultonj | smallest worked in my situtation | 00:26 |
| fultonj | i've always just used the same image for all hardware though, never used diff images per server | 00:27 |
| fultonj | and if i changed an image for one server, e.g. added a pacakge, it didn't hurt the other servers if that package was there because only certain servers would use configuration for that server type that needed that image | 00:28 |
| tonyb | fultonj: im my case I have a mutli-arch deploy I'm trying to work so the images aren't even remotely compatible | 00:29 |
| fultonj | ohhhh | 00:29 |
| fultonj | multiple arch.... i have 0 experience with that | 00:30 |
| fultonj | i see | 00:30 |
| tonyb | fultonj: I think all bits are theer to make this work in a semi-manual fashion I just need to work out how to find them ;P | 00:31 |
| tonyb | fultonj: like the image name is an argument to the mistral workbook but I was striggling to find if/where that was exposed | 00:31 |
| tonyb | fultonj: thanks to your help I can see it and I have a plan | 00:32 |
| fultonj | https://github.com/fultonj/mistral/blob/master/101/input_action_details_session.txt | 00:34 |
| fultonj | ok, here's ^ an example of passing an argument to a workflow | 00:34 |
| fultonj | and then digging after it to see the results | 00:34 |
| *** achadha has joined #tripleo | 00:42 | |
| tonyb | fultonj: Thanks! | 00:54 |
| fultonj | tonyb: np, glad i could help | 00:54 |
| *** stendulker has joined #tripleo | 00:59 | |
| *** ebarrera has quit IRC | 01:03 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 01:10 |
| *** achadha_ has joined #tripleo | 01:48 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Don't fail if VM extradisks are already attached https://review.openstack.org/474981 | 01:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: pin ara to a known version https://review.openstack.org/498545 | 01:51 |
| *** achadha has quit IRC | 01:51 | |
| *** achadha_ has quit IRC | 01:52 | |
| *** fzdarsky_ has joined #tripleo | 01:55 | |
| *** fzdarsky|afk has quit IRC | 01:57 | |
| *** catintheroof has quit IRC | 02:00 | |
| *** stendulker has quit IRC | 02:01 | |
| *** catintheroof has joined #tripleo | 02:01 | |
| *** yamahata has joined #tripleo | 02:01 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Make overcloud trust the undercloud's CA certificate https://review.openstack.org/496639 | 02:04 |
| openstackgerrit | Merged openstack/tripleo-common master: Fix port health check false negatives https://review.openstack.org/497792 | 02:05 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Switch scenario004 to run Tempest https://review.openstack.org/491113 | 02:05 |
| *** pmannidi has joined #tripleo | 02:08 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 02:10 |
| *** itlinux has joined #tripleo | 02:12 | |
| pmannidi | Hello guys .. has anyone hit "Failed to detach interface from server" error during deployment update? | 02:12 |
| pmannidi | I'm using Newton | 02:13 |
| *** ykarel has joined #tripleo | 02:15 | |
| *** blacksouljah has joined #tripleo | 02:16 | |
| *** blacksouljah has left #tripleo | 02:17 | |
| pabelanger | EmilienM: stevebaker: mwhahaha: 499693 pass check with all green, if we want to approve, I can promote | 02:24 |
| pabelanger | that will stop the gate from reseting | 02:24 |
| stevebaker | pabelanger: its a low risk change, make it so | 02:28 |
| mwhahaha | pabelanger: +A | 02:31 |
| *** jlabarre has quit IRC | 02:31 | |
| pabelanger | and prompted | 02:34 |
| pabelanger | that should make all stable/pike jobs behind it pass now | 02:34 |
| mwhahaha | pabelanger: no that was just master | 02:35 |
| mwhahaha | so it probably needs to get backported | 02:35 |
| pabelanger | mwhahaha: Oh, right. we already did stable/pike | 02:36 |
| pabelanger | confused them | 02:36 |
| *** ykarel has quit IRC | 02:53 | |
| *** ykarel has joined #tripleo | 03:03 | |
| *** gbarros has quit IRC | 03:06 | |
| EmilienM | pabelanger: thanks good to know | 03:07 |
| *** ramishra has joined #tripleo | 03:08 | |
| EmilienM | thrash: maybe | 03:09 |
| EmilienM | thrash: I need to catchup tbh | 03:09 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 03:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| *** ykarel has quit IRC | 03:18 | |
| EmilienM | pabelanger: what's up about https://review.openstack.org/#/c/499821/ ? | 03:21 |
| *** garyk has joined #tripleo | 03:22 | |
| pabelanger | EmilienM: still on plate, I'll loop back to that in the morning. Almost have a query | 03:23 |
| *** stendulker has joined #tripleo | 03:26 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Fix port health check false negatives https://review.openstack.org/499880 | 03:28 |
| EmilienM | stevebaker: please look my comment on https://review.openstack.org/#/c/498683/ | 03:30 |
| EmilienM | pabelanger: ack, please push over | 03:30 |
| EmilienM | pabelanger: good night sir | 03:30 |
| *** links has joined #tripleo | 03:32 | |
| *** udesale has joined #tripleo | 03:37 | |
| *** psachin has joined #tripleo | 03:41 | |
| *** gkadam_ has joined #tripleo | 03:41 | |
| *** achadha has joined #tripleo | 03:42 | |
| *** lblanchard has quit IRC | 03:47 | |
| *** lblanchard has joined #tripleo | 03:48 | |
| *** tzumainn has quit IRC | 03:55 | |
| *** noslzzp has quit IRC | 04:03 | |
| *** yprokule has joined #tripleo | 04:08 | |
| EmilienM | stevebaker: are you around? | 04:09 |
| *** garyk has quit IRC | 04:09 | |
| EmilienM | "/usr/bin/docker-current: Error: image tripleoupstream/centos-binary-cron:latest not found.", | 04:09 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 04:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| EmilienM | upgrades from ocata to pike are now broken :( | 04:10 |
| EmilienM | it fails to pull containers during the upgrade | 04:10 |
| *** ykarel has joined #tripleo | 04:12 | |
| EmilienM | https://bugs.launchpad.net/tripleo/+bug/1714412 | 04:16 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 04:16 |
| EmilienM | stevebaker: if you're back and have time ^ ptal | 04:16 |
| *** garyk has joined #tripleo | 04:16 | |
| *** garyk has quit IRC | 04:20 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add missing BarbicanApi service https://review.openstack.org/499693 | 04:33 |
| EmilienM | pabelanger: ^ scenario002 is back on stage :D | 04:35 |
| *** garyk has joined #tripleo | 04:38 | |
| *** catintheroof has quit IRC | 04:41 | |
| EmilienM | numans: are you around? | 04:42 |
| EmilienM | numans: when you're back, can you look why https://review.openstack.org/#/c/494293/ is failing please? | 04:43 |
| *** skramaja has joined #tripleo | 04:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: run tempest on fs018 (scenario003-container) https://review.openstack.org/499889 | 04:54 |
| pabelanger | EmilienM: almost, you need a backport: http://logs.openstack.org/57/499457/1/gate/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/1e896f1/logs/undercloud/home/jenkins/failed_deployment_list.log.txt.gz | 04:55 |
| pabelanger | that is in the gate | 04:55 |
| EmilienM | pabelanger: it's backported | 04:56 |
| EmilienM | err no | 04:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Add missing BarbicanApi service https://review.openstack.org/499892 | 04:57 |
| EmilienM | now it is | 04:57 |
| pabelanger | k, looks like 12 incoming merges too | 04:57 |
| EmilienM | jaosorior: thx | 04:57 |
| EmilienM | yeah | 04:57 |
| EmilienM | pabelanger: dude you never sleep | 04:57 |
| EmilienM | jaosorior: if you have time, and can take a look at https://bugs.launchpad.net/tripleo/+bug/1714412 | 04:57 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 04:57 |
| pabelanger | EmilienM: ya, calling it soon | 04:57 |
| EmilienM | if you're not familiar no worries I sent an email to some folks | 04:57 |
| jaosorior | EmilienM: I can give it a try, but it does sound out of what I know. I'll ping sshnaidm|off when he's online though. | 04:58 |
| EmilienM | jaosorior: it looks related to what stevebaker / mandre have been working on recently though | 04:59 |
| *** pmannidi has quit IRC | 04:59 | |
| EmilienM | but we'll see, I'm going to bed now | 04:59 |
| EmilienM | i'm just waiting for the merge flood | 04:59 |
| EmilienM | so I can dream about it | 04:59 |
| EmilienM | jaosorior: you'll want to backport https://review.openstack.org/#/c/499541/ I quess | 05:01 |
| EmilienM | guess$ | 05:01 |
| EmilienM | err.. | 05:01 |
| *** aditya_r has joined #tripleo | 05:01 | |
| EmilienM | jaosorior: also you can ping bogdan when he's up about https://bugs.launchpad.net/tripleo/+bug/1714412 | 05:01 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 05:01 |
| jaosorior | EmilienM: yes | 05:02 |
| EmilienM | thx | 05:02 |
| jaosorior | EmilienM: and yes to the backport too | 05:02 |
| EmilienM | kk | 05:02 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Configure Zaqar trust notifier https://review.openstack.org/485124 | 05:04 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Configure Zaqar trust notifier https://review.openstack.org/499894 | 05:05 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add a warning message for the list of unused parameters https://review.openstack.org/495300 | 05:05 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix enabling zaqar keystone endpoint and MySQL database https://review.openstack.org/499541 | 05:05 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Fix enabling zaqar keystone endpoint and MySQL database https://review.openstack.org/499895 | 05:05 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: fs016: run tempest like fs005 https://review.openstack.org/498569 | 05:05 |
| *** dpawar has joined #tripleo | 05:06 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/pike: Fix enabling zaqar keystone endpoint and MySQL database https://review.openstack.org/499895 | 05:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Remove hard-coded image reference https://review.openstack.org/499449 | 05:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Update generated ssl environments https://review.openstack.org/493245 | 05:06 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Update generated ssl environments https://review.openstack.org/499896 | 05:06 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix filter image list by deployed services https://review.openstack.org/499548 | 05:06 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements stable/ocata: Add remove-machine-id element https://review.openstack.org/493684 | 05:07 |
| EmilienM | and I'm out! | 05:07 |
| jaosorior | EmilienM: have a good one | 05:08 |
| *** EmilienM changes topic to "CI Status: Orange: upgrade jobs failing https://bugs.launchpad.net/tripleo/+bug/1714412 | TripleO | https://docs.openstack.org/tripleo-docs/latest/ | http://tripleo.org" | 05:08 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 05:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 05:10 |
| *** achadha has quit IRC | 05:21 | |
| *** achadha has joined #tripleo | 05:21 | |
| *** pdeore has joined #tripleo | 05:22 | |
| *** aditya_r has quit IRC | 05:25 | |
| *** aditya_r has joined #tripleo | 05:25 | |
| *** achadha has quit IRC | 05:26 | |
| *** shreshtha has joined #tripleo | 05:27 | |
| *** ratailor has joined #tripleo | 05:29 | |
| *** dpawar has quit IRC | 05:30 | |
| *** dpawar has joined #tripleo | 05:32 | |
| *** dpawar has quit IRC | 05:42 | |
| *** marios has joined #tripleo | 05:44 | |
| *** marios_ has joined #tripleo | 05:45 | |
| *** dpawar has joined #tripleo | 05:45 | |
| *** achadha has joined #tripleo | 05:47 | |
| *** achadha_ has joined #tripleo | 05:49 | |
| *** links has quit IRC | 05:50 | |
| *** achadha has quit IRC | 05:53 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 06:00 |
| *** aditya_ra has joined #tripleo | 06:00 | |
| *** links has joined #tripleo | 06:01 | |
| *** aditya_r has quit IRC | 06:03 | |
| *** iranzo has joined #tripleo | 06:03 | |
| *** dparkes has joined #tripleo | 06:07 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add less verbosity for fernet keys ansible playbook https://review.openstack.org/499526 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add storage backends env files for containerized deployment https://review.openstack.org/495370 | 06:09 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Use Python to compute release notes version https://review.openstack.org/499355 | 06:09 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Prepare 6.5.1 (ocata) https://review.openstack.org/499700 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Use Python to compute release notes version https://review.openstack.org/499729 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Use Python to compute release notes version https://review.openstack.org/499731 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Release 3.2.1 (ocata) https://review.openstack.org/499733 | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 06:10 |
| *** achadha_ has quit IRC | 06:13 | |
| *** achadha has joined #tripleo | 06:13 | |
| *** pgadiya has joined #tripleo | 06:15 | |
| lvdombrkr | hello guys, i cant dalete my overcloud delete process stuck on NetworksDELETE_IN_PROGRESS | 06:17 |
| *** pcaruana has joined #tripleo | 06:17 | |
| lvdombrkr | any ideas how can i delete my cloud? | 06:17 |
| *** jtomasek has joined #tripleo | 06:21 | |
| *** nyechiel has joined #tripleo | 06:24 | |
| jaosorior | lvdombrkr: any idea why they're stuck? Have you tried checking the heat logs? | 06:30 |
| *** masco has joined #tripleo | 06:31 | |
| lvdombrkr | jaosorior: it was first time when i tried deploy overcloud with network-isolation and deployment failed... after that deletion process also failed | 06:31 |
| *** nyechiel has quit IRC | 06:31 | |
| *** jaganathan has joined #tripleo | 06:32 | |
| *** rcernin has joined #tripleo | 06:33 | |
| jaosorior | lvdombrkr:yeah, but, anything in the logs? | 06:34 |
| jaosorior | lvdombrkr: also, are the neutron agents still running? | 06:37 |
| *** jfrancoa has joined #tripleo | 06:37 | |
| *** jprovazn has joined #tripleo | 06:39 | |
| *** pgadiya has quit IRC | 06:42 | |
| *** dpawar has quit IRC | 06:43 | |
| *** daidv has left #tripleo | 06:44 | |
| *** daidv has joined #tripleo | 06:45 | |
| *** apetrich has joined #tripleo | 06:45 | |
| lvdombrkr | jaosorior: in which logs i should look firstly? | 06:46 |
| *** jaganathan has quit IRC | 06:46 | |
| jaosorior | lvdombrkr: so, the heat logs would be a good indication on why it's not deleting it | 06:47 |
| jaosorior | lvdombrkr: you could try a stack delete again, and then check the heat engine logs | 06:47 |
| *** jaganathan has joined #tripleo | 06:49 | |
| *** iranzo has quit IRC | 06:49 | |
| *** achadha_ has joined #tripleo | 06:50 | |
| *** iranzo has joined #tripleo | 06:51 | |
| *** dpawar has joined #tripleo | 06:53 | |
| *** achadha has quit IRC | 06:54 | |
| *** dpawar has quit IRC | 06:54 | |
| *** dpawar has joined #tripleo | 06:55 | |
| *** achadha_ has quit IRC | 06:58 | |
| *** ebarrera has joined #tripleo | 07:00 | |
| *** hjensas has joined #tripleo | 07:07 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements master: Adding Bagpipe driver to controller and compute elements https://review.openstack.org/454670 | 07:07 |
| *** shardy has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 07:10 |
| *** dpawar has quit IRC | 07:12 | |
| *** tesseract has joined #tripleo | 07:12 | |
| *** cylopez has joined #tripleo | 07:16 | |
| *** d0ugal has quit IRC | 07:20 | |
| *** cylopez has left #tripleo | 07:21 | |
| *** fzdarsky_ is now known as fzdarsky | 07:23 | |
| *** hanish has joined #tripleo | 07:24 | |
| *** cschwede has joined #tripleo | 07:26 | |
| lvdombrkr | jaosorior: cant find any helpful information | 07:30 |
| hanish | Hi I could see some vendor specific templates, how welcoming is the community on these? | 07:31 |
| jaosorior | hanish: I would say quite welcoming :D folks are usually pretty happy to get them mainstream :D | 07:34 |
| jaosorior | *upstream | 07:34 |
| lvdombrkr | jaosorior: there is some info but same what i can see displayed after failed deletion process: 2017-09-01 10:11:24.933 27094 ERROR heat.engine.resource ResourceFailure: resources.Networks: GreenletExit() | 07:34 |
| jaosorior | lvdombrkr: what about the neutron agents? are they running? how's the memory situation in your undercloud? I have seen that if there are OOMs you might have to restart them manually | 07:35 |
| hanish | jaosorior: Thanks | 07:35 |
| jaosorior | hanish: ideally, bring up a blueprint of what you want to do. That way it's easier to track and for folks to review. | 07:36 |
| *** mhenkel has quit IRC | 07:36 | |
| *** jpich has joined #tripleo | 07:38 | |
| hanish | jaosorior: definetly, i would like to put the blueprint today, is it ok to have only intial idea in blueprint or does it require complete details | 07:38 |
| *** jpena|off is now known as jpena | 07:39 | |
| *** lifeless_ is now known as lifeless | 07:39 | |
| jaosorior | hanish: well, lets start off with the initial idea. It doesn't need to be complete as of now. Are you going to the PTG? That might be a great place to bring the blueprint up and bring more attention to it. | 07:39 |
| lvdombrkr | jaosorior: neutron agent was inactive, and there is no problems with memory | 07:41 |
| jaosorior | lvdombrkr: funky, well, might wanna restart it and attempt to delete the stack again | 07:41 |
| *** dpawar has joined #tripleo | 07:41 | |
| hanish | jaosorior: i would put the blueprint today, since i have decided at the last moment i may not attend the ptg. Is there any way to attend it virtually | 07:42 |
| *** itlinux has quit IRC | 07:42 | |
| jaosorior | hanish: I think some folks were asking the same thing. Might wanna ask EmilienM or mwhahaha about that. | 07:42 |
| *** mhenkel has joined #tripleo | 07:43 | |
| jaosorior | hanish: and it's not entirely necessary to attent, it just makes things easier sometimes :D. | 07:43 |
| jaosorior | hanish: as long as you put enough detail in the blueprint to have folks understand the use case and what you'll do. It's alright. | 07:43 |
| *** ykarel is now known as ykarel|lunch | 07:43 | |
| *** aufi has joined #tripleo | 07:44 | |
| hanish | jaosorior: Thanks by the time of ptg, i would present the complete details. Should i mail ptl for approval if i am not attending the ptg | 07:45 |
| *** dpawar has quit IRC | 07:46 | |
| *** florianf has joined #tripleo | 07:47 | |
| lvdombrkr | jaosorior: no luck unfortinetly | 07:48 |
| *** daidv has quit IRC | 07:50 | |
| *** egonzalez has joined #tripleo | 07:51 | |
| *** daidv has joined #tripleo | 07:51 | |
| openstackgerrit | Frank A. Zdarsky proposed openstack/tripleo-specs master: WIP - Introduce skip level upgrades spec https://review.openstack.org/497257 | 07:53 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Define ceph image in overcloud_containers.yaml.j2 https://review.openstack.org/499822 | 07:54 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Revert "Exclude networking-bagpipe from dlrn" https://review.openstack.org/499743 | 07:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Unset default value for the DockerCephDaemonImage https://review.openstack.org/499555 | 07:54 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Revert "Stop trying to build networking-bagpipe with DLRN" https://review.openstack.org/499744 | 07:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Remove puppet run and workarounds from tripleo_upgrade_node.sh https://review.openstack.org/499625 | 07:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Add --wsrep-provider=none to the mysql_bootstrap container https://review.openstack.org/499623 | 07:55 |
| *** jaosorior has quit IRC | 07:59 | |
| *** jaosorior has joined #tripleo | 08:00 | |
| *** masco_ has joined #tripleo | 08:00 | |
| *** masco has quit IRC | 08:02 | |
| *** skramaja_ has joined #tripleo | 08:02 | |
| *** skramaja has quit IRC | 08:04 | |
| *** lucas-hungry is now known as lucasagomes | 08:04 | |
| *** nyechiel has joined #tripleo | 08:05 | |
| jaosorior | bandini: hey dude, could you check these two out https://review.openstack.org/#/c/498324/ https://review.openstack.org/#/c/498325/ ? | 08:07 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 08:10 |
| *** skramaja_ is now known as skramaja | 08:10 | |
| *** nyechiel has quit IRC | 08:12 | |
| *** anshul has joined #tripleo | 08:14 | |
| *** bogdando has joined #tripleo | 08:15 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Add SRIOV container image parameter generation https://review.openstack.org/487390 | 08:15 |
| *** akrivoka has joined #tripleo | 08:18 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute_feature_enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 08:21 |
| lvdombrkr | jaosorior: can i try just reboot undercloud and try delete after that? | 08:21 |
| jaosorior | shardy: lvdombrkr's deployment is stuck deleting the network, any ideas? | 08:22 |
| bogdando | o/ | 08:24 |
| *** mcornea has joined #tripleo | 08:24 | |
| lvdombrkr | shardy: in heat-engine logs i can find only one ERROR 2017-09-01 10:59:37.304 27092 ERROR heat.engine.resource ResourceFailure: resources.Networks: GreenletExit() | 08:25 |
| bogdando | folks, what could I mess with the configs so os-net-config attempted to create br-ex at undercloud node instead of overcloud? :) | 08:25 |
| bogdando | at overcloud controller, there is even no /etc/os-net-config | 08:26 |
| shardy | bogdando: there is an instack net_config_override option in undercloud.conf, but I assume you mean undercloud deploy? | 08:27 |
| bogdando | shardy: I tried to deploy an overcloud | 08:27 |
| *** paramite has joined #tripleo | 08:28 | |
| shardy | lvdombrkr: Hmm, not sure - I've seen that once before but it was due to a bug in eventlet, do you have steps to reproduce? | 08:28 |
| bogdando | shardy: net config goes here https://github.com/bogdando/oooq-warp/blob/master/vars/overcloud-traas.yaml#L89 | 08:28 |
| bogdando | I changed nic2 to eth1 as IIRC, my prev overcloud deploy attempt complained there is no /sys/class/net/eth1/address which is fair | 08:29 |
| bogdando | I think I'm lost in those encodings. But anyway, the last time that worked, not this time though. Why os-net-config applied to uc instead of overcloud?.. | 08:30 |
| shardy | bogdando: os-net-config is used for both undercloud and overcloud, but the configuration should be different (or at least it may be) | 08:30 |
| shardy | I'm unclear how you're generating the nic config template, or are you just using the t-h-t examples? | 08:31 |
| bogdando | I think the overcloud deploy regenerates it | 08:31 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates stable/pike: Add storage backends env files for containerized deployment https://review.openstack.org/499931 | 08:32 |
| shardy | overcloud deploy doesn't regenerate nic templates | 08:32 |
| shardy | you can pass environment files which override the defaults tho | 08:32 |
| bogdando | shardy: interesting :) I repeated overcloud deploy / undercloud deploy a few times | 08:32 |
| shardy | I'm just not clear how you're doing that in this ansible | 08:32 |
| bogdando | so probably that created a mess | 08:32 |
| *** gfidente has joined #tripleo | 08:33 | |
| bogdando | shardy: just calling these roles for uc https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas-under.yaml and overcloud https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas-over.yaml | 08:33 |
| lvdombrkr | <shardy: | 08:33 |
| bogdando | playbooks* | 08:33 |
| bogdando | and it worked last time, unless I interleaved them consequently | 08:34 |
| bogdando | shardy: there is also a few vars here https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example#L60 so I use the same t-h-t path for uc and overcloud deploy | 08:34 |
| *** cylopez has joined #tripleo | 08:35 | |
| *** limao has joined #tripleo | 08:36 | |
| cylopez | shardy: hello, sorry to disturbed you, I'm look how to remove all reference to a node from heat stack after the deletion of this node | 08:36 |
| bogdando | so what is the standard way the templates get regenerated? | 08:37 |
| bogdando | I use nothing but oooq roles | 08:37 |
| lvdombrkr | shardy: i was deployed overcloud without network isolation, than i decide to test tls, so i delete existing overcloud, create network-isolation config and start deploy overcloud.. after that deployment failed and i decide to remove overcloud and deletion also failed | 08:38 |
| lvdombrkr | shardy: and here im | 08:39 |
| shardy | cylopez: how was the node deleted? | 08:40 |
| cylopez | shardy: openstack overcloud node delete --stack ... | 08:40 |
| shardy | cylopez: that should remove all references to the node when it completes, what are you seeing? | 08:41 |
| jbadiapa | mandre, ping https://review.openstack.org/#/c/487038/ | 08:41 |
| cylopez | shardy: if you scale-up after, i got my index for naming starting after the old compute | 08:42 |
| cylopez | shardy: customer would like to use the name, ip,... | 08:42 |
| *** ykarel|lunch is now known as ykarel | 08:42 | |
| *** dpawar has joined #tripleo | 08:43 | |
| gfidente | jprovazn morning | 08:43 |
| shardy | cylopez: yeah that's expected, but default the old index is not reused, but you can do it with some additional steps, let me try to find some notes | 08:43 |
| cylopez | thx a lot shardy :-) | 08:44 |
| jprovazn | gfidente: hi | 08:44 |
| *** masco_ is now known as masco | 08:45 | |
| cylopez | shardy++ | 08:45 |
| cylopez | you are awesome | 08:45 |
| bogdando | shardy: uc uses net-config-noop.yaml (uc deploy containers templates has it hardcoded). Not sure how come overcloud deploy messes things for uc | 08:46 |
| mandre | jbadiapa: hey! I commented on https://review.openstack.org/#/c/487038/, hope it clarifies a bit | 08:47 |
| bogdando | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/undercloud-deploy.sh.j2#L27 I mean | 08:47 |
| bogdando | shardy: overcloud gets this one https://pastebin.com/KbdfQwkq | 08:49 |
| jbadiapa | madre, let me take a look, thx | 08:50 |
| lvdombrkr | shardy: can i try first of all reboot undercloud ? | 08:51 |
| shardy | lvdombrkr: yes you could, and/or deleting the underlying neutron resources manually to determine if it's a neutron or heat error | 08:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Move deprecated SchedulerHints logic to overcloud.j2.yaml https://review.openstack.org/499440 | 08:52 |
| shardy | bogdando: yeah I can't explain it unless the overcloud resource_registry was somehow passed to the undercloud deploy command | 08:53 |
| paramite | Hey guys is there way to define default value in heat templates which will be transformed to undef for hieradata? | 08:53 |
| bogdando | shardy: wierd... | 08:53 |
| bogdando | uc deployed just fine | 08:53 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Disable compute auto disabling https://review.openstack.org/499398 | 08:54 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/498195 | 08:54 |
| bogdando | deploys* | 08:54 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Enable docker debug when deployed with debug https://review.openstack.org/499437 | 08:54 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Support fernet key rotation with containers https://review.openstack.org/499808 | 08:54 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-common master: Run fluentd container https://review.openstack.org/487038 | 08:54 |
| shardy | paramite: Yes but it requires either a heat conditional or a conditional in the puppet module, because null isn't a valid default for a heat parameter | 08:55 |
| bogdando | shardy: is thee a command to render t-h-t j2 files? | 08:55 |
| bogdando | live | 08:55 |
| bogdando | my env is missing the environments/split-stack-consistent-hostname-format.yaml for a reason | 08:55 |
| paramite | shardy, I am using conditional, so null it is? | 08:55 |
| shardy | paramite: yeah you can do somehierakey: null I think, you just can't do get_param: SomeParam to get null | 08:56 |
| paramite | shardy, thx, gonna try it | 08:56 |
| shardy | bogdando: yes you can run tools/process-templates.py - we don't render any nic templates at this point though | 08:57 |
| bogdando | I'll try to purge the local t-h-t dir, so it will be refetched for overcloud deploy and will contain no uc deploy leftovers | 08:57 |
| bogdando | sigh | 08:57 |
| ratailor | jaosorior, you around ? | 08:57 |
| shardy | bogdando: you can also do openstack container save overcloud to get the contents of the rendered plan | 08:57 |
| *** psachin has quit IRC | 09:00 | |
| ratailor | shardy, Is there any issue with ocata deployment using quickstart ? | 09:00 |
| ratailor | 2017-09-01 05:47:52 | https://trunk.rdoproject.org/centos7-ocata/rdo-trunk-ocata-tested/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found"] | 09:01 |
| ratailor | shardy, I got this ^^ error while trying to deploy ocata using devmode.sh on ovb. | 09:01 |
| ratailor | shardy, when I checked above repo, there is no ref for rdo-trunk-ocata-tested. | 09:02 |
| ratailor | shardy, https://trunk.rdoproject.org/centos7-ocata/ | 09:02 |
| bogdando | it seems that oooq is missing the step to get the split-stack-consistent-hostname-format.yaml file for deployed-server case | 09:02 |
| openstackgerrit | Merged openstack/tripleo-common master: Don't mock mkdtemp https://review.openstack.org/499708 | 09:04 |
| openstackgerrit | Christian Schwede proposed openstack/puppet-tripleo master: Retry Swift ring up-/downloads on failures https://review.openstack.org/499936 | 09:05 |
| ratailor | owalsh, you around ? | 09:06 |
| owalsh | ratailor; yea | 09:06 |
| ratailor | owalsh, I was trying to deploy ocata on ovb using quickstart, got below error. | 09:07 |
| ratailor | owalsh, 2017-09-01 05:47:52 | https://trunk.rdoproject.org/centos7-ocata/rdo-trunk-ocata-tested/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found"] | 09:07 |
| ratailor | I checked above repo, and found that there is no ref to rdo-trunk-ocata-tested. | 09:07 |
| ratailor | owalsh, Is it a bug ? | 09:07 |
| ratailor | https://trunk.rdoproject.org/centos7-ocata/ | 09:08 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 09:10 |
| *** milan has joined #tripleo | 09:11 | |
| owalsh | ratailor: might be... newton is using current-passed-ci - https://github.com/openstack/tripleo-quickstart/blob/master/config/release/trunk/newton.yml#L9 | 09:12 |
| owalsh | ratailor: try changing this to current-passed-ci https://github.com/openstack/tripleo-quickstart/blob/master/config/release/trunk/ocata.yml#L2 | 09:12 |
| ratailor | owalsh, yes, doing that only. Should I report a bug for this. or submit patch ? | 09:13 |
| shardy | ratailor: maybe check with adarazs or sshnaidm|off, I assume the quickstart defaults for ocata repos should be the same as what we test in CI | 09:15 |
| shardy | sounds like maybe that's not the case atm | 09:15 |
| ratailor | owalsh, shardy Thanks! | 09:16 |
| skramaja | shardy: could you check https://review.openstack.org/#/c/490474/ which makes the NetworkDeploymentActions as role-specific? | 09:16 |
| shardy | skramaja: ack will do | 09:16 |
| * adarazs looks at the configs. | 09:17 | |
| jaosorior | ratailor: now I am | 09:21 |
| jaosorior | ratailor: what's up? | 09:21 |
| adarazs | ratailor, shardy: I don't know what that "rdo-trunk-ocata-tested" is there. I think that should be "current-tripleo" or "consistent". | 09:22 |
| ratailor | jaosorior, The ocata config issue, which we are discussing now. Could you pl read above msgs. | 09:23 |
| jaosorior | ratailor: the quickstart issue? | 09:24 |
| ratailor | jaosorior, yes, | 09:24 |
| jaosorior | ratailor: not sure how to go forwared with that one :/ | 09:24 |
| ratailor | jaosorior, no problem. | 09:24 |
| lvdombrkr | shardy: i deleted neutron resources which find but result the same.. i cant delete stuck | 09:25 |
| shardy | adarazs: Ok so that may be a bad default and it's not consistent with what we actually test in CI then? | 09:26 |
| *** udesale__ has joined #tripleo | 09:27 | |
| *** limao has quit IRC | 09:27 | |
| *** udesale has quit IRC | 09:27 | |
| *** suuuper has joined #tripleo | 09:27 | |
| *** limao has joined #tripleo | 09:28 | |
| adarazs | shardy: there seems to be a bit of mess in those release config files... we do test consistent on the promotion pipelines, and then promote them to "current-tripleo" and then further to "current-tripleo-rdo" when they pass RDO Phase1. | 09:28 |
| adarazs | I don't know about any link like "rdo-trunk-ocata-tested" :/ | 09:28 |
| adarazs | looks like quite an old change to that file. I'll put up a change to fix it. | 09:29 |
| *** udesale has joined #tripleo | 09:29 | |
| *** pkovar has joined #tripleo | 09:29 | |
| *** gcerami has joined #tripleo | 09:29 | |
| jtomasek | shardy: Hi, for queens we'd like to implement network configuration wizard for TripleO UI. Currently the networks and networks-roles assignment is driven by roles-data.yaml and network_data.yaml which produces network-isolation.yaml. The other part is generating nic config templates and populating network-environment.yaml's resource registry OS::TripleO::<RoleName>::Net::SoftwareConfig with them. Has there been some planning done in that | 09:30 |
| jtomasek | direction already? | 09:30 |
| *** udesale__ has quit IRC | 09:31 | |
| *** limao has quit IRC | 09:32 | |
| *** achadha has joined #tripleo | 09:34 | |
| jaosorior | adarazs, sshnaidm|off: Any idea what's up in this bug https://bugs.launchpad.net/tripleo/+bug/1714412 http://logs.openstack.org/57/498057/7/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/d714b99/logs/subnode-2/var/log/messages.txt.gz#_Aug_31_23_36_11 :/ | 09:34 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 09:34 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo master: Move manila backend configuration from pacemaker to base https://review.openstack.org/499945 | 09:34 |
| shardy | adarazs: ack, thanks for clarifying! | 09:35 |
| shardy | jtomasek: Yes, I started looking at j2 rendering the nic config template examples but ran out of time to do it for pike | 09:35 |
| shardy | jtomasek: basically we'd refactor the t-h-t network/config examples to be rendered per role and per network | 09:36 |
| shardy | jtomasek: but I think we'd still want to support operator specified templates as well | 09:36 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: Derive params support for ODL DPDK feature https://review.openstack.org/486425 | 09:37 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo master: Move manila backend configuration from pacemaker to base https://review.openstack.org/499945 | 09:37 |
| shardy | jtomasek: I'll be happy to help with the t-h-t part if it helps move the ui wizard feature forward | 09:37 |
| *** achadha has quit IRC | 09:38 | |
| jtomasek | shardy: amazing. What is not entirely clear to me at the moment is the data which we need to provide to be able to generate nic config templates | 09:38 |
| shardy | jtomasek: I think it's basically the same as the work we did for composable networks, e.g roles_data.yaml and network_data.yaml should be enough | 09:39 |
| shardy | jtomasek: the only tricky part is if there are hardware specific configuration changes per role/network | 09:39 |
| shardy | in those cases rendering it all from a template may be tricky | 09:39 |
| shardy | but for cases where the hardware is fairly consistent it should work I think | 09:39 |
| shardy | jtomasek: we should probably chat with dsneddon about it as well | 09:40 |
| *** udesale has quit IRC | 09:40 | |
| *** janki has joined #tripleo | 09:40 | |
| *** udesale has joined #tripleo | 09:41 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Fix the trunk/ocata release file https://review.openstack.org/499947 | 09:42 |
| shardy | jtomasek: possibly we'd want to move towards a generic template with more j2 variables vs the current approach where we duplicate the nic templates for each network configuration | 09:43 |
| shardy | jtomasek: but I guess the first step is to get the exisitng examples rendered per network/role | 09:43 |
| adarazs | shardy, ratailor: ^ I think that change is what you need to get it going. | 09:43 |
| jtomasek | shardy: right. I thought that there is additional data required to generate nic config templates, which describe nics and bonds etc. If all we need is roles and networks data, then it is great | 09:43 |
| jtomasek | shardy: ok, doing it step by step sounds good | 09:44 |
| shardy | jtomasek: Yeah, if we wanted to enable the wizard to fully specify the network config vs select from some pre-canned examples we'd need more variables | 09:44 |
| shardy | maybe a first step with some common configs may be enough though? | 09:44 |
| adarazs | jaosorior: not sure what's up with that bug, EmilienM was working on it. | 09:44 |
| ratailor | adarazs, Thanks! I have already started deployment with current-passed-ci | 09:44 |
| *** udesale has quit IRC | 09:44 | |
| jtomasek | shardy: I think that is what we'll need in the end, but starting light sounds good too. | 09:45 |
| shardy | https://github.com/openstack/tripleo-heat-templates/tree/master/network/config | 09:45 |
| shardy | jtomasek: Ok, yeah it sounds like you'd like a common "master" template instead of all those directories | 09:45 |
| adarazs | ratailor: current-passed-ci is a symlink to current-tripleo-rdo I think, so that's good then. :) | 09:45 |
| shardy | which is probably possible but it's likely to be a pretty complex j2 template | 09:45 |
| jtomasek | shardy: yeah, I am looking at those. Exactly. If we could identify the data which are needed to be able to generate a nic config template, then we're fine | 09:46 |
| openstackgerrit | Merged openstack/tripleo-validations master: Lazy load the entire stack instead of single outputs https://review.openstack.org/498884 | 09:46 |
| openstackgerrit | Merged openstack/tripleo-validations master: Prevent unnecessary calls to dynamic inventory host() https://review.openstack.org/498939 | 09:46 |
| openstackgerrit | Ricardo Noriega proposed openstack/tripleo-heat-templates master: Add Bagpipe driver composable service https://review.openstack.org/454754 | 09:46 |
| *** aditya_ra has quit IRC | 09:46 | |
| jtomasek | shardy: bnemec has been doing this in his network configuration GUI afaik. I am going to take a look at how exactly he did that and it would be great if we could discuss it at PTG | 09:47 |
| shardy | jtomasek: ack, yeah lets also discuss with bnemec, I won't be at the PTG this time but happy to set up a call when you're ready to discuss it | 09:48 |
| jtomasek | shardy: ok, sounds good | 09:48 |
| bogdando | shardy: it seems my deployed-server resource has a wrong "physical_resource_id" that points to UC node | 09:49 |
| rnoriega | shardy, hi!! one quick question: with the inclusion of roles/XXX.yaml files... do we need to edit roles_data.yaml to add a new service to a role?? or will it be autogenerated? | 09:49 |
| bogdando | not sure how this happens | 09:49 |
| jtomasek | shardy: thanks! | 09:50 |
| shardy | rnoriega: the idea is folks stop editing the roles_data.yaml and instead use the new openstack overcloud roles generate command which combines the various roles/* | 09:50 |
| shardy | rnoriega: however it's still possible to manually edit the roles_data.yaml if you wish | 09:50 |
| shardy | rnoriega: to update t-h-t you should update the roles/* where appropriate then regenerate the roles_data.yaml with the roles generate command | 09:51 |
| rnoriega | shardy, could you take a look at this? I'm not sure if it's correct editing both... | 09:51 |
| rnoriega | https://review.openstack.org/#/c/454754/ | 09:51 |
| rnoriega | shardy, ^^ | 09:51 |
| rnoriega | shardy, thank you very much... | 09:51 |
| jtomasek | rnoriega: it is correct. Just to be sure, you should probably run the command shardy specified to get the roles-data.yaml regenerated. but the result is probably the same | 09:53 |
| shardy | rnoriega: yes that looks right, but should the other Compute* roles also be updated? | 09:53 |
| rnoriega | jtomasek, shardy, so we should have the openstack client installed to develop?? mmmm... | 09:54 |
| rnoriega | shardy, I'll check the other roles... | 09:54 |
| jtomasek | rnoriega: good point | 09:54 |
| rnoriega | jtomasek, not to complain or anything, but I usually don't have python clients installed in my laptop | 09:55 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Allow upgrade tasks to run when looping through steps https://review.openstack.org/499517 | 09:55 |
| jtomasek | shardy: we're hitting the problem which I wanted to rise too here. We're duplicating the roles information in t-h-t, if the /roles directory is where the customization (and network assignment) is supposed to happen, then roles-data.yaml could only contain the list of role names which are supposed to be deployed | 09:56 |
| shardy | rnoriega: tox -e pep8 validates the roles_data using tools/roles-data-validation.sh, which uses tools/roles-data-generate.py | 09:57 |
| shardy | which doesn't need tripleoclient installed | 09:57 |
| rnoriega | jtomasek, agree... first time I see it, and it's a bit confusing | 09:57 |
| shardy | operators are expected to use the tripleoclient interface though | 09:57 |
| jtomasek | shardy: the alternative is to treat /roles directory as defaults and do deployment specific customization in roles-data.yaml - this approach would match what we do with networks currently | 09:57 |
| rnoriega | shardy, got it, thanks | 09:57 |
| *** karthiks is now known as karthiks_afk | 09:58 | |
| openstackgerrit | Ricardo Noriega proposed openstack/tripleo-heat-templates master: Add Bagpipe driver composable service https://review.openstack.org/454754 | 09:58 |
| bogdando | shardy: oh, my bad, I put wrong OVERCLOUD_HOSTS myself! sorry for distracting | 09:59 |
| bogdando | that was funny indeed | 09:59 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster https://review.openstack.org/495149 | 10:00 |
| *** achadha has joined #tripleo | 10:00 | |
| jtomasek | shardy: FYI this affects the implementation of roles management actions. Here is the GUI planning draft I am working on currently http://openstack.etherpad.corp.redhat.com/tripleo-ui-queens-planning | 10:01 |
| shardy | jtomasek: ack, yeah I think treating roles/* as defaults then customizing network assignments is valid | 10:03 |
| shardy | ultimately they are just examples, and roles generate is a convenience to make rebasing forked roles_data.yaml files easier | 10:04 |
| lvdombrkr | hello guys, i cant dalete my overcloud delete process stuck on NetworksDELETE_IN_PROGRESS | 10:04 |
| *** achadha has quit IRC | 10:04 | |
| jtomasek | shardy: ok, yeah, so in GUI, user will add roles from the list provided in /roles and then customize them im roles-data.yaml (all done through mistral actions) | 10:05 |
| shardy | jtomasek: yeah sounds reasonable - the networks in roles/* are just what makes sense based on the services specified, I don't see how we can handle every possible customization without still allowing some changes to the generated roles_data | 10:06 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 10:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 10:10 |
| *** achadha has joined #tripleo | 10:10 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: Derive params network config stack exists fix https://review.openstack.org/489168 | 10:10 |
| *** daidv has quit IRC | 10:12 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Fix hardcoded references to deprecated *ExtraConfig parameters https://review.openstack.org/496604 | 10:14 |
| *** gcerami has quit IRC | 10:16 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params network config validation https://review.openstack.org/488362 | 10:18 |
| *** achadha has quit IRC | 10:18 | |
| *** d0ugal has joined #tripleo | 10:19 | |
| *** achadha has joined #tripleo | 10:20 | |
| gfidente | jprovazn why was that working before though? | 10:22 |
| jprovazn | gfidente: before == when? | 10:23 |
| jprovazn | gfidente: before it worked because pacemaker was used | 10:23 |
| jprovazn | gfidente: now with containers pacemaker is not used in scenario004 | 10:23 |
| lvdombrkr | hello guys, i cant dalete my overcloud delete process stuck on NetworksDELETE_IN_PROGRESS | 10:24 |
| gfidente | jprovazn so previously the non-pacemaker version was broken as well? | 10:24 |
| jprovazn | gfidente: I think non-pacemaker version was never used, was it? | 10:24 |
| gfidente | jprovazn I am trying to see what scenario004 non containers did | 10:25 |
| gfidente | jprovazn right was using pacemaker version | 10:25 |
| jprovazn | gfidente: non-pacemaker version should not be used (at least in production) as manila-share HA relies on pacemaker | 10:25 |
| gfidente | so shall we use pacemaker version in -containers too? | 10:26 |
| gfidente | regardless of your fix I mean | 10:26 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params failure message format change https://review.openstack.org/481524 | 10:26 |
| jprovazn | gfidente: if it's possible to use pacemaker version, I would lean toward it as it better reflects production scenario | 10:26 |
| jprovazn | (albeit I hate pacemaker of course) | 10:26 |
| lvdombrkr | shardy: when i tried to delete on of the network which overcloud deployment has created i get error : [root@undercloud stack]# nova network-delete 7fa40d7e-86a1-4d26-8337-6d1f49498bab | 10:27 |
| lvdombrkr | WARNING: Command network-delete is deprecated and will be removed after Nova 15.0.0 is released. Use python-neutronclient or openstackclient instead. | 10:27 |
| lvdombrkr | ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. | 10:27 |
| lvdombrkr | <type 'exceptions.NotImplementedError'> (HTTP 500) (Request-ID: req-3e6c714a-8ff3-48ce-8ae9-8eb8a482fc63) | 10:27 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params network config validation https://review.openstack.org/488362 | 10:28 |
| gfidente | jprovazn so let's try to push a change for that too, jistr started working on it | 10:30 |
| gfidente | sec | 10:30 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens https://review.openstack.org/499359 | 10:30 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: add upgrade release files for the latest deployments https://review.openstack.org/498057 | 10:30 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Add manifests to install and configure stunnel https://review.openstack.org/499234 | 10:30 |
| jprovazn | gfidente: jistr|off: ok, great | 10:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Telemetry specific config for scenario001 https://review.openstack.org/499438 | 10:30 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001 https://review.openstack.org/490376 | 10:30 |
| gfidente | jprovazn wait | 10:30 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Add error message if no bare metal nodes available https://review.openstack.org/499236 | 10:31 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Update generated ssl environments https://review.openstack.org/499896 | 10:31 |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/498747 | 10:31 |
| *** achadha has quit IRC | 10:34 | |
| jprovazn | gfidente: what's up? | 10:36 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Allow upgrade tasks to run when looping through steps https://review.openstack.org/499517 | 10:40 |
| openstackgerrit | Marius Cornea proposed openstack/python-tripleoclient master: Convert step to integer in when statement for upgrade tasks https://review.openstack.org/499540 | 10:41 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-quickstart master: Enable pacemaker in scenario004 https://review.openstack.org/499965 | 10:41 |
| *** achadha has joined #tripleo | 10:42 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-quickstart master: Enable pacemaker in scenario004/containers https://review.openstack.org/499965 | 10:43 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Switch manila-share to pacemaker version in scenario004/containers https://review.openstack.org/499966 | 10:44 |
| gfidente | jprovazn let's see in parallel to your fix how far gets the above | 10:44 |
| *** hanish_ has joined #tripleo | 10:45 | |
| jprovazn | gfidente: ok | 10:45 |
| jprovazn | gfidente: I think combination of both would be best | 10:45 |
| *** psachin has joined #tripleo | 10:45 | |
| gfidente | yeah we need the fix anyway | 10:45 |
| gfidente | but we can test pacemaker version when ready | 10:45 |
| chandankumar | arxcruz: it is not overriding the value | 10:48 |
| *** achadha has quit IRC | 10:48 | |
| chandankumar | arxcruz: i am looking into that | 10:48 |
| *** pkovar has quit IRC | 10:50 | |
| *** social_ has quit IRC | 10:52 | |
| *** tosky has joined #tripleo | 10:55 | |
| *** achadha has joined #tripleo | 10:57 | |
| apetrich | jrist, honza sorry I didn't see the email from yesterday, so now I'm working on that cron triggers patch | 10:57 |
| *** mrch has joined #tripleo | 11:00 | |
| *** achadha has quit IRC | 11:01 | |
| lvdombrkr | guys, i cant delete my existing overcloud, in and nova logs i see 2017-09-01 13:30:05.888 7692 DEBUG nova.api.openstack.wsgi [req-4d13d823-356a-4015-8708-fac23583eb77 988403dbcc5b4905a42154ae4f426275 a054e657680648e7bfd6e30024f889e0 - default default] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. | 11:02 |
| lvdombrkr | deletion fails in network delete process | 11:03 |
| *** lucasagomes is now known as lucas-afk | 11:06 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 11:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: TLS proxy for redis https://review.openstack.org/496520 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] | 11:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 11:10 |
| *** stendulker_ has joined #tripleo | 11:11 | |
| *** achadha has joined #tripleo | 11:11 | |
| arxcruz | chandankumar: I believe this should be fixed in tempestconf | 11:13 |
| arxcruz | tempestconf should check if encryption is enabled | 11:13 |
| *** stendulker has quit IRC | 11:14 | |
| *** stendulker_ has quit IRC | 11:15 | |
| *** adarazs is now known as adarazs_brb | 11:16 | |
| *** achadha has quit IRC | 11:17 | |
| openstackgerrit | Janki Chhatbar proposed openstack/python-tripleoclient master: Add neutron_driver value to prepare command https://review.openstack.org/498743 | 11:17 |
| *** rbowen has joined #tripleo | 11:18 | |
| mandre | has anyone seen ci jobs failing with "devstack-gate/functions.sh: line 180: declare: gate_hook: not found"? | 11:20 |
| openstackgerrit | Merged openstack/tripleo-common master: Make curl healthchecks work with internal TLS https://review.openstack.org/498805 | 11:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: NetworkDeploymentActions shall be made role specific https://review.openstack.org/490474 | 11:21 |
| mandre | for example in tripleo-common stable/pike branch, http://logs.openstack.org/92/499892/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/407b9bc/console.html#_2017-09-01_07_23_19_415023 | 11:21 |
| honza | apetrich: np, let me know if i can help | 11:22 |
| apetrich | honza, I drilled down to the ci run is missing that https://review.openstack.org/#/c/493550/ patch that got merged. I have no idea why | 11:23 |
| chandankumar | arxcruz: yup | 11:24 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Do attach_encrypted_volume to False if not in tempest_extra_config https://review.openstack.org/499972 | 11:24 |
| *** achadha has joined #tripleo | 11:25 | |
| honza | apetrich: say what | 11:25 |
| honza | apetrich: sorry, i need more coffee to understand that sentence | 11:26 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute_feature_enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 11:26 |
| apetrich | honza, so the error we are getting is the same we got a way back when we found that it was an issue with keystone | 11:26 |
| honza | right | 11:26 |
| apetrich | honza, I wrote a bug and a patch it got merged and d0ugal backported it and it got merged | 11:27 |
| apetrich | honza, but that is not present on that run and that is what failed | 11:27 |
| honza | apetrich: is that really true? i thought back then the error was a 400, and now it's 500 | 11:27 |
| honza | apetrich: i see | 11:27 |
| apetrich | honza, as to why I have no clue | 11:27 |
| apetrich | honza, I linked the log here https://bugs.launchpad.net/tripleo/+bug/1714361 | 11:28 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 11:28 |
| *** achadha has quit IRC | 11:30 | |
| *** yprokule has quit IRC | 11:31 | |
| mandre | seems like "devstack-gate/functions.sh: line 180: declare: gate_hook: not found" is not what is causing http://logs.openstack.org/92/499892/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/407b9bc/console.html#_2017-09-01_07_23_19_415023 to fail because I can also see it in a successful job | 11:32 |
| mandre | the failure seems to come from fix_disk_layout in http://logs.openstack.org/92/499892/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/407b9bc/logs/devstack-gate-setup-host.txt | 11:32 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: docker: add logging(source & groups) https://review.openstack.org/499529 | 11:35 |
| *** shreshtha has quit IRC | 11:36 | |
| arxcruz | chandankumar: https://review.openstack.org/499972 what's the point? | 11:38 |
| arxcruz | chandankumar: http://logs.openstack.org/28/499928/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/5f04dcf/logs/undercloud/home/jenkins/tempest-setup.sh.txt.gz | 11:38 |
| arxcruz | chandankumar: you're setting compute_feature_enabled while the correct is compute-feature-enabled | 11:38 |
| chandankumar | one min | 11:39 |
| *** eck` is now known as eck`gone | 11:41 | |
| *** gcerami has joined #tripleo | 11:41 | |
| chandankumar | arxcruz: you are correct, | 11:42 |
| chandankumar | arxcruz: i am too much in the code. | 11:42 |
| arxcruz | chandankumar: ;) it's friday | 11:42 |
| chandankumar | arxcruz: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/config.py#n1150 | 11:42 |
| chandankumar | - and _ screwes us always | 11:42 |
| *** ebarrera has quit IRC | 11:44 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute_feature_enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 11:44 |
| *** bogdando has quit IRC | 11:44 | |
| *** ebarrera has joined #tripleo | 11:44 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 11:45 |
| *** abishop has joined #tripleo | 11:46 | |
| *** dprince has joined #tripleo | 11:53 | |
| *** ratailor has quit IRC | 11:53 | |
| *** dpawar has quit IRC | 11:56 | |
| *** limao has joined #tripleo | 11:56 | |
| *** iranzo has quit IRC | 11:57 | |
| *** adarazs_brb is now known as adarazs | 11:57 | |
| *** limao_ has joined #tripleo | 11:58 | |
| *** tzumainn has joined #tripleo | 11:58 | |
| *** iranzo has joined #tripleo | 11:59 | |
| *** iranzo has joined #tripleo | 11:59 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs master: Document the need to clean the Ceph disks when redeploying https://review.openstack.org/499979 | 11:59 |
| *** limao has quit IRC | 12:01 | |
| *** limao_ has quit IRC | 12:02 | |
| *** limao has joined #tripleo | 12:02 | |
| honza | apetrich: i just went through the logs and i'm out of ideas :( | 12:04 |
| *** pkovar has joined #tripleo | 12:08 | |
| *** trown|outtypewww is now known as trown | 12:08 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 12:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 12:10 |
| *** dougbtv_laptop has joined #tripleo | 12:11 | |
| *** noslzzp has joined #tripleo | 12:11 | |
| *** catintheroof has joined #tripleo | 12:17 | |
| *** hewbrocca_afk is now known as hewbrocca | 12:19 | |
| *** mdnadeem has joined #tripleo | 12:24 | |
| *** gkadam_ has quit IRC | 12:27 | |
| *** jlabarre has joined #tripleo | 12:29 | |
| *** udesale has joined #tripleo | 12:29 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Consume new RoleConfig data in config download https://review.openstack.org/485732 | 12:31 |
| *** catintheroof has quit IRC | 12:34 | |
| *** catintheroof has joined #tripleo | 12:34 | |
| *** ecerquei has joined #tripleo | 12:34 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo stable/pike: Use TLS proxy for Redis' internal TLS https://review.openstack.org/499995 | 12:36 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/492768 | 12:36 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/pike: TLS proxy for redis https://review.openstack.org/499997 | 12:36 |
| *** lblanchard has joined #tripleo | 12:42 | |
| *** rlandy has joined #tripleo | 12:43 | |
| *** jmelvin has joined #tripleo | 12:44 | |
| skramaja | dprince: hi.. could you take a look at https://review.openstack.org/#/c/499053/? | 12:44 |
| skramaja | dprince: i am not sure whether the config change should be part of puppet-tripleo as i am not sure if image bulding requires underclous setup. | 12:45 |
| *** jpena is now known as jpena|lunch | 12:46 | |
| *** psachin has quit IRC | 12:46 | |
| *** lblanchard has quit IRC | 12:47 | |
| *** eck`gone is now known as eck` | 12:49 | |
| *** mdnadeem has quit IRC | 12:51 | |
| *** jcoufal has joined #tripleo | 12:51 | |
| *** limao has quit IRC | 12:52 | |
| *** limao has joined #tripleo | 12:53 | |
| *** rbrady has joined #tripleo | 12:53 | |
| *** rbrady has quit IRC | 12:53 | |
| *** rbrady has joined #tripleo | 12:53 | |
| dprince | skramaja: I'm not aware of anything currently in puppet-tripleo that would configure kolla.conf | 12:55 |
| dprince | skramaja: let me ask stevebaker on your review Instead of packaging a kolla conf, can we instead modify puppet-tripleo to set the required values on the installed /etc/kolla/kolla-build.conf? | 12:55 |
| dprince | skramaja: sorry, bad paste. Let me ask stevebaker on your review here: https://review.openstack.org/#/c/499053/2 | 12:56 |
| skramaja | dprince: thanks.. | 12:57 |
| dprince | skramaja: okay, I commented. let see what he says | 12:57 |
| dprince | skramaja: I will try to follow up next week | 12:57 |
| skramaja | dprince: also could you take a look at https://review.openstack.org/#/c/499086/, which is another pending issue for dpdk? | 12:58 |
| *** limao_ has joined #tripleo | 12:59 | |
| *** limao has quit IRC | 12:59 | |
| lvdombrkr | guys, i cant delete my existing overcloud, in and nova logs i see 2017-09-01 13:30:05.888 7692 DEBUG nova.api.openstack.wsgi [req-4d13d823-356a-4015-8708-fac23583eb77 988403dbcc5b4905a42154ae4f426275 a054e657680648e7bfd6e30024f889e0 - default default] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. | 13:00 |
| *** maeca has joined #tripleo | 13:01 | |
| skramaja | dprince: google landed by to https://github.com/dprince/undercloud_containers/blob/master/build_kolla.sh#L10, while trying to find what is the best way to include this config file default for container image build. | 13:01 |
| skramaja | dprince: but i just want to undetand how thecontinaer image build is done.. | 13:02 |
| skramaja | dprince: so that the conf file (part of the review) will be added to the build. | 13:02 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common stable/pike: Updated from global requirements https://review.openstack.org/498181 | 13:02 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates stable/pike: Updated from global requirements https://review.openstack.org/498182 | 13:02 |
| dprince | skramaja: once we containerize Openvswitch (targetted for Queens I think) we won't have all these host system requirements with regard to the uid/guid stuff right? | 13:03 |
| *** jprovazn has quit IRC | 13:03 | |
| dprince | skramaja: container images aren't required to be built on the Undercloud | 13:03 |
| skramaja | dprince: yes ideally.. | 13:03 |
| dprince | skramaja: which is why I don't like steve's solution | 13:03 |
| skramaja | skramaja: i have validated by chaning the id to 42427 (kolla default for qemu user) and it works fine.. i will evaludate as part of the dpdk containerization though after ovs is containerized.. then we can remove it. | 13:05 |
| skramaja | dprince: upgrade shouldn't be a problem if the vms are evacuated.. but need to be validated.. | 13:05 |
| *** pdeore has quit IRC | 13:07 | |
| dprince | skramaja: +1 on this https://review.openstack.org/#/c/499086/3 if you add a comment I'll +2 | 13:07 |
| skramaja | thanks dprince.. | 13:07 |
| dprince | skramaja: if only we had containerized openvswitch first! then you wouldn't have to jump through some of these hoops I think | 13:08 |
| skramaja | yes dprince. agreed. | 13:08 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 13:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 13:10 |
| *** catintheroof has quit IRC | 13:16 | |
| *** catintheroof has joined #tripleo | 13:16 | |
| *** Altaf has joined #tripleo | 13:17 | |
| Altaf | Hi | 13:18 |
| Altaf | I have just deployed the triple or setup in centos 7 and after deployment deployment was successful but I am not able to get into the UI of openstack | 13:19 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Disable properly services api_cfn and api_cloudwatch. https://review.openstack.org/499182 | 13:21 |
| Altaf | After successful authentication to you are a it showing me error for zaqar socket connection failure | 13:22 |
| Altaf | Have no idea why it showing error | 13:22 |
| *** Goneri has joined #tripleo | 13:24 | |
| *** skramaja has quit IRC | 13:24 | |
| *** leitan has joined #tripleo | 13:27 | |
| radez | d0ugal: could I git a few mins of your time to help me debug a zaqar issue? I just don't know how to look up a message that's timing out | 13:30 |
| radez | https://paste.fedoraproject.org/paste/2OIYlrOI0U1-~EFsuAAUlA | 13:31 |
| d0ugal | radez: I don't really know that much about zaqar... but I can take a look | 13:32 |
| radez | oh.. heh :) | 13:32 |
| radez | in that paste do you know how i can find out more information about the message id that times out? | 13:32 |
| lvdombrkr | folks, only i think that in tripleo network-isolation is most complicated config setup? | 13:36 |
| EmilienM | hi | 13:37 |
| d0ugal | radez: no, not really. I've seen this before but honestly never managed to figure it out | 13:37 |
| radez | d0ugal: kk, thx | 13:37 |
| EmilienM | adarazs: which bug. | 13:38 |
| EmilienM | ? | 13:38 |
| *** yprokule has joined #tripleo | 13:38 | |
| adarazs | EmilienM: "(11:34:52 AM) jaosorior: adarazs, sshnaidm|off: Any idea what's up in this bug https://bugs.launchpad.net/tripleo/+bug/1714412 http://logs.openstack.org/57/498057/7/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/d714b99/logs/subnode-2/var/log/messages.txt.gz#_Aug_31_23_36_11 :/" | 13:38 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 13:38 |
| EmilienM | adarazs: I didn't work on that bug. I just found it. | 13:39 |
| EmilienM | do we have any progress so far? | 13:39 |
| EmilienM | mandre: could you have a look? | 13:39 |
| *** ansmith has quit IRC | 13:40 | |
| EmilienM | flaper87: hey, can you sign up on https://etherpad.openstack.org/p/deployment-queens please? | 13:40 |
| EmilienM | dprince, mandre, stevebaker: I really need some help on https://bugs.launchpad.net/tripleo/+bug/1714412 | 13:41 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 13:41 |
| *** udesale has quit IRC | 13:42 | |
| mandre | EmilienM: hmm, the error really makes me think that the insecure_registry is not set | 13:42 |
| janki | Hi. Can I get some reivews on https://review.openstack.org/#/c/498383/ and https://review.openstack.org/#/c/498743/ please. | 13:43 |
| *** jpena|lunch is now known as jpena | 13:43 | |
| *** links has quit IRC | 13:44 | |
| mandre | EmilienM: haha I guess it's not big news, marios and bogdan already commented on the LP issue | 13:44 |
| *** pdeore has joined #tripleo | 13:45 | |
| *** limao_ has quit IRC | 13:45 | |
| EmilienM | mandre: we had the job working a week ago | 13:45 |
| *** janki has left #tripleo | 13:46 | |
| *** janki has joined #tripleo | 13:46 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Manually set healthchecks for _cron services https://review.openstack.org/498136 | 13:47 |
| *** Altaf has quit IRC | 13:47 | |
| *** jaganathan has quit IRC | 13:49 | |
| *** ratailor has joined #tripleo | 13:49 | |
| *** shardy has quit IRC | 13:49 | |
| *** pchavva has joined #tripleo | 13:54 | |
| mandre | EmilienM: yeah, I'm looking at what could be wrong | 13:54 |
| *** lblanchard has joined #tripleo | 13:56 | |
| *** shardy has joined #tripleo | 13:56 | |
| *** sri_ has quit IRC | 13:58 | |
| *** noslzzp has quit IRC | 13:59 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 14:00 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Consume new RoleConfig data in config download https://review.openstack.org/485732 | 14:00 |
| *** mrch has quit IRC | 14:04 | |
| *** catintheroof has quit IRC | 14:04 | |
| *** catintheroof has joined #tripleo | 14:05 | |
| *** yprokule has quit IRC | 14:06 | |
| *** yprokule has joined #tripleo | 14:06 | |
| rnoriega | Kind reviewers, make my Friday!! :-) https://review.openstack.org/#/c/454754/ | 14:08 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 14:09 |
| *** jmelvin has quit IRC | 14:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/488148 | 14:09 |
| *** hanish_ has quit IRC | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 14:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 14:10 |
| *** gbarros has joined #tripleo | 14:10 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add separate fail-if-no-hosts plugin https://review.openstack.org/500067 | 14:11 |
| *** catintheroof has quit IRC | 14:15 | |
| *** catintheroof has joined #tripleo | 14:15 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove package if service stopped and disabled https://review.openstack.org/479886 | 14:16 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add separate fail-if-no-hosts plugin https://review.openstack.org/500067 | 14:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Undercloud/Certmonger: Only attempt to reload haproxy is it's active https://review.openstack.org/496564 | 14:18 |
| *** hewbrocca is now known as hewbrocca_afk | 14:18 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/ocata: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/494947 | 14:19 |
| *** catintheroof has quit IRC | 14:25 | |
| *** catintheroof has joined #tripleo | 14:25 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common stable/pike: Add less verbosity for fernet keys ansible playbook https://review.openstack.org/500070 | 14:28 |
| EmilienM | we are still hitting https://bugs.launchpad.net/tripleo/+bug/1713832 quite often | 14:29 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 14:29 |
| EmilienM | do we have someone looking at it? | 14:29 |
| EmilienM | therve ^ | 14:29 |
| therve | EmilienM, We still see it after the revert? | 14:29 |
| EmilienM | yes | 14:29 |
| EmilienM | we talked about it Wednesday | 14:30 |
| EmilienM | the fact it's still there | 14:30 |
| EmilienM | something weird is still there, we have the same problem | 14:30 |
| EmilienM | therve: I can show you logs, give me a sec | 14:30 |
| EmilienM | therve: http://logs.openstack.org/13/495413/2/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container/fc64106/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-09-01_08_02_31 | 14:31 |
| *** jmelvin has joined #tripleo | 14:34 | |
| *** catintheroof has quit IRC | 14:35 | |
| *** catintheroof has joined #tripleo | 14:36 | |
| *** catintheroof has quit IRC | 14:37 | |
| *** catintheroof has joined #tripleo | 14:37 | |
| lvdombrkr | folks, only i think that in tripleo network-isolation is most complicated config setup? | 14:37 |
| mwhahaha | dmsimard: did we ever get a solution for the /dev/xvde1 device or resource busy? http://logs.openstack.org/28/495328/3/gate/gate-tripleo-ci-centos-7-undercloud-oooq/d74d79c/ | 14:38 |
| dmsimard | mwhahaha: I sent https://review.openstack.org/#/c/499687/ but it hasn't been improved yet, i'll ping -infra | 14:38 |
| mwhahaha | k | 14:38 |
| dmsimard | I'll add an e-r query | 14:39 |
| therve | EmilienM, Do you have a elastic search showing when it started? | 14:39 |
| EmilienM | therve: yes, a sec | 14:39 |
| *** iranzo has quit IRC | 14:40 | |
| *** jaosorior has quit IRC | 14:40 | |
| EmilienM | therve: https://goo.gl/mzjfJK | 14:41 |
| EmilienM | essage:"u'subscription_create" AND message:"u'Object PUT failed" AND tags:console AND voting:1 | 14:41 |
| EmilienM | message:"u'subscription_create" AND message:"u'Object PUT failed" AND tags:console AND voting:1 | 14:41 |
| mwhahaha | pabelanger: docker debug landed for the undercloud in pike so you should have docker debug logs at your disposal | 14:44 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common stable/pike: Don't mock mkdtemp https://review.openstack.org/500083 | 14:45 |
| *** gbarros has quit IRC | 14:45 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX ISCSI Backend https://review.openstack.org/499139 | 14:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC VMAX Manila Backend https://review.openstack.org/499199 | 14:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add support for Dell EMC Isilon Manila backend https://review.openstack.org/499195 | 14:47 |
| *** pdeore_ has joined #tripleo | 14:52 | |
| *** catintheroof has quit IRC | 14:52 | |
| *** catintheroof has joined #tripleo | 14:52 | |
| dmsimard | mwhahaha: fyi: https://review.openstack.org/#/c/500088/ and https://review.openstack.org/#/c/499687/ is merging | 14:54 |
| dmsimard | mwhahaha: the issue only reproduces on centos nodes too, just to make matters worse :/ | 14:54 |
| *** pdeore has quit IRC | 14:54 | |
| dmsimard | mwhahaha: http://logstash.openstack.org ->Â (message:"/dev/xvde1: No such file or directory") OR (message:"/dev/xvde" AND message:"Device or resource busy") AND tags:"console" | 14:55 |
| *** ratailor has quit IRC | 14:55 | |
| *** masco has quit IRC | 14:55 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix the trunk/ocata release file https://review.openstack.org/499947 | 14:58 |
| *** catintheroof has quit IRC | 15:00 | |
| *** egonzalez has quit IRC | 15:00 | |
| *** jprovazn has joined #tripleo | 15:00 | |
| *** catintheroof has joined #tripleo | 15:00 | |
| mwhahaha | dmsimard: interesting that it's only rax too | 15:02 |
| *** jfrancoa has quit IRC | 15:03 | |
| *** jpena is now known as jpena|away | 15:03 | |
| dmsimard | mwhahaha: the issue is only with rax, yes | 15:05 |
| openstackgerrit | Lokesh Jain proposed openstack/tripleo-heat-templates master: Make nova patching parameters configurable in Nuage https://review.openstack.org/500096 | 15:05 |
| dmsimard | mwhahaha: by design it's only an issue with rax | 15:05 |
| dmsimard | mwhahaha: rax provisions smaller disks but they provision two of them so devstack-gate repartitions things to fix | 15:05 |
| *** anshul has quit IRC | 15:05 | |
| *** gbarros has joined #tripleo | 15:05 | |
| dmsimard | to fix/fit and make consistent with other providers | 15:05 |
| mwhahaha | i see | 15:06 |
| *** gbarros has quit IRC | 15:10 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 15:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 15:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 15:10 |
| *** mbeierl has joined #tripleo | 15:11 | |
| *** EmilienM has quit IRC | 15:12 | |
| *** EmilienM has joined #tripleo | 15:12 | |
| *** karatkievich.freenode.net sets mode: +o EmilienM | 15:12 | |
| *** ChanServ sets mode: -o EmilienM | 15:12 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Mount folders and log file https://review.openstack.org/500097 | 15:13 |
| *** dparkes has quit IRC | 15:13 | |
| *** dparkes has joined #tripleo | 15:15 | |
| therve | EmilienM, It started happening on the 23rd | 15:15 |
| therve | Not sure if there is a promotion matching that | 15:15 |
| therve | No tripleo changes for sure | 15:15 |
| mwhahaha | looks like there was a promotion on aug 22 | 15:17 |
| mwhahaha | so yea | 15:17 |
| mwhahaha | previous one was the 16th | 15:17 |
| mwhahaha | so some change between the 16th and 22 | 15:17 |
| *** links has joined #tripleo | 15:18 | |
| *** dmsimard has quit IRC | 15:19 | |
| *** dmsimard has joined #tripleo | 15:19 | |
| *** janki has quit IRC | 15:21 | |
| *** pdeore_ has quit IRC | 15:22 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci master: Fix hash_info.sh path for the DLRN API reporting https://review.openstack.org/500101 | 15:23 |
| openstackgerrit | Lokesh Jain proposed openstack/puppet-tripleo master: Conditionally include nova patch config in Nuage https://review.openstack.org/500107 | 15:25 |
| therve | Zaqar didn't change, but swift did | 15:25 |
| therve | got to go, will look later | 15:25 |
| *** achadha has joined #tripleo | 15:26 | |
| *** achadha has quit IRC | 15:27 | |
| *** achadha has joined #tripleo | 15:28 | |
| *** rcernin has quit IRC | 15:29 | |
| *** pcaruana has quit IRC | 15:30 | |
| *** aufi has quit IRC | 15:33 | |
| pabelanger | mwhahaha: great, thanks. | 15:33 |
| EmilienM | therve: yeah promotion probably | 15:33 |
| EmilienM | therve: ok thanks! let us know | 15:33 |
| pabelanger | just getting online now, things look good in gate right now. Any new issues pop up since last night? | 15:34 |
| pabelanger | I haven't checked elastic-recheck yet | 15:34 |
| *** ramishra has quit IRC | 15:34 | |
| *** dparkes has quit IRC | 15:36 | |
| openstackgerrit | Numan Siddique proposed openstack/python-tripleoclient master: Set neutron_driver to ovn for image prepare https://review.openstack.org/499563 | 15:36 |
| *** maeca has quit IRC | 15:37 | |
| hamzy | does anyone know what else I need to do after a failed overcloud deploy to clean up properly? I am seeing: | 15:47 |
| hamzy | [u'Only 0 nodes are exposed to Nova of 2 requests. Check that enough nodes are in "available" state with maintenance mode off.', u'Only 0 nodes are exposed to Nova of 2 requests. Check that enough nodes are in "available" state with maintenance mode off.'] | 15:47 |
| hamzy | I did "openstack stack delete overcloud --yes" | 15:47 |
| hamzy | http://paste.openstack.org/show/620222/ | 15:49 |
| mwhahaha | hamzy: you should just need to do that, check the scheduler log to see why it's not picking those nodes up? | 15:49 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE enable docker debugging https://review.openstack.org/500112 | 15:50 |
| hamzy | mwhahaha, /var/log/nova/nova-scheduler.log ? | 15:51 |
| mwhahaha | hamzy: yea it's either tha tone or the conductor | 15:51 |
| hamzy | no errors in that one... I'll check the other | 15:51 |
| mwhahaha | hamzy: oh check that nova-compute is still enabled | 15:51 |
| mwhahaha | hamzy: we just merged a fix for that but it used to disable itself if there were too many build failures | 15:52 |
| mwhahaha | hamzy: new "feature" for pike | 15:52 |
| hamzy | systemctl service? | 15:52 |
| mwhahaha | hamzy: no openstack compute service list it hink | 15:52 |
| hamzy | | 15 | nova-compute | oscloud5.stglabs.ibm.com | nova | disabled | up | 2017-09-01T15:52:58.000000 | | 15:53 |
| mwhahaha | yea there's youre problem | 15:53 |
| mwhahaha | your* | 15:53 |
| hamzy | thanks... It sounds like an error msg needs to be changed | 15:53 |
| *** ykarel has quit IRC | 15:53 | |
| mwhahaha | hamzy: we disabled that "Feature" | 15:53 |
| *** yamahata has quit IRC | 15:54 | |
| hamzy | in newer builds? I installed this morning | 15:54 |
| mwhahaha | yea | 15:54 |
| mwhahaha | openstack compute service set --enable oscloud5.stglabs.ibm.com nova-compute | 15:54 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Parse ceph_client_ansible_vars in ceph-ansible workbook https://review.openstack.org/499624 | 15:55 |
| mwhahaha | hamzy: landed 7 hours ago, https://review.openstack.org/#/c/499398/1 | 15:55 |
| hamzy | mwhahaha, thanks! I owe you many beers | 15:55 |
| EmilienM | marios: I replied. It's nothing against you or your patch. It's just we're trying to kick this release out | 15:56 |
| EmilienM | marios: and we can't afford new regressions... | 15:57 |
| *** yamahata has joined #tripleo | 15:57 | |
| *** dsariel has joined #tripleo | 15:59 | |
| *** thrash is now known as thrash|biab | 16:02 | |
| *** itlinux has joined #tripleo | 16:05 | |
| *** jpich has quit IRC | 16:06 | |
| marios | EmilienM: ok, i understand this as we already discussed on wednesday. its just that there is no evidence the patch is responsible (indeed why/how did you decide it was that particular patch?). i won't push for it but at the moment, you reverted a random patch, seeminlgy | 16:07 |
| *** dsariel has quit IRC | 16:07 | |
| marios | EmilienM: /me end of day ttyl next week then if there is more thanks | 16:08 |
| marios | have a good day all bai | 16:08 |
| *** dsariel has joined #tripleo | 16:08 | |
| *** marios has quit IRC | 16:08 | |
| *** jpich has joined #tripleo | 16:08 | |
| EmilienM | marios_: it was not random | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 16:10 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 16:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 16:10 |
| *** gbarros has joined #tripleo | 16:10 | |
| *** fzdarsky is now known as fzdarsky|afk | 16:11 | |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Filter out disabled services from prepare command https://review.openstack.org/499704 | 16:15 |
| *** achadha_ has joined #tripleo | 16:18 | |
| *** ebarrera has quit IRC | 16:19 | |
| *** ebarrera has joined #tripleo | 16:19 | |
| gfidente | EmilienM so the manila issue with pingtest | 16:20 |
| hamzy | Swift temporary URLs require a shared secret to be created. You must provide "swift_temp_url_key" as a config option.: MissingParameterValue: Swift temporary URLs require a shared secret to be created. You must provide "swift_temp_url_key" as a config option. | 16:21 |
| hamzy | sigh | 16:21 |
| *** maeca has joined #tripleo | 16:21 | |
| mwhahaha | hamzy: that's a new one | 16:21 |
| *** achadha has quit IRC | 16:21 | |
| *** maeca has quit IRC | 16:22 | |
| gfidente | EmilienM can you rebase the pingtest on https://review.openstack.org/#/c/499966/ | 16:22 |
| *** achadha_ has quit IRC | 16:22 | |
| gfidente | problem is we were running part of the manifest only in the pacemaker profile and deploying the non-pacemaker version | 16:23 |
| gfidente | jprovazn has a fix for puppet-tripleo in https://review.openstack.org/#/c/499945/ | 16:23 |
| gfidente | but we also want to use the pacemaker version in scenario004 because it is the only "supported" configuration, hence https://review.openstack.org/#/c/499966/ | 16:23 |
| gfidente | which should make pingtest pass | 16:23 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Don't fail if Virtual BMCs have already been created https://review.openstack.org/486175 | 16:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add Bagpipe driver composable service https://review.openstack.org/454754 | 16:24 |
| EmilienM | gfidente: sure thing | 16:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove ipv6 specific network templates https://review.openstack.org/499385 | 16:24 |
| hamzy | probably from https://github.com/openstack/ironic/blob/master/ironic/common/glance_service/v2/image_service.py#L164 | 16:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: enable pingtest on fs019 https://review.openstack.org/498575 | 16:26 |
| *** tongl has joined #tripleo | 16:26 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: enable pingtest on fs019 https://review.openstack.org/498575 | 16:26 |
| EmilienM | gfidente: done | 16:26 |
| *** ykarel has joined #tripleo | 16:26 | |
| gfidente | EmilienM let's see | 16:27 |
| *** links has quit IRC | 16:31 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: manila: set "neutron_admin_auth_url" correctly https://review.openstack.org/497604 | 16:32 |
| *** catintheroof has quit IRC | 16:36 | |
| *** catintheroof has joined #tripleo | 16:36 | |
| openstackgerrit | Martin André proposed openstack/tripleo-docs master: Document how to upload only the needed container images https://review.openstack.org/500126 | 16:37 |
| tongl | Hi, is there any way to add selinux policy to allow neutron-server service? On my setup, neutron-server with thirdparty plugin failed to start with selinux enforcing. I am wondering, how default ml2 set it up. | 16:37 |
| tongl | Found this doc: https://www.systutorials.com/docs/linux/man/8-neutron_selinux/. But not sure how to add it to environment file. | 16:38 |
| *** jpena|away is now known as jpena|off | 16:38 | |
| beagles | tongl, not sure the templates are where you want to put that | 16:39 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Allow upgrade tasks to run when looping through steps https://review.openstack.org/499517 | 16:40 |
| tongl | beagles: Usually how to set it up during overcloud deployment? | 16:41 |
| beagles | tongl, if it's required for proper operation of the third party plugin wouldn't it be better to cover in the packaging so it would benefit anyone using that plugin not just those deploying with tripleo? | 16:41 |
| pabelanger | EmilienM: how have jobs been working this morning? Any thing I should be looking at? | 16:41 |
| openstackgerrit | Merged openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/492768 | 16:42 |
| *** achadha has joined #tripleo | 16:44 | |
| *** ramishra has joined #tripleo | 16:44 | |
| *** jpich has quit IRC | 16:45 | |
| *** milan has quit IRC | 16:45 | |
| EmilienM | pabelanger: i've been busy in meetings this morning but I'll start looking shortly. | 16:46 |
| *** achadha has quit IRC | 16:46 | |
| *** achadha has joined #tripleo | 16:46 | |
| *** cylopez has left #tripleo | 16:47 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common master: Don't mock mkdtemp in test_plan.py either https://review.openstack.org/500129 | 16:47 |
| pabelanger | http://logs.openstack.org/64/496564/3/gate/gate-tripleo-ci-centos-7-undercloud-oooq/12c7b25/console.html | 16:48 |
| pabelanger | EmilienM: mwhahaha: dmsimard: ^github failure in gate for dlrn | 16:48 |
| pabelanger | failed getting distgit for tripleo-heat-templates | 16:48 |
| beagles | tongl, selinux policies are usually part of a package, e.g.openstack-selinux | 16:49 |
| *** achadha has quit IRC | 16:49 | |
| *** achadha has joined #tripleo | 16:50 | |
| *** dprince has quit IRC | 16:50 | |
| *** catintheroof has quit IRC | 16:50 | |
| mwhahaha | pabelanger: we need something like https://github.com/sitaramc/gitpod | 16:51 |
| tongl | beagles: Got it, thanks! | 16:51 |
| mwhahaha | pabelanger: or https://github.com/rohanpm/ngitcached | 16:52 |
| pabelanger | mwhahaha: sure, we actually already have a git farm, git.o.o is our front end to git01-git08.o.o. We actually have a process for importing upstream repos into that too. But, need to discuss with openstack-infra, if we can do that with rdo things | 16:52 |
| dmsimard | pabelanger: I'll go ahead and add a topic for that in the infra ptg pad | 16:53 |
| *** dsariel has quit IRC | 16:53 | |
| mwhahaha | pabelanger: well I was thinking less sync and more caching | 16:53 |
| mwhahaha | since it could be more of a dynamic thing | 16:53 |
| pabelanger | mwhahaha: zuulv3 makes this more interesting, because once we move forward with github integration, we'd be able to cross project depends-on with RDOproject.org | 16:53 |
| pabelanger | But ya, I'm guess in openstack-infra we might need to thing about a cache with github | 16:54 |
| pabelanger | but, that is still a bit aways | 16:54 |
| mwhahaha | yea | 16:54 |
| dmsimard | pabelanger: added a topic in the infra ptg pad so we don't forget. | 16:55 |
| mwhahaha | seems like something that could be quite useful to others | 16:55 |
| *** mcornea has quit IRC | 16:55 | |
| *** gcerami has quit IRC | 16:55 | |
| *** gfidente has quit IRC | 16:55 | |
| *** Goneri has quit IRC | 16:55 | |
| *** achadha_ has joined #tripleo | 16:55 | |
| *** marios_ has quit IRC | 16:56 | |
| *** achadha_ has quit IRC | 16:57 | |
| *** achadha_ has joined #tripleo | 16:57 | |
| *** achadha has quit IRC | 16:58 | |
| *** pchavva has quit IRC | 17:04 | |
| *** Goneri has joined #tripleo | 17:05 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 17:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,New] - Assigned to Adriano Petrich (apetrich) | 17:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 17:10 |
| *** suuuper has quit IRC | 17:12 | |
| *** Goneri has quit IRC | 17:17 | |
| *** tosky has quit IRC | 17:17 | |
| *** ramishra has quit IRC | 17:18 | |
| *** ykarel has quit IRC | 17:25 | |
| *** akrivoka has quit IRC | 17:27 | |
| *** trown is now known as trown|lunch | 17:27 | |
| *** yprokule has quit IRC | 17:29 | |
| *** gbarros has quit IRC | 17:30 | |
| *** achadha_ has quit IRC | 17:30 | |
| *** achadha has joined #tripleo | 17:31 | |
| *** gbarros has joined #tripleo | 17:31 | |
| *** achadha has quit IRC | 17:36 | |
| EmilienM | can I troll? it's friday | 17:40 |
| beagles | go head | 17:41 |
| EmilienM | thanks | 17:41 |
| beagles | or ahead rather | 17:41 |
| EmilienM | odl_dpdk: <% let(role => $.role_name) -> $.heat_resource_tree.parameters.get(concat($role, 'Parameters'), {}).get('default', {}).get('OvsEnableDpdk', false) %> | 17:41 |
| EmilienM | in tripleo-common | 17:41 |
| EmilienM | is my brain suppose to understand that? | 17:41 |
| *** achadha has joined #tripleo | 17:42 | |
| *** achadha has quit IRC | 17:42 | |
| EmilienM | didn't we say in the past we would make tripleo more simple? | 17:42 |
| *** achadha has joined #tripleo | 17:42 | |
| beagles | heh, write-only code a la perl days | 17:44 |
| beagles | actually I withdraw that "heh" - not really funny | 17:45 |
| *** ebarrera_ has joined #tripleo | 17:47 | |
| *** pkovar has quit IRC | 17:47 | |
| EmilienM | :D | 17:51 |
| *** jprovazn has quit IRC | 17:55 | |
| *** bnemec is now known as beekneemech | 17:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: manila: set "neutron_admin_auth_url" correctly https://review.openstack.org/500145 | 17:59 |
| EmilienM | tbarron: backporting for you ^ | 17:59 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Remove ipv6 specific network templates https://review.openstack.org/500146 | 17:59 |
| EmilienM | dsneddon: backporting for you ^ | 17:59 |
| EmilienM | mwhahaha: we won't backport https://review.openstack.org/#/c/454754/ and I want us to -2 anyone who try to add new services or containers in tripleo stable/pike from now | 18:00 |
| EmilienM | we need more stability | 18:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Manually set healthchecks for _cron services https://review.openstack.org/500147 | 18:00 |
| EmilienM | dprince: ^ backporting for you | 18:00 |
| EmilienM | shardy: should we backport https://review.openstack.org/#/c/490474/ to stable/pike? | 18:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Make curl healthchecks work with internal TLS https://review.openstack.org/500149 | 18:01 |
| EmilienM | mandre: ^ backporting for you | 18:01 |
| beagles | crap sriov agent is still hanging out there - though I understand the ruling | 18:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: TLS proxy for redis https://review.openstack.org/499997 | 18:01 |
| *** tosky has joined #tripleo | 18:01 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Use TLS proxy for Redis' internal TLS https://review.openstack.org/499995 | 18:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Unset default value for the DockerCephDaemonImage https://review.openstack.org/500150 | 18:02 |
| EmilienM | vkmc: do you need https://review.openstack.org/#/c/495370/ in stable/pike? | 18:02 |
| abishop | d0ugal: would you mind taking a look at https://review.openstack.org/498561 (it's a quick one) | 18:03 |
| vkmc | EmilienM, yes | 18:03 |
| vkmc | EmilienM, should I backport it? | 18:04 |
| EmilienM | vkmc: cherry-pick it with gerrit UI and I'll look | 18:04 |
| vkmc | k | 18:04 |
| EmilienM | vkmc: they won't break anything so it's good to me. I'lla pprove | 18:04 |
| vkmc | EmilienM, sweet, thx | 18:05 |
| EmilienM | vkmc: it's done already : https://review.openstack.org/#/c/499931/1 | 18:05 |
| vkmc | o.o | 18:05 |
| EmilienM | vkmc: sorry for noise :D | 18:05 |
| vkmc | EmilienM, no probs, thanks :) | 18:06 |
| EmilienM | vkmc: I'll ping you next time I need nothing :D | 18:06 |
| *** ebarrera_ has quit IRC | 18:06 | |
| vkmc | EmilienM, sounds good, I'm here to endorse what you do | 18:06 |
| vkmc | :D | 18:06 |
| EmilienM | lol | 18:06 |
| *** rhallisey has quit IRC | 18:07 | |
| tongl | EmilienM: when you have a chance, could you please look at the following patches :) https://review.openstack.org/#/c/499395/, https://review.openstack.org/#/c/498143/, https://review.openstack.org/#/c/498142/ | 18:08 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 18:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 18:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 18:10 |
| EmilienM | tongl: sure, i'll try though our first priority now is to ship pike | 18:11 |
| *** ebarrera has quit IRC | 18:11 | |
| tongl | EmilienM: thanks. they are related to bug fixes and once they get merged, I also would like to back port to pike as well. | 18:11 |
| EmilienM | tongl: it's too late to backport features in Pike | 18:12 |
| EmilienM | tongl: you should have asked for a FFE (feature freeze exception) | 18:12 |
| EmilienM | tongl: we designed Pike back in April, how come we don't have a blueprint since then to track this work? | 18:13 |
| tongl | There is no blueprint as far as I know. If needed, I can create one. | 18:14 |
| *** achadha has quit IRC | 18:14 | |
| *** achadha has joined #tripleo | 18:14 | |
| tongl | The driver has been added in pike cycle and now we try to fix some bugs. | 18:15 |
| EmilienM | tongl: it would be great, but we can't backport features in stable branches | 18:15 |
| EmilienM | tongl: it could be discussed on the mailing list though | 18:15 |
| EmilienM | and evaluate the impact of doing such a backport | 18:15 |
| EmilienM | if nothing would break backward compatibility why not then | 18:15 |
| *** aditya_r has joined #tripleo | 18:15 | |
| *** maeca has joined #tripleo | 18:16 | |
| EmilienM | but still, it doesn't match stable-policy requirements | 18:16 |
| *** maeca has quit IRC | 18:16 | |
| tongl | EmilienM: the feature is in during pike cycle. we have some critical bug fixes. | 18:16 |
| beagles | looking at these patches these are all around a bug aren't they? | 18:16 |
| tongl | beagles: yes | 18:16 |
| EmilienM | maybe... | 18:16 |
| EmilienM | tongl: best way to know is, you to send an email to openstack-dev [tripleo], explain what you're doing, give URLs of your patches / blueprints and we'll see | 18:17 |
| tongl | beagles: it is critical and without these the tripleo setup will fail when nsx driver is enabled. | 18:17 |
| tongl | Sure, will do | 18:17 |
| tongl | EmilienM: Thanks! | 18:17 |
| beagles | EmilienM, with regards to the sriov container - that's a complete no-go? | 18:17 |
| beagles | EmilienM, https://review.openstack.org/#/c/469066/ and https://review.openstack.org/#/c/487390/ | 18:18 |
| * beagles hates to ask | 18:18 | |
| beagles | one is blocked on merging due to the depends on to the other | 18:19 |
| EmilienM | beagles: I thought downstream wouldn't containerize neutron | 18:21 |
| EmilienM | beagles: do we really need it in pike? | 18:21 |
| beagles | EmilienM, they want it for "tech preview" ... | 18:21 |
| beagles | le sigh | 18:21 |
| beagles | otherwise I'd not ask | 18:22 |
| EmilienM | mwarf | 18:22 |
| beagles | meaning I'd not push it myself if not .. I suspect we are going to find all sorts of stuff that is not going to play nice with containers and PCI passthrough | 18:23 |
| beagles | not that this would actually mess with anything unless somebody enables it | 18:23 |
| *** thrash|biab is now known as thrash | 18:25 | |
| * beagles gulps at the *famous last words* he just dared utter | 18:25 | |
| dmsimard | EmilienM, mwhahaha: what was probably the device busy fix merged, please let me know if you see any in new jobs | 18:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Use list_concat in place of yaql https://review.openstack.org/499157 | 18:27 |
| EmilienM | dmsimard: k | 18:27 |
| EmilienM | beekneemech: wdyt about backporting https://review.openstack.org/#/c/499157/ ? | 18:28 |
| EmilienM | so much change | 18:28 |
| *** trown|lunch is now known as trown | 18:29 | |
| trown | EmilienM: really not sure what to do about https://bugs.launchpad.net/tripleo/+bug/1714270 | 18:30 |
| openstack | Launchpad bug 1714270 in tripleo "containerised tacker implementation is incomplete" [High,Triaged] | 18:30 |
| *** itlinux has quit IRC | 18:30 | |
| *** achadha_ has joined #tripleo | 18:30 | |
| *** achadha_ has quit IRC | 18:30 | |
| trown | EmilienM: sbaker put it to queens... but pike scenario001 is broken without fixing that | 18:30 |
| *** achadha has quit IRC | 18:30 | |
| trown | on containers | 18:30 |
| EmilienM | trown: mhh | 18:31 |
| EmilienM | trown: we can disable tacker in scenario001-container | 18:31 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE enable docker debugging https://review.openstack.org/500112 | 18:31 |
| EmilienM | like we did with bgp-vpn and l2gw | 18:31 |
| trown | EmilienM: it only works in upstream jobs because we have an old container in the registry... if you build pike containers using kolla today they wont work | 18:31 |
| *** achadha has joined #tripleo | 18:31 | |
| EmilienM | yeah | 18:31 |
| EmilienM | let's disable it | 18:31 |
| trown | k | 18:31 |
| EmilienM | can you submit a patch please? | 18:31 |
| *** achadha has quit IRC | 18:31 | |
| trown | sure | 18:31 |
| EmilienM | thanks a lot | 18:31 |
| *** achadha has joined #tripleo | 18:32 | |
| *** yamahata has quit IRC | 18:32 | |
| *** achadha has quit IRC | 18:33 | |
| *** aditya_ra has joined #tripleo | 18:34 | |
| *** achadha has joined #tripleo | 18:34 | |
| beekneemech | beagles: In the manila patch that downstream also wanted for tech preview, I asked them to put an EXPERIMENTAL comment in the environment file for enabling so we at least have plausible deniability if someone uses it and it blows up. | 18:34 |
| *** aditya_r has quit IRC | 18:34 | |
| beagles | beekneemech, good plan | 18:35 |
| beekneemech | beagles: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/manila-cephfsnative-config-docker.yaml | 18:35 |
| beagles | beekneemech, thanks.. will replicate | 18:35 |
| beekneemech | EmilienM: Doesn't sound like something that really calls for a backport, but on the other hand it may make future backports merge conflict nightmares if we don't. :-/ | 18:36 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Fix enabling zaqar keystone endpoint and MySQL database https://review.openstack.org/499895 | 18:36 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE enable docker debugging https://review.openstack.org/500112 | 18:37 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Neutron SR-IOV agent container https://review.openstack.org/469066 | 18:38 |
| *** aditya_ra has quit IRC | 18:40 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Remove tacker from containers scenario001 https://review.openstack.org/500165 | 18:40 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/pike: Remove tacker from containers scenario001 https://review.openstack.org/500166 | 18:41 |
| trown | EmilienM: patch and cherry-pick ^ | 18:41 |
| *** aditya_ra has joined #tripleo | 18:41 | |
| EmilienM | thx! | 18:45 |
| *** fzdarsky|afk has quit IRC | 18:49 | |
| *** aditya_ra has quit IRC | 18:50 | |
| *** Goneri has joined #tripleo | 18:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Add missing BarbicanApi service https://review.openstack.org/499892 | 18:57 |
| *** achadha_ has joined #tripleo | 18:57 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use list_concat in place of yaql https://review.openstack.org/500172 | 18:57 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: NetworkDeploymentActions shall be made role specific https://review.openstack.org/500173 | 18:58 |
| EmilienM | pabelanger: it would be fun to get number of patches merged / day over the last weeks | 18:59 |
| *** achadha has quit IRC | 19:00 | |
| *** leseb has quit IRC | 19:01 | |
| *** achadha_ has quit IRC | 19:01 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Allow composable scenarios without deployed server environment https://review.openstack.org/499094 | 19:02 |
| *** iranzo has joined #tripleo | 19:02 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement https://review.openstack.org/442716 | 19:03 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name https://review.openstack.org/442755 | 19:03 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector https://review.openstack.org/457822 | 19:03 |
| *** lblanchard has quit IRC | 19:04 | |
| *** lblanchard has joined #tripleo | 19:05 | |
| pabelanger | EmilienM: should be able to get that info per project | 19:07 |
| EmilienM | arxcruz: are you around? I'm having tempest failures | 19:09 |
| EmilienM | see http://logs.openstack.org/26/499626/1/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq/44bf3e9/logs/tempest.html.gz | 19:09 |
| *** gbarros has quit IRC | 19:09 | |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Add less verbosity for fernet keys ansible playbook https://review.openstack.org/500070 | 19:10 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 19:10 |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 19:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 19:10 |
| EmilienM | yeah gate-tripleo-ci-centos-7-scenario004-multinode-oooq is broken on stable/pike | 19:10 |
| EmilienM | tempest test fail, i'll look at it | 19:11 |
| *** gbarros has joined #tripleo | 19:14 | |
| *** EmilienM changes topic to "CI Status: Orange - see alerts | TripleO | https://docs.openstack.org/tripleo-docs/latest/ | http://tripleo.org" | 19:14 | |
| EmilienM | mandre: that's the last time we had an upgrae job working https://review.openstack.org/#/c/461000/ | 19:16 |
| EmilienM | 3 days ago | 19:16 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Don't mock mkdtemp https://review.openstack.org/500083 | 19:16 |
| *** achadha has joined #tripleo | 19:16 | |
| EmilienM | I'm pretty sure we broke something over the last 3 days on re: upgrades | 19:16 |
| *** leitan has quit IRC | 19:16 | |
| arxcruz | EmilienM: hei, let me check | 19:18 |
| *** gbarros has quit IRC | 19:18 | |
| *** leseb has joined #tripleo | 19:19 | |
| EmilienM | arxcruz: https://bugs.launchpad.net/tripleo/+bug/1714577 | 19:19 |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Undecided,Triaged] | 19:19 |
| EmilienM | I'm investigating a bit as well | 19:19 |
| EmilienM | http://status.openstack.org/openstack-health/#/g/build_name/gate-tripleo-ci-centos-7-scenario004-multinode-oooq | 19:20 |
| EmilienM | it's not that bad | 19:20 |
| EmilienM | for these who didn't like tempest, this is how it's useful now: | 19:21 |
| EmilienM | you go look which tests are failing in our gate: http://status.openstack.org/openstack-health/#/g/build_name/gate-tripleo-ci-centos-7-scenario004-multinode-oooq | 19:21 |
| EmilienM | gate-tripleo-ci-centos-7-scenario004-multinode-oooq has 2 failures on this test | 19:21 |
| EmilienM | you can also filter by tempest test http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_network_basic_ops.TestNetworkBasicOps | 19:22 |
| EmilienM | so you can see if the test is broken in tempest or just in tripleo | 19:22 |
| *** iranzo has quit IRC | 19:22 | |
| EmilienM | arxcruz: i'm trying to confirm in logstash that the error is random | 19:23 |
| arxcruz | EmilienM: something between openstack-tempest-16.1.1-0.20170824065155.c961a65.el7.centos.noarch and openstack-tempest-16.1.1-0.20170830101230.e70e0fe.el7.centos.noarch | 19:23 |
| EmilienM | we should pin tempest in stable/pike | 19:23 |
| EmilienM | but I think it was done in RDO yesterday | 19:24 |
| EmilienM | let me check | 19:24 |
| arxcruz | EmilienM: I think it was | 19:24 |
| EmilienM | no it wasn't | 19:24 |
| EmilienM | https://review.rdoproject.org/r/#/c/9176/ | 19:24 |
| arxcruz | oh, ok | 19:24 |
| EmilienM | I'm going to go ahead and approve | 19:24 |
| arxcruz | EmilienM: sorry, i didn't understood, it's merged already... | 19:25 |
| arxcruz | oh, but master ok | 19:25 |
| EmilienM | it will make stable/pike tripleo ci more stable | 19:25 |
| EmilienM | if we pin tempest | 19:25 |
| EmilienM | (which is exactly what we do in puppet CI as well) | 19:25 |
| arxcruz | EmilienM: ok | 19:26 |
| *** eck` is now known as eck`gone | 19:28 | |
| *** beagles has left #tripleo | 19:30 | |
| arxcruz | EmilienM: openstack-tempest-16.1.1-0.20170830101230.e70e0fe.el7.centos.noarch is the one who fails | 19:31 |
| arxcruz | EmilienM: I believe now would be easier to check these failures with more scenarios running tempest... | 19:31 |
| *** beagles has joined #tripleo | 19:31 | |
| EmilienM | arxcruz: can you check in tempest what could fail? | 19:32 |
| arxcruz | EmilienM: sure | 19:33 |
| EmilienM | thx | 19:36 |
| *** gbarros has joined #tripleo | 19:45 | |
| arxcruz | EmilienM: so https://github.com/openstack/tempest/blob/e70e0fe/tempest/scenario/manager.py#L82 doesn't have the verification if cinder service is enabled or not | 19:46 |
| EmilienM | arxcruz: hm I'm not sure about that, why did it work in our gate several times | 19:47 |
| arxcruz | EmilienM: as you can see here https://github.com/openstack/tempest/blob/master/tempest/scenario/manager.py#L83 | 19:47 |
| arxcruz | EmilienM: because https://github.com/openstack/tempest/blob/c961a65/tempest/scenario/manager.py#L83 | 19:48 |
| arxcruz | the openstack-tempest-16.1.1-0.20170824065155.c961a65.el7.centos.noarch has the check if cinder is enabled | 19:48 |
| arxcruz | openstack-tempest-16.1.1-0.20170830101230.e70e0fe.el7.centos.noarch doesn't | 19:48 |
| EmilienM | arxcruz: which patch broke it? | 19:48 |
| arxcruz | EmilienM: that's the thing, e70e0fe is from july 19 and don't have the patch and it's in 20170830101230 build which checking the date should be 'recently' than 20170824065155 who has the patch from 25 days ago | 19:50 |
| pabelanger | EmilienM: gate-tripleo-ci-centos-7-scenario004-multinode-oooq is at 97% SUCCESS / 2% FAILURE rate in gate over last 10 days. not too bad given all the issues this week. | 19:51 |
| arxcruz | pabelanger: we just started run tempest there... | 19:51 |
| pabelanger | gate-tripleo-ci-centos-7-scenario001-multinode-oooq is 100% over 36 runs in gate | 19:52 |
| *** abishop has quit IRC | 19:52 | |
| pabelanger | gate-tripleo-ci-centos-7-scenario001-multinode-oooq-containers 94% success over 36 | 19:52 |
| arxcruz | pabelanger: yeah, scenario001 is been running tempest for a while | 19:52 |
| arxcruz | cool it's 100% :D | 19:53 |
| pabelanger | Ya, a large improvement over the last month | 19:53 |
| arxcruz | EmilienM: this is the patch 28 days ago who check if cinder is available https://github.com/openstack/tempest/commit/a6b301595a1340abdbcfac57831aed70be192775 | 19:56 |
| arxcruz | in scenario004 cinder isn't available | 19:56 |
| arxcruz | so, why the latest tempest package don't have this patch, while the previous one has | 19:56 |
| *** rbowen has quit IRC | 19:56 | |
| EmilienM | good question | 19:57 |
| EmilienM | pabelanger: ++ | 19:57 |
| arxcruz | EmilienM: oh https://review.rdoproject.org/r/#/c/9070/ | 19:58 |
| arxcruz | so, it seems that | 19:58 |
| arxcruz | so, we fix one thing, and broken others | 19:58 |
| arxcruz | ¯\_(ツ)_/¯ | 19:58 |
| beagles | so glad I'm not the only one ;) | 20:00 |
| mandre | EmilienM: uh? which one is the "upgrade" job? because in the review you pasted gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv is red | 20:02 |
| *** paramite has quit IRC | 20:02 | |
| mandre | EmilienM: but according to http://tripleo.org/cistatus.html, the last time the job was green was in https://review.openstack.org/#/c/499199/ which is even more confusing | 20:03 |
| EmilienM | mandre: gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container-upgrades-nv | 20:04 |
| arxcruz | EmilienM: shall we fast-forward the commit in tempest to englobe both patches? | 20:04 |
| arxcruz | although this patch is tagged as 17.0.0... | 20:05 |
| * arxcruz starting to get very confuse | 20:05 | |
| EmilienM | same | 20:06 |
| arxcruz | well, we weren't running tempest on scenario004 before, so this would be catch | 20:06 |
| *** gfidente has joined #tripleo | 20:09 | |
| arxcruz | gotta go play overwatch, it's 10pm here :) | 20:09 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714577 | 20:10 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 20:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Critical,Triaged] | 20:10 |
| pabelanger | EmilienM: did we have a bug for Property DockerBarbicanApiImage not assigned issue? | 20:10 |
| pabelanger | I think I still see some failures in logstash, and going to create an elastic-recheck query | 20:10 |
| *** eck`gone is now known as eck` | 20:11 | |
| EmilienM | pabelanger: not sure | 20:14 |
| EmilienM | I don't see any | 20:14 |
| pabelanger | EmilienM: ya, I just created bug 1714586. Pretty sure it is fixed, but just want to classify failures in elastic-recheck to be safe | 20:14 |
| openstack | bug 1714586 in tripleo "Add missing BarbicanApi service" [Undecided,New] https://launchpad.net/bugs/1714586 | 20:14 |
| *** dougbtv_laptop has quit IRC | 20:15 | |
| EmilienM | pabelanger: really cool, it was on my long list as well | 20:15 |
| EmilienM | arxcruz: what version should we run then? | 20:15 |
| EmilienM | pabelanger: we don't have tempst results in logstash http://logs.openstack.org/26/499626/1/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq/44bf3e9/logs/undercloud/var/log/extra/logstash.txt.gz | 20:17 |
| *** dparkes has joined #tripleo | 20:20 | |
| pabelanger | EmilienM: when is pike release for tripleo? | 20:20 |
| *** dhill_ is now known as dhill|brb | 20:23 | |
| EmilienM | pabelanger: I hope next week | 20:25 |
| pabelanger | EmilienM: tuesday or friday? | 20:26 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add CephExternal role for ceph-ansible https://review.openstack.org/499627 | 20:29 |
| EmilienM | pabelanger: tbh, I don't know | 20:31 |
| EmilienM | pabelanger: we have 4 alerts now | 20:31 |
| EmilienM | a 5th soon | 20:31 |
| *** rcernin has joined #tripleo | 20:31 | |
| EmilienM | we'll release when down to 0 | 20:31 |
| pabelanger | EmilienM: okay, thanks. having swap issues on centos still so trying to see if a revert would be needed or we keep iterating forward | 20:33 |
| *** Goneri has quit IRC | 20:34 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Save tempest output in logstash https://review.openstack.org/500187 | 20:37 |
| EmilienM | pabelanger: see that ^ | 20:37 |
| EmilienM | so we can do queries now | 20:37 |
| EmilienM | with tempest failures | 20:37 |
| EmilienM | pabelanger: I'm investigating a 5th issue in gate | 20:38 |
| EmilienM | http://logs.openstack.org/26/499626/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/39c064a/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-09-01_12_03_06 | 20:38 |
| EmilienM | we have no query for this one | 20:38 |
| EmilienM | http://mirror.regionone.infracloud-vanilla.openstack.org:8080/buildlogs.centos/centos/7/cloud/x86_64/openstack-pike/common/python2-markupsafe-0.23-16.el7.x86_64.rpm: [Errno 14] HTTP Error 502 - Bad Gateway | 20:39 |
| EmilienM | http://logs.openstack.org/26/499626/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/39c064a/logs/undercloud/var/log/bootstrap-subnodes.log.txt.gz | 20:39 |
| EmilienM | we need a query for this one | 20:39 |
| EmilienM | and we don't have /var/log/bootstrap-subnodes.log.txt.gz in logstash file | 20:39 |
| EmilienM | adarazs, sshnaidm|off: you around? | 20:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Save bootstrap server logs in logstash https://review.openstack.org/500189 | 20:41 |
| EmilienM | pabelanger: also when we have backported what we needed | 20:44 |
| EmilienM | pabelanger: it seems like next week is doable if we get more help on CI | 20:44 |
| pabelanger | EmilienM: let me check buildlogs error in apache logs, we already have an elastic-recheck query for that. But tl;dr is round robin DNS issue, and we've pinned to a specific buildlogs server, in this case, it was likely a networking issue in infracloud that cause the query to fail. | 20:50 |
| pabelanger | EmilienM: but, that is the first time in a few days it has happened | 20:50 |
| pabelanger | EmilienM: http://status.openstack.org/elastic-recheck/#1708704 for some history | 20:51 |
| EmilienM | ok | 20:51 |
| EmilienM | not critical then | 20:51 |
| EmilienM | the tempest thing worries me | 20:51 |
| pabelanger | EmilienM: I also think, at PTG, we can talk about using a mirrorlist, and have the yum client make multiple requests | 20:51 |
| EmilienM | i'll revert the patch in quickstart if it continues, fyi | 20:51 |
| EmilienM | pabelanger: with a beer? | 20:52 |
| pabelanger | EmilienM: haven't been following which tempest issue | 20:52 |
| pabelanger | EmilienM: message:"[Errno 256] No more mirrors to try" AND tags:"console" AND node_provider:infracloud-vanilla | 20:52 |
| pabelanger | you can see the failure last week compared to this week | 20:52 |
| EmilienM | k | 20:53 |
| *** jcoufal has quit IRC | 20:53 | |
| *** rcernin has quit IRC | 20:55 | |
| *** jmelvin has quit IRC | 20:56 | |
| *** ansmith has joined #tripleo | 20:57 | |
| *** vpickard has quit IRC | 20:58 | |
| *** catinthe_ has joined #tripleo | 20:58 | |
| *** lblanchard has quit IRC | 20:59 | |
| *** vpickard has joined #tripleo | 21:01 | |
| *** lblanchard has joined #tripleo | 21:07 | |
| *** lblanchard has joined #tripleo | 21:08 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 21:10 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714577 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714586 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 21:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 21:10 |
| *** ansmith has quit IRC | 21:10 | |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 21:10 |
| openstack | Launchpad bug 1714586 in tripleo "Add missing BarbicanApi service" [Critical,Triaged] | 21:10 |
| *** yamahata has joined #tripleo | 21:12 | |
| stevebaker | EmilienM: morning | 21:24 |
| EmilienM | stevebaker: hey | 21:24 |
| EmilienM | thanks for being online on a Saturday | 21:24 |
| stevebaker | totally fine | 21:24 |
| EmilienM | we were investigating https://bugs.launchpad.net/tripleo/+bug/1714412 with mandre | 21:24 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 21:24 |
| EmilienM | we have new logs now with more docker debug: http://logs.openstack.org/12/500112/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/7735d7e/logs/subnode-2/var/log/messages.txt.gz | 21:25 |
| EmilienM | for example http://logs.openstack.org/12/500112/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/7735d7e/logs/subnode-2/var/log/messages.txt.gz#_Sep__1_20_49_24 | 21:26 |
| EmilienM | stevebaker: that's where we are now, upgrade jobs fail on that | 21:26 |
| *** dparkes has quit IRC | 21:31 | |
| *** jtomasek has quit IRC | 21:32 | |
| stevebaker | EmilienM: huh, that is a sad docker | 21:32 |
| EmilienM | arxcruz: https://github.com/openstack/tempest/compare/e70e0fe...c961a65 that's the diff between stable/pike where it fails and master where it works | 21:33 |
| EmilienM | stevebaker: something broke during the last 3 days because I have a working upgrade job 3 days ago | 21:34 |
| EmilienM | stevebaker: see http://logs.openstack.org/00/461000/50/check/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container-upgrades-nv/1833356/console.html#_2017-08-28_19_53_51_935162 | 21:34 |
| stevebaker | EmilienM: it could be something as simple as the containers not existing in http://192.168.24.1:8787 | 21:35 |
| tongl | EmilienM: As you suggested, I created a blueprint and sent an email to openstack-dev [tripleo]. https://blueprints.launchpad.net/tripleo/+spec/neutron-nsx-driver | 21:38 |
| *** jmelvin has joined #tripleo | 21:44 | |
| stevebaker | EmilienM: overcloud-prep-containers.sh is not run, that task is being skipped | 21:45 |
| EmilienM | tongl: ok cool | 21:45 |
| EmilienM | stevebaker: wow | 21:45 |
| EmilienM | what did we change in quickstart / -extras recently? | 21:45 |
| stevebaker | EmilienM: maybe the oooq vars is missing containerized_overcloud:true | 21:46 |
| EmilienM | maybe https://github.com/openstack/tripleo-quickstart-extras/commit/bf0f2d3424aa9cdaf0050a2703a6c907b8443d42 | 21:47 |
| EmilienM | brb eat | 21:47 |
| *** lblanchard has joined #tripleo | 21:48 | |
| *** lblanchard has joined #tripleo | 21:49 | |
| EmilienM | stevebaker: do you mean the bash snipper or the whole ansible task is ignored? | 21:50 |
| EmilienM | snippet | 21:50 |
| *** lblanchard has joined #tripleo | 21:50 | |
| stevebaker | EmilienM: overcloud-prep-containers.sh is uploaded but not run, because the conditional containerized_overcloud==true is false | 21:51 |
| *** lblanchard has joined #tripleo | 21:51 | |
| stevebaker | EmilienM: I'm looking at the -e @ here and wondering which file should be setting that http://logs.openstack.org/12/500112/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/7735d7e/console.html#_2017-09-01_18_59_06_199231 | 21:52 |
| arxcruz | EmilienM: as I EmilienM and this is the missing piece https://github.com/openstack/tempest/commit/a6b301595a1340abdbcfac57831aed70be192775 | 21:52 |
| EmilienM | arxcruz: ok so 17.0.0 should be good | 21:53 |
| *** lblanchard has joined #tripleo | 21:53 | |
| stevebaker | EmilienM: ah, we have a containerized_overcloud and a containerized_overcloud_upgrade variable, should probably be checking for both | 21:53 |
| EmilienM | stevebaker: yes we do have it | 21:54 |
| stevebaker | EmilienM: config/general_config/featureset011.yml has | 21:54 |
| EmilienM | for the time being ocata/pike | 21:54 |
| stevebaker | # we're upgrading from non-containers to containers, so first we | 21:54 |
| stevebaker | # deploy non-containerized overcloud | 21:54 |
| stevebaker | containerized_overcloud: false | 21:54 |
| stevebaker | containerized_overcloud_upgrade: true | 21:54 |
| *** lblanchard has joined #tripleo | 21:56 | |
| stevebaker | EmilienM: oh, hang on | 21:56 |
| EmilienM | I don't move | 21:56 |
| EmilienM | I actually have to go | 21:56 |
| *** mburned has quit IRC | 21:57 | |
| tongl | EmilienM: Enjoy your long weekend :) | 21:57 |
| EmilienM | stevebaker: I have to leave computer, I'm back later in the evening and will be online this weekend. If you have an idea, please send a fix, I'll review it for sure. Otherwise I'll investigate as well. Thanks for your help. | 21:57 |
| EmilienM | tongl: you too | 21:58 |
| stevebaker | EmilienM: will do, now I'm looking at containerized_overcloud_upgrade_pull_images | 21:58 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
| mwhahaha | ugh looks like python jobs are broke | 22:02 |
| mwhahaha | http://logs.openstack.org/64/496564/3/check/gate-instack-undercloud-python27-ubuntu-xenial/77b1d19/console.html#_2017-09-01_19_41_05_552040 | 22:02 |
| mwhahaha | tox is puking now | 22:03 |
| mwhahaha | pabelanger: might be something more global than just us if you're still around today | 22:03 |
| EmilienM | we need a logstash query | 22:03 |
| pabelanger | mwhahaha: EmilienM: Ya, I think we are in the process of rolling new images. tox 2.8 broke openstack today | 22:04 |
| pabelanger | checking | 22:04 |
| mwhahaha | oh joy | 22:04 |
| EmilienM | we needed that | 22:04 |
| EmilienM | great | 22:04 |
| EmilienM | I'm out! | 22:04 |
| stevebaker | biab | 22:08 |
| pabelanger | EmilienM: mwhahaha: okay, looks like we'd deleted the bad images, and reverted to yesterdays. That will trigger new image builds with tox 2.7 pin | 22:09 |
| *** tesseract has quit IRC | 22:09 | |
| mwhahaha | k | 22:09 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714577 | 22:10 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714586 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 22:10 |
| *** rlandy has quit IRC | 22:10 | |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 22:10 |
| openstack | Launchpad bug 1714586 in tripleo "Add missing BarbicanApi service" [Critical,Triaged] | 22:10 |
| pabelanger | EmilienM: mwhahaha: can you post a log of tox failure? | 22:12 |
| pabelanger | this might be something different | 22:12 |
| mwhahaha | -^ | 22:12 |
| mwhahaha | http://logs.openstack.org/64/496564/3/check/gate-instack-undercloud-python27-ubuntu-xenial/77b1d19/console.html#_2017-09-01_19_41_05_552040 | 22:12 |
| mwhahaha | it's a valueerror | 22:12 |
| pabelanger | k, | 22:13 |
| pabelanger | I think that is the same issue | 22:13 |
| pabelanger | if you recheck, I think it is fixed | 22:13 |
| mwhahaha | k | 22:13 |
| *** gfidente has quit IRC | 22:18 | |
| pabelanger | EmilienM: mwhahaha: okay, I see the tempest failures now: https://review.openstack.org/499892/ is hitting them in check | 22:21 |
| mwhahaha | that's the AttributeError: 'Manager' object has no attribute 'volumes_v2_client' | 22:22 |
| mwhahaha | don't we have a bug for that | 22:22 |
| pabelanger | going to see if I can get an elastic-recheck query going | 22:23 |
| mwhahaha | pabelanger: https://bugs.launchpad.net/tripleo/+bug/1714577 | 22:23 |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 22:23 |
| pabelanger | mwhahaha: thanks | 22:23 |
| pabelanger | Ha | 22:26 |
| pabelanger | we need to uncompress logs/testrepository.subunit | 22:26 |
| pabelanger | so we can get logstash to index it | 22:26 |
| pabelanger | pretty sure we don't compress it for tox jobs | 22:26 |
| pabelanger | will look quickly | 22:26 |
| pabelanger | Hmm, we do compress it | 22:27 |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n302 | 22:29 |
| pabelanger | logs/tempest.txt | 22:29 |
| pabelanger | that will get indexed | 22:29 |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder master: Remove nested quotes from TAROPTS https://review.openstack.org/500212 | 22:30 |
| *** jmelvin has quit IRC | 22:44 | |
| *** achadha_ has joined #tripleo | 22:54 | |
| *** catinthe_ has quit IRC | 22:54 | |
| *** achadha has quit IRC | 22:57 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Add storage backends env files for containerized deployment https://review.openstack.org/499931 | 22:58 |
| *** achadha_ has quit IRC | 22:58 | |
| *** tosky has quit IRC | 22:59 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix hardcoded references to deprecated *ExtraConfig parameters https://review.openstack.org/496604 | 23:00 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: run tempest on fs018 (scenario003-container) https://review.openstack.org/499889 | 23:00 |
| *** catintheroof has joined #tripleo | 23:03 | |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Fix port health check false negatives https://review.openstack.org/499880 | 23:05 |
| *** tongl has quit IRC | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713832 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714361 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714412 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714577 | 23:10 |
| openstack | Launchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] - Assigned to Marios Andreou (marios-b) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1714586 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1714361 in tripleo "undercloud reinstall is unstable" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 23:10 |
| openstack | Launchpad bug 1714412 in tripleo "Upgrade from Ocata to Pike fails to pull containers during ControllerDeployment_Step1" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1714577 in tripleo "scenario004 failing: 'Manager' object has no attribute 'volumes_v2_client'" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 23:10 |
| openstack | Launchpad bug 1714586 in tripleo "Add missing BarbicanApi service" [Critical,Triaged] | 23:10 |
| openstackgerrit | Merged openstack/tripleo-common master: Add SRIOV container image parameter generation https://review.openstack.org/487390 | 23:18 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Mock out the creation of the tempest config https://review.openstack.org/495328 | 23:19 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Filter out disabled services from prepare command https://review.openstack.org/499704 | 23:19 |
| *** rwsu has quit IRC | 23:20 | |
| *** gbarros has quit IRC | 23:26 | |
| EmilienM | pabelanger:I'm on my phone but I have patches on oooq to index tempest | 23:31 |
| EmilienM | Ptal | 23:31 |
| EmilienM | But you can uncompress if you prefer | 23:32 |
| EmilienM | Just FYI we already have the files | 23:32 |
| EmilienM | pabelanger : https://review.openstack.org/500187 | 23:34 |
| *** jlabarre has quit IRC | 23:38 | |
| *** achadha has joined #tripleo | 23:40 | |
| *** jlabarre has joined #tripleo | 23:41 | |
| pabelanger | EmilienM: sure, that will help, but I don't think logstash will index it by default. Lets land and see | 23:45 |
| *** achadha_ has joined #tripleo | 23:48 | |
| *** achadha__ has joined #tripleo | 23:51 | |
| *** achadha has quit IRC | 23:51 | |
| *** catintheroof has quit IRC | 23:51 | |
| *** achadha_ has quit IRC | 23:52 | |
| *** achadha has joined #tripleo | 23:55 | |
| *** achadha__ has quit IRC | 23:55 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Remove ipv6 specific network templates https://review.openstack.org/500146 | 23:56 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/pike: Fix hardcoded references to deprecated *ExtraConfig parameters https://review.openstack.org/500223 | 23:57 |
| *** thrash is now known as thrash|g0ne | 23:57 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/pike: Filter out disabled services from prepare command https://review.openstack.org/500225 | 23:58 |
| *** achadha_ has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!