| *** mengxd has quit IRC | 00:10 | |
| *** eharney has joined #rdo | 00:20 | |
| *** crazyraven has joined #rdo | 00:23 | |
| *** limao has joined #rdo | 00:24 | |
| *** jerrygb has joined #rdo | 00:36 | |
| *** saneax is now known as saneax_AFK | 00:37 | |
| *** mbound has joined #rdo | 00:38 | |
| *** jerrygb has quit IRC | 00:41 | |
| *** shivrao has quit IRC | 00:41 | |
| *** mbound has quit IRC | 00:43 | |
| *** Liuqing has joined #rdo | 00:45 | |
| *** Amita has quit IRC | 00:48 | |
| *** beagles_l8r is now known as beagles | 00:49 | |
| *** gildub has joined #rdo | 00:51 | |
| *** rhallisey has quit IRC | 00:54 | |
| *** Amita has joined #rdo | 01:01 | |
| *** wfoster has quit IRC | 01:03 | |
| *** Guest49585 has quit IRC | 01:03 | |
| *** Son_Goku has joined #rdo | 01:07 | |
| *** bfournie has joined #rdo | 01:09 | |
| *** wfoster has joined #rdo | 01:10 | |
| *** rook_ has joined #rdo | 01:10 | |
| *** flepied has joined #rdo | 01:13 | |
| *** Son_Goku has quit IRC | 01:15 | |
| *** shivrao has joined #rdo | 01:37 | |
| *** jerrygb has joined #rdo | 01:37 | |
| *** jerrygb has quit IRC | 01:42 | |
| *** mlammon has quit IRC | 01:46 | |
| *** mlammon has joined #rdo | 01:47 | |
| *** pilasguru has joined #rdo | 01:49 | |
| *** Son_Goku has joined #rdo | 01:50 | |
| *** pilasguru has quit IRC | 01:54 | |
| *** pilasguru has joined #rdo | 01:58 | |
| *** egafford has quit IRC | 02:03 | |
| *** priteau has joined #rdo | 02:13 | |
| *** priteau has quit IRC | 02:18 | |
| *** jerrygb has joined #rdo | 02:21 | |
| *** shivrao has quit IRC | 02:22 | |
| *** jhershbe__ has joined #rdo | 02:32 | |
| *** ashw has joined #rdo | 02:32 | |
| *** crossbuilder has joined #rdo | 02:34 | |
| *** crossbuilder_ has quit IRC | 02:35 | |
| *** weshay has quit IRC | 02:40 | |
| *** paragan has joined #rdo | 02:56 | |
| *** saneax_AFK is now known as saneax | 02:59 | |
| *** livelace has joined #rdo | 03:07 | |
| *** livelace has quit IRC | 03:16 | |
| *** julim has quit IRC | 03:31 | |
| *** Alex_Stef has joined #rdo | 03:41 | |
| *** vimal has joined #rdo | 03:43 | |
| *** julim has joined #rdo | 03:44 | |
| *** Amita has quit IRC | 03:57 | |
| *** Amita has joined #rdo | 03:57 | |
| *** saneax is now known as saneax_AFK | 04:00 | |
| *** richm has quit IRC | 04:04 | |
| *** imcleod_ has quit IRC | 04:04 | |
| *** julim has quit IRC | 04:05 | |
| *** jhershbe__ has quit IRC | 04:13 | |
| *** rdas has joined #rdo | 04:15 | |
| *** yfried has joined #rdo | 04:20 | |
| *** vimal has quit IRC | 04:22 | |
| *** Liuqing has quit IRC | 04:36 | |
| *** Liuqing has joined #rdo | 04:36 | |
| *** vimal has joined #rdo | 04:41 | |
| *** zodbot_ has joined #rdo | 04:44 | |
| *** zodbot has quit IRC | 04:44 | |
| *** zodbot_ is now known as zodbot | 04:45 | |
| *** nehar has joined #rdo | 04:46 | |
| *** chandankumar has joined #rdo | 04:47 | |
| *** jhershbe__ has joined #rdo | 04:48 | |
| *** yfried has quit IRC | 04:50 | |
| *** yfried has joined #rdo | 04:53 | |
| *** ashw has quit IRC | 04:55 | |
| *** d0ugal has quit IRC | 04:56 | |
| *** d0ugal has joined #rdo | 04:57 | |
| *** pilasguru has quit IRC | 05:00 | |
| *** jaosorior has joined #rdo | 05:01 | |
| *** gkadam has joined #rdo | 05:07 | |
| *** hynekm has joined #rdo | 05:07 | |
| *** ekuris has joined #rdo | 05:07 | |
| *** shivrao has joined #rdo | 05:09 | |
| *** jerrygb has quit IRC | 05:09 | |
| *** shivrao_ has joined #rdo | 05:11 | |
| *** kaminohana has joined #rdo | 05:11 | |
| *** shivrao has quit IRC | 05:14 | |
| *** shivrao_ is now known as shivrao | 05:14 | |
| *** hynekm has quit IRC | 05:14 | |
| *** pgadiya has joined #rdo | 05:16 | |
| *** yfried has quit IRC | 05:17 | |
| *** jprovazn has joined #rdo | 05:22 | |
| *** yfried has joined #rdo | 05:31 | |
| *** afazekas|dentist is now known as afazekas | 05:32 | |
| *** Poornima has joined #rdo | 05:45 | |
| *** Amita has quit IRC | 05:49 | |
| *** gkadam has quit IRC | 05:50 | |
| *** oshvartz has joined #rdo | 05:51 | |
| *** mosulica has joined #rdo | 05:53 | |
| *** satya4ever has joined #rdo | 05:55 | |
| *** pilasguru has joined #rdo | 05:57 | |
| rdogerrit | zaitcev proposed openstack/swift-distgit: Consolidate the code in the main package python-swift http://review.rdoproject.org/r/1575 | 05:57 |
|---|---|---|
| *** lkuchlan has joined #rdo | 05:57 | |
| *** Amita has joined #rdo | 06:00 | |
| *** nehar has quit IRC | 06:03 | |
| *** nehar has joined #rdo | 06:04 | |
| *** Amita has quit IRC | 06:06 | |
| *** Amita has joined #rdo | 06:07 | |
| *** nehar has quit IRC | 06:09 | |
| *** pilasguru has quit IRC | 06:12 | |
| *** yfried has quit IRC | 06:14 | |
| *** dtantsur|afk is now known as dtantsur | 06:15 | |
| *** ccamacho has joined #rdo | 06:15 | |
| *** gkadam has joined #rdo | 06:18 | |
| *** gkadam is now known as Guest68366 | 06:18 | |
| *** saneax_AFK is now known as saneax | 06:18 | |
| *** florianf has joined #rdo | 06:18 | |
| *** anilvenkata has joined #rdo | 06:19 | |
| *** Amita has quit IRC | 06:20 | |
| *** Guest68366 is now known as gkadam | 06:20 | |
| *** edannon has joined #rdo | 06:21 | |
| *** gkadam has quit IRC | 06:24 | |
| *** lkuchlan has quit IRC | 06:25 | |
| *** ganesh has joined #rdo | 06:26 | |
| *** ganesh has quit IRC | 06:26 | |
| *** gildub has joined #rdo | 06:27 | |
| *** nehar has joined #rdo | 06:27 | |
| *** ganesh has joined #rdo | 06:28 | |
| *** ganesh is now known as Guest92654 | 06:28 | |
| *** Guest92654 is now known as gkadam | 06:28 | |
| *** mcornea has joined #rdo | 06:30 | |
| *** devvesa has joined #rdo | 06:30 | |
| *** smeyer has joined #rdo | 06:33 | |
| *** tesseract- has joined #rdo | 06:39 | |
| *** ccamacho is now known as ccamacho|afk | 06:44 | |
| *** hynekm has joined #rdo | 06:46 | |
| *** iranzo has joined #rdo | 06:53 | |
| *** iranzo has quit IRC | 06:53 | |
| *** iranzo has joined #rdo | 06:53 | |
| *** shivrao has quit IRC | 06:54 | |
| *** tshefi has joined #rdo | 06:55 | |
| *** Alex_Stef has quit IRC | 06:56 | |
| *** jubapa has joined #rdo | 06:57 | |
| *** ohamada has joined #rdo | 06:57 | |
| *** karimb has joined #rdo | 06:58 | |
| *** nyechiel has joined #rdo | 06:59 | |
| *** eliska has joined #rdo | 07:00 | |
| *** edannon has quit IRC | 07:01 | |
| *** gildub_ has joined #rdo | 07:01 | |
| flaper87 | number80: w000h000! Thanks a lot :) | 07:02 |
| *** iranzo has quit IRC | 07:02 | |
| *** kaminohana has quit IRC | 07:03 | |
| *** iranzo has joined #rdo | 07:03 | |
| *** iranzo has quit IRC | 07:03 | |
| *** iranzo has joined #rdo | 07:03 | |
| *** pcaruana has joined #rdo | 07:03 | |
| *** athomas has joined #rdo | 07:05 | |
| *** leanderthal|afk is now known as leanderthal | 07:05 | |
| *** nmagnezi has joined #rdo | 07:06 | |
| *** rcernin has joined #rdo | 07:07 | |
| *** rcernin has quit IRC | 07:10 | |
| *** rcernin has joined #rdo | 07:10 | |
| *** Alex_Stef has joined #rdo | 07:11 | |
| *** fzdarsky has joined #rdo | 07:12 | |
| *** egallen has joined #rdo | 07:12 | |
| *** karimb has quit IRC | 07:15 | |
| *** ifarkas_afk is now known as ifarkas | 07:17 | |
| *** dgurtner has joined #rdo | 07:18 | |
| *** dgurtner has joined #rdo | 07:18 | |
| *** jhershbe__ has quit IRC | 07:22 | |
| *** fzdarsky has quit IRC | 07:22 | |
| *** karimb has joined #rdo | 07:29 | |
| *** Alex_Stef has quit IRC | 07:29 | |
| *** KarlchenK has joined #rdo | 07:30 | |
| *** lkuchlan has joined #rdo | 07:30 | |
| *** zoli_gone-proxy is now known as zoliXXL | 07:33 | |
| *** fzdarsky has joined #rdo | 07:36 | |
| *** d0ugal has quit IRC | 07:37 | |
| *** Alex_Stef has joined #rdo | 07:40 | |
| *** Son_Goku has quit IRC | 07:42 | |
| *** p01nt3r75 has joined #rdo | 07:42 | |
| *** jpich has joined #rdo | 07:47 | |
| *** edannon has joined #rdo | 07:47 | |
| *** yfried has joined #rdo | 07:48 | |
| *** garrett has joined #rdo | 07:51 | |
| *** nehar has quit IRC | 07:56 | |
| *** fzdarsky has quit IRC | 07:57 | |
| *** shardy has joined #rdo | 07:59 | |
| *** Son_Goku has joined #rdo | 08:02 | |
| *** mvk has quit IRC | 08:02 | |
| *** dtantsur is now known as dtantsur|bbl | 08:05 | |
| *** ccamacho|afk is now known as ccamacho | 08:08 | |
| *** ohamada has quit IRC | 08:08 | |
| *** ushkalim has joined #rdo | 08:09 | |
| openstackgerrit | Marcus Furlong proposed openstack/packstack: add workers for trove::conductor https://review.openstack.org/341289 | 08:14 |
| openstackgerrit | Marcus Furlong proposed openstack/packstack: add number of workers for nova::conductor https://review.openstack.org/341284 | 08:15 |
| openstackgerrit | Marcus Furlong proposed openstack/packstack: add workers for trove::conductor https://review.openstack.org/341289 | 08:16 |
| openstackgerrit | Marcus Furlong proposed openstack/packstack: add workers for heat::api and heat::engine https://review.openstack.org/341286 | 08:17 |
| *** derekh has joined #rdo | 08:18 | |
| openstackgerrit | Marcus Furlong proposed openstack/packstack: add wsgi threads for gnocchi::api https://review.openstack.org/341287 | 08:20 |
| *** jlibosva has joined #rdo | 08:20 | |
| *** rdo has quit IRC | 08:21 | |
| hewbrocca | Morning folks | 08:21 |
| *** ohamada has joined #rdo | 08:22 | |
| hewbrocca | I see we still have no promote of master | 08:22 |
| *** zoliXXL is now known as zoli|wfh | 08:23 | |
| *** Son_Goku has quit IRC | 08:23 | |
| *** arnewiebalck_ has joined #rdo | 08:23 | |
| *** priteau has joined #rdo | 08:23 | |
| *** gildub_ has quit IRC | 08:24 | |
| *** rdo has joined #rdo | 08:24 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:24 | |
| *** gildub has quit IRC | 08:24 | |
| *** arnewiebalck has quit IRC | 08:25 | |
| *** arnewiebalck_ is now known as arnewiebalck | 08:25 | |
| *** gildub has joined #rdo | 08:25 | |
| *** priteau has quit IRC | 08:28 | |
| *** rdo has quit IRC | 08:28 | |
| *** rdo has joined #rdo | 08:30 | |
| *** gfidente|afk has joined #rdo | 08:34 | |
| *** rdo has quit IRC | 08:34 | |
| *** rdo has joined #rdo | 08:35 | |
| *** pilasguru has joined #rdo | 08:37 | |
| *** pilasguru has quit IRC | 08:42 | |
| *** jubapa has quit IRC | 08:46 | |
| *** Son_Goku has joined #rdo | 08:48 | |
| *** Son_Goku has quit IRC | 08:49 | |
| *** paramite has joined #rdo | 08:49 | |
| *** aufi has joined #rdo | 08:50 | |
| *** paragan has quit IRC | 08:50 | |
| *** fzdarsky has joined #rdo | 08:51 | |
| *** paragan has joined #rdo | 08:53 | |
| *** paragan has joined #rdo | 08:53 | |
| *** Son_Goku has joined #rdo | 08:54 | |
| *** edannon has quit IRC | 08:56 | |
| *** priteau has joined #rdo | 08:57 | |
| *** jhershbe__ has joined #rdo | 08:58 | |
| *** priteau has quit IRC | 08:58 | |
| *** jaosorior has quit IRC | 08:59 | |
| *** jaosorior has joined #rdo | 08:59 | |
| *** crazyraven has quit IRC | 09:00 | |
| *** paramite is now known as paramite|afk | 09:01 | |
| *** mvk has joined #rdo | 09:03 | |
| *** gfidente|afk is now known as gfidente | 09:03 | |
| *** nehar has joined #rdo | 09:07 | |
| *** edannon has joined #rdo | 09:09 | |
| *** d0ugal has joined #rdo | 09:10 | |
| *** zoli|wfh is now known as zoli|brb | 09:12 | |
| *** jerrygb has joined #rdo | 09:13 | |
| *** paramite|afk is now known as paramite | 09:16 | |
| *** jerrygb has quit IRC | 09:18 | |
| *** d0ugal has quit IRC | 09:22 | |
| *** zoli|brb is now known as zoli|wfh | 09:29 | |
| *** d0ugal has joined #rdo | 09:29 | |
| *** fzdarsky has quit IRC | 09:30 | |
| *** jubapa has joined #rdo | 09:30 | |
| *** jubapa has quit IRC | 09:31 | |
| *** karimb has quit IRC | 09:40 | |
| *** akrivoka has joined #rdo | 09:43 | |
| *** paragan has quit IRC | 09:43 | |
| *** fzdarsky has joined #rdo | 09:44 | |
| *** jubapa has joined #rdo | 09:45 | |
| *** _degorenko|afk is now known as degorenko | 09:47 | |
| *** apetrich has quit IRC | 09:49 | |
| *** karimb has joined #rdo | 09:53 | |
| *** d0ugal has quit IRC | 09:56 | |
| *** gszasz has joined #rdo | 09:58 | |
| *** Poornima has quit IRC | 10:01 | |
| *** d0ugal has joined #rdo | 10:02 | |
| *** d0ugal has quit IRC | 10:03 | |
| *** d0ugal has joined #rdo | 10:04 | |
| *** Liuqing has quit IRC | 10:08 | |
| *** Liuqing has joined #rdo | 10:09 | |
| *** Poornima has joined #rdo | 10:13 | |
| *** jerrygb has joined #rdo | 10:14 | |
| *** ihrachys has joined #rdo | 10:15 | |
| *** mlammon has quit IRC | 10:18 | |
| *** mlammon has joined #rdo | 10:18 | |
| *** jerrygb has quit IRC | 10:20 | |
| *** rgogunskiy has joined #rdo | 10:20 | |
| *** jubapa has quit IRC | 10:21 | |
| *** rgogunskiy has quit IRC | 10:23 | |
| *** limao has quit IRC | 10:24 | |
| *** apevec has joined #rdo | 10:24 | |
| *** apevec has quit IRC | 10:24 | |
| *** apevec has joined #rdo | 10:24 | |
| *** garrett has quit IRC | 10:25 | |
| *** mbound has joined #rdo | 10:26 | |
| jschlueter | imcsk8: checking the patch you posted yesterday for packstack | 10:27 |
| *** gildub has quit IRC | 10:28 | |
| *** apetrich has joined #rdo | 10:30 | |
| *** iberezovskiy|off is now known as iberezovskiy | 10:30 | |
| *** d0ugal has quit IRC | 10:31 | |
| *** dtantsur|bbl is now known as dtantsur | 10:32 | |
| *** jubapa has joined #rdo | 10:33 | |
| *** aortega has joined #rdo | 10:35 | |
| *** jpich has quit IRC | 10:36 | |
| *** ihrachys has quit IRC | 10:36 | |
| *** jlibosva has quit IRC | 10:36 | |
| *** ihrachys has joined #rdo | 10:37 | |
| *** tosky has joined #rdo | 10:37 | |
| *** jlibosva has joined #rdo | 10:38 | |
| *** aufi has quit IRC | 10:40 | |
| *** aufi has joined #rdo | 10:40 | |
| *** garrett has joined #rdo | 10:43 | |
| *** rodrigods has quit IRC | 10:43 | |
| *** rodrigods has joined #rdo | 10:44 | |
| *** jpich has joined #rdo | 10:45 | |
| *** rhallisey has joined #rdo | 10:50 | |
| *** chopmann has joined #rdo | 10:56 | |
| *** rdas has quit IRC | 10:57 | |
| *** xb_ has quit IRC | 10:58 | |
| *** paramite has quit IRC | 10:58 | |
| *** pkovar has joined #rdo | 11:00 | |
| *** Son_Goku has quit IRC | 11:01 | |
| *** milan has joined #rdo | 11:06 | |
| *** xb_ has joined #rdo | 11:07 | |
| *** dpeacock has joined #rdo | 11:13 | |
| *** jerrygb has joined #rdo | 11:16 | |
| *** Poornima has quit IRC | 11:17 | |
| hewbrocca | number80: shardy and dtantsur have found the ipxe problem we think | 11:18 |
| dtantsur | that's our tradition. every couple of months we curse the ipxe | 11:19 |
| hewbrocca | short answer, old ipxe rpm lurking somewhere | 11:19 |
| *** Liuqing has quit IRC | 11:19 | |
| *** abregman has joined #rdo | 11:19 | |
| hewbrocca | number80: probably if we update to the right one the promote will finally pass | 11:19 |
| *** jerrygb has quit IRC | 11:21 | |
| apevec | dtantsur, hewbrocca, can I have more details? | 11:21 |
| apevec | what is old | 11:21 |
| apevec | and what is new | 11:21 |
| *** abregman has quit IRC | 11:21 | |
| dtantsur | apevec, new is ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch | 11:22 |
| dtantsur | everything with year < 2016 is old | 11:22 |
| apevec | we have that in the repo http://cbs.centos.org/koji/buildinfo?buildID=10754 | 11:22 |
| apevec | where do you see old one popping up? | 11:22 |
| apevec | dtantsur, ^ | 11:24 |
| dtantsur | apevec, shardy does, not me | 11:24 |
| apevec | shardy, do you have link to logs? | 11:25 |
| shardy | apevec: https://bugs.launchpad.net/tripleo/+bug/1604770 has details, I had to get the version by screenshot of the VM primary console | 11:26 |
| openstack | Launchpad bug 1604770 in tripleo "introspection hangs due to broken ipxe config" [Critical,Fix released] - Assigned to Dmitry Tantsur (divius) | 11:26 |
| number80 | mmm | 11:26 |
| shardy | I'm not sure if it's logged anywhere tbh | 11:26 |
| shardy | apevec: In my case the underlying host had a wrong old version of ipxe-roms-qemu because of some yum priorities problems | 11:27 |
| number80 | apevec: do you remember that Goneri asked us late april to update ipxe? | 11:27 |
| apevec | number80, it was updated, see cbs link above | 11:27 |
| *** ade_b has joined #rdo | 11:27 | |
| hewbrocca | but probably not on *all* the hosts | 11:27 |
| hewbrocca | this is the problem | 11:27 |
| apevec | we need to see which repos are included in the image build | 11:27 |
| hewbrocca | shardy: so, yum priorities, at the end of the day | 11:28 |
| number80 | ack | 11:28 |
| hewbrocca | GOD I HATE YUM PRIORITIES | 11:28 |
| apevec | dtantsur, shardy - how is the image built? | 11:28 |
| *** ade_b has quit IRC | 11:28 | |
| *** ade_b has joined #rdo | 11:28 | |
| *** Son_Goku has joined #rdo | 11:29 | |
| *** Son_Goku has quit IRC | 11:29 | |
| shardy | apevec: My comment about the image was a mistake, I thought the error was coming from the deploy kernel image | 11:30 |
| shardy | the actual fix was updating the host (not undercloud) ipxe-roms-qemu to the delorean version | 11:30 |
| shardy | hewbrocca: it was actually my fault tbh - I had things set up to prioritize a local yum mirror server | 11:30 |
| * shardy sighs | 11:31 | |
| shardy | the version in centos updates doesn't work for us, as it turns out | 11:31 |
| apevec | ah so you got baseos version | 11:31 |
| shardy | we need the bleeding edge delorean one | 11:31 |
| shardy | yeah | 11:31 |
| shardy | "Introspection completed." | 11:32 |
| hewbrocca | shardy: blearrgh | 11:32 |
| shardy | hooray :) | 11:32 |
| hewbrocca | woop woop | 11:32 |
| shardy | that only took an entire morning, now for some lunch | 11:32 |
| hewbrocca | now how do we fix the promote job? | 11:32 |
| number80 | then, in this case, you don't need yum priorities, it's RDO base repository | 11:32 |
| apevec | number80, it is in testing which is used by CI | 11:34 |
| *** Son_Goku has joined #rdo | 11:34 | |
| shardy | Yeah in CI we juggle priorities pointing to 4 different delorean repos :\ | 11:34 |
| *** ohamada has quit IRC | 11:35 | |
| apevec | dtantsur, ^ so promotion should be using it, let's check rpm-qa list ? | 11:35 |
| jschlueter | imcsk8: yep that fixes it | 11:35 |
| *** ohamada has joined #rdo | 11:35 | |
| apevec | jschlueter, yay! | 11:35 |
| *** Poornima has joined #rdo | 11:35 | |
| *** ohamada has quit IRC | 11:35 | |
| jschlueter | apevec: yep | 11:36 |
| * jschlueter learned something about puppet and fixing ordering stuff this week | 11:36 | |
| apevec | EmilienM, please sanity check https://review.openstack.org/344664 | 11:37 |
| hewbrocca | apevec: that sounds right | 11:38 |
| jschlueter | I abandoned the puppet-nova change as this one is better | 11:38 |
| *** Son_Goku has quit IRC | 11:38 | |
| *** lucasagomes is now known as lucas-hungry | 11:42 | |
| apevec | so last promotion run this morning https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/509/ passed all weirdo puppet/packstack jobs | 11:43 |
| apevec | but tripleo min and ha failed | 11:43 |
| apevec | I've symlinked https://trunk.rdoproject.org/centos7-master/weirdo-passed-ci/ with that hash | 11:44 |
| hewbrocca | apevec: right, and we believe the problem with tripleo jobs is this ipxe version thing | 11:44 |
| *** zoli|wfh is now known as zoli|lunch | 11:44 | |
| hewbrocca | if the error is a timeout on introspection, that's almost certainly what it is | 11:44 |
| apevec | hewbrocca, ok, I'm looking at the logs | 11:44 |
| *** dprince has joined #rdo | 11:45 | |
| *** ade_b has quit IRC | 11:45 | |
| apevec | Installed: ipxe-roms-qemu-20130517-8.gitc4bce43.el7_2.1.noarch | 11:45 |
| apevec | in https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-382/172.19.2.94/var/log/messages.gz | 11:45 |
| apevec | so repo setup is not right on the virthost ? | 11:46 |
| apevec | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-382/172.19.2.94/etc/yum.repos.d/ | 11:46 |
| apevec | it doesn't have any RDO repos ?? | 11:46 |
| *** jubapa has left #rdo | 11:46 | |
| *** jubapa has joined #rdo | 11:46 | |
| apevec | shardy, trown ^ | 11:47 |
| hewbrocca | that sounds like the problem, all right | 11:47 |
| * hewbrocca facepalm | 11:47 | |
| hewbrocca | need this one: ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch | 11:48 |
| apevec | on undercloud: Installed: ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch | 11:48 |
| apevec | in https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-382/undercloud/var/log/yum.log.gz | 11:48 |
| hewbrocca | that's the right one, but it doesn't help in the undercloud | 11:48 |
| rbowen | So ... what's the vector, victor? | 11:48 |
| apevec | yep | 11:48 |
| apevec | victor? | 11:49 |
| hewbrocca | that means we need to update repos on the virt host? | 11:49 |
| rbowen | Quote from an old movie. Airplane. Never mind. :-) | 11:49 |
| rbowen | Do we have M2 yet this morning? | 11:49 |
| apevec | rbowen, not yet fully | 11:49 |
| rbowen | ok | 11:49 |
| *** Son_Goku has joined #rdo | 11:50 | |
| apevec | rbowen, we could run packstack part, but tripleo is part of our definition-of-done, resolving one remaining issue now | 11:50 |
| apevec | hewbrocca, yeah, I'm not sure how we didn't hit this before | 11:50 |
| hewbrocca | me neither, but shardy hit it on his local setup as well | 11:51 |
| *** bfournie has quit IRC | 11:51 | |
| apevec | did we just feel lucky all this time?? | 11:52 |
| hewbrocca | dtantsur: you have any insight here? | 11:52 |
| *** gildub has joined #rdo | 11:52 | |
| hewbrocca | apevec: I mean I guess what it comes down to is we're shipping a later ipxe in RDO, for good reasons | 11:52 |
| apevec | ok, so which of CI roles is setting up virthost? | 11:53 |
| hewbrocca | but the physical host needs to have that ipxe version | 11:53 |
| hewbrocca | (I'm not sure why) | 11:53 |
| apevec | hewbrocca, hopefully next RHEL will rebase ipxe in baseos | 11:53 |
| hewbrocca | If they release one that works, then yeah, we can stop worrying about this | 11:53 |
| dtantsur | sorry, just got back after unexpected firmware update for my laptop >_< | 11:54 |
| hewbrocca | lulz | 11:54 |
| hewbrocca | dtantsur: it didn't come up? | 11:55 |
| dtantsur | yeah | 11:55 |
| hewbrocca | excellent | 11:55 |
| hewbrocca | dtantsur: so, yes, virt host for the promote job has wrong ipxe version | 11:55 |
| *** jubapa_ has joined #rdo | 11:55 | |
| hewbrocca | Out of curiosity, why does it matter what version is on the host? | 11:55 |
| dtantsur | hewbrocca, this is the one actually used :) | 11:55 |
| dtantsur | a bit longer answer: | 11:56 |
| hewbrocca | I guess I assumed that :) | 11:56 |
| dtantsur | we try to use iPXE from the machine itself, then fall back to iPXE shipped on the undercloud | 11:56 |
| dtantsur | on virtual environment "iPXE from the machine itself" means "iPXE from the virtual host" | 11:56 |
| dtantsur | I hope it makes the thing a bit clearer | 11:56 |
| hewbrocca | Yeah I think I get it | 11:56 |
| hewbrocca | apevec: can you fix it? | 11:59 |
| *** jubapa_ has quit IRC | 11:59 | |
| *** jayg|g0n3 is now known as jayg | 12:00 | |
| *** amuller has joined #rdo | 12:02 | |
| *** weshay has joined #rdo | 12:02 | |
| *** dgurtner has quit IRC | 12:03 | |
| weshay | apevec, greetings.. I was just briefed on the ipxe issue | 12:09 |
| weshay | apevec, sounds like we need to blacklist ipxe on the virthost centos repos | 12:09 |
| *** paragan has joined #rdo | 12:10 | |
| *** paragan has joined #rdo | 12:10 | |
| hewbrocca | dtantsur: ^^^ this should work, right? | 12:11 |
| *** d0ugal has joined #rdo | 12:11 | |
| dtantsur | I don't quite get it, blacklist what exactly? | 12:12 |
| hewbrocca | weshay: ^^^ | 12:13 |
| *** King_InuYasha has joined #rdo | 12:13 | |
| weshay | so what hewbrocca was saying was that the ipxe rpm in centos is the incorrect rpm to use.. the virthost should use ipxe from delorean | 12:14 |
| weshay | so we just need to blacklist the ipxe rpm in the centos yum repo conf and it will be pulled from delorean. | 12:14 |
| weshay | yes/no? | 12:15 |
| *** Son_Goku has quit IRC | 12:16 | |
| *** ohochman has joined #rdo | 12:17 | |
| hewbrocca | that seems like the right result to me | 12:17 |
| *** jerrygb has joined #rdo | 12:17 | |
| *** ohochman has left #rdo | 12:17 | |
| hewbrocca | dtantsur: ^^^ | 12:17 |
| * weshay finds a blacklist example | 12:17 | |
| *** trown|outtypewww is now known as trown | 12:19 | |
| weshay | dtantsur, http://www.cyberciti.biz/faq/rhel-fedora-centos-linux-yum-disable-certain-packages-from-being-installed/ | 12:19 |
| weshay | trown, morning sunshine | 12:19 |
| dtantsur | sounds correct | 12:19 |
| trown | morning | 12:19 |
| weshay | hewbrocca, dtantsur may have found the reason introspection works for me locally, but fails in ci.centos | 12:20 |
| weshay | introspection is apparently using the virthost to execute ipxe, and the centos rpm version of ipxe is not working correctly.. we need to use ipxe from delorean | 12:21 |
| *** pilasguru has joined #rdo | 12:21 | |
| *** jerrygb has quit IRC | 12:21 | |
| weshay | trown, one possible solution is to blacklist ipxe in the centos repos http://www.cyberciti.biz/faq/rhel-fedora-centos-linux-yum-disable-certain-packages-from-being-installed/ | 12:22 |
| trown | what if we just `yum remove -y ipxe` from the virthost? | 12:22 |
| *** paragan has quit IRC | 12:22 | |
| weshay | sounds like it *needs* to be installed to me | 12:22 |
| *** Poornima has quit IRC | 12:22 | |
| trown | then ironic will use the undercloud ipxe | 12:22 |
| trown | dtantsur: is that right ^ | 12:22 |
| trown | weshay: we dont put dlrn repos on the virthost currently | 12:23 |
| dtantsur | trown, I don't know if qemu depends on it | 12:23 |
| weshay | meh.. we could | 12:23 |
| trown | right, just saying we dont | 12:23 |
| trown | it also then creates issues for cleaning up, as you now need to make sure the virthost has the right repos | 12:24 |
| trown | in the current state, we try to do as little as possible on the virthost, and even less as root | 12:24 |
| *** unclemarc has joined #rdo | 12:25 | |
| dtantsur | trown, removing it removes libguestfs for me | 12:26 |
| *** athomas has quit IRC | 12:27 | |
| * shardy returns from lunch | 12:28 | |
| shardy | Yeah the only solution I found was to configure the delorean repos on the virt host and ensure they had priorities set above centos-updates | 12:29 |
| trown | it is only one package ya? | 12:29 |
| *** cpg is now known as cpg|away | 12:29 | |
| shardy | tripleo.sh --repo-setup is run on the virthost for tripleO CI which is why we don't see this I think | 12:29 |
| shardy | trown: Yeah ipxe-roms-qemu | 12:29 |
| dtantsur | I think we should converge to a bit less scripts to setup the environment :/ | 12:30 |
| dtantsur | like, for example, one | 12:30 |
| trown | dtantsur: maybe respond to my proposal on openstack-dev about that :P | 12:30 |
| *** newuser_rdo has joined #rdo | 12:30 | |
| shardy | dtantsur: Yeah, we've been trying to do that for a while | 12:30 |
| dtantsur | trown, I don't have a strong voice in TripleO anyway :) | 12:30 |
| * shardy will use whatever we use in CI | 12:31 | |
| weshay | shardy, I think introspection is off in tripleo-ci based on http://logs.openstack.org/92/344792/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/98371bb/console.html | 12:32 |
| weshay | if I'm reading that correctly | 12:32 |
| *** Alex_Stef has quit IRC | 12:32 | |
| *** King_InuYasha is now known as Son_Goku | 12:33 | |
| *** flepied has quit IRC | 12:33 | |
| trown | ya there is also that | 12:33 |
| trown | when we moved to a single job for tripleo-ci, we lost introspection testing | 12:33 |
| dtantsur | weshay, you're right. and that's the reason we're having so many problems (not this one, the 2-3 previous ones) | 12:34 |
| trown | evidenced by the multiple patches to instack-undercloud to fix the ipxe port | 12:34 |
| *** bfournie has joined #rdo | 12:34 | |
| weshay | trown, so are you thinking a yum install http://foo/ipxe ? | 12:34 |
| weshay | on the virthost | 12:34 |
| *** athomas has joined #rdo | 12:34 | |
| * dtantsur shakes his fist at people disabling important bits in gate | 12:34 | |
| newuser_rdo | hi | 12:34 |
| trown | weshay: ya I am testing adding a direct http link to https://github.com/openstack/tripleo-quickstart/blob/master/roles/parts/libvirt/defaults/main.yml#L2 | 12:34 |
| trown | putting dlrn repos on the virthost is not really a great idea | 12:35 |
| weshay | ack | 12:35 |
| *** zoli|lunch is now known as zoli|wfh | 12:35 | |
| newuser_rdo | I want to integrate my OpenStack rdo with my microsoft active directory. | 12:35 |
| newuser_rdo | which option is better: use packstack with the parameters of the keystone + ldap, or install with packstack and after setup ldap configurations? | 12:35 |
| rbowen | newuser_rdo: The expert on this is Adam Young, and he appears to not be here at the moment. It's still early in his time zone. | 12:36 |
| *** paragan has joined #rdo | 12:37 | |
| newuser_rdo | rbowen, thank you. I'll try talk to him later | 12:38 |
| *** egafford has joined #rdo | 12:38 | |
| trown | what dlrn repo is the ipxe package in? I dont see it in https://trunk.rdoproject.org/centos7-master/current/ | 12:38 |
| *** vimal has quit IRC | 12:39 | |
| dtantsur | trown, something "common" iirc | 12:39 |
| apevec | trown, in deps | 12:39 |
| *** laron has joined #rdo | 12:40 | |
| dtantsur | oh, deps, right | 12:40 |
| trown | oh, so I can get it off buildogs even | 12:40 |
| apevec | trown, http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-newton/common/ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch.rpm | 12:40 |
| *** laron has quit IRC | 12:40 | |
| trown | apevec++ thanks | 12:40 |
| zodbot | trown: Karma for apevec changed to 1 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 12:40 |
| *** laron has joined #rdo | 12:41 | |
| weshay | how is it apevec just has one karma point in #rdo.. new f24 cycle.. I guess | 12:41 |
| weshay | apevec++ | 12:41 |
| zodbot | weshay: Karma for apevec changed to 2 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 12:41 |
| weshay | just cause | 12:41 |
| rbowen | apevec++ | 12:41 |
| rbowen | Hmm. It doesn't like me. | 12:41 |
| trown | lol, must not link to your FAS account | 12:42 |
| number80 | rbowen: only one cookie per cycle :) | 12:42 |
| number80 | apevec++ | 12:42 |
| zodbot | number80: Karma for apevec changed to 3 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 12:42 |
| rbowen | My FAS account is rcb | 12:42 |
| rbowen | Is that why? | 12:43 |
| number80 | .fasinfo rcb | 12:43 |
| zodbot | number80: User: rcb, Name: Rich Bowen, email: rbowen@redhat.com, Creation: 2013-08-01, IRC Nick: None, Timezone: UTC, Locale: C, GPG key ID: None, Status: active | 12:43 |
| zodbot | number80: Approved Groups: cla_fpca cla_done | 12:43 |
| *** jcoufal has joined #rdo | 12:43 | |
| *** aufi_ has joined #rdo | 12:43 | |
| number80 | rbowen: you need to add your irc nick in your FAS profile, so zodbot can do the mapping | 12:43 |
| *** rlandy has joined #rdo | 12:43 | |
| trown | weshay: ok adding that http link to the list of packages for libvirt "just worked" for me | 12:44 |
| trown | will find out shortly if that fixes introspection | 12:45 |
| weshay | cool.. trown I think this does explain why it worked locally for me.. my virthosts are rhel | 12:45 |
| rbowen | number80: I don't see where to do that. | 12:45 |
| rbowen | number80: I'm looking at https://fedorahosted.org/fas/prefs ... is there another place? | 12:46 |
| misc | yeah | 12:47 |
| * misc search the url | 12:47 | |
| *** karimb has quit IRC | 12:47 | |
| misc | https://admin.fedoraproject.org/accounts | 12:47 |
| *** dneary has joined #rdo | 12:48 | |
| rbowen | Thanks. | 12:48 |
| *** lucas-hungry is now known as lucasagomes | 12:49 | |
| rbowen | apevec++ | 12:49 |
| rbowen | Oh, well, I tried. :-) | 12:49 |
| number80 | ping EmilienM, trown, see jjoyce request ^ | 12:50 |
| number80 | arf | 12:50 |
| number80 | .fasinfo rbowen | 12:50 |
| zodbot | number80: User "rbowen" doesn't exist | 12:50 |
| number80 | .fasinfo rcb | 12:51 |
| zodbot | number80: User: rcb, Name: Rich Bowen, email: rbowen@redhat.com, Creation: 2013-08-01, IRC Nick: rbowen, Timezone: UTC, Locale: en, GPG key ID: None, Status: active | 12:51 |
| zodbot | number80: Approved Groups: cla_fpca cla_done | 12:51 |
| number80 | zodbot: naughty bot! | 12:51 |
| trown | jjoyce: could you repeat the request? I dont see it in scrollback | 12:52 |
| jjoyce | trown: https://review.openstack.org/#/c/338879/3 trying to get that guy moving | 12:53 |
| jjoyce | trown: I had to find it in my scroll back :) | 12:53 |
| *** Amita has joined #rdo | 12:53 | |
| *** _elmiko is now known as elmiko | 12:53 | |
| *** jmelvin has joined #rdo | 12:55 | |
| trown | jjoyce: k looks like it is not passing CI yet | 12:55 |
| jjoyce | trown: Yeah it looks like a new patch was added since I made the last request. | 12:57 |
| *** jeckersb is now known as jeckersb_gone | 12:57 | |
| *** ashw has joined #rdo | 13:00 | |
| *** aufi has quit IRC | 13:01 | |
| number80 | .bu32 | 13:01 |
| weshay | matbu, are you running 3rd party on https://review.openstack.org/#/c/338879/ | 13:01 |
| social | number80: O.o | 13:01 |
| trown | weshay: put up https://review.openstack.org/345410 for introspection fix | 13:01 |
| *** julim has joined #rdo | 13:01 | |
| number80 | social: typing too fast | 13:01 |
| *** jubapa_ has joined #rdo | 13:01 | |
| number80 | (it was actually an irc client shortcut to switch buffer) | 13:02 |
| * weshay looks | 13:02 | |
| *** flepied has joined #rdo | 13:02 | |
| matbu | weshay: no not this one | 13:03 |
| weshay | trown, added comment | 13:03 |
| trown | weshay: why only master? | 13:04 |
| trown | iPXE out of date is a problem everywhere, it is only a blocking problem on master | 13:04 |
| weshay | that specific rpm is for newton no? | 13:04 |
| trown | we have been having issues with out of date iPXE since kilo though | 13:04 |
| *** karimb has joined #rdo | 13:04 | |
| weshay | hrm.. | 13:04 |
| trown | nah it is not an openstack package | 13:04 |
| *** paragan has quit IRC | 13:05 | |
| weshay | ah ok | 13:05 |
| weshay | +1 | 13:05 |
| trown | the version of iPXE that ships with CentOS is very old | 13:05 |
| *** ddmitriev has quit IRC | 13:06 | |
| matbu | weshay: i don't because it's already tested in the role itself and it's for mitaka upgrade, not newton | 13:06 |
| hewbrocca | so... | 13:11 |
| hewbrocca | icanhazpromotejob? | 13:11 |
| *** sgotliv has joined #rdo | 13:11 | |
| *** jpich has quit IRC | 13:12 | |
| *** anilvenkata has quit IRC | 13:13 | |
| *** READ10 has joined #rdo | 13:15 | |
| *** jerrygb has joined #rdo | 13:18 | |
| *** dustins has joined #rdo | 13:18 | |
| *** akshai has joined #rdo | 13:20 | |
| newuser_rdo | one question... anyone knows any doc about how to add a blockstorage node into my lab? I have one compute node at my lab | 13:21 |
| *** tshefi has quit IRC | 13:21 | |
| *** vaneldik has joined #rdo | 13:22 | |
| *** jpich has joined #rdo | 13:22 | |
| *** jerrygb has quit IRC | 13:22 | |
| *** akshai_ has joined #rdo | 13:22 | |
| *** egallen has quit IRC | 13:24 | |
| dmsimard | trown: everything is green except ooo-q :( https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/509/ | 13:24 |
| trown | dmsimard: wow really? | 13:24 |
| hewbrocca | almost there | 13:25 |
| hewbrocca | trown: are the oooq failures because of the bad ipxe rom? Has that change gone in yet? | 13:25 |
| *** akshai has quit IRC | 13:26 | |
| apevec | hewbrocca, https://review.openstack.org/#/c/345410/ | 13:26 |
| *** vaneldik has quit IRC | 13:26 | |
| hewbrocca | ahh, it has not | 13:27 |
| dmsimard | hmm, CI isn't happy about that patch | 13:27 |
| hewbrocca | well that's probably why oooq isn't working | 13:27 |
| *** milan has quit IRC | 13:27 | |
| *** milan has joined #rdo | 13:27 | |
| *** jeckersb_gone is now known as jeckersb | 13:28 | |
| trown | ya, that patch needed a fix | 13:28 |
| apevec | weshay, I guess you have more than just base RHEL 7.2 repos enabled if you don't see this internally? https://review.openstack.org/#/c/345410/3/roles/parts/libvirt/tasks/main.yml@2 | 13:31 |
| *** ddmitriev has joined #rdo | 13:33 | |
| *** milan has quit IRC | 13:34 | |
| *** jerrygb has joined #rdo | 13:34 | |
| *** milan has joined #rdo | 13:35 | |
| *** richm has joined #rdo | 13:35 | |
| *** trown is now known as trown|mtg | 13:37 | |
| *** dgurtner has joined #rdo | 13:37 | |
| *** dgurtner has joined #rdo | 13:37 | |
| *** pgadiya has quit IRC | 13:39 | |
| *** Liuqing has joined #rdo | 13:40 | |
| *** Liuqing has quit IRC | 13:41 | |
| *** milan has quit IRC | 13:41 | |
| *** vaneldik has joined #rdo | 13:41 | |
| *** paragan has joined #rdo | 13:41 | |
| *** milan has joined #rdo | 13:43 | |
| *** jubapa_ has quit IRC | 13:44 | |
| *** fultonj has joined #rdo | 13:45 | |
| *** tosky has quit IRC | 13:52 | |
| *** ebalduf has joined #rdo | 13:52 | |
| *** ekuris has quit IRC | 13:55 | |
| *** livelace has joined #rdo | 13:56 | |
| *** laron has quit IRC | 13:57 | |
| *** dtantsur is now known as dtantsur|pto | 13:57 | |
| *** laron has joined #rdo | 13:57 | |
| *** vaneldik has quit IRC | 13:58 | |
| *** chandankumar has quit IRC | 13:58 | |
| *** imcleod has joined #rdo | 14:00 | |
| *** gildub has quit IRC | 14:01 | |
| *** eliska has quit IRC | 14:05 | |
| *** ushkalim has quit IRC | 14:05 | |
| *** eliska has joined #rdo | 14:06 | |
| *** eliska is now known as eliska-mtg | 14:06 | |
| *** kgiusti has joined #rdo | 14:06 | |
| mcornea | trown|mtg: hi, for rdo test day should we use the stable repos or trunk? | 14:07 |
| trown|mtg | mcornea: I think both are valid to test | 14:10 |
| mcornea | trown|mtg: ok, so even stable points to Netwon mileston 2? | 14:11 |
| trown|mtg | mcornea: trunk is a couple weeks old | 14:11 |
| trown|mtg | oh I think I misundertood what you mean by trunk | 14:11 |
| *** rbowen has quit IRC | 14:11 | |
| trown|mtg | I read as mitaka vs newton | 14:11 |
| trown|mtg | testing the repos that are not passing CI is unlikely to be successful :) | 14:12 |
| mcornea | trown|mtg: right :) so I'm following the docs and I have 2 options: stable or "latest RDO Trunk Delorean repository" | 14:12 |
| trown|mtg | ah upstream docs... | 14:13 |
| mcornea | trown|mtg: yep | 14:13 |
| trown|mtg | the repos there are not valid for RDO | 14:13 |
| *** tumble has joined #rdo | 14:13 | |
| trown|mtg | they are meant to test latest tripleo with a pinned version of everything else | 14:13 |
| trown|mtg | for RDO we want to test everything together at the same point in time | 14:14 |
| *** Ryjedo has joined #rdo | 14:15 | |
| *** eharney has quit IRC | 14:15 | |
| mcornea | trown|mtg: ok, I misunderstood it then. So where can I get the RDO repos from? | 14:15 |
| *** vaneldik has joined #rdo | 14:15 | |
| *** milan has quit IRC | 14:16 | |
| *** milan has joined #rdo | 14:16 | |
| trown|mtg | mcornea: https://github.com/redhat-openstack/ansible-role-tripleo-image-build/blob/master/templates/repo-centos7-delorean.sh.j2 is the repos that get installed in the quickstart image | 14:17 |
| *** dustins has quit IRC | 14:20 | |
| apevec | trown|mtg, hmm, https://review.openstack.org/345410 is not merged yet? So current run https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/510/ will not pass? | 14:21 |
| trown|mtg | apevec: right | 14:22 |
| *** edannon has quit IRC | 14:23 | |
| *** lpabon has joined #rdo | 14:23 | |
| *** rbowen has joined #rdo | 14:23 | |
| *** rbowen has quit IRC | 14:23 | |
| *** rbowen has joined #rdo | 14:23 | |
| *** ChanServ sets mode: +o rbowen | 14:23 | |
| *** eliska-mtg is now known as eliska | 14:25 | |
| *** sgotliv has quit IRC | 14:25 | |
| *** Amita has quit IRC | 14:27 | |
| *** jlibosva has quit IRC | 14:29 | |
| *** nmagnezi has quit IRC | 14:29 | |
| *** jlibosva has joined #rdo | 14:29 | |
| *** eliska has quit IRC | 14:29 | |
| *** apetrich has quit IRC | 14:30 | |
| *** nehar has quit IRC | 14:31 | |
| *** lkuchlan has quit IRC | 14:31 | |
| *** lpabon has quit IRC | 14:32 | |
| *** laron has quit IRC | 14:38 | |
| *** fzdarsky is now known as fzdarsky|afk | 14:38 | |
| *** laron has joined #rdo | 14:39 | |
| *** michchap has quit IRC | 14:40 | |
| *** rbowen has quit IRC | 14:40 | |
| *** fzdarsky|afk has quit IRC | 14:42 | |
| *** vaneldik1 has joined #rdo | 14:44 | |
| *** michchap has joined #rdo | 14:45 | |
| *** vaneldik has quit IRC | 14:45 | |
| apevec | trown|mtg, is there only noop CI on https://review.openstack.org/345410 ? | 14:49 |
| trown|mtg | apevec: no other CI is running | 14:50 |
| *** saneax is now known as saneax_AFK | 14:50 | |
| trown|mtg | https://ci.centos.org/view/rdo/view/tripleo-gate/ | 14:51 |
| *** anilvenkata has joined #rdo | 14:51 | |
| *** rbowen has joined #rdo | 14:53 | |
| *** ChanServ sets mode: +o rbowen | 14:53 | |
| *** READ10 has quit IRC | 14:54 | |
| rbowen | Any news on ooo-q while my network was down? | 14:55 |
| *** vaneldik1 has quit IRC | 14:55 | |
| *** ebalduf has quit IRC | 14:57 | |
| *** bswartz is now known as bswartz_ | 14:57 | |
| apevec | rbowen, https://review.openstack.org/345410 is running in CI | 14:58 |
| apevec | once it's merged we can retrigger promotion pipeline | 14:58 |
| rbowen | excellent. Thanks for the update. | 14:58 |
| apevec | trown|mtg, let's disable pipeline until that? | 14:58 |
| apevec | it's just wasting resources now | 14:58 |
| *** yfried has quit IRC | 14:59 | |
| apevec | trown|mtg, dmsimard - rdo-delorean-promote-master disabled | 15:00 |
| dmsimard | ok | 15:00 |
| trown|mtg | cool | 15:00 |
| *** dyasny has quit IRC | 15:01 | |
| *** d0ugal has quit IRC | 15:02 | |
| *** gkadam has quit IRC | 15:02 | |
| *** pcaruana has quit IRC | 15:02 | |
| *** d0ugal has joined #rdo | 15:05 | |
| *** lpabon has joined #rdo | 15:05 | |
| *** hynekm has quit IRC | 15:06 | |
| *** READ10 has joined #rdo | 15:08 | |
| *** ebalduf has joined #rdo | 15:09 | |
| *** mengxd has joined #rdo | 15:11 | |
| *** dyasny has joined #rdo | 15:13 | |
| *** sdake has joined #rdo | 15:13 | |
| jschlueter | apevec, EmilienM: what's next for getting this merged? https://review.openstack.org/#/c/344664 | 15:14 |
| *** eharney has joined #rdo | 15:14 | |
| jschlueter | are we waiting on another review of the change or not? | 15:14 |
| jschlueter | imcsk8: ^^ | 15:14 |
| apevec | in theory one more +2 | 15:14 |
| *** satya4ever has quit IRC | 15:15 | |
| *** karimb has quit IRC | 15:15 | |
| EmilienM | apevec: I'm not core on packstack. | 15:15 |
| apevec | but with folks on pto ... | 15:15 |
| number80 | apevec, pabelanger, dmsimard: let's sync next week about post-commit jobs | 15:15 |
| EmilienM | apevec: you can +A it | 15:15 |
| EmilienM | who cares | 15:15 |
| *** trown|mtg is now known as trown | 15:15 | |
| *** panda|zZ is now known as panda | 15:15 | |
| apevec | number80, let's | 15:16 |
| number80 | apevec: as you have the busiest schedule, I'll let you choose the timeslot | 15:16 |
| *** jlibosva1 has joined #rdo | 15:17 | |
| *** sdake_ has joined #rdo | 15:17 | |
| *** apetrich has joined #rdo | 15:17 | |
| apevec | dmsimard, social - +2 anyone ? https://review.openstack.org/344664 | 15:17 |
| *** jlibosva has quit IRC | 15:17 | |
| apevec | imcsk8, ^ | 15:17 |
| pabelanger | number80: sure, feel free to send out an invite | 15:18 |
| dmsimard | number80: sure | 15:18 |
| number80 | ack | 15:19 |
| *** sdake has quit IRC | 15:19 | |
| hewbrocca | wahey | 15:21 |
| hewbrocca | https://review.openstack.org/#/c/345410/4 | 15:21 |
| hewbrocca | appears to have passed CI | 15:21 |
| hewbrocca | needs a workflow +1... | 15:21 |
| jschlueter | dmsimard: thanks! | 15:21 |
| hewbrocca | trown: ^^^ | 15:23 |
| trown | larsks: mind a quick review of https://review.openstack.org/#/c/345410/4 | 15:24 |
| larsks | trown: sure thing. | 15:25 |
| * hewbrocca waits anxiously | 15:25 | |
| trown | hewbrocca: something else is broken after that now... investigating | 15:26 |
| hewbrocca | sigh... shocking... | 15:26 |
| trown | hewbrocca: and tripleo is set on merging a patch I have said 100% breaks RDO, so we will likely have a second issue shortly | 15:26 |
| hewbrocca | nah, they're not gonna merge it | 15:26 |
| hewbrocca | don't worry :) | 15:26 |
| *** mengxd has quit IRC | 15:27 | |
| hewbrocca | trown: Speaking of fun things, do we know why the mitaka promote job is failing? | 15:28 |
| *** hrw has quit IRC | 15:28 | |
| *** paragan has quit IRC | 15:29 | |
| trown | hewbrocca: seems to be httpd failing to start only on the minimal job, but I can't reproduce it locally | 15:31 |
| trown | https://review.openstack.org/#/c/338879/4 seems relevant, but that is only in the upgrades script | 15:31 |
| *** dustins has joined #rdo | 15:32 | |
| trown | hewbrocca: I am comandeering a CI node though to investigate | 15:32 |
| hewbrocca | well, excellent | 15:32 |
| hewbrocca | we're getting there... | 15:32 |
| * larsks wonders how many times gerrit will require him to log in today. | 15:33 | |
| dmsimard | trown: why would a tripleo patch break RDO ? | 15:33 |
| dmsimard | tripleo *uses* RDO | 15:33 |
| dmsimard | not the other way around | 15:33 |
| trown | dmsimard: a tripleo-heat-templates patch breaks on quickstart, but so far nobody has reproduced it outside of quickstart | 15:34 |
| dmsimard | ah so it breaks quickstart :p | 15:34 |
| trown | dmsimard: the thing is it is clearly the patch, because I can remove it and tripleo deploys fine | 15:34 |
| trown | dmsimard: right I meant it breaks RDO promote | 15:34 |
| larsks | trown: which patch? | 15:34 |
| trown | larsks: https://review.openstack.org/341616 | 15:35 |
| rdogerrit | David Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects http://review.rdoproject.org/r/1662 | 15:35 |
| *** pilasguru has quit IRC | 15:38 | |
| *** pilasguru has joined #rdo | 15:38 | |
| weshay | trown, not seeing that undercloud issue in tripleo | 15:38 |
| weshay | http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/3d40e61/logs/undercloud/var/log/undercloud_install.txt.gz | 15:38 |
| weshay | 2016-07-21 06:38:40.000 | + touch /opt/stack/.undercloud-setup | 15:38 |
| *** laron has quit IRC | 15:39 | |
| trown | weshay: ya I am hoping something weird happened in the last image, just kicked a run to get a new image at least | 15:39 |
| weshay | k.. will pull that image when it's ready | 15:39 |
| trown | weshay: that touch has not changed recently either | 15:39 |
| *** laron has joined #rdo | 15:39 | |
| *** leanderthal is now known as leanderthal|afk | 15:40 | |
| *** paragan has joined #rdo | 15:41 | |
| *** paragan has joined #rdo | 15:41 | |
| *** sshnaidm has quit IRC | 15:42 | |
| *** pilasguru has quit IRC | 15:42 | |
| *** zodbot_ has joined #rdo | 15:43 | |
| *** zodbot has quit IRC | 15:43 | |
| *** zodbot_ is now known as zodbot | 15:44 | |
| *** adarazs has quit IRC | 15:45 | |
| *** cschwede has quit IRC | 15:45 | |
| *** slagle has quit IRC | 15:45 | |
| *** dgurtner has quit IRC | 15:46 | |
| *** zoli|wfh has quit IRC | 15:46 | |
| *** jschlueter has quit IRC | 15:46 | |
| *** smeyer has quit IRC | 15:46 | |
| *** jjoyce has quit IRC | 15:46 | |
| *** jjoyce has joined #rdo | 15:46 | |
| *** psanchez has quit IRC | 15:46 | |
| *** psanchez has joined #rdo | 15:47 | |
| *** slagle has joined #rdo | 15:47 | |
| *** jschlueter has joined #rdo | 15:47 | |
| *** adarazs has joined #rdo | 15:48 | |
| *** maeca1 has joined #rdo | 15:48 | |
| *** zoliXXL has joined #rdo | 15:48 | |
| *** cschwede has joined #rdo | 15:49 | |
| *** fultonj has quit IRC | 15:51 | |
| *** jubapa has quit IRC | 15:52 | |
| openstackgerrit | Merged openstack/packstack: Fix user creation for nova network https://review.openstack.org/344664 | 15:54 |
| *** hynekm has joined #rdo | 15:57 | |
| *** paragan has quit IRC | 15:58 | |
| *** nmagnezi has joined #rdo | 15:59 | |
| *** paragan has joined #rdo | 16:01 | |
| *** paragan has joined #rdo | 16:01 | |
| hewbrocca | Merged! Huzzah! | 16:01 |
| hewbrocca | trown: now what about this other thing | 16:01 |
| *** aufi_ has quit IRC | 16:02 | |
| *** d0ugal has quit IRC | 16:04 | |
| *** Son_Goku has quit IRC | 16:04 | |
| *** Son_Goku has joined #rdo | 16:05 | |
| *** fzdarsky|afk has joined #rdo | 16:09 | |
| trown | hewbrocca: ya waiting on a new image to see if that is actually an issue or not https://ci.centos.org/view/rdo/view/promotion-pipeline/job/tripleo-quickstart-promote-master-delorean-build-images/ | 16:10 |
| hewbrocca | go job go! | 16:11 |
| *** tesseract- has quit IRC | 16:15 | |
| *** Son_Goku has quit IRC | 16:16 | |
| *** rcernin has quit IRC | 16:19 | |
| *** jhershbe__ has quit IRC | 16:20 | |
| *** fultonj has joined #rdo | 16:21 | |
| *** ayoung has joined #rdo | 16:24 | |
| *** ifarkas is now known as ifarkas_afk | 16:24 | |
| *** ayoung has quit IRC | 16:25 | |
| *** ayoung has joined #rdo | 16:25 | |
| *** derekh has quit IRC | 16:27 | |
| *** garrett has quit IRC | 16:27 | |
| trown | WTF... just ran the minimal job that has been failing promote for days (in a way I cant reproduce locally) manually on a cico node... fails to fail | 16:27 |
| *** dyasny has quit IRC | 16:27 | |
| trown | fml | 16:28 |
| *** julim has quit IRC | 16:28 | |
| trown | oh right... because it landed on the fast chassis | 16:29 |
| trown | ugh | 16:29 |
| *** jpich has quit IRC | 16:32 | |
| *** mvk has quit IRC | 16:32 | |
| apevec | trown, so we have gambling included | 16:33 |
| trown | ya and similar to casinos the odds are not in our favor | 16:33 |
| trown | it is 1/4 | 16:34 |
| *** lucasagomes is now known as lucas-afk | 16:35 | |
| trown | I am a bit lost on what our options are with this at this point | 16:36 |
| trown | we cant magically make the 3 slow chassis faster | 16:36 |
| *** mcornea has quit IRC | 16:36 | |
| apevec | so it's just CPU not RAM? | 16:37 |
| trown | ya only difference is CPU | 16:37 |
| apevec | so increasing timeouts? | 16:37 |
| trown | all of them have the same RAM and SSDs | 16:37 |
| trown | ya, I suppose for mitaka it is exposing a race condition that is likely fixable... just not reproducible on a decent CPU | 16:38 |
| rdogerrit | David Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects http://review.rdoproject.org/r/1662 | 16:38 |
| *** pilasguru has joined #rdo | 16:39 | |
| trown | being able to request nodes on dusty (fast chassis) would be pretty nice though | 16:39 |
| apevec | dmsimard, ^ is that possible? | 16:39 |
| dmsimard | not sure what you mean | 16:40 |
| apevec | get(fast-node) | 16:40 |
| dmsimard | you mean requesting a node from a particular chassis ? | 16:40 |
| apevec | yes | 16:40 |
| dmsimard | It's not possible right now, duffy doesn't have an API for that, no. | 16:40 |
| trown | dmsimard: ya, tripleo jobs are just not passing much on the other chassis' now | 16:40 |
| dmsimard | Khaleesi used to request nodes (and release them) until it got one of the kind it wanted and I'm really against that kind of implementation | 16:40 |
| trown | well I did that ;P | 16:41 |
| apevec | wow that was evil :) | 16:41 |
| dmsimard | We can ask KB if they can provide a feature to have something like that | 16:41 |
| trown | and it was actually only throwing back nodes with 16G of RAM | 16:41 |
| dmsimard | Would need to file a bug | 16:41 |
| *** gszasz has quit IRC | 16:41 | |
| trown | so it was 1/5 chassis getting thrown back, not 3/4 like this would require | 16:41 |
| dmsimard | I will file a bug and poke the team about it | 16:42 |
| trown | but cico resolved that by decomissioning the 16G chassis (RIP hufty) | 16:42 |
| *** d0ugal has joined #rdo | 16:45 | |
| *** mcornea has joined #rdo | 16:45 | |
| *** sdake_ has quit IRC | 16:46 | |
| dmsimard | which is a shame because that chassis can be useful to every other job | 16:46 |
| trown | of course when I am trying to reproduce the issue it is all dusty https://paste.fedoraproject.org/393603/19714146/ | 16:48 |
| *** mosulica has quit IRC | 16:49 | |
| * trown gets lunch | 16:49 | |
| *** sdake has joined #rdo | 16:49 | |
| *** fultonj has quit IRC | 16:49 | |
| *** trown is now known as trown|lunch | 16:49 | |
| imcsk8 | jschlueter: hello, sorry i wasn't around | 16:50 |
| dmsimard | apevec, trown|lunch: https://bugs.centos.org/view.php?id=11200 | 16:50 |
| imcsk8 | jschlueter: i worked until very late and i overslept | 16:51 |
| *** paramite has joined #rdo | 16:53 | |
| *** p01nt3r75 has quit IRC | 16:54 | |
| *** jargonmonk has joined #rdo | 16:55 | |
| apevec | imcsk8, thanks for chasing that nova-net fix, it's now merged! | 16:55 |
| rdogerrit | David Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects http://review.rdoproject.org/r/1662 | 16:55 |
| imcsk8 | apevec: np, it took me while because there where other errors arund it and puppet had misleading outputs | 16:57 |
| *** laron has quit IRC | 16:57 | |
| *** laron has joined #rdo | 16:58 | |
| *** jaosorior has quit IRC | 16:59 | |
| *** zoliXXL is now known as zoli|gone | 16:59 | |
| *** jaosorior has joined #rdo | 16:59 | |
| *** zoli|gone is now known as zoli_gone-proxy | 17:00 | |
| *** choirboy has joined #rdo | 17:00 | |
| *** florianf has quit IRC | 17:01 | |
| *** pkovar has quit IRC | 17:02 | |
| *** pilasguru has quit IRC | 17:03 | |
| jschlueter | imcsk8: no problems, thank you much answering my questions as well along the way, I learned a bit about puppet and trying to resolve the issue | 17:06 |
| imcsk8 | jschlueter: yeah i actually want to dig why puppet was showing that the user was created but in reality it was not | 17:08 |
| *** chopmann has quit IRC | 17:08 | |
| imcsk8 | (if you can call database information reality :P ) | 17:08 |
| *** hynekm has quit IRC | 17:09 | |
| *** jlibosva1 has quit IRC | 17:09 | |
| *** cpg|away is now known as cpg | 17:12 | |
| *** paragan has quit IRC | 17:15 | |
| *** amuller is now known as amuller_afk | 17:18 | |
| *** athomas has quit IRC | 17:19 | |
| *** anilvenkata has quit IRC | 17:24 | |
| *** trown|lunch is now known as trown | 17:27 | |
| *** laron has quit IRC | 17:27 | |
| *** laron has joined #rdo | 17:28 | |
| openstackgerrit | Merged openstack/packstack: add number of workers for nova::conductor https://review.openstack.org/341284 | 17:30 |
| *** athomas has joined #rdo | 17:30 | |
| *** ihrachys has quit IRC | 17:30 | |
| openstackgerrit | Merged openstack/packstack: add workers for heat::api and heat::engine https://review.openstack.org/341286 | 17:30 |
| *** julim has joined #rdo | 17:34 | |
| *** oshvartz has quit IRC | 17:34 | |
| apevec | dmsimard, trown, bad: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/511/ | 17:35 |
| apevec | ha and packstack 003 failed | 17:35 |
| *** jcoufal has quit IRC | 17:36 | |
| imcsk8 | apevec: checking... | 17:39 |
| *** iberezovskiy is now known as iberezovskiy|off | 17:41 | |
| apevec | imcsk8, looks like cirros image d/l failed | 17:41 |
| apevec | bah | 17:41 |
| *** degorenko is now known as _degorenko|afk | 17:41 | |
| imcsk8 | apevec: https://paste.fedoraproject.org/393614/12290314/ | 17:41 |
| *** Goneri has quit IRC | 17:41 | |
| imcsk8 | it's the warning osc_lib warning output | 17:42 |
| apevec | warning doesn't break it | 17:42 |
| imcsk8 | let me try to confirm it, some puppet modules are not prepared to deal with extra output from the commands | 17:44 |
| *** fzdarsky|afk has quit IRC | 17:44 | |
| *** mvk has joined #rdo | 17:45 | |
| *** ebalduf has quit IRC | 17:45 | |
| apevec | imcsk8, but right, EmilienM said when using osc puppet modules are doing retries, which puppet module is packstack using? | 17:49 |
| imcsk8 | apevec: glance | 17:50 |
| imcsk8 | i'm checking if it's inheriting from puppet-openstacklib | 17:51 |
| imcsk8 | apevec: this is the output i get: https://paste.fedoraproject.org/393616/69123499/ | 17:51 |
| *** nyechiel has quit IRC | 17:52 | |
| jschlueter | imcsk8: it could be one of 2 issues I can think of, one is nova network-list was not relying on nova but nova@service, the other is the puppet logic is open loop and doesn't verify the identity is actually created/propagated before moving on | 17:54 |
| jschlueter | the propagation part might be the bit we got hit with | 17:54 |
| EmilienM | apevec: only providers that use osc | 17:55 |
| EmilienM | apevec: not all do, ie: nova network afik | 17:55 |
| imcsk8 | apevec: https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/provider/openstack.rb#L147 | 17:57 |
| imcsk8 | jschlueter: might be the second one | 17:58 |
| apevec | right, so warning is ignored | 17:58 |
| *** aortega has quit IRC | 17:59 | |
| *** julim_ has joined #rdo | 18:01 | |
| imcsk8 | i tested and the warning is not ignored | 18:01 |
| *** mcornea has quit IRC | 18:02 | |
| trown | weshay: https://review.openstack.org/345588 fixes undercloud install issue | 18:02 |
| weshay | trown, lolz | 18:03 |
| weshay | cool | 18:03 |
| weshay | I assume there was some puppet change? | 18:03 |
| weshay | and why is tripleo not hitting that? | 18:03 |
| weshay | you don't need to answer | 18:03 |
| weshay | pinche ci | 18:04 |
| trown | weshay: because there is an opt/stack dir on the nodepool nodes | 18:04 |
| *** julim has quit IRC | 18:04 | |
| trown | it would be hit by anyone outside of CI not just quickstart | 18:04 |
| trown | https://github.com/openstack/instack-undercloud/commit/2d76a8de512bcf3aa76a5e3b0e881431c3a6245e seems unrelated, but it the element it removes was creating that dir | 18:05 |
| apevec | why is that folder included in nodepol image? | 18:05 |
| apevec | oh devstack? | 18:06 |
| trown | also, puppet modules from source get put there | 18:06 |
| weshay | trown, I'll open a bug | 18:08 |
| weshay | was about to | 18:08 |
| weshay | keep gettting intrupted | 18:09 |
| apevec | imcsk8, I see some 'Retrying' in the log | 18:09 |
| trown | k thanks | 18:09 |
| apevec | e.g. openstack image list was retried | 18:09 |
| apevec | but openstack image create was not retired | 18:10 |
| apevec | in Packstack::Provision::Glance/Glance_image[cirros-uec-ramdisk] | 18:10 |
| weshay | trown, adding to it now.. https://bugs.launchpad.net/tripleo/+bug/1605349 | 18:11 |
| openstack | Launchpad bug 1605349 in tripleo "instack-undercloud fails to install, w/ touch: cannot touch ‘/opt/stack/.undercloud-setup’: No such file or directory" [Undecided,New] | 18:11 |
| *** xinwu has joined #rdo | 18:14 | |
| imcsk8 | apevec: i'm trying to reproduce the error to confirm if it's related to the warning | 18:15 |
| *** anilvenkata has joined #rdo | 18:15 | |
| *** anilvenkata has quit IRC | 18:16 | |
| trown | weshay: there is yet another issue after the one I just put a patch up for :( | 18:22 |
| trown | Exception registering nodes: The requested action "provide" can not be performed on node "70104ab2-0414-4b49-b15f-7aa139ea074c" while it is in state "enroll". | 18:22 |
| trown | must be an Ironic change since tripleo-ci doesnt see it | 18:23 |
| *** amuller_afk is now known as amuller | 18:25 | |
| *** sasha2 has quit IRC | 18:26 | |
| *** shaunm has quit IRC | 18:26 | |
| * weshay pulls the latest image | 18:26 | |
| trown | weshay: well you will have to get past the unmerged patch to get an undercloud install at all, but even with that there is another major issue | 18:27 |
| weshay | ok... /me going to let the important folks know | 18:27 |
| *** jaosorior has quit IRC | 18:27 | |
| dprince | EmilienM: Httpd fails to start due to a horizon issue in my dev environment. http://paste.openstack.org/show/539101/ | 18:28 |
| dprince | EmilienM: just wondering if you've seen it? you were poking at Horizon today or yesterday right? | 18:28 |
| *** eggmaster has quit IRC | 18:28 | |
| EmilienM | dprince: with current master? | 18:28 |
| dprince | EmilienM: master | 18:28 |
| weshay | trown, apetrich is oddly hitting a bug w/ mitaka current passed ci | 18:29 |
| weshay | https://ci.centos.org/artifacts/rdo/jenkins-poc_apetrich_quickstart_thirdparty_gate_upgrade_mitaka_to_master-40/undercloud/home/stack/failed_deployment_5d83e3ba-4162-41df-a9ad-2d151e7c716e.log.gz | 18:29 |
| EmilienM | dprince: the only work I'm doing is https://review.openstack.org/#/c/345031/ and https://review.openstack.org/#/c/345025/ | 18:29 |
| apetrich | trown, here is the same thing but more readable http://paste.openstack.org/show/539103/ | 18:29 |
| weshay | apetrich, thinks it may be https://github.com/openstack/puppet-keystone/blob/stable/mitaka/lib/puppet/provider/keystone_user/openstack.rb#L83 | 18:29 |
| apetrich | but it might be related to something else missing | 18:30 |
| EmilienM | dprince: see my question on https://review.openstack.org/#/c/345031/3/puppet/services/pacemaker/horizon.yaml | 18:30 |
| *** mcornea has joined #rdo | 18:30 | |
| *** jcoufal has joined #rdo | 18:30 | |
| EmilienM | dprince: both patches are ready for review | 18:30 |
| *** ihrachys has joined #rdo | 18:31 | |
| *** cwolferh has quit IRC | 18:32 | |
| dprince | EmilienM: +2 on your patch, also commented per your question | 18:33 |
| dmsimard | number80: I'm working on a gate job for the config repo that'll sanity check that every project in gerrit gerrit matches a pattern in gerrit replication.config, the gerritbot and the zuul layout | 18:33 |
| dmsimard | number80: There's a lot of problems :/ | 18:34 |
| EmilienM | dprince: ack, I hope it help to fix horizon, otherwise I'll try it again | 18:35 |
| dmsimard | number80: this is just replication: http://paste.openstack.org/show/539105/ | 18:36 |
| *** mcornea has quit IRC | 18:40 | |
| *** visbits has quit IRC | 18:40 | |
| *** devvesa has quit IRC | 18:40 | |
| *** jcoufal_ has joined #rdo | 18:44 | |
| *** jcoufal has quit IRC | 18:46 | |
| EmilienM | hey, can someone review https://review.rdoproject.org/r/#/c/1693/ please? | 18:49 |
| *** cwolferh has joined #rdo | 18:49 | |
| EmilienM | oh I see number80 already reviewed it | 18:49 |
| dmsimard | EmilienM: sounds odd to me that it'd come up just now | 18:49 |
| dmsimard | live migration over ssh/rsync is a common use case | 18:50 |
| EmilienM | dmsimard: michchap is actually fixing a bug | 18:50 |
| dmsimard | no one complained about that until now ? | 18:50 |
| EmilienM | dmsimard: yes it's currently not working afik | 18:50 |
| dmsimard | wth ? | 18:50 |
| EmilienM | there is a workaround in doc | 18:50 |
| EmilienM | believe me or not | 18:50 |
| michchap | dmsimard: https://bugzilla.redhat.com/show_bug.cgi?id=1221776 | 18:50 |
| openstack | bugzilla.redhat.com bug 1221776 in rhel-osp-director "nova migrate fails with ssh command failure" [High,Assigned] - Assigned to emacchi | 18:50 |
| *** ihrachys has quit IRC | 18:51 | |
| dmsimard | michchap: I'm well aware nova should have a shell, I'm wondering why until now no one complained about that | 18:51 |
| dmsimard | mind boggling | 18:51 |
| *** sasha2 has joined #rdo | 18:51 | |
| *** ihrachys has joined #rdo | 18:51 | |
| michchap | dmsimard: hah, yep. I was also surprised. It's only for compute, right? | 18:52 |
| *** maeca1 has quit IRC | 18:53 | |
| *** xinwu has quit IRC | 18:54 | |
| *** apevec_ has joined #rdo | 18:54 | |
| *** apevec_ has quit IRC | 18:54 | |
| *** apevec_ has joined #rdo | 18:54 | |
| *** apevec has quit IRC | 18:58 | |
| number80 | that's a bit in the gray area of packaging but not a bad compromise | 19:01 |
| *** dpeacock has quit IRC | 19:01 | |
| *** laron has quit IRC | 19:01 | |
| *** laron has joined #rdo | 19:02 | |
| larsks | dmsimard: that sounds familiar. Oh, right: https://review.openstack.org/gitweb?p=openstack%2Fpuppet-nova.git;a=commitdiff;h=7bbef2f8886e2ba5225825dea1b9ad6bf9cde94a | 19:02 |
| dmsimard | larsks: 2014 :o | 19:03 |
| michchap | larsks: and then we removed all the user mgmt code from puppet | 19:03 |
| larsks | Yup. | 19:03 |
| *** vaneldik has joined #rdo | 19:04 | |
| dmsimard | number80: hang on for that nova change, I -3'd | 19:05 |
| dmsimard | I talked to dansmith about it, he has a good point | 19:05 |
| dmsimard | it's something that should be configured by the user -- if he's going to be doing live migrations over SSH, he's going to need to set up SSH keys and other things anyway | 19:06 |
| dmsimard | live migrations can be done over libvirt/tcp as well | 19:06 |
| michchap | dmsimard: that means we're back to putting it in puppet | 19:07 |
| dmsimard | michchap: but there is already a manifest to configure ssh live migrations iirc, no ? | 19:07 |
| michchap | dmsimard: yes but puppet won't touch the user at all, so it won't have a shell. | 19:07 |
| michchap | dmsimard: so to get it to work today, you pass in the keypair to puppet, and add this or equivalent: https://github.com/michaeltchapman/opnfv-tht/commit/5ad8bf208ce768ae2b6ceb930355f8745b67b45c | 19:09 |
| michchap | dmsimard: but what I have there is really hacky, and I want to fix it properly in tripleo | 19:09 |
| mlammon | sasha: ohochman: trown: just finished deploying the RDO newton N2 overcloud successfully. however, i see some failed actions.. http://pastebin.test.redhat.com/394840 | 19:10 |
| dmsimard | michchap: yeah I understand all that, but I don't believe it's reasonable to default to a shell in packaging because puppet doesn't want to touch the user. I don't feel it's that much of a hack to have a nova user resource in puppet to set the shell. | 19:10 |
| dmsimard | michchap: we removed POSIX users/permissions from most modules because we were managing too many things like /etc/nova and stuff | 19:11 |
| larsks | michchap: that grep -q \$node is going to cause problems probably | 19:11 |
| trown | mlammon: nice one... the ceilometer issue is known... missing python-redis package on the overcloud images | 19:12 |
| michchap | larsks: it's not idempotent atm. it doesn't need to be for opnfv because it's only for PoC | 19:12 |
| larsks | it could lead to nodes not getting added to the known_hosts file. | 19:12 |
| larsks | E.g., if you have node10 already in the file, then grep -q node1 will return true, so node1 wouldn't get added... | 19:12 |
| michchap | larsks: it won't ever refresh | 19:12 |
| larsks | Okay. | 19:12 |
| michchap | larsks: it has refreshonly triggered from a file resource so it will only run once | 19:13 |
| * larsks remains suspicious | 19:13 | |
| michchap | larsks: so node addition/removal isn't covered. For PoC this is fine, but I will write a native type for puppet-tripleo hopefully next week to do it properly | 19:13 |
| larsks | Cool. | 19:13 |
| *** ihrachys has quit IRC | 19:14 | |
| *** ashw has quit IRC | 19:14 | |
| *** ihrachys has joined #rdo | 19:16 | |
| michchap | dmsimard: do you remember why the user resources were removed from puppet? iirc it was mainly because of uid/gid issues. Was there anything else? | 19:16 |
| dmsimard | michchap: I have the bug nearby | 19:17 |
| dmsimard | https://bugs.launchpad.net/puppet-keystone/+bug/1458915 | 19:17 |
| openstack | Launchpad bug 1458915 in puppet-swift "remove POSIX users, groups and file modes" [Medium,In progress] - Assigned to Emilien Macchi (emilienm) | 19:17 |
| mlammon | trown: thanks, is there a bug id i can reference? | 19:17 |
| *** nmagnezi has quit IRC | 19:18 | |
| dmsimard | michchap: for the actual background/context of the removal, I forget.. so long ago | 19:18 |
| number80 | dmsimard: well, at some point, I want nova people to interact with the damn reviews | 19:19 |
| dmsimard | number80: I interacted with a nova people on IRC :p | 19:20 |
| number80 | if we keep pulling them, we're just spending time doing things and then reverting | 19:20 |
| apevec_ | dmsimard, have them leave comments in review.rdo | 19:20 |
| number80 | they're as much responsible of the package as we are | 19:21 |
| apevec_ | really, w/o component teams starting to care about their rpm-master, dist isn't going to work | 19:22 |
| number80 | *nods* | 19:22 |
| number80 | dmsimard: not against you, you did right | 19:22 |
| apevec_ | we have good examples w/ telemetry (pradk) and neutron (ihar et co) | 19:22 |
| *** akrivoka has quit IRC | 19:22 | |
| number80 | egafford and tosky does their fair share w/ sahara | 19:22 |
| number80 | (QE people have also their say as they tend to have good expertise on running services) | 19:23 |
| trown | mlammon: I am not finding it... it is a specific issue with the image build in RDO https://github.com/redhat-openstack/ansible-role-tripleo-image-build | 19:24 |
| trown | mlammon: filing an issue there would make sense | 19:25 |
| number80 | anyone contributing upstream is welcome to work on packaging (submitting/reviewing/commenting patchset) | 19:25 |
| number80 | I mean anyone | 19:25 |
| *** READ10 has quit IRC | 19:27 | |
| *** ihrachys has quit IRC | 19:27 | |
| number80 | the very core of good packaging is to know well the software you package | 19:29 |
| number80 | if people keep relying solely on few individuals, then it's no good as we can't have expertise on all components | 19:30 |
| *** choirboy is now known as choirboy|lunch | 19:30 | |
| mlammon | trown: okay , thanks | 19:30 |
| *** beagles is now known as beagles_biab | 19:30 | |
| *** jerrygb has quit IRC | 19:32 | |
| mlammon | sasha: ohochmanlook at trown response ^^ do we need to try and resolve this or safe to move on with some tests? | 19:33 |
| *** ihrachys has joined #rdo | 19:33 | |
| trown | mlammon: `yum install -y python-redis` on overcloud controllers fixes it | 19:33 |
| mlammon | trown: ah, ok thanks. | 19:36 |
| dmsimard | number80, apevec: any idea why puppet modules don't have repositories in rdo-packages ? | 19:38 |
| dmsimard | apevec_: ^ | 19:38 |
| rdogerrit | David Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects http://review.rdoproject.org/r/1662 | 19:39 |
| *** sdake_ has joined #rdo | 19:39 | |
| *** sdake has quit IRC | 19:40 | |
| *** jerrygb has joined #rdo | 19:40 | |
| number80 | dmsimard: because they're puppet modules. Joke aside, no idea | 19:41 |
| rdogerrit | David Moreau Simard created config: Add a sanity-check script to validate the config repository http://review.rdoproject.org/r/1700 | 19:41 |
| dmsimard | number80, tristanC: https://review.rdoproject.org/r/#/c/1700/ | 19:42 |
| dmsimard | see my comment for example output | 19:43 |
| rdogerrit | David Moreau Simard proposed config: Add a sanity-check script to validate the config repository http://review.rdoproject.org/r/1700 | 19:44 |
| *** shardy has quit IRC | 19:45 | |
| *** maeca1 has joined #rdo | 19:47 | |
| apevec_ | dmsimard, replication? | 19:47 |
| apevec_ | distgit or patches? | 19:47 |
| dmsimard | apevec_: both | 19:47 |
| apevec_ | we don't replicate any patches | 19:47 |
| dmsimard | apevec_: neither are in rdo-packages | 19:47 |
| apevec_ | that doesn't make sense b/c patches are left unmerged | 19:47 |
| dmsimard | https://github.com/rdo-packages?utf8=✓&query=puppet | 19:48 |
| apevec_ | and since puppet specs are generated, I don't think it's interesting to replicated them either | 19:48 |
| dmsimard | they were generated originally, they're maintained afterwards ? | 19:49 |
| dmsimard | I don't care (that much) tbh, just looking at the output of my new script to detect inconsistencies in config http://paste.openstack.org/raw/53EERSgjtQYXHTV9zpfT/ | 19:49 |
| *** ihrachys has quit IRC | 19:50 | |
| tristanC | dmsimard: reviewing now, shouldn't this be used by the config-check job ? | 19:50 |
| dmsimard | tristanC: yes, that's the point | 19:51 |
| *** vaneldik has quit IRC | 19:51 | |
| dmsimard | It looks like we might want some level of freedom over what is replicated and isn't, though, so I need to bake that in | 19:51 |
| tristanC | dmsimard: running it locally, you need to add whitelist for project such as All-User | 19:52 |
| dmsimard | tristanC: yeah.. | 19:54 |
| dmsimard | tristanC: the script is a safety net for me for the upcoming changes with the integrated jobs -- quite a refactor | 19:55 |
| dmsimard | the fact that the config-check job passes doesn't mean that I didn't screw up :) | 19:55 |
| *** lpabon has quit IRC | 19:56 | |
| *** flepied has quit IRC | 19:58 | |
| number80 | dmsimard: small changes here and there, including py3 compat | 20:03 |
| number80 | we should prepare for that | 20:03 |
| dmsimard | sure, ty | 20:03 |
| *** jprovazn has quit IRC | 20:04 | |
| *** laron has quit IRC | 20:04 | |
| number80 | dmsimard++ | 20:04 |
| zodbot | number80: Karma for dmsimard changed to 4 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 20:04 |
| *** brault has quit IRC | 20:05 | |
| *** hrww has joined #rdo | 20:09 | |
| *** gfidente is now known as gfidente|afk | 20:11 | |
| *** shardy has joined #rdo | 20:12 | |
| number80 | https://review.rdoproject.org/r/#/c/1699/ <-- do not be surprised by the changes, I just made it future-proof | 20:12 |
| *** iranzo has quit IRC | 20:13 | |
| * number80 wishes that RPM supported regular expressions rather than globbing | 20:13 | |
| *** newuser_rdo has quit IRC | 20:13 | |
| *** DaveJ__ has joined #rdo | 20:17 | |
| *** jeckersb is now known as jeckersb_gone | 20:19 | |
| rdogerrit | David Moreau Simard proposed config: Add a sanity-check script to validate the config repository http://review.rdoproject.org/r/1700 | 20:20 |
| dmsimard | number80, tristanC ^ | 20:20 |
| dmsimard | and I'll even submit a follow-up patch to fix the detected errors :) | 20:20 |
| number80 | dmsimard: good enough to be merged for me | 20:23 |
| number80 | You even fixed the StringIO moves that I forgot | 20:24 |
| *** akshai_ has quit IRC | 20:24 | |
| rdogerrit | David Moreau Simard created config: Add missing projects to gerritbot and alpha sort http://review.rdoproject.org/r/1701 | 20:24 |
| dmsimard | number80: now, what this script doesn't tell us, though, is if there are stale projects | 20:25 |
| dmsimard | i.e, projects configured in zuul that have been deleted from gerrit | 20:25 |
| dmsimard | I thought one-way verification with the gerrit project list being the source of truth was a good start | 20:25 |
| dmsimard | we can iterate on that later | 20:25 |
| *** ashw has joined #rdo | 20:25 | |
| *** pilasguru has joined #rdo | 20:26 | |
| number80 | dmsimard: that's still better than nothing | 20:26 |
| number80 | can't wait to be at flock, I'll have plenty of time to hack :) | 20:27 |
| dmsimard | flock ? | 20:28 |
| number80 | the fedora conference | 20:29 |
| number80 | https://flocktofedora.org/ | 20:29 |
| dmsimard | ahhhhhhh | 20:29 |
| dmsimard | tristanC: the sfmanager CLI is a bit tricky | 20:29 |
| dmsimard | sfmanager --url <url> command works | 20:30 |
| * number80 does background tasks during conferences as he gets less interrupted | 20:30 | |
| *** egafford has quit IRC | 20:30 | |
| dmsimard | but not sfmanager command --url <url> | 20:30 |
| *** egafford has joined #rdo | 20:31 | |
| number80 | argparse limitation | 20:31 |
| dmsimard | number80: so are these projects legit ? http://paste.openstack.org/show/539110/ | 20:31 |
| dmsimard | I guess qpid and tuskar could be deleted from gerrit | 20:31 |
| dmsimard | EmilienM: right? ^ | 20:31 |
| number80 | tuskar yes | 20:31 |
| number80 | qpid wait for it, someone is working toward reintroducing them | 20:32 |
| EmilienM | yes | 20:34 |
| rdogerrit | David Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort http://review.rdoproject.org/r/1701 | 20:35 |
| apevec_ | trown, EmilienM https://review.openstack.org/345588 is ready for +W now? | 20:35 |
| *** laron has joined #rdo | 20:35 | |
| apevec_ | number80, not qpid | 20:35 |
| apevec_ | amqp | 20:35 |
| trown | apevec_: nope it is waiting on ovb job | 20:36 |
| *** akshai has joined #rdo | 20:36 | |
| EmilienM | apevec_: not yet, waiting for the job that deploys ovb undercloud | 20:36 |
| apevec_ | how do you tell? | 20:36 |
| *** shaunm has joined #rdo | 20:36 | |
| EmilienM | trown: feel free to +A it when green | 20:36 |
| trown | apevec_: in any case there is another issue preventing registering nodes in ironic, that does not even have a patch up | 20:36 |
| apevec_ | crap | 20:36 |
| trown | I was trying to work on it, but the way mistral loads actions is befuddling me | 20:37 |
| trown | my local hacks on the code seem to have no effect | 20:37 |
| apevec_ | it's a wind, so blows your mind! | 20:37 |
| richm | "The answer my friends, is blowin' in the wind . . ." | 20:38 |
| tristanC | dmsimard: note that we are adding project listing, api_key authentication mechanism and sfmanager configuration file, cli usage should be improved soon | 20:40 |
| *** abregman has joined #rdo | 20:42 | |
| tristanC | though in the meantime, what you propose sounds good to me | 20:42 |
| *** dprince has quit IRC | 20:44 | |
| rdogerrit | David Moreau Simard created config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 20:47 |
| *** maeca1 has quit IRC | 20:50 | |
| *** jeckersb_gone is now known as jeckersb | 20:51 | |
| *** pilasguru has quit IRC | 20:53 | |
| rdogerrit | David Moreau Simard proposed config: Add a sanity-check script to validate the config repository http://review.rdoproject.org/r/1700 | 20:53 |
| *** pilasguru has joined #rdo | 20:53 | |
| rdogerrit | David Moreau Simard proposed config: Add a sanity-check script to validate the config repository http://review.rdoproject.org/r/1700 | 20:53 |
| rdogerrit | David Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort http://review.rdoproject.org/r/1701 | 20:54 |
| rdogerrit | David Moreau Simard proposed config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 20:54 |
| rdogerrit | David Moreau Simard proposed config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 20:55 |
| *** shaunm has quit IRC | 20:55 | |
| apevec_ | trown, so we should pin ironic, to n2 tag ? | 20:58 |
| apevec_ | when mistral was introduced in ironic? | 20:58 |
| *** bfournie1 has joined #rdo | 20:59 | |
| rdogerrit | David Moreau Simard proposed config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 20:59 |
| trown | apevec_: it is not ironic problem, they have had current behavior since mitaka or liberty, it is tripleo/mistral issue | 21:00 |
| rdogerrit | David Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort http://review.rdoproject.org/r/1701 | 21:00 |
| rdogerrit | David Moreau Simard proposed config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 21:00 |
| trown | apevec_: prior to the switch to mistral for node registration, tripleo pinned to a specific microversion of ironic api (1.11), but mistral does not have that pin | 21:00 |
| apevec_ | ah microversion api, not version of ironic | 21:01 |
| dmsimard | apevec_: re: sanity-check and rdoinfo, yes .. maybe, in another iteration. Have to take into consideration review.rdo hosts projects that aren't involved with rdoinfo (easy example: weirdo and puppet-dlrn) | 21:01 |
| *** bfournie has quit IRC | 21:01 | |
| apevec_ | tristanC, ^ dmsimard, right, we'd need to somehow mark which projects are imported from rdoinfo | 21:01 |
| dmsimard | apevec_: I can reverse check rdoinfo -> gerrit | 21:02 |
| apevec_ | tristanC, is there something in SF datamodel for that? | 21:02 |
| dmsimard | instead of gerrit -> rdoinfo | 21:02 |
| apevec_ | ah yes, that will work | 21:02 |
| dmsimard | right now gerrit is the source of truth | 21:02 |
| *** ccamacho has quit IRC | 21:02 | |
| apevec_ | but you would miss projects removed from rdoinfo like puppet-qpid | 21:02 |
| dmsimard | yes | 21:03 |
| dmsimard | definitely want to do it, eventually :) | 21:03 |
| rdogerrit | David Moreau Simard proposed config: Add projects that are missing in the Zuul layout http://review.rdoproject.org/r/1702 | 21:07 |
| rdogerrit | David Moreau Simard created config: Add a config-sanity-check job to the config repository http://review.rdoproject.org/r/1703 | 21:07 |
| dmsimard | https://review.rdoproject.org/r/#/q/topic:integrated-pipeline-refactor ready for review :) | 21:08 |
| dmsimard | It's a pre-requisite to the ongoing work I've been doing to refactor the pipeline with integrated dlrn/weirdo jobs | 21:09 |
| larsks | Anybody around who is familiar with pbr? | 21:09 |
| larsks | Actually, belay that, have to go pick up kids... | 21:09 |
| *** unclemarc has quit IRC | 21:12 | |
| *** dustins has quit IRC | 21:13 | |
| *** julim_ has quit IRC | 21:14 | |
| number80 | I'm wondering if it's good idea or not to send internal DFG reports on the rdo-list | 21:18 |
| *** trown is now known as trown|outtypewww | 21:19 | |
| *** bandini has quit IRC | 21:22 | |
| rdogerrit | Merged openstack/swift-distgit: Consolidate the code in the main package python-swift http://review.rdoproject.org/r/1575 | 21:23 |
| *** laron has quit IRC | 21:24 | |
| *** ihrachys has joined #rdo | 21:25 | |
| *** laron has joined #rdo | 21:25 | |
| *** jlabocki has quit IRC | 21:28 | |
| *** ihrachys has quit IRC | 21:29 | |
| *** laron has quit IRC | 21:34 | |
| *** shardy has quit IRC | 21:39 | |
| *** Son_Goku has joined #rdo | 21:40 | |
| *** bfournie1 has quit IRC | 21:43 | |
| *** akshai has quit IRC | 21:51 | |
| *** dtrainor_ has joined #rdo | 21:53 | |
| *** dtrainor has quit IRC | 21:53 | |
| *** Son_Goku has quit IRC | 21:56 | |
| *** ihrachys has joined #rdo | 21:57 | |
| *** jmelvin has quit IRC | 21:59 | |
| *** dtrainor_ has quit IRC | 22:11 | |
| *** jayg is now known as jayg|g0n3 | 22:15 | |
| *** paramite has quit IRC | 22:16 | |
| *** apevec_ has quit IRC | 22:18 | |
| *** jeckersb is now known as jeckersb_gone | 22:19 | |
| *** mlammon has quit IRC | 22:21 | |
| *** sdake_ has quit IRC | 22:24 | |
| *** jeckersb_gone is now known as jeckersb | 22:27 | |
| *** dtrainor_ has joined #rdo | 22:29 | |
| *** eharney has quit IRC | 22:30 | |
| *** gfidente|afk has quit IRC | 22:38 | |
| *** KarlchenK has quit IRC | 22:39 | |
| *** imcleod has quit IRC | 22:42 | |
| *** kgiusti has left #rdo | 22:43 | |
| *** sdake has joined #rdo | 22:49 | |
| *** morazi has quit IRC | 22:51 | |
| *** ashw has quit IRC | 22:54 | |
| *** jargonmonk has quit IRC | 22:54 | |
| *** kaminohana has joined #rdo | 22:55 | |
| *** jerrygb has quit IRC | 22:55 | |
| *** akshai has joined #rdo | 22:57 | |
| *** ihrachys has quit IRC | 23:00 | |
| *** ashw has joined #rdo | 23:03 | |
| *** pilasguru has quit IRC | 23:04 | |
| *** ashw has quit IRC | 23:20 | |
| *** elmiko is now known as _elmiko | 23:21 | |
| *** chopmann has joined #rdo | 23:25 | |
| *** akshai has quit IRC | 23:26 | |
| *** pilasguru has joined #rdo | 23:33 | |
| *** saneax_AFK is now known as saneax | 23:33 | |
| *** zodbot has quit IRC | 23:44 | |
| *** zodbot_ has joined #rdo | 23:44 | |
| *** zodbot_ is now known as zodbot | 23:45 | |
| *** gildub has joined #rdo | 23:48 | |
| pabelanger | dmsimard: number80: who do we need to talk to to enable rsync on cloud.centos.org? | 23:49 |
| pabelanger | no easy way to mirror the cloud images | 23:49 |
| pabelanger | better yet, adding them into mirror.centos.org | 23:50 |
| *** danofsatx has joined #rdo | 23:51 | |
| *** jeckersb is now known as jeckersb_gone | 23:53 | |
| *** cpg is now known as cpg|away | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!