Wednesday, 2018-02-21

*** openstackstatus has quit IRC00:12
*** openstackstatus has joined #openstack-ironic00:14
*** ChanServ sets mode: +v openstackstatus00:14
*** AlexeyAbashkin has joined #openstack-ironic00:23
*** AlexeyAbashkin has quit IRC00:27
*** alineb has quit IRC00:41
*** akhilaki_ has joined #openstack-ironic00:42
*** akhilaki_ has joined #openstack-ironic00:43
*** d0ugal_ has joined #openstack-ironic00:48
rpiosojroll: http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n44501:00
*** rpioso is now known as rpioso|afk01:01
*** akhilaki_ has quit IRC01:02
*** openstackgerrit has joined #openstack-ironic01:03
openstackgerritJohn L. Villalovos proposed openstack/ironic stable/ocata: DNM/WIP: Testing  https://review.openstack.org/54646401:03
*** tiendc has joined #openstack-ironic01:07
*** alineb has joined #openstack-ironic01:11
*** tiendc has quit IRC01:17
*** tiendc has joined #openstack-ironic01:19
openstackgerritMerged openstack/ironic stable/pike: Clean nodes stuck in CLEANING state when ir-cond restarts  https://review.openstack.org/54608301:26
*** hshiina has joined #openstack-ironic01:28
*** rcernin has quit IRC01:36
*** rcernin has joined #openstack-ironic01:36
*** rcernin has quit IRC01:42
*** rcernin has joined #openstack-ironic01:43
*** sapd has joined #openstack-ironic01:51
*** rcernin has quit IRC01:53
*** rcernin has joined #openstack-ironic01:53
openstackgerritHironori Shiina proposed openstack/ironic master: Set 'initrd' to 'rescue_ramdisk' for rescue with iPXE  https://review.openstack.org/54518601:55
*** khyr0n has quit IRC01:58
*** phuongnh has joined #openstack-ironic02:21
*** khyr0n has joined #openstack-ironic02:27
*** harlowja_ has quit IRC02:28
*** links has joined #openstack-ironic02:49
*** akhilaki has joined #openstack-ironic03:13
*** stendulker has joined #openstack-ironic03:22
*** AlexeyAbashkin has joined #openstack-ironic03:23
*** stendulker has quit IRC03:23
*** AlexeyAbashkin has quit IRC03:27
*** stendulker has joined #openstack-ironic03:54
*** vsaienk0 has joined #openstack-ironic03:58
*** khyr0n has quit IRC03:59
*** vsaienk0 has quit IRC04:09
*** d0ugal__ has joined #openstack-ironic04:12
*** d0ugal_ has quit IRC04:15
*** AlexeyAbashkin has joined #openstack-ironic04:22
*** tiendc has quit IRC04:23
*** phuongnh has quit IRC04:23
*** phuongnh has joined #openstack-ironic04:23
*** tiendc has joined #openstack-ironic04:23
*** AlexeyAbashkin has quit IRC04:26
*** fragatina has joined #openstack-ironic05:10
openstackgerritNisha Agarwal proposed openstack/ironic master: Update iLO documentation for deprecating classical drivers  https://review.openstack.org/54259305:14
*** khyr0n has joined #openstack-ironic05:15
*** khyr0n has quit IRC05:16
*** khyr0n has joined #openstack-ironic05:17
*** etingof has quit IRC05:19
*** etingof has joined #openstack-ironic05:27
*** vsaienk0 has joined #openstack-ironic05:28
*** dpawar has joined #openstack-ironic05:30
*** vsaienk0 has quit IRC05:38
*** marios has joined #openstack-ironic06:03
*** pmannidi has quit IRC06:04
*** d0ugal__ has quit IRC06:27
*** d0ugal__ has joined #openstack-ironic06:32
*** charcol-v2 has joined #openstack-ironic06:40
*** charcol-v2 has quit IRC06:46
*** hjensas has quit IRC06:51
*** d0ugal__ has quit IRC06:52
*** mjura has joined #openstack-ironic07:04
*** vsaienk0 has joined #openstack-ironic07:06
*** khyr0n has quit IRC07:09
*** yangyape_ has quit IRC07:11
*** yangyapeng has joined #openstack-ironic07:12
*** yangyapeng has quit IRC07:17
*** rcernin has quit IRC07:21
*** parlos has joined #openstack-ironic07:23
*** fragatina has quit IRC07:41
*** hoonetorg has quit IRC07:46
*** pcaruana has joined #openstack-ironic07:47
*** fragatina has joined #openstack-ironic07:50
*** e0ne has joined #openstack-ironic07:52
*** fragatina has quit IRC07:54
*** hjensas has joined #openstack-ironic07:55
*** d0ugal has joined #openstack-ironic07:55
*** d0ugal has quit IRC07:55
*** d0ugal has joined #openstack-ironic07:55
*** hoonetorg has joined #openstack-ironic08:00
*** d0ugal has quit IRC08:00
*** d0ugal has joined #openstack-ironic08:01
*** MattMan has quit IRC08:03
*** akhilaki has quit IRC08:03
*** MattMan has joined #openstack-ironic08:03
*** e0ne has quit IRC08:04
*** d0ugal has quit IRC08:06
*** fragatina has joined #openstack-ironic08:06
*** fragatina has quit IRC08:08
*** fragatina has joined #openstack-ironic08:09
*** vabada has quit IRC08:11
*** vabada has joined #openstack-ironic08:12
*** fragatina has quit IRC08:13
*** d0ugal has joined #openstack-ironic08:15
*** e0ne has joined #openstack-ironic08:16
*** sapd_ has joined #openstack-ironic08:17
*** AlexeyAbashkin has joined #openstack-ironic08:22
*** athomas has joined #openstack-ironic08:27
*** d0ugal has quit IRC08:29
*** tesseract has joined #openstack-ironic08:34
*** d0ugal has joined #openstack-ironic08:34
*** d0ugal has quit IRC08:39
openstackgerritHironori Shiina proposed openstack/ironic master: Set 'initrd' to 'rescue_ramdisk' for rescue with iPXE  https://review.openstack.org/54518608:39
openstackgerritNisha Agarwal proposed openstack/ironic master: Update iLO documentation for deprecating classical drivers  https://review.openstack.org/54259308:40
*** e0ne has quit IRC08:47
*** d0ugal has joined #openstack-ironic08:48
*** d0ugal has quit IRC08:48
*** d0ugal has joined #openstack-ironic08:48
*** d0ugal has quit IRC08:58
*** jtomasek has joined #openstack-ironic09:01
*** vsaienk0 has quit IRC09:06
*** d0ugal has joined #openstack-ironic09:07
*** hamzy_ has joined #openstack-ironic09:17
*** hamzy has quit IRC09:19
*** mgoddard_ has joined #openstack-ironic09:19
*** derekh has joined #openstack-ironic09:39
openstackgerritNguyen Hung Phuong proposed openstack/python-ironic-inspector-client master: Clean imports in code  https://review.openstack.org/54655009:39
openstackgerritDao Cong Tien proposed openstack/ironic-tempest-plugin master: Rescue mode tempest tests  https://review.openstack.org/52869909:42
openstackgerritDmitry Tantsur proposed openstack/ironic stable/queens: Increase the instance_info column size to LONGTEXT on MySQL/MariaDB  https://review.openstack.org/54655109:45
openstackgerritDao Cong Tien proposed openstack/ironic-tempest-plugin master: Rescue mode standalone tests  https://review.openstack.org/53811909:47
*** csatari has joined #openstack-ironic09:58
*** dtantsur|afk is now known as dtantsur10:02
dtantsurmorning ironic10:02
*** pcaruana has quit IRC10:05
*** d0ugal_ has joined #openstack-ironic10:06
*** d0ugal has quit IRC10:06
*** hjensas has quit IRC10:08
etingofo/10:11
*** d0ugal_ has quit IRC10:11
*** d0ugal_ has joined #openstack-ironic10:13
*** d0ugal__ has joined #openstack-ironic10:17
*** d0ugal_ has quit IRC10:18
*** pcaruana has joined #openstack-ironic10:20
*** e0ne has joined #openstack-ironic10:21
* dtantsur can finally propose meaningful names for the S release \o/10:24
* dtantsur really likes OpenStack Spree though :)10:26
*** parlos has quit IRC10:26
*** jaganathan has quit IRC10:27
*** hjensas has joined #openstack-ironic10:29
*** priteau has joined #openstack-ironic10:34
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: DNM experiment re-using devstack-tempest job  https://review.openstack.org/52016710:38
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: DNM experiment re-using devstack-tempest job  https://review.openstack.org/52016710:44
etingofdtantsur, Schönefeld/berg ;)10:46
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: DNM experiment re-using devstack-tempest job  https://review.openstack.org/52016710:46
dtantsuretingof: I think Schoneberg is there10:47
* etingof expects quite some UnicodeDecodeError's ;)10:48
*** d0ugal__ has quit IRC10:54
*** d0ugal has joined #openstack-ironic10:54
*** d0ugal has quit IRC10:54
*** d0ugal has joined #openstack-ironic10:54
*** phuongnh has quit IRC11:04
*** manjeets has quit IRC11:05
*** manjeets has joined #openstack-ironic11:06
*** tiendc has quit IRC11:12
*** stendulker has quit IRC11:12
*** parlos has joined #openstack-ironic11:14
*** pcaruana has quit IRC11:19
*** d0ugal has quit IRC11:23
*** etingof has quit IRC11:23
*** etingof has joined #openstack-ironic11:28
*** d0ugal has joined #openstack-ironic11:30
*** pcaruana has joined #openstack-ironic11:33
dtantsuretingof: haha. well, they only accept ASCII12:03
dtantsurotherwise imagine the actual spelling of OpenStack Ocata (IIRC) ;)12:04
*** d0ugal has quit IRC12:06
*** parlos has quit IRC12:07
*** d0ugal has joined #openstack-ironic12:10
*** parlos has joined #openstack-ironic12:13
*** mgagne has quit IRC12:19
*** d0ugal has quit IRC12:20
*** d0ugal has joined #openstack-ironic12:22
*** dprince has joined #openstack-ironic12:23
openstackgerritHironori Shiina proposed openstack/ironic master: Refresh port before storing VIF ID for cleaning  https://review.openstack.org/54658412:31
*** d0ugal has quit IRC12:34
*** mgagne has joined #openstack-ironic12:36
*** mgagne is now known as Guest2094612:36
*** milan_ has joined #openstack-ironic12:39
*** persia has quit IRC12:46
*** persia has joined #openstack-ironic12:47
*** melwitt has quit IRC12:47
*** melwitt has joined #openstack-ironic12:52
*** weshay_PTO is now known as weshay13:04
*** rbartal has joined #openstack-ironic13:11
*** d0ugal has joined #openstack-ironic13:13
*** d0ugal_ has joined #openstack-ironic13:19
*** d0ugal has quit IRC13:20
*** ricardoas has joined #openstack-ironic13:20
*** d0ugal_ has quit IRC13:25
*** hjensas has quit IRC13:27
hshiinahi, it seems that vif detach without a lock causes another issue: https://bugs.launchpad.net/ironic/+bug/175078513:36
openstackLaunchpad bug 1750785 in Ironic "Detached VIF may be restored during node cleaning" [Undecided,In progress] - Assigned to Hironori Shiina (shiina-hironori)13:36
hshiinai wounder if we should revert the lock removal or fix this issue for queens.13:36
dtantsurhshiina: hi! oh.. cannot we land and backport your patch above though?13:37
*** d0ugal_ has joined #openstack-ironic13:38
*** dpawar has quit IRC13:38
hshiinadtantsur: i think we can land my patch to mitigate this issue.13:39
openstackgerritDmitry Tantsur proposed openstack/ironic master: Rework logic handling reserved orphaned nodes in the conductor  https://review.openstack.org/54627313:41
dtantsurhshiina: anyway, thanks for raising this. I'll check with other folks later today to see what they think.13:41
dtantsurjroll, TheJulia, ^^^13:42
hshiinadtantsur: thanks, i'm afraid i have to go home soon13:46
dtantsurhshiina: sure, have a nice evening13:46
hshiinadtantsur: thank you, good evening13:46
*** d0ugal_ has quit IRC13:48
*** d0ugal has joined #openstack-ironic13:48
*** d0ugal has quit IRC13:48
*** d0ugal has joined #openstack-ironic13:48
*** hshiina is now known as hshiina|afk13:50
openstackgerritDmitry Tantsur proposed openstack/ironic master: Rework logic handling reserved orphaned nodes in the conductor  https://review.openstack.org/54627313:55
*** d0ugal has quit IRC13:58
*** d0ugal has joined #openstack-ironic13:59
*** cdearborn has joined #openstack-ironic14:01
*** parlos has quit IRC14:01
*** parlos has joined #openstack-ironic14:04
*** d0ugal has quit IRC14:04
TheJuliaGood morning everyone14:10
dtantsurmorning TheJulia14:10
*** Goneri has joined #openstack-ironic14:12
*** cdearborn has quit IRC14:12
TheJuliahshiina|afk: ugh, the vif should never get restored out of cleaning... I guess the port is saving :\14:13
TheJuliadtantsur: +1 to Spree14:14
*** etingof has quit IRC14:14
openstackgerritDmitry Tantsur proposed openstack/ironic master: Rework logic handling reserved orphaned nodes in the conductor  https://review.openstack.org/54627314:21
*** d0ugal has joined #openstack-ironic14:22
*** hshiina|afk has quit IRC14:27
*** links has quit IRC14:29
openstackgerritMark Goddard proposed openstack/ironic master: Support nested objects and object lists in as_dict  https://review.openstack.org/54583014:29
*** mjturek has joined #openstack-ironic14:31
jrollmorning y'all14:36
* jroll looks at vif thing14:36
dtantsurit sounds like hshiina's patch is just a work around, and still a racy one14:37
*** dmellado has quit IRC14:37
dtantsurI wonder if we should get back to locking..14:38
dtantsurjroll: this is also ready for review: https://review.openstack.org/54627314:39
patchbotpatch 546273 - ironic - Rework logic handling reserved orphaned nodes in t...14:39
* jroll will look14:40
*** dmellado has joined #openstack-ironic14:42
openstackgerritMark Goddard proposed openstack/ironic master: Register traits on nodes in devstack  https://review.openstack.org/54537014:48
openstackgerritMark Goddard proposed openstack/ironic master: Validate instance_info.traits against node traits  https://review.openstack.org/54346114:48
TheJuliadtantsur: we really just need to remove the vif upon teardown, we just can't have it each and every different way imho14:49
dtantsurmaybe.. what's the reason we don't remove it automatically?14:49
*** d0ugal has quit IRC14:49
TheJuliaresistance14:49
TheJuliadesire for pet management14:49
TheJuliaassertion nova should remove, but we are super slow14:50
*** baha has joined #openstack-ironic14:50
TheJuliawe being super slow meaning all of the processes we have to walk through to the point where nova could possibly complete the removal of the vif record14:50
dtantsurwhat's the problem with pet management though?14:51
TheJuliaIn so as much as nova's use model doesn't support it. The contract we established with nova was that nova was to add the vifs, and then remove the vifs via ironic. The pet management desire is for the vif to live to the machine after removal from active state14:52
dtantsurugh14:52
jrollyeah, I still don't buy that argument14:53
TheJulianor do I, I think we should nuke it14:53
jrollif you're going to need the vif on the same machine again, add it again14:53
TheJulia++14:53
TheJuliathere is also rebuild which could be useful for a number of situations where a machine is desired to be rebuilt. We keep the vifs for that14:53
jrollindeed14:54
TheJuliathe only middle ground is gutting and re-doing locking14:56
*** fragatina has joined #openstack-ironic14:56
jrollwhich we need to do, just isn't a short term thing :)14:57
TheJuliayeah, it is a very long term thing :(14:57
*** d0ugal has joined #openstack-ironic14:57
TheJuliabecause we would have to plan that across a release boundry and have dual locking behavior potentially14:58
*** etingof has joined #openstack-ironic14:59
jrollso fun14:59
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Prevent overwriting of last_error on cleaning failures  https://review.openstack.org/54665615:00
*** crushil_ has joined #openstack-ironic15:00
*** crushil has joined #openstack-ironic15:00
TheJuliaEINSUFFCENTLIQUOR15:00
*** crushil_ has quit IRC15:00
TheJuliaAnyway, packing up this laptop because I need to head to $new_house15:01
jrollwoot15:01
jrollsee you later \o15:01
*** edleafe has quit IRC15:12
*** edleafe has joined #openstack-ironic15:12
*** rloo has joined #openstack-ironic15:13
rloogood morning to all ironickers in the universe. This means jroll, dtantsur, TheJulia!15:19
dtantsurmorning rloo15:19
rlooderekh: btw, thx for booking the pub for our PTG festivities!15:20
derekhrloo: no prob at all15:20
dtantsurderekh++15:20
rlooderekh: :)15:22
*** yangyapeng has joined #openstack-ironic15:32
*** deadnull has joined #openstack-ironic15:35
openstackgerritMerged openstack/ironic stable/queens: Increase the instance_info column size to LONGTEXT on MySQL/MariaDB  https://review.openstack.org/54655115:45
rloodtantsur and others: i was reviewing the VNC graphical console spec: https://review.openstack.org/#/c/306074/15:46
patchbotpatch 306074 - ironic-specs - VNC Graphical console15:46
rloodtantsur: do you know whether we need to have both serial & graphical consoles for a node, at the same time? Or only one console max, at any time?15:47
dtantsurrloo: both, these are separate interfaces with potentially separate purposes15:47
rloodtantsur: so you see it as a new interface, not a ConsoleInterface?15:48
dtantsurrloo: this is pretty much what we all agreed on, no?15:48
dtantsurthis has been discussed twice with the same outcome :)15:48
rloodtantsur: i don't recall. i can look at past etherpads to see. i am asking cuz the existing spec isn't clear to me.15:48
rloodtantsur: it makes sense for there to be two separate interfaces. maybe i am misunderstanding the current spec. sigh. i'll look at past etherpads. we need to get these done sooner :-(15:49
*** rbartal has quit IRC15:53
dtantsurI'm not sure what we would get by mixing console and graphical interfaces, to be honest. less additions to API - yes, but these are really not the same things, and probably won't even conflict15:53
dtantsurah, yeah, I was also about to bring console logging, but Tim beat me to it15:54
*** r-daneel has joined #openstack-ironic15:54
rloodtantsur: i saw two ways of implementing; easiest is a new eg GraphicalConsoleinterface. Harder but maybe? simpler, is existing ConsoleInterface supporting both serial and graphical, and we'd have to change some internal stuff to allow more than one of them per node (which is probably do-able and maybe useful for future stuff but ugh).15:56
rloodtantsur: i think there is a spec for console logging but not sure. sooo many specs... :-(15:56
dtantsurit may be dangerous to assume that console and graphical access it using the same tech15:57
dtantsure.g. we can have a vendor VNC but generic ipmitool sol15:57
dtantsurwe can solve it with inheritance, but it may get ugly soon15:57
dtantsuralso: I've been doing the driver composition so that we can have MOAR INTERFACES \o/15:57
rloodtantsur: right, that's the ugh part. i'm not sure exactly what it would entail, which means it could take longer to do15:58
rloodtantsur: OH. i thought we didn't want to add more interfaces! :)15:58
*** r-daneel_ has joined #openstack-ironic16:01
*** r-daneel has quit IRC16:02
*** r-daneel_ is now known as r-daneel16:02
*** zer0c00l has quit IRC16:04
*** crushil has quit IRC16:06
*** crushil has joined #openstack-ironic16:06
*** manjeets has quit IRC16:11
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Prevent overwriting of last_error on cleaning failures  https://review.openstack.org/54665616:11
dtantsurrloo: with the driver composition in place it's much less of a pain16:13
rloodtantsur: true! If we're ok with an explosion of interfaces, corresponding configs, etc :) but why not!16:13
*** pcaruana has quit IRC16:16
dtantsurrloo: as small review, if you don't mind https://review.openstack.org/54528516:19
patchbotpatch 545285 - ironic-inspector - Switch documentation to hardware types16:19
*** openstackgerrit has quit IRC16:19
rloodtantsur: sure, in a few minutes; i'm going back in history right now, about vnc consoles :)16:19
dtantsurack16:19
rloodtantsur: ok, going to take a break from that cuz yeah, we talked about it in newton summit, apr 2016 :-(16:24
dtantsurtime flies..16:24
*** dprince has quit IRC16:24
rloodtantsur: https://etherpad.openstack.org/p/ironic-rocky-ptg-graphical-console. i was going to copy/paste the stuff from the past ...16:25
rloodtantsur: i might still do it... i think it is good/bad/eye opener/<add your adjective here>16:25
dtantsuryep, thanks for keeping an eye on it!16:29
*** AlexeyAbashkin has quit IRC16:35
*** parlos has quit IRC16:36
*** dprince has joined #openstack-ironic16:37
*** r-daneel_ has joined #openstack-ironic16:43
*** r-daneel has quit IRC16:44
*** r-daneel_ is now known as r-daneel16:44
dtantsurrloo: another urgent thing for queens: https://bugs.launchpad.net/ironic/+bug/1750785 and https://review.openstack.org/54658416:53
openstackLaunchpad bug 1750785 in Ironic "Detached VIF may be restored during node cleaning" [High,In progress] - Assigned to Hironori Shiina (shiina-hironori)16:53
patchbotpatch 546584 - ironic - Refresh port before storing VIF ID for cleaning16:53
dtantsurwhat do you think about the work around?16:53
rloodtantsur: two patches?16:53
dtantsurrloo: now, I'm just linking both the bug and the patch16:54
rloodtantsur: oh, one is a bug16:54
rloodtantsur: let me look...16:54
*** khyr0n has joined #openstack-ironic16:56
*** khyr0n has quit IRC17:07
NobodyCamGood Morning Ironic'ers17:08
rloodtantsur: what about reverting the vif detach w/o locking thing?17:10
dtantsurrloo: I'm kind of leaning towards it as well.. but I'm not sure what we'll regress on /cc TheJulia17:11
rloodtantsur: what are the ramifications if the tenant_vif_port_id is accidentally restored?17:11
*** athomas has quit IRC17:11
dtantsurrloo: it will mean restoring the VIF if I get it right17:11
rloodtantsur: right, which means... ?? we cannot attach another vif?17:12
dtantsurrloo: yep, I guess this port is "occupied"17:12
rloodtantsur: that would be bad then. since eg, this is in cleaning, the node is getting ready to be used again. by another tenant or whatever.17:13
dtantsurcorrect17:13
rloodtantsur: i feel like we should revert17:14
dtantsuryeah, it may be the correct thing to do17:15
dtantsurrloo: wanna propose the revert?17:16
rloodtantsur: the only other thing we can do is to change that patch to eg add some 'locking' when modifying a port but i'm not sure it is worth it and/or if we'll get it right...17:16
rloodtantsur: no. i don't want to be blamed.17:16
*** openstackgerrit has joined #openstack-ironic17:16
openstackgerritMark Goddard proposed openstack/ironic master: Register traits on nodes in devstack  https://review.openstack.org/54537017:16
openstackgerritMark Goddard proposed openstack/ironic master: Validate instance_info.traits against node traits  https://review.openstack.org/54346117:16
peitolmis there a common reason why cleaning would fail on a node with '[FAILED] Failed to start Switch Root.'17:16
* dtantsur looks at THAT patch17:16
dtantsurpeitolm: not that I'm aware of. is it a coreos image?17:17
peitolmfor cleaning?17:18
TheJuliarloo: dtantsur I'm good with reverting the locking change, but that reintroduces the detachment race with Nova which may still prevent reuse. We're just pushing the issue around, and I think the right thing is just rip the vif out upon teardown17:20
* TheJulia returns to trying to get intertubes working so all the lolcats can be streamed to the house17:20
dtantsurTheJulia: I'd do both: revert and rip the VIF17:20
dtantsurlolcats!17:20
dtantsurokay, I'll propose the revert, as it seems quite urgent17:20
rloothx dtantsur, TheJulia!17:20
dtantsurthen we can rip the vif on teardown, quickly merge it and let people complain17:21
peitolmdtantsur: Fedora 26 (cloud edition)17:21
openstackgerritDmitry Tantsur proposed openstack/ironic master: Revert "Don't try to lock for vif detach"  https://review.openstack.org/54670517:22
TheJuliadtantsur: thanks <317:22
dtantsurTheJulia, rloo ^^^17:22
dtantsurhmm, what should I do with the release note?17:22
dtantsurthe change was released, so I guess I need to keep the old one and add a new about the revert, wdyt?17:22
peitolm"Failed to switch root: Specified switch root path '/sysroot' does not seem to be an OS tree. os-release file is missing."17:22
dtantsurpeitolm: so, Fedora Atomic? are you using it as a whole-disk image? I think it won't work as a partition image.17:23
rloodtantsur: i think we can edit release notes in stable/queens. if we backport this, won't it delete the release note?17:23
dtantsurrloo: it will17:24
dtantsurideally, we should remove the release note on master, but keep it (and add a new one) on stable17:24
peitolmdtantsur: how would i check, i'd expect it as a whole-disk image17:24
dtantsurpeitolm: it depends on how you added it to glance (skipping kernel/ramdisk properties)17:24
peitolmhmm17:25
rloodtantsur: oh. if we want to do that, i think we can remove the release note from the cherry-picked patch, so that it isn't deleted. and maybe in the same cherry-picked patch, add a new release note? or edit the existing one?17:25
peitolmcan i get that info from glance, or do i need to try and find it in shell history?17:25
*** e0ne has quit IRC17:25
dtantsurrloo: yep, about to do it17:25
peitolmhmm, vm vs baremetal17:30
peitolmI think i have a whole disk image configured17:31
*** marios has quit IRC17:32
*** baha has quit IRC17:32
*** etingof has quit IRC17:33
jrollrloo | dtantsur: no. i don't want to be blamed. <- if anyone ever blames someone personally for any code change, I will... dunno. but I'll be mad. that shouldn't be a thing.17:33
dtantsur++17:33
openstackgerritDmitry Tantsur proposed openstack/ironic master: Revert "Don't try to lock for vif detach"  https://review.openstack.org/54670517:36
dtantsurTheJulia, rloo ^^ sorry, this should be correct now17:36
peitolmlooks like a bug with fedora2617:38
rloojroll: heh. i think i wanted to get agreement from the folks that originally wanted that patch. I don't like undoing things that others put in, w/o discussing with them.17:38
openstackgerritDmitry Tantsur proposed openstack/ironic master: Stop running check-releasenotes in `tox -e releasenotes`  https://review.openstack.org/54670917:43
dtantsurjust got a WUT moment with ^^^17:43
*** openstackgerrit has quit IRC17:48
*** milan_ has quit IRC17:51
*** mgoddard_ has quit IRC17:53
*** baha has joined #openstack-ironic17:57
*** AlexeyAbashkin has joined #openstack-ironic17:57
*** Nasir has joined #openstack-ironic17:57
peitolmdtantsur: switching the deploy images to coreOS seems to have worked, will have more of a play later17:58
*** derekh has quit IRC18:00
*** AlexeyAbashkin has quit IRC18:01
NasirHi, I'm confused about the openstack instructions on setting/configuring the ironic serial console using socat... I'm on Pike, and using Ironic with Nova, trying to configure the serial console that can be accessible through horizon18:02
NasirFollowing these instructions, https://docs.openstack.org/ironic/pike/admin/console.html18:02
NasirI get this error msg , 2018-02-21 17:59:38.346 26329 ERROR ironic.conductor.base_manager [req-799eac22-d8c4-41b2-9886-c75113fec9ac - - - - -] Failed to register hardware types. Could not find the following items in the 'ironic.hardware.interfaces.console' entrypoint: ipmitool_socat.: DriverNotFoundInEntrypoint: Could not find the following items in18:02
Nasir the 'ironic.hardware.interfaces.console' entrypoint: ipmitool_socat.18:02
Nasirwhen i set the "enabled_console_interfaces = ipmitool_socat,no-console" in ironic.conf, enabled_hardware_types = ipmi, enabled_drivers = pxe_ipmitool18:03
NasirShould the "enabled_console_interface' be "pxe_ipmitool_socat, or ipmitool_socat ? Thanks for the help18:04
dtantsurNasir: hi, you're confusing enabled_drivers and enabled_console_interfaces18:06
dtantsurthese are for different types of drivers18:06
dtantsurthe guide you're looking at refers to adding pxe_ipmitool_socat and/or agent_ipmitool_socat to enabled_drivers without touching enabled_hardware_types or enabled_console_interfaces18:06
Nasirdtantsur: What is the correct procedure then ... I want to be able to see the baremetal console from horizon, when a boot an ironic instance from Nova18:12
*** crushil has quit IRC18:13
dtantsurNasir: add one or both of these drivers to enabled_drivers and use them for your nodes18:13
*** crushil has joined #openstack-ironic18:13
dtantsurNasir: though the version from master will also work, and it may be much clearer: https://docs.openstack.org/ironic/latest/admin/console.html18:14
*** openstackgerrit has joined #openstack-ironic18:14
openstackgerritDmitry Tantsur proposed openstack/ironic stable/queens: Revert "Don't try to lock for vif detach"  https://review.openstack.org/54671918:14
dtantsurTheJulia, rloo, cherry-pick, when/if the master version merges ^^^18:14
* dtantsur has to go now18:14
*** dtantsur is now known as dtantsur|afk18:15
rloodtantsur: thx. and ciao for now :)18:15
dtantsur|afko/18:15
*** hjensas has joined #openstack-ironic18:15
Nasirdtantsur: so my enabled_drivers is set to "pxe_ipmitool" right now... Should it now be enabled_drivers=pxe_ipmitool,pxe_ipmitool_socat ?18:15
dtantsur|afkNasir: that's one of the options, yes18:15
* dtantsur|afk goes now18:15
rlooNasir: you'll also need to update your node.driver to be 'pxe_ipmitool_socat'18:16
Nasirdtantsur: and i should leave enabled_console_interfaces commented out , the way it is by default in the conf file ?18:16
Nasirdtantsur|afk: and i should leave enabled_console_interfaces commented out , the way it is by default in the conf file ?18:17
rlooNasir: it doesn't matter, you can leave the enabled*interfaces alone, set or not set. you're not using them.18:17
*** tesseract has quit IRC18:25
*** dsneddon is now known as dsneddon_pto18:25
*** mjura has quit IRC18:28
*** r-daneel_ has joined #openstack-ironic18:31
*** r-daneel has quit IRC18:32
*** r-daneel_ is now known as r-daneel18:32
*** rpioso|afk is now known as rpioso18:34
rpiosoGood morning18:34
*** edleafe- has joined #openstack-ironic18:34
*** Nasir has quit IRC18:45
jrollTheJulia: have you thought about what to discuss with nova in the hour we have? I was chatting with jaypipes and he recommended bringing up the disk partitioning thing18:54
jrollI was also thinking we should look at the big picture of the interactions with our virt driver, and figure out how we really want to do this18:55
*** e0ne has joined #openstack-ironic18:59
*** edleafe| has joined #openstack-ironic18:59
*** akhilaki has joined #openstack-ironic19:00
rloojroll, TheJulia: good question. i am guessing that we ought to discuss/agree on ironic API version negotiation. (see L247 of https://etherpad.openstack.org/p/IronicWhiteBoard)19:00
*** e0ne has quit IRC19:00
jroll++19:01
rloojroll: and hopefully the traits/deploy steps work will help and we won't have to discuss with them, how the user can send RAID config info to ironic, when booting a node :)19:02
*** edleafe- has quit IRC19:02
rloojroll: i mean, at least not discuss with them at THIS ptg :D19:02
jrollrloo: I think we'll still need it as an option - and if both ironic and nova can agree to the same schema at the same time, we can make good progress this cycle19:02
jrollwithout having to re-do things in ironic when it turns out nova doesn't like it, or vice versa19:03
rloojroll: are we ready to discuss that with them next week?19:03
rloojroll: we only have 60 min of their precious time!19:03
jrollrloo: I hope so, I have a proposal up, we'll see how the ironic discussion goes I guess19:04
* jroll thinks we aren't decisive enough, hopes we can improve on that19:04
rloojroll: oh, i can decide. decide not to do anything. wheeee...19:04
jroll:/19:04
* rloo thinks we don't decide sometimes, because the (background) info needed for making decisions, hasn't been presented19:05
* rloo speaks for herself only19:05
jrollI'm not saying all indecisiveness is bad or unwarranted,19:06
rloojroll: yeah, i know what you mean. but also, even after deciding, things lag so long, that it is like we never discussed it. so we do it again.19:06
jrollmaybe just that we're too afraid to experiment? or do anything without 100% of the details being clear? dunno19:06
* jroll gets excited to retro19:06
jrollyes19:06
jrollcompletely agree19:06
rloojroll: take a look at the graphical console stuff, i've provided links to the discussions i remember: https://etherpad.openstack.org/p/ironic-rocky-ptg-graphical-console19:07
jrollyep19:07
rloojroll: i guess we incrementally have gotten farther with it, but ...19:07
jrollI think for a while we would begin discussing things too early19:07
jrollor in other words, discuss things we knew we didn't have time for, for a long time19:08
* jroll realizes we probably have some of those topics again19:08
rloojroll: yup. but i thought people wanted to do those discussions early. to socialize the idea. or whatever.19:09
jrollrloo: yeah, can't blame them19:09
rloojroll: anyway. i was wondering which specs/things people should be reading/getting up to speed on, before PTG.19:09
rlooTheJulia: ^^ hopefully there are links to things on the etherpads...19:09
jrollrloo: yeah, I need to look as well, I haven't yet19:10
*** khyr0n has joined #openstack-ironic19:12
*** Goneri has quit IRC19:20
*** AlexeyAbashkin has joined #openstack-ironic19:21
*** AlexeyAbashkin has quit IRC19:25
*** akhilaki has quit IRC19:33
*** akhilaki has joined #openstack-ironic19:34
rlooTheJulia: if you have a minute to revert this: https://review.openstack.org/#/c/546705/19:37
patchbotpatch 546705 - ironic - Revert "Don't try to lock for vif detach"19:37
*** e0ne has joined #openstack-ironic19:51
*** fragatina has quit IRC19:53
*** akhilaki has quit IRC19:56
*** peitolm has quit IRC20:09
*** Goneri has joined #openstack-ironic20:22
*** crushil has quit IRC20:23
*** crushil has joined #openstack-ironic20:24
*** crushil has quit IRC20:25
*** crushil has joined #openstack-ironic20:26
*** edleafe| has quit IRC20:26
*** edleafe- has joined #openstack-ironic20:28
*** edleafe- has quit IRC20:31
*** devananda has joined #openstack-ironic20:32
*** crushil has quit IRC20:45
*** akhilaki has joined #openstack-ironic20:50
*** priteau has quit IRC20:52
*** dprince has quit IRC21:02
*** openstackgerrit has quit IRC21:03
*** dprince has joined #openstack-ironic21:04
*** crushil has joined #openstack-ironic21:09
*** marst has joined #openstack-ironic21:12
*** dprince has quit IRC21:13
*** openstackgerrit has joined #openstack-ironic21:21
openstackgerritMerged openstack/ironic-inspector master: Imported Translations from Zanata  https://review.openstack.org/54566121:21
*** khyr0n has quit IRC21:24
*** Nasir has joined #openstack-ironic21:25
*** olivierbourdon38 has quit IRC21:26
*** Nasir has quit IRC21:28
*** e0ne has quit IRC21:46
TheJulia\o/ I have internets again21:49
TheJuliarloo: revert the revert?21:49
rlooTheJulia: heh, that's the revert :)21:49
* TheJulia is all confused now21:50
TheJuliaBut, I have working intertubes full of the lolcats21:50
rlooTheJulia: ok, i just saw my original request. I mean, approve the revert of the original patch :)21:50
*** shoaibwr has joined #openstack-ironic21:50
TheJuliavdrok approved it, checking if it has been cherrypicked21:50
openstackgerritJulia Kreger proposed openstack/ironic stable/queens: Revert "Don't try to lock for vif detach"  https://review.openstack.org/54671921:51
rlooTheJulia: oh, yeah, just noticed that he approved it.21:51
rlooTheJulia: dmitry cherry-picked it already. sec.21:51
TheJuliaoh, hmm21:51
rlooTheJulia: https://review.openstack.org/#/c/546719/21:51
patchbotpatch 546719 - ironic (stable/queens) - Revert "Don't try to lock for vif detach"21:51
TheJuliayup, same one, it just updated it21:51
rlooTheJulia: oh, cool. nice. smart. as it should do! :)21:52
*** jtomasek has quit IRC21:52
rlooTheJulia: oh. except that it updated so we need to wait for zuul. heh.21:52
*** fragatina has joined #openstack-ironic21:54
*** shoaibwr has quit IRC21:57
*** baha has quit IRC21:59
*** dmellado has quit IRC22:00
* TheJulia retrieves beer22:01
TheJuliarloo: eh, if the tests pass it can merge22:02
rlooTheJulia: yup. they (the stable/queens patch) already passed once; the update is causing the tests to run again :)22:03
rlooTheJulia: did you see jroll's question about nova-ironici ptg meeting, and what we are going to discuss there? ^^ (I suspect you have)22:03
TheJuliaI have, it was already on my mind22:03
jroll:)22:04
jrollTheJulia: fwiw, I'm tracking topics in the nova etherpad, in an ironic section22:04
TheJuliajroll: thanks22:04
*** crushil has quit IRC22:05
* TheJulia ponders going out into the garage and beginning the bed assembly of doom22:05
*** marst has left #openstack-ironic22:06
rlooTheJulia: would you like this backported? https://review.openstack.org/#/c/544750/ :)22:07
patchbotpatch 544750 - ironic - Disable .pyc files for grenade multinode22:07
rloojroll: thx!22:07
TheJuliarloo: it won't make much of a difference, it only helps on moderately more stable builds where no binary objects have been touched22:07
TheJuliaerr22:07
TheJuliayeah, that22:08
rlooTheJulia: so it won't help the multinode grenade job in queens? aren't those stable builds?22:08
TheJuliatl;dr there is no fix short of client version negotiation handling in our nova virt library and upgrading nova, or totally retooling grenade22:08
rlooTheJulia: oh yeah. but in the meantime... ?22:09
TheJuliano fix, maybe we can negotiate a minimal backportable nova virt driver change to provide sanity again while we're at the ptg, but I suspect based on prior discussions there is little desire to do that from the nova team22:10
TheJulias/do/permit/22:10
jrollTheJulia: I mean... the nova negotiation thing was just a different hack around it. it isn't a permanent fix22:10
jrollwhat happens when the nova upgrade makes the previous ironic start segfaulting for the same reason? :)22:11
TheJuliawell, not really, the guideline is only a mixed stack, it doesn't say that we have to run an old version of nova, we've only boxed ourselves into that artificially22:11
jrollsure22:11
TheJuliajroll: ironic gets upgraded and is running with current libraries and thus shared object files under the hood22:11
jrollif the tag is the goal, there's lots of simpler ways to test that22:12
TheJuliaThe tag is the goal, except there has also been resistance to retooling our own job because we could still operate with a mixed stack if we leverage a pin but fire up a newer api22:12
jrollwe went with what we have today because it's extensive testing around a realistic-ish upgrade procedure, with a clear upgrade procedure documented for ops22:13
TheJuliaSlight warning: I've had one beer, i'm exhausted from running errands as $new_homeower today... so my filters are gone22:13
* jroll doesn't give a damn about the tag, tbh, I want a good upgrade experience for ops22:14
jrollheh, feel free to hold off on this conversation until later / next week :)22:14
TheJuliaAgreed, but we chose to leverage grenade for that, and grenade simply does not support what we _need_22:14
TheJuliaSo grenade shoe-horns us into an unrealistic scenario22:15
TheJuliaat least binary dependency wise22:15
jrolljust like the rest of our CI, yes22:15
TheJuliain which case, the operator is going to be broken hard regardless and will have to upgrade22:15
TheJuliayeah22:15
TheJuliathe other conundrum is the tag requirements state a full stack, so we can't go minimalist22:16
jrollopenstack does a ton of work to provide co-installability, it's silly and I hate it22:16
TheJuliaexcept across versions22:16
jrollwell, there's never been a problem with mixed versions before22:17
TheJuliaThere has to be a better way that makes everyone happy22:17
*** akhilaki has quit IRC22:17
TheJuliaI kind of disagree, but only because this is third cycle that upon the end of cycle grenade has been the bane of our existence22:18
jrollidk if this fell through the wrong cracks or what, but I'm surprised that more people aren't caring about this problem22:18
jrollI mean, rolling upgrade testing is a pain yes22:18
jrollbut have dependencies been an issue with that job in the past? I don't recall that22:18
TheJuliawe did have a very similar unexplained issue that would have just gone away if we upgraded nova last cycle22:19
TheJuliaI don't remember what it was at this point22:19
TheJuliabut it is how we got into the discussion of being able to support version negotiation in the client22:19
TheJuliain terms of handling more than just a single static version pin22:20
jrollgotcha22:20
jrolldon't get me wrong, I think that's a useful thing22:20
TheJuliaif we could just upgrade nova, the world would be a million times happier22:20
jrollI also think a relatively strict upgrade procedure for real operators is a useful thing22:20
jrolls/upgrade nova/run in virtualenvs/22:20
jrollnothing else would need to change :)22:20
TheJuliayeah, which I happened to find the flag for that, it is broken trying to install nova22:20
jrollheh.22:21
TheJuliaat least, nova + grenade22:21
* TheJulia stares at the fireplace with the awesome housewarming gift that BadCub and NobodyCam gifted to Summer and myself... and sips beer22:24
NobodyCam:) mmmmm beer22:24
BadCub❤️❤️22:24
jrollnice22:24
jrollyou should go enjoy that :)22:24
rloojroll, TheJulia: it would be good to discuss rolling upgrades at the PTG with infra folks. i know there is that ffu? upgrade session on Mon or Tues but they don't discuss infra-related, or they haven't in the past.22:29
rlooI think TheJulia is off starting today? so don't want to bug her until next week :)22:29
jrollrloo: that's about skipping versions during upgrades, completely unrelated to CI or rolling upgrades22:29
rloojroll: right, but they were talking baby steps. oh yeah, they were cold upgrades. you're right.22:30
rlooit is all a blur...22:30
persiaMy feeling is that the FFU crew is close to consensus on how to do things, and that it might almost be time to take that as instruction for what to do to infra to imitate their plans.22:30
rloopersia: that would be good! guess we'll find out next week...22:31
NobodyCamhey hey persia long time no see. hope all is well and good with you.22:31
persiaYep.22:31
*** rcernin has joined #openstack-ironic22:32
persiaNobodyCam: Your hopes are satisfied.  Would mine be as well?22:32
NobodyCamThey would!22:32
NobodyCam:)22:32
persiaExcellent :)22:32
*** r-daneel has quit IRC22:40
rloovdrok, jlvillal: if either of you are around and have time to review, looks like folks would like this fixed/backported: https://review.openstack.org/#/c/545830/22:53
patchbotpatch 545830 - ironic - Support nested objects and object lists in as_dict22:53
openstackgerritMerged openstack/ironic-inspector master: Updated from global requirements  https://review.openstack.org/54554323:08
*** shekar has quit IRC23:08
openstackgerritMerged openstack/python-ironicclient master: Updated from global requirements  https://review.openstack.org/54556123:08
*** shekar has joined #openstack-ironic23:08
openstackgerritMerged openstack/ironic master: Updated from global requirements  https://review.openstack.org/54554223:14
*** Goneri has quit IRC23:29
*** hshiina has joined #openstack-ironic23:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!