Wednesday, 2018-01-17

*** rbudden has quit IRC00:13
*** milan has quit IRC00:21
openstackgerritIan Pilcher proposed openstack/ironic-lib master: Use dd conv=sparse when writing images to nodes  https://review.openstack.org/53444200:22
*** tzumainn has quit IRC00:27
*** etingof has quit IRC00:33
*** yangyapeng has quit IRC00:38
*** yangyapeng has joined #openstack-ironic00:38
*** cjloader has joined #openstack-ironic00:42
*** yangyapeng has quit IRC00:43
tonybSo I'm a little confused about the right way to setup introspection (this is in the context of tripleo but I'm not sure that matters)00:44
tonybif I run 'openstack baremetal node inspect <node_UUID>00:45
tonyb' the node boots but it seems like nothign has configured PXE to give it a kernel+ramdisk00:45
tonybIf I manually give it one and boot it it completes the introspection00:46
tonybSo my question is who is responsible for setting up introspection? tripleo? me? or ironic?00:47
tonybsorry to ask such a fundamental question00:47
*** etingof has joined #openstack-ironic00:50
tonybOh I think I see, what has happend It looks like despite having disabled ipxe in tripleo it's still configured ironic-inspector to use it00:53
* tonyb goes to debug that.00:53
*** phuongnh has joined #openstack-ironic01:01
openstackgerritHarald Jensås proposed openstack/networking-baremetal master: Add dsvm job  https://review.openstack.org/53040901:03
openstackgerritHarald Jensås proposed openstack/networking-baremetal master: Docs - Add multi-tenant devstack - n-g-s vlans  https://review.openstack.org/53445901:03
*** jaypipes has quit IRC01:06
*** phuongnh has quit IRC01:06
*** rloo has quit IRC01:07
*** cjloader has quit IRC01:09
*** yangyapeng has joined #openstack-ironic01:11
*** tiendc has joined #openstack-ironic01:13
*** etingof has quit IRC01:21
*** etingof has joined #openstack-ironic01:22
*** phuongnh has joined #openstack-ironic01:33
*** rbudden has joined #openstack-ironic01:47
*** tuanla____ has joined #openstack-ironic01:48
*** dsneddon has quit IRC02:01
*** bfournie has joined #openstack-ironic02:02
openstackgerritHarald Jensås proposed openstack/ironic master: Wait for ironic-neutron-agent to report state  https://review.openstack.org/53163702:16
*** zhangfei has joined #openstack-ironic02:19
*** cjloader has joined #openstack-ironic02:26
*** cjloader has quit IRC02:27
*** cjloader_ has joined #openstack-ironic02:27
*** jlabarre has quit IRC02:43
*** crushil_ has joined #openstack-ironic02:57
*** crushil has joined #openstack-ironic02:57
*** crushil_ has quit IRC03:03
*** ccollett has joined #openstack-ironic03:04
*** dpawar has joined #openstack-ironic03:05
*** dpawar has quit IRC03:06
*** dpawar has joined #openstack-ironic03:06
*** charcol has quit IRC03:06
openstackgerritTuan Luong-Anh proposed openstack/ironic master: [WIP] Implement iRMC BIOS configuration  https://review.openstack.org/53459503:08
*** gcb has quit IRC03:14
*** gcb has joined #openstack-ironic03:18
*** cjloader_ has quit IRC03:23
openstackgerritMerged openstack/ironic-python-agent master: Updated from global requirements  https://review.openstack.org/52994903:30
*** fragatina has quit IRC03:44
*** rbudden has quit IRC03:46
*** rbudden has joined #openstack-ironic03:48
*** jaianshu has joined #openstack-ironic03:57
*** rbudden has quit IRC04:14
openstackgerritMerged openstack/ironic-inspector master: Updated from global requirements  https://review.openstack.org/53387604:21
*** sasha2 has quit IRC04:33
openstackgerritMerged openstack/ironic master: Add additional context to contribution guide  https://review.openstack.org/52968104:37
*** sasha2 has joined #openstack-ironic04:39
*** zer0c00l has quit IRC04:46
*** links has joined #openstack-ironic04:49
*** cjloader has joined #openstack-ironic04:54
*** cjloader has quit IRC04:57
*** mvpnitesh has joined #openstack-ironic05:03
*** zer0c00l has joined #openstack-ironic05:06
*** zer0c00l has quit IRC05:12
*** zer0c00l has joined #openstack-ironic05:13
*** dpawar_ has joined #openstack-ironic05:13
openstackgerritMadhuri Kumari proposed openstack/ironic-specs master: Add service management API for ironic  https://review.openstack.org/47121705:15
*** dpawar has quit IRC05:16
*** hshiina has joined #openstack-ironic05:17
*** dpawar_ has quit IRC05:18
*** sasha2 has quit IRC05:20
*** zer0c00l has quit IRC05:24
*** crushil_ has joined #openstack-ironic05:29
*** zer0c00l has joined #openstack-ironic05:38
*** zer0c00l has quit IRC06:06
*** absubram has joined #openstack-ironic06:06
*** dpawar has joined #openstack-ironic06:06
*** ccollett has quit IRC06:10
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-inspector master: Imported Translations from Zanata  https://review.openstack.org/53310006:10
*** charcol has joined #openstack-ironic06:12
*** pmannidi has quit IRC06:16
*** pmannidi has joined #openstack-ironic06:33
*** pmannidi has quit IRC06:38
*** sapd__ has quit IRC06:38
ameedaMorning :)06:38
*** marios has joined #openstack-ironic06:39
*** sapd__ has joined #openstack-ironic06:39
ameedawhen I try to deploy Overstack on baremetal from VM, I got this "Filter RetryFilter returned 0 hosts" from nova-scheduler.log , any suggestions ?06:40
*** hieulq has quit IRC06:40
*** mcarden has quit IRC06:48
ameedaalso this one "Filter ComputeCapabilitiesFilter returned 0 hosts"06:49
openstackgerritZhijiang Hu proposed openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464606:49
*** pmannidi has joined #openstack-ironic06:50
*** zhangfei has quit IRC06:51
*** hieulq has joined #openstack-ironic06:52
openstackgerritZhijiang Hu proposed openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464606:52
*** mvpnitesh has quit IRC06:56
openstackgerritZhijiang Hu proposed openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464606:57
*** makowals has joined #openstack-ironic07:01
*** zer0c00l has joined #openstack-ironic07:05
openstackgerritZhijiang Hu proposed openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464607:06
*** zhangfei has joined #openstack-ironic07:07
*** absubram has quit IRC07:10
*** zer0c00l has quit IRC07:14
*** zer0c00l has joined #openstack-ironic07:16
*** threestrands_ has quit IRC07:20
*** jkilpatr has quit IRC07:28
*** crushil has quit IRC07:29
*** zhangfei has quit IRC07:32
pas-hamorning ironic :)07:37
*** rbartal has joined #openstack-ironic07:39
*** jkilpatr has joined #openstack-ironic07:39
*** charcol has quit IRC07:41
*** zhangfei has joined #openstack-ironic07:45
*** crushil has joined #openstack-ironic07:47
*** zer0c00l has quit IRC07:48
*** pcaruana has joined #openstack-ironic07:48
*** zhangfei has quit IRC07:50
*** honza has quit IRC07:53
*** pcaruana has quit IRC07:55
*** pcaruana has joined #openstack-ironic07:55
*** AlexeyAbashkin has joined #openstack-ironic07:57
*** zhangfei has joined #openstack-ironic08:03
*** athomas has joined #openstack-ironic08:05
*** hoonetorg has quit IRC08:10
*** phuongnh has quit IRC08:11
*** phuongnh has joined #openstack-ironic08:12
*** mgoddard_ has joined #openstack-ironic08:17
*** hoonetorg has joined #openstack-ironic08:26
*** crushil has quit IRC08:27
*** tesseract has joined #openstack-ironic08:29
*** milan has joined #openstack-ironic08:34
openstackgerritRushil Chugh proposed openstack/ironic master: Add XClarity Driver  https://review.openstack.org/51942708:35
*** zer0c00l has joined #openstack-ironic08:36
*** mgoddard_ has quit IRC08:37
*** crushil has joined #openstack-ironic08:37
*** crushil__ has joined #openstack-ironic08:39
*** crushil_ has quit IRC08:41
*** pmannidi has quit IRC08:41
*** crushil has quit IRC08:43
*** rcernin has quit IRC08:45
*** crushil__ has quit IRC08:45
*** xnox has quit IRC08:45
openstackgerritZhijiang Hu proposed openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464608:46
*** zer0c00l has quit IRC08:47
*** zer0c00l has joined #openstack-ironic08:54
*** liuzz has joined #openstack-ironic08:56
*** xnox has joined #openstack-ironic08:57
*** xnox has quit IRC08:57
*** xnox has joined #openstack-ironic08:57
sapd__hi guys, Does ironic support software RAID?08:59
openstackgerrityuan liang proposed openstack/ironic-python-agent master: Execute error in _detect_cna_card  https://review.openstack.org/53469009:00
*** tuanla____ has quit IRC09:01
*** tuanla____ has joined #openstack-ironic09:01
openstackgerrityuan liang proposed openstack/ironic-python-agent master: Execute error in _detect_cna_card  https://review.openstack.org/53469009:04
*** xnox has quit IRC09:05
openstackgerritliumengke proposed openstack/ironic master: fix a typo in ilo.rst: s/fimware/firmware/  https://review.openstack.org/53469509:06
*** xnox has joined #openstack-ironic09:08
*** xnox has quit IRC09:08
*** xnox has joined #openstack-ironic09:08
*** liuzz_ has joined #openstack-ironic09:09
pas-hasapd__: the agent-based drivers do not AFAIU (there are plans to support it). You can however write custom Ansible playbooks for ansible deploy interface that can something in this regard.09:09
pas-ha(a really old) blog post on that has some examples https://www.mirantis.com/blog/automate-bare-metal-server-provisioning-using-ironic-bifrost-and-the-ansible-deploy-driver/09:10
*** zer0c00l has quit IRC09:10
*** liuzz has quit IRC09:11
pas-hause it just for inspiration, the actual way of writing playbooks and using the driver has changed since09:11
*** xnox has quit IRC09:13
sapd__pas-ha: thankyou. I will check it.09:14
*** xnox has joined #openstack-ironic09:16
*** xnox has quit IRC09:16
*** xnox has joined #openstack-ironic09:16
*** hshiina has quit IRC09:18
*** hw_wutianwei has quit IRC09:23
*** hw_wutianwei has joined #openstack-ironic09:23
*** ejsf has joined #openstack-ironic09:35
*** stendulker has joined #openstack-ironic09:39
*** derekh has joined #openstack-ironic09:39
*** rcernin has joined #openstack-ironic09:40
*** zer0c00l has joined #openstack-ironic09:41
*** liuzz_ has quit IRC09:47
*** e0ne has joined #openstack-ironic09:47
*** vabada has joined #openstack-ironic09:52
*** milan has quit IRC09:56
*** zer0c00l has quit IRC09:58
*** zer0c00l has joined #openstack-ironic10:02
openstackgerritwangdequn proposed openstack/ironic master: correct the referenced url int the comment  https://review.openstack.org/53471010:07
*** amarao has joined #openstack-ironic10:12
*** amarao has quit IRC10:16
*** amarao has joined #openstack-ironic10:16
*** zer0c00l has quit IRC10:18
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Add docs for ansible deploy interface  https://review.openstack.org/52550110:19
*** zer0c00l has joined #openstack-ironic10:21
*** sambetts|afk is now known as sambetts10:28
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: [docs] mention new nova scheduler option  https://review.openstack.org/53440110:35
*** zer0c00l has quit IRC10:43
*** etingof has quit IRC10:45
*** xnox has quit IRC10:47
*** priteau has joined #openstack-ironic10:49
*** xnox has joined #openstack-ironic10:51
*** xnox has quit IRC10:51
*** xnox has joined #openstack-ironic10:51
*** dtantsur|afk is now known as dtantsur10:57
dtantsurmorning ironic10:57
*** dims has quit IRC10:57
dtantsurtonyb: hey, our time difference is unfortunate :( Were you able to solve your problem?10:57
*** dims has joined #openstack-ironic10:58
*** dpawar_ has joined #openstack-ironic10:59
*** zer0c00l has joined #openstack-ironic11:01
*** dpawar_ has quit IRC11:01
*** dpawar_ has joined #openstack-ironic11:02
*** dpawar has quit IRC11:03
pas-hadtantsur: morning11:10
pas-hadtantsur: seems we have some problems with docs job11:10
dtantsuroh?11:11
*** zer0c00l has quit IRC11:11
pas-hait fails complaining about files that are not changed in a patch - https://review.openstack.org/#/c/534401/ and https://review.openstack.org/#/c/525501/ as examples11:11
patchbotpatch 534401 - ironic - [docs] mention new nova scheduler option11:11
patchbotpatch 525501 - ironic - Add docs for ansible deploy interface11:11
pas-haalthough when running locally I can't repro those failures11:12
pas-hathe ansible playbook task that fails has some comments from mordred re disabling pbr autodoc..11:12
*** zer0c00l has joined #openstack-ironic11:13
dtantsurpas-ha: I guess we have no options other than try to fix it..11:13
pas-hayep, will try11:13
*** tuanla____ has quit IRC11:26
*** dpawar_ has quit IRC11:28
*** zhangfei has quit IRC11:30
*** phuongnh has quit IRC11:34
*** AlexeyAbashkin has quit IRC11:36
dtantsurthnx11:38
*** etingof has joined #openstack-ironic11:40
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Automatically migrate nodes to hardware types  https://review.openstack.org/53437311:44
openstackgerritDao Cong Tien proposed openstack/ironic master: devstack: add support for rescue mode  https://review.openstack.org/52411811:44
openstackgerritDao Cong Tien proposed openstack/ironic master: CI job for rescue mode  https://review.openstack.org/52870411:44
openstackgerritDao Cong Tien proposed openstack/ironic master: DNM: test rescue mode  https://review.openstack.org/53318711:45
*** absubram has joined #openstack-ironic11:46
*** dpawar has joined #openstack-ironic12:01
*** AlexeyAbashkin has joined #openstack-ironic12:02
*** AlexeyAbashkin has quit IRC12:06
*** jkilpatr has quit IRC12:07
pas-hadtantsur: sooo, it most likely that the yesterday's bump for sphinx in u-c was the reason.. https://github.com/openstack/requirements/commit/3326377e752231c702b73b0bb71ceda0d06fb834#diff-0bdd949ed8a7fdd4f95240bd951779c8L36812:09
pas-hawas able to repro locally, and now will test with 1.6.512:09
dtantsuraha12:09
*** jkilpatr has joined #openstack-ironic12:09
dtantsurI wonder if the failure is real (then we should fix it) or fake (then they should fix it)12:10
pas-haalso consult our docs team - may be we do do something wrong with refs in includes..12:10
pas-haexactly12:10
*** AlexeyAbashkin has joined #openstack-ironic12:12
*** rcernin has quit IRC12:14
openstackgerritMark Goddard proposed openstack/networking-generic-switch master: Add a netmiko device driver for Juniper switches  https://review.openstack.org/53053712:20
dtantsursambetts: hey, around? if you have some time, I'd appreciate a fresh view on https://review.openstack.org/#/c/471942/ please. We need to finish it by tomorrow.12:21
patchbotpatch 471942 - sushy - Implement Redfish Sessions12:21
dtantsurTheJulia: ^^^12:21
*** jaypipes has joined #openstack-ironic12:24
*** tiendc has quit IRC12:28
*** yangyapeng has quit IRC12:38
*** dprince has joined #openstack-ironic12:40
jrollgood morning12:42
pas-hajroll: morning :)12:44
*** serlex has joined #openstack-ironic12:44
*** jlabarre has joined #openstack-ironic12:45
*** racedo has joined #openstack-ironic12:51
*** racedo has quit IRC12:53
TheJuliadtantsur: Once I have coffee :)13:00
*** racedo has joined #openstack-ironic13:00
openstackgerritDao Cong Tien proposed openstack/ironic-tempest-plugin master: Rescue mode tempest tests  https://review.openstack.org/52869913:04
*** pmannidi has joined #openstack-ironic13:04
openstackgerritDao Cong Tien proposed openstack/ironic master: DNM: standalone test rescue mode  https://review.openstack.org/53475113:10
*** yangyapeng has joined #openstack-ironic13:11
*** absubram has quit IRC13:12
*** trown|outtypewww is now known as trown13:12
dtantsurmorning jroll, TheJulia13:15
*** milan_ has joined #openstack-ironic13:15
dtantsuroh, we should start planning the PTG.. I will start an etherpad soon(ish) if nobody beats me to it13:16
*** MattMan_1 has quit IRC13:21
*** MattMan_1 has joined #openstack-ironic13:21
rpiosoGood morning13:24
*** vabada has quit IRC13:25
*** vabada has joined #openstack-ironic13:26
*** vabada has quit IRC13:26
openstackgerritHugo Nicodemos proposed openstack/ironic master: Migrate oneview hardware type to use python-hpOneView  https://review.openstack.org/52431013:26
*** vabada has joined #openstack-ironic13:27
*** vabada has quit IRC13:27
*** vabada has joined #openstack-ironic13:28
dtantsurTheJulia: https://etherpad.openstack.org/p/ironic-rocky-ptg (please review before I send it out)13:30
dtantsurmorning rpioso13:30
rpiosodtantsur: :)13:30
*** jaianshu has quit IRC13:35
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Abstract away the virtualization management interface  https://review.openstack.org/52332113:40
TheJuliadtantsur: I'm +2 on the sushy session patch13:44
dtantsurcool13:44
dtantsurTheJulia: wanna merge it or have someone else look at it?13:45
TheJuliaat this point, we likely just merge it13:45
dtantsuryep13:45
TheJuliain route13:46
*** pmannidi has quit IRC13:46
*** dpawar has quit IRC13:47
TheJuliadtantsur: Added one item, lgtm13:49
*** rbudden has joined #openstack-ironic13:51
*** Goneri has joined #openstack-ironic13:56
*** sasha2 has joined #openstack-ironic13:57
*** tzumainn has joined #openstack-ironic14:00
*** rloo has joined #openstack-ironic14:04
*** rbartal has quit IRC14:04
rloogood morning ironickers all over the world14:16
rloojohnthetubaguy, mgoddard: what's the status wrt the traits work? the feeling was that if we didn't land the ironic parts this week, there was no way the nova part would land by FF next week14:17
hamzydtantsur, heya... I'm seeing "[  363.570582] ironic-python-agent[2729]: "message": "The following failures happened during running pre-processing hooks:\nLook up error: Could not find a node for attributes {'bmc_address': u'9.114.118.155', 'mac': [u'00:90:fa:74:05:52',"14:17
hamzyit looks like it was fixed a couple of times?14:17
hamzyI have the console output...14:18
dtantsurmorning rloo14:19
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Fix docs for Sphinx 1.6.6  https://review.openstack.org/53476814:19
mgoddardhi rloo: I don't know what johnthetubaguy's status is beyond the patches that he's pushed already14:19
pas-hadtantsur: ^^14:19
mgoddardrloo: I have some nova patches up for review, which still need some more testing. Just about to do that14:19
dtantsurhamzy: you need to make sure the nodes you're introspecting have correct IPMI addresses and correct MAC addresses (if at all)14:19
dtantsurthanks pas-ha14:19
hamzydtantsur, I've successfully deployed TripleO in the past, but this morning it stopped working14:20
rloomgoddard: thx. i've been waiting for updates to review. will see what johnthetubaguy sez. wrt the nova parts, you think they'll be easy to review? (I haven't looked yet)14:20
dtantsurhamzy: I don't think we have changed anything recently..14:21
hamzyit looks like the node gets an IP address from systemd but then ironic brings the interface down to do its discovery14:21
dtantsuris it completely the same environment with completely the same instackenv.json?14:21
dtantsurwhich release is it about?14:21
hamzyI should be running master14:22
hamzyopenstack-ironic-common-9.2.1-0.20171227184854.bf8cb05.el7.centos.noarch14:22
*** crushil__ has joined #openstack-ironic14:23
hamzydtantsur, https://hamzy.fedorapeople.org/TripleO-multi-arch/deploy-c365f02u23.fail14:23
dtantsurjlvillal: if by any chance you're around today, could you please check https://review.openstack.org/#/c/534736/ ? I'm afraid it will break ironic14:24
patchbotpatch 534736 - oslo.serialization - Revert "When serializing an exception return its '...14:24
*** crushil_ has joined #openstack-ironic14:24
dtantsurhamzy: does IPMI address and at least one MAC match what is in ironic?14:24
*** mcarden has joined #openstack-ironic14:25
dtantsursambetts: if you remember the context on https://review.openstack.org/#/c/534736/ please check as well14:25
patchbotpatch 534736 - oslo.serialization - Revert "When serializing an exception return its '...14:25
hamzydtantsur, does the MAC show in "openstack baremetal node show"?14:27
*** crushil__ has quit IRC14:28
*** mjturek has joined #openstack-ironic14:29
dtantsurhamzy: openstack baremetal port list --node <uuid>14:29
openstackgerritMerged openstack/sushy master: Implement Redfish Sessions  https://review.openstack.org/47194214:30
hamzydtantsur, https://paste.fedoraproject.org/paste/dwMbtIAJE4lFCBT3mBqCzg14:31
TheJuliawell this seems wrong http://logs.openstack.org/25/529325/6/check/ironic-lib-tempest-partition-agent_ipmitool/6d871b3/logs/screen-ir-cond.txt.gz?level=ERROR :(14:32
mgoddardrloo: there isn't too much to the nova parts really. They're a little tied up with some other placement work, but hopefully that shouldn't block us as it's also targeted for Queens.14:32
mgoddardrloo: if you feel like reviewing nova code: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/ironic-driver-traits14:33
rloomgoddard: don't feel like reviewing *any* code :D14:34
dtantsurhamzy: provision_state = "wait callback" is what preventing introspection14:35
mgoddardrloo: guess you're in the wrong job then :p14:35
dtantsurit looks like your node is half-way through deployment14:35
dtantsurMAC and IPMI address look fine14:35
hamzyit seems to get all the way to the end of IPA detecting everything14:36
*** mjturek has quit IRC14:36
rloomgoddard: yup, as core anyway ;)14:36
mgoddardrloo: actually I think johnthetubaguy is in Cambridge for at least some of today14:36
*** mjturek has joined #openstack-ironic14:36
dtantsurhamzy: it should not even start inspection in this state.. I dunno why. but that's the cause of your problem, I think14:37
rloomgoddard: so i'm avail to review the traits code up til tomorrow; after that maybe others will review, dunno. but at this point, i'm not sure it'll make it into queens.14:38
hamzydtantsur, I only see "2018-01-17 14:08:22.443 3647 ERROR ironic.conductor.utils [req-b5fa24f9-2b66-4cc7-b9ae-19058d6a91fd - - - - -] Timeout reached while waiting for callback for node 82e17bd4-cfbd-4574-b49d-ea03b89861b3" in /var/log/ironic/ironic-conductor.log14:38
dtantsurhamzy: the whole situation is a bit messy. you (or something) managed to start introspection on a node that was deploying OR was about to be deployed at14:39
dtantsurwhich broke both the deployment and the introspection14:40
dtantsurbecause the deployment never received a callback, while introspection found the node in a wrong state14:40
dtantsurthis is how I see the situation from the information I've got at least14:40
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: [docs] mention new nova scheduler option  https://review.openstack.org/53440114:40
dtantsurnow the question is how you ended up there :) did you deploy and introspect in parallel?14:40
TheJuliaheh, busybox fuser != psmisc fuser :(14:41
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Add docs for ansible deploy interface  https://review.openstack.org/52550114:41
hamzydtantsur, :( well I run the command "openstack overcloud deploy --templates /home/stack/templates -e /home/stack/templates/environments/network-environment.yaml -e /home/stack/templates/environments/network-isolation-custom.yaml -e /home/stack/templates/environments/override-overcloud-image.yaml --control-scale 1 --compute-scale 1 --control-flavor control --compute-flavor compute" which starts the giant stone ball rolling...14:42
*** jcoufal has joined #openstack-ironic14:42
*** dpawar has joined #openstack-ironic14:43
*** baha has joined #openstack-ironic14:43
hamzyI'll try poking around some more...14:43
dtantsurhamzy: I suggest you abort whatever is running now, make sure node's status is clean, then retry only one action14:44
hamzytripleo is a complicated beast14:46
dtantsuror did you even start introspection?14:46
dtantsur+10050014:46
hamzyI will clean up and start from the top... maybe something got bent along the wya14:47
hamzyway14:47
*** ianychoi has quit IRC14:48
mgoddardrloo: yeah it's definitely getting tight, which is a real shame. The client changes seem the limiting factor to me as the deadline is soon and it depends to some extent on everything else. Do you think it's possible?14:49
*** fragatina has joined #openstack-ironic14:49
rloomgoddard: isn't anything possible? :) if we had people updating the patches and reviewing them frequently, then yes. i probably should have asked yesterday.14:50
rloomgoddard: if we only care to get the traits in ironic done, i think it is possible; the deadline for that is next week. if we also want the nova part, that is really really tight, cuz we need to get the code in ironic first, before nova will look at that part, and their deadline is next week.14:51
mgoddardrloo: is the ironic support useful without nova?14:51
*** ianychoi has joined #openstack-ironic14:52
mgoddardrloo: we do have an ace up our sleeves - johnthetubaguy is a nova core, and isn't the one writing the nova code14:52
*** fragatina has quit IRC14:52
rloomgoddard: nope, don't think so. i think we wanted this in due to the nova changes wrt placement.14:52
rloomgoddard: true, i just don't like asking people to deal with 'exceptions'.14:52
*** fragatina has joined #openstack-ironic14:52
rloomgoddard: i could also update the ironic patches, but then who'd review them?14:53
mgoddardrloo: right, exceptions should remain exceptional14:53
rloomgoddard: well, you get the nova ones working as best you can, so folks can just +2 them :)14:53
mgoddardrloo: I'm thinking I could take a look at some ironic changes, but want to make sure I'm not duplicating john's efforts14:54
mgoddardrloo: from your review, there's a patch missing for ironic - RPC API for trait CRUD14:54
jrollI should have the client patches done shortly, fwiw14:55
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Abstract away the virtualization management interface  https://review.openstack.org/52332114:55
mgoddardjroll: great14:55
jrollI could also update the ironic stuff if that's helpful14:55
rloojroll: ++ to updating the ironic stuff14:55
jrolloops, it's way too easy to sign up for work around here14:56
mgoddardjroll: it's unlikely to be unhelpful14:56
rloojroll: if tubaman isn't going to do it soon14:56
jrollsuspect I won't get to the API until this afternoon (nighttime for john) so we shouldn't conflict14:56
rloojroll: if you were core, i'd volunteer to update :)14:56
jrollheh14:57
mgoddardgood spot re remoteable jroll, that will likely save us a patch15:04
*** cjloader has joined #openstack-ironic15:10
*** links has quit IRC15:11
*** racedo has quit IRC15:12
dtantsurrloo: did you have a chance to read my comment on the hw types upgrade patch?15:15
rloodtantsur: not yet. was trying to look into the oslo.serialization, then went to traits, now your stuff. umm, are you sure that you want to go this route before I look at it? (i'm not saying it is wrong, just don't want to spend time if you're thinking of changing again. i don't really care how we do it, since it is just for one cycle.15:16
dtantsurrloo: the end result seems much simpler now15:17
rloodtantsur: ok, let me skim it quickly.15:17
dtantsurthnx!15:17
*** absubram has joined #openstack-ironic15:19
jlvillaldtantsur, I left a review of -1 on https://review.openstack.org/#/c/534736/15:22
patchbotpatch 534736 - oslo.serialization - Revert "When serializing an exception return its '...15:22
jlvillalsambetts, Maybe you can also look at ^^^15:22
jlvillalI forget what this broke of ours15:22
dtantsurjlvillal: thanks! I don't remember why we did it, so your input is very helpful15:22
jlvillaldtantsur, I found the reason why in https://etherpad.openstack.org/p/IronicGateDebugging15:23
jlvillalSearch for 50828715:23
jlvillaldtantsur, I'm glad we keep notes :)15:23
dtantsur++15:23
dtantsurjlvillal: thanks, mind summarizing it on the review?15:24
sambettsdtantsur, jlvillal: left a comment, -1 to reverting a fix for a legitamte bug15:25
dtantsuryeah, I wonder if glance tests should be fixed  instead..15:25
sambettsif that change breaks them, then they should definatly be fixed...15:27
jlvillalsambetts, dtantsur: So basically I think we can handle a revert as we did a work-around. Since there has been no oslo.serialization release with that code being used by us.15:28
jlvillalI don't think we will break as sambetts' work-around handles it for us15:28
sambettsyeah, we could handle the revert, but I prefer to revert our workaround post-upper-constrait bump15:28
jlvillalThe work-around: https://review.openstack.org/#/c/50822515:28
patchbotpatch 508225 - ironic - Stop passing raw Exceptions as the reasons for iro... (MERGED)15:28
*** mjturek has quit IRC15:29
*** serlex has left #openstack-ironic15:29
jlvillalWell I think we have left enough info for them to figure out what they want to do :)15:29
sambettsyeah...15:30
*** mjturek has joined #openstack-ironic15:33
*** mjturek has quit IRC15:34
openstackgerritJulia Kreger proposed openstack/ironic-lib master: Add wait_for_disk to destroy_disk_metadata function  https://review.openstack.org/52932515:40
*** mjturek has joined #openstack-ironic15:41
TheJuliarloo: ^^^ ripped out -m15:42
rlooTheJulia: thx15:44
dtantsurrloo: thanks for review! so I see you're not firmly NOPE on the new approach, right?15:44
TheJuliarloo: tl;dr busybox fuser has a completely different behavior15:44
rloodtantsur: i'm ok on almost any approach that works; this code is not going to be forever, we just need to get it done in some reasonable way :)15:44
rlooTheJulia: :-( and why am I not surprised?15:45
rloodtantsur: i'm fairly sure that we can land that by end of next week. right now, trying to focus on other priorities...15:46
dtantsurack, I'll work further on this15:47
rloodtantsur: since you had +2 this before, it shouldn't take you too long if you have a few min: https://review.openstack.org/#/c/509336/15:48
patchbotpatch 509336 - ironic - Adds RPC calls for rescue interface15:48
dtantsurrloo: will do, after the current meeting(s)15:48
rloodtantsur: thx15:48
*** baha has left #openstack-ironic15:53
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Abstract away the virtualization management interface  https://review.openstack.org/52332115:54
*** baha has joined #openstack-ironic15:54
*** chas has joined #openstack-ironic15:54
*** chas has quit IRC15:54
*** makowals has quit IRC16:03
*** makowals has joined #openstack-ironic16:04
*** makowals has quit IRC16:04
*** makowals has joined #openstack-ironic16:05
*** makowals has quit IRC16:05
openstackgerritMerged openstack/virtualbmc master: Updated from global requirements  https://review.openstack.org/53407216:05
*** makowals has joined #openstack-ironic16:05
*** makowals has quit IRC16:06
*** racedo has joined #openstack-ironic16:06
*** makowals has joined #openstack-ironic16:06
*** makowals has quit IRC16:06
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add rescue related methods to network interface  https://review.openstack.org/50934216:18
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add rescuewait timeout periodic task  https://review.openstack.org/35315616:18
openstackgerritShivanand Tendulker proposed openstack/ironic master: Agent rescue implementation  https://review.openstack.org/40043716:18
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Automatically migrate nodes to hardware types  https://review.openstack.org/53437316:18
openstackgerritJim Rollenhagen proposed openstack/python-ironicclient master: Traits support  https://review.openstack.org/53262216:19
jroll^ this is done except release note, will write that when I'm not in a meeting16:19
*** absubram has quit IRC16:21
rloojroll: i commented in the rpc traits patch. the remotable stuff doesn't work (for one, it is turned off in api service)16:22
dtantsurrloo: thinking about the migration.. on my undercloud pxe_ipmitool nodes won't migrate, because shellinabox is not enabled16:24
dtantsurand agent RAID16:24
dtantsurI wonder how important it is to migrate optional interfaces.. or whether we should say, okay, these will be no-console and no-raid16:25
rloodtantsur: oh. pxe_ipmitool is configured to use shellinabox? let me look/think.16:27
dtantsurrloo: well, yes16:27
dtantsurand ditto for RAID16:27
dtantsurin TripleO case we don't care about either.. but we won't be migrated with the current logic :(16:28
rloodtantsur: so right now, if shellinabox is not enabled (i'm assuming you mean via configs), will console work for node with pxe_ipmitool?16:28
dtantsurrloo: it will. classic drivers don't depend on enabled_XXX_interfaces stuff16:29
rloodtantsur: i think then, that we should migrate those with a big warning that they need to update their config, cuz we can't update their config values.16:29
rloodtantsur: either that, or we don't migrate with a big warning that we cannot unless they update their config16:30
dtantsurrloo: the 3rd alternative is to allow broken nodes16:30
dtantsurwhich is probably even worse, yeah16:30
rloodtantsur: 'broken' == what?16:30
dtantsurrloo: with disabled interfaces16:30
rloodtantsur: that is worse.16:30
rloodtantsur: i think16:30
rloodtantsur: hmm. so they may not want that enabled, they may never use raid or console. so maybe that isn't worse.16:32
dtantsurwell, I don't think we'll work with such nodes at all16:32
dtantsurthe 4th option is to allow configuration in ironic.conf specifically for this migration (SIGH)16:32
rloodtantsur: i don't think we can do that. you mean update their config file?16:33
dtantsurI guess, putting aside crazy options, we have two: 1. skip such nodes, 2. revert optional interfaces to no-XXX with a warning16:33
rloodtantsur: i think the conservative approach is to skip such nodes16:34
dtantsuryes. I think it's fair to expect no regressions in functionality after data migration16:34
rloodtantsur: they will have to do something like 1. enable the interface in the config; 2. do migration manually16:34
dtantsurnot necessary manually, they can just rerun ironic-dbsync online_data_migrations16:35
dtantsurit will pick nodes skipped the last time16:35
rloodtantsur: oh yes, if they do 1. I mean, if they don't do 1, onlinedbmigration won't migrate still.16:35
dtantsuryep, I'm leaning towards 1.16:36
rloodtantsur: so if they don't do 1, they'll have to manually migrate, disable those optional interfaces16:36
rloodtantsur: which could be a pain, if they have a lot of nodes with pxe_ipmitool and never use eg raid.16:36
rloodtantsur: well, c'est la vie. i don't want to think that we're so smart we can figure out what to do programmatically and get it correct each time.16:37
dtantsurright, thanks for thinking about it with me :)16:37
rloodtantsur: another alternative is to add some sort of flag to the online-data-migrations cmd, to indicate wehther to 1. disable interface if not enabled in conf or 2. don't migrate if not enabled in conf, with 2 being the default.16:39
*** penick has joined #openstack-ironic16:40
* rloo doesn't have an operator hat16:40
*** marios has quit IRC16:40
dtantsuryeah, I don't know. we may be overthinking it.16:40
dtantsurthen, things like tripleo, where online_data_migrations is buried deep in puppet won't benefit from such option anyway16:41
*** AlexeyAbashkin has quit IRC16:41
rloodtantsur: right. it is only to provide an option to do 1 for those that want it. eg, you run online_data_migrations and get all these warnings. do you update your conf to enable them, or do you really want them (raid, console) to be set as no-X. If the latter, then this new option is for them. Otherwise, they'll have to manually migrate/set those interfaces.16:43
*** penick has quit IRC16:43
dtantsurI guess we can land this patch without options and then decide if we have time/energy to work on them16:45
rloodtantsur: yup, that makes sense16:45
*** penick has joined #openstack-ironic16:46
rloobtw, gate is broken w/o this patch: https://review.openstack.org/#/c/534768/16:46
patchbotpatch 534768 - ironic - Fix docs for Sphinx 1.6.616:46
*** pcaruana has quit IRC16:46
rloodo I need to update whiteboard? hopefully that will land w/i the hour...16:46
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Automatically migrate nodes to hardware types  https://review.openstack.org/53437316:46
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add rescuewait timeout periodic task  https://review.openstack.org/35315616:47
openstackgerritShivanand Tendulker proposed openstack/ironic master: Agent rescue implementation  https://review.openstack.org/40043716:47
jrollrloo: boooooo (re remotable)16:48
jrollmuch more code to write now16:48
rloojroll: yeah. sorry about that16:48
jrollit happens16:49
* jroll runs to lunch and an appt16:49
rloojroll: i might be fine just updating from the api. i think we can change/move to conductor doing it later. let me look at that patch again.16:49
jrollrloo: eh, we try to keep writes out of the api, I think partially for rolling upgrades purposes16:49
rloojroll: exactly. but i doubt that we'll change that trait object any time soon?16:50
jrollrloo: probably not, but not sure it's worth the risk (or the inconsistency)16:50
rloojroll: it is the object versions that is the tricky part.16:50
rloojroll: i'm fine if it is coded with the conductor. shouldn't be too hard?16:51
rloojroll: i can't recall, but i think we already have writes in api. oh yeah. chassis. maybe something else.16:51
jrollrloo: as in, putting methods in conductor/manager.py? yeah, won't be too hard, just more to do16:51
rloojroll: yup, that. rpc version update, blah blah. but simple code :)16:52
*** absubram has joined #openstack-ironic16:52
jrollindeed16:52
jrollanyway, bbl16:52
rlooenjoy your lunch16:52
*** Goneri has quit IRC16:53
*** stendulker has quit IRC16:56
*** mjturek has quit IRC16:57
*** milan_ has quit IRC16:57
*** fragatina has quit IRC17:03
*** e0ne has quit IRC17:09
*** racedo_ has joined #openstack-ironic17:11
*** honza has joined #openstack-ironic17:11
*** racedo has quit IRC17:11
*** mjturek has joined #openstack-ironic17:16
*** dtantsur is now known as dtantsur|afk17:18
dtantsur|afko/17:18
mjturekdoes anyone have any advice on debugging this? http://logs.openstack.org/99/501799/15/check/ipa-tempest-dsvm-ironic-inspector-src/547314e/logs/ironic-bm-logs/node-0_no_ansi_2018-01-16-15:42:08.txt.gz#_2018-01-16_15_41_25_037 Not sure why execute is failing17:20
*** tesseract has quit IRC17:21
TheJuliamjturek: silly question, are you feeding it 'command', 'arg1', 'arg2' ?17:22
sambettsmjturek: seems like the error log is being eaten by TypeError: not all arguments converted during string formatting17:22
TheJuliamjturek: your feeding a single string in, you need to break it up17:24
sambettsyeah +1, you can only pass a full string in if shell=True17:24
mjturekahhhh okay, I got rid of shell=True to address a comment is wasn't needed, didn't realize it takes commands like that! Thanks sambetts and TheJulia17:25
mjturekthat it wasn't needed*17:25
sambettsnp17:25
*** amarao has quit IRC17:30
*** r-daneel has joined #openstack-ironic17:31
*** racedo_ has quit IRC17:33
openstackgerritMichael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager  https://review.openstack.org/50179917:49
openstackgerritMerged openstack/sushy master: Updated from global requirements  https://review.openstack.org/53405717:49
*** fragatina has joined #openstack-ironic17:52
*** fragatin_ has joined #openstack-ironic17:53
*** fragatina has quit IRC17:54
*** derekh has quit IRC18:00
*** dpawar has quit IRC18:01
TheJuliaI swear half the time I'm running unit tests right now is deprecation warnings being printed to my screen18:01
*** mjturek has quit IRC18:02
*** Goneri has joined #openstack-ironic18:04
*** trown has quit IRC18:06
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Don't try to lock upfront for vif removal  https://review.openstack.org/53444118:07
TheJuliasambetts: ^^^ conceptually what might have helped prevent the issue I ran into with orphaned vifs, since it really seems like we shouldn't need to lock unless it is going to actually impact a node operationally18:08
*** mjturek has joined #openstack-ironic18:09
sambettsTheJulia: +1 I was thinking about that, we don't need to lock that during cleaning, we didn't used to care about the lock when nova port.updated the old field from the port.info so I'm good with that18:10
TheJuliasambetts: awesome18:11
openstackgerritJohn L. Villalovos proposed openstack/ironic-lib master: Simplify logic in wait_for_disk_to_become_available  https://review.openstack.org/53486718:11
sambettsTheJulia: thanks for following up on that :D18:11
jlvillalTheJulia, ^^^ May be of interest to you18:11
TheJuliasambetts: oh, no problem :)18:11
TheJuliajlvillal: I'll take a look in a few minutes, looking at somehting for crushil_ atm18:12
jlvillalTheJulia, No hurry18:12
sambettsTheJulia: re deprecation warnings ... I know right, I've been working on the networking-cisco project recently and there are so many deprecation warnings coming from the libraries, but its not something I can fix because its in a library so annoy18:13
*** ianychoi has quit IRC18:14
*** e0ne has joined #openstack-ironic18:15
*** ianychoi has joined #openstack-ironic18:15
TheJuliaIt always gets bad around this time of the cycle :(18:17
*** AlexeyAbashkin has joined #openstack-ironic18:20
openstackgerritMerged openstack/ironic stable/pike: Do not validate root partition size for whole disk images in iscsi deploy  https://review.openstack.org/53425118:25
openstackgerritMerged openstack/ironic master: Fix docs for Sphinx 1.6.6  https://review.openstack.org/53476818:25
*** AlexeyAbashkin has quit IRC18:25
rlooyay, gate is fixed ^^18:26
* sambetts --> home 18:28
sambettsnight all o/18:28
openstackgerritMerged openstack/ironic-lib master: Use dd conv=sparse when writing images to nodes  https://review.openstack.org/53444218:29
*** e0ne has quit IRC18:30
*** sambetts is now known as sambetts|afk18:33
openstackgerritHugo Nicodemos proposed openstack/ironic master: Migrate oneview hardware type to use python-hpOneView  https://review.openstack.org/52431018:35
*** mjturek has quit IRC18:36
*** mjturek has joined #openstack-ironic18:38
TheJuliadid the test-runner processing change, seems like all tests now are running when a small subset are defined to run18:40
*** openstackstatus has quit IRC18:40
mgoddardwho is doing the rescue work?18:41
mgoddardjust hit this:18:41
mgoddard2018-01-17 18:06:38.840 7 ERROR ironic.conductor.base_manager [req-f2f1c54a-6d00-4e38-b85e-391e514563ef - - - - -] Failed to register hardware types. For hardware type 'fake-hardware', no default value found for rescue interface.: NoValidDefaultForInterface: For hardware type 'fake-hardware', no default value found for rescue interface.18:41
* TheJulia sighs18:41
*** openstackstatus has joined #openstack-ironic18:41
*** ChanServ sets mode: +v openstackstatus18:41
TheJuliamgoddard: they are in india, any specific patches applied to master?18:42
mgoddardTheJulia: I'm here: https://review.openstack.org/#/c/532269/1018:43
patchbotpatch 532269 - ironic - WIP: API: Node Traits API18:43
TheJuliacrushil_: so crazy idea, what if you changed your mock so it was not get client, but actually mocking your actual xclarity_client library18:45
openstackgerritMerged openstack/ironic master: fix a typo in ilo.rst: s/fimware/firmware/  https://review.openstack.org/53469518:45
mgoddardTheJulia: hmm, this could be a config issue - perhaps I need to enable the fake rescue interface18:46
TheJuliaI kind of suspect it is autospec limiting scope because if I reconsruct your power test a little differently, it is spitting an error out that the mock is a function, not an object with methods.18:46
*** karthiks has quit IRC18:46
*** AlexeyAbashkin has joined #openstack-ironic18:47
mgoddardTheJulia: indeed that was the issue - user error...18:48
TheJuliamgoddard: I prefer "silly human tricks"18:48
TheJulia:)18:48
crushil_TheJulia, Hmmm. Lemme try that18:49
rloomgoddard: just saw, yes, that is needed. hmm. it means we have to be really careful about landing intermediate patches.18:49
TheJuliacrushil_: the more I think about it, the better that is, of course, it means you have to have enough structure mocked in case the library is not present to still run unit tests :\18:50
*** AlexeyAbashkin has quit IRC18:52
*** zer0c00l has quit IRC18:52
TheJuliacrushil_: alternatively https://review.openstack.org/#/c/524310/11/ironic/tests/unit/drivers/modules/oneview/test_power.py line 152 might bring you inspiration18:53
patchbotpatch 524310 - ironic - Migrate oneview hardware type to use python-hpOneView18:53
TheJuliasince it is very similar18:54
openstackgerritJulia Kreger proposed openstack/ironic-lib master: Add wait_for_disk to destroy_disk_metadata function  https://review.openstack.org/52932518:55
crushil_TheJulia, I see. Let me try that first18:55
mgoddardrloo, jroll, johnthetubaguy: good news: I've cobbled together an environment with all the traits patches applied and done an end to end test that worked!18:55
mgoddardrloo, jroll, johnthetubaguy: now all that's left is to polish these turds18:55
rloomgoddard: yay!18:55
rloomgoddard: you mean 'polish these gems' ? :)18:55
TheJuliacrushil_: yeah, less impactful to the rest of the file :)18:56
TheJuliajlvillal: updated the ironic-lib patch18:56
mgoddardrloo: hard to tell at this point :)18:56
openstackgerritJulia Kreger proposed openstack/ironic-lib master: Simplify logic in wait_for_disk_to_become_available  https://review.openstack.org/53486718:56
*** priteau has quit IRC18:58
TheJuliasounds like we need an industrial rock tumbler anyway18:58
rloo+118:59
* TheJulia wonders if Acme sells such a product, although worries about delivery since she has never been able to take delivery of many of their products19:00
jlvillalTheJulia, Reviewed the patch :)19:00
TheJulia\o/19:00
*** gmonteiro has left #openstack-ironic19:06
openstackgerritMerged openstack/sushy master: Update documentation related to 'refresh()'  https://review.openstack.org/53134119:07
*** karthiks has joined #openstack-ironic19:10
*** e0ne has joined #openstack-ironic19:13
*** absubram has quit IRC19:18
openstackgerritMerged openstack/python-ironicclient master: Updated from global requirements  https://review.openstack.org/53402319:18
jrollTheJulia: an industrial size cocktail tumbler you say?19:19
TheJuliajroll: heh19:29
crushil_TheJulia, That didn't work. I'm thinking of creating a fake client and providing it as a parameter to the test.19:32
*** e0ne has quit IRC19:38
*** trown has joined #openstack-ironic19:38
*** mjturek has quit IRC19:38
*** etingof has quit IRC19:42
openstackgerritJim Rollenhagen proposed openstack/python-ironicclient master: Traits support  https://review.openstack.org/53262219:48
jrollok this is ready to go afaict ^19:48
jrolldocstrings and all19:48
*** e0ne has joined #openstack-ironic19:49
*** athomas has quit IRC19:52
*** mjturek has joined #openstack-ironic19:52
TheJuliaawesome19:57
TheJuliacrushil_: :(19:57
openstackgerritJulia Kreger proposed openstack/ironic master: Don't try to lock upfront for vif removal  https://review.openstack.org/53444119:59
*** penick has quit IRC20:05
rlooTheJulia: wrt https://review.openstack.org/#/c/529325/, do you want to do a followup or fix this to set that config in the unit test?20:11
patchbotpatch 529325 - ironic-lib - Add wait_for_disk to destroy_disk_metadata function20:11
*** mjturek has quit IRC20:12
*** penick has joined #openstack-ironic20:16
openstackgerritRuby Loo proposed openstack/ironic stable/ocata: Do not validate root partition size for whole disk images in iscsi deploy  https://review.openstack.org/53489820:19
TheJuliaI'm getting a bad feeling about our grenade multinode job20:20
TheJuliarloo: I'll update in a minute20:23
rlooTheJulia: thx. I hope your bad feeling is wrong, but honestly, i haven't looked at those failures.20:23
TheJuliaactually20:23
TheJuliaI'll follow-up, since john has a patch dependent upon that one20:24
rlooTheJulia: ok, i'll +A then. sec.20:24
openstackgerritMerged openstack/ironic-ui master: Updated from global requirements  https://review.openstack.org/53396320:24
openstackgerritOpenStack Proposal Bot proposed openstack/bifrost master: Updated from global requirements  https://review.openstack.org/53490520:28
*** fragatin_ has quit IRC20:29
*** mjturek has joined #openstack-ironic20:30
*** fragatina has joined #openstack-ironic20:30
*** fragatina has quit IRC20:31
*** fragatina has joined #openstack-ironic20:31
*** hw_wutianwei has quit IRC20:31
*** dprince has quit IRC20:31
*** hw_wutianwei has joined #openstack-ironic20:32
TheJuliahttp://logs.openstack.org/56/353156/68/check/ironic-grenade-dsvm-multinode-multitenant/0d98473/logs/screen-q-svc.txt.gz#_Jan_17_18_37_17_69071720:33
*** fragatin_ has joined #openstack-ironic20:34
TheJuliahttp://logs.openstack.org/18/524118/11/check/ironic-grenade-dsvm-multinode-multitenant/4f27311/logs/screen-q-svc.txt.gz#_Jan_17_13_23_23_85035320:34
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-inspector master: Updated from global requirements  https://review.openstack.org/53493120:35
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-lib master: Updated from global requirements  https://review.openstack.org/53493220:35
*** fragatina has quit IRC20:35
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-tempest-plugin master: Updated from global requirements  https://review.openstack.org/53493320:35
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-python-agent master: Updated from global requirements  https://review.openstack.org/53493420:36
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-ui master: Updated from global requirements  https://review.openstack.org/53493520:36
*** fragatina has joined #openstack-ironic20:36
*** fragatina has quit IRC20:37
mgoddardrloo, jroll: taking a quick look at the RPC layer for traits. There are 4 write operations - add one, add all, remove one, remove all. Thoughts on how to translate these to RPC API methods?20:37
*** fragatin_ has quit IRC20:37
TheJuliahttp://logs.openstack.org/10/534710/1/check/ironic-grenade-dsvm-multinode-multitenant/079fa3e/logs/screen-q-svc.txt.gz#_Jan_17_11_51_35_24123020:38
* TheJulia declares the multinode job broken20:38
rlooTheJulia: :-(20:38
* rloo looks at mgoddard's question first before facing broken job...20:39
-openstackstatus- NOTICE: Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added.20:39
jlvillalTheJulia, Does this look like what you want?  http://paste.openstack.org/show/646544/20:39
jlvillalI was thinking I could add it to my patch20:39
TheJuliajlvillal: that works, I _wonder_ if busyboxy fuser doesn't split output though.....20:40
TheJuliasince they seem to be two very different beasts20:40
* jlvillal does not know20:40
TheJuliahmmm20:40
TheJuliagive me 30 seconds20:41
rloomgoddard: might be easier to look at the API part and work backwards. also, i thought jroll was going to do this. i hope you aren't both doing it.20:41
jlvillalTheJulia, Sure.20:41
jlvillalTheJulia, fuser blah > /dev/null; fuser blah 2> /dev/null20:41
jlvillalTheJulia, Is how I have been checking stuff20:41
mgoddardrloo: simple answer is to mirror the DB API methods, but there are 4 of them20:41
*** fragatina has joined #openstack-ironic20:42
rloomgoddard: in the API there is one PUT and one DELETE. so I'd do one 'update' RPC API, and one 'delete' RPC API. but give me a few mins to think about it20:42
TheJuliajlvillal: ugh, it behaves very diffrently, might be good to leave the tests as-is :\20:43
mgoddardrloo: each of those is actually two operations - PUT one vs. PUT all20:43
TheJuliajust to ensure we're basically covered, at least output/logging wise it is likely acting the same20:43
* TheJulia doesn't want to go hunt down busybox source atm20:43
TheJuliawell20:44
rloomgoddard: yeah, but we can add parameters to the call to indicate which. sec, looking at existing ones to see about consistency20:44
TheJulianow I have a moment, downstream question went away20:44
jlvillalTheJulia, Differently how?20:44
jlvillalTheJulia, As in it doesn't output to stderr?20:45
TheJuliahttps://git.busybox.net/busybox/tree/procps/fuser.c20:46
jlvillalTheJulia, That makes me thing too much. :(20:47
*** fragatina has quit IRC20:47
jlvillals/thing/think/20:48
TheJuliaat a glance, without digging too much into the busybox source, it might toss everything to stdout20:48
* TheJulia pours glasses of scotch and passes them around20:49
jlvillalTheJulia, I thought you were running the fuser command from busybox.20:49
jlvillalTheJulia, so could just test it with: fuser foo > /dev/null20:49
jlvillalTheJulia, I didn't realize you were reading the source code to figure it out :)20:49
mgoddardjroll: are you looking at the RPC layer for traits?20:51
TheJuliajlvillal: I fired up busybox, but then I realized it was looking for /proc, so then I pulled the source20:52
jlvillalln -s /sbin/busybox fuser20:52
jlvillal ./fuser open-file.txt20:52
jlvillal1552620:52
jlvillalTheJulia, So in my test it doesn't even show a file name.20:52
jlvillalThis is Fedora and installing the busybox package20:53
TheJulia\o/20:53
jlvillalTheJulia, Does TinyIPA use busybox and CoreOS uses ...20:53
TheJuliaI don't think it matters20:53
TheJuliacirros uses ?psmisc?'s fuser, which is what most distributions use20:54
rloomgoddard, jroll: so at API, we have (per node): 'add/create new trait', 'replace with these traits', 'remove a trait', 'remove all traits'20:54
jlvillalTheJulia, Anyway tests seem to pass :)20:54
jlvillalTheJulia, Kind of sucks with the lack of consistency though20:54
mgoddardrloo: correct20:54
TheJuliajlvillal: inconsistency as a service20:55
jlvillalheh20:55
rloomgoddard, jroll: wrt remove, rpc calls seem to use 'destroy', but i'm ok if we use something like 'remove_traits(self,context,node, trait=None, topic=None)20:55
rloomgoddard, jroll: where we remove one trait if trait is not None, and remove all traits if trait is None.20:55
TheJulia+1 to rloo's statement20:55
TheJuliavifs are vif_attach/vif_detach20:56
TheJuliaso, I think we are in "whatever works/makes sense" territory too20:56
mgoddardrloo: yes, that seems reasonable20:56
rlooTheJulia: good. attach/detach is odd for traits, and we seem to 'say' add/remove, so...20:56
rloomgoddard: the add one, replace all is not so easy. thinking...20:57
TheJuliarloo: agreed20:57
mgoddardrloo: maybe we should stick with set/add as separate?20:58
rloomgoddard: i think it is clearer to have two RPC apis. create (or add)_trait(self, context, node, trait, topic=None)20:58
rloomgoddard: yeah20:58
rloomgoddard: if we think we might want to add more than one trait in the future, we could change that to be a list of traits ^^20:59
rloomgoddard: and set_traits or replace_traits? (self, context, node, traits, topic=None)21:00
rloomgoddard: now they look alike wrt arguments. I suppose we could have one set_traits() with a Bool flag 'replace' defaulting to False?21:00
mgoddardrloo: that could work21:02
rloomgoddard: so set_traits(self, context, node, traits, replace=False, topic=None) ?21:03
rloomgoddard: i think that is easier than having two somewhat similar apis.21:03
rloomgoddard: and it makes it clear if it is adding or replacing.21:03
jrollmgoddard: I'm not looking at it (yet)21:03
jrollprobably won't get to it this afternoon21:04
tonybdtantsur|afk: Yeah the non-overlap is like that.  I *think* I decided that I (well tripleo) need to setup the tftpboot etc so that when the node boots it all happens.21:04
tonybdtantsur|afk: unlike when I'm booting the node for deployment when ironic will setup the pxe environment for me21:05
rlooTheJulia: ok, so do we need to look into the multinode job?21:08
* rloo hopes that 'no' is the answer21:08
TheJuliarloo: I think yes :(21:09
rloodarn. i need to learn to darn. socks...21:10
openstackgerritJulia Kreger proposed openstack/ironic-lib master: Minor follow-up for wait_for_disk tests  https://review.openstack.org/53495221:10
TheJuliaheh21:10
TheJuliaanyway, multinode grenade...21:10
rlooTheJulia: looks like it was fine last night. http://ci-watch.tintri.com/project?project=ironic21:14
rlooTheJulia: and is it a coincidence that it started failing when sphinx did too. wondering if some library got pulled in...21:14
TheJulialooks like I14e45fd5d2d3c816bb39f8ace56f7be460bac0d6 merged earlier today21:15
TheJuliawell, last night, 16 hours ago21:15
TheJuliaI suspect this will be a quick networking-generic-switch fix21:16
rlooTheJulia: if it is network related, i won't be much help.21:16
rlooTheJulia: quick for you? :)21:16
TheJuliayes21:16
TheJuliaI hope21:16
TheJuliahmmm21:16
* rloo takes a deep breath and dives into the logs...21:17
mgoddardjroll: ok, I moved onto the API, I'll pick up RPC layer tomorrow. If you have any code to share by then it would be appreciated21:17
jrollmgoddard: cool, if I write any I will put it in gerrit21:17
jrollthanks21:17
mgoddardjroll: ty21:17
TheJuliai hope we don't need to release n-g-s21:18
rlooTheJulia: we shouldn't have to. if i understand (which I don't), the callback ability is there, just not in that package, so we need to do something to use it?21:21
TheJuliaso the installed n-g-s version that is getting used is 0.4.1dev5....21:23
* TheJulia wonders if that is the stable branch21:23
TheJuliauhh yup21:24
TheJuliaso neutron is starting with old networking-generic-switch21:24
TheJulia$#*!(#!(*21:25
rloovdrok: are you around? ^^21:26
vdrokhi, yes, kind of21:27
vdrokhello folks :)21:27
rloovdrok: our multitenant/grenade job is broken. TheJulia is looking into it. Looks like it has to do with callbacks,eg http://logs.openstack.org/56/353156/68/check/ironic-grenade-dsvm-multinode-multitenant/0d98473/logs/screen-q-svc.txt.gz#_Jan_17_18_37_17_69071721:28
vdrokso multinode grenad does not update n-g-s?21:28
rloovdrok: i'm not familiar with this stuff, hoping you would be21:28
rloovdrok: TheJulia mentioned above, that it seems to coincide with https://review.openstack.org/#/c/529706/21:29
patchbotpatch 529706 - neutron - remove neutron.callbacks package (MERGED)21:29
TheJuliavdrok: neutron before plugins I guess, static upgrade path I believe21:29
TheJuliaI suspect the shortest path is ask for the neutron change to be reverted21:30
rlooTheJulia: that change makes it sound like the stuff is available in neutron lib -- can't we use from the lib then?21:32
TheJuliaif we backported the change....21:33
*** pmannidi has joined #openstack-ironic21:33
TheJuliathat might be an option21:33
vdrokhrm, we do use it from the neutron-lib in master21:33
* TheJulia hasn't looked at the change in n-g-s- yet21:33
vdrokah so you mean neutron upgraded before n-g-s and cannot start because callbacks were deleted from neutron and older release n-g-s still uses them21:34
rlooI am thinking TheJulia may have a point about reverting... seems like they need a deprecation period first?21:36
vdrokbackport should be easy as well, callbacks in neutron-lib have been around since ocata it seems21:38
rloovdrok: let's backport then21:38
openstackgerritVladyslav Drok proposed openstack/networking-generic-switch stable/pike: use callbacks from neutron-lib  https://review.openstack.org/53495521:38
vdrokhttps://review.openstack.org/53495521:39
patchbotpatch 534955 - networking-generic-switch (stable/pike) - use callbacks from neutron-lib21:39
vdrokheh, I already forgot there is a bot :)21:39
*** baha has quit IRC21:39
rloovdrok: no worries, whatever works!21:40
TheJuliait looks like the extent of the deprecation was an inline note last april21:40
vdrokyeah the policy was met i think, this is our fault :(21:41
rlooTheJulia, vdrok: do you know if that will break CI on stable branch? ocata -> pike?21:42
vdrokrloo: should not, callbacks still there in pike21:42
rloovdrok: good21:42
vdrokso i guess no need to backport to ocata21:42
TheJuliayeah, it shouldn't21:43
*** threestrands_ has joined #openstack-ironic21:44
TheJuliavdrok: there was no other annoucement that I know of, but I've not searched the ML yet21:44
TheJuliain-line note is kind of not great :(21:44
*** threestrands_ has quit IRC21:45
vdrokyeah indeed, some warning would be nice in the logs21:45
rloowrt stable/pike, this worked today so we're good there: https://review.openstack.org/#/c/534251/21:45
patchbotpatch 534251 - ironic (stable/pike) - Do not validate root partition size for whole disk... (MERGED)21:45
*** threestrands_ has joined #openstack-ironic21:45
*** threestrands_ has quit IRC21:45
*** threestrands_ has joined #openstack-ironic21:45
TheJuliayeah, ml post on 9/19/1721:45
TheJuliaglad it is backportable21:46
rlooyup. Thx TheJulia and vdrok for noticing & fixing21:47
vdroknp, you've already provided all the info :)21:47
openstackgerritJohn L. Villalovos proposed openstack/ironic-lib master: Simplify logic in wait_for_disk_to_become_available  https://review.openstack.org/53486721:47
jlvillalTheJulia, ^^ I updated stuff. One unit test no longer takes 2 seconds. And added additional comments, etc...21:48
* TheJulia wonders if now is a good time to go make dinner21:48
rlooTheJulia: should I +A that pike patch before tests are done?21:48
TheJuliajlvillal: awesome21:48
TheJuliarloo: I think it is fine if it passes the jobs21:49
jlvillalTheJulia, And of course I have a pep8 error. Duh21:49
openstackgerritMark Goddard proposed openstack/ironic master: WIP: API: Node Traits API  https://review.openstack.org/53226921:49
openstackgerritJohn L. Villalovos proposed openstack/ironic-lib master: Simplify logic in wait_for_disk_to_become_available  https://review.openstack.org/53486721:50
jlvillalTheJulia, ^^ all default tox tests pass :)21:50
TheJuliawell, if this is our one grenade disaster this cycle, and we have it fixed in under 24 hours, I think we're doing really good21:50
rlooTheJulia: definitely!21:53
TheJuliajlvillal: \o/21:56
openstackgerritJohn L. Villalovos proposed openstack/ironic-lib master: Simplify logic in wait_for_disk_to_become_available  https://review.openstack.org/53486721:56
jlvillalTheJulia, ^^^ Just more unit tests to be thorough :)  I think I'm done until someone -1s the patch :)21:57
TheJuliaI'm going to plug in my laptop to charge and work on a few things to get ready for dinner since I had to get a stupidly early start this morning. I'll keep an eye and issue rechecks one the n-g-s backport passes (hopefully)21:58
jlvillalTheJulia, You need an automated recheck service?21:58
jlvillalTheJulia, Oh never mind. Not that kind of recheck.21:59
rloojlvillal: well, it has been approved but we don't know if the tests pass. might want a manual look first before rechecking :)21:59
* jlvillal decides to go enjoy his day off work.21:59
jlvillalrloo, Yep!21:59
* rloo thought that jlvillal WAS enjoying his day off.21:59
* rloo wonders what could be more fun that hanging out with us22:00
* jlvillal decides to go enjoy his day off work even more!22:00
rloos/that/than/22:00
jlvillalrloo, :P22:00
rloojlvillal: thx!  ha ha22:00
* jlvillal has a new CPU cooler he should install22:00
*** trown is now known as trown|outtypewww22:01
*** rcernin has joined #openstack-ironic22:02
*** milan has joined #openstack-ironic22:02
TheJuliajlvillal: nah :)22:04
TheJulia\o/ enjoying the day22:05
openstackgerritMerged openstack/ironic-lib master: Add wait_for_disk to destroy_disk_metadata function  https://review.openstack.org/52932522:09
*** e0ne has quit IRC22:20
*** fragatina has joined #openstack-ironic22:23
*** e0ne has joined #openstack-ironic22:26
*** e0ne_ has joined #openstack-ironic22:27
*** e0ne has quit IRC22:30
*** e0ne_ has quit IRC22:32
*** milan has quit IRC22:53
*** jkilpatr has quit IRC22:54
*** PixieBoots has quit IRC23:00
*** cjloader_ has joined #openstack-ironic23:01
*** cjloader has quit IRC23:01
*** penick has quit IRC23:01
*** milan has joined #openstack-ironic23:03
*** cjloader_ has quit IRC23:06
*** crushil has joined #openstack-ironic23:10
*** r-daneel has quit IRC23:11
*** Goneri has quit IRC23:16
*** persia has quit IRC23:18
*** persia has joined #openstack-ironic23:18
*** etingof has joined #openstack-ironic23:24
*** milan has quit IRC23:24
*** mjturek has quit IRC23:28
*** charcol has joined #openstack-ironic23:34
*** etingof has quit IRC23:35
*** rloo has quit IRC23:38
*** cjloader has joined #openstack-ironic23:52
*** pmannidi has joined #openstack-ironic23:52
*** persia has quit IRC23:53
*** etingof has joined #openstack-ironic23:54
*** cjloader has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!