Monday, 2018-04-23

*** fragatin_ has quit IRC00:03
*** fragatina has joined #openstack-ironic00:11
*** zzY has joined #openstack-ironic00:16
zzYHi00:16
*** fragatina has quit IRC00:21
*** zzY has quit IRC00:21
*** hshiina|afk is now known as hshiina00:46
*** tiendc has joined #openstack-ironic00:52
openstackgerritDao Cong Tien proposed openstack/ironic master: Update CI jobs for rescue mode  https://review.openstack.org/52870400:55
openstackgerritDao Cong Tien proposed openstack/ironic master: Update CI jobs for rescue mode  https://review.openstack.org/52870400:56
*** trungnv has joined #openstack-ironic01:01
*** phuongnh has joined #openstack-ironic01:08
*** namnh has joined #openstack-ironic01:17
*** sapd has joined #openstack-ironic01:43
*** zhangfei has joined #openstack-ironic01:50
*** tuanla____ has joined #openstack-ironic01:53
*** masuberu has quit IRC02:06
*** masuberu has joined #openstack-ironic02:06
openstackgerritwangqi proposed openstack/ironic-inspector master: Replace assertRaisesRegexp with assertRaisesRegex  https://review.openstack.org/56348802:28
*** phuongnh has quit IRC02:28
*** rbudden has quit IRC02:30
*** masuberu has quit IRC03:06
*** masuberu has joined #openstack-ironic03:08
*** masber has joined #openstack-ironic03:15
*** masuberu has quit IRC03:18
*** anupn has quit IRC03:25
*** anupn has joined #openstack-ironic03:26
*** rcernin has quit IRC03:31
*** rcernin has joined #openstack-ironic03:35
*** Nisha_Agarwal has joined #openstack-ironic04:02
*** phuongnh has joined #openstack-ironic04:02
*** actatux has quit IRC04:20
openstackgerritTuan Luong-Anh proposed openstack/ironic master: [WIP] Implement iRMC BIOS configuration  https://review.openstack.org/53459504:22
*** Nisha_Agarwal has quit IRC05:08
*** jtomasek has joined #openstack-ironic05:13
*** tuanla____ has quit IRC05:26
*** rbartal has joined #openstack-ironic05:30
*** pmannidi has quit IRC05:37
*** marios has joined #openstack-ironic05:52
*** mjura has joined #openstack-ironic06:00
*** e0ne has joined #openstack-ironic06:02
pas-hamorning ironic :)06:12
*** links has joined #openstack-ironic06:13
*** parlos has joined #openstack-ironic06:20
*** jaganathan has joined #openstack-ironic06:24
*** jaganathan has quit IRC06:25
*** jaganathan has joined #openstack-ironic06:25
*** akhilaki has joined #openstack-ironic06:25
*** akhilaki has quit IRC06:29
*** racedo has joined #openstack-ironic06:40
*** tiendc has quit IRC06:45
*** athomas has quit IRC06:45
*** tiendc has joined #openstack-ironic06:46
*** e0ne has quit IRC06:49
*** tesseract has joined #openstack-ironic07:04
*** sapd has quit IRC07:13
*** rcernin has quit IRC07:19
*** pcaruana has joined #openstack-ironic07:25
*** AlexeyAbashkin has joined #openstack-ironic07:36
*** livelace has joined #openstack-ironic07:51
*** livelace has quit IRC07:51
*** mgoddard has joined #openstack-ironic08:07
*** lucas-afk is now known as lucasagomes08:15
*** threestrands has quit IRC08:17
*** kiseok7 has quit IRC08:20
*** derekh has joined #openstack-ironic08:27
*** phuongnh has quit IRC08:41
*** sambetts_ is now known as sambetts08:46
*** Alexey_Abashkin has joined #openstack-ironic08:48
*** Alexey_Abashkin has quit IRC08:50
*** Alexey_Abashkin has joined #openstack-ironic08:50
*** AlexeyAbashkin has quit IRC08:51
*** sapd has joined #openstack-ironic08:53
*** AlexeyAbashkin has joined #openstack-ironic08:54
*** Alexey_Abashkin has quit IRC08:54
*** Alexey_Abashkin has joined #openstack-ironic09:02
*** e0ne has joined #openstack-ironic09:03
*** AlexeyAbashkin has quit IRC09:05
*** Alexey_Abashkin is now known as AlexeyAbashkin09:05
*** MattMan has joined #openstack-ironic09:16
*** hshiina is now known as hshiina|afk09:17
*** namnh has quit IRC09:22
*** trungnv has quit IRC09:22
*** Nisha_Agarwal has joined #openstack-ironic09:23
*** trungnv has joined #openstack-ironic09:23
*** namnh has joined #openstack-ironic09:23
*** milan_ has joined #openstack-ironic09:24
openstackgerritpippo proposed openstack/ironic master: Trivial: Update pypi url to new url  https://review.openstack.org/56354509:29
*** liuzz has quit IRC09:29
*** stendulker has joined #openstack-ironic09:30
*** liuzz has joined #openstack-ironic09:38
*** liuzz_ has joined #openstack-ironic09:40
*** liuzz has quit IRC09:43
*** Nisha_Agarwal has quit IRC10:06
*** derekjhyang has joined #openstack-ironic10:11
*** dtantsur|pto is now known as dtantsur10:16
dtantsurmorning ironic!10:16
*** Nisha_Agarwal has joined #openstack-ironic10:16
*** namnh has quit IRC10:17
dtantsurplease ping me now if you need anything urgent from me :) otherwise i have quite a few emails to go through10:17
etingofdtantsur, welcome back ;)10:18
dtantsur\o/10:18
dtantsurhow were things here?10:18
*** trungnv has quit IRC10:18
* dtantsur will not read the IRC scrollback :)10:19
*** grafoo has joined #openstack-ironic10:20
* dtantsur -> emails10:23
*** pcaruana has quit IRC10:26
*** parlos has quit IRC10:27
openstackgerrityolanda.robla proposed openstack/ironic master: WIP: Add Node BIOS support - REST API  https://review.openstack.org/51257910:30
openstackgerrityolanda.robla proposed openstack/ironic master: BIOS Settings: Add RPC object  https://review.openstack.org/51171410:31
*** pcaruana has joined #openstack-ironic10:33
*** e0ne has quit IRC10:35
*** e0ne_ has joined #openstack-ironic10:35
*** AlexeyAbashkin has quit IRC10:47
*** jcoufal has joined #openstack-ironic10:47
*** parlos has joined #openstack-ironic10:51
*** AlexeyAbashkin has joined #openstack-ironic10:51
*** dprince has joined #openstack-ironic10:57
*** hoonetorg has quit IRC11:03
*** lucasagomes is now known as lucas-hungry11:06
*** e0ne_ is now known as e0ne11:07
*** hoonetorg has joined #openstack-ironic11:16
*** hoonetorg has quit IRC11:21
*** stendulker_ has joined #openstack-ironic11:29
*** stendulker has quit IRC11:32
*** tiendc has quit IRC11:33
*** stendulker_ has quit IRC11:34
*** racedo has quit IRC11:35
*** racedo has joined #openstack-ironic11:36
*** zshi has quit IRC11:36
*** zshi has joined #openstack-ironic11:37
*** hoonetorg has joined #openstack-ironic11:39
*** Nisha_Agarwal has quit IRC11:52
*** pcaruana has quit IRC11:54
*** lucas-hungry is now known as lucasagomes12:06
*** pcaruana has joined #openstack-ironic12:10
*** trown|outtypewww is now known as trown12:12
*** ktibi has joined #openstack-ironic12:23
*** cdearborn has joined #openstack-ironic12:27
*** dougsz has joined #openstack-ironic12:28
*** zshi has quit IRC12:30
*** zshi has joined #openstack-ironic12:34
openstackgerritGerry Buteau proposed openstack/ironic master: Enables MySQL Cluster Support for Ironic  https://review.openstack.org/56360612:37
*** rbudden has joined #openstack-ironic12:38
*** zshi has quit IRC12:48
*** rloo has joined #openstack-ironic12:49
*** zshi has joined #openstack-ironic12:50
*** mjturek has joined #openstack-ironic12:53
openstackgerritIlya Etingof proposed openstack/ironic master: SNMPv3 security features added to the `snmp` driver  https://review.openstack.org/54799913:00
rlooGood Monday morning all! I just updated the white board with gate status == Green. (I forgot to update it on Fri). If this isn't true, please let us know.13:02
fungifrickler just mentioned in #openstack-infra that pip 10 breaks bifrost testing13:03
*** Goneri has joined #openstack-ironic13:04
*** Nisha_Agarwal has joined #openstack-ironic13:07
TheJuliaGood morning13:07
TheJuliawoot :(13:07
jrollgooooood monday morning ironic :)13:09
dtantsurmorning rloo, TheJulia, jroll13:12
dtantsurso, is the pep8 import problem fixed?13:13
TheJuliacoffee... must make coffeee... the fate of the world depends on it13:13
jrolldtantsur: indeed13:13
*** Nisha_Agarwal has quit IRC13:13
dtantsurfolks, could you review these 3 backports: https://review.openstack.org/#/c/557327/ https://review.openstack.org/#/c/557329/ and https://review.openstack.org/#/c/557331/13:14
patchbotpatch 557327 - ironic-inspector (stable/queens) - Support zuul's standard override-checkout variable13:14
patchbotpatch 557329 - ironic-inspector (stable/pike) - Support zuul's standard override-checkout variable13:14
patchbotpatch 557331 - ironic-inspector (stable/ocata) - Support zuul's standard override-checkout variable13:14
rloomorning dtantsur, TheJulia, jroll. Welcome back dtantsur! :)13:16
TheJuliadone, coffee time13:16
rloodtantsur: can we approve them all, or do we need to wait for queens to merge first, etc...13:18
dtantsurI think we can, esp. given that these only touch the CI13:18
rloodtantsur: good13:18
dtantsurand two more small clean ups if somebody has time: https://review.openstack.org/#/c/558789/ and https://review.openstack.org/55909513:20
patchbotpatch 558789 - ironic-inspector - Switch the grenade job to hardware types and clean...13:20
patchbotpatch 559095 - ironic-python-agent-builder - Change bug links to storyboard13:20
dtantsurall these have survived my PTO ;)13:20
*** Nisha_Agarwal has joined #openstack-ironic13:20
* dtantsur looks at his open tripleo patches and sighs..13:20
TheJulia:(13:21
jrolldtantsur: they wouldn't have passed CI for most of your PTO anyway :) :(13:22
dtantsurugh :(13:22
TheJuliaYeah, been a fun two weeks :(13:22
dtantsurbecause of that pep8 thingy? or something else?13:23
* dtantsur wonders if we should backport https://review.openstack.org/#/c/499050/13:23
patchbotpatch 499050 - ironic - Fix ``agent`` deploy interface to call ``boot.prep... (MERGED)13:23
jrollthe pep8 thing most of last week, yeah13:24
jrollthere was another13:24
jrolloh, this: https://review.openstack.org/#/c/56196313:25
patchbotpatch 561963 - ironic-tempest-plugin - Explicitly use iscsi for standalone BaremetalIpmiR... (MERGED)13:25
TheJuliadtantsur: I think that would make sense to backpot13:25
TheJuliabackport13:25
* TheJulia is waiting for espresso machine to warm up13:25
jrollactually pep8 started apr 1213:25
openstackgerritDmitry Tantsur proposed openstack/ironic stable/queens: Fix ``agent`` deploy interface to call ``boot.prepare_instance``  https://review.openstack.org/56362113:28
dtantsurokay ^^^13:28
jrollTheJulia's comment in the original patch makes me a bit skeptical about backporting that, gonna break any deployments that successfully use netboot+whole-disk-image+neutron13:30
jrollnot sure if those deployments exist, but13:30
*** Nisha_Agarwal has quit IRC13:31
sambettshmmm apprently single +2+As don't work any more... super easy review: https://review.openstack.org/#/c/557118/13:35
patchbotpatch 557118 - ironic - fix a typo13:35
*** r-daneel has joined #openstack-ironic13:37
dtantsursambetts: it depends on an abandoned patch13:38
dtantsurthus your +A does not work13:38
TheJuliagreat catch13:38
dtantsurjroll: how can they use netboot with neutron? Oo13:38
dtantsuranyway, feel free to -1/-2 with an explanation13:39
jrolldtantsur: very carefully :P13:39
dtantsurlol13:39
TheJuliadtantsur: firewall rules that permit it ;)13:39
jrollyou can do network magic to allow traffic to pass from tenant network to a provider network13:39
sambettsdtantsur: oh... no wonder...13:39
dtantsurwelll.... yes. but if we don't backport it, some rescue case is broken, right?13:39
* dtantsur lunch brb13:40
jrolldtantsur: not saying I'm totally opposed to backporting it, I haven't fully understood the patch yet so I won't put a -1 now13:40
jrollif it does break someone we can put a switch on that bit and backport it13:40
jrollwhich is a long way to say, don't wait for my ack to land that :)13:41
openstackgerritSam Betts proposed openstack/ironic master: fix a typo  https://review.openstack.org/55711813:41
*** r-daneel has quit IRC13:51
*** liuzz_ has quit IRC13:54
*** rh-jelabarre has quit IRC13:55
*** liuzz has joined #openstack-ironic13:55
*** trown is now known as trown|brb13:56
*** trown|brb is now known as trown14:01
*** rh-jelabarre has joined #openstack-ironic14:03
*** baha has joined #openstack-ironic14:10
openstackgerritHarald Jensås proposed openstack/ironic-inspector stable/queens: Call shutdown() on SIGTERM - controlled teardown  https://review.openstack.org/56333714:11
*** liuzz has quit IRC14:23
*** liuzz has joined #openstack-ironic14:24
*** hjensas is now known as hjensas|afk14:29
*** links has quit IRC14:30
openstackgerritMerged openstack/ironic-ui master: Update links in README  https://review.openstack.org/54838114:31
*** jroll has quit IRC14:31
*** jroll has joined #openstack-ironic14:32
jrolloh my, bifrost is very broken14:33
*** jiapei has joined #openstack-ironic14:33
*** namnh has joined #openstack-ironic14:34
jrollmight just be this patch, actually14:35
jrollre https://review.openstack.org/#/c/563252/14:35
patchbotpatch 563252 - bifrost - Stop using slave_scripts/install-distro-packages.sh14:35
*** hshiina has joined #openstack-ironic14:36
jrollah no, it is the pip 10 thing14:37
sambetts*rage*14:37
* TheJulia hands out coffee to temper the rage14:37
* dtantsur wants back to the mountains :)14:38
* etingof has never seen TheJulia outraged (yet) ;)14:41
TheJuliaetingof: I table flip occasionally....  :(  Not a great thing and I beat myself up afterwards for days14:41
etingofuh-oh14:42
dtantsurwe call table flip occasionally, I guess it's a part of the human specification..14:44
*** rpioso|afk is now known as rpioso14:49
etingofI learned (hard way) not to let the code matters flipping tables14:49
rpiosoGood flipping morning :)14:49
jrollheh, morning \o14:49
rpiosojroll o/14:50
jrollfyi, I'm fixing up https://review.openstack.org/#/c/560499/14:50
patchbotpatch 560499 - ironic-inspector - uncap eventlet14:50
*** Alexey_Abashkin has joined #openstack-ironic14:50
rloogood morning rpioso14:50
rloo10 minutes til the ironic meeting14:50
rloothx jroll -- is that to address the bifrost breakage?14:51
rpiosoHey rloo!14:51
jiapeiGood morning14:51
jrollrloo: no, this is about the "uncap eventlet" stuff the requirements folks are working on14:51
*** hjensas_mobile has joined #openstack-ironic14:51
jrollI haven't investigated the bifrost thing14:51
etingofrpioso, o/14:51
jrollother than to find it's installing libvirt-python, which pip 10 isn't allowing, because it's already installed by the distro14:51
etingofflipping morning sounds really weird ;)14:51
rloojroll: oh. I guess we should update the whiteboard wrt the bifrost thing. i can update with what i saw mentioned here in IRC.14:51
jrollrloo: yeah, guess so14:52
*** gcb has joined #openstack-ironic14:53
*** stendulker has joined #openstack-ironic14:53
openstackgerritJim Rollenhagen proposed openstack/ironic-inspector master: Fix lower constraints and uncap eventlet  https://review.openstack.org/56049914:53
jroll^ easy review14:53
TheJuliarloo: I've got bifrost firing off right now locally to compare/contrast14:53
*** r-daneel has joined #openstack-ironic14:53
TheJuliafrom there I can dig in14:53
rlooThank you TheJulia!14:54
*** AlexeyAbashkin has quit IRC14:54
*** Alexey_Abashkin is now known as AlexeyAbashkin14:54
*** jcoufal_ has joined #openstack-ironic14:56
*** zhangfei has quit IRC14:57
rpiosoetingof: Hey!14:58
openstackgerritJulia Kreger proposed openstack/virtualbmc master: Testing CI  https://review.openstack.org/56365414:58
TheJuliajust to be on the safe side.... ^^^14:59
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Apr 23 15:00:01 2018 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
openstackThe meeting name has been set to 'ironic'15:00
TheJuliao/15:00
jroll\o15:00
vdroko/15:00
*** jcoufal has quit IRC15:00
dtantsuro/15:00
stendulkero/15:00
hjensas_mobileo/15:00
etingofo/15:00
jiapeio/15:00
jlvillalo/15:00
rpiosoo/15:00
rlooo/15:00
mgoddard\o15:00
hshiinao/15:00
TheJuliaOur agenda this week is on the wiki, and it looks deceptively light :)15:00
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:00
TheJulia#topic Announcements / Reminder15:01
*** openstack changes topic to "Announcements / Reminder (Meeting topic: ironic)"15:01
*** cjloader has joined #openstack-ironic15:01
TheJulia#info The TC election is this week! Remember to vote!15:02
*** cjloader has quit IRC15:02
*** cjloader has joined #openstack-ironic15:02
TheJulia#info The next PTG has been announced and will be back in Denver, Colorado \o/15:03
jrollwoo15:03
TheJuliaThat is all I have this week, does anyone have anything to announce or remind us of?15:03
jrollbifrost CI is broken, in case anyone didn't read scrollback15:03
jroll(issues with pip 10)15:04
openstackgerritMerged openstack/sushy-tools master: update lower-constraints.txt to match *requirements.txt  https://review.openstack.org/56001915:04
TheJuliaVery broken it seems :(15:04
TheJuliaWell, if nobody has anything else, we should move on.15:05
rloo:-( I wonder what the delay was (in it breaking). Why didn't it break when everything else broke last week? :)15:05
*** mjura has quit IRC15:05
TheJuliarloo: low contribution levels15:05
* rloo wonders again about having weekly (or maybe biweekly) CI runs...15:06
rlooI mean twice-a-week which might not be the same as biweekly.15:06
TheJuliaSo it was likely just not noticed. Also operates a little differently than devstack jobs so it is possibly pulling in pip10... although so far locally it seems to be working >.>15:06
rloosigh. well, thx TheJulia for looking into it!15:07
jrollTheJulia: I've got some thoughts on the bug if you want to discuss after meeting15:07
TheJuliajroll: okay15:07
TheJuliaAnyway, moving on!15:07
TheJulia#topic Review action items from previous meeting15:07
*** openstack changes topic to "Review action items from previous meeting (Meeting topic: ironic)"15:07
TheJuliaThe only action item was mine regarding mox, which I went ahead and closed out the task in storyboard as invalid since we don't use it.15:08
*** rajinir has joined #openstack-ironic15:08
TheJulia#link http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-04-16-15.00.log.html15:08
jrollnice15:09
dtantsur\o/15:09
TheJulia#topic Review subteam status reports15:09
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)"15:09
*** stendulker_ has joined #openstack-ironic15:09
openstackgerritMerged openstack/virtualbmc master: Add Serial-over-LAN (SOL) support  https://review.openstack.org/48285315:10
TheJuliaI hope everyone has had a chance to update the whiteboard today, but if not! :)15:10
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:10
TheJuliaStarting around line 15315:10
*** stendulker has quit IRC15:11
jrolloooops15:12
rloogood progress on BIOS config15:12
dtantsuryep15:13
jroll++15:13
jrollTheJulia: can we update the "Updating nova virt to use REST API" goal to be named something more like "make nova flexible with ironic versions"? :)15:13
TheJuliaVery good progress I would say, we should keep it up :)15:14
TheJuliajroll: absolutely!15:14
jroll(as that's the real goal, for now)15:14
jrollcool, doing it now15:14
TheJuliajroll: thanks!15:14
* TheJulia actually has something to type there \o/15:14
jrollnice15:15
TheJuliaokay, typed.15:16
jrolllooks like good progress overall on things15:16
TheJuliadtantsur: did dashboard/reporting discussions ever go anywhere with storyboard folk?15:16
rloodtantsur: wrt classic driver removal. this needs to be addressed: https://storyboard.openstack.org/#!/story/200188415:17
dtantsurTheJulia: the consensus was for me to prototype something in JS and show them15:17
dtantsurbut15:17
dtantsurtheir CORS rules prevent access to their API from other sites15:17
dtantsurso it got nowhere, and I'm thinking of doing it in Python again15:17
jrollrloo: ++15:17
TheJuliadtantsur: have you pondered just standing up a test instance?15:17
TheJuliarloo: oh nice :(15:18
dtantsurrloo: ugh :(15:18
dtantsurI thought it was fixed...15:18
dtantsurTheJulia: a test instance of storyboard, you mean?15:18
dtantsurETOOMUCHEFFORT + I don't have where15:18
rloodtantsur: i took a quick look at the code, doesn't look like it is addressed, hoping you'll look into it :)15:18
dtantsurrloo: I will15:19
jrollshould be an easy fix15:19
TheJuliadtantsur: (they have made it SUPER easy, fwiw... but yeah)15:19
*** pcaruana has quit IRC15:19
openstackgerritMerged openstack/ironic-inspector stable/queens: Support zuul's standard override-checkout variable  https://review.openstack.org/55732715:20
TheJuliaSo aside from some painful bugs, things look in decent shape15:20
TheJuliaEveryone ready to move on?15:20
dtantsur#action dtantsur to look into https://storyboard.openstack.org/#!/story/200188415:20
dtantsuryep15:20
rloo+ movin' on15:21
TheJuliadtantsur: thanks15:21
openstackgerritMerged openstack/ironic-inspector stable/pike: Support zuul's standard override-checkout variable  https://review.openstack.org/55732915:22
openstackgerritMerged openstack/ironic-inspector stable/ocata: Support zuul's standard override-checkout variable  https://review.openstack.org/55733115:22
openstackgerritMerged openstack/python-ironicclient master: Follow the new PTI for document build  https://review.openstack.org/55415715:22
TheJulia#topic Deciding on priorities for the coming week15:22
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)"15:22
openstackgerritMerged openstack/ironic-tempest-plugin master: Add comments for [deploy|rescue]_interface  https://review.openstack.org/56203715:23
TheJuliaI think we should go ahead and review the rest of the bios interface patches this week, any objections?15:23
jrollare they relatively close?15:23
jrollI haven't looked at them15:23
dtantsurI've checked the API patch, it looks quite raw still15:23
dtantsurbut it's the last one15:24
jrollI'm fine with it if they're ready to be reviewed15:24
TheJuliaso I think rpc is just in the middle then...15:25
* TheJulia looks15:25
dtantsurI need some attention, mostly from ironic-inspector people, on https://review.openstack.org/#/q/status:open+topic:hw-types for switching to hw types15:25
dtantsurTheJulia: RPC is the next, no?15:26
TheJuliaerr, no, there is some more work to be done there15:26
TheJuliayeah, there are some other mechanics15:26
TheJuliazshi: yolanda: Any chance we can get the bios interface patches re-stacked... or is the list accurate under the update?15:27
TheJuliadtantsur: other mechanics between rpc and api surface being able to land, hence my question above15:27
* TheJulia adds todo entries for issues that we've identified this morning15:27
rloodoesn't xclarity have a patch they need reviewed?15:28
jiapeiYes, we have one15:29
rloojiapei: i found it. added it to the whiteboard, L137 :)15:29
TheJuliaAnd thanks goes to whoever just pasted the link into the xclarity section. I'm guessing jiapei :)15:29
TheJuliaoh, nope, thanks rloo!15:30
rloo:)15:30
jiapei:) thank you rloo and TheJulia15:30
TheJuliaOkay, I think priority wise, that looks good, any objections although we're lacking some links and some patches at the moment15:30
jroll+115:31
rloono objections :)15:32
dtantsur++15:32
jiapei++15:32
TheJuliaOkay15:32
TheJuliaSo it looks like we're going to jump directly to Open Discussion. Any objections or RFE's to discuss first?15:33
* TheJulia hears crickets15:35
* jroll has none15:35
*** stendulker has joined #openstack-ironic15:35
clarkbfollowing back up on why you may have seen a delay in pip10 breaking things, we had image build brokeness (some due to pip10, some unrelated) early last week so wasn't until late last week that we go base images up with pip10 preinstalled (instaed of pip 9.0.3)15:36
*** stendulker_ has quit IRC15:36
TheJuliaclarkb: Ahh that makes sense, thanks!15:36
rpiosomjturek: Thank you for sending out an email to the mailing list about monthly Bug Days :) I'm sorry I missed the inaugural one, but plan to attend the next.15:37
rlooclarkb: thx! Mystery solved :)15:37
TheJulia#topic Open Disucssion15:37
*** openstack changes topic to "Open Disucssion (Meeting topic: ironic)"15:37
TheJulia#undo15:37
openstackRemoving item from minutes: #topic Open Disucssion15:37
TheJulia#topic Open Discussion15:37
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:37
TheJuliaI have nothing to discuss off the top of my head15:37
rpiosoDo we want to discuss monthly Bug Days? See ^^^15:38
* etingof would be grateful for VirtualBMC patch reviews -- https://review.openstack.org/#/c/48887415:39
patchbotpatch 488874 - virtualbmc - multiprocess server, ZMQ-based management cli tool15:39
* rpioso thought we had already moved on to Open Discussion :)15:39
jrollwe did!15:39
jrollsince we have a ML thread going, I'd rather continue discussing it there15:39
*** fragatina has joined #openstack-ironic15:39
TheJuliaI've not gotten to that thread yet :(15:40
dtantsuretingof: 1x -1 and 1x merge conflict may keep you busy for some time ;)15:40
rpiosojroll: Sounds reasonable15:40
openstackgerritRajini Karthik proposed openstack/ironic master: Devstack plugin support for Redfish and Hardware  https://review.openstack.org/56283115:41
*** fragatin_ has joined #openstack-ironic15:41
etingofdtantsur, thanks for your -1, but that won't hold it off for long ;)15:41
TheJuliaHhe15:41
TheJuliaerr15:41
TheJuliaheh15:41
dtantsurhehe15:41
dtantsurTheJulia: did we release something for Rocky-1?15:42
TheJuliaWell, seems like we don't have anything else to really discuss... so I guess we can wrap up the day15:42
TheJuliadtantsur: no, there was nothing to really release afaik15:42
dtantsurack15:43
* TheJulia hears crickets and thinks we can call it a wrap for today15:44
jroll++15:44
TheJuliaThanks everyone!15:44
rpiosoThank you, TheJulia15:45
*** fragatina has quit IRC15:45
jrollthanks :)15:45
jiapeiThank you :)15:46
TheJulia#endmeeting15:46
dtantsurthanks15:46
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/developer/ironic/ | Bugs: https://bugs.launchpad.net/ironic"15:46
openstackMeeting ended Mon Apr 23 15:46:07 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:46
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-04-23-15.00.html15:46
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-04-23-15.00.txt15:46
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-04-23-15.00.log.html15:46
TheJuliajroll: so pip10?15:46
NobodyCamGood Morning Ironic'ers15:47
dtantsurmorning NobodyCam15:47
NobodyCam:)15:47
jrollTheJulia: oh yeah15:48
jrollso the case where this will happen is, libvirt-python installed with a distro package, and not running bifrost in a virtualenv15:48
jrollbasically pip 10 refuses to uninstall (aka upgrade) python things installed by system packages15:49
*** hjensas_mobile has quit IRC15:49
jrollso if you can't reproduce locally, I'm gonna guess you're using virtualenvs (because you're a sane person)15:49
sambettshit this on Friday in a local env ended up apt-get uninstalling python-libvirt, and then had to manually sudo pip install libvirt-python to fix15:50
jrolland I'm assuming the fix is to not install libvirt-python in CI, which I could not find where was happening15:50
jrollthough I didn't search python-libvirt, thanks sambetts :D15:50
* jroll spins a patch15:51
rpiosoNobodyCam: Happy Monday!15:51
TheJuliaperfect! \o/15:51
NobodyCammorning rpioso :)15:52
openstackgerritJim Rollenhagen proposed openstack/bifrost master: Only install libvirt-python via pip  https://review.openstack.org/56368315:54
openstackgerritMerged openstack/ironic-tempest-plugin master: Gate: run the multinode job instead of the regular one  https://review.openstack.org/55744115:54
*** e0ne has quit IRC15:54
jrollTheJulia: I think that will do it, unless we have another thing doing the same thing15:54
openstackgerritmelissaml proposed openstack/ironic-specs master: Trivial: Update pypi url to new url  https://review.openstack.org/56330815:55
*** stendulker_ has joined #openstack-ironic15:56
TheJuliajroll: in all likelihood we do, but easiest may be just to work through them given CI is different from our dev machines15:57
jrollyep, that's my take15:57
*** hshiina has quit IRC15:57
TheJuliaOn a plus side, at least, on my dev machine, aside from forgetting I had a stale ironic database, it seems good, it is on the last step of a general test run on fedora 2715:57
*** stendulker has quit IRC15:58
*** gcb has quit IRC16:03
*** gyee has joined #openstack-ironic16:03
*** namnh has quit IRC16:04
*** rbartal has quit IRC16:05
*** stendulker_ has quit IRC16:05
openstackgerritHarald Jensås proposed openstack/ironic-inspector stable/pike: Call shutdown() on SIGTERM - controlled teardown  https://review.openstack.org/56333816:08
openstackgerritRajini Karthik proposed openstack/ironic master: Devstack plugin support for Redfish and Hardware  https://review.openstack.org/56283116:10
*** marios has quit IRC16:11
*** pcaruana has joined #openstack-ironic16:13
*** akhilaki has joined #openstack-ironic16:14
*** hjensas|afk is now known as hjensas16:18
* sambetts --> home16:20
sambettsnight all o/16:20
*** sambetts is now known as sambetts|afk16:20
jrollnight sambetts|afk16:20
jroll"msg": "The `libvirt` module is not importable. Check the requirements."16:20
jrollwat.16:20
jrolldoes ansible not work without the system version of libvirt-python?16:22
TheJuliajroll: chicken/egg maybe16:23
TheJuliajroll: I suspect it is going to need to be before virt*16:23
jrollTheJulia: oh, you're right, need to move that pip install I added16:23
TheJulia since they all load it16:24
jrollyep16:25
* jroll tries it16:25
openstackgerritJim Rollenhagen proposed openstack/bifrost master: Only install libvirt-python via pip  https://review.openstack.org/56368316:25
*** lucasagomes is now known as lucas-afk16:29
*** Alexey_Abashkin has joined #openstack-ironic16:31
*** dougsz has quit IRC16:32
*** AlexeyAbashkin has quit IRC16:34
*** Alexey_Abashkin is now known as AlexeyAbashkin16:34
*** srart has quit IRC16:40
*** srart has joined #openstack-ironic16:40
*** exodusftw has quit IRC16:43
*** srart has quit IRC16:43
etingofdtantsur, hey, what kind of logging you think we need forin the vbmcd service? we presently have file logging configurable through .ini16:43
etingofsyslog I guess?16:44
dtantsuretingof: well, to use python logging you have to configure it16:46
dtantsurmaybe we already do it, I haven't checked16:46
dtantsurit was just suspicious that the application start up code did not have anything like thaty16:46
etingofit is being configured via .ini16:46
dtantsuretingof: at which point?16:46
etingofdtantsur, this function does it -- https://git.openstack.org/cgit/openstack/virtualbmc/tree/virtualbmc/cmd/vbmcd.py?id=ca2d17640e2ff9804360ae84051f1f46a9a80746#n2616:48
etingofdtantsur, that function is not part of this patch I believe16:49
*** racedo has quit IRC16:50
*** racedo has joined #openstack-ironic16:50
*** exodusftw has joined #openstack-ironic16:50
etingofI can think of two things: 1) add syslog configuration 2) add c/l options to configure logging in the same way as it's being done through .ini16:50
*** racedo has quit IRC16:51
*** racedo has joined #openstack-ironic16:51
etingofbut I'd argue for a followup in both cases because 1) this patch does not really touch the original logging 2) the patch turns 10 month old, may be let's merge it? ;-)16:51
*** racedo has quit IRC16:51
*** srart has joined #openstack-ironic16:52
dtantsurlogging configuration at import time, SIGH16:52
*** racedo has joined #openstack-ironic16:52
dtantsurokay, this is not this patch's fault16:52
etingofdtantsur, exactly16:52
dtantsurif we start doing things like syslog configuration, we can as well switch to oslo.log which does all of it and more16:52
*** racedo has quit IRC16:52
*** racedo has joined #openstack-ironic16:53
*** mgoddard has quit IRC16:53
*** racedo has quit IRC16:53
etingofyes, but that would make the package tighter dependent on OS16:53
*** racedo has joined #openstack-ironic16:53
etingofI mean currently it does not require much OS-specific16:54
*** racedo has quit IRC16:54
dtantsuryep16:54
dtantsurso maybe just leave it alone16:55
etingofalright16:55
etingofthis code needs lots of love, tbh16:55
etingoflet it be a follow up love, huh?16:56
*** AlexeyAbashkin has quit IRC16:59
*** trown is now known as trown|lunch17:00
TheJuliaetingof: +117:04
dtantsuryep17:06
dtantsurI'm afraid that the Nova bug will be closes with Invalid "Please use resource classes" :)17:07
*** derekh has quit IRC17:08
TheJuliadtantsur: quite likely, but it is a worthwhile fix from our point of view because it is locking of our nodes17:11
openstackgerritMerged openstack/ironic-python-agent master: fix lower constraints and uncap eventlet  https://review.openstack.org/56050117:11
openstackgerritMerged openstack/ironic-lib master: fix lower constraints and uncap eventlet  https://review.openstack.org/56050017:11
openstackgerritMerged openstack/ironic-inspector master: Imported Translations from Zanata  https://review.openstack.org/55395117:11
TheJuliaFor those who are confused, dtantsur is speaking about https://bugs.launchpad.net/nova/+bug/176630117:13
openstackLaunchpad bug 1766301 in OpenStack Compute (nova) "ironic baremetal node ownership not checked with early vif plugging" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)17:13
dtantsurTheJulia: right, kind of a hardening fix17:14
TheJuliayeah17:15
*** srart has left #openstack-ironic17:22
*** tesseract has quit IRC17:23
*** dgautam has joined #openstack-ironic17:25
*** e0ne has joined #openstack-ironic17:26
*** mgoddard has joined #openstack-ironic17:31
dgautammy "iscsiadm -d 8 -m discovery -t st <ip> 3260 port" is stuck and baremetal node show is showing last_error "Async execution of heartbeat failed with error: Node ed9f9c87-90c8-46e4-828c-595d8bc20121 is locked by host a5d02e40., please retry after the current operation is completed. "17:31
dgautamany guidance where to look for ?17:31
dgautam3260 port is reachable on target baremetal17:32
*** actatux has joined #openstack-ironic17:32
*** dtantsur is now known as dtantsur|afk17:33
dtantsur|afko/17:33
dgautamwhat way I could check where lock is taken.17:34
jrollTheJulia: I think that's our typical scheduling race, but given code has changed it now fails at that step instead of the build step17:34
jrollwhich we can't really do much about at the moment17:34
jrollbut will be resolved when claims move to scheduler17:34
dgautamjroll: this is consistently happening.17:34
jrolldgautam: those messages were for TheJulia, not you :)17:35
TheJuliawell... we're seeing it really heavily at the moment, so I'm adding logic to lock the instance upfront. At least, that is what I feel like would work17:35
dgautammy bad17:35
jrollTheJulia: like, tag it with an instance id earlier?17:35
TheJuliadgautam: has the host been restarted? Are there multiple conductors?17:36
TheJuliajroll: yup17:36
jrollTheJulia: oh yeah, that should help mitigate :)17:36
TheJulias/host/conductor/17:36
TheJuliaand since I think we only allow add/delete....17:36
TheJuliaI'll have to write a lot of tests for it, but I've got something I'm just toying around with before I need to step away for a few hours17:36
jrolldgautam: that means a conductor has locked the node for some action, like bmc control or deployment in progress. if it stays locked, it's typically a conductor went down while locking the node17:37
jrollTheJulia: shouldn't be too terrible17:37
TheJuliaand depending on where, that might not get cleaned up17:37
dgautamTheJulia: there is single conductor17:38
dgautamTheJulia: I restarted the ironic_condcutor and tried fresh.17:38
TheJuliajroll: I'm thinking worst case, considering I'm just hacking on the virt driver code at the moment and fear running the unit tests at the moment17:38
TheJuliadgautam: so depneding on where when the conductor service was restarted, the lock may not have been cleaned up upon restart17:39
TheJuliadgautam: What version is this, or is it master branch17:39
TheJulia?17:39
dgautamocata17:39
dgautambit old17:39
TheJuliayeah... I think that was a recent bug fix to try and clean up all of the locking issues17:39
jrollTheJulia: nova might be open to adding a method on the virt driver like prep_for_spawn() or something and doing that before anything else17:40
TheJuliajroll: I think if we get a plug request through the driver, it is only sane to double check and ensure that one is added... I think.17:40
dgautamTheJulia: is there is way to find what is lock for ? node is deploying state17:41
jrollTheJulia: I guess, it seems a bit out of scope for that code17:42
jrolldgautam: if debug logging is on, the conductor should log the reason for the lock17:42
TheJuliaand also if there is only one conductor and it has been restarted, you could just likely clear the reservation in the db... :(17:42
TheJuliajroll: I kind of agree with you, but I think it is better to check/assert than not... anyway I just posted https://review.openstack.org/56371417:43
patchbotpatch 563714 - nova - DNM: Test: Ironic: Lock the instance if plug vifs17:43
TheJuliaI'm going to drop off for a couple hours, bbl17:44
jrollcheers \o17:45
jrollTheJulia: I was thinking more like https://review.openstack.org/563722, fwiw17:54
patchbotpatch 563722 - nova - WIP: ironic: add instance_uuid before any other sp...17:54
*** dprince has quit IRC18:00
*** r-daneel has quit IRC18:00
dgautamjroll: debug logging is enabled, I looked into that. I see messages for "Attempting to get shared lock on" and then .. (for power state sync)"Successfully released shared lock for power sync"18:01
*** r-daneel has joined #openstack-ironic18:01
dgautamin b/w, I see messages for heatbeat locks as week.18:02
dgautamas well*18:02
jrollright, if the lock is stuck, then the last message like that for the node ed9f9c87-90c8-46e4-828c-595d8bc20121 would be the stuck one18:02
*** trown|lunch is now known as trown18:05
dgautamjroll: will retry again all over again and watch over more closely this time.18:07
*** jiapei has quit IRC18:13
openstackgerritIlya Etingof proposed openstack/virtualbmc master: multiprocess server, ZMQ-based management cli tool  https://review.openstack.org/48887418:15
openstackgerritMerged openstack/ironic master: fix a typo  https://review.openstack.org/55711818:17
*** noam__ has joined #openstack-ironic18:24
*** noam__ has left #openstack-ironic18:25
*** dprince has joined #openstack-ironic18:25
dgautamjroll: tried again. "sudo ironic-rootwrap /etc/ironic/rootwrap.conf iscsiadm -m discovery -t st -p <baremetal-ip-address>:3260" took the lock and this process is stuck.18:33
dgautamps ax show this command. for a long time18:34
dgautamI checked the tcpdump, not even a single packet was sent on port 3260.18:35
*** mgoddard has quit IRC18:43
*** harlowja has joined #openstack-ironic18:44
*** Goneri has quit IRC18:56
jrolldgautam: interesting, what if you run it manually?18:59
*** fragatin_ has quit IRC19:02
dgautamjroll: I am running it inside the container (kolla ), I tried running on my host as well. same behavior. no SYN packet sent.19:07
*** harlowja has quit IRC19:07
*** rajinir has quit IRC19:08
openstackgerritMerged openstack/ironic-inspector master: Add 'inspect wait' as a valid state  https://review.openstack.org/55520219:10
*** mgoddard has joined #openstack-ironic19:10
jrolldgautam: no packets sent if you run the command manually? what about if you run it without sudo or rootwrap?19:12
jrollI seem to remember people in the past having trouble with iscsi commands inside a container, but don't recall why19:13
dgautamjroll: same behavior.  I running as root on host19:13
jrolldgautam: hrm, no idea then. at this point I'd begin furiously googling and/or running dtrace :/19:15
jroller, strace19:15
*** mgoddard has quit IRC19:16
dgautamstrace that says recefrom(3,..)19:17
dgautamlrwx------ 1 root root 64 Apr 23 12:15 /proc/4764/fd/3 -> socket:[3535562]19:17
dgautamand that is "unix  3      [ ]         STREAM     CONNECTED     3535562  4764/iscsiadm"19:17
openstackgerritMerged openstack/ironic-python-agent master: Stop using slave_scripts/install-distro-packages.sh  https://review.openstack.org/56324919:21
*** Nisha_Agarwal has joined #openstack-ironic19:27
*** Nisha_Agarwal has quit IRC19:32
*** ktibi has quit IRC19:43
*** akhilaki has quit IRC19:51
*** akhilaki has joined #openstack-ironic19:52
*** sambetts|afk has quit IRC19:58
openstackgerritPaul Belanger proposed openstack/bifrost master: Stop using slave_scripts/install-distro-packages.sh  https://review.openstack.org/56325220:00
*** sambetts_ has joined #openstack-ironic20:00
*** milan_ is now known as milan20:00
* milan is away: I'm busy20:00
*** milan has quit IRC20:03
*** dprince has quit IRC20:32
openstackgerritRajini Karthik proposed openstack/ironic master: Devstack plugin support for Redfish and Hardware  https://review.openstack.org/56283120:35
*** mjturek has quit IRC20:38
*** mjturek has joined #openstack-ironic20:40
*** jtomasek has quit IRC20:43
*** mjturek has quit IRC20:44
*** rajinir has joined #openstack-ironic20:45
*** Goneri has joined #openstack-ironic21:00
*** trown is now known as trown|outtypewww21:02
gyeeAnyone seeing this when boot from volume?21:06
gyeeValidationError: Ironic node: a15da082-d9ca-4a5c-8247-98101b4cd5ee failed to validate. (deploy: {u'reason': u"Cannot validate image information for node a15da082-d9ca-4a5c-8247-98101b4cd5ee because one or more parameters are missing from its instance_info. Missing are: ['ramdisk', 'kernel', 'image_source']", u'result': False}, power: {u'result': True}, storage: {u'result': True})21:06
gyeeI don't understand why it's looking from 'image_source'.21:07
*** fragatina has joined #openstack-ironic21:09
*** fragatina has quit IRC21:10
*** fragatina has joined #openstack-ironic21:11
jrollTheJulia: bifrost CI is happy here https://review.openstack.org/#/c/563683/221:26
patchbotpatch 563683 - bifrost - Only install libvirt-python via pip21:26
jroller, damn, not centos21:27
TheJulia:(21:28
TheJuliawell, :) and then :(21:28
TheJuliagyee: you can define a kernel or ramdisk to be deployed, or an image source which would bea w whole disk image21:28
TheJuliaoh, bfv21:28
gyeeyes, bfv21:29
gyeeI thought we don't need image_source21:29
openstackgerritJim Rollenhagen proposed openstack/bifrost master: Only install libvirt-python and python-lxml via pip  https://review.openstack.org/56368321:29
TheJuliahmm.... gyee does openstack baremetal node validate $node_uuid show anything?21:29
TheJuliagyee: you don't with bfv, but a volume target needs to exist for it to know21:29
gyeeTheJulia, I was using pxe_impitool driver21:29
TheJuliaalso the storage interface needs to be set on the node, and iscsi_boot needs to be enabled21:29
jrollI think that will do it, TheJulia21:29
gyeeI am switching over to agent_ipmitool right now to see if the issue is isolated21:29
gyeeyes, I have iscsi_boot:True21:30
TheJuliajroll: thanks! <321:30
jroll:)21:30
* TheJulia increments the beer she owes jroll count by three or four21:30
TheJuliabeers21:30
jrollha21:31
jrollwas an easy one :)21:31
TheJuliagyee: storage_interface on the node would also need to be checked. By default that is not enabled and needs to be set explicitly since BFV is an opt-in feature21:31
*** baha has quit IRC21:32
TheJuliagyee: one other thing, the storage interface contains all of the logic that governs if it has enough to boot from volume21:32
gyeeTheJulia, yeah, validate is complaining the same thing21:33
TheJuliagyee: if you do openstack baremetal node show $node_uuid, is the storage_interface set to cinder?21:33
TheJuliaalso, in the validate output is there anything reported?21:33
gyeeit is not set, let me set it now21:34
TheJuliaThat would do it21:34
*** cdearborn has quit IRC21:34
*** r-daneel_ has joined #openstack-ironic21:35
*** r-daneel has quit IRC21:36
*** r-daneel_ is now known as r-daneel21:36
gyeeTheJulia, same problem after setting storage_interface to cinder21:39
gyeeTheJulia, devstack also have the same issue21:41
gyee openstack --os-baremetal-api-version 1.33 baremetal node validate 5c209c48-ecf4-4152-a469-1c28bf0af845 is complaining about missing image_source21:42
*** exodusftw has quit IRC21:53
*** rbudden has quit IRC21:58
*** exodusftw has joined #openstack-ironic21:59
*** Goneri has quit IRC22:07
*** jrist has quit IRC22:08
*** jrist has joined #openstack-ironic22:12
*** jrist has quit IRC22:12
*** jrist has joined #openstack-ironic22:12
*** e0ne has quit IRC22:14
*** lbragstad has quit IRC22:18
*** rcernin has joined #openstack-ironic22:31
*** rpioso is now known as rpioso|afk22:38
*** threestrands has joined #openstack-ironic22:41
*** threestrands has quit IRC22:41
*** threestrands has joined #openstack-ironic22:41
*** cjloader has quit IRC22:47
*** zshi has quit IRC22:53
*** rh-jelabarre has quit IRC22:57
*** zshi has joined #openstack-ironic23:08
*** rbudden has joined #openstack-ironic23:08
*** r-daneel has quit IRC23:21
*** rbudden has quit IRC23:33
*** zshi has quit IRC23:45
*** zshi has joined #openstack-ironic23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!