Friday, 2018-01-19

rlooTheJulia, vdrok: if you upgrade nova, it'll expect ironic with 1.<something, i forgot what>, which is in queens 9.2x release. but grenade is not upgrading API, so it won't handle that ironic API version. I think anyway. but worth trying I guess.00:00
vdrokyeah this is just a desperate attempt :)00:00
rloovdrok, TheJulia: OR we just don't test rolling upgrades right now?00:02
rloovdrok, TheJulia: I blame it on jroll, he said we needed to test or we couldn't put in the feature. we can test *after* the upgrade is done... or *after* it is done but everything pinned still? dunno.00:03
TheJuliathat and or we join the restart with it.... we should see the idfference in the log before we even restart ironic00:03
TheJuliawe'll figure it out00:04
rloovdrok, TheJulia: so sorry, i have to take off. thx for looking into it. talk to you on Monday.00:04
vdroko/ good night00:04
*** rloo has quit IRC00:04
TheJuliahave a good weekend rloo00:08
TheJulia:(00:09
TheJuliaI'm going to disappear for about two hours, dinner with my father... besides CI takes a long time :(00:09
openstackgerrityuan liang proposed openstack/ironic-python-agent master: Execute error in _detect_cna_card  https://review.openstack.org/53469000:24
*** liuzz has joined #openstack-ironic00:36
*** penick_ has quit IRC00:37
*** tuanla____ has joined #openstack-ironic00:43
*** hieulq_ has joined #openstack-ironic01:03
*** racedo_ has quit IRC01:04
*** hieulq has quit IRC01:06
*** crushil has joined #openstack-ironic01:06
*** lbragstad has joined #openstack-ironic01:09
*** tuanla____ has quit IRC01:24
*** tuanla____ has joined #openstack-ironic01:25
*** tiendc has joined #openstack-ironic01:27
*** rbudden has quit IRC01:34
*** mjturek has quit IRC01:35
*** bfournie has joined #openstack-ironic01:36
*** hshiina has joined #openstack-ironic01:55
*** weshay|dentist is now known as weshay|ruck02:00
*** crushil has quit IRC02:09
*** gcb has joined #openstack-ironic02:28
*** harlowja has quit IRC02:31
TheJuliaWell, this is a good sign.. upgrading nova did the trick, minus one test failed02:34
TheJuliadifferent microversion. 1.35 vs 1.34 (our api endpoint)02:39
*** namnh has joined #openstack-ironic02:40
*** threestrands_ has joined #openstack-ironic02:49
*** threestrands_ has quit IRC02:49
*** threestrands_ has joined #openstack-ironic02:49
*** threestrands has quit IRC02:51
*** andreaf has quit IRC03:07
*** lbragstad has quit IRC03:08
*** pmannidi has quit IRC03:23
*** pmannidi has joined #openstack-ironic03:23
TheJuliadtantsur|afk: no great options at this point, https://etherpad.openstack.org/p/IronicWhiteBoard line 74 details options03:23
crushil_Thanks for helping out TheJulia03:31
TheJuliaI'm not really sure of a good option at this point w/r/t grenade beyond just disabling multinode for the time being03:32
TheJuliawhich, in it's self is a really bad idea03:33
TheJuliabut its the best short term bad idea that I have03:33
*** andreaf has joined #openstack-ironic03:36
* TheJulia wonders if that would be a good commit message subject03:38
*** zshi has quit IRC03:38
*** fragatina has quit IRC03:38
*** fragatina has joined #openstack-ironic03:39
*** fragatina has quit IRC03:41
*** AlexeyAbashkin has joined #openstack-ironic03:44
*** jappleii__ has joined #openstack-ironic03:44
*** jappleii__ has quit IRC03:45
*** jappleii__ has joined #openstack-ironic03:45
*** jappleii__ has quit IRC03:46
*** threestrands_ has quit IRC03:46
*** lbragstad has joined #openstack-ironic03:46
*** jappleii__ has joined #openstack-ironic03:47
*** jappleii__ has quit IRC03:48
*** AlexeyAbashkin has quit IRC03:48
*** jappleii__ has joined #openstack-ironic03:48
*** dpawar has joined #openstack-ironic03:49
*** rcernin has quit IRC03:49
*** dpawar has quit IRC03:49
*** rcernin has joined #openstack-ironic03:49
*** dpawar has joined #openstack-ironic03:56
*** dpawar has quit IRC03:57
*** dpawar has joined #openstack-ironic03:57
*** fragatina has joined #openstack-ironic03:59
*** Nisha_Agarwal has joined #openstack-ironic04:00
*** lbragstad has quit IRC04:02
*** hamzy_ has joined #openstack-ironic04:03
*** fragatina has quit IRC04:04
*** ameeda has quit IRC04:04
openstackgerritJulia Kreger proposed openstack/ironic master: Mark multinode job as non-voting  https://review.openstack.org/53559404:04
openstackgerritRushil Chugh proposed openstack/ironic master: Add XClarity Driver  https://review.openstack.org/51942704:05
openstackgerritMerged openstack/bifrost master: Updated from global requirements  https://review.openstack.org/53490504:11
*** dpawar has quit IRC04:11
openstackgerritJulia Kreger proposed openstack/ironic master: Always attempt to restart n-cpu/n-cond  https://review.openstack.org/53539104:12
*** pmannidi_ has joined #openstack-ironic04:17
*** pmannidi has quit IRC04:19
*** pmannidi_ is now known as pmannidi04:19
openstackgerritJulia Kreger proposed openstack/ironic master: Rework upgrade to upgrade nova/ironic  https://review.openstack.org/53559604:29
*** links has joined #openstack-ironic04:37
*** namnh has quit IRC04:38
*** kiseok7_ has joined #openstack-ironic05:06
*** dpawar has joined #openstack-ironic05:10
*** harlowja has joined #openstack-ironic05:21
openstackgerritJulia Kreger proposed openstack/python-ironicclient master: Facilitate latest Rest API use  https://review.openstack.org/53102905:36
openstackgerritJulia Kreger proposed openstack/python-ironicclient master: Allow API user to define list of versions  https://review.openstack.org/53127105:36
* TheJulia goes to sleep05:37
*** crushil has joined #openstack-ironic05:43
*** jappleii__ has quit IRC05:52
*** marios has joined #openstack-ironic06:14
*** logan- has quit IRC06:16
*** crushil has quit IRC06:22
*** harlowja has quit IRC06:29
*** logan- has joined #openstack-ironic06:40
*** pcaruana has joined #openstack-ironic06:44
*** mcarden has quit IRC06:49
*** charcol has quit IRC06:59
*** namnh has joined #openstack-ironic07:03
*** deray has joined #openstack-ironic07:06
*** mjura has joined #openstack-ironic07:07
derayHello Ironic'ers! good morning07:09
*** fragatina has joined #openstack-ironic07:28
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-ui master: Imported Translations from Zanata  https://review.openstack.org/53243607:29
*** fragatina has quit IRC07:33
openstackgerritAnkit Kumar proposed openstack/ironic master: Adding condition for setting variable  https://review.openstack.org/53565107:37
openstackgerritAnkit Kumar proposed openstack/ironic-tempest-plugin master: Test cases for iLO drivers in standalone ironic  https://review.openstack.org/53565207:40
openstackgerritAnkit Kumar proposed openstack/ironic-tempest-plugin master: Test cases for iLO drivers in standalone ironic  https://review.openstack.org/53565207:43
*** rcernin has quit IRC07:43
*** etingof has quit IRC07:55
*** zshi has joined #openstack-ironic08:04
*** AlexeyAbashkin has joined #openstack-ironic08:13
*** Nisha_Agarwal has quit IRC08:15
*** tesseract has joined #openstack-ironic08:16
*** harlowja has joined #openstack-ironic08:17
*** tuanla_____ has joined #openstack-ironic08:25
*** namnh_ has joined #openstack-ironic08:26
*** jmccrory has quit IRC08:26
*** sdake has quit IRC08:27
*** persia has quit IRC08:28
*** mkrai has quit IRC08:28
*** tuanla____ has quit IRC08:28
*** tuanla_____ has quit IRC08:28
*** namnh has quit IRC08:28
*** tiendc has quit IRC08:28
*** persia has joined #openstack-ironic08:28
*** tuanla_____ has joined #openstack-ironic08:29
*** tiendc has joined #openstack-ironic08:29
*** deray has quit IRC08:30
*** sdake has joined #openstack-ironic08:33
*** sdake has quit IRC08:33
*** sdake has joined #openstack-ironic08:33
*** jmccrory has joined #openstack-ironic08:33
*** deray has joined #openstack-ironic08:35
*** harlowja has quit IRC08:37
*** namnh has joined #openstack-ironic08:40
*** mkrai has joined #openstack-ironic08:43
*** namnh_ has quit IRC08:43
*** Nisha_Agarwal has joined #openstack-ironic08:43
*** jmccrory has quit IRC08:50
*** jmccrory has joined #openstack-ironic08:52
*** namnh has quit IRC08:54
*** pmannidi has quit IRC08:59
*** zshi has quit IRC09:00
*** stendulker has joined #openstack-ironic09:01
*** homeski has quit IRC09:02
*** makowals has quit IRC09:06
*** e0ne has joined #openstack-ironic09:10
*** e0ne has quit IRC09:10
*** hshiina has quit IRC09:17
*** racedo has joined #openstack-ironic09:23
*** Nisha_Agarwal has quit IRC09:24
*** athomas has joined #openstack-ironic09:28
*** fragatina has joined #openstack-ironic09:30
*** fragatina has quit IRC09:35
*** tuanla____ has joined #openstack-ironic09:40
*** derekh has joined #openstack-ironic09:41
*** makowals has joined #openstack-ironic09:43
*** tuanla_____ has quit IRC09:44
*** karthiks has quit IRC09:47
*** tuanla____ has quit IRC09:48
*** pcaruana has quit IRC09:50
*** tuanla____ has joined #openstack-ironic09:50
*** pcaruana has joined #openstack-ironic09:53
*** pcaruana has quit IRC09:53
*** pcaruana has joined #openstack-ironic09:54
*** tuanla____ has quit IRC09:56
*** karthiks has joined #openstack-ironic09:59
*** lucas-pto is now known as lucasagomes10:03
*** hieulq_ has quit IRC10:05
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add rescuewait timeout periodic task  https://review.openstack.org/35315610:14
openstackgerritShivanand Tendulker proposed openstack/ironic master: Agent rescue implementation  https://review.openstack.org/40043710:14
*** etingof has joined #openstack-ironic10:21
*** tiendc has quit IRC10:30
*** e0ne has joined #openstack-ironic10:32
*** stendulker_ has joined #openstack-ironic10:33
*** marlinc has quit IRC10:36
*** stendulker has quit IRC10:37
*** e0ne has quit IRC10:37
*** liuzz has quit IRC10:39
*** stendulker_ has quit IRC10:39
*** marlinc has joined #openstack-ironic10:47
*** makowals has quit IRC10:47
*** makowals has joined #openstack-ironic10:48
*** makowals has quit IRC10:48
*** makowals has joined #openstack-ironic10:49
*** makowals has quit IRC10:49
*** makowals has joined #openstack-ironic10:49
*** dtantsur|afk is now known as dtantsur10:54
dtantsurmorning ironic10:55
*** e0ne has joined #openstack-ironic10:55
*** deray has quit IRC10:59
*** amarao has joined #openstack-ironic11:04
dtantsurTheJulia: thanks for looking into it. I'm approving making the job non-voting, but we have to recover and make it pass before the release..11:09
*** marios has quit IRC11:16
*** makowals has quit IRC11:21
*** fragatina has joined #openstack-ironic11:32
*** fragatina has quit IRC11:37
*** dpawar has quit IRC11:45
mgoddarddoes anyone know what version the queens release will be?12:04
mgoddard10.1.0?12:04
*** e0ne has quit IRC12:12
dtantsurmgoddard: likely, unless we land a breaking change12:14
*** marios has joined #openstack-ironic12:19
*** gmonteiro|home has joined #openstack-ironic12:23
*** hogepodge has quit IRC12:26
*** strigazi has quit IRC12:27
*** dansmith has quit IRC12:27
*** jtomasek has quit IRC12:27
*** exodusftw has quit IRC12:27
*** jtomasek_ has joined #openstack-ironic12:27
*** gcb has quit IRC12:28
*** dansmith has joined #openstack-ironic12:28
*** dansmith is now known as Guest8664912:28
*** hogepodge has joined #openstack-ironic12:28
*** strigazi has joined #openstack-ironic12:29
*** exodusftw has joined #openstack-ironic12:29
*** makowals has joined #openstack-ironic12:33
*** jtomasek_ is now known as jtomasek12:35
*** pc_m has quit IRC12:48
*** pc_m has joined #openstack-ironic12:50
*** yangyapeng has quit IRC12:55
*** yangyapeng has joined #openstack-ironic12:55
*** yangyapeng has quit IRC12:59
openstackgerritMerged openstack/ironic master: Mark multinode job as non-voting  https://review.openstack.org/53559413:01
*** jaypipes is now known as leakypipes13:10
openstackgerritNikolay Fedotov proposed openstack/ironic-python-agent master: Try to find partition 3 times  https://review.openstack.org/52557713:11
*** dprince has joined #openstack-ironic13:11
openstackgerritNikolay Fedotov proposed openstack/ironic-python-agent master: Try to find partition 3 times  https://review.openstack.org/52557713:12
openstackgerritHugo Nicodemos proposed openstack/ironic master: Migrate oneview hardware type to use python-hpOneView  https://review.openstack.org/52431013:12
*** jlabarre has quit IRC13:12
*** mcarden has joined #openstack-ironic13:13
nicodemoshey, about https://review.openstack.org/#/c/524310/ do you want me to create a reno just to talking about the redfish import in this patch? or I put this warning in the remove python-oneviewclient release note?13:18
patchbotpatch 524310 - ironic - Migrate oneview hardware type to use python-hpOneView13:18
nicodemosdtantsur ^13:18
dtantsurnicodemos: any way is fine with me13:20
nicodemosok, thanks. :)13:20
*** MattMan has quit IRC13:22
*** MattMan has joined #openstack-ironic13:22
*** crushil has joined #openstack-ironic13:24
*** makowals has quit IRC13:24
*** links has quit IRC13:28
*** yangyapeng has joined #openstack-ironic13:29
TheJuliadtantsur: acknowledged. Sadly few good options :(  What is your perspective on actually completing upgrades for nova/ironic?13:31
TheJuliabut leaving like the rpc pin in place13:32
*** yangyapeng has quit IRC13:32
*** yangyapeng has joined #openstack-ironic13:32
dtantsurTheJulia: that's not quite the thing we're supposed to test..13:32
dtantsurI'm not sure I've fully grasped the problem, mind providing another tl;dr please?13:33
jrollmorning ironic13:33
dtantsurmorning jroll13:34
TheJuliaeverything points to something gets upgraded that caues n-cond proces to spin out of control crashing on a segmentation violation, which causes other fun things like n-compute to get killed off by systemd13:34
* jroll attempts to grok grenade problems13:34
*** fragatina has joined #openstack-ironic13:34
gmonteiro|homeMorning jroll and all o/13:34
dtantsurTheJulia: isn't it something that nova folks should become concerned about as well?13:34
dtantsurlike, I don't think we expect n-cond to segfault..13:34
TheJuliasince there is no isolation in venvs, and I believe python tries to dynamically recompile (at least I think), or that is c code that gets upgraded in some package13:35
TheJuliano, we don't, but since we leave it running and never upgrade it....13:35
jrollit's even scarier that it does it without restarting n-cond13:36
TheJuliayup....13:36
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Automatically migrate nodes to hardware types  https://review.openstack.org/53437313:36
openstackgerritDmitry Tantsur proposed openstack/ironic master: Allow data migrations to accept options  https://review.openstack.org/53577213:36
dtantsurTheJulia: this basically means that rolling upgrades don't work..13:36
TheJuliawell13:36
TheJuliano13:36
jrollrolling upgrades don't work *if nova is on the same machine as ironic without virtualenvs or similar* :)13:37
TheJuliaThe problem is that you have to have some sort of isolation, presently we don't13:37
TheJuliawe're still upgrading underlying packages that nova uses, nothing prevents that13:37
TheJuliawhat jroll said13:37
jrollfeels like this is a thing to bring up with nova, or maybe better yet the requirements/release team13:37
*** edleafe is now known as figleaf13:37
jrollfeels like if we pin down which library it is, we could do something like bump the minimum in pike, or lower the minimum in queens, or13:38
TheJuliaI was pondering that last night, for the fun of it, I went and checked bugs for oslo, nothing matched13:38
jrolland they might have some insight on a) how to track it down, and b) the best route to take13:38
dtantsur"if nova is on the same machine as ironic without virtualenvs or similar" is a very common situation fwiw13:38
TheJuliaI was thinking if we could get the upgrade script ot fire lsof a few times, we might be able to get a list of what it is loading....13:39
jrolldtantsur: I didn't mean to imply it isn't13:39
*** fragatina has quit IRC13:39
jrollTheJulia: and/or run an ldd on nova-conductor before and after the ironic upgrade?13:40
TheJuliawell,I did also try just restrating n-cond to see if it came up clean, I've not had coffee nor looked at that yet13:40
dtantsurI don't think you can run ldd on python scripts13:40
TheJuliajroll: that is only static linkings13:40
jrollbleh, you might be right13:40
jrollyeah13:40
TheJuliawe need to actually pull what is open in ram13:40
* jroll also needs more coffee13:40
TheJulialsof -n |grep nova13:41
*** trown|outtypewww is now known as trown13:42
*** trown is now known as trown|ruck13:42
dtantsurbut if nova pike crashes with packages from queens, it means that their rolling upgrade does not work..13:43
jrollhm, yeah fair point13:44
sambetts|afkdepends if it only crashes if the package changes out during run time13:44
*** sambetts|afk is now known as sambetts13:44
jrollthey leave conductor running in rolling upgrades13:44
jrollonly upgrade compute afaik13:44
jroller, I may have that backwards though13:45
jrollI do: "For maximum safety (no failed API operations), gracefully shutdown all the services (i.e. SIG_TERM) except nova-compute." https://docs.openstack.org/nova/pike/user/upgrade.html13:45
jrollso everything but -compute goes first13:45
TheJuliahttp://logs.openstack.org/91/535391/3/check/ironic-grenade-dsvm-multinode-multitenant/41889b3/logs/screen-n-cond.txt.gz#_Jan_19_05_32_17_704998 Looks like library incompatability so just restarting n-cond doesn't work13:46
dtantsuroh, so maybe we should do the same in the CI13:46
dtantsurlike, upgrading everything except for n-cpu13:46
sambettsshouldn't their grenade plugin be handling all of that already?13:47
jrolldtantsur: eh, we want the ironic upgrade to be separate from the nova upgrade, ideally13:47
TheJuliait will upgrade nova-compute, but doesn't mean we _have_ to restart it13:47
TheJuliabut we will need to move the restart such that an ironic api endpoint is reachable13:47
jrolldtantsur: might be a valid workaround though13:47
sambettsso the upgrade needs to do: all nova services except compute, then ironic, then nova compute13:48
dtantsurcam we 1. upgrade ironic, 2. restart n-cpu, 3. upgrade nova?13:49
jrollthe "upgrade ironic" is what makes everything go nuts13:49
TheJuliadtantsur: afaik no13:49
TheJuliadtantsur: goes back to the ordering control issues13:49
dtantsurUGH13:49
TheJuliaugh13:49
TheJuliawe can't prevent n-cpu from being upgraded...13:49
TheJuliabecause it _will_ stop/start it13:50
TheJuliaas part of its upgrade13:50
sambettspersonally I don't think testing our rolling upgrade should test nova's rolling upgrades, so I'd be +1 to disabling upgrading any of nova13:50
dtantsuranother option: QUICKLY patch nova to stop hardcoding the latest microversion13:50
dtantsurwhich may be a work around until we land TheJulia's patches13:50
TheJuliasambetts: well, that is presently how we operate by default already13:50
TheJuliadtantsur: we would actually have to lower the microversion13:51
TheJuliadtantsur: OR.... get python-ironicclient paches landed13:51
* TheJulia has estimated timeline on the whiteboard for that13:51
sambettscan't do: upgrad all nova services except compute, then upgrade ironic, then upgrade nova compute?13:52
TheJuliaconsidering it is friday, there is no way to pull off a release of it, likely the earliest we could get such a patch landed is wednesday13:52
sambettscan't we do*13:52
TheJuliasambetts: all nova packages are upgraded in one shot, its sequence is stop/start api, compute, and conductor13:52
TheJuliawe would have to write custom nova upgrade stuffs13:52
dtantsurTheJulia: I meant, poor man's negotiation like http://paste.openstack.org/show/647041/13:53
*** Goneri has joined #openstack-ironic13:54
TheJuliadtantsur: that would do it....13:54
*** e0ne has joined #openstack-ironic13:55
jrolland doing the negotiation would allow us to upgrade nova first, then ironic?13:55
jrollthus fixing the CI issue?13:56
sambettswell, s/fixing/avoiding13:56
*** milan_ has joined #openstack-ironic13:56
jrollsure13:56
jrolljust wondering if there's any pieces I'm missing13:56
jroll(note: we'd have to caveat our upgrade docs with "if pike->queens, and nova and ironic share packages, upgrade order must be different")13:57
dtantsuranyone wants to try such nova patch?13:57
*** rbudden has joined #openstack-ironic13:57
dtantsurI can, but I'm also trying to figure out upgrade to hardware types..13:57
TheJuliaThe pin still broke my upgrade ironic and nova attempt :\ http://logs.openstack.org/96/535596/1/check/ironic-grenade-dsvm-multinode-multitenant/41aa951/logs/screen-n-cpu.txt.gz#_Jan_19_06_13_51_82225513:57
jrolldtantsur: I can in a bit13:58
jrolldoing some irl things at the moment13:58
dtantsurcool13:58
TheJuliajroll: lmk when you post it, we can fire a few test jobs off with it fairly quickly13:59
jrollTheJulia: okay, it might be 30+ minutes13:59
TheJuliajroll: works for me, I'm still trying to wake up13:59
jrollyes, go coffee13:59
*** sasha21 has joined #openstack-ironic14:00
jrollI do think it's worth letting nova know about the runtime segfaults, possibly with the bonus of nerd-sniping someone into helping14:03
*** SerenaFeng has joined #openstack-ironic14:07
*** weshay|ruck is now known as weshay|rover14:08
*** lbragstad has joined #openstack-ironic14:10
TheJuliaraised in chat, lets see what people say14:12
TheJuliaanother alternative, we could identify the parent nova-conductor process, and strace it for a second or two, then try and collect that process data14:16
TheJuliathat would give us a really clear picture of where in the world it is blowing up at14:17
TheJuliaHmm... nerd sniping might not work14:19
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add API methods for [un]rescue  https://review.openstack.org/35083114:20
*** crushil has quit IRC14:23
openstackgerritMichael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager  https://review.openstack.org/50179914:27
openstackgerritJulia Kreger proposed openstack/ironic master: DNM: Attempt to collect more info re grenade failures  https://review.openstack.org/53549214:29
*** jistr is now known as jistr|mtg14:30
TheJuliahopefully that will give us a little more insight into what is occuring, and maybe give us a clue of what libraries are "good"14:32
openstackgerritHugo Nicodemos proposed openstack/ironic master: Migrate python-oneviewclient validations to oneview hardware type  https://review.openstack.org/52459914:35
openstackgerritHugo Nicodemos proposed openstack/ironic master: Remove python-oneviewclient from oneview hardware type.  https://review.openstack.org/52472914:35
openstackgerritMichael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager  https://review.openstack.org/50179914:36
*** lucasagomes is now known as lucas-hungry14:38
*** jlabarre has joined #openstack-ironic14:42
jrolldtantsur: TheJulia: I don't need any depends-on for this nova negotiation patch, right? that'll be the base for our test patches?14:48
jrollI don't think we do, here it is https://review.openstack.org/53578614:50
patchbotpatch 535786 - nova - WIP: hacky negotiation of ironic microversion14:50
TheJuliajroll: not yet :)14:53
jrollcool14:53
dtantsurright14:53
jrollpretty sure that should work, I haven't executed it yet14:53
* jroll tries14:54
jrollappears to work fine with everything on queens14:57
jrollor maybe not14:58
jrollk, fixed now15:01
jrollworks with pike too15:01
jroller, pike ironic15:02
*** crushil_ is now known as crushil15:02
TheJuliajroll: a few comments on rev 1 if you haven't seen them, but later :)15:02
jrollTheJulia: thanks, I wasn't sure if we just wanted to test this or make it an actual patch15:03
TheJuliaI'm going to fire off a job in a moment15:03
TheJuliajust trying to choose the right one :)15:03
jrollin the latter case I could clean it up later today15:03
jrollcool :)15:03
*** jistr|mtg is now known as jistr15:04
*** SerenaFeng has quit IRC15:04
dtantsurjroll: I'm afraid we'll have to make it an actual patch, then replace with TheJulia's negotiation work15:06
*** pc_m has quit IRC15:08
*** pc_m has joined #openstack-ironic15:09
jrolldtantsur: yeah, I'll clean it up and try to think of a commit message that can reasonably explain the situation :P15:10
openstackgerritJulia Kreger proposed openstack/ironic master: Rework upgrade to upgrade nova/ironic  https://review.openstack.org/53559615:10
TheJulianot perfect, still upgrades ironic, we can peel that back once we have results15:10
TheJuliamarked that wf-1 and put a note in15:11
jrollcool15:12
TheJuliaI would say that it feels like a day where I should have something tasty.... except I have to drive the RV ~250 miles later today15:14
jrollsounds like a good reason to stop and get a dozen donuts and a gallon of coffee :P15:15
jrolland tasty real food upon arrival15:16
TheJuliaThere is not much where we're headed tonight... :(15:16
jrolloh :/15:16
TheJuliaWe'll likely cook a pizza or maybe some chicken once we get there15:16
*** crushil_ has joined #openstack-ironic15:19
jrollcould be worse :)15:19
TheJuliaI'm not sure zuul picked up the patch :\15:22
jrollit's there15:22
jrollunless you mean the depends-on15:23
TheJuliayeah, its in the zuul_changes string it looks like15:23
TheJulianow we wait :(15:23
*** livelace-link has joined #openstack-ironic15:23
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add rescue interface field to node-related notifications  https://review.openstack.org/50288915:26
openstackgerritShivanand Tendulker proposed openstack/ironic master: Update description for config params of 'rescue' interface  https://review.openstack.org/51791915:26
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add documentation for rescue interface  https://review.openstack.org/41960615:26
*** mjturek has joined #openstack-ironic15:28
TheJuliadtantsur: fyi, if you haven't noticed, I uploaded new revs for two of the three client changes... the two changes we would need at a minimum, the third is entirely optional15:34
*** lucas-hungry is now known as lucasagomes15:34
*** fragatina has joined #openstack-ironic15:36
TheJuliaWhen I finally have a new home, I'll just have a monitor for watching CI jobs.15:40
*** fragatina has quit IRC15:40
*** gmonteiro|home has quit IRC15:49
*** amarao has quit IRC15:51
dtantsurTheJulia: thanks, will check15:53
*** jlvillal has quit IRC16:04
*** crushil_ has quit IRC16:06
*** mjura has quit IRC16:10
*** jlvillal has joined #openstack-ironic16:14
*** crushil_ has joined #openstack-ironic16:19
*** jcoufal has joined #openstack-ironic16:24
*** penick has joined #openstack-ironic16:30
openstackgerritSam Betts proposed openstack/ironic master: Only set default network interface flat if enabled in config  https://review.openstack.org/53583016:32
sambettsdtantsur: just discovered that ^ while working on my CI16:33
*** AlexeyAbashkin has quit IRC16:35
*** fragatina has joined #openstack-ironic16:37
dtantsurk16:39
*** absubram has joined #openstack-ironic16:40
*** fragatina has quit IRC16:41
openstackgerritMark Goddard proposed openstack/ironic master: Add a version argument to traits DB API  https://review.openstack.org/53548216:42
openstackgerritMark Goddard proposed openstack/ironic master: Add RPC object for traits  https://review.openstack.org/53226816:43
openstackgerritMark Goddard proposed openstack/ironic master: Add RPC API and conductor manager for traits  https://review.openstack.org/53529616:43
openstackgerritMark Goddard proposed openstack/ironic master: API: Node Traits API  https://review.openstack.org/53226916:43
mgoddardrloo, jroll: ^^^16:43
*** cdearborn has joined #openstack-ironic16:48
TheJuliaand upgrade running *crosses fingers*16:52
TheJuliao/ cdearborn16:52
cdearborn\o TheJulia!16:54
NobodyCamGood Morning Ironic'ers16:58
NobodyCamand ofc....16:58
NobodyCamTGIF16:58
*** trown|ruck is now known as trown|outtypewww16:59
TheJuliaugh, not looking good for that patch...17:01
* TheJulia waits for logs to get posted17:03
*** absubram has quit IRC17:04
*** etingof has quit IRC17:04
TheJulialooks like most of the compute tests... build failures for instances....17:07
*** bnemec is now known as beekneemech17:13
TheJuliajroll: Ever seen anything like this http://logs.openstack.org/96/535596/2/check/ironic-grenade-dsvm-multinode-multitenant/079e25a/logs/screen-n-cpu.txt.gz#_Jan_19_16_55_26_003011 ?17:14
dtantsurmorning NobodyCam17:15
*** Goneri has quit IRC17:15
openstackgerritDmitry Tantsur proposed openstack/ironic master: Automatically migrate nodes to hardware types  https://review.openstack.org/53437317:16
dtantsurthis ^^^ was not easy at all...17:16
NobodyCamGood Morning dtantsur :) happy Friday17:17
TheJuliahttp://logs.openstack.org/96/535596/2/check/ironic-grenade-dsvm-multinode-multitenant/079e25a/logs/screen-ir-api.txt.gz#_Jan_19_17_00_40_97670017:20
jrollTheJulia: interesting, that placement error looks familiar17:22
TheJuliarealistically that run was with newer ironic, and it spewed some errors about a pin being present for rpc17:24
TheJuliaso, I'm going to restore the old logic to switch to an older api and not restart locally17:25
TheJuliaand go from there17:25
jrollyeah, +1 on using the old api17:25
*** penick has quit IRC17:25
jrollthough I guess I'm concerned the api doesn't work with a pin in it. I'm not sure if that's a good reason to be concerned.17:25
*** e0ne has quit IRC17:25
TheJuliaIt seemed to work, but not entirely sure17:27
openstackgerritJulia Kreger proposed openstack/ironic master: Rework upgrade to upgrade nova/ironic  https://review.openstack.org/53559617:28
openstackgerritDmitry Tantsur proposed openstack/ironic master: Remove the resourceclasses CI job  https://review.openstack.org/53586217:36
*** pcaruana has quit IRC17:36
*** fragatina has joined #openstack-ironic17:36
*** fragatina has quit IRC17:37
*** fragatina has joined #openstack-ironic17:37
*** rpioso|afk is now known as rpioso17:48
rpiosodtantsur: Is https://review.openstack.org/#/c/526773/ still being worked?17:48
patchbotpatch 526773 - ironic - boot mode support at ManagementInterface17:48
*** cjloader has joined #openstack-ironic17:54
jrollTheJulia: your comment here was for later, not this patch, right? https://review.openstack.org/#/c/535786/1/nova/virt/ironic/client_wrapper.py@13017:54
patchbotpatch 535786 - nova - WIP: hacky negotiation of ironic microversion17:54
*** rpioso is now known as rpioso|eat17:55
*** penick has joined #openstack-ironic17:56
*** milan_ has quit IRC17:56
*** baha has joined #openstack-ironic17:58
TheJuliajroll: the comment on how we would down the road17:59
*** crushil_ has quit IRC17:59
*** r-daneel has joined #openstack-ironic17:59
jrollTheJulia: I just linked to the RFE instead :)17:59
jrollthanks18:00
*** SerenaFeng has joined #openstack-ironic18:00
* jroll figures out how to test this18:00
*** derekh has quit IRC18:01
openstackgerritMerged openstack/ironic master: Adds RPC calls for rescue interface  https://review.openstack.org/50933618:02
*** Goneri has joined #openstack-ironic18:06
*** vmud213 has joined #openstack-ironic18:07
*** marios has quit IRC18:13
*** AlexeyAbashkin has joined #openstack-ironic18:16
*** AlexeyAbashkin has quit IRC18:20
openstackgerritvinay kumar muddu proposed openstack/ironic master: Update proliantutils version for Queens release  https://review.openstack.org/53589518:22
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Clean up CI playbooks  https://review.openstack.org/53589618:23
dtantsurrpioso|eat: better ask etingof when he's online, but I think yes. he may appreciate your help though18:23
*** dtantsur is now known as dtantsur|afk18:24
dtantsur|afkhappy Friday, y'all!18:24
rpioso|eatdtantsur: Cool. So, I’ll proceed to review it and circle back with etingof next time I see him online. Thank you.18:27
*** SerenaFeng has quit IRC18:28
dtantsur|afkrpioso|eat: np. he's in central EU time18:28
TheJuliaI'm going to go drive for a little while, I'll check back in a couple hours :(18:29
TheJulialooks like the gate test just got started, so ~2 hours :(18:29
vmud213dtantsur|afk or TheJulia, Mind taking a look at https://review.openstack.org/53589518:29
patchbotpatch 535895 - ironic - Update proliantutils version for Queens release18:29
vmud213small patch on updating the driver requirements18:30
rpioso|eatdtantsur|afk: Thanks, again. Enjoy your weekend :)18:30
*** weshay|rover is now known as weshay|bbiab18:31
jrollTheJulia: dtantsur|afk: updated that nova patch, should be landable ish18:38
jrollwhich means I blew away julia's test :(18:38
* jroll restarts it18:38
*** vmud213 has quit IRC18:43
*** jaganathan has quit IRC18:45
* sambetts --> home 18:48
sambettsnight all18:48
jroll\o18:48
sambettshave a great weekend18:48
sambettso/18:48
jrollyou too :)18:48
*** sambetts is now known as sambetts|afk18:48
openstackgerritvinay kumar muddu proposed openstack/ironic master: Update proliantutils version for Queens release  https://review.openstack.org/53589518:54
*** lucasagomes is now known as lucas-afk18:58
*** racedo has quit IRC18:59
*** vmud213 has joined #openstack-ironic18:59
*** penick has quit IRC19:01
*** penick has joined #openstack-ironic19:03
*** e0ne has joined #openstack-ironic19:12
vmud213vdrok: THere's a patch on driver-requirements here https://review.openstack.org/53589519:13
patchbotpatch 535895 - ironic - Update proliantutils version for Queens release19:13
vmud213can you please look into that?19:13
*** e0ne has quit IRC19:17
openstackgerritMark Goddard proposed openstack/ironic-tempest-plugin master: Add node trait tests  https://review.openstack.org/53590819:23
openstackgerritMerged openstack/ironic master: Updated from global requirements  https://review.openstack.org/53387519:27
*** makowals has joined #openstack-ironic19:30
*** harlowja has joined #openstack-ironic19:31
openstackgerritYusef Shaban proposed openstack/sushy master: Closes-Bug: 1744378  https://review.openstack.org/53591019:34
openstackbug 1744378 in sushy "Connector ignoring verify" [Undecided,New] https://launchpad.net/bugs/174437819:34
openstackgerritMark Goddard proposed openstack/ironic master: Add a version argument to traits DB API  https://review.openstack.org/53548219:35
openstackgerritMark Goddard proposed openstack/ironic master: Add RPC object for traits  https://review.openstack.org/53226819:35
openstackgerritMark Goddard proposed openstack/ironic master: Add RPC API and conductor manager for traits  https://review.openstack.org/53529619:35
openstackgerritMark Goddard proposed openstack/ironic master: API: Node Traits API  https://review.openstack.org/53226919:35
*** vmud213 has quit IRC19:35
*** AlexeyAbashkin has joined #openstack-ironic19:45
*** etingof has joined #openstack-ironic19:47
*** e0ne has joined #openstack-ironic19:47
*** AlexeyAbashkin has quit IRC19:49
openstackgerritJohn L. Villalovos proposed openstack/virtualbmc master: Change numeric constants to VARIABLE_NAME  https://review.openstack.org/53591619:59
*** manjeets has joined #openstack-ironic20:10
*** dprince has quit IRC20:20
*** dprince has joined #openstack-ironic20:20
*** e0ne has quit IRC20:21
openstackgerritMerged openstack/virtualbmc master: Support power reset command  https://review.openstack.org/53464620:25
*** AlexeyAbashkin has joined #openstack-ironic20:27
*** hw_wutianwei has quit IRC20:31
*** AlexeyAbashkin has quit IRC20:31
*** hw_wutianwei has joined #openstack-ironic20:32
*** fragatina has quit IRC20:34
*** e0ne has joined #openstack-ironic20:35
*** e0ne has quit IRC20:37
*** weshay|bbiab is now known as weshay20:38
*** weshay is now known as weshay|ruck20:38
*** weshay|ruck is now known as weshay|rover20:38
*** penick_ has joined #openstack-ironic20:40
*** penick has quit IRC20:42
openstackgerritIhar Hrachyshka proposed openstack/ironic master: DNM testing whether lib/neutron switch breaks this repo  https://review.openstack.org/53592820:44
*** penick_ has quit IRC20:58
*** penick has joined #openstack-ironic20:58
*** Nisha_Agarwal has joined #openstack-ironic20:59
*** e0ne has joined #openstack-ironic21:04
*** e0ne has quit IRC21:05
*** Nisha_Agarwal has quit IRC21:14
*** jtomasek has quit IRC21:14
*** bfournie1 has joined #openstack-ironic21:14
*** beekneemech has quit IRC21:14
*** Nisha_Agarwal has joined #openstack-ironic21:15
*** crushil_ has joined #openstack-ironic21:15
*** bfournie has quit IRC21:15
*** bnemec has joined #openstack-ironic21:17
*** makowals has quit IRC21:28
*** e0ne has joined #openstack-ironic21:29
*** e0ne has quit IRC21:33
openstackgerritMichael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager  https://review.openstack.org/50179921:38
openstackgerritMichael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager  https://review.openstack.org/50179921:45
*** cjloader has quit IRC21:48
*** cjloader has joined #openstack-ironic21:49
jrollTheJulia: your tests passed \o/21:50
*** jcoufal has quit IRC21:53
openstackgerritYusef Shaban proposed openstack/sushy master: Closes-Bug: 1744378  https://review.openstack.org/53591021:58
openstackbug 1744378 in sushy "Connector ignoring verify" [Undecided,New] https://launchpad.net/bugs/174437821:58
*** crushil_ has quit IRC22:01
*** tesseract has quit IRC22:01
*** dprince has quit IRC22:01
*** cjloader has quit IRC22:08
*** fragatina has joined #openstack-ironic22:13
*** Goneri has quit IRC22:14
TheJuliaawww yeah \o/22:16
*** baha has quit IRC22:20
openstackgerritJulia Kreger proposed openstack/ironic master: Rework upgrade to upgrade nova/ironic  https://review.openstack.org/53559622:21
*** cjloader_ has joined #openstack-ironic22:21
*** jlabarre has quit IRC22:28
*** penick_ has joined #openstack-ironic22:28
TheJuliajroll: looks like you might have a stray change in that nova change. I marked it and gave it a +1 otherwise :)22:28
TheJuliaAnyway, going to get back on the road. 80 more miles to go and it is starting to get windy :(22:30
*** penick has quit IRC22:31
*** penick has joined #openstack-ironic22:32
*** penick_ has quit IRC22:33
*** cjloader_ has quit IRC22:46
*** figleaf is now known as edleafe22:55
*** rbudden has quit IRC22:58
*** Nisha_Agarwal has quit IRC23:02
*** leakypipes has quit IRC23:14
openstackgerritYusef Shaban proposed openstack/sushy master: Closes-Bug: 1744378  https://review.openstack.org/53591023:15
openstackbug 1744378 in sushy "Connector ignoring verify" [Undecided,New] https://launchpad.net/bugs/174437823:15
*** karthiks has quit IRC23:16
*** AlexeyAbashkin has joined #openstack-ironic23:22
*** AlexeyAbashkin has quit IRC23:26
openstackgerritYusef Shaban proposed openstack/sushy master: Closes-Bug: 1744378  https://review.openstack.org/53591023:30
openstackbug 1744378 in sushy "Connector ignoring verify" [Undecided,New] https://launchpad.net/bugs/174437823:30
*** cdearborn has quit IRC23:31
*** karthiks has joined #openstack-ironic23:35
-openstackstatus- NOTICE: Zuul will be offline over the next 20 minutes to perform maintenance; active changes will be reenqueued once work completes, but new patch sets or approvals during that timeframe may need to be rechecked or reapplied as appropriate23:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!