Friday, 2015-02-06

*** Nisha_away has joined #openstack-ironic00:01
*** Nisha has quit IRC00:01
* NobodyCam hopes the J's can put a fix in for the weather next week :)00:01
*** eghobo has quit IRC00:06
*** Nisha has joined #openstack-ironic00:06
*** Nisha_away has quit IRC00:06
jlvillalNobodyCam: I'm looking forward to coming down.  I'm sure the weather is better than here in the Portland area :)00:11
jrollit's going to rain all next week :P00:11
jroll(says jay)00:11
NobodyCam:-p00:11
jlvillal:(  Luckily I only have to walk a few blocks from each BART station.00:12
*** andreykurilin_ has joined #openstack-ironic00:12
NobodyCamthe hp travel site says I'm .5 miles from the meetup00:13
*** Nisha has quit IRC00:13
NobodyCamso /me expects a mile each day up hill both ways in the rain00:13
jrollNobodyCam: where are you staying?00:13
jrollalso, lol00:13
jlvillalNobodyCam: Wear your fitness tracker :)00:13
NobodyCamone of the hiltons00:14
jrollmmm00:14
* BadCub_ will take the car, even if it is just to drive .5 miles00:14
NobodyCamlol00:14
* BadCub_ also realizes in SF, that .5 miles will take 2.5 hours to complete00:14
NobodyCam:(00:15
jrolllol00:15
jrollI'm glad you at least realize thar00:15
jrollthat00:15
jrollrussell_h: ^ what's the good place to park00:15
mrdadevananda: Am working on the python-ironicclient on the side00:15
BadCub_Yep! driven up there too many times00:15
mrdanot much is needed there tbh00:16
mrdajroll: I've asked JayF to fix the weather problem.  It's all good00:16
jrollneat00:16
russell_hI've never parked around here, but I know Kristy parks here sometimes: http://www.303second.com/building-information/parking-information/00:18
jrollyeah, that one00:18
jrollerr, maybe not00:18
jrollI tohught there was one for like $18/day00:18
jrolloh, Early Bird (in between 7AM – 9AM out by 6PM) $18/day00:19
jrollBadCub_: ^ park there00:19
russell_heverywhere keeps jacking up prices00:19
jrollin SF? really?00:19
jroll:P00:19
russell_hheh00:19
BadCub_hmmm00:21
* devananda realises laptop is still on, brain is not, goes to sleep00:22
JayFrussell_h: I park there all the time; it's great00:22
NobodyCamlol parking in SF is high .... mock.shocked.look()00:22
JayFif you want free/cheap parking, you can park and ride from the bart lots00:22
JayFbut those fill up really early on commute days00:23
jrollJayF: he's staying half a mile away :P00:23
NobodyCamnight devananda00:23
JayFoh, then he should walk00:23
BadCub_yep! But .5 miles in the rian.. eeewww00:23
BadCub_*rain00:23
jroll00:14:20               * | BadCub_ will take the car, even if it is just to drive .5 miles00:23
jroll00:14:59               * | BadCub_ also realizes in SF, that .5 miles will take 2.5 hours to complete00:24
BadCub_LOL00:24
jroll:P00:24
BadCub_Gn devananda00:25
NobodyCamlol : http://www.umbrellahat.net00:25
BadCub_I'm just lazy and don;t want to walk in teh rain. But on the other hand, it would probably be faster than waiting for the valet to bring the car around00:25
*** jmanko has quit IRC00:27
JayFFYI: pep8 tests appear to be broken for IPA00:33
JayFI'm looking into it now.00:34
JayFclif_h: ^ why pep8 failed on your patch00:34
jrollgoody!00:34
*** korekhov has quit IRC00:38
*** korekhov has joined #openstack-ironic00:38
*** achanda has quit IRC00:39
*** Marga_ has quit IRC00:42
*** korekhov has quit IRC00:42
NobodyCamhmmm how should I answer question #83 .... http://www.buzzfeed.com/floperry/how-hipster-are-you#.ytBRBjbMw00:45
BadCub_lol00:47
NobodyCamjroll: nice ... https://review.openstack.org/#/c/15336300:53
jrollwoot00:53
jrollNobodyCam: that might take a while to gate, if you see it through later can you recheck that backport?00:53
NobodyCamI do agree with JayF that we should keep the devstack patch going00:54
NobodyCamoh ya... I basiclly done00:54
NobodyCamI recheck and what not in hte mornign00:54
NobodyCam*morning even00:54
jrolloh really?00:54
jrollI just abandoned it00:55
NobodyCammeh okay :)00:55
jrollagent job won't run against juno now00:55
jrollso no sense in backporting agent fixes to juno devstack00:55
NobodyCamya or icehouse00:55
NobodyCam:)00:55
jrollright, though ironic doesn't support icehouse and the agent driver didn't exist then :P00:56
NobodyCamhehheeh00:56
NobodyCamits landing so all is good and right with the world00:56
* NobodyCam shines his rose colored glasses00:57
*** BadCub_ has quit IRC01:08
* NobodyCam needs stronger rose colored glasses: http://logs.openstack.org/44/152844/3/gate/gate-tempest-dsvm-ironic-agent_ssh/d77b8ca/logs/screen-ir-cond.txt.gz#_2015-02-05_23_43_32_92201:11
*** andreykurilin_ has quit IRC01:11
*** zhenzanz has joined #openstack-ironic01:18
*** openstack has joined #openstack-ironic01:33
*** chenglch has joined #openstack-ironic01:39
*** korekhov has joined #openstack-ironic01:40
*** rloo_afk has quit IRC01:41
*** alex_xu has quit IRC01:44
*** alex_xu has joined #openstack-ironic01:46
*** korekhov has quit IRC01:46
*** alex_xu has quit IRC01:48
*** r-daneel has quit IRC01:51
*** rwsu is now known as rwsu-afk01:53
*** korekhov has joined #openstack-ironic02:01
openstackgerritJosh Gachnang proposed openstack/ironic: Implement Cleaning States  https://review.openstack.org/15344402:03
JoshNang\o/ more cleaning patches coming soon02:03
*** ChuckC_ has joined #openstack-ironic02:09
*** korekhov has quit IRC02:11
*** korekhov has joined #openstack-ironic02:11
*** ChuckC has quit IRC02:13
*** korekhov has quit IRC02:16
*** yog_ has quit IRC02:19
*** zhenzanz has joined #openstack-ironic02:23
*** zhenzanz has quit IRC02:33
*** zhenzanz_ has joined #openstack-ironic02:33
*** zhenzanz_ is now known as zhenzanz02:33
*** korekhov has joined #openstack-ironic02:35
*** ramineni has joined #openstack-ironic02:39
*** korekhov_ has joined #openstack-ironic02:46
*** kan_ has quit IRC02:48
*** harlowja is now known as harlowja_away02:48
*** korekhov has quit IRC02:49
*** korekhov_ has quit IRC02:50
*** spandhe has quit IRC02:51
*** ChuckC has joined #openstack-ironic02:59
*** ChuckC_ has quit IRC02:59
*** zhenzanz has quit IRC03:04
*** achanda has joined #openstack-ironic03:17
*** Marga_ has joined #openstack-ironic03:20
*** Marga_ has quit IRC03:20
*** Marga_ has joined #openstack-ironic03:21
*** Nisha has joined #openstack-ironic03:22
*** achanda has quit IRC03:23
*** r-daneel has joined #openstack-ironic03:31
*** r-daneel has quit IRC03:35
*** naohirot has quit IRC03:35
*** r-daneel has joined #openstack-ironic03:50
*** naohirot has joined #openstack-ironic04:04
*** early has quit IRC04:04
*** yog_ has joined #openstack-ironic04:09
*** achanda has joined #openstack-ironic04:23
*** early has joined #openstack-ironic04:25
*** zhenzanz has joined #openstack-ironic04:25
*** anderbubble has joined #openstack-ironic04:29
* mrda struggles to work out why the doc job is failing for 141737 after the addition of the microversion stuff04:36
*** PaulCzar has joined #openstack-ironic04:36
*** chenglch has quit IRC04:37
*** Haomeng has quit IRC04:42
*** early has quit IRC04:43
*** Haomeng has joined #openstack-ironic04:44
*** EmilienM|afk has quit IRC04:45
*** EmilienM has joined #openstack-ironic04:46
*** rameshg87 has joined #openstack-ironic04:49
*** zhenzanz has quit IRC04:49
*** ijw has quit IRC04:50
*** eghobo has joined #openstack-ironic04:52
*** anderbubble has quit IRC04:54
*** anderbubble has joined #openstack-ironic04:56
*** spandhe has joined #openstack-ironic05:05
openstackgerritNaohiro Tamura proposed openstack/ironic: Add iRMC Management module for iRMC Driver  https://review.openstack.org/14680305:06
*** killer_prince is now known as lazy_prince05:06
*** eghobo has quit IRC05:21
*** achanda has quit IRC05:25
*** lazy_prince is now known as killer_prince05:25
*** achanda has joined #openstack-ironic05:27
*** anderbubble has quit IRC05:29
*** killer_prince is now known as lazy_prince05:30
*** eghobo has joined #openstack-ironic05:33
*** harlowja_away has quit IRC05:38
*** early has joined #openstack-ironic05:47
*** early has quit IRC05:50
openstackgerritNaohiro Tamura proposed openstack/ironic: Add iRMC Virtual Media Deploy module for iRMC Driver  https://review.openstack.org/15195805:55
*** early has joined #openstack-ironic06:06
*** Nisha has quit IRC06:09
*** early has quit IRC06:12
*** Nisha has joined #openstack-ironic06:13
mrdaOk, giving up for today.  devananda (or any other ironic developer) - I haven't been able to solve the docs job problem, will look at it inbetween flights, but if you have any spare cycles, please feel free to debug and post a patch to solve (ref 141737)06:14
*** mrda is now known as mrda-away06:14
*** spandhe has quit IRC06:17
*** eghobo has quit IRC06:21
*** early has joined #openstack-ironic06:23
*** xxj has quit IRC06:29
*** xxj has joined #openstack-ironic06:30
*** openstackgerrit has quit IRC06:35
*** openstackgerrit has joined #openstack-ironic06:35
*** early has quit IRC06:43
openstackgerritTan Lin proposed openstack/ironic: Add AMT-PXE-Driver Common Library  https://review.openstack.org/13518406:45
openstackgerritTan Lin proposed openstack/ironic: Add AMT-PXE-Driver Power&Management Interface  https://review.openstack.org/15285706:45
openstackgerritTan Lin proposed openstack/ironic: Enable AMT driver to set boot device in pxe deploy  https://review.openstack.org/15285806:45
*** chenglch has joined #openstack-ironic06:45
*** early has joined #openstack-ironic06:49
*** achanda has quit IRC06:52
*** r-daneel has quit IRC06:57
*** achanda has joined #openstack-ironic07:01
*** chlong has quit IRC07:12
*** chlong has joined #openstack-ironic07:13
*** mgoddard has joined #openstack-ironic07:20
*** mgoddard has quit IRC07:21
*** Marga_ has quit IRC07:23
*** achanda has quit IRC07:27
openstackgerritMerged openstack/python-ironicclient: cli support --os-endpoint  https://review.openstack.org/15276507:35
*** chenglch has quit IRC07:55
*** chenglch has joined #openstack-ironic07:55
*** ifarkas has joined #openstack-ironic08:08
openstackgerritjiangfei proposed openstack/python-ironicclient: improve chassis-node-list option  https://review.openstack.org/15185908:16
*** yog_ has quit IRC08:42
*** foexle has joined #openstack-ironic08:44
*** alexpilotti has joined #openstack-ironic08:51
*** chlong has quit IRC08:53
*** teju has joined #openstack-ironic08:57
*** erwan_taf has joined #openstack-ironic08:58
*** yog_ has joined #openstack-ironic08:59
*** derekh has joined #openstack-ironic09:02
*** jgrimm is now known as zz_jgrimm09:14
*** MattMan has joined #openstack-ironic09:18
*** andreykurilin_ has joined #openstack-ironic09:23
*** alexpilotti has quit IRC09:32
*** Nisha_away has joined #openstack-ironic09:39
*** Nisha has quit IRC09:42
*** Nisha_away has quit IRC09:45
*** jcoufal has joined #openstack-ironic09:46
*** early has quit IRC09:51
*** kbyrne has quit IRC09:53
*** jerryz has quit IRC09:53
*** BadCub has quit IRC09:53
*** BadCub has joined #openstack-ironic09:54
*** jcoufal has quit IRC09:55
*** kbyrne has joined #openstack-ironic10:06
*** chlong has joined #openstack-ironic10:09
*** chenglch has quit IRC10:09
*** moshaile has joined #openstack-ironic10:12
*** subscope has quit IRC10:14
*** jerryz has joined #openstack-ironic10:20
*** subscope has joined #openstack-ironic10:26
*** andreykurilin_ has quit IRC10:31
*** jcoufal has joined #openstack-ironic10:33
openstackgerritAnusha Ramineni proposed stackforge/proliantutils: Initial Support to RIS  https://review.openstack.org/15278010:40
*** subscope has quit IRC10:52
*** ramineni has quit IRC11:04
openstackgerritRamakrishnan G proposed stackforge/proliantutils: Add hpssa module to proliantutils  https://review.openstack.org/15351911:08
*** Haomeng|2 has joined #openstack-ironic11:10
*** Haomeng has quit IRC11:11
openstackgerritRamakrishnan G proposed stackforge/proliantutils: Add hpssa module to proliantutils  https://review.openstack.org/15351911:26
*** rameshg87 has quit IRC11:27
*** pelix has joined #openstack-ironic11:30
*** teju has left #openstack-ironic11:31
*** zigo has quit IRC11:42
*** yarker has quit IRC11:57
*** bradjones has quit IRC11:59
*** sirushti has quit IRC12:00
*** tonyb has quit IRC12:00
*** yarker has joined #openstack-ironic12:00
*** sirushti has joined #openstack-ironic12:00
*** tonyb has joined #openstack-ironic12:01
*** bradjones has joined #openstack-ironic12:02
*** russell_h has quit IRC12:06
*** jroll has quit IRC12:06
*** russell_h has joined #openstack-ironic12:08
*** xxj has quit IRC12:09
*** Haomeng|2 has quit IRC12:09
*** alex_xu has joined #openstack-ironic12:09
*** russell_h has quit IRC12:09
*** russell_h has joined #openstack-ironic12:09
*** BadCub_ has joined #openstack-ironic12:11
BadCub_Morning Ironic12:13
*** maurosr has quit IRC12:17
*** jgrimmn has joined #openstack-ironic12:19
*** Isotopp has quit IRC12:19
*** zsmithnyc has quit IRC12:19
*** morgabra has quit IRC12:19
*** comstud has quit IRC12:19
*** wendar has quit IRC12:19
*** mgagne has quit IRC12:19
*** rainya has quit IRC12:19
*** cppforlife_ has quit IRC12:19
*** zz_jgrimm has quit IRC12:19
*** dtantsur|afk has quit IRC12:19
*** maurosr has joined #openstack-ironic12:19
*** jroll has joined #openstack-ironic12:20
*** dtantsur|afk has joined #openstack-ironic12:20
*** Isotopp has joined #openstack-ironic12:20
*** zsmithnyc has joined #openstack-ironic12:20
*** morgabra has joined #openstack-ironic12:20
*** comstud has joined #openstack-ironic12:20
*** wendar has joined #openstack-ironic12:20
*** mgagne has joined #openstack-ironic12:20
*** rainya has joined #openstack-ironic12:20
*** cppforlife_ has joined #openstack-ironic12:20
*** pradipta has joined #openstack-ironic12:36
*** stendulker has joined #openstack-ironic12:52
*** ndipanov has joined #openstack-ironic12:54
*** smoriya has quit IRC12:55
*** kbs1 has quit IRC12:57
*** early has joined #openstack-ironic13:01
*** early has quit IRC13:08
*** nosleep77 has joined #openstack-ironic13:15
*** athomas has joined #openstack-ironic13:16
*** alexpilotti has joined #openstack-ironic13:20
*** dprince has joined #openstack-ironic13:21
*** anderbubble has joined #openstack-ironic13:26
*** anderbubble has quit IRC13:28
*** dlpartain has joined #openstack-ironic13:29
*** dlpartain has left #openstack-ironic13:31
*** yog_ has quit IRC13:32
*** jjohnson2 has joined #openstack-ironic13:36
ShrewsBadCub_: morning13:46
Shrewsand to others13:46
BadCub_morning Shrews13:46
*** kbs has joined #openstack-ironic13:46
* Shrews wonders who all is "working" today on the ski slops of France13:47
Shrewsslopes, even13:47
BadCub_lol13:47
* BadCub_ imagines folks sliding out of control down slopes while checking messages13:47
* Shrews looks for out of control nerds here: http://www.meteo-chamrousse.com/webcams.html13:49
BadCub_that just looks way too cold, and way too much snow for this guy13:50
*** Marga_ has joined #openstack-ironic13:51
*** athomas has quit IRC13:52
*** ndipanov has quit IRC13:59
*** dttocs has joined #openstack-ironic14:01
*** jroll has quit IRC14:03
*** jroll has joined #openstack-ironic14:03
*** dttocs has quit IRC14:07
*** dttocs has joined #openstack-ironic14:07
*** dttocs has quit IRC14:08
*** dttocs has joined #openstack-ironic14:08
*** mlsoule has joined #openstack-ironic14:09
*** mjturek1 has joined #openstack-ironic14:10
jrollmorning all :)14:14
NobodyCammorning Ironic14:15
NobodyCammorning jroll BadCub_ Shrews14:15
jrollhiya NobodyCam Shrews and BadCub_ :)14:15
NobodyCam:)14:15
ShrewsNobodyCam: jroll: morning14:17
NobodyCam:)14:17
ShrewsNobodyCam: which hotel did you get for next week?14:18
Shrewsor RVing in?14:18
jrollNobodyCam: you're awful happy today, it must be friday14:18
NobodyCamhilton ...14:18
NobodyCamoh ya it s deff TGIF :)14:18
jroll:)14:18
NobodyCamworld still fuzzy14:18
Shrewshttps://twitter.com/devananda/status/56365668506430668814:20
Shrewsjroll: i demand you organize a snowboard trip for next week14:20
jrolllol14:21
Shrewsah, the snowy mountains of SF14:21
jrollwe can go up to twin peaks14:21
NobodyCamlol14:21
jrolland ride... something14:21
jrollprobably not snowboards14:21
NobodyCamhahahha14:21
*** stendulker has quit IRC14:29
NobodyCamspec review for a discovery tool several +1's and one +2 https://review.openstack.org/#/c/13486614:37
naohirotjroll: NobodyCam: Shrews: good morning14:52
jrollhi naohirot14:52
*** ChuckC has quit IRC14:52
*** alex_xu has quit IRC14:52
naohirotjroll: today jenkins gate failed, and I failed a bug report which is something to do with ConfigDrive14:53
*** xu_alex has joined #openstack-ironic14:53
naohirotjroll: https://bugs.launchpad.net/ironic/+bug/141883314:53
openstackLaunchpad bug 1418833 in Ironic "check-tempest-dsvm-ironic-agent_ssh fails due to ConfigDriveWriteError" [Undecided,New]14:53
jrollnaohirot: is that for every patch?14:53
naohirotjroll: Yes14:53
jrollughhhhhhhhh14:53
NobodyCamI saw that yesterday I think14:54
NobodyCam01:11  > NobodyCam needs stronger rose colored glasses: http://logs.openstack.org/44/152844/3/gate/gate-tempest-dsvm-ironic-agent_ssh/d77b8ca/logs/screen-ir-cond.txt.gz#_2015-02-05_23_43_32_92214:54
jrollyeah14:54
jrollI rechecked that, figured it was a one-off14:55
naohirotjroll: my two patches failed, and also Tan Lin's failed14:55
NobodyCam:(14:55
jrollI understand14:55
jrollso uh14:55
jrolldid we add configdrive to tempest?14:55
jrollor does it always use it14:56
jrollI wonder if how we do that just doesn't work for nested virt or something14:56
naohirotjroll: I read the bp, but still I don't fully understand what is configdrive :)14:56
jrollnaohirot: think metadata service without the metadata service14:57
jrollhttps://bugzilla.redhat.com/show_bug.cgi?id=109577314:58
openstackbugzilla.redhat.com bug 1095773 in util-linux "partx -a /dev/vda not working - VM reboot required to be synched to newly added size of partition." [Urgent,New] - Assigned to kzak14:58
jrollwhee.14:58
naohirotjroll: is it something to do with IPA?15:00
jrollnaohirot: ... yes15:00
jrollthat's why only IPA jobs are failing15:00
jrollI have a though15:01
jrollt15:01
jrollnope, I'm wrong15:01
jrollthis is... not awesome15:01
jrollJayF: I need your technical awesomeness on this15:02
naohirotjroll: Is Ironic team maintaining check-tempest-dsvm-ironic-agent_ssh?15:02
jrollJayF: partprobe fails on virt "bare metal" and has now broken the gate :|15:02
jrollnaohirot: yes15:02
naohirotjroll: I see.15:02
jrollin case your curious, this is where it fails: https://github.com/openstack/ironic-python-agent/blob/master/ironic_python_agent/shell/copy_configdrive_to_disk.sh#L4615:03
*** r-daneel has joined #openstack-ironic15:03
naohirotjroll: now I understand why you put the Red Hat Bugzilla – Bug 109577315:04
openstackbug 1095773 in linux-lowlatency (Ubuntu) "linux-lowlatency: <version to be filled> -proposed tracker" [Undecided,Invalid] https://launchpad.net/bugs/109577315:04
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: Use partx to update partition table  https://review.openstack.org/15359215:09
jrollgoing to see what happens with this15:09
*** Marga_ has quit IRC15:11
*** Marga_ has joined #openstack-ironic15:12
*** mjturek1 has quit IRC15:13
lazy_princehi all.. using cli, is it possible to add instance_info to a ironic node..?15:15
jrolllazy_prince: sure, ironic node-update uuid add /instance_info/key=val15:15
jrollor s/add/replace/ if the key exists15:15
lazy_princecool.. thanks..15:15
jrollnp15:15
*** mjturek1 has joined #openstack-ironic15:16
*** mjturek1 has quit IRC15:17
*** mjturek1 has joined #openstack-ironic15:17
*** ijw has joined #openstack-ironic15:17
*** ijw has quit IRC15:18
*** ijw has joined #openstack-ironic15:18
*** jgrimmn is now known as zz_jgrimmn15:21
lazy_princeumm.. actually one of node has failed deployment and an instance id is assigned to it.. So i am trying to recover that node.. is there a way to do that..? nova delete is not helping..15:22
*** Marga_ has quit IRC15:24
jrolllazy_prince: I would think nova delete should work15:27
*** mgoddard has joined #openstack-ironic15:27
jrollbut you can always remove the instance uuid, tear it down, reset-state on the nova instance and delete it15:27
*** anderbubble has joined #openstack-ironic15:28
lazy_princeokay..15:29
lazy_princejroll: are you guys planning to upstream ironic-neutron-plugin code..?15:30
jrolllazy_prince: into neutron?15:30
lazy_princeyes..15:30
jrolllazy_prince: it's an ml2 plugin, do they even accept those anymore?15:30
jrollI thought they pushed them all out15:30
jrollbut at any rate, not really15:31
lazy_princeso is there any alternate plan in neutron to provide support for ironic..?15:31
jrollI have no idea what neutron is doing15:32
jrollthere's been some activity around real switches, but unclear if it's going anywhere15:32
jrollyou might ask kevin benton15:32
lazy_princedo you have his irc name..?15:32
*** athomas has joined #openstack-ironic15:33
lazy_princethe patches are abondned.. and i wanted to work on them as we nned thoss..15:33
lazy_princes/nned/need15:33
jrollI have no idea15:34
jrollsorry15:35
jrollwe're running production just fine without it being in neutron, fwiw15:35
jroll:P15:35
lazy_prince:) cool..15:35
*** mgoddard has quit IRC15:37
* naohirot have a nice weekend, good night15:41
*** naohirot has quit IRC15:41
gilliardGood morning Ironic15:42
BadCub_morning gilliard15:44
jrollstack@devstack:~/nova$ tox -r -epy2715:44
jrollRIP15:44
jrollheya gilliard :)15:44
*** lnxnut has joined #openstack-ironic15:54
*** jlvillal has quit IRC15:56
*** mgoddard has joined #openstack-ironic15:57
*** mgoddard has quit IRC16:02
*** Nisha has joined #openstack-ironic16:03
*** jlvillal has joined #openstack-ironic16:05
*** lazy_prince is now known as killer_prince16:07
*** david-lyle_afk is now known as david-lyle16:07
*** Marga_ has joined #openstack-ironic16:10
*** jcoufal has quit IRC16:19
* NobodyCam is out of COFFEE... starbucks run required.... brb16:20
*** openstackgerrit has quit IRC16:21
*** openstackgerrit has joined #openstack-ironic16:22
*** Nisha_away has joined #openstack-ironic16:27
*** mgoddard has joined #openstack-ironic16:29
*** Nisha has quit IRC16:30
*** mjturek1 has quit IRC16:30
*** mjturek1 has joined #openstack-ironic16:31
*** dttocs has quit IRC16:34
*** dttocs has joined #openstack-ironic16:35
*** dtantsur|afk is now known as dtantsur16:36
dtantsurg'evening folks!16:37
* dtantsur is online for an hour after the conference16:37
*** Nisha_away has quit IRC16:38
*** mgoddard has quit IRC16:40
* NobodyCam is back16:43
*** ndipanov has joined #openstack-ironic16:44
jrollheya dtantsur :)16:44
agordeevhi ironic-folks16:45
agordeevhi dtantsur jroll16:45
dtantsuragordeev, jroll, NobodyCam, o/16:45
agordeevjroll: i've just noticed that you're going to replace partprobe call with partx. https://review.openstack.org/#/c/153592/16:45
jrollagordeev: hey, long time no see16:46
agordeevjroll: yep, it's been a while16:46
jrollagordeev: well... see the bug, partprobe doesn't work in VMs apparently16:46
jrollthat did pass though, yay16:46
* jroll will want to test it on hardware16:46
* jroll pokes JayF16:47
agordeevjroll: could you tell me, is that script calling partprobe after the disk partitioning has been done?16:47
NobodyCamnight dtantsur16:48
*** Nisha has joined #openstack-ironic16:48
jrollagordeev: we write a full disk image to the disk, call partprobe, then make a configdrive partition16:48
agordeevjroll: so, full disk image contains partition table, right?16:49
jrollcorrect16:49
*** dhellmann_ has quit IRC16:53
*** dhellmann_ has joined #openstack-ironic16:54
*** ifarkas has quit IRC16:54
*** ndipanov has quit IRC16:54
*** dhellmann_ has quit IRC16:56
*** Nisha has quit IRC16:57
agordeevjroll: i don't think it's partprobe related issues. Have you tried to call partprobe several times with a few secs of sleep?16:57
*** dhellmann_ has joined #openstack-ironic16:57
*** Nisha has joined #openstack-ironic16:57
jrollagordeev: it's failing every time, there's also a redhat bug about this, https://bugzilla.redhat.com/show_bug.cgi?id=109577316:58
openstackbugzilla.redhat.com bug 1095773 in util-linux "partx -a /dev/vda not working - VM reboot required to be synched to newly added size of partition." [Urgent,New] - Assigned to kzak16:58
*** ChuckC has joined #openstack-ironic16:58
jrollagordeev: this never fails in real life, only in the gate (haven't tested in virt otherwise)16:58
*** dhellmann_ has quit IRC16:59
jrollwell I guess that's not partprobe, idk, might not be related16:59
*** dhellmann_ has joined #openstack-ironic16:59
jrollagordeev: I'll try that too just for funsies17:00
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: WIP: retry partprobe a few times  https://review.openstack.org/15363017:02
agordeevjroll: why not adding a sleep between partprobe calls? i think it's a races somewhere in part of linux run-time.17:03
agordeevsleep should help to reduce cpu load between calls17:04
jrollagordeev: oops17:05
jrollyeah, meant to add a sleep17:05
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: WIP: retry partprobe a few times  https://review.openstack.org/15363017:06
JayFjroll: that's some other bug, for sure17:08
JayFjroll: those partitions should *not* be in use at that point in time17:08
*** Marga_ has quit IRC17:08
jrollJayF: right, but like, idk17:08
JayFjroll: and given this worked for months and months before this; I'm suspicious of the diagnosis and fix17:08
jrollthis has never run in the gate until now17:08
jrollbecause configdrive17:08
JayFoh.17:08
JayFOH.17:08
JayFHm.17:08
JayFThat shouldn't error in that way though, at all.17:09
jrollright.17:09
JayFAlthough ++ to us for passing through that error17:09
*** rwsu-afk is now known as rwsu17:09
jrollyeah, but17:09
JayFIs it reproducable?17:09
jrollnow the gate is broken :D17:09
jrollI haven't tried yet, been debugging nova things :/17:09
JayFwell the gate is broken but I don't want us to massage it17:09
JayFI want us to find what's really broken17:09
jrollwell, yes17:09
JayFand if partprobe just never works in virt; so be it17:09
JayFbut lets not assume that?17:09
jrollright, see the patch I just pushed17:09
JayFfor instance it works in virtualbox for me locally17:10
JayFthe patch that replaces it with partx?17:10
JayFoh the retry wip17:10
jrollyeah17:10
JayFThat's a good idea17:11
jrollwas agordeev's idea :D17:11
JayFwait that's bad code though17:11
JayFyou shouldn't || true it, should you?17:11
jrollyes, it is17:11
jrollwhy?17:11
jrollOH17:11
jrollheh17:11
JayFyou'll have to either remove set -e17:12
JayFor make the logic something like partprobe || retry17:12
agordeevjroll: i have something to show you. I think it's related to partitioning failures.17:12
jrollwe don't set -e17:12
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: WIP: retry partprobe a few times  https://review.openstack.org/15363017:12
jrollwe just fail things explicitly17:12
agordeevjroll: https://etherpad.openstack.org/p/Fuel-Agent-EPIC-BUG-device-is-busy17:12
jrollagordeev: so show me :)17:12
agordeevjroll: i hope that helps. Otherwise, try to profile what happens when error appears with 'udevadm monitor'17:14
JayFjroll: in that case; I'd do partprobe && break17:14
JayFjroll: I think break is the right one for busting out of a loop in bash17:14
JayFand if it fails N number of times then explicitly fail it out17:14
jrollJayF: yeah, this needs to be better17:15
jrollagordeev: interesting, idk if that's related to this, honestly17:15
JayFthe udevadm settle is an interesting idea17:15
JayFbut I don't think it counts as hotplugging a device when you add new partition17:16
jrollI really don't know enough about this stuff to have an opinion17:16
JayFjroll: is this failing consistently everywhere with that message?17:16
openstackgerritDmitry Tantsur proposed stackforge/ironic-discoverd: Allow ramdisk to specify PXE boot interface  https://review.openstack.org/15326117:16
jrollJayF: yes17:16
jrollJayF: well, in ironic reviews at least17:17
jrollhaven't tried an agent_ssh-src job without any patches17:17
* jroll rechecks a thing17:17
JayFI mean, same deal really17:17
JayFthat's incredibly strange17:17
JayFI think your retries patch will fix it17:17
JayFand we'll have to clean it up some17:17
agordeevjroll: JayF: at least, few secs of sleep between partprobe call works for us (fuel-agent)17:17
JayFagordeev: yeah; the retry will effectively do that17:17
jrollI rechecked https://review.openstack.org/#/c/152755/17:18
jrolljust for science17:18
JayFagordeev: but still allow it to "work quickly" if the hardware does it righty17:18
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: WIP: retry partprobe a few times  https://review.openstack.org/15363017:18
jrollugh, commit message17:19
*** tonyb has quit IRC17:19
*** mgoddard has joined #openstack-ironic17:20
jrollok, that should do it17:20
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: Retry partprobe if it fails  https://review.openstack.org/15363017:20
*** tonyb has joined #openstack-ironic17:20
*** rwsu has quit IRC17:20
*** Nisha has quit IRC17:23
*** early has joined #openstack-ironic17:23
*** zz_jgrimmn is now known as jgrimm17:23
JayFjroll: look at my comment on that17:26
*** korekhov_ has joined #openstack-ironic17:26
JayFjroll:17:27
JayFbash-4.3$ for fail in 1 2 3 4; do sleep $(($fail*1)); false && break; done || echo "broke"17:27
JayFbroke17:27
jrollah yeah17:27
jrollI'm going to sleep after the call though17:27
JayFno17:27
JayFthat breaks it17:27
jrollwat17:27
*** davideagnello has quit IRC17:27
JayFit has to be the last command executed that returns a 117:27
JayFfor that construct to work17:28
jrollugh17:28
JayFa sleep 1 to let the disk settle is likely to make it succeed first try anyway, I'd suspect17:28
*** anderbubble_ has joined #openstack-ironic17:28
JayFjroll: you could do for attempt in 0 1 2 3 417:28
JayFthen you'd get the first run as a sleep 017:28
JayFlemme make sure that works17:28
jrollyeah17:28
JayFthat seems to work17:28
JayF\o/17:29
*** anderbubble has quit IRC17:29
*** anderbubble_ is now known as anderbubble17:29
*** korekho__ has joined #openstack-ironic17:29
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: Retry partprobe if it fails  https://review.openstack.org/15363017:29
JayFjroll: https://gist.github.com/jayofdoom/9e0c2d512135eb8a337617:29
JayFjroll: just some science :D17:29
jrollyay science17:29
JayFjroll: not going to do it stepped?17:30
JayFjroll: multiplicative like I suggested?17:30
JayF$(($attempt * 2))17:30
JayFor whatever17:30
jrollnah, linear seems fine17:30
JayFI mean, I disagree17:30
jrollthen fix it17:30
JayFthat means by the last attempt it's been ~10s17:31
JayFI guess that's OK17:31
JayFheh, in my testing I did *117:31
JayFwhich is the same as that17:31
* JayF whee17:31
jrollheh17:31
JayFjroll: commit message still needs fixup. I can do it if you want?17:31
jrollif it doesn't pass after 10s I don't think it's going to pass at all17:31
jrollugh17:31
jrollI'll do it17:31
JayFI agree; was thinking wrongly17:31
JayFwhen I see IPA broke the gate before I hit my chair my brain hasn't been spun up yet17:32
JayFlol17:32
*** korekhov_ has quit IRC17:32
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: Retry partprobe if it fails  https://review.openstack.org/15363017:32
JayFjroll: I suspect this is actually broken, in terms of a race17:34
JayFjroll: just in real life, there's enough latency between when the image gets written, conductor sees it, and tells agent to write configdrive17:34
JayFbut in a single VM environment it goes fast17:34
*** davideagnello has joined #openstack-ironic17:35
JayFjroll: given this is breaking gate for Ironic; we might be able to get infra people to bump the testing of your patch17:36
jrollJayF: you're welcome to ask them17:38
jrollJayF: but it's probably fine17:38
jrollmany people out today17:38
JayFjroll: how'd the original configdrive patch pass tempest?17:39
JayFjroll: or was there another patch to enable configdrive in tempest, and that broke the gate?17:39
jrollJayF: nova doesn't gate on agent17:39
JayFoh, it was the nova driver patch to enable it17:39
JayFgot it17:39
JayFthat makes more sense17:39
*** ndipanov has joined #openstack-ironic17:40
agordeevis VM for agent gate checks running under qemu?17:40
jrolllibvirt17:41
*** pradipta has quit IRC17:41
jrollor whatever ironic gate does in general17:41
agordeevwell, if yes, qemu is very slow in terms of cpu. I hope that few secs will be enough to fix the issue.17:43
*** bnemec is now known as beekneemech17:44
agordeevjroll: JayF: sorry guys, i'm done for today. have a nice day!17:44
jrollagordeev: thanks for your help, have a good weekend :)17:45
JayFagordeev: thanks; gl17:45
*** ChuckC has quit IRC17:46
*** spandhe has joined #openstack-ironic17:47
*** Nisha has joined #openstack-ironic17:47
*** rwsu has joined #openstack-ironic17:49
*** Marga_ has joined #openstack-ironic17:51
*** achanda has joined #openstack-ironic17:51
*** pelix has quit IRC17:58
*** MattMan has left #openstack-ironic17:59
NobodyCamuggg /me just spent close to an hour going thru logs only to find out that the time block I am looking is missing from them :(17:59
*** early has quit IRC18:00
openstackgerritMerged openstack/python-ironicclient: Fix help string for port-list  https://review.openstack.org/15328418:01
*** ChuckC has joined #openstack-ironic18:02
*** Nisha has quit IRC18:05
*** derekh has quit IRC18:06
*** early has joined #openstack-ironic18:06
*** BadCub_ is now known as BadCub_Away18:07
dtantsurhave a nice weekend everyone!18:08
*** dtantsur is now known as dtantsur|afk18:08
JayFyou too!18:09
openstackgerritClif Houck proposed openstack/ironic-python-agent: Added support for secure erase enhanced when doing an ATA secure erase  https://review.openstack.org/15341718:09
openstackgerritClif Houck proposed openstack/ironic-python-agent: Added support for secure erase enhanced  https://review.openstack.org/15341718:10
*** ndipanov has quit IRC18:11
*** korekhov has joined #openstack-ironic18:11
*** korek____ has joined #openstack-ironic18:14
*** korekhov has quit IRC18:15
*** harlowja has joined #openstack-ironic18:15
*** korekho__ has quit IRC18:15
JayFjroll: oh shit18:19
JayFjroll: I know why this is failing now18:19
JayFjroll: or at least part of it18:19
JayFjroll: http://logs.openstack.org/30/153630/7/check/gate-tempest-dsvm-ironic-agent_ssh-src/95281bd/logs/ironic-bm-logs/baremetalbrbm_0_console.txt.gz18:19
JayFjroll: note that coreos-cloudinit is reading and trying to do things with the configdrive18:19
JayFjroll: that's why it's in use; not partprobe retried18:19
JayF*retries18:19
* JayF pushes up a patch18:19
*** early has quit IRC18:20
*** yjiang5 has left #openstack-ironic18:21
JayFjroll: as soon as that partition exists with the config-2 label, coreos is reading and trying to cloud-init it18:21
JayFwe have a fix for this in our agent downstream; I'll forward port it18:22
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Prevent CoreOS from using configdrive in ramdisk  https://review.openstack.org/15364618:23
JayFGenerally I need to merge some upstream changes down and vice-versa in the IPA image. We haven't pulled the coreos-oem-inject.py script that's been improved down, and my refactoring of the build stuff should go up as well18:27
JayFI can probably JFDI today assuming we fix IPA gate18:27
*** zer0c00l has quit IRC18:28
*** zer0c00l has joined #openstack-ironic18:28
*** ijw has quit IRC18:28
*** jerryz has quit IRC18:28
NobodyCamJayF: thats a good one!18:30
*** korek____ has quit IRC18:30
JayFI mean, it's downstream and has been for a long time :/18:30
JayFbut so has configdrive, so w/e18:30
*** korekhov has joined #openstack-ironic18:31
JayFNobodyCam: not the best assumption to think I fixed the gate bug yet :P18:32
* JayF will only believe it when tempest goes green18:32
NobodyCam:)18:32
*** korekhov has quit IRC18:35
*** early has joined #openstack-ironic18:38
Shrewsyay borked gates on Friday  :)18:41
NobodyCamShrews: well it kinda started yesterday18:41
Shrewsalso, yay broken internetz @ home18:41
NobodyCambut ya18:42
NobodyCamalways seems to be the case18:42
JayFI think it'd be fixed already18:42
JayFif agent_ssh-src didn't take so dang long18:42
NobodyCamoh JayF any luck on that weather patch for next week?18:42
* Shrews feeds Jenkins some coffee18:42
JayFI can't stop the rain from falling down18:42
JayFAnd it has been pouring some today for sure18:43
NobodyCamlol... hum sounds like a song I knew once18:43
ShrewsNobodyCam: blame it on the rain18:43
* Shrews lip syncs18:43
NobodyCam:-P18:43
NobodyCamJayF: only 20 more minutes18:45
NobodyCamaccording to zuul18:45
jrollJayF: fun18:48
jrollJayF: mind adding a closes-bug tag there?18:48
*** early has quit IRC18:53
openstackgerritJim Rollenhagen proposed openstack/ironic-python-agent: Prevent CoreOS from using configdrive in ramdisk  https://review.openstack.org/15364618:53
jrollJayF: NobodyCam ^ added closes-bug18:53
NobodyCamjroll: JayF: held off on +a until tests pass but as soon as they do feel free to land if I'm by chance afk :p18:58
*** dhellmann has quit IRC18:58
*** dhellmann_ is now known as dhellmann18:58
jrollNobodyCam: thanks18:59
*** dhellmann_ has joined #openstack-ironic18:59
* NobodyCam can not wait to get into the new house and get his 30" monitor back... going thru GB's of logs all week on a laptop screen is painful18:59
*** dhellmann_ has quit IRC19:01
*** dhellmann_ has joined #openstack-ironic19:01
NobodyCamdid we ever figure out whats up with the names patch and the doc check?19:02
JayFjroll: tests didn't pass19:05
JayFhttp://logs.openstack.org/30/153630/7/check/gate-tempest-dsvm-ironic-agent_ssh-src/95281bd/logs/ironic-bm-logs/baremetalbrbm_0_console.txt.gz19:05
jrollJayF: that's awesome19:05
JayFit looks like coreos-cloudinit is still trying to read configdrive19:05
NobodyCamdoc improvment review... only six lines: has one +2 already ... https://review.openstack.org/#/c/15331219:05
jrollyeah19:05
NobodyCamlol19:05
JayFjroll: this has to be impacting us downstream as well in some cases, I think19:08
NobodyCamJayF: http://paste.openstack.org/show/ygrACGzqnpdO6lCsYRkJ/19:09
jrollJayF: we've never seen that afaik19:09
*** dhellmann has quit IRC19:09
*** dhellmann_ is now known as dhellmann19:09
NobodyCamthats from https://github.com/coreos/coreos-cloudinit/releases19:09
JayFNobodyCam: We're running a really old coreos right now19:09
jrollthat is great to know about though19:10
jrollNote: by default config drive is enabled on virtual machines and disabled on physical hardware.19:10
JayFNobodyCam: like 6-8m old (I'm actually working on patches to systemd to fix some of it)19:10
JayFjroll: OH. That's really interesting, and explains the change in behavior.19:10
NobodyCamthat from june 201419:10
JayFI *think* we're even older than that19:11
JayFI can check and see, I have an agent booted in our hardware lab19:11
JayFroot@lab-cpu2 ~ # coreos-cloudinit --version19:12
JayFcoreos-cloudinit version 1.2.119:12
jrollheh19:12
*** alexpilotti has quit IRC19:12
NobodyCamcoreOs release?19:12
JayF375.0.019:12
jrollNobodyCam: https://github.com/openstack/ironic-python-agent/blob/master/imagebuild/coreos/coreos-oem-inject.py#L2419:12
NobodyCamso the kernel opt should work19:13
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Prevent CoreOS from using configdrive in ramdisk  https://review.openstack.org/15364619:15
JayFNobodyCam: kernel opt is not the hammer I'd like to use in this case19:15
NobodyCam:-p19:15
JayFNobodyCam: although in these units I'm masking; they check the kernel command line19:16
JayFso I think we have a winner19:16
JayFwe can't disable *all* configdrive indiscriminately19:16
jrollJayF: is that suplicate intentional?19:16
JayFbecause CoreOS considers the oem/cloud-config.yml a form of configdrive19:16
JayFjroll: suplicate?19:16
jrollduplicate19:16
jrollsorry19:16
jroll(see review, left a note)19:16
JayFjroll: nope; I effed up19:16
JayFsecond19:16
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Prevent CoreOS from using configdrive in ramdisk  https://review.openstack.org/15364619:18
JayFjroll: got it; thanks for catching that, I was masking the wrong things19:18
jrollyeah np19:19
jroll+219:19
JayFnow we see if it passes tempest19:19
JayFnot how I wanted to spend friday mornning, lol19:19
jrollikr19:20
NobodyCamJayF: much better then Saturday morning doing the same19:20
JayFI gotta get my abstract in for the Vancouver CfP19:21
JayFgoing to do something on how operators should participate in OpenStack, not just consume it19:22
*** zer0c00l has quit IRC19:32
*** zer0c00l has joined #openstack-ironic19:32
jrollhttp://www.cloudscaling.com/blog/openstack/vanilla-openstack-doesnt-exist-and-never-will/19:32
jrollgood read19:32
NobodyCamlol is it too lazy of /me to want to move the periodic tasks to a file/folder so they are easier to find :-p19:37
jrollnot the worst idea19:37
*** andreykurilin_ has joined #openstack-ironic19:38
* NobodyCam notes it for next week19:38
NobodyCambrb19:39
*** achanda has quit IRC19:44
*** bradjones has quit IRC19:47
*** early has joined #openstack-ironic19:50
devanandajroll: yes it is, even if it's factually incorrect on a few points19:50
*** bradjones has joined #openstack-ironic19:50
devanandabut "openstack is a grab-bag of components and YOU need to decide what to put together" is accurate19:51
devanandahmmm19:51
devanandaOpenStack is Legos19:51
jrolldevananda: which points are incorrect?19:51
jrollheh19:51
devanandaalso, OpenStack is the Linux kernel of the cloud19:51
NobodyCamhey hey devananda :)19:51
devanandaalmost no one, today, compiles their laptop's kernel -- they dwnload it from a distro19:52
devanandawe hae the same relationship with oeprators19:52
devanandathey should be consuming an opinionated combination of things that a disto has created for them19:52
devanandawhere distro could be canonical, or redhat, or hp, or nebula, or bluebox, or ....19:52
Shrewsdevananda: how was the slopes?19:53
*** early has quit IRC19:53
devanandaJayF: on my list of things to do next week: share what I learned from talking with Brian Redbeard about CoreOS19:53
*** achanda has joined #openstack-ironic19:53
JayFdevananda: WHERE19:54
JayFer19:54
JayFwhere'd you see redbeard?19:54
devanandaFOSDEM19:54
devanandahe gave a great session19:54
devanandaand mentioned you guys and "some openstack project using it"19:54
devanandalawl :)19:54
JayFlol19:54
devanandawe chatted for like an hour afterwards, opened laptops, looked at code, etc19:54
NobodyCamhumm which project could that bee19:54
JayFI mentioned on systemd-dev that Ironic used coreos meaning we also use systemd19:55
JayFand they thought it was cool too19:55
devanandatldr;  his reaction to the size of IPA's ramdisk was "oh, they're basing it on dockeroem, they should use busybox"19:55
JayFthey live in a world of go19:55
JayFwhere you don't need all those deps and such19:55
JayFsetting up a python inside a busybox container == lol good luck19:56
devanandaJayF: he seemed to think that coreos had a mechanism to make that easy19:56
JayFHmm. If so we should look into it19:56
JayFbut right now we're "stuck" on this old coreos19:56
devanandaShrews: the slopes were great19:56
JayFsystemd-nspawn broke our use case and I've been patching it up to try and get it where we can upgrade19:56
JayFone down probably one more to go19:56
devanandaShrews: couple feet of fresh snow19:57
*** early has joined #openstack-ironic19:58
* devananda wonders if there's any slopes near teh vancouver summit that would still have snow on them ...19:58
jrollwhistler is the big one there19:58
jrolldunno how it is in may19:59
*** BadCub_Away is now known as BadCub_19:59
NobodyCamsnow is good for pictures, not being in... :-p19:59
devanandajroll: website says: November 27, 2014 - May 18, 2015 Blackcomb Mountain - See more at: http://www.whistler.com/skiing/#sthash.ZX9AzkaN.dpuf19:59
devanandaso, yes20:00
jrollbarely20:00
devanandavancouver is May 18-2220:00
devanandawe *might* be able to get in on the last weekend20:00
devanandabefore the summit20:00
jrollindeed20:00
NobodyCamdevananda: when is your flight back to SF?20:01
devanandaNobodyCam: "back to" an "SF" don't go together20:02
NobodyCamlol20:02
devanandaNobodyCam: I arrive in SF wednesday morning around 9am20:02
NobodyCam:) home first?20:02
devanandayes!!!!!!20:03
*** early has quit IRC20:03
*** early has joined #openstack-ironic20:07
NobodyCam:) nice20:11
*** penick has joined #openstack-ironic20:14
*** early has quit IRC20:14
JayFnooooo20:20
JayF:-(20:20
*** achanda has quit IRC20:20
JayF2015-02-06 20:20:09.653 | Finished: FAILURE20:20
JayFthis may have failed in a different way though20:21
JayFno partprobe failures in the cond log http://logs.openstack.org/46/153646/4/check/gate-tempest-dsvm-ironic-agent_ssh-src/b2b55de/logs/screen-ir-cond.txt.gz20:22
JayF[   71.433788] systemd[1]: Starting Untar Provided IPA Container...20:22
JayF[   72.980616] systemd[1]: Failed to set memory.limit_in_bytes on : Invalid argument20:22
JayFit didn't fail in conductor the same way20:24
*** early has joined #openstack-ironic20:24
JayFbecause the entire container failed to boot for whatever that reason is20:24
jlvillalJayF: Agreed.  The other patch has a partprobe probe error in screen-ir-cond20:25
jlvillal'recheck'?20:25
JayFI don't think recheck will make a difference but imbw20:26
jrollJayF: I feel like I've seen that before20:27
jrolland it's random20:27
jrolliirc20:27
JayFthat's an awful answer :(((20:27
JayFbut I'll recheck20:27
*** davideagnello has quit IRC20:29
*** annegentle has quit IRC20:29
*** davideagnello has joined #openstack-ironic20:31
jlvillalJayF: You seem to know about the log files :)20:35
JayFjlvillal: in what way?20:35
jlvillalI was going to do a patch for the HTML that generates this page: http://logs.openstack.org/30/153630/7/check/gate-tempest-dsvm-ironic-agent_ssh-src/95281bd/logs/20:35
JayFoh, to add the info for Ironic?20:35
jlvillalSo I need a description for the ironic directory20:35
jlvillalYes20:35
JayFI'd be glad to help review in any way possible; but I think it'll take a collaboration for us to get them all20:36
JayFme, today http://gateserviceprofessionals.com/wp-content/uploads/2013/04/4GateSlider1.png20:36
jlvillalI was going to add:20:36
jlvillal<li><a href="screen-ir-api.txt.gz">screen-ir-api.txt.gz</a>: ironic-api20:36
jlvillal    <li><a href="screen-ir-cond.txt.gz">screen-ir-cond.txt.gz</a>: ironic-conductor20:36
JayF(credit: our internal product manager)20:36
JayFironic_bm_logs/ is the console output from the last successful boot of a ironic "bare metal" vm20:37
jlvillalI also wanted a description of the directory 'ironic-bm-logs'.  "ironic baremetal logs"20:37
JayFI think that'd be it for ironic20:37
jlvillalOkay.  I'll submit a patch with those three lines and an ironic section20:37
jlvillalIt will be a start :)20:37
JayFcool, link it here20:37
jlvillalWill do20:37
JayFin the meantime I'm building an image and testing localls20:37
*** ijw has joined #openstack-ironic20:39
*** ijw has quit IRC20:40
*** ijw has joined #openstack-ironic20:40
*** pcrews has quit IRC20:42
*** jgrimm is now known as zz_jgrimm20:42
jlvillalJayF: Patch for adding description of the ironic log files: https://review.openstack.org/#/c/153683/20:43
*** pcrews has joined #openstack-ironic20:44
*** Marga_ has quit IRC20:47
JayFjroll: I think you were right about that being transient; the image boots for me in our hw lab20:47
* JayF hates the gate20:47
JayFalthough this at least is a /real/ bug20:47
jrollyeah20:48
*** Marga_ has joined #openstack-ironic20:48
*** early has quit IRC20:49
*** ijw_ has joined #openstack-ironic20:58
openstackgerritJosh Gachnang proposed openstack/ironic: Implement Cleaning States  https://review.openstack.org/15344420:59
*** ijw_ has quit IRC21:00
*** ijw_ has joined #openstack-ironic21:00
*** yjiang5 has joined #openstack-ironic21:01
jlvillalJoshNang: Question on ^^^21:02
JoshNangjlvillal: ask away!21:02
jlvillalmachine.add_transition(MANAGEABLE, CLEANFAIL, 'clean')21:02
*** ijw has quit IRC21:02
jlvillalSo that is correct and not supposed to be CLEANING?21:02
JoshNangoh, that's incorrect21:02
JoshNangthanks :)21:02
jlvillalI had made comment in patch 121:02
*** davideagnello has quit IRC21:02
jlvillalOkay.  Thanks.21:02
*** mgoddard has quit IRC21:02
JoshNangoh! sorry i missed it. patch 2 was just editting the commit message to add the blueprint21:03
jlvillalJoshNang: No problem.  Just trying to learn, so I wasn't sure.21:03
JayFYou're doing very well jlvillal :)21:03
JayFjlvillal: protip: reviewing specs is the easiest/quickest way to get on top of what's going on in the projct21:03
jlvillalJayF: Thanks.  Hopefully I get to meet some of you in person next week at the sprint.21:04
jlvillalJayF: Ah.  I haven't been doing that.  I will do that.  Thanks for the info.21:04
JayFit's at the office that me, joshnan g, jrol l, clif_ h, and russell_ h all work at (spaces added to avoid the ping)21:04
JayFso we'll all be here21:04
JayFwell, clif isn't always here, but he's here in spirit21:04
JayFsame with morgabr a21:05
jlvillalJayF: Awesome! :)21:05
JayFbasically we're the guys who run Rackspace OnMetal21:05
JayFand more or less invented IPA and the agent driver21:05
*** davideagnello has joined #openstack-ironic21:05
jlvillalAh, so I may recognize you from various YouTube videos I have been watching ;)21:05
JayFme and JoshNang gave the talk on, um, um, decom, um21:07
JayFwhich is now cleaning21:07
JoshNangheh21:07
JayFwhich is what you're reviewing now :)21:07
* JayF working on abstract for Vancouver while watching the gate fix21:07
jlvillalJayF: I watched that one.  On decommisioning.21:07
JayFjlvillal: reviewed; -1'd, but it's simple21:08
JayFw/r/t your devstack patch21:08
JayFer, system-config21:08
jlvillalThanks for the review21:08
devanandaJoshNang: so "cleaned" isn't actually in the spec at all: http://specs.openstack.org/openstack/ironic-specs/specs/kilo/new-ironic-state-machine.html#proposed-change21:10
devanandaJoshNang: I think you mean "zap" ?21:10
*** davideagnello has quit IRC21:11
JoshNangdevananda: it is mentioned in http://specs.openstack.org/openstack/ironic-specs/specs/kilo/new-ironic-state-machine.html#rest-api-impact21:11
devanandaJoshNang: yae, you're adding an RPC call for a thing which can not be initiated by the API21:11
devanandaJoshNang: not as a verb21:12
JoshNangdevananda: oh i see21:12
devanandait's a state nodes go through between deletign and available21:12
devanandayour state changes are mostly OK, but it doesn't need a new VERB, or any new RPC method21:12
devanandaa user can not initiate cleaning /directly/21:12
devanandathey can delete an instance21:12
devanandaand it will get cleaned, if the driver implements taht21:13
JoshNangdevananda: they can from managed IIRC21:13
devanandanope21:13
devanandawell21:13
JoshNangerr manageable21:13
*** davideagnello has joined #openstack-ironic21:13
devanandathey can "provide" it from manageable21:13
devanandaand it will go through the state of cleaning21:13
JoshNangahh i see that now. ok! i won't complain about the patch being simpler :)21:14
devanandahehe :)21:14
* devananda does the lazy thing and copies this chat log to gerrit21:14
JoshNangthanks for the quick review!21:15
NobodyCambrb21:15
*** achanda has joined #openstack-ironic21:20
*** dprince has quit IRC21:25
*** achanda has quit IRC21:25
*** Marga_ has quit IRC21:28
*** Marga_ has joined #openstack-ironic21:28
*** Marga_ has quit IRC21:32
JayFjroll: it failed again21:34
JayFjroll: I'm thinking maybe we should disable configdrive testing to fix the gate for now21:34
JayFjroll: and track this specific issue down later?21:34
JayFI'm at my wits end and don't wanna be troubleshooting the gate all day21:34
JayF2015-02-06 21:27:11.471 5015 ERROR ironic.drivers.modules.agent [-] node e00ddc78-f414-4e33-af5d-9bf0cfada91f command status errored: {u'message': u'Error writing configdrive to device.', u'code': 500, u'type': u'ConfigDriveWriteError', u'details': u'Writing configdrive to device /dev/vda failed with exit code 1. stdout: copy_configdrive_to_disk.sh: Error running partprobe against /dev/vda\n.21:35
JayFstderr: Error: Partition(s) 2 on /dev/vda have been written, but we have been unable to inform the kernel of the change, probably because it/they are in use.  As a result, the old partition(s) will remain in use.  You should reboot now before making further changes.\n.'}21:35
JayFjroll: did the partx change pass?21:35
JayFjroll: your partx change passed tempest; I'm going to look at logs but for now I suggest we merge that one to fix the gate21:36
*** ChuckC has quit IRC21:38
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Use partx to update partition table  https://review.openstack.org/15359221:39
jrollJayF: I don't think configdrive was explicitly enabled, I think that's just how nova works21:39
JayFjroll: ^ I restored your change, pushed a patchset to fix clif_h's review21:39
JayFif it passes tempest I vote to merge it21:39
jrollyeah, thanks for that21:39
jrollI'm going to +2 and poke NobodyCam21:39
JayFlet me +221:40
JayFsince my commit was trivial21:40
JayFand the code was more you21:40
jrolloh right, ipa21:40
jlvillalJayF: what time will the sprint start?  I'm wondering what time to show up on Wednesday morning :)  The sprint page doesn't seem to have the info.21:40
jrolljlvillal: let's say 10am for wednesday21:40
jlvillalWorks for me :)21:40
JayFjlvillal: you here Tuesday as well?21:40
jlvillalI fly in on Tuesday (the 10th).21:41
jrolljlvillal: add yourself to the dinner list if you'd like https://etherpad.openstack.org/p/kilo-ironic-midcycle21:41
JayFjlvillal: if you get here by noon Tuesday; drop by. I'm doing an iptables tutorial.21:41
jlvillaljroll: Thanks21:41
jlvillalJayF: I come in after that :(21:42
*** alexpilotti has joined #openstack-ironic21:48
jlvillaljroll: I added myself.  At least I think it was the dinner list...21:49
jrolljlvillal: cool21:49
*** Marga_ has joined #openstack-ironic21:49
*** spandhe has quit IRC21:58
*** achanda has joined #openstack-ironic22:00
openstackgerritJarrod Johnson proposed stackforge/pyghmi: Configure UEFI settings on Lenovo servers (WIP)  https://review.openstack.org/15340222:01
*** spandhe has joined #openstack-ironic22:05
*** jjohnson2 has quit IRC22:06
*** bradjones has quit IRC22:09
*** zigo has joined #openstack-ironic22:11
*** BadCub_ has quit IRC22:12
*** bradjones has joined #openstack-ironic22:13
*** ChuckC has joined #openstack-ironic22:13
Shrewsooh, we should consider moving our devstack integration to a plugin22:16
Shrewshttp://lists.openstack.org/pipermail/openstack-dev/2015-February/056257.html22:16
* Shrews adds to list of "random ideas"22:16
*** davideagnello has quit IRC22:17
*** achanda has quit IRC22:17
*** achanda has joined #openstack-ironic22:17
*** davideagnello has joined #openstack-ironic22:18
JayFhttps://review.openstack.org/#/c/153592/ is landing now to fix the gate22:21
*** Marga_ has quit IRC22:23
*** Marga_ has joined #openstack-ironic22:23
*** Marga_ has quit IRC22:28
JayFJoshNang: https://review.openstack.org/#/c/153592/22:28
JayFJoshNang: mind putting a vote on that? I accidentally merged it with only my own +222:28
* JayF fanatical gate support22:28
JoshNangheh22:28
jrollJayF: it's fine22:28
JoshNangJayF: done anyway22:29
JoshNangif nothing else, it'll help me keep an eye on the jenkins merge22:30
*** lnxnut has quit IRC22:35
*** ijw_ has quit IRC22:39
*** Marga_ has joined #openstack-ironic22:50
JayFSo just a note; even once #153592 merges, we'll have to wait for the post job to finish22:53
JayFbefore Ironic changes are "unbroken"22:53
JayFsince it uses the built files loaded up into tarballs.os.org22:53
openstackgerritMerged openstack/ironic-python-agent: Use partx to update partition table  https://review.openstack.org/15359222:55
*** penick has quit IRC22:56
JayF\o/22:56
JayFthanks for the fix jroll; I should've listened to you this morning instead of trying other things :)22:57
*** Marga_ has quit IRC23:02
*** Marga_ has joined #openstack-ironic23:03
JayFI'll post in here when the IPA post job is done so people can recheck23:03
*** Marga__ has joined #openstack-ironic23:06
*** Marga_ has quit IRC23:07
*** dividehex has quit IRC23:10
*** Marga__ has quit IRC23:11
*** dividehex has joined #openstack-ironic23:14
JayFJFYI: It might be a *really long time* before the IPA post job finishes. Until then IPA Tempest will pass (it compiles fresh each time) but Ironic will not (it only tests against the uploaded tarball)23:14
JayFwell I say that but it's building now, so maybe not23:18
*** Marga_ has joined #openstack-ironic23:19
JayFclif_h: around?23:23
JayFclif_h: if so, 153417; second line of your sommit s/escure/secure/23:23
JayFclif_h: and if you push that now I'll skip rechecking it since it'll recheck itself :)23:24
clif_hsure, one moment23:24
*** Marga_ has quit IRC23:26
*** Marga_ has joined #openstack-ironic23:26
* JayF rechecked all the patchsets that appeared to be broken by bug 141883323:27
openstackbug 1418833 in Ironic "check-tempest-dsvm-ironic-agent_ssh fails due to ConfigDriveWriteError" [Undecided,Fix committed] https://launchpad.net/bugs/1418833 - Assigned to Jay Faulkner (jason-oldos)23:27
openstackgerritClif Houck proposed openstack/ironic-python-agent: Added support for secure erase enhanced  https://review.openstack.org/15341723:27
clif_hJayF: ^23:28
JayFty clif_h ; will re-review now23:28
clif_hthanks for poking me23:28
JayFnp; I just noticed it while I was rechecking things23:28
clif_hI was wondering what I did to get that test to fail23:28
JayFand thought I'd save the gate a check23:28
JayFno that's been what I've been working on all morning23:28
JayFwell, and jroll before that even23:28
JayFlol23:28
*** anderbubble has quit IRC23:31

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!