Tuesday, 2016-01-26

*** amotoki has joined #openstack-ironic00:00
*** Sukhdev has joined #openstack-ironic00:03
*** r-daneel has quit IRC00:08
*** amotoki has quit IRC00:15
jlvillalTheJulia: Are you interested in having the OpenStack Proposal Bot propose requirement changes for Bifrost?00:18
*** chlong has quit IRC00:20
*** chlong has joined #openstack-ironic00:20
NobodyCamjlvillal: oh That could be good00:21
jlvillalNobodyCam: Okay. I saw a hand-crafted patch and thought maybe it should be automated :)00:22
jlvillalI'm willing to propose a patch to do it.00:22
NobodyCam:) +++00:22
jlvillalOkay then :)00:22
jlvillalNobodyCam: TheJulia cinerama: https://review.openstack.org/#/c/272334/00:25
cineramajlvillal: thanks for proposing00:32
jlvillalcinerama: My pleasure :)00:33
jlvillalI hope it helps.00:33
*** Sukhdev has quit IRC00:39
*** chlong has quit IRC00:41
*** chlong has joined #openstack-ironic00:41
*** david-lyle has joined #openstack-ironic00:42
*** chlong has quit IRC00:48
*** chlong has joined #openstack-ironic00:49
*** chlong has quit IRC00:53
*** piet has quit IRC00:53
*** chlong has joined #openstack-ironic00:54
*** garthb has quit IRC01:03
*** amotoki has joined #openstack-ironic01:04
*** mkovacik has quit IRC01:09
*** sinval has quit IRC01:09
*** yuanying has joined #openstack-ironic01:10
*** yuanying_ has quit IRC01:11
*** sinval has joined #openstack-ironic01:11
*** rpioso has quit IRC01:17
*** rbudden has joined #openstack-ironic01:26
*** prometheanfire has joined #openstack-ironic01:27
prometheanfirehow long is ironic gonna be broken?01:27
prometheanfirethe gate job01:27
jrollprometheanfire: we're up to like our fourth straight gate breakage01:29
jroll:(01:29
jrollprometheanfire: we want it fixed too, trust me01:29
*** mtanino__ has quit IRC01:30
prometheanfireI know01:31
prometheanfirejust annoying :P01:32
jrolltell me about it.01:32
*** piet has joined #openstack-ironic01:36
*** r-daneel has joined #openstack-ironic01:39
*** r-daneel has quit IRC01:39
*** piet has quit IRC01:50
*** piet has joined #openstack-ironic01:54
*** chlong has quit IRC01:55
*** chlong has joined #openstack-ironic01:56
*** kan_ has joined #openstack-ironic01:57
*** yuanying has quit IRC02:00
*** yuanying has joined #openstack-ironic02:03
*** david-lyle has quit IRC02:05
*** davidlenwell has quit IRC02:14
*** davidlenwell has joined #openstack-ironic02:16
*** baoli has joined #openstack-ironic02:21
*** rbudden has quit IRC02:22
*** yuanying has quit IRC02:25
*** yuanying has joined #openstack-ironic02:27
*** hoangcx has joined #openstack-ironic02:44
*** chlong has quit IRC02:49
*** chlong has joined #openstack-ironic02:49
*** superflyy has joined #openstack-ironic02:50
*** daemontool has quit IRC02:56
*** harshs has joined #openstack-ironic03:00
*** baoli has quit IRC03:08
*** achanda has joined #openstack-ironic03:09
*** chlong has quit IRC03:17
*** chlong has joined #openstack-ironic03:18
*** chlong has quit IRC03:19
*** yuanying_ has joined #openstack-ironic03:19
*** chlong has joined #openstack-ironic03:20
*** yuanyin__ has joined #openstack-ironic03:20
*** yuanying has quit IRC03:22
*** yuanying_ has quit IRC03:23
*** david-lyle has joined #openstack-ironic03:25
*** baoli has joined #openstack-ironic03:25
*** spandhe has quit IRC03:29
*** yuanyin__ has quit IRC03:29
*** lazy_prince has joined #openstack-ironic03:29
*** yuanying has joined #openstack-ironic03:29
*** vishwanathj has joined #openstack-ironic03:31
*** bnemec has quit IRC03:34
*** bnemec has joined #openstack-ironic03:38
*** thrash is now known as thrash|g0ne03:39
*** amotoki_ has joined #openstack-ironic03:42
*** dims has joined #openstack-ironic03:49
*** jaybeale has joined #openstack-ironic03:51
*** dims has quit IRC03:51
*** mtanino has quit IRC03:51
*** mtanino_ has quit IRC03:51
*** harlowja has quit IRC03:54
*** dims has joined #openstack-ironic03:56
*** yuanying has quit IRC03:57
*** yuanying has joined #openstack-ironic03:58
*** piet has quit IRC03:59
*** superflyy has quit IRC04:01
*** yuanying has quit IRC04:02
*** dims has quit IRC04:05
*** yuanying has joined #openstack-ironic04:08
*** amotoki has quit IRC04:08
*** praneshp has joined #openstack-ironic04:10
*** ijw has quit IRC04:14
*** amotoki_ has quit IRC04:20
*** achanda has quit IRC04:23
*** achanda has joined #openstack-ironic04:23
*** hnwolf has joined #openstack-ironic04:24
hnwolfI am new to Ironic, I want to contribute to the project, please help me to do from beginning, how to deploy, how to get the code, how to reading code? Thanks.04:27
hnwolfI just need documents and order of them to read04:27
*** amotoki has joined #openstack-ironic04:28
*** vishwanathj has quit IRC04:29
*** lazy_prince has quit IRC04:29
Haomenghnwolf: welcome to join ironic community!04:31
hnwolftks Haomeng04:31
Haomenghnwolf: let me find document for your newcomers04:32
Haomenghnwolf: suggest to follow this guide - http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack to play with ironic04:33
*** achanda has quit IRC04:36
*** piet has joined #openstack-ironic04:38
*** kalpase has joined #openstack-ironic04:42
*** tiendc has joined #openstack-ironic04:45
*** raddaoui has joined #openstack-ironic04:52
*** baoli has quit IRC04:58
*** piet has quit IRC04:59
*** piet has joined #openstack-ironic05:03
*** Sukhdev has joined #openstack-ironic05:21
*** piet has quit IRC05:30
hnwolfHaomeng: Thanks, I am following your document. If I have any question, I will let you know soon. Thank again.05:42
*** Guest73 has quit IRC05:44
*** baoli has joined #openstack-ironic05:49
Haomenghnwolf: welcome, take your time:)05:50
*** raddaoui has quit IRC05:50
*** spandhe has joined #openstack-ironic05:54
*** baoli has quit IRC05:54
Haomenghnwolf: also, there are some other dev ref documents in this wiki - http://docs.openstack.org/developer/ironic/05:54
hnwolfHaomeng: Thanks05:58
Haomenghnwolf: :)05:58
Haomenghnwolf: yw:)05:58
*** ChubYann has quit IRC06:05
*** hoangcx has quit IRC06:11
*** amotoki has quit IRC06:19
*** hoangcx has joined #openstack-ironic06:28
*** achanda has joined #openstack-ironic06:28
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Imported Translations from Zanata  https://review.openstack.org/26858206:29
*** itamarl has joined #openstack-ironic06:35
*** absubram has joined #openstack-ironic06:40
devanandajroll: on the gate breakages, are we gathering data about which breakage affects us how frequently?06:40
*** sirushti has joined #openstack-ironic06:40
*** absubram_ has joined #openstack-ironic06:41
*** ukalifon1 has joined #openstack-ironic06:44
*** absubram has quit IRC06:44
*** absubram_ is now known as absubram06:44
*** Sukhdev has quit IRC06:49
*** rcernin has joined #openstack-ironic06:53
*** raddaoui has joined #openstack-ironic06:54
*** absubram has quit IRC07:01
*** smoriya_ has quit IRC07:05
*** raddaoui has quit IRC07:08
*** jaybeale has quit IRC07:14
*** spandhe has quit IRC07:14
*** amotoki has joined #openstack-ironic07:27
*** hoangcx has quit IRC07:31
*** harshs has quit IRC07:44
openstackgerrityolanda.robla proposed openstack/bifrost: Add dns_servers feature to bifrost dnsmasq  https://review.openstack.org/27205307:56
*** Fdaisuke has joined #openstack-ironic08:02
openstackgerritHaomeng,Wang proposed openstack/ironic-python-agent: add new portal_port argument into iscsi.start_iscsi_target api  https://review.openstack.org/27242008:10
openstackgerritHaomeng,Wang proposed openstack/ironic-python-agent: add new portal_port argument into iscsi.start_iscsi_target api  https://review.openstack.org/27242008:16
*** achanda has quit IRC08:23
*** jcoufal has joined #openstack-ironic08:26
*** amotoki has quit IRC08:28
*** amotoki has joined #openstack-ironic08:29
openstackgerritZhenguo Niu proposed openstack/ironic: Add Tag, TagList objects and a new tags field to Node  https://review.openstack.org/23335708:29
openstackgerritZhenguo Niu proposed openstack/ironic: Joined 'tags' column while getting node  https://review.openstack.org/25306508:29
*** ifarkas has joined #openstack-ironic08:30
*** praneshp has quit IRC08:53
*** praneshp has joined #openstack-ironic08:54
openstackgerritAnton Arefiev proposed openstack/ironic-inspector-specs: Ironic node auto-discovery  https://review.openstack.org/25294608:54
aarefievgood morning all!08:56
*** derekh has joined #openstack-ironic08:56
*** yuriyz has quit IRC08:57
*** yuriyz has joined #openstack-ironic08:59
*** mkovacik has joined #openstack-ironic09:05
*** praneshp has quit IRC09:06
*** lucas-dinner is now known as lucasagomes09:12
lucasagomesmorning all09:12
aarefievlucasagomes: morning09:15
*** dtantsur|afk is now known as dtantsur09:16
dtantsurmorning ironic, morning lucasagomes, aarefiev09:16
*** ndipanov has joined #openstack-ironic09:16
aarefievdtantsur: g'morning09:17
openstackgerritTan Lin proposed openstack/ironic: Accept header 'X-Openstack-Request-ID' as request_id  https://review.openstack.org/23800809:18
*** jistr has joined #openstack-ironic09:19
ifarkasmorning all09:19
lintanmorning lucasagmoes aarefiev and dtantsur and ifarkas :)09:20
dtantsurifarkas, o/09:20
dtantsurlintan, o/09:20
*** achanda has joined #openstack-ironic09:24
*** mgoddard has joined #openstack-ironic09:25
*** electrofelix has joined #openstack-ironic09:28
*** achanda has quit IRC09:30
*** dtantsur is now known as dtantsur|brb09:48
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Add vendor interface for Intel NM policies  https://review.openstack.org/26418309:50
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Add "agent_ipmitool_nm" driver  https://review.openstack.org/26418409:50
*** kalpase has left #openstack-ironic09:53
*** _degorenko|afk is now known as degorenko09:56
*** mkovacik has quit IRC10:04
*** tiendc has quit IRC10:09
*** itamarl has quit IRC10:11
*** baoli has joined #openstack-ironic10:13
*** jamielennox is now known as jamielennox|away10:15
*** baoli has quit IRC10:18
*** athomas has quit IRC10:25
*** jamielennox|away is now known as jamielennox10:25
*** achanda has joined #openstack-ironic10:27
*** athomas has joined #openstack-ironic10:30
*** achanda has quit IRC10:33
*** sinval has quit IRC10:42
*** sinval has joined #openstack-ironic10:42
*** MattMan has quit IRC10:46
*** MattMan has joined #openstack-ironic10:46
*** dtantsur|brb is now known as dtantsur11:00
*** sinval has quit IRC11:00
*** kertis has left #openstack-ironic11:01
*** sinval has joined #openstack-ironic11:03
*** chlong has quit IRC11:05
*** hnwolf has quit IRC11:08
*** sambetts has joined #openstack-ironic11:09
*** chlong has joined #openstack-ironic11:10
*** mbound has joined #openstack-ironic11:13
*** amotoki has quit IRC11:20
*** baoli has joined #openstack-ironic11:25
*** achanda has joined #openstack-ironic11:30
*** mgould has joined #openstack-ironic11:34
*** achanda has quit IRC11:35
*** yhvh- has joined #openstack-ironic11:55
*** yhvh- is now known as yhvh11:55
*** amotoki has joined #openstack-ironic11:56
yhvhHi, working on IPA here, if I add the line 'from ironic_python_agent import netutils' in inspector.py I enter a whole world of pain11:57
yhvhnamely circular imports11:58
*** awiddersheim has quit IRC12:01
dtantsuryhvh, hi! yeah, this https://github.com/openstack/ironic-python-agent/blob/master/ironic_python_agent/netutils.py#L25-L28 looks hacky, I wonder if we can e.g. import options instead..12:02
*** Marga_ has quit IRC12:03
TheJuliajlvillal: Thank you!  I've been meaning to do that, but it has been super low on the to-do list12:03
dtantsuryhvh, so my guess is that it's because of this module using lldp_timeout option. I think we should use import_opt instead12:03
*** Marga_ has joined #openstack-ironic12:03
*** yuriyz has quit IRC12:05
yhvhdtantsur: ty I'll have to read up on this12:05
TheJulialovely, looks like bifrost's gate is broken now. :(12:06
*** yuriyz has joined #openstack-ironic12:08
* TheJulia holds off on the wet cat tossing until she is at the cinder midcycle and can focus brain on issue12:08
mgould"wet cat tossing"?12:10
TheJuliaIt is a saying I picked up hanging out with monty12:10
*** sinval has quit IRC12:10
dtantsursounds funny12:10
* mgould imagines a wet cat would probably be an unhappy cat, and would make its displeasure known to anyone it was tossed at12:11
TheJuliaexactly!12:11
lucasagomesdtantsur, https://review.openstack.org/#/c/272499/ o/12:12
TheJuliaWell time to vanish off to the cinder midcycle, traffic is arleady startin got get bad between my house and NetApp :(12:13
TheJuliastarting12:13
TheJuliato12:13
* TheJulia needs way more coffee12:13
*** daemontool has joined #openstack-ironic12:14
*** baoli has quit IRC12:17
*** pas-ha has quit IRC12:23
*** dims has joined #openstack-ironic12:28
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector: Use new introspection data save command in excercise.sh  https://review.openstack.org/27250712:39
*** dims has quit IRC12:45
*** itamarl has joined #openstack-ironic12:47
*** daemontool has quit IRC12:55
*** baoli has joined #openstack-ironic12:58
*** raildo-afk is now known as raildo12:59
*** dprince has joined #openstack-ironic12:59
*** baoli has quit IRC13:01
*** baoli has joined #openstack-ironic13:01
*** trown|outttypeww is now known as trown13:04
romcheghttps://en.wikipedia.org/wiki/Fucking,_Austria13:04
romchegOh shi... wrong chat folks13:05
*** baoli has quit IRC13:05
romchegGood morning, btw :)13:05
lucasagomesromcheg, lol13:05
lucasagomeshey there13:06
romcheglucasagomes: Anyway, ^ looks like it should be added to the list of places to visit :)13:06
dtantsurmorning romcheg, should be a great place to stay :D13:06
lucasagomesromcheg, indeed13:07
* lucasagomes brb will grab some food13:07
romchegunfortunately their road signs are now thief proof :(13:07
*** lucasagomes is now known as lucas-hungry13:07
*** dnikishov has joined #openstack-ironic13:08
*** raildo is now known as raildo-afk13:13
*** raildo-afk is now known as raildo13:14
*** Nisha has joined #openstack-ironic13:14
devanandamoring, all13:14
*** baoli has joined #openstack-ironic13:14
dtantsurmorning devananda, you're early today13:14
devanandadtantsur: back in dallas again, so yea13:15
*** baoli has quit IRC13:17
devanandadtantsur: anyone making progress on fixing the gate?13:20
dtantsurnot me right now (on the call)13:22
*** baoli has joined #openstack-ironic13:22
*** rbudden has joined #openstack-ironic13:28
*** chaustin has joined #openstack-ironic13:32
*** achanda has joined #openstack-ironic13:32
*** chaustin has quit IRC13:33
vdrokgood morning13:35
vdrokI'm trying to look into router not found error, it is reproducible locally13:35
*** chaustin has joined #openstack-ironic13:35
*** chaustin has quit IRC13:37
devanandavdrok: hi! I'm tracking it in the gate now13:37
devanandavdrok: can you explain how its reproduced? I see many cases where hte error appeares in a gate job, but it passes13:37
*** chaustin has joined #openstack-ironic13:38
devanandaalso, the error ceases to appear in gate logs starting about a day ago13:38
vdrokdevananda, I just pulled the most recent devstack and recloned all projects13:38
vdrokthen run tempest13:38
*** achanda has quit IRC13:38
*** piet has joined #openstack-ironic13:38
vdrokand the router is in fact still there as neutron router-list shows :013:38
devanandaany idea why this is not indicative of a nova gate failure, then?13:39
vdrokdevananda, no idea atm13:40
vdrokwill look through tempest stuff13:40
devanandak13:40
devanandaif you find any more log messages that are good indications of this error, let me know13:40
devanandaright now I've got "tags:"screen-q-svc.txt" AND message:"RouterNotFound" AND message:"DB Error" "13:40
devanandabut that is not precise enough13:41
vdrokdevananda, the most persistent one is I guess this one: INFO neutron.api.v2.resource [req-ccb39183-37d0-45f5-a4c3-1b26465b462c tempest-BaremetalBasicOps-360999219 c6eee64055ee4d7aa537c7c0f685936d] update failed (client error): Router aa710b2d-9f19-4ef6-8df6-59a9ea9ee28c could not be found13:42
vdrokin q-svc13:42
devanandak, thx13:43
devanandagot it -- if I include the tempest job name, it's a match13:44
devanandawow, that's bad -- 250 failures matching that in 2 days :(13:45
*** krtaylor has quit IRC13:46
jrolldevananda: there are e-r queries for most of the things13:51
jrollother than that I have not had much time to look :(13:51
devanandajroll: there are?13:55
jrolldevananda: for the timeout stuff13:55
jrolldunno about the new things13:56
devanandaI have proposed two -- I dont see anyone else leaving comments on either the etherpad or the bugs themselves13:56
jrollI've been effectively AFK since Thursday, need to catch up13:56
jrollbut :(13:56
jroll(fwiw, we've always been bad about e-r)13:57
jroll(not an excuse)13:57
devanandayea, well, for a while they didn't index us. that changed ... and we should get better13:57
jrollyep13:57
devanandathis is now causing significant pain for other projects13:57
*** piet has quit IRC13:57
*** krtaylor has joined #openstack-ironic13:58
devanandahttps://bugs.launchpad.net/ironic/+bug/1537754 looks like the worst one right now,  ithink13:58
openstackLaunchpad bug 1537754 in Ironic "Unable to associate floating IP 172.24.5.4 to fixed IP 10.1.0.5 for instance ..." [High,Triaged]13:58
jrolloh? tripleo or?13:58
devanandait's hitting our gate jobs in dib, nova, neutron, ...13:59
jrollnone of those vote13:59
devanandaright13:59
devanandawell, dib13:59
*** alexpilotti has quit IRC13:59
jrolloh, we do vote on dib13:59
jrollwhomp13:59
dtantsuryep13:59
jrollanyway, I hope to spend some time on this today14:00
jrollstepping away until I'm actually awake, though14:00
devananda:)14:00
devanandavdrok: e-r search shows that that bug ^ has a very clear starting point14:01
devanandavdrok: that might help you narrow down what change caused it14:01
*** piet has joined #openstack-ironic14:01
*** mkovacik has joined #openstack-ironic14:02
vdrokdevananda, thanks, will look!14:02
devanandavdrok: first record of it that I see is here https://review.openstack.org/#/c/20763514:03
*** lucas-hungry is now known as lucasagomes14:06
lucasagomesdevananda, jroll morning14:07
*** Guest73 has joined #openstack-ironic14:08
devanandaand then 18 hours later it shows up here https://review.openstack.org/#/c/246161 and starts happening ALL THE TIME14:08
*** rajinir has joined #openstack-ironic14:09
*** amotoki has quit IRC14:09
*** cdearborn has joined #openstack-ironic14:12
*** phil_231 has joined #openstack-ironic14:13
devanandavdrok: http://logs.openstack.org/35/207635/29/check/gate-tempest-dsvm-ironic-pxe_ipa-nv/f9be225/logs/screen-n-cpu.txt.gz?level=DEBUG#_2016-01-21_20_27_04_55614:14
devanandaalso, we really need to stop returning the configdrive contents in every GET /v1/node/xx request ...14:15
devanandait' annoying when reading these logs14:15
phil_231hey everyone, does anyone have experience with the lldp methods in netutils.py in IPA?14:16
jrolldevananda: got a link to this query?14:16
*** alexpilotti has joined #openstack-ironic14:16
vdrokjroll, http://logstash.openstack.org/#/dashboard/file/logstash.json?query=tags:%5C%22screen-q-svc.txt%5C%22%20AND%20message:%5C%22RouterNotFound%5C%22%20AND%20message:%5C%22DB%20Error%5C%22%20AND%20project:%5C%22openstack%2Fnova%5C%2214:16
jrollthanks14:17
vdrokoh, wrong link14:17
devanandajroll: on the https://etherpad.openstack.org/p/IronicGateDebugging pad14:17
vdrokjroll, query is tags:"screen-q-svc.txt" AND ( message:"tempest-BaremetalBasicOps-" AND message:"update failed (client error): Router" AND message:"could not be found")14:17
openstackgerritSam Betts proposed openstack/ironic-python-agent: Add tinyipa to IPA imagebuild directory  https://review.openstack.org/23490214:19
vdrokdevananda, http://logs.openstack.org/35/207635/29/check/gate-tempest-dsvm-ironic-pxe_ipa-nv/f9be225/logs/screen-n-cpu.txt.gz?level=DEBUG#_2016-01-21_20_27_04_556 this happens on cleanup, so I guess it's fine14:19
*** alexpilotti has quit IRC14:20
openstackgerritSam Betts proposed openstack/ironic: Enable tinyipa for devstack Ironic  https://review.openstack.org/25908914:21
*** absubram has joined #openstack-ironic14:23
sambettsphil_231: Some14:23
jrolldevananda: ohai https://github.com/openstack-dev/devstack/commit/5544c4a74fb985d10bc3f27fa7778a582424897914:23
jrolltimeline doesn't really match, but is interesting14:23
*** daemontool has joined #openstack-ironic14:24
*** absubram_ has joined #openstack-ironic14:24
devanandajroll: yea, that merged yesterday14:24
jrollironic should work with floating ips, I've tested it manually, however idk if we've seen it work in the gate14:25
jrollbut this definitely turns them on14:25
devanandaindeed14:25
jrolloh that's just connect method though14:25
* jroll digs more14:25
jrollssh connect method*14:26
*** thrash|g0ne is now known as thrash14:26
jroller. https://github.com/openstack/tempest/blob/master/tempest/scenario/test_baremetal_basic_ops.py#L11614:26
jrollit won't create a flip if that's 'fixed'14:26
jrollso why are we failing to create floating ips before we have them enabled?14:26
*** dims has joined #openstack-ironic14:27
jrollnever mind, I can't read14:27
jrollyou can completely ignore me, these were always enabled14:27
*** absubram has quit IRC14:28
*** absubram_ is now known as absubram14:28
sambettsjroll: if fixed became floating in that devstack commit, then we'll be entering that block for the first time in the gate won't we?14:28
sambettstempest commit *14:28
jrollsambetts: it did not14:28
jrollit was previously floating if nova-network was *not* enabled14:28
jrollthe not is the part I missed14:28
sambettsooh14:28
devanandamay not be related, but interesting timing: https://github.com/openstack/nova/commit/4ee7856315fd5e59e059848cf7213b4fcf93844514:28
phil_231sambetts, I am trying to parse the resulting chassis id, however the format is a little odd14:29
*** dims has quit IRC14:29
*** chaustin has quit IRC14:29
sambettsphil_231: its a tlv right? https://en.wikipedia.org/wiki/Type-length-value14:30
phil_231sambetts, I believe so, it looks as if only the middle four characters of the chassis id are missing14:32
devanandaanother interesting timing: https://github.com/openstack/neutron/commit/3c1c1010aef98d05fe11f7515fb8774011e6a22b14:32
*** dims has joined #openstack-ironic14:32
*** izaakk_ has joined #openstack-ironic14:34
vdrokdevananda, yep, here it adds one more _get_router when updating floating ip association14:34
*** rajinir has quit IRC14:34
*** boris-42 has quit IRC14:34
*** izaakk has quit IRC14:35
*** yarkot has quit IRC14:35
*** izaakk_ is now known as izaakk14:35
*** boris-42 has joined #openstack-ironic14:35
vdrokand the failure happens when a floating ip tries to associate to instance, not during creation14:35
*** davidlenwell has quit IRC14:35
*** rajinir has joined #openstack-ironic14:36
*** vishwanathj has joined #openstack-ironic14:36
*** alexpilotti has joined #openstack-ironic14:36
jrolldevananda: yeah, that looks like a thing14:36
*** vishwanathj has quit IRC14:36
jrollmy question is why the router is gone at that point14:36
jrollbut, I think that's the one, you wanna test a revert or shall I?14:36
jrollI looked at neutron but didn't realize logstash showed local TZ so thought it was 8 hours off :(14:37
dtantsur'Timed out waiting for Nova hypervisor-stats count >= 3' in inspector gate :(14:37
*** alexpilo_ has joined #openstack-ironic14:38
sambettsphil_231: thats a very weird error :/14:38
*** chaustin has joined #openstack-ironic14:38
devanandajroll: go for it14:41
*** alexpilotti has quit IRC14:41
devanandaI'm looking into this one right now, may or may not be related: http://logs.openstack.org/35/207635/29/check/gate-tempest-dsvm-ironic-pxe_ipa-nv/f9be225/logs/screen-n-cpu.txt.gz?level=DEBUG#_2016-01-21_20_27_04_57114:42
*** rloo has joined #openstack-ironic14:43
*** daemontool has quit IRC14:43
jrolldevananda: I feel like that's "normal"14:44
devanandaoh?14:44
jrollit's a cleanup thing, and we don't implement detach14:44
jrollbut I think I've seen it in successful runs14:44
devanandathat log shows failure  as soon as the lock is released14:44
devanandahmm. k.14:45
sambettsphil_231: are you working on lldp for inspection ?14:45
jrollI mean, I could be wrong14:45
*** chaustin has quit IRC14:45
*** AJaeger has left #openstack-ironic14:46
vdrokdevananda, seems that it works! :)14:47
vdrokI've switched to previous commit14:47
*** chaustin has joined #openstack-ironic14:47
*** daemontool has joined #openstack-ironic14:47
jrollvdrok: orly!14:47
jrollI just pushed a revert, we'll see how it does in the gate14:48
jrollhttps://review.openstack.org/27256414:48
*** davidlenwell has joined #openstack-ironic14:49
vdrokjroll, yep, it failed with timeout locally (forgot to change the config), but it was in clean-wait already, so floating ip association worked fine14:52
jrollcool14:52
jrollty14:52
devanandaok, time for me to get coffee and head into the office14:54
devanandajroll: and yea, that nova error I was looking at appears to be benign14:54
jrollcool14:54
devanandawe should perhaps implement that method so it stops logging that error :)14:55
*** kan_ has quit IRC14:55
jrollwell14:57
jrollhow do you detach an interface from a bare metal machine?14:57
jrolldef detach_interface(self): self.call_dcops('unplug')14:57
jroll:P14:58
jrollbut yeah, maybe a log.debug is in order14:58
lucasagomesfolks, if you have time there's this patch here in the python-ironicclient with a 2+2 https://review.openstack.org/#/c/268098/14:59
*** piet has quit IRC14:59
lucasagomesI didn't approve because it's all red hatters so far14:59
lucasagomesso... waiting for someone from another company to take a look14:59
lucasagomesthanks14:59
*** sirushti has quit IRC15:02
*** Nisha has quit IRC15:02
vdrokwheeeee {0} tempest.scenario.test_baremetal_basic_ops.BaremetalBasicOps.test_baremetal_server_ops [545.568341s] ... ok15:03
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Add vendor interface for Intel NM policies  https://review.openstack.org/26418315:04
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Add "agent_ipmitool_nm" driver  https://review.openstack.org/26418415:04
openstackgerritDmitry Tantsur proposed openstack/python-ironic-inspector-client: Set MAX_API_VERSION to actually supported 1.2  https://review.openstack.org/27257515:05
*** raddaoui has joined #openstack-ironic15:05
jrolllucasagomes: one thing inline there15:06
lucasagomesjroll, oh good catch15:06
lucasagomesindeed should say OSC15:06
lucasagomesmgould, ^15:07
jrolloh yeah I coulda pinged mgould heh15:07
lucasagomesit's all good15:07
* mgould appears15:07
*** amotoki has joined #openstack-ironic15:08
mgouldjroll, thanks! I'll fix that right now15:08
jrollcool15:08
sambettsjroll: I assume the 16-18th for the mid cycle is inclusive of the 16th and 18th ?15:09
jrollsambetts: yes, but because time zones are weird...15:09
sambettsyeah :/15:09
jrollit's basically feb 16th 1500 utc to feb 19th 0400 utc15:09
jrollI noted as such on the etherpad15:10
openstackgerritMiles Gould proposed openstack/python-ironicclient: Support all API versions up to 1.latest  https://review.openstack.org/26809815:10
jrollwoo15:10
mgouldjroll, done ^^^15:10
jroll+A15:11
TheJuliaNow I really want to look at the link....15:11
TheJuliadoh, buffer was locked in the wrong place15:12
sambettsjroll: I did some digging into using Webex for the mid cycle, and what I've learned so far is that I can organise a bunch of meetings that are publicly accessible and the limit for people is like 500, however the only issue I see is that, once a meeting is started when the last person leaves it ends, so as long as we always have 1 person in a meeting then it will work15:13
*** piet has joined #openstack-ironic15:13
jrollsambetts: ah, good to know. they can be scheduled in advance right?15:13
sambettsjroll: yeah, and they don't have to be started by me either, the first person to join, whoever it is, becomes the host15:14
jrollneat, noted15:14
mgouldjroll, thanks!15:15
*** sirushti has joined #openstack-ironic15:15
jrollnp mgould :)15:15
vdrokI've had troubles making webex work on ubuntu15:15
vdrokI could connect and hear things but could not say anything15:16
* mgould doesn't think he ever got webex working on Linux15:16
jrollsambetts: Users starting or joining a meeting on Linux are not able to share their webcam video; they are only able to see the current speaker video, if it is being shared.15:17
jrollalso requires java 32 bit15:17
jrollso probably a nogo15:17
mgouldoh God yes15:17
mgouldI'd really like to keep this machine 64-bit clean if possible ;-)15:17
sambettsjroll: :( me and a colleague have been fighting that one for a long time15:17
lucasagomesjroll, w00t, thanks15:18
jrollsambetts: heh yeah15:18
sambettsjroll: I tried it recently on a 64bit linux env and I thought it was working better now, I'll give it a quick go again now and see if they've just not updated the requirement15:19
jrollsambetts: yeah, I don't see 32-bit on the official page, but if linux users can't share webcams I don't want to use it15:20
*** mtanino has joined #openstack-ironic15:21
sambettsjroll: looks like they've put in a compatibility check now so it won't even let me try :( sigh...15:21
jrollwow15:22
*** mtanino_ has joined #openstack-ironic15:22
vdrokor everyone can connect from android, it works good :)15:22
*** ukalifon1 has quit IRC15:22
*** mtanino__ has joined #openstack-ironic15:23
*** bmclarnon has joined #openstack-ironic15:24
bmclarnonhi, when writing a hardware manager for IPA, what does the 'interface' option mean in the JSON for get_clean_steps?15:25
mgouldhttps://play.google.com/store/apps/details?id=com.cisco.webex.meetings if anyone wants to check their devices are compatible with the webex android app15:26
bmclarnondoes it mean that this step will be run during execution of that interface, e.g. that the step I define can be run before doing 'deploy'15:26
jrollbmclarnon: in IPA, interface will always be deploy15:26
jrollidk why we make that configurable15:27
jrollbut in ironic, a clean step could be for a 'deploy' driver, a 'boot' driver, a 'raid' driver, etc, that's where it comes from15:27
bmclarnonok :) but I want to perform actions before doing deploy, in this instance, RAIDing drives15:27
jrollright, so the 'priority' field defines the order15:28
jrollhigher is first iirc15:28
jrollbmclarnon: have you seen http://docs.openstack.org/developer/ironic-python-agent/#custom-hardwaremanagers-and-cleaning ?15:28
bmclarnonok, so the clean_steps will always run before the interface?15:28
rloojroll is right. Also, clean steps run before deploying happens.15:28
jrollclean steps run during clean, so yes always before a deploy15:29
*** chaustin has quit IRC15:29
bmclarnonok, but my node should already be in the Available state15:29
rloobmclarnon: the state diagram might help: http://docs.openstack.org/developer/ironic/dev/states.html15:29
bmclarnonuntil I begin to deploy, I won't have the target RAID config15:29
*** pas-ha has joined #openstack-ironic15:30
bmclarnonI was hoping I could do the RAIDing of drives before get_os_install_device is called15:31
*** raddaoui has quit IRC15:31
jrollah, I see15:31
jrollyou'd have to modify code then, no way to run clean steps at deploy time15:31
bmclarnonthat's what I thought. This would be the simplest implementation, but it doesn't seem to fit our purpose15:32
bmclarnonso then my 2nd issue comes in15:32
bmclarnonget_os_install_device doesn't have a handle to the node info or APIClient15:32
bmclarnonso I have no way of accessing the target_raid_config in Ironic15:33
jlvillalTheJulia, FYI: I think the bifrost gate is broken, but I'm thinking that because every job I saw failed. I updated the whiteboard last night.15:36
jlvillalTheJulia, I didn't do any investigation into why.15:36
*** achanda has joined #openstack-ironic15:36
jlvillalcinerama, ^^^15:36
jrollbmclarnon: yeah, you'd have to change that somehow15:36
jrollbmclarnon: this is something we want to do upstream, it's just a down the road thing15:37
bmclarnonjroll: not the news I was hoping for, but I was expecting it15:37
jrollyeah, sorry15:37
bmclarnonis there a spec for these modifications?15:37
bmclarnonI guess trying to RAID right before deploying is a rare scenario anyway15:39
*** achanda has quit IRC15:41
TheJuliajlvillal: yeah, I spotted that this morning.  I suspect I'll need to reproduce it while watching a screen :(15:41
jlvillalTheJulia, Sorry :(15:41
sambettsbmclarnon: its something thats been discussed before, are you choosing RAID based on flavours?15:43
jrollbmclarnon: nope, it's just on our list for something we'd like to do15:43
jrolland yeah, sambetts is pointing you where I was going to15:43
bmclarnonsambetts: we're currently using Ironic in standalone, but we support multiple RAID config scenarios and hw vendors15:43
jrollah15:44
jrollso manual cleaning is coming soon(tm)15:44
bmclarnon:)15:44
jrolland what you'd end up doing is goign to the manageable state, then manually triggering a raid step that sets up what you want15:44
jroll(via the api)15:44
jrollthen push it back to available and provision it15:45
*** alexpilo_ has quit IRC15:45
jrollbbiab15:45
bmclarnonour nodes have huge amounts of RAM though and take an age to boot, which is why we bypass cleaning, otherwise we'd have to do 2 power cycles + boot (3 in total)15:45
bmclarnonso we do just-in-time RAIDing to reduce our provisioning time15:46
*** chaustin has joined #openstack-ironic15:47
*** garthb has joined #openstack-ironic15:55
*** piet has quit IRC15:58
*** chaustin has quit IRC15:59
*** chaustin has joined #openstack-ironic15:59
*** praneshp has joined #openstack-ironic15:59
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector: Add new conditions: matches and contains  https://review.openstack.org/27261216:02
jlvillalvdrok, If you can update https://etherpad.openstack.org/p/IronicGateDebugging with info that would be great.16:02
jlvillalvdrok, I did put some of today's IRC chat in there as a note.16:02
jlvillalthanks in advance :)16:04
vdrokmorning jlvillal16:05
yhvhI was talking to phil_231 here, it seems the lldp parsing logic in netutils.py is incomplete, it only extracts tlv data but returns raw values which need further parsing (usually divided into sub-type and data)16:05
vdrokjlvillal, actually everything is there already :)16:05
vdrokat the top16:05
jlvillalvdrok, Great!  Thanks16:06
*** itamarl has quit IRC16:08
*** mbound has quit IRC16:09
*** r-daneel has joined #openstack-ironic16:10
*** jcoufal_ has joined #openstack-ironic16:11
yhvhirc16:11
yhvh:(16:11
*** jcoufal has quit IRC16:12
*** Guest73_ has joined #openstack-ironic16:16
*** amotoki has quit IRC16:16
*** baoli has quit IRC16:17
*** baoli has joined #openstack-ironic16:18
*** Guest73 has quit IRC16:19
*** chaustin has quit IRC16:20
*** chaustin has joined #openstack-ironic16:23
*** dims has quit IRC16:24
openstackgerritZhenguo Niu proposed openstack/ironic: Add DB layer support for node tags/tags-any filter  https://review.openstack.org/27262416:26
*** chlong is now known as chlong_zzz16:28
*** prometheanfire has left #openstack-ironic16:28
*** phil_231 has quit IRC16:31
*** Nisha has joined #openstack-ironic16:32
*** chaustin has quit IRC16:35
*** phil_231 has joined #openstack-ironic16:35
*** e0ne has joined #openstack-ironic16:37
*** chaustin has joined #openstack-ironic16:37
*** dtantsur is now known as dtantsur|afk16:39
*** spandhe has joined #openstack-ironic16:42
*** mbound has joined #openstack-ironic16:44
*** phil_231 has quit IRC16:45
*** baoli has quit IRC16:47
*** mgould has quit IRC16:48
*** achanda has joined #openstack-ironic16:49
*** dims has joined #openstack-ironic16:50
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic-specs: Implement libvirt-based driver for virtual HW  https://review.openstack.org/25442116:53
NobodyCamMorning Itonic folks says the sick person16:53
*** baoli has joined #openstack-ironic16:53
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic-specs: Implement libvirt-based driver for virtual HW  https://review.openstack.org/25442116:54
*** dims has quit IRC16:56
*** chaustin has quit IRC16:57
*** chaustin has joined #openstack-ironic16:58
*** vishwanathj has joined #openstack-ironic17:00
*** ndipanov has quit IRC17:01
openstackgerritMilan Kováčik proposed openstack/ironic-inspector: Introduce API for aborting introspection  https://review.openstack.org/26527517:01
*** chaustin1 has joined #openstack-ironic17:02
*** vishwana_ has joined #openstack-ironic17:02
*** chaustin has quit IRC17:02
*** vishwana_ is now known as vishwanathj_17:03
*** pas-ha has quit IRC17:03
*** mgould has joined #openstack-ironic17:03
*** garthb_ has joined #openstack-ironic17:05
*** linuxaddicts has joined #openstack-ironic17:05
*** izaakk_ has joined #openstack-ironic17:07
*** garthb has quit IRC17:07
*** linuxgeek has quit IRC17:07
*** vishwanathj has quit IRC17:07
*** izaakk has quit IRC17:07
*** izaakk_ is now known as izaakk17:07
*** chaustin1 has quit IRC17:10
openstackgerritlokesh s proposed openstack/ironic: Adding audit support middleware to Ironic  https://review.openstack.org/27265817:12
openstackgerritlokesh s proposed openstack/ironic: Adding audit support middleware to Ironic  https://review.openstack.org/27265817:14
* TheJulia goes to thank lokesh17:15
*** openstackgerrit has quit IRC17:17
*** raddaoui has joined #openstack-ironic17:17
*** dnikisho1 has joined #openstack-ironic17:18
*** openstackgerrit has joined #openstack-ironic17:18
*** jaybeale has joined #openstack-ironic17:18
*** praneshp_ has joined #openstack-ironic17:18
*** e0ne_ has joined #openstack-ironic17:18
sambettsjroll: before I head off, I found this, its web conferencing thing that says it works on linux and has a 30 day trail that will handle up to 25 people http://www.gotomeeting.com/17:19
* sambetts goes home 17:19
*** dnikishov has quit IRC17:20
*** e0ne has quit IRC17:20
*** praneshp has quit IRC17:20
*** mgoddard has quit IRC17:20
vdrokmorning NobodyCam, get better!17:21
*** praneshp has joined #openstack-ironic17:22
*** piet has joined #openstack-ironic17:23
*** praneshp_ has quit IRC17:23
*** sambetts has quit IRC17:24
jlvillalNobodyCam: Good morning. Hopefully you feel better soon.17:24
*** jaybeale has quit IRC17:27
*** baoli has quit IRC17:28
openstackgerritRuby Loo proposed openstack/ironic: Agent vendor handles manual cleaning  https://review.openstack.org/24769517:29
*** baoli has joined #openstack-ironic17:29
openstackgerritRuby Loo proposed openstack/ironic: Agent vendor handles manual cleaning  https://review.openstack.org/24769517:30
*** alexpilotti has joined #openstack-ironic17:30
*** EmilienM has quit IRC17:30
*** ionutbalutoiu has joined #openstack-ironic17:31
*** e0ne_ has quit IRC17:31
*** EmilienM has joined #openstack-ironic17:34
NobodyCamthank you vdrok jlvillal17:35
*** bmclarnon has quit IRC17:39
*** achanda has quit IRC17:40
jlvillalvdrok: jroll: I don't quite understand tidwellr comment that L3 Notification patch is 'completely unrelated' to a Neutron bug. vdrok you posted that issue went away after you reverted.17:41
jlvillalIf the patch exposes a bug, then in my mind it is related. Even if the patch itself isn't the bug.17:42
vdrokjlvillal, not exactly, I've checked out the parent of the original change, not the revert17:42
vdroki'll try to check revert now17:42
jlvillalvdrok: Ah, you went back in time. Not the revert. Got it.17:42
jrolljlvillal: replied17:43
jlvillaljroll: Thanks.17:43
*** raildo is now known as raildo-afk17:47
gmmahaTheJulia: cinerama: is there a possibility to configure multiple network interfaces during a bifrost install? the config drive from the yaml seems to set just one network with an IP.. Just looking to see if i can give multiple IPs to different MACs17:47
*** jaybeale has joined #openstack-ironic17:49
*** raildo-afk is now known as raildo17:49
*** alexpilotti has quit IRC17:51
*** electrofelix has quit IRC17:53
openstackgerritRuby Loo proposed openstack/ironic: During cleaning, store clean step index  https://review.openstack.org/27098617:53
*** ifarkas has quit IRC17:54
cineramagmmaha: so we only create configuration for one nic on the config drive17:55
cineramagmmaha: you might be best off either handling config of the others post-deployment or rolling your own solution17:55
*** degorenko is now known as _degorenko|afk17:56
*** alexpilotti has joined #openstack-ironic17:56
gmmahacinerama: thanks.. will try something with ansible17:56
vdrokjlvillal, jroll revert wfm locally too, so let's wait what jenkins says :)17:57
openstackgerritRuby Loo proposed openstack/ironic: During cleaning, store clean step index  https://review.openstack.org/27098617:58
*** derekh has quit IRC18:01
*** vishwanathj_ has quit IRC18:02
lucasagomescalling it a day18:04
lucasagomeshave a great night everyone!18:04
*** lucasagomes is now known as lucas-dinner18:04
jlvillallucas-dinner: Good night18:04
jlvillalvdrok: Thanks18:04
*** raildo is now known as raildo-afk18:10
NobodyCam17:24 | jlvillal > NobodyCam: Good morning. Hopefully you feel better soon.night li18:10
NobodyCamgah18:10
NobodyCam:p18:10
NobodyCamnight lucas-dinner18:10
*** achanda has joined #openstack-ironic18:10
jlvillalNobodyCam: ????18:10
NobodyCamright click past18:11
NobodyCampaste even18:11
jlvillal:D18:11
NobodyCam:p18:11
*** jistr has quit IRC18:11
*** raildo-afk is now known as raildo18:13
*** harshs has joined #openstack-ironic18:13
*** ijw has joined #openstack-ironic18:14
*** harlowja has joined #openstack-ironic18:18
*** mgarza has joined #openstack-ironic18:19
*** mbound has quit IRC18:19
openstackgerritSergii Turivnyi proposed openstack/python-ironicclient: Add functional-tests-node-list  https://review.openstack.org/26016518:20
*** e0ne has joined #openstack-ironic18:21
*** jaybeale has quit IRC18:24
*** mgould has quit IRC18:25
*** raddaoui has quit IRC18:26
*** penick has joined #openstack-ironic18:28
*** achanda has quit IRC18:29
*** alexpilotti has quit IRC18:30
*** alexpilotti has joined #openstack-ironic18:31
*** mgoddard has joined #openstack-ironic18:33
*** Marga_ has quit IRC18:33
vdrokgood night everyone!18:42
jlvillalvdrok: Dos ve dos!18:43
*** ChubYann has joined #openstack-ironic18:43
*** baoli has quit IRC18:45
*** maurosr has quit IRC18:46
*** Nisha_away has joined #openstack-ironic18:47
*** Nisha has quit IRC18:47
*** achanda has joined #openstack-ironic18:48
*** mgoddard has quit IRC18:49
*** trown is now known as trown|lunch18:51
*** mgoddard has joined #openstack-ironic18:58
*** krtaylor has quit IRC18:58
*** praneshp has quit IRC19:03
*** krtaylor has joined #openstack-ironic19:04
*** alexpilotti has quit IRC19:09
*** alexpilotti has joined #openstack-ironic19:09
*** athomas has quit IRC19:09
*** alexpilotti has quit IRC19:10
*** Marga_ has joined #openstack-ironic19:11
*** dims has joined #openstack-ironic19:13
*** konetzed has joined #openstack-ironic19:15
*** arahal_ has joined #openstack-ironic19:15
konetzedAnyone ever seen this problem with kilo ironic, Failed to create a target: WWN not valid as: iqn, naa, eui http://paste.openstack.org/show/eLOBf0NPkBZKL0MZRWkm/19:16
*** Sukhdev has joined #openstack-ironic19:17
*** chaustin has joined #openstack-ironic19:17
*** r-daneel has quit IRC19:18
*** arahal_ has quit IRC19:19
*** dprince has quit IRC19:21
*** achanda has quit IRC19:21
*** ianw has joined #openstack-ironic19:22
*** athomas has joined #openstack-ironic19:22
*** alexpilotti has joined #openstack-ironic19:23
*** achanda has joined #openstack-ironic19:23
*** dims has quit IRC19:24
NobodyCamkonetzed: all the issci packages installed?19:24
*** mkovacik has quit IRC19:25
*** achanda has quit IRC19:25
openstackgerritNisha Agarwal proposed openstack/ironic: Add documentation for RAID  https://review.openstack.org/22633019:25
*** alexpilotti has quit IRC19:26
*** alexpilotti has joined #openstack-ironic19:26
*** chaustin has quit IRC19:29
rloojroll, others: cinder midcycle is streaming: https://www.youtube.com/watch?v=bC6wRygqGuI19:30
jrollwith a washed out whiteboard and all :D19:31
jrollalso a hangouts link there19:31
*** chaustin has joined #openstack-ironic19:31
openstackgerritNisha Agarwal proposed openstack/python-ironicclient: Add CLI support for RAID configuration  https://review.openstack.org/22623419:32
*** jaybeale has joined #openstack-ironic19:33
ianwjroll: with http://logs.openstack.org/62/271862/5/check/gate-tempest-dsvm-ironic-pxe_ssh-dib/340baed/logs/screen-n-cpu.txt.gz ... is the "No compute node record for host devstack-trusty-ovh-gra1-7499972" a symptom or the cause of the failure?19:33
jrollianw: I feel like that's normal? it isn't the cause19:34
jrollianw: devananda was able to reproduce, and keystone wasn't responding on /v2.019:34
jrollbut was at /19:34
jrollwhich is odd19:34
jrollI don't know much more than that, I haven't been around enough19:35
jrollwas fighting the other one earlier19:35
konetzedNobodyCam: i believe so19:35
*** Nisha_away has quit IRC19:36
konetzedi wish it would log the command it was running19:36
*** alexpilotti has quit IRC19:36
*** alexpilotti has joined #openstack-ironic19:36
*** mkovacik has joined #openstack-ironic19:39
*** daemontool_ has joined #openstack-ironic19:39
*** dprince has joined #openstack-ironic19:42
*** daemontool has quit IRC19:43
*** ijw has quit IRC19:44
konetzedim not even sure if hte compute node or the target box is throwing that error19:46
*** alexpilotti has quit IRC19:48
openstackgerritJulia Kreger proposed openstack/ironic-python-agent: Fall back from ATA erase to shredding  https://review.openstack.org/27090219:48
TheJuliarloo: I guess I should have been suspicious of the camera....19:50
rlooTheJulia: are you there? (I didn't actually watch it)19:50
TheJuliarloo: sitting off to the right19:50
rlooTheJulia: am looking but I don't see you. Oh, are you the one in red?19:51
TheJuliaohh... this could be nice and creepy, I can watch the person behind me19:51
rlooTheJulia: Oh, I see you now. Not in red!19:51
TheJulia:)19:51
rlooTheJulia: yeah, I'm not sure I would like it. I hope they told you all about it...19:51
TheJulianope :\19:52
TheJuliahad no clue it was going to be done19:52
rlooTheJulia: ohhh. That is NOT GOOD.19:52
TheJuliaYeah, not exactly happy about it19:53
* TheJulia should glare at the person with the camera, but its pointed at me19:54
rlooTheJulia: :D Maybe mention it to everyone when the camera is elsewhere.19:55
*** sirushti has quit IRC19:56
*** trown|lunch is now known as trown19:56
jroll+1 for not letting people know being not good19:57
jrollugh19:57
TheJuliaI thought it was purely for the virutal attendes in hangouts19:58
jrollyeah, I would have assumed so too19:58
jrollI don't see any notice19:58
jrollwhere'd you find that link rloo?19:58
rloojroll: harlowja mentioned it.19:58
jrollah19:58
*** rcernin has quit IRC19:58
harlowjain cinder channel19:58
TheJuliayeah, going back in the history I see it now :\20:00
* jroll brings it up20:02
TheJuliajroll: Thanks20:03
*** ijw has joined #openstack-ironic20:03
jrollyou're welcome :)20:03
rloohey jroll, wondering whether you think we should have a reno for a config that isn't usable yet: https://review.openstack.org/#/c/253355/20:06
jrollrloo: it appears like it works to me... I think the reno might mean "is not useful" rather than "is not usable"?20:08
*** raddaoui has joined #openstack-ironic20:09
*** chaustin has quit IRC20:10
*** Guest73 has joined #openstack-ironic20:11
*** Guest73_ has quit IRC20:11
rloojroll: ok.20:14
*** krtaylor has quit IRC20:16
*** Guest73_ has joined #openstack-ironic20:18
*** Guest73 has quit IRC20:21
*** chaustin has joined #openstack-ironic20:25
*** chaustin has quit IRC20:27
*** chaustin has joined #openstack-ironic20:30
*** derekh has joined #openstack-ironic20:31
*** ijw has quit IRC20:31
*** rcernin has joined #openstack-ironic20:33
*** harlowja_ has joined #openstack-ironic20:36
*** harlowja has quit IRC20:37
*** harlowja has joined #openstack-ironic20:45
*** harlowja_ has quit IRC20:45
*** derekh has quit IRC20:53
*** raildo is now known as raildo-afk20:54
*** krtaylor has joined #openstack-ironic20:54
*** daemontool has joined #openstack-ironic21:00
*** daemontool_ has quit IRC21:03
*** derekh has joined #openstack-ironic21:06
*** daemontool_ has joined #openstack-ironic21:07
*** Sukhdev has quit IRC21:07
*** maurosr has joined #openstack-ironic21:08
*** daemontool has quit IRC21:10
*** piet has quit IRC21:13
*** raddaoui has quit IRC21:14
TheJuliajlvillal: reproduce locally, pxe boot failure, going to look at pxe changes in ironic since I had to nuke and reset my /etc/ironic/ironic.conf21:21
*** alexpilotti has joined #openstack-ironic21:22
*** ijw has joined #openstack-ironic21:22
*** boris-42 has quit IRC21:23
*** alexpilotti has quit IRC21:26
*** achanda has joined #openstack-ironic21:27
*** rcernin has quit IRC21:28
*** achanda has quit IRC21:30
*** jcoufal_ has quit IRC21:32
*** Sukhdev has joined #openstack-ironic21:34
*** baoli has joined #openstack-ironic21:35
*** piet has joined #openstack-ironic21:36
*** trown is now known as trown|outttypeww21:37
*** baoli_ has joined #openstack-ironic21:38
*** baoli has quit IRC21:40
*** baoli_ has quit IRC21:41
*** baoli has joined #openstack-ironic21:41
*** ionutbalutoiu has quit IRC21:44
*** chaustin has quit IRC21:48
*** e0ne has quit IRC21:57
jlvillalTheJulia: Glad to hear you could reproduce the issue.22:01
TheJuliajlvillal: well, actually looks like I had to rip out my coreos ipa image22:03
TheJulialooks like IPA is failing to start in coreos22:03
*** ijw has quit IRC22:07
TheJuliajlvillal: https://launchpadlibrarian.net/235307552/coreos-fail1.png22:08
TheJuliahttps://launchpadlibrarian.net/235307477/coreos-fail2.png22:09
jlvillalTheJulia: :(  Maybe JayF would have ideas?22:09
*** dprince has quit IRC22:09
JayFTheJulia: that almost looks like a bad build22:10
JayFTheJulia: the questino you have to answer is why it wouldn't untar22:10
TheJuliayeah22:10
TheJuliaI'm going to have to load up an ssh key and login to it22:11
JayFTheJulia: you have console access?22:11
TheJuliawhy yes, I do22:11
JayFTheJulia: add "coreos.autologin" to the kernel command line22:11
TheJuliaoh... yeah, that will work22:11
JayFhttps://github.com/openstack/ironic-python-agent/blob/master/imagebuild/coreos/oem/cloud-config.yml#L41 I mean line 41 and 42 are the ones that are failing22:12
JayFhard for me to imagine tar is broken vs a bad tarball being generated22:12
TheJuliame watches it boot22:12
*** ijw has joined #openstack-ironic22:13
TheJulia  what is odd is I don't see anything having merged recently that would have broken it22:14
*** penick has quit IRC22:14
TheJuliaXattr request not supported22:16
*** penick has joined #openstack-ironic22:18
*** jaybeale has quit IRC22:20
TheJuliaJayF: tar: Xattr support requested, but not available22:20
JayFTheJulia: I noticed that; but given nothing changed in the image; we aren't using the latest version anymore22:21
JayFTheJulia: the only thing I am left to assume is the tar is broken22:21
JayFdoes that tarball extract somewhere else?22:21
*** ionutbalutoiu has joined #openstack-ironic22:21
TheJuliatar: usr/bin/systemd-detect-virt: Cannot open: No such file or directory22:21
TheJuliaJayF: copying off the maachine now22:22
JayFyeah I mean this whole problem, given the minor level of changes, screams correct tarball22:22
JayFTheJulia: you aren't using a diff version of coreos or anything, right?22:22
TheJuliaJayF: using exactly what is posted on tarballs.o.o22:23
JayFwell if that wasn't working, our gate would be broken22:23
JayFnot like that would be abnormal for the last while though, heh22:23
TheJulialovely, untars just fine in ubuntu22:23
*** daemontool has joined #openstack-ironic22:23
*** davidlenwell has quit IRC22:24
*** penick has quit IRC22:24
TheJuliaJayF: well, gates are broken :)22:24
JayFnow my other question; can you untar other things in the coreos?22:25
JayFheh22:25
*** davidlenwell has joined #openstack-ironic22:25
*** ijw has quit IRC22:26
*** derekh has quit IRC22:27
*** daemontool_ has quit IRC22:27
*** ijw has joined #openstack-ironic22:27
TheJuliaJayF: able to extract dateutils-zoneinfo, looks like its the extended attribs that are blowing it up22:28
JayFthere weren't any extended attributes in our older builds though22:28
JayFso something must've changed in either how docker builds happen or something else :x22:28
JayFI wonder if there's a flag to tar to tell it to ignore that?22:28
TheJulia --no-xattrs22:29
*** cdearborn has quit IRC22:29
TheJuliaadding that, I get no errors22:30
TheJulialovely :(22:30
JayFthat *is* lovely22:31
TheJuliayup22:31
JayFpush that pr up, my friend22:31
TheJuliaabout to, then go eat delicious italian food at southpoint22:31
JayFWhat italian place is there at Southpoing?22:31
JayF*point22:31
JayFOh, there's a nice sit down place in the outdoor mall portion, isn't there?22:32
TheJuliayup, maggianos22:32
JayFTheJulia: I'm actually in NC Weds-Fri. My grandmother passed and am heading up for the funeral22:32
TheJuliaI think the netapp folks area bout to make me leave22:32
TheJulia:( sorry to hear that dude22:32
JayFif I had time I'd suggest we grab a bite or something22:33
openstackgerritJulia Kreger proposed openstack/ironic-python-agent: Disable xattrs in IPA extraction  https://review.openstack.org/27276522:37
TheJuliaJayF: ^^^22:37
*** harshs has quit IRC22:37
TheJuliaJayF: totally understand, go be with your family :)22:37
JayFTheJulia: you need to add a space between the s and the \, I think22:38
*** ijw has quit IRC22:38
TheJuliadoh22:38
*** e0ne has joined #openstack-ironic22:39
openstackgerritJulia Kreger proposed openstack/ironic-python-agent: Disable xattrs in IPA extraction  https://review.openstack.org/27276522:39
*** daemontool_ has joined #openstack-ironic22:39
*** daemontool has quit IRC22:42
JayFI feel like I'm going crazy; I can't find the "reply" button to vote on the change even though I'm logged in22:47
JayFoh with the new gerrit if the window is too narrow it's completely hidden; that's unfortunate22:47
*** harshs has joined #openstack-ironic22:52
openstackgerritArun S A G proposed openstack/ironic-specs: Add spec for deploying OS tarballs  https://review.openstack.org/24896822:54
*** boris-42 has joined #openstack-ironic22:54
*** dims has joined #openstack-ironic22:55
*** achanda has joined #openstack-ironic22:58
gmmahaTheJulia: hitting the same error with xattrs on my deployment as well.. if that helps22:58
*** ntpttr has joined #openstack-ironic23:01
*** e0ne has quit IRC23:02
zer0c00lTheJulia: Where was the tarball created? What distro is it?23:05
*** rbudden has quit IRC23:05
openstackgerritKurt Taylor proposed openstack/ironic-python-agent: Add DIB ironic-agent element to readme for IPA  https://review.openstack.org/27277423:06
zer0c00lI don't know how this tarball is created in DIB, (docker?) why not disable xattrs and acls there?23:06
zer0c00lI mean disable xattrs and acls during the tarball creation time23:07
zer0c00lTo completely disable all the xattrs23:08
zer0c00lyou probably need --no-acls and --no-selinux23:08
*** baoli has quit IRC23:12
*** baoli has joined #openstack-ironic23:13
*** ijw has joined #openstack-ironic23:16
JayFzer0c00l: it's not in dib23:17
*** Sukhdev has quit IRC23:17
JayFzer0c00l: look at the scripts in ironic-python-agent/imagebuild/coreos23:17
jlvillalJayF: Is it: https://github.com/openstack/ironic-python-agent/blob/master/imagebuild/coreos/full_trusty_build.sh#L1923:17
JayFhttps://github.com/openstack/ironic-python-agent/blob/master/imagebuild/coreos/docker_build.bash is23:18
zer0c00lJayF: yeah i mispoke23:18
zer0c00ldocker export $CONTAINER | gzip > ${OUTPUT_FILE}23:18
zer0c00lThat one23:18
zer0c00lWe are not really using tar utility to create the container image23:18
zer0c00lwe are using docker23:18
JayFdocker export STDOUT is a stream of tar23:18
zer0c00lNot sure if there is any way to disable extended filesystem attributes there23:19
JayFI'm not sure either.23:19
jlvillaldocker export $CONTAINER | tar x  --XXXXX | tar c --XXXX | gzip > ${OUTPUT_FILE}23:20
jlvillal:D23:20
JayFthat might not be a TARible idea23:21
* jlvillal remembers someone telling me that JayF liked puns. I said inpunsible!23:21
zer0c00ljlvillal: lol23:22
* jlvillal thinks with a few more hours he could come up with a better joke, but won't try :)23:22
zer0c00ljlvillal: So docker implemented their own 'tar' and there were 3  CVEs on it23:22
jlvillalzer0c00l: You sound like the email thread I read about the idea for adding tar file support to glance23:23
zer0c00ljlvillal: yes23:23
zer0c00ljlvillal: thanks for the comment on the spec, i updated it with security impact23:23
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Updated from global requirements  https://review.openstack.org/27162823:23
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-inspector: Updated from global requirements  https://review.openstack.org/27278923:23
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-lib: Updated from global requirements  https://review.openstack.org/26932023:23
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/26845023:23
jlvillalzer0c00l: Ah so you are Arun :)23:24
* zer0c00l really need to change his irc nick23:24
zer0c00ljlvillal: yes i am23:24
* jlvillal used to have a funny/fancy nick. But then went for one that was easy for people to figure out who he was.23:24
* jlvillal is now boring.23:25
zer0c00ljlvillal: Hopefully that was you were looking for? A statement about security implication of allowing untrusted tar images23:25
*** mgoddard has quit IRC23:25
jlvillalzer0c00l: I did respond. I was hoping for a touch more detail.23:25
zer0c00ljlvillal: Thanks will take a look23:27
jlvillalzer0c00l: Thank you.23:27
*** derekh has joined #openstack-ironic23:29
*** jcoufal has joined #openstack-ironic23:33
ntpttrjlvillal: what did your nick used to be?23:34
jlvillalntpttr: Years ago it was 'happycamp', before that '23:38
jlvillalBefore that wolverine. But that was too popular :)23:38
* NobodyCam has been and will continue to be NobodyCam :p23:39
zer0c00lNo body cam?23:39
zer0c00l:P23:39
*** piet has quit IRC23:39
*** ionutbalutoiu has quit IRC23:39
NobodyCamlol was a typo from long long ago that just stuck23:40
zer0c00l:) i created this irc nick after watching the hacker movie23:41
NobodyCamw00t23:41
NobodyCamhehe23:41
zer0c00lhttp://www.imdb.com/title/tt0113243/23:41
zer0c00l"In 1988, Dade "Zero Cool" Murphy (age 11) is arrested and charged with crashing 1,507 systems in one day and causing a single-day 7-point drop in the New York Stock Exchange...23:42
jlvillalzer0c00l: Oh that might be fun to watch. I like Jonny Lee Miller in Elementary.23:42
NobodyCamlol ++23:43
NobodyCamI started with this movie: http://www.imdb.com/title/tt0086567/23:43
NobodyCama little older23:43
jlvillalNobodyCam: I remember that! :)23:43
jlvillalNobodyCam: WOPR :)23:43
NobodyCamyep23:43
zer0c00lcomputer fraud and abuse act was created based on that movie. isn't it?23:44
NobodyCamand 8" floppy disks23:44
*** rajinir has quit IRC23:45
NobodyCamzer0c00l: I'll bet it was23:45
* jlvillal really hates debugging tempest failures. The ever helpful message 'No valid host was found. There are not enough hosts available.'23:46
* jlvillal can not seem to find the root cause error message :(23:47
jlvillalzer0c00l: NobodyCam: Make you both happy :)  http://www.imdb.com/media/rm1802208512/tt0113243?ref_=ttmd_md_nxt23:48
*** ijw has quit IRC23:50
jrolljlvillal: root cause is usually in nova-compute23:52
jrollthat means it was able to schedule and attempt to build23:52
jrollthe build failed in the compute layer23:52
jrolland so it rescheduled and tried again23:52
jroll$(config with default of 3) times23:52
NobodyCamlol23:52
jlvillaljroll: So screen-n-cpu?23:53
jrolljlvillal: y23:53
jlvillaljroll: I'm using the UUID I got from the error message in tempest. But I don't see it in screen-n-cpu23:53
jrollO_o23:53
jrolllink?23:53
jrollor is this local23:53
jrollthe other causes for that error are: 1) there's no capacity to schedule to; 2) nova-compute is not up23:54
*** sturivnyi has quit IRC23:54
jrollin either case the n-sch logs may be enlightening23:54
jlvillaljroll: Local :(23:54
jrollyeah, try n-sch23:55
jlvillaljroll: Pretty similar to this though: http://logs.openstack.org/24/269924/2/experimental/gate-grenade-dsvm-ironic/4508673/23:56
jlvillaljroll: Though I haven't looked into that one that much.23:56
jlvillalI get six errors and that one gets three.23:56
*** sturivnyi has joined #openstack-ironic23:58
jrollidk what I'm looking for :P23:59
jlvillaljroll: I do see n-sch saying Filtering removed all hosts for the request with reservation ID 'r-2junma0e' and instance ID '938abe6c-7819-41ff-b49d-f912493108a7' on my local one23:59
jrollah I see it23:59
*** achanda has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!