Wednesday, 2014-09-24

*** marcoemorais has quit IRC00:00
*** marcoemorais has joined #openstack-ironic00:00
NobodyCamIPA team: are lines 12 thru 17 of https://review.openstack.org/#/c/103105/5/elements/ironic-agent/post-install.d/80-ironic-agent required for IPA?00:09
*** lucas-dinner has quit IRC00:17
jrollNobodyCam: idk, I think that's fedora related maybe?00:18
jrollNobodyCam: no idea, at all00:19
NobodyCamseems wrong to me00:20
jrollyeah, dunno, never seen anything like that00:21
NobodyCamhat looks like the old school file injection from early nova baremetal00:22
NobodyCams/hat/that/00:22
jrollgah00:24
*** nosnos has joined #openstack-ironic00:24
*** ChuckC_ has joined #openstack-ironic00:29
NobodyCamyuriyz: please ping me RE: https://review.openstack.org/#/c/10310500:32
*** ChuckC has joined #openstack-ironic00:33
*** ChuckC_ has quit IRC00:33
*** todd_dsm has joined #openstack-ironic00:39
*** Nicklaus_Zulauf3 has quit IRC00:42
*** Arvid_Ebert86 has joined #openstack-ironic00:42
*** penick has joined #openstack-ironic00:46
*** marcoemorais has quit IRC00:47
*** marcoemorais has joined #openstack-ironic00:48
*** marcoemorais has quit IRC00:48
*** marcoemorais has joined #openstack-ironic00:48
*** marcoemorais has quit IRC00:48
*** marcoemorais has joined #openstack-ironic00:49
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Use LLDP to get switch port mapping  https://review.openstack.org/9262700:50
*** r-daneel_ has quit IRC00:56
*** todd_dsm has quit IRC01:02
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Use LLDP to get switch port mapping  https://review.openstack.org/9262701:08
*** chenglch has joined #openstack-ironic01:18
*** todd_dsm has joined #openstack-ironic01:20
*** chenglch has quit IRC01:20
*** Arvid_Ebert86 has quit IRC01:25
*** chenglch has joined #openstack-ironic01:29
openstackgerritxu-haiwei proposed a change to openstack/ironic: Fix typo to show correct log message  https://review.openstack.org/12231601:34
*** Haomeng has joined #openstack-ironic01:39
*** Haomeng|2 has quit IRC01:40
*** todd_dsm has quit IRC01:42
*** Alyson_Cassin83 has joined #openstack-ironic01:44
*** todd_dsm has joined #openstack-ironic02:01
*** todd_dsm has quit IRC02:02
*** marcoemorais has quit IRC02:02
*** pcrews has quit IRC02:06
*** todd_dsm has joined #openstack-ironic02:11
*** Poornima has joined #openstack-ironic02:14
openstackgerritxu-haiwei proposed a change to openstack/ironic: Sync ironic/openstack/common/policy.py with oslo.  https://review.openstack.org/12231602:15
*** dlaube has quit IRC02:19
*** todd_dsm has quit IRC02:24
*** harlowja is now known as harlowja_away02:36
*** Alyson_Cassin83 has quit IRC02:38
*** Alysa_Schmeler has joined #openstack-ironic02:49
*** ramineni has joined #openstack-ironic02:55
*** sabah has joined #openstack-ironic02:58
*** comstud has quit IRC03:07
*** wendar has quit IRC03:07
*** wendar has joined #openstack-ironic03:08
JayFjroll: is there a bug number yet for the new agent tempest job failures?03:15
*** penick has quit IRC03:19
*** jrist has quit IRC03:33
*** Alysa_Schmeler has quit IRC03:39
*** jrist has joined #openstack-ironic03:40
openstackgerritYuiko Takada proposed a change to openstack/python-ironicclient: Add unit test for "ironic node-update" shell cmd  https://review.openstack.org/12098903:41
*** Albert87 has joined #openstack-ironic03:43
*** marcoemorais has joined #openstack-ironic03:55
*** sabah has quit IRC03:56
*** Poornima has quit IRC03:56
*** marcoemorais1 has joined #openstack-ironic03:57
*** lazy_prince is now known as killer_prince04:00
*** marcoemorais has quit IRC04:00
*** Haomeng|2 has joined #openstack-ironic04:07
*** Haomeng has quit IRC04:08
openstackgerritYuiko Takada proposed a change to openstack/python-ironicclient: Add unit tests for "ironic node-show" shell cmd  https://review.openstack.org/12000104:08
openstackgerritYuiko Takada proposed a change to openstack/python-ironicclient: Add unit tests for "ironic node-create" shell cmd  https://review.openstack.org/12031204:15
*** Albert87 has quit IRC04:18
*** comstud has joined #openstack-ironic04:21
*** rushiagr_away is now known as rushiagr04:23
*** nikunj2512 has joined #openstack-ironic04:27
*** Poornima has joined #openstack-ironic04:33
*** comstud has quit IRC04:35
*** killer_prince has quit IRC04:36
*** comstud has joined #openstack-ironic04:38
*** vinbs has joined #openstack-ironic04:40
*** rakesh_hs has joined #openstack-ironic04:41
*** comstud has quit IRC04:45
*** pensu has joined #openstack-ironic05:00
*** r-mibu has joined #openstack-ironic05:10
*** comstud has joined #openstack-ironic05:18
*** pensu has quit IRC05:19
*** pensu has joined #openstack-ironic05:23
*** pensu has quit IRC06:00
*** jcoufal has joined #openstack-ironic06:01
*** killer_prince has joined #openstack-ironic06:07
*** killer_prince is now known as lazy_prince06:07
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/12334206:07
*** k4n0 has joined #openstack-ironic06:09
*** pensu has joined #openstack-ironic06:21
*** athomas has joined #openstack-ironic06:43
*** jistr has joined #openstack-ironic06:46
*** romcheg has joined #openstack-ironic07:00
*** ifarkas has joined #openstack-ironic07:02
*** Poornima has quit IRC07:03
*** Poornima has joined #openstack-ironic07:10
*** GheRivero_ has joined #openstack-ironic07:11
*** GheRivero has quit IRC07:14
*** GheRivero_ is now known as GheRivero07:15
*** romcheg has joined #openstack-ironic07:18
*** romcheg has left #openstack-ironic07:33
*** romcheg has joined #openstack-ironic07:33
*** ndipanov_gone is now known as ndipanov07:35
*** Poornima has quit IRC07:44
*** athomas has quit IRC07:51
*** athomas has joined #openstack-ironic07:54
*** takadayuiko has joined #openstack-ironic08:05
*** lucasagomes has joined #openstack-ironic08:17
*** dtantsur|afk is now known as dtantsur08:25
dtantsurMorning Ironic08:25
vinbsMorning dtantsur!08:25
*** krykowski has joined #openstack-ironic08:26
*** MattMan has quit IRC08:32
*** MattMan has joined #openstack-ironic08:33
*** Poornima has joined #openstack-ironic08:40
*** marcoemorais1 has quit IRC08:41
yuriyzmorning Ironic dtantsur vinbs08:41
dtantsurhi yuriyz, vinbs! :)08:42
*** bluex-pl has joined #openstack-ironic08:42
*** takadayuiko has quit IRC08:42
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: pxe_ilo driver to call iLO set_boot_device  https://review.openstack.org/12366008:45
*** jistr has quit IRC08:45
vinbsMorning yuriyz08:46
*** christopheraedo has quit IRC08:47
*** christopheraedo has joined #openstack-ironic08:48
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: pxe_ilo driver to call iLO set_boot_device  https://review.openstack.org/12281908:48
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: EXPERIMENTAL Implement hardware discovery in PXE driver  https://review.openstack.org/11003108:53
yuriyz122819 and 123660 duplicated, one should be abandoned08:53
*** bluex-pl has quit IRC08:53
*** bluex-pl has joined #openstack-ironic08:54
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/12366208:57
*** krykowski has quit IRC08:58
*** krykowski has joined #openstack-ironic08:59
*** bluex-pl has quit IRC08:59
*** bluex-pl has joined #openstack-ironic09:00
*** Haomeng has joined #openstack-ironic09:00
pensuHi all, I have set up Ironic using devstack. Now, I need to do some experiments by adding a new node. I couldn't find any guide on how to add a new node to this setup. How can it be done?09:00
*** Haomeng|2 has quit IRC09:01
lazy_princepensu: are you looking for ironic node-create .... ?09:01
dtantsurpensu, simple example is in the end of http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#exercising-the-services-locally09:02
pensulazy_prince: yeah, what I want to know is can I add a physical node using that in a devstack rnvironment? I tried and it says can't validate PXE bootloader.....09:06
*** krykowski has quit IRC09:06
lazy_princepense: aha.. what driver are you using when you are trying to add node..?09:07
pensudtantsur: yeah, I tried that, just want to confirm that it would work with devstack installation or not?09:07
dtantsurpensu, well, difference is driver used (pxe_ssh) and set of required parameters. And for real bare metal you probably want pxe_ipmitool or another real driver09:08
dtantsurpensu, what exactly says "can't validate PXE bootloader"? which command?09:08
*** jistr has joined #openstack-ironic09:08
dtantsurusually pxe parameters are filled by nova when deploying a node09:08
dtantsurand ssh/ipmi/ilo/drac ones should be set by you in advance09:09
*** derekh has joined #openstack-ironic09:09
pensulazy_prince: dtantsur: my nvoa.conf says "compute_driver = ironic.nova.virt.ironic.IronicDriver"09:09
pensudoes that makes sense?09:10
dtantsurpensu, I mean Ironic driver that is set for every node, not Nova compute driver09:10
dtantsurdo ironic node-show for any existing node and you'll see09:10
*** Nisha has joined #openstack-ironic09:10
pensudtantsur: okay, I guess I understand this. Let me try something and I will get back to you. Thank you....:)09:13
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Remove redundant context parameter  https://review.openstack.org/12341209:14
lucasagomesdtantsur, can you re-approve it please? https://review.openstack.org/#/c/123412/09:16
lucasagomesI had to rebase because the dependent patch was outdated (now merged)09:16
*** andreykurilin_ has joined #openstack-ironic09:16
openstackgerritA change was merged to openstack/ironic: Update docs with new dbsync command  https://review.openstack.org/12280209:16
dtantsurlucasagomes, done09:19
lucasagomesdtantsur, ta much09:19
*** krykowski has joined #openstack-ironic09:20
*** loki184 has joined #openstack-ironic09:20
*** openstack has joined #openstack-ironic09:24
zigodevananda: When I see that the global-requirements.txt pushes me to do a new version, I just package last tag. Currently 0.2.1 is in Debian Experimental. Do you think I should package something more recent?09:25
*** vdrok has quit IRC09:32
*** vdrok has joined #openstack-ironic09:36
*** Nisha has quit IRC09:40
openstackgerritYuriy Zveryanskyy proposed a change to openstack/ironic: Do not return 'id' in REST API error messages  https://review.openstack.org/12315009:45
raminenilucasagomes:hi09:46
lucasagomesramineni, hi there09:47
raminenilucasagomes: regarding review comment on https://review.openstack.org/#/c/122819/4/ironic/drivers/modules/ilo/deploy.py09:47
ramineniraising IPMIFailure in set_boot_device09:48
raminenilucasagomes: we are not using ipmi call to set the boot device , so doesn't it convey the wrong  idea , if we raise IPMIfailure09:49
lucasagomesramineni, hmm... to be honest yeah, but I was thinking about the user perspective09:49
lucasagomeslike that interface inherits from the ipmitool one09:49
lucasagomesso for get_boot_device for e.g09:49
lucasagomesif something goes wrong, IPMIFailure will be raised09:49
lucasagomessame for get_sensor_data09:50
lucasagomesnow for set_boot_device IloOperationError will be raised09:50
raminenilucasagomes: yes , for others i agree , but if we keep it here , user will get worng idea , something wrong with IPMI?09:50
ramineniyes , it raises IloOperationError09:50
raminenifor now09:51
lucasagomesramineni, right, ok well it was mostly a suggestion. But I can see benefits on both approachs09:51
lucasagomesbut yeah I'm grand raising iloOperationError if you prefer. But we still need to updated that docs about that09:51
raminenilucasagomes: yes ..will do that09:52
lucasagomesramineni, and, there's a duplicated patch. It would be good to abandon one of them09:52
lucasagomes(they look exactly same)09:52
raminenilucasagomes: ya .. didn't check Change-Id has been changed :(09:52
ramineniwill abandon that09:52
lucasagomesoh, no worries :)09:52
lucasagomesalright so we can keep the ilo error09:53
raminenilucasagomes: ya ..thanks :)09:53
*** Nisha has joined #openstack-ironic09:54
*** viktors|afk is now known as viktors09:56
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: pxe_ilo driver to call iLO set_boot_device  https://review.openstack.org/12281909:58
*** krykowski has quit IRC10:01
dtantsurbtw I'd also prefer iLO error10:03
openstackgerritA change was merged to openstack/ironic: Update devstack docs, require Ubuntu 14.04  https://review.openstack.org/12251910:04
*** andreykurilin_ has quit IRC10:28
*** nikunj2512 has quit IRC10:30
*** datajerk has joined #openstack-ironic10:35
*** krykowski has joined #openstack-ironic10:36
*** rushiagr is now known as rushiagr_away10:40
*** rushiagr_away is now known as rushiagr10:43
*** pensu has quit IRC10:45
*** bluex-pl has quit IRC10:56
*** bluex-pl has joined #openstack-ironic10:56
openstackgerritA change was merged to openstack/ironic: Remove redundant context parameter  https://review.openstack.org/12341210:57
*** ramineni has quit IRC11:02
*** krykowski has quit IRC11:06
*** romcheg has quit IRC11:08
*** lucasagomes is now known as lucas-hungry11:09
*** chenglch has quit IRC11:15
ekarlsoHey guys, is ironic using WSME or JsonSchema ?11:21
*** vinbs has quit IRC11:23
dtantsurekarlso, wsme at least11:27
ekarlsodtantsur: using both or ?11:28
dtantsurnot sure11:29
*** bluex-pl has quit IRC11:30
*** bluex-pl has joined #openstack-ironic11:31
*** krykowski has joined #openstack-ironic11:33
*** pensu has joined #openstack-ironic11:34
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/12366211:34
*** bluex-pl has quit IRC11:35
*** bluex-pl has joined #openstack-ironic11:36
*** Nisha has quit IRC11:42
*** Poornima has quit IRC11:55
*** romcheg has joined #openstack-ironic11:58
*** loki184 has quit IRC12:04
Shrewsmorning ironic12:04
Shrewsekarlso: the ironic api server uses wsme for validation12:05
ekarlsoShrews: cool! :)12:05
*** lucas-hungry is now known as lucasagomes12:08
lucasagomesShrews, morning12:08
Shrewslucasagomes: morning12:09
*** HenryG_afk is now known as HenryG12:09
*** krykowski_ has joined #openstack-ironic12:09
*** krykowski has quit IRC12:13
*** pensu has quit IRC12:15
*** bluex-pl has quit IRC12:16
*** bluex-pl has joined #openstack-ironic12:22
*** linggao has joined #openstack-ironic12:27
*** bluex-pl has quit IRC12:29
*** krykowski_ has quit IRC12:30
*** pensu has joined #openstack-ironic12:30
*** bluex-pl has joined #openstack-ironic12:31
*** rakesh_hs has quit IRC12:36
jrollJayF: no12:40
jrollmorning ironic :)12:40
jrollpensu: perhaps you could show us the node-create command you are running, and the exact error?12:42
lucasagomesjroll, morning12:43
*** bluex-pl has quit IRC12:46
ekarlsoShrews: was there a reason why WSME vs jsonschema ?12:50
Shrewsekarlso: before my time, but i think that code was pulled from another project to start with? also, the author of wsme works on openstack (dhellman)12:51
lucasagomesekarlso, it was recommended to use WSME for new projects12:51
lucasagomesyeah the code was based on ceilometers api12:51
Shrewsekarlso: also, wsme was used b/c at one point, openstack supported both json AND xml, which wsme supports quite nicely12:52
*** jjohnson2 has joined #openstack-ironic12:57
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: EXPERIMENTAL Implement hardware discovery in PXE driver  https://review.openstack.org/11003112:58
ekarlsoah ok12:59
dtantsurShrews, jroll, morning12:59
Shrewsdtantsur: o/12:59
jrollgoooood morning :)13:00
* jroll really wants read-only access via policy.conf right now13:00
*** rloo has joined #openstack-ironic13:02
openstackgerritA change was merged to openstack/ironic: pxe_ilo driver to call iLO set_boot_device  https://review.openstack.org/12281913:03
*** vdrok has quit IRC13:08
dtantsurjroll, I guess we can update whiteboard re the mirrors?13:10
rloohi everyone!13:11
lucasagomesrloo, morning :)13:12
dtantsurrloo, morning13:12
rlooyuriyz: wrt https://review.openstack.org/123150, why aren't port/node destroys related to that bug?13:12
rloohiya lucasagomes, dtantsur13:12
*** vdrok has joined #openstack-ironic13:16
jrolldtantsur: oh yeah, go for it :)13:19
yuriyzrloo, DB API can raise NotFound for port/node, but REST API does get_by_uuid() before (uuid will be in error message), only ChassisNotEmpty exception related to this bug ("id" in the message)13:20
rlooyuriyz: hmm. ok, I trust that you're right since I'm not familiar with that code. I don't like that the code doesn't seem consistent now, but I guess that's another story. Thx.13:22
*** nosnos has quit IRC13:27
*** nosnos has joined #openstack-ironic13:27
*** dprince has joined #openstack-ironic13:31
*** nosnos has quit IRC13:32
yuriyzrloo, now I think we should change obj.destroy() for port/node also, because this bug will be in delete() race case. Thanks.13:35
rlooyuriyz: thx! ;)13:38
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Separate the agent driver config from the base localrc config  https://review.openstack.org/12373313:46
lucasagomesjroll, ^ to facilitate the c&p13:47
openstackgerritYuriy Zveryanskyy proposed a change to openstack/ironic: Do not return 'id' in REST API error messages  https://review.openstack.org/12315013:47
* lucasagomes built an env to test the pxe hash ring but ended with agent_ssh enabled by default13:47
jrollheh, oops13:48
jroll+2'd13:48
*** r-daneel_ has joined #openstack-ironic13:59
*** bluex-pl has joined #openstack-ironic14:07
NobodyCamgood morning Ironic14:21
lucasagomesNobodyCam, morning14:21
NobodyCammorning lucasagomes14:21
NobodyCammorning rloo :)14:21
rloobonjour NobodyCam14:22
NobodyCamyuriyz: morning14:22
NobodyCam:)14:22
yuriyzmorning NobodyCam14:22
NobodyCamyuriyz: I had a question about https://review.openstack.org/#/c/10310514:23
NobodyCamare you still working on that one?14:23
NobodyCam:)14:23
Shrewsmorning Mr. NobodyCam14:24
NobodyCammorning Shrews :)14:24
yuriyzNobodyCam, yes I should add some doc and not proper tested yet14:24
NobodyCamI also added a couple of comments14:24
yuriyzNobodyCam, thanks14:25
jrollmorning NobodyCam and yuriyz :)14:25
NobodyCamI don't get lines 12 thru 17 of https://review.openstack.org/#/c/103105/5/elements/ironic-agent/post-install.d/80-ironic-agent14:25
NobodyCammorning jroll14:25
NobodyCamare those lines needed14:25
jrollyuriyz: does that IPA DIB thing start the agent properly and everything? eager to try it14:26
yuriyzjroll, deploy not tested yet14:27
jrollok14:28
jrollI have another thing to do but I think I'll try that this morning :)14:28
yuriyzjroll, thanks14:28
NobodyCamawesome jroll :)14:29
* jroll starts building it now14:30
jrollone thing that would be nice is to be able to build this from source14:30
jrolldunno how feasible that is14:30
*** bluex-pl has quit IRC14:42
*** bluex-pl has joined #openstack-ironic14:43
*** pcrews has joined #openstack-ironic14:47
NobodyCambrb14:52
*** Poornima has joined #openstack-ironic14:57
*** ifarkas has quit IRC14:59
NobodyCamrain rain go away gome again some other day!15:02
NobodyCam:-p15:02
*** ramineni has joined #openstack-ironic15:10
NobodyCamno code for https://bugs.launchpad.net/ironic/+bug/136533415:10
NobodyCam:(15:10
lucasagomeshmm there were some15:13
lucasagomesit's in the queue afair15:14
NobodyCamI will dig in in a minute15:14
Shrewsit was something from lifeless, iirc15:15
Shrewshttps://review.openstack.org/11893215:15
NobodyCamdtantsur: you Abandoned https://review.openstack.org/#/c/92115 and https://review.openstack.org/#/c/93748??15:15
NobodyCamShrews: TY, odd it didn't get added to the bug15:16
ShrewsNobodyCam: bug came after the fix15:17
Shrewsbut, hrm... there is a closes-bug tag on it.15:18
Shrewsweird15:18
* Shrews blames LP15:18
rlooShrews: I just gave feedback on 123518, but I decided not to look at it all, cuz I should probably look at code changes for RC1.15:18
*** jistr has quit IRC15:21
dtantsurNobodyCam, yeah, IIRC I got message from devananda that it's not the right way to do it15:26
NobodyCamI was reading his comments15:28
*** rushiagr is now known as rushiagr_away15:29
*** loki184 has joined #openstack-ironic15:30
Shrewsrloo: so, i think you are going to force me to outline how i think doc reviews should be handled  :)15:30
rlooShrews: sorry. How should they be handled?15:31
Shrewsrloo: tl;dr... IMO, docs should be reviewed more for correctness vs. formatting/completeness. Especially when it's for documentation that is non-existent. Something is better than nothing.15:32
*** ramineni has quit IRC15:32
rlooShrews: so you're saying, first pass for new docn is for correctness of info. then let later revisions fix formatting/completeness?15:33
Shrewspretty much, yeah. documentation should be a collaborative effort since no single person wants to do it.15:33
rlooShrews: I'm fine with that if others are too. Although I'm not sure I'm really fine with that, but if others are fine with that...15:33
NobodyCamoh nice: https://review.openstack.org/#/c/9374815:33
*** lazy_prince is now known as killer_prince15:34
NobodyCamShrews: +1 to that.. Something is better then nothing!15:35
Shrewsrloo: for example, you prefer an alternate organization of the info, but i like it the way i presented it. should we stall the docs until we come to a consensus, or go ahead and put it in so that at least there is SOMETHING there?15:35
rlooShrews: but that's the discussion we have with all reviews, if there is diff of opinion. Isn't it better to work it out before something goes in, than try to fix/modify afterwards? Even afterwards, I hope the discussion still happens.15:36
rlooShrews: it just seems more efficient to me to do it 'as best' the first time, than to then have to deal with subsequent patches.15:36
Shrewsrloo: i think code is totally different. code MUST work and MUST be as close to perfect we can get it. refactoring is hard15:36
*** rushiagr_away is now known as rushiagr15:37
Shrewscode can break us, docs can't  :)15:37
* NobodyCam is not sure he agrees with Shrews on that15:37
rlooShrews: ohhh kay. But as someone that reads doc, I like to be able to read/understand what I'm reading.15:38
rlooShrews: Anyway, I know I can be picky. So I'm willing to not be picky if that's the consensus.15:38
Shrewsrloo: i actually agree with you that *ideally* it would be perfect the first time. the problem is we have no standard of "perfect" for docs.15:38
Shrewsrloo: i would never suggest accepting docs that are not understandable15:39
rlooShrews: yes, there is no standard. So I try to review the doc as if I were the reader w/o much knowledge.15:39
rlooShrews: so my comments were based on understandability.15:40
rlooShrews: "my" understandability. Or how it can be done better to make it easier for me to understand.15:40
rlooShrews: clearly everyone has diff opinions on what goes in doc. you can see that by the comments you get.15:40
Shrewsrloo: indeed. :)  so, i'm not clear what it is about "options" that's confusing you?15:42
rlooShrews: So I guess I wasn't clear in my comments. The first section was title 'Options', and it referred to the optional arguments, the --* stuff.15:43
rlooShrews: the second section starts off with a sentence that mentions 'options' and to do an ironic-dbsync -h to see them all. But you had already mentioned that in the first section.15:44
rlooShrews: So my thinking is maybe you meant something else in the second section wrt the term 'options'.15:44
rlooShrews: and since the second section was titled 'usage', I sort of assumed it'd show the usage stuff.15:44
jrollyuriyz: update, I can't get this thing to boot :/15:45
rlooShrews: like when you look at a man page.15:45
Shrewsrloo: no, that was just a repeat. showing how to "use" help  :)15:45
*** ndipanov is now known as ndipanov_gone15:45
Shrewsrloo: i can remove that though, since it's a repeat15:46
rlooShrews: oh. Well then, yeah, remove it if you were only talking about the optional arguments.15:46
jrollyuriyz: but not entirely sure why... going to look a bit15:46
rlooShrews: but the help shows the usage/args/subcommands, so more completely, you can say 'use help to see the full something of the command'15:47
*** viktors is now known as viktors|afk15:47
openstackgerritDavid Shrewsbury proposed a change to openstack/ironic: Add documentation for ironic-dbsync command  https://review.openstack.org/12351815:51
Shrewsrloo: not sure i understood that last bit, but ^^^^15:51
rlooShrews: I want to focus on the hash ring stuff today (was getting distracted with other stuff). So I'll take a look at this later. docn can be updated after rc1 cuz they just show up when they're merged.15:53
Shrewsrloo: certainly!15:53
loki184hi all had a question using host aggregates creation with ironic enabled  multinode devstack setup15:54
rlooShrews: one question I have for you. If the doc for the commands doesn't show everything that the command can do, why/what subset is being documented, and it should be clear that the doc isn't complete.15:54
NobodyCamShrews: may I ask why Revision, stamp and version do not have command examples as the others do?15:54
loki184can someone please help me with grouping normal vms vs ironic baremetal vms using host aggregates and scheduler filter15:54
openstackgerritA change was merged to openstack/ironic: Separate the agent driver config from the base localrc config  https://review.openstack.org/12373315:54
jrollhmm15:54
* jroll wonders who knows about host aggregates and such15:55
Shrewsrloo: i think i did document all of the subcommand options. not sure what you're asking15:55
rlooShrews: your comment 'I intentionally did not add that because then we'd force documentation update for any change in the options15:55
jrollloki184: I'd love to help, but I don't use host aggregates, my team runs ironic in a separate cell15:55
ShrewsNobodyCam: b/c i didn't think all of them (like version) needed an example. and i plain just don't know why or how i'd use stamp.  :)15:55
NobodyCamloki184: I have not ever setup such a configuration, but would welcome a doc on how to do it15:55
NobodyCamlol15:56
NobodyCamShrews: ack15:56
jrollloki184: might be best to mail the list so that nova folks can chime in (they might know more)15:56
loki184jroll: i have setup with two computehost service running want to provision vms on one of the host as per user choice. i will check with nova folks thanks!15:57
loki184NobodyCam: Will document it :)15:57
NobodyCamloki184: awesome Thank you :)15:57
Shrewsrloo: the subset i mentioned are what i thought would be the most used options (the subcommands list the full options for that command) and that a full list is available with -h15:58
*** killer_prince is now known as lazy_prince15:59
*** Poornima has quit IRC16:00
rlooShrews: yes. hmm. I guess I really like to see the usage string from the command.16:00
devanandamorning, all16:01
jrollheya devananda :)16:01
NobodyCamgood morning devananda16:01
rloomorning devananda16:02
devanandazigo: my testing yesterday indicates that the current requirements (0.2.1) are sufficient for the nova driver, but the latest release (0.3.0) does have several improvements16:02
*** k4n0 has quit IRC16:03
lucasagomesdevananda, morning16:03
zigodevananda: I'll try to find the time to update the package to 0.3.0 then.16:03
lucasagomesdevananda, do we have a consensus if we are going to fix the take over in J? I started looking into that16:04
*** saurabhs has joined #openstack-ironic16:04
lucasagomesdevananda, I'd like to validate some assumptions, for e.g: Is it fine to only call a take over for nodes that are *deployed*16:05
lucasagomes>16:05
lucasagomes?*16:05
devanandazigo: thanks much16:05
devanandalucasagomes: correct16:05
lucasagomesit seems so... because I want to make it a light operation16:06
lucasagomesright16:06
devanandaalso, https://review.openstack.org/#/c/122819/5/ironic/drivers/modules/ilo/deploy.py seems wierd16:06
lucasagomesI want to create a bound conductor->node as part of the deployment of the node, and remove it when we undeploy16:06
devanandawhy is ilo management using ipmitool?16:06
*** rameshg87 has joined #openstack-ironic16:06
lucasagomesdevananda, to be able to set the boot device?16:06
lucasagomesand get sensor data16:07
lucasagomesetc16:07
devanandaright - why isn't it doing that with *ilo* ?16:07
* lucasagomes thinks (that sounds a better idea really)16:08
devanandathis means a user of the ilo driver needs to input both ilo and ipmi credentials16:08
devanandaand make sure both proliantutils and ipmitool are present on teh system16:09
lucasagomesyeah, they were using the ipmitool.Management directly before16:09
lucasagomesand this is something we talked when the ilo driver was being proposed afair16:09
lucasagomesand they were about it, I think that's was when the "credentials should be separated" topic came from16:10
devanandathe commit message doesn't match the implementation at all16:10
devanandaThis fix proposes to change the management interface for pxe_ilo driver16:10
devanandato call ilo set_boot_device using proliantutils ilo_client functions16:10
devanandainstead of IPMI call16:10
devananda... but it's not using ilo_client16:10
devanandawait, is it?16:11
lucasagomesit's16:11
lucasagomesilo_common.set_boot_device(task.node, boot_device, persistent)16:11
devanandaheh, it is16:11
devanandayea16:11
lucasagomesbefore it was using ipmitool16:11
devanandait's still subclassing IPMIManagement tho16:11
*** bluex-pl has quit IRC16:12
devanandawhich includes validate()16:12
lucasagomesalso https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ilo/common.py#L26216:13
lucasagomesdevananda, yeah, that's not ideal16:13
lucasagomesbut not worse than it was before too16:13
*** rameshg87 has left #openstack-ironic16:14
devanandaanyone know if Syed is on IRC?16:14
devanandaI dont think I know his/her handle16:14
lucasagomesramineni (I think)16:15
lucasagomeshe was the one pinging us to take a look at those patches16:15
devanandawanyen: ping16:15
* devananda files a new bug16:16
devanandadtantsur: https://bugs.launchpad.net/ironic/+bug/1367182 isn't invalid just because we're in feature freeze16:17
devanandadtantsur: it's still a bug, and actually, a fairly bad one IMHO16:19
dtantsurdevananda, I put it as "invalid" because we're decided some time ago to have a good talk about credentials unification16:21
devanandadtantsur: sure - but "we'll talk about how to fix this later" doesn' tmake the current problem invalid16:21
*** christopheraedo has quit IRC16:21
devanandathat the iLO driver also requires IPMITool's credentials is a bug, IMO16:22
devanandathey've proposed a solution in this bug report so that, from a user POV, it won't16:22
devanandaand so that, if we do consolidate credentials in teh future, this will also make that easier and not break existing users16:22
dtantsurdevananda, yeah, it's a complex thing. I just didn't want the reporter to end up with proposing patch and hear "no, please not now and not that way"16:23
dtantsurdevananda, then we need to change both credentials to just 'username' and 'password'16:23
NobodyCamlucasagomes: your looking at the has ring stuff?16:23
lucasagomesNobodyCam, yup16:23
dtantsurdevananda, it would be the start of consolidation, but without a spec and an agreement16:23
lucasagomesNobodyCam, well, I'm first looking at how I'll bound nodes to conductors, and get a delta of what changed when it comes to rebalance it and trigger take_over on the nodes that have been affected16:24
NobodyCamI addeda couple of old patches to the etherpad16:24
devanandadtantsur: sure, that's a valid point.16:24
lucasagomesNobodyCam, greg ones? will take a look16:24
lucasagomesthanks!16:24
dtantsurdevananda, honestly I never know what to do with this kind of bugs :( and I'm seeking your guidance16:24
lucasagomesNobodyCam, ohh no no I'm not looking into it16:25
dtantsurdevananda, how to say "right, but please don't take actions w/o spec and an agreement"16:25
NobodyCamahh ok :)16:25
lucasagomesNobodyCam, I'm looking more into https://bugs.launchpad.net/bugs/135551016:25
devanandadtantsur: in those cases, the mailing list is probably the best answer16:25
lucasagomesNobodyCam, but that hash ring problem affects it because if it have to move a lot of nodes around the take over is more costy16:26
devanandadtantsur: since that hits a wider audience and gives people in different timezones the opportunity to participate16:26
dtantsurwell yeah, maybe16:26
devanandadtantsur: I'm at fault for not using the ML enough16:26
* lucasagomes also needs to use ML more/better16:26
dtantsurdevananda, right, we didn't have any serious holy war on ML! Something to fix in K cycle :)16:27
devanandadtantsur: haha! yes :)16:27
*** christopheraedo has joined #openstack-ironic16:28
jrollhahaha16:32
*** r-daneel_ has quit IRC16:33
*** openstackgerrit has quit IRC16:35
*** romcheg has quit IRC16:35
devanandalucasagomes: i'm pushing other distractions aside for a bit, if you're still around and want to chat about the hash ring16:36
lucasagomesdevananda, yeah I'm here, I'm investigating it yet... trying to make some assumptions16:37
lucasagomesdevananda, but sometimes I think that another way to solve it for the pxe driver specifically16:37
lucasagomeswould be to generate the configs on the fly16:37
devananda?16:37
lucasagomes(it's possible with ipxe)16:37
devanandawhich configs16:37
lucasagomespxe config16:37
JayFah, like you'd have the pxe config come from http://ironic-api/some/path/ipxe16:37
lucasagomesand make the pxe driver stateless16:37
lucasagomesJayF, yes16:38
lucasagomesI'm think about the short term (tho that's a good solution)16:38
lucasagomesso we can be able to fix it in J rc216:38
devanandalucasagomes: stateless? go on16:39
lucasagomesdevananda, yeah... the boot process of ipxe is scripted, so we can make it do a call to the ironic api when it's booting passing the mac address16:40
lucasagomesthe ironic get the mac and find the node16:40
lucasagomeslook at the provision_state of the node16:40
lucasagomesif it's DEPLOYWAIT for e.g the deploy ramdisk should be booted16:40
lucasagomesso we tell the ipxe script to boot it16:41
lucasagomesif it's ACTIVE we tell the ipxe script to boot the image ramdisk16:41
devanandathat'd remove the dependency on neutron16:41
devanandasince we wouldn't need the DHCP service to respond with the IP address of a specific conductor16:41
lucasagomesso we don't keep config files locally16:41
lucasagomesand have to regenetated it etc...16:41
JayFIf this were implemented16:42
lucasagomesdevananda, thing is... we still need to bootstrap from normal pxe to ipxe in some cases16:42
JayFI'd suspect we'd move our production over to use these, because it's awesome16:42
lucasagomesso neutron is needed for that bit16:42
JayFlucasagomes: you can do that with a simple static dhcp config16:42
jrollJayF++16:42
JayFlucasagomes: I love this because you're detaching the dhcp from the dynamic stuff16:42
devanandawe would need ipxe to fetch the boot config from the Ironic API service, which, of course, would be load balanced, and could point the rest of the iPXE script to any conductor at that time16:43
JayFlucasagomes: I want Ironic to be able to tell the node things when it boots without having to own the dhcp server...and this would do it16:43
lucasagomesJayF, yup!16:43
jrolllucasagomes, devananda, this will also help support rescue mode :)16:43
devanandalucasagomes: the dhcp service would need to respond to teh PXE boot request with the iPXE kernel location, yes, but taht's static -- not dynamic per MAC address16:43
jroll(I think)16:43
lucasagomesdevananda, yeah, that's static16:44
devanandalucasagomes: this sounds great. it's a massive change this late in the cycle, tho :(16:44
lucasagomesbut this does not solve the *general* take over problem16:44
lucasagomeswhich is intent to be generic16:44
lucasagomestake_over still not being called when the ring is rebalanced for the nodes affected16:44
lucasagomesdevananda, yeah :(16:44
JayFlucasagomes: something like this could even be used in IPA itself... we've talked about (me and jroll) making the ramdisk image mostly static... where for CoreOS ramdisk users, they'd just run a "stock" coreos pxe image, and be fed a cloud-config.yml via kernel command line on boot that tells it to download and extract IPA along with all the needed deps16:44
lucasagomesdevananda, JayF should I write a spec about it for K16:45
lucasagomesif u guys are interested I think it's a good addition I can work on it16:45
JayFVery very yes16:45
devanandalucasagomes: +10016:45
JayFplease make it generic enough that ipa can use it as well16:45
*** jistr has joined #openstack-ironic16:45
lucasagomesack I will ;) /me writes it down16:45
JayFand maybe even a mechanism for dynamically generating OTHER configs would be useful too16:45
lucasagomesJayF, oh yeah, sure I will try to be as generic as possible16:45
devanandaI'm wondering if there's ever another need for takeover to rebuild local state16:46
lucasagomesdevananda, maybe for other drivers... I think take cover is cool16:46
devanandaif configs are generated on the fly by the API service, rather than in-advance16:46
lucasagomesbut I can't see how to make it not being so costy16:46
JayFthe only thing is16:47
lucasagomeswithout having to loop around loads of nodes16:47
JayFfor non-ipxe users16:47
JayFyou can't generate the config on the fly16:47
lucasagomesyeah16:47
devanandaright16:47
JayFbecause it has to be tftp'able16:47
lucasagomesthat's also ^16:47
JayFThat being said who's in for deprecating PXELINUX support16:47
lucasagomesI'd like also to make ipxe default if possible16:47
devanandayea, for hardwar that doesn't support ipxe ...16:47
JayFo/16:47
devanandadoes that exist? :)16:47
lucasagomesI don't see reason why use PXE16:47
lucasagomesJayF, +116:47
JayFdevananda: you can bootstrap any UNDI-supporting hardware into ipxe16:47
lucasagomesdevananda, if it doesn't support iPXE it can bootstrap the image16:47
lucasagomesfrom the dhcp server16:47
devanandaright16:48
lucasagomesyeah like JayF said, but with more specific terms16:48
JayFiPXE also has some more hardware-specific ROMs16:48
NobodyCamdidn't we have a spec fir just that?16:48
JayFbut those are generally used for flashing on the chip16:48
JayFI don't forsee a case where a standard pxelinux.0 rom would work that an ipxe undi rom wouldn't16:49
lucasagomesNobodyCam, deprecating PXE? not that I know16:49
JayFNobodyCam: lucasagomes added support for ipxe, but optional and I don't even think default support16:49
devanandaAIUI, the iLO driver stores its images in Swift, so also doesn't need local state16:49
lucasagomesdevananda, yeah, ipxe can boot from http16:50
NobodyCamack that was it16:50
lucasagomesso we could just pass the url16:50
lucasagomestemp url*16:50
JayFwe boot from http using ipxe all the time :)16:50
lucasagomesand boot from that too, and avoid caching locally16:50
*** romcheg has joined #openstack-ironic16:50
lucasagomesthe downside I see is that, we would depend on a http server to be up and running (just like we now depend on a tftp server)16:50
devanandalucasagomes: that's an improvement, IMO16:51
JayFIronic /is/ an http server16:51
devanandahttp is much more reliable16:51
NobodyCamjbjohnso__: was in support of aways chain loading ipxe thru pxe16:51
NobodyCamif I recall correctly16:51
JayFlucasagomes: I don't think you should depend on ANOTHER http server16:51
lucasagomesJayF, oh yeah... that's also, because now I put the images on a HTTP server16:51
devanandaJayF: though fwiw, i don't want our API server to take on image streaming  ...16:51
lucasagomesbut with the use of swift16:51
JayFlucasagomes: ironic already has an http api; why shouldn't these just be capability urls?16:51
lucasagomeswe don't need another anymore16:51
lucasagomesJayF, +1! u right16:51
JayFdevananda: I agree, but this is a simple config file in this particular case :) If people need images they should talk to glance or swift16:52
devanandaJayF: because then it also has to take on receiving and storing those images16:52
devanandaJayF: right - swift16:52
JayFwhat images are you talking about?16:52
*** pensu has quit IRC16:52
lucasagomesdevananda, JayF all that together is a lot of work... I see at least 2 bps here... 1 to make iPXE default. Then another implementing the generation of the config files and using swift etc16:52
JayFwe're talking about a text file that'd likely be five lines16:52
devanandaJayF: don't you guys have a swift cluster or something already? :p16:52
JayFand generated on the fly16:53
devanandaJayF: oh, no -- THAT config file absolutely should be served by ironic-api16:53
JayFthe ipxe image has to be served over tftp, if that's what you mean16:53
devanandaJayF: I meant the actual image endpoint, which should also be fetched over http instead of tftp16:53
JayFbecause it has to be bootstrapped in using the normal pxe process unless you flash your own nic16:53
JayFdevananda: I missed something, because I'm not sure where images came into play in the conversation?16:54
lucasagomesyeah the ipxe image should be served by tftp16:54
devananda16:49:26 < devananda> AIUI, the iLO driver stores its images in Swift, so also doesn't need local state16:55
devananda...16:55
devananda16:50:53 < lucasagomes> the downside I see is that, we would depend on a http server to be up and running (just like we now depend on a tftp server)16:55
lucasagomestho, if all ur hardware already support iPXE we can make it optional16:55
devanandaJayF: that section of conversation16:55
JayFAh, okay, gotcha. Absolutely those belong and go into swift :)16:55
devananda:)16:55
devanandaso, to summarize16:55
devananda- tftp still needs to serve the iPXE ROM (since we can't require all operators to flash that into firmware)16:56
devananda- deploy and user kernel and ramdisk images can be fetched over HTTP (from swift) rather than over TFTP16:56
*** harlowja_away is now known as harlowja16:56
*** derekh has quit IRC16:56
devananda- iPXE config should be served by ironic-api, making it dynamically-generatable, and removing the need to maintain it as local-state on a given conductor16:56
lucasagomesyeah16:57
JayFbingo, this is great16:57
lucasagomesand we have to think about what to do with take_over() :)16:57
devananda- then, outside of the times where a conductor has a Task *lock* on a node, there is no dependency between a given node and a given conductor16:57
lucasagomesyeah, for the drivers we have now in tree it sounds correct16:58
lucasagomesI still see take_over() as a valid operation tho16:58
lucasagomesI don't think we should dump it...16:58
devananda(though, if conductor 1 starts a deploy, and conductor 2 continues it, c2 may need to fetch the user image from glance at that point in time)16:58
* lucasagomes just can't think about how to make it a light operation16:59
lucasagomesdevananda, yeah to write it to the disk16:59
devanandaI think the above could become *the* PXE implementation, and the same processes should work for IPA17:00
devanandaalong with the refactoring of the deploy vs boot mechanism17:00
lucasagomesyeah it would be pretty good indeed, I will start a spec about it17:00
devanandawe end up with a PXE boot driver that is shared by both17:00
devanandaand an iSCSI deploy + an Agent deploy17:00
devanandaJayF: yes?17:00
lucasagomesyeah, good point17:00
lucasagomesthat separation of the boot interface would be great to happen as soon as possible when K opens17:01
JayFone note: I'd call it the iPXE driver, simply because it's more accurate and avoids overloading "PXE" any more in Ironic :)17:01
devanandaJayF: fair point17:01
JayFtelling people how the agent pxes is sometimes like doing a whos on first skit17:01
devanandaheh17:01
lucasagomesdevananda, JayF you guys want a session about it in paris?17:02
devanandalucasagomes: yes17:02
lucasagomesor we are pretty much in agreement and it's not needed?17:02
JayFwe are three :)17:02
lucasagomesheh17:02
devanandaeven if we are in agreement, it needs a session17:02
JayFI can pretty much say jroll would be in too because he's been wanting this for a while :P17:02
lucasagomesack ok17:02
lucasagomesI will propose that then17:02
* lucasagomes writes everything down to not forget17:02
devanandait's a fairly major change in the default driver - even if everyone agrees that it's good, we will need community awareness17:03
jroll?17:03
* jroll reads17:03
lucasagomesdevananda, indeed17:03
jrollJayF++ do want17:03
*** rwsu has quit IRC17:03
lucasagomesdevananda, btw, maybe we even should start a new driver as JayF said17:03
lucasagomesiPXE driver17:03
lucasagomesinstead of making it as we do today, PXE and IPXE (changing a config)17:03
devanandaconsidering our need to support existing users, give them time to migrate, etc17:03
devanandayep17:04
devanandawe can't delete or suddenly change teh functionality of an existing driver17:04
lucasagomesyeah17:04
lucasagomesright17:04
lucasagomesdevananda, so, for J17:04
lucasagomeswhat we do with the take_over()17:04
lucasagomes?17:05
*** rwsu has joined #openstack-ironic17:06
lucasagomesI mean, anyone... ideas?17:06
*** rushiagr is now known as rushiagr_away17:08
*** todd_dsm has joined #openstack-ironic17:10
devanandahackish idea - simple periodic task that refreshes the local ring17:11
devanandawell, not so hackish, i mean, i think that's what i wanted to do originally :)17:12
lucasagomesright, yeah minimize the problem17:13
lucasagomesmaybe for J we should really work on the rebalancing problem of the hash ring17:13
lucasagomes+ that periodic task17:13
lucasagomesit's not perfect but it's seems reasonable for the time we have17:14
NobodyCambrb .... quick walkies17:14
devanandathe redistribution is just silly, and probably my fault17:14
devanandai only tested it with small rings, at which scale that doesn't really show up17:14
devanandai didn't test the distribution of a ring with 10k conductors :(17:14
lucasagomesdevananda, well, we reviewed that, so it's everyone's fault :)17:14
lucasagomesalright, I will think about it tomorrow a bit more17:16
lucasagomesit's late here and I'm hungry17:16
lucasagomeshave a good night everyone17:17
lucasagomesdevananda, last thing... we don't know how many slots we have for the design summit yet do we?17:17
romcheggnight lucasagomes!17:17
romchegAnd good evening too :)17:17
lucasagomesromcheg, night :)17:17
romchegHi everyone17:17
devanandalucasagomes: nope17:17
devanandaromcheg: hi!17:18
devanandalucasagomes: g'night! I'll update the etherpad as I go.17:18
devanandaoh - I'm giogn to be offline most of tomorrow17:18
lucasagomesalright thanks!17:18
devanandapulled into a meeting in sunnyvale...17:18
lucasagomesdevananda, oh ok... I will try to start a spec about the iPXE stuff we talked, and a presentation for the design summit17:18
romchegHope after I fix all red tape here I'll be able to spend some time with you17:18
lucasagomesdevananda, alright :) enjoy the meeting there17:18
lucasagomesdevananda, you should go to that bar with the pool table, oasis!17:19
lucasagomesthat was a cool bar17:19
*** lucasagomes is now known as lucas-dinner17:20
NobodyCamnight lucas-dinner17:22
NobodyCamhey romcheg :)17:22
romchegHi devananda, NobodyCam!17:23
NobodyCamhey romcheg how's the NEW pad?17:23
romchegNobodyCam: Well, not bad at all except I'm not in the upstream now17:24
NobodyCam:/17:25
*** igordcard has joined #openstack-ironic17:25
*** openstackgerrit has joined #openstack-ironic17:25
romchegBut here I'll have more free time so I plan to spend some time with you as soon as I manage to deal with all red tape for me and my wife17:25
NobodyCam:)17:26
*** harlowja has quit IRC17:27
romchegNow I barely manage to do my paid job because of that :)17:27
*** harlowja has joined #openstack-ironic17:27
NobodyCam:(17:27
*** dtantsur is now known as dtantsur|afk17:28
NobodyCamdevananda: anything need covering when you in sunnyvale?17:28
romchegmedical exams, apartment, n+1 different registrations, taxes — that's what every immigrant has to do during their first days17:29
NobodyCamromcheg: gah,17:29
dtantsur|afkromcheg, oh yeah, it's all fun17:29
romchegdtantsur|afk: you know what I mean :)17:30
dtantsur|afkthough I still have to deal with taxes next year17:30
dtantsur|afkromcheg, do you at least know the language people around use?17:30
romchegdtantsur|afk: I undertand Polish but don't speak it. So I use Ukrainian + improvisation to convert it to Polish. It's not very hard :)17:31
dtantsur|afkromcheg, heh better than for me, I understood nearly no Czech back then17:32
*** dtantsur|afk is now known as dtantsur|nearly-17:32
NobodyCamlol that sounds like a utube video in the making17:32
*** dtantsur|nearly- is now known as dtantsur|nearlya17:32
Shrewsdevananda: so, RC's should start being proposed beginning tomorrow?17:32
Shrewshttps://wiki.openstack.org/wiki/Juno_Release_Schedule17:32
*** dtantsur|nearlya is now known as dtantsur|afk17:32
dtantsur|afkok afk for real, see you17:33
rloociao dtantsur|afk17:33
romchegdtantsur|afk: bye17:33
JayFShrews: aiui, from what's been said in channel, we're not supposed to cut an RC until any known bugs we'd be comfortable releasing with are gone17:34
JayFShrews: so I think we're waiting for a hash ring fix before cutting rc1 but imbw17:34
*** marcoemorais has joined #openstack-ironic17:35
ShrewsJayF: devananda: i ask b/c one of our targeted bugs, 1271317, is assigned to mrda and he's still on his extended vacation. just wondering about that one17:35
NobodyCamhave a good night dtantsur|afk17:35
Shrewsreading through the bug, doesn't seem like a quick fix17:36
JayFShrews: I think that was being talked about in here yesterday, the guy who works on our wsme middleware added a patch allows choosing xml/json17:36
JayFbut i think the problem was seeing if we could get that in global reqs17:36
ShrewsJayF: oh! i missed that17:36
JayFif you log the channel there was a good amount of chatter about it yesterday17:36
JayFand you're better off reading it than getting it through a jay-filter17:37
Shrews/disable filter jay17:37
devanandaShrews: yea. I was just updating that bug17:37
devanandaShrews: the fix in wsme is small, and we could easily patch ironic to remove XML fromthe API ... IF we could require the latest release of WSME17:38
devanandaShrews: which we can't :(17:38
devanandabecause it's too late in the release cycle17:38
devanandaso, we failed to address that in time, and will have to fix it in K17:39
Shrewsdevananda: ack. thanks for the summary17:39
devanandaas a still-incubated project, we can't requset a change to global requirements the day before other priojects cut their RC's17:39
devanandaand the fix to WSME hasn't actually landed yet anyway17:39
devanandafwiw: https://review.openstack.org/#/c/123792/17:40
devanandaand https://review.openstack.org/#/c/123520/717:40
Shrewsoh nice17:41
devanandabug updated17:42
devanandaso besides the hash ring bugs, there are only two left17:43
devanandaAPI translation (jroll?)17:43
devanandadrivers raising non-ironic exceptions (rloo?)17:43
rloodevananda: in meeting right now. (and i need to listen). in 30 min.17:44
devanandanp17:46
jrollhi17:48
jrolldevananda: need that done today, I guess? did you decide how large of an impact that is?17:49
NobodyCamhello jroll :>17:49
jrollheya :P17:49
*** jcoufal has quit IRC17:51
*** openstackgerrit has quit IRC17:51
*** openstackgerrit has joined #openstack-ironic17:53
devanandajroll: I agree the impact is relatively minor. we can bump it (and unassign it?) if you're not working on it17:57
jrolldevananda: I'm not actively working on it, can be, would prefer not to be right this minute17:57
Shrewsdevananda: jroll: i can take a stab at that one, but can't promise i can figure it out in time for RC. not sure yet how to fix it.17:58
devanandalet's bump it17:59
jrollShrews: I think the way to go is, enable lazy translation, translate it at the last minute in the error handling middleware17:59
devanandait will be an inconvenience to multi-language teams, but not prevent any functionality18:00
NobodyCamoh jroll did you get the ipa dib element to work?18:00
*** todd_dsm has quit IRC18:01
jrollNobodyCam: no, nothing in the console logs :(18:01
NobodyCam:(18:02
*** andreykurilin_ has joined #openstack-ironic18:13
NobodyCamJayF: question on the "Experimental" tag for drivers idea18:16
JayFNobodyCam: yeah, this is the thing we talked about some at the midcycle18:16
JayFNobodyCam: what's the ?18:16
*** jistr has quit IRC18:16
NobodyCamI really like mordred's idea of positive tags. like "production ready18:17
NobodyCam"18:17
NobodyCamwhat are your thoughts on switching htat around18:17
jroll++18:17
jrollalso, we saw how well the experimental tag worked for nova-bm18:17
JayFI think we should be very careful what we name it18:18
JayFbut I don't care at all if it's a negative tag or a positive tag18:18
JayFas long as a deployer would have to do an extra step, that's not part of our standard howtos, to use a driver that we generally wouldn't trust18:18
jrolloh, is that the goal?18:19
jrollwhat's the extra step?18:19
NobodyCamthey already have to add the driver to the conf file18:19
NobodyCamto enable it18:19
JayFjroll: use_untested_drivers = true18:20
JayFjroll: or something like that18:20
jrollwat18:20
jroll:/18:20
*** krtaylor has quit IRC18:20
jrollthat's kinda lame18:20
JayFjroll: you're a deployer. Right now how do you know that ipmitool and not impinative is the usual driver people use18:20
JayFfwiw this was talked about at the mid-cycle and everyone seemed to like the idea then :)18:21
jrollwell. there's nothing right now that says either of those exist, afaik18:21
jrollother than wiki pages18:21
jrollmaaaaaaaybe docs, but I don't think so18:21
jrollso I would try to figure out "what drivers can I use"18:21
jrollgoogle "ironic drivers"18:22
jrollfind the wiki page with all drivers, driver status, etc18:22
NobodyCamI think I would rether have non-production ready drivers log a simple "this driver is not tested in production enviroments"18:22
jroll(and testing/CI/deployment info)18:22
jrollNobodyCam: as if anyone reads the conductor startup spam :P18:22
NobodyCamthats another battle18:23
NobodyCamlol18:23
JayFjroll: NobodyCam: I just think about the mysql client option of --safe-updates (it's the default)... what's the opposite option (to disable it)? --i-am-a-dummy18:24
jrollthis isn't about "we will slaughter your data"18:25
jrollthis is about "this might not work perfect" or "this hasn't been run at scale"18:25
*** krtaylor has joined #openstack-ironic18:25
jrolldo we think nova deployers just point at a random driver and decide to use that?18:25
jrollor do they evaluate the list of drivers and try to make an informed decision?18:26
NobodyCamjroll: + the down side if a poor driver is selected by the operator is that they have to change the driver18:26
*** zigo has quit IRC18:26
jrollwhy should I have to change two config options to use the drac driver?18:26
jrollNobodyCam: right, but that's 10 seconds on the db server18:27
JayFjroll: I think there's a huge difference there; most people will choose their hypervisor before possibly even choosing nova18:27
jrollI'm highly in favor of marking drivers prod ready or not; I don't see the use in making folks take an extra step to use them18:27
jrollJayF: sure18:28
JayFNobodyCam: jroll: No, if a poor drivver is selected by the operator, they'll say "Ironic sucks" and go use something else because we didn't make it clear which ones we know haven't been well tested18:28
jrollthere's also the issue of not having much driver overlap18:28
JayFwe have tons of driver overlap18:28
devanandaJayF: I dont think that's all that different18:28
NobodyCamyep and thats really how I see https://github.com/openstack/ironic/blob/master/etc/ironic/ironic.conf.sample#L220 getting used18:28
JayFespecially in power drivers18:28
jrollNobodyCam++18:28
*** zigo has joined #openstack-ironic18:28
jrollenable prod-ready by default18:28
jrollfolks change that as needed18:28
devanandai think operators are likely to choose drivers based on two things18:29
devananda- i already have hardware. does this driver work with it?18:29
devananda- i'm buying new hardware specifically for use with ironic. what does my vendor recommend?18:29
devanandathe second case is up to the vendor. hopefully hp, dell, and ibm are giving their customers good advice (and good drivers!)18:29
devanandathe first case is where the community is "responsible"18:30
devanandaI put that in quotes because we can't dictate what the user/operator will do, but we should give them sane defaults and good suggestions18:30
devanandawhich I think we do, today18:30
devanandapxe_ipmitool18:30
devanandait's the most tested right now18:30
NobodyCamdevananda: ++ yes!18:30
JayFI'm OK with turfing the experimental drivers thing if you guys think that's a better approach18:30
devanandaif an operator is going to change the config options, they should do some research into /why/ they're changing them18:30
devanandaturfing?18:31
NobodyCamside-lining?18:31
devanandafor now, I'd leave them all installed, but not enabled by default18:31
JayFkilling, getting rid of, going to the big whiteboard in the sky18:31
jrollJayF: we should still discuss it at the summit18:31
devanandaJayF: eh?18:31
*** lsmola has quit IRC18:31
jrollas far as how we want to do it18:31
devanandawhcih one(s) are experimental?18:31
JayFturfing == killing the idea :)18:31
devananda*do you see as ..18:31
*** lsmola has joined #openstack-ironic18:31
JayFWhen we mentioned this at the mid-cycle, we specifically called out the iboot, seamicro, and ipminative drivers18:32
JayFobviously ipminative has CI now so that's a different ball of wax18:32
jrolldevananda: I think he's talking about killing that summit session, not the drivers :P18:33
devanandajroll: oh.18:33
JayFOh yeah that's exactly what I meant18:33
JayFhah18:33
devananda:)18:33
* devananda goes back to trying to write PTL email18:34
jrolllol18:34
*** marcoemorais has quit IRC18:34
*** marcoemorais has joined #openstack-ironic18:35
*** marcoemorais has quit IRC18:36
*** marcoemorais has joined #openstack-ironic18:37
NobodyCamlol... Shrews did you see this: https://github.com/openstack/ironic/blob/master/ironic/db/sqlalchemy/alembic/README#L6-L718:37
* NobodyCam is now even more confizled by the stamp cmd18:37
*** marcoemorais has quit IRC18:37
*** marcoemorais has joined #openstack-ironic18:37
*** marcoemorais has quit IRC18:38
jrollseems like stamp is for when you mess up18:38
*** marcoemorais has joined #openstack-ironic18:38
rloodevananda: wrt drivers raising non-ironic exceptions. There are two patches:18:40
rloodevananda: 1. https://review.openstack.org/#/c/122224/. The agent driver. No one has reviewed it recently.18:40
rloodevananda: 2. https://review.openstack.org/#/c/122526/. Changes to conductor. This one needs more discussion. Technically, it isn't part of the bug though.18:40
rloodevananda: so if patch 1 is approved, I would be comfortable saying the bug was addressed.18:41
*** pcrews has quit IRC18:42
devanandarloo: fantastic. thank you for the summary!18:46
devanandajroll: I think 122224 needs your eyes18:46
rloodevananda: yw ;)18:46
NobodyCamdevananda: TY for the notes on the hash ring etherpad18:47
jrollrloo, devananda, reviewed, left a -118:51
jrollrloo: not sure about my first comment there tbh, it might be valuable18:51
* rloo looks18:52
jrolldevananda: folks shouldn't be afraid to review agent code, btw :)18:52
*** marcoemorais has quit IRC19:00
*** marcoemorais has joined #openstack-ironic19:01
adam_gdevananda, follow up from meeting: any objection to removing check-tempest-dsvm-ironic-pxe_ssh-nv from stable/icehouse? it hasn't been passing in forever, and is using up precious gate resources19:09
devanandaadam_g: i'm sad about that not passing. i thought we had proposed fixes for that?19:09
devanandaadam_g: which, btw, I can not approve19:09
ShrewsNobodyCam: i did not19:10
adam_gdevananda, im not aware of any fixes for it?  i dont think tempest folk would be receptive to the kind of special casing we'd need to do to deal with differing APIs between branches19:11
*** coolsvap is now known as coolsvap|gone19:13
devanandaadam_g: yea... we would need a feature test for that, and some way to expose it, backported, etc, etc.19:14
devanandaadam_g: ok, i'm convinced19:14
*** marcoemorais1 has joined #openstack-ironic19:14
adam_gwe could possibly add a periodic job to test the baremetal scenario tests against stable/icehouse, just to have some level of confidence that it still works19:14
devanandaadam_g: how are other projects notifying themselves of periodic job results?19:15
*** marcoemorais has quit IRC19:15
adam_galtho, i dont even know if the scenario would pass. IIRC rebuild wasnt fixed until this cycle19:15
adam_gdevananda, just email on failures19:15
* NobodyCam calls the local dmv and enters the black hole of phone systems19:15
mgagneIs anyone running Ironic with Nova cells? If yes, at which level are you running Ironic? Api cell or Compute cell? Do you need a dedicated Ironic installation per compute cell?19:16
jrollmgagne: \o19:16
jrollmgagne: here's what we have:19:16
mgagnejroll: (go way!)> \o   =)19:16
jroll(as I understand it)19:16
mgagneaway*19:17
jrollglobal cell -> region cell -> ironic cell19:17
jrollit's a nova-api cell19:17
mgagnewhich one is an api cell ?19:17
jrolland I presume you need an ironic per cell, idk, we're only running it in one cell19:17
jrollthe ironic cell19:17
jrollhas everything from nova-api to ironic-conductor19:17
jroll(including scheduler, compute, etc)19:17
*** ChuckC has quit IRC19:18
*** athomas has quit IRC19:19
mgagneok, so what is normally a compute cell is running nova-api and has a dedicated ironic installation. How is nova discovered by Ironic?19:19
jrollnot sure if I understand the question, sorry :/19:20
mgagneand the million dollar question: what about N ironic installations in the same region?19:20
jrollnova is pointed at ironic19:20
jrollwe don't have that (yet) but we expect to just spin up identical cells19:20
mgagnejroll: hmm, might be my misunderstanding of Ironic inner working. Nova knows about Ironic but not the other way around right?19:21
jrollcorrect19:21
*** loki184 has quit IRC19:21
mgagnejroll: how does Nova discovers Ironic? With the catalog or is the API url "hardcoded" in nova.conf?19:22
mgagnejroll: nova.conf: [ironic]/api_endpoint19:23
mgagnejroll: will do my homework first =)19:23
jrollit can be both iirc19:23
jrolls/both/either19:23
jrollactually, it can be either, I fixed a bug with making it work in nova.conf :)19:23
jrollmgagne: ^19:23
devanandajroll: I don't see any discovery of the endpoint in nova/virt/driver/irnoic/client_wrapper.py19:25
jrolldevananda: I think it's in the client19:25
* jroll will look in a second19:26
devanandajroll: the client_wrapper passes ironic_url=CONF.ironic.api_endpoint in every case19:26
jrolloh, does it? huh19:26
jrollok, thanks for correcting me, I must be thinking of something else19:26
devanandaoh - that has no default19:26
jrollmaybe ironicclient looks at keystone if it's not provided19:27
jrollor if it's None, I should say19:27
devanandalooking in the client ...19:27
devananda 97         endpoint = kwargs.get('ironic_url') or \19:27
devananda 98             _get_endpoint(_ksclient, **ks_kwargs)19:27
jrollyeah19:27
devanandajroll: so i think you're correct :)19:27
mgagnejroll: so the ironic driver in nova has the ironic api endpoint "hardcoded" (not auto-discovered). http://docs.openstack.org/developer/ironic/deploy/install-guide.html19:27
jrollmgagne: ironicclient will discover it if it is None19:28
devanandamgagne: after looking at the code, i think it will default to autodiscover from keystone (eg, if you dont set the CONF option)19:28
jrollbut, I don't trust service catalogs because $reasons19:28
devanandajroll: i want us to default to using keystone for discovering all the endpoints, fwiw19:28
devanandajroll: including glance, swift, etc19:28
jrolldevananda: default is fine19:28
devanandajroll: and i fully support you overriding that :)19:28
jrolldevananda: I'm sure you've heard about the rackspace service catalog :)19:28
jrolland how great it is19:29
mgagnejroll: where you have to go through hoops to manage to access glance service? =)19:29
jrollmgagne: that's one thing, yeah19:30
adam_gironic will also use keystoneclient directly to get the ironic API URL for purposes of ramdisk19:30
mgagnejroll: who should I poke to get it fixed?19:30
NobodyCamwow DMV employee was very helpful! /me is shocked19:30
jrollmgagne: to get our service catalog fixed?19:30
mgagnejroll: I suppose19:31
jrollmgagne: probably taylor rhodes at this point19:31
jroll(mostly kidding)19:31
jrollmgagne: we're... working on things19:31
jrollkeystone, first19:31
mgagnejroll: is it really called keystone internally? =)19:32
russell_hthe thing we run isn't called keystone19:32
jrollmgagne: ha, no, I meant deploying keystone19:32
russell_hbut we're deleting that and switching to keystone19:32
jrollrather than what we run19:32
mgagne*wink* *wink*19:33
openstackgerritRuby Loo proposed a change to openstack/ironic: Don't reraise Exceptions from agent driver  https://review.openstack.org/12222419:37
*** lazy_prince is now known as killer_prince19:38
rloojroll: see if I answered your questions/concerns: https://review.openstack.org/122224.19:44
*** openstackgerrit has quit IRC19:46
jrollrloo: +2, thanks19:47
rloothx jroll!19:47
*** openstackgerrit has joined #openstack-ironic19:48
*** pcrews has joined #openstack-ironic19:50
*** coolsvap|gone has quit IRC19:51
*** ChuckC has joined #openstack-ironic19:54
*** marcoemorais1 has quit IRC20:04
*** marcoemorais has joined #openstack-ironic20:04
*** marcoemorais has quit IRC20:05
*** marcoemorais has joined #openstack-ironic20:05
JayFmgagne: I think our glance api is public?20:06
mgagnejroll: how many cells level do you guys have? I see you mentioning a global cell, would it be like an api cell in IAD? or is the api cell region agnostic?20:06
JayFmgagne: "global" is in a region20:06
JayFmgagne: so we have a "global" nova api in IAD, ORD, DFW, LON, etc20:07
JayFmgagne: OnMetal / Ironic is deployed as one of the cells (alongside normal compute cells)20:07
mgagneJayF: and what jroll referred to as a region cell is in fact a "zone" in the region?20:07
jrollmgagne: oh yeah, listen to JayF, I wasn't braining well when I said that20:07
jrollmgagne: it's two levels, global (region) and onmetal20:07
mgagneJayF: I once managed to authenticate against Glance but now, it's 401 all the time. :-/20:07
JayFmgagne: if it's publically hittable, it should be somewhat publically usable20:08
mgagnejroll: your brain fart is excused20:08
jrollJayF: our glance doesn't work very well out of the box with standard glance client20:08
JayFah20:08
JayFI think russell_h might have gotten a working one once though20:08
jrollyeah20:08
jrollso did monty20:08
jrollit took him a whole weekend20:08
JayFWe should put that in a devops blog post20:09
jroll(turns out you need to specify the version as v2)20:09
JayFif it's hard to do and we can do it20:09
jroll(and the registry doesn't have the right url)20:09
jrollJayF: maybe we should just make our glance endpoint work like the rest of openstack :/20:09
JayFjroll: I can't do that; I can write a blog post20:09
mgagneJayF: someone wrote a blog post about it but lost it20:10
mgagneJayF: found it, I used the API key instead of my user password.20:15
jrollyeah, that's another one20:16
*** marcoemorais has quit IRC20:18
*** marcoemorais has joined #openstack-ironic20:18
*** marcoemorais has quit IRC20:18
*** marcoemorais has joined #openstack-ironic20:18
* devananda posts nomination to ML20:28
* devananda gets more coffee20:28
NobodyCam:)20:28
jrollbout time :P20:30
devanandaI know :(20:35
* rloo wonders what would happen if no one ran for PTL20:35
JayFlast cycle's PTL wins by fiat?20:35
jrollheh20:36
jrollI'm sure someone would swoop in last minute20:36
JayF"You're the PTL again whether you like it or not, mister"20:36
jrollheh20:36
devanandarloo: I don't see any indication of it in http://git.openstack.org/cgit/openstack/governance/tree/reference/charter.rst#n9920:37
devanandarloo: which probably suggests that it hasn't actually come up before outside of theoretical discussions20:37
*** dprince has quit IRC20:37
rlooooooo. too bad you submitted something devananda. could have made history...20:38
devanandaheh20:38
devanandarloo: i'm OK making other kinds of history :)20:38
rloo:D20:38
*** dividehex has quit IRC20:44
NobodyCamdevananda: all kidding aside. that is a very good email !20:45
devanandaty20:45
NobodyCamno no Thank you :)20:45
NobodyCambrb20:45
*** dividehex has joined #openstack-ironic20:47
jroll+120:52
* NobodyCam has found a leak in his roof and must go and try to fix... bbiab20:57
*** marcoemorais has quit IRC21:06
*** marcoemorais has joined #openstack-ironic21:06
*** marcoemorais has quit IRC21:07
*** marcoemorais has joined #openstack-ironic21:07
*** marcoemorais has quit IRC21:08
*** marcoemorais has joined #openstack-ironic21:10
*** marcoemorais has quit IRC21:10
*** marcoemorais has joined #openstack-ironic21:10
*** marcoemorais has quit IRC21:11
*** marcoemorais has joined #openstack-ironic21:11
* NobodyCam hopes he has "fixed" his leak21:11
davidlenwellNobodyCam: is the sky falling ?21:14
*** linggao has quit IRC21:17
*** jjohnson2 has quit IRC21:25
NobodyCamit has been raining a bit here21:30
NobodyCamand hey davidlenwell :)21:30
davidlenwellHi !21:30
NobodyCam:)21:30
davidlenwellSo we inch closer to having a small cluster at bluebox to donate to the ironic project.21:31
jrollooo!21:31
jrollwhat kind of cluster?21:31
davidlenwellsomething we can use to test and refine the ipmi driver21:32
jrollnice :)21:32
davidlenwellmaybe if we do it right use it as an ipmi driver gate test21:32
davidlenwellendless possibilities really21:32
jrollindeed21:33
davidlenwelldevananda 's call really21:33
jrollhow many nodes in the cluster?21:33
* NobodyCam thinks its a cluster of old iphone 5's 21:33
davidlenwellha ha21:33
davidlenwelllol NobodyCam21:33
jrolllol21:33
davidlenwellwe're starting with 5 nodes21:33
NobodyCam:)21:33
jrollonly android has ipmi NobodyCam21:33
davidlenwellolder hardware21:33
* NobodyCam has hte old g1 dev version somewhere21:34
davidlenwellyou're a packrat NobodyCam21:34
jrolldavidlenwell: neat, maybe we can test all of the *_ipmitool drivers :)21:34
NobodyCamhehehe /yes21:34
davidlenwelljroll: I think thats the idea21:35
jroll\o/21:35
davidlenwellfrom what I am told these 5 nodes are all super micro21:35
davidlenwellbut not all the same21:35
jrollshould be fine21:36
jrollas long as they work :P21:36
davidlenwellyeah21:36
davidlenwellwell idealy they will .. if they don't we'll replace the broken ones ..21:36
jrollidk what bluebox is, but I take it y'all will be deploying ironic eventually?21:37
davidlenwelljroll:  thats the idea21:37
jrollwoohoo21:37
jrollI like having users21:37
davidlenwellwe're working on a proof of concept now21:37
davidlenwelland I've been instructed to start contributing to ironic as well21:37
jrollneat :)21:37
NobodyCamdavidlenwell: awesome!!!21:37
davidlenwellSo I'll be lurking a bit and trying to find a place I can jump in21:38
jrollcool!21:38
NobodyCamatm DOC's please read our docs as a new user :)21:38
davidlenwellNobodyCam: I can do that21:38
jrollso right now we're about to cut rc1, which means just critical bugs and docs from here to juno final21:38
jrollso yes, read/improve/write docs21:38
davidlenwelldo you want me to look at the code docs?21:38
rloohash rings, hash rings...21:39
davidlenwellthat is the docs generated from the doc strings?21:39
jrolldavidlenwell: what I would love is for you to work on a test deploy of ironic and tell us if anything is missing from our user/deployer docs21:39
jroll(to start)21:39
jrolland contribute to the missing pieces, of course :P21:39
davidlenwelljroll: we are getting the hardware together for that as well21:39
jrollcool21:39
davidlenwellto do a proof of concept deploy with ironic rather than what we are using now21:40
jrollperfect21:40
devanandadavidlenwell: not the inline doc strings. the sphinx docs aimed at operators/deployers21:41
davidlenwelllink ?21:41
devanandathe things which become this: http://docs.openstack.org/developer/ironic/#admin-guide21:41
davidlenwellokay21:41
davidlenwellare these rst files in the repo?21:42
devanandalive here: http://git.openstack.org/cgit/openstack/ironic/tree/doc/source/deploy21:42
devanandayes21:42
davidlenwellahh .. thanks21:42
davidlenwellthedave lives on!21:42
devanandadavidlenwell: I'd say, start by testing out and reviewing the proposed changes21:42
devanandahttps://review.openstack.org/11861421:42
davidlenwelldevananda: as of right now I don't have real hardware to deploy on .. but I am working on that21:43
devanandaVinay had several other proposed doc changes, i'm not sure why they are abandoned though ... https://review.openstack.org/#/q/owner:%22Vinay+B+S%22,n,z21:43
*** marcoemorais has quit IRC21:43
devanandadavidlenwell: ok. well. read away, then test on hardware -- that'd be very helpful21:43
davidlenwellwill do21:43
JayFdavidlenwell: welcome :)21:44
devanandaand, assuming the docs are good, give you an excellent starting point21:44
davidlenwellawesome!21:44
JayFdevananda: FWIW; a group of us joined this channel about 9 months ago with no product and a mandate to make one and help upstream... and now some of us are cores and we have a product :)21:44
JayFerm21:44
JayFdavidlenwell:^^21:44
JayFdavidlenwell: I wish you the same level of success :)21:44
davidlenwell:)21:45
devanandadavidlenwell: where's craig? I don't see him in here yet?21:45
davidlenwelldevananda: i nag him21:45
ekarlsoJayF: u from hp ? :=)21:46
*** harlowja has quit IRC21:47
devanandaekarlso: nope, he's from rackspace21:47
JayFekarlso: myself, jroll and a few others in here work on rackspace.com/onmetal21:47
*** harlowja has joined #openstack-ironic21:47
devanandadavidlenwell: oh, ignore my second link. it seems Vinay condensed all the other proposals into the virst one I linked, 118614 - so that's the one to read21:48
davidlenwellokay21:49
* davidlenwell ignores the second link ;) 21:49
*** todd_dsm has joined #openstack-ironic21:57
-openstackstatus- NOTICE: The openstack-infra/config repo will be frozen for project-configuration changes starting at 00:01 UTC. If you have a pending configuration change that has not merged or is not in the queue, please see us in #openstack-infra.21:58
*** harlowja has quit IRC22:03
*** harlowja has joined #openstack-ironic22:03
*** harlowja has quit IRC22:09
*** harlowja_ has joined #openstack-ironic22:09
*** marcoemorais has joined #openstack-ironic22:14
*** todd_dsm has quit IRC22:16
NobodyCamShrews: +2'd https://review.openstack.org/#/c/123518 and left a nit22:20
*** andreykurilin_ has quit IRC22:21
adam_gfun race uncovered by the new parallel tempest coverage: https://bugs.launchpad.net/ironic/+bug/137365022:45
NobodyCamoh nice...22:46
NobodyCamadam_g: dose it matter for step 3 if that is done in-instance or thru nova reboot22:46
NobodyCam?22:46
*** openstackgerrit has quit IRC22:47
adam_gNobodyCam, its a test of the nova api22:47
adam_gso, via nova22:47
NobodyCamack22:47
adam_gNobodyCam, are all drivers power actions processed similarly async?22:47
devanandaadam_g: nice!22:48
*** openstackgerrit_ has joined #openstack-ironic22:48
devanandaadam_g: so this is similar to another bug that I marked notabug recently, let me find it22:48
NobodyCamyes i believe so22:48
*** openstackgerrit_ is now known as openstackgerrit22:48
adam_gFWIW tempest has config setting 'ready_wait' that can be used to configure an additional sleep after the nova instance has been marked ACTIVE, to actually let the thing boot22:49
devanandaadam_g: https://bugs.launchpad.net/nova/+bug/131013522:52
devanandaone idea i had was setting the power state in Nova right away and _not_ polling ironic for it22:53
devanandathat'll be slightly better, but would still race with nova's periodic task22:53
devanandaadam_g: the problem with ready_wait here is that a simple time-based wait is prone to still fail when under load, and a condition-based wait may fail (tmieout) if the state changes *before* the condition is checked22:55
*** romcheg has quit IRC22:58
devanandaadam_g: if I"m reading nova/compute/manager correctly, the race exists in Nova22:58
adam_gdevananda, in the case of the reboot, i think  thats essentially what happens. icli.call("node.set_power_state", node.uuid, 'reboot'), ACTIVE22:58
devanandacompute manager assumes that a virt driver will return the *new* state immediatey after it requests the change22:58
devananda2909             self.driver.reboot(22:59
devananda...22:59
devananda2935             new_power_state = self._get_power_state(context, instance)22:59
devanandathere's no sleep or wait or loopingcall in there22:59
devanandaso, because ironic's power state changes are async, it's very likely that Nova will see the instance as ACTIVE at the end of manager.reboot()23:00
devanandathe only real solution here is a notification callback from ironic, I think23:01
devanandaand having our driver wait for it before returning23:01
devanandaat least, unless we look at larger changes in Nova23:01
adam_gyeah, similar to the neutron callbacks23:01
devanandayep23:01
adam_gso a ready_wait will probably avoid the issue in our tempest case, tho would definitely add some minutes to an already long test time23:05
* NobodyCam will brb quick walk to store while there is no water falling from the sky23:13
*** igordcard has quit IRC23:17
* adam_g needs to run out as well23:22
*** marcoemorais has quit IRC23:27
*** marcoemorais has joined #openstack-ironic23:28
*** marcoemorais has quit IRC23:28
*** marcoemorais has joined #openstack-ironic23:29
*** marcoemorais has quit IRC23:29
devanandaadam_g: on looking at compute/manager start_instance() and stop_instance() - i'm now of the mind that our nova driver implemented start and stop incorrectly23:29
*** marcoemorais has joined #openstack-ironic23:29
devanandathese calls must be blocking within nova.virt.ironic.driver - compute manager assumes that, when the call returns, the operation is complete23:30
adam_gdevananda, so ironic driver needs to add loopingcalls between power state changes similar to provision state?23:31
devanandayep23:31
devanandawhich is easy for on/off23:31
devanandabut i'm not sure we can do that for reboot23:31
adam_guse an on / off cycle instead of set_power_state=reboot? :)23:32
jrolldevananda: ouch23:33
adam_gneed to run out, will recap on backscroll when i return23:33
devanandaadam_g: yea, which is going to be slower23:33
*** wanyen has quit IRC23:34
* NobodyCam is back23:35
devanandaadam_g: think i have a generic solution. poll for target_power_state != (the one just requested)23:37
*** coolsvap has joined #openstack-ironic23:39
*** openstackstatus has quit IRC23:55
*** openstack has joined #openstack-ironic23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!