Tuesday, 2015-03-31

*** achanda_ has joined #openstack-ironic00:03
*** achanda has quit IRC00:07
*** achanda_ has quit IRC00:08
*** Marga_ has joined #openstack-ironic00:09
NobodyCamromcheg: :) cool i'll look it up00:12
*** Marga_ has quit IRC00:27
*** mtanino_ has joined #openstack-ironic00:27
*** Marga_ has joined #openstack-ironic00:28
*** mtanino has quit IRC00:29
*** ijw has quit IRC00:31
*** naohirot has joined #openstack-ironic00:33
romchegDone, it's time to go to bed now00:36
romchegSee you guys!00:36
*** romcheg has quit IRC00:36
*** Marga_ has quit IRC00:49
*** kkoski has joined #openstack-ironic00:53
*** Marga_ has joined #openstack-ironic01:04
*** kkoski has quit IRC01:07
* BadCub updates the review day pad with new bugs01:07
*** ChuckC has quit IRC01:08
mrdaBadCub: This is a simple fix that improves our backward compat: https://review.openstack.org/#/c/169101 (might be worthwhile getting in for K)01:09
openstackgerritZhenguo Niu proposed openstack/ironic: Use node UUID in logs instead of node ID  https://review.openstack.org/16762301:13
* BadCub looks01:17
*** spandhe has quit IRC01:18
BadCubmrda: can you tag the commit for 169101 with the micro-version BP ?01:18
mrdaBadCub: Sure01:21
BadCubty :-)01:21
openstackgerritTan Lin proposed openstack/ironic: Enable pxe_amt driver with localboot  https://review.openstack.org/16797501:23
*** mitz has quit IRC01:26
openstackgerritMichael Davies proposed openstack/ironic: Improve backwards compat on HTTP error codes  https://review.openstack.org/16910101:26
BadCubmrda: I added it to the review day pad01:27
mrdathnx01:27
BadCubyw :-)01:27
BadCubI'm gonna head off to do dinner-y things. Should be back for the meeting tonight01:28
*** chenglch has joined #openstack-ironic01:32
*** kkoski has joined #openstack-ironic01:32
*** ChuckC has joined #openstack-ironic01:34
*** mitz has joined #openstack-ironic01:36
*** jerryz_ has joined #openstack-ironic01:39
jrollI have flappy conductors, wtf01:50
jrollno clue as to why01:50
* jroll suddenly wonders if he has broken configs or if we broke something in the hash ring stuff01:52
* jroll walks away01:53
openstackgerritHaomeng,Wang proposed openstack/ironic: Fix UnicodeEncodeError issue when the language is not en_US  https://review.openstack.org/16826801:56
*** kkoski has quit IRC02:01
openstackgerritMichael Davies proposed openstack/ironic: Improve backwards compat on API behaviour  https://review.openstack.org/16910102:16
*** rloo has quit IRC02:16
* mrda notes the good timing of pushing the patch to address rloo's comments just as she leaves :)02:18
mrdaBadCub: FWIW, I've raised a bug for review 163730 and referenced that instead of the bp02:19
mrdaBadCub: Sorry, mea culpa, I meant for 16910102:19
*** achanda has joined #openstack-ironic02:34
*** Haomeng has joined #openstack-ironic02:36
*** Haomeng|2 has quit IRC02:37
*** ramineni has joined #openstack-ironic02:40
*** achanda has quit IRC02:44
*** achanda has joined #openstack-ironic02:45
*** mtanino_ has quit IRC02:50
*** Marga_ has quit IRC02:58
*** harlowja_ is now known as harlowja_away03:07
*** Marga_ has joined #openstack-ironic03:15
*** saripurigopi has joined #openstack-ironic03:45
ramineniJoshNang: hi04:09
raminenithere?04:09
*** krtaylor has quit IRC04:11
*** achanda has quit IRC04:12
*** krtaylor has joined #openstack-ironic04:14
*** rameshg87 has joined #openstack-ironic04:17
rameshg87good morning ironic04:17
*** achanda has joined #openstack-ironic04:19
*** spandhe has joined #openstack-ironic04:21
*** spandhe_ has joined #openstack-ironic04:24
*** spandhe has quit IRC04:26
*** spandhe_ is now known as spandhe04:26
*** achanda has quit IRC04:27
openstackgerritRamakrishnan G proposed openstack/ironic: Convert inspect_ports to string before string operations  https://review.openstack.org/16877604:27
*** achanda has joined #openstack-ironic04:30
Haomengrameshg87: good morning ramesh:)04:30
mrdahey rameshg87 and Haomeng04:31
Haomengmrda: morning:)04:31
rameshg87good afternoon Haomeng and mrda (i hope it's afternoon for Haomeng too) :)04:31
Haomengrameshg87: yes, my local time is 12pm:)04:31
Haomengmrda, rameshg87, help me take a look for my patch, welcome your comments - https://review.openstack.org/#/c/168268/04:31
Haomengif you have time, thank you!04:32
mrdaahh, gate failures!!04:32
Haomengmrda: yes, should not my code issue I think:)04:33
mrdaI've been seeing this intermittent problem today a lot04:33
*** oomichi_ has joined #openstack-ironic04:33
Haomengmrda: found some devstack log error - Could not install requirement XStatic-Angular-Irdragndrop>=1.0.2.1 (from horizon==2015.1.dev106) because of error 404 Client Error: Not Found04:34
mrdaHaomeng: love the test name "def test____init__(self)"04:34
Haomengmrda: :)04:34
rameshg87Haomeng: sure04:34
rameshg87Haomeng: found same set of failures here too04:35
rameshg87https://review.openstack.org/#/c/167975/04:35
mrdaand https://review.openstack.org/#/c/169101/04:35
Haomengmrda: yes04:35
Haomengshould be same issue04:36
rameshg87mrda: Haomeng: might be related to http://lists.openstack.org/pipermail/openstack-dev/2015-March/060174.html04:36
mrdarecheck didn't work though :/04:37
Haomengmaybe some one change the requirement file, then can not install XStatic-Angular-Irdragndrop>=1.0.2.1 (from horizon==2015.1.dev106)04:37
Haomengrameshg87: ok, let me have a look04:37
Haomengmrda: yes, it can be recreated each time04:37
Haomengmrda: not the testing env unstable issue04:37
Haomenglooks like need tripleo guys helping04:38
Haomengand for my test code, I just create new file ironic/tests/test_common.py, because I can not find such existing test file for common code such as the exception testing04:39
Haomeng:)04:39
*** achanda has quit IRC04:40
*** achanda has joined #openstack-ironic04:40
NobodyCamlintan_: are you around?04:43
HaomengNobodyCam: good evening:)04:44
BadCubheya folks04:45
NobodyCamgood afternoon Haomeng :)04:45
rameshg87Hello BadCub, NobodyCam04:45
HaomengNobodyCam: :)04:45
openstackgerritAnusha Ramineni proposed openstack/ironic: iLO driver documentation for node cleaning  https://review.openstack.org/16916204:45
BadCubhey rameshg8704:45
NobodyCammorning rameshg8704:45
mrdaHaomeng: It could have been test_exception.py but I am not fussed04:45
HaomengBadCub: hello:)04:45
mrdaWelcome back NobodyCam04:45
BadCubhey Haomeng :-)04:46
Haomengmrda: ok, let me change in next patch:)04:46
HaomengBadCub: :)04:46
mrdaand DabDub04:46
mrdaBadCub04:46
NobodyCammorning mrda04:46
mrdaSO MUCH TYPING FAIL BY ME04:46
HaomengBadCub: you have a cool name badcub:)04:46
BadCubhey mrda LOL04:46
NobodyCam:)04:46
Haomengmrda: :)04:46
BadCubthnx Haomeng :-)04:46
HaomengBadCub: :)04:47
NobodyCamrameshg87: your ok with the pxe_amt change? https://review.openstack.org/#/c/167975 ?04:47
openstackgerritAnusha Ramineni proposed openstack/ironic: iLO driver documentation for node cleaning  https://review.openstack.org/16916204:47
BadCubso lookin over this new bug. Seems kinda ouchy04:48
NobodyCamramineni: w00 h00 for docs :)04:48
mrdaBadCub: mine?04:48
rameshg87NobodyCam: yes04:48
BadCubhttps://bugs.launchpad.net/ironic/+bug/143682404:49
openstackLaunchpad bug 1436824 in Ironic "Lost control of nodes with amt driver after user reboot " [Undecided,In progress] - Assigned to Tan Lin (tan-lin-good)04:49
rameshg87NobodyCam: we need to do the same thing for pxe_amt + ipa ramdisk too, but may be better if it was a separate patch in my opinion04:49
NobodyCamthe linked bug basiclly will exclude partition images04:49
ramineniNobodyCam: :)04:50
NobodyCamwe are going to need a driver matrix as to which drivers suport for capabilities04:50
NobodyCamoh fyi meeting i about nine minutes04:51
NobodyCam:-p04:51
*** achanda has quit IRC04:51
NobodyCams/i/in/04:51
openstackgerritHaomeng,Wang proposed openstack/ironic: Fix UnicodeEncodeError issue when the language is not en_US  https://review.openstack.org/16826804:55
Haomengmrda: yes, the test_common.py is too *common*:), so accept your good idea, changed to ironic/tests/test_exception.py, done04:56
mrdaHaomeng: \o/04:56
Haomengmrda: :)04:56
jroll\o04:58
lintan_hi NobodyCam05:00
jrolllintan_: meeting is starting :)05:01
*** kalpase has joined #openstack-ironic05:09
NobodyCamhi lintan_ yep we're in the meeting05:11
NobodyCamatm05:11
lintan_NobodyCam , we can talk after meeting :)05:12
NobodyCamya05:12
*** Nisha has joined #openstack-ironic05:15
*** achanda has joined #openstack-ironic05:22
*** oomichi_ has quit IRC05:29
firlSo I went and migrated my “flat” network to the same management network. Now the DHCP server is giving out the proper IP address, however the TFTP server doesn’t seem to be listening on the interface. “IP 10.0.8.101 > 10.0.8.99: ICMP 10.0.8.101 udp port tftp unreachable, length 91”05:36
firlIt is joined via a ovs bridge05:36
firlIs there a way to have the DHCP for ironic serve up an alternative IP?05:37
rameshg87NobodyCam: i think https://bugs.launchpad.net/ironic/+bug/1436824 says to introduce localboot for pxe_amt driver05:49
openstackLaunchpad bug 1436824 in Ironic "Lost control of nodes with amt driver after user reboot " [Medium,In progress] - Assigned to Tan Lin (tan-lin-good)05:49
rameshg87NobodyCam: not a very clear description of bug infact :)05:50
*** pradipta has joined #openstack-ironic05:52
*** ukalifon1 has joined #openstack-ironic05:52
*** pcrews_ has joined #openstack-ironic05:59
*** pcrews has quit IRC05:59
*** pcrews_ has quit IRC05:59
jrollrameshg87: so what sort of order does this thing have? e.g. if I put 1,206:00
jrollis that order guaranteed etc06:00
rameshg87jroll: ilo out-of-band inspection cannot detect the link status06:01
lintan_Hi NobodayCam,06:01
devanandarameshg87: ugh. API parameter validation should be in the API, not inthe driver :(06:01
NobodyCamlintan_: hi06:01
devanandarameshg87: I mean, this needs to be standardized across all drivers06:01
Haomengfirl: see some invalid chars with your words06:01
rameshg87jroll: so we request the operator to say what all ports they wanted ironic to enroll as ironic port06:01
NobodyCamlintan_: I think rameshg87 asnwered my question06:01
NobodyCamabove ^^06:01
jrollrameshg87: that doesn't tell me if it's random or not. I don't think an integer is a very good identifier06:02
rameshg87devananda: but we have only one out-of-band driver using this no ?06:02
devanandarameshg87: what if another driver accepts the value of "zebra"? now the API is different between drivers and our users are very, very sad06:02
jrollidk what link status has to do with it.06:02
rameshg87jroll: in proliant hardware, ports are numbered in the physical hardware in the back of the server06:02
devanandarameshg87: what does that have to do with building an API that supports LOTS of drivers doing it?06:02
rameshg87devananda: yeah :(06:03
rameshg87Nisha: ^^^06:03
devanandaperhaps I should be a whole lot clearer perhaps that we shouldn't accept features when only one driver implements them ... because omg the pain if another driver implements the API differently :(06:03
lintan_OK, thanks NobodayCam and rameshg8706:03
devanandarameshg87: wait, the integer number here indicates which physical port to inspect in the chassis???!?!06:04
jrollyes.06:04
jrollmy servers don't have numbers on the back, just mac address06:04
jrollRIP06:04
* devananda tries to inspect port number 99999906:04
rameshg87devananda: which all physical ports in the server to enroll as ironic port06:05
devanandarameshg87: True or False are the only values i can imagine having any meaning here06:05
devanandaeither "find and update the ports" or "do not..."06:06
jrolldevananda: I could see mac addresses being almost sane06:06
rameshg87devananda: jroll: the context of the problem was that - we cannot detect whether a physical cable is plugged into a nic or not06:06
jrollor I guess that's what is being discovered. womp.06:06
devanandajroll: presumably ... right.06:06
rameshg87devananda: jroll: from ilo06:06
jrollrameshg87: I fail to see what link status has to do with this :/06:06
*** pcrews has joined #openstack-ironic06:06
devanandajroll: me too06:06
rameshg87devananda: jroll: if we enroll all the nics, that might lead to deploy failures - because nova maps to neutron networks randomly06:07
devanandaoh!06:07
devanandaso you're working around the multi-nic bug agove06:07
devananda*above06:07
rameshg87devananda: unfortunately yes :(06:07
devanandaby implementing the work around in the API and requiring users to know which port (#1, #2, #3...) is plugged in?06:07
jrollso someone is physically checking what NICs are plugged in06:07
jrollblahhhhhh06:07
devanandarameshg87: rather than having tried to fix the prolem?06:07
*** achanda has quit IRC06:08
*** achanda has joined #openstack-ironic06:08
* BadCub heads off_to_bed.06:08
*** BadCub is now known as BadCub_Hiding06:08
* devananda has a sad06:08
rameshg87devananda: jroll: if they still want to enroll all the nic, they can do with "inspect_ports=all"06:08
jrollsure.06:09
* rameshg87 wonders if inspect_ports is not conveying the meaning at all06:09
jrollI guess this isn't horribly far off of how we register hardware06:09
openstackgerritTan Lin proposed openstack/ironic: Enable pxe_amt driver with localboot  https://review.openstack.org/16797506:10
rameshg87:(06:10
jrollrameshg87: what I mean is, this is similar to how we register hardware in our environment06:10
jrolljust someone writes down numbers rather than mac addresses.06:11
NobodyCamlintan_: can you update teh bug with the info in your reply to me on that patch :)06:11
rameshg87jroll: that was to work around the link-status issue and nova-ironic-neutron-port-mapping issue06:12
NobodyCamand I need to head to sleep land06:12
NobodyCamso good night all06:12
rameshg87jroll: the issue was the ilo doesn't support fetching the link status06:12
jrollrameshg87: no, I get it. it's just... not ideal.06:12
rameshg87jroll: and without knowing where physical cables are plugged, it's even more dangerous to enroll all the ports as that might silently lead to deploy failures :(06:13
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/16918406:13
jrollrameshg87: right, we should make that part better06:13
devanandarameshg87: there is nothing about this port-number-thing in the spec http://specs.openstack.org/openstack/ironic-specs/specs/kilo/ironic-node-properties-discovery.html06:13
rameshg87jroll: yes06:13
*** ijw has joined #openstack-ironic06:13
devanandag'night, NobodyCam06:13
rameshg87Nisha: are you around ?06:14
rameshg87devananda: i think this was lately identified06:14
devanandarameshg87: what would be the impact if we remove it now (ie, before RC1)06:14
rameshg87devananda: and hence spec wasn't updated06:14
rameshg87devananda: might start leading to deploy failures06:15
*** Marga_ has quit IRC06:15
rameshg87devananda: because we would end up enrolling all the ports06:15
devanandarameshg87: well. if the down'd ports are removed before we deploy, then it's fine06:15
openstackgerritMichael Davies proposed openstack/ironic: Fix is_hostname_safe for RFC compliance  https://review.openstack.org/16566606:15
devanandarameshg87: you can discover htem just fine. the problem is having them active at deploy time06:15
devanandabecause nova picks them up and then fails, modulo some randomness from that bug06:16
rameshg87devananda: what do you mean by down'd the port ?06:16
lintan_done, NobodyCam :)06:16
rameshg87devananda: can we down an ironic port ?06:16
devanandai mean the ports that dont have link status UP06:16
devanandano. but we can DELETE them :06:16
devananda:)06:16
rameshg87devananda: oh okay06:16
rameshg87devananda: so delete them after inspection ?06:16
devanandaI mean, that's not great either06:17
*** Nisha_away has joined #openstack-ironic06:17
*** Nisha has quit IRC06:17
rameshg87do you mean let operator delete them manually  ?06:17
devanandayes06:17
devanandafind all the ports then remove ones that are not connected to the network06:17
rameshg87devananda: but that might lead to the same work no ? know which ports are connected after inspection06:18
devanandaneither of these are good solutions, but this doesn't introduce a driver-specific non-discoverable non-conventional non-documented thing in the API06:18
devanandaclearly the right thing to do is to fix nova06:18
rameshg87devananda: but i idk how we would fix up nova for this06:19
rameshg87devananda: i think we are supposed to enroll only the nics that have physical connectivity06:19
rameshg87devananda: the base problem was that ilo cannot detect which nics have physical connectivity :(06:19
rameshg87devananda: so in my mind - either we enroll only the ports which operator requests OR enroll all ports and let operator decide which ones to remove06:21
* jroll goes off to bed, good luck with this one06:22
rameshg87good night jroll06:22
devanandathe problem is that nova is picking one at random to set up the networking. see prior discussion of https://bugs.launchpad.net/ironic/+bug/140513106:23
openstackLaunchpad bug 1405131 in OpenStack Compute (nova) "Ports cannot be mapped to networks" [Low,In progress] - Assigned to Mark Goddard (mgoddard)06:23
rameshg87devananda: yeah, may be solution of https://bugs.launchpad.net/ironic/+bug/1405131 might end up fixing this problem06:24
openstackLaunchpad bug 1405131 in OpenStack Compute (nova) "Ports cannot be mapped to networks" [Low,In progress] - Assigned to Mark Goddard (mgoddard)06:24
rameshg87devananda: but (correct me if i am wrong) any rate are we are not supposed to enroll ports that don't have physical connectivity, right ?06:25
*** kalpase has quit IRC06:27
*** mrda is now known as mrda-away06:27
devanandawell, i was just going to say this bug should be easy to reproduce06:28
devanandajust enroll one MAC that works, and a second one that doesn't exist06:28
devanandaand see how often "nova boot" succeeds06:28
rameshg87devananda: yeah06:28
rameshg87half of the time shouldn't succeed06:28
devanandaright06:28
devanandabecause random() is bad06:28
rameshg87yeah :)06:29
rameshg87devananda: so what best can be done for now for ilo inspection ?06:29
devanandarameshg87: but think of this -- I'm the remote hands in the data center, I need to replace a switch. right now only one cable is plugged in (that's bad, but hey, i'm cheap)06:30
devanandarameshg87: so I cable the second port, then unplug the first one06:30
devanandaboom. nothing can be deployed06:30
rameshg87devananda: yes :(06:30
devanandathat's never what I want06:30
*** kalpase has joined #openstack-ironic06:30
rameshg87devananda: discoverd will be able to correct this - operator just inspects the node again after replugging the cable06:31
rameshg87devananda: discoverd enrolls the right ports06:31
devanandanova & neutron should be setting up dhcp options for ALL ports, not first(port) or random(port)06:31
rameshg87devananda: but then dhcp options for all ports in provisioning network ?06:32
devananda*all ports that are configured to DHCP06:32
rameshg87devananda: i mean create a neutron port in the provisioning network for all ironic ports06:32
devanandawhich in some cases may in fact be all of tem06:32
devanandathem06:32
rameshg87devananda: but right know we don't isolate deployment network from tenant network06:33
rameshg87devananda: so that would end up connectivity to only deployment network during provisioning06:34
rameshg87devananda: and connectivity to tenant networks after instance is active06:34
rameshg87devananda: right ?06:34
devanandarameshg87: some users dont need to separate the provisioning & tenant nets. some do.06:36
*** spandhe has quit IRC06:36
rameshg87devananda: sorry, need to goto a meeting now in office.  i will catch up with you tonight on this if you get away before i come back.06:37
devanandarameshg87: k k06:37
*** dlpartain has joined #openstack-ironic06:37
*** rameshg87 is now known as rameshg87-away06:37
*** dlpartain has left #openstack-ironic06:38
*** pas-ha has joined #openstack-ironic06:41
*** takadayuiko has joined #openstack-ironic06:42
*** saripurigopi has quit IRC06:46
*** rameshg87-away is now known as rameshg8706:46
rameshg87devananda: i am back and ready to continue discussion if you are available06:47
devanandathat was a quick meeting. howeve,r i need to get up and get coffee and head into the office soon06:48
*** jamielennox is now known as jamielennox|away06:49
rameshg87devananda: :).  okay, may be i will catch up with you when are you free.06:49
rameshg87some time later today06:49
*** ifarkas has joined #openstack-ironic06:56
devanandarameshg87: https://bugs.launchpad.net/ironic/+bug/143854607:00
openstackLaunchpad bug 1438546 in Ironic "ilo driver inspection requires extra parameters" [Undecided,New]07:00
* devananda goes afk to get coffee, etc07:00
*** Nisha_away has quit IRC07:01
*** achanda has quit IRC07:05
rameshg87devananda: okay, so we would rather take off the inspect_ports thing, right ?07:05
*** saripurigopi has joined #openstack-ironic07:17
*** zhenguo has joined #openstack-ironic07:43
*** jistr has joined #openstack-ironic07:43
*** _lintan has joined #openstack-ironic07:48
_lintanhi rameshg8707:49
rameshg87hey lintan_07:51
rameshg87lintan_: i am just leaving my desk, will be back in a short while07:51
rameshg87can we talk after that ?07:52
_lintanrameshg87, for sure :)07:53
*** mgoddard has joined #openstack-ironic07:58
*** viktors|afk is now known as viktors08:01
*** romcheg has joined #openstack-ironic08:01
rameshg87lintan_: hi08:12
rameshg87lintan_: i am back :)08:12
viktorshi folks! Is there any instruction, how to run ironic-api with apache2?08:13
*** yuanying has quit IRC08:13
_lintanrameshg87, I have a question about how to use IPA-Ramdisk08:14
rameshg87lintan_: sure ..08:14
rameshg87go ahead08:15
*** ndipanov has joined #openstack-ironic08:15
rameshg87viktors: what do you meanby running "ironic-api with apache2" ?08:15
_lintanrameshg87, I download these two images from https://github.com/openstack/ironic-python-agent/tree/master/imagebuild/coreos, Can I use them as replace with dib-ramdisk?08:15
_lintanrameshg87, or I have to build IPA driver with devstack?08:16
rameshg87lintan_: yes, you can build a new ipa ramdisk by  running make on imagebuild/coreos08:17
rameshg87lintan_: alternately you can use prebuilt ramdisk available here: http://tarballs.openstack.org/ironic-python-agent/coreos/files/08:17
viktorsrameshg87: i'm looking for instruction similar to http://docs.openstack.org/developer/keystone/apache-httpd.html08:18
rameshg87viktors: are you looking for this - https://github.com/openstack/ironic/blob/master/etc/apache2/ironic ?08:20
*** lucasagomes has joined #openstack-ironic08:20
ifarkasdevananda, hi, could you please take a look at https://review.openstack.org/#/c/165860/ I refactored the patch to avoid introducing new config options and the bug is targeted for rc108:20
rameshg87i haven't done this myself, but it might be what you are looking for08:20
_lintanrameshg87, Yes, this is what I mean, I download the prebuild ramdisks. My question is can I directly replace dib-ramdisk with IPA-Ramdisk in my previous pxe-* environment. It looks like agent-* driver need swift support08:21
viktorsrameshg87: yes thats correct config, but I'm not familiar with apache, so I looked for some instruction, if any :)08:21
rameshg87lintan_: yes, you can do that08:21
rameshg87:)08:21
_lintanCool, thanks.08:21
rameshg87lintan_: no need of swift or any extra stuffs08:21
rameshg87just replace dib ramdisk with ipa ramdisk08:21
rameshg87that's all08:21
rameshg87credits to lucasagomes :)08:21
rameshg87morning lucasagomes :)08:22
* lucasagomes is lost heh08:22
lucasagomesrameshg87, good morning!08:22
lucasagomesmorning all08:22
_lintanMorning lucasagomes08:22
openstackgerritLucas Alvares Gomes proposed openstack/ironic: Add config drive documentation  https://review.openstack.org/16620108:23
rameshg87lucasagomes: lintan_ was asking if it will work for pxe_* drivers if we replace dib ramdisk with ipa ramdisk08:23
lucasagomesyeah :) cool08:23
lucasagomesipa ftw08:23
_lintanReally awesome work, lucasagomes08:24
lucasagomes_lintan, thanks, it's everyone's work :)08:25
rameshg87viktors: i am not sure if there's something more from ironic documentation08:25
rameshg87viktors: i haven't done it myself too08:26
* rameshg87 never worked on anything other than devstack configuration :(08:26
rameshg87viktors: if you had some other specific questions on configuring apache, may be you can check with other folks ehre08:26
rameshg87lucasagomes: any updates on that grub2 stuff ?08:28
rameshg87lucasagomes: i am still not able to pack both bios and efi grub binaries on same image08:28
viktorsrameshg87: ok, thanks! I know, that devananda added apache config, maybe he knows something...08:28
lucasagomesrameshg87, not really I tried some things but had to change the focus yesterday on something else08:28
lucasagomesinstalling like: DEBIAN_FRONTEND=noninteractive apt-get install -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" grub208:28
lucasagomesis non-interactive, which is good08:29
rameshg87lucasagomes: oh okay08:29
lucasagomesbut DIB complain :/08:29
rameshg87:(08:29
*** tiagogomes_ has joined #openstack-ironic08:29
lucasagomesthe grub-probe command says /dev is not mounted08:29
lucasagomesso I have to debug it08:29
rameshg87okay, let me try that too08:29
*** derekh has joined #openstack-ironic08:29
lucasagomesok, lemme get some coffee08:30
viktorsmrda-away: Hi! Please ping me as for bug 1438531, when you'll be here08:33
openstackbug 1438531 in Ironic "Ironic database migration tests not running" [Undecided,New] https://launchpad.net/bugs/1438531 - Assigned to Michael Davies (mrda)08:33
rameshg87lucasagomes: please check the today's meeting minutes and let me know what you think08:35
rameshg87lucasagomes: we decided to give a try fixing the issue that dib ramdisk doesn't report back the status of bootloader installation08:35
rameshg87lucasagomes: and bug is on me right now08:36
rameshg87:)08:36
lucasagomesrameshg87, will do08:39
lucasagomesrameshg87, but I'm +1 on fixing that08:39
lucasagomesur adding a new endpoint to the pxe vnedor interface right?08:39
rameshg87lucasagomes: yes08:39
lucasagomesthat will be called after the bootloader is installed or something08:39
rameshg87lucasagomes: yes08:39
lucasagomesmake sure we don't reboot on the ramdisk as well, let's ironic do the reboot08:39
rameshg87lucasagomes: in all cases ?08:40
rameshg87lucasagomes: the second call back will be only for localboot08:40
rameshg87lucasagomes: and we will wait for second call back  only if boot_option == "local"08:41
lucasagomesrameshg87, oh I see, could be only for bootloader08:41
rameshg87lucasagomes: in that way i think we can preserve backward compatibility08:41
lucasagomesI think it would be good to be all cases. Because for example our reboot in ironic is a power off and power on again08:41
lucasagomeswhich is good08:41
lucasagomeswhen you have VMs, if you only reboot from within the ramdisk some changes may not get applied, including the boot device08:41
lucasagomeson my test env it's a pain08:41
rameshg87lucasagomes: but old dib ramdisks don't know it has to do second call back08:41
lucasagomesbecause virsh only applies the confg changes after you power off that vm >.<08:42
lucasagomesrameshg87, oh I see08:42
rameshg87oh08:42
lucasagomesrameshg87, well that's good anyway, if it's only for localboot that would solve the problem already08:42
rameshg87lucasagomes: can we preserve backward compatibility if we do that for all cases ?08:42
lucasagomesrameshg87, hmm I don't think so08:42
lucasagomesbecause before it just called pass_deploy_info and then rebooted08:43
rameshg87lucasagomes: yeah08:43
lucasagomesso maybe  yeah making it only for the bootloader seems fair08:43
rameshg87lucasagomes: yeah, will do that08:43
rameshg87lucasagomes: make second call back from ramdisk if boot_option == "local"08:43
lucasagomesrameshg87, good stuff, thanks!08:43
lucasagomesrameshg87, yeah sounds good08:43
rameshg87okay08:43
rameshg87thanks :)08:43
lucasagomesthank u for fixing it :D08:44
lucasagomesgate seems broken08:44
*** dtantsur|afk is now known as dtantsur08:44
dtantsurmorning Ironic08:45
lucasagomesit looks likes it's devstack08:45
*** pelix has joined #openstack-ironic08:46
dtantsurlucasagomes, what's with gate?08:46
lucasagomesdtantsur, not sure, just saw it now08:46
lucasagomesit seems something in devstack has broken all jobs08:46
dtantsuroh08:47
yuriyzmorning Ironic08:47
dtantsuryuriyz, o/08:47
*** _lintan has quit IRC08:49
*** yog__ has joined #openstack-ironic08:53
-openstackstatus- NOTICE: CI Check/Gate pipelines currently stuck due to a bad dependency creeping in the system. No need to recheck your patches at the moment.08:53
*** ChanServ changes topic to "CI Check/Gate pipelines currently stuck due to a bad dependency creeping in the system. No need to recheck your patches at the moment."08:53
rameshg87there you go ^^^^ :)08:54
*** athomas has joined #openstack-ironic08:57
openstackgerritYuiko Takada proposed stackforge/ironic-discoverd: Add unit tests for firewall.py  https://review.openstack.org/16830408:57
rameshg87dtantsur: hi08:58
rameshg87dtantsur: wanted to ask something regarding discoverd08:58
rameshg87dtantsur: are we creating ironic ports for all the nics in the system ?08:59
rameshg87(may be i asked it before)08:59
rameshg87there was a discussion surrounding this in the meeting (not w.r.t discoverd)08:59
*** jiangfei|2 has joined #openstack-ironic09:01
dtantsurrameshg87, it's configurable for discoverd09:02
* dtantsur hasn't looked at meeting minutes yet09:02
dtantsurrameshg87, default being: only one PXE booted port09:02
rameshg87dtantsur: okay, so they have option to configure so that all ports are enrolled as well, right ?09:03
dtantsurrameshg87, exactly09:03
rameshg87dtantsur: there was this bug https://bugs.launchpad.net/ironic/+bug/140513109:04
openstackLaunchpad bug 1405131 in OpenStack Compute (nova) "Ports cannot be mapped to networks" [Low,In progress] - Assigned to Mark Goddard (mgoddard)09:04
rameshg87dtantsur: which was being discussed09:04
dtantsurI see, yeah09:04
*** jiangfei has quit IRC09:04
rameshg87dtantsur: not to be fixed on kilo, but a solution to this might bring in a solution which works when all ports are enrolled09:04
*** rameshg87 is now known as rameshg87-brb09:05
dtantsurrameshg87-brb, then we'll change the default in discoverd and adopt this solution :)09:05
*** jiangfei|3 has joined #openstack-ironic09:06
*** jiangfei|2 has quit IRC09:06
lucasagomesok the bug seems to affect all projects09:10
*** rameshg87-brb is now known as rameshg8709:11
rameshg87lucasagomes: dtantsur: one question regarding proliantutils09:11
rameshg87we are planning to release proliantutils==3.0.0 with ironic kilo09:11
rameshg87we are planning to delay that till april 9 so that we can fix any bugs that we may find in it09:12
rameshg87is it okay to update ironic now only saying we need proliantutils>=3.0.0 without it being released officially :D09:12
rameshg87i mean update ironic 3-4 days before releasing 3.0.009:12
lucasagomesrameshg87, that's a documentation?09:13
rameshg87lucasagomes: yes09:13
rameshg87lucasagomes: we want to delay it till april 9, but can't wait till last moment for ironic doc change09:13
lucasagomesit's odd, but since we have a time constraint in Ironic I think it's ok09:14
rameshg87lucasagomes: only constraint is driver-requirements for whoever packages it09:14
lucasagomesseems fine09:14
rameshg87lucasagomes: they might depend on the kilo-released-version of ironic09:14
rameshg87okay09:14
*** pradipta has quit IRC09:20
*** pradipta has joined #openstack-ironic09:24
dtantsurrameshg87, I would say: release on Apr 8, make people land version bump09:24
dtantsurdepending on non-existing version might be confusing09:24
dtantsurthough I don't have a string opinion on this09:25
rameshg87dtantsur: okay09:26
rameshg87dtantsur: may be apr 7 or apr 8, i can keep bugging people on irc for this :)09:26
dtantsuryep09:26
dtantsurI'll be releasing discoverd 1.1 on Apr 9, but it's not a hard dep for Kilo Ironic09:26
devanandaifarkas: done. thanks for the ping09:36
*** mgoddard has quit IRC09:36
ifarkasdevananda, thank for the update!09:36
devanandalucasagomes, dtantsur: related to discovery -- https://bugs.launchpad.net/ironic/+bug/143854609:37
openstackLaunchpad bug 1438546 in Ironic "ilo driver inspection requires extra parameters" [Undecided,New]09:37
lucasagomesdevananda, morning09:37
* lucasagomes looks09:37
devanandai filed after discussion with rameshg87 this morning09:37
dtantsurdevananda, hmm yeah. discoverd works around the situation somewhat differently09:38
dtantsurdevananda, I agree that's bad situation, but I've no idea how to fix until until https://bugs.launchpad.net/ironic/+bug/1405131 is fixed09:38
openstackLaunchpad bug 1405131 in OpenStack Compute (nova) "Ports cannot be mapped to networks" [Low,In progress] - Assigned to Mark Goddard (mgoddard)09:38
devanandaright09:39
rameshg87dtantsur: same with ilo :(09:39
rameshg87devananda: dtantsur: so may be we should get it fixed soon in liberty09:39
dtantsurrameshg87, yeah, it's about ilo. discoverd, being in-band, can at least detect which port we can PXE boot from09:39
devanandaso the approach you've both taken is, effectively, dont register ports that are offline // only register one port09:39
dtantsurrameshg87, we MUST :)09:39
dtantsurdevananda, right09:40
rameshg87devananda: yeah exactly :)09:40
dtantsurdevananda, (for discoverd is configurable)09:40
devanandabut the way this is done is different in each driver, and this difference is exposed in the API <<< that's what bothers me09:40
devanandafor a standard interface, every driver MUST present the same API09:40
*** jamielennox|away is now known as jamielennox09:41
*** romcheg has quit IRC09:41
dtantsurdevananda, right... I wonder how to fix it though09:42
dtantsurI could potentially make discoverd accept port list too. but I've no idea what these "port numbers" mean09:42
devanandadtantsur: you and most operators09:43
dtantsur:)09:43
devanandaIMO, we should really not have landed that "port number" thing09:43
devanandaI understand the bug and the need for a way to work around it for now, but we ought to have caught that in the review09:44
devanandaeven on HP hardware, I'm not sure what it means09:44
dtantsurdevananda, yeah :( then we can't land ilo (any OOB?) inspection though09:44
devanandadtantsur: sure we can. it discovers all ports09:44
* lucasagomes remembers seem that port numbers list, I thought it was some iLO thing09:44
*** romcheg has joined #openstack-ironic09:45
dtantsurdevananda, and then we ask users to delete "the wrong ones"?09:45
devanandaif the operator knows that some ports are not connected, ... yup09:45
rameshg87yeah that's the only other way09:45
lucasagomesrameshg87, what informations you get from the ports in iLO?09:46
devanandadtantsur: does discoverd support any option to say "dont enroll ports" ?09:46
lucasagomesmaybe we should add the ability of passing a regex to Ironic09:46
lucasagomeslike if the port is connect to the network X09:47
lucasagomesregister it in Ironic09:47
rameshg87lucasagomes: the port number is actually marked where the lan cable is plugged09:47
*** jamielennox is now known as jamielennox|away09:47
lucasagomesignore all the rest09:47
devanandarameshg87: what about in a blade system?09:47
dtantsurdevananda, it does not, probably it should. what's the use case?09:47
lucasagomesrameshg87, right09:47
rameshg87devananda: :D09:47
dtantsurlucasagomes, "the port is connect to the network X" any ideas how to implement OOB?09:47
devanandadtantsur: I actually dont have a use case. I think Ironic should always, when inspecting, update the ports.09:47
rameshg87devananda: when enclosure comes it's a different story :(09:48
lucasagomesdtantsur, so that's why I asked which information they get frm the ports OOB09:48
devanandadtantsur: but the ilo driver has three options here: update all ports, do not update any ports, only update ports [...]09:48
lucasagomesif the network it's connected is one, fine otherwise :/09:48
devanandarameshg87: we already have folkstrying to use this with blades. "when" isn't the issue...09:48
dtantsurdevananda, oh. and again it's different behavior...09:48
devanandarameshg87: the API for any solution we implement today needs to account for what other situations we will meet tomorrow09:49
dtantsurthat's probably my fault, I should have reviewed the whole inspection thingy better...09:49
devanandathe hard thing about making APIs is that you cant change them without breaking someone09:49
rameshg87yeah i understand now09:49
rameshg87we SHOULD make it consistent09:50
rameshg87devananda: but then ilo inspection will have to remain with the same behaviour - either UPDATE all ports OR UPDATE none09:50
devanandadtantsur: discoverd always updates the ports (the ones it finds) right?09:51
devanandaas far as I can tell, that's what the spec says all drivers should do09:51
devanandathre's nothing here http://specs.openstack.org/openstack/ironic-specs/specs/kilo/ironic-node-properties-discovery.html#rest-api-impact09:52
dtantsurdevananda, "update" = "create"? yes. it can optionally delete missing ports (this "optionally" is one more behavior difference)09:52
devanandathat says "pass this extra option to skip discovering ports"09:52
devanandadtantsur: :(09:52
devanandanothing here either about optionally doing something else http://specs.openstack.org/openstack/ironic-specs/specs/kilo/ironic-node-properties-discovery.html#driver-api-impact09:52
dtantsurdevananda, it's not late to make it default to "delete missing" for 1.1. If you feel like filing a but against https://bugs.launchpad.net/ironic-discoverd I'll change the default to strictly match Ironic behavior09:53
dtantsurstill, I can't make "add all ports" the default, because it's the broken default :(09:54
devanandanothing here either - http://specs.openstack.org/openstack/ironic-specs/specs/kilo/inband-properties-discovery.html09:54
devanandadtantsur: from an operator standpoint, if I ask Ironic to "inspect" the hardware, and it comes back saying there is only one NIC in the machine, when I know there are two ...09:55
devanandadtantsur: I'm going to think that the second NIC is bad. or that Ironic is defective.09:55
dtantsurdevananda, and if we add both ports and then deployment fails for vague reason, what is operator supposed to think?09:56
dtantsurI mean, Ironic (and Nova) IS broken: it's affected by bug https://bugs.launchpad.net/ironic/+bug/140513109:57
openstackLaunchpad bug 1405131 in OpenStack Compute (nova) "Ports cannot be mapped to networks" [Low,In progress] - Assigned to Mark Goddard (mgoddard)09:57
devanandaoh, totally09:57
devanandathat's really a much bigger bug than it looked like when mgoddard first mentioned it to me09:57
devanandaI have mistakenly thought that nova/neutron was setting the dhcp boot options on all known ports, not random(1)09:58
*** naohirot has quit IRC09:58
devanandabut both of the proposed fixes here create additional problems09:59
devanandawith discoverd, i could get different results if I run inspect with different cables plugged in09:59
devanandaand no changes to the hardware being inspected09:59
devanandaand with ilo, inspect will flat-out error if I dont pass in this additional parameter10:00
devanandaif I'm writing some automation to inspect my hardware, I have to special case what driver I'm using10:01
rameshg87:(10:01
dtantsurdevananda, is it correct that we treat Ironic ports as equivalent to NIC inventory?10:02
dtantsurI mean, maybe " i could get different results if I run inspect with different cables plugged in" is the correct thing to do?10:02
devanandadtantsur: i believe so, yes10:02
dtantsurespecially while the bug in question is still present10:02
devanandadtantsur: ironic should represent the hardware effectively10:02
devanandadtantsur: and it's quite reasonable for an operator to temporarily disconnect some network cables, pull a switch out, etc10:03
devanandaas part of routine maintenance10:03
openstackgerritMerged stackforge/ironic-discoverd: Add unit tests for firewall.py  https://review.openstack.org/16830410:03
dtantsuraren't we getting to CMDB border here? if we need one port, why add all present?10:03
openstackgerritDmitry Tantsur proposed stackforge/ironic-discoverd: First take on integration test for using on devstack  https://review.openstack.org/16924110:03
devanandadtantsur: CMDB typically holds a lot more information than just "what is my hardware"10:03
*** jiangfei|3 has quit IRC10:04
*** jiangfei|3 has joined #openstack-ironic10:04
dtantsurdevananda, last summer we agreed that trying to represent hardware information that we're not using means crossing CMDB borders10:04
devanandadtantsur: why NOT add all ports? we should use them all ...10:04
dtantsurdevananda, what for? especially if only one can PXE boot?10:05
devanandaif all the ports are cabled, and on the same network, then ironic can use all of them10:05
dtantsurthat's a strong assumptions for bare metal10:05
devanandacertainly the user who is deploying an instance to a node with 4 ports may want to, you know, bond them for HA and extra throughput10:05
*** achanda has joined #openstack-ironic10:06
dtantsurare we planning to support this case in the near future?10:06
devanandaand as the operator of that cloud, I kinda want to know what all the MAC addresses are so that neutron puts them all on the right VLAN10:06
devanandauh... i thought we already did10:06
*** chenglch has quit IRC10:06
dtantsurI'm not sure, but it doesn't sound easy10:06
devanandadtantsur: you're saying ironic doesn't support more than one NIC per node??10:06
devanandaI'm quite sure it does10:06
dtantsurI'm not sure what's required for bonding...10:07
dtantsurIronic support more than one NIC only if they are 1. on one network; 2. all can PXE boot10:07
dtantsurreferring to the same bug as above10:07
devanandadoes not support != affected by bug10:07
devanandawe need to support servers10:08
devanandaevery server I've used in the last 15 years has had >1 NIC10:08
dtantsurI agree. But we have problems right now, and they are pretty hard to solve in a proper way10:09
*** pradipta has quit IRC10:09
devanandasome times, only one NIC can PXE boot. some times, more than one can. that needs to be (and isn't right now) accounted for. but Ironic needs to model the hardware that's there, be able to inform neutron (or other network providers) about what MACs belong to which machine, etc10:09
*** jcoufal has joined #openstack-ironic10:09
devanandaI agree. but hard or easy doesn't mean we should not try10:09
dtantsurwe should. but let's get back to Kilo situation10:10
devanandaright10:10
*** achanda has quit IRC10:10
dtantsurwe're not fixing it in Kilo, and we have some workaround on the table10:10
devanandaif discoverd only finds MACs that are cabled and have LINK UP right now, I think that's a bug, however, I recognize that it's a workaround, and it doesn't affect the API10:11
devanandathe way ilo is wokring around this is, IMO, incompatible, because it's changed the API10:11
rameshg87devananda: yeah, now it requires driver_info['inspect_ports'] to be filled in before triggering inspect10:12
devanandaif both drivers enrolled all NICs, and we document and widely advertise "hey, discovery will find all the NICs, but if they're on separate networks, E_BUG. you should delete some manually"10:13
devanandathen we have a consistent API, which will still work after we fix the bug, and clear messaging to users as to why there is a work around10:13
devanandanone of these options are perfect, I know10:13
rameshg87devananda: one sec, let me confirm10:13
rameshg87devananda: all nics = nics which have link up + nics which have link down10:14
rameshg87right ?10:14
devanandarameshg87: yes10:14
rameshg87okay10:14
dtantsurdevananda, then on my discoverd side I will update inspection docs saying one should put "add_ports = all" to the discoverd.conf to match Ironic expectations10:15
devanandadtantsur: actually I think that parameter should be removed from ilo driver10:15
dtantsurdevananda, I meant discoverd configuration. +1 for removing from ilo.10:16
devanandathat parameter was never discussed in the spec, and AFAIK it only exists so the ilo driver can work around this byg10:16
rameshg87devananda: if we choose to enroll all ports, it's not required10:16
devanandadtantsur: oh. gotcha. you'll make it optional in discoverd10:16
dtantsuryep10:17
rameshg87devananda: so i will go ahead and remove all references of inspect_ports from ilo inspection10:18
devanandasometimes the right long-term solution isn't the best short-term solution, but the short-term solution makes it much harder in the long term :(10:18
rameshg87devananda: may be worth discussing in the summit ?10:20
*** ramineni has quit IRC10:22
*** ramineni has joined #openstack-ironic10:23
openstackgerritDmitry Tantsur proposed openstack/ironic: Document ports creating configuration for in-band inspection  https://review.openstack.org/16925310:23
dtantsurdevananda, kind of ^^^ wdyt?10:23
dtantsur++ for summit (provided I'll be granted a visa :D )10:24
openstackgerritDmitry Tantsur proposed openstack/ironic: Document ports creating configuration for in-band inspection  https://review.openstack.org/16925310:27
devanandadefinitely needs discussion at summit10:29
devanandawould be good for some folks to test it ahead of time10:29
devanandaafaict, the current nova/network code handles multiple NICs, as long as they're all in the same subnet, just fine10:30
dtantsuras to testing, our test labs have separate networks10:30
takadayuikodtantsur, is there?10:31
dtantsurtakadayuiko, o/10:31
takadayuikodtantsur, hi :D10:31
devanandaOH! no, it doesn't10:31
dtantsur:(10:31
dtantsurtakadayuiko, I'm a bit surprised you got DHCP request from some 192.168.100 network. did you change it?10:32
dtantsurthe default is different10:32
devanandahttps://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L29910:32
dtantsurtakadayuiko, anyway, could you paste both logs somewhere?10:33
devanandacmpute/manager is geting a list of macs from ironic, passing that list to _create_port() there10:33
takadayuikodtantsur, No, I didn't do any change about neutron. Should I?10:33
devanandabut crete_port only sets up one10:33
takadayuikodtantsur, OK. screen-ironic-discoverd-dhcp.log:10:34
-takadayuiko- sudo dnsmasq --conf-file=/etc/ironic-discoverd/dnsmasq.conf10:34
-takadayuiko- dnsmasq: started, version 2.68 DNS disabled10:34
-takadayuiko- dnsmasq: compile time options: IPv6 GNU-getopt DBus i18n IDN DHCP DHCPv6 no-Lua TFTP conntrack ipset auth10:34
-takadayuiko- dnsmasq-dhcp: DHCP, IP range 192.168.100.13 -- 192.168.100.20, lease time 1h10:34
-takadayuiko- dnsmasq-dhcp: DHCP, sockets bound exclusively to interface br-discoverd10:34
-takadayuiko- dnsmasq-dhcp: DHCPDISCOVER(br-discoverd) 52:54:00:58:b7:a510:34
-takadayuiko- dnsmasq-dhcp: DHCPOFFER(br-discoverd) 192.168.100.18 52:54:00:58:b7:a510:34
-takadayuiko- dnsmasq-dhcp: DHCPDISCOVER(br-discoverd) 52:54:00:58:b7:a510:34
-takadayuiko- dnsmasq-dhcp: DHCPOFFER(br-discoverd) 192.168.100.18 52:54:00:58:b7:a510:34
-takadayuiko- dnsmasq-dhcp: DHCPREQUEST(br-discoverd) 192.168.100.18 52:54:00:58:b7:a510:34
-takadayuiko- dnsmasq-dhcp: DHCPACK(br-discoverd) 192.168.100.18 52:54:00:58:b7:a510:34
dtantsurtakadayuiko, you'd better use http://paste.openstack.org/ for pasting :)10:34
takadayuikodtantsur, but my local.conf is a little bit different from your.10:34
dtantsurtakadayuiko, please provide it as well (also on http://paste.openstack.org/)10:35
takadayuikodtantsur, OK, sorry10:35
takadayuikodtantsur, http://paste.openstack.org/show/197674/ Can you see this? it's first time for me to use this10:36
dtantsurtakadayuiko, yeah, it's fine10:36
takadayuikodtantsur, and my local.conf: http://paste.openstack.org/show/197675/10:37
dtantsurtakadayuiko, oh, IRONIC_DISCOVERD_DHCP_RANGE and IRONIC_DISCOVERD_INTERNAL_IP should be from some random subnet, not your real one. better leave them as default values (i.e. drop from local.conf)10:38
* devananda proposes https://review.openstack.org/169258 to Nova10:40
takadayuikodtantsur, Oh! OK! I'll fix to be same as etherpad's.10:40
dtantsuryes please :)10:40
* dtantsur hunts for food, brb10:41
tiagogomes_Why is Ironic creating absolute symbolic links in the tftp folder? That makes impossible to use --secure option of tftp-hpa server no?10:46
openstackgerritNisha Agarwal proposed stackforge/proliantutils: Adding functionality required by ilo-inspection  https://review.openstack.org/16414210:54
*** teju has joined #openstack-ironic10:55
*** ramineni1 has joined #openstack-ironic11:02
*** ramineni has quit IRC11:02
*** ramineni1 has quit IRC11:03
openstackgerritVladyslav Drok proposed openstack/ironic: Removed hardcoded IDs from "chassis" test resources  https://review.openstack.org/13320511:05
*** jcoufal has quit IRC11:08
*** jcoufal has joined #openstack-ironic11:08
*** dmellado has quit IRC11:08
*** jcoufal has quit IRC11:10
takadayuikoHmm, it doesn't work well even though changing IRONIC_DISCOVERD_DHCP_RANGE and IRONIC_DISCOVERD_INTERNAL_IP...11:12
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Do not save auth token on TFTP server in PXE driver  https://review.openstack.org/15981911:14
dtantsurtakadayuiko, please paste logs and local.conf again11:15
takadayuikodtantsur, thanks. Are you OK now? lunch time? local.conf is as this; http://paste.openstack.org/show/197684/11:19
*** vdrok_afk is now known as vdrok11:19
dtantsurtakadayuiko, already had lunch, thanks11:20
dtantsurtakadayuiko, local.conf looks fine, now logs please11:20
*** romcheg has quit IRC11:23
takadayuikoin this time, node doesn't boot maybe because of blacklisted. screen-ironic-discoverd.log: http://paste.openstack.org/show/197685/11:23
takadayuikoI deleted messages a little because it was too long11:23
*** romcheg has joined #openstack-ironic11:23
tiagogomes_Can some one explain to me the purpose of the remapping rules on http://docs.openstack.org/developer/ironic/deploy/install-guide.html#configure-neutron-to-communicate-with-the-bare-metal-server11:29
*** jistr is now known as jistr|english11:32
*** jistr|english is now known as jistr|class11:33
dtantsurtakadayuiko, hmm, how did you start the introspection?11:33
takadayuikodtantsur, just executed API, like curl -g -i -X POST http://192.168.100.10:5050/v1/introspection/50d273af-1197-4336-95b5-666b7e3f8694 -H "X-Auth-Token: 79133057ea8c4a20b795cd6418e24309"11:33
dtantsurtakadayuiko, the thing is, I don't see this call in logs. did it succeed?11:34
dtantsurtakadayuiko, also updated https://etherpad.openstack.org/p/DiscoverdDevStack with instructions on how to avoid CURL :)11:36
takadayuikodtantsur, The reason is I removed. Well, API-executed-log was written in the log; INFO:werkzeug:192.168.100.10 - - [31/Mar/2015 12:30:59] "POST /v1/introspection/50d273af-1197-4336-95b5-666b7e3f8694 HTTP/1.1" 202 -11:36
takadayuikodtantsur, Wao! thanks!11:37
dtantsurtakadayuiko, could post the full log please? (also note that debug mode is not very helpful, it's safe to disabled it)11:38
takadayuikodtantsur, sure. I'll stack.sh again, so that it will take a little.11:38
dtantsurifarkas, hey, mind reviewing https://review.openstack.org/#/c/168354/ before you go on PTO? :)11:46
ifarkasdtantsur, sure thing ;-)11:46
*** dmellado has joined #openstack-ironic11:47
*** saripurigopi has quit IRC11:48
*** ChanServ changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/developer/ironic/ | Bugs: https://bugs.launchpad.net/ironic"11:49
-openstackstatus- NOTICE: Check/Gate unstuck, feel free to recheck your abusively-failed changes.11:49
*** Haomeng|2 has joined #openstack-ironic11:50
*** Haomeng has quit IRC11:51
*** romcheg1 has joined #openstack-ironic11:51
*** romcheg has quit IRC11:52
dtantsurdevananda, are we granting string freeze exception to https://review.openstack.org/#/c/165788/ ?11:54
dtantsur... and to https://review.openstack.org/#/c/168030/11:54
*** romcheg has joined #openstack-ironic11:56
takadayuikodtantsur, I've tried, and it fails with "502 Server Error: Bad Gateway" at "openstack baremetal introspection start <uuid>".11:57
openstackgerritjiangfei proposed openstack/python-ironicclient: Log the SHA1 hash of X-Auth-Token value  https://review.openstack.org/16251711:58
takadayuikoit's same as directly executing "openstack baremetal introspection star" command.11:58
*** romcheg1 has quit IRC11:58
dtantsurO_o11:58
takadayuikoit's weired. BTW, it's PM9::00 here. I have to go home and cook for my hasband :(11:59
dtantsurtakadayuiko, oh sorry for keeping you here :(11:59
dtantsurI think I'll approve the devstack thing and then let's fix your case...12:00
dtantsurI think you're not the last one for whom this plugin won't work :D12:00
dtantsurg'night12:00
takadayuikodtantsur, no problem at all, It's sorry taking your time and thank you very much.12:00
dtantsur:)12:01
takadayuikoI'll investigate tomorrow ;)12:01
takadayuikoBye.12:01
*** takadayuiko has quit IRC12:01
*** ndipanov has quit IRC12:03
*** teju has left #openstack-ironic12:04
*** lucasagomes is now known as lucas-hungry12:04
*** mgoddard has joined #openstack-ironic12:06
*** zhenguo has quit IRC12:07
*** dprince has joined #openstack-ironic12:09
*** pas-ha has quit IRC12:18
openstackgerritMerged stackforge/ironic-discoverd: Proper errors handling for client  https://review.openstack.org/16835412:19
openstackgerritMerged stackforge/ironic-discoverd: Add DevStack plugin for ironic-discoverd  https://review.openstack.org/16478212:19
*** mgoddard has quit IRC12:23
* rameshg87 goes home12:23
*** rameshg87 has quit IRC12:23
devanandadtantsur: 169253 seems fine to me12:26
dtantsurgood12:27
openstackgerritjiangfei proposed openstack/python-ironicclient: Log the SHA1 hash of X-Auth-Token value  https://review.openstack.org/16251712:31
*** pas-ha has joined #openstack-ironic12:32
*** trown|outttypeww is now known as trown12:42
*** mgoddard has joined #openstack-ironic12:51
*** lucas-hungry is now known as lucasagomes12:53
*** mgoddard has quit IRC12:56
*** jistr|class is now known as jistr12:58
*** rameshg87 has joined #openstack-ironic13:01
openstackgerritMerged openstack/ironic: DRAC: add retry capability to wsman client operations  https://review.openstack.org/16586013:04
*** Marga_ has joined #openstack-ironic13:11
*** Marga_ has quit IRC13:11
tiagogomes_Hi, the image deployed by Ironic is hanging at "Trying to unpack rootfs image as initramfs". Any ideas? I used disk-image-builder to create the images13:11
*** Marga_ has joined #openstack-ironic13:12
*** logan2 has quit IRC13:16
*** rloo has joined #openstack-ironic13:19
*** logan2 has joined #openstack-ironic13:19
*** kkoski has joined #openstack-ironic13:21
*** kkoski has quit IRC13:22
*** kkoski has joined #openstack-ironic13:22
openstackgerritRamakrishnan G proposed openstack/ironic: Remove inspect_ports from ilo inspection  https://review.openstack.org/16930313:29
rameshg87tiagogomes_: how much memory does your system have ?13:30
rameshg87tiagogomes_: and how bug is the ramdisk ?13:30
rameshg87tiagogomes_: is it a virtual machine ?13:30
tiagogomes_rameshg87 yes, it is a VM for the time being13:30
tiagogomes_ramdisk is 83M13:31
tiagogomes_the VM has allocated 256M of RAM13:31
Shrewstiagogomes_: i think DiB created images require at least 3GB of RAM on the VM. I'm not quite sure why, but it stinks, I know  :(13:34
rloomorning ironic'ers13:35
Shrewsrloo: morning13:35
rlooDoes anyone understand the string freeze? I thought we weren't supposed to approve any new strings: https://review.openstack.org/#/c/165860/13:36
Shrewsrloo: hrm, i thought the freezes were very short lived... like, during the week of the release13:36
rlooShrews: I thought it was til end of kilo13:37
tiagogomes_Shrews ta, I'll try that13:37
TheJuliatiagogomes_: If your using IPA, I think you need at least 500MB-1GB to be able to expand the agent image13:37
Shrews"The string freeze is maintained for every module affected by the freeze until the release branch is cut. When that happens, the string freeze is lifted from master."13:37
rlooShrews: yeah, so until kilo release13:38
Shrews*sigh*13:38
rlooShrews: +213:38
TheJuliatiagogomes_: from there, the file your writing out is downloaded into RAM, and the file is written out to disk.13:38
rlooShrews: so we're not supposed to approve new strings, right?13:38
devanandadtantsur: i've updated mgoddard's nova fix - https://review.openstack.org/#/c/153230/13:39
*** rameshg871 has joined #openstack-ironic13:39
rlooShrews: unless we accidentally do it. Hmm...13:39
devanandadtantsur: if you have hardware with >1 NIC that you have been testing with, I'd like to know what you find13:39
devanandastring freeze is "dont approve unnecessary or very large changes to the translated strings"13:40
devanandait's not "dont approve any at all"13:40
*** ukalifon1 has quit IRC13:40
rloodevananda: so we can use our judgement?13:40
devanandaand yes, it is from k3 tag until rc113:40
dtantsurinteresting, will test. lucasagomes, also have a look at https://review.openstack.org/#/c/153230/13:40
devanandaso that translation teams have time to, you know, translate it13:40
rloodevananda: or do/should we ask you?13:40
tiagogomes_TheJulia, I am using the pxe_ipmi driver, does that uses IPA?13:41
lucasagomeswill do13:41
devanandarloo: preferrably, ask me, but there is a part of my mind right now that's wondering whether there is any benefit to Ironic in following the string freeze this cycle13:41
devanandahttps://www.transifex.com/projects/p/ironic/13:41
rloodevananda: that was in my mind in Juno too. I think not.13:41
*** romcheg1 has joined #openstack-ironic13:41
devanandaare all quite low still13:41
*** romcheg has quit IRC13:41
devanandaunless they hit the threshold (80% IIRC) the translations won't be included at all13:42
*** rameshg87 has quit IRC13:42
Shrewspfft13:42
rloodevananda: right. And I'm doubtful that they will do much this time. And what's the odds that they will have translated something that we might change in the near future13:42
devanandaah, 75%13:43
devanandahttps://wiki.openstack.org/wiki/Translations/Infrastructure#Workflow13:43
devananda" The script connects to Transifex and asks to download for each resource all new "sufficiently translated" files. We define "sufficiently" as at least 75 per cent of strings are translated."13:43
TheJuliatiagogomes_: if memory serves, iscsi, so I think your max required is something like 1GB13:44
rloodevananda: maybe we can translate the english (UK) and english (australia) ones. I mean, how hard could those be :-)13:45
devanandarloo: ;)13:45
TheJuliaheh13:45
lucasagomesdtantsur, O.O I thought we only needed to filter the macs returned on the macs_for_instance() method?13:46
TheJuliaSomebody should just write a script that translates the strings to latin13:46
rloodevananda: so I think I spend more time wondering about whether we can approve a patch cuz of strings, than is warranted given our current xlated string situation. So I'm going to ahh, use my own judgement to decide ;)13:46
dtantsurlucasagomes, not sure I understand the question...13:46
openstackgerritRamakrishnan G proposed openstack/ironic: Remove inspect_ports from ilo inspection  https://review.openstack.org/16930313:46
rameshg871dtantsur: ^^ tested :)13:46
devanandarloo: great :)13:46
dtantsurrameshg871, cool!13:46
lucasagomesdtantsur, the patch you told me to take a look13:46
*** rameshg871 is now known as rameshg8713:47
dtantsurlucasagomes, I've no idea about it's contents :) devananda has updated it and I though you might be interested13:47
jrollmorning all :)13:47
dtantsurlucasagomes, we can apply it to our nova and try13:47
lucasagomesI thought that the nova part, would be just to filter out the ports in Ironic which are bootable and return their mac addresses to nova13:47
rameshg87morning jroll13:47
lucasagomesbut that patch is doing way more than it13:47
dtantsurjroll, TheJulia, Shrews, morning13:48
lucasagomesdtantsur, I see13:48
lucasagomesyeah wroth trying13:48
rameshg87morning everyone13:48
lucasagomesjroll, TheJulia rloo morning13:48
jrolldevananda: so um. do we want to commit to that node.extra['physical_network'] thing? that's a bit of a data model change that we might want to think on13:48
lucasagomesdevananda, https://review.openstack.org/#/c/153230/ perhaps I need to read more about the problem this patch is trying to fix13:48
lucasagomesbut would be enough to just filter out the macs that can be PXE booted in the macs_for_instance() method?13:49
rloooh yeah, morning devananda (wherever you are), jroll, lucasagomes, dtantsur, TheJulia, rameshg8713:49
dtantsurrloo, morning!13:49
rameshg87rloo: morning13:49
jrolllucasagomes: see the bug there, tl;dr nova has one network and picks a NIC at random to attach it to... your idea might be ok for now but will break later when we try to support multiple networks13:49
devanandare the multiple NIC issue,https://review.openstack.org/#/c/153230/ looks like it should address the issue where different NICs are on different networks13:49
devanandahowever there are two issues still not directly solved by it13:50
devananda1) which NIC(s) are bootable via PXE isn't explicit, but by creating different networks and associating the port to the right one, you can model it13:50
jrolldevananda: side note, according to docstrings it looks like you're still changing the API there (but I don't think you actually are)13:51
devanandait appears that you need to request multiple networks to get multiple ports via Nova13:51
jrollyes. and there's a false assumption that number of networks == number of ports13:52
devanandawhich makes sense in VM-land but no sense in physcal-server-land. however, I'm not sure how much we would need to change in Nova to fix this13:52
devanandajroll: exactly13:52
devanandajroll: so even if we expose >1 port here, if they're all on one network, nova will only process one port13:53
* rameshg87 wonders if nova will have problems with breaking macs_for_instance for out-of-tree drivers 13:53
jrolla long-standing comment in a downstream hack: "# TODO(russell_h): this is based on the broken assumption that the number of Neutron ports will match the number of physical ports."13:53
devanandajroll: fwiw, this is still requiring a change to ironic. one must pass some extra info on the port object so nova knows what network to put it on13:53
devanandajroll: aaahahaha13:53
devanandajroll: so what's the code that follows it? :)13:53
*** logan2 has quit IRC13:53
jrolldevananda: right, which is why I think we need to punt on it and do it right?13:54
jrolls/?//13:54
devanandajroll: yes13:54
jrolldevananda: for port in ports: attach_tenant_net(port)13:54
jrollby the grace of $deity, we happen to have two NICs on our servers and two networks that we attach13:55
devanandajroll: and no bonding13:56
jrollyes bonding13:56
devanandaoh13:56
firldevananda: I went through and put my flat network on the same management network so that the TFTP clients would be able to reach the IP. Now the qdhcp namespace responds to the DHCP requests, however it tries to pull the boot files ( TFTP ) off from the qdhcp ip instead of the IP on the network. Any ideas?13:56
*** logan2 has joined #openstack-ironic13:56
devanandafirl: your dhcp config is pointing to the wrong ip?13:57
firldevananda: the dhcp is auto configured based upon the subnet create13:58
devanandafirl: using neutron?13:58
firlam I missing a config option in ironic / neutron?13:58
firlya13:58
firlneutron subnet-create dot8 10.0.8.0/24 --name dot8 --ip-version=4 --gateway=10.0.8.1 --allocation-pool start=10.0.8.100,end=10.0.8.200 --enable-dhcp13:59
devanandafirl: using which driver in ironic?14:00
firlipmi_pxe14:01
firlshould the qdhcp namespace be able to respond on the TFTP?14:01
devanandafirl: /etc/ironic/ironic.conf should have a [pxe] section with tftp_server=x.x.x.x14:01
firlgot it14:02
firltftp_server=$my_ip14:02
devanandafirl: that may or may not be related to your issue. pxe should try to infer that14:02
devanandayea14:02
firlcool I will try that14:02
devanandathat IP will get passed to Neutron for dhcp next-server response14:03
devanandasounds like it isn't, so that's where i'd look14:03
*** absubram has joined #openstack-ironic14:04
*** yog__ has quit IRC14:05
*** ChuckC has quit IRC14:09
*** Marga_ has quit IRC14:20
*** enikanorov has quit IRC14:23
firlTFTP.....P:110.0.8.14  MASK: 255.255.255.0  DHCP IP: 10.0.8.101 TFTP.32: TFTP open timeout14:24
firllooks like no dice still14:24
*** enikanorov has joined #openstack-ironic14:27
*** anderbubble has joined #openstack-ironic14:28
*** viktors has quit IRC14:30
openstackgerritMerged openstack/ironic: Use node UUID in logs instead of node ID  https://review.openstack.org/16762314:30
*** absubram has quit IRC14:31
*** zz_jgrimm is now known as jgrimm14:31
*** BadCub_Hiding is now known as BadCub14:35
BadCubmorning folks14:35
lucasagomesdevananda, jroll so lemme see if I understood that nova patch right. With that nova will create a  network for each physical_network that is passed with the mac addresses?14:36
lucasagomesI'm wondering in the case we have 2 ports, and they have the same physical_network14:36
devanandalucasagomes: right. it does not handle that case14:37
lucasagomeswill nova create the 2 network for both ports?14:37
lucasagomesBadCub, morning14:37
lucasagomesdevananda, right14:37
devanandalucasagomes: it only addresses the case where i have >1 network, and one port on each network14:37
devanandaor the case where I have 1 network, and only one port on tht network, and  iwant to ignore all the other ports14:37
TheJuliaBadCub: good morning14:37
devanandag'rmonring BadCub14:38
* devananda tyep gdoo14:38
lucasagomesdevananda, I see, in that case wouldn't another metadata be useful?14:38
devanandagah14:38
lucasagomeslike primary=True14:38
lucasagomesmeaning that, a port which has that is the one pick14:38
devanandalucasagomes: well, maybe. but there are a lot of other cases to consider too. and whether or not nova will allow us to model the case where >1 port is on the same phys network AND we want them all to work14:39
*** ChuckC has joined #openstack-ironic14:39
jrollif they don't allow that, I'll be really sad14:41
lucasagomesdevananda, right yeah fair enough14:41
lucasagomesjroll, yeah I hope they do, I'd love to be able to specify precisely which port I want to use14:42
lucasagomesamong many ports14:42
jrolllucasagomes: I mean like, take my ball and go home kind of sad14:42
lucasagomesbut that said, it also makes us to look into ironic itself. why we register many ports if not of all of them are going to be used14:43
lucasagomesshould we change something in our part too?14:43
* lucasagomes brainstorms14:43
jrollI mean, multiple networks is pretty dang valid for bare metal14:44
jrolland you'll likely only be booting once14:44
lucasagomessure14:44
jrolle.g. at rackspace our hypervisors have at least two different networks14:45
jrollpxe booting one*14:45
dtantsurin our case it's also different networks14:45
*** anderbubble has left #openstack-ironic14:45
NobodyCamgood morning Ironic14:46
*** edcragg has joined #openstack-ironic14:46
BadCubugh. morning TheJulia , devananda and lucasagomes14:46
devanandamorning14:46
lucasagomesNobodyCam, hey ya morning14:46
NobodyCammorning lucasagomes, dtantsur jroll and devananda14:47
jrollmorning NobodyCam :)14:47
dtantsurNobodyCam, morning14:47
NobodyCam:)14:48
devanandalucasagomes: given our earlier conversation re: string freeze ... 167122 ?14:48
devanandalucasagomes: just posing the question. i dont feel strongly either way on that one14:48
*** romcheg has joined #openstack-ironic14:48
lucasagomesdevananda, right, since it wasn't fixing any bugs just enhancing the message I thought it felt into the string freeze14:49
lucasagomesI don't have a strong feeling on that too14:49
lucasagomesplus, knowing that we are way low % on the translations14:49
lucasagomesand it won't even be included in the release14:49
lucasagomeswe could give it a go14:50
devanandalucasagomes: meh. you're right. not actually fixing anything.14:50
devananda*any particular bug14:50
lucasagomesyeah14:50
lucasagomesthat's why I blocked it14:50
*** romcheg1 has quit IRC14:50
lucasagomesI mean it's a nice improvement on the log message to know the number of attempts14:51
lucasagomesbut not critical or anything14:51
*** hj-hp has joined #openstack-ironic14:51
*** ndipanov has joined #openstack-ironic14:51
devanandayea, well, after using this a bit more i kinda think that we should move all of those sort of things to DEBUG level14:51
devanandabecause hardware *is* flaky. ironic's job (one of htem) is to handle that14:52
*** mgoddard has joined #openstack-ironic14:52
devanandaso logging a WARNING every time a bmc is a litte slow --- this just adds noise for the operators who are looking for service problems in the logs14:52
devanandajroll: JayF: thoughts ^ ?14:52
jrolldevananda: do we expect most people to run without DEBUG level?14:53
devanandaor perhaps s/DEBUG/NOTICE/14:53
jrolldevananda: in our experience, slow BMCs can *really* mess up an environment14:53
jlvillalGood morning Ironic.14:54
NobodyCamgood morning jlvillal14:54
devanandajroll: beyond the node on which that bmc exists?14:54
BadCubmornin jlvillal14:54
devanandajroll: ie, because it causes timeouts in the periodic tasks?14:54
lucasagomesjlvillal, morning14:54
jrolldevananda: yeah, if the power loop lags things go badly, worker threads get tied up, long locks etc14:54
devanandagotcha14:54
devanandawe should fix that14:54
devanandapower loop shouldn't (b)lock14:55
jrolldevananda: when we started standing up prod, it was unusable until we disabled a few slow nodes14:55
jrollyeah14:55
* devananda adds to priorities14:55
* jlvillal thinks he will working on setting up ZoZ (Znc on Znc) today14:56
jrollO.o14:58
lucasagomesthere's a way to see how many times a job in gate failed or passed?14:58
lucasagomesjenkins just shows that? /me looks14:58
devanandalucasagomes: the job, not the change?15:01
lucasagomesyeah the job15:01
lucasagomesI want to see if the if the pxe_ipa is stable15:01
lucasagomesit seems it is, but I wanted to know %15:02
devanandalogstash, or look at adam's stats page15:02
lucasagomesah cool, will take a look! devananda thanks15:02
devanandalucasagomes: http://no-carrier.net/~adam/openstack/ironic_gate_status.html15:02
lucasagomesnice, the job doesn't seem to be there we should include it :)15:03
lucasagomesthe page is cool anyway15:03
devanandahttp://no-carrier.net/~adam/openstack/ironic_gate.html15:03
devanandaoh - pxe_ipa15:04
devanandaright, yea, not there15:04
devanandalucasagomes: have a look at graphite.openstack.org -- you can make what ever graph you want15:04
lucasagomesoh will take a look15:06
lucasagomesthanks15:06
devanandalucasagomes: http://graphite.openstack.org/render/?width=1086&height=384&_salt=1399585848.568&target=sumSeries%28stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-ironic-pxe_ipa-nv.FAILURE%29%29&target=sumSeries%28stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-ironic-pxe_ipa-nv.SUCCESS%29&lineMode=connected&connectedLimit=&areaMode=all&colorList=red%2Cgreen15:07
devanandathat's a start -- it doesn't show a comparison for where that job failed but others passed15:07
devanandawhich is what you really want to see15:08
lucasagomesdevananda, heh i was just trying to get used to that interface, now I can see the folders on the left side with the data you can grab15:08
lucasagomesdevananda, thanks for that :D15:08
devanandayvm!15:08
devanandayvw, even15:08
devanandaalso, i just edited the URL to change the test name ;)15:09
devanandagoing to drop off for dinner in about 20 minutes15:09
devanandataking another qiuck look at our RC1 bug list ... it's long ... perhaps I've targeted too much to it?15:10
lucasagomesdevananda, enjoy dinner15:12
lucasagomeshttp://graphite.openstack.org/render/?width=1411&height=794&_salt=1427814736.728&target=stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-ironic-pxe_ipa-nv.FAILURE&target=stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-ironic-pxe_ipa-nv.SUCCESS&from=00%3A00_20150310&until=23%3A59_2015033115:12
lucasagomeslooks pretty stable15:12
dtantsurdevananda, we can start dropping things from the list later :)15:12
dtantsuralso enjoy your meals15:13
* lucasagomes liks graphite15:13
* dtantsur drops off for food shopping for some time15:13
devanandahuh. I thought this was already addressed? https://bugs.launchpad.net/ironic/+bug/141256115:16
openstackLaunchpad bug 1412561 in Ironic "IPA/DIB is not compatible to create the uefi capable images" [Medium,Confirmed]15:16
devanandaor should that be targeted as a bug to DIB, not Ironic?15:16
*** a1exhughe5 has joined #openstack-ironic15:18
*** Marga_ has joined #openstack-ironic15:19
mjturek1hey all, I'm trying to use the python apis. Can anyone point me to the methods in the python APIs to get the extra, driver_info, and properties of an ironic node?15:19
jrollJoshNang: left a comment here https://review.openstack.org/#/c/168197/15:21
lucasagomesdevananda, yeah indeed it looks like it's related to the image building process15:22
firldevananda: http://pastebin.com/z4ercBK4 I seem to be stuck. Does this seem to be an issue with ovs / neutron?15:22
jrollmjturek1: it should be in the node show response /me looks15:22
lucasagomesso ironic + dib seems correct15:22
lucasagomesironic because ipa uses the ironic bug tracker15:22
lucasagomesdevananda, https://bugs.launchpad.net/nova/+bug/1177655 I think this, would need to be L15:22
openstackLaunchpad bug 1177655 in Ironic "kernel boot command line for baremetal assumes block device UUID is correct root" [Medium,Triaged]15:22
jrollmjturek1: sorry, node.get15:22
lucasagomesbecause that also needs to change in the way the images are builded, so that we can build the root partition with a specific label15:23
*** zigo__ is now known as zigo15:23
mjturek1jroll oh sweet, perfect! thanks :)15:24
jrollnp :)15:24
jrollJoshNang: also curious why we need to bump this so high (this may have been asked before) https://review.openstack.org/#/c/168175/4/lib/tempest15:25
JoshNangjroll: your comment is correct, i meant to remove that code and add it as a separate patch with some extra handling.15:27
jrolloh!15:27
jrollyay, I found a thing15:27
JoshNangi think i left a comment on that review...i put it to 10 mins because it was timing out before the agent even got booted15:27
JoshNangi'll check how long it actually took and bump it down15:27
jrollah ok15:28
jrollright, we have to boot the agent again15:28
jrollno worries then :)15:28
lucasagomessomeone understand this bug here? https://bugs.launchpad.net/ironic/+bug/132726015:28
openstackLaunchpad bug 1327260 in Ironic "Disk layout is not being verified on re-provisioning" [Medium,Triaged]15:28
lucasagomesI mean, we destroy the disk layour when provisioning the node, so...15:28
jrollJoshNang: "I bumped the timeout way up just to test. 10 minutes is definitely unreasonable." they probably won't merge with that comment there :P15:28
devanandalucasagomes: "rebuild" ?15:28
jrolllucasagomes: sounds like rebuild15:28
jrollthat's an interesting bug15:29
JoshNangjroll: heh and it's not my patch, so i couldn't workflow :P15:29
devanandayea, if someone changes the data in ironic then starts a rebuild, it'll break15:29
lucasagomesoh15:29
lucasagomesgotcha15:29
jrollJoshNang: oh, oops. tests should catch it if it's too short right?15:29
*** spandhe has joined #openstack-ironic15:30
lucasagomeslike root_gb ephemeral_gb and so on15:30
lucasagomesyeah15:30
lucasagomesmakes sense15:30
JoshNangjroll: for sure15:30
devanandalike if I change root_gb and swap_mb15:30
jrolldevananda: I think it's the reverse here, someone changes the disk layout on the disk?15:30
devanandajroll: oh. that too15:30
jrollmaybe not15:30
*** maurosr has quit IRC15:30
jrollat any rate15:30
lucasagomesthat can get really funny... heh15:30
devanandajroll: if I parted and shrink root, for example, then try to rebuild, yea, I think that would break15:30
jrollyou can't preserve ephemeral in that case15:30
*** ramineni has joined #openstack-ironic15:30
devanandawell, right :)15:30
lucasagomesnot sure whether we should allow changing such things when the machine is deployed15:31
jrollwhich is what the bug is about15:31
devanandathe whole preserve ephemeral is somewhat .... awkward15:31
jrolland an oxymoron15:31
jrollI hate it15:31
devanandaindeed15:31
lucasagomeslol15:31
lucasagomesyeah15:31
devanandai think we all do15:31
devananda*have some issues with it15:31
lucasagomesis tripleo still using it?15:31
jrollI'm sure they are, but I really have no idea15:31
jrolllooks like fuel is using it based on this bug ;D15:32
devanandain any case, I need to run (car's waiting). I targeted some of these bugs so we'd look at them as they're old and sound bad15:33
lucasagomesyeah, imo the only way to safely fix that bug is to prevent those sizes from being updated if the node is already deployed15:33
lucasagomesit's not only recreating the partition layout if, say the first partition is now bigger15:33
*** spandhe_ has joined #openstack-ironic15:33
lucasagomeswe would have to move data around15:33
lucasagomeswhich I'm pretty sure we don't want to do15:33
jroll+115:33
devanandamaybe they're not valid any more, or maybe the right thing to do is just more error checking :)15:34
*** spandhe has quit IRC15:34
*** spandhe_ is now known as spandhe15:34
devanandalucasagomes: blocking changes to node.properties while it is state=active makes some sense. i think we tried that a couple cycles ago though and had a problem?15:34
* devananda really goes afk now15:34
*** maurosr has joined #openstack-ironic15:35
lucasagomesdevananda, hmm can't recall. But yeah I think we should prevent only a subset of it15:36
*** mgoddard has quit IRC15:36
lucasagomesstatic things like disk layout, things like memory_gb still can be updated15:36
* lucasagomes have to think more about it15:37
firldevananda: the TFTP server isn’t listening on the qdhcp ip namespace. Should it be? right now my PXE client gets an IP from the qdhcp namespace but can’t connect to the tftp server because it is passing the same IP. and the TFTP IP config change didn’t seem to matter15:44
*** ifarkas has quit IRC15:44
*** ramineni has quit IRC15:45
*** dprince has quit IRC15:46
*** saripurigopi has joined #openstack-ironic15:47
* BadCub has to reboot for lovely updates. BRB15:50
*** a1exhughe5 has quit IRC16:00
*** rloo has quit IRC16:02
openstackgerritJosh Gachnang proposed openstack/ironic: Fix cleaning nits  https://review.openstack.org/16819716:05
*** jistr has quit IRC16:09
jrollJoshNang: you missed the other nits there :P16:10
JoshNangjroll: oh gah, got distracted by the weirdness.16:10
*** Sukhdev has joined #openstack-ironic16:11
jrollalso uh16:11
jrollso do we not handle reboots for in-band things at all right now?16:11
JoshNangyeahhh16:11
*** saripurigopi_ has joined #openstack-ironic16:12
JoshNangi was working on a patch for it yesterday but got distracted by the decom->cleaning thing16:12
jrollok16:13
*** saripurigopi has quit IRC16:14
jrollthanks, +216:14
*** saripurigopi_ is now known as saripurigopi16:14
*** dprince has joined #openstack-ironic16:14
openstackgerritJosh Gachnang proposed openstack/ironic: Fix cleaning nits  https://review.openstack.org/16819716:15
JoshNangjroll: oh blah, i was just waiting on tests after fixing the nits from NobodyCam16:16
jrolloh, no worries :)16:16
JayFMeeting today in 40m, correct?16:19
jrollno?16:19
jrollit was last night16:19
jrollit's tuesday :)16:19
*** derekh has quit IRC16:21
JayFHAH16:21
JayFIt's monday in my head, doesn't that count for anything16:22
jrollno, because this week was the late meeting ;D16:22
*** mgoddard has joined #openstack-ironic16:26
*** mtanino has joined #openstack-ironic16:27
NobodyCamso many calls this morning :-p16:27
* BadCub no like late meeting *grumbles at coffee cup*16:30
*** spandhe has quit IRC16:35
*** harlowja_away is now known as harlowja_16:45
openstackgerritRamakrishnan G proposed openstack/ironic: Check status of bootloader installation for DIB ramdisk  https://review.openstack.org/16941916:46
*** absubram has joined #openstack-ironic16:47
rameshg87folks ^^^^^16:47
rameshg87above is a proposed fix for our last critical bug for rc-116:47
rameshg87https://bugs.launchpad.net/ironic/+bug/142272316:47
openstackLaunchpad bug 1422723 in Ironic "Ironic sets instance as active even if bootloader installation fails when boot_option is 'local'" [Critical,In progress] - Assigned to Ramakrishnan G (rameshg87)16:47
rameshg87(last for now)16:48
rameshg87haven't fixed the tests/flake816:48
rameshg87but wanted to know if jenkins goes through and would love to get some quick feedback from someone16:48
rameshg87i will fix the tests and rest of the things tomorrow16:48
rameshg87thanks16:48
rameshg87and good night all16:49
rameshg87see you tomorrow16:49
rameshg87bye16:49
*** rameshg87 has quit IRC16:49
*** Marga_ has quit IRC16:49
jrolldevananda: hahahaha, I found my thing with the conductors. clock skew.16:57
*** rloo has joined #openstack-ironic16:57
*** saripurigopi has quit IRC16:57
BadCubhey folks... Going through our old bugs... Is anyone still seeing this issue: https://bugs.launchpad.net/ironic/+bug/131985816:59
openstackLaunchpad bug 1319858 in Ironic "default api loop count / intervals can't cope with 40 machine clusters" [High,Confirmed]16:59
jrollBadCub: the default is better, but doing callbacks could make it even better https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L8417:00
jrollwhich is why we left that open17:01
openstackgerritJay Faulkner proposed openstack/ironic: Cleaning docs followup: Add that it's new in Kilo  https://review.openstack.org/16942317:02
*** saripurigopi has joined #openstack-ironic17:03
JayFhttps://review.openstack.org/#/c/168189/ is ready to land, and ^ 169423 is the followup for one of the nits17:03
JayFthe first patch only needs one more +2A, lots of +1s17:03
NobodyCamjroll: think that old bug still need to be left at High?17:05
*** andreykurilin_ has joined #openstack-ironic17:05
JayFjroll: ^ you could land 168189 fwiw :D17:05
* BadCub adds followup cleaning doc to pad17:05
jrollNobodyCam: dunno, it's going to end up as a spec17:06
NobodyCamya17:07
BadCubjroll: NobodyCam I changed it to Wishlist and noted that it will end up requiring a spec17:08
jrollcool, thanks17:09
BadCubyw :)17:09
*** kalpase has left #openstack-ironic17:11
NobodyCamJayF: look at the new doc (which is awesome TY)17:11
NobodyCamparagraph 5 under Troubleshooting17:12
NobodyCamteh last sentence : It will restart cleaning from the first step17:12
NobodyCamoh NM nodes got thru cleading moving from MANAGEABLE to AVAILABLE17:13
openstackgerritJulia Kreger proposed openstack/ironic: Add retry logic to _exec_ipmitool  https://review.openstack.org/16812017:13
NobodyCamw00 h00 TheJulia :)17:14
*** dtantsur is now known as dtantsur|afk17:14
TheJuliaThat... was not fun :)17:14
JayFNobodyCam: ah, I'll add that fix to my followup17:14
openstackgerritShivanand Tendulker proposed openstack/ironic: boot_mode is overwritten in node properties  https://review.openstack.org/16795217:14
NobodyCamJayF: ack I'll +a then :)17:14
openstackgerritJay Faulkner proposed openstack/ironic: Cleaning docs followup: Add that it's new in Kilo  https://review.openstack.org/16942317:15
openstackgerritShivanand Tendulker proposed openstack/ironic: pxe deploy fails for whole disk images in UEFI  https://review.openstack.org/16788217:15
openstackgerritJay Faulkner proposed openstack/ironic: Followup to comments on Cleaning Docs  https://review.openstack.org/16942317:15
openstackgerritShivanand Tendulker proposed openstack/ironic: grub2 bootloader support for uefi boot mode  https://review.openstack.org/16619217:16
openstackgerritShivanand Tendulker proposed openstack/ironic: Secure boot support for pxe_ilo driver  https://review.openstack.org/15480817:16
NobodyCambam17:17
lucasagomeshey folks I will call it a day17:19
lucasagomeshave a good night everyone17:19
*** lucasagomes is now known as lucas-dinner17:19
NobodyCamhave a great night lucas-dinner17:19
BadCubg'night lucas-dinner17:20
* NobodyCam gets more offee17:20
JayFnight lucas17:20
*** achanda has joined #openstack-ironic17:23
*** Marga_ has joined #openstack-ironic17:24
*** pas-ha has quit IRC17:27
*** Sukhdev has quit IRC17:35
NobodyCamdidn't we fix this already: https://bugs.launchpad.net/ironic/+bug/1403887 ?17:38
openstackLaunchpad bug 1403887 in Ironic "No such file or directory error during deployment" [High,Triaged]17:38
*** jerryz_ has quit IRC17:39
JayFNobodyCam: that was fixed in /ipa/17:39
JayFNobodyCam: was it fixed in Ironic-proper?17:39
JayFThinking fix for this is `udevadm settle`; right?17:39
NobodyCamwith the udevadm settle?17:39
JayFthe udevadm settle 100% landed in IPA17:39
TheJuliaNobodyCam: could you be thinking of a similar issue downstream ?17:39
JayFidk about Ironic-pxe17:39
NobodyCamya..17:40
NobodyCamTheJulia: I could be17:40
TheJuliaNobodyCam: I remember talking about it, I'm thinking it was something like the iscsi connection was blipping in the rack due to the switchports, I remember we requested information w/r/t the switch configuration and I think thats where it was left off.17:45
NobodyCamya I think I'm thinking of https://bugs.launchpad.net/ironic/+bug/141511717:46
openstackLaunchpad bug 1415117 in Ironic "iSCSI login depends on fix length sleep to wait for connections to become active" [Medium,In progress] - Assigned to Chris Krelle (nobodycam)17:46
*** pelix has quit IRC17:50
NobodyCamI'll ask lucas-dinner tomorrow if this is still a issue17:51
* NobodyCam heads out for quick smoke17:53
*** penick has joined #openstack-ironic17:54
*** mtanino has quit IRC17:56
*** spandhe has joined #openstack-ironic17:59
*** saripurigopi has quit IRC18:01
*** jamielennox|away is now known as jamielennox18:04
*** edcragg has quit IRC18:09
JayFDoes anyone know what the Friday of the summit is supposed to be? Nothing at all on the sched for it -- basically wondering if I should be good to fly out Friday afternoon rather than staying overnight to get all day fri in18:09
JayFIn case you haven't seen it; summit schedule: https://openstacksummitmay2015vancouver.sched.org/18:09
jrollJayF: design sessions?18:10
jrollI don't see design sessions on the schedule18:10
JayFhmm18:11
*** Haomeng has joined #openstack-ironic18:11
JayFDesign summit is listed as Tues-Fri18:11
JayFhttps://www.openstack.org/summit/vancouver-2015/details-and-updates/18:11
rlooI thought Fri was going to be sort of like a mini mid-cycle thingy. small pods/groups. up to us/ironic to decide what to do then i think.18:12
JayFI guess I'd need to konw if Ironic sessions were on Fri to make a decision?18:12
JayFAha. Okay, like it was in Paris, then?18:12
*** Haomeng|2 has quit IRC18:12
jrollhrm, this looks interesting: https://openstacksummitmay2015vancouver.sched.org/event/7461140343cb709e3113d353c984842e18:12
JayFI'm just trying to avoid flying on Sun-Sat18:12
rlooyeah, although 'more so'. i think. fewer large design sessions, more smaller things.18:12
jrollJayF: I think it's safe to say friday will be valuable18:12
jrollI'm probably flying out friday evening18:12
rlooby fri aft, i suspect people will be tired/ready to leave.18:12
JayFjroll: there aren't really flights18:12
JayFjroll: which is why I was looking at leaving on the 5-6am flight Sat if I stayed on Fri18:13
jrollJayF: hrm, I'm going to pdx, hopefully there is one18:13
JayFMaybe so, that'll be shorter for sure18:13
rloowhere is pdx?18:13
jrollportland18:13
rloojroll: oh. thx.18:14
jrollgoing to visit friends for the long weekend18:14
jroll:)18:14
JayFNothing YVR->SFO in our corporate travel booking thing that leaves after 3pm on Friday18:14
rloooh, is that a long weekend in the US?18:14
JayFso I'll just book Sun-Sat18:14
JayFoh, is it? I don't think it is...18:14
BadCubas of yesterday the 4Seasons still had some rooms at the conference rate for Vancouver, but you have to call them direct18:14
JayFFirst Monday in May is memorial day18:14
jrolloh, right. cwt.18:14
* jroll cries18:14
JayFyeeep18:15
jrollrloo: yeah, memorial day18:15
jrolllast monday in may18:15
JayFwait, so we have that Monday off? Seriously, that's memorial day?18:15
JayFhrm.18:15
jrollya18:15
rloojroll: my long weekend ends the day the summit starts :-(18:15
* JayF wonders if $wife would want to join him for a pleasant weekend in vancouver18:15
*** dencaval has joined #openstack-ironic18:15
jrollJayF: doeet, vancouver is great from what I hear18:15
jrollrloo: :(18:15
BadCubIsn't conference the 3rd week of May?18:16
JayFno18:16
jrollhttps://www.google.com/search?q=memorial+day+2015&ie=utf-8&oe=utf-818:16
JayFwell, yes18:16
jrollit is18:16
JayFMon May 18- Fri MAy-2218:16
jrollmemorial day is the monday after18:16
JayFand then Mon May 24 is US holiday18:17
jroll25*18:17
jroll:P18:17
BadCuboh hell. That really messes things up18:17
JayFI math real good18:17
jrollJayF: I just assume you still think today is yesterday18:17
JayFHeh18:18
* BadCub has to rethink packing up the RV to head to Washington for summer because of conference *frowns*18:19
JayFWhy not take the RV?18:20
JayFIt's in Vancouver18:20
JayFif you're already in Washington... right there18:20
BadCubThat may end up being the plan18:20
BadCubwe are booked in Sequim, which is 20 minutes south of the ferry to Vancouver18:20
BadCubbut that means the kids will be with us, so I won't be able to go to conference :(18:22
openstackgerritMerged openstack/ironic: Ensure configdrive isn't mounted for ilo drivers  https://review.openstack.org/16770018:26
*** mgoddard has quit IRC18:27
openstackgerritMerged openstack/ironic: Add IPA to enable drivers doc's page  https://review.openstack.org/16809518:27
* NobodyCam needs to run to the cornor store .. brb18:31
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-lib: Updated from global requirements  https://review.openstack.org/16945318:32
BadCubhey adam_g are our current tempest tests addressing this bug: https://bugs.launchpad.net/ironic/+bug/1252824 if so, I will close it out18:34
openstackLaunchpad bug 1252824 in Ironic "RPC exception deserialization is not tested (need integration tests)" [Low,Triaged]18:34
adam_gBadCub, hmm no. im not sure thats something we can test, at least according to the test example described there18:36
BadCubhmm probably why it has been hanging around for so long :-p18:39
* NobodyCam is back-ish18:43
openstackgerritNisha Agarwal proposed stackforge/proliantutils: Adding functionality required by ilo-inspection  https://review.openstack.org/16414218:46
*** achanda has quit IRC18:49
*** Marga_ has quit IRC18:51
NobodyCamrloo: happen to be around?18:53
rlooNobodyCam: yeah, in a meeting. what's up?18:54
NobodyCamoh just had a question on your comment on 16436918:54
NobodyCamit can wait until you done, just wanted to know if the review you pointed out just needed to be added to the comments on that patch or if more code was needed to guard them18:55
* BadCub is going blind sifting through year-old bugs18:56
rlooNobodyCam: there are those two endpoints that will be available in v1.018:56
NobodyCamBadCub: :(18:56
NobodyCamrloo:  ahh ok I'll add them :)18:56
NobodyCamthank you :)18:56
rlooNobodyCam: the GET .../vendor_passthru/methods etc18:56
NobodyCamand good morning rloo :)18:56
rlooNobodyCam: good morning!18:57
NobodyCamya, I'll add them18:57
NobodyCam:)18:57
rlooyou need to add code somewhere to check the version.18:57
rlooNobodyCam: in v1/node.py and v1/driver.py I think.18:59
*** Sukhdev has joined #openstack-ironic19:01
*** Marga_ has joined #openstack-ironic19:02
NobodyCam:) was just looking there19:04
*** Sukhdev has quit IRC19:05
firlanyone know if I should be able to see my SoL console inside the openstack webview of the console / log?19:11
*** spandhe has quit IRC19:13
NobodyCamjlvillal: have you looked at the faliures on 169109? not sure they are real but the ibm 3rd party tet have been mostly stable?19:16
NobodyCamfirl: I have not tested that19:17
firldo you know what the reasons we have the IPMI console parameters then?19:17
firljust future dev? or is there another way to access it19:17
jlvillalNobodyCam: I have glanced at them.  I am going to try a recheck.19:18
jrollNobodyCam: I've never noticed the xcat stuff being stable19:20
*** athomas has quit IRC19:21
NobodyCamjroll: humm19:22
NobodyCamjlvillal: Thank you19:22
NobodyCamfirl: we do have console support19:22
jlvillalNobodyCam: Thanks for pointing it out :)19:22
NobodyCamI was just pointing out that I have not tested it in horzion19:22
*** hj-hp has quit IRC19:24
firlahh gotcha19:24
*** hj-hp has joined #openstack-ironic19:24
firlIs there a doc / guide to working with the console instead of me just SoL from command line? the ironic-conductor keeps stealing the session19:25
firljust don’t know where to view the conductors session19:25
jrolldisable console for the node and the conductor shouldn't grab a session from you?19:26
*** achanda has joined #openstack-ironic19:27
*** Marga_ has quit IRC19:27
firljroll: yeah, I can but if there is an “ironic” way to use it19:28
firlI was trying to leverage that19:28
NobodyCamfirl: that is a area our doc's could use improvment19:28
*** spandhe has joined #openstack-ironic19:28
jrollfirl: I see, I've never used ironic's console thing but I thought it gives you some sort of url for the console?19:29
firljroll: NobodyCam said it hasn’t been tested on horizon. Guess It just might not be visible yet? I don’t mind looking into it, I just don’t know where to start hah19:29
*** Sukhdev has joined #openstack-ironic19:29
jrollfirl: I have no idea about horizon, sorry :)19:30
firlhaha19:30
firlif there is a non horizon url that’d be awesome19:30
jrollsee if ironic node-show $node has some sort of url, maybe in driver_info19:30
firlit’s deploying now, will see if it shows up19:32
firlno url’s, just instance_info19:32
jrollhrm, yeah, dunno. I always just use ipmitool when I need a console :)19:33
* NobodyCam steps away to find his mind and maybe some food stuffs too19:35
*** spandhe has quit IRC19:35
*** Sukhdev has quit IRC19:36
*** Sukhdev has joined #openstack-ironic19:37
firlyeah, I am getting a post PXE boot kernel load error. I figure now I just need to make sure I provisioned the images properly19:41
*** alexpilotti has joined #openstack-ironic19:41
*** hj-hp has quit IRC19:50
*** wanyen has joined #openstack-ironic19:52
openstackgerritMerged openstack/ironic: Add documentation for Cleaning  https://review.openstack.org/16818919:53
*** Sukhdev has quit IRC19:54
wanyenHi, JoshNang, I have a question regarding node zapping and cleaning19:55
*** Marga_ has joined #openstack-ironic19:58
BadCubheya jroll is https://bugs.launchpad.net/ironic/+bug/1300939 still an issue we are looking at?19:59
openstackLaunchpad bug 1300939 in Ironic "API does not translate errors based on Accept-Language header" [Low,Confirmed] - Assigned to Jim Rollenhagen (jim-rollenhagen)19:59
*** hj-hp has joined #openstack-ironic20:01
JoshNangwanyen: hi! ok, i hopefully have an answer :)20:02
*** Marga_ has quit IRC20:03
*** andreykurilin_ has quit IRC20:06
jrollBadCub: lol, I picked that up at the end of kilo and never finished it, I know Haomeng was working on the same thing but maybe fined a different bug?20:07
BadCubhmmm20:08
jrolls/fined/filed20:08
*** dencaval has quit IRC20:09
BadCubHaomeng: are you working on something similar to/or dup of ^^^20:09
BadCubthanks jroll :-) I will wait to hear from Haomeng on that one20:10
jrollBadCub: https://review.openstack.org/#/c/167507/20:12
jrollit was that one20:12
wanyenJoshNang, node zapping design spec says "The API will be changed to prevent changing power state or provision state while the node is in a ZAPPING state".   Can a driver power on bare-metal node while performing execute_cleaning_steps()?20:12
BadCubCoolness20:12
BadCubI will mark the original as a dup then20:13
JoshNangwanyen: heh we were just talking about this yesterday. i'm going to put up a patch to prevent it.20:15
jrollBadCub: usually the latter is the dupe20:15
jrollBadCub: also that change was abandoned20:15
BadCubI see that20:15
BadCubleaving it as-is for now20:15
jrollk20:15
wanyenJoshNang,  OOB node cleaning may need to power on the bare-metal node during execute_cleaning-steps so I am actually hoping that we won't restrict driver to power on a bm node.20:17
JoshNangwanyen: it should only be restricted at the api level20:18
wanyenJoshNang, so the driver can power on/off the node during execute_cleaning-steps as needed. right?20:19
*** achanda has quit IRC20:20
JoshNangwanyen: i think that's reasonable. the agent needs the same thing20:20
wanyenJoshNang, +120:20
jrollwanyen: yes, the goal is to stop a user from turning off the node while cleaning is happening. for example, when firmware updates are running20:21
*** alexpilotti has quit IRC20:21
wanyenjroll, do we allow a user to cancel node cleaning?20:21
JoshNangwanyen: hmm, i don't think so, but let me check20:22
JoshNangwanyen: no we don't20:23
wanyenJoshNang, it's probaly ok for kilo but we might want to consider that for Liberty.  It will be complicated as some of the steps may not be canacellable after certain point.20:24
jrollwhy would we need to cancel cleaning?20:25
JoshNangwanyen: right, that's why i hadn't included it. you could potentially brick a node if you cancel and it isn't handled properly20:25
wanyenjroll, sometine cleaning takes too long and user could change their mind.20:25
TheJuliaI think cancel is a bad description, abort maybe?20:26
jrollwanyen: change their mind about what? what state would the node go to if it was cancelled?20:26
wanyenTheJulia, abort indeed.20:26
wanyenjroll, for instance, they might decide not to do firmware update.20:27
TheJuliacancel has this implication something may be recoverable, abort should kind of just stop things20:27
*** ijw has quit IRC20:27
jrollwanyen: ok, so cleaning is something automatic, where I do not believe the user should have a choice. zapping is something triggered by a user, and I'm ok with being able to abort a zap process.20:28
jlvillalDoes anyone know if the IBM xCAT test honors the 'recheck" comment?20:29
wanyenjroll, sounds reasonable for now.  I need to think more about it.20:29
jlvillalI'm curious since IBM xCAT posted a comment that it was starting the test and ending the test when I uploaded the patch.20:29
jlvillalBut I didn't see the comment on starting after I did 'recheck"20:29
wanyenJoshNang  and Jroll, ty for answering my questions.20:30
JayFjlvillal: most 3rd part CIs are supposed to have their own keyword20:30
jrollwanyen: no problem, I hope I was helpful20:31
jlvillalJayF: Oh :(  How does someone figure out that keyword?20:31
NobodyCamoff the wall question if you were going to check for a service, such as tftp, would netstat be the best option?20:31
JayFhttps://wiki.openstack.org/wiki/ThirdPartySystems/IBM_xCAT_CI how to recheck should maybe go here20:31
jrolljlvillal: I ignore the xcat CI so I have no idea20:31
jrollNobodyCam: that or ps20:31
openstackgerritMerged openstack/ironic: Removed hardcoded IDs from "chassis" test resources  https://review.openstack.org/13320520:31
NobodyCamya ps has to many options20:31
jlvillalJayF: Thanks.  I had read that page earlier and didn't see any info.20:31
jrollNobodyCam: what do you actually want to know? :P20:32
jlvillaljroll: Okay.  I won't worry about it too much :)20:32
NobodyCamxinit.d tftpd bob's trival file transfer20:32
jrolljlvillal: I'm also kind of a bad person20:32
jlvillal:D20:32
jrolltake advice at your own risk :)20:32
NobodyCamjroll: I was looking at https://bugs.launchpad.net/ironic/+bug/128283620:32
openstackLaunchpad bug 1282836 in Ironic "PXE driver does not manage tftpd" [Low,Confirmed]20:32
jrollNobodyCam: oh. fun.20:33
NobodyCamand figured I could just add a cehck to my https://review.openstack.org/#/c/167451 patch20:33
jrollNobodyCam: so we'll refuse to start if tftp isn't running?20:34
jrollseems heavy-handed, idk20:34
NobodyCamjroll: nope fir that I was just going to log "tftp appears to not be running.. please start it" type message20:35
jrolltftp can also be managed outside of ironic as well, TheJulia does this (with ironic managing /tftpboot), I do it without ironic managing /tftpboot20:35
wanyenjroll and JoshNang, yes you are very helpful. :)20:35
JoshNang:)20:36
jrollNobodyCam: in my case, tftp runs on a different host than the conductor20:36
NobodyCamack, so maybe just the directory check is good enough20:36
jrollmaybe20:37
TheJuliaNobodyCam: locally or via tftp?20:37
jrolljust throwing out some cases to think about20:37
NobodyCamTheJulia: I was trying to think of a pre-flight style check for running tftp service20:38
NobodyCambut as jroll pointed out that might not be so easy20:38
firlanyone able to help me diagnose why the node isn’t booting? http://bit.ly/1NB5eYR http://picpaste.com/Screen_Shot_2015-03-31_at_3.34.16_PM-YenPc3qN.png20:38
firlit’s able to get to the point where it pulls a deploy image from ironic20:38
TheJuliaNobodyCam: what about a pre-flight check before powering on the node to double check that something is present via tftp?20:39
NobodyCamTheJulia: I got kick back checking before each action20:40
NobodyCamso I was thinking about a startup check20:40
NobodyCambut ..20:40
*** david-lyle has quit IRC20:40
jrollfirl: that looks pretty normal to me?20:41
TheJuliafirl: Looks normal to me, did you look in the conductor log?20:41
jrollfirl: have any conductor logs?20:41
firljroll: it just turns off after that20:41
firllet me clear my log space and re run it20:41
jrollfirl: right, at that point the image writing is done and it should try to boot the instance20:41
firl( it turns off right after that )20:41
TheJuliafirl: what does ironic node-show indicate?20:42
jrollfirl: yeah, would love to see conductor logs and know what driver you're running20:42
firlhttp://pastebin.com/iHTCdAe020:43
firlipmi_pxe20:43
firlregenerating conductor logs from start to finish now20:43
TheJuliayour instance_info is empty20:43
TheJuliafirl: your missing the information required in instance info for ironic to know what to put on the host, if that makes sense20:44
firlgotcha20:44
jrollI would think it wouldn't boot without that20:44
TheJuliabtw, you should now change your ipmi password20:44
jrollare you using nova?20:44
firllol yes thank you20:44
firlI forgot that it put it in clear text20:44
firlyes nova20:44
jrollyeah, the deploy should break way earlier with nova involved20:45
jrollI'm guessing the deploy failed, nova rescheduled (which tears down the first node)20:45
firlhttp://pastebin.com/JXQx4b6X20:45
firlthat is the instance info during boot20:45
*** mrda-away is now known as mrda20:46
firlmaybe the swap being 0 is an issue?20:46
mrdaMorning Ironic20:46
jrollfirl: yeah, that lgtm, swap=0 should be fine20:46
firljroll kk20:46
firlnow it is deleting20:47
jrollconductor logs should have all the answers20:47
firlhttp://pastebin.com/mG4x8phN20:47
jrolland maybe nova-compute logs, but mostly conductor20:47
firljroll: just finished the conductor log20:47
jrollMar 31 15:46:39 granger ironic-conductor: 2015-03-31 15:46:39.100 11885 ERROR ironic.drivers.modules.deploy_utils [-] StdErr: 'Error: The location 74753 is outside of the device /dev/sdb.\n'20:47
jrolllooks like maybe the disk is smaller than the flavor?20:48
firljroll: compute logs http://pastebin.com/z9vJtA7g20:49
firlok I will try to resize it down20:49
firlgiving it another go20:51
*** arif-ali has joined #openstack-ironic20:57
* BadCub is done with bugs for today. Review Day pad has been updated with some new goodies20:59
*** Marga_ has joined #openstack-ironic20:59
openstackgerritJosh Gachnang proposed openstack/ironic: Allow IPA to request reboot after clean steps  https://review.openstack.org/16950420:59
*** trown is now known as trown|outttypeww21:01
*** kkoski has quit IRC21:03
*** Marga_ has quit IRC21:04
firlHow do I have the ironic node show up as having a console?21:04
NobodyCamfirl: ironic node-set-console-mode21:06
firlcan’t set it while it’s locked by the host hah21:07
NobodyCamironic node-validate will check that console can be enabled21:07
NobodyCam:-p21:07
firlit has True on it21:08
firlso I just assumed that the node would automatically have it21:09
NobodyCamahh :) needs to be enabled :)21:09
firlyeah, I should probably put a wiki together on what all I had to do to get this all working lol21:10
NobodyCamfirl: my standard /shamelessPlug is we love to review doc patches :)21:10
firlyeah, I am doing a PoC for my company for automated testing of build OS images on baremetal21:11
firlso if I get it working end to end I will do that, then you can pick through and tell me where I didn’t do it proper haha21:11
NobodyCamfirl: if you see any area where our docs can be improved ... hint ... wink.. lol21:12
NobodyCam:)21:12
* BadCub snickers at NobodyCam's shamless plugs and hints LOL21:12
firlI can put my thoughts in yeah, however things like having to specify dhcp options inside a port, or diagnosing why the dhcp client is passing a certain parameter when using the dnsmasq driver21:12
*** hj-hp has quit IRC21:13
firlmy next task, once this is done, is to go through and figure out how to create the deploy images for our custom centos OS. In which we have a custom anaconda installer UI, which didn’t quite work with Oz21:13
*** achanda has joined #openstack-ironic21:14
openstackgerritJosh Gachnang proposed openstack/ironic: Prevent power actions on node in cleaning  https://review.openstack.org/16951021:15
*** Marga_ has joined #openstack-ironic21:16
openstackgerritJosh Gachnang proposed openstack/ironic: Prevent power actions on node in cleaning  https://review.openstack.org/16951021:17
NobodyCamoh fooy :( I believe linc would prevent us from using :https://github.com/msoulier/tftpy21:17
JoshNangJayF: ^ rebased21:17
BadCubJoshNang: I added ^^ to the pad21:17
JoshNangBadCub: thanks!21:18
BadCubyw!21:18
*** ndipanov has quit IRC21:18
*** mgoddard has joined #openstack-ironic21:19
*** mgoddard has quit IRC21:20
openstackgerritJay Faulkner proposed openstack/ironic: Update docs: No power actions during cleaning  https://review.openstack.org/16951421:20
*** Sukhdev has joined #openstack-ironic21:22
JoshNangJayF: nice, thanks! +121:23
JayFyeah lets try to, for the stuff that we took the time to document, to update in or as a followup patch21:23
JayFthat was easy to do now, pita to do it in Liberty when $who_knows_what has changed21:24
*** jgrimm is now known as zz_jgrimm21:26
jrollwow nice21:27
*** mjturek1 has quit IRC21:28
JoshNangJayF: ++21:28
*** hj-hp has joined #openstack-ironic21:32
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Add sphinx build + basic documentation  https://review.openstack.org/16850321:33
JayFAll comments addressed on that ^ and I'd love to land it today if someone with core can take a look.21:34
* JayF reminds folks that all Ironic cores are IPA cores, and since I stol^W adopted the docs buidler from Ironic, it should be a good review :P21:34
JayFNobodyCam: ^21:34
firlA node that is stuck in deploying, is the only way to remove it via sql still? I found some older bugs that reference it21:34
JayFfirl: yes, and yes that does make all of us sad21:35
*** dprince has quit IRC21:35
firlwomp womp21:35
firlIf I wanted to write a python method to force a delete ( and this would be valued ) where would I start21:35
JayFI'd look more at something like the nova reset-state CLI command21:36
JayFwhich doesn't force a delete, but puts a node in a sane state so things (like delete) can work21:36
firlgotcha, nova also has a force command21:36
jrollit needs to be in the API21:36
JayFso if I had an instance in Nova stuck spawning; nova reset-state UUID (as an admin) would put the node in task_state:none/prov_state:error21:36
jrollyou can't directly update, say, target_provision_state21:36
jroll(through the API)21:37
jrollso it would have to be a new api endpoint21:37
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Add sphinx build + basic documentation  https://review.openstack.org/16850321:38
openstackgerritMerged openstack/ironic: Prevent updating the node's driver if console is enabled  https://review.openstack.org/16803021:42
mrdadevananda: Not sure if you've seen my reply to your comments on 165666 but I think that's fine to proceed with now.21:44
openstackgerritJosh Gachnang proposed openstack/ironic: Fix cleaning nits  https://review.openstack.org/16819721:44
mrdarloo: Review 169101 fixing up some backwards compatibility is now also ready for your re-review :)21:46
rloomrda: in a meeting, will try to look21:47
devanandaJayF: yay docs!!!21:48
mrdanp rloo21:48
TheJuliaNobodyCam: fwiw, that bug I was bashing my head against for a few days, I just removed the WIP,  Happilly worked across 35 modes.21:49
NobodyCamTheJulia: awesome21:50
NobodyCam!!!!21:50
openstackNobodyCam: Error: "!!!" is not a valid command.21:50
NobodyCamlol21:50
mrdaha!21:51
TheJulialol21:51
JayFdevananda: anyone you can suggest as a resource for docs builds failing with giant horrible tracebacks followed by "TypeError"21:56
JayFheh21:56
* JayF suspects something is None somewhere, but no idea what21:56
BadCubTheJulia: I changed your patch on the pad from (WIP) to needs review21:58
firlNobodyCam: how do i edit the docs for adding content for review?21:59
devanandaJayF: run locally?21:59
JayFthis is local21:59
JayFVery intermittant failuires21:59
NobodyCamfirl: do you have a launchpad account?21:59
devanandaJayF: o.021:59
JayFhttps://bugs.launchpad.net/ironic/+bug/136129521:59
openstackLaunchpad bug 1361295 in Ironic "gate-ironic-docs failed due to TypeError from sphinx" [High,Fix released]21:59
JayFappears to be it21:59
JayFbut the fix implemented there no longer exists in ironic afaict22:00
firlNobodyCam: no, signing up now22:00
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Add sphinx build + basic documentation  https://review.openstack.org/16850322:01
NobodyCamfirl: :) also take a look at http://docs.openstack.org/developer/ironic/dev/contributing.html22:01
firlty22:01
NobodyCam:)22:01
NobodyCamthe files are in the dos/source directory22:01
JayFdevananda: in the realm of docs, you should look at the cleaning docs that just landed22:01
NobodyCams/dos/docs/22:01
BadCubheya gang.. We gots a growing list of goodies that need reviews on the pad :-)22:02
devanandaJayF: indeed. i saw (but didn't do a full review)22:02
*** igordcard_ has joined #openstack-ironic22:03
BadCubjroll: NobodyCam & anyone else interested. Is there a good day this week to maybe pull together a bug squash?22:04
devanandabugsquash ++22:04
*** harlowja_ is now known as harlowja_away22:04
NobodyCamBadCub: tomorrow morning is good.. I have eye doctor in the afternoon so I expect I wont be able to see after that. or thurs, Fri is also good for me22:05
devanandathis would be a fairly low hanging task if there are newer contributors that want to help22:05
devanandahttps://bugs.launchpad.net/ironic/+bug/127131722:05
openstackLaunchpad bug 1271317 in Ironic "XML support not required for ironic" [Low,Triaged] - Assigned to Michael Davies (mrda)22:05
BadCubNobodyCam: I imagine you'll need a ride from Eye Dr tomorrow LOL22:05
*** absubram has quit IRC22:05
NobodyCamsi22:06
firlNobodyCam: sounds good, I will go through and see what I might be able to add22:06
NobodyCamfirl: awesome! thank you :)22:06
firlI didn’t realize that I needed shellinabox to have the console enabled, was going to add that for example22:06
NobodyCam:) ahh22:06
BadCubHow does Friday sound for bug squash then?22:07
*** harlowja_away is now known as harlowja_22:07
mrdare: 1271317 will require touching every wsexpose method, and will need a bit of testing effort too.  But certainly doable.22:07
NobodyCamBadCub: works for me22:08
NobodyCammorning mrda22:08
devanandamrda: what if we monkeypatch wsexpose22:08
devanandamrda: in the api base class22:08
devanandaor something22:08
BadCubI will put a note on the pad for Friday :-)22:08
mrdaooh, devananda, that's an idea22:08
devanandashould be like 10 lines22:08
mrdaif no-one else jumps on that, I'm happy to play on that today (not sure how it ended up on my plate again, but hey, happy to pick it up again)22:09
mrdaonce I re-roll 163730 again22:09
devanandamrda: I think the bug just didn't get untargeted from you?22:10
mrdasomeone in channel told me they were working on it, but I forgot to follow thru and assign them the bug22:10
devanandaanyway, it ought to be fairly easy now, and it'd be nice if we officially drop xml rather than having it around another cycle22:10
mrdathat's all ancient histroy now though22:10
devanandaheh22:10
mrdamea culpa22:10
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Add sphinx build + basic documentation  https://review.openstack.org/16850322:11
devanandaon https://bugs.launchpad.net/bugs/1326269 i have found out that certain companies who shall remain nameless are using the testing drivers essentially in production22:11
openstackLaunchpad bug 1326269 in Ironic "Developer docs should include information about fake drivers" [Low,Triaged] - Assigned to Shraddha Pandhe (shraddha-pandhe)22:11
devanandafor reasons that i can't fathom right now22:12
devanandai dont htink now's the right time to push https://review.openstack.org/152056 through -- but want to bring this to folks attention (again)22:13
BadCubdevananda: do you want me to add ^ to L pad?22:14
mrdaBadCub: can you post the link for that22:14
mrda?22:14
devanandaBadCub: definitely for discussion post RC. like i said, i dont think RC is the right time to push that22:14
BadCub#link https://etherpad.openstack.org/p/ironic-liberty-priorities22:14
devanandai think it's there already22:14
mrdata22:14
devanandaoh. it's not22:15
*** mtanino has joined #openstack-ironic22:15
BadCubdevananda: kk. Will double check it for sanity sake :-)22:15
BadCubadded22:16
*** hj-hp has quit IRC22:18
*** harlowja_ has quit IRC22:21
NobodyCamlol : https://tools.ietf.org/html/rfc716822:21
NobodyCamlast years april 1st rfc22:22
*** penick has quit IRC22:23
BadCubLOL22:23
mrdaoh rats, I forgot to get my patch ready - to change all spellings in Ironic to the English, rather than US dictionary.  i.e. add back in all the 'u's and s/z/s/ conditionally :)22:24
NobodyCammrda: :-p shhh *dont tell BadCub*22:24
mrdalol22:25
NobodyCamhehehe22:25
mrdathe i18n team won't be happy with me...22:25
* BadCub looks up.. Say what?22:25
BadCublol22:25
NobodyCamhehehe22:25
NobodyCamwhy is there no native python support for tftp file retrival22:26
mrdaNobodyCam: sounds like an opportunity for upstream contribution :-P22:26
*** hj-hp has joined #openstack-ironic22:26
*** harlowja has joined #openstack-ironic22:26
NobodyCamthere are several packages that do it. just didn't want to add anymore deps22:27
TheJuliaNobodyCam: umm.... it is a relatively simple protocol22:27
devanandaNobodyCam: https://tools.ietf.org/html/rfc7168#section-2.3.3 418 IM A TEAPOT22:27
NobodyCamdevananda: ya...22:27
NobodyCamlol22:27
NobodyCami love that error22:28
firldevananda, NobodyCam, jroll: Thanks again for all your help22:29
NobodyCam:)22:29
firlJust succesfully deployed the first bare metal ubuntu os22:29
NobodyCamfirl: w00t22:29
BadCubfirl: congrats :-)22:29
mrdaOh, so we don't want 406s anymore, but we want 418s instead?  I can fix thaty...22:30
NobodyCammrda: ++++22:30
firlthanks! :)22:30
NobodyCamlol22:30
devanandamrda: the error message body should be short22:30
devanandaand stout22:30
NobodyCamlol22:30
BadCubLOL22:30
mrdagood job firl!22:30
mrdalol22:30
devanandafirl: woot!22:30
mrdastout as in beer, or in stature, or size?22:31
BadCubor all of the ^^22:31
*** penick has joined #openstack-ironic22:31
TheJuliaNobodyCam: of course I show the RFC to my girlfriend and she immediately complains that there must be an addendum for hot chocolate.22:32
mrdaor as in 'standard out'?22:32
mrdaTheJulia: next year is only 365 days away22:32
BadCubLOL TheJulia22:32
NobodyCam:)22:32
BadCubIf we are making addendum for hot chocolate, we should include hot buttered rum as well22:32
devanandaTheJulia: naturally, hot chocolate is prepared on a stove, not brewed in a teapot22:33
BadCubdevananda: well... technically... one could boil water/milk in a tea pot and pour into coco-mix22:33
TheJuliamrda: I think the requirement is to have it filed by mid-march, but I don't remember the rules anymore.22:33
devanandathe original HTCPCP - https://tools.ietf.org/html/rfc232422:34
* BadCub ducks22:34
TheJuliaBadCub: I'll put you two in touch and you can write the addendum.22:34
TheJuliaoh, wait a second, that might not be a good idea22:34
TheJulianvmd!22:34
devanandaCoffee is brewed using coffee pots. Networked coffee pots require a control protocol if they are to be controlled.22:34
BadCubTheJulia: yeah, that could be dangerous!22:34
mrdaTheJulia: Just plan to have it up for review by summit, and then the reviews will be done in L, ready for next year with a cycle to spare :)22:35
* mrda thinks that everyone should run to the OpenStack cadence22:36
TheJulia*facepalm*22:36
mrdaThat would make my life easier :)22:36
NobodyCambrb22:39
firlanyone have a good resource on how to make all the needed ironic image files from a iso boot source?22:40
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Fix Sphinx Autodoc WARNING/ERROR in docs build  https://review.openstack.org/16954522:40
*** romcheg has quit IRC22:42
devanandafirl: you said ISO22:44
*** andreykurilin_ has joined #openstack-ironic22:45
firlYes, sorry, centos 6 image source specifically ( we generate a usb boot image, and ISO  image )22:45
devanandafirl: you realize ironic doesn't use scripted installation media?22:47
firlI thought that I could script the install in qemu and create the image to test it on a physical machine22:50
*** devlaps has joined #openstack-ironic22:50
NobodyCamfirl: have you ever looked at Disk-Iage-builder?22:51
NobodyCamDisk-Image-bulider even?22:51
firllol22:51
NobodyCam:-p22:51
firlyeah I have, I was looking at that earlier, I was going to use that as a starting point, just didn’t know if anyone here had a better idea22:52
devanandafirl: diskimage-builder is sort of the common base line most of us use22:53
firlsounds good. I will go through and research / utilize it. I just wanted to have a known good ironic system before going down that route22:53
firlhopefully it will take less than 4 days to get it up like ironic did hah22:53
NobodyCamfirl: looks like a lot of steps: https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/OpenStack/page/Creating+qcow2+CentOS+Image+for+OpenStack22:54
*** devlaps has quit IRC22:54
devanandafirl: this is probably the simplest way to get started: http://docs.openstack.org/developer/ironic/deploy/install-guide.html#image-requirements22:54
firlnobodycam: thanks for the link, I will check it out in depth22:55
devanandait's also what we do CI with, so there's a fairly good chance it will _just_work_ :)22:55
firldevananda: :) yeah I used those instructions for the fedora and ubuntu images22:55
NobodyCam:)22:55
devanandacool22:56
firlubuntu is up and running right now, however my ssh key authority didn’t get copied over, but figured that was just something I might have messed up22:56
NobodyCamTheJulia: fyi I found a example of using python to get a tftp file22:56
TheJuliaNobodyCam: that... took you a while22:57
TheJuliaNobodyCam: was it well hidden on the internet?22:57
BadCubTheJulia: NobodyCam is old and blind.. be nice now22:57
* BadCub ducks under desk22:57
BadCublol22:57
NobodyCamI wanted I single sctipt22:57
NobodyCamdoh22:57
TheJuliaNobodyCam: ahhh!22:57
TheJuliaBadCub: troublemaker :)22:57
* BadCub is not a troublemaker... I just give it a helping hand! LOL22:58
NobodyCamehh, got a speack up.. /me is also getting hard of hearing23:00
BadCublol23:00
* BadCub notices NobodyCam's typos are getting worse with age too lol23:01
NobodyCamlol23:01
NobodyCamdoh23:01
NobodyCamfingers are the second thing to go23:01
BadCublol23:02
SukhdevNobodyCam: can I ask a QQ23:03
NobodyCamSukhdev: sure :)23:03
SukhdevI am trying to use ironicclient API23:04
Sukhdevtrying to look for some sample use examples, have not been able to find23:04
Sukhdevcan you point me to an example? if you know of one?23:04
HaomengBadCub: Yes, agree with you, this 1436173 is dup with existing one 1300939, we can work wigh orig one, I found the basic translation issue with UnicodeEncodeError - https://review.openstack.org/#/c/168268/, so we have to make the basic translation work[1], and then go ahead to enable lazy translation().23:05
HaomengBadCub: reply in the taht bug:)23:05
NobodyCamSukhdev: like the ironic nova driver?23:05
BadCubHaomeng: total awesomeness!!!!23:05
SukhdevNobodyCam: yes23:05
NobodyCamhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py23:06
SukhdevNobodyCam: Basically I want to do an equivalent of "ironic port-show", "ironic node-list", etc -23:06
SukhdevNobodyCam: but, programatically23:06
SukhdevNobodyCam: from ML2 driver23:07
BadCubHaomeng: do you want ot assign 1300939 to you? I have set it to rc-1 for K. We can tag 1426173 as a dup?23:07
SukhdevNobodyCam: that link does not help because I can not import it23:07
openstackgerritMerged openstack/ironic: Prevent power actions on node in cleaning  https://review.openstack.org/16951023:08
NobodyCamSukhdev: are you looking to run the command line client?23:08
openstackgerritMerged openstack/ironic: Followup to comments on Cleaning Docs  https://review.openstack.org/16942323:08
SukhdevNobodyCam: so, I thought I use pyrhon-ironicclient to achieve it -23:08
openstackgerritMerged openstack/ironic: Update docs: No power actions during cleaning  https://review.openstack.org/16951423:08
NobodyCamor the python lib?23:08
NobodyCamhahahaha DOCS23:09
HaomengBadCub: for this one https://bugs.launchpad.net/ironic/+bug/1300939, I worked on it for long time, but not working and no soultion now , blocking at - https://bugs.launchpad.net/wsme/+bug/1256042, so I am not sure I can find new way to support lazy translation now, you can check https://review.openstack.org/#/c/84362/ for details23:09
openstackLaunchpad bug 1300939 in Ironic "API does not translate errors based on Accept-Language header" [Low,Confirmed] - Assigned to Jim Rollenhagen (jim-rollenhagen)23:09
openstackLaunchpad bug 1256042 in WSME "Pecan's on_error() hook never gets trigged when used with WSME" [Undecided,Confirmed] - Assigned to Jianing Yang (jianingy)23:09
NobodyCamSukhdev: https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L432-L43723:09
NobodyCamthats a example og node list via the Lib23:10
*** ijw has joined #openstack-ironic23:10
NobodyCamfor the CLI it would be "ironic node-list"23:10
BadCubHaomeng: I copied ^^ to the bug23:10
*** ijw has quit IRC23:10
NobodyCamSukhdev: oh associated=True is NOT needed for fill list that is a filter for nides with instance id set23:11
SukhdevNobodyCam; that example is perfect - however, when I try to run it, I get the authentication error - hence, I was looking for a use case where and entrypoint (ironic end point) is passed to the ironicclient23:11
HaomengBadCub: https://bugs.launchpad.net/ironic/+bug/1300939 current owner is jim, not sure if he have idea to fix23:12
openstackLaunchpad bug 1300939 in Ironic "API does not translate errors based on Accept-Language header" [Low,Confirmed] - Assigned to Jim Rollenhagen (jim-rollenhagen)23:12
jrollyou can unassign me from that, I haven't looked at it in 6 months23:12
HaomengBadCub: I think if it is not in high prority, can we target to next-release?23:12
NobodyCamSukhdev: oh23:13
Haomengjroll: yes, i think we are blocking at 1256042, so no solution so far23:13
SukhdevNobodyCam: for example if I import ironicclient in python and then run that command (that you pointed me to) it fails - because of authentication error23:13
BadCubHaomeng: I didn't target it based on convo & amount of bugs we have for rc123:13
*** igordcard_ has quit IRC23:13
BadCubjroll: I unassigned it for ya23:13
NobodyCamSukhdev: ironic needs admin creds23:14
jrollBadCub: thanks23:14
BadCubyw23:14
NobodyCamSukhdev: is this with in an openstack frame work?23:14
SukhdevNobodyCam: Yes, I am aware of it, but, where and how do I pass it to the API call so that it will allow me to access the DB? That is the example I am looking for and could not find one23:15
*** hj-hp has quit IRC23:15
*** davideagnello has quit IRC23:15
*** pcrews_ has joined #openstack-ironic23:15
*** pcrews has quit IRC23:15
BadCubHaomeng: since you are working on the secondary, would you mind to keep an eye on the original one in case a solution pops_to_mind?23:16
*** hj-hp has joined #openstack-ironic23:16
NobodyCamSukhdev: i'm not understanding, a API call to access the DB?23:16
NobodyCamwe have a http API23:16
SukhdevNobodyCam: I want to something like "ic = ironicclient.client(ironic-url, username, password, etc)….and can not seem to find example as to what needs to be passed to it23:16
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Docs on HardwareManager, building, and workflow  https://review.openstack.org/16852223:17
NobodyCamyou can get smaples of that by adding --debug to the cli commands23:17
NobodyCamoh23:17
JayFjroll: I have 3 patchsets in a row. I need to make a one character change to the one in the middle; what's the best way you'd suggest to do that without breaking my world23:17
NobodyCamSukhdev: https://github.com/openstack/nova/blob/master/nova/virt/ironic/client_wrapper.py#L59-L8923:18
SukhdevNobodyCam: once I have instance of "ic" then I can do ic.node.list(), etc..23:18
NobodyCamthat23:18
jrollJayF: fix the middle and rebase the end23:18
HaomengBadCub: yes, i will try, but not sure if we still depens on wsme defect 1256042, and try to check with wsme guys, but I can not promise now:)23:18
*** pcrews__ has joined #openstack-ironic23:18
SukhdevNobodyCam: perfect - thanks - that is exactly I was looking for23:18
NobodyCam:)23:18
*** pcrews__ has quit IRC23:18
BadCubHaomeng: you rock! No promises expected :-)23:18
HaomengBadCub: https://bugs.launchpad.net/wsme/+bug/125604223:19
openstackLaunchpad bug 1256042 in WSME "Pecan's on_error() hook never gets trigged when used with WSME" [Undecided,Confirmed] - Assigned to Jianing Yang (jianingy)23:19
NobodyCamsorry I was missi understanding there23:19
SukhdevNobodyCam: I was looking in the tests (hoping they will set up the endpoint)23:19
HaomengHaomeng: :)23:19
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Add sphinx build + basic documentation  https://review.openstack.org/16850323:19
mrdaJayF: Download the first review in the sequence, rebase -i master, choose to edit the middle one, git commit -a --amend, continue, hope it behaves correctly :)23:19
SukhdevNobodyCam: Thanks a ton...23:19
NobodyCam:) sure23:19
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Fix Sphinx Autodoc WARNING/ERROR in docs build  https://review.openstack.org/16954523:20
*** hj-hp has quit IRC23:20
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Docs on HardwareManager, building, and workflow  https://review.openstack.org/16852223:20
JayFthat was super easy, wow23:20
*** pcrews_ has quit IRC23:20
mrdaJayF: :)23:21
JayFI didn't know rebase button worked on dependent changes tbh23:21
JayFthat makes it way easier23:21
JayFplus my first patch failed pep8 so I had more fixes anyway :P23:21
*** Sukhdev has quit IRC23:22
JayFNobodyCam: JoshNang: https://review.openstack.org/#/c/168503/7 should be landable right meow23:22
JayFhttps://review.openstack.org/#/c/169545/2 is a no-brainer kind of review too :)23:22
NobodyCamJayF: just a rebase?23:23
*** davideagnello has joined #openstack-ironic23:24
JayFNobodyCam: you never had a + on any of these; first one had -1 from you and lucas I fixed, 2nd patch didn't exist yesterday :)23:24
NobodyCamya but my - was for version number :-p23:24
JayFenough substance has changed you should have a look23:24
NobodyCamlooking23:25
NobodyCam:-p23:25
* devananda wanders back to the hotel to find sleep23:26
NobodyCamhave a good night devananda23:26
BadCubg'night devananda23:26
*** yuanying has joined #openstack-ironic23:26
NobodyCamJayF: PYTHONHASHSEED=0 needed?23:28
JayFNobodyCam: yes, or the builds randomly fail. see the bug I linked earlier23:28
JayFit clearly indicates something fucky is going on but I can't figure out what, so I used that to get it to build consistently23:28
JayFNobodyCam: https://bugs.launchpad.net/ironic/+bug/136129523:29
openstackLaunchpad bug 1361295 in Ironic "gate-ironic-docs failed due to TypeError from sphinx" [High,Fix released]23:29
JayFNobodyCam: and JoshNang confirmed that without the PYTHONHASHSEED=0 he wasn't getting things to reliably run either23:29
NobodyCamya thats what I was recalling .. trying to think what the fix was23:29
JoshNangyeah, i checked because...well...that seems like an unlikely fix23:30
JayFlooks like venv is still set to that23:30
JayFin Ironic23:30
NobodyCamack23:30
JayFI might, if anything, have to add this to tox.ini for IPA testenv:venv as well once I turn jenkins on for these docs23:30
JayFbut I want to land them first23:30
JayFthen make a docs job -- one that will fail in IPA if someone makes a docstring that WARN/ERR in the build23:30
JayFsince IPA is a mostly developer-consumed project seems to me it should have great dev docs, even if most of them are generated23:31
NobodyCamJayF: :)23:31
*** andreykurilin_ has quit IRC23:31
*** penick has quit IRC23:33
*** wanyen has quit IRC23:33
NobodyCamJayF: +a'd23:33
JayFNobodyCam: the followup is dead simple if you wanna get that too23:35
*** rfchapman has quit IRC23:35
JayFthat last one is about 170 lines of docs though, so you might wanna save that one for just before beer:thirty23:35
JayFlol23:35
*** achanda has quit IRC23:41
NobodyCamlol23:41
* BadCub is thinking it is cocktail time already23:41
*** rfchapman has joined #openstack-ironic23:42
rfchapmanNobodyCam: Hey hows it going?23:43
NobodyCamhey rfchapman doing good.. how many nodes are you deploying now?23:44
NobodyCam:-P23:44
NobodyCamhow are you doing23:44
rfchapmancurrently 3....  I have deployed upto 10 at one time, but I'm still having issues with the metadata portion of cloud-init.23:45
NobodyCam:(23:45
NobodyCamwhat kind of error?23:45
rfchapmanI tried to build an image with a default root ssh key but something doesn't seem to have worked.23:46
*** pcrews has joined #openstack-ironic23:47
NobodyCamrfchapman: are you seeing errors or is it just not workoing?23:47
NobodyCamworking even :-p23:47
rfchapman[  129.180402] cloud-init[467]: 2015-03-31 18:45:52,338 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [119/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 101] Network is unreachable)]23:47
*** Marga_ has quit IRC23:47
jrollwe really need some sort of doc on setting up the metadata service23:47
jrollsome people have solved this but I have no idea how23:47
jroll"routing magic" is all I know23:48
*** Marga_ has joined #openstack-ironic23:48
BadCubhey jroll did you see the mention of a Friday bug squash?23:50
rfchapmanNobodyCam: It will eventually give up..  and it tries another ip address on my network, but when I manually try to connect to that address it doesn't repond.23:50
JayFBadCub: Friday is a nogo for j*23:50
rfchapmanJroll: that would be nice...23:50
JayFBadCub: Friday is our annual company outing to angel island \o/23:50
BadCubSWEET!23:50
BadCubHow would Thursday work?23:50
jrollthursday is fine23:51
BadCubNobodyCam: you good with Thursday?23:51
NobodyCamrfchapman: your using dib23:52
NobodyCamBadCub: ya23:52
BadCubAwesome. Ya'll rock. TY :-)23:52
rfchapmanNobodyCam: yes23:52
rfchapmanNobodyCam: It would be nice if there were a ENV Var that I could set with the password for root while testing/debugging.23:54
rfchapmanI mean a DIB_VAR23:55
NobodyCamadd the stackuser element23:55
openstackgerritMichael Davies proposed openstack/ironic: New field 'name' not supported in port REST API  https://review.openstack.org/16373023:55
*** achanda has joined #openstack-ironic23:55
NobodyCamrfchapman: maybe something like: iptables -t nat -A PREROUTING -d 169.254.169.254/32 -i <interface> -p tcp -m tcp --dport 80 -j DNAT --to-destination <ip>:877523:59
jrollhow do you do that withuot access to the box23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!