| *** rh-jelabarre has quit IRC | 00:11 | |
| *** rh-jelabarre has joined #openstack-ironic | 00:13 | |
| *** Emine has joined #openstack-ironic | 00:15 | |
| *** TxGirlGeek has quit IRC | 00:25 | |
| *** Emine has quit IRC | 00:27 | |
| *** hwoarang_ has quit IRC | 00:48 | |
| *** hwoarang has joined #openstack-ironic | 00:53 | |
| *** gyee has quit IRC | 00:54 | |
| *** mnasiadka has joined #openstack-ironic | 00:59 | |
| *** fyx has joined #openstack-ironic | 00:59 | |
| *** TheJulia has joined #openstack-ironic | 00:59 | |
| *** preece has joined #openstack-ironic | 00:59 | |
| *** rh-jelabarre has quit IRC | 00:59 | |
| *** sdake has joined #openstack-ironic | 01:01 | |
| *** moshele has joined #openstack-ironic | 01:07 | |
| *** hwoarang has quit IRC | 01:10 | |
| *** trungnv has joined #openstack-ironic | 01:10 | |
| *** hwoarang has joined #openstack-ironic | 01:11 | |
| *** ijw has joined #openstack-ironic | 01:12 | |
| *** tiendc has joined #openstack-ironic | 01:22 | |
| *** moshele has quit IRC | 01:25 | |
| *** _fragatina has quit IRC | 01:37 | |
| *** sdake has quit IRC | 01:37 | |
| *** rloo has quit IRC | 01:38 | |
| *** sdake has joined #openstack-ironic | 01:39 | |
| *** sdake has quit IRC | 01:43 | |
| *** sdake has joined #openstack-ironic | 01:50 | |
| *** sdake has quit IRC | 01:51 | |
| *** TxGirlGeek has joined #openstack-ironic | 02:05 | |
| *** ijw has quit IRC | 02:07 | |
| *** dustinc has quit IRC | 02:33 | |
| *** dustinc has joined #openstack-ironic | 02:33 | |
| *** TxGirlGeek has quit IRC | 02:36 | |
| *** dustinc has quit IRC | 02:43 | |
| *** hwoarang has quit IRC | 02:48 | |
| *** hwoarang has joined #openstack-ironic | 02:56 | |
| *** dustinc has joined #openstack-ironic | 03:05 | |
| *** dustinc has quit IRC | 03:26 | |
| *** dnuka has joined #openstack-ironic | 03:27 | |
| dnuka | good morning ironic | 03:27 |
|---|---|---|
| * TheJulia blinks | 03:33 | |
| dnuka | :) | 03:34 |
| dnuka | good night TheJulia | 03:35 |
| TheJulia | Yeah, I guess I am going to sleep soon | 03:36 |
| dnuka | :) | 03:36 |
| *** sdake has joined #openstack-ironic | 03:40 | |
| *** hwoarang has quit IRC | 03:40 | |
| *** hwoarang has joined #openstack-ironic | 03:45 | |
| *** TxGirlGeek has joined #openstack-ironic | 03:57 | |
| dnuka | oh, come on merge conflict :( | 03:58 |
| *** sdake has quit IRC | 03:59 | |
| *** hwoarang has quit IRC | 04:30 | |
| *** hwoarang has joined #openstack-ironic | 04:31 | |
| *** manjeets has quit IRC | 04:41 | |
| * TheJulia blinks:( | 04:54 | |
| TheJulia | err | 04:54 |
| TheJulia | :( | 04:54 |
| *** early has quit IRC | 05:14 | |
| *** early has joined #openstack-ironic | 05:22 | |
| *** hwoarang has quit IRC | 05:42 | |
| *** hwoarang has joined #openstack-ironic | 05:44 | |
| *** TxGirlGeek has quit IRC | 05:56 | |
| *** early has quit IRC | 06:05 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: [WIP]: fast tracked deployment support https://review.openstack.org/635996 | 06:05 |
| * TheJulia goes to bed | 06:08 | |
| dnuka | good night TheJulia | 06:08 |
| dnuka | :) | 06:08 |
| *** early has joined #openstack-ironic | 06:13 | |
| *** whoami-rajat has joined #openstack-ironic | 06:19 | |
| *** e0ne has joined #openstack-ironic | 06:24 | |
| dnuka | \o/ | 06:34 |
| *** e0ne has quit IRC | 06:35 | |
| *** arne_wiebalck_ has joined #openstack-ironic | 06:38 | |
| *** zhangfei has joined #openstack-ironic | 06:44 | |
| *** tiendc has quit IRC | 06:44 | |
| *** moshele has joined #openstack-ironic | 07:12 | |
| *** e0ne has joined #openstack-ironic | 07:12 | |
| *** arne_wiebalck_ has quit IRC | 07:16 | |
| *** dnuka is now known as dnuka|brb | 07:16 | |
| *** e0ne has quit IRC | 07:16 | |
| *** e0ne has joined #openstack-ironic | 07:24 | |
| *** hamdyk has joined #openstack-ironic | 07:30 | |
| *** e0ne has quit IRC | 07:32 | |
| *** Emine has joined #openstack-ironic | 07:32 | |
| *** e0ne has joined #openstack-ironic | 07:42 | |
| *** Emine has quit IRC | 07:49 | |
| *** zhangfei has quit IRC | 08:00 | |
| *** gkadam has joined #openstack-ironic | 08:08 | |
| *** zhangfei has joined #openstack-ironic | 08:12 | |
| *** rpittau has joined #openstack-ironic | 08:13 | |
| rpittau | good morning ironic! o/ | 08:13 |
| *** gkadam_ has joined #openstack-ironic | 08:15 | |
| *** gkadam has quit IRC | 08:17 | |
| * etingof hopes that iurygregory likes the snow storm | 08:24 | |
| etingof | o/ ironic | 08:24 |
| *** e0ne has quit IRC | 08:35 | |
| arne_wiebalck | good mornign ironic! | 08:35 |
| *** e0ne has joined #openstack-ironic | 08:37 | |
| *** dnuka|brb is now known as dnuka | 08:37 | |
| dnuka | good morning arne_wiebalck, etingof & rpittau o/ | 08:38 |
| arne_wiebalck | hey dnuka o/ | 08:38 |
| *** e0ne has quit IRC | 08:38 | |
| rpittau | buongiorno etingof arne_wiebalck dnuka :) | 08:38 |
| dnuka | :) | 08:38 |
| arne_wiebalck | rpittau: international day today ? ;) | 08:39 |
| rpittau | arne_wiebalck, I'm feeling more italian than usual :D | 08:39 |
| arne_wiebalck | rpittau: lol | 08:39 |
| *** e0ne has joined #openstack-ironic | 08:46 | |
| *** amoralej|off is now known as amoralej | 08:47 | |
| * etingof finds out that tomorrow is the international day of electromagnetic waves | 08:47 | |
| *** e0ne has quit IRC | 08:48 | |
| dnuka | :) | 08:48 |
| etingof | rpittau, should be especially proud because Marconi | 08:48 |
| rpittau | very ^^ | 08:50 |
| etingof | btw, Russians have a competing figure for that discovery | 08:51 |
| rpittau | you mean for the radio telegraph ? | 08:52 |
| etingof | yes, based on the electromagnetic radiation - that's the key | 08:53 |
| *** e0ne has joined #openstack-ironic | 08:54 | |
| *** whoami-rajat has quit IRC | 08:54 | |
| *** e0ne has quit IRC | 08:56 | |
| *** priteau has joined #openstack-ironic | 08:58 | |
| openstackgerrit | Merged openstack/ironic master: Allocation API: fix a small inconsistency https://review.openstack.org/636110 | 09:01 |
| *** jistr_ is now known as jistr | 09:09 | |
| *** dougsz has joined #openstack-ironic | 09:09 | |
| *** Emine has joined #openstack-ironic | 09:15 | |
| *** tssurya has joined #openstack-ironic | 09:17 | |
| *** dnuka has quit IRC | 09:22 | |
| *** e0ne has joined #openstack-ironic | 09:25 | |
| *** e0ne has quit IRC | 09:26 | |
| *** Emine has quit IRC | 09:26 | |
| *** Emine has joined #openstack-ironic | 09:26 | |
| dtantsur | morning ironic | 09:28 |
| arne_wiebalck | morning dtantsur o/ | 09:28 |
| iurygregory | etingof, for sure i like \o/ | 09:36 |
| iurygregory | morning people o/ | 09:37 |
| arne_wiebalck | hey iurygregory o/ | 09:38 |
| hjensas | good morning. o/ | 09:39 |
| arne_wiebalck | hjensas: o/ | 09:39 |
| *** moshele has quit IRC | 10:08 | |
| *** derekh has joined #openstack-ironic | 10:27 | |
| *** MattMan has quit IRC | 10:28 | |
| *** MattMan has joined #openstack-ironic | 10:28 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: DNM - Testing https://review.openstack.org/636169 | 10:30 |
| *** moshele has joined #openstack-ironic | 10:39 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: DNM - Testing https://review.openstack.org/636169 | 10:44 |
| *** jtomasek has quit IRC | 10:46 | |
| *** jtomasek has joined #openstack-ironic | 10:54 | |
| *** zhangfei has quit IRC | 10:56 | |
| *** Emine has quit IRC | 11:09 | |
| *** Emine has joined #openstack-ironic | 11:10 | |
| jroll | morning y'all | 11:37 |
| rpittau | hey jroll :) | 11:42 |
| jroll | \o rpittau :) | 11:44 |
| dtantsur | morning jroll | 11:46 |
| jroll | hey dtantsur \o | 11:46 |
| iurygregory | morning jroll | 11:48 |
| *** dtrainor has joined #openstack-ironic | 11:50 | |
| jroll | iurygregory: morning! :) | 11:51 |
| *** _fragatina has joined #openstack-ironic | 11:56 | |
| *** _fragatina has quit IRC | 11:59 | |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| *** _fragatina has joined #openstack-ironic | 12:00 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: DNM - Testing https://review.openstack.org/636169 | 12:08 |
| *** emine__ has joined #openstack-ironic | 12:28 | |
| *** Emine has quit IRC | 12:30 | |
| *** bfournie has quit IRC | 12:38 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: DNM - Testing https://review.openstack.org/636169 | 12:41 |
| iurygregory | dtantsur, i think i found the problem override-branch is not working properly, I switched to override-branch and zuul shows the job | 12:43 |
| *** emine__ has quit IRC | 12:50 | |
| *** _fragatina has quit IRC | 12:56 | |
| dtrainor | Howdy. Last time I tried this it didn't work, but I'm hoping something might have changed in the process since pike. I fear I'm missing some node info but according to the docs for the snmp driver, I think I have everything necessary, at least at a minimum. I might also be missing some bits as they relate to ironic ports etc, that's a new concept to me | 12:57 |
| dtrainor | Either way, any guidance would be appreciated. Here's my nodes file, and the associated errors while attempting introspection http://paste.openstack.org/show/744930/ | 12:58 |
| dtrainor | This might be a clue about a bit I'm missing: WARNING ironicclient.common.http [-] The following arguments are being ignored when constructing the client: %s | 12:58 |
| *** moshele has quit IRC | 13:00 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Run all defined jobs defined in check and gate https://review.openstack.org/636169 | 13:01 |
| *** rh-jelabarre has joined #openstack-ironic | 13:01 | |
| *** bfournie has joined #openstack-ironic | 13:08 | |
| *** trown|outtypewww is now known as trown | 13:11 | |
| etingof | dtrainor, I do not think you need snmp_user and snmp_priv_protocol in driver_info, but that is irrelevant to the problem you experience | 13:18 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Run all defined jobs defined in check and gate https://review.openstack.org/636169 | 13:21 |
| *** whoami-rajat has joined #openstack-ironic | 13:22 | |
| dtrainor | etingof, thanks for the info | 13:22 |
| dtrainor | that would make sense actually... | 13:23 |
| iurygregory | dtrainor, jroll now we have all 20 jobs running again in ironic-tempest-plugin =) | 13:25 |
| iurygregory | ops dtantsur* | 13:25 |
| iurygregory | XD | 13:25 |
| dtrainor | :) | 13:27 |
| etingof | dtrainor it does not seem like driver problem to me. do you have ironic port configured? -- https://docs.openstack.org/ironic/queens/install/enrollment.html#enrollment-process | 13:28 |
| *** amoralej|lunch is now known as amoralej | 13:28 | |
| dtrainor | I had not, no. I was curious about that as I was following up with my original question. | 13:30 |
| rpittau | iurygregory, that's very interesting, maybe the 2 options are actually not mutually exclusive but they refer to 2 different things ? | 13:31 |
| dtrainor | (my knowledge of ironic ports is limited, this illustrates that problem) | 13:31 |
| iurygregory | rpittau, maybe with zuulv2 was fine, but when switched to zuulv3 wasnt or something | 13:31 |
| dtrainor | why did we move away from using a mac attribute in a node definition via nodes.json in favor of creating ports? | 13:31 |
| iurygregory | rpittau, according to infra "I might be mistaken, but from the zuul docs, with "override-checkout: stable/rocky" it checks the stable branch for the job definition, too. which fails, since ironic-tempest-plugin doesn't have stable branches" | 13:32 |
| *** sdake has joined #openstack-ironic | 13:32 | |
| rpittau | iurygregory, ok, so override-branch is deprecated in zuulv3 ? | 13:35 |
| iurygregory | rpittau, no no override-branch works, override-checkout doesnt seems to work =) | 13:36 |
| rpittau | uh ok | 13:36 |
| iurygregory | and also the checkout if it really check if the repo has the branch it will fail | 13:36 |
| etingof | dtrainor, are you referring to instackenv.json? | 13:37 |
| iurygregory | because ironic-tempest-plugin only have master | 13:37 |
| rpittau | yeah that makes sense | 13:37 |
| *** openstackgerrit has quit IRC | 13:37 | |
| iurygregory | now https://zuul.openstack.org/status shows all jobs running, i will check when they finished if the repos was using stable/* | 13:38 |
| dtrainor | etingof, sure, whatever arbitrary name you want to give it i suppose | 13:41 |
| dtrainor | also, holy moly, it's working. | 13:41 |
| etingof | dtrainor I just meant that OoO way of enrolling nodes is still in place | 13:42 |
| etingof | the command line way has also been around since forever | 13:42 |
| dtrainor | right | 13:43 |
| dtrainor | i'm suepr excited this is working, this truly makes my day | 13:44 |
| etingof | that's the beauty of computers - whenever they finally do something we perceive as reasonable, that gives us happiness \o/ | 13:51 |
| jroll | iurygregory: awesome, thanks! gonna wait for zuul before I vote :) | 13:53 |
| iurygregory | jroll, sure, im also waitting to check if the jobs did the checkout to stable branches =) | 13:53 |
| jroll | ok cool | 13:53 |
| *** rloo has joined #openstack-ironic | 13:55 | |
| *** e0ne has joined #openstack-ironic | 13:56 | |
| jroll | dtrainor: just curious, did you end up manually creating the port with the openstack cli? or did you add a ports section to your nodes file? | 13:57 |
| *** baha has joined #openstack-ironic | 13:59 | |
| *** sdake has quit IRC | 14:03 | |
| dtantsur | iurygregory: nice! | 14:04 |
| iurygregory | =) | 14:04 |
| *** tzumainn has joined #openstack-ironic | 14:11 | |
| dtrainor | jroll, i manually created the port, i'll explore adding it to my nodes file shortly | 14:13 |
| jroll | dtrainor: ah gotcha. ctrl-f "Some fields are optional if you’re going to use introspection later" here: https://docs.openstack.org/tripleo-docs/latest/install/environments/baremetal.html | 14:14 |
| dtrainor | jroll, i see that. thank you. | 14:19 |
| jroll | np :) | 14:19 |
| dtrainor | what's the bigger picture? why did we move away from 'mac'? | 14:19 |
| dtrainor | is it for resource based scheduling? | 14:19 |
| jroll | I'm not sure as I'm not super familiar with tripleo | 14:19 |
| jroll | but I assume it's so we can provide the local link connection stuff | 14:19 |
| jroll | (among other port properties) | 14:19 |
| dtrainor | ah that would make sense, sure. | 14:20 |
| dtrainor | well, power management works. the node is timing out when attempting to pxeboot, double checking some switch config | 14:20 |
| *** openstackgerrit has joined #openstack-ironic | 14:20 | |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-tools master: Add configurable libvirt firmware https://review.openstack.org/620605 | 14:20 |
| * etingof is not entirely sure what dtrainor meant by moving away from 'mac'... | 14:22 | |
| dtrainor | prior to rocky, we had a 'mac' property to use to identify a baremetal node, that property isn't applicable any more i'm finding, instead used in the ports property | 14:23 |
| dtantsur | yeah, it is deprecated (should work still) | 14:24 |
| dtrainor | Cannot create the node with attributes {u'mac': [u'd4:3d:7e:bc:ad:02'], u'driver': u'snmp', u'name': u'osp1-1', u'driver_info': {u'snmp_outlet': u'8', u'snmp_community': u'private', u'snmp_address': u'pdu02.lab.home.dtrainor.net', u'snmp_driver': u'apc_masterswitch'}}. One or more attributes are invalid: The attribute(s) "mac" are invalid; they are not needed to create nodes. | 14:25 |
| dtrainor | that's the message i get when trying to 'openstack baremetal create nodes.json' with a mac property | 14:25 |
| dtantsur | maybe it was "macs"? | 14:25 |
| dtantsur | or maybe it got removed indeed already | 14:25 |
| * dtantsur checks git log | 14:25 | |
| *** priteau has quit IRC | 14:26 | |
| dtrainor | i'm almost certain it's 'mac', as the one mac the node should have on the ctlplane network | 14:26 |
| dtantsur | dtrainor: wait, are we talking about tripleo command or ironic command? the ironic one has never had "mac". | 14:27 |
| dtrainor | the tripleo command, sorry i didn't make that clear | 14:27 |
| dtantsur | dtrainor: well, 'baremetal create' is an ironic native command, it doesn't support tripleo stuff like 'mac', 'pm_addr', etc | 14:29 |
| dtantsur | you're confusing it with 'overcloud node import' (former 'baremetal import', thanks tripleo for confusion :) | 14:29 |
| dtrainor | i'm going to take a break, have some more coffee, and wake up a little bit moree, so I start asking intelligent questions. | 14:30 |
| dtantsur | heh, no worries. two commands that do similar things with somewhat different input is a recipe for problems. | 14:31 |
| dtrainor | yeah, but i should know that. it's been a while since I've had to go back and forth between the two different command sets. | 14:31 |
| *** sthussey has joined #openstack-ironic | 14:31 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Run all defined jobs defined in check and gate https://review.openstack.org/636169 | 14:33 |
| *** sdake has joined #openstack-ironic | 14:35 | |
| *** sdake has quit IRC | 14:37 | |
| *** sdake_ has joined #openstack-ironic | 14:37 | |
| * iurygregory thinks he was using the wrong nodeset (－‸ლ) | 14:40 | |
| TheJulia | Good morning fellow bipeds and AIs | 14:40 |
| iurygregory | good morning TheJulia o/ | 14:40 |
| rpittau | hi TheJulia :) | 14:41 |
| *** bfournie has quit IRC | 14:43 | |
| jroll | morning TheJulia \o | 14:43 |
| *** e0ne has quit IRC | 14:44 | |
| jroll | so many priorities on the whiteboard, idk where to start. what happened to limiting these to a doable amount? | 14:46 |
| dtrainor | 'morn TheJulia | 14:46 |
| arne_wiebalck | good morning TheJulia | 14:48 |
| TheJulia | jroll: start at the top of the list and work down? | 14:52 |
| dtantsur | morning TheJulia | 14:52 |
| TheJulia | jroll: it has only really grown over the last few weeks as we've got tons of stuff in flight and went most of january in a bit of a lul. | 14:52 |
| *** gkadam_ has quit IRC | 14:54 | |
| *** gkadam has joined #openstack-ironic | 14:54 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Expose conductors: api-ref https://review.openstack.org/622862 | 15:00 |
| TheJulia | ^^ 2x+2 +A'ed patch that needed a rebase | 15:00 |
| TheJulia | i see one minor thing, fixing | 15:00 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Expose conductors: api-ref https://review.openstack.org/622862 | 15:02 |
| *** moshele has joined #openstack-ironic | 15:04 | |
| *** ianychoi has quit IRC | 15:07 | |
| *** ianychoi has joined #openstack-ironic | 15:07 | |
| rpittau | since I'm on the python 3 wave, I was actually checking the python 3 migration progress and trying to make a list of what's missing | 15:08 |
| rpittau | it looks like we're in good shape on that front :) | 15:08 |
| *** e0ne has joined #openstack-ironic | 15:09 | |
| *** hamdyk has quit IRC | 15:10 | |
| TheJulia | rpittau: thanks for the extra set of eyes on that | 15:13 |
| rpittau | TheJulia, no problem, can't wait to get rid of py2, that's it xD | 15:14 |
| openstackgerrit | Julia Kreger proposed openstack/python-ironicclient master: Support node description https://review.openstack.org/632935 | 15:18 |
| *** TxGirlGeek has joined #openstack-ironic | 15:23 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-ironicclient master: [WIP] Allocation API: client API and CLI https://review.openstack.org/636354 | 15:25 |
| *** moshele has quit IRC | 15:28 | |
| *** bfournie has joined #openstack-ironic | 15:30 | |
| *** priteau has joined #openstack-ironic | 15:30 | |
| *** e0ne has quit IRC | 15:33 | |
| TheJulia | Smartnic API has 2x+2, Last chance to review it before it mergees. I'll approve it later today. | 15:36 |
| *** e0ne has joined #openstack-ironic | 15:41 | |
| dtrainor | I'm trying to introspect a node and though I see requests from the node via tcpdump, I see no replies from my Undercloud. I see ironic whitelisting the mac address of the node, everything looks kosher so far as I can tell, but pxeboot does not succeed | 15:42 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Run all defined jobs defined in check and gate https://review.openstack.org/636169 | 15:43 |
| TheJulia | dtrainor: When you say it does not succeed, what do you observe? | 15:44 |
| dtrainor | i observe the node's pxe attempt timing out | 15:44 |
| dtrainor | 08:41:33.597934 ethertype IPv4, IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from d4:3d:7e:bc:ad:02 (oui Unknown), length 548 | 15:44 |
| *** moshele has joined #openstack-ironic | 15:47 | |
| TheJulia | so the node is failing to get an IP address :( | 15:50 |
| TheJulia | has dnsmasq been restarted at all? | 15:50 |
| TheJulia | the dnsmasq for inspection that is | 15:50 |
| dtrainor | right, the undercloud doesn't appear to be responding to any requests. i'm just watching ports 67,68,69 etc | 15:51 |
| dtrainor | it's been restarted as part of an undercloud reboot | 15:52 |
| dtrainor | when i start introspection, i see activity in the ironic_inspector_dnsmasq container log: Feb 12 08:37:03 dnsmasq-dhcp[1]: read /var/lib/ironic-inspector/dhcp-hostsdir/d4:3d:7e:bc:ad:02 | 15:52 |
| dtrainor | that mac address matches that of the overcloud node that's failing to get an ip / pxeboot | 15:52 |
| TheJulia | dtrainor: whats in the file? | 15:56 |
| dtrainor | just one line containing the mac address of the overcloud node i'm attempting to introspect | 15:57 |
| TheJulia | also, what version or release is this? | 15:57 |
| TheJulia | dtantsur: anything in the leases folder? could it be out of addresses? | 15:57 |
| dtrainor | rocky, downstream osp14 | 15:57 |
| dtrainor | i don't reckon, i used undercloud defaults which should be suitable, but it would be owrth checking | 15:58 |
| TheJulia | hjensas: any ideas^^^ | 15:58 |
| *** mjturek has joined #openstack-ironic | 16:00 | |
| TheJulia | o/ mjturek | 16:05 |
| hjensas | dtrainor: The /var/lib/ironic-inspector/dhcp-hostsdir/d4:3d:7e:bc:ad:02 should contain only the mac when the node is to be introspected. So that part looks ok. | 16:07 |
| hjensas | dtrainor: is the firewall good? Is there a rule to allow dhcp on br-ctlplane? | 16:08 |
| *** gkadam has quit IRC | 16:09 | |
| mjturek | heyo TheJulia | 16:09 |
| dtrainor | i have not made any changes to it, but I'll confirm | 16:09 |
| dtrainor | yes, can confirm | 16:10 |
| *** gkadam has joined #openstack-ironic | 16:14 | |
| *** moshele has quit IRC | 16:15 | |
| hjensas | dtrainor: ok, and I assume no activit after startup in the ironic_inspector_dnsmasq container log? | 16:17 |
| hjensas | dtrainor: Which interface are you tcpdumping on? | 16:17 |
| hjensas | dtrainor: are all the VIPs active ? ip addr show br-ctlplane? (Should have 3 IPs) | 16:18 |
| dtrainor | the long i'm referring to is ironic-inspector/dnsmasq.log, is that the same as what you are referring to? | 16:18 |
| dtrainor | i'm tcpdumping on local_interface | 16:18 |
| dtrainor | i see three IPs on br-ctlplane; two IPv4, one IPv6 | 16:19 |
| hjensas | dtrainor: ok, local_interface is probably hooked up to a ovs bridge? and the br-ctlplane interface is on that bridge. Try dumping on the bridge and br-ctlplane as well? (Maby the traffic is dropped somewhere along the way?) | 16:20 |
| dtrainor | will do | 16:21 |
| hjensas | dtrainor: hm, there should be 3 IPv4 addresses. | 16:21 |
| dtrainor | i see | 16:22 |
| hjensas | dtrainor: local_ip, admin_host and public_host ip's from undercloud.conf - Try restarting the keepalived container. | 16:23 |
| dtrainor | i still see the same three IPs as i described them on br-ctlplane | 16:24 |
| hjensas | dtrainor: hm, is there two IPv6 addresses in /var/lib/config-data/puppet-generated/keepalived/etc/keepalived/keepalived.conf ? | 16:27 |
| hjensas | dtantsur: sorry, two IPv4 addresses. | 16:27 |
| dtrainor | there are only two, one for the undercloud_admin_host and one for the undercloud_public_host | 16:28 |
| TheJulia | Guys, stepping away shortly to get some breakfast and take my cat to the vet. I should be back in about an hour and a half.... traffic permitting | 16:28 |
| dtrainor | appreciate the help TheJulia | 16:28 |
| hjensas | dtrainor: yes, thats correct. Hm, so for some reason the local_ip is'nt on the br-ctlplane interface? | 16:29 |
| dtrainor | *shrug* :) | 16:29 |
| TheJulia | just at a glance, that would likely explain why dnsmasq is not replying :( | 16:30 |
| hjensas | dtrainor: I assume local_ip in undercloud.conf is a ipv4 address + /subnet-bits ? | 16:32 |
| dtrainor | hjensas, it's the commented out default | 16:34 |
| hjensas | dtrainor: for reference the config file for br-ctlplane should look something akin to : http://paste.openstack.org/show/744955/ | 16:34 |
| dtrainor | i need to take a phone call real quick.... blame identity theft for this one, it's been a long last few days :) | 16:35 |
| dtrainor | thank you for the example | 16:35 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-ironicclient master: Allocation API: client API and CLI https://review.openstack.org/636354 | 16:41 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-ironicclient master: Allocation API: client API and CLI https://review.openstack.org/636354 | 16:47 |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Prioritize sloppy nodes for power sync https://review.openstack.org/635871 | 16:47 |
| *** moshele has joined #openstack-ironic | 16:51 | |
| *** moshele has quit IRC | 16:54 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-ironicclient master: Allocation API: client API and CLI https://review.openstack.org/636354 | 16:55 |
| *** TxGirlGeek has quit IRC | 16:57 | |
| dtantsur | okay, this seems to work ^^\ | 16:59 |
| *** sdake_ has quit IRC | 17:01 | |
| openstackgerrit | Arne Wiebalck proposed openstack/ironic-python-agent master: [WIP] Support Software RAID https://review.openstack.org/634681 | 17:02 |
| *** sdake has joined #openstack-ironic | 17:03 | |
| *** hamzy has quit IRC | 17:06 | |
| rpittau | bye all! good night! o/ | 17:07 |
| *** rpittau has quit IRC | 17:08 | |
| *** moshele has joined #openstack-ironic | 17:11 | |
| *** amoralej is now known as amoralej|off | 17:13 | |
| larsks | Hey folks, I'm trying to boot a baremetal node from a cinder volume as described in https://goodsquishy.com/2017/11/booting-baremetal-from-a-cinder-volume-in-tripleo/, but nova refuses to try. It fails with: | 17:16 |
| larsks | Instance failed to spawn: ValidationError: Ironic node: 015954fa-c900-4798-8c04-808a1504fe35 failed to validate. (deploy: {u'reason': u"Cannot validate image information for node 015954fa-c900-4798-8c04-808a1504fe35 because one or more parameters are missing from its instance_info and insufficent information is present to boot from a remote volume. Missing are: ['ramdisk', 'kernel', | 17:16 |
| larsks | 'image_source']", u'result': False}, power: {u'result': True}, storage: {u'result': True}) | 17:16 |
| larsks | Oh, I think I'm missing `--bootable`! | 17:16 |
| *** gkadam has quit IRC | 17:19 | |
| larsks | No, that wasn't it; same error. | 17:21 |
| larsks | ...so, any pointers would be much appreciated :) | 17:21 |
| NobodyCam | Good Morning Ironic'eres | 17:24 |
| arne_wiebalck | larsks: Looks like the deploy_kernel and deploy_ramdisk are missing from the node’s driver_info, no? | 17:26 |
| *** e0ne has quit IRC | 17:27 | |
| arne_wiebalck | good morning NobodyCam o/ | 17:28 |
| NobodyCam | hey hey Good Morning arne_wiebalck :) | 17:29 |
| NobodyCam | happy NOT monday | 17:29 |
| dtantsur | morning NobodyCam | 17:32 |
| larsks | arne_wiebalck: are those...required? Where? I didn't see anything mention those in the boot-from-volume docs. | 17:32 |
| larsks | Although to be honest I've found several versions of that doc so I may be confused at this point. | 17:32 |
| arne_wiebalck | larsks: Haven’t noticed your message before the error. | 17:33 |
| arne_wiebalck | larsks: Sorry about that. | 17:34 |
| arne_wiebalck | larsks: I was judging from the error message. | 17:34 |
| larsks | arne_wiebalck: no worries! I'm just hoping someone can help figure out what's going on. | 17:34 |
| larsks | The ironic docs (I'm looking at https://docs.openstack.org/ironic/latest/admin/boot-from-volume.html) don't actual go as far as showing how to actually boot from a volume, and dhiggins' doc at https://goodsquishy.com/2017/11/booting-baremetal-from-a-cinder-volume-in-tripleo/ seems to suggest things should Just Work. | 17:35 |
| *** chihhsin has quit IRC | 17:35 | |
| NobodyCam | hey hey dtantsur howdy! | 17:35 |
| NobodyCam | :) | 17:35 |
| *** chihhsin has joined #openstack-ironic | 17:35 | |
| *** whoami-rajat has quit IRC | 17:36 | |
| *** moshele has quit IRC | 17:36 | |
| arne_wiebalck | larsks: Not sure that’s helpful, but what does “openstack baremetal node validate <node>” give? | 17:43 |
| *** e0ne has joined #openstack-ironic | 17:43 | |
| *** sdake has quit IRC | 17:44 | |
| dtrainor | i'm back, sorry for making you wait hjensas | 17:44 |
| larsks | It gives back some information, but I don't think it's relevant to this particular issue (it's basic a list of features supported by the driver specific to the given node) | 17:45 |
| larsks | Oh wait, maybe... | 17:45 |
| arne_wiebalck | larsks: from what I remember it should not return anything | 17:45 |
| larsks | Huh, it suggests that one can set ramdisk/kernel/etc on instance_info? Argh, but none of the docs suggest that is necessary, and include examples of booting from a centos7 image without a separate kernel/ramdisk. | 17:45 |
| larsks | So confused. | 17:46 |
| *** dtrainor has quit IRC | 17:46 | |
| *** sdake has joined #openstack-ironic | 17:46 | |
| *** gyee has joined #openstack-ironic | 17:47 | |
| *** dtrainor has joined #openstack-ironic | 17:50 | |
| arne_wiebalck | larsks: I just checked my prod machines, they report the message you see. | 17:54 |
| arne_wiebalck | larsks: I don’t boot from cinder, though. | 17:54 |
| larsks | arne_wiebalck: thanks for looking | 17:54 |
| arne_wiebalck | larsks: np, I have to leave now sorry … :-/ | 17:55 |
| arne_wiebalck | good night everyone | 17:55 |
| *** derekh has quit IRC | 17:56 | |
| *** dtantsur is now known as dtantsur|afk | 17:58 | |
| dtantsur|afk | o/ | 17:58 |
| *** dougsz has quit IRC | 17:59 | |
| *** tssurya has quit IRC | 18:09 | |
| TheJulia | larsks: what exactly are you seeing when you do a validate command? | 18:26 |
| larsks | TheJulia: howdy! I'm seeing this: https://termbin.com/51cr | 18:27 |
| larsks | TheJulia: (that neutron error can be ignored; someone is mucking about with it right now) | 18:28 |
| TheJulia | larsks: anything if you look at the volume targets and connectors information? | 18:28 |
| larsks | I have created a volume connector; my reading of https://docs.openstack.org/ironic/latest/admin/boot-from-volume.html was that it wasn't necessary to create a volume target when using cinder. volume connector: https://termbin.com/4wgo | 18:29 |
| larsks | (and using nova to boot things) | 18:30 |
| larsks | "volume target list" output is empty | 18:30 |
| *** dustinc has joined #openstack-ironic | 18:38 | |
| *** trown is now known as trown|lunch | 18:41 | |
| *** hamzy has joined #openstack-ironic | 18:43 | |
| *** dustinc has quit IRC | 18:43 | |
| *** dustinc has joined #openstack-ironic | 18:44 | |
| *** sdake has quit IRC | 18:44 | |
| TheJulia | larsks: what exactly is showing up in the nova-compute log then? | 18:45 |
| TheJulia | and just to confirm, your setup for iscsi via lvm, not something like ceph right? | 18:46 |
| *** priteau has quit IRC | 18:47 | |
| larsks | TheJulia: nova-conductor reports failure to schedule, like this: https://termbin.com/xbxi | 18:47 |
| TheJulia | I suspect your tring to boot from an unsupported backend | 18:48 |
| TheJulia | and nova is retrying | 18:48 |
| larsks | "unsupported backend" in this case meaning...which? cinder backend? | 18:48 |
| TheJulia | larsks: what does "openstack baremetal node show $uuid" say? | 18:49 |
| TheJulia | larsks: yes | 18:49 |
| TheJulia | larsks: it has to offer iscsi for it to work | 18:49 |
| larsks | TheJulia: we're using ceph behind cinder. | 18:49 |
| TheJulia | Yeah, that is just not going to work | 18:49 |
| TheJulia | sadly | 18:49 |
| TheJulia | :( | 18:49 |
| TheJulia | jungleboyj: any progress on Cinder doing magic to support radosgw iscsi targets? | 18:49 |
| larsks | I see. I thought the whole "create a volume connector" bit was creating an iscsi target on the host (I figured rbdmap -> export an iscsi lun ->boot from it) | 18:50 |
| larsks | Guess not. | 18:50 |
| jungleboyj | TheJulia: Some. We discussed the approach we would like to take at the Mid-Cycle. Hoping that Finix and I can start working it early next month. | 18:50 |
| TheJulia | nah, cinder returns a ceph rbd url which ironic is unable to leverage and actually doesn't even recognize it as a volume | 18:50 |
| TheJulia | jungleboyj: \o/ | 18:50 |
| jungleboyj | The hard part is that we will need to create a new driver for it based on the existing RBD driver. | 18:51 |
| larsks | Got it. So, just use the LVM backend for now if we want boot-from-volume to work? | 18:51 |
| jungleboyj | So, it isn't going to happen until Train at the earliest, but we are working on it. | 18:51 |
| *** sdake has joined #openstack-ironic | 18:51 | |
| TheJulia | larsks: correct | 18:52 |
| larsks | I wonder if you could teach nbdkit (https://github.com/libguestfs/nbdkit) how to talk to that rbd url? I guess performance in that case would be awful. | 18:52 |
| larsks | TheJulia: thanks! | 18:53 |
| TheJulia | jungleboyj: yeouch, but good to know there is progress. Do I need to buy beers one night for a group of people in denver? | 18:53 |
| larsks | tzumainn: you should come to #openstack-ironic and check out the scrollback... | 18:53 |
| TheJulia | :) | 18:53 |
| *** _fragatina has joined #openstack-ironic | 18:55 | |
| tzumainn | larsks, ah, that's exciting! | 18:59 |
| larsks | tzumainn: well, "exciting" :). But at least it suggests a path forward. | 18:59 |
| jungleboyj | TheJulia: The answer tho that is always yes. ;-) | 19:00 |
| *** jiapei_ has joined #openstack-ironic | 19:03 | |
| *** v12aml has quit IRC | 19:04 | |
| *** dtantsur|afk has quit IRC | 19:04 | |
| *** rloo has quit IRC | 19:04 | |
| *** jroll has quit IRC | 19:04 | |
| *** jiapei has quit IRC | 19:04 | |
| *** fdegir has quit IRC | 19:04 | |
| *** tzumainn has quit IRC | 19:04 | |
| *** jiapei_ is now known as jiapei | 19:04 | |
| *** v12aml has joined #openstack-ironic | 19:05 | |
| *** fdegir has joined #openstack-ironic | 19:05 | |
| *** jroll has joined #openstack-ironic | 19:06 | |
| *** tzumainn has joined #openstack-ironic | 19:07 | |
| *** dtantsur has joined #openstack-ironic | 19:08 | |
| openstackgerrit | Aija Jaunteva proposed openstack/sushy master: Add public resource loading and message parsing https://review.openstack.org/590747 | 19:09 |
| openstackgerrit | Aija Jaunteva proposed openstack/sushy master: Add public resource loading and message parsing https://review.openstack.org/590747 | 19:16 |
| openstackgerrit | Aija Jaunteva proposed openstack/sushy master: Add @Redfish.Settings update status and expose it for BIOS https://review.openstack.org/591635 | 19:30 |
| *** arne_wiebalck_ has joined #openstack-ironic | 19:37 | |
| *** sdake has quit IRC | 19:42 | |
| *** trown|lunch is now known as trown | 19:44 | |
| *** dougsz has joined #openstack-ironic | 20:10 | |
| *** dougsz has quit IRC | 20:13 | |
| *** moshele has joined #openstack-ironic | 20:14 | |
| *** e0ne has quit IRC | 20:25 | |
| *** moshele has quit IRC | 20:27 | |
| *** penick has joined #openstack-ironic | 20:32 | |
| *** moshele has joined #openstack-ironic | 20:34 | |
| *** mjturek has quit IRC | 20:47 | |
| *** e0ne has joined #openstack-ironic | 20:48 | |
| *** arne_wiebalck__ has joined #openstack-ironic | 21:03 | |
| *** arne_wiebalck_ has quit IRC | 21:06 | |
| *** dtantsur has quit IRC | 21:06 | |
| *** fdegir has quit IRC | 21:06 | |
| *** tzumainn has quit IRC | 21:06 | |
| *** dtantsur has joined #openstack-ironic | 21:06 | |
| *** mjturek has joined #openstack-ironic | 21:08 | |
| *** moshele has quit IRC | 21:18 | |
| *** moshele has joined #openstack-ironic | 21:19 | |
| *** dsneddon has quit IRC | 21:22 | |
| *** sdake has joined #openstack-ironic | 21:26 | |
| *** e0ne has quit IRC | 21:28 | |
| *** jtomasek has quit IRC | 21:35 | |
| *** trown is now known as trown|outtypewww | 21:36 | |
| *** arne_wiebalck__ has quit IRC | 21:42 | |
| *** hamzy has quit IRC | 21:46 | |
| *** mjturek has quit IRC | 21:48 | |
| *** sdake has quit IRC | 21:50 | |
| *** moshele has quit IRC | 21:52 | |
| *** moshele has joined #openstack-ironic | 21:53 | |
| *** moshele has quit IRC | 22:08 | |
| larsks | TheJulia: any chance you're still around? | 22:10 |
| TheJulia | larsks: I am, whats up? | 22:10 |
| larsks | Things look much better having switched to the lvm backend. THe host pxe boots and successfully logs in to the iscsi target, but it's failing to boot...we see an "exec format error" from ipxe, followed by endless "Failed to attach iscsi volume(s)" messages. I *think* the iscsi login is successful (that's what wireshark tells me). | 22:11 |
| *** NobodyCam has quit IRC | 22:12 | |
| larsks | Not sure what to do with that "exec format error" message, though; it's a centos filesystem image. Does that mean "missing a bootloader"? | 22:12 |
| *** NobodyCam has joined #openstack-ironic | 22:12 | |
| larsks | You know, now that I'm saying it out loud, I should investigate how the source image was created; I didn't create it myself. | 22:13 |
| TheJulia | larsks: yeah, use a whole disk image with a bootloader | 22:15 |
| TheJulia | otherwise it doesn't know how to boot | 22:15 |
| larsks | Makes sense. Hopefully that all that it is. | 22:15 |
| larsks | Sorry for the bother! | 22:15 |
| TheJulia | no worries! | 22:19 |
| openstackgerrit | Merged openstack/ironic master: Expose conductors: api-ref https://review.openstack.org/622862 | 22:22 |
| *** dustinc has quit IRC | 22:36 | |
| *** dustinc has joined #openstack-ironic | 22:39 | |
| openstackgerrit | Ruby Loo proposed openstack/ironic master: Add check for object versions https://review.openstack.org/636458 | 22:47 |
| *** rloo has joined #openstack-ironic | 22:50 | |
| *** sthussey has quit IRC | 22:51 | |
| *** dustinc has quit IRC | 23:01 | |
| *** dustinc has joined #openstack-ironic | 23:05 | |
| *** whoami-rajat has joined #openstack-ironic | 23:12 | |
| openstackgerrit | Merged openstack/ironic master: Expose is_smartnic in port API https://review.openstack.org/630508 | 23:20 |
| *** baha has quit IRC | 23:28 | |
| *** sdake has joined #openstack-ironic | 23:43 | |
| *** rh-jelabarre has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!