Tuesday, 2019-12-03

*** jistr has quit IRC00:07
*** jistr has joined #openstack-ironic00:08
*** ijw_ has quit IRC00:32
openstackgerritSteve Baker proposed openstack/metalsmith master: WIP Implement a instance_config.NovajoinConfig  https://review.opendev.org/69699300:47
*** ijw has joined #openstack-ironic00:47
*** kaifeng|afk is now known as kaifeng00:52
*** yolanda has quit IRC01:25
*** ociuhandu has joined #openstack-ironic01:31
*** ociuhandu has quit IRC01:35
*** cdearborn has quit IRC01:43
*** gyee has quit IRC01:48
*** Goneri has quit IRC01:57
*** yaawang has quit IRC02:36
*** yaawang has joined #openstack-ironic02:36
*** chenhaw has joined #openstack-ironic02:45
*** ericin has joined #openstack-ironic03:02
*** ijw has quit IRC03:03
*** ijw has joined #openstack-ironic03:05
*** ijw has quit IRC03:09
*** ricolin has joined #openstack-ironic03:17
*** rloo has quit IRC03:18
*** mkrai has joined #openstack-ironic03:27
*** ijw has joined #openstack-ironic03:30
*** ijw has quit IRC03:30
*** ijw has joined #openstack-ironic03:30
*** ericin has quit IRC03:59
*** ericin has joined #openstack-ironic03:59
*** yaawang has quit IRC04:01
*** yaawang has joined #openstack-ironic04:02
*** stendulker has joined #openstack-ironic04:31
*** igordc has quit IRC04:34
*** ricolin has quit IRC05:09
*** ericleiin has joined #openstack-ironic05:36
*** mkrai has quit IRC05:36
*** ericin has quit IRC05:39
*** ijw has quit IRC05:52
*** mkrai has joined #openstack-ironic05:54
*** ijw has joined #openstack-ironic06:01
*** ijw has quit IRC06:06
*** ericlei_ has joined #openstack-ironic06:10
*** ericleiin has quit IRC06:14
*** ericleiin has joined #openstack-ironic06:14
*** ericlei_ has quit IRC06:15
*** rachit7 has joined #openstack-ironic06:25
*** mkrai has quit IRC06:30
*** mkrai has joined #openstack-ironic06:30
*** mkrai has quit IRC06:35
*** mkrai_ has joined #openstack-ironic06:36
*** ericlei_ has joined #openstack-ironic06:42
*** jtomasek has joined #openstack-ironic06:43
*** ericleiin has quit IRC06:46
*** yaawang has quit IRC06:47
*** yaawang has joined #openstack-ironic06:48
*** mkrai_ has quit IRC06:49
*** khansa has joined #openstack-ironic06:55
*** ericlei_ has quit IRC07:09
*** yolanda has joined #openstack-ironic07:22
*** mkrai_ has joined #openstack-ironic07:24
arne_wiebalckGood morning, ironic!07:38
khansaarne_wiebalck good morning o/07:43
*** yaawang has quit IRC07:46
*** yaawang has joined #openstack-ironic07:48
*** rachit7 has quit IRC07:49
*** Blinkiz9 has joined #openstack-ironic07:50
*** trident has quit IRC07:51
arne_wiebalckhey khansa o/07:51
*** Blinkiz has quit IRC07:51
*** Blinkiz9 has quit IRC07:51
*** trident has joined #openstack-ironic07:51
*** Blinkiz has joined #openstack-ironic07:52
*** Blinkiz has quit IRC07:53
*** Blinkiz has joined #openstack-ironic07:53
cp-Can anyone help me get a clear understanding of what needs to go in the local.conf in devstack to get ironic working with fake hardware (VMs)08:06
cp-?08:06
openstackgerritJerry Wang proposed openstack/ironic master: [PATCH] Add support for replacing WSME  https://review.opendev.org/67585308:14
*** tesseract has joined #openstack-ironic08:16
openstackgerritAnkit Kumar proposed openstack/ironic master: Add iso less virtual media deploy  https://review.opendev.org/67799608:16
*** yedongcan has joined #openstack-ironic08:21
*** alexmcleod has joined #openstack-ironic08:22
*** iurygregory has joined #openstack-ironic08:39
iurygregorygood morning Ironic08:40
*** rpittau|afk is now known as rpittau08:43
rpittaugood morning ironic! o/08:43
khansagood morning rpittau @iur08:44
rpittauhey khansa :)08:44
khansaiurygregory good morning o/08:44
iurygregorymorning rpittau khansa o/08:44
rpittauhey iurygregory :)08:45
*** lucasagomes has joined #openstack-ironic08:54
cp-morning iurygregory08:54
iurygregorymorning cp-08:55
*** mkrai_ has quit IRC09:00
*** mkrai has joined #openstack-ironic09:00
*** mbeierl has quit IRC09:03
*** dougsz has joined #openstack-ironic09:03
*** mbeierl has joined #openstack-ironic09:04
*** yaawang has quit IRC09:45
szivianiGood morning Ironic :)09:45
*** yaawang has joined #openstack-ironic09:46
szivianicp-: you can use the local.conf file defined here: https://docs.openstack.org/ironic/train/contributor/dev-quickstart.html09:47
*** mkrai has quit IRC09:54
cp-sziviani: thanks I will try it10:04
*** stendulker has quit IRC10:04
*** rcernin has quit IRC10:06
cp-sziviani: I am not seeing a local.conf file in this page10:08
*** pcaruana has joined #openstack-ironic10:08
cp-sziviani: ah found it my bad10:08
iurygregoryhttps://docs.openstack.org/ironic/train/contributor/dev-quickstart.html#deploying-ironic-with-devstack  =)10:09
sziviani:)10:09
cp-wow10:11
cp-disable service horizon ?10:11
cp-on the controller ?10:11
cp-disable cinder ....10:12
cp-I am confused10:12
iurygregoryyou don't need =D10:12
cp-I do not need what ?10:12
iurygregorycinder horizon10:13
rpittaucp-: that local.conf is a very basic configuration for ironic development and testing, you won't need all the services10:13
cp-why not ?10:13
iurygregorythis is justa simple deployment10:13
cp-I want cinder and horizon10:13
iurygregoryso change to enable service10:13
iurygregoryand you may need to configure some extra variables on the local.conf to work10:14
cp-like what ?10:14
cp-#IRONIC_ENABLED_HARDWARE_TYPES=ipmi,fake-hardware10:14
cp-what is the difference with10:14
cp-#IRONIC_ENABLED_MANAGEMENT_INTERFACES=ipmitool,fake10:14
*** rachit7 has joined #openstack-ironic10:15
iurygregoryyou "may" need, tbh I have no idea sicne I only use devstack to run some tempest tests and debug CI, I never used with horizon or cinder enable10:15
cp-probably I need both ?10:15
rpittaucp-: I think you'll find this useful: https://docs.openstack.org/ironic/latest/install/enabling-drivers.html10:19
*** dtantsur|afk is now known as dtantsur10:19
dtantsurmorning ironic10:20
iurygregorymorning dtantsur10:20
lucasagomesdtantsur:  o/ morning... Missed u in shanghai btw10:21
rachit7Good morning dtantsur rpittau iurygregory10:22
dtantsurlucasagomes: hey-hey! yeah, I was caught in the middle of a move10:22
lucasagomesyeah, I remember u told me u moving out of berlin10:23
lucasagomesdtantsur: all settled now ?10:23
dtantsuryep, in Düsseldorf nowadays10:23
lucasagomesnice10:23
dtantsuryeah, finally! I think we're good. some more furniture to buy, but nothing urgent10:23
rachit7Guys..! Anyone know where/how to check logs when we inject nmi to host?10:23
lucasagomesdtantsur: right yeah, u can do that in a weekend probably :D10:24
dtantsurhah, yeah, but I don't want to waste a weekend for it :)10:24
lucasagomesdtantsur: I've recently ordered a laptop refreshment and they sent me one with a german keyboard by mistake,10:24
dtantsurrachit7: mmm, not sure. in the journal of the operating system?10:24
lucasagomesdude wtf is that, the "Y" and "Z" swapped places10:24
* lucasagomes sent it back already so it's all good10:25
dtantsurhahaha10:25
dtantsuryeah, it requires getting used to it10:25
lucasagomesrachit7: dmesg if I'm not mistaken10:25
dtantsurfortunately, I'm blind-typing, otherwise I'd be constantly confused10:25
*** sshnaidm|afk is now known as sshnaidm10:26
lucasagomesyeah it's mind twisting really10:26
rachit7Thanks dtantsur lucasagomes10:26
*** chenhaw has quit IRC10:27
dtantsurlucasagomes: I've got an ergonomic keyboard from a local producer. so no alternative layouts for me10:30
iurygregorylucasagomes, better a german keybord than a czech one =)10:31
cp-rpittau: configuration variable are lowercases or uppercases ? in the doc it is confusing for beginnners10:31
lucasagomesdtantsur: ah wow, that sounds fancy10:31
lucasagomesiurygregory: hah yeah I bet, I haven't seeing a czech one AFAIR10:31
dtantsurhah, it was much cheaper than famous brands10:31
* etingof thinks German keyboard has the same feature Y/Z as the Czech one10:32
rpittauhave you ever seen a French keyboard ? you need to press shift to type numbers10:33
rpittaucp-: lowercase should work10:33
*** dmellado has quit IRC10:33
etingofso it's the matter of preference between umlauts and haček10:33
*** derekh has joined #openstack-ironic10:35
*** dmellado has joined #openstack-ironic10:35
cp-rpittau: thanks10:36
etingofmy laptop has a nice feature - every digit is duplicated on two adjacent keys10:37
lucasagomesI probably would sound like "my cat just walked across my keyboard" if I had to use any of these keyboards u guys mentioned10:38
etingofon top of that, it has two instances of '=' sign! I can understand why people seem jealous10:38
* dtantsur has ß instead of -10:39
dtantsurlucasagomes: it's a strong motivation to stop looking at the keyboard when typing ;)10:39
dtantsur(but boy do I suck in blind-typing Russian..)10:39
* etingof can't believe lucasagomes's cat is illiterate10:39
lucasagomestrue that10:40
dtantsuretingof: all cats a literate they just don't want to communicate with inferior life forms10:40
lucasagomesetingof: lol10:40
iurygregoryomg10:40
iurygregoryXD10:40
etingofcats should talk to dolphins10:40
iurygregorybut we don't have dolphins in Brno XD10:41
iurygregoryso they talk to their pets =) (aka their owners)10:41
etingofgiven they have gators in Brno, dolphins aren't impossible either10:42
iurygregory=O10:43
* rpittau feels lucky to not have met any gator while in Brno10:43
* iurygregory only saw the statue ..10:44
* lucasagomes remembers that... a gator stuck to the ceiling somewhere10:44
iurygregorylucasagomes, yeah it's on a building on the city center =)10:45
* etingof suspects lucasagomes has been upside down10:45
iurygregoryLOL10:46
lucasagomesetingof: quite possible, I don't think I was sober for long while in BRNO10:46
rpittaubased on my experience I don't think it's possible to stay sober for too long in Brno :D10:49
etingofthat ^ entirely explains the state of IT10:51
*** gudrutiss has joined #openstack-ironic10:52
*** hjensas has quit IRC10:54
iurygregorylucasagomes, you can visti Brno any time if you want o/10:54
iurygregoryrpittau, it's possible but it's hard =)10:54
lucasagomesabsolutely man, I would love to go back there10:55
lucasagomeseat some zebra (ribs, not the zebra-zebra)10:56
etingoffun fact, žerba == ribs10:57
iurygregorylucasagomes, come to devconf XD10:59
*** hjensas has joined #openstack-ironic10:59
openstackgerritIlya Etingof proposed openstack/ironic master: Add a CI job to UEFI boot over Redfish virtual media  https://review.opendev.org/69386711:00
*** hjensas has quit IRC11:01
*** ociuhandu has joined #openstack-ironic11:02
dtantsurtravelling to Brno is annoyingly complicated11:03
iurygregorydtantsur, next year will be worst "Ryanair To Terminate Brno-Berlin Route From April 2020"11:04
dtantsurI see11:05
etingofcome on, even Swedes came over once11:05
dtantsurwell, Berlin was a strange choice for a destination11:05
dtantsurMunich made much more sense back at the time11:05
*** root has joined #openstack-ironic11:06
*** root is now known as Guest695611:06
*** Guest6956 is now known as jerrywang11:06
dtantsurDüsseldorf would make a lot of sense ;) It's a big EU hub11:06
* dtantsur has bad memories of the train Berlin-Brno11:07
iurygregorythey have cancelled the flight to Munich this year =)11:07
dtantsurI know11:07
dtantsurnow that RH and IBM are together, they should just organize a flight to some large hub :D11:09
iurygregory++11:10
gudrutissGooood morning Viet... Ironic channel. Now, since I have your attention, have any of you have experience using `openstack baremetal introspection` (https://docs.openstack.org/ironic-inspector/latest/user/usage.html#introspection-rules) sub-command? We find it useful, but the documentation feels incomplete and examples dated. I am willing to updated it, but I need someone to clear some things for me.11:10
*** ociuhandu has quit IRC11:12
iurygregorygudrutiss, I never used the introspection command =( sorry11:14
*** rpittau is now known as rpittau|bbl11:18
*** hjensas has joined #openstack-ironic11:19
dtantsurgudrutiss: I wrote it, so yeah, sort of :)11:20
dtantsurI would really appreciate more docs and real world examples11:20
dtantsurto be clear: I assume you're talking specifically about introspection rules?11:21
gudrutissyes11:22
dtantsurgudrutiss: it's used in tripleo http://tripleo.org/install/advanced_deployment/profile_matching.html11:23
dtantsurfeel free to ask any questions11:23
gudrutissdtantsur: there is one quirk - `openstack baremetal introspection start $NODE` will not work, but `openstack baremetal node inspect` will.11:24
dtantsurthat sounds weird, the latter uses the API behind the former11:25
gudrutissit just stuck in "waiting" state11:26
dtantsurgudrutiss: is it on really recent ironic?11:27
gudrutiss`stein`11:27
dtantsurI see. That's weird, it's essentially the same code working11:29
gudrutissfrom what I see, `openstack baremetal introspection start` will not change the state on the node. it will not go to "inspection" mode and that is why its introspection is stuck in "waiting"11:31
dtantsurrpittau|bbl, TheJulia, do you think we can approve https://review.opendev.org/#/c/693026/ ?11:32
patchbotpatch 693026 - ironic-lib - mdns: support IPv6 addresses - 7 patch sets11:32
dtantsurgudrutiss: these events are unrelated. Indeed, it doesn't change the node's state (it cannot do it from "outside" of ironic).11:32
dtantsurbut that's the only change between the two commands11:33
dtantsurthe 'baremetal node inspect' command changes the state to 'inspect wait', then calls the API behind 'introspection start'.11:33
gudrutissThen how 'openstack baremetal introspection start $NODE' was supposed to work from the command line?11:36
*** trident has quit IRC11:40
*** trident has joined #openstack-ironic11:43
dtantsurgudrutiss: without relying on node.provision_state11:43
dtantsuryou can use 'openstack baremetal introspection status $NODE'11:43
dtantsurhowever, these commands are considered internal, 'openstack baremetal node inspect' should be used instead.11:43
*** ociuhandu has joined #openstack-ironic11:50
gudrutissdtantsur: if execute 'openstack baremetal introspection status $NODE', then I just table, where it says `| state       | waiting                              |`11:56
dtantsurwell, it's waiting for the ramdisk to post back11:57
gudrutissdtantsur: in any case, if you say we should use `openstack baremetal node inspect`, i do not object, but we need to document it.11:57
dtantsurI think we sort of have documented it11:57
dtantsurin https://docs.openstack.org/ironic/latest/admin/inspection.html11:58
gudrutissdtantsur: this is much more clear, but is old - https://www.slideshare.net/anniesowmya/osic-tech-talk-presentation-on-ironic-inspector11:59
dtantsurI haven't even seen it12:00
openstackgerritDmitry Tantsur proposed openstack/ironic master: Implement managed in-band inspection boot for redfish-virtual-media  https://review.opendev.org/69629112:03
dtantsuretingof: ^^ now with a CI job!12:06
dtantsurlet's see if it works :D12:06
cp-[ERROR] /opt/stack/ironic/devstack/lib/ironic:1432 Default interface set for deploy interface is not enabled.12:08
cp-Ok I am missing something12:08
gudrutissdtantsur: another question about introspection rules: can they be node specific or only global (on all nodes)?12:08
dtantsurcp-: inconsistency between IRONIC_DEFAULT_DEPLOY_INTERFACE and IRONIC_ENABLED_DEPLOY_INTERFACES?12:10
*** mkrai has joined #openstack-ironic12:10
dtantsurgudrutiss: they're always global12:10
dtantsuryou can probably hack something inside a rule to make it work only for some nodes12:10
cp-ah crap12:10
cp-typo on my part12:10
cp-I had a typo in iscsi12:11
cp-too many s :)12:11
cp-onto the next error12:12
cp-:)12:12
dtantsur:)12:12
gudrutissdtantsur: I don't see how - there are no boolean logic in the rules12:13
*** mkrai has quit IRC12:14
*** lucasagomes has quit IRC12:25
*** ociuhandu has quit IRC12:26
*** ociuhandu has joined #openstack-ironic12:28
*** yedongcan has left #openstack-ironic12:32
dtantsurgudrutiss: you can use the conditions for that12:37
openstackgerritMerged openstack/virtualbmc master: Stop using six library  https://review.opendev.org/69692412:39
gudrutissdtantsur: ok, I see what you mean.12:43
*** lucasagomes has joined #openstack-ironic12:55
*** lucasagomes has quit IRC12:56
*** lucasagomes has joined #openstack-ironic12:56
*** lucasagomes has quit IRC12:57
*** lucasagomes has joined #openstack-ironic12:57
openstackgerritSerena Ziviani proposed openstack/ironic-inspector master: Do not update/delete ports upon inspection of active nodes  https://review.opendev.org/69707513:01
openstackgerritMerged openstack/ironic-inspector master: Create a job with boot and networking managed by ironic  https://review.opendev.org/68892013:07
openstackgerritMerged openstack/ironic-python-agent master: Stop using six library  https://review.opendev.org/69660913:09
arne_wiebalckdtantsur: With global rules, only one set of identical hardware can be verified at any given moment (unless we bend the rules as you suggest) and the rules would need to be changed every time a new set of hardware comes in ... how about grouping rules into sets which could be referenced by nodes?13:11
arne_wiebalckrpittau|bbl: dtantsur: Serena's patch ^ addresses the issue we ran into the other day doing manual inspection.13:14
openstackgerritRiccardo Pittau proposed openstack/networking-baremetal master: Stop using six library  https://review.opendev.org/69708113:23
etingofdtantsur, what's interesting about vmedia jobs that they never fail13:25
etingof(never - by CI standards)13:26
*** ociuhandu has quit IRC13:26
*** ociuhandu has joined #openstack-ironic13:27
*** rh-jelabarre has joined #openstack-ironic13:27
dtantsurarne_wiebalck: I've been long thinking about re-doing introspection rules completely (and probably doing them inside ironic)13:29
dtantsurwe may start collecting requirements for such future project13:29
arne_wiebalckdtantsur: interesting13:30
dtantsuretingof: well, random PXE failures contribute a lot to the overall instability. no PXE - no failures :)13:30
arne_wiebalckdtantsur: Would be nice if per node rule sets could make it to the new design ;)13:30
dtantsurokay, I'll take it into consideration13:31
arne_wiebalckdtantsur: We're preparing to move our procurement team to this, hence the questions.13:31
dtantsurarne_wiebalck: I think we can extend the existing rules to have something like "scope"13:31
dtantsurwith scope != None meaning that rules are applied only to nodes with node.properties['inspection_scope'] == rule.scope13:32
dtantsuror something like that13:32
dtantsurI'd happily review an RFE on this13:32
arne_wiebalckdtantsur: uh, that'd be nice13:32
*** ociuhandu has quit IRC13:33
openstackgerritMerged openstack/ironic stable/stein: Add timeout when querying agent's command statuses  https://review.opendev.org/69648413:33
* rpittau|bbl still sipping coffee13:33
etingofit appears as if vmedia boot is not a total hoax...13:33
arne_wiebalckdtantsur: understood :-)13:33
arne_wiebalckdtantsur: we may be able to propose sth13:34
* arne_wiebalck goes and talks to gudrutiss ...13:34
dtantsurawesome13:36
openstackgerritIlya Etingof proposed openstack/ironic master: Add a CI job to UEFI boot over Redfish virtual media  https://review.opendev.org/69386713:38
* etingof is pocking at Zuul with the sharp edge of the virtual CD ^13:39
*** iurygregory has quit IRC13:42
*** iurygregory has joined #openstack-ironic13:43
*** rpittau|bbl is now known as rpittau13:46
*** rloo has joined #openstack-ironic13:53
* arne_wiebalck convince gudrutiss to work on this :)13:56
* arne_wiebalck *convinced13:56
dtantsur\o/13:56
dtantsurcould someone please approve https://review.opendev.org/#/c/696117/13:57
patchbotpatch 696117 - ironic - Add an ironic-inspector job with managed boot - 2 patch sets13:57
arne_wiebalckdtantsur: we'll probably need to tap your expertise when it comes to introspection rules13:58
dtantsursure thing13:58
*** ricolin has joined #openstack-ironic14:03
arne_wiebalckthx!14:09
TheJuliagood morning14:10
* TheJulia sips coffee to try and wake up14:10
*** Goneri has joined #openstack-ironic14:12
*** rachit7 has quit IRC14:14
*** khansa has quit IRC14:14
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Stop using six library  https://review.opendev.org/69661714:15
openstackgerritIury Gregory Melo Ferreira proposed openstack/metalsmith master: Stop using six library  https://review.opendev.org/69709314:15
*** rachit7 has joined #openstack-ironic14:17
*** khansa has joined #openstack-ironic14:17
dtantsurmorning TheJulia14:17
iurygregorymorning TheJulia14:18
rpittaugood morning TheJulia14:19
khansamorning TheJulia o/14:20
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: TEST DNM Revert "Don't try to put a bootloader in place when bootable"  https://review.opendev.org/69709414:21
TheJulia^^^ test revert, rpioso hit an issue and I'm worried it is that patch that breaks his uefi boot testing, since the firmware never gets updated :\14:22
dtantsursigh14:24
*** trident has quit IRC14:24
*** trident has joined #openstack-ironic14:25
cp-+lib/neutron_plugins/services/l3:_neutron_configure_router_v6:423  sudo ip -6 addr replace 2001:db8::2/64 dev br-ex14:26
cp-RTNETLINK answers: No buffer space available14:26
cp-+lib/neutron_plugins/services/l3:_neutron_configure_router_v6:1  exit_trap14:26
cp-probably because I have not given a public interface so the bridge can not be build with at least 1 member ?14:27
*** jhesketh has quit IRC14:27
cp-oopss probably not the good channel14:27
cp-sorry guys14:27
*** jhesketh has joined #openstack-ironic14:28
openstackgerritIury Gregory Melo Ferreira proposed openstack/sushy-tools master: Stop using six library  https://review.opendev.org/69709814:30
openstackgerritSerena Ziviani proposed openstack/ironic-inspector master: Do not update/delete ports upon inspection of active nodes  https://review.opendev.org/69707514:32
*** pcaruana has quit IRC14:33
rpiosoTheJulia: I don't believe the Dell EMC 3d Party CI encounters the issue, because it uses "standard" cirros images and boot_option=network. I'm testing a whole disk image with boot_option=local, because that's a common workflow for us during deployment of the overcloud.14:36
szivianidtantsur: thanks for the comments, I've uploaded a new patch set14:37
dtantsursziviani: I've already +2'ed it :)14:37
TheJuliarpioso: oh! okay :\14:39
TheJuliarpioso: well, if you want to build an ipa image with the revert incorporated, or edit you existing image and update it, you may see different results14:39
rpiosoTheJulia: Were you able to reproduce my results?14:40
szivianidtantsur: thanks!!14:40
*** jerrywan1 has joined #openstack-ironic14:40
* sziviani feels like a snail14:40
dtantsur:D14:40
*** rachit7 has quit IRC14:40
dtantsurno, it's just me being quick :)14:41
rpittausziviani: no worries, you're not alone :D14:43
TheJuliarpioso: I just woke up and I might not even find the time to try and reproduce your results14:43
TheJuliarpioso: five bazillion things for me to attend to :(14:43
rpiosoTheJulia: I'll be glad to try it. I'm not familiar with building nor modifying an IPA image.14:44
TheJuliarpioso: if you've never done it, it can be a little difficult but we have instructions in the documentation on modifying the image14:45
rpiosoTheJulia: And by modify, I mean edit, as you suggested above.14:46
rpiosoDoc pointer would be much appreciated.14:46
TheJuliayeah edit14:46
TheJuliarpioso: https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#patching-the-deploy-ramdisk14:47
etingofrpioso, FWIW, I have a quick-and-dirty shell script automating ramdisk changes -- http://paste.openstack.org/show/787045/14:53
etingof(quick here does not imply it works quickly)14:55
*** mkrai has joined #openstack-ironic14:57
*** igordc has joined #openstack-ironic14:57
*** ociuhandu has joined #openstack-ironic14:58
*** Lucas_Gray has joined #openstack-ironic15:01
TheJuliarpioso: any chance you can package logs up for the conductor of the deploy you made and ship them on over? if you can match it up with an IPA log, that would also be useful since the odds of me getting a fresh devstack to try and reproduce is just not in the cards for this week with time.15:03
*** pcaruana has joined #openstack-ironic15:04
*** jerrywan1 has quit IRC15:05
*** igordc has quit IRC15:17
*** igordc has joined #openstack-ironic15:25
*** igordc has quit IRC15:30
*** jlvillal has quit IRC15:34
*** jlvillal has joined #openstack-ironic15:35
*** tesseract has quit IRC15:37
*** ociuhandu has quit IRC15:42
*** jtomasek has quit IRC15:42
*** ociuhandu has joined #openstack-ironic15:43
openstackgerritRiccardo Pittau proposed openstack/networking-generic-switch master: Stop using six library  https://review.opendev.org/69711915:44
rpiosoetingof: Thank you!15:47
*** lucasagomes has quit IRC15:47
rpiosoTheJulia: I can definitely get you the conductor log. I haven't been able to obtain IPA logs since my first devstck deployment several weeks ago.15:47
*** lucasagomes has joined #openstack-ironic15:48
openstackgerritDmitry Tantsur proposed openstack/ironic master: Implement managed in-band inspection boot for redfish-virtual-media  https://review.opendev.org/69629115:48
*** tesseract has joined #openstack-ironic15:48
*** ociuhandu has quit IRC15:48
rpiosoIs there an ironic.conf and/or local.conf setting for obtaining IPA logs?15:48
*** ociuhandu has joined #openstack-ironic15:49
iurygregoryrpioso, maybe this will help https://docs.openstack.org/ironic-python-agent/latest/admin/troubleshooting.html#where-can-i-find-the-ipa-logs ?15:59
TheJuliayeah, I am wondering if since your using a centos ramdisk and I'm used to see tinyipa which I bet is 5 files and centos is getting 4 with one just being the journal.15:59
*** mkrai has quit IRC16:02
*** ricolin has quit IRC16:05
*** khansa has quit IRC16:05
*** gyee has joined #openstack-ironic16:19
*** ricolin has joined #openstack-ironic16:26
*** lucasagomes has quit IRC16:31
iurygregoryfirst time I saw UNSTABLE  on gate O.o16:33
iurygregorydell CI XD16:33
TheJuliaJenkins!16:38
*** ociuhandu has quit IRC16:41
*** ricolin has quit IRC16:43
*** jlvillal has quit IRC16:45
*** jlvillal has joined #openstack-ironic16:46
openstackgerritIury Gregory Melo Ferreira proposed openstack/sushy-tools master: Stop using six library  https://review.opendev.org/69709816:48
*** jlvillal has quit IRC16:50
iurygregoryTheJulia, I'm updating the patch for uefi, going home now but I'll work to push changes today after I finish my dinner o/16:51
*** ricolin has joined #openstack-ironic16:52
*** hamzy has quit IRC16:53
*** ricolin has quit IRC16:57
*** iurygregory has quit IRC17:00
*** tesseract has quit IRC17:03
*** aedc has joined #openstack-ironic17:04
dtantsuretingof: it doesn't look like inspection is using CD: https://04b009c71702bdc110bb-5c00355391412ee9732b9566536c5478.ssl.cf5.rackcdn.com/696291/3/check/ironic-tempest-partition-bios-redfish-vmedia/3274c6b/controller/logs/ironic-bm-logs/node-0_no_ansi_2019-12-03-16%3A41%3A11_log.txt.gz17:07
*** jlvillal has joined #openstack-ironic17:09
dtantsurah, damn, I see a trivial problem :)17:10
etingofis it sushy-tools dependency?17:11
rpittaugood night! o/17:11
*** rpittau is now known as rpittau|afk17:12
openstackgerritDmitry Tantsur proposed openstack/ironic master: Implement managed in-band inspection boot for redfish-virtual-media  https://review.opendev.org/69629117:13
dtantsuretingof: like 682 https://review.opendev.org/#/c/696291/4/ironic/drivers/modules/redfish/boot.py :D17:13
patchbotpatch 696291 - ironic - Implement managed in-band inspection boot for redf... - 4 patch sets17:13
dtantsurI missed it initially17:13
*** jlvillal has quit IRC17:14
etingofah17:14
*** jlvillal has joined #openstack-ironic17:14
*** Lucas_Gray has quit IRC17:15
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector stable/train: Stop trying to power off nodes if manage_boot is False  https://review.opendev.org/69714017:16
dtantsurTheJulia, if you have a minute ^^^17:16
TheJuliaafter I get back :(17:18
TheJuliaiuthanks!17:18
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Replace WSME and Pecan with Werkzeug  https://review.opendev.org/69504117:24
dtantsurhave a good night17:31
*** dtantsur is now known as dtantsur|afk17:31
openstackgerritArne Wiebalck proposed openstack/ironic-specs master: Add support for node retirement  https://review.opendev.org/65679917:39
*** ijw has joined #openstack-ironic17:41
arne_wiebalckbye everyone o/17:41
*** jhesketh has quit IRC17:42
*** jhesketh has joined #openstack-ironic17:44
openstackgerritMerged openstack/sushy-tools master: Bring libvirt domain down prior to any change  https://review.opendev.org/69662017:50
openstackgerritMerged openstack/sushy-tools master: Retain boot device selection upon boot image change  https://review.opendev.org/69675217:59
*** jtomasek has joined #openstack-ironic18:03
*** jtomasek has quit IRC18:03
*** ociuhandu has joined #openstack-ironic18:04
*** ociuhandu has quit IRC18:05
*** ijw has quit IRC18:05
*** ociuhandu has joined #openstack-ironic18:07
*** aedc has quit IRC18:09
*** ociuhandu has quit IRC18:12
*** igordc has joined #openstack-ironic18:15
*** ociuhandu has joined #openstack-ironic18:18
*** sshnaidm is now known as sshnaidm|afk18:21
rpiosoiurygregory: Silly question. Is there an issue with the Dell EMC CI?18:23
*** jtomasek has joined #openstack-ironic18:25
*** derekh has quit IRC18:29
rpiosoetingof: I executed the commands through and including "gunzip -c ~/ws/ramdisk.bin | cpio -i"18:34
rpiosoetingof: Not much is written out. There's no opt subdirectory. Also, I can't find image.py, the file TheJulia's prospective fix changes.18:35
etingofrpioso, once you download ramdisk image from glance, the command you've pasted should create the entire filesystem tree in your cwd18:39
*** ociuhandu has quit IRC18:39
*** ociuhandu has joined #openstack-ironic18:40
etingofrpioso, last time I checked, tinycore distro had /opt in the file system tree unpacked18:40
rpiosoetingof: I see etc , usr, and  usr.squashfs18:40
etingofrpioso, this is ipa ramdisk from glance as put there by devstack,, correct?18:44
*** bobmel has joined #openstack-ironic18:44
rpiosoetingof: That's correct.18:44
*** ociuhandu has quit IRC18:44
etingofrpioso, well, does it contain the things you would like to change? e.g. installed ironic-python-agent package?18:45
rpiosoetingof: No, it doesn't.18:45
etingofrpioso, that feels like a wrong image...18:46
etingofrpioso, in devstack log there might be something ipa image creation process18:47
etingofincluding image ID18:47
*** bobmel has quit IRC18:49
etingofTheJulia, rpioso first take -- https://review.opendev.org/#/c/697159/18:52
patchbotpatch 697159 - project-config - Add `sushy-oem-idrac` project - 1 patch set18:52
*** hamzy has joined #openstack-ironic18:59
rpiosoetingof: I see that it wget a few files and "oscwrap image create ir-deploy-redfish.kernel --public --disk-format=aki --container-format=aki"18:59
*** gmann is now known as gmann_afk19:00
*** lucasagomes has joined #openstack-ironic19:01
*** lucasagomes has quit IRC19:01
rpiosoetingof: followed by "oscwrap image create ir-deploy-redfish.initramfs --public --disk-format=ari --container-format=ari"19:03
*** hjensas has quit IRC19:08
TheJuliaetingof: I think the namespaces on https://review.opendev.org/#/c/697159/1 is wrong19:08
patchbotpatch 697159 - project-config - Add `sushy-oem-idrac` project - 1 patch set19:08
TheJuliamainly as driver libraries are not in governance....19:09
larsksMy ironic-inspector-dnsmasq doesn't seem to be responding to queries. I see the queries coming in on the expected interface; there appears to be a matching entry in /var/lib/ironic-inspector/dhcp-hostsdir/, but even with log-queries enabled dnsmasq doesn't seem to see anything. Any thoughts on what I should be looking at?19:13
larsks(osp 15 in a podman container)19:13
rpiosoetingof: I get the same result following the documented approach TheJulia linked -- https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#patching-the-deploy-ramdisk19:38
rpiosoetingof: I passed it /opt/stack/devstack/files/ir-deploy-redfish.initramfs19:40
rpiosoetingof: No opt directory.19:40
*** ijw has joined #openstack-ironic19:41
rpiosoTheJulia: ^^^19:41
*** ijw has quit IRC19:47
etingofTheJulia, jfyi: shuffled the namespaces in https://review.opendev.org/#/c/697159/119:53
patchbotpatch 697159 - project-config - Add `sushy-oem-idrac` project - 2 patch sets19:53
etingofi.e. https://review.opendev.org/#/c/69715919:53
patchbotpatch 697159 - project-config - Add `sushy-oem-idrac` project - 2 patch sets19:53
etingofrpioso, I'd try to track down how devstack builds this ramdisk image at all... Where does filesystem layout come from...19:54
rpiosoetingof: It clones DIB repo20:00
rpiosoetingof: wget https://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe-master.vmlinuz -O /opt/stack/devstack/files/ir-deploy-redfish.kernel20:01
*** ociuhandu has joined #openstack-ironic20:03
rpiosoetingof: wget https://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe_image-oem-master.cpio.gz -O /opt/stack/devstack/files/ir-deploy-redfish.initramfs20:05
rpiosoetingof: And then it appears to upload it into glance --  oscwrap image create ir-deploy-redfish.initramfs --public --disk-format=ari --container-format=ari20:07
*** ociuhandu has quit IRC20:08
rpiosoetingof: It doesn't look like it builds the ramdisk image. Rather, it gets it and give it a new name.20:09
rpiosos/give/gives/20:09
*** ijw has joined #openstack-ironic20:22
openstackgerritMerged openstack/ironic master: Add an ironic-inspector job with managed boot  https://review.opendev.org/69611720:25
*** gmann_afk is now known as gmann20:25
*** ijw has quit IRC20:26
etingofrpioso, ah, my devstack and therefore my script worked with tinycore image20:43
etingofthat is, not coreos20:43
etingofhowever that does not explain why you can't find ironic_python_agent installed somewhere in /usr/lib/python...20:44
etingofrpioso, may be you also need to `unsquashfs usr.squashfs`20:45
etingofor may be switch devstack to tinycore, unless you have reasons to run coreos...?20:46
*** vesper11 has quit IRC20:49
rpiosoetingof: unsquashfs didn't excavate ironic_python_agent. No "*python*" anywhere in ~/ws/rd.20:50
rpiosoetingof: I'm open to using tinycore. What do I need to do?20:50
* rpioso heads out to clean up more snow before it becomes dark and falls below freezing.20:51
*** vesper11 has joined #openstack-ironic20:51
*** dougsz has quit IRC20:52
*** ijw has joined #openstack-ironic20:53
*** ijw has quit IRC20:58
*** ijw has joined #openstack-ironic21:16
*** aedc has joined #openstack-ironic21:18
*** ijw has quit IRC21:20
*** ijw has joined #openstack-ironic21:22
etingofrpioso, perhaps you should use tinyipa-* images from https://tarballs.openstack.org/ironic-python-agent/tinyipa/21:23
TheJulialarsks: is it doing dhcp config based or iptables based filtering for mac addresses?21:23
etingofrpioso, I can see some presumably related devstack options here -- https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L23821:24
larsksTheJulia: I'm pretty sure it's neither of those things. I'm beginning to suspect openvswitch, so I'm trying to find an ovs person to sanity check my configuration.21:24
*** ijw has quit IRC21:26
TheJulialarsks: ack, okay :(21:27
*** Goneri has quit IRC21:33
*** aedc has quit IRC21:40
*** aedc has joined #openstack-ironic21:41
*** ijw has joined #openstack-ironic21:42
*** aedc_ has joined #openstack-ironic21:43
*** ijw has quit IRC21:45
*** aedc has quit IRC21:47
*** ijw has joined #openstack-ironic21:47
*** ijw has quit IRC21:53
*** aedc_ has quit IRC21:58
*** aedc has joined #openstack-ironic21:58
*** hjensas has joined #openstack-ironic22:03
*** pcaruana has quit IRC22:06
*** ijw has joined #openstack-ironic22:06
*** ijw has quit IRC22:09
*** aedc_ has joined #openstack-ironic22:09
*** ijw has joined #openstack-ironic22:11
*** aedc has quit IRC22:11
*** aedc_ has quit IRC22:18
*** alexmcleod has quit IRC22:22
rpiosoetingof, TheJulia: IRONIC_RAMDISK_TYPE has been set to 'dib' in my local.conf \o/. I'll change it to 'tinyipa' and redeploy devstack.22:26
* rpioso cleans up after git push snow.22:27
*** bobmel has joined #openstack-ironic22:48
*** rcernin has joined #openstack-ironic22:57
TheJuliarpioso: suddenly my mind is thinking of "git push snow" becoming "fire up the jet engine and push the snow away!"23:04
openstackgerritMerged openstack/ironic-lib master: mdns: support IPv6 addresses  https://review.opendev.org/69302623:06
*** hamzy has quit IRC23:06
*** hjensas has quit IRC23:13
*** hjensas has joined #openstack-ironic23:15
*** ociuhandu has joined #openstack-ironic23:30
*** ociuhandu has quit IRC23:36
*** ijw has quit IRC23:44
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Permit hashed passwords to be sent to IPA.  https://review.opendev.org/69137223:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!