Thursday, 2020-02-20

*** stevebaker has quit IRC00:36
*** TxGirlGeek has quit IRC00:40
*** TxGirlGeek has joined #openstack-ironic00:43
*** gyee has quit IRC00:48
*** stevebaker has joined #openstack-ironic01:15
*** rloo has quit IRC01:17
*** ociuhandu has quit IRC01:27
*** ociuhandu has joined #openstack-ironic01:28
*** ociuhandu has quit IRC01:34
openstackgerritKaifeng Wang proposed openstack/ironic master: Project Contributing updates for Goal  https://review.opendev.org/70793002:01
*** TxGirlGeek has quit IRC02:02
*** ricolin has quit IRC02:25
*** hwoarang has quit IRC02:29
*** hwoarang has joined #openstack-ironic02:31
*** Goneri has quit IRC02:34
*** igordc has quit IRC02:45
openstackgerritMerged openstack/ironic master: Project Contributing updates for Goal  https://review.opendev.org/70793002:48
*** ijw has quit IRC02:55
*** openstackstatus has joined #openstack-ironic02:56
*** ChanServ sets mode: +v openstackstatus02:56
*** mkrai has joined #openstack-ironic03:00
*** ricolin has joined #openstack-ironic03:02
*** ociuhandu has joined #openstack-ironic03:11
*** ociuhandu has quit IRC03:16
*** ijw has joined #openstack-ironic03:23
*** ijw has quit IRC03:28
*** stevebaker has quit IRC03:40
*** mkrai has quit IRC03:56
*** mkrai_ has joined #openstack-ironic03:57
*** hwoarang has quit IRC04:01
*** ijw has joined #openstack-ironic04:11
*** mkrai_ has quit IRC04:16
*** mkrai has joined #openstack-ironic04:21
*** mkrai has quit IRC04:36
*** ijw has quit IRC05:22
*** ijw has joined #openstack-ironic05:25
*** ijw has quit IRC05:29
*** ociuhandu has joined #openstack-ironic05:30
*** ociuhandu has quit IRC05:35
*** ijw has joined #openstack-ironic05:56
*** ijw has quit IRC06:01
*** yolanda has joined #openstack-ironic06:22
*** Lucas_Gray has joined #openstack-ironic06:24
*** ijw has joined #openstack-ironic06:28
*** priteau has joined #openstack-ironic06:30
*** ijw has quit IRC06:32
*** Lucas_Gray has quit IRC06:41
*** Lucas_Gray has joined #openstack-ironic06:42
*** k_mouza has joined #openstack-ironic06:52
*** k_mouza has quit IRC06:56
*** ijw has joined #openstack-ironic06:59
*** ijw has quit IRC07:03
*** Lucas_Gray has quit IRC07:25
*** ijw has joined #openstack-ironic07:30
arne_wiebalckGood morning, ironic!07:32
*** priteau has quit IRC07:34
*** ijw has quit IRC07:35
*** ociuhandu has joined #openstack-ironic07:40
*** Lucas_Gray has joined #openstack-ironic07:43
*** ociuhandu has quit IRC07:45
*** ijw has joined #openstack-ironic08:02
*** tesseract has joined #openstack-ironic08:05
*** ijw has quit IRC08:06
*** ociuhandu has joined #openstack-ironic08:13
*** ociuhandu has quit IRC08:17
*** ociuhandu has joined #openstack-ironic08:19
*** rpittau|afk is now known as rpittau08:26
rpittaugood morning ironic! o/08:26
*** iurygregory has joined #openstack-ironic08:31
iurygregorygood morning Ironic08:31
*** ijw has joined #openstack-ironic08:33
*** ijw has quit IRC08:38
*** tesseract has quit IRC08:38
*** tesseract has joined #openstack-ironic08:39
*** amoralej|off is now known as amoralej08:40
*** ociuhandu has quit IRC08:50
*** ociuhandu has joined #openstack-ironic08:56
*** dougsz has joined #openstack-ironic08:59
*** Lucas_Gray has quit IRC09:02
*** ijw has joined #openstack-ironic09:05
openstackgerritIlya Etingof proposed openstack/virtualbmc master: Fix hanging on shell-pipe  https://review.opendev.org/70848309:09
*** lucasagomes has joined #openstack-ironic09:09
*** ijw has quit IRC09:09
*** k_mouza has joined #openstack-ironic09:16
*** tkajinam has quit IRC09:19
*** priteau has joined #openstack-ironic09:20
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Use train branch for centos7 job  https://review.opendev.org/70629209:23
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Force DIB_PYTHON_VERSION to 3 for Debian  https://review.opendev.org/70577309:26
*** hwoarang has joined #openstack-ironic09:27
*** derekh has joined #openstack-ironic09:29
*** k_mouza_ has joined #openstack-ironic09:35
*** ijw has joined #openstack-ironic09:36
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Fix RAID create_config clean step  https://review.opendev.org/70716909:38
*** k_mouza has quit IRC09:38
*** ijw has quit IRC09:40
*** Lucas_Gray has joined #openstack-ironic09:43
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent stable/train: Rescan after restarting the md device  https://review.opendev.org/70882709:49
*** tesseract has quit IRC09:58
openstackgerritIlya Etingof proposed openstack/virtualbmc master: Fix hanging on shell-pipe  https://review.opendev.org/70848310:02
*** Lucas_Gray has quit IRC10:03
*** ijw has joined #openstack-ironic10:07
*** alexmcleod has joined #openstack-ironic10:07
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic-prometheus-exporter master: Fix None for instance_uuid label  https://review.opendev.org/70634610:08
iurygregoryrpittau, done, I forgot about the Task =)10:09
openstackgerritIlya Etingof proposed openstack/virtualbmc master: Fix hanging on shell-pipe  https://review.opendev.org/70848310:10
*** tesseract has joined #openstack-ironic10:11
*** ijw has quit IRC10:11
*** Lucas_Gray has joined #openstack-ironic10:14
*** Wryhder has joined #openstack-ironic10:17
*** Lucas_Gray has quit IRC10:18
*** Wryhder is now known as Lucas_Gray10:19
*** ijw has joined #openstack-ironic10:38
*** ijw has quit IRC10:43
*** Lucas_Gray has quit IRC11:02
*** ijw has joined #openstack-ironic11:09
*** ijw has quit IRC11:14
*** rpittau is now known as rpittau|bbl11:20
*** Lucas_Gray has joined #openstack-ironic11:39
*** ijw has joined #openstack-ironic11:41
*** ijw has quit IRC11:45
*** dtantsur|afk is now known as dtantsur11:51
dtantsurmorning/afternoon ironic11:51
*** amoralej is now known as amoralej|lunch12:01
iurygregorydtantsur, afternoon o/12:02
gudrutis2dtantsur: hi 0/`12:06
openstackgerritZygimantas Matonis proposed openstack/ironic-python-agent-builder master: Append ironic-python-agent-ramdisk path to ELEMENTH_PATH instead overriding.  https://review.opendev.org/70885812:14
openstackgerritIlya Etingof proposed openstack/virtualbmc master: Fix hanging on shell-pipe  https://review.opendev.org/70848312:33
*** ijw has joined #openstack-ironic12:43
*** ijw has quit IRC12:47
openstackgerritIlya Etingof proposed openstack/ironic master: Rename `create_isolinux_image_for_uefi` function as misleading  https://review.opendev.org/70886412:58
*** rh-jelabarre has joined #openstack-ironic13:03
*** rpittau|bbl is now known as rpittau13:07
*** ijw has joined #openstack-ironic13:15
*** ijw has quit IRC13:19
openstackgerritDmitry Tantsur proposed openstack/ironic master: Provide a foundation for purely out-of-band deploy/clean steps execution  https://review.opendev.org/70863813:21
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic-prometheus-exporter stable/train: Fix timeseries in redfish parser  https://review.opendev.org/70887213:22
openstackgerritDmitry Tantsur proposed openstack/ironic master: Provide a foundation for purely out-of-band deploy/clean steps execution  https://review.opendev.org/70863813:23
*** amoralej|lunch is now known as amoralej13:28
openstackgerritDmitry Tantsur proposed openstack/ironic master: WIP: Generalize clean step functions to support deploy steps  https://review.opendev.org/69876813:29
*** rloo has joined #openstack-ironic13:31
*** Lucas_Gray has quit IRC13:38
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Fix RAID create_config clean step  https://review.opendev.org/70716913:45
*** ijw has joined #openstack-ironic13:46
*** ociuhandu has quit IRC13:50
*** ijw has quit IRC13:51
*** Goneri has joined #openstack-ironic13:55
*** ociuhandu has joined #openstack-ironic13:58
*** ociuhandu has quit IRC14:02
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Use train branch for centos7 job  https://review.opendev.org/70629214:05
openstackgerritDmitry Tantsur proposed openstack/ironic master: Start removing ipxe support from the pxe interface  https://review.opendev.org/69666614:10
openstackgerritDmitry Tantsur proposed openstack/ironic master: Finalize removal of ipxe_enabled option  https://review.opendev.org/69835214:11
*** ijw has joined #openstack-ironic14:18
*** ijw has quit IRC14:22
*** ociuhandu has joined #openstack-ironic14:29
openstackgerritkhansa proposed openstack/sushy-cli master: Add manager vmedia command  https://review.opendev.org/70889014:32
openstackgerritkhansa proposed openstack/sushy-cli master: Add manager vmedia command  https://review.opendev.org/70889014:33
openstackgerritMerged openstack/ironic-python-agent-builder master: Force DIB_PYTHON_VERSION to 3 for Debian  https://review.opendev.org/70577314:39
*** tzumainn has joined #openstack-ironic14:46
*** ijw has joined #openstack-ironic14:49
*** ijw has quit IRC14:54
dougszHave any folks seen very high call volumes to the placement API (specifically: GET/resource_providers/$ID/inventories)?14:54
dougszI'm talking about 10 million per day for 150 baremetal nodes.14:54
dtantsurdougsz: it's probably a question to #openstack-nova, but maybe arne_wiebalck has?15:04
arne_wiebalckdougsz: I don't have numbers at hand, but the interaction of nova for ironic with placement was (and is) an issue.15:04
arne_wiebalckdougsz: At lot of work has been done in the recent releases to improve the situation.15:04
arne_wiebalckdougsz: We still run a patched version of the resource tracker.15:05
dougszthanks both - this is on rocky, so there is hope15:05
dougszThat's interesting arne, do you share the patched resource tracker, or is that an internal thing?15:06
arne_wiebalckdougsz: I don't think issues were fixed in Stein.15:06
*** jdandrea has joined #openstack-ironic15:06
arne_wiebalckdougsz: Our patch does not reduce the number of calls, just what it collects.15:06
arne_wiebalckdougsz: I'd also suggest to check in #openstack-nova. I can try to get numbers from our deployment, so you can compare.15:08
arne_wiebalckdougsz: We are on Stein atm.15:08
dougszMany thanks arne_wiebalck :)15:08
arne_wiebalckdougsz: FWIW, we will try to shard nova-compute with conductor groups to handle our current scale.15:09
dougszYou guys are running 1000s of nodes in a single cell?15:10
arne_wiebalckdougsz: Yes.15:10
arne_wiebalckdougsz: https://techblog.web.cern.ch/techblog/post/nova-ironic-at-scale/15:11
dougszExcellent, thanks15:11
openstackgerritVerification of a change to openstack/ironic-inspector failed: Change CoreOS to Centos for IPA  https://review.opendev.org/70717415:14
*** ijw has joined #openstack-ironic15:21
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Expose allocation owner to additional policy checks  https://review.opendev.org/70730715:23
*** ijw has quit IRC15:25
*** ijw has joined #openstack-ironic15:53
*** ijw has quit IRC15:58
openstackgerritVerification of a change to openstack/ironic failed: Refactoring: rename agent_base_vendor to agent_base  https://review.opendev.org/70867616:10
*** gyee has joined #openstack-ironic16:14
*** ijw has joined #openstack-ironic16:24
*** ijw has quit IRC16:29
*** ijw has joined #openstack-ironic16:30
*** jdandrea has quit IRC16:44
*** ociuhandu has quit IRC16:44
*** TxGirlGeek has joined #openstack-ironic16:45
*** TxGirlGeek has quit IRC16:46
*** ociuhandu has joined #openstack-ironic16:46
*** dtantsur is now known as dtantsur|afk16:51
dtantsur|afkhave a good night16:51
*** ociuhandu has quit IRC16:52
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Native zuulv3 grenade job for ironic  https://review.opendev.org/70309816:52
rpittaugood night! o/16:53
*** rpittau is now known as rpittau|afk16:53
iurygregorygn rpittau|afk16:53
*** jdandrea_ has joined #openstack-ironic16:58
*** lucasagomes has quit IRC16:58
*** tesseract has quit IRC17:00
*** jdandrea_ has quit IRC17:03
openstackgerritArne Wiebalck proposed openstack/ironic-python-agent master: [WIP] Software RAID: make it bootable with uefi  https://review.opendev.org/69615617:08
*** ociuhandu has joined #openstack-ironic17:12
openstackgerritZygimantas Matonis proposed openstack/ironic-python-agent-builder master: Fix ELEMENTS_PATH environment variable being overwritten.  https://review.opendev.org/70892717:23
*** ijw has quit IRC17:34
*** dking_desktop has joined #openstack-ironic17:38
*** k_mouza_ has quit IRC17:42
dking_desktopWhat I'm reading makes it seem that baremetal nodes can only be a part of a tenant network if they are attached to a switch which can be programmed by ML2. Am I understanding that correctly?17:46
*** ociuhandu_ has joined #openstack-ironic18:00
*** derekh has quit IRC18:02
*** ociuhandu has quit IRC18:04
*** ociuhandu_ has quit IRC18:05
*** TxGirlGeek has joined #openstack-ironic18:18
*** ijw has joined #openstack-ironic18:27
*** ijw has quit IRC18:32
*** igordc has joined #openstack-ironic18:34
*** amoralej is now known as amoralej|off18:36
TheJuliadking_desktop: that is correct, there is no other way to make that happen18:55
dking_desktopI'm assuming that's for security reasons?18:58
*** ijw has joined #openstack-ironic18:59
TheJuliabasically yes. The machines an either live on a shared flat network, or be on a tenant network with ML2 moving the port mappings around.18:59
*** ijw has quit IRC19:03
*** ijw has joined #openstack-ironic19:08
*** ijw has quit IRC19:13
*** stevebaker has joined #openstack-ironic19:15
openstackgerritJulia Kreger proposed openstack/ironic master: Change force_raw_images to use sha256 if md5 is selected  https://review.opendev.org/70849919:16
*** ijw has joined #openstack-ironic19:30
openstackgerritJulia Kreger proposed openstack/ironic master: Change [deploy]/default_boot_option to local  https://review.opendev.org/49211419:34
*** ijw has quit IRC19:35
*** igordc has quit IRC19:38
*** ijw has joined #openstack-ironic20:02
*** ijw has quit IRC20:07
*** jtwill98 has joined #openstack-ironic20:19
TheJuliarpioso: you around?20:20
openstackgerritJulia Kreger proposed openstack/ironic master: DRAC: Fix RAID create_config clean step  https://review.opendev.org/70716920:25
*** penick has joined #openstack-ironic20:27
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan devices before performing uefi checks  https://review.opendev.org/70666720:28
*** priteau has quit IRC20:44
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add NTP time sync  https://review.opendev.org/70791121:00
*** Lucas_Gray has joined #openstack-ironic21:03
*** Lucas_Gray has quit IRC21:03
openstackgerritMerged openstack/ironic-inspector master: Change CoreOS to Centos for IPA  https://review.opendev.org/70717421:14
*** dougsz has quit IRC21:21
*** Goneri has quit IRC21:25
*** jtwill98 has quit IRC21:26
*** igordc has joined #openstack-ironic21:28
openstackgerritMerged openstack/ironic master: Refactoring: rename agent_base_vendor to agent_base  https://review.opendev.org/70867621:40
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Hash the rescue_password  https://review.opendev.org/69141321:48
*** phibs has joined #openstack-ironic21:59
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141321:59
phibsAnyone know how to contact: Jarrod Johnson: https://opendev.org/x/pyghmi/commits/branch/master ?21:59
dking_desktopTheJulia: Thank you for the information.22:08
dking_desktopIs there a separate channel for Bifrost?22:09
TheJuliadking_desktop: no, there is not a separate channel just for bifrost22:10
TheJuliaphibs: last I heard he was still at Lenovo22:11
phibsnod, I've not been successful in contacting him :(22:11
TheJuliajungleboyj: o/ you around?22:12
TheJuliaphibs: some sort of problem i take it? I'm hoping jungleboyj can confirm for us22:14
TheJuliaconfirm presence there that is22:14
phibsyes I am having issues using it with grpc threads where initial requests work, subsequent fail / hang trying to get an ipmi session :(22:15
dking_desktopThat's unfortunate. It seems like they would have a lot of different issues. Anyway, if anybody knows, I just attempted to deploy bifrost, and first, I notice that it want me to run "ironic node-list". There is no "ironic" binary, and "openstack baremetal node list" can't connect to port 6385, because there's nothing listening there.22:16
dking_desktopI'm not really certain how they start the ironic-api or where the logs are at.22:17
TheJuliadking_desktop: the whole switch to python3 made it a little harder to get running depending on how your trying to install. Also, sounds like old docs need to be fixed because it is now "openstack baremetal node list"22:18
TheJuliaphibs: I'm having some deja vu fom  a long time ago with threading and pyghmi22:18
dking_desktopYeah, that was my thought. I was going through: https://docs.openstack.org/kolla-ansible/latest/reference/deployment-and-bootstrapping/bifrost.html22:18
phibsTheJulia: ut oh :)22:18
dking_desktopI imagine that's been outdated for a while. But the URL has "latest" in it.22:20
dking_desktopHmm... But that's a kolla-ansible URL, so maybe they're the right place to discuss that?22:21
*** penick has quit IRC22:22
TheJuliadking_desktop: if your following thier docs, maybe but the python3 switchover really broke their bifrost builds :\22:22
dking_desktopI'm using kolla-ansible for their builds, and I really do like their containers. But it's good to know that it's probably not just me.22:24
dking_desktopWas the change in Train? I thought that they weren't switching to Python 3 until Ussuri? And wasn't the change to use the openstack cli done before even stein?22:25
TheJuliadking_desktop: change was in ussuri/master branch builds22:25
dking_desktopThe documentation hasn't been updated in much longer than that. Oh, well. Maybe when they do update, they'll get the documentation and everything. :)22:26
phibsTheJulia: also to note, this only happens with subsequent requests for teh same BMC address22:26
phibsserver works fine with consecutive requests for different BMC addresses22:27
phibsbut as soon as I re-use one used prior, hangs22:27
TheJuliaphibs: oh wow, this is sounding really familiar22:28
phibsTheJulia: if you can remember the solution you deserve some beer ;022:29
phibsI am using the latest pip release btw22:29
TheJuliaphibs: Sadly this was from a long time ago, so I don't quite rember if there is a solution22:30
phibsyeah I even tried calling ipmi.ipmi_session.logout() after i'm done, did not help22:32
phibssaid no session when I call again22:32
openstackgerritJulia Kreger proposed openstack/ironic master: Pre-shared agent token  https://review.opendev.org/69260922:33
*** iurygregory has quit IRC22:36
TheJuliawell, here is a new one, only run unit tests for the functional test run22:45
TheJuliaon ipa22:45
TheJuliaphibs: by chance, did you look through launchpad?22:46
phibsyeah i've submitted bugs there with no response ;022:47
TheJuliathis feels like it has been a thing for a long time22:47
TheJuliasince my brain is recalling from like... 5 years ago22:48
phibsyeah i'm open to any workarounds ;022:48
TheJuliaphibs: Maybe take a look at the ironic code from when we had the ipminative driver?22:51
*** ijw has joined #openstack-ironic22:51
TheJuliahttps://github.com/openstack/ironic/blob/kilo-eol/ironic/drivers/modules/ipminative.py22:51
phibsyeh maybe I could just use my own lib and rip out all the threading and such since I just want 1 shot stuff22:52
TheJuliacould definitely work22:53
phibsthe win I want is not having to shell out to ipmitool :)22:53
phibsI have a ton of CLI tools using pyghmi already, just nothing server side service :(22:53
*** tkajinam has joined #openstack-ironic22:58
jungleboyjTheJulia: trying to catch up.22:59
TheJuliaI'm totally unsure of how we're going to fix the funtional tests, looks like when the hardware manager loads, raid assembly attempt blows it up. http://paste.openstack.org/show/789821/23:00
jungleboyjYes. Jared Johnson is still at Lenovo. I can look up his email address a little bit later if you need it.23:00
TheJuliajungleboyj: phibs may already have it, but... it might help them, dunno.23:02
* TheJulia feels really bad that she doesn't have a magical solution for phibs 23:02
jungleboyjI am at the gym right now will try to look at the throwback more closely later. Know Jared well enough that I can pin him and try to get more attention.23:03
TheJuliajungleboyj: <323:03
phibsTheJulia: I appreciate the attention at least ;023:05
phibsjungleboyj: thanks!23:05
jungleboyjNp.23:06
*** ociuhandu has joined #openstack-ironic23:16
*** ociuhandu has quit IRC23:22
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Agent token support  https://review.opendev.org/69261423:42
phibsso if I create a global DICT in my server to store BMC sessions, that works (I don't call get new session if hostname already in the dictionary). I just don't know how to tell when it needs to be renewed/removed ;023:44
openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178523:48
openstackgerritJulia Kreger proposed openstack/ironic master: Send our token back to the agent  https://review.opendev.org/69758523:48
openstackgerritJulia Kreger proposed openstack/ironic master: Enable agent_token for virtual media boot  https://review.opendev.org/69758423:48
openstackgerritJulia Kreger proposed openstack/ironic master: Signal agent token is required  https://review.opendev.org/69930423:48
openstackgerritJulia Kreger proposed openstack/ironic master: Send our token back to the agent  https://review.opendev.org/69758523:51
openstackgerritJulia Kreger proposed openstack/ironic master: Signal agent token is required  https://review.opendev.org/69930423:51
TheJuliaphibs: maybe have a periodic thread that triggers every so often?23:52
*** alexmcleod has quit IRC23:52
phibsyeah I just don't know how totest to see if it is still valid23:55
TheJuliamock sleep?23:56
phibswhatcha mean23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!