Monday, 2020-08-03

openstackgerritJacob Anders proposed openstack/ironic master: [WIP]Generic way to configure clean step priorites  https://review.opendev.org/74411700:05
*** ricolin has quit IRC00:41
*** k_mouza has joined #openstack-ironic01:12
*** k_mouza has quit IRC01:16
*** diurnalist has joined #openstack-ironic01:43
*** SuiongNg|ITRI_TW has quit IRC02:30
openstackgerritJacob Anders proposed openstack/ironic master: [WIP]Generic way to configure clean step priorites  https://review.opendev.org/74411702:32
*** ricolin_ has joined #openstack-ironic02:41
*** ricolin_ has quit IRC02:46
*** ricolin_ has joined #openstack-ironic02:46
*** ricolin_ has quit IRC03:25
*** ddurst has quit IRC03:28
*** ddurst has joined #openstack-ironic03:28
*** ociuhandu has joined #openstack-ironic03:53
*** ab-a has quit IRC03:57
*** ociuhandu has quit IRC03:57
*** diurnalist has quit IRC04:07
*** diurnalist has joined #openstack-ironic04:27
*** rcernin has quit IRC04:31
*** diurnalist has quit IRC04:31
*** Goneri has quit IRC04:44
*** rcernin has joined #openstack-ironic04:52
*** diurnalist has joined #openstack-ironic05:11
*** SuiongNg|ITRI_TW has joined #openstack-ironic05:53
*** yolanda has quit IRC05:56
*** yolanda has joined #openstack-ironic05:58
arne_wiebalckGood morning, ironic!06:38
openstackgerritKaifeng Wang proposed openstack/ironic-python-agent master: Extends pci devices metrics  https://review.opendev.org/74440307:00
*** ricolin_ has joined #openstack-ironic07:12
*** ntt__ has joined #openstack-ironic07:16
*** Lucas_Gray has joined #openstack-ironic07:19
*** ricolin_ has quit IRC07:23
*** ricolin has joined #openstack-ironic07:24
openstackgerritShivanand Tendulker proposed openstack/ironic master: Adds support SUM based firmware update as deploy step  https://review.opendev.org/74089307:27
iurygregorygood morning arne_wiebalck and Ironic!07:27
*** yaawang has quit IRC07:32
*** yaawang has joined #openstack-ironic07:32
*** Zempashi has joined #openstack-ironic07:34
*** dougsz has joined #openstack-ironic07:35
*** ociuhandu has joined #openstack-ironic07:40
arne_wiebalckhey iurygregory o/07:51
iurygregoryo/07:51
rpittaugood morning ironic! o/07:56
*** sshnaidm|afk is now known as sshnaidm07:58
*** uzumaki has joined #openstack-ironic07:59
iurygregorygood morning rpittau o/08:00
rpittauhey iurygregory :)08:00
*** yaawang has quit IRC08:02
*** yaawang has joined #openstack-ironic08:03
*** dtantsur|afk is now known as dtantsur08:10
dtantsurmorning ironic08:11
dtantsuris the CI broken or is it my luck again? https://review.opendev.org/#/c/743941/08:13
patchbotpatch 743941 - ironic - Log the traceback of unexpected errors when verify... - 1 patch set08:13
dtantsurmmm, I'd say broken https://zuul.openstack.org/builds?job_name=ironic-tempest-ipa-partition-uefi-pxe-grub208:14
rpittauoh gosh, not that job08:15
rpittaulooks like a kernel panic in ipa ramdisk08:16
dtantsur\o/08:21
dtantsurlow RAM again?08:22
rpittaummm maybe...08:22
rpittauyep: Initramfs unpacking failed: junk in compressed archive08:22
rpittauoh08:22
rpittauthis is actually different08:23
dtantsurOo08:23
rpittauinteresting that it's happening only there though08:23
rpittauthere's also this: timeout reading `00beee59-4187-4108-a0ba-3e380ff96283/deploy_ramdisk'08:31
*** Lucas_Gray has quit IRC08:35
*** ntt has joined #openstack-ironic08:36
iurygregorydtantsur, ++ for the idea to set our  own flavor configs =)08:37
*** ntt__ has quit IRC08:37
*** k_mouza has joined #openstack-ironic08:41
iurygregorywondering if we want to fallback to CONF.compute.flavor_* for stable branches or if we will just backport thigns08:43
openstackgerritAija Jaunteva proposed openstack/ironic-specs master: Operationally efficient & fast-track provisioning  https://review.opendev.org/74072108:47
*** Lucas_Gray has joined #openstack-ironic08:48
gudrutis0HI ironic 0/08:54
*** dougsz has quit IRC09:01
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and switch the keystone jobs to it  https://review.opendev.org/74442109:02
jandersg'day ironic09:02
dtantsuriurygregory: may be of use for your testing ^^^09:02
dtantsurhey janders, gudrutis009:02
rpittauhey janders gudrutis0 :)09:02
*** Lucas_Gray has quit IRC09:13
*** dougsz has joined #openstack-ironic09:15
gudrutis0rpittau: question for you - can you suggest anything for https://bugs.launchpad.net/diskimage-builder/+bug/1887813 ?09:19
openstackLaunchpad bug 1887813 in diskimage-builder "Failed to unmount on clean up when building Centos8 IPA image on Docker" [Undecided,New]09:19
*** Lucas_Gray has joined #openstack-ironic09:25
*** yaawang has quit IRC09:29
rpittaugudrutis0: I think you should check what's keeping that busy, as mentioned in the comment, you should be able to do that with lsof09:29
*** yaawang has joined #openstack-ironic09:32
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and switch the keystone jobs to it  https://review.opendev.org/74442109:43
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add redfish-uefi CI jobs and support default_boot_mode  https://review.opendev.org/74443409:45
*** dtantsur is now known as dtantsur|brb10:09
*** rcernin has quit IRC10:13
*** tkajinam has quit IRC10:13
*** rcernin has joined #openstack-ironic10:14
gudrutis0rpittau: I don't see anything http://paste.openstack.org/show/796532/10:19
rpittaugudrutis0: +D is ok, but can you please try with an old school 'grep', like: lsof | grep /mnt ?10:25
rpittauwell in your case /tmp10:25
gudrutis0```10:26
gudrutis0lsof    1181 root  cwd    DIR   0,54      169 161512418 /tmp10:26
gudrutis0[root@677741bc63ef tmp]#  lsof | grep /tmp10:26
gudrutis0bash       1 root  cwd    DIR   0,54      169 161512418 /tmp10:26
gudrutis0lsof    1182 root  cwd    DIR   0,54      169 161512418 /tmp10:26
gudrutis0grep    1183 root  cwd    DIR   0,54      169 161512418 /tmp10:26
gudrutis0lsof    1184 root  cwd    DIR   0,54      169 161512418 /tmp10:26
gudrutis0```10:26
rpittaugudrutis0: I'm just going through standard ops here, can you please check with fuser?10:28
gudrutis0I dont know this command, can you give me a snippet how to check /tmp directory ?10:33
gudrutis0```10:34
gudrutis0[root@677741bc63ef tmp]# fuser /tmp/10:34
gudrutis0```10:34
gudrutis0`/tmp:                    1c`10:35
*** diurnalist has quit IRC10:50
rpittaugudrutis0: please run it with -vm options, like fuser -vm /tmp10:52
*** uzumaki has quit IRC10:56
*** rcernin has quit IRC11:02
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and switch the keystone jobs to it  https://review.opendev.org/74442111:03
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add redfish-uefi CI jobs and support default_boot_mode  https://review.opendev.org/74443411:09
gudrutis0rpittau:11:17
gudrutis0```11:17
gudrutis0[root@31938eba4821 CERN_scripts]# fuser -vm /tmp11:17
gudrutis0                     USER        PID ACCESS COMMAND11:17
gudrutis0                     root          1 .rce. bash11:17
gudrutis0```11:17
*** Lucas_Gray has quit IRC11:19
*** Lucas_Gray has joined #openstack-ironic11:31
openstackgerritAnkit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type  https://review.opendev.org/74349011:48
*** janders has quit IRC11:49
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add redfish-uefi CI jobs and support default_boot_mode  https://review.opendev.org/74443411:51
*** rh-jelabarre has joined #openstack-ironic11:56
*** janders has joined #openstack-ironic11:57
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and switch the keystone jobs to it  https://review.opendev.org/74442111:57
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add redfish-uefi CI jobs and support default_boot_mode  https://review.opendev.org/74443411:58
*** dtantsur|brb is now known as dtantsur11:58
openstackgerritMerged openstack/networking-generic-switch master: Add support for Cumulus 4.x NCLU driver  https://review.opendev.org/74326912:08
*** k_mouza has quit IRC12:16
*** k_mouza has joined #openstack-ironic12:23
*** k_mouza has quit IRC12:28
rpittaugudrutis0: is /tmp actually mounted as a separate fs ? or it's the temp target inside /tmp/ that is mounted ?12:36
gudrutis0it is this temp directory `/tmp/dib_image.OEXt5BEC`12:38
rpittaugudrutis0: ok, please run fuser on that then12:38
*** diurnalist has joined #openstack-ironic12:47
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and add CI jobs with Redfish and UEFI  https://review.opendev.org/74442112:48
openstackgerritDmitry Tantsur proposed openstack/bifrost master: [WIP] Configure redfish virtual media  https://review.opendev.org/74445912:50
gudrutis0rpittau: I wrote you the output privately in order not to spam the chanel12:52
iurygregorygudrutis0, you can post the output here (use paste.openstack.org/ ) =)12:54
*** belmoreira has joined #openstack-ironic12:55
rpittauthe more I check the jobs, the more I think the problem with ironic-tempest-ipa-partition-uefi-pxe-grub2 is  timeout reading `b881fd17-cc55-49ee-a627-e0f642b8d09f/deploy_ramdisk'13:05
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and add CI jobs with Redfish and UEFI  https://review.opendev.org/74442113:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and add CI jobs with Redfish and UEFI  https://review.opendev.org/74442113:23
openstackgerritDmitry Tantsur proposed openstack/bifrost master: [WIP] Configure redfish virtual media  https://review.opendev.org/74445913:27
TheJuliagood morning13:30
dtantsurmorning TheJulia13:32
iurygregorygood morning TheJulia =)13:34
rpittaugood morning TheJulia :)13:35
openstackgerritRiccardo Pittau proposed openstack/ironic master: DNM TEST CI  https://review.opendev.org/74138913:36
rpittauheh tinycore is working fine :/13:37
*** rcernin has joined #openstack-ironic13:38
openstackgerritDmitry Tantsur proposed openstack/sushy-tools master: Fix handling SUSHY_EMULATOR_CONFIG when running under a WSGI server  https://review.opendev.org/74447113:38
* dtantsur le sigh ^^^13:38
dtantsurI guess the sushy emulator just happens to work in the CI because the defaults are good enough13:38
TheJuliadtantsur: replied to your comments on https://review.opendev.org/#/c/744077/1, I'll rev it later but it should hopefully explain why log.exception is just a bad idea13:39
patchbotpatch 744077 - ironic-python-agent - Fix TypeError on agent lookup failure - 1 patch set13:39
dtantsurTheJulia: hmm, okay, I just hope we never get a KeyError or something like that..13:40
TheJuliawell, any exception at that point totally tanks the process13:40
TheJuliaso we're in "handling the process crashing" at that point13:40
TheJuliaor "failing hard"13:41
dtantsurI mean, KeyError's are impossible to debug from the message only :)13:41
TheJulia$word_of_choice_for_process_going_to_exit_with_non_zero_error_code13:41
TheJuliathis was impossible to debug without video of it happening :(13:41
dtantsurle sigh * 213:41
TheJuliayeah :(13:41
*** k_mouza has joined #openstack-ironic13:42
* TheJulia goes and re-coffees13:43
* dtantsur has seen https://github.com/metal3-io/ironic-image/blob/master/Dockerfile#L19-L21 and wants to throw his monitor in the window13:44
dtantsuroh, and sushy-tools unit tests still don't work on 3.8. just saying it in case someone's Monday is not bad enough already :)13:44
jandersgood morning TheJulia o/13:45
*** tzumainn has joined #openstack-ironic13:47
TheJuliagood morning janders :(13:47
TheJuliaerr :( was for dtantsur's latest message13:47
*** k_mouza has quit IRC13:47
jandersno worries :)13:47
rpittaudtantsur: re unit test py3.8 weird I tested them last week :/13:48
* rpittau is not having a good monday13:48
rpittaudtantsur: Ran: 168 tests in 0.3469 sec.13:49
rpittau - Passed: 16813:49
openstackgerritChristopher Dearborn proposed openstack/sushy master: Fix retrieving software & firmware inventory  https://review.opendev.org/74447413:52
*** k_mouza has joined #openstack-ironic13:54
iurygregorydtantsur, sushy-tools was fixed for 3.8 I think rpittau fixed O.o13:54
iurygregoryat least I do remember a patch...13:54
rpittauyeah, it should be fine now, there was also a patch or two last week that merged and we're using victoria tests with py3.813:55
openstackgerritVerification of a change to openstack/ironic failed: Use TLS for json_rpc when configured  https://review.opendev.org/74413213:55
rpittauactually I think I fixed that when we switched to victoria tests13:55
dtantsurrpittau: yeah, I somehow managed not to rebase on gerrit/master. sorry for the noise.13:59
rpittauno worries! :)14:00
* dtantsur gets back to trying to make redfish+UEFI work on bifrost14:00
*** JamesBenson has joined #openstack-ironic14:02
dtantsurjesus, suse, why are you so special all the time???14:06
jandersit may be their music videos dtantsur14:07
jandersshame the os isn't as cool14:07
dtantsurheh14:07
jandershttps://www.youtube.com/watch?v=SYRlTISvjww14:08
jandersI realised it's just past midnight here, I better wrap up14:08
janderssee you tomorrow, have a good one! :)14:08
dtantsurg'night janders14:09
janderscheers dtantsur14:09
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Support redfish emulation and add CI jobs with Redfish and UEFI  https://review.opendev.org/74442114:10
openstackgerritDmitry Tantsur proposed openstack/bifrost master: [WIP] Configure redfish virtual media  https://review.opendev.org/74445914:11
TheJuliahow would people rate the gate today?14:12
TheJuliaI ask because the status was last updated 2020-07-2014:13
dtantsurTheJulia: well.. https://zuul.openstack.org/builds?job_name=ironic-tempest-ipa-partition-uefi-pxe-grub214:13
*** jhesketh has quit IRC14:14
*** ntt has quit IRC14:15
TheJuliawell then14:16
TheJuliaIt is too early to drink14:16
TheJuliabut it seems like a Redbreast day14:16
*** jhesketh has joined #openstack-ironic14:16
dtantsurMonday..14:17
dtantsurat least we have 3 days of relief from heat14:17
TheJuliait looks like it is timing out on the tftp download14:18
TheJuliaI wonder if it is then trying to boot with an incomplete ramdisk14:18
TheJuliaor no ramdisk at all14:19
TheJuliaLovely14:19
TheJuliaHas anyone taken apart the dstat numbers yet for one of the uefi-pxe-grub2 jobs?14:20
iurygregoryTheJulia, quick question, do you want to participate in the discussion about the multinode grenade this week? =)14:25
iurygregorybest day seems to be Thursday, just wondering if the time would be ok for you https://doodle.com/poll/m69b5zwnsbgcysct14:26
TheJuliaiurygregory: checking other calendar14:30
iurygregoryTheJulia, take your time =)14:30
TheJuliayeah, I can14:30
TheJuliaresponded to the poll14:31
iurygregory\o/14:31
*** rcernin has quit IRC14:32
iurygregoryThursday 2pm-3pm UTC14:32
* iurygregory sends email to openstack-discuss14:32
TheJuliaEveryone in the states is like... trying to buy an RV and go roaming and working remote.14:33
iurygregoryWOW O.o14:33
*** stendulker has joined #openstack-ironic14:38
*** ntt has joined #openstack-ironic14:42
arne_wiebalckHmm ... is it possible that I need to set the ipmi_address in the driver_info for introspection to work when the node uses redfish as its driver?14:45
*** rcernin has joined #openstack-ironic14:45
TheJuliamaybe. inspector doesn't know to try the redfish address14:45
TheJuliaAlso it is a url versus not14:45
TheJuliaalso... inspector does't know how to extract the bmc url yet14:46
dtantsurarne_wiebalck: rather a MAC address14:46
arne_wiebalckThe inspector uses get_ipmi_address from utils14:46
dtantsurwe have two lookup strategies: MAC addresses and IPMI address14:46
dtantsurfor non-IPMI nodes we're pretty much stuck with the former14:46
* TheJulia wonders when rackcdn's download will be done14:46
TheJuliahmm, looks like we're not dumping the extra debug info anymore14:49
TheJuliaor never did for this job14:49
arne_wiebalckdtantsur: and both strategies are tried?14:49
dtantsurarne_wiebalck: yep14:49
arne_wiebalckhmm, setting the mac address is not very nice as it can change (while an IP address can stay)14:50
*** cdearborn has joined #openstack-ironic14:54
dtantsurwe've been considering other lookup fields (motherboard UUID?), but nobody has proposed anything14:54
TheJuliachassis uuid/serial which is obtainable via redfish and ipmi14:55
TheJuliadownside is the db query :\14:55
dtantsurfolks, plz review: https://review.opendev.org/#/c/744471/14:59
patchbotpatch 744471 - sushy-tools - Fix handling SUSHY_EMULATOR_CONFIG when running un... - 1 patch set14:59
dtantsurI have to work around it in bifrost for now..14:59
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Aug  3 15:00:16 2020 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
TheJuliao/15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
openstackThe meeting name has been set to 'ironic'15:00
erbarro/15:00
rpioso\o15:00
ajyao/15:00
stendulkero/15:00
arne_wiebalcko/15:00
*** kaifeng has joined #openstack-ironic15:00
dtantsuro/15:01
kaifengo/15:01
bdoddo/15:01
TheJuliaOur agenda can be found on the wiki, as always.15:01
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:01
TheJuliaOn a plus side, it looks a bit light this week.15:01
iurygregoryo/15:01
rpittauo/15:01
TheJulia#topic Announcements / Reminder15:02
*** openstack changes topic to "Announcements / Reminder (Meeting topic: ironic)"15:02
TheJuliaI only have two items this week. The first is reviews. Please spend some time reviewing, even just one patch a day can help everyone else out quite a bit.15:02
TheJuliaThe second item CI. It has been failing a lot and we're essentially due to cut another release this week.15:03
dtantsurnot next week?15:03
TheJuliaI believe it is this week15:03
* TheJulia looks15:03
rpittauwe might need to swtich grub2 job to tinycore temporary as dib seems just not working due to timeout15:03
TheJuliaokay, next week15:03
TheJuliaWeek of August 10th15:03
cdearborno/15:04
TheJuliaPossibly, I'd love to get a little more debugging info because we should be able to transfer the required amount of data into the VM in time15:04
TheJuliaat least, in theory15:04
TheJuliaBottom line, its failure rates is functionally blocking.15:05
TheJuliaDoes anyone else have anything to remind us of this week?15:05
TheJuliaOh, one more item. Today is the last day to submit items for the Open Infra Summit!15:06
TheJulia#link https://cfp.openstack.org/15:06
kaifengmaybe cyborg has a topic on baremetal gpu scheduling15:07
iurygregoryit's tomorrow TheJulia =)15:07
iurygregory(for me it's wed at 9am)15:07
TheJuliaiurygregory: Ugh, I'm completely off on my internal clock. Maybe I just need to go back to bed15:07
TheJuliaOr something15:07
TheJuliaAnyway15:07
TheJuliaOkay, TWO days!15:07
dtantsurbed++15:07
iurygregoryyeah =)15:08
iurygregorygo back to bed, dtantsur will be the chair =D15:08
TheJuliaWell, if there is nothing else, we can skip action items since we had none last week15:08
TheJuliaAnd proceed directly to Subteam Status reports15:08
iurygregorywe will have the grenade meeting on Thursday 2pm UTC =)15:08
TheJulia#info Meeting on grenade on Thursday - 2PM UTC15:09
TheJuliaiurygregory: got a link yet?15:09
iurygregoryyeah15:09
TheJuliaor are we going to use our shiny thing15:09
TheJuliaI can't remember the URL right now15:09
iurygregorythread http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016241.html15:09
TheJuliameetpad!15:09
rpittauhttps://meetpad.opendev.org/etherpad/p/ironic ?15:10
TheJuliaThat works15:10
iurygregoryI was planning in use bluejeans15:10
TheJulia#link https://bluejeans.com/imelofer15:10
TheJuliathat works15:10
iurygregoryok =)15:10
TheJuliaOnward!15:10
TheJulia#topic subteam status reports15:10
*** openstack changes topic to "subteam status reports (Meeting topic: ironic)"15:10
TheJuliaI don't expect there to have been much progress in the last week. CI is evil.15:10
TheJulia#link https://etherpad.opendev.org/p/IronicWhiteBoard15:11
TheJuliaStarting around line 29415:11
TheJuliaCan anyone provide a standalone authentication topic update on the etherpad?15:12
dtantsurI thought I did..15:14
TheJuliadates are as of like a montha go15:14
TheJuliamonth ago15:14
dtantsuraha, fixed the date :)15:14
iurygregory20200803?15:14
TheJuliaahh! okay15:14
* dtantsur reminds himself that August is the 8th month15:14
TheJuliaheh15:14
iurygregoryhehehe15:14
dtantsurI even did it right 2 times of 3 today :)15:15
TheJuliaI'm firmly in the "it is still march" crowd15:15
dtantsureverything after that has been cancelled15:15
TheJuliaiurygregory: dhcp-less deployments. Is there a next step?15:15
iurygregoryI asked people from dib today if diskimage-builder already provides the support (since I think it does)15:15
TheJuliaI'm kind of wondering what is missing15:15
iurygregoryso next setp would be only testing in hardware15:16
TheJuliaokay15:16
TheJuliaThat may be able to be orchustrated15:16
iurygregoryand update the docs "how to build an image" etc15:16
iurygregory=)15:16
TheJuliaMaybe start on docs and someone else could try and give it a spin?15:16
dtantsurI'm trying to make virtual media work on bifrost for testing, without much success so far though15:17
*** janders has quit IRC15:17
iurygregoryI will update the ironic patch with the docs, let me get a confirmation from diskimage-builder team =)15:17
*** belmoreira has quit IRC15:17
iurygregorydtantsur, ouch15:17
dtantsurnever ending fun of UEFI, largely :)15:18
rpittauunified extensible fun interface ?15:18
dtantsur++15:18
TheJuliasure sounds _fun_15:18
iurygregoryrpittau, LOL15:19
TheJuliaiurygregory: any progress on privsep?15:19
iurygregorytouching again this week15:19
TheJuliaok15:19
iurygregoryIm removing tests that we require the non-root15:19
TheJuliaoh joy15:20
iurygregorysince things will BOOM since privsep will require that...15:20
iurygregorywe had some discussion about it if I do remember15:20
*** ntt has quit IRC15:20
TheJuliayeah15:21
TheJuliaWe're going to need to make sure to get eyes on that quickly to merge it this cycle15:21
iurygregoryack15:21
TheJuliaAre we good with updates?15:22
dtantsuryep15:22
iurygregoryyeah15:22
TheJulia#topic Deciding on priorities for the coming week15:22
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)"15:22
TheJulia#link https://etherpad.opendev.org/p/IronicWhiteBoard15:22
TheJuliaStarting at line 14215:22
TheJuliaDoes anyone have anything to add this week?15:23
dtantsurI've added a few things in the end. most/all are minor15:23
ajyanot me, but can anyone take a look at https://review.opendev.org/#/c/740721/ that's already priority, now has WIP removed15:23
patchbotpatch 740721 - ironic-specs - Operationally efficient & fast-track provisioning - 12 patch sets15:23
TheJuliabdodd: your change 730000 has a great changeset number :)15:24
TheJuliabdodd: Also, is that still a WIP?15:24
bdoddTheJulia I know!15:24
bdoddTheJulia Yes, still WIP. But any feedback appreciated.15:25
TheJuliaok15:25
TheJuliaOkay, cleaned up, Lots didn't move forward last week because of CI issues, again if anyone can spend some cycles this week to trying to identify/fix CI issues, it would be greatly appreciated.15:28
TheJuliaEveryone good with the list? Shall we move on?15:31
TheJuliaAs always, CI fixes should go to the top of the list.15:31
TheJuliaOh, I should add they fun ipa bug15:31
dtantsur"fun"15:32
dtantsurotherwise, lgtm15:32
*** ociuhandu_ has joined #openstack-ironic15:32
TheJuliaYeah, "fun"</sarcasm></ultra-sarcasm></sarcasm-of-sadness>15:33
*** ociuhandu has quit IRC15:33
TheJuliaAlthough I'm unsure if dashes are XML compliant15:33
TheJuliaSince we have no discussion items, we'll go directly to Baremetal sig for a quick stop before proceeding to Open Discussion, if that is alright with everyone?15:34
dkingTheJulia: Thank you. I suppose that it makes sense that if you just look at the highest number in that list, then you should have all the features. However, would it be possible to list the latest API version at the top of that page, or a link or instructions on where to find it? Perhaps even a list of highest versions supported by each stable release. It's not necessary, but I think it might be helpful.15:34
dtantsur++15:34
rpittauyep15:35
TheJuliadking: I guess that is largely served by our api version history doc15:35
dkingI was thinking about adding a bug report to request that be added. What project would that be?15:35
TheJulia#topic Baremetal SIG15:35
*** openstack changes topic to "Baremetal SIG (Meeting topic: ironic)"15:35
arne_wiebalckSIG: still need to send out the mail re monthly meetings, otherwise I don't think there is anything to report atm15:35
TheJuliaarne_wiebalck: your quick! You beat me to even asking the question!15:35
arne_wiebalck:)15:35
dkingOops. I forget the meeting times. Sorry about that.15:35
TheJuliaSounds good to me!15:35
TheJuliadking: no worries15:35
TheJuliaWell then Open Discussion!15:36
TheJulia#topic Open Discussion15:36
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:36
TheJuliadking: https://docs.openstack.org/ironic/latest/contributor/webapi-version-history.html tracks with the code and covers version, and release point.15:37
* TheJulia hears crickets15:38
TheJuliahttps://www.youtube.com/watch?v=K8E_zMLCRNg15:39
TheJuliaWell, I guess everyone is looking at CI issues  then... or working on their summit proposals!15:39
TheJuliaI guess that means we can call it a meeting then15:40
TheJuliaThanks everyone!15:40
kaifengThank you Julia15:41
rpittauthanks!15:41
TheJulia#endmeeting15:41
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."15:41
openstackMeeting ended Mon Aug  3 15:41:54 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:41
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-03-15.00.html15:41
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-03-15.00.txt15:41
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-03-15.00.log.html15:42
openstackgerritRiccardo Pittau proposed openstack/ironic-tempest-plugin master: Enforce check on flake8 E129 test  https://review.opendev.org/74451415:42
*** k_mouza has quit IRC15:42
dkingTheJulia: That page is great, but it seems to only list to 1.67, where the API documentation lists updates all the way to 1.8.15:49
*** k_mouza has joined #openstack-ironic15:50
TheJuliadking: scroll down15:50
TheJuliahttps://docs.openstack.org/ironic/latest/contributor/webapi-version-history.html#id4015:50
openstackgerritJulia Kreger proposed openstack/ironic master: Get extra logging output  https://review.opendev.org/74451715:56
openstackgerritKaifeng Wang proposed openstack/ironic master: [WIP] Fix console auto port allocation under IPv6  https://review.opendev.org/74451815:57
*** dtantsur is now known as dtantsur|afk15:58
dtantsur|afko/15:58
dkingOkay. I still might want to put in a request to make it more clear, rather than having to scroll down a separate page.15:58
dkingdtantsur|afk: Have a good night.15:58
arne_wiebalckTheJulia: Adding an ipmi_address entry to the driver_info works for inspection with a redfish driver ... it would feel less awkward if it was called bmc address, though :)16:10
arne_wiebalckbmc_address16:10
*** stendulker has quit IRC16:12
*** rcernin has quit IRC16:15
arne_wiebalckTheJulia: Would it make sense to extract the redfish endpoint host from the URL in redfish_address and use this the same way ipmi_address is used now?16:23
*** dougsz has quit IRC16:35
*** rcernin has joined #openstack-ironic16:50
openstackgerritMerged openstack/sushy-tools master: Fix handling SUSHY_EMULATOR_CONFIG when running under a WSGI server  https://review.opendev.org/74447116:50
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Fix TypeError on agent lookup failure  https://review.opendev.org/74407716:51
TheJuliadtantsur|afk: ^^^ revised16:51
TheJuliaperhaps, or maybe we allow the api to search multiple options16:52
TheJuliaAlthough, I think it is already doing a field level like to find the match16:52
*** sshnaidm has quit IRC16:55
arne_wiebalckbye everyone o/16:57
*** rcernin has quit IRC16:59
openstackgerritVerification of a change to openstack/sushy-tools failed: Update version of hacking  https://review.opendev.org/74396217:00
dkingWhat would be the project name be for submitting a bug for the baremetal api documentation?17:17
dkingIt's been too long since I updated documentation.17:17
*** k_mouza has quit IRC17:19
iurygregorydking, a bug in ironic's api goes in storyboard ironic17:24
dkingiurygregory: Thank you very much.17:24
iurygregorydking, https://storyboard.openstack.org/#!/project/openstack/ironic17:24
*** Lucas_Gray has quit IRC17:26
*** k_mouza has joined #openstack-ironic17:35
*** kaifeng has quit IRC18:00
*** k_mouza has quit IRC18:06
*** k_mouza has joined #openstack-ironic18:09
*** sshnaidm has joined #openstack-ironic18:14
*** gyee has joined #openstack-ironic18:17
*** sdanni has joined #openstack-ironic18:26
openstackgerritJulia Kreger proposed openstack/ironic master: Change UEFI PXE job to use tinyipa  https://review.opendev.org/74453518:33
TheJuliaiurygregory: you around?18:41
iurygregoryTheJulia, yes18:43
TheJuliahttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5dc/744052/1/check/ipa-tempest-partition-bios-ipmi-direct-tinyipa-src/5dc7460/testr_results.html <-- rocky18:43
TheJulia:(18:43
iurygregoryouch =O18:43
iurygregorywe don't test rocky in ironic-tempest-plugin right?18:44
TheJuliaohh.... we might not18:44
* iurygregory cheks the config of the job in rocky18:45
TheJuliaYeah, I'm thinking that is likely the easiest path at this point18:45
TheJuliadefine the jobs18:45
TheJuliaspecific jobs18:45
iurygregoryWe can just change the tempest regex for it18:45
iurygregorywdyt?18:45
TheJuliayup18:45
iurygregoryack, will take care of it18:46
TheJuliaI think that works and if you want to do it for rocky real quick I'll take it to the older branches so I can merge fixes18:46
iurygregoryworking on it18:46
openstackgerritJulia Kreger proposed openstack/ironic stable/ussuri: Update number of VM on ironic-base  https://review.opendev.org/74453818:56
openstackgerritJulia Kreger proposed openstack/ironic stable/train: Update number of VM on ironic-base  https://review.opendev.org/74453919:00
openstackgerritJulia Kreger proposed openstack/ironic stable/train: Update number of VM on ironic-base  https://review.opendev.org/74453919:04
openstackgerritJulia Kreger proposed openstack/ironic stable/stein: Update number of VM on ironic-base  https://review.opendev.org/74454019:08
openstackgerritJulia Kreger proposed openstack/ironic stable/rocky: Update number of VM on ironic-base  https://review.opendev.org/74454119:09
TheJuliaugh, I'm tempted to turn off the jobs on queens19:12
TheJuliaerr19:13
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/rocky: Use specific tempest regex for each job  https://review.opendev.org/74454219:19
iurygregoryTheJulia, let's see how it goes ^19:19
TheJuliaiurygregory: thanks19:19
iurygregoryfingers crossed that will help19:20
*** k_mouza has quit IRC19:23
openstackgerritJulia Kreger proposed openstack/ironic stable/queens: Change VM_COUNT to 2  https://review.opendev.org/74454319:24
TheJuliaso that should at least help some of it and wherever the happy medium needs to be we can solve it19:24
iurygregoryoh wow we run with only 119:25
*** k_mouza has joined #openstack-ironic19:31
*** zaneb has quit IRC19:33
*** zaneb has joined #openstack-ironic19:33
TheJuliaiurygregory: was there anything else that we really needed to backport19:33
TheJuliaI'm wondering if this is why everyting on older branches is grumpy right now19:34
* iurygregory cheks19:35
*** k_mouza has quit IRC19:36
*** Zempashi has quit IRC19:37
*** Zempashi has joined #openstack-ironic19:38
*** JamesBen_ has joined #openstack-ironic19:38
iurygregorywe have https://review.opendev.org/#/q/Ic6faf73430e56e2b1ff19a72b1b03f8ef34eff5f19:39
iurygregorywe probably need to old branches since we have uefi jobs19:39
*** JamesBenson has quit IRC19:41
iurygregorythis one fits with the backports you did19:41
iurygregoryat least we increase the number of VMs19:41
TheJuliaWe might just need to turn off CI for some older branches and force some stuff in to fix the jobs :(19:42
iurygregoryyeah19:43
TheJuliaugh19:43
iurygregoryOH NO19:43
iurygregorywe don't19:43
iurygregorythere is another way19:43
TheJulia?19:43
iurygregorypin ironic-tempest-plugin version19:43
TheJuliayou know,, that would work19:43
TheJuliathat would acutally solve all of this19:43
iurygregoryit should19:43
iurygregory=X19:43
iurygregoryyeah...19:43
TheJuliagot that handy?19:43
iurygregorydoing now19:44
TheJuliak19:44
iurygregorywhich branches I should go for first?19:44
iurygregoryqueens/rocky?19:45
TheJuliawell, I see this on stein on ipa19:45
iurygregoryok19:45
dkingI'm not sure if I did it right, but I added the story https://storyboard.openstack.org/#!/story/200797519:45
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic-python-agent stable/stein: Pin Ironic Tempest Plugin  https://review.opendev.org/74454619:53
iurygregoryTheJulia, fingers crossed19:53
TheJuliaIt is a good starting point :)19:53
iurygregoryyeah19:54
iurygregoryjust wondering how the legacy jobs will handle19:54
TheJuliaYeahhhhhh19:54
* iurygregory watches zuul streaming the console of the jobs19:55
iurygregoryNote: checking out '1.5.1'. \o/20:00
iurygregorygo ipa go20:00
iurygregoryTheJulia, do you want me to go and push the pin for the tempest plugin on stein for ironic? pushing there would help the zuulv3 jobs on the other projects and we just need to pin the legacy ones20:06
TheJuliaiurygregory: likely a good idea20:06
iurygregoryack20:06
TheJuliaThat will at least give us a good idea where things shake out20:06
TheJuliaI may have to make a chart to detail what/where is broke20:06
TheJuliabroken20:06
TheJuliaerr, looks like ipa train as well :(20:08
*** k_mouza has joined #openstack-ironic20:09
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/stein: Pin ironic-tempest-plugin  https://review.opendev.org/74454720:09
iurygregorytrain should probably be fine after we change the number of VM's20:10
openstackgerritJulia Kreger proposed openstack/ironic-python-agent stable/train: Pin Ironic Tempest Plugin  https://review.opendev.org/74454820:11
iurygregorytrain should be pin to 2.0.020:13
iurygregorysteain and older would need 1.5.1 (since it supports py2)20:13
*** k_mouza has quit IRC20:14
openstackgerritJulia Kreger proposed openstack/ironic-python-agent stable/train: Pin Ironic Tempest Plugin  https://review.opendev.org/74454820:15
TheJuliadone.20:16
*** aedc has joined #openstack-ironic20:16
* iurygregory takes note about things to do next time updating tempest jobs to take over the world...20:18
TheJuliaheh20:18
TheJuliaAnd then there is likely also ironic-lib but the odds we'll backport a change there anytime soon are kind of remote20:18
iurygregorywill look at it20:19
iurygregoryfingers crossed with multiple windoes showing the zuul progress20:19
TheJuliaheh20:19
TheJuliahopefully20:19
iurygregoryyeah, otherwise I won't be able to sleep well and zuul will give me nightmares probably20:20
TheJuliaheh20:24
TheJuliawell get some rest. I have a slew of patches to update while CI chews on these patches20:24
iurygregoryI will, but not now =) (probably in about 2hrs)20:25
TheJuliaheh20:25
iurygregorywow, now there is the open source security foundation =O20:29
*** Lucas_Gray has joined #openstack-ironic20:31
TheJuliasigh20:38
TheJuliaso when is the "your not secure unless you join our foundation" marketing ?20:39
iurygregoryno idea =X20:39
*** janders has joined #openstack-ironic20:39
*** k_mouza has joined #openstack-ironic20:43
iurygregory744546 helped for 2 jobs so far20:43
iurygregoryhttps://review.opendev.org/#/c/744546/ ipa-tempest-partition-bios-ipmi-direct-tinyipa-src ipa-tempest-wholedisk-bios-ipmi-iscsi-tinyipa-src are green20:44
patchbotpatch 744546 - ironic-python-agent (stable/stein) - Pin Ironic Tempest Plugin - 1 patch set20:44
*** k_mouza has quit IRC20:48
*** janders has quit IRC20:48
*** janders has joined #openstack-ironic20:52
*** cdearborn has quit IRC20:53
*** rcernin has joined #openstack-ironic20:56
TheJulia\o/20:57
openstackgerritJulia Kreger proposed openstack/ironic master: Prevents power sync with ADOPTFAIL nodes  https://review.opendev.org/74332220:59
iurygregoryfunny the ironic patch fails in l-c, but locally it's working O.o20:59
*** rcernin has quit IRC21:01
*** Zempashi has quit IRC21:13
iurygregoryTheJulia, so https://review.opendev.org/#/c/744547 helps for ironic was checking in https://zuul.openstack.org/status (l-c failled but I couldn't reproduce locally)21:13
patchbotpatch 744547 - ironic (stable/stein) - Pin ironic-tempest-plugin - 1 patch set21:13
iurygregoryipa is green https://review.opendev.org/#/c/744546/21:26
patchbotpatch 744546 - ironic-python-agent (stable/stein) - Pin Ironic Tempest Plugin - 1 patch set21:26
iurygregoryofc grenade multinode also decided to cause problems -.-'21:32
TheJulia:(21:39
iurygregorythe other multinode also seems unhappy =(21:39
*** diurnalist has quit IRC21:40
iurygregorywell we know it works for 90%+ of the jobs21:40
iurygregoryhttps://review.opendev.org/#/c/744547/21:40
patchbotpatch 744547 - ironic (stable/stein) - Pin ironic-tempest-plugin - 1 patch set21:40
iurygregoryWTF  Request to https://10.209.129.64:9696/v2.0/ports timed out21:42
iurygregoryreally?!21:42
iurygregoryseems like I forgot to update the multinode job21:43
* iurygregory double checks21:43
iurygregoryofc I did, because multinode doesn't use ironic-base hehe21:44
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/stein: Pin ironic-tempest-plugin  https://review.opendev.org/74454721:45
iurygregoryTheJulia, any thougts on disabling multinode-grenade on stein to get the fix in ?21:57
TheJulianight as well21:58
TheJuliamight21:58
TheJuliaat that old, we just need to validate basic funcitionality is good and not blowing up on basic bug fixes21:59
*** tkajinam has joined #openstack-ironic21:59
iurygregoryack22:00
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/stein: Pin ironic-tempest-plugin  https://review.opendev.org/74454722:00
iurygregorydone22:00
*** k_mouza has joined #openstack-ironic22:00
iurygregorythis should fix stable/stein for most projects if not all =)22:01
* TheJulia crosses fingers22:03
TheJuliaI'm going to go lay down for a little bit, thanks iurygregory22:03
iurygregoryTheJulia, np o/ take care22:03
iurygregoryI'm going to try a backport for rocky and queens so we can get results22:04
*** k_mouza has quit IRC22:05
*** ociuhandu has joined #openstack-ironic22:05
*** ociuhandu_ has quit IRC22:07
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Pin ironic-tempest-plugin  https://review.opendev.org/74456422:11
*** bdodd has quit IRC22:14
*** janders has quit IRC22:17
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/rocky: Pin ironic-tempest-plugin  https://review.opendev.org/74456722:20
iurygregoryQueens should be fine since we already use 1.5.1 https://github.com/openstack/ironic/blob/stable/queens/zuul.d/legacy-ironic-jobs.yaml#L2322:23
TheJuliaiurygregory: <322:26
*** sdanni has quit IRC22:39
openstackgerritMerged openstack/ironic-python-agent-builder master: Support installing with Python 3 on CentOS 7  https://review.opendev.org/74419722:41
openstackgerritMerged openstack/ironic-python-agent stable/ussuri: Update jobs  https://review.opendev.org/74324823:10
openstackgerritMerged openstack/ironic-python-agent stable/ussuri: Ignore devices with size 0 when collecting inventory  https://review.opendev.org/74117123:10
*** rcernin has joined #openstack-ironic23:12
*** bdodd has joined #openstack-ironic23:14
*** Lucas_Gray has quit IRC23:14
*** rcernin has quit IRC23:15
*** rcernin has joined #openstack-ironic23:16
*** Lucas_Gray has joined #openstack-ironic23:19
*** janders has joined #openstack-ironic23:24
jandersgood morning Ironic o/23:26
*** diurnalist has joined #openstack-ironic23:28
TheJuliagood morning janders23:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!