Monday, 2020-05-25

*** rcernin has quit IRC00:06
openstackgerritBrin Zhang proposed openstack/ironic-lib master: Bump hacking min version to 3.0.1  https://review.opendev.org/72872200:12
*** rcernin has joined #openstack-ironic00:25
*** xiaolin has joined #openstack-ironic00:58
*** jawad_axd has joined #openstack-ironic01:18
*** jawad_axd has quit IRC01:23
*** yaawang has joined #openstack-ironic02:17
*** ociuhandu has joined #openstack-ironic02:27
*** ociuhandu has quit IRC02:32
openstackgerritMaAoyu proposed openstack/ironic master: Add py38 package metadata  https://review.opendev.org/73054402:33
openstackgerritMaAoyu proposed openstack/ironic-inspector master: Add py38 package metadata  https://review.opendev.org/73054802:55
*** stevebaker has quit IRC04:10
*** threestrands has joined #openstack-ironic04:38
*** ociuhandu has joined #openstack-ironic05:36
openstackgerritMaël Kimmerlin proposed openstack/ironic master: Do not fail when raw image is larger than memory for http  https://review.opendev.org/73031705:41
*** ociuhandu has quit IRC05:46
*** ociuhandu has joined #openstack-ironic05:47
*** ociuhandu has quit IRC05:52
*** Qianbiao has joined #openstack-ironic06:17
*** jawad_axd has joined #openstack-ironic06:18
*** ociuhandu has joined #openstack-ironic06:39
*** ociuhandu has quit IRC06:46
arne_wiebalckGood morning, ironic!06:47
QianbiaoMorning arne_wiebalck06:47
Qianbiaohappy monday :)06:47
arne_wiebalckHey Qianbiao, same to you!06:47
Qianbiao;)06:48
*** jhesketh has quit IRC07:03
*** jhesketh has joined #openstack-ironic07:05
iurygregorygood morning arne_wiebalck, Qianbiao and Ironic o/07:20
Qianbiaomorning iurygregory07:20
*** rpittau|afk is now known as rpittau07:21
rpittaugood morning ironic!07:21
rpittauHappy Towel Day!07:21
iurygregorymorning rpittau o/07:22
iurygregoryHappy Towel Day ++07:22
rpittauhey iurygregory :)07:23
*** k_mouza has joined #openstack-ironic07:23
*** jhesketh has quit IRC07:25
*** jhesketh has joined #openstack-ironic07:25
*** k_mouza has quit IRC07:28
* iurygregory grabs more coffee07:28
*** sshnaidm|off is now known as sshnaidm07:37
arne_wiebalckHey iurygregory rpittau o/07:38
rpittauhey arne_wiebalck :)07:38
* rpittau dives in mails and messages07:44
*** ociuhandu has joined #openstack-ironic07:46
*** yolanda has joined #openstack-ironic07:49
* arne_wiebalck is preparing the upgrade and was not aware there were no db schema changes between Stein and Train07:54
*** lucasagomes has joined #openstack-ironic07:55
* iurygregory assumes arne_wiebalck is happy07:56
arne_wiebalckoh, that makes the upgrade less scary for sure07:56
rpittauless scary :D07:56
iurygregoryless scary =)07:56
arne_wiebalckit is just I never had this in all the upgrades I did so far07:56
rpittauthat sounds a bit odd actually, not saying it couldn't happen07:57
* arne_wiebalck thinks rpittau and iurygregory are fearless07:57
arne_wiebalckI could not believe it initially :-D07:57
iurygregoryhehehe07:57
arne_wiebalckno db schema changes: some call it "going stale", others "becoming mature"07:59
rpittauother "forgetting something"08:00
* iurygregory goes back try to figure out how to make wholedisk + uefi work in our CI =(08:01
*** tkajinam has quit IRC08:01
iurygregoryif anyone has ideas feel free to say =)08:01
arne_wiebalckiurygregory: what is the issue?08:02
*** gkadam has joined #openstack-ironic08:03
*** gkadam has quit IRC08:03
iurygregoryarne_wiebalck, I'm trying uefi with the following config boot interface pxe, hardware type ipmi, deploy interface iscsi using tinyipa08:06
iurygregoryhttps://zuul.opendev.org/t/openstack/build/67cc0100fd7642da8710abd7e03cf7f3/log/controller/logs/ironic-bm-logs/node-0_console_2020-05-19-09:09:44_log.txt#1440 it founds uefi partition but it can't mount08:07
rpittauwhen any good-hearted core has a minute to spare: https://review.opendev.org/72863508:08
patchbotpatch 728635 - python-ironic-inspector-client - Reduce timeout for tempest job - 8 patch sets08:08
iurygregoryrpittau, wow08:08
iurygregory=O08:08
iurygregoryreduce ++08:08
rpittauyeah, that's some better numbers :)08:09
iurygregory+208:09
rpittauthanks08:09
rpittauI see all the ironic-lib jobs broken oO08:09
iurygregoryrpittau, well they are fixed already08:10
iurygregory=)08:10
iurygregoryjust put a recheck08:10
rpittauok08:10
iurygregorywe merged https://review.opendev.org/72974608:10
patchbotpatch 729746 - ironic-lib - Fix DIB jobs (MERGED) - 3 patch sets08:10
arne_wiebalckiurygregory: could it be that the partition is mounted already?08:10
iurygregoryarne_wiebalck, well looking at the workflow I don't see how this can happen O.o08:11
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: Split and move logic for partition tables  https://review.opendev.org/72265408:11
arne_wiebalckiurygregory: is there an fstab?08:11
gudrutis2morning ironic08:12
iurygregorymorning gudrutis208:12
iurygregoryarne_wiebalck, let me check08:12
arne_wiebalckiurygregory: can you issue a "mount" before you try to mount to see what is mounted?08:12
*** dtantsur|afk is now known as dtantsur08:12
dtantsurmorning ironic08:12
iurygregoryarne_wiebalck, maybe if I add a patch to ipa and try to use a depends-On....08:12
arne_wiebalckiurygregory: I haven't looked at the definitions of the return codes, but it seem 32 is busy08:12
arne_wiebalckhey dtantsur o/08:13
iurygregorymorning dtantsur o/08:13
iurygregoryI hope you enjoyed the time off =)08:13
rpittauhey dtantsur :)08:13
dtantsurhey-hey! yeah, it was pretty good to disconnect for a while08:14
dtantsurokay, I don't think I'll read the whole scrollback, just let me know if you needed anything from me or I need to be aware of anything08:16
arne_wiebalckiurygregory: EBUSY is 1608:16
arne_wiebalckiurygregory: still, I'd try to see what is mounted at that point08:16
arne_wiebalckiurygregory: or if there is anything fstab which would mount /boot/efi08:17
iurygregorywe don't collect fstab =(08:18
iurygregoryfunny that the lsblk doesn't show sda1508:20
iurygregoryO.o08:20
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix pip3 path  https://review.opendev.org/73057308:22
*** xiaolin has quit IRC08:24
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop installing openstackclient if keystone is not enabled  https://review.opendev.org/73057508:25
*** xiaolin has joined #openstack-ironic08:28
openstackgerritAndreas Jaeger proposed openstack/virtualbmc master: Fix doc build failure  https://review.opendev.org/73057608:29
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Deprecate a separate bifrost-inspector cloud  https://review.opendev.org/73057708:30
*** adrianc has joined #openstack-ironic08:34
openstackgerritAndreas Jaeger proposed openstack/virtualbmc master: Fix doc build failure  https://review.opendev.org/73057608:45
rpittauI don't think we should not remove six from lower-constraints if it's a req for other libs08:47
dtantsurTheJulia, all, since the PTG is around the corner, I took a liberty to compose a preliminary schedule from whatever is proposed atm: https://etherpad.opendev.org/p/Ironic-VictoriaPTG-Planning08:48
openstackgerritMerged openstack/ironic-specs master: Switch to newer openstackdocstheme version  https://review.opendev.org/73051008:48
dtantsurlemme know if I'm doing something wrong :)08:48
*** ociuhandu has quit IRC08:49
iurygregorydtantsur, ++08:51
openstackgerritRiccardo Pittau proposed openstack/ironic-prometheus-exporter master: Revert "Remove six"  https://review.opendev.org/73058408:51
iurygregoryrpittau, that makes sense, if another project requires six we need in l-c08:53
iurygregorymaybe not all projects removed after the py3 migration08:54
rpittauiurygregory: yeah08:54
dtantsursome non-openstack projects may keep it for loooong time09:05
iurygregoryyeah09:11
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Make the keystone job voting and re-enable commented out jobs  https://review.opendev.org/73059109:12
iurygregorydtantsur, did you had a chance to look at the things we are doing wrong with rabbit in ironic inspector?09:12
iurygregoryI remember you talked with some people from oslo, but i don't remember if you started looking at the issue09:13
dtantsuriurygregory: I got nowhere with it :( at some point the job started passing again and I went on PTO :)09:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop installing openstackclient if keystone is not enabled  https://review.opendev.org/73057509:13
iurygregorydtantsur, gotcha =)09:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Deprecate a separate bifrost-inspector cloud  https://review.opendev.org/73057709:14
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix pip3 path  https://review.opendev.org/73057309:28
openstackgerritRiccardo Pittau proposed openstack/bifrost master: [WIP] rework install-deps script  https://review.opendev.org/73059909:33
iurygregorydtantsur, do you know how we can request a release of osc-lib? I think we will only be able to move with https://review.opendev.org/720986 after they do a release that includes the removal of mock on their side  2.0.0 doesn't include =(09:38
patchbotpatch 720986 - python-ironic-inspector-client - Use unittest.mock instead of third party mock - 2 patch sets09:38
openstackgerritAndreas Jaeger proposed openstack/virtualbmc master: Switch to newer openstackdocstheme and reno versions  https://review.opendev.org/73009909:43
*** ociuhandu has joined #openstack-ironic09:45
*** jhesketh has quit IRC09:48
*** jhesketh has joined #openstack-ironic09:49
openstackgerritVerification of a change to openstack/python-ironic-inspector-client failed: Reduce timeout for tempest job  https://review.opendev.org/72863509:53
iurygregoryofc CI is trolling ^09:54
rpittauit still failed for timeout, it took a couple minutes too long09:57
iurygregoryyup09:57
rpittauit varies a lot09:57
iurygregoryperformance issues =(09:57
rpittauI'm tempted to go for 2100 seconds, 35 minutes09:58
iurygregorybefore was 3600 right?10:00
rpittauyeah10:00
iurygregorymaybe we can be conservative, and use 75% 80% of it and see how it goes10:01
openstackgerritMerged openstack/python-ironic-inspector-client master: Update releasenotes conf  https://review.opendev.org/72992910:02
dtantsurrpittau: to avoid stepping on your shoes: are you looking into the opensuse bifrost failures?10:08
rpittaudtantsur: I was barely looking at the logs, not started anything yet10:09
rpittauI'm mostly focused on the bionic and centos8 issues10:09
dtantsurokay10:10
rpittauand I think now I remember why we need the full pip3 path....10:11
*** rpittau is now known as rpittau|bbl10:12
dtantsurrpittau|bbl: unpopular opinion: scripts/install-deps should be removed in favour of actual playbooks10:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Repair openSUSE support  https://review.opendev.org/73060910:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop installing openstackclient if keystone is not enabled  https://review.opendev.org/73057510:16
dtantsuriurygregory: a trivial review if you have a second: https://review.opendev.org/#/c/730591/10:18
patchbotpatch 730591 - bifrost - Make the keystone job voting and re-enable comment... - 1 patch set10:18
openstackgerritVerification of a change to openstack/ironic failed: Do not fail when raw image is larger than memory for http  https://review.opendev.org/73031710:21
iurygregorydtantsur, done10:22
dtantsurthx!10:22
dtantsurrpittau|bbl: I mean, python, pip and ansible can be installed from it, but everything else should probably go through bindep10:25
dtantsuractually, even python should go through bindep probably..10:25
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop installing openstackclient if keystone is not enabled  https://review.opendev.org/73057510:38
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop installing openstackclient if keystone is not enabled  https://review.opendev.org/73057510:38
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Repair openSUSE support  https://review.opendev.org/73060910:39
dtantsuriurygregory: missed your question re osc-lib: I've already asked Monty10:41
iurygregorydtantsur, tks!10:45
iurygregoryat least i think that is the reason for the failures =)10:45
openstackgerritMerged openstack/bifrost master: Make the keystone job voting and re-enable commented out jobs  https://review.opendev.org/73059110:47
*** derekh has joined #openstack-ironic10:51
*** ociuhandu has quit IRC11:00
*** ociuhandu has joined #openstack-ironic11:01
*** ociuhandu has quit IRC11:05
*** threestrands has quit IRC11:11
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Repair openSUSE support  https://review.opendev.org/73060911:17
gudrutis2can you delete comments in storyboard ? :D11:20
openstackgerritMerged openstack/ironic-python-agent master: Switch to newer openstackdocstheme and reno versions  https://review.opendev.org/72994611:23
openstackgerritMerged openstack/ironic-tempest-plugin master: Switch to newer openstackdocstheme version  https://review.opendev.org/73051111:23
openstackgerritVerification of a change to openstack/ironic-inspector failed: Set tempest_test_timeout for managed job  https://review.opendev.org/73051511:23
iurygregoryI don't think so11:23
dtantsurdoes anyone have a clue why we're updating pip in bifrost? seems to cause all sorts of problems.11:45
dtantsurit seems to be due to an ubuntu bug from 2015, let's try removing11:48
iurygregoryO.o 2015?! wow11:48
*** ianychoi has joined #openstack-ironic11:50
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:02
dtantsurrpittau|bbl: a bold idea ^^^12:02
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Deprecate a separate bifrost-inspector cloud  https://review.opendev.org/73057712:03
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:07
*** seongsoocho has quit IRC12:08
*** ociuhandu has joined #openstack-ironic12:09
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/ussuri: Make the keystone job voting and re-enable commented out jobs  https://review.opendev.org/73062212:11
*** rpittau|bbl is now known as rpittau12:11
rpittaudtantsur: I agree on the ansible thing, I'll check that now12:12
*** seongsoocho has joined #openstack-ironic12:12
dtantsurrpittau: see my patch above, I think it gets as close as possible12:12
dtantsur(may need taking in your changes as well)12:12
rpittaudtantsur: we might be able to drop the workaround for pep517 issue, need to doublecheck12:13
dtantsursegmentation fault from pip WOW12:14
rpittauwas connected to python version installed in the system12:14
rpittauoh interesting!12:14
Qianbiaodtantsur i remember pip from apt and pip from easy_install is different once before12:15
openstackgerritRiccardo Pittau proposed openstack/python-ironic-inspector-client master: Reduce timeout for tempest job  https://review.opendev.org/72863512:15
Qianbiaothey are totally different. and always break things.12:15
openstackgerritRiccardo Pittau proposed openstack/python-ironic-inspector-client master: Reduce timeout for tempest job  https://review.opendev.org/72863512:16
Qianbiaobut it's long ago.. not sure now.12:16
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:16
dtantsurI guess we just try and see12:16
dtantsurrpittau: the pep517 problem is also related to newer pip that we insist on pulling12:17
dtantsurif we can use whatever pip is shipped, we shouldn't hit it12:18
dtantsuroh, hmm, we don't need epel anymore, do we?12:18
* dtantsur tries removing12:18
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:19
iurygregoryshouldn't we assume 3072 for IRONIC_VM_SPECS_RAM by default? https://opendev.org/openstack/ironic/src/branch/master/devstack/lib/ironic#L14612:21
iurygregorysince the default is dib12:21
dtantsuriurygregory: we should12:22
iurygregoryI noticed that when trying wholedisk uefi with dib locally12:22
Qianbiaohello, i got a question about python package. if we hope the python package could be installed with dnf, should we create a rpm package for it?12:26
dtantsurQianbiao: you mean, for ironic? RDO is already doing it12:30
dtantsurhttps://www.rdoproject.org/12:30
QianbiaoFor python-ibmcclient, https://github.com/metal3-io/ironic-image/blob/d3a22dab580b0953f682cc1894c8f0e76282504c/Dockerfile#L33-L4412:30
rpittauQianbiao: are you referring to my comment for the metal3 change?12:30
Qianbiaoaha, that is you?12:31
Qianbiao* from you.12:31
rpittauQianbiao: yeah :)12:31
dtantsurQianbiao: yes, you need an RDO package for that12:31
dtantsurQianbiao: https://www.rdoproject.org/documentation/add-packages/12:32
Qianbiaothank you two.12:32
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Change IRONIC_VM_SPECS_RAM default  https://review.opendev.org/73062312:34
dtantsuroh, we need epel for debootstrap (which I guess is needed for DIB)12:35
dtantsurbut seriously, a segfault??12:36
rpittaudtantsur: your change looks good on setup, but not on install, epel is needed12:37
rpittauoh ok you saw that12:37
dtantsuryeah12:37
dtantsurI'm reverting the EPEL change; more curious what to do with ubuntu12:37
dtantsurinclined to keep the pip update conditional on ubuntu.. sigh12:38
rpittauI have a dejavu about the pip upgrade, I think we talked already about that :D12:39
rpittaulike, same discussion12:39
rpittauand same sadness12:39
iurygregorydtantsur, re your comments about the release notes on https://review.opendev.org/#/c/688184/ https://review.opendev.org/#/c/688266/ I should have one release note in https://review.opendev.org/#/c/688272/ ?12:43
patchbotpatch 688184 - ironic - Add `get_node_network_data` method to NetworkInter... - 24 patch sets12:43
patchbotpatch 688266 - ironic - Add `get_node_network_data` to non-Neutron Network... - 24 patch sets12:43
patchbotpatch 688272 - ironic - Make redfish boot interface to use `network_data` - 23 patch sets12:43
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:43
dtantsuriurygregory: more precisely, in whatever patch makes the feature usable12:43
dtantsuri.e. once it merges I must be able to go and try the feature without additional patches12:43
iurygregoryok now i have the feeling it should be in https://review.opendev.org/#/c/688896/12:44
patchbotpatch 688896 - ironic - Add `get_node_network_data` to Neutron NetworkInte... - 21 patch sets12:44
iurygregorynot 100% sure but I will move the releasenote for this one =)12:44
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:45
dtantsurmmm, why are we using --system-site-packages?12:47
rpittaudtantsur: can't remember, I'12:47
rpittaurmrrrr12:47
* dtantsur removes12:47
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062112:48
rpittauI'm going through the scripts and reviewing stuff, I think your patch probably will cover most of that12:48
dtantsursorry if I did step on your shoes today12:49
rpittaudtantsur: no worries, I will have fun reviewing your stuff, and checking centos8! :D12:50
dtantsur:D12:50
* rpittau said "fun" with an evil smile12:50
iurygregorylol12:51
iurygregoryDon't Panic =)12:51
* rpittau has always his towel ready12:52
iurygregorysame12:52
maelkHi There ! I am back with the "Agent driver requires agent_url in driver_internal_info" error! We're using Master current-tripleo repo in Metal3, and when we try to turn on fast track, we see this error. (we did not try since it the patch that was fixing it was merged). It looks like we are hitting a corner case somewhere. Was it so that the fix wa12:57
maelks supposed to remove the agent_url so that IPA could register its URL again before any operation ? Is there something like this missing somewhere ?12:57
dtantsurokay, so --system-site-packages is a requirement because python3-dnf cannot be installed in a virtual env :(13:00
iurygregoryrpittau, I'm trying to understand how I got a 6 instead of 2...13:01
dtantsurmaelk: just guessing, ancient IPA?13:01
rpittaumaelk: I think we talked about the IPA ramdisk ?13:01
maelkno, we upgraded it last week13:01
maelkrpittau it was your commit for the IPA upgrade13:02
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Change IRONIC_VM_SPECS_RAM default  https://review.opendev.org/73062313:02
maelkwe get IPA from https://images.rdoproject.org/centos8/master/rdo_trunk/current-tripleo13:03
Qianbiaodtantsur should just create a bug under RDO project no bugzilla?13:04
Qianbiaoor some other place.13:04
dtantsurQianbiao: please follow the links from https://www.rdoproject.org/documentation/add-packages/13:04
dtantsuryes, the project is "RDO"13:05
Qianbiaook thanks.13:06
Qianbiaothe doc did not say which product i should pick when "Next, you must pick a product on which to enter a bug:"13:06
QianbiaoI am not sure whether python-ibmcclient belongs RDO13:06
openstackgerritMerged openstack/bifrost stable/ussuri: Make the keystone job voting and re-enable commented out jobs  https://review.opendev.org/73062213:07
dtantsurQianbiao: pick RDO13:07
Qianbiaosure, thanks.13:07
iurygregoryQianbiao, if you have any questions for RDO you can join #rdo irc channel on freenode =)13:07
dtantsurthis ^^^13:07
dtantsur(I'm there as well)13:07
Qianbiao:)13:08
Qianbiaook13:08
openstackgerritMerged openstack/ironic-inspector stable/train: Stop running a periodic task for the noop PXE filter  https://review.opendev.org/73051713:08
QianbiaoMeet people on this channel everywhere. ~13:09
openstackgerritMerged openstack/ironic-inspector stable/train: Treat endpoints with trailing slashes the same way as without them  https://review.opendev.org/73051813:12
openstackgerritMerged openstack/ironic-inspector master: Add py38 package metadata  https://review.opendev.org/73054813:12
openstackgerritMerged openstack/ironic master: Add py38 package metadata  https://review.opendev.org/73054413:12
openstackgerritMerged openstack/python-ironicclient master: Update lower-constraints.txt  https://review.opendev.org/72724313:12
openstackgerritMerged openstack/ironic-lib master: Update lower-constraints.txt  https://review.opendev.org/72723513:12
openstackgerritMerged openstack/ironic-prometheus-exporter master: Revert "Remove six"  https://review.opendev.org/73058413:13
openstackgerritVerification of a change to openstack/ironic-lib failed: Switch to newer openstackdocstheme version  https://review.opendev.org/72991513:13
openstackgerritVerification of a change to openstack/ironic-inspector failed: Stop running a periodic task for the noop PXE filter  https://review.opendev.org/73051613:13
iurygregorywpw13:13
iurygregorywow*13:13
iurygregoryOMG13:21
iurygregoryI think i got wholedisk + uefi working with DIB13:21
iurygregory=O13:21
iurygregoryarne_wiebalck, rpittau wdyt https://gist.github.com/iurygregory/f20d53656cc4290a9eda62a9ed5fa3a8 ?13:33
iurygregorydtantsur, also ^13:33
*** rloo has joined #openstack-ironic13:33
openstackgerritAndreas Jaeger proposed openstack/ironic-lib master: Switch to newer openstackdocstheme version  https://review.opendev.org/72991513:36
iurygregorythe only strange thing is that the second log shows cirros13:37
iurygregorynot centos813:38
iurygregoryhttps://gist.github.com/iurygregory/d442a7ce7f8e7561519a043b72ea8d46 O.o13:38
*** aedc has joined #openstack-ironic13:44
openstackgerritVerification of a change to openstack/ironic failed: Revert "Deprecate ibmc"  https://review.opendev.org/72983813:51
dtantsuriurygregory: cirros is the user image, no?13:53
iurygregoryin centos8?13:53
dtantsurwdym "in centos8"?13:53
dtantsurIPA != instance image13:53
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062113:55
iurygregoryif we are using DIB the OS we are loading is Centos8 no?13:56
rpittaudtantsur: we might need to include the pip path change in your patch13:56
*** rpittau is now known as rpittau|brb13:56
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Wholedisk+Uefi job  https://review.opendev.org/71445314:02
*** yolanda has quit IRC14:05
openstackgerritVerification of a change to openstack/ironic failed: Raise the JSON RPC connection timeout to 2 minutes and disable retries  https://review.opendev.org/72844514:06
iurygregorydtantsur, gotcha, some how i thought that when using dib (with centos8) the instance image would be the same14:07
dtantsuriurygregory: nope, we're using cirros because it's very small14:17
dtantsurwhich means, your job probably works correctly14:17
iurygregoryI thought it was only the case for tinyipa14:18
* iurygregory takes note to not think that again =)14:18
*** yolanda has joined #openstack-ironic14:19
dtantsur:)14:21
openstackgerritDmitry Tantsur proposed openstack/bifrost master: install-deps: use system pip and bindep for installing dependencies  https://review.opendev.org/73062114:21
dtantsurI think I've figured it14:21
iurygregoryawesome14:22
*** ociuhandu has quit IRC14:25
openstackgerritMerged openstack/virtualbmc master: Fix doc build failure  https://review.opendev.org/73057614:26
*** ociuhandu has joined #openstack-ironic14:27
*** rpittau|brb is now known as rpittau14:30
dtantsurand of course it's a known problem that nobody cared to fix https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/182148314:30
openstackLaunchpad bug 1821483 in python-pip (Ubuntu) "pip crashes when reinstalling native wheels" [Undecided,Confirmed]14:30
dtantsurshadower: you were curious ^^14:31
iurygregoryO.o14:31
iurygregorywut14:31
dtantsurI hope removing --ignore-installed will fix us14:31
rpittaustill having ahuge sense of deja vu14:32
*** ociuhandu has quit IRC14:32
rpittaudtantsur: at this point I will wait for your patch and rebase the path change because fixing the issues with that brought to some of your changes14:33
shadower"Running 'pip install simplejson' or 'pip install PyOpenSSL' twice crashes on exit because their shared libraries are overwritten while in use." tableflip14:33
arne_wiebalckrpittau: our image building broke all of a sudden without us changing anything (we think :-D) .... setuptools/setuptools_scm and LookupError does this ring any bell?14:34
iurygregory(ノ ゜Д゜)ノ ︵ ┻━┻14:34
shadowerthanks dtantsur I'm properly horrified14:34
arne_wiebalckrpittau: this is with IPAB, but still on python 214:35
arne_wiebalckrpittau: it is not pip (I downgraded), it is not the IPA branch (stein stopped building as well)14:36
*** yolanda has quit IRC14:36
arne_wiebalckrpittau: and I have an image built after the last time we touched our IPAB repo14:36
*** yolanda has joined #openstack-ironic14:37
rpittauarne_wiebalck: I'm not sure I get it, you're building the ipa ramdisk with IPA-builder with python 2 ?14:37
dtantsurarne_wiebalck: a full error needed. it does ring some bells.14:37
arne_wiebalckhttp://paste.openstack.org/show/793954/14:38
gudrutis2rpittau:diskimage-builder14:38
dtantsurmmm, no, this is new to me14:38
iurygregoryI love how we did refactor in  ironic code and we forgot to update some text references XD14:39
arne_wiebalckdtantsur: and we are pretty sure it worked last week14:39
dtantsurarne_wiebalck: can you pip-install this jaraco.windows thing on a clean venv?14:40
iurygregorythis is because you touched the limit "one image to rule them all" XD14:40
arne_wiebalckdtantsur: yes14:43
rpittauarne_wiebalck: it looks like a resolution loop, weird14:43
arne_wiebalckdtantsur: I can install jaraco.windows14:43
*** elemaill has joined #openstack-ironic14:47
dtantsurrpittau, iurygregory, much green wow https://review.opendev.org/#/c/730621/ wow14:50
patchbotpatch 730621 - bifrost - install-deps: use system pip and bindep for instal... - 9 patch sets14:50
iurygregorydtantsur, please tell me that there is no magic involved =P14:51
dtantsurnot much in the end14:51
iurygregorywill add to my list14:51
dtantsurI would dare say, this patch reduces the amount of magic involved14:51
iurygregorycool14:51
*** yolanda has quit IRC14:53
rpittaudtantsur: ok, I'll rebase on top of that14:59
dtantsurreviews also welcome :)14:59
*** kaifeng has joined #openstack-ironic15:00
dtantsur#startmeeting ironic15:00
openstackMeeting started Mon May 25 15:00:06 2020 UTC and is due to finish in 60 minutes.  The chair is dtantsur. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
openstackThe meeting name has been set to 'ironic'15:00
iurygregoryo/15:00
kaifengo/15:00
rpittauo/15:00
dtantsur#chair TheJulia15:00
openstackCurrent chairs: TheJulia dtantsur15:00
dtantsurhello ironic people!15:00
elemaillhello there !15:00
dtantsurthe presence is expected to be lighter today as the USA has a holiday15:00
dtantsur#link https://wiki.openstack.org/wiki/Meetings/Ironic our agenda15:00
arne_wiebalcko/15:00
ajyao/15:01
dtantsur#topic Announcements / Reminder15:01
*** openstack changes topic to "Announcements / Reminder (Meeting topic: ironic)"15:01
dtantsur#info Virtual PTG next week - June 1-515:01
dtantsurhey, does anyone else feel that time is flying too quickly?15:02
iurygregoryyup15:02
dtantsurthe PTG is around the corner15:02
dtantsur#link http://ptg.openstack.org/ptg.html15:02
dtantsur#info PTG preliminary schedule on https://etherpad.opendev.org/p/Ironic-VictoriaPTG-Planning15:02
dtantsursince TheJulia is out today, I decided to try composing a schedule from what we have on the etherpad15:02
dtantsurwe seem to have an exact slot-to-topic mapping15:03
dtantsurplease don't treat this as final until TheJulia confirms it15:03
iurygregoryawesome15:03
dtantsurwe'll be in the Liberty room (whatever it means), our slots are Tue-Fri 14:00-16:00 UTC15:04
iurygregoryI was just wondering if it's ok to let the operators feedback on Friday15:04
iurygregorywondering if it also good to send an email about that15:04
dtantsuryeah, dunno15:05
dtantsurre email: we will, once the list is final15:05
iurygregorycool15:05
dtantsurnow a few links for your consideration *before* the PTG:15:05
dtantsur#info Priorities - https://review.opendev.org/#/c/720100/15:05
patchbotpatch 720100 - ironic-specs - WIP - Victoria Cycle Priorit(y|ies) - 4 patch sets15:05
dtantsur#info New release model - https://review.opendev.org/72554715:06
patchbotpatch 725547 - ironic-specs - Proposal for a new release model - 6 patch sets15:06
*** yolanda has joined #openstack-ironic15:06
dtantsurI assume most of people here have read both already15:06
dtantsurif you haven't - please do15:06
*** hamzy has quit IRC15:06
dtantsurthe release team has already discussed our new release model. they have questions but no objections.15:06
dtantsurI expect TheJulia to press the final W+1 on that as the PTG15:07
iurygregoryawesome!15:07
dtantsur* PTL15:07
dtantsur** that TLA!15:07
dtantsuranything else to announce or remind of?15:07
dtantsurno action items recorded last week, so moving straight to15:08
dtantsur#topic Review subteam status reports (capped at ten minutes)15:08
*** openstack changes topic to "Review subteam status reports (capped at ten minutes) (Meeting topic: ironic)"15:08
dtantsur#link https://etherpad.opendev.org/p/IronicWhiteBoard around line 23115:08
dtantsurarne_wiebalck: do you plan anything else re performance/scale?15:09
arne_wiebalckdtantsur: not for now15:09
arne_wiebalckdtantsur: the blog post is almost ready15:10
arne_wiebalckdtantsur: that concludes things for us for now15:10
dtantsurnice15:11
dtantsurre neutron events work: do I recall it right that kaifeng and rpittau volunteered to take it over?15:12
*** Goneri has joined #openstack-ironic15:12
iurygregorydtantsur, I think you are correct =)15:12
iurygregoryI also recall that15:12
rpittauyeah, didn't really start doing anything on that15:13
dtantsurk15:13
kaifengit is, but haven't started yet15:14
dtantsurcool, thanks15:14
dtantsuris everyone done with the statuses?15:15
iurygregoryI'm15:15
rpittauyup15:15
dtantsur#topic Deciding on priorities for the coming week15:16
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)"15:16
dtantsurlet me clean up a bit15:16
dtantsurokay, we've merged a few things, and I've just added the new bifrost patches15:18
dtantsuranything else that should be there?15:18
* iurygregory double checks15:19
*** yolanda has quit IRC15:19
iurygregorydtantsur, can I add https://review.opendev.org/728942 to get feedback?15:20
patchbotpatch 728942 - ironic - Migration from oslo.rootwrap to oslo.privsep - 4 patch sets15:20
dtantsurwe need to do something about https://review.opendev.org/#/c/704478/ it blocks our dibipa jobs15:20
patchbotpatch 704478 - diskimage-builder - Add handling for no activate_this.py in venv - 2 patch sets15:20
dtantsuriurygregory: please do15:20
iurygregorydone15:22
dtantsurokay, how is the list looking now?15:23
rpittaulooks good15:24
iurygregorylooks good, not many things I would say =)15:24
dtantsurcollect some energy for the PTG :)15:24
iurygregoryto take over the world15:24
dtantsurI may start throwing some deploy steps patches at people later this week15:24
dtantsurand yes, take over the world finally15:24
dtantsurthe current overhumans are obviously incapable of handling it :)15:25
iurygregoryyes15:25
dtantsur#topic Open discussion15:25
*** openstack changes topic to "Open discussion (Meeting topic: ironic)"15:25
dtantsurno discussion topics planned, so bring whatever you want15:25
iurygregoryI have one =)15:26
* kaifeng too but after iurygregory15:26
iurygregorywhile moving things to oslo.privsep I noticed that some commands can run as root or not15:26
iurygregoryeven the ones defined in the rootwrap15:26
dtantsurexample?15:27
iurygregorysome of the qemu-img15:27
*** ociuhandu has joined #openstack-ironic15:27
dtantsurright, okay15:27
dtantsurso, what's the question?15:28
iurygregoryso we should still keep this or we want to make sure the commands are only for privileged user?15:29
dtantsurI think we should run as few commands as possible under root15:31
dtantsurso if something can be run as a normal user (e.g. 'qemu-img info'), it should15:31
iurygregorygotcha15:32
iurygregorykaifeng, the mic is yours =)15:33
kaifengwell, i hit an issue with conductor when ha switch happens, the conductor keeps throwing db exception and cannot recover15:33
iurygregorywow15:33
kaifengi don't have the log at hand, but it says the database is readonly15:34
kaifengso a node in the inspecting state is stuck there15:34
dtantsurit is because of ha switch in ironic or the database itself?15:35
kaifengjust ha switch, ironic conductor is not effected15:35
kaifengs/effected/affected/15:36
dtantsurplease define "ha switch" then15:36
kaifengwe have two control nodes, all api services / db services are hosted there, a controller node is down and triggers the ha switch15:37
dtantsurokay, so it's probably more of a question to oslo.db/sqlalchemy/galera15:38
*** yolanda has joined #openstack-ironic15:38
kaifenghmm, maybe, the trackback is from sqlalchemy15:39
kaifengtraceback..15:39
kaifengok, i'll take a look if there is any known issue there, since the deployment is running with an ancient ocata release, thanks15:41
iurygregorygood luck kaifeng =)15:41
dtantsur++15:41
kaifengthank you :)15:41
dtantsuranything else?15:41
* dtantsur hears lovely summer crickets15:42
iurygregoryhehehe15:43
openstackgerritMerged openstack/ironic master: Do not fail when raw image is larger than memory for http  https://review.opendev.org/73031715:43
dtantsurthank you all!15:43
dtantsur#endmeeting15:43
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."15:43
iurygregorytks!15:43
openstackMeeting ended Mon May 25 15:43:49 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-25-15.00.html15:43
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-25-15.00.txt15:43
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-25-15.00.log.html15:43
rpittauthanks!15:43
kaifengo/15:44
*** ociuhandu has quit IRC15:46
*** ociuhandu has joined #openstack-ironic15:47
rpittauarne_wiebalck: do you use a virtualenv to build the image? and what's the base OS ?15:49
arne_wiebalckrpittau: centos7 and it is inside a new container15:49
arne_wiebalckrpittau: this is the minimal command which fails:15:50
arne_wiebalckrpittau: pip install --ignore-installed --no-binary :all: 'jaraco.windows'15:50
rpittauarne_wiebalck: ok so it's not strictly related to ipa-builder ?15:50
arne_wiebalckrpittau: it is the --no-binary option15:50
rpittauyeah15:50
*** elemaill has quit IRC15:51
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix pip3 path  https://review.opendev.org/73057315:51
arne_wiebalckrpittau: we clone the IPAB and run diskimage-builder inside it15:51
openstackgerritDerek Higgins proposed openstack/ironic master: Add IPv6 ci Job  https://review.opendev.org/72408715:51
rpittauok15:51
arne_wiebalckrpittau: the command also fails on my other centos 7 host15:51
*** elemaill has joined #openstack-ironic15:52
*** ociuhandu has quit IRC15:53
*** mugsie has joined #openstack-ironic15:57
*** Qianbiao has quit IRC15:59
iurygregoryhttps://zuul.opendev.org/t/openstack/build/1fc2e20793a446e3a57472c25af19dac/log/controller/logs/ironic-bm-logs/node-0_console_2020-05-25-14:52:04_log.txt#1365 *-*16:01
iurygregoryit works in devstack16:01
rpittauarne_wiebalck: let me get this straight because I can't reproduce the issue, it fails for you just running "pip install --ignore-installed --no-binary :all: 'jaraco.windows'" in a centos7 container ?16:02
arne_wiebalckyes16:02
rpittauwell that's weird, it works for me on a centos7 container new and clean16:03
arne_wiebalckhmm16:03
*** lucasagomes has quit IRC16:13
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add `get_node_network_data` method to NetworkInterface  https://review.opendev.org/68818416:18
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add `get_node_network_data` to non-Neutron NetworkInterface  https://review.opendev.org/68826616:20
*** elemaill has quit IRC16:22
*** ociuhandu has joined #openstack-ironic16:23
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Make redfish boot interface to use `network_data`  https://review.opendev.org/68827216:24
*** elemaill has joined #openstack-ironic16:25
*** dtantsur is now known as dtantsur|afk16:36
dtantsur|afko/16:36
mugsiehey - random queston, if I wanted to have a lab with a few test machines for Ironic, what would you recommend? HP Gen8, or a R6xx series dell? Intel AMT on a nuc type device is also an option, I am just looking to get a few nodes to try and prototype a teapot example, so actual compute power is basically irrelevent for me.16:42
mugsieand trying to find cheaper 2nd hand hardware in the EU seems to be eluding me16:43
*** ociuhandu has quit IRC16:44
*** ociuhandu has joined #openstack-ironic16:45
rpittaugood night! o/16:48
*** rpittau is now known as rpittau|afk16:48
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add `get_node_network_data` to Neutron NetworkInterface  https://review.opendev.org/68889616:55
arne_wiebalckFTR rpittau was able to reproduce the issue I have with pip installing jaraco.windows ... I opened an issue upstream now.16:59
*** ociuhandu has quit IRC17:00
*** derekh has quit IRC17:16
*** derekh has joined #openstack-ironic17:30
*** derekh has quit IRC17:34
*** kaifeng has quit IRC17:49
*** ociuhandu has joined #openstack-ironic18:15
*** ociuhandu has quit IRC18:23
*** elemaill has quit IRC18:25
*** ociuhandu has joined #openstack-ironic18:33
*** yolanda has quit IRC18:49
*** ociuhandu has quit IRC19:01
*** ociuhandu has joined #openstack-ironic19:02
openstackgerritFedor Tarasenko proposed openstack/ironic-python-agent master: Fix an issue with high cpu usage caused by ironic-python-agent  https://review.opendev.org/73067619:22
*** stevebaker has joined #openstack-ironic20:51
*** rloo has quit IRC22:00
openstackgerritSteve Baker proposed openstack/ironic-lib master: Implement Basic HTTP authentication middleware  https://review.opendev.org/72907022:00
*** derekh has joined #openstack-ironic22:31
openstackgerritMerged openstack/ironic-inspector master: Stop configuring install_command in tox.  https://review.opendev.org/72079122:49
*** rcernin has quit IRC22:49
*** rcernin has joined #openstack-ironic22:50
*** tkajinam has joined #openstack-ironic22:53
openstackgerritDerek Higgins proposed openstack/ironic master: Add IPv6 ci Job  https://review.opendev.org/72408723:03
*** derekh has quit IRC23:21
*** ab-a has quit IRC23:24

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!