Monday, 2020-08-31

*** k_mouza has joined #openstack-ironic01:19
*** k_mouza has quit IRC01:23
*** rcernin has quit IRC02:58
*** rcernin has joined #openstack-ironic03:18
*** rcernin has quit IRC04:12
*** rcernin has joined #openstack-ironic04:13
openstackgerritNisha Agarwal proposed openstack/ironic master: Adds few of the security dashboard parameters to capabilities  https://review.opendev.org/74641604:28
*** janders has quit IRC04:45
*** janders has joined #openstack-ironic04:46
*** rcernin has quit IRC05:48
*** PrinzElvis has joined #openstack-ironic05:57
*** Qianbiao has joined #openstack-ironic05:59
*** rcernin has joined #openstack-ironic06:03
*** hjensas has joined #openstack-ironic06:04
arne_wiebalckGood morning, ironic!06:05
jandersgood morning arne_wiebalck06:15
jandershow was your weekend?06:15
arne_wiebalckhey janders o/06:15
arne_wiebalckrainy06:15
arne_wiebalckand yours?06:15
jandersfunnily enough a bit rainy, too.06:16
*** sshnaidm|afk is now known as sshnaidm06:17
jandersMy wife's laptop malfunctioned so ended up spending a fair bit of the weekend helping her out. Frustrating at first cause despite her reinstalling a couple of times we couldn't get any NIC to deliver any decent performance. Really weird issues. Then we ended up dropping Fedora32 on the laptop and it *just works* and she's happy with it so good06:18
jandersoutcome.06:18
jandersI haven't touched windows for around 20 years now and looking how much trouble she had I'm not missing out :)06:19
arne_wiebalckI banned windows from my house some time ago ... not because it does not work, more because I don't know how fix things :-D06:26
arne_wiebalck... and as the computer engineer in the house, this can become very embarassing ;)06:27
*** PrinzElvis has quit IRC06:46
*** PrinzElvis has joined #openstack-ironic06:46
*** jtomasek has joined #openstack-ironic06:57
*** PrinzElvis has quit IRC07:03
*** PrinzElvis has joined #openstack-ironic07:03
*** PrinzElvis has quit IRC07:07
*** PrinzElvis has joined #openstack-ironic07:08
*** PrinzElvis has quit IRC07:10
*** PrinzElvis has joined #openstack-ironic07:11
*** trident has quit IRC07:18
mnasiadkamorning07:29
*** PrinzElvis has quit IRC07:30
*** PrinzElvis has joined #openstack-ironic07:31
*** Prinz_Elvis has joined #openstack-ironic07:32
*** Prinz_Elvis has quit IRC07:37
*** tosky has joined #openstack-ironic07:39
iurygregorygood morning Ironic! o/07:39
iurygregoryjanders, yeah the properties/capabilties are set =(07:40
*** Prinz_Elvis has joined #openstack-ironic07:41
iurygregoryhttps://zuul.opendev.org/t/openstack/build/bf03fd694f2b45daaca348588609e8d4/log/job-output.txt#2689507:42
*** Prinz_Elvis has quit IRC07:44
*** zigo has joined #openstack-ironic07:44
*** rcernin has quit IRC07:51
rpittaugood morning ironci! o/07:52
iurygregorymorning rpittau o/07:52
iurygregoryjust for me or zuul is a bit different when you check the job result?07:53
rpittauhey iurygregory :)07:54
iurygregoryfinally summer is over \o/07:54
rpittaunever started for me :/07:54
iurygregorythe max temperature this week seems to be 25 \o/07:55
* iurygregory dances07:55
rpittauiurygregory: no worries, another heat wave is coming this week :)07:56
iurygregoryrpittau, noooooooooooooo <O>07:56
*** belmoreira has joined #openstack-ironic07:57
*** PrinzElvis is now known as Prinz-Elvis07:58
*** tosky has quit IRC08:00
*** jtomasek has quit IRC08:00
*** ddurst has quit IRC08:00
*** lucasagomes has joined #openstack-ironic08:01
*** irclogbot_2 has quit IRC08:02
*** Prinz-Elvis is now known as PrinzElvis08:04
*** tosky has joined #openstack-ironic08:05
*** jtomasek has joined #openstack-ironic08:05
*** ddurst has joined #openstack-ironic08:05
*** PrinzElvis is now known as Prinz_Elvis08:05
*** irclogbot_2 has joined #openstack-ironic08:07
jandersarne_wiebalck haha! I know the feeling.08:08
rpittaueverybody ready for the first day of Ironic Victoria virtual Meetup? :)08:08
jandersiurygregory rpittau good morning :) how was your weekend08:09
rpittauhey janders :)08:09
iurygregorya bit complicated, but I solved all my personal problems  =)08:11
rpittauhad a nice dinner with some friends on saturday night, lots of alcohol, cheese and meat!08:11
rpittauand worked hard in the new apartment, we move in 1 week, I have internet but no bathrooms yet :D08:11
*** Prinz_Elvis is now known as PrinzElvis08:12
*** ricolin has quit IRC08:16
openstackgerritRiccardo Pittau proposed openstack/sushy stable/ussuri: Use Sessions URL from root service if it's provided  https://review.opendev.org/74897208:16
openstackgerritRiccardo Pittau proposed openstack/sushy stable/train: Use Sessions URL from root service if it's provided  https://review.opendev.org/74897308:17
jandersiurygregory rpittau nice! :)08:22
openstackgerritKaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority  https://review.opendev.org/74897508:24
jandersmy weekend was a bit similar to yours rpittau. Put some shelves in the garage. Lots of parts missing after the move so had to take the tools out and cut some metal but it all worked in the end. Also put most hooks in so that we can hang paintings on the walls. The place looks awesome now. Then dropped into our fav craft brewery for a couple pints08:25
jandersas a reward :)08:25
jandersI will pop our for a quick walk. When back I will check out the UEFI issue logs iurygregory08:26
iurygregoryjanders, tks!08:26
iurygregoryso far seems that nova is unhappy..08:26
iurygregorylooking at the nova-sched logs08:26
*** Zempashi has joined #openstack-ironic08:26
jandersI need to check for any signs of any UEFI tags getting overwritten when capabilities are set08:27
jandersthat was killing me a while back08:27
openstackgerritRiccardo Pittau proposed openstack/ironic master: [trivial] remove emacs config from devstack script  https://review.opendev.org/74897808:29
*** derekh has joined #openstack-ironic08:32
*** Zempashi has quit IRC08:37
openstackgerritRiccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 602  https://review.opendev.org/74859708:39
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: [WIP] Move ironic-standalone-ipa-src to Ubuntu Focal  https://review.opendev.org/74821308:43
iurygregoryrpittau, this patch only reminds me of dtantsur|afk 's tweet =) (bifrost)08:43
openstackgerritQianBiao Ng proposed openstack/ironic master: Feat: add ibmc hardware info support for devstack  https://review.opendev.org/74884108:44
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: Move ironic-standalone-ipa-src to Ubuntu Focal  https://review.opendev.org/74821308:44
*** Zempashi has joined #openstack-ironic08:44
rpittauiurygregory: mmm which tweet ?08:44
iurygregoryrpittau, https://twitter.com/creepy_owlet/status/129943463448542003308:45
rpittauah yeah, I'm tempted to leave 602 disabled08:46
iurygregoryafter I saw the tweet I totally understood why you said " this will likely fail"08:47
rpittauthere's a long thread about that08:47
rpittauit seems enabling 602 makes everything less readable and more complicated to understand08:47
iurygregoryouch08:47
jandersrpittau you mentioned connecting Internet - out of curiosity, what speeds are you typically getting in Europe?08:47
jandersI'm 80/40mbps, fast for local standards, but if my memory doesn't fail me I think I remember having 1gbps to the front door in Singapore08:48
rpittaujanders: with FTTH I have 2 Gbit/s08:49
jandersnice! way to go!08:49
jandersI think here they offer 200/200mbps on FTTH (which I don't have) otherwise due to the silly VDSL+ last-hop it's hard to go far beyond 10008:50
jandersuploading videos would be totally awesome on 2gbps08:50
jandersmy drone can fly ~30mins between batt swaps, so that in 4K would probably upload under 1 minute08:51
janders(assuming the remote side offers that much upload bandwidth)08:52
rpittauit really depends by the zone here, even in the same city, but there's a lot of competition and the gov pushes for high speed08:52
rpittauin theory, if it was not for the covid, we should have already working 5G08:53
jandershere it's a bit of 4.5G really08:53
rpittaueheh yeah, same :)08:53
jandersI see uploads of 200-300mbps which isn't really what was expected but not too bad for a mobile phone08:56
*** janders2 has joined #openstack-ironic08:57
rpittauI don't think there's real 5G deployed anywhere yet, or at least very few places, most companies use a mix of 4G/5G cards, because the frequencies are not open for commercial use yet08:58
janders2...looks like my ISP is trying to convince me to reconsider my ideas about "5G"/4.5G08:58
rpittau:D08:58
janders2brief dropout08:58
*** Qianbiao has quit IRC08:58
*** janders has quit IRC09:00
*** janders2 is now known as janders09:00
rpittaucan I get one more review for this please https://review.opendev.org/74793609:03
patchbotpatch 747936 - networking-baremetal - Add missing keystoneauth1 and oslo.service to requ... - 2 patch sets09:03
iurygregoryrpittau, done09:04
rpittauthanks!09:04
rpittaulol "/usr/local/bin/keystone-manage: No such file or directory"09:07
*** trident has joined #openstack-ironic09:08
*** uzumaki has joined #openstack-ironic09:10
*** dtantsur|afk is now known as dtantsur09:11
dtantsurmorning ironic, happy Monday!09:11
dtantsurdo I get it right from my email notifications that the multinode job is broken?09:11
*** Qianbiao has joined #openstack-ironic09:13
iurygregorydtantsur, depends09:14
iurygregorydevstack is broken...09:14
rpittauhey dtantsur :)09:14
iurygregorySetuptools 50 and Devstack Failures09:14
dtantsurwhat I've seen was inability to PXE boot on all nodes09:14
dtantsurstarted on Thursday https://zuul.openstack.org/builds?job_name=ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode09:15
openstackgerritAnkit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type  https://review.opendev.org/74349009:16
-openstackstatus- NOTICE: due to a new release of setuptools (50.0.0), a lot of jobs are currently broken, please do not recheck blindly. see http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html09:16
rpittaummm no bootable device09:17
openstackgerritKaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority  https://review.opendev.org/74897509:19
rpittauseems the nic doesn't receive updates from dhcp09:19
Qianbiaohello, i am working with devstack too recently.09:19
QianbiaoIt seems python3 pip could not be installed this afternoon.09:20
QianbiaoYestoday, it's ok...09:20
QianbiaoAnd i am wondering why it auto purge pip first?09:20
QianbiaoI cant even install it manually.09:20
iurygregoryQianbiao, there is some problem on devstack atm09:23
openstackgerritVerification of a change to openstack/networking-baremetal failed: Add missing keystoneauth1 and oslo.service to requirements  https://review.opendev.org/74793609:24
dtantsuriurygregory: could you check https://review.opendev.org/#/c/748853/ please09:26
patchbotpatch 748853 - bifrost (stable/train) - [Train and older] Fix several CI problems - 8 patch sets09:26
iurygregorydtantsur, doing now09:26
Qianbiaook09:27
*** jtomasek has quit IRC09:33
dtantsuralso folks, while devstack is broken, could someone please help me clean up my bifrost reviews? :) https://review.opendev.org/#/q/owner:dtantsur%2540protonmail.com+status:open+project:openstack/bifrost09:39
dtantsuryes, I know, I'm a bit crazy, but they'll all good reviews :D09:39
dtantsur("a bit", haha)09:40
iurygregory41 files09:41
iurygregory'-'09:41
iurygregoryin the first patch I clicked09:41
dtantsurI hope it's not the TLS patch - not the best way to start your Monday :)09:43
dtantsurI wonder if I'll have to walk you folks through it..09:44
*** jtomasek has joined #openstack-ironic09:44
rpittauI will leave that for last, I reviewd most of the others last week, going through some more now09:45
dtantsur++ it's a good idea. other patches must be quite straightforward even if large.09:46
rpittaualso I'm thinking to abandon the ansible-lint patch that enables 602, some changes are ridiculous09:47
iurygregorydtantsur, nope =)09:47
iurygregoryI'm looking at Remove support for non-venv deployments =)09:47
iurygregorythe good thing is that the changes are simple09:48
dtantsurah, this was created with a lot of find+sed :)09:48
iurygregoryhehehe09:49
dtantsurrpittau: I.. have to concur. just let's make sure we don't do "when: string_variable" because this sane behavior is deprecated..09:49
* dtantsur wants to start a rant09:49
rpittauheh, yeah :/09:50
Qianbiaoiurygregory do u know which part of devstack is broken.09:50
iurygregoryQianbiao, http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html09:51
dtantsurQianbiao: installation of python packages. pretty much everything.09:51
iurygregoryyep09:51
* dtantsur wonders how many merge conflicts his patches have between each other09:51
iurygregorydtantsur, you are about to figure out =D09:52
dtantsurright :D09:52
dtantsurI've also started figuring out what may be missing in the direct deploy compared to iscsi: https://storyboard.openstack.org/#!/story/200807509:52
iurygregorywell your TLS patch for sure will have conflict09:53
dtantsurno doubt09:53
iurygregoryso far is the only I saw in the "Conflicts With"09:53
Qianbiaoiurygregory And is there a reason that devstack need to reinstall pip?09:54
Qianbiaois there an option that skip pip reinstall09:54
dtantsurdevstack is a pile of hacks, I'm not sure there is a reason, and if there is, I'm not sure if it's still valid09:55
dtantsurQianbiao: http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016907.html has some reviews you could try09:55
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/stein: [Train and older] Fix several CI problems  https://review.opendev.org/74901409:59
*** tosky has quit IRC10:13
*** tosky has joined #openstack-ironic10:13
jandershey dtantsur10:14
dtantsuro/10:14
jandershow was your weekend?10:14
QianbiaoI remove "uninstall pip" from devstack, it starts install now.10:14
QianbiaoIn ironic devstack doc, https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html,  NETWORK_GATEWAY=10.1.0.1 this option is not working, should use IPV4_ADDRS_SAFE_TO_USE=xxxx/24 instead10:17
openstackgerritMerged openstack/bifrost stable/train: [Train and older] Fix several CI problems  https://review.opendev.org/74885310:25
openstackgerritMerged openstack/bifrost master: Remove support for non-venv deployments  https://review.opendev.org/74743410:25
openstackgerritMerged openstack/bifrost master: Make /var/lib/ironic/{,images,master_images} readable by nginx  https://review.opendev.org/74847210:25
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet for serving API  https://review.opendev.org/74902010:27
openstackgerritDmitry Tantsur proposed openstack/bifrost bugfix/8.3: Make /var/lib/ironic/{,images,master_images} readable by nginx  https://review.opendev.org/74902110:27
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/ussuri: Make /var/lib/ironic/{,images,master_images} readable by nginx  https://review.opendev.org/74902210:29
iurygregoryQianbiao, I think this is the default from Neutron, feel free to override the configs if doesn't suit to you10:29
Qianbiaook10:30
*** fmuyassarov has joined #openstack-ironic10:41
openstackgerritKaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority  https://review.opendev.org/74897510:44
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet for serving API  https://review.opendev.org/74902010:45
rpittaudtantsur, TheJulia: are we going to use meetpad for the virtual Ironic Meetup ?10:47
dtantsurI guess so?10:48
openstackgerritMerged openstack/bifrost master: Disable DHCP on the libvirt network rather than doing `killall dnsmasq`  https://review.opendev.org/74827211:18
openstackgerritMerged openstack/bifrost master: Stop supporting storing introspection data in nginx  https://review.opendev.org/74790111:18
openstackgerritMerged openstack/bifrost master: Authentication JSON RPC even in no-auth mode  https://review.opendev.org/74789711:18
dtantsuryay, so many merge conflicts \o/11:37
*** antotala has joined #openstack-ironic11:40
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Move services to internal_ip by default and refactor endpoint creation  https://review.opendev.org/74823011:41
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Update keystone documentation  https://review.opendev.org/74839211:41
*** weshay is now known as weshay|ruck11:44
antotalaHello All, I have added some custom collectors in ironic -python-agent. I want to run them during the inspection, I am not sure how can I enable these  collectors11:45
antotalaI know some where I have to configure this parameter `ipa-inspection-collectors` but where is not very clear to me11:46
openstackgerritDmitry Tantsur proposed openstack/bifrost master: TLS support for API services  https://review.opendev.org/74792111:48
dtantsurantotala: there are two places where you configure kernel parameters: in the PXE/iPXE configuration of ironic-inspector itself, as well as in the ironic's option [inspector]extra_kernel_params11:49
*** uzumaki has quit IRC11:50
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Let us finish the rabbit hunt  https://review.opendev.org/74826511:50
antotalaLet me try that. Thank dtantsur11:53
*** sshnaidm has quit IRC11:57
janderswrapping up, have a good day. See you tomorrow Ironic o/12:03
*** sshnaidm has joined #openstack-ironic12:07
*** Qianbiao has quit IRC12:08
rpittaummm looks like the issue with setuptools is impacting bifrost too12:18
dtantsurwonderful \o/12:18
dtantsurrpittau: the focal failure, right?12:18
dtantsurso not gate-blocking?12:19
rpittauyeah12:19
openstackgerritAnkit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type  https://review.opendev.org/74349012:19
rpittauno, not blocking, still frustrating12:19
rpittaualso not clear why centos8 is failing12:19
dtantsurrpittau: is it? I see fedora-latest and ubuntu-focal on my patches in zuul12:20
rpittauok, then maybe it's the 602 change that centos8 doesn't like, even though it's the only one failing12:20
dtantsurwe have transient failures on bifrost as well, although much less frequently than on ironic12:21
dtantsurmaybe it's just one of these?12:21
rpittaucould be12:21
dtantsurokay, so the focal problem is up to us to fix. are you looking in it or should I?12:22
rpittaudtantsur: go ahead, I'm looking at centos8 at the moment12:23
dtantsurokie12:23
rpittauthe problem is that it's failing on keystone setup and we have no_log: true12:24
dtantsurof course :)12:25
dtantsurrpittau: if you point me at the exact task, I can take a look12:25
dtantsur`ModuleNotFoundError: No module named 'setuptools._distutils` WTF, it's not exactly what breaks devstack?12:25
rpittauyes, exactly that12:25
rpittaudtantsur: playbooks/roles/bifrost-ironic-install/tasks/keystone_setup.yml12:26
dtantsurrpittau: I mean, in your change12:26
rpittauoh yeah, of course12:26
fmuyassarovHi JayF and dtantsur. For the custom hardware manager can I use any of the Ironic supported root disk hints (model, vendor, etc.) to filter out the disks I want to clean during the deprovisioning? Or is there some other way to filter the disks?12:28
dtantsurfmuyassarov: you totally can. use the get_os_install_device call to detect what the expected root disk is12:29
dtantsurmmmm, scratch that, get_os_install_device only works during deployment12:29
dtantsurbut you can follow roughly the same logic using the node you received in your clean step12:30
rpittaudtantsur: the task is "Check ironic admin endpoint exists", I can't find the way to point directly there though, I don't see a link in the logs, just plain logs here https://6ee071d84f4801a650d3-2635c9269ad2bde2592553cd282ad960.ssl.cf2.rackcdn.com/748597/5/check/bifrost-integration-tinyipa-keystone-centos-8/a9247e2/job-output.txt12:32
fmuyassarovdtantsur, I will try to copy & modify the logic as in the clean step for filtering. Thank you.12:32
dtantsurrpittau: you can point at lines in gerrit by appending @<lineno>12:32
dtantsurfmuyassarov: ironic-lib has all the necessary code for dealing with root device hints12:33
rpittaudtantsur: oh, you meant the gerrit change, I should've probably said that it's failing in a task that was not modified in the change12:34
dtantsurrpittau: start with rebasing your patch. I've rewritten these tasks recently :)12:34
rpittauok :)12:34
dtantsurmm, interesting. but let's rebase first anyway.12:34
fmuyassarovdtantsur, got it, thanks. I will come back if I don't manage it to work.12:35
openstackgerritRiccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 206  https://review.opendev.org/74788312:36
openstackgerritRiccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 504  https://review.opendev.org/74792512:37
openstackgerritRiccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 602  https://review.opendev.org/74859712:37
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Block setuptools 50.0.0 and newer  https://review.opendev.org/74904612:38
rpittau^ sigh12:38
*** rh-jelabarre has joined #openstack-ironic12:39
dtantsuryeah. mirroring a global reqs change.12:40
*** antotala has quit IRC12:42
iurygregoryomg12:44
rpittau15 minutes to midcyle, meetpad is there -> https://meetpad.opendev.org/Ironic-Victoria-midcycle12:46
iurygregorybetter to use chrome right?12:46
rpittauyes12:46
rpittauif you even think about using it with firefox, it crashes12:47
iurygregoryhahaha12:47
*** Zempashi has quit IRC12:49
*** trandles has joined #openstack-ironic12:56
*** rloo has joined #openstack-ironic12:56
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet and oslo.service for serving API  https://review.opendev.org/74902012:58
dtantsurJayF: ^^^12:58
openstackgerritChristopher Dearborn proposed openstack/sushy master: Make message parsing more resilient  https://review.opendev.org/74892712:59
JayFoooh12:59
dtantsurJayF: it will need also moving ironic-lib away from loopingcall, but that's a good thing to do anyway13:00
dtantsurI can look into it later today or tomorrow13:01
dtantsur(there is only one place where it's used)13:01
JayFoslo.concurrency uses eventlet too aiui13:01
JayFso I'm not sure you're 100% wiping out eventlet deps13:01
dtantsursigh13:02
iurygregoryare we going to use the jitsi meetpad for the notes or the normal etherpad?13:02
rpittauiurygregory: I think the normal etherpad13:03
rpittauwe have all the topics there13:03
iurygregoryI was thinking this =)13:03
JayFCan someone link it in the meetpad etherpad then?13:03
dtantsurJayF: at first glance it seems that oslo.concurrency can do both13:03
JayFI'm just telling you what a `grep eventlet site-packages` says :D13:03
rpittauJayF: it's in the chat in meetpad https://etherpad.opendev.org/p/Ironic-Victoria-midcycle13:03
JayFack13:04
dtantsurrpittau: it's not that chrome does not crash..13:07
rpittauyeah :D13:07
*** bnemec has joined #openstack-ironic13:07
JayFdtantsur: FWIW, I believe we explicitly wanted etherpad for the ability to timeout "stuck" TCP operations? So we might want to dig that too. At least that's what I've been told, I have no direct knowledge of it.13:08
JayF**eventlet13:14
JayFsorry, I usually wouldn't be awake for another 15-30 minutes :D13:14
openstackgerritDmitry Tantsur proposed openstack/ironic-lib master: Drop the dependency on oslo.service loopingcall  https://review.opendev.org/74905313:15
dtantsurJayF: ^^13:16
JayFI want TheJulia to weigh in on if we actually want eventlet for purposes of allowing TCP timeouts13:17
JayFbecause I think we do, which is why I went down the path of making it work instead of nuking it13:17
dtantsurmmm, I need to refresh my memory13:17
dtantsurI think removing loopingcall from ironic-lib is a good idea nonetheless because it makes ironic-lib eventlet-neutral13:18
JayFFWIW, I broke unit tests and need to fix13:18
JayFhttps://review.opendev.org/#/c/747193/13:18
patchbotpatch 747193 - ironic-python-agent - If listen_tls is true, enable TLS on wsgi server - 6 patch sets13:18
JayFbut I got SSL working without breaking the rest of the stack13:18
JayFwith a limited eventlet monkeypatch13:18
JayFI think we should probably make our codebase eventlet-safe. It's used throughout openstack and you'll be playing whackamole forever if you try to keep it out while also using oslo libs13:19
dtantsurJayF: I think we didn't end up going the eventlet path with timeouts. I don't see any mentions of eventlet outside of tests after my patch.13:19
JayFhmm13:19
JayFokay13:19
dtantsuractually, using werkzeug to serve API does not prevent someone from using monkey_patch (my PoC prevents it for PoC purposes)13:20
JayFI still think trying to do an openstack service without worrying about eventlet-safety is swimming upstream a little13:20
dtantsurironic-inspector use to use Flask's built-in service with eventlet13:20
dtantsur* used to13:20
dtantsurwhich is based on werkzeug13:20
*** fmuyassarov has quit IRC13:23
*** Qianbiao has joined #openstack-ironic13:36
Qianbiaohello, i have a question about nova ironic driver13:36
Qianbiaohow nova knows when to use ironic driver.13:37
QianbiaoWhen reading devstack source code, it seems the flavor has a customer spec named CUSTOM_BAREMETAL.13:37
QianbiaoIs any flavor that has property "resources:CUSTOM_*anything*" will use ironic driver.13:39
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: If listen_tls is true, enable TLS on wsgi server  https://review.opendev.org/74719313:40
*** stendulker has joined #openstack-ironic13:43
*** tzumainn has joined #openstack-ironic13:47
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: If listen_tls is true, enable TLS on wsgi server  https://review.opendev.org/74719313:54
TheJuliaJayF: we basically we do because we can't figure out if the socket has hanged otherwise, at least that I'm aware of :(13:55
JayFdtantsur: ^^13:55
JayFTheJulia: That's what I thought13:55
dtantsurbut we don't use eventlet for that13:55
dtantsuror do we use some hidden property of it?13:55
*** uzumaki has joined #openstack-ironic13:56
TheJuliaI need to look at it, but I remember fighting some eventlet related stuff when I was trying to detect hung sockets13:56
TheJuliabecause we don't want to be suck on the low level read()13:56
TheJuliastuck13:56
*** Qianbiao has quit IRC13:56
*** Qianbiao has joined #openstack-ironic13:57
dtantsuryep, but I don't think we ended up landing it13:58
TheJuliauhhhh I think we did13:58
TheJuliawhen I'm not listening I'll need to look13:59
*** uzumaki has quit IRC14:03
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives  https://review.opendev.org/74876714:04
JayF^ Pretty straightforward bugfix. Just added some additional unit tests. It was +1 across the board in zuul before I added the new unit tests (which pass locally). Should be a trivial review.14:05
JayFWill likely conflict with my TLS change, so getting it approved quickly would be nice :D14:05
dtantsurJayF: left a comment (just hit a similar thing with my anti-eventlet patch)14:06
JayFhmm14:06
JayFI don't think those values respect listen_host14:07
JayFwill look14:07
dtantsurI think they do, they're coming from ironic_python_agent.cmd.agent14:07
JayFhmm yeah14:07
JayFwhy though14:07
JayFLike, it's clearly more correct14:07
JayFbut I wonder why we pass it thru instead of using it in conf14:07
dtantsurit's been there since forever, I think14:09
dtantsurI want to refactor it all one day, but probably not in a backportable fix14:09
JayFAck, makes sense14:09
JayFif you look at my heartbeat patch (which is failing tests for $whoKnows reasons), I found a lot of dead code around error backoffs that never was used :X14:10
dtantsurJayF: re $whoKnows, everything devstack-based is broken now14:10
dtantsurbut yeah14:10
JayFhmm, okay14:10
JayFthat's nice to know14:10
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives  https://review.opendev.org/74876714:12
JayFdtantsur: ^ fixed14:12
dtantsurthx14:12
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives  https://review.opendev.org/74876714:23
JayFfixed, and fixed a pep8 issue at the same time14:23
*** belmoreira has quit IRC14:30
dtantsurJayF: sorry, one thing is incorrect now :)14:36
dtantsur(also a comment re storyboard)14:36
JayFlol it's alright; low-latency code reviews are  great14:36
JayFOpenstack Commit Messages docs are /wrong/ :C14:37
JayFI looked that up...14:37
*** openstackgerrit has quit IRC14:37
*** uzumaki has joined #openstack-ironic14:38
*** uzumaki has quit IRC14:39
*** thiagop has joined #openstack-ironic14:53
*** cdearborn has joined #openstack-ironic14:56
*** rloo has quit IRC14:58
*** kaifeng has joined #openstack-ironic15:01
*** rloo has joined #openstack-ironic15:02
iurygregorynewbie question if the user is trying to create a node like in Option1  it would be a problem? http://paste.openstack.org/show/797301/15:05
*** mjturek1 has joined #openstack-ironic15:05
*** rloo has quit IRC15:09
*** Qianbiao has quit IRC15:09
TheJuliaI _think_ that is the way15:11
*** sshnaidm is now known as sshnaidm|bbl15:11
TheJuliaIf confirmed: https://knowyourmeme.com/photos/1653546-this-is-the-way15:12
iurygregory++15:13
kaifengmy big gamble is option 1 does not work15:13
*** belmoreira has joined #openstack-ironic15:13
dtantsurthis ^^15:13
iurygregoryI have this feeling because all uefi jobs are not working15:14
TheJuliahmmm15:14
iurygregoryand I only noticed this after talking with janders that --property capabilities twice would be a problem15:14
kaifengwe can have mutiple different property fields set in one command line15:14
TheJuliais this new?15:14
trandlesTheJulia, the next Scientific-SIG meeting is Tuesday. I'll advertise the kexec WG there and share a doodle link if one is available.15:14
trandlesTuesday == tomorrow15:15
TheJuliatrandles: ack, I'll make one after I get some breakfast15:15
trandlesbon ap15:15
iurygregorywell let's see what CI will say \o/15:15
iurygregoryfingers crossed15:15
dtantsurI think the last one will win, but I need to check the client code to be sure15:16
dtantsurwe could have special processing for capabilities in the client. maybe we even should.15:16
TheJuliaI'm kind of thinking the same thing,  without looking at the client and server side field handling code for properties specifically, it is kind of a wash15:17
dtantsurserver-side it's a string15:18
rpittaushouldn't that include also the cpu_arch in the same property field ?15:18
dtantsurcpu_arch is a different property15:18
iurygregoryyeah cpu_arch is different so it should be ok15:18
iurygregorybut for capabilities they should be all together15:18
* iurygregory facepalm15:19
*** stendulker has quit IRC15:19
dtantsurcapabilities is a dark page of ironic15:19
iurygregoryhehehe15:19
iurygregorygerrit bot is on PTO today15:19
dtantsurwe have sinned, and now everyone is paying for our sins15:19
rpittaupffff my brain ignored 'capabiities' there15:19
dtantsurI cannot blame your brain for that15:20
rpittau:)15:20
iurygregorysorry =)15:20
*** Goneri has joined #openstack-ironic15:25
*** ricolin has joined #openstack-ironic15:31
thiagopMorning folks! TheJulia what would be the best way to find "needs review" stuff currently? I saw that storyboard doesn't have an Ironic board, so I'm looking for a way to find patches to review across all projects under ironic's umbrella...15:32
iurygregorythiagop, https://etherpad.openstack.org/p/IronicWhiteBoard15:33
iurygregorywe have the patches that need attention there (for the week)15:33
iurygregorytoday we skipped the weekly meeting because we had the meetup15:34
thiagopTheJulia: ok, I think I found the correct links for the gerrit filters, thanks! iurygregory you mean under 2020-08-20 on the whiteboard itself?15:37
kaifengOH I was wondering why there is no meeting today15:37
iurygregorykaifeng, I think we skipped because of the meet up =)15:37
iurygregorythiagop, starts on L15615:38
* kaifeng is checking etherpad15:38
thiagopiurygregory: oh, ok. hahaha15:39
thiagopKinda difficult to find...15:39
thiagopBtw, what time is the meetup? I'd like to attend as a listener, of course :)15:40
kaifengwe have changed the default timeout to 15s for ipmitool, it seems working well15:40
TheJuliakaifeng: o/15:40
iurygregorythiagop, tomorrow at 15 UTC15:40
iurygregoryops15:40
iurygregory13 UTC15:40
iurygregoryTuesday September 1st, at 1300 UTC until 1500 UTC15:40
kaifengthis issue is raised due to currently we need to support multiple ipmi addresses15:40
thiagopiurygregory: kthx15:41
iurygregoryI can ping you if you need =)15:41
TheJuliakaifeng: huh? multiple addresses?15:42
TheJuliafor a single node?15:43
TheJuliawell single node's bmc15:43
kaifengTheJulia: yep, one bmc can have multiple ipmi addresses configured15:43
kaifengthat's the issue we encountered, by checking them one by one15:43
TheJuliaare they for distince sub-machines like ipmi bridging or just multiple addresses for BMC for soemthing like multipath15:44
kaifengjust mutiple addresses, configured at different channels15:44
kaifengI think this is the problem that user should guarantee, but *shurgs*15:45
TheJuliaI guess I'm still wondering why15:45
*** janders3 has joined #openstack-ironic15:47
kaifengIt's because in one of our scenarios, the bmc address is collected by a ramdisk not governed by ironic, previously the ramdisk only collects one bmc address, but when user start to configuring multiple addresses (ipv4/ipv6 for example), some of them may not reachable from ironic conductor15:48
kaifengso the ramdisk collects them all15:48
TheJuliahmm15:48
*** dking has joined #openstack-ironic15:48
kaifengand registered this node to ironic15:48
TheJuliaThis is a conundrum15:48
TheJuliatrandles: https://doodle.com/poll/ihbbtns36b2rkhfd15:49
*** janders has quit IRC15:50
*** janders3 is now known as janders15:50
trandlesTheJulia, thanks!15:51
TheJuliatrandles: also added links to the etherpad and for change sets15:52
trandlesperfect15:52
*** belmoreira has quit IRC15:53
*** Qianbiao has joined #openstack-ironic15:53
*** ricolin has quit IRC16:00
QianbiaoHello, in ironic devstack, Ironic create node and the node auto clean. But how the clean success without setting deploy-kernel16:01
TheJuliayou need deploy kernel and ramdisk with the agent in them to perform cleaning16:01
*** lucasagomes has quit IRC16:02
dtantsurI think we set the default kernel/ramdisk in ironic.conf16:02
Qianbiaodtantsur you are right.16:02
QianbiaoAnd when i try to add hardware bmc(ibmc), it fails with "clean failed".16:03
kaifengTheJulia: I left some info on the etherpad wrt the snapshot, hope that explains something16:03
Qianbiao<dtantsur> ^^^ and the bmc boot up failed with "media error?"16:04
Qianbiaoshould it be the wrong deploy kernel cause this issue?16:04
Qianbiaothe virt node can be instanced successful.16:05
*** ricolin has joined #openstack-ironic16:08
*** priteau has joined #openstack-ironic16:10
TheJuliakaifeng: thanks16:12
kaifengyw16:17
dtantsurrpioso: hi, ever seen anything like https://bugzilla.redhat.com/show_bug.cgi?id=1873305#c2 ?16:19
openstackbugzilla.redhat.com bug 1873305 in Bare Metal Hardware Provisioning "Failed to power on /inspect node when using Redfish protocol" [High,New] - Assigned to tsedovic16:19
*** Qianbiao has quit IRC16:25
*** openstackgerrit has joined #openstack-ironic16:31
*** belmoreira has joined #openstack-ironic16:31
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop using --system-site-packages  https://review.opendev.org/74908116:31
*** belmoreira has quit IRC16:38
*** thiagop has quit IRC16:43
*** thiagop has joined #openstack-ironic16:46
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop using --system-site-packages  https://review.opendev.org/74908117:04
JayFBoth https://review.opendev.org/#/c/748767/ and https://review.opendev.org/#/c/747193/ are ready for review, AIUI tempest failures are due to an ongoing devstack issue. would love to get these in as soon as that is resolved. I'm against a downstream deadline and would strongly prefer backporting community-approved upstream patches than having to take my unmerged drafts :D17:07
patchbotpatch 748767 - ironic-python-agent - Make WSGI server respect listen_* directives - 5 patch sets17:07
patchbotpatch 747193 - ironic-python-agent - If listen_tls is true, enable TLS on wsgi server - 8 patch sets17:07
*** dtantsur is now known as dtantsur|afk17:13
dtantsur|afko/17:13
*** tosky has quit IRC17:14
*** derekh has quit IRC17:20
*** ijw has joined #openstack-ironic17:26
*** Nisha_Agarwal has joined #openstack-ironic17:27
*** priteau has quit IRC17:29
Nisha_AgarwalTheJulia,  if possible could you please have a look at this RFE https://storyboard.openstack.org/#!/story/2008024. The task 40678 is a very small patch in ironic. Its already under review. The patch link is https://review.opendev.org/74641617:29
patchbotpatch 746416 - ironic - Adds few of the security dashboard parameters to c... - 4 patch sets17:29
*** ijw_ has joined #openstack-ironic17:30
*** ijw_ has quit IRC17:30
*** ijw_ has joined #openstack-ironic17:31
*** ijw_ has quit IRC17:31
*** ijw_ has joined #openstack-ironic17:32
*** ijw_ has quit IRC17:32
*** ijw has quit IRC17:33
*** ijw has joined #openstack-ironic17:34
openstackgerritNisha Agarwal proposed openstack/ironic master: Adds few of the security dashboard parameters to capabilities  https://review.opendev.org/74641617:37
*** gyee has joined #openstack-ironic17:43
*** JamesBenson has joined #openstack-ironic17:43
*** jamesden_ has quit IRC17:47
*** jamesdenton has joined #openstack-ironic17:49
*** dsneddon has joined #openstack-ironic18:25
*** Nisha_Agarwal has quit IRC18:32
*** zzzeek has quit IRC18:34
*** zzzeek has joined #openstack-ironic18:36
*** k_mouza has joined #openstack-ironic18:39
*** kaifeng has quit IRC18:40
*** k_mouza has quit IRC18:40
*** k_mouza has joined #openstack-ironic18:41
*** k_mouza has quit IRC18:44
*** belmoreira has joined #openstack-ironic18:47
*** k_mouza has joined #openstack-ironic18:51
*** zzzeek has quit IRC18:54
openstackgerritvinay kumar muddu proposed openstack/ironic master: Adds ilo-uefi-https boot interface to ilo5  https://review.opendev.org/74550118:56
*** zzzeek has joined #openstack-ironic18:56
iurygregorywoot it worked \o/19:08
iurygregoryhttps://knowyourmeme.com/photos/1653546-this-is-the-way19:09
TheJuliaiurygregory: but which way?19:20
TheJuliaoption 1 or option 2?19:20
iurygregory219:20
*** belmoreira has quit IRC19:20
*** stevebaker has joined #openstack-ironic19:23
trandlesapologies for asking this last Friday and again today...I didn't realize it was so close to end of the day and I closed up IRC before I saw a reply:19:29
trandlesDo you recommend I install IPA builder from tarball or pip?19:29
*** k_mouza has quit IRC19:34
iurygregoryboth should be ok I would say19:40
*** tosky has joined #openstack-ironic20:15
bdodd"/opt/stack/devstack/lib/keystone: line 448: /usr/local/bin/keystone-manage: No such file or directory"20:40
bdodd^^^ Is this due to the setuptools problem?20:40
clarkbbdodd: yes20:41
bdoddclarkb Thanks!20:41
gregworkhas anyone thought about ironic managing virtual metal inside of kube-virt/ocp-virt ?20:50
TheJuliagregwork: afaik no. From past experiences such shim layers tend to create all sort of complications, so I think the question needs to be a strong asking of ourselves of "why"21:06
TheJuliatrandles: pip is likely easier, but you may not be able to just run a pip command21:06
TheJuliaI guess the whole setuptools thing is a good reason not to look at code today21:07
TheJuliaor well, to better put it, CI21:07
trandleson my testbed I can `pip install` so I'll try that first, thanks iurygregory and TheJulia21:07
*** jtomasek has quit IRC21:12
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add tempest default_boot_option and altflavor  https://review.opendev.org/74188621:14
*** thiagop has quit IRC21:33
TheJuliadtantsur|afk: on the topic of metalsmith, is there a specific reason you didn't use dib in the CI job?21:38
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add L3 boot section to the docs  https://review.opendev.org/68984421:58
jandersgood morning Ironic o/22:46
*** rcernin has joined #openstack-ironic22:51
*** trandles has quit IRC22:51
stevebakerjanders: morning23:03
jandershi stevebaker23:03
*** tosky has quit IRC23:03
jandershow was your weekend?23:03
stevebakerjanders: pretty low key, we didn't get up to much23:12
*** Goneri has quit IRC23:33
*** hjensas has quit IRC23:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!