Thursday, 2022-03-31

rpittaugood morning ironic! o/06:38
arne_wiebalckGood morning rpittau and Ironic!06:44
rpittauhey arne_wiebalck :)06:44
kamlesh6808cGood morning Ironic !07:23
rpittauiurygregory, TheJulia, about https://review.opendev.org/c/openstack/metalsmith/+/835749 we probably have to adjust the domain xml to make latest CS9 work -> https://bugzilla.redhat.com/show_bug.cgi?id=183471407:29
kamlesh6808cTheJulia, iurygregory, dtantsur : This is regarding raid cleaning implementation for physical baremetal in ironic tempest plugin.07:58
kamlesh6808cAs suggested by community, i was looking to leverage introspection to grab "by_path" info for root device hint inside raid cleaning test cases.07:59
kamlesh6808cHurdle what I get is, while running introspection from raid cleaning block it expects to have Nova service disabled since its standalone test. If disabled, it doesn't execute inband introspection since it requires compute Service Enabled.In both sense, it skips execution.08:00
kamlesh6808cCan you please suggest way ahead.08:01
cboucharTheJulia:  I've been wanting to chat with you about upstream testing so let me know when available.  10:07
opendevreviewRiccardo Pittau proposed openstack/ironic master: [DNM] TEST CI  https://review.opendev.org/c/openstack/ironic/+/83596011:08
rpittauseems like grenade is not behaving very well11:10
rpittauinteresting, we're not collecting wheels for libvirt-python anymore in bifrost, that's why upgrade is failing now11:27
iurygregorygood morning Ironic11:41
iurygregoryrpittau, ack re-adjust the xml domain11:41
iurygregorykamlesh6808c, I will check the plugin code to see if we can avoid skipping 11:43
kamlesh6808ciurygregory : thanks :)11:47
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Force install binaries for libvirt-python  https://review.opendev.org/c/openstack/bifrost/+/83596511:48
rpittaummm may need to drop this ^ to yoga first11:48
iurygregoryhummm funny that we are always trying to fix the libvirt-python :D11:50
iurygregorylet's see how CI will react11:51
iurygregoryI will review things after the live episode11:51
rpittauwell it keeps changing from wheel to source instead of just staying to wheel :/11:51
iurygregory=/11:53
iurygregoryOpenInfra Live - OpenStack Yoga: New Features Straight from the Contributors will start in 46min https://youtu.be/hwPfjvshxOM  \o/13:14
rpittauyep grenade is utterly and completely broken13:15
rpittau-> https://review.opendev.org/c/openstack/ironic/+/83596013:15
TheJuliawhat is grenade doing?13:41
TheJuliaalso good morning13:41
iurygregorygood morning TheJulia 13:42
rpittauTheJulia: something odd with nova13:42
rpittauor well nova/neutron combination13:42
rpittauTheJulia: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c5c/835960/1/check/ironic-grenade/c5c7ca9/controller/logs/grenade.sh_log.txt13:43
iurygregorynova + neutron </313:47
iurygregoryI will take a look after the presentation13:47
TheJuliaso neutron has lost it's mind I guess13:48
rpittauit was working fine until 2 days ago13:49
TheJuliaright after the "release"13:50
rpittauyep13:50
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Force install binaries for libvirt-python  https://review.opendev.org/c/openstack/bifrost/+/83596513:53
rpittaunot related to grenade, how come we're not getting any more whl pkgs for libvirt-python ?13:53
TheJuliaI think being a binary module... it likely has to come from distros given the binary nature (that and if you ever look at how some  of the translation layer stuff is built you'll want to run for the hills(14:04
TheJulias/hills(/hills)/14:04
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [DNM] TEST CI  https://review.opendev.org/c/openstack/bifrost/+/83602414:07
TheJuliaWell, I know why I've preferred soy milk so much recently. The coffee I've been using is slightly bitter14:07
rpittauwe were getting the whl since a couple of days ago, now they just disappeared.....14:08
TheJuliaweird14:09
* iurygregory should have added more features to the slides =(14:16
* iurygregory will mention that we have the feedback form <314:24
cboucharIronic Folks: Wondering in your tempest tests whether you have hardware in the testbed with architectures other than x86_64.  If so, which ones?14:39
iurygregoryI've only run tempest in x86_6414:40
cboucharDo you know if there is other architecture hosts in what's set-up?14:41
ameya49Hi iurygregory o/14:42
iurygregorycbouchar, I think our CI only runs tempest in x86_64, we do run unit tests in ARM14:43
iurygregoryameya49, hi14:43
ameya49Here is the tracback for quota exceeded issue while running test_introspection_basic tempest test case for ironic_tempest_plugin : https://paste.openstack.org/show/bFzCgezgUB97OP2b67Qk/14:44
ameya49I was not able to add whole traceback since it was giving spam error. But let me know if you need whole traceback. Will try to upload.14:46
iurygregorythat should be enough, I will try to check latter today some codes 14:47
ameya49sure. Thanks.. Good day ahead!14:47
iurygregoryarne_wiebalck, let us see if we will get more answers in the form after the live :D15:03
TheJuliacbouchar: upstream all of our tests are x86_64 because virt in virt is painful and slow and we're running tests in ?9? or so public clouds.15:18
TheJuliacbouchar: I think someone has run tempest against power, really the fundimentals are basically the same as long as the enrolled machine is flagged properly as being that architecture15:19
cboucharTheJulia:  How do you verify the target host was reimaged successfully by last ironic action as opposed to reimage failed and booting what was on disk previously?  Do you store info on the machine to verify against?15:25
TheJuliacbouchar: two step process. We move a vm into cleaning which is a pass/fail operation15:32
TheJuliathen we redeploy15:32
cboucharTY15:32
TheJuliarebuild is just expected to work as it is just the re-running deploy, fwiw15:33
cboucharwasn't thinking you were using VMs.15:33
TheJuliaI'm not sure that is really tested, but it is literally just an alias in our code15:33
cboucharTY15:33
TheJuliayeah, all our test resources are in public clouds, so... yeah :\15:33
rpittaugood night! o/15:43
TheJuliacbouchar: I have a 1.5 hour call coming up in a few minutes, and then I have an an hour of free time before my weekly 1-116:27
arne_wiebalckiurygregory: not yet :)16:40
arne_wiebalckbye everyone o/16:40
iurygregoryarne_wiebalck, bye o/16:43
cboucharTheJulia:  Sounds good.17:04
* TheJulia feels exhausted18:22
TheJuliaJayF: I think we'd document it in the admin guide, fwiw18:26
TheJuliabut yeah, afaik there is no other http medium to grok something is a folder since it is more a human construct18:26
JayFIt's one of those things where like, I don't *think* anyone would do that18:26
TheJuliayeah18:26
JayFbut I personally know that it's possible because the static site gen I use for jay.jvf.cc and oldos.org both have it as a possibility18:26
JayFwhere you can do domain.tld/path/to/file/ and it loads that as file.html 18:27
TheJuliainternally is that a redirect though?18:28
JayFNo.18:28
JayFIt just works that way in browsers these days. I don't fully understand it. Logs show fetching of file.html, URL in address bar is /path/to/file/18:28
TheJuliafunky18:29
* TheJulia momentarilly longs for HTTP and browsers of... 15 years ago18:29
TheJuliaw/r/t https://review.opendev.org/c/openstack/ironic/+/834709/5/ironic/conductor/utils.py what specifically were you thinking config option wise18:30
JayFIt sounded like you were debating whether or not to write back image type to [the node? the image service?]18:34
JayFand there was a little bit of disagreement18:34
JayFI was just saying, you can make that optional18:34
TheJuliaYeah, I'm not sure *why* we're doing it at all18:36
TheJuliaTo be honest.18:36
TheJuliaThat is likely Dmitry context I'll need to extract next week18:36
TheJuliaoh why oh why is grenade now failing18:45
cboucharTheJulia:  I upgraded y bifrost host to yoga (with adjustments as needed) and applied  https://review.opendev.org/c/openstack/ironic/+/834709.  It worked like a charm.18:52
TheJuliawoot!19:28
TheJuliacbouchar: that makes me super happy to hear19:30
TheJuliaso before 2 days ago, grenade was Xena->Master, now it is Yoga->Master and it *feels* like filesystem permissions are wrong20:00
TheJuliafile permissions seem suspect20:13
TheJuliabut odds it broke now20:14
* TheJulia goes and lays down20:15
admiyoContainers kinda suck, don't they?20:43
admiyoI mean...they let you do some cool things, but once they start failing and hiding information on you, they really are nasty little beasts.20:44
admiyoI mean, it does tell me the pid file has a number in it that does not match, but that really is not actionable data20:44
admiyo(No such process)?  Reaslly...why did it die?  "I'm sorry Adam, I can't tell you that."20:45
admiyoIs OVS like, a major thorn in the Ironic paw?  20:45
admiyoJayF, um, that is a dangerous mechanism, and is severly limited in the browser.  Think XSRF  type attack.21:01
admiyoI mean, yeah, I can do file:/// but only if I either explicitly type it in or from another page already loaded file file:///21:02
admiyoThere is an apache mod that lets you od http://tld/~user/ and that will load from the users public_html dir, but there are a slew of permission issues there now.  That was also all way before SELinux got on the scene21:03
JayFadmiyo: I'm not saying it's good; I'm saying we should explicitly document that we don't support it since it's possible. 21:17
JayFAlso, all my comments on PRs these days are mostly advisory, since I haven't been working full time on Ironic in several months at this point21:18
admiyoOh, I am just speaking off the cuff here, just spent a lot of time dealing with some security stuff like that21:19
admiyoI'm still trying to understand the issue21:20
JayFIt's not an issue.21:21
JayFA PR TheJulia put up has an assumption that any URL ending in / is a path, not a single file21:22
admiyoCool21:22
JayFwhich is an OK assumption for most Ironic use cases, I just think we should doc it21:22
admiyoWell...I don't think there is anything in the HTTP spec that distinguishes that.  I know a lot of autogenerated content is actually kinda sloppy about differentiating.  I think the most common approach now is to do a redirect21:24
admiyoFor Keystone I am pretty sure the Flask mechanism treats them the same.  I know we don't have seprate entries for /v3  and /v3/ and they both return the same data21:27
admiyobut you are talking images.  Really it should be based on the content type of the response, not the path.21:28
* admiyo turning back into a purist, goes back to debuggin OVS21:28
TheJuliaadmiyo: yeah, capturing redirects now too.21:32
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic-python-agent-builder master: Add multipath element  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/83609421:37
admiyoTheJulia, I am trying to stifle the pedant in me, but...you should make no assumptions about the URL except based on the content type it returns.  But I am guessing here the issue is just that it says "binary" for most images.  Anyd you want to make a decision before you actually call on the URL....21:38
TheJuliaYeah, non-images actually. Like to a repository path used by anaconda21:41
JayFWhat really matters in this case is that we capture the 99.9% case and document that we don't support the 0.1% case (probably need more nines and 0s in those comparisons)22:02
TheJulia++22:18
opendevreviewJulia Kreger proposed openstack/ironic stable/yoga: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610523:18
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610623:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!