Thursday, 2023-10-12

opendevreviewVerification of a change to openstack/ironic master failed: Introduce conductor touch while offline  https://review.opendev.org/c/openstack/ironic/+/89737500:58
opendevreviewVerification of a change to openstack/ironic stable/yoga failed: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89620901:06
opendevreviewVerification of a change to openstack/ironic stable/xena failed: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89621001:31
opendevreviewMerged openstack/ironic master: Introduce conductor touch while offline  https://review.opendev.org/c/openstack/ironic/+/89737502:27
opendevreviewMerged openstack/ironic stable/yoga: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89620903:13
opendevreviewMerged openstack/ironic stable/wallaby: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89637603:13
opendevreviewVerification of a change to openstack/ironic stable/xena failed: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89621003:19
opendevreviewBoushra Sondos Bettir proposed openstack/ironic-python-agent master: Replace shlex module with helper function  https://review.opendev.org/c/openstack/ironic-python-agent/+/89805805:20
rpittaugood morning ironic! o/07:14
opendevreviewAdam Rozman proposed openstack/ironic master: implement basic-auth support for user image download process  https://review.opendev.org/c/openstack/ironic/+/89041107:41
opendevreviewAdam Rozman proposed openstack/ironic master: implement basic-auth support for user image download process  https://review.opendev.org/c/openstack/ironic/+/89041107:43
rpittaudtantsur: good timing! :D08:03
dtantsurmmm?08:03
rpittauthis > https://review.opendev.org/c/openstack/ironic-python-agent/+/89805808:03
dtantsurahhh, I was 1 minute earlier, lol08:04
rpittauyeah :D08:05
dtantsurNeed to also put the Adam's image auth patches on the queue. I suspect he'll have an issue with image_download_source=local and its lack of authenticaiton support, just like we hit it with the new non-bootable image API08:05
* dtantsur is pissed because weechat somehow broken nick autocompletion on tab08:06
opendevreviewVerification of a change to openstack/ironic stable/xena failed: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89621008:31
opendevreviewMahnoor Asghar proposed openstack/ironic master: Add inspection hooks  https://review.opendev.org/c/openstack/ironic/+/89266108:57
opendevreviewMerged openstack/ironic-python-agent stable/2023.2: Retry on checksum failures  https://review.opendev.org/c/openstack/ironic-python-agent/+/89796109:29
opendevreviewMerged openstack/ironic-python-agent stable/2023.1: Retry on checksum failures  https://review.opendev.org/c/openstack/ironic-python-agent/+/89795009:29
opendevreviewMerged openstack/ironic stable/xena: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89621011:52
TheJuliagood morning13:38
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: Add test for dhcp-less vmedia based deployment  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/89800613:48
opendevreviewJulia Kreger proposed openstack/ironic master: WIP/DNM: Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801013:49
dtantsurTheJulia: good morning, hopefully better than we have here in OCP :D14:08
dtantsuractually, PSA: https://issues.redhat.com/browse/RHEL-1287014:08
dtantsurpeople may start seeing this in Stream 814:08
TheJuliawheeeeee14:27
TheJuliahmm, our API has improved mysteriously since the early days of me sending json patches to it14:32
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: Add test for dhcp-less vmedia based deployment  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/89800614:34
TheJuliaiurygregory: I have a question for you on https://review.opendev.org/c/openstack/ironic/+/897989, maybe I'm not understanding why we have to special case to continue.14:43
TheJuliawell, not to continue, as it were14:43
-opendevstatus- NOTICE: The lists.openstack.org site will be offline over the next few hours for migration to a new server15:31
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: Add test for dhcp-less vmedia based deployment  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/89800615:42
TheJulia\o/15:42
rpittaugood night! o/15:50
JayF\o15:56
dtantsurSo folks, when is the right time to migrate off eventlet? :D16:30
JayFI have actually thought about this and come to the conclusion the only way that actually happens is if someone wrote an eventlet-compatible library mapping to one of the real-async libraries16:32
dtantsurI don't think monkey-patching makes it possible16:32
JayFbecause mixing greenthreads and actual threads is likely a really bad idea and eventlet is baked in deep, deep, deep to the codebase16:32
dtantsur(and if we keep the monkey patching, we keep all the downsides)16:32
dtantsurmmm, mixing greenthreads and actual threads is a great idea, eventlet just cannot do it16:32
dtantsur(both Go and Rust's Tokyo can)16:33
JayFmy experience is around eventlet/greenlet16:33
JayFso that tracks :D 16:33
JayFextremely unpopular opinion: we'd be in a MASSIVELY better place if OpenStack was written around twisted instead :D 16:34
JayFlol16:34
dtantsurI will side with you on this one16:34
dtantsurhttps://github.com/eventlet/eventlet/issues/673 (the temoto's suggestion) make me think that we could potentially isolate an asyncio executor in a green thread16:36
JayFhonestly I only feel that way because I know it was migrated to some of the native async stuff on the backend, and I'm friends with Glyph so I know someone would care about our bugs ;) 16:36
dtantsurand then grow the asyncio part and reduce the eventlet one16:36
dtantsurI've done a lot of Twisted in both of my previous jobs16:37
clarkbJayF: are you aware of the history there with twisted and eventlet?16:37
JayFNo, actually. I've written basically zero anything in twisted despite Glyph teaching me quite a bit of the advanced python stuff I know now16:38
JayFb/c he was at a desk about 20 ft from me at Rackspace SF :D 16:38
clarkbtl;dr nova was twisted, swift was eventlet. Before I got involved apparently the decisions was made to standardize on eventlet. Then a few yaers later swift realized eventlet was not the greatest and that led to the go experiment16:38
JayFI traded devops knowledge for python knowledge16:38
JayFoh :( 16:38
dtantsurbtw how did the go experiment go?16:38
JayFdtantsur: I believe rackspace ran the go fork downstream in production for ... as long as I was aware?16:39
JayFdtantsur: but was a situation where I think they stopped investing in it once they got the API coverage they cared about implemented16:39
dtantsurI see16:39
clarkbya the code is out there somewhere but it never ended up in swift proper aiui16:39
clarkbfunny though go has the same underlying issue though16:39
clarkbit just scales up better on top of the greentrhead design so you notice less16:40
JayFhttps://github.com/troubling/hummingbird16:40
dtantsurclarkb, IIUC it uses an M:N thread model16:40
dtantsurwhich can result in much better scaling with CPU numbers16:40
dtantsurbut also, they don't deal with non-sense like "eventlet overriding things the way it no longer works" like in https://issues.redhat.com/browse/RHEL-1287016:41
clarkbdtantsur: yup and you don't get strict control of it which is the problem aiui. Specifically disk/fs io is often blockign (there are no non blocking options) which means you basically need to park an entire thread for it16:41
clarkbboth go and python make that painful16:41
clarkbgo just happens to not hit the limits nearly as quickly so its probably fine16:41
dtantsurokay, you convinced me, Rust it is :D16:41
JayFI am not 100% sure because I mostly worked on the outskirts of the code at this job16:41
JayFbut I worked at a place that did a lot of go that interfaced with the DB16:41
JayFand IIRC we did a completely separate set of goroutines off a queue for the actual DB write bits16:41
JayFlike ensured no matter what I/O never happened in the primary set of greenthreads16:42
dtantsurMaybe not using OS threads was a mistake to begin with..16:43
JayFI honestly don't know, all these problems are hard and it's easy to pretend the alternatives don't have their own set of problems but they do; we just don't know what they are16:45
dtantsurTrue. I'm just upset because I spent the whole day chasing this eventlet regression16:46
dtantsur(I wonder how many people will see it, potentially everyone still using Stream 8 / RHEL 8)16:46
JayFI mean, that's unfortunate; but it is part of the burden taken on when a vendor wants to support python for longer. 16:47
JayFI can't imagine that was a pleasant one to track either16:48
* JayF wishes "apt-get install python3.8" would be a valid fix for those folks16:48
JayFI've been running Gentoo desktops/homelabs and not enough actual enterprise linux servers for too long ;) 16:48
dtantsur:)16:49
TheJulia*sigh* "Network 530dd336-f70a-4339-ad68-2aaf704d186b could not be found."16:50
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: Add test for dhcp-less vmedia based deployment  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/89800617:29
TheJuliawoot, my dhcp-less ramdisk booted18:55
TheJuliamuahahahahaha18:55
opendevreviewJulia Kreger proposed openstack/ironic master: WIP/DNM: Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801019:09
opendevreviewBoushra Sondos Bettir proposed openstack/ironic-python-agent master: Replace shlex module with helper function  https://review.opendev.org/c/openstack/ironic-python-agent/+/89805819:52
opendevreviewJulia Kreger proposed openstack/ironic master: WIP/DNM: Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801020:20
opendevreviewBoushra Sondos Bettir proposed openstack/ironic-python-agent master: Replace shlex module with helper function  https://review.opendev.org/c/openstack/ironic-python-agent/+/89805820:37
opendevreviewJulia Kreger proposed openstack/ironic master: WIP/DNM: Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801022:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!