Wednesday, 2021-06-30

*** sshnaidm is now known as sshnaidm|afk04:39
cennegood morning janders o/05:13
* TheJulia needs more coffeeee05:38
cennewow.. you're still up.05:45
cenneAll the best TheJulia, for what you are doing. 05:53
TheJuliaI'm chairing the Open Infra Foundation board meeting right now05:54
cenneoh cool! ++06:04
TheJuliaand soon I'll be going to bed06:05
* TheJulia is normally in bed by 9pm06:05
TheJuliait is 1106:05
iurygregorygood morning Ironic =)06:33
jandershey cenne TheJulia iurygregory o/06:33
iurygregoryhey janders o/06:34
TheJuliaNini06:34
TheJuliaCorgi and feline overlords are inches away saying time to sleep.06:34
arne_wiebalckGood morning iurygregory janders cenne and Ironic!06:34
arne_wiebalckOh, and TheJulia !06:34
* iurygregory agrees with corgi and feline overlords06:35
iurygregoryhey arne_wiebalck o/06:35
jandersTheJulia I think Corgi and Feline Overlords are right!06:36
TheJuliaZzzzzzzzzzzz06:38
cennegood night TheJulia. 06:39
cennehey iurygregory arne_wiebalck janders o/06:39
iurygregoryhey cenne o/06:39
opendevreviewWill Szumski proposed openstack/bifrost master: Allow HTTP headers to be customised for IPA image download  https://review.opendev.org/c/openstack/bifrost/+/79882510:28
dtantsurgood morning folks10:44
iurygregorygood afternoon dtantsur =)10:44
*** sshnaidm|afk is now known as sshnaidm10:53
jandershey dtantsur o/11:51
mnaserTheJulia: when you have as second, what is the intended replacement of `baremetal_admin` in the new rbac model?  in this case, a system scope admin => admin of the whole cloud, but what if i wanted an ironic admin only?12:05
janderssee you tomorrow Ironic o/12:41
opendevreviewDerek Higgins proposed openstack/ironic master: Skip port create if MAC is blank  https://review.opendev.org/c/openstack/ironic/+/79884412:50
ajyaTheJulia, rpittau|afk & others, posted a story for sushy for discussion https://storyboard.openstack.org/#!/story/200901712:51
dtantsurajya: I don't have objections to that12:55
ajyadtantsur: thanks12:57
opendevreviewDerek Higgins proposed openstack/ironic master: Skip port create if MAC is blank  https://review.opendev.org/c/openstack/ironic/+/79884413:29
TheJuliaajya: no objections as long as we don't go walking the api entire api to figure out what we can have present... or not on the object.14:10
dtantsurmorning TheJulia 14:21
TheJuliagood morning dtantsur 14:26
TheJuliaI would appreciate a review on https://review.opendev.org/c/openstack/ironic-python-agent/+/798732  It is train only, to fix my screw up14:27
ajyaTheJulia: thanks14:29
JayFTheJulia: is that OK to merge into a stable branch? 14:29
TheJuliaJayF: I think so, its never going to be released again so it is patches to fix vendors downstream branches at this point14:30
JayFoh, it's EM. Hmm that does change the calculus some.14:30
JayFI really don't like that patch, but I can pretend I never saw it if you want :)14:30
TheJuliathe change that introduced it was also an em patch14:30
JayFyeah IMO I would've reverted the backported patch with inconsistent behavior, and probably declared it unbackportable14:31
JayFwhich is not a good solution either14:31
JayFbut seeing if python2; bail in code that we advertised as supporting python 2 seems pretty rough too14:31
TheJuliaits all kind of awful since it didn't break in gate, but python internal codepoint checking blew up when it hit the utf-16 encoding marker on rhel in py36 because it needs explicit encoding satement14:31
JayFOh, I understand the failure semantics, and it's no fun :-(14:31
JayFTheJulia: internet says `io.open` exists in py27 standard library, and gives you an encoding param14:32
TheJuliaMy focus, atm is to just fix broken downstream stable/train, so I could try to pen the file separate ways if we want. Just seems like supporting py2 still in any way is a pita14:32
JayFTheJulia: apparently it's slow and python-only in py2 but fast and uses the C path in py314:32
TheJuliaJayF: orignal attempt to pass utf-16 encoding blew up14:33
TheJuliawait, io.open allows for encoding=utf-16?14:33
JayFTheJulia: my concern is actually amplified by this being IPA code... that warning may not be seen by folks14:33
JayFTheJulia: that's what that stackoverflow said14:33
JayFhttps://stackoverflow.com/questions/10971033/backporting-python-3-openencoding-utf-8-to-python-214:34
TheJuliadoes it honor the utf-16 delimieter marker?14:34
* TheJulia reads14:34
JayFall I theoretically know is from that stack overflow answer14:34
JayFwhich means I don't actually know it until I read some docs :)14:34
TheJuliahmm, that should be easy14:35
JayFthe answer by YaOZl looks to be straight copy+pastable14:35
TheJuliawell, version dependent though14:35
JayFtrue but I don't mind if py2; blah14:35
JayFI only mind just punting in that case :)14:35
JayFif six.PY2 is not that abnormal to see in 2/3 supporting code14:36
TheJuliano, but I think we started to strip six out around this time. RDO really frustrates me by sypporting py2714:36
JayFI mean, it is what it is. If we said we were gonna support a thing, regardless of if we personally know of any customers, we should support it14:37
JayFand especially not drop that support when least expected; in EM14:37
TheJuliawell, its complex14:42
TheJuliaI'll give it a shot. I think since my problem is only py3 native, it shouldn't e a big deal really.14:42
dtantsuryou can always experiment with your BOOTX64.CSV locally14:43
TheJuliaThat requires me to have py2 installed14:44
TheJulia:(14:44
TheJuliaI surely have a VM installed someplace14:44
dtantsurit's still available on Fedora14:44
dtantsurif you give me a code snippet, I'll run it14:44
TheJuliak14:45
* TheJulia still feels asleep14:45
dtantsurTheJulia: http://paste.openstack.org/show/807076/14:48
TheJuliadtantsur: nice! *looks* like it did the needful. Can you have it spit it out by character  number real quick? :)14:49
JayF\o/14:50
dtantsurlike this? http://paste.openstack.org/show/807077/14:51
JayFNext time, just paste the broken code into the github AI and teach it how to replace you14:51
dtantsur:D14:51
JayFBTW; that thing seems super problematic14:51
TheJuliadtantsur: that works just as well14:51
JayFI am not touching it with a 50000 foot pole14:51
JayFand I hope other open source contributors take the same approach14:51
dtantsuryeah, it's very questionable14:51
TheJuliaJayF: yeah, heard about that and it seems... kind of disturbing14:52
TheJuliawhat if the AI wants to code in a bunch of backdoors and you just trust it14:52
JayFTheJulia: I'm not even going there; I'm thinking copyright/licensing issues14:52
TheJuliaoh jeeze yeah14:52
TheJuliadidn't even think of that14:52
JayFTheJulia: for example; if it pulls one of our cool hardware tricks out of IPA while someone is using that IDE for a commercial competetor to IPA, is that OK?14:52
JayFyeah, that's why I mention it here; not just for the chat but to say a little bit of !!!14:53
JayFand discourage people from muddying the waters in the upstream project14:53
JayFI'm less worried about AI backdooring, or things like that, because just like with stack overflow, if you keep the code it gives you without personally validating it you're basically committing engineering malpractice anyway14:53
* TheJulia watches py27 tests run again14:58
TheJuliawheeee they passed14:58
cenne:)15:04
cennetests going green is a good feeling15:04
JayFuntil you find a bug AFTER the tests turn green15:06
JayFand you lose confidence in them15:06
JayF/o\15:06
cennehehe. that's happened to me just now. 15:07
JayFThat's when you find how to run the test so it fails15:07
JayFgotta answer the question why were tests OK when the code wasn't15:07
cenneWrote new tests that dtantsur suggested. felt nice even seing red. atleast the bug got found.15:07
cenneyup. lesson being learned.15:08
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/train: Train only - Fix py3 support for bootloader default config load  https://review.opendev.org/c/openstack/ironic-python-agent/+/79873215:11
JayFin many situations; especially in IPA early days, I'd write the unit tests all first because a full round trip on real hardware took so long15:11
JayFso just "mock" the executes to return whatever that system command would run, and exercise the code through unit tests15:12
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/train: Train only - Fix py3 support for bootloader default config load  https://review.opendev.org/c/openstack/ironic-python-agent/+/79873215:12
JayFthat's a lot harder for API code I think15:12
TheJuliaIt is15:13
TheJulia*but* if you do it, once you get things at least wired through it makes things go a lot faster15:13
dtantsurwriting a unit test can be a good way to confirm/reject a hypothesis15:14
TheJuliaI think for the loading default bootlaoder stuff originally, I actually wrote the test with bfournie on the call first before writing a line of code15:14
TheJuliawell, a line of code in image.py15:14
opendevreviewJulia Kreger proposed openstack/ironic master: WIP Scoped RBAC Devstack Plugin support  https://review.opendev.org/c/openstack/ironic/+/77895715:54
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/train: Train only - Fix py3 support for bootloader default config load  https://review.opendev.org/c/openstack/ironic-python-agent/+/79873215:57
TheJuliaJayF: pep8 fix15:57
TheJulia^^15:57
JayFI had it +2'd before you got the ^^ out :P15:58
TheJulianice16:03
* TheJulia suspects her devstack changes are all good now for scope enforcement, at least for cross-service between ironic/ironic-inspector16:12
arne_wiebalckbye everyone, see you tomorrow o/16:20
TheJuliagoodnight arne_wiebalck 16:24
opendevreviewcenne proposed openstack/ironic master: Add `boot_mode` and `secure_boot` to node object and expose in api  https://review.opendev.org/c/openstack/ironic/+/79705516:34
cennegn arne_wiebalck 16:34
dtantsurI'm also leaving for a day, see you tomorrow16:47
cennegn dtantsur16:57
opendevreviewJulia Kreger proposed openstack/ironic-inspector master: Add rbac scope enforcement handling to devstack plugin  https://review.opendev.org/c/openstack/ironic-inspector/+/79835917:41
TheJuliastevebaker: question of the day, do we need to do anything with metalsmith w/r/t secure rbac work18:20
TheJuliastevebaker: https://089e4f224791bf0b3f34-27a42f979dc9642e645167ee17c588d5.ssl.cf1.rackcdn.com/778957/27/check/ironic-inspector-tempest-rbac-scope-enforced/df7fce0/testr_results.html <-- inspector + ironic talking using system scoped access works \o/19:00
opendevreviewJulia Kreger proposed openstack/ironic master: Scoped RBAC Devstack Plugin support  https://review.opendev.org/c/openstack/ironic/+/77895719:25
TheJuliajust commit message updates19:26
stevebakermorning20:10
stevebakerTheJulia: metalsmith as used by tripleo, I don't think so. All actions are done with one admin user20:11
TheJuliaI guess they would just shift that to a system-admin user then20:11
TheJuliaworst comes to worst, I intend to force most jobs over to enforced scope at some point20:12
TheJuliastevebaker: fyi, I swapped out the train fix to take a different path, just needs another review20:14
stevebakerI will check that out20:31
JayFTheJulia: I'm ready to +2 https://review.opendev.org/c/openstack/ironic/+/792274 -- do you want it +A'd too, or should it wait / merge many of those related changes as a block20:55
JayFbtw that looks 5000% more readable after the sqlalchemy maintainer-requested changes20:55
TheJuliaJayF: Yeah, once I figured out how to do it and keep us from doing more work :)20:56
JayFAlso, do we intend on backporting the DB perf changes?20:56
TheJuliaJayF: I intend to backport them, so I think you can merge at will, none of the stack is breaking behavior wise20:56
JayF+1 awesome, will save me the effort if we can get them backported upstream :D 20:57
TheJuliaJayF: I can likely backport them to train, but I'm not sure I'll pick them up downstream on train fwiw20:58
JayFTheJulia: the code now looks a lot like the more optimized sqlalchemy code we churned out at $lastJob20:58
TheJuliamaybe merging as a block will make backporting easier20:58
TheJuliaat least tracking wise20:59
JayFit's up to you, I also know dmitry had a strong -1 on it, and IDK if the changes resolved his concerns (looks like it to me?)21:01
JayFso I'll just drop a +2 on it, and we can block-merge, I think that's the better idea anyway21:01
TheJuliaat a minimum, I need to get them backported to wallaby because the rbac stuff added more overhead and possibilities to make things more painful performance wise accidently21:02
TheJuliawfm21:02
TheJuliaI did, afaik, take care of everything Dmitry was objecting to21:02
JayFwe should get it back as far as possible if we have strong tests to ensure no regression21:02
TheJuliaI just think he has been too busy to get back to reviewing it21:02
JayFthat'd be a really nice bonus for someone tracking stable lol21:02
TheJulia++ it is all api field contract based so I think the testing I add in along the way does the sufficent testing required and all of the tempest tests pass without blinking and nova just works which I consider the ultimate test21:03
TheJuliaoh yeah, I feel personally responsible for making the performance worse, so... I now feel the need to make it better :)21:04
TheJuliasilly head21:04
JayFYou gotta flip that21:04
JayFsince everyone made it slow over the course of like 8 years21:05
JayFit's not your fault :P21:05
JayFwhat really hurts is when I fix something in IPA that's obviously been there since it was the teeth-agent21:05
JayFlol21:05
JayFno buck passing there21:05
TheJuliaWe've been focused on features as a community so much becasue that was the immediate needful that we never really stoped to quantify things at the end21:05
TheJuliastopped21:05
* TheJulia really likes the "lets not do a community goal and just focus on improving pain points" thread21:06
JayFBluntly, openstack is so CI driven that it gets very easy to ignore scale issues unless you have a loud open operator (like arne_wiebalck) pointing at the issues21:06
TheJulia++++++++++21:06
TheJuliaIt is, and CI systems can have variable performance21:06
TheJuliaat least, cloud based CI21:06
TheJuliaiurygregory: tomorrow, I could use like 20 minutes of your assistance looking at puppet-ironic21:26
TheJuliawell, your today once you finally read this my tomorrow21:26
opendevreviewMerged openstack/ironic master: Refactor deploy_utils.validate_image_properties  https://review.opendev.org/c/openstack/ironic/+/79787522:37
jandersgood morning Ironic o/23:05

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!