Monday, 2022-07-11

opendevreviewMerged openstack/ironic-tempest-plugin master: Add idrac OOB inspection test cases  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/84359000:12
opendevreviewSteve Baker proposed openstack/bifrost master: WIP Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722000:15
opendevreviewSteve Baker proposed openstack/bifrost master: Fix TFTP read access for enforcing SELinux  https://review.opendev.org/c/openstack/bifrost/+/84924600:15
opendevreviewSteve Baker proposed openstack/bifrost master: Copy shim and grub into tftp and http directories  https://review.opendev.org/c/openstack/bifrost/+/84924700:15
opendevreviewMerged openstack/ironic-tempest-plugin master: Add more deploy tests for idrac, redfish, ipmi  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/84557700:19
opendevreviewVerification of a change to openstack/ironic-tempest-plugin master failed: Add iDRAC Redfish virtual media boot deploy test  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/84535600:19
opendevreviewMerged openstack/ironic-python-agent-builder master: Remove support for openSUSE since Python 3.6 is no longer supported  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/84227800:42
opendevreviewMerged openstack/ironic master: Prevent pxe retry when agent token exists  https://review.opendev.org/c/openstack/ironic/+/84739201:51
opendevreviewSteve Baker proposed openstack/bifrost master: Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722002:14
opendevreviewSteve Baker proposed openstack/bifrost master: Remove enable_uefi_ipxe  https://review.opendev.org/c/openstack/bifrost/+/84924802:14
opendevreviewSteve Baker proposed openstack/bifrost master: Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722002:30
opendevreviewSteve Baker proposed openstack/bifrost master: Remove enable_uefi_ipxe  https://review.opendev.org/c/openstack/bifrost/+/84924803:06
opendevreviewSteve Baker proposed openstack/bifrost master: Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722003:06
opendevreviewSteve Baker proposed openstack/bifrost master: Remove enable_uefi_ipxe  https://review.opendev.org/c/openstack/bifrost/+/84924803:34
opendevreviewSteve Baker proposed openstack/bifrost master: Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722003:34
dtantsurmorning folks06:30
rpittaugood morning ironic! o/07:03
opendevreviewVerification of a change to openstack/ironic bugfix/19.0 failed: Fix redfish-virtual-media for newer iDRACs  https://review.opendev.org/c/openstack/ironic/+/84871707:56
jandersgood morning dtantsur rpittau and Ironic o/08:16
jandersdtantsur rpittau how did you go with your IKEA kit, all assembled successfully?08:17
jandersmine is mostly done, a couple items leftover for this week but bulk of it is all done08:17
rpittauhey janders :)08:19
rpittauI did what I could, at least the file cabinet is done08:22
rpittaurealized I will need some more shelves, probably another kallax08:22
ajyaGood morning, Ironic08:25
jandershey ajya o/08:26
ajyahi janders, about that issue on Friday - can you double check that credentials for that node in Ironic is correct? 13G is bad with reporting user friendly errors, instead it drops connection, also if credentials are incorrect.08:27
jandersajya will do08:46
timeuHello all, 09:01
timeuWhen I create a baremetal node via the openstack ansible collection (1.0.0) or openstacksdk (0.61) the provision_state state returned by the ironic API is always "available". Is this by design ? I was expecting it to be enroll 09:03
timeuok after reading the API docs it seems that this behavior changed in 1.11 (https://docs.openstack.org/api-ref/baremetal/?expanded=create-node-detail) and the openstacksdk passes 1.6 as microversion 09:06
dtantsurjanders: well, 2/3 done, I didn't have any energy left for the last item (but it can wait)09:09
opendevreviewMerged openstack/ironic bugfix/18.1: Fix redfish-virtual-media for newer iDRACs  https://review.opendev.org/c/openstack/ironic/+/84874709:09
dtantsurtimeu: yep, openstacksdk keeps the old behavior09:09
dtantsurI was thinking of making it configurable, but never got time for it09:09
timeudtantsur: thanks for confirming it. I was wondering even in master of openstacksdk they hardcode the microversion to 1.6 09:11
dtantsurtimeu: they don't hardcode it, they just default to it09:12
timeuso I would have to register the nodes and then move them to enroll if I want to validate BMC and node (cleaning) or just use the openstack client via a ansible shell command 09:12
dtantsuryep, these are your options for now09:12
dtantsur(I have some time this week, maybe I'll finally fix it?)09:12
timeuI meant hardcode it in the sense that I can't override if: https://github.com/openstack/openstacksdk/blob/master/openstack/cloud/_baremetal.py#L215 09:12
dtantsurohhh, we still use *that*. too bad09:12
timeuhow would the fix look like ? 09:12
timeuallow to pass the mciroversion from the ansible module to the sdk ? 09:13
timeuor solve it on the API side ?09:13
dtantsurtimeu: you see, the newer baremetal API in the SDK has some smart logic: https://github.com/openstack/openstacksdk/blob/master/openstack/baremetal/v1/node.py#L27609:13
dtantsurbut the older "cloud" API does not use it. somebody has to fix it.09:13
timeuah ok I see09:14
dtantsura fix will be for register_machine to use the new API internally09:14
timeuyeah I remember that the 2.x release of the collection is moving away from the cloud objects09:14
dtantsurtrue09:14
timeubut according to github the 2.x.x is only supported from Zed on and we are currently on Train (OSP 16.2)09:15
dtantsuroh09:15
dtantsurI wonder if they actually only support it on Zed or only with the Zed version of openstacksdk09:15
dtantsurworth asking on #openstack-ansible-sig IMO09:15
timeuyeah good idea 09:15
timeuthanks09:15
timeuI might just install it and see it works ;-)09:16
opendevreviewVerification of a change to openstack/ironic-python-agent stable/yoga failed: Gather details about bond interfaces if present  https://review.opendev.org/c/openstack/ironic-python-agent/+/84874209:29
opendevreviewSwapnil Machikar proposed openstack/ironic-tempest-plugin master: Add iDRAC Redfish virtual media boot deploy test  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/84535610:11
iurygregorygood morning Ironic11:21
opendevreviewMerged openstack/ironic bugfix/19.0: Fix redfish-virtual-media for newer iDRACs  https://review.opendev.org/c/openstack/ironic/+/84871711:35
opendevreviewMerged openstack/ironic-python-agent-builder stable/yoga: Add smartmontools package to DIB image  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/84860712:11
jandersajya I had the creds verified with the reporter of this issue, they are correct12:19
janders(and I also ran some authenticated queries using these creds, it worked)12:19
ajyathanks janders  for confirming. Can you get output of these commands on the affected system - https://paste.opendev.org/show/bcjqd1nXL6XmWpEsd4E3/ ?12:27
jandersajya all worked fine - GET against System.Embedded.1 returned the system attributes and poweron and poweroff worked fine, too12:35
janders(independently confirmed via ipmitool)12:36
jandersno output in response to poweron/poweroff, 0 exit codes from curl12:36
ajyayeah, it should be 204 No Content on success12:36
ajyajanders: then it's not power actions that causes the error. Is it possible to trace in the logs the requests that cause the issues? Or can you share the full logs with me with debug enabled?12:37
jandersajya happy to try - however we're supposed to be on a "study week" internally this week so it may be next week if that's okay (I will just check with the reporter if he can wait)?12:41
ajyaok12:43
jandersajya TY!12:44
janderssee you tomorrow Ironic o/12:44
iurygregorybye janders o/12:48
TheJuliagood morning13:09
rpittaugood morning TheJulia :)13:10
iurygregorygood morning TheJulia =)13:10
TheJuliabrraaaainnns13:26
opendevreviewRiccardo Pittau proposed openstack/ironic bugfix/19.0: No deploy_kernel/ramdisk with the ramdisk deploy and no cleaning  https://review.opendev.org/c/openstack/ironic/+/84922013:32
opendevreviewRiccardo Pittau proposed openstack/ironic bugfix/18.1: No deploy_kernel/ramdisk with the ramdisk deploy and no cleaning  https://review.opendev.org/c/openstack/ironic/+/84922113:33
rpittaubye everyone, see you tomorrow o/14:35
iurygregorybye rpittau o/14:38
TheJuliao/14:38
TheJuliaI suspect we need to clean up some of our deprecated things in unit testing14:38
TheJuliamy tests seem to be running longer these days14:38
TheJuliaso, I actually have something you should read14:39
opendevreviewJulia Kreger proposed openstack/ironic master: Make anaconda non-image deploys sane  https://review.opendev.org/c/openstack/ironic/+/83470914:41
TheJulia^^^ just text revisions, no code revisions from ruby's +214:41
iurygregorywill look at it o/14:50
iurygregory#startmeeting ironic15:00
opendevmeetMeeting started Mon Jul 11 15:00:00 2022 UTC and is due to finish in 60 minutes.  The chair is iurygregory. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
iurygregoryHello ironicers o/15:00
iurygregoryWelcome to our weekly meeting =)15:00
erbarro/15:00
stendulkero/15:00
rpioso\o15:00
iurygregorythe agenda for the meeting can be found in the wiki15:00
iurygregory#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:00
ajyao/15:01
matfechnero/15:01
iurygregory#topic Announcements / Reminder15:02
iurygregory#info Revise Ironic Vision15:02
iurygregory#link https://doodle.com/meeting/participate/id/eZ4nEk2b15:02
iurygregorywe want to gather feedback on how we see the project in the future, so we can build an updated concensus =)15:03
iurygregorywe will schedule a meeting for it next week =), please vote in the doodle if you would like to participate =)15:03
iurygregoryI will wait till Friday morning to close the doodle15:03
dtantsuro/15:04
iurygregory#info PTG Columbus, OH15:04
TheJuliao/15:04
iurygregory#link https://etherpad.opendev.org/p/ironic-ptg-planing-Columbus-OH15:04
iurygregoryyou probably know that the PTG will be in Columbus-OH in Oct 17-2015:05
iurygregoryso if you are planning in attend, please add your name in the etherpad15:05
iurygregoryfeel free to start adding topics for discussion also =)15:06
dtantsurI wish I had any idea if I come or not :)15:06
TheJuliaBut that doesn't stop us from identifying topics early15:07
iurygregory++15:07
TheJuliaAnd if some of us can't make it, perhaps plan for that and setup calls15:07
TheJuliaI hear some rooms will have projectors15:07
iurygregoryohhh nice15:07
iurygregorywe can try a mix of in-person+virtual PTG =)15:08
iurygregoryI know some folks won't be able to attend =(15:08
rpiosoThe Ohio State Buckeyes football team will be playing at home in Columbus on October 22. Highly recommended if you can get a ticket.15:08
iurygregorythanks for sharing this info rpioso o/15:09
rpiosoiurygregory: yw15:09
TheJuliarpittau: Alma mater?15:09
TheJuliaerr15:09
TheJuliarpioso: 15:09
TheJuliaJust seems like a weird thing to note...15:09
* TheJulia shrugs15:09
erbarrI got an announcement, Dell CI will be offline this weekend 7/15-7/17. If you need it to run, wait for it to come back online on Monday and do a "dell-recheck"15:10
rpiosoTheJulia: Nope. My daughter's, though, and in-laws', too.15:10
iurygregory#info Dell CI will be offline this weekend 7/15-7/17. If you need it to run, wait for it to come back online on Monday and do a "dell-recheck"15:10
TheJuliarpioso: ahh! That makes sense! :)15:10
TheJuliaRegarding the PTG, given scheduling for rooms, I suspect we may want to decompose some topics in advance.15:10
iurygregorythanks for the information erbarr o/15:10
TheJuliaJust a thought, we can maybe look at larger items and pull them apart so we can timebox some things15:11
iurygregoryTheJulia, that makes sense to me15:12
rpiosoIronicers, this will be the last weekly meeting I regularly attend, because I have been given new downstream responsibilities.15:12
rpiosoIt has been wonderful being a member of the awesome Ironic community. Thank you!15:13
TheJuliarpioso: Congrats! Good luck! and don't feel like you have to stay away :)15:13
rpiosoTheJulia: Thank you :)15:13
TheJuliaIn other words, everyone is always welcome :)15:13
iurygregoryrpioso, congrats on the new role, you are always welcome to join us! 15:13
rpiosoiurygregory: Thanks :-)15:14
iurygregorydoes anyone have anything that would like to add to Announcements / Reminder ?15:14
iurygregoryok, onward15:15
iurygregory#topic Review subteam status reports15:15
iurygregory#link https://etherpad.openstack.org/p/IronicWhiteBoard15:15
iurygregoryStarting L7415:16
iurygregoryTheJulia, just wondering about ipv6.. should we try to have a non-voting with vmedia?15:19
TheJuliaI thought we already had a voting job15:22
* TheJulia looks15:22
TheJuliaoh, for v6?15:22
iurygregoryyeah15:22
TheJuliaugh, metalsmith is broken15:23
TheJuliaI'm unsure of what value we would gain for vmedia based v6... tbh15:23
TheJuliaat least, as yet another distinct upstream job15:23
TheJuliawe already have a *ton* of jobs15:23
iurygregoryyeah, that's true15:23
TheJuliamany for super good reasons15:24
TheJuliabut still... it is a lot15:25
iurygregoryok, onward o/15:26
iurygregory#topic Deciding on priorities for the coming week15:26
* TheJulia adds a ptg note to bring up jobs15:26
iurygregory#link https://review.opendev.org/q/status:open+hashtag:ironic-week-prio15:27
TheJuliawould it be possible to get reviews on my anaconda fixes/improvements this week?15:27
iurygregoryI will look at it after lunch today =)15:27
JayFTheJulia: if I haven't reviewed it, please add me to the reviewers list15:27
TheJuliahttps://review.opendev.org/c/openstack/ironic/+/834709/ and https://review.opendev.org/c/openstack/ironic/+/835769 15:27
TheJuliaJayF: just the latter one15:29
TheJuliaThanks for the quick +2 on the first one15:29
TheJuliacbouchar: hopefully this will help with some of the confusion, anaconda driver wise :)15:30
iurygregoryDoes anyone have any patches to add for review?15:30
cboucharTheJulia: Will look.15:30
TheJuliaiurygregory: I don't think so from my end15:31
iurygregoryTheJulia, ack15:31
iurygregory#topic Baremetal SIG15:32
iurygregory#info Tomorrow we will have a Baremetal SIG session from Scott Solkhon & Jamie Poole: "Bare metal Kubernetes at G-Research"15:32
iurygregoryyou can find the details on how to join in the sig etherpad15:32
iurygregory#link https://etherpad.opendev.org/p/bare-metal-sig15:33
JayFWhoa hey, I had no idea15:33
JayFthat's my new employer!15:33
TheJuliaJayF: the world works in funny ways15:33
iurygregoryJayF, nice! =)15:33
JayFI'll have to attend. I've been curious about what they do with Ironic :D 15:33
iurygregory#topic Open discussion15:34
TheJuliaI'm semi-hoping to get August's baremetal presentation to be something in relation to MOC/New England Research Cloud15:34
TheJuliahope-ing15:34
TheJuliaI may just end up with a blog post though15:34
iurygregorythank you TheJulia =)15:35
* TheJulia is battling with the cat for control of the desk today15:35
iurygregorygood luck, even if you can't win this battle15:35
TheJuliashe is working hard to take out all wifi15:36
iurygregoryops =X15:36
iurygregoryDo we have any topics we should discuss?15:37
TheJuliaThere was something on my mind earlier15:37
iurygregorygo ahead =)15:37
TheJuliawell, it is less directly related and more related to open infra labs15:37
cboucharI did have an issue with a Selinux patch I was give to fix a PXE issue.  Let me know if take this outside meeting15:37
TheJuliaI'm kind of curious if there is an interest in some collaboration in terms of operational feedback15:38
TheJuliaso less baremetally and more... working feedback mechanisms related with people we do soemtiems chat with a lot15:38
iurygregorythat sounds interesting15:39
TheJuliaand the cat has returned, on mount documents tryng to push the joystick to the far side of the desk15:39
TheJuliaand my purse on to the floor... and block keyboard access15:39
TheJuliaand apparently play with keys15:39
* TheJulia picks her up and removes her from the desk15:39
TheJuliacbouchar: likely after meeting topic15:40
cboucharok15:40
* TheJulia awaits the cat learning how to use the keyboard15:41
TheJuliaand she leaves15:41
TheJuliaiurygregory: I don't think we have anything else to really discuss15:41
TheJuliaBesides maybe setting up a desk camera where everyone can watch my cat cause trouble15:41
iurygregory:D15:41
iurygregoryok15:42
iurygregoryI will run the meeting next week o/15:42
iurygregoryThanks everyone!15:42
JayFo/15:42
iurygregory#endmeeting15:42
opendevmeetMeeting ended Mon Jul 11 15:42:29 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:42
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-07-11-15.00.html15:42
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-07-11-15.00.txt15:42
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-07-11-15.00.log.html15:42
TheJulia-o/15:42
iurygregorysorry TheJulia 15:42
TheJuliafor?15:42
iurygregorythe o/ wasn't recorded =(15:43
TheJuliait is what it is15:43
TheJuliacbouchar: and I guess, what are you running into?15:43
cboucharAbout this selinux patch  https://review.opendev.org/c/openstack/bifrost/+/807220/32/playbooks/roles/bifrost-ironic-install/tasks/bootstrap.yml#51715:43
cboucharI have 2 hosts:  One is configured with ipxe and another older host only can do PXE.15:44
cboucharWith the patch, only the pxe host is successful.  To get ipxe host working again, I had to remove the patch.15:44
* TheJulia raises an eyebrow15:44
TheJuliawhat do you observe on the ipxe host access/error wise?15:45
cboucharI'm working from yoga branch but patched in the suggested fix.15:45
opendevreviewJulia Kreger proposed openstack/ironic master: Do not require stage2 for anaconda with standalone  https://review.opendev.org/c/openstack/ironic/+/83576915:46
cboucharThe target host sends out 'Operation not permitted' error when it tries to get the kernel file.15:46
cboucharWhen I was originally looking at the issue, I saw a link from /var/lib/tftpboot directory to the httpboot directory.15:47
TheJuliaso 403 error code15:47
TheJuliaohhh...15:47
TheJuliaugh15:47
TheJuliaso the conundrum is the stock selinux policy for tftpboot doesn't permit access to httpboot by path through the vfs layer15:48
TheJuliaso apache tries to read and things detonate15:48
cboucharI was focused on what was seen on the target side.  It may have just eventually timed out on ironic side.15:48
TheJuliaor nginx or $perl_webserver_i_wrote_a_very_long_time_ago15:48
cboucharyes I'm suspicious that's the issue15:48
TheJuliawe've seen something similar to this in the past15:49
TheJuliahmmm15:49
cboucharOriginally I was retagging the file and I could see that it affected the http file that it linked to.15:50
TheJuliaI tought we had a custom policy we added ages ago to handle the privs, perhaps we're applying it too early?15:50
cboucharHere's something from my notes:  'I learned the files in tftp directory are actually hard links to /var/lib/ironic/master_images/'15:51
cboucharIt's a selinux issue15:51
cboucharnothing to do with file permissions15:52
TheJuliayeah... so this is the other side of the conudnrum15:52
TheJuliawhy did we do the links....15:52
TheJuliareduce fs usage15:53
TheJuliaand dedup ultimately15:53
cboucharSo for PXE, I saw a tag of var_lib_t for the file and it must be tftpdir_t BUT this will break ipxe15:53
cboucharBUT changing this breaks ipxe15:53
TheJuliabecause httpboot is also a symlink15:53
dtantsurthe tie-breaker is probably to allow one of the services to read files of another15:54
TheJuliayeah15:55
cboucharI actually didn't step thru httpboot.  I was suspicious given the error I saw on the target that if I removed the patch the problem would go away and it did. 15:55
TheJuliadtantsur: I thought we did that at one point in bifrost15:55
dtantsurI thought so too15:55
dtantsuranyway, see you tomorrow folks o/15:58
cboucharIn the meantime, I changed my Proof of concept code to apply patch only for my PXE host.15:58
TheJuliaso, it looks like two things are going on, we used to have a policy, it got removed in favor of restoring the policies16:03
TheJuliabut I think that was on specific folders16:03
TheJuliacbouchar: can you confirm, what is your httpboot folder?16:04
TheJuliaa link, or directory?16:04
cboucharI'll need to rerun.  I am having issues re-imaging the ironic host so it could take awhile.16:06
TheJuliaahh, so in the middle of teardown/rebuild?16:06
cboucharyes16:06
TheJuliaokay, lmk, it should be a directory which makes your earlier statement confusing, at least precisely, but that may begin to explain in part what is going on I think16:07
cboucharI'm busy trying to get a set of code pushed out which works for both x86 & aarch16:07
TheJuliaokay16:08
opendevreviewVerification of a change to openstack/ironic stable/yoga failed: CI: Removing ironic job queue  https://review.opendev.org/c/openstack/ironic/+/84351116:12
TheJuliait hates me16:12
rpiosoI suggest folks make hotel reservations early for the PTG, especially if you plan to stay through the following weekend. Home games are held at The Ohio Stadium, known as The (Horse)'Shoe (https://ohiostatebuckeyes.com/100-years-of-ohio-stadium/), which has a capacity of over 100,000. Home game weekends are major events in Columbus.16:16
rpioso The American football game on Saturday, October 22 will be against the University of Iowa Hawkeyes, a fellow member of the Big Ten conference. In pre-season rankings, The Ohio State Buckeyes are ranked #2 in the country, and the Hawkeyes are ranked #16.16:16
TheJuliagood to know16:21
TheJuliafwiw, I thinkt he foundation's room block is reserved, but ideally we would want to fill that up16:21
JayFWait, did we seriously book PTG in Columbus on a CFB weekend?17:38
JayFAnd is it too late to beg someone to change the date...17:39
JayFdo you have any idea the amount that's going to be awful? lol17:39
iurygregoryJayF, seems like it...17:39
iurygregorynow I think I should talk with my manager asap to get approval17:39
JayFI have already been approved, it's not too early to book is it?17:40
JayFI will counter this with: if you are staying thru the weekend ** get tickets to the game **17:41
JayFa CFB game in the US is a unique experience to literally anything else I've ever been to, and I love sports/big events17:41
opendevreviewJulia Kreger proposed openstack/ironic-python-agent master: Guard shared device/cluster filesystems  https://review.opendev.org/c/openstack/ironic-python-agent/+/83908417:51
TheJuliaiurygregory: I was thinking earlier, we should do like a review jam walk through the repos at some point soon()19:34
iurygregoryTheJulia, sure!20:14
JayFif you get me on that invite, I'll come if the time is right (but don't schedule it around me)21:06
iurygregoryJayF, ack =)22:18
iurygregoryjanders, you around? o/22:23
jandersgood morning Ironic o/23:07
jandersiurygregory now I am! :)23:07
opendevreviewSteve Baker proposed openstack/bifrost master: Fix TFTP read access for enforcing SELinux  https://review.opendev.org/c/openstack/bifrost/+/84924623:38
opendevreviewSteve Baker proposed openstack/bifrost master: Copy shim and grub into tftp and http directories  https://review.opendev.org/c/openstack/bifrost/+/84924723:38
opendevreviewSteve Baker proposed openstack/bifrost master: Remove enable_uefi_ipxe  https://review.opendev.org/c/openstack/bifrost/+/84924823:38
opendevreviewSteve Baker proposed openstack/bifrost master: Support PXE network boot with grub  https://review.opendev.org/c/openstack/bifrost/+/80722023:38

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!