*** tosky has quit IRC | 00:02 | |
*** MentalSiege has quit IRC | 00:02 | |
iurygregory | morning janders o/ | 00:02 |
---|---|---|
*** ociuhandu has quit IRC | 00:03 | |
*** iurygregory has quit IRC | 00:06 | |
*** rcernin_ has joined #openstack-ironic | 00:19 | |
*** rcernin has quit IRC | 00:20 | |
*** iurygregory has joined #openstack-ironic | 00:43 | |
*** openstackgerrit has joined #openstack-ironic | 00:46 | |
openstackgerrit | Jacob Anders proposed openstack/ironic-python-agent master: [WIP] Add support for using NVMe specific cleaning https://review.opendev.org/c/openstack/ironic-python-agent/+/770237 | 00:46 |
*** jamesden_ has joined #openstack-ironic | 01:00 | |
*** paras33__ has joined #openstack-ironic | 01:01 | |
*** pmannidi has quit IRC | 01:02 | |
*** pmannidi has joined #openstack-ironic | 01:02 | |
*** stevebaker has quit IRC | 01:03 | |
*** jamesdenton has quit IRC | 01:03 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Bump oslo.log requirement to 4.3.0 https://review.opendev.org/c/openstack/ironic/+/763256 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Write stub ACL test for every existing API call https://review.opendev.org/c/openstack/ironic/+/767445 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Attempt to slim down protection test base class https://review.opendev.org/c/openstack/ironic/+/770673 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Start populating existing policy tests https://review.opendev.org/c/openstack/ironic/+/768136 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Duplicate testing for system scoped ACL testing https://review.opendev.org/c/openstack/ironic/+/770002 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Introduce common personas for secure RBAC https://review.opendev.org/c/openstack/ironic/+/763255 | 01:07 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP Implement secure RBAC for baremetal nodes https://review.opendev.org/c/openstack/ironic/+/763257 | 01:08 |
openstackgerrit | Merged openstack/bifrost master: Add `bifrost-cli enroll` command https://review.opendev.org/c/openstack/bifrost/+/770042 | 01:18 |
openstackgerrit | Shuai Qian proposed openstack/ironic-ui master: Fix unittest coverage bug https://review.opendev.org/c/openstack/ironic-ui/+/771176 | 01:39 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/sushy stable/victoria: Catch errors when retriving severe index https://review.opendev.org/c/openstack/sushy/+/769950 | 01:53 |
iurygregory | enr I should push to master -.-' | 01:53 |
openstackgerrit | Merged openstack/sushy master: Secure boot support: enabling/disabling and resetting keys https://review.opendev.org/c/openstack/sushy/+/770607 | 02:28 |
*** stevebaker has joined #openstack-ironic | 02:37 | |
*** mkowalski_ has joined #openstack-ironic | 02:39 | |
*** mkowalski_ has quit IRC | 02:43 | |
*** ricolin has joined #openstack-ironic | 02:45 | |
*** tzumainn has quit IRC | 02:45 | |
*** Qianbiao has joined #openstack-ironic | 02:50 | |
*** zzzeek has quit IRC | 03:04 | |
*** zzzeek has joined #openstack-ironic | 03:05 | |
*** rcernin_ has quit IRC | 03:23 | |
openstackgerrit | Shuai Qian proposed openstack/ironic-ui master: Fix unittest coverage bug https://review.opendev.org/c/openstack/ironic-ui/+/771176 | 03:32 |
*** mkrai has joined #openstack-ironic | 03:36 | |
*** rcernin_ has joined #openstack-ironic | 04:01 | |
*** mkrai has quit IRC | 04:34 | |
*** mkrai_ has joined #openstack-ironic | 04:34 | |
*** pmannidi has quit IRC | 05:04 | |
*** pmannidi has joined #openstack-ironic | 05:05 | |
openstackgerrit | Verification of a change to openstack/ironic failed: Bump oslo.log requirement to 4.3.0 https://review.opendev.org/c/openstack/ironic/+/763256 | 05:17 |
*** iurygregory has quit IRC | 05:33 | |
*** ricolin_ has joined #openstack-ironic | 05:47 | |
*** ricolin has quit IRC | 05:47 | |
*** Qianbiao has quit IRC | 05:49 | |
*** moshiur has joined #openstack-ironic | 05:56 | |
*** gyee has quit IRC | 05:59 | |
openstackgerrit | Min Li proposed openstack/ironic-ui master: Fix unittest coverage bug https://review.opendev.org/c/openstack/ironic-ui/+/771176 | 06:17 |
*** Qianbiao has joined #openstack-ironic | 06:30 | |
arne_wiebalck | Good morning, ironic! | 06:35 |
*** mkrai_ has quit IRC | 07:07 | |
*** rcernin_ has quit IRC | 07:28 | |
*** rcernin_ has joined #openstack-ironic | 07:32 | |
janders | good morning arne_wiebalck o/ | 07:32 |
arne_wiebalck | hey janders o/ | 07:33 |
*** Qianbiao has quit IRC | 07:34 | |
*** anuradha1904 has joined #openstack-ironic | 07:41 | |
*** mkrai_ has joined #openstack-ironic | 08:00 | |
*** mkrai_ has quit IRC | 08:04 | |
*** rpittau|afk is now known as rpittau | 08:17 | |
rpittau | good morning ironic! o/ | 08:17 |
janders | good morning rpittau o/ | 08:17 |
rpittau | hey janders :) | 08:18 |
*** Qianbiao has joined #openstack-ironic | 08:22 | |
Qianbiao | morning arne_wiebalck | 08:22 |
arne_wiebalck | hey Qianbiao o/ | 08:29 |
Qianbiao | o/ hey | 08:30 |
*** mkrai has joined #openstack-ironic | 08:32 | |
*** rcernin_ has quit IRC | 08:35 | |
*** QianbiaoNG has joined #openstack-ironic | 08:38 | |
*** mkrai_ has joined #openstack-ironic | 08:40 | |
*** mkrai has quit IRC | 08:41 | |
*** stevebaker has quit IRC | 08:41 | |
*** Qianbiao has quit IRC | 08:41 | |
*** akahat|rover is now known as akahat|lunch | 08:46 | |
*** tosky has joined #openstack-ironic | 08:47 | |
*** dougsz has joined #openstack-ironic | 08:52 | |
rpittau | two very quick reviews if anyone has a minute https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/766915 https://review.opendev.org/c/openstack/networking-generic-switch/+/766254 | 09:03 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-prometheus-exporter stable/ussuri: Remove lower-constraints job https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/767977 | 09:07 |
*** lucasagomes has joined #openstack-ironic | 09:12 | |
rpittau | well ussuri is almost ok, need a coffee before even thinking about checking train | 09:24 |
*** pmannidi has quit IRC | 09:36 | |
*** pmannidi has joined #openstack-ironic | 09:45 | |
*** derekh has joined #openstack-ironic | 09:49 | |
rpittau | one more for the glory https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/767977 :) | 09:56 |
openstackgerrit | Derek Higgins proposed openstack/ironic stable/victoria: Add a delay/retry is vmedia insert fails https://review.opendev.org/c/openstack/ironic/+/771243 | 10:00 |
*** ociuhandu has joined #openstack-ironic | 10:07 | |
*** akahat|lunch is now known as akahat|rover | 10:09 | |
*** ociuhandu has quit IRC | 10:12 | |
*** tosin has joined #openstack-ironic | 10:18 | |
*** mkrai_ has quit IRC | 10:18 | |
openstackgerrit | Aija Jauntēva proposed openstack/ironic master: Add import, export configuration to idrac-redfish https://review.opendev.org/c/openstack/ironic/+/759428 | 10:19 |
*** rpittau is now known as rpittau|bbl | 10:20 | |
openstackgerrit | Aija Jauntēva proposed openstack/ironic master: Add import, export configuration to idrac-redfish https://review.opendev.org/c/openstack/ironic/+/759428 | 10:21 |
*** ociuhandu has joined #openstack-ironic | 10:26 | |
openstackgerrit | Jacob Anders proposed openstack/ironic-python-agent master: [WIP] Add support for using NVMe specific cleaning https://review.opendev.org/c/openstack/ironic-python-agent/+/770237 | 10:31 |
*** priteau has joined #openstack-ironic | 10:31 | |
*** rcernin_ has joined #openstack-ironic | 10:34 | |
*** rcernin_ has quit IRC | 10:41 | |
*** sshnaidm|afk is now known as sshnaidm|ruck | 10:43 | |
*** dtantsur|afk is now known as dtantsur | 10:44 | |
dtantsur | trandles: I thought I made bifrost install DIB images if no --testenv or --develop is used | 10:45 |
dtantsur | good morning folks | 10:45 |
janders | good morning dtantsur | 10:46 |
openstackgerrit | Merged openstack/python-ironic-inspector-client master: Move pep8 dependencies from test-requirements to tox.ini https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/766915 | 10:48 |
*** mkrai_ has joined #openstack-ironic | 10:49 | |
openstackgerrit | Merged openstack/networking-generic-switch master: Remove pep8 dependencies from test-requirements https://review.opendev.org/c/openstack/networking-generic-switch/+/766254 | 10:50 |
*** ociuhandu has quit IRC | 10:54 | |
*** ociuhandu_ has joined #openstack-ironic | 10:54 | |
*** ociuhandu_ has quit IRC | 10:54 | |
*** ociuhandu has joined #openstack-ironic | 10:54 | |
*** pmannidi has quit IRC | 10:59 | |
*** ociuhandu has quit IRC | 11:14 | |
*** ociuhandu_ has joined #openstack-ironic | 11:14 | |
*** uzumaki has joined #openstack-ironic | 11:22 | |
*** rpittau|bbl is now known as rpittau | 11:24 | |
*** iurygregory has joined #openstack-ironic | 11:27 | |
iurygregory | good morning Ironic | 11:28 |
rpittau | unbelievable https://review.opendev.org/c/openstack/sushy/+/767988 is green :) | 11:29 |
iurygregory | rpittau, you almost gave me a heart attack now =D | 11:33 |
rpittau | lol | 11:33 |
rpittau | hey iurygregory :) | 11:33 |
iurygregory | "sushy-tempest-ironic-partition-redfish-src-python2" | 11:33 |
iurygregory | I was like "WHAT?!" | 11:33 |
iurygregory | 5s later... "stable/train" oh ok | 11:34 |
iurygregory | =) | 11:34 |
openstackgerrit | Riccardo Pittau proposed openstack/python-ironic-inspector-client stable/ussuri: Remove lower-constraints job https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/767795 | 11:34 |
rpittau | I doubt bifrost will be as easy to fix :/ | 11:36 |
*** ociuhandu_ has quit IRC | 11:42 | |
*** rcernin_ has joined #openstack-ironic | 11:42 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Refactoring: move vendor caching to where it belongs https://review.opendev.org/c/openstack/ironic/+/771595 | 11:47 |
dtantsur | TheJulia: ^^ (I need it for redfish too) | 11:47 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Prevent redfish-virtual-media from being used with Dell nodes https://review.opendev.org/c/openstack/ironic/+/771619 | 11:53 |
dtantsur | rpioso, ajya, wdyt ^^ | 11:54 |
*** fgofurov has joined #openstack-ironic | 11:55 | |
*** pmannidi has joined #openstack-ironic | 11:56 | |
openstackgerrit | Jacob Anders proposed openstack/ironic-python-agent master: [WIP] Add support for using NVMe specific cleaning https://review.opendev.org/c/openstack/ironic-python-agent/+/770237 | 12:00 |
openstackgerrit | Merged openstack/ironic-inspector stable/ussuri: Fix database migrations and disable the non-standalone job https://review.opendev.org/c/openstack/ironic-inspector/+/759826 | 12:01 |
*** pmannidi has quit IRC | 12:01 | |
*** QianbiaoNG has quit IRC | 12:05 | |
*** QianbiaoNG has joined #openstack-ironic | 12:05 | |
ajya | dtantsur: could be useful, potentially for other interfaces (e.g. RAID) too. Is this related to the bug you mentioned yesterday? | 12:07 |
*** uzumaki has quit IRC | 12:09 | |
dtantsur | ajya: nope. but we do have people constantly confusing the two interfaces, I'd like to give them a clear error | 12:09 |
ajya | dtantsur: yup, I can see that happening | 12:11 |
iurygregory | yeah a lot of people try to use redfish-virtualmedia instead of idrac-.... =( | 12:13 |
*** zzzeek has quit IRC | 12:18 | |
*** akrus has joined #openstack-ironic | 12:21 | |
*** zzzeek has joined #openstack-ironic | 12:21 | |
dtantsur | could someone please request a sushy release? | 12:24 |
iurygregory | dtantsur,for master only? | 12:29 |
dtantsur | yep | 12:30 |
iurygregory | doing now | 12:30 |
iurygregory | dtantsur, done https://review.opendev.org/c/openstack/releases/+/771641 | 12:35 |
dtantsur | thanks! | 12:35 |
iurygregory | np! | 12:35 |
iurygregory | dtantsur, quick question do you prefer a separate try catch for the self.detail? | 12:38 |
*** mkrai_ has quit IRC | 12:38 | |
*** bfournie has left #openstack-ironic | 12:38 | |
dtantsur | iurygregory: likely yes, although I don't care much | 12:40 |
dtantsur | I only care that raising an exception never fails and ends up with at least some message | 12:40 |
dtantsur | (even if we have to do str(body) in the worst case) | 12:40 |
iurygregory | dtantsur, ack =) | 12:41 |
*** ociuhandu has joined #openstack-ironic | 12:42 | |
akrus | Hello everyone! I'm trying to prepare Ironic for bare metal deployment (Dell with idrac driver). While I can manage RAID config, prepare the image, I somehow miss the part where should I specify the partitioning layout? I've got these two errors: [Unable to find a valid partition table on the disk after writing the image] and [Installing GRUB2 boot loader to device /dev/sda failed; mount: /tmp/tmp6mk8k9c5: /dev/sda2 already mounted on | 12:43 |
akrus | /tmp/tmp6mk8k9c5]. Could someone please point me in a right direction? | 12:43 |
*** ociuhandu has quit IRC | 12:44 | |
*** Nisha_Agarwal has joined #openstack-ironic | 12:45 | |
Nisha_Agarwal | dtantsur, hi | 12:45 |
*** ociuhandu has joined #openstack-ironic | 12:45 | |
dtantsur | o/ | 12:46 |
openstackgerrit | Merged openstack/sushy stable/train: Remove lower-constraints job https://review.opendev.org/c/openstack/sushy/+/767988 | 12:46 |
Nisha_Agarwal | dtantsur, i am facing one strange issue...Need some help with that | 12:46 |
dtantsur | akrus: I wonder if you're using the right image type. "unable to find a valid partition table" sounds like you may be using a partition image instead of a whole disk one | 12:47 |
dtantsur | akrus: https://docs.openstack.org/ironic/latest/install/creating-images.html | 12:47 |
Nisha_Agarwal | dtantsur, http://paste.openstack.org/show/801767/ I am unable to understand why lookup fails | 12:47 |
*** bfournie has joined #openstack-ironic | 12:47 | |
Nisha_Agarwal | manually curl on the baremetal endpoint works, but IPA says resource couldnt be found | 12:48 |
dtantsur | Nisha_Agarwal: ironic cannot find a port matching any of these MACs | 12:48 |
Nisha_Agarwal | neutron port u mean? | 12:48 |
dtantsur | ironic port | 12:48 |
Nisha_Agarwal | ohk | 12:48 |
Nisha_Agarwal | let me check that | 12:48 |
*** Nisha_Agarwal has quit IRC | 12:51 | |
*** rh-jelabarre has joined #openstack-ironic | 12:54 | |
*** ociuhandu has quit IRC | 12:54 | |
*** ociuhandu has joined #openstack-ironic | 12:56 | |
akrus | dtantsur, maybe, but still, regarding the actual partitioning e.g. if I need to create separate /boot, /usr, /tmp, etc., what's the proper way to handle this? | 12:57 |
*** rcernin_ has quit IRC | 12:58 | |
dtantsur | akrus: currently you need to build a whole disk image or use the ansible deploy interface which allows any customization | 12:59 |
*** bburns_ has quit IRC | 12:59 | |
akrus | dtantsur, okay, thank you! | 13:00 |
janders | see you tomorrow Ironic o/ | 13:00 |
*** ociuhandu has quit IRC | 13:00 | |
*** rh-jelabarre has quit IRC | 13:01 | |
*** bburns has joined #openstack-ironic | 13:02 | |
*** rh-jelabarre has joined #openstack-ironic | 13:04 | |
*** akrus has quit IRC | 13:06 | |
*** rcernin_ has joined #openstack-ironic | 13:08 | |
*** rh-jelabarre has quit IRC | 13:11 | |
iurygregory | dtantsur, do you think the fallback to index = 0 is a good idea in case we can't retrive the severe index? | 13:14 |
dtantsur | I don't remember the exact error, but it may well be that indexes don't make sense in this case | 13:15 |
iurygregory | if we fail to get the index it doesn't make sense to try to get detail, so I will put in one try/except block | 13:17 |
iurygregory | since we would need the index in normal cases to get the correct message | 13:18 |
dtantsur | yep. just let's make sure we still have *some* error message | 13:18 |
iurygregory | yeah | 13:18 |
*** ociuhandu has joined #openstack-ironic | 13:19 | |
dtantsur | .. and add unit tests to provde that | 13:19 |
*** moshiur has quit IRC | 13:20 | |
*** rh-jelabarre has joined #openstack-ironic | 13:22 | |
*** rh-jelabarre has quit IRC | 13:22 | |
*** rh-jelabarre has joined #openstack-ironic | 13:22 | |
*** ociuhandu has quit IRC | 13:26 | |
iurygregory | I will update with some logs so I can ask people to test and will work in the unit tests | 13:26 |
*** nam-est has joined #openstack-ironic | 13:27 | |
nam-est | Hi all, | 13:27 |
nam-est | Please, any reviews are appreciated since we are needing these PRs to go in urgently. | 13:29 |
nam-est | https://github.com/metal3-io/ironic-image/pull/230 | 13:29 |
nam-est | https://github.com/metal3-io/ironic-inspector-image/pull/70 | 13:29 |
nam-est | T | 13:29 |
nam-est | Thank you. | 13:29 |
nam-est | Also, thanks very much, Dtantsur, for the outstanding reviews you have made. | 13:29 |
dtantsur | nam-est: could you please make sure the CI passes before you ask for reviews? | 13:30 |
nam-est | dtantsur: that is another issue, these PRs and another PR on Baremetal-operator side needs to go in together before they can pass the CI | 13:31 |
dtantsur | nam-est: I don't think we can merge anything without the CI passing on them | 13:31 |
nam-est | I'm also wondering if we have a way to solve this problem | 13:31 |
dtantsur | at the very least, it needs to be globally coordinated (but I think github will simply prevent that) | 13:32 |
dtantsur | (note that nobody in this chat has approval rights on BMO, so it has to be coordinated with the other folks) | 13:33 |
nam-est | should I add an option to toggle the use of wsgi, and make it false bu default, so it can pass the CI? | 13:34 |
dtantsur | if that's the only way - yes. I wonder why it cannot pass the CI the way it is, but I can imagine it's complicated. | 13:34 |
dtantsur | do you know what exactly prevents the CI from passing? | 13:34 |
nam-est | yes | 13:34 |
dtantsur | does apache need more options that ironic-api? what exactly is happening? | 13:34 |
nam-est | because I also make change to the httpd instance which is used for ipa to download images | 13:35 |
nam-est | so with my PR, we have everything in a single httpd instance, and this instance is in the same container with ironic-api | 13:36 |
nam-est | so I need a PR in baremetal-operator to make that work with the CI | 13:36 |
nam-est | however, the PR in baremetal-operator also need the PR in ironic-image side to go in so it can pass the CI | 13:37 |
nam-est | so it is like deadlock | 13:37 |
*** akrus has joined #openstack-ironic | 13:38 | |
*** ociuhandu has joined #openstack-ironic | 13:38 | |
*** QianbiaoNG has quit IRC | 13:39 | |
*** paras33__ has quit IRC | 13:39 | |
dtantsur | okay, I'm completely lost now as to what exactly you're trying to do, and why it is breaking.. | 13:39 |
*** QianbiaoNG has joined #openstack-ironic | 13:39 | |
dtantsur | could you tell me what precisely breaks if you don't update BMO? | 13:40 |
nam-est | it could be more easier if we can have a call and I can share my screen, but if not, I will try to explain here. | 13:42 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/sushy stable/victoria: Catch errors when retriving severe index https://review.opendev.org/c/openstack/sushy/+/769950 | 13:42 |
nam-est | previously, we already have one httpd container that allows IPA to download images to the node | 13:42 |
nam-est | now if I want to have apache serving as WSGI server, I can add another httpd instance | 13:43 |
nam-est | and as we discussed before, we should make use of the existing httpd instance | 13:44 |
nam-est | However, the ironic-api (WSGI application) and the web server (httpd) need to be in the same container | 13:44 |
*** ociuhandu has quit IRC | 13:45 | |
*** QianbiaoNG has quit IRC | 13:45 | |
nam-est | so I add an httpd instance inside the ironic-api container, and remove the old httpd instance. Also, I move the image hosting function to the httpd instance inside the ironic-api | 13:45 |
nam-est | so now this httpd instance serve two purposes, the wsgi server, and the image host where IPA can download images. | 13:47 |
dtantsur | okay, so far so good | 13:47 |
*** ociuhandu has joined #openstack-ironic | 13:47 | |
nam-est | because I delete the old httpd instance, we need to also change the BMO | 13:47 |
dtantsur | you don't need to do that and don't actually do that | 13:48 |
nam-est | otherwise, we have two httpd instances opening the same port that is used for IPA | 13:48 |
openstackgerrit | Verification of a change to openstack/ironic failed: Bump oslo.log requirement to 4.3.0 https://review.opendev.org/c/openstack/ironic/+/763256 | 13:48 |
dtantsur | so, just default to a different port? | 13:48 |
dtantsur | will it solve the compatibility problem? | 13:49 |
nam-est | no, changing the port for IPA will also require to change in BMO and Metal3-dev-env. That means it cannot pass the CI | 13:50 |
dtantsur | change the port for your new httpd serving files | 13:50 |
dtantsur | then the old httpd will be used until BMO changes | 13:50 |
nam-est | Ok, that can be a good option | 13:51 |
*** ociuhandu has quit IRC | 13:51 | |
*** derekh has quit IRC | 13:51 | |
dtantsur | it seems the best option right now, because it will allow the CI to pass AND won't need you to rewrite your patch significantly | 13:52 |
*** QianbiaoNG has joined #openstack-ironic | 13:53 | |
nam-est | yes, true. That is good idea. I will do that and come back when the PRs pass the CI. Thanks for your help, dtantsur. | 13:54 |
*** ociuhandu has joined #openstack-ironic | 13:54 | |
nam-est | but wait | 13:55 |
nam-est | the follow-up PR that fix the port will see the same problem | 13:56 |
openstackgerrit | Riccardo Pittau proposed openstack/python-ironic-inspector-client stable/ussuri: Remove lower-constraints job https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/767795 | 13:56 |
dtantsur | nam-est: ironic-image -> BMO -> ironic-image | 13:56 |
dtantsur | BMO can override the port via the HTTP_PORT variable | 13:56 |
dtantsur | then we can fix the default in ironic-image | 13:57 |
tosin | Hello Ironic. I accidentally pushed to master branch. Is there a way to revert this? | 13:57 |
dtantsur | tosin: to master branch of what? | 13:58 |
nam-est | dtantsur: how should we override the port via HTTP_PORT so the PR in BMO can pass the CI? | 13:58 |
dtantsur | 1) start with HTTP_PORT=${HTTP_PORT:-<random>} in ironic-image | 13:59 |
dtantsur | 2) update BMO to stop launching a separate httpd container and to override HTTP_PORT for ironic-api | 13:59 |
dtantsur | 3) update ironic-image again to use the real default | 13:59 |
tosin | dtantsur: ansible collections | 14:00 |
dtantsur | tosin: I don't think you have rights to push to master, what exactly do you mean? | 14:01 |
*** rloo has joined #openstack-ironic | 14:01 | |
tosin | from my local, I did not checkout to a branch, I was on master and I pushed from there with git review | 14:02 |
*** jdandrea has joined #openstack-ironic | 14:02 | |
dtantsur | tosin: does you review looks okay? if yes, you don't need to worry | 14:02 |
tosin | ok then | 14:03 |
nam-est | dtantsur: ok, now I get it. Thanks you very much | 14:04 |
*** moshiur has joined #openstack-ironic | 14:09 | |
*** rcernin_ has quit IRC | 14:13 | |
*** derekh has joined #openstack-ironic | 14:17 | |
TheJulia | good morning | 14:17 |
iurygregory | good morning TheJulia =) | 14:23 |
*** Nisha_Agarwal has joined #openstack-ironic | 14:24 | |
Nisha_Agarwal | dtantsur, thanks the response resolved the issue immediately. :) | 14:24 |
openstackgerrit | Aija Jauntēva proposed openstack/ironic master: Update iDRAC doc with missing interfaces https://review.opendev.org/c/openstack/ironic/+/771653 | 14:25 |
dtantsur | Nisha_Agarwal: great :) | 14:25 |
dtantsur | morning TheJulia | 14:25 |
ajya | dtantsur, iurygregory JFYI - a tiny update to add missing interfaces, including for virtual media boot, to iDRAC doc. Maybe it contributed to missing that in config, but does not cancel the need for better error message. | 14:26 |
ajya | ^ | 14:26 |
dtantsur | yep, thanks! | 14:27 |
Nisha_Agarwal | dtantsur, centos7 image works in dhcpless environment end-to-end without any issue using glean. We tested on HPE SuperdomeFlex systems. CentOS8 ramdisk still has the same issue | 14:27 |
*** irclogbot_2 has quit IRC | 14:27 | |
iurygregory | ajya, tyvm! =) | 14:28 |
TheJulia | brraaaainnns | 14:29 |
rpittau | good morning TheJulia :) | 14:30 |
*** irclogbot_0 has joined #openstack-ironic | 14:31 | |
dtantsur | Nisha_Agarwal: thank you for testing! could you update the warning in https://docs.openstack.org/ironic/latest/admin/dhcp-less.html with CentOS 7? | 14:37 |
*** rh-jelabarre has quit IRC | 14:38 | |
*** rcernin_ has joined #openstack-ironic | 14:40 | |
*** tzumainn has joined #openstack-ironic | 14:42 | |
*** rcernin_ has quit IRC | 14:45 | |
* TheJulia gives cookies to gerrit | 14:47 | |
* TheJulia starts to grow concerned | 14:48 | |
dtantsur | Zuul: -1 Give Me Too | 14:48 |
TheJulia | Zuul gets cookies once I can upload an updated rbac series | 14:48 |
iurygregory | =O | 14:48 |
TheJulia | hmm | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Write stub ACL test for every existing API call https://review.opendev.org/c/openstack/ironic/+/767445 | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Attempt to slim down protection test base class https://review.opendev.org/c/openstack/ironic/+/770673 | 14:50 |
TheJulia | there it goes! | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Start populating existing policy tests https://review.opendev.org/c/openstack/ironic/+/768136 | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Duplicate testing for system scoped ACL testing https://review.opendev.org/c/openstack/ironic/+/770002 | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Introduce common personas for secure RBAC https://review.opendev.org/c/openstack/ironic/+/763255 | 14:50 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP Implement secure RBAC for baremetal nodes https://review.opendev.org/c/openstack/ironic/+/763257 | 14:51 |
dtantsur | yeah, uploading patches takes a lot of time recently, even for a single patch | 14:51 |
TheJulia | it is a variable of load I think, when I do late afternoon uploads like that it is almost instant | 14:52 |
TheJulia | but by then most people have gone home | 14:52 |
dtantsur | makes sense | 14:52 |
*** rcernin_ has joined #openstack-ironic | 14:58 | |
*** ricolin_ has quit IRC | 15:00 | |
*** lmcgann has joined #openstack-ironic | 15:01 | |
*** rcernin_ has quit IRC | 15:03 | |
*** MentalSiege has joined #openstack-ironic | 15:04 | |
*** rcernin_ has joined #openstack-ironic | 15:07 | |
*** MentalSiege has quit IRC | 15:09 | |
*** rcernin_ has quit IRC | 15:12 | |
*** bburns has quit IRC | 15:14 | |
*** bburns has joined #openstack-ironic | 15:19 | |
arne_wiebalck | TheJulia: Good morning! | 15:21 |
arne_wiebalck | TheJulia: I have cleaning failing as there are 1k partitions to clean :-D | 15:22 |
arne_wiebalck | TheJulia: That does not play well with https://github.com/openstack/ironic-lib/blob/master/ironic_lib/disk_utils.py#L503 | 15:22 |
TheJulia | WUT?!? | 15:22 |
TheJulia | 1k alignment partitions? | 15:22 |
TheJulia | \or devices only wanting 1k blocks? | 15:23 |
arne_wiebalck | TheJulia: Seems so, anaconda creates them | 15:23 |
TheJulia | got an error from the agent logs? | 15:23 |
arne_wiebalck | TheJulia: There are not in the kickstart file so I think anaconda does some padding. | 15:23 |
iurygregory | 1k WOW | 15:23 |
arne_wiebalck | iurygregory: don't fill it all up in one go! | 15:23 |
iurygregory | bad anaconda =P | 15:24 |
* TheJulia surrenders a desktop monitor to the home office viewing of the news this morning | 15:24 | |
arne_wiebalck | TheJulia: Shall we check device size and adapt the 33 to sth smaller? | 15:24 |
arne_wiebalck | TheJulia: 33 is the GPT size. | 15:25 |
TheJulia | yeah | 15:25 |
arne_wiebalck | TheJulia: Like if<33 use that, otherwise use 33. | 15:25 |
TheJulia | possibly, just surprising the kernel is not sythasizing it | 15:25 |
TheJulia | is this through the sata layer in the kernel? special block device driver? | 15:26 |
iurygregory | probably worth make it configurable? (just wondering)... | 15:26 |
TheJulia | needs to be automagic | 15:26 |
TheJulia | and handle 4k blocks too, realistically | 15:26 |
dtantsur | ++ | 15:26 |
dtantsur | configuration options are a last resort | 15:26 |
arne_wiebalck | this one gives an ENOSPC | 15:27 |
TheJulia | just super super super surprising that the kernel is not doing the requisite "read/write" operation to override | 15:27 |
* arne_wiebalck checks the error log ... | 15:27 | |
TheJulia | wow | 15:27 |
iurygregory | automagic <3 | 15:27 |
TheJulia | arne_wiebalck: dmesg output from a ramdisk or a boot look would be super good to have too | 15:27 |
*** QianbiaoNG has quit IRC | 15:28 | |
arne_wiebalck | this is lsblk http://paste.openstack.org/show/801775/ | 15:29 |
arne_wiebalck | the ks file does not mention this partition from what I see | 15:29 |
TheJulia | OH | 15:31 |
TheJulia | yeah, logs | 15:31 |
TheJulia | It *looks* like somehow we're picking that deice | 15:31 |
TheJulia | but we should be picking the actual device, not a partition for that operation | 15:31 |
arne_wiebalck | I think we also clean partitions | 15:32 |
arne_wiebalck | fun fact: this is BIOS/MBR, with UEFI there is no such partition (using the same ks) | 15:33 |
TheJulia | yeah, its creating a spacer partition to force alignment | 15:34 |
TheJulia | wonderful! | 15:34 |
TheJulia | yeah, if you push a patch for that, it should be easy for us to approve | 15:34 |
arne_wiebalck | sure, so we check size and take max(size, 33) ? | 15:36 |
*** Nisha_Agarwal has quit IRC | 15:39 | |
TheJulia | size if size is the number of 512 byte blocks in the device | 15:41 |
TheJulia | your basically just stropping out the header data in that case | 15:41 |
arne_wiebalck | https://storyboard.openstack.org/#!/story/2008539 | 15:45 |
*** MentalSiege has joined #openstack-ironic | 15:47 | |
rpioso | Good morning, ironic.. | 15:48 |
rpioso | dtantsur: I like the idea of making it easier for users. I'm a bit puzzled, though. The idrac and redfish hardware types only support their vmedia boot interfaces, idrac-redfish-... and redfish-..., respectively. How does a user configure a node with the wrong one? Doesn't that fail before the new logic? | 15:52 |
arne_wiebalck | TheJulia: this is maybe not a spacer but the marker for the extended partitions | 15:54 |
TheJulia | oh, yeah | 15:54 |
TheJulia | I guess it does put another partition table in a 1k partition | 15:55 |
openstackgerrit | Verification of a change to openstack/ironic failed: Add a delay/retry is vmedia insert fails https://review.opendev.org/c/openstack/ironic/+/771243 | 16:05 |
arne_wiebalck | TheJulia: other tools report the size of the extended partition(s) | 16:05 |
arne_wiebalck | TheJulia: only lsblk says 1K | 16:06 |
arne_wiebalck | TheJulia: ok, I will try to figure sth out and propose a patch | 16:06 |
*** moshiur has quit IRC | 16:06 | |
*** akrus has quit IRC | 16:07 | |
TheJulia | gah, I was on a roll last week and restarting these tests is like trying to move a mountain from no momentum | 16:10 |
TheJulia | arne_wiebalck: okay | 16:11 |
*** ricolin_ has joined #openstack-ironic | 16:22 | |
*** paras333 has joined #openstack-ironic | 16:23 | |
*** ociuhandu has quit IRC | 16:25 | |
TheJulia | hmm... interesting | 16:28 |
*** tosin has quit IRC | 16:33 | |
arne_wiebalck | TheJulia: $ blockdev --getsz /dev/sda4 | 16:36 |
arne_wiebalck | 2 | 16:36 |
arne_wiebalck | TheJulia: so, we should be good using this | 16:36 |
*** ociuhandu has joined #openstack-ironic | 16:36 | |
arne_wiebalck | TheJulia: I was afraid, blockdev would do the sum just as parted or fdisk | 16:36 |
TheJulia | ++ | 16:36 |
*** Nisha_Agarwal has joined #openstack-ironic | 16:47 | |
*** gyee has joined #openstack-ironic | 16:50 | |
Nisha_Agarwal | dtantsur, i had built the ramdisk using " disk-image-create -o centos_deploy_image ironic-python-agent-ramdisk centos simple-init devuser selinux-permissive" instead of "ironic-python-agent-builder -o /output/ramdisk debian-minimal -e simple-init" | 16:51 |
Nisha_Agarwal | dtantsur, are the images built using both mechanism are same? | 16:54 |
dtantsur | Nisha_Agarwal: pretty much, IPA-builder is a wrapper around DIB | 16:55 |
*** lucasagomes has quit IRC | 16:57 | |
Nisha_Agarwal | dtantsur, ok..thanks | 16:57 |
Nisha_Agarwal | dtantsur, will raise the doc patch for it | 16:58 |
TheJulia | So question of the day: Should an reader/observer e able to get the boot device from a BMC? | 16:58 |
dtantsur | TheJulia: keeping in mind a possibility of DoS since that's the only synchronous call to the BMC | 16:59 |
TheJulia | s/\ e/\ be/ | 16:59 |
TheJulia | That is exactly what I've been thinking | 16:59 |
dtantsur | I'd rather have us introduce Node.boot_device with a regularly cached value | 16:59 |
TheJulia | it is an operational command in my view | 16:59 |
dtantsur | and deprecate the synchronous API | 16:59 |
TheJulia | if a reader needs it, I can agree with that | 16:59 |
dtantsur | btw, if you haven't seen, I'm expanding detect_vendor to redfish | 17:00 |
TheJulia | I have not, carrying on the first patch I created for detect_vendor? | 17:01 |
TheJulia | or should I abandon that one? | 17:01 |
dtantsur | oh, you have a patch? I must admit I haven't checked | 17:01 |
TheJulia | I started one, it was super simple I think | 17:02 |
dtantsur | well, the initial one merged long ago | 17:02 |
TheJulia | yeah | 17:02 |
TheJulia | $time | 17:02 |
dtantsur | ah, https://review.opendev.org/c/openstack/ironic/+/760675 | 17:02 |
dtantsur | no, I started a new one | 17:02 |
TheJulia | ok | 17:03 |
dtantsur | also I'm moving the boilerplate into the conductor with https://review.opendev.org/c/openstack/ironic/+/771595 | 17:03 |
dtantsur | so my redfish patch ends up a bit different | 17:03 |
dtantsur | (and it's a part of https://review.opendev.org/c/openstack/ironic/+/771619 which has bigger goals) | 17:03 |
TheJulia | ++ yeah that works | 17:04 |
TheJulia | I think that was kind of the basic consensus after the initial "Ipmi hates us" moment | 17:04 |
TheJulia | or well, ipmi implementations hate us | 17:04 |
dtantsur | they do | 17:05 |
rpittau | other 2 quick fixes for ussuri CI when anyone has a minute https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/767795 https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/767977 | 17:05 |
rpittau | only bifrost left | 17:05 |
dtantsur | looking | 17:05 |
dtantsur | done | 17:06 |
rpittau | thanks | 17:06 |
dtantsur | for bifrost start with https://review.opendev.org/c/openstack/bifrost/+/766742 | 17:06 |
*** rcernin_ has joined #openstack-ironic | 17:08 | |
rpittau | ok, I'll work on that directly, I think I'll just remove l-c as for the other projects | 17:08 |
*** rcernin_ has quit IRC | 17:12 | |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost stable/ussuri: Fix two CI issues https://review.opendev.org/c/openstack/bifrost/+/766742 | 17:14 |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost stable/ussuri: Fix CI issues https://review.opendev.org/c/openstack/bifrost/+/766742 | 17:14 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Prevent redfish-virtual-media from being used with Dell nodes https://review.opendev.org/c/openstack/ironic/+/771619 | 17:22 |
dtantsur | rpioso: re ^^^ a user may pick the wrong hardware type | 17:22 |
dtantsur | especially since normal redfish supports Dell machines, but not for virtual media | 17:23 |
dtantsur | we had actual people making this mistake a few times already | 17:23 |
*** dtantsur is now known as dtantsur|afk | 17:23 | |
dtantsur|afk | have to go, see you tomorrow | 17:23 |
rpittau | bye everyone, talk tomorrow! | 17:26 |
*** rpittau is now known as rpittau|afk | 17:26 | |
*** dougsz has quit IRC | 17:32 | |
openstackgerrit | Merged openstack/ironic master: Bump oslo.log requirement to 4.3.0 https://review.opendev.org/c/openstack/ironic/+/763256 | 17:34 |
*** ociuhandu_ has joined #openstack-ironic | 17:38 | |
*** ociuhandu has quit IRC | 17:42 | |
*** ociuhandu_ has quit IRC | 17:42 | |
rpioso | dtantsur|afk: I see :) | 17:46 |
openstackgerrit | Merged openstack/ironic-prometheus-exporter stable/ussuri: Remove lower-constraints job https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/767977 | 17:48 |
*** derekh has quit IRC | 18:01 | |
arne_wiebalck | bye everyone o/ | 18:05 |
TheJulia | goodnight | 18:05 |
TheJulia | soooo many policy things | 18:07 |
*** ricolin_ has quit IRC | 18:15 | |
openstackgerrit | Merged openstack/python-ironic-inspector-client stable/ussuri: Remove lower-constraints job https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/767795 | 18:17 |
*** Nisha_Agarwal has quit IRC | 18:22 | |
JayF | FYI, folks running dnsmasq, it just had a big set of vulnerabilities dropped: | 19:05 |
JayF | https://www.tenable.com/blog/dnspooq-seven-vulnerabilities-identified-in-dnsmasq | 19:05 |
*** rcernin_ has joined #openstack-ironic | 19:09 | |
*** anuradha1904 has quit IRC | 19:11 | |
*** rcernin_ has quit IRC | 19:14 | |
TheJulia | goodnight:( | 19:21 |
TheJulia | \err | 19:21 |
TheJulia | :( | 19:21 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Implement secure RBAC for baremetal nodes https://review.opendev.org/c/openstack/ironic/+/763257 | 19:24 |
*** rcernin_ has joined #openstack-ironic | 19:25 | |
*** rcernin_ has quit IRC | 19:30 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Start populating existing policy tests https://review.opendev.org/c/openstack/ironic/+/768136 | 19:55 |
TheJulia | okay, orphaned file removed up next | 19:55 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Duplicate testing for system scoped ACL testing https://review.opendev.org/c/openstack/ironic/+/770002 | 19:55 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Introduce common personas for secure RBAC https://review.opendev.org/c/openstack/ironic/+/763255 | 19:55 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Implement secure RBAC for baremetal nodes https://review.opendev.org/c/openstack/ironic/+/763257 | 19:55 |
*** rcernin_ has joined #openstack-ironic | 20:12 | |
*** rcernin_ has quit IRC | 20:23 | |
*** fgofurov_ has joined #openstack-ironic | 20:39 | |
*** tosky has quit IRC | 20:41 | |
*** paras333 has quit IRC | 20:42 | |
*** tosky has joined #openstack-ironic | 20:42 | |
*** fgofurov has quit IRC | 20:42 | |
*** stevebaker has joined #openstack-ironic | 20:42 | |
*** rcernin_ has joined #openstack-ironic | 20:48 | |
TheJulia | lbragstad: you around? | 21:48 |
lbragstad | in a meeting currently - should be free in about 30? | 21:48 |
TheJulia | sure | 21:48 |
TheJulia | if you have spoons | 21:48 |
*** rcernin_ has quit IRC | 21:49 | |
*** rcernin has joined #openstack-ironic | 21:50 | |
*** jamesden_ has quit IRC | 21:51 | |
*** jamesdenton has joined #openstack-ironic | 21:51 | |
lbragstad | TheJulia ok - what's up? | 22:07 |
TheJulia | if a policy filter says to match a field value of None... say project_id is none and the policy is project_id:%(project_id)s... is that a problem? | 22:08 |
lbragstad | are you referring to a context object where the project_id = None? | 22:10 |
lbragstad | and what happens when you use that in a policy with `role:member and project_id:%(project_id)s`? | 22:10 |
TheJulia | specifically in that the owner and lessee fields can be None in ironic | 22:11 |
TheJulia | yeah, basically. | 22:11 |
lbragstad | oh - ok | 22:11 |
lbragstad | yeah | 22:11 |
lbragstad | so - if target = {'lessee': None, 'owner': None} | 22:11 |
TheJulia | yes | 22:12 |
lbragstad | then project_id:%(project_id)s will turn into $project_id_from_token:$lessee or $project_id_from_token:$owner | 22:13 |
lbragstad | so - if we have a token scope to project_id 'foo' | 22:13 |
lbragstad | and we pass target = {'lessee': None, 'owner': None} into enforcement for `(role:member and project_id:%(project_id)s) or (role:member and project_id:%(project_id)s)` | 22:14 |
TheJulia | and i guess the middleware should be guarding against a forged token with incorrect values going in | 22:14 |
lbragstad | sorry - my last snippet didn't make sense | 22:14 |
lbragstad | what i meant was this | 22:15 |
lbragstad | `(role:member and project_id:%(project_id)s) or (role:member and project_id:%(project_id)s)` | 22:15 |
TheJulia | I think i got it | 22:15 |
lbragstad | `(role:member and project_id:%(lessee)s) or (role:member and project_id:%(owner)s)` | 22:15 |
TheJulia | yup | 22:15 |
lbragstad | yeah - then it would evaluate like foo:None (which fails for lessee checks) and foo:None (which fails for owner checks) | 22:15 |
TheJulia | okay, yeah, and if htere is no project_id with a system scoped token, could that part of the rule still be hit | 22:16 |
TheJulia | (if yes, this may explain some of the oddness I've encountered | 22:16 |
TheJulia | ) | 22:16 |
lbragstad | but - yeah, keystonemiddleware is responsible for validating the token and setting attributes from the token as request headers, which get picked up by oslo.context | 22:16 |
lbragstad | right | 22:16 |
lbragstad | system-scoped tokens will result in context objects with ctx.system_scope = 'all', but ctx.project_id = None | 22:17 |
TheJulia | okay, that is what I was suspecting | 22:17 |
TheJulia | for https://review.opendev.org/c/openstack/ironic/+/763257 I did some minor peeling back of project scope ness since we don't have project level testing enumerated completely yet | 22:19 |
TheJulia | and I think I was hitting this with the testing because I was ending up in a weird state where "wait, this shouldn't really be working" | 22:19 |
lbragstad | mmm | 22:21 |
lbragstad | was it one of the tests in https://review.opendev.org/c/openstack/ironic/+/763257/11/ironic/tests/unit/api/test_rbac_system_scoped.yaml ? | 22:21 |
TheJulia | I think so yes, and if you look at common/policy.py between the revisions you can see where I peeled back system and project scope to just system for now | 22:23 |
lbragstad | ok - so you're ignoring project persons for the time being and formally porting existing administrator functionality to the system users | 22:24 |
TheJulia | basically yes | 22:25 |
lbragstad | before you start writing more complex checks to handle both scopes (project and system) | 22:25 |
TheJulia | exactly | 22:25 |
lbragstad | ok - i see what you're doing | 22:25 |
lbragstad | that makes sense | 22:25 |
lbragstad | and that started failing because None essentially equals None with a system-scoped context and a baremetal node without a lessee or owner | 22:26 |
TheJulia | I'm also trying to be very methodical, for obvious reasons there are lots of moving parts | 22:26 |
TheJulia | one test at a time, going sequentially down the list in each group | 22:28 |
lbragstad | so https://review.opendev.org/c/openstack/ironic/+/763257/9..11/ironic/common/policy.py ? | 22:30 |
TheJulia | SYSTEM_MEMBER + permissible scope including project | 22:31 |
*** lmcgann has quit IRC | 22:31 | |
TheJulia | lbragstad: there is also a distinct possibiliyt I'm loosing what is left of my mind | 22:36 |
TheJulia | fwiw | 22:36 |
lbragstad | so - i'm trying to find an example test case that's failing because of what you're describing | 22:37 |
TheJulia | I might have a better/more concrete example once I finally get into the projects specifically | 22:37 |
TheJulia | hundreds of tests later, my brain is kind of jello at this point | 22:37 |
TheJulia | which reminds me, I need to start dinner soon for it to be ready in time. | 22:37 |
lbragstad | ok - maybe sync tomorrow then? | 22:38 |
TheJulia | yeah, likely for the best then | 22:38 |
lbragstad | ok | 22:38 |
*** fgofurov_ has quit IRC | 23:07 | |
*** lbragstad has quit IRC | 23:13 | |
*** lbragstad_ has joined #openstack-ironic | 23:13 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Implement secure RBAC for ports https://review.opendev.org/c/openstack/ironic/+/763267 | 23:20 |
janders | good morning Ironic o/ | 23:22 |
*** pmannidi has joined #openstack-ironic | 23:22 | |
*** rloo has quit IRC | 23:26 | |
TheJulia | good morning janders | 23:30 |
*** tosky has quit IRC | 23:44 | |
*** hoonetorg has quit IRC | 23:48 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!