Thursday, 2018-11-29

« Wednesday, 2018-11-28 Index Friday, 2018-11-30 »
openstackgerritMatt Riedemann proposed openstack/nova master: Default zero disk flavor to RULE_ADMIN_API in Stein  https://review.openstack.org/60391000:01
*** wolverineav has joined #openstack-nova00:04
SpamapSIIRC, we had some improvement with newer RabbitMQ versions.00:05
*** slaweq has quit IRC00:05
sorrisonSpamapS: yeah some of our cells have found upgraded rabbit helps. We tried to upgrade the rabbit that neutron uses and it fell over so we down graded back00:06
*** mriedem has quit IRC00:13
*** brinzhang has joined #openstack-nova00:17
*** artom has quit IRC00:36
openstackgerritArtom Lifshitz proposed openstack/nova-specs master: Re-propose numa-aware-live-migration spec  https://review.openstack.org/59958700:36
*** tbachman has joined #openstack-nova00:38
*** artom has joined #openstack-nova00:45
*** tetsuro has joined #openstack-nova00:58
*** jistr has quit IRC01:00
*** jistr has joined #openstack-nova01:01
*** markvoelker has joined #openstack-nova01:23
*** markvoelker has quit IRC01:28
*** dklyle has joined #openstack-nova01:32
*** trident has quit IRC01:50
*** gyee has quit IRC01:54
*** trident has joined #openstack-nova01:55
*** Dinesh_Bhor has joined #openstack-nova02:11
*** Dinesh_Bhor has quit IRC02:12
*** Dinesh_Bhor has joined #openstack-nova02:15
*** erlon has quit IRC02:16
*** wolverineav has quit IRC02:21
*** mrsoul has joined #openstack-nova02:21
*** wolverineav has joined #openstack-nova02:24
*** hongbin has joined #openstack-nova02:28
*** wolverineav has quit IRC02:28
*** markvoelker has joined #openstack-nova02:30
*** bhagyashris has joined #openstack-nova02:33
*** cfriesen has quit IRC02:35
*** mhen has quit IRC02:43
*** mhen has joined #openstack-nova02:44
*** rcernin has quit IRC02:58
*** rcernin has joined #openstack-nova03:38
*** dklyle has quit IRC03:58
*** tetsuro has quit IRC04:05
openstackgerritGhanshyam Mann proposed openstack/nova stable/queens: Test websocketproxy with TLS in the nova-next job  https://review.openstack.org/62077604:32
*** hongbin has quit IRC04:34
*** dave-mccowan has quit IRC04:34
*** dave-mccowan has joined #openstack-nova04:35
*** eandersson has joined #openstack-nova04:42
openstackgerritGhanshyam Mann proposed openstack/nova stable/queens: Move the nova-next job in-tree and update it  https://review.openstack.org/62077704:44
openstackgerritGhanshyam Mann proposed openstack/nova stable/queens: Test websocketproxy with TLS in the nova-next job  https://review.openstack.org/62077604:47
*** whoami-rajat has joined #openstack-nova04:47
*** dave-mccowan has quit IRC04:49
*** udesale has joined #openstack-nova05:06
*** janki has joined #openstack-nova05:09
*** sridharg has joined #openstack-nova05:35
*** imacdonn has quit IRC05:38
*** imacdonn has joined #openstack-nova05:39
*** jackivanov has joined #openstack-nova05:49
*** ratailor has joined #openstack-nova05:51
*** tetsuro has joined #openstack-nova05:55
*** ccamacho has quit IRC06:21
*** ondrejme has quit IRC06:40
*** tetsuro has quit IRC06:40
*** Luzi has joined #openstack-nova06:59
*** slaweq has joined #openstack-nova07:03
*** moshele has joined #openstack-nova07:06
*** ccamacho has joined #openstack-nova07:12
openstackgerritBrin Zhang proposed openstack/nova master: Remove useless sample and add the lack of tests in v266  https://review.openstack.org/61467107:24
*** adrianc has joined #openstack-nova07:26
*** mdbooth has joined #openstack-nova07:28
*** mdbooth_ has quit IRC07:31
openstackgerritBrin Zhang proposed openstack/nova master: Remove useless sample tests in v266  https://review.openstack.org/61467107:32
*** dpawlik has joined #openstack-nova07:32
*** rcernin has quit IRC07:35
*** ccamacho has quit IRC07:39
*** tetsuro has joined #openstack-nova07:54
*** jangutter has joined #openstack-nova07:56
*** ralonsoh has joined #openstack-nova07:58
*** sahid has joined #openstack-nova08:02
*** ccamacho has joined #openstack-nova08:06
*** ccamacho has quit IRC08:07
*** ccamacho has joined #openstack-nova08:08
*** tetsuro has quit IRC08:14
*** helenafm has joined #openstack-nova08:15
*** tetsuro has joined #openstack-nova08:16
*** takamatsu has quit IRC08:31
*** dims has quit IRC08:32
*** dims has joined #openstack-nova08:33
*** ttsiouts has joined #openstack-nova08:34
*** ttsiouts has quit IRC08:36
*** ttsiouts has joined #openstack-nova08:37
*** ttsiouts has quit IRC08:41
*** moshele has quit IRC08:45
*** pcaruana has joined #openstack-nova08:48
*** markvoelker has quit IRC08:50
*** adrianc has quit IRC08:57
*** tetsuro has quit IRC09:08
*** ttsiouts has joined #openstack-nova09:09
*** takamatsu has joined #openstack-nova09:13
*** k_mouza has joined #openstack-nova09:13
*** ondrejme has joined #openstack-nova09:19
*** derekh has joined #openstack-nova09:22
openstackgerritMatthew Booth proposed openstack/nova master: Workaround a race initialising version control in db_version()  https://review.openstack.org/61962209:27
*** tssurya has joined #openstack-nova09:27
openstackgerritMatthew Booth proposed openstack/nova master: Workaround a race initialising version control in db_version()  https://review.openstack.org/61962209:33
*** adrianc has joined #openstack-nova09:35
openstackgerritJason SUN proposed openstack/nova master: Add task_states when confirm resize  https://review.openstack.org/62084809:35
*** sapd1 has quit IRC09:36
*** sapd1 has joined #openstack-nova09:36
openstackgerritZhenyu Zheng proposed openstack/nova-specs master: Per aggregate scheduling weight (spec)  https://review.openstack.org/59930809:38
*** cdent has joined #openstack-nova09:39
openstackgerritAlvaro Lopez Garcia proposed openstack/nova master: Ensure that periodic reclaim cleans DB deleted instances  https://review.openstack.org/32325009:40
*** ohorecny2_ has joined #openstack-nova09:44
*** erlon has joined #openstack-nova09:46
*** bhagyashris has quit IRC09:51
ohorecny2_Hi #stephenfin, I would like to ask you about your commit  https://github.com/openstack/nova/commit/6b3b04d2113915729fd9aced9839338e429e1a01 which implemented PCI NUMA policies, I found that this change is not working properly. So I search about fix and I found this bug: https://bugs.launchpad.net/nova/+bug/1795920 . I would like to ask you if anybody is working on it, or if you have some proposals how to fix it.09:51
openstackLaunchpad bug 1795920 in OpenStack Compute (nova) "SR-IOV shared PCI numa not working " [Undecided,Confirmed]09:51
*** markvoelker has joined #openstack-nova09:51
*** k_mouza has quit IRC09:52
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix misuse of assertTrue  https://review.openstack.org/62086109:53
*** k_mouza has joined #openstack-nova09:53
*** jchhatbar has joined #openstack-nova10:02
*** janki has quit IRC10:05
*** ttsiouts has quit IRC10:05
*** ttsiouts has joined #openstack-nova10:05
*** ttsiouts has quit IRC10:08
openstackgerritMerged openstack/nova master: Remove get_node_uuid  https://review.openstack.org/62071510:08
*** ttsiouts has joined #openstack-nova10:08
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Refactor handling of PCIe root ports  https://review.openstack.org/62032710:10
openstackgerritAlex Xu proposed openstack/nova master: Parse the numa topology from the new flavor when resize instance  https://review.openstack.org/62087410:14
*** k_mouza has quit IRC10:15
*** k_mouza has joined #openstack-nova10:18
*** markvoelker has quit IRC10:24
*** udesale has quit IRC10:27
*** bhdn has quit IRC10:32
*** sayalilunkad has quit IRC10:33
*** adrianc has quit IRC10:35
*** jchhatba_ has joined #openstack-nova10:37
*** lpetrut has joined #openstack-nova10:38
*** jchhatbar has quit IRC10:39
*** ohorecny2 has joined #openstack-nova10:40
*** ohorecny2 has quit IRC10:41
mdboothbauzas: I need placement to think my compute has more than 2 vcpus in my functional test. Any idea what the best thing to mock would be?10:42
*** Dinesh_Bhor has quit IRC10:44
mdboothbauzas: When you're back, I think I'll be best mocking LibvirtDriver.get_available_resource()10:57
*** hongda has joined #openstack-nova11:01
*** moshele has joined #openstack-nova11:01
bauzasmdbooth: well, no11:07
bauzasmdbooth: we now have a new method11:07
bauzasmdbooth: but do you need libvirt ? because we have a FakeDriver11:08
bauzasmdbooth: https://github.com/openstack/nova/blob/master/nova/virt/fake.py11:10
bauzaseg. https://github.com/openstack/nova/blob/master/nova/virt/fake.py#L13811:11
*** adrianc has joined #openstack-nova11:12
*** sayalilunkad has joined #openstack-nova11:12
*** markvoelker has joined #openstack-nova11:21
*** k_mouza has quit IRC11:22
*** ttsiouts has quit IRC11:24
*** k_mouza has joined #openstack-nova11:24
*** ttsiouts has joined #openstack-nova11:24
*** takamatsu has quit IRC11:25
*** ohorecny2_ has quit IRC11:28
*** ohorecny2 has joined #openstack-nova11:30
*** jchhatbar has joined #openstack-nova11:30
*** takamatsu has joined #openstack-nova11:31
*** ttsiouts has quit IRC11:32
openstackgerritGhanshyam Mann proposed openstack/nova stable/queens: Make the nova-next job voting and gating  https://review.openstack.org/62088811:32
*** purplerbot has quit IRC11:32
*** purplerbot has joined #openstack-nova11:33
*** jchhatba_ has quit IRC11:33
*** aloga has quit IRC11:33
*** aloga has joined #openstack-nova11:33
*** tbachman has quit IRC11:42
*** artom has quit IRC11:42
*** jchhatbar has quit IRC11:43
*** bhdn has joined #openstack-nova11:54
*** markvoelker has quit IRC11:55
*** brinzhang has quit IRC11:56
*** ttsiouts has joined #openstack-nova11:58
*** moshele has quit IRC12:01
*** moshele has joined #openstack-nova12:03
*** takamatsu has quit IRC12:06
mdboothbauzas: No, I'm specifically testing the LibvirtDriver12:10
mdboothI *think* I've nearly got it12:10
mdboothAlthough....12:10
mdboothAAAAAAAAAAAAAAAAAAARGH! methods which secretly modify shared data!12:11
*** xek_ has joined #openstack-nova12:12
sean-k-mooneymdbooth: dose the method also retrun something?12:12
sean-k-mooneyif it just has sideffect its not terrible but if it both retruns things and has sideffect that is a pain12:13
mdboothbauzas: Sorted now. mocked libvirt methods for fetching disk space, vcpu, and memory, which are used in both places.12:17
*** xek_ has quit IRC12:21
cdentmdbooth: tshirt12:24
*** takashin has quit IRC12:25
mdboothcdent: Hehe12:25
*** ShilpaSD has quit IRC12:26
mdboothcdent: This case wasn't egregious, tbh. LibvirtDriver._get_local_gb_info modified the return from libvirt_utils.get_fs_info() in place, which isn't unreasonable. However, I was mocking get_fs_info(), so it was always returning the same dict. It took me over an hour to work out why my disk space got 1000 times smaller every time it was called.12:28
* cdent rewrites nova in haskell12:28
cdent<- doesn't know haskell12:28
mdboothFTW!12:28
mdbooth<- neither12:28
cdentof course the number of times I've heard people say that the original authors of nova didn't know python is unfortunately high12:29
mdboothHAHA12:29
cdentso, you know, maybe it is a goer12:29
sean-k-mooneyi didnt know python when i started working on openstck not sure i still dont12:30
*** ttsiouts has quit IRC12:30
sean-k-mooneypython is a language that you can pick up as you go along and with the gated trunk/review model we use you learn what you need quickly12:31
cdentyeah, that's the other side of the coin: if you can code, you can usally code anywhere, if you pay attention12:31
*** ttsiouts has joined #openstack-nova12:31
sean-k-mooneyyep once you lear to corralate different concpets in different languages and how to reason about problems that applies across many languages12:31
*** ttsiouts has quit IRC12:32
sean-k-mooneyfunctional programing people however i have found think differnetly then i do12:32
*** ttsiouts has joined #openstack-nova12:32
mdboothsean-k-mooney: It's a mental switch. It's not as hard to make as you'd think.12:33
*** ratailor has quit IRC12:34
sean-k-mooneymdbooth: ya i have tried learning some functional libs in the past and i can use them but its still a style that i reserve for specific uses12:34
cdentthere are degrees as well. you can sort of pick and choose what you think matters most. for example: don't be side-effecty12:34
mdboothThat's a general lesson12:35
cdentfor collaborative code maintenance I think that one is the most important12:35
cdenta lesson people apparently don't learn often enough :)12:35
kashyapcdent: What makes you think all the current contributors (/looks at self) "know" Python? :D12:36
cdentIf you're steeped in a certainly style of OO, it's too normal, even though it doesn't have to be12:36
cdentkashyap: I was trying to be polite, please don't out me :)12:36
kashyapHehe, before I "out" anyone, /me goes to work on his own limitations12:36
sean-k-mooneycdent: speaking of side effects this will reintoduce the placemetn wsgi isssue the run_once decorator was trying to avoid12:36
sean-k-mooneyhttps://review.openstack.org/#/c/620617/3/placement/db_api.py12:36
cdentthat's been abandoned12:37
sean-k-mooneyya i just noticed12:37
cdentin part because of exactly that12:37
sean-k-mooneyso is the issue fixed by the way?12:38
*** Nel1x has joined #openstack-nova12:38
cdentit's either fixed, or so out of the timing as to appear to be fixed. I got 77 successful runs last night12:40
*** panda|pto is now known as panda12:41
sean-k-mooneycool so just diffing the change ye stoped using a global config  fixture12:41
cdentsean-k-mooney: that helped, but the crux of the biscuit was probably moving something from init in the Database fixture to setUp12:42
cdentwhich was probably wrong from the start, but didn't rear its head until mixing with nova12:42
cdentjaypipes++ on the container shinkerage12:42
cdentI think you've nailed it with "lightweight vms in disguise"12:43
sean-k-mooneycdent: ah ok. ya this is proably raising it head due to the use of eventlets in nova12:43
* cdent nods12:43
kashyapcdent: Where was that comment from Jay?12:43
sean-k-mooneyi just recived it in my email12:44
cdentthe removal of global config is still a huge win, sean-k-mooney, so I'm hoping we can keep and merge that soon12:44
sean-k-mooneycdent is a few minuts ahead of us it seams12:44
cdenthttp://lists.openstack.org/pipermail/openstack-discuss/2018-November/000338.html12:44
cdentI subscribed to openstack-discuss very early so probably my messages a few seconds before others :)12:44
kashyapAlso all the mailing lists are being merged, aren't they?12:46
* kashyap saw a thread on openstack-dev about it12:46
cdentyeah, openstack-discuss is the one true mailing list now12:46
cdentuntil early next week the others are still around and include the new one in what they send to12:47
cdentbut next week the old ones will stop accepting submissions12:47
cdentbut the archives will remain12:47
kashyap(Thx)12:48
kashyapcdent: What's the rationale for merging all of them, and making it into a one Jupiter-sized firehose?12:48
* kashyap should read the thread maybe12:49
cdentyeah probably better to read the related discussion. there are many reasons12:49
cdentsome better than others12:49
kashyapThanks12:50
cdentthe overriding reason is to break down some of the artificial boundaries between devs, users, ops, I touch upon that in https://anticdent.org/mailing-list-review.html12:51
*** markvoelker has joined #openstack-nova12:52
kashyapYeah, but it also requires people to massively "up their game" of managing emails.12:52
* kashyap reads the blog from cdent 12:52
cdentYes, that was one of the arguments that people made, but the conclusions appeared to be: you need to do that anyway for any of the lists12:53
cdentwhich seemed a bit weak to me, but meh12:53
kashyapcdent: If only more people realized (not just in our community; but inside company lists, too) this:12:53
kashyap[quote]12:53
kashyap[/quote]12:53
kashyapYour main goal as a member of a mailing list is to keep the archive as useful as possible for other members of the community. Do that, and the dynamic activity on the list itself also manages to be useful.12:54
* kashyap despises it when people spam a human-discussion list with _daily_ Jenkins emails or whatever. It ruins the archives completely12:54
cdentwe've found several time, kashyap, that you and I have very similar attitudes towards community collaboration...12:55
sean-k-mooneykashyap: none does that to the openstack list right12:55
kashyapsean-k-mooney: Yeah, true.  But it is also due to not doing enough due diligence about how to work in an open source community.12:55
kashyapcdent: Probably it's just that I got exposed to old-school mailing list approach, being at RHT for 10 years I guess :-)12:56
* cdent forms an open source due diligence consulting company, invites kashyap as first partner12:56
sean-k-mooneyi kind of whish they had just made the mailing list openstack instead of openstack-discuss. i always coralate discuss mailing list with purly enduser support12:56
kashyapsean-k-mooney: Err, what I meant was -- no one does that on the list, but there's a _crap_ load of "meeting invites" and related junk12:56
kashyapPost the minutes, but not frequent reminders about invites and what-not.12:57
kashyapsean-k-mooney: That is true, on the naming; 'qemu-discuss' is a user-focused list.12:57
sean-k-mooneykashyap: i had an auto delete filter for meting invites12:57
cdentsean-k-mooney: that was discussed too, but that list already exists, and the hope was by creating a new one to remove a lot of dead addresses12:57
kashyapsean-k-mooney: Heh, thanks for the idea12:57
*** tbachman has joined #openstack-nova12:57
sean-k-mooneycdent: ya i assumed that was the reason still i would be intally much less incliend to join it as a dev12:58
cdentwhich gets to one of the other reasons: stop people thinking that way12:59
sean-k-mooneyits not an issue because i know its going to be the only opstack mailing list but otherwise i would ignore it12:59
*** takashin has joined #openstack-nova13:00
sean-k-mooneycdent: i dont think discuss is something we should have been trying to reclaim for all discussions about a project but that ship has sailed so ill hold my piece on that topic13:00
cdentI've always wanted lots of small lists (and irc channels, and projects and everything else) but I lost that battle nearly 4 years ago, so I gave up on that front13:01
*** artom has joined #openstack-nova13:02
kashyapLots of small lists work for people with effective email workflows.  And are disciplined enough to manage them properly.  Which is quite a high bar.13:02
cdentyes.13:03
sean-k-mooneycdent: i dont mind the merger of the list as i will just use email filter to break it up but i would prefer if all email had [*] subjust tags in them13:03
sean-k-mooneye.g. if its ment for all add [all]13:05
jaypipessean-k-mooney: how does one even know that triple-o uses kolla under the hood? :(13:06
*** ShilpaSD has joined #openstack-nova13:07
jaypipessean-k-mooney: I get so lost looking through triple-o's documentation and endless repos and abstractions13:07
jaypipessean-k-mooney: puppet, ansible, kolla, heat, mistral, just goes on and on.13:07
sean-k-mooneyjaypipes: i worked on kolla for a while so i know but ya triplos docs suck13:07
sean-k-mooneythe mariadb contianer is based on the kolla base contaienr which as the name implies creates a common baslien for all kolla contiers by enableing repos like the ubunto cloud archive or rdo13:09
sean-k-mooneyyou can make the mariadb continer smaller by makeing the base container smaller but with the layers in docker container the actual contentce of the mariadb container should be small13:10
sean-k-mooneyjaypipes: personnally i always wanted to move kolla to alpine for the container images. to make the smaller13:15
sean-k-mooneythe centos mariadb rocky image is 189MB vs the ubuntu one which is 13913:17
sean-k-mooney30MB of that comes from the fact the centos bas image is 75 megs vs ubutus xenial's 43 and with bionic droping to 32MB the centos containers are much bigger13:19
jaypipessean-k-mooney: or LOCI?13:19
*** whoami-rajat has quit IRC13:19
jaypipessean-k-mooney: for the openstack service containers at least..13:19
sean-k-mooneyloci did not have much of a size advantage the last time i looked but it has been 2 releases13:20
jaypipessean-k-mooney: for the openstack service projects, there was hundreds of MB difference.13:20
sean-k-mooneyloci does not use layers kolla does so when you pull down all the contaier to disk the kolla ones are much smaller then if you jsut add up the totoal isze of the images listed on docker hub13:21
jaypipesah, good point sean-k-mooney13:22
sean-k-mooneyhaha i just looked up the loci bas image which is based on centos and its alos 73MB becase centos13:23
*** markvoelker has quit IRC13:24
cdentto me, the fundamental issue with the containers being created is that they are not single processes dummies pushing logs to stderr. they are doing all sorts of stuff13:24
sean-k-mooneycdent: most of them are13:25
sean-k-mooneycdent: infact the only kolla one i know of that is not is one i wrote whtat was ment to be tempory13:26
sean-k-mooneykolla even runs ovs in 2 containers 1 for the ovs-db and a second for the ovs-vswithd13:26
cdentlast I checked the service containers run apache2 and then mod_wsgi and then the service13:26
cdentfar better to have an external ingress thing which proxies to a single process in the container13:27
sean-k-mooneyah well yes13:27
sean-k-mooneyyou litrally ment singel procress rather then i start a singel proces which may spawn others13:28
cdenti did, yes13:28
sean-k-mooneywell they said they were open to uwsgi in stead of apachy and they already use haproxy so that would give you the same effect13:28
openstackgerritSurya Seetharaman proposed openstack/nova master: Add DownCellFixture  https://review.openstack.org/61481013:34
openstackgerritSurya Seetharaman proposed openstack/nova master: WIP: API microversion bump for handling-down-cell  https://review.openstack.org/59165713:34
*** janki has joined #openstack-nova13:35
cdentsean-k-mooney: If I had clones, I'd help13:35
sean-k-mooneyloci has come a long way sicne i last looked at it13:36
sean-k-mooneyits funny we had a patch that would transfrom the kolla docker files and build them in a way very similar to how loci is building things but it did not get merged in the end13:37
*** ttsiouts has quit IRC13:37
*** moshele has quit IRC13:38
*** awalende has joined #openstack-nova13:40
*** awalende has quit IRC13:41
*** awalende has joined #openstack-nova13:41
efriedjaypipes: Would you please hit https://review.openstack.org/#/c/615646/ quick so I can rework the whole series at once?13:43
jaypipesefried: yessir, on it.13:44
efriedthank you sir.13:44
jaypipesefried: I'd reviewed it already but not left a vote since I wanted to see how all the upper patches worked.13:45
efriedjaypipes: Cool. It's really much more related to the one below it (linked in the commit message).13:45
*** takamatsu has joined #openstack-nova13:56
gibinova meeting in two minutes on #openstack-meeting13:58
openstackgerritMatthew Booth proposed openstack/nova master: Add BFV, ephemeral, and swap test cases for bug 1550919  https://review.openstack.org/62091713:58
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)13:58
*** zul has quit IRC14:00
*** dpawlik has quit IRC14:01
*** dpawlik has joined #openstack-nova14:03
*** dpawlik has quit IRC14:04
openstackgerritSurya Seetharaman proposed openstack/nova master: WIP: API microversion bump for handling-down-cell  https://review.openstack.org/59165714:15
*** hoonetorg has quit IRC14:20
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate  https://review.openstack.org/57884614:21
*** k_mouza has quit IRC14:21
*** mriedem has joined #openstack-nova14:29
*** k_mouza has joined #openstack-nova14:30
*** ttsiouts has joined #openstack-nova14:30
*** hoonetorg has joined #openstack-nova14:33
*** eharney has joined #openstack-nova14:33
*** dpawlik has joined #openstack-nova14:33
gmannmriedem: https://review.openstack.org/#/q/topic:nova-next-queens+(status:open+OR+status:merged)14:34
mriedemthanks14:35
*** dpawlik has quit IRC14:38
*** KeithMnemonic has joined #openstack-nova14:45
KeithMnemonicmriedem this should be good now https://review.openstack.org/#/c/614872/ since the queens merged it seems14:46
efriedkashyap: we're discussing https://review.openstack.org/#/c/575735/ in the nova meeting. Are you going to be able to take another look?14:46
kashyapefried: Hi14:46
* kashyap clicks14:46
mriedemKeithMnemonic: yup, you don't have to tell me :)14:47
*** ttsiouts has quit IRC14:47
mriedemneed another stable core14:47
mriedembauzas: dansmith: ^14:47
KeithMnemonicsorry we have an inpatient customer ;-)14:47
*** ttsiouts has joined #openstack-nova14:48
* bauzas goes looking14:48
KeithMnemonicdidnt mean to pester14:48
mriedemKeithMnemonic: it's fine14:48
mriedemwe need reminders14:48
*** ttsiouts has quit IRC14:48
*** ttsiouts has joined #openstack-nova14:49
bauzasyup, and good news, I'm almost done with all my internal cruft, so moar time upstream \o/14:50
*** awalende has quit IRC14:52
*** moshele has joined #openstack-nova14:52
*** awalende has joined #openstack-nova14:53
*** awalende has quit IRC14:53
*** awaugama has joined #openstack-nova14:53
*** awalende has joined #openstack-nova14:53
*** cfriesen has joined #openstack-nova14:54
*** phasespace has joined #openstack-nova14:54
*** mlavalle has joined #openstack-nova14:56
artombauzas, mriedem, hey, so I https://review.openstack.org/#/c/599587/, would appreciate another round of reviews :)14:57
artomErr, I accidentally the verb14:58
*** udesale has joined #openstack-nova14:58
*** lpetrut has quit IRC14:58
bauzasartom: I'll, once I'm done with sean-k-mooney's one ;)14:59
phasespaceQuestion. I'm trying to use the AggregateImagePropertiesIsolation scheduler filter. I've set up two availability zones (which themselves are host aggregates and contain all hosts in total), and created another host aggregate intended for windows VMs, with only a subset of the hosts. I've set the os_type metadata for the host aggregate to windows, and likewise with the image metadata. Still I'm able to launch instances on hosts not in the14:59
phasespacewindows host aggregate. Is this because the AZ host aggregates also need the metadata properties?14:59
artombauzas, SRIOV live migration? I should proll'y circle back to that as well :14:59
artom:/14:59
bauzas:)15:00
*** xek has joined #openstack-nova15:00
cfriesenmriedem: thanks for the heads-up on the other hpet bug15:01
mriedemyw15:02
*** takashin has left #openstack-nova15:03
mriedemphasespace: that is likely the problem,15:03
mriedemthe windows aggregate can only host images with the matching images,15:04
*** k_mouza_ has joined #openstack-nova15:04
mriedembut that doesn't *exclude* the other hosts, not in the windows aggregate, from hosting those same images15:04
*** Luzi has quit IRC15:04
mriedemphasespace: there is a nova spec describing this exact issue, sec15:04
*** k_mouza has quit IRC15:04
mriedemphasespace: https://review.openstack.org/#/c/609960/15:04
*** rambo_li__ has joined #openstack-nova15:05
rambo_li__hi,all. I find it is important that live-resize the instance in production environment. We have talked it many years and we agreed this in Rocky PTG, then the author remove the spec to Stein, but there is no information about this spec, is there anyone to push the spec and achieve it?  The link:https://review.openstack.org/#/c/141219/15:05
rambo_li__if anyone can tell me the actual progress?15:06
mriedemrambo_li__: there were actually a series of PoC patches for that blueprint https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/instance-live-resize15:06
sean-k-mooneycfriesen: mriedem by the way i have been asked to enable a feature that is very simlar to hpet in that it jsut a feture booling to set in the config. should i propsoe a spec an basically copy what we agreed for hpet or specless blueprint?15:06
mriedemrambo_li__: the problem is while there is general agreement on supporting live resize, it is a somewhat complicated change and low priority, which therefore means it does not really get attention15:07
mriedemsean-k-mooney: i would start with specless and bring it up in open discussion in the nova meeting15:07
sean-k-mooneymriedem: ok the feture is jsut enable/disbaleing the PMU (performce monitoring unit) to reduce latency for realtime guests15:08
sean-k-mooneyill write it up15:08
rambo_li__ ok,thank you,last one ,:)Currently openstack does not support limiting the total number of block volumes that can be attached to an instance. It can be a useful quota which, on after implementation, will restrict the deterioration of VM performance disallowing a unlimited number of block volumes attachments to a VM. The link:https://blueprints.launchpad.net/nova/+spec/block-volume-limit-per-instance15:10
rambo_li__what do you think of it ?15:11
mriedemsean-k-mooney: why does that need to be a config option rather than an image property?15:11
mriedemrambo_li__: i thought there was already a duplicate spec for this, sec15:11
mriedemrambo_li__: https://blueprints.launchpad.net/nova/+spec/conf-max-attach-volumes15:11
sean-k-mooneymriedem: oh i ment the libvirt xml sorry config was bad phrasing on my part15:12
mriedemrambo_li__: that one also had a spec https://review.openstack.org/#/c/597306/15:13
rambo_li__oh,I'm sorry about it15:13
mriedemand a lot more discussion15:13
sean-k-mooneymriedem: you could use a flaver extra_spec or image metadata to turn it on of off15:13
rambo_li__ok,ok,15:13
mriedemrambo_li__: no problem; if that fits your use case then great.15:13
mriedemit's not quota,15:14
mriedemit's per-driver configuration for the max number of block devices per guest.15:14
rambo_li__yeah,it is necessary in some case15:15
rambo_li__cases15:15
rambo_li__:)15:15
mriedemok i will mark the other blueprint as superseded15:16
rambo_li__mriedem:goodbye15:17
mriedemrambo_li__: good night15:18
mriedemmelwitt: johnthetubaguy: am i missing something or does this spec intentionally not support the block device limit for boot from volume? https://review.openstack.org/#/c/597306/15:18
mriedembecause it doesn't mention boot from volume with >26 bdms, and if we support that for attach volume, i expect people are going to want it for bfv later - so if there is good reason for not supporting it on bfv that should probably be amended to the spec15:19
mriedemphasespace: also see https://bugs.launchpad.net/nova/+bug/167721715:21
openstackLaunchpad bug 1677217 in OpenStack Compute (nova) " AggregateImagePropertiesIsolation filter return unwanted compute nodes" [Undecided,In progress] - Assigned to Md Nadeem (mail2nadeem92)15:21
*** whoami-rajat has joined #openstack-nova15:21
*** rambo_li__ has quit IRC15:22
*** udesale has quit IRC15:29
*** mriedem is now known as mriedem_afk15:29
*** udesale has joined #openstack-nova15:29
*** ttsiouts has quit IRC15:32
*** ttsiouts has joined #openstack-nova15:33
*** panda is now known as panda|pto15:34
*** ttsiouts has quit IRC15:37
openstackgerritMatthew Booth proposed openstack/nova master: Add BFV, ephemeral, and swap test cases for bug 1550919  https://review.openstack.org/62091715:37
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)15:37
openstackgerritMatthew Booth proposed openstack/nova master: Address nits from change I5619728d  https://review.openstack.org/62094115:37
*** itlinux has quit IRC15:38
*** ccamacho has quit IRC15:39
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate  https://review.openstack.org/57884615:39
artomWhat are those "Cannot load <field> in the base class" errors again? I remember getting a few of them when writing tests for new code15:45
*** erlon has quit IRC15:46
artomDo they happen because you forgot to load a field with expected_attrs? Or does that only exist for Instances?15:48
artomdansmith, ^^ awake yet?15:48
dansmithartom: it means you're trying to lazy-load a field for which there is no handler15:48
dansmithlazy-loading isn't magic, the object has to implement it specifically, because it may or may not mean "go back to the database"15:49
artomdansmith, ah, there we go, thanks!15:49
*** ccamacho has joined #openstack-nova15:49
*** tbachman has quit IRC15:50
*** awalende has quit IRC15:51
*** awalende has joined #openstack-nova15:52
*** ttsiouts has joined #openstack-nova15:52
*** munimeha1 has joined #openstack-nova15:53
*** awalende has quit IRC15:56
phasespacemriedem: thanks!15:59
*** dklyle has joined #openstack-nova16:01
*** moshele has quit IRC16:01
*** ohorecny2 has quit IRC16:02
*** awalende has joined #openstack-nova16:02
*** awalende_ has joined #openstack-nova16:04
*** awalende_ has quit IRC16:05
*** awalende has quit IRC16:07
openstackgerritMonty Taylor proposed openstack/nova master: Use ksa adapter for cinder client  https://review.openstack.org/50834516:13
mordredmriedem_afk, efried: ^^ there's an initial stab at updating that patch16:14
*** adrianc has quit IRC16:15
openstackgerritMonty Taylor proposed openstack/nova master: Use ksa adapter for cinder client  https://review.openstack.org/50834516:16
efriedmordred: ack16:17
*** udesale has quit IRC16:20
mriedem_afki do have this easy peasy workaround for sorrison now too https://review.openstack.org/#/c/620738/16:22
*** mriedem_afk is now known as mriedem16:22
*** k_mouza_ has quit IRC16:23
*** janki has quit IRC16:24
*** k_mouza has joined #openstack-nova16:24
*** k_mouza has quit IRC16:25
*** k_mouza has joined #openstack-nova16:26
*** ccamacho has quit IRC16:34
*** adrianc has joined #openstack-nova16:35
mordredmriedem: yes. I like that - I'm going to rebase the other thing on top of it16:36
openstackgerritMonty Taylor proposed openstack/nova master: Use ksa adapter for cinder client  https://review.openstack.org/50834516:38
*** tbachman has joined #openstack-nova16:46
*** hamzy has quit IRC16:46
*** ttsiouts has quit IRC16:51
*** ttsiouts has joined #openstack-nova16:52
*** k_mouza has quit IRC16:54
*** itlinux has joined #openstack-nova16:54
*** ttsiouts has quit IRC16:56
mriedemmdbooth: you're getting lucky in https://review.openstack.org/#/c/620917/ because of defaults in the cinder fixture and api code16:57
openstackgerritJack Ding proposed openstack/nova-specs master: Select cpu model from a list of cpu models  https://review.openstack.org/62095916:58
mdbooth\o/ I'm lucky :)17:03
*** david-lyle has joined #openstack-nova17:04
*** phasespace has quit IRC17:05
*** dklyle has quit IRC17:05
*** helenafm has quit IRC17:06
*** hongda has quit IRC17:06
mdboothmriedem: Thanks, will fix.17:07
*** maciejjozefczyk has quit IRC17:07
*** gyee has joined #openstack-nova17:09
*** k_mouza has joined #openstack-nova17:10
mriedemi also left some comments in https://review.openstack.org/#/c/620941/ - if we were to move that functional test module to a non-regressions location (since it's not a regression), i would think you'd want to do that before proposing backports and such, but just something to think about17:11
*** k_mouza has quit IRC17:14
*** k_mouza has joined #openstack-nova17:17
mdboothmriedem: Ok. Agree it's not a regression, put it there because I had the (incorrect) impression that's where we were putting this kind of 'assert the broken behaviour, fix it and update the test' stuff.17:17
mriedemyeah that's the usual pattern, but doesn't always have to be a regression to do that,17:17
*** k_mouza has quit IRC17:17
mriedemjust nice for the hairier things that need a big functional test17:17
*** maciejjozefczyk has joined #openstack-nova17:20
*** jarodwl has quit IRC17:24
*** jarodwl1 has joined #openstack-nova17:24
openstackgerritMatthew Booth proposed openstack/nova master: Add BFV, ephemeral, and swap test cases for bug 1550919  https://review.openstack.org/62091717:24
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)17:24
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate  https://review.openstack.org/57884617:24
mdboothmriedem: Thanks.17:24
*** dpawlik has joined #openstack-nova17:25
*** dpawlik has quit IRC17:26
*** jarodwl1 is now known as jarodwl17:26
*** dpawlik has joined #openstack-nova17:26
*** mdbooth_ has joined #openstack-nova17:28
*** mdbooth has quit IRC17:31
*** mdbooth_ has quit IRC17:32
*** k_mouza has joined #openstack-nova17:37
*** k_mouza has quit IRC17:45
*** wolverineav has joined #openstack-nova17:59
*** derekh has quit IRC18:06
*** hamzy has joined #openstack-nova18:12
*** dpawlik has quit IRC18:14
*** david-lyle has quit IRC18:15
mriedemjaypipes: dansmith: before yikun spends too much time on writing a PositiveFloatOpt, i'd like to get your input/agreement on it https://review.openstack.org/#/c/602804/12/nova/conf/compute.py@48118:16
mriedemhe started that in oslo.config https://review.openstack.org/#/c/620547/18:16
*** wolverineav has quit IRC18:16
*** wolverineav has joined #openstack-nova18:18
*** jistr has quit IRC18:19
dansmithmriedem: tbh, I'd just do the min=0 thing and just log error and treat the value as 1.0 if it's invalid18:19
*** jistr has joined #openstack-nova18:19
jaypipesmriedem: ok, I'll try to look at that. right now, just fighting to keep myself from throwing myself off a cliff.18:19
dansmithjust seems like a really minor detail to go to all this trouble18:19
dansmithbut if it's really important, I'd say do it in nova as you suggested.18:19
dansmithcommented on both18:22
*** frippe75 has joined #openstack-nova18:26
*** frippe75 has left #openstack-nova18:26
*** sahid has quit IRC18:27
*** hamzy has quit IRC18:31
*** dklyle has joined #openstack-nova18:45
*** k_mouza has joined #openstack-nova18:51
*** hamzy has joined #openstack-nova18:52
*** k_mouza has quit IRC18:56
*** hamzy_ has joined #openstack-nova18:57
mriedemit's not really important, which is also what i said in my comment. if we were going to ignore <1 and make it 1.0 anyway, then the min should be 1.018:57
*** lpetrut has joined #openstack-nova18:58
*** hamzy has quit IRC18:58
efriedjaypipes: Nudge (not off a cliff): Is https://review.openstack.org/#/c/615646/ green?19:01
artomCliff? That's stephen's thing19:04
*** wolverineav has quit IRC19:04
dansmithmriedem: I meant ignore if ==019:04
*** wolverineav has joined #openstack-nova19:05
*** wolverineav has quit IRC19:06
*** wolverineav has joined #openstack-nova19:06
mriedemyeah i replied in there and just said leave as is and we'll change later if it's a problem19:06
*** wolverineav has quit IRC19:07
*** dklyle has quit IRC19:07
*** wolverineav has joined #openstack-nova19:07
*** tangledether has joined #openstack-nova19:09
mriedembauzas: your turn https://review.openstack.org/#/c/599587/919:12
artommriedem, cheers!19:15
artom(I wrote it at the end of yesterday, so yeah, your wording is better)19:15
*** wolverineav has quit IRC19:19
*** wolverineav has joined #openstack-nova19:20
*** xek has quit IRC19:23
*** wolverineav has quit IRC19:24
*** wolverineav has joined #openstack-nova19:24
*** sridharg has quit IRC19:25
*** frippe75_ has joined #openstack-nova19:28
frippe75_Been bashing #openstack and #rdo about this for a week and hoping since its "nova related" someone here might have more info (thanks in advance!)19:29
frippe75_Trying to keep it to the point. Should'nt nova-compute service create a row in nova db compute_nodes table during startup ?19:30
frippe75_Having trouble getting the compute node into the cells_v2 via a "nova-manage cells_v2 discover_hosts" command19:31
frippe75_...via the instance_init()19:32
*** _pewp_ has quit IRC19:33
dansmithfrippe75_: compute asks conductor put put a row in the compute_nodes table on startup yes19:33
*** _hemna has quit IRC19:33
dansmithfrippe75_: once that is there, you can do the "cell_v2 discover_hosts" part to put a mapping in the api database19:33
frippe75_Nova compute service is up listing it via "openstack compute service list --service nova-compute" but not the agent via "openstack compute agent list"19:34
dansmithagent list is legacy and not related19:34
frippe75_dansmith: exaclty. But I cannot get it into comput_nodes19:34
dansmithunless you're running icehouse and xenserver from five years ago? :)19:34
frippe75_haha ok. that was a check suggested by #openstack com..19:34
dansmithfrippe75_: this sounds like a setup/usage sort of issue then, and that's not what this channel is for (see topic)19:35
frippe75_No CentOS 7.5.1804 / Rocky stable release19:35
frippe75_dansmith: Sorry I really know! But I have been banging my head for 30hours+ and then you go off-topic. Ok. understand.19:36
*** markvoelker has joined #openstack-nova19:36
*** dpawlik has joined #openstack-nova19:39
*** markvoelker has quit IRC19:40
mriedemthe services table record exists for the host but not the compute_nodes table record? which release?19:41
mriedemwhich virt driver?19:42
dansmithmriedem: we switched to #openstack19:42
*** adrianc has quit IRC19:48
*** wolverineav has quit IRC19:55
*** wolverineav has joined #openstack-nova19:56
sean-k-mooneybauzas: thanks for the reivew.19:56
*** whoami-rajat has quit IRC19:56
sean-k-mooneyill make some chages and submit again tomorow19:56
*** itlinux has quit IRC19:56
*** markvoelker has joined #openstack-nova20:00
*** wolverineav has quit IRC20:00
*** wolverineav has joined #openstack-nova20:04
*** wolverineav has quit IRC20:10
*** slaweq has quit IRC20:11
*** ralonsoh has quit IRC20:16
*** awalende has joined #openstack-nova20:17
*** awalende_ has joined #openstack-nova20:18
*** awalende has quit IRC20:22
*** awalende has joined #openstack-nova20:30
*** awalend__ has joined #openstack-nova20:30
*** awalende_ has quit IRC20:31
*** slaweq has joined #openstack-nova20:32
*** awalende has quit IRC20:34
*** lucidguy has joined #openstack-nova20:40
*** lucidguy has quit IRC20:41
*** _pewp_ has joined #openstack-nova20:43
*** _hemna has joined #openstack-nova20:43
*** wolverineav has joined #openstack-nova20:51
*** igordc has joined #openstack-nova20:53
*** wolverineav has quit IRC20:53
*** wolverineav has joined #openstack-nova20:53
*** ivve has quit IRC21:01
mriedemPciDevice objects are used to model a tree, right? where you can have a PciDevice.dev_type = 'type-PF' with children PciDevices that are type-VF, yeah?21:09
mriedemand the allocation of each device is in the 'status' field, so allocated/claimed/available etc21:10
*** dklyle has joined #openstack-nova21:10
mriedemjaypipes: right? ^21:11
dansmithmriedem: correct as I understand it21:12
dansmiththere should be a parent_id relating vf to pf21:12
*** dpawlik has quit IRC21:13
mriedemyup ok21:14
*** moshele has joined #openstack-nova21:20
*** tangledether has quit IRC21:25
*** dpawlik has joined #openstack-nova21:28
*** dpawlik has quit IRC21:33
*** wolverineav has quit IRC21:34
*** wolverineav has joined #openstack-nova21:35
*** wolverineav has quit IRC21:38
*** wolverineav has joined #openstack-nova21:38
*** markvoelker has quit IRC21:38
*** markvoelker has joined #openstack-nova21:38
openstackgerritEric Fried proposed openstack/nova master: Use a static resource tracker in compute manager  https://review.openstack.org/62071121:39
*** dklyle has quit IRC21:39
*** cdent has quit IRC21:40
efriedjaypipes: I think this is ready now ^  Lots of test changes. However, I think there's going to be a manual rebase needed when I restack the series.21:40
efriedheh, yup21:41
*** markvoelker has quit IRC21:43
openstackgerritEric Fried proposed openstack/nova master: SIGHUP n-cpu to clear provider tree cache  https://review.openstack.org/61564621:45
openstackgerritEric Fried proposed openstack/nova master: Reduce calls to placement from _ensure  https://review.openstack.org/61567721:45
openstackgerritEric Fried proposed openstack/nova master: Consolidate inventory refresh  https://review.openstack.org/61569521:45
openstackgerritEric Fried proposed openstack/nova master: Commonize _update code path  https://review.openstack.org/61570521:45
openstackgerritEric Fried proposed openstack/nova master: Rip the report client out of SchedulerClient  https://review.openstack.org/61704221:45
openstackgerritEric Fried proposed openstack/nova master: Rip out the SchedulerClient  https://review.openstack.org/61704921:45
openstackgerritEric Fried proposed openstack/nova master: Use a static resource tracker in compute manager  https://review.openstack.org/62071121:45
efriedrebase only ^21:46
*** dpawlik has joined #openstack-nova21:46
*** hamzy_ has quit IRC21:47
*** awaugama has quit IRC21:49
*** rcernin has joined #openstack-nova21:57
*** markvoelker has joined #openstack-nova22:01
*** awalend__ has quit IRC22:05
*** xek has joined #openstack-nova22:11
*** dklyle has joined #openstack-nova22:19
*** moshele has quit IRC22:23
*** dklyle has quit IRC22:24
mriedemtis your white whale matey22:28
*** manjeets has joined #openstack-nova22:28
*** manjeets has quit IRC22:29
*** manjeets has joined #openstack-nova22:29
mriedemtonight, during TNF?!22:29
mriedemthere will be brees slips all over it22:30
mriedemheh wrong channel22:32
*** dklyle has joined #openstack-nova22:32
*** mriedem is now known as mriedem_afk22:33
*** mrhillsman has joined #openstack-nova22:33
*** igordc has quit IRC22:37
*** igordc has joined #openstack-nova22:38
*** tbachman has quit IRC22:39
*** slaweq has quit IRC22:41
*** dklyle has quit IRC22:44
*** xek has quit IRC22:44
*** dpawlik has quit IRC22:47
*** dpawlik has joined #openstack-nova22:48
*** dpawlik has quit IRC22:48
*** slaweq has joined #openstack-nova22:53
openstackgerritEric Fried proposed openstack/nova master: WIP: Reduce calls to placement from _ensure  https://review.openstack.org/61567722:56
openstackgerritEric Fried proposed openstack/nova master: Consolidate inventory refresh  https://review.openstack.org/61569522:56
openstackgerritEric Fried proposed openstack/nova master: Commonize _update code path  https://review.openstack.org/61570522:56
openstackgerritEric Fried proposed openstack/nova master: Rip the report client out of SchedulerClient  https://review.openstack.org/61704222:56
openstackgerritEric Fried proposed openstack/nova master: Rip out the SchedulerClient  https://review.openstack.org/61704922:56
openstackgerritEric Fried proposed openstack/nova master: Use a static resource tracker in compute manager  https://review.openstack.org/62071122:56
*** igordc has quit IRC22:57
*** slaweq has quit IRC22:57
efriedjaypipes: Ran out of time tonight, still need to fix up the tests for the now-WIP above. That will cause failures up the chain, and I'm guessing there will be manual rebases needed there once I do fix the tests. But other than that, everything in the series should be ready.22:57
*** lpetrut has quit IRC23:07
*** artom has quit IRC23:08
*** artom has joined #openstack-nova23:09
*** artom has joined #openstack-nova23:09
*** artom has quit IRC23:10
*** artom has joined #openstack-nova23:10
*** pacharya_ has joined #openstack-nova23:11
pacharya_Hi need some help with nova instance info cache table. Due to some network connectivity issues nova received empty list during the heal instance info cache periodic task and instance cache table got updated with same.23:12
pacharya_now the list and get API for that instance does not have any IPs listed23:13
pacharya_Does anyone know how to fix this?23:13
*** igordc has joined #openstack-nova23:14
*** jamesdenton has quit IRC23:23
*** jamesdenton has joined #openstack-nova23:32
*** tbachman has joined #openstack-nova23:41
jaypipesefried: cool, will get to it again tomorrow morning.23:43
*** pacharya_ has quit IRC23:44
*** erlon has joined #openstack-nova23:45
*** tbachman has quit IRC23:46
*** manjeets has quit IRC23:46
*** manjeets has joined #openstack-nova23:46
*** munimeha1 has quit IRC23:50
*** tbachman has joined #openstack-nova23:53
*** igordc has quit IRC23:59
« Wednesday, 2018-11-28 Index Friday, 2018-11-30 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!