Thursday, 2020-04-02

*** watersj has quit IRC00:49
*** cdearborn has quit IRC01:13
*** k_mouza has joined #openstack-kolla01:31
*** weshay|ruck is now known as weshay01:31
*** k_mouza has quit IRC01:35
*** noxoid has quit IRC01:37
*** zhanglong has joined #openstack-kolla01:40
blineyoctozepto: I meant i couldn't find an entry for the failure but I did finally find a log entry that corresponds to each failure but it doesn't make much sense.03:37
bline==> /var/log/kolla/barbican/barbican-api.log <==03:38
bline-- unavailable modifier requested: 0 --03:38
*** igordc has quit IRC03:42
*** skramaja has joined #openstack-kolla03:50
*** ykarel|away is now known as ykarel04:33
*** evrardjp has quit IRC04:36
*** evrardjp has joined #openstack-kolla04:37
*** cah_link has joined #openstack-kolla04:45
*** cah_link has quit IRC04:52
*** threestrands has joined #openstack-kolla05:06
*** cah_link has joined #openstack-kolla06:19
*** mnasiadka has quit IRC06:21
*** mnasiadka has joined #openstack-kolla06:22
mnasiadkamorning06:22
*** vishalmanchanda has joined #openstack-kolla06:30
*** abdysn has joined #openstack-kolla06:31
yoctozeptobline: whoa, it really has only one line in there? :O06:33
yoctozeptomnasiadka: morning :D06:33
*** jaicaa has quit IRC06:33
mnasiadkamorning yoctozepto :)06:33
*** jaicaa has joined #openstack-kolla06:35
yoctozeptomnasiadka: monasca-grafana again? it started yesterday; I'm pretty sure it got broken again06:36
mnasiadkaoh shit06:36
mnasiadkaI'll bug Doug when he'll be online06:36
yoctozeptomnasiadka: shit indeed06:37
mnasiadkaI'm not keen on even having a quick look into that monster06:37
yoctozeptoit's npm failing, my world really ;p06:37
yoctozeptobline: I just noticed this is the same message as in https://bugs.launchpad.net/kolla-ansible/+bug/1870086 btw, which release is that?06:39
openstackLaunchpad bug 1870086 in kolla-ansible "key-manager-service(Barbican)deployment should use wsgi with Apache" [Undecided,Incomplete]06:39
*** zhanglong has quit IRC06:39
*** zhanglong has joined #openstack-kolla06:40
yoctozeptomnasiadka: https://review.opendev.org/713628 - fellow citizens getting upset ;D06:41
patchbotpatch 713628 - kolla-ansible (stable/rocky) - rabbitmq: update cluster version on reconfigure - 9 patch sets06:41
*** Abdallahyas has joined #openstack-kolla06:41
mnasiadkayoctozepto: well, rocky is EM, they need to patient :)06:42
*** abdysn has quit IRC06:44
*** gary_perkins has quit IRC06:55
*** Tony31 has joined #openstack-kolla06:57
*** gary_perkins has joined #openstack-kolla06:58
*** jbadiapa has joined #openstack-kolla07:01
whoami-rajatHi #openstack-kolla , can i have a review on https://review.opendev.org/#/c/714391/ ? Thanks!07:05
patchbotpatch 714391 - kolla - Add nfs dependencies to glance container - 3 patch sets07:05
osmanlicilegimorning07:06
*** rpittau|afk is now known as rpittau07:17
*** diga has joined #openstack-kolla07:19
*** bengates has joined #openstack-kolla07:21
*** bengates has quit IRC07:27
*** bengates has joined #openstack-kolla07:27
yoctozeptomnasiadka: ^^ -> whoami-rajat07:30
mnasiadkayoctozepto: just commented07:31
openstackgerritAlfredo Moralejo proposed openstack/kolla master: DNM Test new deps based on final CBS builds  https://review.opendev.org/71024007:35
mnasiadkayoctozepto: so openstack client is also broken in rocky... https://zuul.opendev.org/t/openstack/build/b068cd7cd18e4d1a90cff4462e7104dc/log/primary/logs/ansible/deploy#2495007:44
yoctozeptomnasiadka: yeah, I'm updating whiteboard live time07:45
yoctozeptobad luck ;d07:45
openstackgerritRajat Dhasmana proposed openstack/kolla master: Add nfs dependencies to glance container  https://review.opendev.org/71439107:52
whoami-rajatyoctozepto, mnasiadka done. thanks for the reviews.07:54
mnasiadkayoctozepto: how's the OVN change review? :)07:54
*** threestrands has quit IRC08:01
*** ykarel is now known as ykarel|lunch08:08
yoctozeptomnasiadka: just like zun and tls :-)08:11
mnasiadkayoctozepto: there's a zun and tls change? :D08:11
*** e0ne has joined #openstack-kolla08:15
yoctozeptomnasiadka: indeed, indeed08:29
*** iniazi has quit IRC08:32
hrwmorning08:41
*** hjensas has quit IRC08:50
mgoddardmorning08:59
*** pbing19 has joined #openstack-kolla09:00
*** hjensas has joined #openstack-kolla09:01
mgoddardhrw, mnasiadka, osmanlicilegi, yoctozepto: anything I should be aware of that happened this week?09:09
hrwmgoddard: I fooled several people in AArch64 circles with https://afd.biz.pl/ website of Polish startup making interesting AArch64 mainboard. Other than that probably nothing.09:10
hrwcause me moving to Vancouver was posted only on Facebook and only for friends09:11
mnasiadkamgoddard: yesterday I fixed CentOS 8 mirrors on Infra side (if you noticed some missing packages), monasca-grafana image is FUBAR in all branches09:11
mnasiadkahrw: Vancouver?09:11
mgoddardhrw: is this an April fool or real?09:11
hrwfool of course09:12
mgoddard:)09:12
mnasiadkalol09:12
mnasiadka:)09:12
hrwmnasiadka: yes. I got an offer to move there. from Amazon09:12
mnasiadkahrw: nice09:12
mgoddardhrw: oh, so it's not a joke09:13
mgoddardwhen are you moving?09:13
*** abdysn has joined #openstack-kolla09:15
hrwmeh.09:16
*** Abdallahyas has quit IRC09:18
*** pbing19 has quit IRC09:20
yoctozepto"Yet another clone of Raspberry/Pi. Nothing to be really proud of. But was well paid." legit desc09:20
*** pbing19 has joined #openstack-kolla09:32
openstackgerritMerged openstack/kolla-ansible master: Add glance_ca_certificates_file when using self sign cert in glance  https://review.opendev.org/71512609:38
openstackgerritMerged openstack/kolla-ansible master: Add clients ca_file in heat  https://review.opendev.org/71512709:38
openstackgerritMerged openstack/kolla-ansible master: kolla-toolbox container name variable  https://review.opendev.org/71520009:38
openstackgerritMerged openstack/kolla-ansible master: Fix HAProxy prechecks during scale-out with limit  https://review.opendev.org/71495009:38
*** ykarel|lunch is now known as ykarel09:42
hrwhttps://marcin.juszkiewicz.com.pl/2020/04/02/april-fools-day/09:55
hrwyoctozepto: all pages removed09:55
yoctozeptohrw: sorry to see it go, great bait that was!10:00
*** cah_link has quit IRC10:04
*** zhanglong has quit IRC10:08
*** k_mouza has joined #openstack-kolla10:12
*** rpittau is now known as rpittau|bbl10:14
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Add clients ca_file in heat  https://review.opendev.org/71691310:15
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Add glance_ca_certificates_file when using self sign cert in glance  https://review.opendev.org/71691410:15
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Fix HAProxy prechecks during scale-out with limit  https://review.opendev.org/71691510:20
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix HAProxy prechecks during scale-out with limit  https://review.opendev.org/71691710:21
openstackgerritWill Szumski proposed openstack/kayobe master: Switch to stackhpc fork of resmo.ntp  https://review.opendev.org/71589310:26
*** negronjl has quit IRC10:32
*** negronjl has joined #openstack-kolla10:35
yoctozeptomonasca-grafana builds locally so must be issue with infra npm mirror10:48
*** gfidente has joined #openstack-kolla11:09
*** Abdallahyas has joined #openstack-kolla11:21
*** abdysn has quit IRC11:24
*** sorin-mihai__ has joined #openstack-kolla11:28
*** sorin-mihai_ has quit IRC11:30
*** cah_link has joined #openstack-kolla11:34
mnasiadkayoctozepto: another mirror issue, yay11:37
mnasiadkayoctozepto: test it with a change to disable usage of infra npm mirror? :)11:39
*** sorin-mihai_ has joined #openstack-kolla11:45
Wellie CRITICAL freezer-scheduler [-] Unhandled error: ValueError: Unable to determine the name of the local timezone -- you must explicitly specify the name of the local timezone. Please refrain from using timezones like EST to prevent problems with daylight saving time. Instead, use a locale based timezone name (such as Europe/Helsinki).11:46
Welliekolla/ubuntu-source-freezer-scheduler11:46
*** sorin-mihai__ has quit IRC11:47
*** ykarel is now known as ykarel|afk12:03
*** rpittau|bbl is now known as rpittau12:12
*** ykarel|afk is now known as ykarel12:13
mgoddardWellie: related bug: https://bugs.launchpad.net/kolla-ansible/+bug/182159212:29
openstackLaunchpad bug 1821592 in kolla-ansible ussuri "Kolla Watcher Service - Unable to determine the name of the local timezone" [Medium,In progress] - Assigned to Dincer Celik (osmanlicilegi)12:29
yoctozeptomnasiadka, mgoddard: https://review.opendev.org/71696912:29
patchbotpatch 716969 - opendev/system-config - Do not canonicalize URLs to registry.npmjs.org - 1 patch set12:29
mgoddardWellie: proposed fix: https://review.opendev.org/#/c/70425812:30
patchbotpatch 704258 - kolla-ansible - Introduce /etc/timezone to containers - 8 patch sets12:30
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Introduce /etc/timezone to containers  https://review.opendev.org/70425812:32
*** ykarel is now known as ykarel|afk12:33
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Introduce /etc/timezone to containers  https://review.opendev.org/70425812:36
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Avoid unconditional fact gathering  https://review.opendev.org/71634012:39
openstackgerritPierre Riteau proposed openstack/kayobe master: Switch to stackhpc fork of resmo.ntp  https://review.opendev.org/71589312:45
yoctozeptomgoddard, mnasiadka: any of you on the kolla-toolbox breakage?12:55
*** ykarel|afk is now known as ykarel12:55
yoctozeptoguessing not...12:56
mgoddardyoctozepto: I was going to ask the same :)12:58
*** bersace has joined #openstack-kolla12:58
mgoddardyoctozepto: I could take a look.12:59
yoctozeptoyeah, I'm already13:00
yoctozeptobut could do paralellelly13:00
yoctozeptonothing suspicious so far13:00
mgoddarda two pronged attack13:00
yoctozeptohere goes nothing ;D13:02
*** sorin-mihai__ has joined #openstack-kolla13:03
*** sorin-mihai_ has quit IRC13:05
yoctozeptogot it13:06
yoctozeptohttps://pypi.org/project/openstacksdk/#history13:06
yoctozepto0.45.013:06
mgoddardyoctozepto: kolla-toolbox stein doesn't use UC13:06
yoctozeptomgoddard: yeah, that's the problem ;/13:07
*** sorin-mihai__ has quit IRC13:09
mgoddardyoctozepto: missing https://review.opendev.org/#/c/642416/13:10
patchbotpatch 642416 - kolla - Bump up pkg versions in kolla-toolbox (MERGED) - 31 patch sets13:10
mgoddardor part of it at least13:10
yoctozeptomgoddard: yeah, full bump is a no-no13:10
mgoddardcould be an interesting one. I made a comment which was unanswered:13:11
mgoddard > I think we will get some complaints from people behind air gaps if13:11
mgoddard > we do not at least make the URL configurable.13:11
mgoddard >13:11
mgoddard > Ideally in source builds we'd use the requirements repo, but this13:11
mgoddard > image is a bit of a fudge at the moment anyway.13:11
mgoddard:)13:11
mgoddardwould be mean to introduce that on a stable branch13:11
yoctozeptoyeah, it's a fudge13:11
mgoddardI'll have a crack at it13:12
yoctozeptoyeah, try this route13:12
yoctozeptoI'm trying why openstacksdk got intsalled on py213:12
yoctozeptoprobably missing metadata...13:12
yoctozeptotwo-pronged attack it is13:13
yoctozepto:D13:13
mgoddardyeah, I think something related went into ironic recently13:13
mgoddardlots of packages seem to be missing this piece of metadata though13:13
mgoddardyoctozepto: https://review.opendev.org/#/c/715454/2/setup.cfg13:15
patchbotpatch 715454 - ironic - Cleanup Python 2.7 support - 2 patch sets13:15
yoctozeptomgoddard: yeah, it did not go into openstacksdk which miserably affected us as well13:15
mgoddardyoctozepto: I guess the damage is done now - there is an incompatible release13:16
yoctozeptomgoddard: yeah, hard to unwind13:18
mgoddardyoctozepto: maybe simpler solution than UC is to pin to <0.45?13:18
kplantany known issues with docker-ce 19.03.8 for k-a?13:18
mgoddardand safer13:19
yoctozeptomgoddard: just 0.27.013:19
yoctozeptolike in uc13:19
yoctozeptomost safe13:19
mgoddardyeah13:19
mgoddardalthough if other clients are unpinned could we hit incompatibilities with such different versions?13:20
Wellieis openvswitch synchronized with each other?13:20
yoctozeptomgoddard: I see most stuff is pinned13:20
*** jimcrowleyibm has joined #openstack-kolla13:21
yoctozeptoah no, you might be right13:21
yoctozeptoif they release py3-only improperly then we are also doomed13:21
*** jimcrowleyibm is now known as jimcrowleyibm[aw13:21
yoctozeptowe can take all necessary pins from those u-c13:22
yoctozeptopython-novaclient13:22
yoctozeptopython-cinderclient13:22
yoctozeptopython-keystoneclient13:22
*** jimcrowleyibm has joined #openstack-kolla13:22
yoctozeptopython-glanceclient13:22
yoctozeptoso 4 pins more13:22
yoctozeptoI'll create a bug report13:22
yoctozeptoso that you can fix it13:23
*** noxoid has joined #openstack-kolla13:24
yoctozeptomgoddard: https://bugs.launchpad.net/kolla/+bug/1870349 go for it13:26
openstackLaunchpad bug 1870349 in kolla stein "unpinned deps in kolla-toolbox break due to py2 incompatibilities" [Critical,Triaged]13:26
*** markmcclain has joined #openstack-kolla13:26
openstackgerritPierre Riteau proposed openstack/kayobe master: Install python-openstackclient using upper constraints  https://review.opendev.org/71588013:27
hrwyoctozepto: https://review.opendev.org/716609 helps with it13:27
patchbotpatch 716609 - kolla - use proper Python version in virtualenv - 1 patch set13:27
hrwa bit13:28
*** ykarel is now known as ykarel|afk13:29
mgoddardhrw: does it fix the issue?13:30
hrwmgoddard: have to check. had other issues to solve13:30
openstackgerritPierre Riteau proposed openstack/kayobe master: Install python-openstackclient using upper constraints  https://review.opendev.org/71588013:31
mgoddardhrw: I'd guess not - the problem is with the package we are installing, it does not say that it is py3 only13:31
hrwok13:31
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Pin openstacksdk and client libraries in kolla-toolbox  https://review.opendev.org/71700813:42
mgoddardyoctozepto: ^13:42
hrwmgoddard: does train needs it too?13:43
mgoddardhrw: in Train we use upper-constraints13:43
kplantso... i've evacuated a compute node, turn off all the containers. ran a yum upgrade and rebooted13:47
kplantnow it looks like instances that i move back to this hypervisor can't pass L2 traffic on existing tenant networks13:48
kplantany idea what i broke?13:48
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Separate per-service host configuration tasks  https://review.opendev.org/70312713:52
*** weshay is now known as weshay|ruck13:55
*** vishalmanchanda has quit IRC13:58
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Introduce /etc/timezone to containers  https://review.opendev.org/70425814:04
*** TrevorV has joined #openstack-kolla14:07
*** ktibi has quit IRC14:09
yoctozeptokplant: networking! what is the prize?14:10
*** ktibi has joined #openstack-kolla14:10
openstackgerritMark Goddard proposed openstack/kayobe master: CentOS 8: seed VM & bifrost  https://review.opendev.org/71213314:10
kplantyoctozepto: me punching myself in the face over and over again14:13
* yoctozepto completely satisfied14:16
yoctozeptokplant: did you check what ovs agent logs say?14:19
kplantlmao14:19
yoctozeptoand whether they say anything at all, maybe it did not come up14:19
kplanteverything looks clean :-|14:20
openstackgerritMark Goddard proposed openstack/kolla stable/rocky: Pin openstacksdk and client libraries in kolla-toolbox  https://review.opendev.org/71702414:20
yoctozeptothen it's fine and you are exaggerating!14:20
kplantthat's why i was asking about docker-ce 19 earlier14:20
kplantmaybe i went too far into the future14:20
kplanti was living in the year 302014:20
yoctozeptonah, it seems worky in our CI14:20
kplanti think my cluster has coronavirus14:21
kplantthat's the only explanation14:21
yoctozeptofirst case14:21
kplanthuman to machine transmission14:21
*** pbing19 has quit IRC14:23
*** pbing19 has joined #openstack-kolla14:26
*** ykarel|afk is now known as ykarel14:28
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Install python-openstackclient using upper constraints  https://review.opendev.org/71703114:28
kplanti'll keep digging14:28
kplantgood to know you guys are having no issues with 19.x though14:28
*** abdysn has joined #openstack-kolla14:34
*** Abdallahyas has quit IRC14:34
yoctozeptoyeah, it's probably related to the upgrade/restart itself14:37
mgoddardkplant: one thing that does bite from time to time is that docker introduced a default DROP policy on the FORWARD chain in the filter table of iptables14:37
kplantooooooooooof14:37
yoctozeptobut we mitigate that14:38
mgoddardcan't remember when they introduced it, but it's a PITA. So far I think it mostly affects development environments14:38
mgoddardyoctozepto: what do you mean?14:38
yoctozeptomgoddard: well, don't we? how come it works? :D14:38
mgoddardyoctozepto: neutron iptables rules?14:39
yoctozeptomgoddard: no idea, I even slapped a comment about it in code14:39
yoctozeptopre.yml14:39
yoctozepto    # FIXME(yoctozepto): really handle this for users - somehow my local multinode14:39
yoctozepto    # deploy fixed it for itself by setting it to ACCEPT on network nodes without14:39
yoctozepto    # my intervention but so far we have no idea what did that. It certainly does14:39
yoctozepto    # not happen in CI where all nodes are aio.14:39
yoctozeptoI seriously did not introduce any own workaround ;p14:40
yoctozeptothough it was needed for CI itself14:40
yoctozeptodubious topic14:40
*** gfidente has quit IRC14:45
openstackgerritPierre Riteau proposed openstack/kayobe master: Install python-openstackclient using upper constraints  https://review.opendev.org/71588014:56
*** gfidente has joined #openstack-kolla14:58
openstackgerritPierre Riteau proposed openstack/kayobe master: Install python-openstackclient using upper constraints  https://review.opendev.org/71588014:59
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Install python-openstackclient using upper constraints  https://review.opendev.org/71703114:59
openstackgerritMerged openstack/kolla-ansible master: Support setting Kafka storage volume  https://review.opendev.org/71530715:11
cosmicsoundreq-5c19c629-78c8-40ac-8ac6-568eec9fb3baattach_volume2 Apr 2020, 9:36 a.m.7096c304e64b4d5a87fa4d7cb8808042Error15:13
cosmicsoundAnyone knows how to debug such issues15:14
cosmicsoundthis is a master k8s machine and the logs throw me this15:14
*** dmellado has quit IRC15:14
cosmicsoundyet the machine have local storage: Disk /dev/mapper/atomicos-root: 29 GiB, 31134318592 bytes, 60809216 sectors15:14
cosmicsoundNot sure whats the attachement related to. I run ceph15:15
*** sorin-mihai has joined #openstack-kolla15:20
*** jimcrowleyibm has quit IRC15:20
*** abdysn has quit IRC15:24
yoctozeptocosmicsound: what cinder-volume says?15:25
*** dmellado has joined #openstack-kolla15:30
cosmicsoundnothing...15:32
cosmicsoundNot about these requests15:32
yoctozeptomgoddard, mnasiadka; INFO:kolla.common.utils.kolla-toolbox:Cannot find a valid baseurl for repo: centos-nfs-ganesha2815:34
yoctozeptoso it hit c7 as well. We need megafix again...15:34
cosmicsoundyoctozepto , here is what it says when I create a new k8s with magnum15:36
cosmicsoundhttp://paste.openstack.org/show/791544/15:36
yoctozeptomnasiadka: you were right about fubar, argh15:37
yoctozeptocosmicsound: "completed successfully" sounds positive to me15:37
cosmicsoundyoctozepto , check this: http://paste.openstack.org/show/791545/15:39
*** hjensas is now known as hjensas|afk15:39
cosmicsoundhttps://mdb.uhlhost.net/uploads/6c866f75c9e0750e/image.png15:39
yoctozeptocosmicsound: and volumes otherwise work?15:42
yoctozeptocosmicsound: outside of magnum things15:42
cosmicsoundyes15:46
cosmicsoundeven the machine with magnum has inside the volume15:47
cosmicsoundjust that the error...15:47
*** ykarel is now known as ykarel|away15:47
yoctozeptocosmicsound: what backend is it?15:48
cosmicsoundceph15:49
cosmicsoundyoctozepto ,15:49
cosmicsoundcant this libvirt values be the issue?15:49
cosmicsoundhttps://mdb.uhlhost.net/uploads/ec1587d9f3e39358/image.png15:49
openstackgerritMerged openstack/kayobe master: Fix loading of Monasca Grafana dashboards  https://review.opendev.org/71563815:50
cosmicsoundthey kinda relate to nova errors about scsi15:50
yoctozeptocosmicsound: no, these are right for ceph in general15:53
cosmicsoundok15:53
yoctozeptoyou might also want to turn on quiesce for flexible snapshots15:53
yoctozeptobut that's orthogonal15:53
yoctozeptosee https://docs.ceph.com/docs/master/rbd/rbd-openstack/#image-properties15:53
yoctozeptoanyways, it's weird15:53
yoctozeptoyou are telling me that doing nova instance and mounting an extra volume there works15:54
yoctozeptobut if magnum does it, then there is this ugly error15:54
cosmicsoundyes15:54
cosmicsoundtrue that15:54
cosmicsoundCan devicemapper or overlay play a role on this?15:55
yoctozeptocosmicsound: I wanted to tell you to ask on #openstack-containers but you already did15:55
yoctozeptocosmicsound: what about magnum logs?15:55
*** rpittau is now known as rpittau|afk15:56
yoctozeptomaybe magnum tries to mount it before giving to nova?15:56
yoctozeptowe can continue this on #...containers, folks probably know how it works15:56
cosmicsoundok15:56
cosmicsoundseems these reqs are only from nova15:57
*** bengates has quit IRC15:57
cosmicsoundNowhere i found the in whole /var/log15:57
mgoddardyoctozepto: do you know what the centos-nfs-ganesha issue is?16:01
hrwhttps://review.opendev.org/#/c/716609 - who adds +w?16:10
patchbotpatch 716609 - kolla - use proper Python version in virtualenv - 1 patch set16:10
openstackgerritDincer Celik proposed openstack/kolla-ansible master: Introduce /etc/timezone to containers  https://review.opendev.org/70425816:10
hrwand then we can backport it16:10
mgoddardhrw: CI is broken16:10
hrwmeh16:12
hrwlet me run some runs16:15
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Use unittest.mock instead of PyPI mock  https://review.opendev.org/71707316:16
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/stein: Pin openstacksdk and client libraries in kolla-toolbox  https://review.opendev.org/71700816:18
*** skramaja has quit IRC16:20
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Use unittest.mock instead of PyPI mock  https://review.opendev.org/71707316:21
hrwhm...16:22
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Fix multiple CI issues  https://review.opendev.org/71700816:22
hrwwhy we pin keystoneclient 3.18.0 when requirements pin 3.19.1 which is py2/3 on pypi?16:22
openstackgerritRadosław Piliszek proposed openstack/kolla master: Use unittest.mock instead of PyPI mock  https://review.opendev.org/71707516:23
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/rocky: Pin openstacksdk and client libraries in kolla-toolbox  https://review.opendev.org/71702416:23
hrwanyway fixed both patches16:23
openstackgerritPierre Riteau proposed openstack/kayobe master: Update documentation for release tasks  https://review.opendev.org/70915416:23
yoctozeptohrw: dunno, I checked Mark pinned to what u-c pin in stable branches16:23
openstackgerritMark Goddard proposed openstack/kolla stable/rocky: Fix multiple CI issues  https://review.opendev.org/71702416:24
hrwI know why we did that way16:24
hrwkolla-toolbox does not use constraints16:24
mgoddardright16:24
mgoddardI added an upper limit of the first version from the next release16:25
mgoddardmeans we do not have to keep bumping for new releases16:25
yoctozeptothe mirror fix is gating now16:26
mgoddardcool16:26
yoctozeptohopefully gets systems reconfigured before monasca-grafana does last try16:26
cosmicsoundImportant Using QCOW2 for hosting a virtual machine disk is NOT recommended. If you want to boot virtual machines in Ceph (ephemeral backend or boot from volume), please use the raw image format within Glance.16:27
cosmicsoundMaybe this helps...16:27
*** ktibi has quit IRC16:28
hrwmgoddard: looks like I have better fix ;D16:33
mgoddardhrw: which one?16:34
openstackgerritScott Solkhon proposed openstack/kolla-ansible master: Support Neutron policy file in both .json and .yaml format  https://review.opendev.org/70268216:34
hrwjust have to port it to master, check and send for review16:34
hrwmgoddard: use constraints16:34
mgoddardhrw: agreed with yoctozepto earlier not to do that16:34
mgoddardwe already use constraints in master & train16:34
hrwso why not in earlier?16:35
mgoddardbut don't want to introduce it to a stable branch because it requires access to the internet to get the constraints file16:35
mgoddardso if you can't access the internet it will break your build16:35
hrwyou need net access to build images16:36
mgoddardnope16:36
mgoddardshouldn't assume that, some don't16:36
hrwthen how do you build openstack-base?16:36
*** evrardjp has quit IRC16:36
*** evrardjp has joined #openstack-kolla16:36
hrwI see...16:37
mgoddardlocal mirrors16:38
hrwmy k-t fix do the same16:38
hrwlet me just test does it build first16:39
hrwhttps://paste.centos.org/view/fa425d08 makes kolla-toolbox use requirements tarball (like openstack-base does) and use constraints for all pip16:42
hrwno more curl from somewhere16:42
yoctozeptohrw: the problem is 'binary' ;p16:45
hrwabomination16:49
openstackgerritMerged openstack/kolla-ansible master: Avoid unconditional fact gathering  https://review.opendev.org/71634016:50
hrwINFO:kolla.common.utils.kolla-toolbox:Step 1/17 : FROM ma/debian-binary-base:9.1.016:59
hrwINFO:kolla.common.utils.kolla-toolbox:Step 7/17 : ADD kolla-toolbox-archive /kolla-toolbox-source16:59
hrwd16:59
hrw:D16:59
hrwINFO:kolla.common.utils.kolla-toolbox:Successfully tagged ma/debian-binary-kolla-toolbox:9.1.016:59
yoctozeptoimpossible :O16:59
hrwbut not a fan of it16:59
yoctozeptothen we have another bug :D16:59
yoctozeptoah, you hacked it16:59
hrwhttps://paste.centos.org/view/0dd89127 adds special treatment for k-t16:59
cosmicsoundI am thinking on dumping ubuntu17:03
cosmicsoundin favor of centos17:03
cosmicsoundor debian17:03
hrwwise choice17:03
cosmicsoundis centos 8 supported in k-a yet?17:03
cosmicsoundubuntu seems to be chasing their non profit business model ... blurps me17:04
* hrw prefers not to comment what ubuntu is chasing17:04
hrwpep8--17:04
hrwpython--17:05
hrwsplitting 'if this or that' into two lines is nightmare17:05
yoctozeptouse parens17:05
hrwor \17:05
hrw            if self.install_type == 'source' or \17:06
hrw               image.name in SOURCES_EVEN_FOR_BINARY:17:06
yoctozeptofolks tell me it's bad to use \17:06
yoctozepto:D17:06
hrwflake8 says OK17:06
yoctozeptofor readability17:06
yoctozeptoyeah, I don't mind either17:06
yoctozeptounless new hacking does17:06
hrw80 columns of pep8 is bad for readability17:06
hrw120 should be new 8017:07
yoctozeptotrue that17:07
hrw19:07 (0s) hrw@puchatek:~$ echo $COLUMNS $LINES17:07
hrw154 5717:07
* cosmicsound hrw good point, idea is simple them made me to find alteratives17:08
hrwhttps://paste.centos.org/view/20e18697 is nicer version17:09
hrwopen for other exceptions17:09
hrwshould just work in each supported branch17:10
hrwwith fuzz tweaks and archive name tweak of course17:10
openstackgerritMerged openstack/kayobe master: Switch to stackhpc fork of resmo.ntp  https://review.opendev.org/71589317:11
hrwyoctozepto: opinion?17:12
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: kolla-toolbox: use requirements for pip constraints  https://review.opendev.org/71708017:15
hrwwhatever ;d17:16
hrwI consider it 'do it once and forget about the problem forever' solution17:16
yoctozeptohrw: :D17:26
yoctozeptohrw: it makes sense to fix airgapped this way17:27
*** KeithMnemonic has joined #openstack-kolla17:28
openstackgerritWill Szumski proposed openstack/kayobe stable/train: Switch to stackhpc fork of resmo.ntp  https://review.opendev.org/71708117:28
openstackgerritWill Szumski proposed openstack/kayobe stable/stein: Switch to stackhpc fork of resmo.ntp  https://review.opendev.org/71708217:29
cosmicsoundOSA had built in ceph support?17:33
cosmicsoundOr will follow same road lika k-a17:33
*** gfidente is now known as gfidente|afk17:39
yoctozeptocosmicsound: I doubt, I believe we were unique in that regard; but trust me - leave ceph to ceph ;-)17:40
*** ironfoot has quit IRC17:43
mnasiadkacosmicsound: OSA uses ceph-ansible, just has a minimal level of integration (imports ceph-ansible roles when deploying ceph)17:43
*** ironfoot has joined #openstack-kolla17:43
*** k_mouza has quit IRC17:46
*** jimcrowleyibm has joined #openstack-kolla17:52
*** iniazi has joined #openstack-kolla18:03
*** k_mouza has joined #openstack-kolla18:13
cosmicsoundthanks mnasiadka , yoctozepto18:13
*** k_mouza has quit IRC18:14
openstackgerritDincer Celik proposed openstack/kolla-ansible master: Introduce /etc/timezone to containers  https://review.opendev.org/70425818:19
*** Tony31 has quit IRC18:28
blineyoctozepto: ubuntu train18:37
cosmicsoundFailed to delete image with name or ID '3482ed4d-571c-4a64-a8ab-07b0c45aae21': HTTP 500 Internal Server Error: The server has either erred or is incapable of performing the requested operation.18:49
cosmicsoundwhat18:49
*** diga has quit IRC18:51
yoctozeptobline: thanks, noted19:12
cosmicsoundunable to delete an image19:16
cosmicsoundthis is first ttime :D19:16
mgoddardyoctozepto: looks like monasca-grafana is still busted :(19:24
mgoddardhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_40d/717024/3/check/kolla-build-ubuntu-source/40d6e06/logs/build/000_FAILED_monasca-grafana.log19:24
*** Chaserjim has joined #openstack-kolla19:34
yoctozeptomgoddard: system reconfigured only recently19:49
yoctozeptomgoddard: zuul had some real delays19:49
yoctozeptomgoddard: otoh, ganesha is still busted in that stein change anyway19:49
yoctozeptoanother day, another trial19:49
yoctozeptogood night19:50
blinethanks yoctozepto, I can add more details to that ticket if it would help.19:50
openstackgerritMerged openstack/kayobe master: Install python-openstackclient using upper constraints  https://review.opendev.org/71588020:07
*** jimcrowleyibm has quit IRC20:29
*** TrevorV has quit IRC20:37
*** jbadiapa has quit IRC20:42
*** mrunge_ has joined #openstack-kolla20:48
*** mrunge has quit IRC20:49
*** xingchao has joined #openstack-kolla20:54
*** weshay|ruck is now known as weshay20:57
*** igordc has joined #openstack-kolla21:05
*** e0ne has quit IRC21:06
*** k_mouza has joined #openstack-kolla22:15
*** k_mouza has quit IRC22:19
*** cah_link1 has joined #openstack-kolla22:21
*** cah_link has quit IRC22:24
*** cah_link1 is now known as cah_link22:24
*** ktibi has joined #openstack-kolla22:24
*** hrw has quit IRC22:37
*** ktibi has quit IRC22:40
*** openstackstatus has quit IRC22:56
*** openstack has joined #openstack-kolla22:59
*** ChanServ sets mode: +o openstack22:59
*** hrw has joined #openstack-kolla23:29
*** Tony31 has joined #openstack-kolla23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!