| *** openstackstatus has joined #openstack-kolla | 00:44 | |
| *** ChanServ sets mode: +v openstackstatus | 00:44 | |
| *** lile has quit IRC | 00:55 | |
| *** hongbin has joined #openstack-kolla | 01:12 | |
| *** diurnalist has joined #openstack-kolla | 01:33 | |
| *** diurnalist has quit IRC | 01:38 | |
| *** Tony31 has joined #openstack-kolla | 01:41 | |
| *** vishalmanchanda has joined #openstack-kolla | 01:51 | |
| *** zhanglong has joined #openstack-kolla | 02:23 | |
| *** xinliang has joined #openstack-kolla | 02:47 | |
| *** xinliang has quit IRC | 02:57 | |
| *** hongbin has quit IRC | 03:03 | |
| *** KeithMnemonic1 has joined #openstack-kolla | 03:28 | |
| *** KeithMnemonic has quit IRC | 03:31 | |
| *** ricolin_ has joined #openstack-kolla | 03:31 | |
| *** ricolin_ has quit IRC | 03:33 | |
| *** ricolin_ has joined #openstack-kolla | 03:34 | |
| *** ykarel|away is now known as ykarel | 03:48 | |
| *** dave-mccowan has quit IRC | 03:58 | |
| *** KeithMnemonic1 has quit IRC | 04:06 | |
| *** zhanglong has quit IRC | 04:10 | |
| *** factor has joined #openstack-kolla | 04:34 | |
| *** skramaja has joined #openstack-kolla | 04:54 | |
| *** zhanglong has joined #openstack-kolla | 05:31 | |
| *** evrardjp has quit IRC | 05:35 | |
| *** evrardjp has joined #openstack-kolla | 05:36 | |
| *** diurnalist has joined #openstack-kolla | 05:47 | |
| *** strigazi has quit IRC | 05:49 | |
| *** sri_ has joined #openstack-kolla | 05:51 | |
| *** strigazi has joined #openstack-kolla | 05:51 | |
| sri_ | morning | 05:52 |
|---|---|---|
| *** diurnalist has quit IRC | 05:52 | |
| sri_ | Tony31, did you catch my comment yesterday | 05:59 |
| Tony31 | Good morning sri_ - how are you doing? | 06:00 |
| Tony31 | About cinder-backup ? Thanks a lot for the reply. I saw it this morning. I searched for the variable you mentioned and it's set in the kayobe source. I've installed the variable in my variables files now and will see if a deployment excludes it from install. | 06:01 |
| *** Luzi has joined #openstack-kolla | 06:02 | |
| sri_ | Tony31, I am doing well, thanks for asking | 06:07 |
| *** cah_link has joined #openstack-kolla | 06:11 | |
| *** abdysn has joined #openstack-kolla | 06:14 | |
| openstackgerrit | Gauvain Pocentek proposed openstack/kolla master: Fix invalid test in cinder data migration script https://review.opendev.org/712055 | 06:32 |
| cosmicsound | greets | 06:55 |
| Tony31 | hi cosmic | 06:58 |
| *** strigazi has quit IRC | 07:03 | |
| cosmicsound | hey Tony31 | 07:09 |
| *** rpittau|afk is now known as rpittau | 07:17 | |
| cosmicsound | swift is not working with ceph backend? | 07:21 |
| sri_ | cosmicsound, are you running rgw ? and set enable_ceph_rgw_keystone: "yes" ? | 07:29 |
| sri_ | are you using external ceph ? if yes you have follow this https://docs.ceph.com/docs/mimic/radosgw/keystone/ | 07:31 |
| *** suff has joined #openstack-kolla | 07:35 | |
| Tony31 | is swift working now? | 07:35 |
| cosmicsound | sri_ , we use external ceph indeed | 07:38 |
| sri_ | cosmicsound, you can follow this https://docs.ceph.com/docs/mimic/radosgw/keystone/ | 07:39 |
| cosmicsound | thanks sri_ checking it | 07:40 |
| sri_ | Tony31, If your not using ceph, you can try this http://paste.openstack.org/show/790575/ | 07:41 |
| Tony31 | @sri_ I was running into this https://storyboard.openstack.org/#!/story/2007297 | 07:44 |
| sri_ | Tony31, hmm, I think i was using stein when i tested swift, maybe something is broke in train i am not sure ;( | 07:46 |
| Tony31 | I'm not sure if it's related to Kayobe or affects Kolla | 07:47 |
| sri_ | hmm | 07:54 |
| *** Fl1nt has joined #openstack-kolla | 08:02 | |
| *** suff has quit IRC | 08:04 | |
| Fl1nt | @cosmicsound, look at your volumes and prune them when doing a destroy as sometimes that destroy just forget about them. There is also a chance that you need to perform the bootstrap step again on some edge case where destroy clean up even the kolla host folders. | 08:05 |
| *** suff has joined #openstack-kolla | 08:05 | |
| Fl1nt | I had the issue earlier today. | 08:05 |
| *** bengates has joined #openstack-kolla | 08:09 | |
| hrw | https://review.opendev.org/#/c/712485/ yoctozepto mnasiadka | 08:22 |
| patchbot | patch 712485 - kolla - openstack-base: pin setuptools < 46 to get horizon... - 1 patch set | 08:22 |
| mnasiadka | hrw: well yoctozepto is complaining on the language :D | 08:23 |
| *** tonythomas has joined #openstack-kolla | 08:24 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712485 | 08:25 |
| hrw | changed | 08:25 |
| hrw | rephrased instead of complaining on his complaints | 08:25 |
| openstackgerrit | Matthias Runge proposed openstack/kolla master: Put back previously removed plugins https://review.opendev.org/712624 | 08:33 |
| *** jbadiapa has joined #openstack-kolla | 08:36 | |
| *** zhanglong has quit IRC | 08:44 | |
| *** k_mouza has joined #openstack-kolla | 08:44 | |
| *** k_mouza has quit IRC | 08:49 | |
| *** rpittau is now known as rpittau|bbl | 08:52 | |
| Fl1nt | ok, folks, how much is kolla-ansible in sync with/dependent of kolla-build images versioning? I mean, let say I want to use kolla-ansible 9.x series playbooks/roles over a 7.1.0 installation, is that a no no? | 08:52 |
| Fl1nt | I'm having a hard time to find out something within the main (vanilla) roles that could prohibit it. | 08:52 |
| hrw | Fl1nt: same release you have to use | 08:53 |
| hrw | images 7, deployment 7 | 08:53 |
| hrw | etc | 08:53 |
| Fl1nt | Same major you mean | 08:53 |
| hrw | yes | 08:53 |
| hrw | unless you want to have issues no one encounter before | 08:54 |
| Fl1nt | I'll take a better exemple | 08:54 |
| Fl1nt | I had the same feeling, and actually enforce that for now | 08:54 |
| Fl1nt | BUT | 08:54 |
| Fl1nt | I checked the swift role | 08:54 |
| Fl1nt | and didn't found anything prohibiting a 7.1 platform to be deployed with the 9.0.1 playbooks as it add few usefull mechanisms without changing options that could broke the swift install. | 08:55 |
| hrw | Fl1nt: there are roles which may not get changed much between releases | 08:56 |
| hrw | Fl1nt: at one moment deploying X images with X+1 kolla-ansible == non working database | 08:56 |
| hrw | while X with X or X+1 with X+1 worked fine | 08:57 |
| Fl1nt | ok, that may not be true for all, especially with deprecated options that became EOL/No longer available. | 08:57 |
| hrw | Fl1nt: if you see good stuff in swift/9 you would like to have in swift/7 then consider checking gerrit and marking patches for backporting | 08:58 |
| Fl1nt | yep, notice that, ok, I'll stick with X/X and X+1/X+1 | 08:58 |
| *** sluna has quit IRC | 08:58 | |
| *** sluna has joined #openstack-kolla | 08:58 | |
| Fl1nt | I'll definitely have to check for gerrit and all that build system on Openstack as I plan to contribute more now that I'm no longer dependent of an employer contribution policy. | 08:59 |
| hrw | https://review.opendev.org/#/c/712485 got RP+2 | 09:00 |
| patchbot | patch 712485 - kolla - openstack-base: pin setuptools < 46 to get horizon... - 2 patch sets | 09:00 |
| *** hrw has quit IRC | 09:03 | |
| *** Tony31 has quit IRC | 09:11 | |
| *** ktibi has joined #openstack-kolla | 09:11 | |
| *** hrw has joined #openstack-kolla | 09:17 | |
| *** reph has joined #openstack-kolla | 09:17 | |
| *** ykarel is now known as ykarel|lunch | 09:19 | |
| *** priteau has joined #openstack-kolla | 09:25 | |
| mnasiadka | hrw: off you go ;) | 09:27 |
| hrw | good | 09:28 |
| *** reph has quit IRC | 09:29 | |
| *** reph has joined #openstack-kolla | 09:30 | |
| *** k_mouza has joined #openstack-kolla | 09:34 | |
| yoctozepto | mgoddard, mnasiadka, hrw: I was negative mostly due to "why not just horizon" | 09:35 |
| yoctozepto | spelling is irrelevant, just marked because of my grammar nazi soul | 09:35 |
| yoctozepto | ;p | 09:35 |
| mnasiadka | yoctozepto: but you only expressed your grammar nazi soul | 09:36 |
| mnasiadka | :) | 09:36 |
| yoctozepto | mnasiadka: nope, please read more carefully | 09:36 |
| yoctozepto | "maybe downgrade in horizon only, hmm?" | 09:37 |
| mgoddard | yoctozepto: fix, then follow up | 09:37 |
| mgoddard | priority is green CI | 09:37 |
| yoctozepto | mgoddard: hence no -1, just no +2, that was a question :-) | 09:37 |
| mnasiadka | yoctozepto: well, and do what in horizon? downgrade something that is installed? I think that would be more dirty. | 09:37 |
| mgoddard | mnasiadka: nah, it's horizon's problem. Better limit the weirdness | 09:38 |
| yoctozepto | mgoddard, mnasiadka: it's already installed anyway | 09:38 |
| yoctozepto | it's setuptools | 09:38 |
| mnasiadka | looking at that, wouldn't it make sense to have some local upper constrains (per image if required) in some better form, than in Dockerfiles? :) | 09:39 |
| mnasiadka | (I might be just picky) | 09:39 |
| hrw | mnasiadka: virtualenv installs setuptools. we can 1. downgrade in next step or 2. do not install setuptools with virtualenv and install it in next step | 09:40 |
| mgoddard | Fl1nt: about mixing versions: it might work, but we make no guarantees. Things change between releases and we only track current. That said, we've had a lot of success running magnum a release or two ahead of other things, mostly to keep up with k8s | 09:41 |
| cosmicsound | Fl1nt , i did solved most of issues by fresh pull and bootstrap and several cleanings | 09:41 |
| mnasiadka | hrw: yeah well, both solutions are similar - difference is just no uninstallation on 2. :) | 09:42 |
| Fl1nt | @mgoddard, ok, cool, I'll test that in a lab env ^^ | 09:43 |
| openstackgerrit | Yongjun Bai proposed openstack/kolla-ansible master: Fix:copy ca certificates to horizon container https://review.opendev.org/712630 | 09:43 |
| mgoddard | Fl1nt: please make it clear in bug reports if you are mixing :) | 09:43 |
| Fl1nt | btw, I looked at your kayobe swift roles, definitely worthy to be backported to kolla ^^ | 09:44 |
| mgoddard | Fl1nt: sure. Is that something you would be able to handle? | 09:44 |
| Fl1nt | I will for sure, but honestly, I'm not gonna do a bug report until I validated an error isn't coming from a mixin actually. | 09:45 |
| mgoddard | ok | 09:45 |
| Fl1nt | I'll have to look at how all the plumbing works (Gerrit/CICD) but yep. | 09:45 |
| openstackgerrit | Yongjun Bai proposed openstack/kolla-ansible master: Fix:copy ca certificates to horizon container https://review.opendev.org/712630 | 09:48 |
| openstackgerrit | Yongjun Bai proposed openstack/kolla-ansible master: Fix:copy ca certificates to horizon container https://review.opendev.org/712630 | 09:49 |
| hrw | when "docker prune -af" ends with "Total reclaimed space: 132.6GB" it shows that too much kolla was done | 09:52 |
| Fl1nt | he he he that's actually the power of kolla, it really bloomed the Openstack enterprise grade lifecycle management. | 09:54 |
| Fl1nt | Before kolla, companies that I worked with where all trying to implement their own lifecycle management solution with more or less success in the process, kolla changed that situation from one day to another. | 09:55 |
| Fl1nt | completely erased years if not decades of tech debts at some point for one of my previous job. | 09:55 |
| Fl1nt | and a guy that I worked with even find a sweet term for our platforms during the process, called them frankeinClouds ^^ | 09:56 |
| Fl1nt | frankenClouds ^^ | 09:56 |
| hrw | Fl1nt: do not ask what I maintained before kolla. | 09:57 |
| openstackgerrit | Merged openstack/kolla-ansible master: Host OS prechecks follow up https://review.opendev.org/712502 | 09:57 |
| hrw | I can point you to git repo if you want nightmares | 09:57 |
| Fl1nt | What did you maintained @hrw ? :D | 09:57 |
| hrw | nice try | 09:57 |
| Fl1nt | send the git repo, I'm always curious to look at what other engineered ^^ | 09:58 |
| hrw | Fl1nt: https://git.linaro.org/leg/sdi/openstack-ref-architecture.git/ | 09:58 |
| Fl1nt | I worked with TripleO for a bit too... it was a nightmare, I love the way kayobe simplified all that ^^ | 09:59 |
| hrw | Fl1nt: if you ask me about anything about that repo I will not confirm that I ever worked on it. | 09:59 |
| Fl1nt | dude, that git solution is nothing compared to the crappy solution that I had to (recently <1 year) worked with, I can't link it the last one without risking any legal action, but trust me, at least yours is based on ansible usual structure. | 10:01 |
| hrw | Fl1nt: to make it funnier - all that crap would be avoided if we did copy of liberty debian packages :D | 10:03 |
| Fl1nt | all I can say is, it was called cloud-management, and handled everything on an over-engineered structure that abused the ansible vars override and a crappy yarn system in order to try to streamline the external role dependencies etc. | 10:03 |
| Fl1nt | It's funny to see how much crap can be produced by company only because they fear to collaborate each other on something similar that could benefit them. | 10:04 |
| Fl1nt | from what I can see, almost every company based their lifecycle tools on ansible, which is what kolla do, but all those initiative became crappy legacy because they didn't shared it. Until Kolla. | 10:05 |
| hrw | Fl1nt: I think that adding aarch64 support, reviving Debian support and getting to point when we were able to deploy something took less workhours than dealing with previous | 10:05 |
| hrw | bbiab | 10:05 |
| Fl1nt | I didn't used a debian install since a while ^^ | 10:10 |
| Fl1nt | Everything on RH or CentOS since around 12/13 years now | 10:11 |
| *** zhanglong has joined #openstack-kolla | 10:17 | |
| *** ykarel|lunch is now known as ykarel | 10:19 | |
| *** reph has quit IRC | 10:22 | |
| yoctozepto | hrw, mgoddard: hmm, we are using delorean on Train CentOS 8? | 10:24 |
| mgoddard | yoctozepto: yes | 10:26 |
| *** rohit02 has joined #openstack-kolla | 10:26 | |
| rohit02 | can we use virtual network interface for neutron external in kolla ansible? | 10:27 |
| hrw | yoctozepto: centos8-train delorean to be exact | 10:28 |
| yoctozepto | hrw, mgoddard: ack, thanks | 10:28 |
| hrw | yw | 10:31 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/train: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712644 | 10:36 |
| *** GeraldS has joined #openstack-kolla | 10:36 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Use internal API for masakari-monitor https://review.opendev.org/712431 | 10:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Swift: remove meta field from rsync command https://review.opendev.org/712428 | 10:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Swift: remove meta field from rsync command https://review.opendev.org/712430 | 10:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Swift: remove meta field from rsync command https://review.opendev.org/712429 | 10:36 |
| hrw | also marked RP+2 | 10:37 |
| *** reph has joined #openstack-kolla | 10:38 | |
| Fl1nt | Is there a reason why kolla fluentd container is using a more than deprecated version with rocky/stein ? | 10:52 |
| mgoddard | Fl1nt: yes - nobody upgraded it | 10:53 |
| mgoddard | it is upgraded in train | 10:53 |
| Fl1nt | ok ^^, I had that on my todo so ^^ | 10:54 |
| *** reph has quit IRC | 10:54 | |
| hrw | Fl1nt: fluentd/td-agent is nightmare | 10:55 |
| Fl1nt | yeah ^^ But I'm discussing with an operator, and he raised me a legitimate question, so I'll answer it and work to fix that ^^ | 10:56 |
| *** vishalmanchanda has quit IRC | 11:00 | |
| *** reph has joined #openstack-kolla | 11:01 | |
| *** iniazi has quit IRC | 11:07 | |
| *** kplant has joined #openstack-kolla | 11:09 | |
| *** ktibi has quit IRC | 11:10 | |
| *** ktibi has joined #openstack-kolla | 11:11 | |
| yoctozepto | Fl1nt: go train :D | 11:15 |
| yoctozepto | hrw: https://review.opendev.org/712644 - needs action (tripleo) | 11:16 |
| patchbot | patch 712644 - kolla (stable/train) - openstack-base: pin setuptools < 46 to get horizon... - 1 patch set | 11:16 |
| Fl1nt | I can't ^^ that's not on my call ^^ | 11:16 |
| Fl1nt | but I will on next month. | 11:17 |
| Fl1nt | hum... are LABEL directive ever used within the kolla-build for packages version pining for instance ? | 11:20 |
| Fl1nt | because, td repo is pointing to: 3.x version: https://opendev.org/openstack/kolla/src/tag/9.0.1/docker/base/td.repo | 11:21 |
| Fl1nt | but dockerfile label state | 11:21 |
| Fl1nt | fluentd_version=0.12 | 11:22 |
| Fl1nt | https://opendev.org/openstack/kolla/src/tag/9.0.1/docker/fluentd/Dockerfile.j2#L4 | 11:22 |
| mgoddard | Fl1nt: that is confusingly named. We basically check for <=0.12 or >0.12. | 11:23 |
| hrw | Fl1nt: depends on distro and arch we use either td-agent or fluentd and either 0.12 or 0.14 | 11:23 |
| mgoddard | Fl1nt: and fluentd version != td-agent version... | 11:23 |
| hrw | or sth like that | 11:23 |
| hrw | it is mess | 11:23 |
| mgoddard | not entirely of our own making :) | 11:23 |
| hrw | Arm Treasuredata is a .... ..... ..... unable to do releases | 11:23 |
| Fl1nt | Distro CentOS RPM arch x86_64 | 11:23 |
| Fl1nt | so the packages installed should be either: 2.3.6-0 for rocky/stein and 3.6.0-0 for train, however, it seems it's 0.12 which is installed. so, how is macro.j2 using LABEL in order to pin the package? at yum install or within the repo? | 11:25 |
| openstackgerrit | Merged openstack/kayobe master: CentOS 8: Add seed and overcloud CI jobs, drop CentOS 7 jobs https://review.opendev.org/709787 | 11:29 |
| hrw | yoctozepto: needs tripleo team as psutil/_psutil_common.c:9:20: fatal error: Python.h: No such file or directory | 11:30 |
| yoctozepto | hrw: argh | 11:30 |
| mgoddard | Fl1nt: the label is just indicative. It's used in kolla-ansible to control logic | 11:32 |
| Fl1nt | ok, so the td-agent package in my case will use 2.3.6-0 rpm version and LABEL will be 0.14 that kolla-ansible will use for ??? | 11:33 |
| *** rohit02 has quit IRC | 11:33 | |
| Fl1nt | ok, got it | 11:35 |
| Fl1nt | so | 11:35 |
| Fl1nt | with rocky/stein, on a CentOS x86_64 install, fluentd role use td-agent 2.3.6-0 rpm package version which so use a fluentd 0.12 and with train it install 3.6.0-0 which use a fluentd 1.0 | 11:36 |
| Fl1nt | meaning that rocky/stein fluentd configs are 0.12 and train are 1.0 ok cool | 11:37 |
| openstackgerrit | Merged openstack/kolla master: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712485 | 11:44 |
| *** rgogunskiy has joined #openstack-kolla | 11:46 | |
| *** cah_link has quit IRC | 12:04 | |
| *** reph has quit IRC | 12:10 | |
| *** Luzi has quit IRC | 12:10 | |
| *** reph has joined #openstack-kolla | 12:11 | |
| *** zhanglong has quit IRC | 12:15 | |
| *** reph has quit IRC | 12:16 | |
| *** gfidente has joined #openstack-kolla | 12:21 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Make local kolla-ansible Python executable configurable https://review.opendev.org/711060 | 12:28 |
| *** zhanglong has joined #openstack-kolla | 12:30 | |
| *** Fl1nt has quit IRC | 12:35 | |
| mgoddard | hrw: you mentioned this earlier: fatal error: Python.h: No such file or directory | 12:36 |
| mgoddard | I am seeing that on tenks | 12:36 |
| mgoddard | also seeing breakage on kayobe | 12:36 |
| hrw | yay | 12:37 |
| mgoddard | I think that virtualenv command now uses python3 by default on CentOS 7 | 12:37 |
| *** Fl1nt has joined #openstack-kolla | 12:37 | |
| mgoddard | so python3-devel missing | 12:37 |
| hrw | patch it with -ppython2 if centos7? | 12:37 |
| mgoddard | yes | 12:37 |
| hrw | we agreed no py3 for c7 | 12:38 |
| mgoddard | but that's a bad default for CentOS 7 | 12:38 |
| yoctozepto | ping centos-devel | 12:38 |
| hrw | mgoddard: py3 or py2 as bad? | 12:39 |
| mgoddard | py3 on centos is half-assed | 12:39 |
| hrw | indeed | 12:43 |
| Fl1nt | except on C8 | 12:45 |
| hrw | Fl1nt: there is no py2 on c8. | 12:45 |
| Fl1nt | no I know, I talked about PY3 | 12:45 |
| hrw | I know | 12:45 |
| *** dciabrin_ is now known as dciabrin | 12:45 | |
| Fl1nt | ^^ | 12:46 |
| Fl1nt | btw, don't get why they didn't used dnf as default replacement for yum yet on C8 | 12:47 |
| kplant | they did | 12:48 |
| kplant | yum is a symlink to dnf | 12:48 |
| *** zhanglong has quit IRC | 12:49 | |
| yoctozepto | mgoddard, hrw: it's mostly missing selinux bindings for source builds I guess? (py3) | 12:51 |
| yoctozepto | anyways, that venv thingy sounds breaking | 12:51 |
| hrw | Fl1nt: yum v4 is dnf | 12:52 |
| hrw | Fl1nt: yum 'binary' is there for those used to yum | 12:52 |
| yoctozepto | hrw, mgoddard: is centos channel logged? | 12:53 |
| mgoddard | not sure | 12:53 |
| Fl1nt | @kplant, wait what?? So someone lied to me that whole time?? | 12:53 |
| * Fl1nt go check that | 12:53 | |
| Fl1nt | Woooh you're right @kplant nice one ^^ I didn't checked earlier but it's sweet ^^ | 12:56 |
| Fl1nt | @hrw, yeah, just didn't knew that they've made that link, just always thought that centos would have switch to dnf without looking at those used to the yum command as fedora did ^^ | 12:58 |
| Fl1nt | habits are hard to loose I guess ^^ | 12:58 |
| Fl1nt | exit | 12:58 |
| Fl1nt | whoops, wrong window ^^ | 12:59 |
| yoctozepto | mgoddard, hrw: so - are we hitting red hat folks? | 12:59 |
| yoctozepto | hrw <- red hat folk | 12:59 |
| mgoddard | should probably raise it with them | 13:00 |
| mgoddard | where to start? | 13:00 |
| yoctozepto | with hrw if he knows the quickest path | 13:00 |
| yoctozepto | otherwise bugzilla | 13:00 |
| hrw | yoctozepto: ? | 13:00 |
| hrw | Fl1nt: note that on c7 you can enable epel and install dnf | 13:00 |
| yoctozepto | hrw: centos claims it's upstream | 13:00 |
| yoctozepto | hrw: the virtualenv switching defaults | 13:00 |
| yoctozepto | mgoddard: https://bugzilla.redhat.com/ | 13:01 |
| hrw | 13:37 < hrw> patch it with -ppython2 if centos7? | 13:01 |
| yoctozepto | if no better way | 13:01 |
| hrw | no, you ... | 13:01 |
| hrw | if you want py2 then add '-p python2' to virtualenv call | 13:01 |
| hrw | done | 13:01 |
| hrw | if you want something done for sure, then do not rely on defaults | 13:01 |
| yoctozepto | hrw: yeah, but like 99% of python world expects virtualenv to run python, not python3? | 13:02 |
| hrw | and? | 13:02 |
| *** rpittau|bbl is now known as rpittau | 13:02 | |
| yoctozepto | hrw: surprised you are not surprised | 13:02 |
| hrw | you want it fixed in kolla or want to spend unknown amount of time for change somewhere? | 13:02 |
| yoctozepto | hrw: fair point | 13:03 |
| hrw | 14:02 (0s) hrw@puchatek:~$ python --version | 13:03 |
| hrw | Python 3.7.6 | 13:03 |
| hrw | no one sane want to run 'python' | 13:03 |
| hrw | you either want 'python3' or 'python2' | 13:03 |
| hrw | if your work is multidistro/os/arch/whatever | 13:03 |
| yoctozepto | hrw: it's centos/rhel 7, they normally don't do such switches over night, that's what we expect from them and that's why we choose them | 13:04 |
| hrw | [root@4eb21ecff0ab /]# virtualenv /tmp/v | 13:05 |
| hrw | New python executable in /tmp/v/bin/python | 13:05 |
| hrw | Installing setuptools, pip, wheel...done. | 13:05 |
| hrw | [root@4eb21ecff0ab /]# . /tmp/v/bin/activate | 13:05 |
| hrw | (v) [root@4eb21ecff0ab /]# python --version | 13:05 |
| hrw | Python 2.7.5 | 13:05 |
| hrw | centos:7 container | 13:05 |
| yoctozepto | hrw: weird, just checked myself and had the same | 13:05 |
| Fl1nt | for that one I do exactly the same as hrw, my CICD worker host is using virtualenv with a VIRTUALENV_PYTHON=blabla and then I'm mkproject with -ppython3 whenever I want it, like with kolla-ansible for instance. | 13:05 |
| yoctozepto | hrw, mgoddard: dafu ^ | 13:05 |
| * hrw -> stable/train | 13:06 | |
| yoctozepto | (I mean hrw, not Fl1nt message) | 13:06 |
| hrw | "stdout": "created virtual environment CPython3.6.8.final.0-64 in 442ms | 13:07 |
| yoctozepto | mgoddard, hrw: in case of tripleo job, they run pip3 to install virtualenv so no wonder it gets python3 inside | 13:09 |
| yoctozepto | mgoddard, hrw: not sure if that was done deliberately or ansible actually changed defaults | 13:09 |
| mgoddard | spinning up a VM to test | 13:09 |
| yoctozepto | mgoddard, hrw: https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L43-L49 partially deliberately | 13:10 |
| yoctozepto | mgoddard, hrw: I'm betting on infra images to have received python3 blessings | 13:11 |
| hrw | argh | 13:12 |
| yoctozepto | onto tripleo | 13:12 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: WIP: Force python 2 for virtualenvs https://review.opendev.org/712673 | 13:15 |
| yoctozepto | mgoddard: any idea what hit kayobe there? | 13:17 |
| mgoddard | yoctozepto: nope | 13:17 |
| yoctozepto | mgoddard: well, tripleo kinda hit themselves | 13:18 |
| yoctozepto | mgoddard: aren't you doing pip installs in kayobe? | 13:18 |
| yoctozepto | on bare I mean | 13:18 |
| yoctozepto | and detect pip3 and prefer | 13:19 |
| yoctozepto | to install virtualenv | 13:19 |
| hrw | yoctozepto: I may not care did tripleo hit themselves or not. but that fact hits us | 13:19 |
| yoctozepto | hrw: disable voting? ;p | 13:20 |
| yoctozepto | hrw: kolla itself not affected | 13:20 |
| hrw | yoctozepto: kolla is affected as long tripleo CI is voting | 13:20 |
| *** k_mouza has quit IRC | 13:21 | |
| yoctozepto | hrw: you must be in bad mood today | 13:22 |
| mnasiadka | oh boy, just set it as non voting and case closed | 13:22 |
| *** cah_link has joined #openstack-kolla | 13:24 | |
| hrw | yoctozepto: maybe | 13:27 |
| yoctozepto | mnasiadka: easier said than done | 13:27 |
| mnasiadka | yoctozepto: why? | 13:27 |
| yoctozepto | mnasiadka: it's not friendly towards tripleo ;-) | 13:29 |
| hrw | yoctozepto: did you contacted them? discussed issue? | 13:30 |
| yoctozepto | cloudnull: emergency tripleo gate situation blocking kolla train, please help - we are considering non-voting soon | 13:30 |
| yoctozepto | hrw: yeah, on tripleo | 13:30 |
| yoctozepto | hrw: ignored me | 13:30 |
| yoctozepto | hrw: last hope in our liaison | 13:30 |
| cloudnull | yoctozepto - please state the nature of our tripleo emergency. | 13:31 |
| yoctozepto | cloudnull: hi, thanks for coming | 13:31 |
| yoctozepto | cloudnull: https://zuul.opendev.org/t/openstack/build/bf343e1ad1684bfb902fb0703085e922 | 13:31 |
| yoctozepto | fatal error: Python.h: No such file or directory | 13:31 |
| yoctozepto | cloudnull: debugged down to this | 13:31 |
| yoctozepto | https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L43-L49 | 13:32 |
| cloudnull | hum, was python-devel removed ? | 13:32 |
| yoctozepto | cloudnull: no idea, but it must have gone one way or another | 13:32 |
| mgoddard | cloudnull: it appears that python3 is being used by default by virtualenv | 13:32 |
| yoctozepto | cloudnull: it seems to be python3-devel though | 13:32 |
| yoctozepto | ^ | 13:32 |
| yoctozepto | cloudnull: see the lines I highlighted | 13:32 |
| mgoddard | we are seeing similar in kayobe & tenks | 13:32 |
| yoctozepto | cloudnull: you detect pip3 and install it for py3 | 13:32 |
| yoctozepto | cloudnull: betting on change in infra image | 13:33 |
| yoctozepto | mgoddard: ^ | 13:33 |
| mgoddard | yoctozepto: are you sure those lines are relevant? they went in some time ago | 13:33 |
| cloudnull | ++ | 13:33 |
| hrw | cloudnull: your CI job does py3 virtualenv | 13:33 |
| yoctozepto | mgoddard: maybe pip3 was not there at the time | 13:33 |
| cloudnull | that's a base job for all of infra | 13:33 |
| yoctozepto | it does pip3 virtualenv | 13:33 |
| mgoddard | I can't reproduce locally | 13:33 |
| yoctozepto | so no wonder it gets python venv | 13:33 |
| * cloudnull py3 has venv built in, not sure why anyone would be virtualenv ... | 13:34 | |
| yoctozepto | mgoddard: try installing virtualenv with pip3 | 13:34 |
| yoctozepto | there is some mess and something has changed | 13:34 |
| mgoddard | ah, that could be it | 13:34 |
| yoctozepto | the part from pip3 to virtualenv to python3 is clear | 13:34 |
| * cloudnull going to go ask some folks whats what | 13:35 | |
| yoctozepto | now, kayobe must be either using pip3 implicitly or semi-explicitly (if you are surprised) | 13:35 |
| yoctozepto | and tripleo does it plainly | 13:35 |
| mgoddard | yoctozepto: I think you have it | 13:36 |
| mgoddard | I did a pip3 install virtualenv | 13:36 |
| mgoddard | now my virtualenvs are py3 (no surprise) | 13:36 |
| cloudnull | tripleo would only use py3 on cent8+ | 13:36 |
| yoctozepto | cloudnull: we too | 13:37 |
| cloudnull | this job is running cent7, unless i'm mistaken ? | 13:37 |
| yoctozepto | cloudnull: but it happens otherwise - as I said - betting on infra change | 13:37 |
| yoctozepto | cloudnull: c7 | 13:37 |
| yoctozepto | cloudnull: I confirm | 13:37 |
| cloudnull | the job name says c7 but the output shows py3.6 | 13:38 |
| cloudnull | so idk ... | 13:38 |
| cloudnull | to fix this I suspect all we need is to have python{2,3}-devel installed. | 13:39 |
| *** skramaja has quit IRC | 13:40 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Fix HAProxy monitor VIP precheck https://review.opendev.org/712441 | 13:40 |
| yoctozepto | cloudnull: for the first try, running off py3 in c7 could still be surprising in the long run | 13:42 |
| cloudnull | ++ | 13:43 |
| cloudnull | in in the #infra channel, it seems that py3 is being installed by default there . | 13:44 |
| cloudnull | which is surprising | 13:44 |
| yoctozepto | mgoddard: mhm, you are using image-provided virtualenv in kayobe which ends up being py3 | 13:46 |
| yoctozepto | cloudnull: ^ | 13:46 |
| yoctozepto | mgoddard, cloudnull: so both the issues are the same mess | 13:47 |
| yoctozepto | mgoddard, cloudnull: moving to infra then | 13:47 |
| stingrayza | hey all o/ been a while. (been far away from my openstack for some time, but recently back...) | 13:51 |
| stingrayza | just upgraded my local k-a deployment to train - what an easy experience (and give yourselves a pat on the back for making it so) | 13:52 |
| yoctozepto | stingrayza: thanks :-) I did it back in the day and was also happy; there was no end to patting :-) | 13:53 |
| *** bengates has quit IRC | 13:57 | |
| *** dave-mccowan has joined #openstack-kolla | 14:02 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712644 | 14:10 |
| *** bengates has joined #openstack-kolla | 14:12 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: WIP: Force python 2 for virtualenvs https://review.opendev.org/712673 | 14:20 |
| openstackgerrit | Radosław Piliszek proposed openstack/kayobe stable/train: DNM: use base-test for kayobe-base to test drop of bad workaround https://review.opendev.org/712694 | 14:22 |
| yoctozepto | mgoddard: ^ | 14:22 |
| mgoddard | yoctozepto: interesting | 14:23 |
| yoctozepto | mgoddard: going to become infra some day this way... | 14:23 |
| mgoddard | why not | 14:23 |
| yoctozepto | mgoddard: yeah, why, kolla ptl dreaming of first-class service? :-) | 14:24 |
| emccormick | Hey, did the simple logo customization ever land? | 14:24 |
| yoctozepto | (not that I would mind much) | 14:24 |
| *** jimcrowleyibm has joined #openstack-kolla | 14:24 | |
| emccormick | Not seeing a doc for it from my google fu | 14:24 |
| yoctozepto | emccormick: probably not, you mean something horizon in kolla-ansible? | 14:25 |
| emccormick | yes, sorry. Horizon | 14:25 |
| *** dave-mccowan has quit IRC | 14:25 | |
| emccormick | we had a blueprint back in 2017 to allow for replacing the horizon logos without having to hack them into the container image | 14:26 |
| yoctozepto | emccormick: I guess it got stuck at kolla :/ | 14:27 |
| emccormick | *sniffle* | 14:28 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: WIP: Force python 2 for virtualenvs https://review.opendev.org/712673 | 14:29 |
| *** dave-mccowan has joined #openstack-kolla | 14:30 | |
| hrw | emccormick: do your theme, use overlays to add it into image and then list own theme first on deployment? | 14:30 |
| emccormick | Yeah I tried doing that a couple releases ago but never got it to work | 14:31 |
| *** abdysn has quit IRC | 14:31 | |
| hrw | we did that way at Linaro | 14:31 |
| emccormick | I don't really have a full blown theme replacement though | 14:31 |
| hrw | emccormick: your theme can be copy of original one + own logo | 14:31 |
| emccormick | I just did a little CSS to tweak colors, and then replaced the logo files | 14:31 |
| *** Fl1nt has quit IRC | 14:32 | |
| emccormick | I'm honestly not very good with all that front end stuff ;) | 14:32 |
| emccormick | do you know exactly what to replace in the container image? Everything I ever replaced never seemed to change it | 14:33 |
| hrw | emccormick: https://git.linaro.org/leg/sdi/kolla/ldc-overlay.git/tree/linaro-override-train.j2 | 14:33 |
| hrw | emccormick: we pass it via --template-override | 14:34 |
| emccormick | ok cool. thanks. Will give it a shot | 14:36 |
| *** rgogunskiy has quit IRC | 14:36 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: WIP: Force python 2 for virtualenvs https://review.opendev.org/712673 | 14:39 |
| *** ricolin_ has quit IRC | 14:41 | |
| *** ricolin_ has joined #openstack-kolla | 14:41 | |
| mgoddard | yoctozepto: your kayobe patch looks quite happy so far | 14:43 |
| yoctozepto | mgoddard: yup | 14:46 |
| yoctozepto | mgoddard: so train revert is possible | 14:46 |
| yoctozepto | mgoddard: also testing rocky for ubuntu py 3.5 | 14:46 |
| yoctozepto | mgoddard: (devstack) | 14:46 |
| mgoddard | well this is just kayobe | 14:46 |
| mgoddard | but it's a good sign | 14:46 |
| weshay|ruck | mgoddard, catching up | 14:46 |
| yoctozepto | mgoddard: if virtualenv was broken, you would see it | 14:46 |
| weshay|ruck | looking for patches where tripleo train and earlier are failing | 14:47 |
| yoctozepto | weshay|ruck: let me summarize this for you | 14:47 |
| weshay|ruck | k | 14:47 |
| yoctozepto | weshay|ruck: infra installed python3+pip3 in centos7 images | 14:47 |
| yoctozepto | (well, all for that matter) | 14:47 |
| *** zbr has joined #openstack-kolla | 14:47 | |
| yoctozepto | weshay|ruck: and base job does detection of py version based on pip3 availability | 14:47 |
| weshay|ruck | ah | 14:47 |
| yoctozepto | weshay|ruck: and replaced virtualenv happily | 14:48 |
| yoctozepto | weshay|ruck: ta-da | 14:48 |
| *** ricolin_ has quit IRC | 14:48 | |
| yoctozepto | weshay|ruck: working with infra on this | 14:48 |
| weshay|ruck | k.. thank you.. /me catching up in there as well | 14:48 |
| *** diurnalist has joined #openstack-kolla | 14:53 | |
| weshay|ruck | k.. | 14:54 |
| weshay|ruck | see the issue | 14:54 |
| weshay|ruck | 2020-03-12 01:51:36.567684 | LOOP [build-containers : Install deps from upper-constraints] | 14:54 |
| weshay|ruck | 2020-03-12 01:51:53.406550 | primary | changed: "kolla" | 14:54 |
| weshay|ruck | 2020-03-12 01:52:27.887975 | primary | changed: "tripleo-common" | 14:54 |
| weshay|ruck | 2020-03-12 01:52:37.301868 | primary | ERROR: Item: python-tripleoclient | 14:54 |
| weshay|ruck | 2020-03-12 01:52:37.302375 | primary | { | 14:54 |
| weshay|ruck | 2020-03-12 01:52:37.302512 | primary | "ansible_loop_var": "item", | 14:54 |
| *** iniazi has joined #openstack-kolla | 14:59 | |
| weshay|ruck | yoctozepto, mgoddard ok.. we're discussing how to resolve now | 15:01 |
| weshay|ruck | thanks for the info | 15:01 |
| iniazi | on a failed deployment, can I re-run deployment again after fixing it or should I destroy and then deploy again? | 15:02 |
| *** GeraldS has quit IRC | 15:02 | |
| iniazi | its been a while since I did a k-a deployment | 15:03 |
| *** suff has quit IRC | 15:04 | |
| mgoddard | weshay|ruck: FWIW, I think we have two candidate solutions for kayobe at least | 15:06 |
| mgoddard | weshay|ruck: bodge: uninstall virtualenv3, reinstall virtualenv2 https://review.opendev.org/712673 | 15:06 |
| patchbot | patch 712673 - kayobe (stable/train) - WIP: Force python 2 for virtualenvs - 4 patch sets | 15:06 |
| mgoddard | weshay|ruck: better: fix in base zuul job: https://review.opendev.org/712694 | 15:07 |
| patchbot | patch 712694 - kayobe (stable/train) - DNM: use base-test for kayobe-base to test drop of... - 1 patch set | 15:07 |
| *** sri_ has quit IRC | 15:08 | |
| *** arxcruz|rover has joined #openstack-kolla | 15:09 | |
| arxcruz|rover | weshay|ruck: p/ | 15:09 |
| *** reph has joined #openstack-kolla | 15:11 | |
| yoctozepto | mgoddard, hrw: infra fix going in 8-) | 15:19 |
| mgoddard | yoctozepto: sweet! | 15:20 |
| mgoddard | thanks for pushing on it | 15:20 |
| yoctozepto | weshay|ruck, cloudnull, arxcruz|rover: ^^ | 15:20 |
| yoctozepto | mgoddard: felt brave enough today | 15:20 |
| weshay|ruck | k.. fyi https://review.opendev.org/#/c/712706/ | 15:23 |
| patchbot | patch 712706 - tripleo-ci - Install python headers - 1 patch set | 15:23 |
| hrw | yoctozepto: coolio! | 15:25 |
| yoctozepto | for future reference: https://review.opendev.org/712107 <- this is the patch going in | 15:27 |
| patchbot | patch 712107 - opendev/base-jobs - Cleanup workaround for importlib-resources bad ver... - 1 patch set | 15:27 |
| yoctozepto | weshay|ruck: k, makes sense to possibly delay failure | 15:28 |
| yoctozepto | aaand it merged :D | 15:29 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712644 | 15:30 |
| yoctozepto | hrw, mgoddard: ^ | 15:30 |
| mgoddard | niiice | 15:31 |
| hrw | uf | 15:32 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Add ssh clients to Ironic Conductor container https://review.opendev.org/712422 | 15:34 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Clean up collectd dockerfile https://review.opendev.org/711891 | 15:34 |
| *** ykarel is now known as ykarel|away | 15:34 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: kibana: enable for non-x86 on Debian/Ubuntu https://review.opendev.org/707789 | 15:34 |
| yoctozepto | rebased w+1 | 15:35 |
| *** TrevorV has joined #openstack-kolla | 15:39 | |
| hrw | 70 files changed, 170 insertions(+), 626 deletions(-) | 15:44 |
| hrw | cleaning will be ugly | 15:44 |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CI: CentOS 8: Enable ceph-ansible jobs https://review.opendev.org/712719 | 15:50 |
| *** cah_link has quit IRC | 15:50 | |
| *** cah_link has joined #openstack-kolla | 15:50 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: Enable upgrade jobs https://review.opendev.org/712723 | 15:58 |
| *** xinliang has joined #openstack-kolla | 16:11 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/rocky: Bump manila version for Rocky https://review.opendev.org/712729 | 16:15 |
| iniazi | hmm, trying to deploy stable/train (i.e. git), and getting error on undefined zookeeper_port for telegraf; which sounds strange, i.e. i'm assuming its zookeeper_client_port it wants? | 16:18 |
| iniazi | my question is, am I missing something else that its giving me an undefined on it... or should i just configure that variable in globals.yml? | 16:19 |
| *** xinliang has quit IRC | 16:20 | |
| iniazi | well anyway, i'm going to just set that variable (wonder if i can do zookeeper_port: "{{ zookeeper_client_port }}" in globals.yml" ) and i guess redeploy | 16:22 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: CI: Ignore .zuul.d https://review.opendev.org/712730 | 16:25 |
| yoctozepto | mgoddard: ^ | 16:25 |
| mgoddard | yoctozepto: classic | 16:26 |
| yoctozepto | mgoddard: k-a is happy | 16:26 |
| *** TrevorV has quit IRC | 16:27 | |
| yoctozepto | iniazi: this part is unfortunately untested; if you think this is a bug, please report | 16:27 |
| *** TrevorV has joined #openstack-kolla | 16:28 | |
| *** Blinkiz has quit IRC | 16:30 | |
| *** Blinkiz has joined #openstack-kolla | 16:31 | |
| *** TrevorV has quit IRC | 16:31 | |
| *** TrevorV has joined #openstack-kolla | 16:32 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Separate per-service host configuration tasks https://review.opendev.org/703127 | 16:33 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Separate per-service host configuration tasks https://review.opendev.org/703127 | 16:36 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Improve Ansible version check error handling https://review.opendev.org/705261 | 16:40 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Avoid writing out requirements.txt in kolla-ansible role https://review.opendev.org/707853 | 16:42 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CI: Add overcloud host configure job https://review.opendev.org/710277 | 16:44 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: Support DNF https://review.opendev.org/711044 | 16:49 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CI: Add overcloud host configure job https://review.opendev.org/710277 | 16:49 |
| *** bengates has quit IRC | 16:50 | |
| *** chrizl has joined #openstack-kolla | 16:50 | |
| *** bengates has joined #openstack-kolla | 16:51 | |
| *** bengates has quit IRC | 16:56 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Copy ca certificates also to horizon container https://review.opendev.org/712630 | 16:59 |
| *** priteau has quit IRC | 17:01 | |
| kplant | would any of you smart people have a guess as to why i can create new instances with flavor X but cannot resize instances to flavor X | 17:04 |
| iniazi | yoctozepto, hmm, is there specific tags I should attach to the bugreport? | 17:04 |
| kplant | i have plenty of available resources | 17:04 |
| yoctozepto | iniazi: mostly irrelevant | 17:04 |
| yoctozepto | kplant: any specific error message? probably question to nova either way | 17:05 |
| kplant | just the classic: "No valid host was found. No valid host found for resize (HTTP 400)" | 17:05 |
| iniazi | submitted https://bugs.launchpad.net/kolla-ansible/+bug/1867179 | 17:05 |
| openstack | Launchpad bug 1867179 in kolla-ansible "Deploy fails on zookeeper_port undefined in telegraf.conf.j2" [Undecided,New] | 17:05 |
| hrw | kplant: looks like not enough resources | 17:05 |
| kplant | it does, but i have plenty of resources | 17:05 |
| kplant | and i can create new instances with the same flavor | 17:05 |
| hrw | kplant: go debug level of logs on nova? | 17:06 |
| kplant | actually am in the middle of the reconfigure pushing out debug=True now | 17:07 |
| openstackgerrit | James Kirsch proposed openstack/kolla master: Install uwsgi for Keystone https://review.opendev.org/710879 | 17:07 |
| kplant | oh that's _super_ annoying | 17:17 |
| kplant | it wasn't working because i renamed the AZ | 17:17 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Switch from shade to openstacksdk https://review.opendev.org/711061 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Remove activate-virtualenv and deactivate-virtualenv roles https://review.opendev.org/711062 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CentOS 8: Use ansible_playbook_python for localhost dependencies https://review.opendev.org/711063 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Make Kayobe code compatible with Python 3 https://review.opendev.org/711064 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CentOS 8: Bump MichaelRigart.interfaces to 1.4.0 https://review.opendev.org/711065 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CentOS 8: Disable ntpd, enable chrony container https://review.opendev.org/711066 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CentOS 8: Use same local python version for kolla-ansible https://review.opendev.org/711219 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CentOS 8: Add seed and overcloud CI jobs https://review.opendev.org/711067 | 17:18 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: DNM: test ansible group prechecks https://review.opendev.org/712743 | 17:21 |
| *** rpittau is now known as rpittau|afk | 17:27 | |
| *** cah_link has quit IRC | 17:29 | |
| *** evrardjp has quit IRC | 17:35 | |
| *** evrardjp has joined #openstack-kolla | 17:36 | |
| iniazi | hmm getting an error on kibana to register in es. its trying to match a hostname (showing as an ip) to the kolla_internal_fqdn, i'm guessing: (this is on deploy on stable/train): | 17:43 |
| iniazi | fatal: [controller01]: FAILED! => {"attempts": 20, "changed": false, "msg": "hostname '10.x.x.x' doesn't match either of 'control.DOMAIN', 'controller.DOMAIN'", "status": -1, "url": "https://10.x.x.x:9200/.kibana"} | 17:44 |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Enable hacluster and masakari images https://review.opendev.org/702706 | 17:44 |
| iniazi | should kolla_internal_vip_address be set to the dnsname and not an IP? | 17:45 |
| *** kozhukalov has joined #openstack-kolla | 17:46 | |
| iniazi | i'll just set it to the hostname? | 17:47 |
| hrw | can anyone build ubuntu/binary neutron-base image? | 17:50 |
| yoctozepto | hrw: which branch? (and what's to be expected?) | 17:56 |
| hrw | master | 17:58 |
| hrw | yoctozepto: I expect it to build | 17:59 |
| hrw | of course | 17:59 |
| yoctozepto | hrw: hah, ok, running | 18:04 |
| *** Trevor_V has joined #openstack-kolla | 18:07 | |
| *** TrevorV has quit IRC | 18:10 | |
| *** jimcrowleyibm is now known as jimcrowleyibm[aw | 18:16 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Fix telegraf with zookeeper (wrong port variable reference) https://review.opendev.org/712758 | 18:16 |
| yoctozepto | hrw: Failed to fetch http://piotrkosoft.net/pub/mirrors/ubuntu/dists/bionic-security/main/binary-amd64/Packages.gz File has unexpected size (834437 != 779543). Mirror sync in progress? | 18:18 |
| yoctozepto | I guess it was random? ;D | 18:18 |
| yoctozepto | retrying | 18:18 |
| yoctozepto | hrw: INFO:kolla.common.utils.neutron-base:E: Unable to locate package python3-networking-ovn | 18:19 |
| yoctozepto | hrw: kolla RED again? ;o | 18:20 |
| *** reph has quit IRC | 18:21 | |
| hrw | thank you | 18:22 |
| hrw | yoctozepto: not RED. it is Polish mirror issue | 18:23 |
| yoctozepto | hrw: nah, it got past mirror sync, I mean lack of ovn | 18:24 |
| hrw | will check on server | 18:24 |
| hrw | looks like package got dropped from UCA | 18:26 |
| hrw | yes. train had 7.0.0 and it is the latest version of that package in UCA archive | 18:27 |
| yoctozepto | hrw: argh | 18:29 |
| yoctozepto | hrw: and we want ovn in ussuri... | 18:29 |
| yoctozepto | mnasiadka: ^ | 18:29 |
| hrw | https://paste.centos.org/view/26a6caa5 ;( | 18:30 |
| mnasiadka | yoctozepto: it’s now in neutron code, no worries | 18:30 |
| mnasiadka | I can raise a change in master tomorrow to sort out this mess | 18:30 |
| mnasiadka | Networking-ovn should cease to exist from Ussuri | 18:31 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: neutron-base: drop python3-networking-ovn on Ubuntu https://review.opendev.org/712762 | 18:31 |
| hrw | mnasiadka: o! even easier! | 18:32 |
| mnasiadka | hrw: you’re welcome :) | 18:32 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: neutron-base: drop python3-networking-ovn https://review.opendev.org/712762 | 18:32 |
| hrw | mnasiadka: please improve commit message | 18:32 |
| * hrw off | 18:33 | |
| mnasiadka | hrw: can I do it tomorrow? Mind blown from a week worth of fight with rabbitmq and neutron/queens :) | 18:33 |
| yoctozepto | hrw, mnasiadka: thanks for handling! I forgot it ships by default from Ussuri | 18:34 |
| hrw | mnasiadka: no problemo | 18:36 |
| *** gfidente is now known as gfidente|afk | 18:41 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: CI: Enable Docker IPv6 https://review.opendev.org/712765 | 18:44 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: IPv6 external network https://review.opendev.org/712768 | 18:50 |
| *** Trevor_V has quit IRC | 18:51 | |
| *** jimcrowleyibm has joined #openstack-kolla | 18:51 | |
| *** jimcrowleyibm is now known as jimcrowleyibm[aw | 18:55 | |
| *** gmann is now known as gmann_lunch | 19:00 | |
| *** gfidente|afk has quit IRC | 19:05 | |
| *** jimcrowleyibm has joined #openstack-kolla | 19:08 | |
| openstackgerrit | Merged openstack/kolla stable/train: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712644 | 19:12 |
| *** kozhukalov has quit IRC | 19:13 | |
| *** jimcrowleyibm is now known as jimcrowleyibm[aw | 19:14 | |
| *** diurnalist has quit IRC | 19:14 | |
| *** reph has joined #openstack-kolla | 19:22 | |
| openstackgerrit | Merged openstack/kolla stable/train: kibana: enable for non-x86 on Debian/Ubuntu https://review.opendev.org/707789 | 19:25 |
| openstackgerrit | Merged openstack/kolla stable/train: Clean up collectd dockerfile https://review.opendev.org/711891 | 19:25 |
| openstackgerrit | Merged openstack/kolla stable/train: Add ssh clients to Ironic Conductor container https://review.opendev.org/712422 | 19:25 |
| *** reph has quit IRC | 19:49 | |
| *** kplant has quit IRC | 19:50 | |
| *** gmann_lunch is now known as gmann | 20:01 | |
| *** diurnalist has joined #openstack-kolla | 20:33 | |
| *** rgogunskiy has joined #openstack-kolla | 20:38 | |
| *** rgogunskiy has quit IRC | 20:42 | |
| *** ktibi has quit IRC | 20:45 | |
| iniazi | hmm, anyone using kibana (and es i suppose) and possibly caused by some logic (haven't looked through yet) of having kolla_internal_fqdn. | 21:04 |
| iniazi | somewhere it looks for the kolla_internal_vip_address to match one of the two kolla_internal_fqdn and kolla_external_fqdn , as part of the kolla config and fails on: | 21:04 |
| iniazi | {"attempts": 20, "changed": false, "msg": "hostname '10.x.x.x' doesn't match either of 'control.DOMAIN', 'controller.DOMAIN'", "status": -1, "url": "https://10.x.x.x:9200/.kibana"} | 21:05 |
| iniazi | oh i asked the question earlier. i tried to set the kolla_internal_vip_address as hostname instead of IP. but then it breaks chrony, so maybe something i'm missing. or is kibana not used much and possibly a bug | 21:06 |
| openstackgerrit | Merged openstack/kolla-ansible master: Copy ca certificates also to horizon container https://review.opendev.org/712630 | 21:11 |
| *** jimcrowleyibm has joined #openstack-kolla | 21:17 | |
| openstackgerrit | James Kirsch proposed openstack/kolla master: Install uwsgi for Keystone https://review.opendev.org/710879 | 21:27 |
| *** jimcrowleyibm is now known as jimcrowleyibm[aw | 21:29 | |
| iniazi | hmm in stable/stein, url is constructed with kolla_internal_vip_address url: "{{ internal_protocol }}://{{ kolla_internal_vip_address }}:{{ elasticsearch_port }}/.kibana" | 21:34 |
| iniazi | but in stable/train its via kolla_internal_fqdn: url: "{{ internal_protocol }}://{{ kolla_internal_fqdn | put_address_in_context('url') }}:{{ elasticsearch_port }}/.kibana" | 21:34 |
| iniazi | oops, the last one, i quoted master, not stable/train. both use kolla_internal_vip_address, but only add 'put_address_in_context'. sorry for the noise. i'll try to change it to whats in master | 21:38 |
| *** jbadiapa has quit IRC | 22:06 | |
| *** jbadiapa has joined #openstack-kolla | 22:09 | |
| *** etp has quit IRC | 22:15 | |
| *** etp has joined #openstack-kolla | 22:16 | |
| *** factor has quit IRC | 22:27 | |
| *** diurnalist has quit IRC | 22:28 | |
| *** diurnalist has joined #openstack-kolla | 22:36 | |
| *** jbadiapa has quit IRC | 22:37 | |
| *** diurnalist has quit IRC | 22:43 | |
| *** diurnalist has joined #openstack-kolla | 22:44 | |
| *** dave-mccowan has quit IRC | 22:50 | |
| *** dave-mccowan has joined #openstack-kolla | 23:10 | |
| *** threestrands has joined #openstack-kolla | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!