Tuesday, 2021-02-23

*** brinzhang_ has quit IRC00:14
*** jamesbenson has joined #openstack-kolla00:14
*** brinzhang has joined #openstack-kolla00:14
*** jamesbenson has quit IRC00:18
*** ricolin_ has joined #openstack-kolla00:20
*** ricolin_ has quit IRC00:22
*** rohit02 has joined #openstack-kolla00:57
*** rohit02 has quit IRC01:01
*** rohit02 has joined #openstack-kolla01:02
*** xinliang has joined #openstack-kolla01:19
*** benj_ has quit IRC01:53
*** benj_ has joined #openstack-kolla01:54
*** rohit02 has quit IRC02:16
*** rohit02 has joined #openstack-kolla02:16
*** rohit02 has quit IRC02:21
*** rohit02 has joined #openstack-kolla02:22
*** LinPeiWen has joined #openstack-kolla02:25
*** ricolin has quit IRC03:15
*** ricolin has joined #openstack-kolla03:30
*** xinliang has quit IRC04:05
*** cah_link has joined #openstack-kolla04:44
*** cah_link has quit IRC05:27
*** LinPeiWen has quit IRC06:18
*** vishalmanchanda has joined #openstack-kolla06:24
*** cah_link has joined #openstack-kolla06:39
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: ovn: Move openvswitch related tasks to openvswitch role  https://review.opendev.org/c/openstack/kolla-ansible/+/77642106:39
*** LinPeiWen has joined #openstack-kolla06:43
*** zzzeek has quit IRC06:45
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Move from ceph-ansible to cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/77141806:45
*** zzzeek has joined #openstack-kolla06:46
*** xinliang has joined #openstack-kolla07:03
*** brinzhang has quit IRC07:13
*** maharg101 has joined #openstack-kolla07:19
*** zzzeek has quit IRC07:39
*** zzzeek has joined #openstack-kolla07:40
*** gfidente|afk is now known as gfidente07:52
*** andrewbonney has joined #openstack-kolla08:06
*** bengates has joined #openstack-kolla08:16
*** luksky has quit IRC08:17
*** e0ne has joined #openstack-kolla08:27
*** rpittau|afk is now known as rpittau08:28
*** luksky has joined #openstack-kolla08:29
*** luksky has quit IRC08:49
*** dougsz has joined #openstack-kolla08:49
openstackgerritMark Goddard proposed openstack/kayobe stable/victoria: Update IPA docs and test build with extra-hardware  https://review.opendev.org/c/openstack/kayobe/+/77694708:49
openstackgerritRico Lin proposed openstack/kolla master: add openstack-python3-wallaby-jobs-arm64 job  https://review.opendev.org/c/openstack/kolla/+/77706208:51
*** luksky has joined #openstack-kolla09:02
openstackgerritMerged openstack/kolla-ansible master: docs: Add information on tuning Ansible  https://review.opendev.org/c/openstack/kolla-ansible/+/75820509:11
*** LinPeiWen has quit IRC09:16
*** k_mouza has joined #openstack-kolla09:27
*** xinliang has quit IRC09:27
*** xinliang has joined #openstack-kolla09:28
*** nikparasyr has joined #openstack-kolla09:29
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Reduce neutron RPC workers to 1  https://review.opendev.org/c/openstack/kayobe-config-dev/+/77707509:29
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Reduce ironic minimum required memory to 256MB  https://review.opendev.org/c/openstack/kayobe-config-dev/+/77707609:29
openstackgerritMark Goddard proposed openstack/kolla-ansible master: CI: Reduce neutron RPC service workers to 1  https://review.opendev.org/c/openstack/kolla-ansible/+/77707709:30
*** skramaja has joined #openstack-kolla09:34
*** kevko has joined #openstack-kolla10:14
openstackgerritMark Goddard proposed openstack/kayobe stable/victoria: Add ipa_build_upper_constraints_file variable  https://review.opendev.org/c/openstack/kayobe/+/77593510:18
*** LinPeiWen has joined #openstack-kolla10:19
*** xinliang has quit IRC10:19
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Register Elasticsearch in Keystone  https://review.opendev.org/c/openstack/kolla-ansible/+/74412110:25
*** rohit02 has quit IRC10:28
*** kevko_ has joined #openstack-kolla10:40
*** k_mouza has quit IRC10:49
*** k_mouza has joined #openstack-kolla10:59
*** rpittau is now known as rpittau|bbl11:00
*** kevko_ has quit IRC11:05
*** Luzi has joined #openstack-kolla11:13
*** kevko_ has joined #openstack-kolla11:15
kevkohi, is here a reason why some services using apache's mode wsgi ? in kolla ?11:16
kevkoyesterday I found weird behaviour when switching VIP adress ... when I removed apache and run under uwsgi ... it was smooth11:17
kevkocan share a video ..11:17
yoctozeptokevko: the reason is historical11:25
yoctozeptoand then we implemented tls with apache11:25
yoctozeptoso it stuck :D11:25
yoctozeptohow is apache relevant to the vip issue?11:26
kevko_yoctozepto: i really don't know , but when i am restarting keepalived and VIP is switching between two controllers ...one of controller is broken somehow ..no traffic going to this controller..and after while apache start to report 50311:30
kevko_yoctozepto: check a video -> https://download.kevko.ultimum.cloud/video_debug.mp411:32
kevko_yoctozepto: from top to bottom , left controller0, right controller111:32
kevko_yoctozepto: first windows just monitoring keystone health via docker ps and grep, second window i am checking where I have VIP currently assigned (switching by keepalived restart in background ) ....and bottom window I am tailing logs from keystone ...11:33
kevko_yoctozepto: it's visible that right after VIP is switched ... server where VIP was is somehow broken ...11:34
kevko_yoctozepto: when I install two another nodes (manually) and not using apache ..but uswgi ... working like a charm ..11:34
kevko_last thing what i need to to say is that another keystones without apache i installed manually and not in docker ..but pure debian buster ..11:35
kevko_so, there is a bug somewhere i think ..in docker, or in apache ..but as you can see ..it is weird11:35
kevko_i'm trying to resolve this issue because we are facing this on client site11:36
*** kevko has quit IRC11:43
kevko_yoctozepto: have u seen it already ? maybe i am trying to fix something what is already fixed (or it is known problem) ..so please ..could you check and let me know ?11:43
kevko_it's just 3minutes :)11:43
kevko_using ussuri11:43
*** brinzhang has joined #openstack-kolla11:43
*** brinzhang has quit IRC11:45
*** nikparasyr has left #openstack-kolla11:48
mgoddardkevko_: have you tried enabling more logging in keystone and apache?11:55
kevko_mgoddard: nope.. but i don't think i will see something more ..11:56
kevko_mgoddard: did you see behaviour ?11:56
mgoddardkevko_: I know that VIP failover is not entirely smooth, but haven't looked for that specific problem11:57
kevko_mgoddard: well, i will investigate ..11:57
kevko_mgoddard, yoctozepto: will you be against when I implement the optional uwsgi in kolla / k-a ? Of course with SSL11:59
*** skramaja has quit IRC11:59
mgoddardkevko_: I'd rather we fixed apache11:59
kevko_i mean, user will be able to choose if he wants apache or uwsgi implementation11:59
kevko_mgoddard: well, of course i will investigate it ... but doesn't make more sense to use uswgi ? Apache for me looks like a pretty big cannon12:00
mgoddardkevko_: we debated apache vs. uwsgi during the backend TLS work and decided to go for apache. There were reasons, but I probably won't remember them all12:01
*** mrunge_ has joined #openstack-kolla12:01
*** mrunge has quit IRC12:02
kevko_so, does it mean that it is impassable ? I mean, if I propose patch for optional uswgi, you will not merge ..right ?12:03
mgoddardkevko_: I would personally be -112:04
mgoddardkevko_: it's just additional complexity12:05
kevko_mgoddard: understand ..12:05
kevko_mgoddard: Openstack is complex :P12:05
mgoddardexactly12:06
kevko_kolla can't be simple :P12:06
mgoddardit's not simple, but I think it does a reasonable job of being as simple as it can12:06
mgoddardkevko_: you've seen how hard it can be to get enough reviewer time to merge feature patches. Is this the best use of that time?12:07
mgoddardkevko_: not to mention your own time to build it12:07
*** jamesbenson has joined #openstack-kolla12:08
kevko_yes, i know :), need to recruit more reviewers :D12:09
kevko_my time is irrelevant, I like it :)12:09
mgoddardkevko_: if you can find more reviewers, please do12:09
mgoddardkevko_: FWIW, each cycle we generate a list of 'priorities' based on community feedback12:09
mgoddardkevko_: https://etherpad.opendev.org/p/KollaWhiteBoard12:09
mgoddardL25112:09
mgoddardthey are in order of priority for each project12:10
mgoddardif you have time to work on things, those are some things people have asked for12:10
mgoddardmany don't have an owner12:10
mgoddardkevko_: we need this one: Cinder removing v2 API12:11
mgoddardkevko_: although to be honest code reviews are more in demand than code12:12
kevko_will try to do more review ..12:14
kevko_*s12:14
mgoddardkevko_: always appreciated12:14
kevko_mgoddard: btw, in whiteboard there is mariadb-ssl-support (7 votes) ... this can be implemented smoothly after proxysql will be merged :P :D12:17
mgoddardkevko_: look forward to it12:18
*** LinPeiWen has quit IRC12:23
*** kevko has joined #openstack-kolla12:24
*** Fl1nt has joined #openstack-kolla12:25
Fl1ntGood afternoon everyone!12:25
Fl1ntamoralej, hi ! quick question, are your still part of RDO contributors/devs ?12:26
amoralejyes, i'm at RDO12:27
Fl1ntperfect! I'd like to know if repository used for CentOS 8 can be used with Stream?12:27
amoralejFl1nt, you mean repo of RDO?12:28
Fl1ntlike, for now, RDO is mostly based on: http://mirror.centos.org/centos/8/cloud/ & http://mirror.centos.org/centos/8/HighAvailability/ & http://mirror.centos.org/centos/8/messaging/ & http://mirror.centos.org/centos/8/storage/ & http://mirror.centos.org/centos/8/virt/ when creating openstack platform on CentOS 8 based.12:29
amoralejFl1nt, we are creating specific repos for Centos Stream12:30
amoraleji.e. http://mirror.centos.org/centos/8-stream/cloud/x86_64/12:30
Fl1ntok, is there pre-alpha public repositories available or is that still something under discussion?12:30
amoralejwe currently have for victoria12:30
Fl1ntamoralej, perfect! thanks12:30
amoralejbut :)12:30
amoralejsome sigs are not shipped there yet12:31
Fl1ntBut it lacks Packages :p12:31
amoralejFl1nt, tbh the content is the same12:31
amoralejand we are testing it with both centos8 and centos8 stream12:32
Fl1ntok so let say I'm on a staging/lab I can use CentOS-8 repos.12:32
amoralejyes, mostly12:32
Fl1ntok, perfect12:32
amoralejat some point, you will just need to do dnf install centos-release-openstack-victoria12:33
amoralejand it will configure youre repos apropiatedly12:33
amoralejbut it's still WIP12:33
Fl1ntI can't ^^ hence why I know where the packages came from :p12:33
Fl1ntI'm on an airgapped zone, so additionals repositories can't be installed using dnf install epel-release or centos-release-openstack-victoria.12:34
Fl1ntwell, you still can, but the yum repo files installed wont work so it doesn't matter, I just put appropriate CentOS/EPEL internal repo URLs ^^ that avoid me two step workflow.12:35
amoralejah, ok12:35
amoralejso you mirror those repos internally12:35
Fl1ntbut that still something interesting for my own personnal dev usage ^^12:35
*** mrunge_ is now known as mrunge12:36
amoralejmy advice for stream is to clone both /8/ and /8-stream/12:36
amoralejuse 8-stream where available12:36
amoralejand fallback to 812:36
Fl1ntyes, we clone the whole internet, then scans it through security scrutinity and then approve or not their usage.12:36
amoralejat some point everything should be in 8-stream12:36
amoralejbut it will take some time12:36
Fl1ntsure no problems as long as I know it now ^^12:36
Fl1nthence why I asked you I knew you would be helpful :p12:37
amoralejglad to help :)12:37
Fl1ntthanks a lot ^^12:37
Fl1ntmgoddard, quick question for you too, I've seen a lot roles don't rely on the same "workflow" to create the services volumes when required, what is the recommended way? Using what's on the common role: https://opendev.org/openstack/kolla-ansible/src/commit/e744b9d510ba183d5a80b3e467d0e764eb5c9e02/ansible/roles/common/tasks/bootstrap.yml12:38
Fl1ntor something else?12:38
mgoddardFl1nt: it happens automatically if you create a container that mounts a named volume12:39
mgoddardFl1nt: in that case there is a symlink, so it's done separately12:40
Fl1ntok, so let say I want to patch tempest to get a real docker volume using docker_runtime_directory instead of a bind to node_config_directory what would be the most efficient way?12:41
Fl1ntbecause, from my understanding, this task do it https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/tasks/check-containers.yml using either default https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/defaults/main.yml#L1012:43
Fl1ntor your own override12:43
Fl1ntbut currently, it doesn't create docker volume, it create a host <-> container bind.12:44
Fl1ntI currently need two extra_volumes on tempest, one named reports, one named testlink. Reports hold for tempest HTML reports that are later one transfered on a specific long term storage zone. Testlink is a temporary volume used to introspect tempest scenarios (tests) and send them to a test manager named testlink.12:46
mgoddardFl1nt: tbh I don't really use the tempest container, I just use a python venv12:49
mgoddardFl1nt: the default volumes are here: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/defaults/main.yml#L2312:50
Fl1ntok, can I patch our current role then? There is some tasks to be patched such as the tempest.conf source list etc12:50
mgoddardyou should keep all of those12:50
mgoddardyou can define extra volumes via tempest_extra_volumes12:50
Fl1ntyes I keep the default, my issue is with the extra_volumes that are mount with bind instead of volumes.12:50
mgoddardtempest_extra_volumes:12:51
Fl1ntyes12:51
mgoddard  - tempest_reports:/path/to/reports12:51
mgoddard  - tempest_testlink:/path/to/testlink12:51
mgoddardit's the same as for 'docker run' - use a name for a named volume12:52
*** kevko has quit IRC12:52
Fl1ntaaaaaaah got the trick!12:52
Fl1ntok, the tempest_extra_volumes: can be named volumes!12:52
Fl1ntperfect12:52
Fl1ntI currently had:12:54
Fl1nttempest_extra_volumes:12:54
Fl1nt  - "{{ node_config_directory }}/tempest/reports:/var/lib/tempest/reports12:54
Fl1nt  - "{{ node_config_directory }}/tempest/testlink:/var/lib/tempest/testlink12:54
Fl1ntwhich explain why it's using bind12:54
Fl1ntok, I'll test using named volumes.12:55
Fl1ntbut I'll still patch that missing sources options on https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/tasks/config.yml#L3212:56
Fl1ntAs for now the tempest.conf need to be on etc/kolla/ where it should actually also be available on /etc/kolla/tempest/tempest.conf as nova is doing it with nova/{{ item.key }}.conf12:58
openstackgerritPiotr Parczewski proposed openstack/kolla-ansible master: Add Neutron DHCP agent to OVN networking setup  https://review.opendev.org/c/openstack/kolla-ansible/+/77422212:58
mgoddardFl1nt: I think it's fine as it is. There is only one tempest service, so no need for a per-service override12:58
*** amoralej is now known as amoralej|lunch13:00
Fl1ntit's just that it is the only service that is locating its config file at kolla config root directory, more a "visual" patch than something else, but many of my ops feedbacks noticed that "inconsistency",13:00
Fl1nteven when I explain that (only one service) they don't really understand/enjoy/whatever they feel about ^^13:01
*** rpittau|bbl is now known as rpittau13:01
Fl1ntand it would be more consistent with other services, so they'll stop bothering me with this question/suggestion and I'll stop loosing time explaining them or pointing out to the internal doc about that.13:02
openstackgerritPierre Riteau proposed openstack/kayobe master: Ubuntu: fix deployment image build  https://review.opendev.org/c/openstack/kayobe/+/77292913:03
Fl1ntlast question, more related to the review workflow, is there a specific day/workflow for patches to be merged on master once reviewed/validated?13:10
oklhosthttps://opendev.org/openstack/kolla/src/branch/master/docker/prometheus/prometheus-v2-server/Dockerfile.j2#L13 seems not working without -L switch to follow redirects.13:18
*** wuchunyang has joined #openstack-kolla13:21
Fl1ntoklhost, works for me13:21
oklhostw00t?!13:22
oklhostFl1nt: sorry, I've forgotten to say - try to uncompress13:23
Fl1ntyep, 61.3Mb and files13:23
oklhostThats strange13:24
Fl1nthttps://github.com/prometheus/prometheus/releases/download/v2.23.0/prometheus-2.23.0.linux-amd64.tar.gz are you able to curl -o manually ?13:25
hrwFl1nt: 2021-02-23 14:25:58 (14,3 MB/s) - zapisano `prometheus-2.23.0.linux-amd64.tar.gz' [64298432/64298432]13:26
openstackgerritPierre Riteau proposed openstack/kayobe stable/victoria: Add ipa_build_upper_constraints_file variable  https://review.opendev.org/c/openstack/kayobe/+/77593513:26
oklhostFl1nt: yes, 640B13:26
Fl1ntMeh? I've got 64MB13:26
jamesbensonI have a tempest question too if anyone could help :-) Everything passes except for tearing down of tempest.api.compute.servers.test_multiple_create.MultipleCreateTestJSON, because there are still ports it can't delete.  What am I missing in the config to get this test to work?13:27
Fl1ntok, which base oklhost ? CentOS or Ubuntu?13:27
openstackgerritPierre Riteau proposed openstack/kayobe stable/ussuri: Add ipa_build_upper_constraints_file variable  https://review.opendev.org/c/openstack/kayobe/+/77538613:27
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Add ipa_build_upper_constraints_file variable  https://review.opendev.org/c/openstack/kayobe/+/77596513:28
Fl1ntjamesbenson, tempest is dumb at ressource housekeeping, it can't keep track of its own puppets... I've the same issue, remaining orphaned ressources and full of race condition everywhere...13:28
oklhostFl1nt: ubuntu-source, well, my build isn't really representative, but I realized it when I played a bit around to build for our victoria deployment (yeah, i know - thats why i said it's not representative)13:28
oklhostbut I tried the same curl on different linux as well as macos hosts with the same result13:29
Fl1ntoklhost, I'm on CentOS Binary and victoria too on staging.13:29
Fl1ntmy CentOS curl is doing it fine, the windows one too13:30
openstackgerritPierre Riteau proposed openstack/kayobe stable/ussuri: Fix IPA build on stable/ussuri  https://review.opendev.org/c/openstack/kayobe/+/77593613:30
oklhostFl1nt: well, maybe a curl version issue? ubuntu: curl 7.68.0 (x86_64-pc-linux-gnu, macos: curl 7.75.0 (arm-apple-darwin20.3.0)13:31
oklhostDon't have any centos to verify13:31
Fl1ntlet me check that13:31
oklhost+113:32
Fl1nt7.61.1 on CentOS13:32
oklhostHm... funny13:33
Fl1nt7.55.1 on Windows13:33
Fl1nthrw, your curl is right, 64MB not 640B ;-)13:34
Fl1nt64298432 <-- those are bytes not bits13:35
oklhostOkay... same with curl 7.58.0 running on ubuntu bionic13:35
Fl1ntwhat is your docker host?13:35
Fl1ntjamesbenson, what can help with those race condition is giving tempest a --init-save-state so it can compare what it added.13:37
Fl1ntbut even with that it doesn't really cleanup everything.13:37
Fl1ntespecially projects/users and ports.13:37
oklhostcurl 7.58.0 is one of our production docker hosts. my dev-build server is also curl 7.58.0 but I was facing the issue when I build prometheus-server, so it must be related to the curl in ubuntu focal13:38
*** jamesbenson has quit IRC13:38
Fl1ntmaybe a compile time options, such as default to follow link on centos13:38
oklhostFl1nt: http://paste.openstack.org/show/802924/ but keep in mind, that build isn't supported in any way, but I think thats not the reason why it fails. After I added -L switch the build went well13:40
Fl1ntoklhost, can you override your Dockerfile to add -vvv to the curl command please?13:41
oklhostsure, just a sec13:41
Fl1ntyep13:41
Fl1ntso we will see if it follows the link13:42
oklhostwithout -L right?13:42
Fl1ntto github CDN13:42
Fl1ntnope13:42
Fl1ntwith -vvv13:42
yoctozeptokevko_: re: apache13:43
yoctozeptodo you mean13:43
yoctozeptothat keystone in apache mod_wsgi13:43
yoctozeptogets stuck13:43
yoctozeptoon vip address move13:44
yoctozeptoand uwsgi does not?13:44
oklhostFl1nt: http://paste.openstack.org/show/802927/13:48
*** jamesbenson has joined #openstack-kolla13:53
jamesbenson@Fl1nt, so run `tempest cleanup --init-saved-state` prior to running my tests?13:55
jamesbensonmy test command is just `refstack-client test -c etc/tempest.conf -v --test-list "https://refstack.openstack.org/api/v1/guidelines/2020.06/tests?target=platform&type=required&alias=true&flag=false"`13:56
jamesbenson@Fl1nt, what's odd/funny? is that if I run that one test independently, it all works.14:01
*** kevko has joined #openstack-kolla14:03
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: Improve trove  releasenote  https://review.opendev.org/c/openstack/kolla-ansible/+/77711314:04
*** amoralej|lunch is now known as amoralej14:05
Fl1ntjamesbenson, Yes, the ALL scenario is a bit messy.14:06
jamesbensonFl1nt, yeah, for me, it's my only issue, maybe I'm lucky!14:07
jamesbensonis there anywhere we need to reference the json that is created from the init-saved-state?14:08
Fl1ntI'm fighting hard with tempest to find a way for the smoke/all test to correctly cleanup behind him...14:08
Fl1ntjamesbenson, can't remember14:08
jamesbensonI can share my settings if you want.  It passes everything except for that cleanup.14:08
kevko_yoctozepto: well, uwsgi didn't stuck ...but as I said ..i installed normal VM with debian buster and copy configs from kolla .. no docker ...so i can't be sure it is apache thing ..14:09
kevko_yoctozepto: now i am going to test centos images - keystone, keepalived ..and will see if same symptom14:09
Fl1ntoklhost, I wanted you to run the curl -vvv -o without -L sorry ^^ here it works.14:09
oklhostFl1nt: [14:42:15]  <oklhost> without -L right? :P14:10
hrwFl1nt: fetching from github without -L is losing14:10
oklhostjust another sec ;-)14:10
Fl1ntoklhost, ooooh so sorry, I didn't read the without :-/14:12
oklhost:D no problem14:12
oklhosthere we go: http://paste.openstack.org/show/802929/14:13
Fl1ntyeah OK, definitely something related to the way distribution compile CURL and probably CentOS and Windows are defaulting to follow link by default.14:14
jamesbensonFl1nt, do you know how tests are incorporated into tempest?  I think that there was a bug fix for my issue, https://review.opendev.org/c/openstack/neutron/+/761498, but not sure how that gets into tempest?  Any insights?14:15
Fl1ntI don't really know, I think it's up to the plugin maintainer but as network is from tempest base, I guess they've to review, test and merge then backport/cherrypick as we do it.14:16
oklhostFl1nt: ack. As I can see, in stable/ussuri the command is "RUN curl -sSL ..."14:19
Fl1ntlet me check on train too.14:20
oklhostsame14:20
oklhostAlso on victoria, it seems the change has be done someday in master14:21
*** vishalmanchanda has quit IRC14:33
oklhostHave to leave now. If it's important that I write a proper bug report, leave me a ping in the query/pm, that way I won't miss it.14:34
*** kevko has quit IRC14:56
openstackgerritcyrille babon proposed openstack/kolla master: add lsscsi due to change in os-brick  https://review.opendev.org/c/openstack/kolla/+/77714214:57
*** kevko has joined #openstack-kolla14:59
parallaxoklhost: https://opendev.org/openstack/kolla/src/branch/master/docker/base/curlrc15:02
parallaxhttps://review.opendev.org/c/openstack/kolla/+/76518515:03
Fl1ntparallax, seems like Ubuntu isn't liking curlrc file maybe?15:03
parallaxmaybe, haven't checked15:03
Fl1ntme neither ^^ I'm on CentOS everywhere :(15:04
Fl1ntWe need more debian and ubuntu reviewer :op15:04
Fl1ntWe need more debian and ubuntu reviewer :p15:04
Fl1nt-_-15:04
Fl1ntdumb irc client...15:04
Fl1ntok team, disconnecting for today, see you later o/15:15
*** Luzi has quit IRC15:15
*** Fl1nt has quit IRC15:15
atmarkI need some pointers to which files I need to override SSL certs if I have keystone and horizon on a separate FQDN other than kolla FQDN15:20
*** wuchunyang has quit IRC15:21
kevko_yoctozepto: hmm, ok I tried to run keystone in uwsgi in kolla env ..and it is stucked also ...15:29
kevko_yoctozepto: so, it has to be something with keepalived, or docker itself :/15:29
yoctozeptokevko_: it's definitely something with keepalived15:45
yoctozeptobut15:45
yoctozeptowhere it works for you15:46
yoctozeptodo you not use keepalived?15:46
kevko_what ?15:46
yoctozeptoI am confused15:46
kevko_yes, i am using ..i am testing VIP failover ..15:46
yoctozeptoyeah, so the difference between working and failing15:46
yoctozeptois docker?15:46
kevko_when i run docker restart keepalived on one controller .. and checking logs ..in that moment it is stucked15:46
kevko_yeah docker, classic kolla env15:47
yoctozeptowhat if you leave everything kolla15:47
yoctozeptoand use keepalived15:47
yoctozeptofrom the base os?15:47
kevko_was wondering about it :D15:47
yoctozeptoack15:47
kevko_let me try ..now i am in my list of tests :D15:48
kevko_i already tested centos ..15:48
kevko_same thing15:48
yoctozeptothough, honestly, I think it should be the same15:48
yoctozeptoI mean15:48
yoctozeptoone runs keepalived15:48
yoctozeptobecause one expects the node to fail15:48
yoctozeptobut perhaps15:48
kevko_sorry, don't understand15:48
yoctozeptoit's not related to the failed one15:48
yoctozeptobut the new one taking over15:48
yoctozeptodon't worry, just thinking "loud"15:49
kevko_but this is very ugly bug if i can give such name for it ..15:49
yoctozeptofugly15:49
kevko_yeah :D15:49
kevko_thanks for new word :D15:50
kevko_a slang term for extreme unattractiveness.15:50
kevko_:D15:50
kevko_wiki said15:50
yoctozeptoit's the f word + ugly15:50
kevko_yeah i saw :D15:51
hrw;D15:56
kevko_what about proxysql btw :P16:00
*** kevko has quit IRC16:02
kevko_yoctozepto: hmm, same16:03
kevko_same with keepalived in OS16:03
kevko_yoctozepto: mi findings ..16:04
kevko_yoctozepto: stucked if running apache or uwsgi16:04
kevko_yoctozepto: stucked also in centos16:04
kevko_yoctozepto: stucked if using keepalived in OS no in docker16:04
kevko_yoctozepto: ^^ when switching VIP16:05
kevko_yoctozepto: not stucked if running keystone on different machines not in docker :/16:05
*** jamesbenson has quit IRC16:09
*** amoralej is now known as amoralej|off16:13
yoctozeptodoes not make sense16:26
openstackgerritMark Goddard proposed openstack/kayobe master: CI: Ubuntu host configure job  https://review.opendev.org/c/openstack/kayobe/+/76975716:33
*** jamesbenson has joined #openstack-kolla16:36
*** bengates has quit IRC16:52
*** gfidente is now known as gfidente|afk16:54
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: OVN: Make OVS db entries idempotent  https://review.opendev.org/c/openstack/kolla-ansible/+/75063116:57
*** jonaspaulo has joined #openstack-kolla17:01
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Fix glance/neutron tls proxy fluentd config  https://review.opendev.org/c/openstack/kolla-ansible/+/77716717:08
*** jamesbenson has quit IRC17:11
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add output printing to host-command-run  https://review.opendev.org/c/openstack/kayobe/+/77647117:14
*** jamesbenson has joined #openstack-kolla17:16
*** jamesbenson has quit IRC17:21
*** jamesbenson has joined #openstack-kolla17:24
*** dougsz has quit IRC17:34
*** jamesbenson has quit IRC17:39
*** rpittau is now known as rpittau|afk17:41
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Ubuntu: support systemd-networkd  https://review.opendev.org/c/openstack/kayobe/+/77650017:42
openstackgerritMark Goddard proposed openstack/kayobe master: Refactor network filter plugins to a Python module  https://review.opendev.org/c/openstack/kayobe/+/77717517:42
openstackgerritMark Goddard proposed openstack/kayobe master: Refactor veth configuration role variable generation  https://review.opendev.org/c/openstack/kayobe/+/77717617:42
*** kevko has joined #openstack-kolla17:43
kevko_hmm, it is definitively something with keepalived :/17:43
*** e0ne has quit IRC17:48
*** k_mouza has quit IRC17:49
*** e0ne has joined #openstack-kolla17:49
*** k_mouza has joined #openstack-kolla17:49
*** jamesbenson has joined #openstack-kolla17:50
*** kevko has quit IRC18:09
yoctozeptokevko_: you have to decide :P18:18
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla-ansible master: [WIP] [CI] Drop the workaround in Masakari client calls  https://review.opendev.org/c/openstack/kolla-ansible/+/77718218:20
*** jamesbenson has quit IRC18:30
*** jamesbenson has joined #openstack-kolla18:31
*** jamesbenson has quit IRC18:40
*** jamesbenson has joined #openstack-kolla18:41
*** jamesbenson has quit IRC18:44
*** jamesbenson has joined #openstack-kolla18:52
*** cah_link has quit IRC19:13
*** k_mouza_ has joined #openstack-kolla19:14
*** k_mouza_ has quit IRC19:17
*** k_mouza has quit IRC19:18
*** ysirndjuro has joined #openstack-kolla19:34
*** andrewbonney has quit IRC19:34
*** kevko_ has quit IRC19:45
*** kevko_ has joined #openstack-kolla19:46
*** gmann is now known as gmann_lunch19:47
*** jamesbenson has quit IRC20:04
*** jamesbenson has joined #openstack-kolla20:05
*** gmann_lunch is now known as gmann20:07
*** jamesbenson has quit IRC20:08
*** kevko_ has quit IRC20:11
*** jonaspaulo has quit IRC20:14
*** jamesbenson has joined #openstack-kolla20:14
*** luksky has quit IRC20:17
*** jamesbenson has quit IRC20:25
*** jamesbenson has joined #openstack-kolla20:26
*** zzzeek has quit IRC20:29
*** luksky has joined #openstack-kolla20:30
*** zzzeek has joined #openstack-kolla20:31
*** kevko_ has joined #openstack-kolla20:48
*** jamesbenson has quit IRC20:59
*** jamesbenson has joined #openstack-kolla21:03
*** k_mouza has joined #openstack-kolla21:18
*** k_mouza has quit IRC21:23
*** maharg101 has quit IRC21:24
*** gfidente|afk has quit IRC21:24
*** jamesbenson has quit IRC21:26
*** jamesbenson has joined #openstack-kolla21:27
*** jamesbenson has quit IRC21:47
*** jamesbenson has joined #openstack-kolla21:48
*** jamesbenson has quit IRC21:55
*** jamesbenson has joined #openstack-kolla21:56
*** kevko_ has quit IRC22:05
*** luksky has quit IRC22:16
openstackgerritMerged openstack/kayobe-config-dev master: Reduce neutron RPC workers to 1  https://review.opendev.org/c/openstack/kayobe-config-dev/+/77707522:19
*** jamesbenson has quit IRC22:31
*** kklimonda_ has quit IRC22:46
*** kklimonda_ has joined #openstack-kolla22:48
*** e0ne has quit IRC22:53
*** jamesbenson has joined #openstack-kolla23:10
*** k_mouza has joined #openstack-kolla23:19
*** maharg101 has joined #openstack-kolla23:21
*** k_mouza has quit IRC23:23
*** maharg101 has quit IRC23:26
*** ysirndjuro has left #openstack-kolla23:35
*** jamesbenson has quit IRC23:36
*** e0ne has joined #openstack-kolla23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!