*** brinzhang_ has quit IRC | 00:14 | |
*** jamesbenson has joined #openstack-kolla | 00:14 | |
*** brinzhang has joined #openstack-kolla | 00:14 | |
*** jamesbenson has quit IRC | 00:18 | |
*** ricolin_ has joined #openstack-kolla | 00:20 | |
*** ricolin_ has quit IRC | 00:22 | |
*** rohit02 has joined #openstack-kolla | 00:57 | |
*** rohit02 has quit IRC | 01:01 | |
*** rohit02 has joined #openstack-kolla | 01:02 | |
*** xinliang has joined #openstack-kolla | 01:19 | |
*** benj_ has quit IRC | 01:53 | |
*** benj_ has joined #openstack-kolla | 01:54 | |
*** rohit02 has quit IRC | 02:16 | |
*** rohit02 has joined #openstack-kolla | 02:16 | |
*** rohit02 has quit IRC | 02:21 | |
*** rohit02 has joined #openstack-kolla | 02:22 | |
*** LinPeiWen has joined #openstack-kolla | 02:25 | |
*** ricolin has quit IRC | 03:15 | |
*** ricolin has joined #openstack-kolla | 03:30 | |
*** xinliang has quit IRC | 04:05 | |
*** cah_link has joined #openstack-kolla | 04:44 | |
*** cah_link has quit IRC | 05:27 | |
*** LinPeiWen has quit IRC | 06:18 | |
*** vishalmanchanda has joined #openstack-kolla | 06:24 | |
*** cah_link has joined #openstack-kolla | 06:39 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: ovn: Move openvswitch related tasks to openvswitch role https://review.opendev.org/c/openstack/kolla-ansible/+/776421 | 06:39 |
---|---|---|
*** LinPeiWen has joined #openstack-kolla | 06:43 | |
*** zzzeek has quit IRC | 06:45 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Move from ceph-ansible to cephadm https://review.opendev.org/c/openstack/kolla-ansible/+/771418 | 06:45 |
*** zzzeek has joined #openstack-kolla | 06:46 | |
*** xinliang has joined #openstack-kolla | 07:03 | |
*** brinzhang has quit IRC | 07:13 | |
*** maharg101 has joined #openstack-kolla | 07:19 | |
*** zzzeek has quit IRC | 07:39 | |
*** zzzeek has joined #openstack-kolla | 07:40 | |
*** gfidente|afk is now known as gfidente | 07:52 | |
*** andrewbonney has joined #openstack-kolla | 08:06 | |
*** bengates has joined #openstack-kolla | 08:16 | |
*** luksky has quit IRC | 08:17 | |
*** e0ne has joined #openstack-kolla | 08:27 | |
*** rpittau|afk is now known as rpittau | 08:28 | |
*** luksky has joined #openstack-kolla | 08:29 | |
*** luksky has quit IRC | 08:49 | |
*** dougsz has joined #openstack-kolla | 08:49 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/victoria: Update IPA docs and test build with extra-hardware https://review.opendev.org/c/openstack/kayobe/+/776947 | 08:49 |
openstackgerrit | Rico Lin proposed openstack/kolla master: add openstack-python3-wallaby-jobs-arm64 job https://review.opendev.org/c/openstack/kolla/+/777062 | 08:51 |
*** luksky has joined #openstack-kolla | 09:02 | |
openstackgerrit | Merged openstack/kolla-ansible master: docs: Add information on tuning Ansible https://review.opendev.org/c/openstack/kolla-ansible/+/758205 | 09:11 |
*** LinPeiWen has quit IRC | 09:16 | |
*** k_mouza has joined #openstack-kolla | 09:27 | |
*** xinliang has quit IRC | 09:27 | |
*** xinliang has joined #openstack-kolla | 09:28 | |
*** nikparasyr has joined #openstack-kolla | 09:29 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Reduce neutron RPC workers to 1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/777075 | 09:29 |
openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Reduce ironic minimum required memory to 256MB https://review.opendev.org/c/openstack/kayobe-config-dev/+/777076 | 09:29 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: CI: Reduce neutron RPC service workers to 1 https://review.opendev.org/c/openstack/kolla-ansible/+/777077 | 09:30 |
*** skramaja has joined #openstack-kolla | 09:34 | |
*** kevko has joined #openstack-kolla | 10:14 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/victoria: Add ipa_build_upper_constraints_file variable https://review.opendev.org/c/openstack/kayobe/+/775935 | 10:18 |
*** LinPeiWen has joined #openstack-kolla | 10:19 | |
*** xinliang has quit IRC | 10:19 | |
openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Register Elasticsearch in Keystone https://review.opendev.org/c/openstack/kolla-ansible/+/744121 | 10:25 |
*** rohit02 has quit IRC | 10:28 | |
*** kevko_ has joined #openstack-kolla | 10:40 | |
*** k_mouza has quit IRC | 10:49 | |
*** k_mouza has joined #openstack-kolla | 10:59 | |
*** rpittau is now known as rpittau|bbl | 11:00 | |
*** kevko_ has quit IRC | 11:05 | |
*** Luzi has joined #openstack-kolla | 11:13 | |
*** kevko_ has joined #openstack-kolla | 11:15 | |
kevko | hi, is here a reason why some services using apache's mode wsgi ? in kolla ? | 11:16 |
kevko | yesterday I found weird behaviour when switching VIP adress ... when I removed apache and run under uwsgi ... it was smooth | 11:17 |
kevko | can share a video .. | 11:17 |
yoctozepto | kevko: the reason is historical | 11:25 |
yoctozepto | and then we implemented tls with apache | 11:25 |
yoctozepto | so it stuck :D | 11:25 |
yoctozepto | how is apache relevant to the vip issue? | 11:26 |
kevko_ | yoctozepto: i really don't know , but when i am restarting keepalived and VIP is switching between two controllers ...one of controller is broken somehow ..no traffic going to this controller..and after while apache start to report 503 | 11:30 |
kevko_ | yoctozepto: check a video -> https://download.kevko.ultimum.cloud/video_debug.mp4 | 11:32 |
kevko_ | yoctozepto: from top to bottom , left controller0, right controller1 | 11:32 |
kevko_ | yoctozepto: first windows just monitoring keystone health via docker ps and grep, second window i am checking where I have VIP currently assigned (switching by keepalived restart in background ) ....and bottom window I am tailing logs from keystone ... | 11:33 |
kevko_ | yoctozepto: it's visible that right after VIP is switched ... server where VIP was is somehow broken ... | 11:34 |
kevko_ | yoctozepto: when I install two another nodes (manually) and not using apache ..but uswgi ... working like a charm .. | 11:34 |
kevko_ | last thing what i need to to say is that another keystones without apache i installed manually and not in docker ..but pure debian buster .. | 11:35 |
kevko_ | so, there is a bug somewhere i think ..in docker, or in apache ..but as you can see ..it is weird | 11:35 |
kevko_ | i'm trying to resolve this issue because we are facing this on client site | 11:36 |
*** kevko has quit IRC | 11:43 | |
kevko_ | yoctozepto: have u seen it already ? maybe i am trying to fix something what is already fixed (or it is known problem) ..so please ..could you check and let me know ? | 11:43 |
kevko_ | it's just 3minutes :) | 11:43 |
kevko_ | using ussuri | 11:43 |
*** brinzhang has joined #openstack-kolla | 11:43 | |
*** brinzhang has quit IRC | 11:45 | |
*** nikparasyr has left #openstack-kolla | 11:48 | |
mgoddard | kevko_: have you tried enabling more logging in keystone and apache? | 11:55 |
kevko_ | mgoddard: nope.. but i don't think i will see something more .. | 11:56 |
kevko_ | mgoddard: did you see behaviour ? | 11:56 |
mgoddard | kevko_: I know that VIP failover is not entirely smooth, but haven't looked for that specific problem | 11:57 |
kevko_ | mgoddard: well, i will investigate .. | 11:57 |
kevko_ | mgoddard, yoctozepto: will you be against when I implement the optional uwsgi in kolla / k-a ? Of course with SSL | 11:59 |
*** skramaja has quit IRC | 11:59 | |
mgoddard | kevko_: I'd rather we fixed apache | 11:59 |
kevko_ | i mean, user will be able to choose if he wants apache or uwsgi implementation | 11:59 |
kevko_ | mgoddard: well, of course i will investigate it ... but doesn't make more sense to use uswgi ? Apache for me looks like a pretty big cannon | 12:00 |
mgoddard | kevko_: we debated apache vs. uwsgi during the backend TLS work and decided to go for apache. There were reasons, but I probably won't remember them all | 12:01 |
*** mrunge_ has joined #openstack-kolla | 12:01 | |
*** mrunge has quit IRC | 12:02 | |
kevko_ | so, does it mean that it is impassable ? I mean, if I propose patch for optional uswgi, you will not merge ..right ? | 12:03 |
mgoddard | kevko_: I would personally be -1 | 12:04 |
mgoddard | kevko_: it's just additional complexity | 12:05 |
kevko_ | mgoddard: understand .. | 12:05 |
kevko_ | mgoddard: Openstack is complex :P | 12:05 |
mgoddard | exactly | 12:06 |
kevko_ | kolla can't be simple :P | 12:06 |
mgoddard | it's not simple, but I think it does a reasonable job of being as simple as it can | 12:06 |
mgoddard | kevko_: you've seen how hard it can be to get enough reviewer time to merge feature patches. Is this the best use of that time? | 12:07 |
mgoddard | kevko_: not to mention your own time to build it | 12:07 |
*** jamesbenson has joined #openstack-kolla | 12:08 | |
kevko_ | yes, i know :), need to recruit more reviewers :D | 12:09 |
kevko_ | my time is irrelevant, I like it :) | 12:09 |
mgoddard | kevko_: if you can find more reviewers, please do | 12:09 |
mgoddard | kevko_: FWIW, each cycle we generate a list of 'priorities' based on community feedback | 12:09 |
mgoddard | kevko_: https://etherpad.opendev.org/p/KollaWhiteBoard | 12:09 |
mgoddard | L251 | 12:09 |
mgoddard | they are in order of priority for each project | 12:10 |
mgoddard | if you have time to work on things, those are some things people have asked for | 12:10 |
mgoddard | many don't have an owner | 12:10 |
mgoddard | kevko_: we need this one: Cinder removing v2 API | 12:11 |
mgoddard | kevko_: although to be honest code reviews are more in demand than code | 12:12 |
kevko_ | will try to do more review .. | 12:14 |
kevko_ | *s | 12:14 |
mgoddard | kevko_: always appreciated | 12:14 |
kevko_ | mgoddard: btw, in whiteboard there is mariadb-ssl-support (7 votes) ... this can be implemented smoothly after proxysql will be merged :P :D | 12:17 |
mgoddard | kevko_: look forward to it | 12:18 |
*** LinPeiWen has quit IRC | 12:23 | |
*** kevko has joined #openstack-kolla | 12:24 | |
*** Fl1nt has joined #openstack-kolla | 12:25 | |
Fl1nt | Good afternoon everyone! | 12:25 |
Fl1nt | amoralej, hi ! quick question, are your still part of RDO contributors/devs ? | 12:26 |
amoralej | yes, i'm at RDO | 12:27 |
Fl1nt | perfect! I'd like to know if repository used for CentOS 8 can be used with Stream? | 12:27 |
amoralej | Fl1nt, you mean repo of RDO? | 12:28 |
Fl1nt | like, for now, RDO is mostly based on: http://mirror.centos.org/centos/8/cloud/ & http://mirror.centos.org/centos/8/HighAvailability/ & http://mirror.centos.org/centos/8/messaging/ & http://mirror.centos.org/centos/8/storage/ & http://mirror.centos.org/centos/8/virt/ when creating openstack platform on CentOS 8 based. | 12:29 |
amoralej | Fl1nt, we are creating specific repos for Centos Stream | 12:30 |
amoralej | i.e. http://mirror.centos.org/centos/8-stream/cloud/x86_64/ | 12:30 |
Fl1nt | ok, is there pre-alpha public repositories available or is that still something under discussion? | 12:30 |
amoralej | we currently have for victoria | 12:30 |
Fl1nt | amoralej, perfect! thanks | 12:30 |
amoralej | but :) | 12:30 |
amoralej | some sigs are not shipped there yet | 12:31 |
Fl1nt | But it lacks Packages :p | 12:31 |
amoralej | Fl1nt, tbh the content is the same | 12:31 |
amoralej | and we are testing it with both centos8 and centos8 stream | 12:32 |
Fl1nt | ok so let say I'm on a staging/lab I can use CentOS-8 repos. | 12:32 |
amoralej | yes, mostly | 12:32 |
Fl1nt | ok, perfect | 12:32 |
amoralej | at some point, you will just need to do dnf install centos-release-openstack-victoria | 12:33 |
amoralej | and it will configure youre repos apropiatedly | 12:33 |
amoralej | but it's still WIP | 12:33 |
Fl1nt | I can't ^^ hence why I know where the packages came from :p | 12:33 |
Fl1nt | I'm on an airgapped zone, so additionals repositories can't be installed using dnf install epel-release or centos-release-openstack-victoria. | 12:34 |
Fl1nt | well, you still can, but the yum repo files installed wont work so it doesn't matter, I just put appropriate CentOS/EPEL internal repo URLs ^^ that avoid me two step workflow. | 12:35 |
amoralej | ah, ok | 12:35 |
amoralej | so you mirror those repos internally | 12:35 |
Fl1nt | but that still something interesting for my own personnal dev usage ^^ | 12:35 |
*** mrunge_ is now known as mrunge | 12:36 | |
amoralej | my advice for stream is to clone both /8/ and /8-stream/ | 12:36 |
amoralej | use 8-stream where available | 12:36 |
amoralej | and fallback to 8 | 12:36 |
Fl1nt | yes, we clone the whole internet, then scans it through security scrutinity and then approve or not their usage. | 12:36 |
amoralej | at some point everything should be in 8-stream | 12:36 |
amoralej | but it will take some time | 12:36 |
Fl1nt | sure no problems as long as I know it now ^^ | 12:36 |
Fl1nt | hence why I asked you I knew you would be helpful :p | 12:37 |
amoralej | glad to help :) | 12:37 |
Fl1nt | thanks a lot ^^ | 12:37 |
Fl1nt | mgoddard, quick question for you too, I've seen a lot roles don't rely on the same "workflow" to create the services volumes when required, what is the recommended way? Using what's on the common role: https://opendev.org/openstack/kolla-ansible/src/commit/e744b9d510ba183d5a80b3e467d0e764eb5c9e02/ansible/roles/common/tasks/bootstrap.yml | 12:38 |
Fl1nt | or something else? | 12:38 |
mgoddard | Fl1nt: it happens automatically if you create a container that mounts a named volume | 12:39 |
mgoddard | Fl1nt: in that case there is a symlink, so it's done separately | 12:40 |
Fl1nt | ok, so let say I want to patch tempest to get a real docker volume using docker_runtime_directory instead of a bind to node_config_directory what would be the most efficient way? | 12:41 |
Fl1nt | because, from my understanding, this task do it https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/tasks/check-containers.yml using either default https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/defaults/main.yml#L10 | 12:43 |
Fl1nt | or your own override | 12:43 |
Fl1nt | but currently, it doesn't create docker volume, it create a host <-> container bind. | 12:44 |
Fl1nt | I currently need two extra_volumes on tempest, one named reports, one named testlink. Reports hold for tempest HTML reports that are later one transfered on a specific long term storage zone. Testlink is a temporary volume used to introspect tempest scenarios (tests) and send them to a test manager named testlink. | 12:46 |
mgoddard | Fl1nt: tbh I don't really use the tempest container, I just use a python venv | 12:49 |
mgoddard | Fl1nt: the default volumes are here: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/defaults/main.yml#L23 | 12:50 |
Fl1nt | ok, can I patch our current role then? There is some tasks to be patched such as the tempest.conf source list etc | 12:50 |
mgoddard | you should keep all of those | 12:50 |
mgoddard | you can define extra volumes via tempest_extra_volumes | 12:50 |
Fl1nt | yes I keep the default, my issue is with the extra_volumes that are mount with bind instead of volumes. | 12:50 |
mgoddard | tempest_extra_volumes: | 12:51 |
Fl1nt | yes | 12:51 |
mgoddard | - tempest_reports:/path/to/reports | 12:51 |
mgoddard | - tempest_testlink:/path/to/testlink | 12:51 |
mgoddard | it's the same as for 'docker run' - use a name for a named volume | 12:52 |
*** kevko has quit IRC | 12:52 | |
Fl1nt | aaaaaaah got the trick! | 12:52 |
Fl1nt | ok, the tempest_extra_volumes: can be named volumes! | 12:52 |
Fl1nt | perfect | 12:52 |
Fl1nt | I currently had: | 12:54 |
Fl1nt | tempest_extra_volumes: | 12:54 |
Fl1nt | - "{{ node_config_directory }}/tempest/reports:/var/lib/tempest/reports | 12:54 |
Fl1nt | - "{{ node_config_directory }}/tempest/testlink:/var/lib/tempest/testlink | 12:54 |
Fl1nt | which explain why it's using bind | 12:54 |
Fl1nt | ok, I'll test using named volumes. | 12:55 |
Fl1nt | but I'll still patch that missing sources options on https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/tempest/tasks/config.yml#L32 | 12:56 |
Fl1nt | As for now the tempest.conf need to be on etc/kolla/ where it should actually also be available on /etc/kolla/tempest/tempest.conf as nova is doing it with nova/{{ item.key }}.conf | 12:58 |
openstackgerrit | Piotr Parczewski proposed openstack/kolla-ansible master: Add Neutron DHCP agent to OVN networking setup https://review.opendev.org/c/openstack/kolla-ansible/+/774222 | 12:58 |
mgoddard | Fl1nt: I think it's fine as it is. There is only one tempest service, so no need for a per-service override | 12:58 |
*** amoralej is now known as amoralej|lunch | 13:00 | |
Fl1nt | it's just that it is the only service that is locating its config file at kolla config root directory, more a "visual" patch than something else, but many of my ops feedbacks noticed that "inconsistency", | 13:00 |
Fl1nt | even when I explain that (only one service) they don't really understand/enjoy/whatever they feel about ^^ | 13:01 |
*** rpittau|bbl is now known as rpittau | 13:01 | |
Fl1nt | and it would be more consistent with other services, so they'll stop bothering me with this question/suggestion and I'll stop loosing time explaining them or pointing out to the internal doc about that. | 13:02 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Ubuntu: fix deployment image build https://review.opendev.org/c/openstack/kayobe/+/772929 | 13:03 |
Fl1nt | last question, more related to the review workflow, is there a specific day/workflow for patches to be merged on master once reviewed/validated? | 13:10 |
oklhost | https://opendev.org/openstack/kolla/src/branch/master/docker/prometheus/prometheus-v2-server/Dockerfile.j2#L13 seems not working without -L switch to follow redirects. | 13:18 |
*** wuchunyang has joined #openstack-kolla | 13:21 | |
Fl1nt | oklhost, works for me | 13:21 |
oklhost | w00t?! | 13:22 |
oklhost | Fl1nt: sorry, I've forgotten to say - try to uncompress | 13:23 |
Fl1nt | yep, 61.3Mb and files | 13:23 |
oklhost | Thats strange | 13:24 |
Fl1nt | https://github.com/prometheus/prometheus/releases/download/v2.23.0/prometheus-2.23.0.linux-amd64.tar.gz are you able to curl -o manually ? | 13:25 |
hrw | Fl1nt: 2021-02-23 14:25:58 (14,3 MB/s) - zapisano `prometheus-2.23.0.linux-amd64.tar.gz' [64298432/64298432] | 13:26 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/victoria: Add ipa_build_upper_constraints_file variable https://review.opendev.org/c/openstack/kayobe/+/775935 | 13:26 |
oklhost | Fl1nt: yes, 640B | 13:26 |
Fl1nt | Meh? I've got 64MB | 13:26 |
jamesbenson | I have a tempest question too if anyone could help :-) Everything passes except for tearing down of tempest.api.compute.servers.test_multiple_create.MultipleCreateTestJSON, because there are still ports it can't delete. What am I missing in the config to get this test to work? | 13:27 |
Fl1nt | ok, which base oklhost ? CentOS or Ubuntu? | 13:27 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/ussuri: Add ipa_build_upper_constraints_file variable https://review.opendev.org/c/openstack/kayobe/+/775386 | 13:27 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Add ipa_build_upper_constraints_file variable https://review.opendev.org/c/openstack/kayobe/+/775965 | 13:28 |
Fl1nt | jamesbenson, tempest is dumb at ressource housekeeping, it can't keep track of its own puppets... I've the same issue, remaining orphaned ressources and full of race condition everywhere... | 13:28 |
oklhost | Fl1nt: ubuntu-source, well, my build isn't really representative, but I realized it when I played a bit around to build for our victoria deployment (yeah, i know - thats why i said it's not representative) | 13:28 |
oklhost | but I tried the same curl on different linux as well as macos hosts with the same result | 13:29 |
Fl1nt | oklhost, I'm on CentOS Binary and victoria too on staging. | 13:29 |
Fl1nt | my CentOS curl is doing it fine, the windows one too | 13:30 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/ussuri: Fix IPA build on stable/ussuri https://review.opendev.org/c/openstack/kayobe/+/775936 | 13:30 |
oklhost | Fl1nt: well, maybe a curl version issue? ubuntu: curl 7.68.0 (x86_64-pc-linux-gnu, macos: curl 7.75.0 (arm-apple-darwin20.3.0) | 13:31 |
oklhost | Don't have any centos to verify | 13:31 |
Fl1nt | let me check that | 13:31 |
oklhost | +1 | 13:32 |
Fl1nt | 7.61.1 on CentOS | 13:32 |
oklhost | Hm... funny | 13:33 |
Fl1nt | 7.55.1 on Windows | 13:33 |
Fl1nt | hrw, your curl is right, 64MB not 640B ;-) | 13:34 |
Fl1nt | 64298432 <-- those are bytes not bits | 13:35 |
oklhost | Okay... same with curl 7.58.0 running on ubuntu bionic | 13:35 |
Fl1nt | what is your docker host? | 13:35 |
Fl1nt | jamesbenson, what can help with those race condition is giving tempest a --init-save-state so it can compare what it added. | 13:37 |
Fl1nt | but even with that it doesn't really cleanup everything. | 13:37 |
Fl1nt | especially projects/users and ports. | 13:37 |
oklhost | curl 7.58.0 is one of our production docker hosts. my dev-build server is also curl 7.58.0 but I was facing the issue when I build prometheus-server, so it must be related to the curl in ubuntu focal | 13:38 |
*** jamesbenson has quit IRC | 13:38 | |
Fl1nt | maybe a compile time options, such as default to follow link on centos | 13:38 |
oklhost | Fl1nt: http://paste.openstack.org/show/802924/ but keep in mind, that build isn't supported in any way, but I think thats not the reason why it fails. After I added -L switch the build went well | 13:40 |
Fl1nt | oklhost, can you override your Dockerfile to add -vvv to the curl command please? | 13:41 |
oklhost | sure, just a sec | 13:41 |
Fl1nt | yep | 13:41 |
Fl1nt | so we will see if it follows the link | 13:42 |
oklhost | without -L right? | 13:42 |
Fl1nt | to github CDN | 13:42 |
Fl1nt | nope | 13:42 |
Fl1nt | with -vvv | 13:42 |
yoctozepto | kevko_: re: apache | 13:43 |
yoctozepto | do you mean | 13:43 |
yoctozepto | that keystone in apache mod_wsgi | 13:43 |
yoctozepto | gets stuck | 13:43 |
yoctozepto | on vip address move | 13:44 |
yoctozepto | and uwsgi does not? | 13:44 |
oklhost | Fl1nt: http://paste.openstack.org/show/802927/ | 13:48 |
*** jamesbenson has joined #openstack-kolla | 13:53 | |
jamesbenson | @Fl1nt, so run `tempest cleanup --init-saved-state` prior to running my tests? | 13:55 |
jamesbenson | my test command is just `refstack-client test -c etc/tempest.conf -v --test-list "https://refstack.openstack.org/api/v1/guidelines/2020.06/tests?target=platform&type=required&alias=true&flag=false"` | 13:56 |
jamesbenson | @Fl1nt, what's odd/funny? is that if I run that one test independently, it all works. | 14:01 |
*** kevko has joined #openstack-kolla | 14:03 | |
openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: Improve trove releasenote https://review.opendev.org/c/openstack/kolla-ansible/+/777113 | 14:04 |
*** amoralej|lunch is now known as amoralej | 14:05 | |
Fl1nt | jamesbenson, Yes, the ALL scenario is a bit messy. | 14:06 |
jamesbenson | Fl1nt, yeah, for me, it's my only issue, maybe I'm lucky! | 14:07 |
jamesbenson | is there anywhere we need to reference the json that is created from the init-saved-state? | 14:08 |
Fl1nt | I'm fighting hard with tempest to find a way for the smoke/all test to correctly cleanup behind him... | 14:08 |
Fl1nt | jamesbenson, can't remember | 14:08 |
jamesbenson | I can share my settings if you want. It passes everything except for that cleanup. | 14:08 |
kevko_ | yoctozepto: well, uwsgi didn't stuck ...but as I said ..i installed normal VM with debian buster and copy configs from kolla .. no docker ...so i can't be sure it is apache thing .. | 14:09 |
kevko_ | yoctozepto: now i am going to test centos images - keystone, keepalived ..and will see if same symptom | 14:09 |
Fl1nt | oklhost, I wanted you to run the curl -vvv -o without -L sorry ^^ here it works. | 14:09 |
oklhost | Fl1nt: [14:42:15] <oklhost> without -L right? :P | 14:10 |
hrw | Fl1nt: fetching from github without -L is losing | 14:10 |
oklhost | just another sec ;-) | 14:10 |
Fl1nt | oklhost, ooooh so sorry, I didn't read the without :-/ | 14:12 |
oklhost | :D no problem | 14:12 |
oklhost | here we go: http://paste.openstack.org/show/802929/ | 14:13 |
Fl1nt | yeah OK, definitely something related to the way distribution compile CURL and probably CentOS and Windows are defaulting to follow link by default. | 14:14 |
jamesbenson | Fl1nt, do you know how tests are incorporated into tempest? I think that there was a bug fix for my issue, https://review.opendev.org/c/openstack/neutron/+/761498, but not sure how that gets into tempest? Any insights? | 14:15 |
Fl1nt | I don't really know, I think it's up to the plugin maintainer but as network is from tempest base, I guess they've to review, test and merge then backport/cherrypick as we do it. | 14:16 |
oklhost | Fl1nt: ack. As I can see, in stable/ussuri the command is "RUN curl -sSL ..." | 14:19 |
Fl1nt | let me check on train too. | 14:20 |
oklhost | same | 14:20 |
oklhost | Also on victoria, it seems the change has be done someday in master | 14:21 |
*** vishalmanchanda has quit IRC | 14:33 | |
oklhost | Have to leave now. If it's important that I write a proper bug report, leave me a ping in the query/pm, that way I won't miss it. | 14:34 |
*** kevko has quit IRC | 14:56 | |
openstackgerrit | cyrille babon proposed openstack/kolla master: add lsscsi due to change in os-brick https://review.opendev.org/c/openstack/kolla/+/777142 | 14:57 |
*** kevko has joined #openstack-kolla | 14:59 | |
parallax | oklhost: https://opendev.org/openstack/kolla/src/branch/master/docker/base/curlrc | 15:02 |
parallax | https://review.opendev.org/c/openstack/kolla/+/765185 | 15:03 |
Fl1nt | parallax, seems like Ubuntu isn't liking curlrc file maybe? | 15:03 |
parallax | maybe, haven't checked | 15:03 |
Fl1nt | me neither ^^ I'm on CentOS everywhere :( | 15:04 |
Fl1nt | We need more debian and ubuntu reviewer :op | 15:04 |
Fl1nt | We need more debian and ubuntu reviewer :p | 15:04 |
Fl1nt | -_- | 15:04 |
Fl1nt | dumb irc client... | 15:04 |
Fl1nt | ok team, disconnecting for today, see you later o/ | 15:15 |
*** Luzi has quit IRC | 15:15 | |
*** Fl1nt has quit IRC | 15:15 | |
atmark | I need some pointers to which files I need to override SSL certs if I have keystone and horizon on a separate FQDN other than kolla FQDN | 15:20 |
*** wuchunyang has quit IRC | 15:21 | |
kevko_ | yoctozepto: hmm, ok I tried to run keystone in uwsgi in kolla env ..and it is stucked also ... | 15:29 |
kevko_ | yoctozepto: so, it has to be something with keepalived, or docker itself :/ | 15:29 |
yoctozepto | kevko_: it's definitely something with keepalived | 15:45 |
yoctozepto | but | 15:45 |
yoctozepto | where it works for you | 15:46 |
yoctozepto | do you not use keepalived? | 15:46 |
kevko_ | what ? | 15:46 |
yoctozepto | I am confused | 15:46 |
kevko_ | yes, i am using ..i am testing VIP failover .. | 15:46 |
yoctozepto | yeah, so the difference between working and failing | 15:46 |
yoctozepto | is docker? | 15:46 |
kevko_ | when i run docker restart keepalived on one controller .. and checking logs ..in that moment it is stucked | 15:46 |
kevko_ | yeah docker, classic kolla env | 15:47 |
yoctozepto | what if you leave everything kolla | 15:47 |
yoctozepto | and use keepalived | 15:47 |
yoctozepto | from the base os? | 15:47 |
kevko_ | was wondering about it :D | 15:47 |
yoctozepto | ack | 15:47 |
kevko_ | let me try ..now i am in my list of tests :D | 15:48 |
kevko_ | i already tested centos .. | 15:48 |
kevko_ | same thing | 15:48 |
yoctozepto | though, honestly, I think it should be the same | 15:48 |
yoctozepto | I mean | 15:48 |
yoctozepto | one runs keepalived | 15:48 |
yoctozepto | because one expects the node to fail | 15:48 |
yoctozepto | but perhaps | 15:48 |
kevko_ | sorry, don't understand | 15:48 |
yoctozepto | it's not related to the failed one | 15:48 |
yoctozepto | but the new one taking over | 15:48 |
yoctozepto | don't worry, just thinking "loud" | 15:49 |
kevko_ | but this is very ugly bug if i can give such name for it .. | 15:49 |
yoctozepto | fugly | 15:49 |
kevko_ | yeah :D | 15:49 |
kevko_ | thanks for new word :D | 15:50 |
kevko_ | a slang term for extreme unattractiveness. | 15:50 |
kevko_ | :D | 15:50 |
kevko_ | wiki said | 15:50 |
yoctozepto | it's the f word + ugly | 15:50 |
kevko_ | yeah i saw :D | 15:51 |
hrw | ;D | 15:56 |
kevko_ | what about proxysql btw :P | 16:00 |
*** kevko has quit IRC | 16:02 | |
kevko_ | yoctozepto: hmm, same | 16:03 |
kevko_ | same with keepalived in OS | 16:03 |
kevko_ | yoctozepto: mi findings .. | 16:04 |
kevko_ | yoctozepto: stucked if running apache or uwsgi | 16:04 |
kevko_ | yoctozepto: stucked also in centos | 16:04 |
kevko_ | yoctozepto: stucked if using keepalived in OS no in docker | 16:04 |
kevko_ | yoctozepto: ^^ when switching VIP | 16:05 |
kevko_ | yoctozepto: not stucked if running keystone on different machines not in docker :/ | 16:05 |
*** jamesbenson has quit IRC | 16:09 | |
*** amoralej is now known as amoralej|off | 16:13 | |
yoctozepto | does not make sense | 16:26 |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: CI: Ubuntu host configure job https://review.opendev.org/c/openstack/kayobe/+/769757 | 16:33 |
*** jamesbenson has joined #openstack-kolla | 16:36 | |
*** bengates has quit IRC | 16:52 | |
*** gfidente is now known as gfidente|afk | 16:54 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN: Make OVS db entries idempotent https://review.opendev.org/c/openstack/kolla-ansible/+/750631 | 16:57 |
*** jonaspaulo has joined #openstack-kolla | 17:01 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Fix glance/neutron tls proxy fluentd config https://review.opendev.org/c/openstack/kolla-ansible/+/777167 | 17:08 |
*** jamesbenson has quit IRC | 17:11 | |
openstackgerrit | Michal Nasiadka proposed openstack/kayobe master: Add output printing to host-command-run https://review.opendev.org/c/openstack/kayobe/+/776471 | 17:14 |
*** jamesbenson has joined #openstack-kolla | 17:16 | |
*** jamesbenson has quit IRC | 17:21 | |
*** jamesbenson has joined #openstack-kolla | 17:24 | |
*** dougsz has quit IRC | 17:34 | |
*** jamesbenson has quit IRC | 17:39 | |
*** rpittau is now known as rpittau|afk | 17:41 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Ubuntu: support systemd-networkd https://review.opendev.org/c/openstack/kayobe/+/776500 | 17:42 |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: Refactor network filter plugins to a Python module https://review.opendev.org/c/openstack/kayobe/+/777175 | 17:42 |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: Refactor veth configuration role variable generation https://review.opendev.org/c/openstack/kayobe/+/777176 | 17:42 |
*** kevko has joined #openstack-kolla | 17:43 | |
kevko_ | hmm, it is definitively something with keepalived :/ | 17:43 |
*** e0ne has quit IRC | 17:48 | |
*** k_mouza has quit IRC | 17:49 | |
*** e0ne has joined #openstack-kolla | 17:49 | |
*** k_mouza has joined #openstack-kolla | 17:49 | |
*** jamesbenson has joined #openstack-kolla | 17:50 | |
*** kevko has quit IRC | 18:09 | |
yoctozepto | kevko_: you have to decide :P | 18:18 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [WIP] [CI] Drop the workaround in Masakari client calls https://review.opendev.org/c/openstack/kolla-ansible/+/777182 | 18:20 |
*** jamesbenson has quit IRC | 18:30 | |
*** jamesbenson has joined #openstack-kolla | 18:31 | |
*** jamesbenson has quit IRC | 18:40 | |
*** jamesbenson has joined #openstack-kolla | 18:41 | |
*** jamesbenson has quit IRC | 18:44 | |
*** jamesbenson has joined #openstack-kolla | 18:52 | |
*** cah_link has quit IRC | 19:13 | |
*** k_mouza_ has joined #openstack-kolla | 19:14 | |
*** k_mouza_ has quit IRC | 19:17 | |
*** k_mouza has quit IRC | 19:18 | |
*** ysirndjuro has joined #openstack-kolla | 19:34 | |
*** andrewbonney has quit IRC | 19:34 | |
*** kevko_ has quit IRC | 19:45 | |
*** kevko_ has joined #openstack-kolla | 19:46 | |
*** gmann is now known as gmann_lunch | 19:47 | |
*** jamesbenson has quit IRC | 20:04 | |
*** jamesbenson has joined #openstack-kolla | 20:05 | |
*** gmann_lunch is now known as gmann | 20:07 | |
*** jamesbenson has quit IRC | 20:08 | |
*** kevko_ has quit IRC | 20:11 | |
*** jonaspaulo has quit IRC | 20:14 | |
*** jamesbenson has joined #openstack-kolla | 20:14 | |
*** luksky has quit IRC | 20:17 | |
*** jamesbenson has quit IRC | 20:25 | |
*** jamesbenson has joined #openstack-kolla | 20:26 | |
*** zzzeek has quit IRC | 20:29 | |
*** luksky has joined #openstack-kolla | 20:30 | |
*** zzzeek has joined #openstack-kolla | 20:31 | |
*** kevko_ has joined #openstack-kolla | 20:48 | |
*** jamesbenson has quit IRC | 20:59 | |
*** jamesbenson has joined #openstack-kolla | 21:03 | |
*** k_mouza has joined #openstack-kolla | 21:18 | |
*** k_mouza has quit IRC | 21:23 | |
*** maharg101 has quit IRC | 21:24 | |
*** gfidente|afk has quit IRC | 21:24 | |
*** jamesbenson has quit IRC | 21:26 | |
*** jamesbenson has joined #openstack-kolla | 21:27 | |
*** jamesbenson has quit IRC | 21:47 | |
*** jamesbenson has joined #openstack-kolla | 21:48 | |
*** jamesbenson has quit IRC | 21:55 | |
*** jamesbenson has joined #openstack-kolla | 21:56 | |
*** kevko_ has quit IRC | 22:05 | |
*** luksky has quit IRC | 22:16 | |
openstackgerrit | Merged openstack/kayobe-config-dev master: Reduce neutron RPC workers to 1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/777075 | 22:19 |
*** jamesbenson has quit IRC | 22:31 | |
*** kklimonda_ has quit IRC | 22:46 | |
*** kklimonda_ has joined #openstack-kolla | 22:48 | |
*** e0ne has quit IRC | 22:53 | |
*** jamesbenson has joined #openstack-kolla | 23:10 | |
*** k_mouza has joined #openstack-kolla | 23:19 | |
*** maharg101 has joined #openstack-kolla | 23:21 | |
*** k_mouza has quit IRC | 23:23 | |
*** maharg101 has quit IRC | 23:26 | |
*** ysirndjuro has left #openstack-kolla | 23:35 | |
*** jamesbenson has quit IRC | 23:36 | |
*** e0ne has joined #openstack-kolla | 23:53 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!