| *** artom has quit IRC | 00:11 | |
| *** NuxRo has quit IRC | 00:26 | |
| *** NuxRo has joined #rdo | 00:27 | |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/31627 | 00:39 |
|---|---|---|
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for rocky-testing https://review.rdoproject.org/r/31628 | 00:41 |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for stein-testing https://review.rdoproject.org/r/31629 | 00:43 |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for train-testing https://review.rdoproject.org/r/31630 | 00:45 |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for train-8-testing https://review.rdoproject.org/r/31631 | 00:48 |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for ussuri-8-testing https://review.rdoproject.org/r/31632 | 00:50 |
| rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for victoria-8-testing https://review.rdoproject.org/r/31633 | 00:54 |
| *** jdandrea has quit IRC | 01:22 | |
| *** tmazur has quit IRC | 01:23 | |
| *** lbragstad_ is now known as lbragstad | 02:15 | |
| *** cp- has quit IRC | 02:33 | |
| *** nweinber has joined #rdo | 02:34 | |
| *** cp- has joined #rdo | 02:38 | |
| *** nweinber has quit IRC | 02:42 | |
| *** cp- has quit IRC | 02:43 | |
| *** cp- has joined #rdo | 02:45 | |
| *** jmlowe has joined #rdo | 03:36 | |
| *** skramaja has joined #rdo | 03:46 | |
| *** pojadhav|away is now known as pojadhav | 03:47 | |
| *** nijaba- has joined #rdo | 04:52 | |
| *** skramaja_ has joined #rdo | 04:52 | |
| *** nijaba has quit IRC | 04:52 | |
| *** skramaja has quit IRC | 04:52 | |
| *** ykarel has joined #rdo | 04:52 | |
| *** chem has quit IRC | 04:52 | |
| *** chem has joined #rdo | 04:53 | |
| *** mgariepy has quit IRC | 04:53 | |
| *** gfidente|afk has quit IRC | 04:53 | |
| *** tflink has quit IRC | 04:53 | |
| *** tflink_ has joined #rdo | 04:53 | |
| *** mgariepy has joined #rdo | 04:53 | |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for ussuri-8-testing https://review.rdoproject.org/r/31632 | 05:01 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for rocky-testing https://review.rdoproject.org/r/31628 | 05:01 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/31627 | 05:02 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for stein-testing https://review.rdoproject.org/r/31629 | 05:02 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for train-8-testing https://review.rdoproject.org/r/31631 | 05:06 |
| *** zzzeek has quit IRC | 05:41 | |
| *** zzzeek has joined #rdo | 05:42 | |
| *** ysandeep|away is now known as ysandeep | 06:06 | |
| *** rcernin has quit IRC | 06:07 | |
| *** marios has joined #rdo | 06:15 | |
| *** ykarel_ has joined #rdo | 06:16 | |
| *** ykarel has quit IRC | 06:19 | |
| *** lmiccini has joined #rdo | 06:45 | |
| *** ramishra has quit IRC | 06:45 | |
| *** ramishra has joined #rdo | 07:08 | |
| *** tkajinam_ has joined #rdo | 07:19 | |
| *** tkajinam has quit IRC | 07:20 | |
| *** ykarel_ is now known as ykarel | 07:27 | |
| *** aufi has joined #rdo | 07:32 | |
| rdogerrit | Yatin Karel created rdo-infra/ci-config master: Run CentOS8 stream jobs too in puppet master promotion https://review.rdoproject.org/r/31634 | 07:34 |
| rdogerrit | User pojadhav proposed rdo-infra/ci-config master: Now onwards only yaml format supported for promotion criteria files https://review.rdoproject.org/r/31318 | 07:43 |
| *** jcapitao has joined #rdo | 07:49 | |
| *** jpena|off is now known as jpena | 07:52 | |
| rdogerrit | Javier Peña proposed rdoinfo master: Promote ansible-freeipa-0.3.1 to testing https://review.rdoproject.org/r/31609 | 07:57 |
| *** slaweq has joined #rdo | 07:58 | |
| *** jpich has joined #rdo | 07:58 | |
| *** jlibosva has joined #rdo | 08:04 | |
| *** Caterpillar has quit IRC | 08:05 | |
| *** apetrich has joined #rdo | 08:06 | |
| *** amoralej|off is now known as amoralej | 08:07 | |
| *** Caterpillar has joined #rdo | 08:09 | |
| *** rpittau|afk is now known as rpittau | 08:11 | |
| *** Caterpillar has quit IRC | 08:13 | |
| *** tosky has joined #rdo | 08:16 | |
| *** Caterpillar has joined #rdo | 08:21 | |
| *** gfidente has joined #rdo | 08:22 | |
| *** apevec has joined #rdo | 08:22 | |
| *** xek has joined #rdo | 08:31 | |
| rdogerrit | Yatin Karel proposed rdo-infra/ci-config master: Run CentOS8 stream jobs too in puppet master promotion https://review.rdoproject.org/r/31634 | 08:32 |
| ykarel | amoralej, updated | 08:33 |
| amoralej | raukadah, https://review.opendev.org/c/openstack/releases/+/771760 should we remove horizon-tempest from rdo? | 08:37 |
| ykarel | i think he is on pto | 08:37 |
| amoralej | arxcruz, ^ | 08:37 |
| *** hoonetorg has joined #rdo | 08:49 | |
| *** adellam has joined #rdo | 08:59 | |
| rdogerrit | Merged rdo-infra/ci-config master: Run CentOS8 stream jobs too in puppet master promotion https://review.rdoproject.org/r/31634 | 09:11 |
| amoralej | ykarel, i've just disabled all jobs in https://ci.centos.org/view/rdo/view/CloudSIG%20periodic%20validation/ | 09:12 |
| amoralej | we can remove them next week or so | 09:12 |
| *** jpich has quit IRC | 09:26 | |
| *** jpich has joined #rdo | 09:27 | |
| *** xek_ has joined #rdo | 09:34 | |
| *** apevec_ has joined #rdo | 09:34 | |
| *** aufi_ has joined #rdo | 09:34 | |
| *** ykarel_ has joined #rdo | 09:34 | |
| arxcruz | amoralej: checking | 09:36 |
| *** tosky has quit IRC | 09:36 | |
| *** tosky_ has joined #rdo | 09:36 | |
| *** xek has quit IRC | 09:37 | |
| *** apevec has quit IRC | 09:37 | |
| arxcruz | amoralej: i don't recall test horizon in our tests... | 09:37 |
| *** aufi has quit IRC | 09:37 | |
| *** ykarel has quit IRC | 09:37 | |
| ykarel_ | amoralej, okk | 09:39 |
| *** ykarel_ is now known as ykarel | 09:39 | |
| *** tosky_ is now known as tosky | 09:43 | |
| rdogerrit | Sandeep Yadav created rdo-jobs master: [wip] Ansible dependency pipeline https://review.rdoproject.org/r/31635 | 09:45 |
| *** apetrich has quit IRC | 09:45 | |
| *** derekh has joined #rdo | 09:46 | |
| amoralej | ykarel, weirdo jobs are failing now in puppet promotion | 09:47 |
| amoralej | when looking for the image | 09:47 |
| ykarel | amoralej, yeap looking there only | 09:47 |
| ykarel | seems need to remove quotes, trying | 09:48 |
| amoralej | it seems it's messing up with quotes | 09:48 |
| amoralej | yep | 09:48 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for victoria-8-testing https://review.rdoproject.org/r/31633 | 09:50 |
| ykarel | amoralej, without quotes it moved forward. | 09:56 |
| ykarel | but i see only c8 job got triggered | 09:56 |
| amoralej | mmm | 09:56 |
| amoralej | ykarel, in https://ci.centos.org/view/rdo/view/weirdo-pipelines/view/weirdo-promote-test-puppet-centos8/job/weirdo-promote-test-puppet-centos8/2121/ | 09:57 |
| amoralej | i see both | 09:57 |
| ykarel | amoralej, ok then i think it will trigger once c8 finishes, which i doubted initially | 09:58 |
| amoralej | ykarel, so you fixed it manually? | 09:58 |
| ykarel | amoralej, yes | 09:59 |
| rdogerrit | Yatin Karel created rdo-infra/ci-config master: Remove quotes from stream_image https://review.rdoproject.org/r/31636 | 09:59 |
| ykarel | removing with ^ now | 09:59 |
| rdogerrit | Yatin Karel proposed rdo-infra/ci-config master: Remove quotes from stream_image https://review.rdoproject.org/r/31636 | 10:02 |
| ykarel | also dropping frequency until we sort out parallel execution | 10:03 |
| *** adellam has quit IRC | 10:04 | |
| *** adellam has joined #rdo | 10:14 | |
| *** ysandeep is now known as ysandeep|afk | 10:14 | |
| ykarel | amoralej, also https://github.com/openstack/tempest/commit/cd0bbbdad37a31248d479ef78df948da0a1e850e caused issues in promotion jobs | 10:21 |
| *** adellam has quit IRC | 10:22 | |
| ykarel | tempest test fails with unautorized https://logserver.rdoproject.org/ci.centos.org/weirdo-generic-puppet-openstack-scenario001/18199/weirdo-project/logs/testr_results.html | 10:22 |
| *** apetrich has joined #rdo | 10:29 | |
| rdogerrit | Javier Peña proposed rdoinfo master: Promote ansible-freeipa-0.3.1 to testing https://review.rdoproject.org/r/31609 | 10:29 |
| *** adellam has joined #rdo | 10:30 | |
| amoralej | ykarel, jcapitao please don't merge anything in rdoinfo until we get https://review.rdoproject.org/r/#/c/31609/ merged | 10:30 |
| ykarel | ack | 10:31 |
| ykarel | uhh so it was rebased due to conflict? | 10:31 |
| jcapitao | ack | 10:31 |
| ykarel | possibly yes as i merged some periodic updates in -testing | 10:32 |
| jcapitao | ykarel: can't figure out why python-amqp-5.0.2-1.el8 is ignored by dnf in https://review.rdoproject.org/r/#/c/31607/ | 10:33 |
| jcapitao | even though it's available in temp repo https://logserver.rdoproject.org/07/31607/6/check/validate-buildsys-tags/d6d2204/buildset/repos/cloud8-openstack-wallaby-testing/ | 10:34 |
| ykarel | jcapitao, looking | 10:34 |
| ykarel | might be some issue with it | 10:34 |
| amoralej | ykarel, yep victoria-testing | 10:35 |
| ykarel | jcapitao, it's happening due to python3-kombu, u need to update that along | 10:49 |
| ykarel | jcapitao, https://github.com/celery/kombu/blob/v4.6.11/requirements/default.txt#L2 is capped in 4.6.11 | 10:51 |
| jcapitao | ykarel: huuh crap | 10:52 |
| jcapitao | ykarel: how did you get that conlusion ? | 10:52 |
| ykarel | jcapitao, i did some local checks with repoquery --whatrequires python3-amqp and sudo dnf install --repofrompath=tmp,https://logserver.rdoproject.org/07/31607/6/check/validate-buildsys-tags/d6d2204/buildset/repos/cloud8-openstack-wallaby-testing/ --enablerepo=tmp python3-amqp | 10:54 |
| ykarel | and sudo dnf install --repofrompath=tmp,https://logserver.rdoproject.org/07/31607/6/check/validate-buildsys-tags/d6d2204/buildset/repos/cloud8-openstack-wallaby-testing/ --enablerepo=tmp python3-oslo-messaging | 10:54 |
| *** dtantsur|afk is now known as dtantsur | 10:58 | |
| jcapitao | okk, thanks ykarel | 11:03 |
| rdogerrit | Bogdan Dobrelya proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Properly override custom vars for mirrors https://review.rdoproject.org/r/27758 | 11:04 |
| rdogerrit | Joel Capitao proposed rdoinfo master: Promote dependencies updates to wallaby-testing https://review.rdoproject.org/r/31607 | 11:09 |
| ykarel | kopecmartin, hi | 11:10 |
| rdogerrit | Gaël Chamoulaud created openstack/tripleo-validations-distgit rpm-master: Remove useless library/__init__.py file https://review.rdoproject.org/r/31637 | 11:11 |
| ykarel | kopecmartin, post tempest change ttps://review.opendev.org/c/openstack/tempest/+/686073, some of our jobs started failing tempest tests with Unauthorized, can u check what's missing | 11:13 |
| kopecmartin | ykarel: hi, sure | 11:13 |
| kopecmartin | ykarel: do you have a job link handy? | 11:14 |
| ykarel | kopecmartin, https://logserver.rdoproject.org/ci.centos.org/weirdo-generic-puppet-openstack-scenario001/18199/weirdo-project/logs/testr_results.html | 11:14 |
| kopecmartin | never mind | 11:14 |
| kopecmartin | i see the comment | 11:14 |
| ykarel | okk | 11:14 |
| kopecmartin | ykarel: thanks | 11:14 |
| rdogerrit | Gaël Chamoulaud created openstack/tripleo-validations-distgit victoria-rdo: Remove useless library/__init__.py file https://review.rdoproject.org/r/31638 | 11:15 |
| *** rcernin has joined #rdo | 11:23 | |
| *** jcapitao is now known as jcapitao_lunch | 11:26 | |
| rdogerrit | Gaël Chamoulaud created openstack/tripleo-validations-distgit ussuri-rdo: Remove useless library/__init__.py file https://review.rdoproject.org/r/31639 | 11:33 |
| rdogerrit | Gaël Chamoulaud created openstack/tripleo-validations-distgit train-rdo: Remove useless library/__init__.py file https://review.rdoproject.org/r/31640 | 11:35 |
| *** ysandeep|afk is now known as ysandeep | 11:36 | |
| amoralej | ykarel, jobs failed in puppet promotion, but we got the right jobs running | 11:40 |
| amoralej | with the right nodepool_image | 11:41 |
| amoralej | btw, the image has not the last kernel i think | 11:41 |
| amoralej | i mean, stream one | 11:42 |
| amoralej | ykarel, btw, there is proposed fix for https://github.com/openstack/tempest/commit/cd0bbbdad37a31248d479ef78df948da0a1e850e ? | 11:42 |
| ykarel | amoralej, i picked latest image from https://cloud.centos.org/centos/8-stream/x86_64/images/?C=M;O=D | 11:42 |
| amoralej | ok | 11:43 |
| amoralej | not big issue | 11:43 |
| ykarel | wrt tempest fix, none that i am aware off | 11:43 |
| rdogerrit | Merged rdo-infra/ci-config master: Remove quotes from stream_image https://review.rdoproject.org/r/31636 | 11:53 |
| *** rcernin has quit IRC | 11:57 | |
| *** phillw has quit IRC | 12:24 | |
| rdogerrit | Gaël Chamoulaud created openstack/validations-common-distgit train-rdo: [DNM] Remove __init__.py file creation if py2 https://review.rdoproject.org/r/31641 | 12:29 |
| *** jpena is now known as jpena|lunch | 12:30 | |
| *** jpich has quit IRC | 12:38 | |
| *** raildo has joined #rdo | 12:38 | |
| *** jpich has joined #rdo | 12:38 | |
| *** jcapitao_lunch is now known as jcapitao | 12:39 | |
| *** phillw has joined #rdo | 12:40 | |
| *** rlandy has joined #rdo | 12:46 | |
| *** phillw has quit IRC | 12:49 | |
| amoralej | lbragstad, tempest is failing in our puppet jobs after some recent changes in tempest and we have some questions about roles that we should assign to admin user | 12:50 |
| amoralej | ykarel, ^ | 12:50 |
| ykarel | ack | 12:51 |
| dtantsur | hey folks! where can I find IPA build logs for current-tripleo images? | 12:55 |
| dtantsur | it got to our attention that these images don't have firmware included, while upstream IPA-builder images do | 12:56 |
| rdogerrit | Yatin Karel created rdo-jobs master: [DNM] Test latest tempest in tempest component job https://review.rdoproject.org/r/31642 | 12:56 |
| ykarel | dtantsur, which release? | 12:57 |
| ykarel | for master is https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-8-buildimage-ironic-python-agent-master# | 12:57 |
| ykarel | similar jobs for other releases should be there | 12:57 |
| dtantsur | ykarel: https://images.rdoproject.org/centos8/master/rdo_trunk/current-tripleo/ | 12:58 |
| *** ChenSa22 has joined #rdo | 12:58 | |
| ykarel | ok then ^ is the build logs | 12:58 |
| ykarel | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-ironic-python-agent-master/b9d32b3/build.log | 12:59 |
| dtantsur | why is it using the ancient deprecated element? | 12:59 |
| ykarel | no idea | 12:59 |
| * dtantsur wonders if he should propose deletion ironic-agent from DIB to force people to update | 12:59 | |
| ChenSa22 | hi, anyone here knows how to install packstack with lbaas/octavia for the train version? | 12:59 |
| *** rh-jelabarre has joined #rdo | 13:02 | |
| ykarel | ChenSa22, i see octavia support addition is WIP https://review.opendev.org/c/x/packstack/+/669206 and stale for long | 13:06 |
| ykarel | in packstack repo | 13:06 |
| *** tosky has quit IRC | 13:06 | |
| *** tosky has joined #rdo | 13:06 | |
| *** jpich has quit IRC | 13:07 | |
| *** jpich has joined #rdo | 13:08 | |
| ChenSa22 | ykarel firstly thanks for the response, do you know if there is any lbaas service in packstack? according to the documentation there should be but the 'packstack' tool that i installed (centos 7, train release) has no lbaas service at all | 13:09 |
| *** amoralej is now known as amoralej|lunch | 13:09 | |
| ykarel | ChenSa22, before train release there was neutron-lbaas, and with train release it got removed https://review.opendev.org/c/x/packstack/+/658807 | 13:12 |
| ykarel | ChenSa22, btw what docs you following? | 13:14 |
| ykarel | might be out dated | 13:14 |
| ChenSa22 | https://www.rdoproject.org/networking/lbaas/ | 13:14 |
| ykarel | it didn't failed for you with packstack --allinone --os-neutron-lbaas-install=y ? | 13:16 |
| ChenSa22 | it failed | 13:16 |
| ykarel | okk, so doc needs to be updated to be used only before train release | 13:17 |
| dtantsur | how do I change how RDO builds the IPA image? | 13:20 |
| ykarel | what type of changes are needed? at job level? or script https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-ironic-python-agent-master/b9d32b3/build_images.sh ? | 13:21 |
| ykarel | script is at https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images/templates/build-images.sh.j2 | 13:22 |
| *** dmacpher has quit IRC | 13:23 | |
| *** dmacpher has joined #rdo | 13:28 | |
| *** phillw has joined #rdo | 13:29 | |
| *** jpena|lunch is now known as jpena | 13:29 | |
| *** owalsh has quit IRC | 13:48 | |
| ykarel | kopecmartin, i added some more details on what more we found on what caused issues in our jobs | 13:49 |
| ykarel | https://review.opendev.org/c/openstack/tempest/+/686073 | 13:51 |
| ykarel | jpena, do you know if there is way to configure octavia with packstack train | 13:53 |
| jpena | ykarel: no | 13:53 |
| gchamoul | jcapitao: hey Joel, I have a question about validations-common and especially on the train-rdo branch | 13:53 |
| ykarel | jpena, okk | 13:54 |
| jpena | ykarel: I know there was some interest in the past to add support, but it never happened | 13:54 |
| ykarel | jpena, yes i found a WIP patch https://review.opendev.org/c/x/packstack/+/669206 | 13:54 |
| gchamoul | jcapitao: you've added the creation of the __init__.py file when py2. I would like to get rid of it once the unittests passed | 13:55 |
| ykarel | ChenSa22, if you would like you could try tripleo standalone that have some octavia support https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario010-standalone.yaml#L8 | 13:55 |
| gchamoul | jcapitao: I am thinking about excluding this file in the %file section but I think it will do that recursively, right ? | 13:55 |
| *** phillw has quit IRC | 13:58 | |
| jcapitao | gchamoul: you mean it will remove all __init__.py found ? | 13:59 |
| gchamoul | jcapitao: no just the one in validations_common/library/ we create during the %prep | 14:00 |
| gchamoul | https://review.rdoproject.org/r/gitweb?p=openstack/validations-common-distgit.git;a=blob;f=validations-common.spec;h=909c5414daddcf796c02e75c1b09f81e8fc5a978;hb=d0208f8f25fa2dd4f0ac295c7533ec1e586a00ee#l67 | 14:01 |
| rdogerrit | Javier Peña created rdo-jobs master: Fix missing quote in rpmbuild-rpm-packaging job https://review.rdoproject.org/r/31643 | 14:02 |
| jcapitao | gchamoul: sorry I didn't get the recursive impact | 14:02 |
| gchamoul | the issue is that we have a file conflict between tripleo-validations and validations-common | 14:02 |
| rdogerrit | Riccardo Pittau created openstack/ironicclient-distgit rpm-master: Update requirements https://review.rdoproject.org/r/31644 | 14:03 |
| lbragstad | amoralej|lunch sure - what's up? | 14:04 |
| jcapitao | gchamoul: okk, I guess the best option would be to exclude that file in %files | 14:04 |
| gchamoul | jcapitao: a simple %exclude %{_datadir}/ansible/library/__init__.py ? | 14:05 |
| *** amoralej|lunch is now known as amoralej | 14:05 | |
| jcapitao | gchamoul: right | 14:05 |
| gchamoul | ok some I misread the rpm doc then :D | 14:06 |
| ykarel | amoralej, it reproduced in tripleo too as expected:- https://logserver.rdoproject.org/42/31642/1/check/periodic-tripleo-ci-centos-8-standalone-tempest-master/2298679/logs/undercloud/var/log/tempest/stestr_results.html.gz | 14:06 |
| amoralej | good | 14:07 |
| ykarel | sshnaidm|ruck, akahat|rover fyi ^ you will see in next tempest component run ^ | 14:07 |
| jcapitao | gchamoul: so is this the reason the init file was not ship in tarball archive ? | 14:07 |
| amoralej | lbragstad, after last changes in tempest, tempest is failing both in tripleo and puppet jobs with unauthorized error | 14:07 |
| amoralej | https://logserver.rdoproject.org/ci.centos.org/weirdo-generic-puppet-openstack-scenario001/18208/weirdo-project/logs/testr_results.html | 14:07 |
| amoralej | https://logserver.rdoproject.org/42/31642/1/check/periodic-tripleo-ci-centos-8-standalone-tempest-master/2298679/logs/undercloud/var/log/tempest/stestr_results.html.gz | 14:08 |
| *** owalsh has joined #rdo | 14:08 | |
| gchamoul | jcapitao: it was needed but we still have to support py2 | 14:08 |
| amoralej | lbragstad, it seems that now tempest is trying to get a token with domain scope instead of project for admin | 14:08 |
| gchamoul | it wasn't needed | 14:08 |
| amoralej | but there there is no role granted for admin | 14:08 |
| amoralej | in default | 14:09 |
| *** jdandrea has joined #rdo | 14:09 | |
| gchamoul | jcapitao: I cleaned it tripleo-validations as well, and it works in train-rdo without this file | 14:09 |
| amoralej | we've checked that running openstack role add admin --user admin --domain default fixes it | 14:09 |
| amoralej | but i'm not sure if that's the appropiate fix | 14:09 |
| amoralej | or tempest is doing something wrong | 14:10 |
| *** ykarel is now known as ykarel|mtg | 14:10 | |
| gchamoul | jcapitao: I will patch the train-spec like you did for validations-common | 14:10 |
| amoralej | we've found that devstack is doing that | 14:10 |
| jcapitao | gchamoul: ok good | 14:10 |
| rdogerrit | Riccardo Pittau created openstack/ironic-distgit rpm-master: Update requirements https://review.rdoproject.org/r/31645 | 14:10 |
| amoralej | https://github.com/openstack/devstack/blob/8e74a617df7d53732c1ef395a97479ce58122731/lib/keystone#L321 | 14:10 |
| rdogerrit | Gaël Chamoulaud proposed openstack/validations-common-distgit train-rdo: Exclude __init__.py file from the %file section https://review.rdoproject.org/r/31641 | 14:10 |
| *** phillw has joined #rdo | 14:13 | |
| lbragstad | amoralej ok - do you know what tempest is doing with the domain-scoped tokens? | 14:14 |
| lbragstad | like what tests does it use that with? | 14:14 |
| rdogerrit | Riccardo Pittau created openstack/ironic-inspector-client-distgit rpm-master: Update requirements https://review.rdoproject.org/r/31646 | 14:15 |
| amoralej | lbragstad, it seems the issue is in https://review.opendev.org/c/openstack/tempest/+/686073/10/tempest/lib/common/dynamic_creds.py#b147 | 14:17 |
| lbragstad | oh - sure | 14:17 |
| amoralej | it's in _get_admin_clients | 14:18 |
| amoralej | so in the setup part i guess, all tests fail | 14:18 |
| lbragstad | tempest recently merged some changes that allow services to use a variety of personas (each default role combined with each scope) | 14:19 |
| lbragstad | and then it supplies those clients to the tests | 14:19 |
| rdogerrit | Riccardo Pittau created openstack/ironic-inspector-distgit rpm-master: Update requirements https://review.rdoproject.org/r/31647 | 14:19 |
| lbragstad | afaik nothing really uses the domain scope clients, which is fine, but that might change in the future | 14:19 |
| amoralej | would it be safe to assign role to admin user to default domain? | 14:22 |
| amoralej | in fact, the actual problem is in how it checks the config options | 14:22 |
| amoralej | mmm | 14:22 |
| amoralej | to define domain or project scope ii uc | 14:22 |
| rdogerrit | Merged rdo-jobs master: Fix missing quote in rpmbuild-rpm-packaging job https://review.rdoproject.org/r/31643 | 14:22 |
| rdogerrit | Gaël Chamoulaud created openstack/tripleo-validations-distgit train-rdo: Create __init__.py file in library directory https://review.rdoproject.org/r/31648 | 14:23 |
| lbragstad | amoralej where do you do the assignment? | 14:23 |
| lbragstad | amoralej is there something that setups the tests for rdo? | 14:24 |
| amoralej | puppet-keystone is what does keystone bootstrap | 14:24 |
| amoralej | creates admin user, role and all that | 14:24 |
| amoralej | that's what you mean? | 14:24 |
| lbragstad | ok - that makes sense | 14:24 |
| lbragstad | i think so? | 14:24 |
| lbragstad | i'm wondering if there is an rdo-specific thing that does some sort of test setup | 14:25 |
| lbragstad | before tempest runs | 14:25 |
| amoralej | we use packstack and puppet-openstack-integration | 14:25 |
| amoralej | but it's also failing in tripleo | 14:25 |
| amoralej | so puppet-keystone for deploy keystone and puppet-tempest or tempestconf to configure tempest | 14:25 |
| *** markmcclain has quit IRC | 14:26 | |
| lbragstad | maybe https://github.com/openstack/puppet-tempest/blob/master/manifests/init.pp is the right place? | 14:26 |
| amoralej | to assign the role to the user? | 14:27 |
| lbragstad | right | 14:27 |
| amoralej | so, that's something we only want to do in tempest case? | 14:27 |
| amoralej | i mean, not a desirable default config? | 14:27 |
| amoralej | to add to puppet-keystone | 14:27 |
| lbragstad | well - the tempest clients are what requires that assignment to exist | 14:27 |
| amoralej | ok | 14:27 |
| lbragstad | in keystone-manage bootstrap - we add the admin role to the admin user on the admin project (yeah, we're great at naming), and we add the admin role to the admin user on the system | 14:28 |
| rdogerrit | Merged rdoinfo master: Promote ansible-freeipa-0.3.1 to testing https://review.rdoproject.org/r/31609 | 14:28 |
| lbragstad | which takes care of some of the project and system clients that tempest needs | 14:28 |
| amoralej | lbragstad, is there any way to test that out of tempest? | 14:28 |
| *** artom has joined #rdo | 14:28 | |
| amoralej | i mean request a token with domain scope | 14:28 |
| amoralej | with openstack cli | 14:29 |
| lbragstad | sure - let me grab you a paste | 14:29 |
| lbragstad | one sec | 14:29 |
| amoralej | ok, nice | 14:29 |
| spotz | jpena: I'm going to send yesterday's meeting to the list and then I'll do the patch. Need to bring up the log for the action items:) | 14:30 |
| jpena | spotz: it should be http://eavesdrop.openstack.org/meetings/rdo_meeting___2021_01_20/2021/rdo_meeting___2021_01_20.2021-01-20-14.00.html | 14:31 |
| rdogerrit | Riccardo Pittau created openstack/ironic-python-agent-builder-distgit rpm-master: Update Requirements https://review.rdoproject.org/r/31649 | 14:31 |
| jpena | Oops, I forgot to send the mails! | 14:31 |
| spotz | jpena yep I got it | 14:31 |
| spotz | And no worries sending it now | 14:32 |
| spotz | sent | 14:33 |
| lbragstad | amoralej ok - so this is the default clouds.yaml file i have with my tripleo deployment | 14:36 |
| lbragstad | http://paste.openstack.org/show/801820/ | 14:36 |
| lbragstad | i created a new user to show how to give a role to someone on a domain http://paste.openstack.org/show/801821/ | 14:36 |
| lbragstad | then i added a new profile to my clouds.yaml specifically for domain-scope http://paste.openstack.org/show/801822/ | 14:36 |
| lbragstad | and you can test it using either the profile or the normal arguments http://paste.openstack.org/show/801823/ | 14:37 |
| amoralej | lbragstad, ok, thanks! | 14:37 |
| lbragstad | ^ but that last paste shows how you can ask keystone for a domain-scoped token | 14:37 |
| lbragstad | amoralej if we fix this in puppet-tempest, that should address things in tripleo, right? | 14:38 |
| amoralej | i'm not sure, tbh, i think they use tempestconf | 14:39 |
| amoralej | but i'm not sure if they also use puppet-tempest | 14:39 |
| amoralej | ykarel|mtg, ^ | 14:39 |
| *** zul has joined #rdo | 14:40 | |
| ykarel|mtg | amoralej, also https://review.opendev.org/c/openstack/tempest/+/771817/2/tempest/lib/common/dynamic_creds.py should fix the current issue | 14:41 |
| ykarel|mtg | yes tempestconf is used in tripleo | 14:41 |
| amoralej | ykarel|mtg, i was checking your patch in the test server | 14:41 |
| amoralej | and yep, it works | 14:42 |
| ykarel|mtg | yes i tried that before suggesting | 14:42 |
| amoralej | lbragstad, ^ it seems we may have a better fix in tempest itself | 14:43 |
| * ykarel|mtg will back read above in a bit once out of mtg | 14:44 | |
| rdogerrit | Yatin Karel proposed rdo-jobs master: [DNM] Test latest tempest in tempest component job https://review.rdoproject.org/r/31642 | 14:46 |
| *** markmcclain has joined #rdo | 14:46 | |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 14:49 | |
| *** TrevorV has joined #rdo | 14:50 | |
| rdogerrit | Merged openstack/ironic-distgit rpm-master: Update requirements https://review.rdoproject.org/r/31645 | 14:51 |
| *** nweinber has joined #rdo | 14:54 | |
| *** elade has joined #rdo | 15:05 | |
| elade | Hi... can anyone jelp me understand why "networking-ovn-metadata-agent" does not appear in "openstack network agent list" ? Everything seems to be in order (no error messages in logfiles) but it just won't show up. | 15:07 |
| amoralej | slaweq, ^ | 15:08 |
| *** ykarel|mtg is now known as ykarel | 15:08 | |
| *** ccamposr has joined #rdo | 15:10 | |
| rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Add missing required projects https://review.rdoproject.org/r/31601 | 15:13 |
| slaweq | elade: I'm not sure TBH but maybe jlibosva will know better as he is one of our ovn experts :) | 15:17 |
| rdogerrit | User spotz created rdo-website master: Last meeting added https://review.rdoproject.org/r/31650 | 15:17 |
| *** deselby has quit IRC | 15:20 | |
| *** irclogbot_1 has quit IRC | 15:21 | |
| *** irclogbot_3 has joined #rdo | 15:23 | |
| *** rh-jelabarre has quit IRC | 15:27 | |
| *** ccamposr has quit IRC | 15:28 | |
| *** skramaja_ has quit IRC | 15:28 | |
| *** deselby has joined #rdo | 15:30 | |
| *** rh-jelabarre has joined #rdo | 15:31 | |
| jlibosva | elade: hi, can you give the output of "ovn-sbctl list chassis" executed from ovn_controller container? | 15:37 |
| elade | jlibosva thanks - here it is http://paste.openstack.org/show/801832/ so I have one node which is the ovn controller and the first compute node , and another node which has everything else of openstack. | 15:41 |
| jlibosva | elade: ok, so the reason why the agent doesn't appear there is that ovn-controller (the one you have) doesn't know about the metadata agent | 15:44 |
| jlibosva | elade: otherwise it would be there in the external_ids | 15:44 |
| jlibosva | elade: is the metadata agent up and running on the host1.com? can you see any errors in the metadata agent logs? | 15:45 |
| *** apevec_ is now known as apevec | 15:46 | |
| jlibosva | elade: also note that you have just one ovn-controller - which is kind of unusual unless you want to host your gateways on the compute node | 15:48 |
| elade | Yes the gateways are the compute nodes. Yes the agent seems fine. No I couldn't find any error message. | 15:49 |
| apevec | spotz, amoralej - wdyt about recording AMA? Not sure if that's GDPR-compliant... | 15:52 |
| spotz | apevec: We could ask attendees at the beginning if they were ok with it? | 15:53 |
| amoralej | apevec, i guess we'd need to ask all users explicitely | 15:53 |
| spotz | We could also offer if anyone didn't want to ask in the recording that a select few of us would be here for them to message their questions and we would pass them on | 15:54 |
| spotz | In hundsight we probably could have streamed this on openshift.tv | 15:55 |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 15:56 | |
| apevec | spotz, amoralej - "slides" I prepared is https://etherpad.opendev.org/p/RDO-Stream-AMA :) | 15:57 |
| apevec | spotz, could you share it please during AMA, my Meet screen sharing is broken | 15:57 |
| spotz | apevec: Can do | 15:58 |
| elade | @jlibosva - Yes the gateways are the compute nodes. Yes "systemctl status neutron-ovn-metadata-agent.service" seems find . No I couldn't find any error message in /var/log/neutron/neutron-ovn-metadata-agent.log | 15:58 |
| apevec | amoralej, spotz - as I'll be talking, if you can please add questions there as they come | 15:58 |
| apevec | so we can followup if needed | 15:59 |
| amoralej | ok | 15:59 |
| * apevec jumps from current call to AMA Meet | 15:59 | |
| amoralej | we can request users to add their questions there too | 15:59 |
| spotz | Annd we can do an attendde list there as well | 15:59 |
| amoralej | yeap, that'd be good | 16:00 |
| rdogerrit | Sagi Shnaidman proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add fedora 33 and rawhide for reproducer https://review.rdoproject.org/r/31389 | 16:01 |
| rdogerrit | Sagi Shnaidman proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add fedora 33 and rawhide for reproducer https://review.rdoproject.org/r/31389 | 16:01 |
| *** apevec is now known as apevec_AMA | 16:03 | |
| jlibosva | elade: can you see "SbGlobalUpdateEvent" events in the metadata log? | 16:06 |
| elade | jlibosva | 16:07 |
| elade | 2021-01-21 18:04:39.554 1128035 DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched UPDATE: SbGlobalUpdateEvent(events=('update',), table='SB_Global', conditions=None, old_conditions=None) to row=SB_Global(ipsec=False, ssl=[], nb_cfg=1423, options={'mac_prefix': 'b6:58:c3', 'max_tunid': '16711680', 'northd_internal_version': '20.09.0-2.11.0-51.0', | 16:07 |
| elade | 'svc_monitor_mac': 'd2:82:18:b1:32:fc'}, external_ids={}) old=SB_Global(nb_cfg=1422) matches /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/event.py:44 | 16:07 |
| *** tmazur has joined #rdo | 16:08 | |
| jlibosva | elade: there should be DbSetCommand after that | 16:08 |
| elade | 2021-01-21 18:08:21.582 1128035 DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Chassis_Private, record=dafe0f55-cf4b-4e6e-a295-64b42d3935d5, col_values=(('external_ids', {'neutron:ovn-metadata-sb-cfg': '1426'}),)) do_commit /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:8 | 16:10 |
| elade | jlibosva | 16:10 |
| jlibosva | elade: aah, ok. so it uses chassis_private table (it's with newer ovn). Can you also pastebin the output of "ovn-sbctl list chassis_private" ? | 16:12 |
| jlibosva | elade: is this an updated environment? | 16:13 |
| elade | http://paste.openstack.org/show/801835/ jlibosva it is Ussuri. Things worked great for a while and then we had some minor catastrophe | 16:14 |
| jlibosva | elade: hmm, this seems fine. the metadata agent is there | 16:17 |
| jlibosva | elade: neutron-server is running on how many nodes? | 16:18 |
| jlibosva | elade: I wonder if it's possible that you updated OVN while neutron-server was kept running | 16:19 |
| elade | jlibosva It is possible that I updated OVN while netron-server was kept running:-) There is only one neutron-server on the host which is not host1.com | 16:21 |
| elade | jlibosnva I'm pretty sure I did 'systemctl restart' several times. not good enough? | 16:21 |
| *** pojadhav is now known as pojadhav|away | 16:23 | |
| jlibosva | elade: you did restart for neutron-server? that should be enough | 16:26 |
| jlibosva | elade: I have a patch fixing this that has some dependencies https://review.opendev.org/c/openstack/neutron/+/760967 | 16:27 |
| jlibosva | elade: this is the lp bug https://bugs.launchpad.net/neutron/+bug/1901527 | 16:27 |
| openstack | Launchpad bug 1901527 in neutron "Agent API gets broken if OVN DB is upgraded to the one introducing chassis_private" [Medium,In progress] - Assigned to Jakub Libosvar (libosvar) | 16:27 |
| elade | @jlibosva yes I used "systemctl restart neutron-server" several times since and once again | 16:27 |
| *** ysandeep is now known as ysandeep|away | 16:31 | |
| elade | jlibosva I'll see if I can apply it | 16:37 |
| jlibosva | elade: if restarting neutron-server doesn't help you then it must be a different issue | 16:38 |
| jlibosva | elade: how did you deploy? | 16:38 |
| elade | @jlibosva - huh so I will not apply. It started as "rdo packstack all in one" over CentOS8 inside a VM. and then I added a few CentOS89 compute nodes. | 16:39 |
| *** aufi_ has quit IRC | 16:40 | |
| jlibosva | elade: if you do "systemctl stop neutron-server" and then grep for neutron-server running (e.g. ps -ef | grep neutron-server), can you see any process still running? | 16:40 |
| elade | @jlibosva . "systemctl stop neutron-server" and then grep for neutron-server running. there are no process still running. | 16:42 |
| *** apevec_AMA is now known as apevec | 16:44 | |
| spotz | apevac I'll track down the recording and sharing features on it to post to the centos-ev, and our users and dev lists. If needed I'll move it to my google account | 16:44 |
| *** marios is now known as marios|out | 16:44 | |
| apevec | thanks spotz | 16:44 |
| apevec | sorry about my bad connection, /me blames family doing Zoom at the same time | 16:45 |
| spotz | Once you moved it was great | 16:45 |
| apevec | yeah, also need more Unifi APs :) | 16:45 |
| * apevec goes to buy some with WFH budget | 16:45 | |
| jlibosva | elade: is this your prod environment or would it be possible to share a tmate session and add a few debug statements in the neutron server? | 16:46 |
| jlibosva | elade: or maybe I can share a patch with you that you could apply | 16:47 |
| *** lmiccini has quit IRC | 16:47 | |
| elade | @jlibosva tmate would be cool. I never used it and i'm behind a proxy but I guess I can make it work. | 16:48 |
| *** lmiccini has joined #rdo | 16:49 | |
| jlibosva | elade: that would be fantastic. I'm almost wrapping up my day but if we can try that out tomorrow I'd be happy to help | 16:49 |
| elade | jlibosva sure what time would that be? | 16:50 |
| jlibosva | elade: I usually start around 9am UTC | 16:50 |
| elade | jlibosva I'll try to ping you then there. thanks alot. | 16:52 |
| *** elade95 has joined #rdo | 16:53 | |
| jlibosva | elade: sounds good. thank to you | 16:54 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: Run centos 8 streamdeps jobs on centos 8 stream nodes https://review.rdoproject.org/r/31500 | 16:54 |
| jlibosva | thanks* | 16:54 |
| *** elade has quit IRC | 16:57 | |
| *** jpena is now known as jpena|off | 16:59 | |
| *** marios|out has quit IRC | 17:03 | |
| *** adellam has quit IRC | 17:04 | |
| *** jlibosva has quit IRC | 17:04 | |
| *** adellam has joined #rdo | 17:04 | |
| *** ChenSa22 has quit IRC | 17:08 | |
| *** pojadhav|away is now known as pojadhav | 17:08 | |
| *** elade95 has quit IRC | 17:08 | |
| *** ykarel has quit IRC | 17:09 | |
| *** lmiccini has quit IRC | 17:10 | |
| *** ykarel has joined #rdo | 17:11 | |
| *** amoralej is now known as amoralej|off | 17:11 | |
| *** ykarel has quit IRC | 17:17 | |
| *** jcapitao has quit IRC | 17:21 | |
| *** bandini has quit IRC | 17:23 | |
| *** jpich has quit IRC | 17:24 | |
| *** gfidente is now known as gfidente|afk | 17:29 | |
| *** ccamposr has joined #rdo | 17:41 | |
| *** rpittau is now known as rpittau|afk | 17:42 | |
| *** rlandy is now known as rlandy|biab | 17:43 | |
| apevec | looking now over RDO website, we might need to update also https://www.rdoproject.org/rdo/release-cadence/ | 17:43 |
| apevec | to include W | 17:44 |
| apevec | also "supported" might give wrong expectation, more correct would be "(CI) tested on" | 17:44 |
| *** rcernin has joined #rdo | 17:54 | |
| *** rcernin has quit IRC | 17:59 | |
| *** cp- has quit IRC | 17:59 | |
| rdogerrit | Merged rdo-infra/ci-config master: Now onwards only yaml format supported for promotion criteria files https://review.rdoproject.org/r/31318 | 18:02 |
| *** cp- has joined #rdo | 18:08 | |
| *** frenzy_friday has quit IRC | 18:11 | |
| *** frenzy_friday has joined #rdo | 18:12 | |
| *** cp- has quit IRC | 18:14 | |
| *** cp- has joined #rdo | 18:30 | |
| *** dtantsur is now known as dtantsur|afk | 18:32 | |
| *** amoralej|off is now known as amoralej | 18:40 | |
| *** rlandy|biab is now known as rlandy | 18:41 | |
| *** ccamposr__ has joined #rdo | 18:42 | |
| *** ccamposr has quit IRC | 18:44 | |
| rdogerrit | Merged rdo-jobs master: Run centos 8 streamdeps jobs on centos 8 stream nodes https://review.rdoproject.org/r/31500 | 18:51 |
| *** amoralej is now known as amoralej|off | 19:24 | |
| *** adellam has quit IRC | 19:25 | |
| *** haleyb has quit IRC | 19:27 | |
| *** haleyb has joined #rdo | 19:28 | |
| *** xek_ has quit IRC | 19:30 | |
| *** xek_ has joined #rdo | 19:31 | |
| *** slaweq has quit IRC | 19:55 | |
| *** ccamposr has joined #rdo | 20:12 | |
| *** irclogbot_3 has quit IRC | 20:14 | |
| *** tosky has quit IRC | 20:14 | |
| *** ccamposr__ has quit IRC | 20:15 | |
| *** tosky has joined #rdo | 20:15 | |
| *** irclogbot_0 has joined #rdo | 20:17 | |
| *** nweinber has quit IRC | 21:11 | |
| *** TrevorV has quit IRC | 21:12 | |
| *** rlandy is now known as rlandy|biab | 21:17 | |
| *** nweinber has joined #rdo | 21:20 | |
| *** owalsh has quit IRC | 21:26 | |
| *** derekh has quit IRC | 21:37 | |
| *** raildo has quit IRC | 21:41 | |
| *** owalsh has joined #rdo | 21:44 | |
| *** nweinber has quit IRC | 21:49 | |
| *** jdandrea has quit IRC | 21:52 | |
| *** rcernin has joined #rdo | 21:54 | |
| *** rcernin has quit IRC | 21:59 | |
| *** xek_ has quit IRC | 22:05 | |
| *** derekh has joined #rdo | 22:06 | |
| *** derekh has quit IRC | 22:06 | |
| *** owalsh has quit IRC | 22:16 | |
| *** rlandy|biab is now known as rlandy | 22:20 | |
| *** owalsh has joined #rdo | 22:25 | |
| *** rcernin has joined #rdo | 22:38 | |
| *** rcernin has quit IRC | 22:56 | |
| *** rcernin has joined #rdo | 22:57 | |
| *** jobewan has joined #rdo | 22:58 | |
| *** paramite|clone has quit IRC | 23:01 | |
| *** apevec has quit IRC | 23:07 | |
| *** holser has quit IRC | 23:17 | |
| *** holser has joined #rdo | 23:19 | |
| *** rlandy has quit IRC | 23:26 | |
| *** holser has quit IRC | 23:35 | |
| *** tmazur has quit IRC | 23:48 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!