| *** marios is now known as marios|ruck | 06:04 | |
| rdogerrit | User karolinku created rdo-infra/ci-config master: Add new dashboard https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46047 | 07:35 |
|---|---|---|
| slaweq | hi rdo team, can You review https://review.rdoproject.org/r/c/openstack/whitebox-neutron-tempest-plugin-distgit/+/45917 so we can move on with that new package? Thx in advance | 07:55 |
| *** amoralej|off is now known as amoralej | 08:11 | |
| *** jpena|off is now known as jpena | 08:23 | |
| rdogerrit | Jakob Meng created rdo-infra/ci-config master: Prepare support for multiple Ansible inventories https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 08:46 |
| *** ysandeep|out is now known as ysandeep | 08:54 | |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple Ansible inventories https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 08:54 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 09:08 |
| rdogerrit | Jakob Meng created rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 09:09 |
| slaweq | amoralej: hi, can You review and approve hopefully patch https://review.rdoproject.org/r/c/openstack/whitebox-neutron-tempest-plugin-distgit/+/45917 ? | 09:30 |
| slaweq | thx in advance for help | 09:30 |
| *** dviroel|biab is now known as dviroel | 09:36 | |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 09:37 |
| amoralej | slaweq, merging it | 09:38 |
| rdogerrit | Merged openstack/whitebox-neutron-tempest-plugin-distgit rpm-master: Initial import of spec file https://review.rdoproject.org/r/c/openstack/whitebox-neutron-tempest-plugin-distgit/+/45917 | 09:43 |
| rdogerrit | Jakob Meng created rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 09:44 |
| amoralej | tkajinam, i'm hitting an issue with p-o-i scenario001 job in Zed release promotion | 09:47 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 09:48 |
| tkajinam | amoralej, I'll have a look. do you care you share the link for logs ? | 09:48 |
| amoralej | tempest tests are consistently failing, and i'd say it's related to performance or something | 09:48 |
| amoralej | tkajinam, https://logserver.rdoproject.org/65/45965/2/check/validate-buildsys-tags-zed-release-puppet-scenario001-centos9/77f6d6f/logs/weirdo-project/logs/testr_results.html | 09:48 |
| amoralej | i think the actual error is | 09:49 |
| amoralej | https://logserver.rdoproject.org/65/45965/2/check/validate-buildsys-tags-zed-release-puppet-scenario001-centos9/77f6d6f/logs/weirdo-project/logs/vitrage/persistor.txt.gz | 09:49 |
| tkajinam | hmm. vitrage | 09:49 |
| amoralej | it doesn't fail with master or even in zed RDO Trunk | 09:49 |
| amoralej | i'd think it may be related to slow infra or something but it only fails with this particular release | 09:50 |
| amoralej | mmmm i may be able to test it in upstream ci infra, lemme take a look | 09:50 |
| *** bbezak_ is now known as bbezak | 09:51 | |
| *** bbezak is now known as Guest1060 | 09:52 | |
| *** dviroel is now known as dviroel|doc-appt | 09:52 | |
| *** Guest1060 is now known as bbezak | 09:56 | |
| tkajinam | https://review.opendev.org/c/openstack/puppet-openstack-integration/+/863883 | 09:57 |
| tkajinam | amoralej, ^^^ this is the patch to switch the RDO release used in stable/zed. probably you can create an additional change to check the same content | 09:58 |
| tkajinam | to see whether the issue can be reproduced | 09:58 |
| tkajinam | what I've learned from the log is that vitrage is failing to persist the alaram because of db lock | 09:58 |
| tkajinam | which is causing the failure when tempest tries to query the alarm | 09:59 |
| amoralej | yes, that's also my understanding | 10:00 |
| amoralej | tkajinam, you have not seem similar issues in upstream jobs, right? | 10:01 |
| tkajinam | you are correct. I've never seen it so far | 10:01 |
| tkajinam | either in master or zed | 10:02 |
| amoralej | https://review.rdoproject.org/zuul/builds?job_name=validate-buildsys-tags-zed-release-puppet-scenario001-centos9&skip=0 | 10:02 |
| amoralej | i started seeing it some days ago ... | 10:02 |
| amoralej | i'll keep investigating | 10:02 |
| amoralej | dunno if i could enable some debug mode in db or something like that | 10:02 |
| apevec | is Vitrage itself still active/maintained? | 10:10 |
| amoralej | apevec, at least they are cutting branches and creating releases | 10:11 |
| amoralej | but not many relevant reviews https://review.opendev.org/q/project:openstack/vitrage | 10:11 |
| tkajinam | yeah | 10:15 |
| apevec | would anyone even notice if we dropped it from p-o-i ? | 10:16 |
| tkajinam | we probably can propose dropping a few puppet modules for such projects | 10:16 |
| amoralej | it's not a big issue, probably, but note that jobs in p-o-i and in promotion pipelines with rdo trunk are passing | 10:17 |
| amoralej | it's just failing in this particular case, CloudSIG Zed | 10:17 |
| amoralej | and i'm not sure why, maybe vitrage is specially sensitive to perf issues, dunno | 10:18 |
| amoralej | i'll try to hold a node and rerun | 10:18 |
| *** ysandeep is now known as ysandeep|out | 10:43 | |
| rdogerrit | Sławek Kapłoński created rdoinfo master: Promote whitebox-neutron-tempest-plugin from under-review to anthelope https://review.rdoproject.org/r/c/rdoinfo/+/46052 | 11:03 |
| slaweq | amoralej: thx a lot | 11:04 |
| slaweq | amoralej++ | 11:04 |
| slaweq | amoralej: now one more (last) bit of this effort: https://review.rdoproject.org/r/c/rdoinfo/+/46052 | 11:04 |
| slaweq | please take a look when You will have few minutes | 11:04 |
| slaweq | ykarel: maybe also You can check ^^ | 11:04 |
| slaweq | thx in advance | 11:04 |
| *** dviroel|doc-appt is now known as dviroel | 11:24 | |
| rdogerrit | Merged deps/python-iso8601 c9s-antelope-rdo: Update to 1.1.0 https://review.rdoproject.org/r/c/deps/python-iso8601/+/46011 | 11:48 |
| rdogerrit | Merged deps/python-ujson c9s-antelope-rdo: Update to 5.5.0 https://review.rdoproject.org/r/c/deps/python-ujson/+/46015 | 11:52 |
| rdogerrit | Merged deps/python-fasteners c9s-antelope-rdo: Update to 0.18 https://review.rdoproject.org/r/c/deps/python-fasteners/+/46010 | 11:55 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for wallaby-8s-testing https://review.rdoproject.org/r/c/rdoinfo/+/46036 | 12:10 |
| rdogerrit | Amol Kahat created rdo-infra/ci-config master: Remove centos-{8,9} jobs from config. https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46053 | 12:17 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for xena-8s-testing https://review.rdoproject.org/r/c/rdoinfo/+/46035 | 12:17 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for yoga-8s-testing https://review.rdoproject.org/r/c/rdoinfo/+/46034 | 12:17 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for yoga-9s-testing https://review.rdoproject.org/r/c/rdoinfo/+/46033 | 12:17 |
| rdogerrit | Merged rdoinfo master: Bump rdoinfo wallaby tags to latest upper-constraints https://review.rdoproject.org/r/c/rdoinfo/+/46031 | 12:18 |
| rdogerrit | Merged rdoinfo master: Bump rdoinfo zed tags to latest upper-constraints https://review.rdoproject.org/r/c/rdoinfo/+/46032 | 12:18 |
| rdogerrit | rdo-trunk created openstack/os-vif-distgit wallaby-rdo: python-os-vif-2.4.1-1 https://review.rdoproject.org/r/c/openstack/os-vif-distgit/+/46054 | 12:22 |
| rdogerrit | rdo-trunk created openstack/manilaclient-distgit zed-rdo: python-manilaclient-4.1.1-1 https://review.rdoproject.org/r/c/openstack/manilaclient-distgit/+/46055 | 12:23 |
| rdogerrit | Merged rdoinfo master: Promote whitebox-neutron-tempest-plugin from under-review to anthelope https://review.rdoproject.org/r/c/rdoinfo/+/46052 | 12:24 |
| rdogerrit | Merged openstack/ceilometer-distgit rpm-master: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/46030 | 12:25 |
| rdogerrit | Merged deps/python-botocore c9s-antelope-rdo: Update to 1.27.89 https://review.rdoproject.org/r/c/deps/python-botocore/+/46008 | 12:29 |
| apevec | did you all get "Invitation to participate in a survey on recheck practice during code reviews" ? | 12:31 |
| apevec | > your user account used the recheck function | 12:31 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 12:31 |
| apevec | that's about everyone in OpenStack :) | 12:31 |
| amoralej | tkajinam, apevec it passed this time https://review.rdoproject.org/r/c/rdoinfo/+/45965 | 12:33 |
| amoralej | i'm merging it | 12:33 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 12:34 |
| apevec | +1 gates will not re-run the whole thing? | 12:37 |
| amoralej | apevec, nop | 12:38 |
| apevec | uhm it failed immediately | 12:38 |
| amoralej | but i need to get oooq patch merged first | 12:38 |
| apevec | Change 45964 in project rdo-jobs does not share a change queue with 45965 in project rdoinfo | 12:38 |
| apevec | 2 | 13:34 | 12:38 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 12:38 |
| apevec | you need to update deps-on | 12:38 |
| amoralej | then, wait | 12:38 |
| rdogerrit | Merged rdo-jobs master: Add tripleo jobs to gate promotions to zed-testing https://review.rdoproject.org/r/c/rdo-jobs/+/45964 | 12:38 |
| amoralej | actually, i just merged rdo-jobs review, dunnow why it failed | 12:39 |
| apevec | you have it as deps-on ? | 12:39 |
| amoralej | yes | 12:39 |
| amoralej | ^ | 12:39 |
| apevec | so I guess zuul complains pre-emptively w/o checking if it was merged? | 12:40 |
| apevec | fbo: ^ ? | 12:40 |
| *** amoralej is now known as amoralej|lunch | 12:53 | |
| rdogerrit | Merged openstack/os-vif-distgit wallaby-rdo: python-os-vif-2.4.1-1 https://review.rdoproject.org/r/c/openstack/os-vif-distgit/+/46054 | 13:00 |
| fbo[m] | apevec: amoralej yes the warning is weird, let's see after the deps-on change on oooq is merged | 13:21 |
| *** slagle is now known as slagle-out | 13:57 | |
| *** dasm|off is now known as dasm | 14:09 | |
| rdogerrit | Rafael Castillo created rdo-infra/ci-config master: Temporarily remove fs001 internal from master alternative criteria https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46056 | 14:11 |
| *** amoralej|lunch is now known as amoralej | 14:51 | |
| rdogerrit | Merged rdo-infra/ci-config master: Temporarily remove fs001 internal from master alternative criteria https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46056 | 15:11 |
| amoralej | apevec, https://review.rdoproject.org/paste/show/458/ that's a trace from the error as seen from db | 15:27 |
| amoralej | commands | 15:27 |
| apevec | so that's a race and we are just lucky when it passes... | 15:32 |
| rdogerrit | Merged rdo-infra/ci-config master: Removal of victoria from promotions dashboard https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46045 | 15:34 |
| *** dviroel is now known as dviroel|lunch | 15:54 | |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 16:00 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 16:02 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 16:02 |
| amoralej | apevec, but see 27 seconds waiting for the lock ... | 16:03 |
| amoralej | and pretty consistent | 16:03 |
| amoralej | but only with cloudsig | 16:03 |
| amoralej | zed | 16:03 |
| amoralej | not en master, even when there are not relenvant commits | 16:03 |
| amoralej | actually, checking mysql command "SHOW ENGINE INNODB STATUS" | 16:05 |
| amoralej | vitrage behavior seems pretty different to other services | 16:05 |
| amoralej | very long running times for transactions | 16:05 |
| amoralej | more locks | 16:05 |
| amoralej | i'm running the same jobs in upstream infra now with https://review.opendev.org/c/openstack/puppet-openstack-integration/+/864194/ | 16:06 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 16:06 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 16:06 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 16:06 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 16:07 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46048 | 16:15 |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Added support for multiple OpenStack projects https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46050 | 16:16 |
| *** marios|ruck is now known as marios | 16:16 | |
| *** marios is now known as marios|out | 16:16 | |
| rdogerrit | Jakob Meng proposed rdo-infra/ci-config master: Prepare staging environment https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46051 | 16:16 |
| *** marios|out is now known as marios | 16:16 | |
| *** marios is now known as marios|out | 16:23 | |
| amoralej | apevec, at least it reproduces in upstream infra, so there must be something wrong somewhere ... https://zuul.opendev.org/t/openstack/build/392d703e60884c75a2ff100101a31119 | 16:50 |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit zed-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45875 | 16:58 |
| *** dviroel|lunch is now known as dviroel | 16:59 | |
| rdogerrit | Leif Madsen proposed openstack/ceilometer-distgit rpm-master: Fix invalid reference to ceilometer-alarm-ipmi service https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/46029 | 17:00 |
| *** mnaser__ is now known as mnaser | 17:05 | |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit yoga-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45876 | 17:12 |
| rdogerrit | Leif Madsen proposed openstack/ceilometer-distgit rpm-master: Fix invalid reference to ceilometer-alarm-ipmi service https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/46029 | 17:15 |
| *** jpena is now known as jpena|off | 17:21 | |
| rdogerrit | Douglas Viroel created rdo-jobs master: Add new nodesets for new IBM node https://review.rdoproject.org/r/c/rdo-jobs/+/46057 | 17:31 |
| rdogerrit | Douglas Viroel created config master: Add new IBM node to ovb-manage role https://review.rdoproject.org/r/c/config/+/46058 | 17:37 |
| rdogerrit | Rafael Castillo created rdo-infra/ci-config master: Revert "Temporarily remove fs001 internal from master alternative criteria" https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45877 | 17:46 |
| amoralej | apevec, https://github.com/openstack/vitrage/commit/432aec7aa13b43ad34f635e3cc87a3c20011d3f1 look at autocommit ... | 17:48 |
| amoralej | hidden in .gitreview update | 17:49 |
| amoralej | that's the issue | 17:49 |
| amoralej | i'll patch it in the distgit | 17:49 |
| apevec | ...how why... | 17:50 |
| apevec | sigh | 17:50 |
| amoralej | to pass ci | 17:50 |
| amoralej | iguess | 17:50 |
| amoralej | yeah, PS 2 after ci failure https://review.opendev.org/c/openstack/vitrage/+/858499/1..2 | 17:51 |
| rdogerrit | Alfredo Moralejo created openstack/vitrage-distgit zed-rdo: Enable autocommit when creating db connection https://review.rdoproject.org/r/c/openstack/vitrage-distgit/+/46059 | 17:56 |
| rdogerrit | Alfredo Moralejo proposed openstack/vitrage-distgit zed-rdo: Enable autocommit when creating db connection https://review.rdoproject.org/r/c/openstack/vitrage-distgit/+/46059 | 18:00 |
| *** dviroel_ is now known as dviroel | 18:02 | |
| rdogerrit | Alfredo Moralejo proposed openstack/vitrage-distgit zed-rdo: Enable autocommit when creating db connection https://review.rdoproject.org/r/c/openstack/vitrage-distgit/+/46059 | 18:11 |
| rdogerrit | Alfredo Moralejo proposed openstack/vitrage-distgit zed-rdo: Enable autocommit when creating db connection https://review.rdoproject.org/r/c/openstack/vitrage-distgit/+/46059 | 18:20 |
| rdogerrit | Dariusz created rdo-infra/ci-config master: Revert "Removal of victoria from promotions dashboard" https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45878 | 18:22 |
| rdogerrit | Alfredo Moralejo created rdoinfo master: Unpin non-OpenStack puppet modules in master https://review.rdoproject.org/r/c/rdoinfo/+/46060 | 18:31 |
| rdogerrit | Alfredo Moralejo proposed rdoinfo master: Unpin non-OpenStack puppet modules in master https://review.rdoproject.org/r/c/rdoinfo/+/46060 | 18:37 |
| rdogerrit | Douglas Viroel created rdo-infra/ci-config master: Add IBM bm3 node to cleanup cron jobs https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46061 | 18:41 |
| rdogerrit | Alfredo Moralejo created rdoinfo master: Promote vitrage with autocommit fix to zed-testing https://review.rdoproject.org/r/c/rdoinfo/+/46062 | 18:45 |
| rdogerrit | Merged openstack/vitrage-distgit zed-rdo: Enable autocommit when creating db connection https://review.rdoproject.org/r/c/openstack/vitrage-distgit/+/46059 | 18:46 |
| *** amoralej is now known as amoralej|off | 18:47 | |
| rdogerrit | Merged rdo-infra/ci-config master: Revert "Removal of victoria from promotions dashboard" https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45878 | 19:12 |
| rdogerrit | Ananya Banerjee created rdo-infra/ci-config master: DNM: This patch is needed at the moment to tweak nginx on the dev server https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46063 | 19:42 |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit xena-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45879 | 20:11 |
| *** dviroel is now known as dviroel|afk | 20:12 | |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit wallaby-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45880 | 20:37 |
| rdogerrit | Merged rdoinfo master: Promote vitrage with autocommit fix to zed-testing https://review.rdoproject.org/r/c/rdoinfo/+/46062 | 21:20 |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit victoria-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45881 | 21:25 |
| rdogerrit | Alfredo Moralejo proposed rdoinfo master: Promote TripleO Zed releases to RDO Clousig zed release https://review.rdoproject.org/r/c/rdoinfo/+/45965 | 21:25 |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit ussuri-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45882 | 21:25 |
| rdogerrit | Leif Madsen created openstack/ceilometer-distgit train-rdo: Remove ceilometer API obsolete reference https://review.rdoproject.org/r/c/openstack/ceilometer-distgit/+/45883 | 21:26 |
| *** dasm is now known as dasm|off | 22:28 | |
| rdogerrit | Merged rdoinfo master: Promote TripleO Zed releases to RDO Clousig zed release https://review.rdoproject.org/r/c/rdoinfo/+/45965 | 23:12 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!