| *** tosky has quit IRC | 00:06 | |
| *** dsneddon has quit IRC | 00:51 | |
| *** dsneddon has joined #oooq | 01:10 | |
| *** dsneddon has quit IRC | 01:16 | |
| *** johnsom has quit IRC | 02:00 | |
| *** johnsom has joined #oooq | 02:01 | |
| *** dsneddon has joined #oooq | 02:14 | |
| *** dsneddon has quit IRC | 02:19 | |
| *** dsneddon has joined #oooq | 02:20 | |
| *** dsneddon has quit IRC | 02:43 | |
| *** dsneddon has joined #oooq | 02:45 | |
| *** dsneddon has quit IRC | 02:50 | |
| *** dsneddon has joined #oooq | 02:52 | |
| *** matbu has quit IRC | 02:56 | |
| *** dsneddon has quit IRC | 02:57 | |
| *** dsneddon has joined #oooq | 03:02 | |
| *** ykarel|away has joined #oooq | 03:02 | |
| *** matbu has joined #oooq | 03:02 | |
| *** dsneddon has quit IRC | 03:07 | |
| *** dsneddon has joined #oooq | 03:08 | |
| *** ykarel|away has quit IRC | 03:09 | |
| *** udesale has joined #oooq | 03:11 | |
| *** apetrich has quit IRC | 03:13 | |
| *** dsneddon has quit IRC | 03:13 | |
| *** dsneddon has joined #oooq | 03:14 | |
| *** rlandy|bbl is now known as rlandy | 03:20 | |
| *** ykarel|away has joined #oooq | 04:45 | |
| *** ykarel|away is now known as ykarel | 04:47 | |
| *** dsneddon has quit IRC | 05:12 | |
| *** dsneddon has joined #oooq | 05:14 | |
| *** ratailor has joined #oooq | 05:23 | |
| *** dsneddon has quit IRC | 05:28 | |
| *** dsneddon has joined #oooq | 05:29 | |
| *** dsneddon has quit IRC | 05:34 | |
| *** dsneddon has joined #oooq | 05:37 | |
| *** marios has joined #oooq | 06:00 | |
| *** udesale has quit IRC | 06:03 | |
| *** udesale has joined #oooq | 06:04 | |
| *** skramaja has joined #oooq | 06:40 | |
| *** ysandeep|away is now known as ysandeep|ruck | 06:43 | |
| ysandeep|ruck | sshnaidm|afk, marios: hi good morning tripleo-ci-centos-8-content-provider-train triggered on ussuri branch gate job, even though we don't have upgrade job in gate. Is it expected ? I noticed it here - https://review.opendev.org/#/c/757150/ | 07:00 |
|---|---|---|
| *** sshnaidm|afk is now known as sshnaidm|rover | 07:01 | |
| marios | ysandeep|ruck: yes cos it is in the layout | 07:02 |
| sshnaidm|rover | ysandeep|ruck, tripleo-ci-centos-8-standalone-upgrade is there | 07:02 |
| ysandeep|ruck | sshnaidm|rover, yes but tripleo-ci-centos-8-standalone-upgrade is in check only | 07:02 |
| sshnaidm|rover | ysandeep|ruck, train is redundant there, we'll need to optimize.. | 07:02 |
| marios | sshnaidm|rover: not sure how we can (we discussed this briefly already ) | 07:03 |
| sshnaidm|rover | ysandeep|ruck, lemme check.. | 07:03 |
| marios | sshnaidm|rover: ysandeep|ruck: eg here https://opendev.org/openstack/tripleo-ci/src/commit/85c707282578562781fbe6366c3c3269259debae/zuul.d/standalone-jobs.yaml#L487-L494 | 07:04 |
| marios | sshnaidm|rover: we might move the branchful upgrade jobs to a different template ... but | 07:04 |
| marios | sshnaidm|rover: needs some thought | 07:04 |
| marios | sshnaidm|rover: we'd still need to include them anyway | 07:05 |
| marios | sshnaidm|rover: ysandeep|ruck: let's discuss in scrum today | 07:05 |
| ysandeep|ruck | irc bounced.. i may have missed some msgs | 07:08 |
| marios | ysandeep|ruck: http://paste.openstack.org/raw/799497/ | 07:09 |
| sshnaidm|rover | ysandeep|ruck, well, we might optimize a little bit with setting irrelevant-files to provider jobs same as it's set for upgrades jobs | 07:11 |
| sshnaidm|rover | but it's a dangerous way | 07:11 |
| ysandeep|ruck | marios, sshnaidm|rover yes I can understand it will be difficult to skip that job if its in template(used for both check and gate).. and maybe in future we plan to add upgrade job in gate too | 07:12 |
| ysandeep|ruck | marios ack lets discuss in scrum | 07:13 |
| sshnaidm|rover | ysandeep|ruck, yes, it will be voting some day | 07:13 |
| ysandeep|ruck | marios++ and congrats on successfull ptg , you ran it very smoothly , thank you.. looking forward to get recordings once you get them | 07:15 |
| marios | thanks ysandeep|ruck ... recordings are out of our hands once I hear something from the foundation will let you know | 07:16 |
| ysandeep|ruck | ack thanks! | 07:16 |
| *** saneax has joined #oooq | 07:23 | |
| *** jpena|off is now known as jpena | 07:45 | |
| zbr | should I join the watercooler meeting or cancel it? | 07:50 |
| *** slaweq has joined #oooq | 08:05 | |
| ysandeep|ruck | sshnaidm|rover, just opened https://bugs.launchpad.net/tripleo/+bug/1901996 , tripleo-ci-centos-8-scenario010-standalone its non-voting from long.. but i didn't find a bug with current error | 08:05 |
| openstack | Launchpad bug 1901996 in tripleo "tripleo-ci-centos-8-scenario010-standalone is failing on tempest test with error 'Load Balancer is immutable and cannot be updated.'" [Critical,New] | 08:05 |
| *** amoralej|off is now known as amoralej | 08:05 | |
| sshnaidm|rover | arxcruz, did you see? ^ | 08:06 |
| arxcruz | sshnaidm|rover: nope, i'll take a look | 08:06 |
| *** marios has quit IRC | 08:09 | |
| arxcruz | ysandeep|ruck: add this test on skiplist for now | 08:11 |
| ysandeep|ruck | arxcruz, sshnaidm|rover, fyi.. periodic integration jobs are green :) https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-standalone-master&project=openstack/tripleo-ci .. not sure if fix is already in and just waiting for promotion | 08:11 |
| arxcruz | hmmm | 08:12 |
| ysandeep|ruck | arxcruz, job is non voting , so not urgent for us to add test in skip list | 08:12 |
| arxcruz | ok | 08:12 |
| *** ysandeep|ruck is now known as ysandeep|lunch | 08:17 | |
| *** yolanda has quit IRC | 08:24 | |
| *** apetrich has joined #oooq | 08:24 | |
| *** yolanda has joined #oooq | 08:25 | |
| *** marios has joined #oooq | 08:50 | |
| *** tosky has joined #oooq | 08:51 | |
| *** ysandeep|lunch is now known as ysandeep|ruck | 08:57 | |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| *** frenzy_friday has joined #oooq | 09:04 | |
| *** dsneddon has quit IRC | 09:25 | |
| *** udesale_ has joined #oooq | 09:43 | |
| *** dtantsur is now known as dtantsur|brb | 09:44 | |
| *** udesale has quit IRC | 09:45 | |
| *** derekh has joined #oooq | 09:52 | |
| *** dsneddon has joined #oooq | 10:03 | |
| marios | sshnaidm|rover: ysandeep|ruck: fyi https://review.opendev.org/#/c/760106/ looks OK | 10:03 |
| *** slaweq has quit IRC | 10:05 | |
| *** holser has joined #oooq | 10:07 | |
| *** slaweq has joined #oooq | 10:13 | |
| *** frenzy_friday has quit IRC | 10:14 | |
| *** frenzy_friday has joined #oooq | 10:14 | |
| *** ykarel has quit IRC | 10:17 | |
| *** dsneddon has quit IRC | 10:18 | |
| *** dsneddon has joined #oooq | 10:19 | |
| *** ykarel has joined #oooq | 10:19 | |
| *** ykarel_ has joined #oooq | 10:52 | |
| *** ykarel has quit IRC | 10:55 | |
| *** ykarel_ is now known as ykarel | 11:06 | |
| *** amoralej is now known as amoralej|brb | 11:14 | |
| *** amoralej|brb is now known as amoralej | 11:27 | |
| ysandeep|ruck | sshnaidm|rover, opened https://bugs.launchpad.net/tripleo/+bug/1902048 its blocking network component promotions | 11:44 |
| openstack | Launchpad bug 1902048 in tripleo "Network component jobs is failing on tempest TASK [os_tempest : Ensure private network exists]" [Critical,New] | 11:44 |
| ysandeep|ruck | no error observed in neutron logs :( | 11:44 |
| *** dtantsur|brb is now known as dtantsur | 11:57 | |
| ykarel | ysandeep|ruck, ^ issue is on CIX | 11:57 |
| ykarel | fix is available in neutron,but not merged yet | 11:57 |
| ysandeep|ruck | ykarel, could you please share the old bug id | 11:59 |
| ykarel | need to check CIX card, bug is reported against neutron | 11:59 |
| slaweq | ykarel: are You talking about https://trello.com/c/ekyqjKDF ? | 12:00 |
| ykarel | https://trello.com/c/ekyqjKDF/1718-cixlp1901534puppetciproa-neutron-fail-to-create-networks-because-of-mtu-value | 12:00 |
| ysandeep|ruck | ykarel, this one https://bugs.launchpad.net/neutron/+bug/1901534 | 12:00 |
| openstack | Launchpad bug 1901534 in neutron "Neutron fail to create networks because of MTU value" [Critical,In progress] - Assigned to yatin (yatinkarel) | 12:00 |
| ykarel | slaweq, yeap | 12:00 |
| ykarel | ysandeep|ruck, yes | 12:00 |
| slaweq | ok, yes, fix is in the queue now | 12:00 |
| ykarel | it's in queue from 10 hours :) | 12:00 |
| ykarel | queue is too long | 12:01 |
| ysandeep|ruck | ykarel, ack i see same logs in my jobs - 2020-10-28 12:58:41.171 7 DEBUG neutron.api.extensions [req-9117c92f-3c44-4548-8735-38af9deea5ca - - - - -] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" _check_extension /usr/lib/python3.6/site-packages/neutron/api/extensions.py:413 | 12:03 |
| ysandeep|ruck | ykarel++ thank you | 12:03 |
| ysandeep|ruck | ykarel, i will close my bug as duplicate | 12:04 |
| ykarel | ack, BadRequestException: 400: Client Error for url: http://192.168.24.28:9696/v2.0/networks.json, Invalid input for operation: Requested MTU is too big, maximum is 1292. the actual error | 12:04 |
| *** rfolco has joined #oooq | 12:08 | |
| weshay|ruck | akahat, I was wrong about the tags required.. needs to be just build.. will let sagi know in a sec.. and update the patch | 12:12 |
| weshay|ruck | marios, one more review on this one .. https://review.opendev.org/#/c/759912/5 | 12:16 |
| marios | weshay|ruck:will do | 12:17 |
| weshay|ruck | thanks | 12:18 |
| *** jpena is now known as jpena|lunch | 12:19 | |
| marios | rlandy: arxcruz: posted that just now to test the upgrade jobs layout https://review.opendev.org/#/c/760350/ | 12:19 |
| rlandy | marios: ack - ok - working on puppet jobs for provider and stein/rocky removal now | 12:20 |
| rlandy | marios: the job definitions should be in/mergeable | 12:20 |
| marios | rlandy: added comments on your patch and posted the layouts in https://review.opendev.org/760323 | 12:21 |
| marios | rlandy: you might want to add the update job in your patch too see comments | 12:21 |
| rlandy | marios: probably not going to do victoria work until next week | 12:21 |
| rlandy | also have to add job to push ceph containers | 12:22 |
| marios | rlandy: ack np | 12:22 |
| marios | rlandy: i will take care | 12:22 |
| marios | rlandy: have a bit more time today ;) | 12:22 |
| rlandy | marios: yea - sorry - weshay|ruck and chandan had some tasks left on the provider work for me to do | 12:23 |
| marios | rlandy: np | 12:24 |
| rfolco | marios, sshnaidm|rover weshay|ruck this one is ready https://review.opendev.org/#/c/759720/, but commit msg is not the best | 12:28 |
| arxcruz | ack | 12:30 |
| arxcruz | rlandy: did it work yesterday the job? | 12:30 |
| weshay|ruck | content provider sync | 12:30 |
| arxcruz | i think i recheck this morning | 12:30 |
| rlandy | arxcruz: I am trying to figure that out ... :( - looks like some jobs found the containers and some didn't | 12:30 |
| weshay|ruck | rfolco, akahat marios soniya29 rlandy | 12:30 |
| arxcruz | rlandy: can you point me the logs? it might be the api from quay just fail | 12:31 |
| arxcruz | i want to double check | 12:31 |
| rlandy | weshay|ruck: not in my calendar - can you post meeting? | 12:31 |
| arxcruz | if the failure is true | 12:31 |
| arxcruz | weshay|ruck: not in my calendar as well | 12:31 |
| weshay|ruck | marios, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5d6/757836/3/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/5d642e6/job-output.txt | 12:32 |
| rlandy | arxcruz: looking at the logs from https://f9ec75f4b8cfafc048e0-c67b93b429db84769e417a4684ceffa6.ssl.cf5.rackcdn.com/759926/1/check/tripleo-ci-centos-7-standalone/fce0dd7/logs/undercloud/home/zuul/standalone_deploy.log | 12:32 |
| arxcruz | rlandy: yeah, i saw this one, i was able to pull this container locally | 12:32 |
| arxcruz | and the tag is working | 12:32 |
| rlandy | marios: can you post the provider meeting link | 12:33 |
| rlandy | arxcruz, and I don't have it | 12:33 |
| rlandy | arxcruz: yeah - and some jobs did fine with it | 12:33 |
| weshay|ruck | marios, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5d6/757836/3/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/5d642e6/job-output.txt | 12:33 |
| rlandy | akahat: hey do you have the meeting link? | 12:33 |
| rlandy | arxcruz: maybe too much load at one time? | 12:35 |
| rlandy | arxcruz: and they still won't tell us the meeting link :) | 12:36 |
| weshay|ruck | akahat? | 12:36 |
| weshay|ruck | rfolco, marios https://review.opendev.org/#/c/760249/ | 12:37 |
| rlandy | rfolco: we're still waiting on the meeting link | 12:38 |
| rfolco | ?? | 12:38 |
| rfolco | we are on the content provider mtg | 12:38 |
| rlandy | rfolco: provider meeting | 12:38 |
| rfolco | https://meet.google.com/jtj-ppwn-wpx?authuser=1 | 12:38 |
| rlandy | arx and I don't have it | 12:38 |
| rlandy | yaeh | 12:38 |
| rlandy | thanks | 12:38 |
| *** ratailor has quit IRC | 12:43 | |
| marios | rlandy: added you to the content provider meeting | 12:49 |
| marios | rlandy: keep it to yourself ;) | 12:49 |
| rlandy | marios+++++++++++++ | 12:49 |
| marios | rlandy: first rule of content provider meeting... | 12:49 |
| rlandy | lol | 12:50 |
| rlandy | gee | 12:50 |
| rfolco | https://09121fad384435046ce5-3bbb48847b672b5467267c1efe6f2622.ssl.cf5.rackcdn.com/759737/2/check/tripleo-ci-centos-7-content-provider/1412e90/logs/undercloud/home/zuul/workspace/build.log | 12:52 |
| rfolco | sshnaidm|rover, weshay|ruck marios rlandy arxcruz ^ | 12:52 |
| rfolco | akahat, ^ | 12:52 |
| rfolco | this is the log c7 provider was failing | 12:52 |
| marios | weshay|ruck: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_cb0/758052/1/gate/tripleo-build-containers-centos-7/cb0392b/ | 12:52 |
| rfolco | no buildah there | 12:52 |
| marios | weshay|ruck: https://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-7 | 12:52 |
| rfolco | https://review.opendev.org/#/c/759737/ | 12:55 |
| rfolco | weshay|ruck, https://review.opendev.org/#/c/759737/ | 12:55 |
| rfolco | https://review.opendev.org/#/c/759737/ | 12:55 |
| rfolco | https://review.opendev.org/#/c/759737/ | 12:55 |
| rfolco | you asked 4 times :) | 12:56 |
| ysandeep|ruck | rfolco, do we have scrum today? | 13:01 |
| rfolco | ysandeep|ruck, I don't think so | 13:02 |
| rfolco | weshay|ruck, ^ | 13:02 |
| ysandeep|ruck | rfolco, ack thanks i was the only one on call, will drop now | 13:03 |
| rfolco | ysandeep|ruck, join https://meet.google.com/jtj-ppwn-wpx?authuser=1 if you like | 13:04 |
| rfolco | we are all there | 13:04 |
| weshay|ruck | of course no one is here | 13:07 |
| rfolco | ysandeep|ruck, sorry | 13:08 |
| *** amoralej is now known as amoralej|lunch | 13:08 | |
| ysandeep|ruck | rfolco, hahaha nw, i was there for like ~1 min | 13:09 |
| akahat | rfolco, hey.. could you please check this job got configured correct: https://review.opendev.org/#/c/759287/4/zuul.d/project.yaml@43 | 13:09 |
| akahat | arxcruz, ^^ | 13:12 |
| *** jpena|lunch is now known as jpena | 13:13 | |
| rfolco | akahat, arxcruz can speak on that tempest job better | 13:16 |
| arxcruz | rfolco: akahat lgtm, but I don't know if the osa guys will like increase the job time so much, however, os_tempest doesn't receive too much patches anyway | 13:18 |
| arxcruz | let's see | 13:18 |
| arxcruz | akahat: - openstack-ansible-deploy-aio_distro_metal_tempestconf-centos-8 | 13:18 |
| arxcruz | akahat: this is not on our side | 13:18 |
| akahat | arxcruz, i'm talking about this job: tripleo-ci-centos-7-standalone-os-tempest-train | 13:19 |
| arxcruz | akahat: yes, but you added the content provider as dependence on openstack-ansible-deploy-aio_distro_metal_tempestconf-centos-8 | 13:20 |
| arxcruz | just saying this job doesn't use tripleo | 13:20 |
| akahat | oh.. | 13:20 |
| akahat | arxcruz, this job ^^ do not have content-provider dependency: | 13:23 |
| akahat | https://review.opendev.org/#/c/759287/4/zuul.d/project.yaml@55 | 13:23 |
| arxcruz | akahat: oh, you right | 13:23 |
| arxcruz | i missread | 13:23 |
| arxcruz | this is gate | 13:23 |
| arxcruz | my bad | 13:23 |
| arxcruz | rfolco: the c7 job there was just to ensure nobody will remove the c7 variables from os_tempest | 13:28 |
| arxcruz | it was removed before, which make some of our jobs fail | 13:28 |
| arxcruz | I re-added and the osa guys asked for a c7 job to validate | 13:28 |
| arxcruz | if we still run c7 on rdo, this will be required | 13:28 |
| rfolco | ok, if you need that job, then content-provider-train is the dependency akahat | 13:28 |
| rfolco | its a branchful job | 13:29 |
| rfolco | depend on -train provider | 13:29 |
| akahat | ah.. that's why it might be failing. | 13:29 |
| akahat | rfolco, arxcruz let me update the patch. | 13:29 |
| *** jbadiapa has joined #oooq | 13:45 | |
| weshay|ruck | marios, https://399637c6f98f105a3f15-e3daadb986270c27e8869be52c5f0413.ssl.cf1.rackcdn.com/759683/1/check/tripleo-ci-centos-8-standalone/c281dd5/logs/undercloud/home/zuul/standalone_deploy.log | 13:46 |
| *** TrevorV has joined #oooq | 13:48 | |
| weshay|ruck | marios, same issue here: https://473a29f7fd55b6514388-3f85b53ff2a553e957b0555e1054822e.ssl.cf5.rackcdn.com/759683/1/check/tripleo-ci-centos-8-containers-multinode/c7bd845/logs/undercloud/home/zuul/overcloud_deploy.log | 13:50 |
| rlandy | weshay|ruck: are you joining the downstream call or should I? | 13:50 |
| weshay|ruck | rlandy, I'll join.. | 13:51 |
| marios | weshay|ruck: 2020-10-26T15:24:12.082571052+00:00 stderr F <13>Oct 26 15:24:12 puppet-user: Error: Evaluation Error: Error while evaluating a Resource Statement, Class[Horizon]: https://399637c6f98f105a3f15-e3daadb986270c27e8869be52c5f0413.ssl.cf1.rackcdn.com/759683/1/check/tripleo-ci-centos-8-standalone/c281dd5/logs/undercloud/var/log/containers/stdouts/container-puppet-horizon.log | 13:51 |
| marios | weshay|ruck: looks like a bug | 13:51 |
| rlandy | sshnaidm|rover: looks like your jobs are using container-tools:2.0 | 13:52 |
| rlandy | so you are getting buildah 1.11.6.7 | 13:52 |
| sshnaidm|rover | yes | 13:52 |
| rlandy | which is supposed to be the good version | 13:52 |
| rlandy | the only outlier I see is this ... | 13:52 |
| rlandy | BuildahVersion: 1.12.0-dev | 13:53 |
| rlandy | in https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ae0/759793/2/check/tripleo-ci-centos-8-content-provider/ae05bd4/logs/undercloud/var/log/extra/podman/podman_allinfo.log | 13:53 |
| rlandy | if that is telling the truth idk | 13:53 |
| weshay|ruck | marios, I think that may need to be disabled for victoria | 13:53 |
| weshay|ruck | not sure | 13:53 |
| weshay|ruck | tbh | 13:53 |
| sshnaidm|rover | rlandy, it's of "podman build" | 13:53 |
| sshnaidm|rover | rlandy, for buildah that is built-in in podman, as I understand it | 13:54 |
| rlandy | sshnaidm|rover: so then you have the version we locked donwtream | 13:54 |
| weshay|ruck | rlandy, or ysandeep|ruck can one of you please join the DF checkpoint | 13:54 |
| weshay|ruck | and give an update on content-provider? | 13:54 |
| weshay|ruck | or perhaps.. maybe rlandy you should go to the downstream call | 13:55 |
| weshay|ruck | and I'll update df | 13:55 |
| rlandy | weshay|ruck: I just joined this project - maybe we switch | 13:55 |
| rlandy | yep | 13:55 |
| weshay|ruck | sorry for the change | 13:55 |
| rlandy | weshay|ruck: ack - np - I'll join downstream | 13:55 |
| weshay|ruck | rlandy, ok.. cool.. thank you | 13:55 |
| weshay|ruck | ysandeep|ruck, rlandy I'll update df | 13:55 |
| sshnaidm|rover | rlandy, seems like it's still not the best.. | 13:56 |
| rlandy | sshnaidm|rover: so possibly if we ran container build enough downstream we'd hit the same issue again | 13:57 |
| ysandeep|ruck | weshay|ruck, thanks , i was planning to attend a neutron ci stablity session.. which is at same time | 13:57 |
| rlandy | but with later version its was pretty consistent | 13:57 |
| rlandy | more failures than not | 13:57 |
| rlandy | sshnaidm|rover: do we have any friends on the podman team to raise the priority of our bug? | 13:58 |
| weshay|ruck | ysandeep|ruck, oh... where did you find that mtg? | 13:58 |
| ysandeep|ruck | weshay|ruck, here http://ptg.openstack.org/ptg.html | 13:58 |
| rlandy | sshnaidm|rover: I raised the problem at the prod chain meeting | 13:58 |
| ysandeep|ruck | neutron - Starting at 14:00 UTC with discussion about CI stability | 13:58 |
| weshay|ruck | ysandeep|ruck++ | 13:59 |
| rlandy | and no response | 13:59 |
| sshnaidm|rover | rlandy, we can try, but no friends there :( | 14:05 |
| weshay|ruck | rlandy, is attila presenting today? | 14:06 |
| rlandy | weshay|ruck: ack | 14:07 |
| weshay|ruck | rlandy, marios rfolco fyi.. no need to review.. mass removal of standalone-upgrade for centos-7 https://review.opendev.org/#/q/topic:bug/1901208+(status:open+OR+status:merged) | 14:12 |
| sshnaidm|rover | weshay|ruck, raukadah we still have problem with kolla centos7 build containers, can't get gating.repo with a patch: http://paste.openstack.org/show/799510/ | 14:17 |
| sshnaidm|rover | weshay|ruck, raukadah kolla doesn't have access to /opt/gating folder where actual repo is | 14:18 |
| *** amoralej|lunch is now known as amoralej | 14:19 | |
| weshay|ruck | hrm.. k.. the dir is a param.. can be changed.. or change perms on the dir | 14:20 |
| sshnaidm|rover | weshay|ruck, I don't think kolla has any access to host system | 14:21 |
| sshnaidm|rover | we pass it repos via http | 14:22 |
| weshay|ruck | hrm... | 14:22 |
| weshay|ruck | it def.. writes to /tmp | 14:22 |
| sshnaidm|rover | need to create maybe a special dir in /var/www/html and copy it there | 14:22 |
| weshay|ruck | aye | 14:22 |
| *** ykarel has quit IRC | 14:54 | |
| rlandy | weshay|ruck: so ... https://review.opendev.org/#/c/760221/7/zuul.d/layout.yaml - should have tripleo-ci-centos-7-standalone not tripleo-ci-centos-7-standalone-upgrade? | 15:01 |
| rlandy | considering alex's patch | 15:01 |
| rlandy | removing that upgrade | 15:01 |
| rlandy | we keep one standalone? | 15:01 |
| weshay|ruck | ya.. keep one standalone deployment | 15:02 |
| rlandy | k - fixing that | 15:02 |
| weshay|ruck | thanks | 15:02 |
| weshay|ruck | rlandy, was there a patch for | 15:04 |
| weshay|ruck | The conditional check '(tripleo_bootstrao_release_version_package |list | length) > 0' failed. The error was: error while evaluating conditional ((tripleo_bootstrao_release_version_package |list | length) > 0): 'tripleo_bootstrao_release_version_package' is undefined\n\nThe error appears to be in '/usr/share/ansible/roles/tripleo_bootstrap/tasks/main.yml': line 36, column 3, but may\nbe elsewhere in the file depending on the exact syntax | 15:04 |
| weshay|ruck | problem.\n\nThe offending line appears to be:\n\n# Currently only supported on RHEL as tripleo does not have a version package\n- name: Deploy release version package\n ^ here\n"} | 15:04 |
| weshay|ruck | rlandy, I remember looking at that bug w/ you | 15:04 |
| rlandy | weshay|ruck: ack | 15:06 |
| weshay|ruck | was a typo | 15:06 |
| rlandy | I fixed it | 15:07 |
| rlandy | in upstream | 15:07 |
| rlandy | patch should have gone downstrea, | 15:07 |
| weshay|ruck | https://review.opendev.org/#/c/758584/ | 15:07 |
| weshay|ruck | k | 15:07 |
| rlandy | weshay|ruck: you looking at 17? | 15:07 |
| weshay|ruck | ya.. /me promotes tripleo component | 15:07 |
| *** skramaja has quit IRC | 15:07 | |
| rlandy | weshay|ruck: so I tried to discuss with you last week | 15:07 |
| weshay|ruck | aye | 15:08 |
| rlandy | we have a chicken and egg problem | 15:08 |
| rlandy | when I wanted to promote the component you told me to drop it | 15:08 |
| weshay|ruck | rlandy, aye.. it's fine :) | 15:09 |
| weshay|ruck | I got it | 15:09 |
| *** ysandeep|ruck is now known as ysandeep|away | 15:12 | |
| akahat | weshay|ruck, rfolco marios arxcruz rlandy https://review.opendev.org/#/c/759211/ | 15:40 |
| arxcruz | akahat: i already +1 :) | 15:41 |
| *** rfolco is now known as rfolco|bbl | 15:41 | |
| akahat | arxcruz, :) | 15:41 |
| *** holser has quit IRC | 15:48 | |
| *** holser has joined #oooq | 15:48 | |
| marios | weshay|ruck: so that should fix the container-multinode issue i think https://opendev.org/openstack/puppet-tripleo/commit/cfaea88a5b091e62842de8ef926f80731177faf1 (i mean the issue we were seeing at https://review.opendev.org/#/c/759683/ | 15:53 |
| marios | hopefully recheck will show that | 15:53 |
| marios | weshay|ruck: (stable/victoria) | 15:54 |
| weshay|ruck | marios, may need to cherry pick that | 15:56 |
| weshay|ruck | not sure where the builds are at w/ victoria and master | 15:56 |
| marios | weshay|ruck: well that is on master there is no victoria for puppet-tripleo yet | 15:57 |
| weshay|ruck | or maybe we need another promotion | 15:57 |
| weshay|ruck | ya.. just looked.. ur right | 15:57 |
| marios | weshay|ruck: so yeah probably that ^^^ i mean promotion? | 15:57 |
| weshay|ruck | ya.. I'll look at that today | 15:57 |
| marios | weshay|ruck: forgot that we'd need a promotion to see that ... so yeah it will fail again until we get one then | 15:57 |
| rlandy | weshay|ruck: do you have the lit with all the puppet repos? | 15:58 |
| rlandy | list | 15:58 |
| rlandy | https://review.opendev.org/#/c/760249/ git a +2 from alex | 15:58 |
| rlandy | so can carry on there | 15:59 |
| *** udesale_ has quit IRC | 16:06 | |
| *** chem has quit IRC | 16:07 | |
| *** marios is now known as marios|out | 16:41 | |
| *** slaweq has quit IRC | 16:44 | |
| *** jpena is now known as jpena|off | 16:54 | |
| rlandy | weshay|ruck: hey ... | 16:55 |
| *** rfolco|bbl is now known as rfolco | 17:01 | |
| weshay|ruck | rlandy, hey.. done syncing w/ joyce | 17:04 |
| weshay|ruck | rlandy, all yours | 17:04 |
| rlandy | weshay|ruck: np - just wanted to let you know I'm covering all the puppet repos | 17:05 |
| rlandy | nearly done | 17:05 |
| weshay|ruck | rlandy, nice.. | 17:05 |
| rlandy | see topic new-ci-jobs | 17:05 |
| weshay|ruck | what can I do to help you? | 17:05 |
| weshay|ruck | k | 17:05 |
| rlandy | puppetr related | 17:05 |
| rlandy | weshay|ruck: make sure I haven't missed something | 17:05 |
| rlandy | on nova, still got octavia | 17:05 |
| rlandy | then I need the line to push ceph containers | 17:05 |
| rlandy | weshay|ruck: ok - they should all be in now | 17:10 |
| weshay|ruck | rlandy++ | 17:11 |
| rlandy | weshay|ruck: k - priority ie: which one first? the rest of the repos on stein/rocky or the lien to push ceph containers? | 17:11 |
| rlandy | line | 17:11 |
| weshay|ruck | rlandy, k.. pinged alex w/ those | 17:12 |
| weshay|ruck | rlandy, let's chat.. | 17:12 |
| rlandy | k | 17:12 |
| weshay|ruck | rlandy, https://meet.google.com/phf-qqxh-jsx?authuser=1 | 17:12 |
| weshay|ruck | rlandy, https://review.opendev.org/#/q/status:open+topic:new-ci-job+owner:%22Ronelle+Landy+%253Crlandy%2540redhat.com%253E%22 | 17:15 |
| rfolco | weshay|ruck, c7 provider keeps failing https://review.opendev.org/#/c/759737/ | 17:17 |
| *** amoralej is now known as amoralej|off | 17:24 | |
| * rfolco is blocked | 17:25 | |
| rfolco | ignoring https://review.opendev.org/#/c/760198/, will apply my fix somewhere else | 17:26 |
| weshay|ruck | rfolco, join https://meet.google.com/phf-qqxh-jsx?authuser=1 | 17:31 |
| *** ykarel has joined #oooq | 17:35 | |
| *** ykarel has quit IRC | 17:37 | |
| *** ykarel has joined #oooq | 17:38 | |
| rlandy | rfolco: https://review.opendev.org/#/c/760428/ | 17:47 |
| rlandy | weshay|ruck: ^^ | 17:49 |
| *** ykarel has quit IRC | 17:54 | |
| weshay|ruck | rlandy, riddle /me this batwoman.. https://review.opendev.org/#/c/757150/ | 17:59 |
| weshay|ruck | in tht | 17:59 |
| weshay|ruck | on master | 17:59 |
| weshay|ruck | why would we launch content-provider for train | 17:59 |
| weshay|ruck | I can see ussuri for upgrade | 17:59 |
| * rlandy looks | 18:02 | |
| weshay|ruck | rlandy, you.. I suspect for good cause | 18:02 |
| rlandy | weshay|ruck: I suspect because the job is always included in the template and is probably not branch specific | 18:03 |
| * rlandy checks theory | 18:03 | |
| weshay|ruck | rlandy, ya.. an improvement would be to figure out how to create templates that would work w/ upgrade jobs... | 18:04 |
| rlandy | https://github.com/openstack/tripleo-ci/blob/master/zuul.d/undercloud-jobs.yaml#L67 | 18:04 |
| weshay|ruck | so two content proivders max | 18:04 |
| rlandy | weshay|ruck: ^^ so it's always in the template | 18:04 |
| weshay|ruck | ya.. I see .. thinking about setting that to voting false | 18:05 |
| rlandy | now let's check the definition on that job | 18:05 |
| weshay|ruck | oh I see | 18:05 |
| weshay|ruck | tripleo-ci-centos-8-undercloud-upgrade-ussuri: | 18:05 |
| weshay|ruck | vars: *undercloud_consumer_vars | 18:05 |
| weshay|ruck | irrelevant-files: *undercloud_ignored | 18:05 |
| weshay|ruck | dependencies: | 18:05 |
| weshay|ruck | - tripleo-ci-centos-8-content-provider-ussuri | 18:05 |
| weshay|ruck | - tripleo-ci-centos-8-content-provider-train | 18:05 |
| rlandy | https://github.com/openstack/tripleo-ci/blob/379d6472fb16d1610d44eb0a46fe5d566db4b57c/zuul.d/standalone-jobs.yaml#L1083 | 18:05 |
| rlandy | weshay|ruck:so I guess we need a branches: line there? | 18:06 |
| weshay|ruck | rlandy, just not sure how much we should muck w/ this now | 18:07 |
| rlandy | weshay|ruck: well, it's hard ... because we need that for upgrades | 18:07 |
| weshay|ruck | I'd be comfortable setting it to non-voting | 18:07 |
| weshay|ruck | if it fails child jobs would fail anyway | 18:07 |
| rlandy | so we would need to trigger it for train and ussuri and stein? | 18:07 |
| weshay|ruck | but we shouldn't fail the gate on a content provider that is not serving content | 18:07 |
| *** derekh has quit IRC | 18:07 | |
| rlandy | how do we determine it's not providing content? | 18:08 |
| weshay|ruck | rlandy, in this set https://review.opendev.org/#/c/757150/ | 18:08 |
| weshay|ruck | there is no train content.. it's master... | 18:08 |
| weshay|ruck | so .. at best it's doing ussuri -> master | 18:08 |
| rlandy | weshay|ruck: ok - so we could d this | 18:08 |
| weshay|ruck | for upgrades | 18:08 |
| rlandy | every job has branches set like this ... | 18:09 |
| rlandy | n-1, n, n+1 | 18:09 |
| rlandy | that covers upgrades | 18:09 |
| rlandy | there is come redundancy | 18:09 |
| rlandy | but less than now | 18:09 |
| rlandy | idea? | 18:09 |
| weshay|ruck | rlandy, what if we set | 18:09 |
| weshay|ruck | https://github.com/openstack/tripleo-ci/blob/379d6472fb16d1610d44eb0a46fe5d566db4b57c/zuul.d/standalone-jobs.yaml#L1083 | 18:09 |
| weshay|ruck | to branches.. stable/train and stable/ussuri | 18:09 |
| weshay|ruck | that way in master it wouldn't trigger | 18:10 |
| weshay|ruck | wdyt? | 18:10 |
| rlandy | weshay|ruck: well really it could land up stein, train, ussuri | 18:10 |
| *** marios|out has quit IRC | 18:10 | |
| rlandy | upgrade | 18:10 |
| weshay|ruck | ya.. | 18:10 |
| rlandy | in theory | 18:10 |
| rlandy | so my n-1, n, n+1 pattern | 18:11 |
| weshay|ruck | ya | 18:11 |
| rlandy | it would work for all | 18:11 |
| rlandy | same for ussuri, victoria etc. | 18:11 |
| rlandy | weshay|ruck: you want me to put in that patch? | 18:12 |
| rlandy | for all providers? | 18:12 |
| rlandy | let people review/discuss at meeting | 18:12 |
| weshay|ruck | oooof | 18:14 |
| weshay|ruck | poor upstream | 18:14 |
| weshay|ruck | rlandy, I can -1 this https://review.opendev.org/760437 | 18:14 |
| weshay|ruck | but good for discussion I think | 18:14 |
| rlandy | weshay|ruck: yeah - let's discuss with marios etc. tomorrow | 18:15 |
| weshay|ruck | k | 18:16 |
| rlandy | wow zuul , you made your point | 18:16 |
| rlandy | 16 times? | 18:16 |
| *** dtantsur is now known as dtantsur|afk | 18:18 | |
| weshay|ruck | ya.. Unable to freeze job graph: Job tripleo-ci-centos-8-standalone-upgrade depends on tripleo-ci-centos-8-content-provider-ussuri which was not run. | 18:19 |
| weshay|ruck | I thought that may be it | 18:19 |
| weshay|ruck | which is why non-voting may be best | 18:19 |
| rlandy | well- what happens if we go with non-voting .... | 18:19 |
| rlandy | it fails, the dependent job kicks or not? | 18:19 |
| rlandy | fail non-voting | 18:20 |
| * rlandy doesn't know | 18:20 | |
| rlandy | I think not | 18:20 |
| rlandy | weshay|ruck: k - then | 18:21 |
| weshay|ruck | Unable to freeze job graph: Job tripleo-ci-centos-8-standalone-upgrade depends on tripleo-ci-centos-8-content-provider-ussuri which was not run. | 18:21 |
| weshay|ruck | oops | 18:21 |
| weshay|ruck | https://review.opendev.org/760438 | 18:21 |
| rfolco | weshay|ruck, rlandy can we merge this one https://review.opendev.org/#/c/759720/ | 18:27 |
| *** tosky has quit IRC | 18:29 | |
| rlandy | rfolco: https://review.opendev.org/#/c/759720/ I see the nuke part - where is the part that switches c8-standalone job? | 18:30 |
| rlandy | from templates? | 18:31 |
| rlandy | ok | 18:33 |
| rfolco | rlandy, commit is not 100% true, but you got it | 18:35 |
| weshay|ruck | rlandy, my critical list? python-tripleoclient tripleo-ansible tripleo-common tripleo-heat-templates | 18:47 |
| weshay|ruck | rlandy, rfolco all the ussuri critical repos are blocked by https://review.opendev.org/#/c/759912/ | 18:50 |
| weshay|ruck | we need to merge that | 18:50 |
| weshay|ruck | and focus on https://review.opendev.org/#/q/owner:%22amolkahat+%253Camolkahat%2540gmail.com%253E%22++branch:stable/ussuri+topic:new-ci-job | 18:50 |
| weshay|ruck | ya.. rfolco rlandy master and train are pretty good.. for critical things | 18:58 |
| weshay|ruck | ussuri needs focus tomorrow | 18:58 |
| rlandy | weshay|ruck: rfolco: ok if I w+ https://review.opendev.org/#/c/759912/ then? | 19:00 |
| weshay|ruck | rlandy, aye.. lets go 4 it | 19:01 |
| rlandy | done | 19:01 |
| *** dsneddon has quit IRC | 19:01 | |
| *** dsneddon has joined #oooq | 19:03 | |
| *** jbadiapa has quit IRC | 19:22 | |
| *** TrevorV has quit IRC | 19:39 | |
| *** frenzy_friday has quit IRC | 19:44 | |
| rlandy | rfolco: did the use_buildah change work for you? | 19:49 |
| rfolco | rlandy, yes in my testproject | 19:50 |
| rlandy | ok | 19:52 |
| rfolco | rlandy, https://logserver.rdoproject.org/89/30689/2/check/tripleo-ci-centos-7-content-provider/bf61bf2/ | 19:58 |
| rlandy | weshay|ruck: ok to w+ https://review.opendev.org/#/c/759985/? | 20:14 |
| * weshay|ruck looks | 20:15 | |
| weshay|ruck | rlandy, +2/wf | 20:18 |
| rlandy | one more | 20:18 |
| weshay|ruck | rfolco, https://review.opendev.org/#/c/758945/ is why provider jobs should be non-voting | 20:30 |
| weshay|ruck | look at the gate | 20:30 |
| rfolco | weshay|ruck, I see | 20:54 |
| rlandy | weshay|ruck: rfolco: hey ... look a this provider error ... | 21:02 |
| rlandy | Could not find or access '/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-7/master.yml' on the Ansible Controller. | 21:02 |
| rlandy | why is it looking for /tripleo-ci/CentOS-7/master.yml | 21:02 |
| rlandy | should be CentOS-8 | 21:03 |
| rlandy | centos-7-limestone-regionone-0021230852 | 21:03 |
| rlandy | building master on centos7 | 21:03 |
| rlandy | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c05/759985/18/gate/tripleo-ci-centos-7-content-provider/c05325b/job-output.txt | 21:03 |
| *** rfolco has quit IRC | 21:36 | |
| *** tosky has joined #oooq | 21:57 | |
| *** rlandy has quit IRC | 22:12 | |
| *** jmasud has joined #oooq | 22:13 | |
| *** jmasud has quit IRC | 22:54 | |
| *** jmasud has joined #oooq | 22:55 | |
| *** jfrancoa has joined #oooq | 22:56 | |
| *** jmasud has quit IRC | 23:25 | |
| *** slaweq has joined #oooq | 23:44 | |
| *** slaweq has quit IRC | 23:55 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!