| *** jmasud has quit IRC | 00:14 | |
| *** tosky has quit IRC | 00:53 | |
| *** apetrich has quit IRC | 03:09 | |
| *** ykarel has joined #oooq | 03:14 | |
| *** udesale has joined #oooq | 04:11 | |
| *** ratailor has joined #oooq | 04:15 | |
| *** jmasud has joined #oooq | 04:41 | |
| *** saneax has joined #oooq | 04:54 | |
| *** jmasud has quit IRC | 05:04 | |
| *** ysandeep|away is now known as ysandeep|ruck | 05:25 | |
| ysandeep|ruck | Good morning o/ | 05:28 |
|---|---|---|
| *** jmasud has joined #oooq | 05:50 | |
| ysandeep|ruck | bhagyashris, akahat old promoter server is not active, Is promoter server running for c8 branches on new promoter server? | 05:59 |
| ysandeep|ruck | c8 train had complete green run yesterday - https://review.rdoproject.org/zuul/buildset/9ebfd850f15348eb843cb1e82248fcd7 , but we didn't get promotion. | 06:00 |
| ysandeep|ruck | arxcruz, fyi.. https://bugs.launchpad.net/tripleo/+bug/1916445 | 06:02 |
| openstack | Launchpad bug 1916445 in tripleo "Heat stack creation failing for featureset039 in Master branch with "ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: MessagingTimeout, Code: 500"" [Critical,Triaged] | 06:02 |
| *** marios has joined #oooq | 06:02 | |
| *** dtantsur|afk is now known as dtantsur | 06:14 | |
| *** jmasud has quit IRC | 06:16 | |
| ykarel | ysandeep|ruck, may be ^ is related to rdo cloud cleanups, see #rhos-ops | 06:48 |
| ykarel | if that server was running on rdo cloud | 06:48 |
| ykarel | atleast from ip it looks like that | 06:49 |
| ykarel | if u have access to tripleo-infra tenant | 06:50 |
| ykarel | u can confirm that | 06:50 |
| ysandeep|ruck | ykarel, yes older promoter was running on rdocloud, bhagyashris and akahat were working to create a new promoter server, I want to confirm with them what's the status of new promoter server. Last week, I think they decided to disable c8 promotion till they do some testing. | 06:51 |
| ykarel | ysandeep|ruck, ack, if needed u can start(if just stopped and not deleted) and have some promotions and shut down it again if new promoter server is not yet ready | 06:53 |
| ysandeep|ruck | ykarel, thanks! | 06:55 |
| *** dtantsur is now known as dtantsur|brb | 07:05 | |
| *** ksambor has joined #oooq | 07:09 | |
| ykarel | ysandeep|ruck, can u check http://eavesdrop.openstack.org/irclogs/%23oooq/%23oooq.2021-02-12.log.html#t2021-02-12T14:45:47 | 07:13 |
| ykarel | seems wes missed | 07:13 |
| ysandeep|ruck | ykarel, looking | 07:13 |
| *** slaweq has joined #oooq | 07:17 | |
| ysandeep|ruck | ykarel, iiuc.. 2 things.. try different ip for ganesha as per https://bugs.launchpad.net/tripleo/+bug/1915519/comments/2 and add job in skiplist.. will do | 07:18 |
| openstack | Launchpad bug 1915519 in tripleo "[Train][CentOS7][scenario004] Failing with Error: 'ip-192.168.24.3' already exists. Too many tries"" [Critical,Triaged] | 07:18 |
| ykarel | ysandeep|ruck, yes two seperate bugs | 07:19 |
| bhagyashris | ysandeep|ruck, this the new promoter server http://10.0.148.74/promoter_logs/ where we tried ussuri promotion for testing on friday and that was successful, after that we tried promotion for other c8 branches, but we need some changes to in like https://review.rdoproject.org/r/#/c/31659/ so thats why again inactive the dlrn-promoter service. May be will tired today again | 07:19 |
| ysandeep|ruck | bhagyashris, ack thanks, Just wondering - In the meantime what should we do about promotions? But i guess that's a question for weshay|ruck .. I will ping him in evening. | 07:21 |
| bhagyashris | ysandeep|ruck, yeah i mean i can't surely tell anything regarding that | 07:23 |
| ysandeep|ruck | folks o/ do you know where it is mentioned.. to which registries(docker or quay) we push our containers ? | 07:26 |
| ysandeep|ruck | For stein we got current-tripleo promotion on 17th feb, But containers with tag were pushed to docker not quay.. http://paste.openstack.org/show/802843/ | 07:26 |
| ysandeep|ruck | But out jobs are looking to fetch containers from quay.io/tripleostein https://13b50ff454f43e41fea1-70aee045aa856a76767e0cd0433cf359.ssl.cf5.rackcdn.com/774581/2/check/tripleo-ci-centos-7-scenario001-standalone/71d6c8e/logs/undercloud/home/zuul/containers-prepare-parameters.yaml | 07:26 |
| ysandeep|ruck | Earlier containers were getting pushed to quay till 11th feb, I am trying to understand what changed.. | 07:26 |
| ysandeep|ruck | chandankumar, ^^ if you have an idea about this.. | 07:28 |
| chandankumar | ysandeep|ruck: arxcruz was making some changes in the toolbox i think few days back | 07:32 |
| chandankumar | ysandeep|ruck: it is mentioned in the promoter config files | 07:34 |
| ysandeep|ruck | chandankumar, thanks! i didn't find it in ini file http://38.102.83.109/config/CentOS-7/stein.ini .. searching in ci-config | 07:36 |
| chandankumar | ysandeep|ruck: I am checking quay copy logs http://38.102.83.131/quay/copy-quay.txt | 07:36 |
| chandankumar | it is very big file | 07:37 |
| chandankumar | also not sure it is the correct file | 07:37 |
| chandankumar | file == copy quay | 07:37 |
| ysandeep|ruck | ~895 mb file | 07:47 |
| *** frenzy_friday has joined #oooq | 07:49 | |
| ysandeep|ruck | ~~~ | 07:50 |
| ysandeep|ruck | tiime="2021-02-17T22:47:16Z" level=error msg="Failed to copy container image: Error in copy the image: Error initializing source docker://trunk.registry.rdoproject.org/tripleostein/workspace:current-tripleo: Error reading manifest current | 07:50 |
| ysandeep|ruck | -tripleo in trunk.registry.rdoproject.org/tripleostein/workspace: name unknown" | 07:50 |
| *** amoralej|off is now known as amoralej | 08:06 | |
| *** ysandeep|ruck is now known as ysandeep|lunch | 08:08 | |
| *** apetrich has joined #oooq | 08:12 | |
| *** jpodivin has joined #oooq | 08:26 | |
| *** ykarel_ has joined #oooq | 08:30 | |
| *** ykarel has quit IRC | 08:33 | |
| *** ykarel_ is now known as ykarel | 08:33 | |
| *** tosky has joined #oooq | 08:43 | |
| bhagyashris | chandankumar, | 08:57 |
| *** jpena|off is now known as jpena | 08:58 | |
| bhagyashris | hey can you please check this https://rhos-d.infra.prod.upshift.rdu2.redhat.com/dashboard/project/instances/ | 08:58 |
| bhagyashris | for launching the instance it's showing the flavors are not available | 08:58 |
| bhagyashris | Unable to retrieve the flavors. | 09:01 |
| bhagyashris | akahat, ^ | 09:01 |
| *** ysandeep|lunch is now known as ysandeep|ruck | 09:03 | |
| chandankumar | bhagyashris: same here, can you check on #rhos-ops with kforde | 09:09 |
| bhagyashris | chandankumar, ok thank you | 09:10 |
| arxcruz | ysandeep|ruck: hey | 09:11 |
| ysandeep|ruck | arxcruz, hello o/ | 09:11 |
| arxcruz | ysandeep|ruck: whats up with quay ? | 09:12 |
| ysandeep|ruck | arxcruz, container with tag(current-tripleo hash) are not available on quay for stein | 09:13 |
| arxcruz | ysandeep|ruck: i'm checking the quay logs, it seems to have a lot of errors on stein, i'm investigating | 09:13 |
| bhagyashris | pojadhav, hey same test is failing with different attribute https://logserver.rdoproject.org/33/32033/5/check/tox-py36-ci-config/ecc964a/job-output.txt | 09:20 |
| bhagyashris | http://paste.openstack.org/show/802872/ | 09:20 |
| *** ykarel has quit IRC | 09:23 | |
| pojadhav | bhagyashris, yup in expected "revert_of" key is missing, let me create fix for it. | 09:36 |
| *** jbadiapa has joined #oooq | 09:36 | |
| bhagyashris | pojadhav, thanks | 09:38 |
| *** ykarel has joined #oooq | 09:38 | |
| *** derekh has joined #oooq | 09:44 | |
| arxcruz | ysandeep|ruck: stein is being pushed right now to quay | 09:58 |
| ysandeep|ruck | arxcruz++ | 09:58 |
| ysandeep|ruck | arxcruz, what was the issue? | 09:59 |
| arxcruz | ysandeep|ruck: is ad5a1f95770874499c54faeca6f1675358488b6e_8d9f1861_x86_64 the last good hash ? | 09:59 |
| arxcruz | ysandeep|ruck: can you confirm ? | 09:59 |
| ysandeep|ruck | arxcruz, checking | 10:00 |
| ysandeep|ruck | arxcruz, the last good hash which pass all the job is f60ad6c2010e9a65a993fbda9a35bf2a656c73d7_893d6aa4 , this is also the current-tripleo right now - https://trunk.rdoproject.org/centos7-stein/current-tripleo/delorean.repo | 10:04 |
| ysandeep|ruck | earlier we didn't have containers on quay for this ^^ hash | 10:06 |
| *** slaweq has quit IRC | 10:11 | |
| *** slaweq has joined #oooq | 10:15 | |
| *** skramaja has joined #oooq | 10:18 | |
| pojadhav | bhagyashris, https://review.rdoproject.org/r/32052 | 10:21 |
| bhagyashris | pojadhav, thanks | 10:22 |
| pojadhav | :) | 10:22 |
| *** sshnaidm__ is now known as sshnaidm | 10:22 | |
| *** jlarriba has quit IRC | 10:24 | |
| arxcruz | ysandeep|ruck: i get the hash from https://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-train-containers-build-push/076c28e/job-output.txt | 10:25 |
| ysandeep|ruck | arxcruz, but its train job.. not stein | 10:27 |
| arxcruz | stein says db93471c423322fc24743db3545da0a11b073599_a1cf5a25_x86_64 | 10:28 |
| arxcruz | ysandeep|ruck: https://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-stein-containers-build-push/6f2085c/job-output.txt | 10:28 |
| ysandeep|ruck | arxcruz, db one is existing triplep-ci-testing hash , but periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-stein-upload failed on that hash yesterday - https://review.rdoproject.org/zuul/buildset/c5378547000c4b4b9baf05be323923a0 , we can reran that job | 10:30 |
| arxcruz | ysandeep|ruck: so the job that upload the hash now is this featureset002 ? | 10:31 |
| arxcruz | ysandeep|ruck: so, here's the thing, the script get the hash and containers from periodic-tripleo-centos-7-stein-containers-build-push latest success job | 10:31 |
| arxcruz | get it from rdo.registry and push to quay | 10:32 |
| arxcruz | then mark the pushed hash as current-tripleo | 10:32 |
| arxcruz | I just run the script now and it pushes this tag db | 10:32 |
| ysandeep|ruck | arxcruz, hmm.. the only thing we need now is tripleo-ci-testing -> current-tripleo promotion .. so that check job can use containers with new hash.. I am rerunning periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-stein-upload via testproject | 10:35 |
| arxcruz | ysandeep|ruck: current-tripleo in quay is pointing now to db | 10:35 |
| ysandeep|ruck | arxcruz, https://trunk.rdoproject.org/centos7-stein/current-tripleo/delorean.repo - but that's not current-tripleo | 10:36 |
| *** ykarel has quit IRC | 10:36 | |
| arxcruz | ysandeep|ruck: where did this hash came from? as i said, the hash i get from periodic-tripleo-centos-7-stein-containers-build-push | 10:37 |
| arxcruz | and the latest passing one from yesterday is pointing to db... | 10:37 |
| ysandeep|ruck | latest periodic-tripleo-centos-7-stein-containers-build-push hash is db.., but that hash is not promoted yet to current-tripleo because 1 of a job periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-stein-upload failed. | 10:38 |
| arxcruz | ysandeep|ruck: ahh, i see, then the periodic-tripleo-centos-7-stein-containers-build-push should not be executed | 10:39 |
| arxcruz | ysandeep|ruck: let's rerun periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-stein-upload | 10:39 |
| ysandeep|ruck | arxcruz, sry, i didn't get what you mean by periodic-tripleo-centos-7-stein-containers-build-push should not be executed.. afaik.. that job creates containers and push to rdo which other jobs in integration line uses, .. i think the script which push containers to quay should only execute during tripleo-ci-testing -> current-tripleo promotion. | 10:42 |
| *** ykarel has joined #oooq | 10:42 | |
| arxcruz | ysandeep|ruck: then there's something very wrong lol | 10:43 |
| arxcruz | ysandeep|ruck: since the beginning, I always pushed to quay.io/$release/current-tripleo from these jobs | 10:43 |
| arxcruz | if that's not the case, we need to change it | 10:44 |
| ysandeep|ruck | https://review.rdoproject.org/r/#/c/28458/41/.zuul.yaml - testproject | 10:44 |
| ysandeep|ruck | I think that's okay to run only when all the jobs passes.. and we are doing tripleo-ci-testing -> current-tripleo promotion.. | 10:46 |
| *** udesale_ has joined #oooq | 10:47 | |
| ysandeep|ruck | arxcruz, anyway did you get what was the issue earlier with quay, why push was not working before? | 10:47 |
| arxcruz | ysandeep|ruck: yes, it was a change in the log, so the regex wasn't working properly, i can show you later | 10:47 |
| ysandeep|ruck | arxcruz++ sure, thanks for fixing that | 10:48 |
| *** udesale has quit IRC | 10:50 | |
| *** tosky_ has joined #oooq | 10:53 | |
| *** tosky has quit IRC | 10:54 | |
| *** tosky_ is now known as tosky | 10:54 | |
| *** migi has joined #oooq | 10:58 | |
| migi | zbr: hello, I have question around https://github.com/ansible-community/ansible-lint/issues/644 | 11:00 |
| bhagyashris | chandankumar, plz add in your review list https://review.rdoproject.org/r/#/c/32052/ | 11:09 |
| bhagyashris | https://review.rdoproject.org/r/#/c/32033/ | 11:09 |
| *** slaweq_ has joined #oooq | 11:27 | |
| *** slaweq has quit IRC | 11:31 | |
| *** jmasud has joined #oooq | 11:49 | |
| *** dtantsur|brb is now known as dtantsur | 11:50 | |
| *** jmasud has quit IRC | 12:16 | |
| *** jlarriba has joined #oooq | 12:21 | |
| *** rlandy has joined #oooq | 12:28 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| rlandy | ysandeep|ruck: hey - did you fix something in ovb? last run went to deployment | 12:35 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/10/207510/106/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/3de7601/job-output.txt | 12:35 |
| ysandeep|ruck | rlandy, no i didn't touch that. Busy day in upstream ruck/rover | 12:37 |
| rlandy | ysandeep|ruck: k - no worries - just surprised | 12:38 |
| rlandy | I'm on iy | 12:38 |
| rlandy | it | 12:38 |
| rlandy | good surprised - but surprised | 12:38 |
| *** jlarriba has quit IRC | 13:00 | |
| *** amoralej is now known as amoralej|lunch | 13:00 | |
| bhagyashris | akahat, chandankumar rlandy pojadhav ysandeep|ruck sshnaidm scrum | 13:00 |
| marios | https://review.opendev.org/q/topic:tripleo-ci-reduce | 13:01 |
| *** tosky has quit IRC | 13:18 | |
| *** tosky has joined #oooq | 13:24 | |
| *** jpena|lunch is now known as jpena | 13:25 | |
| *** ratailor has quit IRC | 13:38 | |
| rlandy | sshnaidm: who runs the df call so I can ask if we can join with the tripleo-repos topic? | 13:38 |
| sshnaidm | rlandy, pweeks? | 13:38 |
| marios | rlandy: sshnaidm: try cedric | 13:39 |
| marios | rlandy: sshnaidm: Tengu: ^^ | 13:39 |
| rlandy | sshnaidm: marios: k, thanks | 13:39 |
| chandankumar | rlandy: didnot get the question during scrum regarding dependency pipeline | 13:39 |
| rlandy | chandankumar: was just asking if you know the schedule for container-tools 3.0 | 13:40 |
| chandankumar | rlandy: nope | 13:40 |
| rlandy | chandankumar: k - np | 13:40 |
| rlandy | will check | 13:40 |
| frenzy_friday | rlandy, are we meeting after the cix call for the c8 stream integration line? | 13:41 |
| bhagyashris | weshay|ruck, we are done with scrum, will meet after CIX call? | 13:42 |
| bhagyashris | akahat, ^ | 13:42 |
| akahat | I'm okay. | 13:42 |
| rlandy | frenzy_friday: yep - let's meet when we can get weshay|ruck's time ^^ after he is done with the promoter work | 13:43 |
| bhagyashris | chandankumar, plz add in your review list https://review.rdoproject.org/r/#/c/32010/ thanks :) | 13:44 |
| weshay|ruck | akahat, you here? | 13:50 |
| akahat | weshay|ruck, yes | 13:50 |
| weshay|ruck | bhagyashris, akahat can we sync for a few min? | 13:50 |
| bhagyashris | weshay|ruck, sure | 13:50 |
| akahat | weshay|ruck, yes. | 13:50 |
| *** apetrich has quit IRC | 13:51 | |
| weshay|ruck | bhagyashris, akahat meet.google.com/zyu-vnzi-czr | 13:51 |
| bhagyashris | weshay|ruck, https://review.rdoproject.org/r/#/c/32052/ | 13:52 |
| bhagyashris | weshay|ruck, https://review.rdoproject.org/r/#/c/32033/ | 13:53 |
| bhagyashris | weshay|ruck, https://logserver.rdoproject.org/33/32033/5/check/tox-py36-ci-config/ecc964a/job-output.txt | 13:54 |
| *** ykarel has quit IRC | 13:56 | |
| bhagyashris | weshay|ruck, https://review.rdoproject.org/r/#/c/31659/ | 13:59 |
| *** amoralej|lunch is now known as amoralej | 14:00 | |
| weshay|ruck | https://github.com/weshayutin.keys | 14:02 |
| chandankumar | weshay|ruck: rlandy https://review.rdoproject.org/r/#/c/32059/ | 14:08 |
| *** apetrich has joined #oooq | 14:11 | |
| weshay|ruck | rlandy, frenzy_friday you folks want to chat? | 14:12 |
| rlandy | weshay|ruck: yep | 14:12 |
| frenzy_friday | weshay|ruck yep | 14:12 |
| weshay|ruck | meet.google.com/qgs-rwgq-eob | 14:12 |
| *** jlarriba has joined #oooq | 14:20 | |
| *** tosky has quit IRC | 14:29 | |
| *** tosky has joined #oooq | 14:33 | |
| weshay|ruck | frenzy_friday, rlandy thanks | 14:35 |
| sshnaidm | frenzy_friday, rlandy please ping me when you want to talk what should be done in sundays | 14:41 |
| sshnaidm | frenzy_friday, rlandy about c8-stream | 14:44 |
| rlandy | sshnaidm: ack - will do - once we see the integration line run once | 14:45 |
| rlandy | sshnaidm: I will be around as well | 14:45 |
| rlandy | weshay|ruck: are master promotions still triggering? | 14:46 |
| weshay|ruck | rlandy, no | 14:46 |
| rlandy | k - cool | 14:46 |
| rlandy | weshay|ruck: sorry - not promotions - the line | 14:46 |
| rlandy | ie: the general integration line | 14:46 |
| ysandeep|ruck | rlandy, yes | 14:46 |
| rlandy | if that starts in the middle it will rev the tripleo-ci-testing hash | 14:47 |
| rlandy | we're running an integration testproject | 14:47 |
| rlandy | ysandeep|ruck: weshay|ruck: we need to stop the master line temp | 14:49 |
| rlandy | putting up temp patch we can reverse | 14:49 |
| weshay|ruck | rlandy, oh.. ok.. let me kill it | 14:49 |
| weshay|ruck | sec | 14:49 |
| rlandy | weshay|ruck: do you have those powers? | 14:50 |
| weshay|ruck | yes | 14:50 |
| rlandy | or do I need a config patch? | 14:50 |
| rlandy | it will kick in an hour approx | 14:50 |
| sshnaidm | pojadhav, wrt grafana patches, you have a button "share" near dashboard name, when you press it you'll have an option to create a snapshot and publish it on snapshot.raintank.io | 14:52 |
| sshnaidm | pojadhav, this link can be attached to patch comments | 14:52 |
| weshay|ruck | rlandy, master is not currently running | 14:52 |
| rlandy | weshay|ruck++ | 14:52 |
| weshay|ruck | https://review.rdoproject.org/zuul/status | 14:52 |
| rlandy | weshay|ruck: we can re-enable when testproject is done | 14:53 |
| rlandy | it's running ... frenzy_friday++ | 14:57 |
| rlandy | nice work | 14:57 |
| rlandy | weshay|ruck: ^^ testproject in progress | 14:57 |
| weshay|ruck | rock on | 14:57 |
| ysandeep|ruck | weshay|ruck, fyi.. sc01/sc04 passed in 17.. i will update those card/bzs | 14:58 |
| weshay|ruck | ysandeep|ruck++ | 15:00 |
| weshay|ruck | ysandeep|ruck, ok.. so I'll look to see if we should promote.. | 15:00 |
| pojadhav | sshnaidm, ack.. thanks for this information :) | 15:00 |
| *** skramaja has quit IRC | 15:03 | |
| rlandy | frenzy_friday: we have a conatiner build failure ... https://logserver.rdoproject.org/41/32041/3/check/periodic-tripleo-ci-build-containers-ubi-8-push/20dfc14/job-output.txt | 15:11 |
| rlandy | frenzy_friday: we're missing the additions to the job definitions | 15:14 |
| *** tosky has quit IRC | 15:15 | |
| rlandy | vars: | 15:15 |
| rlandy | push_containers: false | 15:15 |
| rlandy | volume_mounts: | 15:15 |
| rlandy | - "/etc/yum.repos.d:/etc/distro.repos.d:z" | 15:15 |
| rlandy | - "/etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z" | 15:15 |
| rlandy | - "/etc/dnf/vars:/etc/dnf/vars:z" | 15:15 |
| rlandy | not the push false thing | 15:15 |
| *** tosky has joined #oooq | 15:15 | |
| rlandy | just the volume mounts | 15:15 |
| rlandy | can you add that? | 15:16 |
| rlandy | and recheck | 15:16 |
| *** tosky_ has joined #oooq | 15:18 | |
| rlandy | Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried | 15:19 |
| *** tosky is now known as Guest43629 | 15:19 | |
| *** tosky_ is now known as tosky | 15:19 | |
| *** Guest43629 has quit IRC | 15:21 | |
| bhagyashris | weshay|ruck, chandankumar we need +W on https://review.rdoproject.org/r/#/c/31659/ | 15:24 |
| * bhagyashris dinner|brb | 15:24 | |
| chandankumar | done | 15:24 |
| bhagyashris | thanks | 15:25 |
| chandankumar | bhagyashris: https://review.rdoproject.org/r/#/c/32060/ 50 is too much | 15:26 |
| chandankumar | can we move it to 10? | 15:26 |
| chandankumar | it will increase the promotion timing | 15:27 |
| weshay|ruck | chandankumar, 50 is correct | 15:33 |
| weshay|ruck | chandankumar, in c8 w/ components.. each component is one tick | 15:34 |
| weshay|ruck | in c7 w/o components.. it can be 10 | 15:34 |
| weshay|ruck | chandankumar, make sense? | 15:34 |
| chandankumar | weshay|ruck: in c8, all component getting promoted in one go, then coming to integration pipeline there it looks for different hashs, going over to 50 hashs, if it get it in 5 iterations, it will promotes, if not then go over to 50 | 15:39 |
| chandankumar | will take time na? | 15:40 |
| chandankumar | I am ok with 50 | 15:40 |
| weshay|ruck | not sure if that's a question | 15:41 |
| weshay|ruck | basically what I'm saying is that 50 hash != 50 executions of the integration line | 15:41 |
| weshay|ruck | it's more like 4+ | 15:41 |
| ysandeep|ruck | rlandy, we need to revert the 16.2 temporarily time change - https://code.engineering.redhat.com/gerrit/#/c/228650/ | 15:42 |
| weshay|ruck | chandankumar, ^ | 15:42 |
| weshay|ruck | for c8 | 15:42 |
| *** ysandeep|ruck is now known as ysandeep|dinner | 15:42 | |
| rlandy | done | 15:42 |
| ysandeep|dinner | ++ | 15:42 |
| chandankumar | weshay|ruck: in promotion, for each hashes, it checks the criteria, if passes, they promote, if not then it goes over multiple hashs | 15:42 |
| chandankumar | basically what I'm saying is that 50 hash != 50 executions of the integration line => totally agreeing | 15:44 |
| chandankumar | just concerned about going over multiple hashes query | 15:44 |
| weshay|ruck | k ++ | 15:46 |
| frenzy_friday | rlandy, lemme check | 15:54 |
| rlandy | frenzy_friday: I have the edit ready - let me copy for you | 15:54 |
| rlandy | hol don | 15:54 |
| rlandy | frenzy_friday: https://review.rdoproject.org/r/#/c/32041/3..4/.zuul.yaml | 15:57 |
| rlandy | frenzy_friday: sorry - should have caught that earlier | 15:58 |
| rlandy | ok - we're running again | 15:58 |
| frenzy_friday | oh, that guy! sorry, I should have added it, lemme add | 15:58 |
| frenzy_friday | oh, you added it, thanks | 15:59 |
| rlandy | sorry - one more | 16:00 |
| rlandy | forgot hardened master | 16:00 |
| rlandy | k - think we have it now | 16:00 |
| frenzy_friday | rlandy, are these the names of the new nodesets? https://review.rdoproject.org/r/#/c/32061/ | 16:17 |
| *** jpodivin has quit IRC | 16:18 | |
| rlandy | looking | 16:18 |
| rlandy | frenzy_friday: I ma not sure about the vexxhost specification | 16:19 |
| rlandy | I think you should be able to use label: upstream-centos-8-stream | 16:20 |
| frenzy_friday | rlandy, so both will have label upstream-centos-8-stream ? | 16:20 |
| rlandy | I think so | 16:20 |
| frenzy_friday | ok, lemme update | 16:20 |
| rlandy | that should load balance between psi and vexxhost | 16:20 |
| *** ysandeep|dinner is now known as ysandeep|away | 16:21 | |
| ysandeep|away | rlandy, fyi.. 16.2 line got killed due failure in container build .. https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-16.2/49d1e9b/job-output.txt | 16:27 |
| rlandy | ok - will look in a gew | 16:28 |
| rlandy | few | 16:28 |
| bhagyashris | weshay|ruck, akahat i pull all the recently merged changes and made the necessary changes in .sh file | 16:28 |
| ysandeep|away | thanks! | 16:28 |
| * ysandeep|away leaves for the day | 16:28 | |
| *** marios has quit IRC | 16:31 | |
| bhagyashris | weshay|ruck, akahat we are good to go | 16:33 |
| akahat | bhagyashris, great.. let's start the service | 16:33 |
| akahat | weshay|ruck, ^^ | 16:33 |
| *** jmasud has joined #oooq | 16:34 | |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-16.2/49d1e9b/logs/report.html | 16:37 |
| rlandy | looks like they all built | 16:37 |
| *** dtantsur is now known as dtantsur|afk | 16:38 | |
| rlandy | ugh - so where is the error?? | 16:42 |
| weshay|ruck | bhagyashris, akahat k.. /me looks | 16:44 |
| rlandy | ah - ush error | 16:50 |
| rlandy | internal server | 16:50 |
| bhagyashris | weshay|ruck, ok. i saw you restart the service | 16:59 |
| weshay|ruck | aye.. bhagyashris I'll watch it from here.. and sync w/ you and akahat tomorrow | 17:00 |
| weshay|ruck | bhagyashris, have a good night | 17:00 |
| weshay|ruck | akahat, emacs.. oh man.. been a very long time for me | 17:00 |
| bhagyashris | weshay|ruck, akahat ok thank you :) Good night | 17:00 |
| * bhagyashris out | 17:00 | |
| akahat | :D | 17:00 |
| akahat | emacs is better then vi/vim :P | 17:01 |
| weshay|ruck | ya ya | 17:01 |
| *** udesale_ has quit IRC | 17:04 | |
| *** udesale has joined #oooq | 17:05 | |
| *** jmasud has quit IRC | 17:09 | |
| weshay|ruck | bhagyashris, tc/ua sync please | 17:13 |
| *** udesale has quit IRC | 17:15 | |
| *** jmasud has joined #oooq | 17:19 | |
| rlandy | weshay|ruck: frenzy_friday; woohoo - we're rolling onto testing now | 17:25 |
| frenzy_friday | rlandy, cool! | 17:30 |
| frenzy_friday | https://review.opendev.org/c/openstack/tripleo-ci/+/775429/2/roles/tripleo-repos/tasks/main.yml#105 - this seems to be adding --stream even for non stream nodes. I'm checking | 17:30 |
| *** jpodivin has joined #oooq | 17:34 | |
| *** jlarriba has quit IRC | 17:36 | |
| rlandy | weshay|ruck: ysandeep|away: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/776692 review requested - for 8.4 ovb | 17:39 |
| *** jmasud has quit IRC | 17:39 | |
| *** amoralej is now known as amoralej|off | 17:40 | |
| *** jpena is now known as jpena|off | 17:55 | |
| *** derekh has quit IRC | 18:01 | |
| *** jmasud has joined #oooq | 18:11 | |
| *** amoralej|off is now known as amoralej | 18:19 | |
| *** jmasud has quit IRC | 18:35 | |
| *** jmasud has joined #oooq | 19:03 | |
| *** saneax has quit IRC | 19:04 | |
| *** jmasud has quit IRC | 19:39 | |
| rlandy | frenzy_friday: your job is running now with node failures | 19:46 |
| rlandy | frenzy_friday: ^^ network issues - abandon and restore to rekick | 19:47 |
| frenzy_friday | rlandy, ok | 19:47 |
| frenzy_friday | restarted | 19:48 |
| rlandy | thanks | 19:48 |
| rlandy | weshay|ruck: remember the multinode verclou can't be reached where we worked around with one playbook? | 19:49 |
| rlandy | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/main.yml#L4 | 19:49 |
| rlandy | 2021-02-21 03:08:43.770745 | primary | TASK [build-test-packages : gather facts used by role] ************************* | 19:49 |
| rlandy | 2021-02-21 03:08:43.770777 | primary | Sunday 21 February 2021 03:08:43 +0000 (0:00:00.079) 1:33:24.476 ******* | 19:49 |
| rlandy | 2021-02-21 03:09:27.893974 | primary | fatal: [subnode-1]: UNREACHABLE! => { | 19:49 |
| rlandy | 2021-02-21 03:09:27.894065 | primary | "changed": false, | 19:49 |
| rlandy | 2021-02-21 03:09:27.894075 | primary | "unreachable": true | 19:49 |
| rlandy | 2021-02-21 03:09:27.894083 | primary | } | 19:49 |
| weshay|ruck | rlandy, why is build test packages running? | 19:50 |
| rlandy | weshay|ruck: excellent question ... | 19:50 |
| rlandy | validations | 19:50 |
| weshay|ruck | huh? | 19:50 |
| rlandy | 2021-02-21 03:08:43.730549 | primary | PLAY [Configure next release repository in the undercloud] ********************* | 19:51 |
| rlandy | 2021-02-21 03:08:43.740078 | primary | | 19:51 |
| * rlandy compares with fs010 in rdo | 19:51 | |
| rlandy | playbooks: | 19:53 |
| rlandy | - multinode.yml | 19:53 |
| rlandy | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/multinode.yml#L7 | 19:53 |
| rlandy | weshay|ruck: openstack-periodic-integration-main is running | 19:56 |
| rlandy | which meana frenzy_friday is not testing stream | 19:56 |
| rlandy | can we stop that line for some time | 19:57 |
| rlandy | weshay|ruck: also btw ... update runs in rdo fs010 multinode as well https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset010-train/d21467f/job-output.txt | 19:58 |
| *** slaweq_ has quit IRC | 20:07 | |
| rlandy | frenzy_friday: we need to stop the main line from kicking at all | 20:08 |
| rlandy | weshay|ruck: putting in a patch unless you have powers to stop the line altogether | 20:09 |
| rlandy | https://review.rdoproject.org/r/32064 Comment out the main line triggering - c8 stream | 20:14 |
| rlandy | weshay|ruck: frenzy_friday: ^^ | 20:14 |
| rlandy | frenzy_friday: ^^ we need to merge this and then rerun the entire line | 20:14 |
| sshnaidm | weshay|ruck, any objections to remove centos7 libvirt support from reproducer? | 20:15 |
| sshnaidm | latest virt-customize is not compatible with rhel7, need tweaks and hacks.. | 20:16 |
| frenzy_friday | rlandy, ok. Should I recheck the actual testproject with the whole integration line then? | 20:16 |
| rlandy | frenzy_friday: pls hold - let me merge that change | 20:18 |
| frenzy_friday | sure | 20:18 |
| rlandy | it's still testing | 20:19 |
| rlandy | and when that is merged - yes, we need to rekick the testproject withe the whole line | 20:20 |
| rlandy | will ping you when | 20:20 |
| frenzy_friday | cool, I'll check back in an hr. Else I'll recheck tomorrow morning before class | 20:20 |
| rlandy | if it's ready, I'll rekick it - no worries | 20:22 |
| rlandy | frenzy_friday: you around? | 20:42 |
| rlandy | we can kill this now https://review.rdoproject.org/r/#/c/32063/ | 20:42 |
| weshay|ruck | sshnaidm, why remove it? | 20:53 |
| weshay|ruck | oh.. virt-customize | 20:53 |
| weshay|ruck | sshnaidm, centos-7 was working for owen and david | 20:54 |
| weshay|ruck | daniel rather | 20:54 |
| weshay|ruck | sshnaidm, are you sure it's centos-7 or the hardware we're using | 20:54 |
| *** jmasud has joined #oooq | 21:01 | |
| *** slaweq_ has joined #oooq | 21:09 | |
| rlandy | frenzy_friday: I rekicked your entire job - fee free to stop https://review.rdoproject.org/r/#/c/32063/ whenever | 21:16 |
| rlandy | weshay|ruck: fyi - I killed the main line triggering | 21:17 |
| rlandy | it was messing with testing | 21:17 |
| sshnaidm | weshay|ruck, I mean host that reproducer containers are executed on, not zuul node.. | 21:40 |
| weshay|ruck | OH | 21:43 |
| weshay|ruck | sshnaidm, yes.. kill the c7 host | 21:43 |
| weshay|ruck | I get it now.. +1000 | 21:43 |
| *** jmasud has quit IRC | 21:52 | |
| *** jmasud has joined #oooq | 21:54 | |
| frenzy_friday | rlandy, thanks | 22:05 |
| frenzy_friday | Killed 32041 | 22:09 |
| rlandy | ovb is deploying overcloud - how nice | 22:15 |
| rlandy | frenzy_friday: I'll watch it - thanks | 22:16 |
| rlandy | see you tomorrow | 22:16 |
| *** slaweq_ has quit IRC | 22:40 | |
| rlandy | https://review.opendev.org/c/openstack/tripleo-ci/+/771717 test provider on stream | 22:45 |
| rlandy | ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: No valid host was found. , Code: 500" | 22:45 |
| rlandy | ugh - maybe our hosts need to be bigger now? | 22:46 |
| *** jmasud has quit IRC | 23:23 | |
| *** jmasud has joined #oooq | 23:35 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!