| *** sshnaidm|afk has joined #oooq | 00:20 | |
| *** sshnaidm|afk is now known as sshnaidm|off | 00:20 | |
| *** gouthamr has quit IRC | 00:57 | |
| *** gouthamr has joined #oooq | 00:59 | |
| *** tosky has quit IRC | 01:01 | |
| *** rfolco has joined #oooq | 01:02 | |
| *** rfolco has quit IRC | 01:18 | |
| *** Goneri has quit IRC | 02:19 | |
| *** skramaja has joined #oooq | 03:40 | |
| *** ykarel|away has joined #oooq | 04:53 | |
| *** ykarel|away is now known as ykarel | 04:53 | |
| *** udesale has joined #oooq | 04:56 | |
| *** ratailor has joined #oooq | 06:20 | |
| *** ysandeep|away is now known as ysandeep | 06:55 | |
| *** marios has joined #oooq | 07:17 | |
| *** saneax has joined #oooq | 07:31 | |
| *** amoralej|off is now known as amoralej | 07:44 | |
| marios | pojadhav|ruck: o/ do you have any idea what's going on with the upstream zuul queue? | 08:42 |
|---|---|---|
| marios | pojadhav|ruck: 1.1 day | 08:42 |
| marios | 39 fails in upstream gate jobs # | 08:43 |
| marios | do we have known gate issues? | 08:43 |
| marios | http://dashboard-ci.tripleo.org/d/Z4vLSmOGk/cockpit?orgId=1 | 08:43 |
| *** jpena|off is now known as jpena | 08:57 | |
| *** tosky has joined #oooq | 09:05 | |
| *** frenzy_friday has joined #oooq | 09:06 | |
| pojadhav|ruck | marios, till now didnt get any common issue, checking 1 by 1 job from gate failures. | 09:07 |
| *** derekh has joined #oooq | 09:09 | |
| marios | pojadhav|ruck: ack | 09:10 |
| *** ysandeep is now known as ysandeep|lunch | 09:12 | |
| *** ysandeep|lunch is now known as ysandeep | 11:13 | |
| *** rfolco has joined #oooq | 11:36 | |
| ykarel | marios, chandankumar can u take a look at https://review.opendev.org/c/openstack/tripleo-quickstart/+/763548 and https://review.opendev.org/c/openstack/tripleo-ci/+/764120 | 11:52 |
| marios | ykarel: ack noting for next reviews | 11:53 |
| *** ratailor has quit IRC | 12:01 | |
| *** jpena is now known as jpena|lunch | 12:32 | |
| *** cgoncalves has quit IRC | 12:45 | |
| *** cgoncalves has joined #oooq | 12:46 | |
| *** cgoncalves has quit IRC | 12:47 | |
| *** udesale_ has joined #oooq | 12:47 | |
| *** udesale has quit IRC | 12:49 | |
| *** weshay|pto is now known as weshay|ruck | 12:49 | |
| weshay|ruck | pojadhav|ruck, 0/ | 12:52 |
| pojadhav|ruck | weshay|ruck, \0 | 12:56 |
| pojadhav|ruck | gate is bad today :( | 12:56 |
| weshay|ruck | pojadhav|ruck, master gate is fine.. it's ussuri and train | 12:57 |
| pojadhav|ruck | yup.. mostly upgrades jobs .. rate limiting/tempest ssh timeout issues | 12:58 |
| pojadhav|ruck | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-ussuri and https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-victoria | 12:59 |
| weshay|ruck | rate limiting from quay? | 12:59 |
| pojadhav|ruck | docker | 12:59 |
| weshay|ruck | docker? | 12:59 |
| weshay|ruck | what upgrade jobs are still using docker.io? | 13:00 |
| *** rlandy has joined #oooq | 13:00 | |
| pojadhav|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3a7/760651/1/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/3a72ec6/logs/undercloud/home/zuul/undercloud_upgrade.log | 13:00 |
| weshay|ruck | marios, ^ | 13:00 |
| marios | pojadhav|ruck: can you please file bugs | 13:01 |
| pojadhav|ruck | yup | 13:01 |
| marios | pojadhav|ruck: are they both the same issue? | 13:01 |
| pojadhav|ruck | victoria i am checking.. | 13:02 |
| rlandy | matbu: hey - you all set with the testing your changes? | 13:02 |
| marios | weshay|ruck: i'll have a look once pojadhav|ruck digs a bit and files bugs | 13:02 |
| rlandy | weshay|ruck: hey - welcome back | 13:02 |
| pojadhav|ruck | but upgrade ussuri having docker.io | 13:02 |
| marios | pojadhav|ruck: because https://review.opendev.org/c/openstack/python-tripleoclient/+/757836 | 13:04 |
| weshay|ruck | 0/ | 13:04 |
| chandankumar | rlandy: weshay|ruck https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/762400 is good to go knpo | 13:04 |
| marios | pojadhav|ruck: it hits docker.io because for tripoleoclient we didn't wire up content provider yet until 15:04 < marios> pojadhav|ruck: because https://review.opendev.org/c/openstack/python-tripleoclient/+/757836 | 13:04 |
| marios | weshay|ruck: pojadhav|ruck: victoria looks ok? https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-victoria | 13:05 |
| weshay|ruck | pojadhav|ruck, are scenario01/04 fixed | 13:05 |
| marios | pojadhav|ruck: weshay|ruck: hmm... 3 gate fails yesterday ... | 13:06 |
| pojadhav|ruck | weshay|ruck, yes fixed : https://review.opendev.org/c/openstack/tripleo-heat-templates/+/764140 | 13:06 |
| marios | pojadhav|ruck: if you find consistent errors and file bugs i will have a closer look | 13:06 |
| rlandy | looking | 13:07 |
| marios | pojadhav|ruck: but don't file a bug for the docker.io issue please | 13:07 |
| marios | pojadhav|ruck: i.e. we know that is because we are waiting for https://review.opendev.org/c/openstack/python-tripleoclient/+/757836 | 13:07 |
| pojadhav|ruck | marios, https://zuul.opendev.org/t/openstack/build/3a72ec67a8fb43b881bc17315398c6be/log/logs/undercloud/home/zuul/undercloud_upgrade.log | 13:07 |
| pojadhav|ruck | marios, sure | 13:08 |
| weshay|ruck | marios, pojadhav|ruck this is why we add depends-on | 13:08 |
| weshay|ruck | meh.. scen01 timed out https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_70e/757836/17/gate/tripleo-ci-centos-8-scenario001-standalone/70e9403/logs/index.html | 13:09 |
| weshay|ruck | at least it's friday | 13:09 |
| weshay|ruck | pojadhav|ruck, you want to do a hand off? | 13:10 |
| pojadhav|ruck | weshay|ruck, hmm | 13:10 |
| marios | weshay|ruck: rlandy: rfolco: chandankumar: ysandeep: sshnaidm|off: needs reviews please https://review.rdoproject.org/r/#/c/31200/ & depends-on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/764767 - test at https://review.rdoproject.org/r/#/c/31201/ ussuri is not green yet i filed https://bugs.launchpad.net/tripleo/+bug/1906822 | 13:10 |
| openstack | Launchpad bug 1906822 in tripleo "tripleo component standalone-upgrade ussuri glance DBConnectionError No route to host" [High,Triaged] | 13:10 |
| marios | (https://projects.engineering.redhat.com/browse/TRIPLEOCI-257) please thank you | 13:10 |
| pojadhav|ruck | weshay|ruck, https://meet.google.com/her-zuex-pas?authuser=0 | 13:12 |
| marios | rlandy: i replied to your comment on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/764767 let me know if you want me to update | 13:12 |
| weshay|ruck | marios, standalone-upgrade-ussuri is voting/gating | 13:12 |
| marios | weshay|ruck: ? | 13:12 |
| marios | weshay|ruck: what are you referring to with 15:12 < weshay|ruck> marios, standalone-upgrade-ussuri is voting/gating | 13:12 |
| weshay|ruck | ah.. nvrmind.. ur bug is periodic :) | 13:13 |
| weshay|ruck | marios, just looking at tags on that bug.. ur good | 13:13 |
| weshay|ruck | sorry | 13:13 |
| matbu | rlandy: Hey, yep thank you very, it's working perfectly as i wanted :) | 13:13 |
| marios | weshay|ruck: ah the new bug | 13:13 |
| matbu | very much* | 13:13 |
| marios | weshay|ruck: yeah it is tripleo component so its a new job | 13:13 |
| marios | weshay|ruck: in fact unmerged | 13:14 |
| * ysandeep just wondering why upgrade job should go to tripleo component :) | 13:14 | |
| marios | weshay|ruck: been scratching my head about that one... in both integration and check/gate the stnadlone-upgrade ussuri is green mostly but tripleo-component fails consistently | 13:14 |
| marios | ... | 13:15 |
| *** skramaja has quit IRC | 13:19 | |
| weshay|ruck | pojadhav|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/762400/9/roles/container-build/tasks/non_tripleo_containers.yml | 13:20 |
| weshay|ruck | pojadhav|ruck, https://docs.google.com/spreadsheets/d/1M1U-ekjEsec-bRjRq7q5rzjbJWKE2uT-ESX4SkeC0Uc/edit#gid=0&fvid=1778061576 | 13:29 |
| *** jpena|lunch is now known as jpena | 13:29 | |
| ysandeep | marios, will we add this upgrade job in criteria for tripleo component promotion (in future once this job is stable)? | 13:29 |
| ysandeep | I am still wondering if we should block tripleo component on upgrade jobs, or if tripleo component is right place to add the upgrade job. | 13:30 |
| marios | ysandeep: o/ yes that is the plan to add into criteria | 13:31 |
| marios | ysandeep: i had to choose one... tripleo component will bring us the tripleo things tripleo-heat-templates python-tripleoclient etc... | 13:31 |
| marios | ysandeep: why do you think it is a bad idea | 13:31 |
| marios | ysandeep: comment on the review? | 13:31 |
| marios | ysandeep: and it won't be only one component will add to others once we start with the first | 13:32 |
| rlandy | marios: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/764767 responded - ok if it's working +2 | 13:32 |
| ysandeep | >> ysandeep: and it won't be only one component will add to others once we start with the first --> thanks i am okay then | 13:32 |
| ysandeep | marios++ thanks! | 13:32 |
| *** ysandeep is now known as ysandeep|mtg | 13:33 | |
| marios | rlandy: yeah investigating an issue with ussuri job but filed a bug for that not sure yet what's up but we aren't adding them to criteria here just landing the definitions and putting them into the component runs | 13:33 |
| rlandy | chandankumar: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/762400 looks good | 13:34 |
| rlandy | marios: ack - just let us know what needs to be watched/merged by your EOD | 13:35 |
| marios | rlandy: thanks | 13:37 |
| marios | rlandy: wasn't sure what you meant with that one https://review.rdoproject.org/r/#/c/31200/3//COMMIT_MSG@10 | 13:38 |
| rlandy | marios: looks fine - not sure what I was writing there - must have stopped mid-sentence | 13:39 |
| rlandy | marios: I think I was going to say wires then up disabled - but then you had that below | 13:40 |
| marios | rlandy: ack | 13:40 |
| *** cgoncalves has joined #oooq | 13:40 | |
| marios | chandankumar: rlandy: rfolco: sshnaidm|off: weshay|ruck: anyone got a WF for me? https://review.opendev.org/c/openstack/tripleo-ci/+/764359 | 13:42 |
| rlandy | marios: done | 13:42 |
| marios | rlandy: thank you | 13:42 |
| marios | rlandy: the last check run failed on tripleo-build-containers-centos-7-buildah-stein https://zuul.opendev.org/t/openstack/build/ca44612c65b24ae5b3a1e587589b6845 : FAILURE in 15m 24s but that was green last time... anyway it will run again now so no need to get that green before WF | 13:43 |
| rlandy | hmmm .. timeouts on train/stein content providers | 13:43 |
| * pojadhav|ruck brb | 13:43 | |
| marios | rlandy: thanks | 13:43 |
| weshay|ruck | zbr, fyi.. 1-1 today | 13:50 |
| *** amoralej is now known as amoralej|lunch | 13:52 | |
| zbr | weshay|ruck: i know, but you will be disappointed, no news. | 13:52 |
| rlandy | marios: I have a similiar timeout on the kolla removal patch - timeout on stein | 13:53 |
| rlandy | maybe we have an issue in general there | 13:53 |
| rlandy | not your patch | 13:54 |
| rlandy | checking cockpit | 13:54 |
| marios | rlandy: ack | 13:56 |
| *** saneax has quit IRC | 13:57 | |
| weshay|ruck | chandankumar, that's for the container pull retry patch! | 14:01 |
| weshay|ruck | saw at least two recent gate failures on that | 14:02 |
| weshay|ruck | marios, fyi ^ | 14:02 |
| chandankumar | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/764218 and https://review.opendev.org/c/openstack/tripleo-ci/+/764218 might help | 14:03 |
| chandankumar | weshay|ruck: I need to copy toci retry logic to content provider | 14:04 |
| weshay|ruck | chandankumar, hey.. if we start including retries on provider builds | 14:18 |
| weshay|ruck | we'll need to think about the run time.. and job timeout values | 14:18 |
| *** ysandeep|mtg is now known as ysandeep | 14:19 | |
| weshay|ruck | marios, you have a quick sec? | 14:20 |
| weshay|ruck | https://meet.google.com/pby-rfzc-hbn?authuser=1 | 14:20 |
| weshay|ruck | akahat, I've seen a few patches on the promoter from you | 14:21 |
| weshay|ruck | akahat, are we close to being able to stand up a test promoter? | 14:22 |
| akahat | weshay|ruck, no.. not yet.. lot needs to fix.. | 14:22 |
| akahat | we are trying to run promoter server with new config.. | 14:22 |
| akahat | it's not ready yet.. | 14:23 |
| akahat | but hope so in next week.. bhagyashris and I planning to add support for rockey release. | 14:23 |
| akahat | after that we can go for some live testing.. | 14:24 |
| marios | weshay|ruck: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-ussuri&job_name=tripleo-ci-centos-8-undercloud-upgrade-victoria | 14:24 |
| marios | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-upgrade/+/760900 | 14:30 |
| marios | weshay|ruck: still in review | 14:30 |
| marios | weshay|ruck: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-ussuri&job_name=tripleo-ci-centos-8-undercloud-upgrade-victoria | 14:33 |
| *** apetrich has quit IRC | 14:35 | |
| chandankumar | weshay|ruck: yes, will look into re-try limit and job timing out | 14:36 |
| weshay|ruck | akahat, k.. next week I'd like to hear about it | 14:38 |
| *** apetrich has joined #oooq | 14:38 | |
| *** amoralej|lunch is now known as amoralej | 14:40 | |
| marios | weshay|ruck: https://projects.engineering.redhat.com/browse/TRIPLEOCI-257 | 14:42 |
| chandankumar | marios: from monday, we will be rucking and rovering, Do you want to go ahead as a ruck? | 14:46 |
| marios | chandankumar: i will be rover | 14:47 |
| chandankumar | marios: ok, we can do sync with current rr on monday? | 14:47 |
| marios | chandankumar: monday works for me? | 14:47 |
| chandankumar | marios: for me, yes | 14:48 |
| marios | chandankumar: we can discuss monday, if you like we can do both ruck|rover since it is only 1week/split the calls etc | 14:48 |
| weshay|ruck | zbr, knock knock | 14:48 |
| chandankumar | marios: sounds good | 14:48 |
| *** TrevorV has joined #oooq | 14:48 | |
| *** Goneri has joined #oooq | 14:54 | |
| ysandeep | weshay|ruck, hey o/ when you have time, could you please review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/763786 | 14:58 |
| weshay|ruck | ysandeep, aye | 14:59 |
| * weshay|ruck immediately likes the code comments | 14:59 | |
| weshay|ruck | + | 14:59 |
| *** jbadiapa has joined #oooq | 15:00 | |
| weshay|ruck | ysandeep, please update the commit-msg and state.. this work will not be executed upstream but rather in periodic | 15:02 |
| weshay|ruck | we need to make that clear | 15:02 |
| ysandeep | weshay|ruck, sure o/ | 15:03 |
| ysandeep | weshay|ruck, Adding below in commit msg:- | 15:08 |
| ysandeep | ~~~ | 15:08 |
| ysandeep | Intention is to create a new ci periodic job which test multi overcloud | 15:08 |
| ysandeep | stack deployment, The new ci job will not be executed upstream but | 15:08 |
| ysandeep | rather in periodic only. | 15:08 |
| ysandeep | ~~~ | 15:08 |
| rlandy | weshay|ruck: I think we just earned the dependency pipeline a new lease on life ... ansible 2.19 - busted https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-dependencies-latest_ansible/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-latest_ansible-container-build-rhos-16.2/f0950b4/logs/undercloud/home/zuul/dependency_repoquery_list.log | 15:09 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-dependencies-latest_ansible/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-latest_ansible-container-build-rhos-16.2/f0950b4/logs/undercloud/home/zuul/container_image_build.log | 15:09 |
| rlandy | to be continued at top of the hour | 15:10 |
| ysandeep | weshay|ruck, updated commit msg https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/763786 | 15:12 |
| *** ysandeep is now known as ysandeep|away | 15:23 | |
| *** pojadhav|ruck is now known as pojadhav|afk | 15:25 | |
| *** udesale_ has quit IRC | 15:38 | |
| *** ysandeep|away is now known as ysandeep | 15:46 | |
| ysandeep | weshay|ruck, rlandy we can start debugging 17 line failures, right? | 15:47 |
| rlandy | ysandeep: idk - weshay|ruck has rules about what we can touch there | 15:47 |
| * rlandy stays away unless told to touch that line | 15:48 | |
| *** ysandeep has quit IRC | 15:52 | |
| *** odyssey4me has quit IRC | 15:52 | |
| *** ysandeep has joined #oooq | 15:53 | |
| *** odyssey4me has joined #oooq | 15:53 | |
| ysandeep | rlandy, okay thanks! :) | 15:53 |
| weshay|ruck | ysandeep, I'd still stay out of 17 | 15:58 |
| weshay|ruck | unless it's a real easy thing | 15:58 |
| weshay|ruck | ysandeep, rlandy so I don't mind you folks looking.. just please don't get sucked into hours of debug.. | 15:59 |
| weshay|ruck | it's not worth it yet | 15:59 |
| ysandeep | weshay|ruck, thanks! , context in pm | 16:02 |
| *** ykarel has quit IRC | 16:17 | |
| *** marios is now known as marios|out | 16:22 | |
| *** ysandeep is now known as ysandeep|away | 16:28 | |
| *** amoralej is now known as amoralej|off | 16:38 | |
| chandankumar | Happy Weekend People, see ya on monday :-) | 16:47 |
| *** chandankumar is now known as raukadah | 16:47 | |
| *** marios|out has quit IRC | 17:01 | |
| *** rlandy is now known as rlandy|brb | 17:20 | |
| *** rlandy|brb is now known as rlandy | 17:47 | |
| *** jpena is now known as jpena|off | 17:59 | |
| *** derekh has quit IRC | 18:04 | |
| spotz | Hey has anyone run into this on a Victoria install? - Error: Evaluation Error: Error while evaluating a Function Call, Could not find class ::neutron::plugins::ml2::ovs_driver for manager.example.com (file: /etc/puppet/modules/tripleo/manifests/profile/base/neutron/plugins/ml2.pp, line: 59, column: 7) on node manager.example.com | 18:09 |
| *** jbadiapa has quit IRC | 18:51 | |
| weshay|ruck | spotz, don't see it in lp | 19:54 |
| *** jfrancoa has quit IRC | 20:03 | |
| spotz | weshay|ruck: lp? | 20:59 |
| weshay|ruck | launchpad | 20:59 |
| spotz | weshay|ruck: Ahh but you haven't run into it yourself then. I'll go over my networking config again see if I skipped something, Using my 16.1 notes to do TripleO | 21:00 |
| spotz | I know I'm using the stock container prepare vs pointing it to my redhat account | 21:02 |
| *** rlandy has quit IRC | 21:04 | |
| *** rfolco has quit IRC | 21:07 | |
| *** TrevorV has quit IRC | 21:36 | |
| *** rfolco has joined #oooq | 23:01 | |
| *** rfolco has quit IRC | 23:06 | |
| *** Goneri has quit IRC | 23:50 | |
| *** tosky has quit IRC | 23:54 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!