| *** ysandeep|away is now known as ysandeep | 00:43 | |
| *** tosky has quit IRC | 00:52 | |
| *** jmasud has quit IRC | 00:54 | |
| *** jmasud has joined #oooq | 00:55 | |
| *** rlandy has joined #oooq | 01:05 | |
| *** rlandy has quit IRC | 01:07 | |
| *** ysandeep is now known as ysandeep|rover | 01:25 | |
| *** Goneri has quit IRC | 01:30 | |
| *** gkadam has joined #oooq | 03:03 | |
| *** apetrich has quit IRC | 03:10 | |
| *** skramaja has joined #oooq | 03:36 | |
| *** ykarel|away is now known as ykarel | 04:08 | |
| *** udesale has joined #oooq | 04:47 | |
| *** jmasud has quit IRC | 04:53 | |
| *** jmasud has joined #oooq | 04:54 | |
| *** udesale has quit IRC | 05:10 | |
| *** udesale has joined #oooq | 05:12 | |
| *** ratailor has joined #oooq | 05:24 | |
| chandankumar | ysandeep|rover, Hello | 05:54 |
|---|---|---|
| ysandeep|rover | chandankumar, hello o/ | 05:55 |
| chandankumar | ysandeep|rover, let me know when can I help. | 05:55 |
| *** ykarel is now known as ykarel|meeting | 06:01 | |
| ysandeep|rover | chandankumar, I think I am good for now.. rdo registry migration patch https://review.opendev.org/#/c/715021/1 is rerunning in gate(faced some transient issue earlier). ykarel helped me with (overcloud image builds failing issue) https://bugs.launchpad.net/tripleo/+bug/1869119 | 06:02 |
| openstack | Launchpad bug 1869119 in tripleo "permission denied error in diskimage_builder/lib/common-functions causing overcloud image build failures" [Critical,Triaged] | 06:02 |
| chandankumar | ysandeep|rover, ok | 06:05 |
| chandankumar | ysandeep|rover, does tempest failure on gate job is consistent? | 06:10 |
| ysandeep|rover | chandankumar, not consistent but i saw it twice today.. | 06:12 |
| ysandeep|rover | https://8cf70d2ee9f0d7f3b892-1aafb108750144ecd9565eaf1429d9e4.ssl.cf2.rackcdn.com/713195/4/gate/tripleo-ci-centos-7-standalone/66600fd/logs/undercloud/var/log/tempest/stestr_results.html | 06:12 |
| chandankumar | ysandeep|rover, with same test failure | 06:12 |
| ysandeep|rover | https://b371d918ba02f17e55c5-1a98755ea7e04dbb8bfefd66f70f5b09.ssl.cf2.rackcdn.com/715021/1/gate/tripleo-ci-centos-8-standalone/b5ad061/logs/undercloud/var/log/tempest/stestr_results.html | 06:12 |
| ysandeep|rover | chandankumar, different failure | 06:12 |
| chandankumar | ah both are different job, let's wait for more failure then we can file a bug | 06:12 |
| ysandeep|rover | chandankumar, i request soniya to take a look also.. | 06:13 |
| chandankumar | ysandeep|rover, regarding image build failure if you want to reproduce it in a centos-8 vm | 06:15 |
| ysandeep|rover | chandankumar, ykarel reproduced it in his local env. | 06:15 |
| chandankumar | ok | 06:16 |
| chandankumar | do we have fix up? | 06:16 |
| ysandeep|rover | Yes, https://github.com/pypa/setuptools/commit/7e2f30748482a4d8daed9071dc7f6168de6267d5 | 06:16 |
| *** marios has joined #oooq | 06:41 | |
| chandankumar | ysandeep|rover, please add the above link and finding in the bug | 06:46 |
| ysandeep|rover | chandankumar, yes its there | 06:46 |
| chandankumar | ysandeep|rover, ok thanks, | 06:48 |
| *** ykarel|meeting is now known as ykarel | 06:49 | |
| *** jbadiapa has joined #oooq | 07:01 | |
| *** jfrancoa has joined #oooq | 07:03 | |
| *** bogdando has joined #oooq | 07:04 | |
| *** dpawlik has joined #oooq | 07:22 | |
| dpawlik | sshnaidm, hi. Registry DNS propagation is IMO done. https://review.rdoproject.org/r/#/c/25814/ has finished with success | 07:28 |
| dpawlik | and sshnaidm, weshay|ruck: now I see that it was possible to replace token with the old one for the serviceaccount in registry, but nvm. We regenerated new token and it is applied to zuul and it works | 07:32 |
| *** ysandeep|rover is now known as ysandeep|rover|l | 07:35 | |
| *** ysandeep|rover|l is now known as ysandeep|roveraf | 07:35 | |
| *** ysandeep|roveraf is now known as ysandeep|rover|l | 07:36 | |
| *** amoralej|off is now known as amoralej | 08:02 | |
| *** apetrich has joined #oooq | 08:03 | |
| *** dmellado has quit IRC | 08:06 | |
| *** akahat is now known as akahat|lunch | 08:06 | |
| *** dmellado has joined #oooq | 08:10 | |
| *** ysandeep|rover|l is now known as ysandeep|rover | 08:35 | |
| *** jmasud has quit IRC | 08:53 | |
| *** jpena|off is now known as jpena | 08:53 | |
| *** jmasud has joined #oooq | 08:56 | |
| *** holser has quit IRC | 08:59 | |
| *** tosky has joined #oooq | 09:00 | |
| *** holser has joined #oooq | 09:18 | |
| *** ykarel is now known as ykarel|lunch | 09:27 | |
| chandankumar | ysandeep|rover, https://130486e6097cfc48efe3-316ead88afa2be91e0f5b80937dadc42.ssl.cf2.rackcdn.com/714609/5/check/tripleo-ci-centos-7-containers-multinode-train/b6d1495/job-output.txt | 09:32 |
| chandankumar | ERROR: Package 'python-heatclient' requires a different Python: 2.7.5 not in '>=3.6' | 09:32 |
| chandankumar | tripleo-ci-centos-7-containers-multinode-train https://zuul.opendev.org/t/openstack/build/b6d1495a2f784248994c28717e4d583a : FAILURE in 13m 14s | 09:32 |
| chandankumar | - tripleo-ci-centos-7-containers-multinode-stein https://zuul.opendev.org/t/openstack/build/932032a4208d40888381ff5a8a3daf1c : FAILURE in 13m 21s | 09:32 |
| chandankumar | - tripleo-ci-centos-7-containers-multinode-rocky https://zuul.opendev.org/t/openstack/build/52ca577e96be4f1c8d35d409a4786252 : FAILURE in 12m 46s | 09:32 |
| chandankumar | - tripleo-ci-centos-7-containers-multinode-queens https://zuul.opendev.org/t/openstack/build/7c2422987c474f7f8a7d8510ff4f6c47 : FAILURE in 13m 04s | 09:32 |
| ysandeep|rover | looking | 09:32 |
| chandankumar | above 4 jobs are started failing | 09:32 |
| ysandeep|rover | chandankumar, yes.. all failing with ERROR: Package 'python-heatclient' requires a different Python: 2.7.5 not in '>=3.6'.. Checking if bz exists if not will open a one | 09:36 |
| *** derekh has joined #oooq | 09:37 | |
| *** akahat|lunch is now known as akahat | 09:43 | |
| chandankumar | ysandeep|rover, it is easily reproducable | 09:46 |
| ysandeep|rover | chandankumar, apart from alert tag do we need any other tag on bug? | 09:46 |
| chandankumar | ysandeep|rover, https://github.com/openstack/tripleo-quickstart/blob/master/requirements.txt#L12 we might need to fix that | 09:47 |
| chandankumar | ysandeep|rover, http://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-containers-multinode-train it needs a promotion blocker | 09:48 |
| chandankumar | also include tag ci | 09:48 |
| chandankumar | ysandeep|rover, we can propose a change to above TQ requirements.txt file https://opendev.org/openstack/requirements/src/branch/master/global-requirements.txt#L312 | 09:49 |
| chandankumar | both py2 and py3 fixes | 09:50 |
| ysandeep|rover | chandankumar, i have opened a bz https://bugs.launchpad.net/tripleo/+bug/1869161 | 09:52 |
| openstack | Launchpad bug 1869161 in tripleo "tripleo-ci-centos-7-containers-multinode-train/stein/stein/queens failing with ERROR: Package 'python-heatclient' requires a different Python: 2.7.5 not in '>=3.6'." [Undecided,New] | 09:52 |
| chandankumar | ysandeep|rover, please send the patch up so that we can get it merged asap | 09:53 |
| ysandeep|rover | chandankumar, checking.. what should be correct value here and why issue suddently arose today. | 09:55 |
| *** sshnaidm is now known as sshnaidm|afk | 09:56 | |
| chandankumar | ysandeep|rover, sure | 09:56 |
| chandankumar | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0ea/715021/1/gate/tripleo-ci-centos-7-containers-multinode-train/0eada7c/job-output.txt till this everything was good, something got changed recently | 10:00 |
| marios | chandankumar: o/ the periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-compute-master failed on the test_port_security_disable_security_group ... unfortunately still seeing that after you split into scenario/api ... we might need to consider disabling the test or perhaps we need to tweak something to fix it... i will file a bug for that now with links | 10:04 |
| marios | cc ysandeep|rover ^^ fyi (there * https://logserver.rdoproject.org/openstack-component-compute/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-compute-master/45c677d/logs/undercloud/var/log/tempest/stestr_results.html.gz# | 10:05 |
| ysandeep|rover | chandankumar, No change today in global-requirements.txt for python-heatclient.. Last change for python-heatclient was month old https://review.opendev.org/#/c/708780/ | 10:06 |
| ysandeep|rover | marios, ack thanks for info. | 10:06 |
| marios | ysandeep|rover: \o/ brave soul good job on taking first ruck|rover shift good luck ;) | 10:07 |
| chandankumar | ysandeep|rover, something got changed either mirror side or somewhere else | 10:07 |
| ysandeep|rover | marios, :) thank you so much.. | 10:08 |
| chandankumar | question to investigate why it started pulling higher version of python-heatclient | 10:08 |
| chandankumar | marios, regarding above issue something is not right on ovn side, I will add more details on the buf | 10:09 |
| chandankumar | *bug | 10:09 |
| marios | chandankumar: k gimme couple mins will give you pointer | 10:10 |
| kopecmartin | zbr: sshnaidm|afk chandankumar weshay|ruck merge this please https://review.opendev.org/#/c/713325/ | 10:11 |
| marios | chandankumar: ysandeep|rover: fyi there https://bugs.launchpad.net/tripleo/+bug/1869165 | 10:13 |
| openstack | Launchpad bug 1869165 in tripleo "component compute test_port_security_disable_security_group tempest failing often" [Undecided,Triaged] | 10:13 |
| *** ykarel|lunch is now known as ykarel | 10:14 | |
| zbr | kopecmartin: thanks for reminding, done. | 10:28 |
| kopecmartin | zbr: chandankumar thank you :) | 10:28 |
| marios | chandankumar: https://review.opendev.org/#/c/714909/ when you get a chance thanks | 10:46 |
| *** dtantsur|afk is now known as dtantsur | 10:48 | |
| chandankumar | ysandeep|rover, https://bugs.launchpad.net/tripleo/+bug/1869174 | 10:54 |
| openstack | Launchpad bug 1869174 in tripleo "tripleo-common-stable/train openstack-tox-py27 job failing with ERROR: Package 'Pygments' requires a different Python: 2.7.17 not in '>=3.5'" [Undecided,New] | 10:54 |
| ysandeep|rover | chandankumar, :) o/ | 10:54 |
| weshay|ruck | ysandeep|rover, 0/ | 11:00 |
| ysandeep|rover | weshay|ruck, o/ hey | 11:00 |
| zbr | panda: i need help on https://logserver.rdoproject.org/02/26102/3/gate/rdo-tox-molecule-delegated-centos-8/eba2823/tox/reports.html | 11:02 |
| zbr | apparently "write out the hash_info file" is unreliable, worked in check, failed in gate. | 11:02 |
| zbr | i know that I can recheck, but it should not be ureliable | 11:03 |
| zbr | apparently nobody reads emails | 11:05 |
| ysandeep|rover | chandankumar, I was not able to reproduce locally.. I cloned tripleo-quickstart on my local centos7 machine and ran pip install . in virtualenv , Pip list have "python-heatclient 1.18" :( | 11:10 |
| *** holser has quit IRC | 11:16 | |
| *** holser has joined #oooq | 11:17 | |
| *** dsneddon has quit IRC | 11:22 | |
| marios | zbr: so https://review.rdoproject.org/r/#/c/26102/ should also fix the tripleo-ci-promotion-staging-single-pipeline-centos-7 @ https://review.rdoproject.org/r/#/c/25795/ looks like ? (nERROR: Could not find a version that satisfies the requirement mistral-lib===2.0.0 @ https://logserver.rdoproject.org/95/25795/3/check/tripleo-ci-promotion-staging-single-pipeline-centos-7/900f4d0/job-output.txt ) | 11:23 |
| zbr | marios: almost for sure | 11:23 |
| marios | zbr: will add depends on... but is https://review.rdoproject.org/r/#/c/26102/ now blocked ona new issue? delegated centos8 job | 11:23 |
| zbr | i did a recheck, likely will pass now. | 11:24 |
| marios | zbr: cool story bro (thanks | 11:24 |
| zbr | panda is off and I do not have enough bandwidth to look into what made it flaky | 11:24 |
| *** sshnaidm|afk is now known as sshnaidm | 11:25 | |
| panda | zbr: sorry was deep in the code | 11:30 |
| panda | what's up ? | 11:31 |
| zbr | look back to a failure on the delegated job | 11:32 |
| zbr | failed in gate but passed check, bet is flaky | 11:32 |
| weshay|ruck | chandankumar, ysandeep|rover do we have a review up for https://bugs.launchpad.net/tripleo/+bug/1869161 ? | 11:34 |
| openstack | Launchpad bug 1869161 in tripleo "tripleo-ci-centos-7-containers-multinode-train/stein/stein/queens failing with ERROR: Package 'python-heatclient' requires a different Python: 2.7.5 not in '>=3.6'." [Critical,Triaged] | 11:34 |
| chandankumar | weshay|ruck, let me send a patch | 11:34 |
| ysandeep|rover | chandankumar, , You were able to reproduce this locally? | 11:35 |
| chandankumar | ysandeep|rover, yes | 11:35 |
| chandankumar | ysandeep|rover, check my second comment | 11:35 |
| weshay|ruck | mig tosky, https://pagure.io/zuul-distro-jobs/blob/master/f/roles | 11:44 |
| ysandeep|rover | chandankumar, strange.. i was unable to repduce the issue.. trying on a new machine.. | 11:46 |
| chandankumar | ysandeep|rover, create a virtualenv with py2.7 python env | 11:48 |
| chandankumar | ysandeep|rover, try to install python-heatclient=20.0.0 | 11:49 |
| chandankumar | ysandeep|rover, the question is that why it is pulling python-heatclient 20.0.0 from pip | 11:49 |
| weshay|ruck | pojadhav, ready a little early if you want to knock out the 1-1 https://meet.google.com/hfu-icdo-kew?authuser=1 | 11:53 |
| weshay|ruck | chandankumar, perhaps ovb? | 11:54 |
| pojadhav | weshay|ruck, sure | 11:54 |
| ysandeep|rover | chandankumar, this is what i did earlier http://pastebin.test.redhat.com/848616 | 11:57 |
| chandankumar | ysandeep|rover, python-heatclient-1.18.0 is used | 11:58 |
| *** jpena is now known as jpena|lunch | 11:58 | |
| chandankumar | but in ci somehow heatclient-2.0.0 is getting installed | 11:58 |
| chandankumar | if we install heatclient-2.0.0 in local venv same error is coming | 11:59 |
| ysandeep|rover | chandankumar, okay, let me try that | 11:59 |
| chandankumar | now the question is why heatclient-2.0.0 is pulled by pip | 11:59 |
| *** holser has quit IRC | 12:03 | |
| chandankumar | marios, weshay|ruck ysandeep|rover https://review.opendev.org/715179 | 12:05 |
| *** holser has joined #oooq | 12:05 | |
| marios | chandankumar: ack | 12:07 |
| chandankumar | marios, queens stein job will tell it | 12:08 |
| chandankumar | arxcruz, Hello | 12:10 |
| arxcruz | chandankumar: hello | 12:10 |
| chandankumar | arxcruz, do we have existing patch up for replacing rhel-8 master containers build with c8 in check job https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L752 | 12:10 |
| chandankumar | arxcruz, https://bugs.launchpad.net/tripleo/+bug/1869175 | 12:10 |
| openstack | Launchpad bug 1869175 in tripleo "tripleo-build-containers-rhel-8-master errors out when applying rhel8 kolla patches" [Undecided,Fix released] - Assigned to wes hayutin (weshayutin) | 12:10 |
| chandankumar | i think that needs to be removed completely | 12:11 |
| arxcruz | chandankumar: hmmm what you mean remove completely ? | 12:12 |
| *** Goneri has joined #oooq | 12:14 | |
| marios | chandankumar: k | 12:14 |
| chandankumar | arxcruz, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L752 tripleo-build-containers-rhel-8-master needs to be replaced with centos-8 based job | 12:15 |
| chandankumar | developers are saying it is not working | 12:15 |
| weshay|ruck | chandankumar, ya. .but the parenting probably prevents that atm | 12:17 |
| weshay|ruck | so I just removed it from the template | 12:17 |
| weshay|ruck | bhagyashris, ready for 1-1 if you are | 12:17 |
| bhagyashris | weshay|ruck, yup | 12:17 |
| *** rfolco has joined #oooq | 12:20 | |
| *** udesale_ has joined #oooq | 12:21 | |
| *** rlandy has joined #oooq | 12:23 | |
| rlandy | sshnaidm: hi - sorry - I landed up tearing down the undercloud vm yesterday to redo the provisioning network bridge so I couldn't test the patch | 12:24 |
| *** pojadhav is now known as pojadhav|brb | 12:24 | |
| *** udesale has quit IRC | 12:24 | |
| rlandy | I'll let you know when the bm system is up and running again | 12:24 |
| chandankumar | weshay|ruck, we need a series of patches to fix the mess | 12:25 |
| weshay|ruck | hrm k | 12:25 |
| *** holser__ has joined #oooq | 12:25 | |
| *** holser has quit IRC | 12:27 | |
| chandankumar | weshay|ruck, https://review.opendev.org/#/q/owner:jesse%2540odyssey4.me+status:open+project:openstack/requirements | 12:27 |
| sshnaidm | rlandy, ack, the patch is https://review.opendev.org/#/c/715073/ and actually we can merge it | 12:27 |
| rlandy | sshnaidm: ok - go4it | 12:30 |
| ysandeep|rover | chandankumar, weshay|ruck i took ykarel help and it seems more like a mirror issue.. We are able to reproduce after adding mirror info in /etc/pip.conf | 12:30 |
| akahat | rlandy, ping.. one question about installing undercloud using tripleo-operator-ansible | 12:30 |
| ysandeep|rover | chandankumar, weshay|ruck http://pastebin.test.redhat.com/848638 | 12:30 |
| akahat | my installation is failing because of docker registry 'registry-1.docker.io' | 12:30 |
| ysandeep|rover | chandankumar, your patch fixed the python-heatclient issue :) but then cliff package is failing in my local env.. | 12:31 |
| rlandy | akahat: do you have a log you can paste? | 12:31 |
| akahat | rlandy, yes. give me a min. | 12:31 |
| rlandy | what environment are you installing on? | 12:31 |
| rlandy | akahat: ^^ what environment are you installing on? | 12:31 |
| rlandy | virt, rdocloud? | 12:32 |
| akahat | rlandy, I'm using centos 7 and installing using tripleo-operator-ansible to install undercloud | 12:32 |
| rlandy | akahat: tripleo-operator-ansible is master and should be done on centos8 | 12:33 |
| rlandy | but the error may be the same either way | 12:33 |
| rlandy | you are installing master, right? | 12:33 |
| rlandy | or is the osp? | 12:33 |
| zbr | weshay|ruck: re your yesterday question on tox job triggering (and resource load), here is a hint: soon we will run them using k8s containers instead of nodepool-VMs, and they will be very fast and spawn instantly. | 12:33 |
| akahat | rlandy, it's master | 12:33 |
| rlandy | akahat: so you won't get far on centos 7 :) ... move to 8 - it will help | 12:34 |
| zbr | if i am correct, tristanC can confirm that (but we are not sure about ETA) | 12:34 |
| akahat | rlandy, okay. Let me try that. | 12:35 |
| ysandeep|rover | chandankumar, weshay|ruck look some chat going on on infra channel about PyPI is down for maintenance | 12:35 |
| chandankumar | ysandeep|rover, https://status.python.org/incidents/1yd6sfczzfmz | 12:36 |
| chandankumar | ysandeep|rover, yes | 12:36 |
| weshay|ruck | oh fun.. at least we have mirrors | 12:39 |
| weshay|ruck | zbr, nice | 12:40 |
| weshay|ruck | chandankumar, dpawlik sshnaidm so is the rdo registry migration complete? | 12:41 |
| sshnaidm | weshay|ruck, yes | 12:42 |
| chandankumar | weshay|ruck, i think yes | 12:42 |
| weshay|ruck | https://registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags/ | 12:42 |
| weshay|ruck | nice | 12:42 |
| chandankumar | sshnaidm, do we need to revert this patch https://review.rdoproject.org/r/#/c/26103/ patch? | 12:42 |
| weshay|ruck | sshnaidm, chandankumar shall we revert the login change? or fix it.. https://review.rdoproject.org/r/#/c/26104/ | 12:43 |
| weshay|ruck | brb | 12:43 |
| *** ratailor has quit IRC | 12:44 | |
| ysandeep|rover | weshay|ruck, chandankumar as per chat on infra https://status.python.org/incidents/1yd6sfczzfmz is resolved.. but my test locally with mirror are still failing.. Seems like a mirror issue | 12:44 |
| sshnaidm | chandankumar, weshay|ruck we don't need it now, but may need someday..maybe, should be fine now with revert | 12:44 |
| chandankumar | sshnaidm, does the new registry still uses openshift one? | 12:46 |
| sshnaidm | chandankumar, yes | 12:46 |
| chandankumar | ok | 12:46 |
| weshay|ruck | zbr, do we have any insight into the upstream mirrors and the config? | 12:47 |
| weshay|ruck | zbr, sure you heard pypy is down | 12:48 |
| zbr | no yet, busy with other stuff. | 12:48 |
| weshay|ruck | chandankumar, ysandeep|rover ping me w/ things you want to hand off :) | 12:52 |
| weshay|ruck | ysandeep|rover, you are not required to join the planning call | 12:52 |
| weshay|ruck | fyi | 12:52 |
| weshay|ruck | chandankumar, you will be required :) | 12:52 |
| ysandeep|rover | weshay|ruck, thank you | 12:53 |
| weshay|ruck | rfolco, we're going to start w/ internal component pipeline in today's mtg.. to get in migi in and out | 12:54 |
| *** jmasud has quit IRC | 12:54 | |
| rfolco | weshay|ruck, ok | 12:55 |
| *** jmasud has joined #oooq | 12:56 | |
| zbr | panda: please give me a hand with https://review.rdoproject.org/r/#/c/25980/ | 12:58 |
| zbr | weshay|ruck: downstream spies in our meeting? 🤔 | 12:59 |
| akahat | rlandy, well on centos-8 it is failing with: "Unable to find tripleo_repos rpm" :/ | 13:00 |
| akahat | we are using ansible roles. RPMs also available for this roles? | 13:01 |
| *** jpena|lunch is now known as jpena | 13:01 | |
| *** amoralej is now known as amoralej|lunch | 13:01 | |
| rlandy | akahat: can you share what is in /etc/yum.repos.d? | 13:02 |
| weshay|ruck | sshnaidm, mtg | 13:02 |
| arxcruz | rfolco: weshay|ruck isn't the meeting now ? | 13:03 |
| rlandy | akahat: we're on planning meeting - pls paste - will look in a bit | 13:03 |
| panda | zbr: what's YTEST_REQPASS, and how can this replace the -skip on collection error | 13:04 |
| panda | zbr: ah | 13:04 |
| akahat | rlandy, okay. Cool | 13:05 |
| panda | zbr: REQUEST A PASS OF TESTS> | 13:05 |
| panda | zbr: any change of making rdefault or vairable on upstream tests ? | 13:05 |
| zbr | exact match regarding number of passed tests, a fail-safe for avoiding accidental testing regressions | 13:05 |
| panda | zbr: all our tox inherit from tripleo-ci tox jobs | 13:06 |
| zbr | this is not a pytest native feature, is added by pytest-plus plugin, but nothing prevents us from using it upstream. | 13:06 |
| akahat | rlandy, http://pastebin.test.redhat.com/848663 | 13:07 |
| zbr | still, enabling is case-by-case | 13:07 |
| panda | zbr: ah, like microsoft plus! | 13:07 |
| zbr | and more important: the way is implemented it has no effect on using tox on dev machines. | 13:07 |
| panda | zbr: and it's not a boolean flag | 13:08 |
| panda | zbr: it's that variable to count the number of tests. | 13:08 |
| panda | zbr: I'm curious how it's reported ... | 13:08 |
| panda | zbr: what happens if it's not specified ? | 13:09 |
| zbr | nothing, no change in behavior. | 13:09 |
| panda | zbr: no test collected will still pass ? | 13:09 |
| zbr | no tests run returns error code 5, documented in pytest docs. nothing changed on this respect. | 13:09 |
| zbr | pytest never returned success when no tests passed. | 13:09 |
| zbr | a good decision on their side :D | 13:10 |
| *** gkadam has quit IRC | 13:10 | |
| dpawlik | sshnaidm, everything is working well on registry? | 13:10 |
| sshnaidm | dpawlik, so far so good | 13:11 |
| dpawlik | sshnaidm, good :) | 13:11 |
| weshay|ruck | https://tree.taiga.io/project/tripleo-ci-board/epic/1566 | 13:12 |
| panda | zbr: so if pytest collect no tests, and PYTEST_REQPASS is not specified, since continue-on-collection-errors is removed, will the job still pass ? | 13:14 |
| weshay|ruck | https://trunk.rdoproject.org/centos8-master/component/ | 13:14 |
| panda | zbr: ok, I get it, too many things to follow | 13:15 |
| zbr | if nothing is collected => that nothing runs => pytest returns 5 regardless presence of pytest-plus or its config options. | 13:15 |
| zbr | chandankumar: i have the impression last merge broke zuul config on rdo-jobs: look at zuul error from https://review.rdoproject.org/r/#/c/26005/ | 13:32 |
| zbr | it has nothing to do with the changes from the review. i bet it would happen even if we do "nop" changes. | 13:33 |
| zbr | i suspect https://review.rdoproject.org/r/#/c/25769/ is the reason | 13:33 |
| chandankumar | zbr, let me check | 13:34 |
| zbr | i think this may happen if you do A -> B and put a condition on A to run on a magic file. If B does not have the same filter, zuul may fail to run because a required job was never run. | 13:35 |
| sshnaidm | dpawlik, can you please ensure pruners work fine on a new registry? It's always a pain point when migrtating.. | 13:44 |
| sshnaidm | dpawlik, and that they work on all "branches" | 13:44 |
| dpawlik | sshnaidm, will check after meeting | 13:45 |
| chandankumar | zbr, https://review.rdoproject.org/r/#/c/26124/ | 13:48 |
| zbr | chandankumar: this change should be a noop, i doubt it changes anything. | 13:50 |
| weshay|ruck | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 13:57 |
| weshay|ruck | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint23 | 14:00 |
| weshay|ruck | FYI ^ | 14:00 |
| chandankumar | zbr, what do you mean by noop changes? | 14:01 |
| *** amoralej|lunch is now known as amoralej | 14:02 | |
| zbr | no-operation, not changing anything | 14:04 |
| *** d0ugal has quit IRC | 14:05 | |
| *** d0ugal has joined #oooq | 14:07 | |
| *** ysandeep|rover is now known as ysandeep|away | 14:10 | |
| *** TrevorV has joined #oooq | 14:15 | |
| *** chandan_kumar has joined #oooq | 14:29 | |
| *** pojadhav|brb has quit IRC | 14:29 | |
| *** chandankumar has quit IRC | 14:29 | |
| *** skramaja_ has joined #oooq | 14:29 | |
| *** pojadhav has joined #oooq | 14:29 | |
| *** skramaja has quit IRC | 14:30 | |
| *** chem has quit IRC | 14:30 | |
| *** sshnaidm has quit IRC | 14:30 | |
| *** chem has joined #oooq | 14:30 | |
| *** sshnaidm has joined #oooq | 14:31 | |
| chandan_kumar | zbr, https://review.opendev.org/#/c/705775/ | 14:42 |
| *** chem has quit IRC | 14:53 | |
| chandan_kumar | marios, https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images/tasks/pre.yaml#L59 | 14:54 |
| rlandy | marios: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L22 | 14:54 |
| *** chem has joined #oooq | 14:55 | |
| marios | chandan_kumar: rlandy: thank you | 14:57 |
| marios | weshay|ruck: rlandy: e.g. that (for fixing build-images ) is what i was referring to fix https://review.opendev.org/714627 tripleo-quickstart-extras master: Fix build-images for centos8 jobs set tripleoclient and image-yaml | 14:58 |
| marios | (which is patching the tqe role) | 14:58 |
| rlandy | marios: yeah - we're ditching that | 14:59 |
| marios | rlandy: ack | 14:59 |
| marios | rlandy: as in, just set no build for *centos8* fs1/35/39 etc 16:59 < rlandy> marios: yeah - we're ditching that | 15:00 |
| rlandy | marios: as in we are going to build with the oooq role | 15:01 |
| rlandy | when we get that working | 15:01 |
| rlandy | the tqe role we're ditching | 15:01 |
| *** dsneddon has joined #oooq | 15:02 | |
| *** ykarel is now known as ykarel|away | 15:06 | |
| akahat | weshay|ruck, no problem!! | 15:07 |
| akahat | mic is not working! | 15:07 |
| weshay|ruck | :) | 15:07 |
| marios | rlandy: ah i see.. so no build is temporary then until we can use the oooq role | 15:09 |
| *** bogdando has quit IRC | 15:09 | |
| chandan_kumar | weshay|ruck, need to drop, will back in sometime | 15:18 |
| weshay|ruck | np | 15:26 |
| rlandy | chandan_kumar; marios: do we want the daily sync meeting for containers build this sprint? | 15:26 |
| marios | rlandy: sure | 15:26 |
| chandan_kumar | rlandy, yes | 15:26 |
| rlandy | marios: chandan_kumar: k - will get those set up again | 15:26 |
| sshnaidm | marios, responded https://review.rdoproject.org/r/#/c/26119/ | 15:29 |
| rlandy | akahat: sorry - to get back to you ... in centos-8, you can find the rpm in https://trunk.rdoproject.org/centos8-master/component/tripleo/current-tripleo/ | 15:31 |
| rlandy | python3-tripleo-repos-0.0.1-0.20200310031241.5aa9c9a.el8.noarch.rpm | 15:31 |
| rlandy | chandan_kumar: marios: I am going to work today on cleaning up the jobs in the downstream tenant so we have a cleared workspace | 15:33 |
| rlandy | I will leave the servers we used the last time we worked on this | 15:33 |
| rlandy | pojadhav: hi - if you want to book a meeting tomorrow or monday, I'll catch you up on the TLS work | 15:34 |
| pojadhav | rlandy, sure.. :) will have meeting tommorow | 15:37 |
| weshay|ruck | panda, one thing we did not account for in the sprint was the reviews out to get aggregate promotions batched https://softwarefactory-project.io/r/#/c/17748/ | 15:41 |
| weshay|ruck | https://review.rdoproject.org/r/#/c/25931/ | 15:41 |
| panda | weshay|ruck: I was able to test locally the patches, they work as far as I test. That review can pass only when https://softwarefactory-project.io/r/#/c/17748/ is merged and releases | 15:43 |
| weshay|ruck | +1 | 15:43 |
| akahat | rlandy, thanks :) | 15:43 |
| weshay|ruck | panda, please just keep your comments updated and clear re: https://softwarefactory-project.io/r/#/c/17748/ so jpena knows if he can merge | 15:44 |
| panda | weshay|ruck: ok, I'll relaunch the tests with the new PS. | 15:44 |
| pojadhav | rlandy, have you got invite? | 15:45 |
| *** udesale_ has quit IRC | 15:50 | |
| pojadhav | rlandy, If yes.. feel free if you want to change the time, I am fine with your availability :) | 15:51 |
| chandan_kumar | weshay|ruck, please add +1 to this review https://review.opendev.org/#/c/714030/ | 15:51 |
| *** chandan_kumar is now known as chandankumar | 15:51 | |
| weshay|ruck | chandankumar, https://review.opendev.org/#/c/715060/ | 15:52 |
| weshay|ruck | meh.. blocked on heat issue I guess | 15:53 |
| weshay|ruck | nvrmind | 15:53 |
| *** pojadhav is now known as pojadhav|dinner | 15:53 | |
| chandankumar | weshay|ruck, commented | 15:54 |
| rlandy | pojadhav: yep - accepted | 15:54 |
| weshay|ruck | ah thanks | 15:54 |
| marios | sshnaidm: ack looking | 15:54 |
| rlandy | weshay|ruck: added you to the daily container sync meeting - for whenever you want to join | 16:05 |
| rlandy | panda: ^^ do you want to join or not relevant atm? | 16:06 |
| weshay|ruck | thanks | 16:06 |
| weshay|ruck | probably not relevant until we're ready to have some internal promotions | 16:06 |
| *** ysandeep|away is now known as ysandeep | 16:08 | |
| panda | weshay|ruck: rlandy agreed | 16:20 |
| marios | rlandy: o/ please vote when you can https://review.rdoproject.org/r/26127 Set to_build false for periodic centos8 ovb featureset 039 | 16:24 |
| marios | cc chandankumar weshay|ruck * anyone else as discussed in call re fs39 disable build ^^ | 16:24 |
| marios | and i will abandon https://review.opendev.org/#/c/714627/ | 16:25 |
| *** dpawlik has quit IRC | 16:26 | |
| rlandy | marios: so I am +2 on the change | 16:26 |
| rlandy | pls see comment though on placing | 16:26 |
| rlandy | marios: ^^ | 16:26 |
| marios | rlandy: k checking | 16:27 |
| rlandy | can be done afterwards | 16:27 |
| marios | rlandy: sure let me update now | 16:27 |
| marios | rlandy: chandankumar: weshay|ruck: thanks updated for rlandy comment please readd votes when you can thanks https://review.rdoproject.org/r/#/c/26127/ | 16:30 |
| rlandy | marios: voted - thanks | 16:30 |
| marios | thanks for voting citizen! | 16:31 |
| marios | thanks rlandy | 16:31 |
| rlandy | marios: w+? | 16:31 |
| marios | rlandy: ack thx | 16:31 |
| rlandy | done | 16:31 |
| *** skramaja_ has quit IRC | 16:32 | |
| *** ysandeep is now known as ysandeep|away | 16:41 | |
| * marios shutdown sequence | 16:43 | |
| *** pojadhav|dinner is now known as pojadhav | 16:49 | |
| rlandy | panda: looks like we do have an internal dlrn server | 16:50 |
| rlandy | dlrnapi --url http://10.0.76.142/api-redhat-osp17 --username tripleo-ci-internal repo-promote --commit-hash 2178426c0c92348fba42f0db8dfde79a44f5372e --distro-hash 690072f60c34b1b47ff499d29a3de0f6d9d2b296 --promote-name tripleo-ci-testing | 16:50 |
| panda | rlandy: jpena do you know if that server uses components ? | 16:54 |
| jpena | panda: yes, it does | 16:54 |
| rlandy | http://10.0.76.142/rhel8-osp17/ | 16:54 |
| *** jmasud has quit IRC | 16:55 | |
| jpena | hm wait | 16:55 |
| jpena | no, not that one. Only the official one does | 16:55 |
| rlandy | jpena: what's the official one? | 16:55 |
| *** marios is now known as marios|out | 16:56 | |
| *** jmasud has joined #oooq | 16:56 | |
| rlandy | zbr: hi - we use http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/playbooks/check-containers-build/run.yaml to determine whether containers have built or not | 17:03 |
| rlandy | this job is still run on a centos-7 node | 17:03 |
| *** marios|out has quit IRC | 17:03 | |
| rlandy | and now fails with "exception": "Traceback (most recent call last):\n File \"/tmp/ansible_pip_payload_Py8_do/__main__.py\", line 254, in <module>\n from pkg_resources import Requirement\nImportError: No module named pkg_resources\n", | 17:03 |
| rlandy | when installing requirements https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_trigger/requirements.txt | 17:04 |
| rlandy | zbr: what's the best way to fix this? up the dlrn_client version? move to centos-8 node? | 17:04 |
| rlandy | panda: ^^?? | 17:05 |
| zbr | likely a setuptools version mismatch of similar, afaik pkg_resources is part of it. | 17:06 |
| panda | yeah | 17:06 |
| zbr | if you cannot fix it in 5-10 mins, it could make sense to try doing the switch | 17:07 |
| zbr | in the end in the next ~30 days we will be forced to do this almost for sure | 17:07 |
| zbr | look at what versions where installed at last succesful run, compare with failure and you will know which library broke it. | 17:08 |
| zbr | pin its version and you should be saved | 17:08 |
| rlandy | zbr: ok - let - let me see what happens when we run on a centos 8 node | 17:09 |
| zbr | to be clear: you need "pip freeze" and put all nested deps, pinning a single library does not pin its own dependencies. | 17:09 |
| zbr | I think that on average we have like ~40-50 deps | 17:10 |
| * rlandy wonders if this is worth it | 17:11 | |
| weshay|ruck | zbr, have a sec? | 17:22 |
| rlandy | jpena: what version of dlrn-client should we be using? (running on centos-8 node) ? updating https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_trigger/requirements.txt | 17:25 |
| jpena | rlandy: latest one (0.8.1). I'm regularly updating it every time we are releasing a new DLRN version with additional functionality | 17:27 |
| rlandy | thanks | 17:27 |
| *** ccamacho has joined #oooq | 17:31 | |
| *** dtantsur is now known as dtantsur|afk | 17:32 | |
| *** ccamacho has quit IRC | 17:32 | |
| *** openstack has quit IRC | 17:49 | |
| *** openstack has joined #oooq | 17:50 | |
| *** ChanServ sets mode: +o openstack | 17:50 | |
| *** pojadhav is now known as pojadhav|away | 17:54 | |
| *** derekh has quit IRC | 18:00 | |
| *** jpena is now known as jpena|off | 18:02 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:17 | |
| *** amoralej is now known as amoralej|off | 18:30 | |
| *** d0ugal has quit IRC | 18:34 | |
| weshay|ruck | rlandy, did you end up having any luck w/ ovs? | 18:39 |
| rlandy | weshay|ruck: didn't try it yet - I did change the slave to just use an interface | 18:40 |
| rlandy | fixing the containers check job now | 18:40 |
| rlandy | nothing is triggering | 18:40 |
| rlandy | weshay|ruck: do we want to keep any osp-15 and osp-16 jobs? | 18:43 |
| weshay|ruck | rlandy, standalone.. I think so yes | 18:44 |
| rlandy | k | 18:44 |
| weshay|ruck | we'll end up needing it at somepoint | 18:44 |
| rlandy | just conserving resources | 18:44 |
| weshay|ruck | rlandy, should we look at the request for increasing resources? | 18:45 |
| rlandy | weshay|ruck: ack | 18:45 |
| * weshay|ruck looks | 18:45 | |
| rlandy | weshay|ruck: we need to work out the numbers we will need | 18:48 |
| rlandy | getting tenant | 18:48 |
| rlandy | weshay|ruck: https://meet.google.com/oiv-geho-mai?authuser=1 | 18:51 |
| rlandy | weshay|ruck: https://code.engineering.redhat.com/gerrit/#/c/195696/ | 20:00 |
| *** jfrancoa has quit IRC | 20:11 | |
| rlandy | 2020-03-26 20:05:38.596228 | TASK [fetch-zuul-cloner-fork : Install zuul-cloner shim dependencies] | 20:16 |
| rlandy | 2020-03-26 20:05:38.973384 | primary | ERROR | 20:16 |
| rlandy | 2020-03-26 20:05:38.973723 | primary | { | 20:16 |
| rlandy | 2020-03-26 20:05:38.973768 | primary | "exception": "Traceback (most recent call last):\n File \"/tmp/ansible_pip_payload_fN8tTD/__main__.py\", line 254, in <module>\n from pkg_resources import Requirement\nImportError: No module named pkg_resources\n", | 20:16 |
| rlandy | 2020-03-26 20:05:38.973800 | primary | "msg": "Failed to import the required Python library (setuptools) on localhost's Python /usr/bin/python. Please read module documentation and install in the appropriate location" | 20:16 |
| rlandy | 2020-03-26 20:05:38.973828 | primary | } | 20:16 |
| rlandy | how are we not hitting this on centos 7 upstream? | 20:16 |
| rlandy | weshay|ruck: ^^? | 20:16 |
| rlandy | ie: in rdocloud | 20:17 |
| * weshay|ruck looks | 20:18 | |
| weshay|ruck | rlandy, we are hitting a bunch of python issues atm | 20:19 |
| weshay|ruck | rlandy, which job | 20:19 |
| weshay|ruck | er.. log | 20:19 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/40/189440/17/check/periodic-tripleo-ci-centos-7-bm_envC-1ctlr_1comp-featureset001-train/fde2550/job-output.txt | 20:19 |
| rlandy | I ma testing the BM train job | 20:19 |
| rlandy | just to see it run | 20:19 |
| rlandy | it's the same role run in both | 20:20 |
| rlandy | http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/tree/playbooks/configure-mirrors.yaml | 20:20 |
| rlandy | vs | 20:20 |
| rlandy | https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/base/pre.yaml | 20:20 |
| rlandy | - import_role: | 20:20 |
| rlandy | name: configure-mirrors | 20:20 |
| weshay|ruck | rlandy, I bet that has been updated in rdo | 20:21 |
| rlandy | weshay|ruck: the node itself? | 20:22 |
| weshay|ruck | no the role | 20:22 |
| rlandy | that role is defined in zuul | 20:23 |
| weshay|ruck | rlandy, aye.. so it's not in https://github.com/rdo-infra/rdo-jobs/tree/master/roles | 20:23 |
| weshay|ruck | rlandy, oh.. so that's the upstream role? | 20:24 |
| weshay|ruck | hrm | 20:24 |
| rlandy | yeah - getting | 20:24 |
| weshay|ruck | https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/configure-mirrors | 20:25 |
| *** saneax has quit IRC | 20:25 | |
| rlandy | yep | 20:26 |
| weshay|ruck | rlandy, I don't see that task | 20:27 |
| rlandy | which task? | 20:27 |
| weshay|ruck | https://opendev.org/zuul/zuul-jobs/search?q=Install+ci_mirror+script | 20:27 |
| weshay|ruck | 2020-03-26 20:05:37.623053 | TASK [mirror-info-fork : Install ci_mirror script] | 20:27 |
| weshay|ruck | https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/fetch-zuul-cloner/tasks/main.yaml#L1 | 20:27 |
| weshay|ruck | there it is | 20:27 |
| rlandy | mirror-info-fork | 20:28 |
| *** d0ugal has joined #oooq | 20:28 | |
| rlandy | oh I think I know ehy | 20:28 |
| rlandy | why | 20:28 |
| rlandy | checking node build | 20:28 |
| weshay|ruck | 2020-03-26 20:05:38.973800 | primary | "msg": "Failed to import the required Python library (setuptools) on localhost's Python /usr/bin/python. Please read module documentation and install in the appropriate location" | 20:29 |
| rlandy | https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml#n136 | 20:29 |
| weshay|ruck | ya.. https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/fetch-zuul-cloner/tasks/main.yaml#L4 | 20:30 |
| weshay|ruck | rlandy, all the non-master branches are busted atm | 20:30 |
| rlandy | http://git.app.eng.bos.redhat.com/git/openstack/sf-config.git/tree/nodepool/tripleo.yaml#n15 | 20:30 |
| rlandy | not there | 20:30 |
| rlandy | they updated rdocloud centos 7 node | 20:31 |
| rlandy | pinging rhos-ops | 20:31 |
| rlandy | putting in review | 20:32 |
| *** Trevor_V has joined #oooq | 20:33 | |
| *** TrevorV has quit IRC | 20:37 | |
| *** jbadiapa has quit IRC | 21:23 | |
| rlandy | ugh - the rhel/redhat nightmare again | 21:54 |
| rlandy | weshay|ruck: ^^ advice needed - when you have a moment | 21:54 |
| rlandy | https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml#L19 | 21:54 |
| rlandy | internal dlrn uses rhel8 not redhat8 | 21:55 |
| weshay|ruck | WHAT | 21:55 |
| weshay|ruck | sec | 21:55 |
| rlandy | the api is fine api-redhat-osp17 | 21:59 |
| weshay|ruck | k.. sorry had to chat w/ family there for a sec | 21:59 |
| * weshay|ruck throws rocks at get_hash | 22:00 | |
| rlandy | it's ok - I think I can override it | 22:00 |
| weshay|ruck | rlandy, I think the right thing to do.. | 22:00 |
| weshay|ruck | is to create a vars dir | 22:00 |
| weshay|ruck | and set dlrnapi_url: | 22:01 |
| rlandy | yeah - good idea | 22:01 |
| weshay|ruck | :) | 22:01 |
| *** holser__ has quit IRC | 22:23 | |
| *** rfolco has quit IRC | 22:45 | |
| *** rfolco has joined #oooq | 22:46 | |
| rlandy | weshay|ruck: pls review https://code.engineering.redhat.com/gerrit/#/q/topic:update-component-release+(status:open+OR+status:merged) | 22:46 |
| rlandy | no rush | 22:46 |
| rlandy | but removed component pipeline until we merge config | 22:46 |
| rlandy | chicken-and-egg reviews | 22:46 |
| weshay|ruck | rlandy, k.. need a few all non-master jobs are busted | 22:48 |
| rlandy | weshay|ruck: need help? | 22:49 |
| weshay|ruck | rlandy, ya..https://review.opendev.org/715324 | 22:49 |
| rlandy | k - looking | 22:50 |
| weshay|ruck | seems to be under control w | 22:50 |
| weshay|ruck | https://review.opendev.org/#/c/715287/ | 22:50 |
| weshay|ruck | https://review.opendev.org/#/c/715321/ | 22:50 |
| *** rfolco has quit IRC | 22:52 | |
| rlandy | what a mess | 22:52 |
| weshay|ruck | rlandy, ya.. | 22:56 |
| *** Trevor_V has quit IRC | 23:05 | |
| weshay|ruck | woot.. ok.. progress | 23:12 |
| rlandy | cool - at least there is progress somewhere | 23:13 |
| *** chem has quit IRC | 23:45 | |
| *** tosky has quit IRC | 23:53 | |
| *** chem has joined #oooq | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!