Monday, 2021-05-10

« Sunday, 2021-05-09 Index Tuesday, 2021-05-11 »
*** jmasud has joined #oooq01:03
*** jmasud has quit IRC01:24
*** ysandeep|away is now known as ysandeep|SL02:07
*** jmasud has joined #oooq02:14
*** pojadhav|away is now known as pojadhav|rover02:47
*** jlarriba has quit IRC03:04
*** skramaja has joined #oooq03:43
*** ykarel has joined #oooq04:21
*** udesale has joined #oooq04:53
*** ratailor has joined #oooq04:57
pojadhav|roverchandankumar, arxcruz : periodic-tripleo-ci-centos-8-scenario010-standalone-wallaby having consistent failure for this tempest test https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-wallaby/e8dbdbc/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz though this test is added to skiplist for this job :05:02
pojadhav|roverhttps://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L1056-L108105:02
pojadhav|roverin this case, what action needs to take to make this job green..?05:03
*** udesale_ has joined #oooq05:06
*** marios has joined #oooq05:12
*** udesale has quit IRC05:29
*** saneax has joined #oooq05:51
*** jpodivin has joined #oooq05:54
*** slaweq has joined #oooq06:23
*** apetrich has joined #oooq06:30
*** amoralej|off is now known as amoralej06:53
*** udesale has joined #oooq07:07
chandankumarpojadhav|rover: looking07:16
*** slaweq has quit IRC07:21
*** slaweq has joined #oooq07:23
*** jlarriba has joined #oooq07:25
*** tosky has joined #oooq07:36
*** udesale has quit IRC07:39
*** jpena|off is now known as jpena07:55
*** ykarel is now known as ykarel|lunch07:58
*** pojadhav|rover is now known as pojadhav|lunch08:01
chandankumarpojadhav|lunch: I am trying to reproduce locally, but it is working fine via cli08:06
chandankumarok I reproduced it08:10
*** kopecmartin has quit IRC08:10
*** saneax has quit IRC08:11
chandankumarpojadhav|lunch: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/790381 will fix the issue08:17
*** dpawlik has quit IRC08:21
pojadhav|lunchchandankumar, thank you !!08:23
*** pojadhav|lunch is now known as pojadhav|rover08:23
*** jmasud has quit IRC08:23
*** jjoyce|gone has quit IRC08:24
*** kopecmartin has joined #oooq08:25
*** jjoyce|gone has joined #oooq08:27
*** dpawlik1 has joined #oooq08:28
*** ykarel|lunch has quit IRC08:42
*** ykarel_ has joined #oooq08:42
*** ykarel_ has quit IRC08:43
*** ykarel_ has joined #oooq08:43
*** ykarel_ is now known as ykarel08:46
*** sshnaidm|afk is now known as sshnaidm09:08
*** matbu has quit IRC09:36
bhagyashrisarxcruz, akahat|ruck, chandankumar 0/ ppc containers are getting pushed on docker.io https://hub.docker.com/r/tripleomaster/openstack-base/tags?page=1&ordering=last_updated i will push the patch soon.09:58
chandankumarbhagyashris ++09:59
akahat|ruckbhagyashris, nice :)09:59
*** saneax has joined #oooq10:04
bhagyashrisarxcruz, pojadhav|rover master promoted https://trunk.rdoproject.org/centos8-master/current-tripleo/delorean.repo.md5 \0/10:17
*** matbu has joined #oooq10:25
arxcruzbhagyashris: so, we are pushing the manifest as welll10:26
bhagyashrisarxcruz, yes10:27
bhagyashristhrough the container push role10:27
arxcruzbhagyashris: ok10:28
pojadhav|roverbhagyashris, ack10:50
*** jbadiapa has joined #oooq10:53
*** jjoyce|gone has quit IRC11:01
*** kopecmartin has quit IRC11:01
*** dpawlik1 has quit IRC11:03
*** kopecmartin has joined #oooq11:08
*** jjoyce|gone has joined #oooq11:09
*** jjoyce|gone is now known as jjoyce11:09
*** jjoyce is now known as fuzzball8111:10
*** dpawlik0 has joined #oooq11:10
*** udesale has joined #oooq11:22
*** jpena is now known as jpena|lunch11:26
*** rlandy has joined #oooq11:40
rlandypojadhav|rover: hey ... triaging CIX cards11:55
rlandyhttps://trello.com/c/7rBkSv9I/1938-cixlp1927917tripleociproa-master-c8-ovb-jobs-failing-with-no-module-named-etcd3gw11:55
bhagyashrisrlandy, gm, we are finally able to pushed the pcc containers and manifest https://hub.docker.com/r/tripleomaster/openstack-base/tags?page=1&ordering=last_updated11:55
rlandydid you determine a team there?11:55
rlandybhagyashris++ nice11:55
bhagyashrisplz review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33663/11:55
pojadhav|roverrlandy, nope.. I just reported a bug till no11:55
pojadhav|rovernow*11:56
rlandybhagyashris: with arxcruz's work?11:56
*** dpawlik0 is now known as dpawlik11:56
bhagyashrisrlandy, nope with out container-push role11:56
rlandyok11:56
bhagyashriswith our11:56
arxcruzrlandy: bhagyashris just finish read the whole docker documentation, they don't have an api to tag an image11:56
arxcruzjust to list the tags11:56
rlandycharming11:57
arxcruzi'm working now on create the manifests11:57
pojadhav|roverrlandy, could you please determine team.. I have no idea about it.11:57
arxcruzso, the solution is copy the containers twice11:57
rlandypojadhav|rover: looking into it11:57
pojadhav|roverrlandy, ack11:57
rlandyarxcruz; that a workable solution? for your side?11:58
arxcruzrlandy: there's no other option, on quay you have an api to tag it11:58
arxcruzwell, at least i'm checking the docker api the free version, not sure if the paid have, but that's not an option11:58
arxcruzand we are doing exactly that today11:59
*** pojadhav|rover is now known as pojadhav|brb12:06
bhagyashrisweshay|ruck,  we are finally able to pushed the pcc containers and manifest https://hub.docker.com/r/tripleomaster/openstack-base/tags?page=1&ordering=last_updated12:07
weshay|ruckbhagyashris, omg... \0/ well done!!!12:08
weshay|ruckthat's awesome12:08
bhagyashrisweshay|ruck, Note: using the container-push role12:08
bhagyashrisweshay|ruck, master is promoted today ....12:09
bhagyashrisplz review this one https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33663/12:09
weshay|ruckbhagyashris, k.. that's good!!12:09
weshay|ruckbhagyashris, anyone ping or email michaal?12:10
weshay|ruckbhagyashris, isn't today a holiday?12:10
rlandypojadhav|brb: https://bugs.launchpad.net/tripleo/+bug/192791712:11
openstackLaunchpad bug 1927917 in tripleo "master : C8 ovb jobs failing with Could not load 'oslo_cache.etcd3gw': No module named 'etcd3gw''" [Undecided,Triaged]12:11
rlandy^^ think the title of the bug there should be  changed12:11
rlandyweshay|ruck: hey12:11
bhagyashrisweshay|ruck, i haven't ping him , not sure about holiday.12:11
weshay|ruckhowdy12:11
weshay|ruckbhagyashris, k.. want me to start an email?12:12
weshay|ruckbhagyashris, holiday in india today?12:12
bhagyashrisweshay|ruck, ok ...12:12
bhagyashrisohh ok weshay|ruck no today is not holiday in India12:12
weshay|ruckoh ok..12:12
weshay|ruckI see Ramzan Eld on my cal12:12
bhagyashrisweshay|ruck, coming Thursday is public holiday in India12:13
weshay|ruckfigured everyone in india was out.. this is much better news that we promoted x86 && ppc container manifests12:13
weshay|ruckoh.. I see the problem12:13
weshay|ruck\/me and coffee12:13
bhagyashrisweshay|ruck, yeah that is on Thursday12:13
weshay|ruckoy12:13
weshay|ruckbhagyashris, I think you are clear now to start a production promoter12:15
weshay|ruck:)12:15
bhagyashrisweshay|ruck, yes :D but before that i want your permission to access the vexxhost ;)12:15
weshay|ruckbhagyashris, ya.. I'll take a look and clean up if we need to sec12:16
weshay|ruckbhagyashris++12:16
bhagyashrisweshay|ruck, sure that will be great12:17
*** pojadhav|brb is now known as pojadhav|rover12:17
*** ratailor_ has joined #oooq12:18
pojadhav|roverrlandy, is this the connection issue with quay.ceph.io ?12:19
pojadhav|roverrlandy, I also reported bug related to quay.ceph.io : https://bugs.launchpad.net/tripleo/+bug/192795212:20
openstackLaunchpad bug 1927952 in tripleo "tripleo-ci-centos-8-content-provider failed to pull containers from quay.ceph.io" [Critical,Triaged]12:20
rlandypojadhav|rover: looks like it12:21
*** ratailor has quit IRC12:21
weshay|ruckpojadhav|rover, thanks for opening https://bugs.launchpad.net/tripleo/+bug/192795212:22
openstackLaunchpad bug 1927952 in tripleo "tripleo-ci-centos-8-content-provider failed to pull containers from quay.ceph.io" [Critical,Triaged]12:22
pojadhav|roverrlandy, weshay|ruck : can we make then this is duplicate of above - https://bugs.launchpad.net/tripleo/+bug/192791712:23
openstackLaunchpad bug 1927917 in tripleo "master : C8 ovb jobs failing with Could not load 'oslo_cache.etcd3gw': No module named 'etcd3gw''" [Undecided,Triaged]12:23
pojadhav|roveras per rlandy's comment on the bug12:23
weshay|ruckpojadhav|rover, haven't dug into that one yet12:24
pojadhav|roverweshay|ruck, ack12:24
weshay|ruckchandankumar, arxcruz trunk.registry.rdoproject.org/ceph/daemon:v6.0.0-stable-6.0-pacific-centos-8-x86_64  https://registry.rdoproject.org:8443/oapi/v1/namespaces/ceph/imagestreamtags/12:24
weshay|ruckcan we get that container pushed to rdo?12:24
weshay|ruckif we can get a copy?12:24
rlandylooks like we have a quay connection issue12:24
weshay|ruckya..12:25
rlandyhttps://review.rdoproject.org/zuul/stream/8b9b63447f0f463aaf828c655bce2edf?logfile=console.log12:25
rlandyis still running12:25
rlandypojadhav|rover: either way - we should change the bug title12:25
weshay|ruckhttps://hub.docker.com/r/ceph/daemon/tags?page=1&ordering=last_updated12:26
weshay|ruckperhaps we pull from docker.io and get it in rdo12:26
*** jpena|lunch is now known as jpena12:27
pojadhav|roverrlandy, ok12:27
rlandypojadhav|rover: but yes, I think it's a dup12:28
rlandyweshay|ruck: OMG12:28
rlandypuppet-openstack-integration-6-scenario001-tempest-centos-8-stream-internal12:28
rlandypuppet-openstack-integration-6-scenario001-tempest-rhel-812:28
weshay|ruckpojadhav|rover, akahat|ruck /me pulling ceph container from docker.io12:29
rlandyrunning jobs12:29
rlandypuppet12:29
rlandydownstream12:29
rlandythey will fail12:29
weshay|ruck[whayutin@localhost ~]$ podman pull docker.io/ceph/daemon:v6.0.0-stable-6.0-pacific-centos-8-x86_6412:29
rlandybut we have lift off12:29
akahat|rucklots of jobs are affected because of quay.ceph.io connection issues12:30
*** amoralej is now known as amoralej|lunch12:31
soniya29bhagyashris, I am stepping out for 1 hr12:42
bhagyashrissoniya29, ack12:47
weshay|ruckmjturek, ping good news12:55
mjturek=-o12:56
mjturekhey weshay|ruck12:56
weshay|ruckthanks to bhagyashris and akahat|ruck12:56
* weshay|ruck sees12:56
weshay|ruckhttps://hub.docker.com/r/tripleomaster/openstack-base/tags?page=1&ordering=last_updated12:56
weshay|ruckhttps://hub.docker.com/r/tripleomaster/openstack-unbound/tags?page=1&ordering=last_updated12:56
weshay|ruckDIGEST12:57
weshay|ruckOS/ARCH12:57
weshay|ruckLAST PULL12:57
weshay|ruckCOMPRESSED SIZE12:57
weshay|ruckd7f96dc0d70712:57
weshay|rucklinux/amd6412:57
weshay|ruck2 hours ago12:57
weshay|ruck208.45 MB12:57
mjturekamazing!!!!!!!12:57
weshay|ruckcac7c0fb9a4712:57
weshay|rucklinux/ppc64le12:57
weshay|ruck2 hours ago12:57
weshay|ruck:)12:57
weshay|ruck\0/12:57
mjturekthanks all feels good to finally have it12:57
weshay|ruckthank you sir12:57
weshay|ruckthanks for you effort and patience :)12:57
mjturek:)12:57
bhagyashris:)12:57
akahat|ruck:)12:57
mjturekthank you bhagyashris akahat|ruck12:58
bhagyashrismjturek, WC! And thanks for your efforts and support! :)12:58
bhagyashrisweshay|ruck, akahat|ruck chandankumar rlandy scrum...13:01
akahat|ruckweshay|ruck, chandankumar rlandy do we have any news on quay.ceph.io outage?13:06
akahat|ruckIt is killing us.13:07
weshay|ruckakahat|ruck, we're working it by pushing to rdo reg.. and we'll have failover13:08
akahat|ruckfailover script :)13:09
chandankumarweshay|ruck: rlandy https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/790381 for fixing sc1013:22
*** amoralej|lunch is now known as amoralej13:24
*** tosky_ has joined #oooq13:27
mariosweshay|ruck: wana meet now?13:27
*** tosky has quit IRC13:27
*** tosky_ is now known as tosky13:27
weshay|ruckmarios, sure13:27
chandankumarmarios: sshnaidm weshay|ruck rlandy want to talk now on tripleo-repos?13:27
mariosweshay|ruck: joining13:28
sshnaidmchandankumar, yeah, let's do13:28
marioschandankumar: have another call now13:28
sshnaidmchandankumar, ok, later then ^13:28
chandankumarmarios: let me know when done, then we can start the call13:28
marioschandankumar: i moved call with weshay|ruck beacuse it was conflicting with repos13:28
marioschandankumar: ack13:28
*** marios is now known as marios|call13:28
*** ratailor_ has quit IRC13:30
*** ykarel_ has joined #oooq13:31
*** ykarel has quit IRC13:31
*** ykarel_ is now known as ykarel13:32
marios|callweshay|ruck: https://wiki.openstack.org/wiki/Meetings/TripleO13:44
marios|callsshnaidm: chandankumar: rlandy: in 15 mins ok for you? otherwise as scheduled works for me too whatever you prefer13:45
chandankumarmarios|call: sounds good13:46
*** marios|call is now known as marios13:46
chandankumarweshay|ruck: tripleoclient repoclosure issue fixed https://0ba370c98f3f7da9d79f-cd31b7d13ce3a5361a90f9a39020eeee.ssl.cf1.rackcdn.com/789380/7/check/tripleo-ci-centos-8-repoclosure/8c21522/logs/undercloud/home/zuul/repoclosure.log13:46
rlandymarios: ack13:46
chandankumarthanks to jpena :-)13:47
chandankumarjpena++13:47
weshay|ruckchandankumar, so.. --disablerepo delorean-current13:47
weshay|ruckis the fix?13:47
chandankumaryes13:47
weshay|ruckk13:47
weshay|ruckchandankumar, and that's because.. we don't have repoclosure until it hits consistent13:47
weshay|ruckk.. so for internal 17.. I'll take a look and see if that fixed it as well13:48
weshay|ruckchandankumar, thanks for your eyes13:48
weshay|ruckjpena++13:48
chandankumarweshay|ruck: it is happening as https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/master.yml#L105 overrides the config from other repo13:49
weshay|ruckaye.. k13:58
weshay|ruckthanks13:58
weshay|ruckarxcruz, chandankumar one more..  "quay.ceph.io/prometheus/node-exporter:v0.17.0" to "docker://127.0.0.1:5001/tripleomaster/node-exporter:v0.17.0": error locating image with name "quay.ceph.io/prometheus/node-exporter:v0.17.0" ([quay.ceph.io/prometheus/node-exporter:v0.17.0]): image not known14:01
weshay|rucknode-exporter14:01
marioschandankumar: rlandy: sshnaidm: joining?14:01
rlandyyep14:01
marioschandankumar: rlandy: sshnaidm: or we doing as scheduled in halfhour?14:01
sshnaidmI'm on mtg now14:01
sshnaidmmarios, go w/o me14:01
rlandyso, go with scheduled?14:01
mariosrlandy: sshnaidm: chandankumar: ack then in half hour it is...14:01
mariosrlandy: yes14:01
marios17:01 < rlandy> so, go with scheduled?14:01
chandankumarok14:01
marios+1214:01
rlandyok14:01
weshay|ruckarxcruz, chandankumar actually it's in rdo14:02
weshay|ruck      "metadata": {14:02
weshay|ruck        "name": "node-exporter:v0.17.0",14:02
weshay|ruck        "namespace": "ceph",14:02
weshay|ruck        "selfLink": "/oapi/v1/namespaces/ceph/imagestreamtags/node-exporter%3Av0.17.0",14:02
weshay|ruck        "uid": "e5fe24a8-2f39-11eb-9204-fa163e4759f3",14:02
weshay|ruck        "resourceVersion": "41972761",14:02
weshay|ruck        "creationTimestamp": "2020-11-25T16:18:48Z"14:02
weshay|ruck      },14:02
weshay|ruckhrm14:02
rlandyweshay|ruck: keep the puppet-6 jobs in the pipeline or just run 7?14:19
* rlandy adds both for now14:19
weshay|ruckrlandy, I *think* just 7.. iirc 7 is passing upstream fine14:19
rlandyack14:20
weshay|ruckand if that's the target.. we might as well just use those14:20
rlandytestprojecting 7 now14:20
*** saneax has quit IRC14:29
mariosrlandy: chandankumar: sshnaidm: o/ joining?14:30
chandankumaryes14:30
chandankumardviroel: https://meet.google.com/pio-bhte-oci?authuser=0 please join tripleo-repos call14:31
mariosrlandy: dviroel: starting in a sec14:32
mariosrlandy: weshay|ruck: https://review.opendev.org/c/openstack/tripleo-specs/+/77244214:35
marioshttps://etherpad.opendev.org/p/ci-tripleo-repos14:36
weshay|ruckarxcruz, chandankumar I love you both: 2021-05-10 14:42:44.621748 | primary | TASK [container-build : Pull failed containers from RDO registry] **************14:43
weshay|ruckhrm..14:44
weshay|ruckstill failing14:44
weshay|ruckhttps://zuul.openstack.org/stream/4afad1e775374414ad6e00fdfb998547?logfile=console.log14:44
*** pojadhav|rover is now known as pojadhav|dinner14:45
marioshttps://review.opendev.org/c/openstack/tripleo-repos/+/785593/1/tripleo_repos/conf/master.yaml#3014:52
chandankumarsshnaidm: weshay|ruck can you take a look at this review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782362/5/roles/container-build/tasks/non_tripleo_containers.yml#b10714:56
*** udesale has quit IRC14:56
*** matbu has quit IRC14:56
chandankumarI am facing issue while pushing containers to provider registry14:56
chandankumarin failover registry we pull the containers14:56
chandankumarand we donot update the non_tripleo containers list14:56
chandankumarbefore pushing I was grabbibg the image id and then pushing14:57
chandankumarbut it was failing earlier14:57
chandankumarSo right now I have changed it to just container name and checking here https://review.rdoproject.org/r/c/testproject/+/3358114:57
*** udesale_ has quit IRC14:58
arxcruzweshay|ruck: sorry, just come back from dentist15:01
*** skramaja has quit IRC15:01
arxcruzweshay|ruck: chandankumar do you still needs me to push this node-exporter ?15:01
weshay|ruckarxcruz, np.. I'm not 100% what the error is.15:01
weshay|ruckarxcruz, I don't *think* so15:01
chandankumarweshay|ruck: above patch will fix the issue15:01
weshay|ruckarxcruz, seems to be there.. and now we have some error15:02
chandankumarwe are not able to push it to content provider registry as their reference does not exists in non-tripleo containers15:02
weshay|ruckarxcruz, chandankumar where is the retry code15:07
weshay|ruckwe have a namespace issue afaict15:07
weshay|ruck2021-05-10 14:45:24.509640 | primary | trunk.registry.rdoproject.org/ceph/grafana                          6.7.4                                       be4c69a1aae8   11 months ago    237 MB15:07
weshay|ruckvs.15:07
weshay|ruck\"quay.ceph.io/app-sre/grafana:6.7.415:07
weshay|ruckapp-sre15:07
weshay|rucksee that?15:08
weshay|ruckalo?15:08
chandankumarweshay|ruck: call?15:08
weshay|rucksure15:08
chandankumarweshay|ruck: https://meet.google.com/wyk-qnmb-nrh?authuser=0&hl=en15:09
weshay|ruckarxcruz, please join15:09
chandankumarweshay|ruck: https://review.rdoproject.org/r/c/testproject/+/3358115:14
frenzy_fridayrlandy, weshay|ruck check jobs passing on your queries patch in tripleo health now. https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/790097/ , https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/788819. I think we can merge them now15:37
*** dsneddon has quit IRC15:37
sshnaidmweshay|ruck, https://review.rdoproject.org/r/c/config/+/3366615:38
*** saneax has joined #oooq15:41
chandankumarsshnaidm: weshay|ruck: https://logserver.rdoproject.org/81/33581/4/check/tripleo-ci-centos-8-content-provider/c55b92a/job-output.txt15:43
chandankumar level=info msg="failed to shutdown storage: \"A layer is mounted: layer is in use by a container\""15:44
chandankumarhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/78236215:44
*** matbu has joined #oooq15:44
weshay|rucksame thing here: chandankumar15:45
weshay|ruckhttps://zuul.openstack.org/stream/57382d376fff40979c6188b0d2e49d4b?logfile=console.log15:45
*** amoralej is now known as amoralej|off15:46
weshay|ruckchandankumar, any idea how to fix that?15:46
rlandyarxcruz: hey - ok if we move 1-on-1 to tomorrow?15:47
rlandyneed to drop my car off15:48
arxcruzrlandy: no problem15:48
rlandythanks15:48
*** dsneddon has joined #oooq15:48
sshnaidmchandankumar, can you run it so it will print "image_id"?15:49
sshnaidmchandankumar, error pushing image "docker://127.0.0.1:5001/tripleomaster/daemon" to "docker://127.0.0.1:5001/tripleomaster/daemon"15:50
*** saneax has quit IRC15:51
*** ykarel has quit IRC15:57
*** marios is now known as marios|out16:00
*** rlandy is now known as rlandy|biab16:03
*** marios|out has quit IRC16:04
chandankumarsshnaidm: can you check now https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782362/6/roles/container-build/tasks/non_tripleo_containers.yml feel free to update it16:05
weshay|ruckchandankumar++16:07
*** jpodivin has quit IRC16:22
*** jmasud has joined #oooq16:29
*** pojadhav|dinner is now known as pojadhav|away16:35
*** jpena is now known as jpena|off16:59
*** rlandy|biab is now known as rlandy17:22
rlandyweshay|ruck: puppet 7 is a go ... https://review.rdoproject.org/r/c/testproject/+/3158617:38
weshay|ruckk.. thanks17:38
rlandyweshay|ruck: pls review https://review.rdoproject.org/r/q/topic:%22tripleo-next-os%22+(status:open%20OR%20status:merged)17:38
*** saneax has joined #oooq17:40
*** jmasud has quit IRC17:49
*** jmasud has joined #oooq18:02
*** saneax has quit IRC18:03
*** sshnaidm is now known as sshnaidm|afk18:17
*** dsneddon has quit IRC19:05
rlandyweshay|ruck: want do you want to do about tripleo wallaby?19:23
rlandywait for kick19:23
rlandyor rerun failed jobs now?19:23
rlandytempest line is operational now19:24
*** jmasud has quit IRC19:26
*** dsneddon has joined #oooq19:29
rlandyweshay|ruck: nvm - tripleo line just kicked19:36
*** jmasud has joined #oooq19:41
weshay|ruckrlandy, I may force promote tripleo to get it imported at least19:44
rlandycriteria looks ok19:44
rlandywas just checking that19:45
rlandy2021-05-10 19:47:59.944358 | primary | cp: cannot stat '/root/openrc': No such file or directory19:48
rlandyweshay|ruck: ^^ shows up in puppet-7 jobs in downstream as well19:49
rlandynot a puppet-6 issue19:49
weshay|ruckhrm.. so it's centos-8 running internally19:49
weshay|ruckcentos-8 puppet-719:50
rlandycentos-8-stream19:50
rlandyrunning internally19:50
rlandyshould be exactly the same as rdo19:50
rlandyunless I am missing the more fundamental error19:50
weshay|ruckya.. that's odd19:50
weshay|ruckonly scenario001 is failing?19:50
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/23db3a48c19c4eb3ba53312eaa471f0b?logfile=console.log19:52
rlandyit's the only one I tested19:52
rlandyI can try 00019:52
rlandybut it's a standard line in the puppet jobs19:52
rlandyexpects /root/openrc19:52
rlandyI could create that dir19:52
rlandyand hope for the best19:52
weshay|ruck\/root?19:52
weshay|ruckrlandy, we running as the same user?19:53
rlandyalways as zuul19:53
rlandyexcept for become lines19:53
weshay|ruckrlandy, k.. table it for now.. just let it run and fail19:53
rlandyit's the exact same job19:53
weshay|ruckthe important thing is that the job is running19:53
rlandyya19:53
rlandymoving on to rhel version of those jobs19:53
rlandyit's what we care about anyways19:54
rlandyperiodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2 rekciked19:54
*** jmasud has quit IRC19:55
rlandygoing to pick up car20:24
rlandybiab20:24
*** rlandy is now known as rlandy|biab20:24
*** rlandy|biab is now known as rlandy21:11
rlandyhmmm ... scenario00121:12
rlandyissue these days?21:12
rlandyweshay|ruck: following up on comment before re: ceph crisis ...21:14
rlandyhttps://review.rdoproject.org/r/c/rdo-jobs/+/3349621:14
rlandyscenario001 ceph crisis21:14
rlandyacross the board on all releases21:14
rlandyexpected??21:14
*** chem has quit IRC21:14
rlandysomething else to investigate?21:15
*** chem has joined #oooq21:19
*** chem has quit IRC21:36
weshay|ruckrlandy, ya.. but it resolved about 3 hours ago21:51
weshay|ruckrlandy, everything was toast21:51
*** chem has joined #oooq22:06
rlandyweshay|ruck: thanks - rekciked22:14
*** jmasud has joined #oooq22:44
*** tosky has quit IRC22:57
« Sunday, 2021-05-09 Index Tuesday, 2021-05-11 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!