| *** jmasud has joined #oooq | 00:03 | |
| *** rlandy|rover has quit IRC | 00:26 | |
| *** rfolco has quit IRC | 01:01 | |
| *** jmasud has quit IRC | 01:12 | |
| *** saneax has joined #oooq | 01:46 | |
| *** chandankumar has quit IRC | 02:18 | |
| *** udesale has joined #oooq | 03:54 | |
| *** saneax has quit IRC | 04:01 | |
| *** ratailor has joined #oooq | 04:19 | |
| *** jmasud has joined #oooq | 04:21 | |
| *** chandankumar has joined #oooq | 04:25 | |
| *** udesale has quit IRC | 04:32 | |
| *** udesale has joined #oooq | 04:34 | |
| *** ykarel|away has joined #oooq | 04:44 | |
| *** ykarel|away is now known as ykarel | 04:58 | |
| *** ykarel_ has joined #oooq | 05:04 | |
| *** ykarel has quit IRC | 05:08 | |
| *** ykarel_ is now known as ykarel | 05:18 | |
| *** marios has joined #oooq | 05:20 | |
| *** saneax has joined #oooq | 05:34 | |
| *** apetrich has joined #oooq | 05:44 | |
| *** saneax has quit IRC | 05:45 | |
| *** saneax has joined #oooq | 05:54 | |
| *** amoralej|off is now known as amoralej | 07:00 | |
| *** jtomasek has joined #oooq | 07:00 | |
| *** ysandeep|away is now known as ysandeep | 07:09 | |
| *** saneax has quit IRC | 07:13 | |
| *** dsneddon has quit IRC | 07:24 | |
| *** sshnaidm|afk is now known as sshnaidm | 07:36 | |
| *** tosky has joined #oooq | 07:43 | |
| *** jpena|off is now known as jpena | 07:57 | |
| *** jbadiapa has joined #oooq | 08:02 | |
| soniya29|ruck | arxcruz, kopecmartin, please edit/update the tempest agenda for today's meeting - https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ | 08:08 |
|---|---|---|
| *** saneax has joined #oooq | 08:20 | |
| *** amoralej is now known as amoralej|brb | 08:23 | |
| *** derekh has joined #oooq | 08:43 | |
| *** amoralej|brb is now known as amoralej | 08:47 | |
| akahat | marios, chandankumar o/ | 08:53 |
| akahat | I'm seeing one repo related issue here: https://b7579b48df70a82a68ef-3543d102446f63172a4b0c8142b2ea07.ssl.cf5.rackcdn.com/756568/4/check/tripleo-ci-centos-8-containers-multinode/6ec0d96/job-output.txt | 08:54 |
| akahat | Timeout when waiting for 198.72.124.77:8766" | 08:54 |
| marios | akahat: it is for install-built-repo i think you can ignore it? | 08:56 |
| marios | akahat: it says 2020-10-13 14:27:23.782077 | primary | ERROR: Ignoring Errors | 08:56 |
| marios | 2020-10-13 14:27:16.752293 | PRE-RUN START: [untrusted : opendev.org/openstack/tripleo-ci/playbooks/tripleo-ci/install-built-repo.yml@master] | 08:56 |
| marios | akahat: i had the same in my review it means there wasn't one built probably | 08:57 |
| akahat | marios, next task got skipped. | 08:57 |
| marios | akahat: but bring it to the call later to show the others | 08:57 |
| akahat | marios, ack. | 08:58 |
| holser | Morning folks | 09:28 |
| holser | marios I removed depends-on in https://review.opendev.org/#/c/757900/4 | 09:29 |
| holser | and rebased it as CI failed on db sync containers (timeout) which is not related to patch | 09:29 |
| marios | holser: ack | 09:31 |
| *** jtomasek has quit IRC | 09:37 | |
| holser | folks can anyone merge https://review.opendev.org/#/c/757605/3 ? | 09:48 |
| chandankumar | sshnaidm: Hello | 10:02 |
| sshnaidm | chandankumar, hi | 10:02 |
| chandankumar | sshnaidm: https://logserver.rdoproject.org/21/29921/7/check/tripleo-ci-centos-7-containers-multinode-queens/253b56f/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 10:03 |
| chandankumar | one queens c7 multinode job https://logserver.rdoproject.org/21/29921/7/check/tripleo-ci-centos-7-containers-multinode-queens/253b56f/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz | 10:04 |
| sshnaidm | chandankumar, sorry, what is the question? | 10:04 |
| chandankumar | after adding the ip under insecure registry it is still failing with ping: http: server gave HTTP response to HTTPS client | 10:05 |
| sshnaidm | chandankumar, where? | 10:05 |
| chandankumar | sshnaidm: during overclid prep containers https://logserver.rdoproject.org/21/29921/7/check/tripleo-ci-centos-7-containers-multinode-queens/253b56f/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 10:05 |
| chandankumar | in centos 7 queens against this patch https://review.rdoproject.org/r/#/c/29921/ | 10:06 |
| *** chem has quit IRC | 10:06 | |
| *** chem has joined #oooq | 10:07 | |
| chandankumar | and here in this patch https://review.opendev.org/#/c/752419/48/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 we are setting the insecure registry ip | 10:08 |
| chandankumar | for train c7 it is working fine | 10:08 |
| chandankumar | I am not sure what is missing for queens | 10:08 |
| sshnaidm | chandankumar, firstly we need to change tags for jobs | 10:10 |
| *** chem has quit IRC | 10:11 | |
| chandankumar | sshnaidm: ok updating | 10:12 |
| sshnaidm | chandankumar, seems like in tain we don't use overcloud prep containers role | 10:12 |
| sshnaidm | *train | 10:12 |
| *** chem has joined #oooq | 10:12 | |
| sshnaidm | chandankumar, https://logserver.rdoproject.org/21/29921/7/check/tripleo-ci-centos-7-containers-multinode-queens/253b56f/logs/undercloud/home/zuul/containers-default-parameters.yaml.txt.gz | 10:14 |
| sshnaidm | DockerInsecureRegistryAddress: | 10:14 |
| sshnaidm | - 192.168.24.1:8787 | 10:14 |
| sshnaidm | maybe to add there? | 10:14 |
| chandankumar | sshnaidm: will update that also | 10:15 |
| *** jfrancoa has joined #oooq | 10:39 | |
| *** saneax has quit IRC | 10:44 | |
| *** jtomasek has joined #oooq | 10:58 | |
| *** saneax has joined #oooq | 11:03 | |
| chandankumar | sshnaidm: https://review.opendev.org/#/c/752419/50/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2 | 11:11 |
| chandankumar | is needed for queens, I checked the ip of undercloud registry, it is mentioned there | 11:11 |
| chandankumar | let'see how it goes | 11:11 |
| sshnaidm | chandankumar, cool! | 11:12 |
| marios | chandankumar: we are working in same files looks like https://review.opendev.org/#/c/753708/23/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2 | 11:21 |
| chandankumar | marios: yes, we share yesterday | 11:22 |
| marios | chandankumar: no problem just saying same as the one we discussed yesterday - lets's talk on the call | 11:22 |
| *** ysandeep is now known as ysandeep|brb | 11:23 | |
| chandankumar | marios: sure | 11:26 |
| *** ysandeep|brb is now known as ysandeep|afk | 11:32 | |
| *** udesale has quit IRC | 11:34 | |
| *** jpena is now known as jpena|lunch | 11:36 | |
| weshay | sshnaidm, osp-13 failed on | 11:38 |
| weshay | Execution of '/bin/yum -d 0 -e 0 -y install openstack-nova-conductor' returned 1: No Presto metadata available for rhelosp-rhel-7.9-server | 11:38 |
| weshay | 2020-10-13 17:38:52,474 INFO: No Presto metadata available for rhelosp-13.0-puddle | 11:38 |
| weshay | asking what version of rhel to use | 11:38 |
| sshnaidm | weshay, hmm.. https://access.redhat.com/solutions/3141231 | 11:39 |
| sshnaidm | "It is safe to ignore as this message as it is displayed as informational only. This will not prevent the packages from being downloaded." | 11:40 |
| weshay | deltarpm-3.6-3.el7.x86_64 | 11:41 |
| weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/78/213478/13/check/tripleo-ci-rhel-7-multinode-1ctlr-featureset010/81776a2/logs/undercloud/var/log/extra/rpm-list.txt | 11:41 |
| weshay | ok.. so that's an easy fix | 11:41 |
| sshnaidm | weshay, I see a lot of errors in the latest jobs like: http://paste.openstack.org/show/799028/ | 11:42 |
| sshnaidm | weshay, it seems like the same error that was before | 11:42 |
| weshay | sshnaidm, like in queens? or specifically this job? | 11:43 |
| sshnaidm | weshay, in this job before | 11:43 |
| weshay | aye.. k.. so we just need to take out deltarpm via the release file | 11:44 |
| weshay | sshnaidm, 7.9 is supported, confirmed by burns | 11:46 |
| chandankumar | sshnaidm: marios can we merge tomorrow's content provider with scrum ? I got meetings back to back | 11:46 |
| sshnaidm | chandankumar, fine for me | 11:46 |
| weshay | sshnaidm, shouldn't blist it here? https://code.engineering.redhat.com/gerrit/#/c/214973/ | 11:46 |
| weshay | sshnaidm, or ur saying it's a fluke of that run? | 11:47 |
| sshnaidm | weshay, https://meet.google.com/rws-pxvy-ozx | 11:48 |
| marios | chandankumar: ack | 11:50 |
| chandankumar | sshnaidm: marios thanks! | 11:52 |
| weshay | soniya29|ruck, looks like we're hanging here for some reason https://review.rdoproject.org/zuul/stream/ffb19076d153432e9674b04dc1e49e26?logfile=console.log | 11:56 |
| weshay | which is odd.. that task has been around forever | 11:57 |
| *** rlandy has joined #oooq | 12:00 | |
| *** rlandy is now known as rlandy|rover | 12:00 | |
| ykarel | ysandeep|afk, same thing in ^ | 12:02 |
| ykarel | weshay, fyi ^ was workaround in upstream with https://review.opendev.org/#/c/736468/ | 12:03 |
| ykarel | likely that is not available in the hanging job | 12:04 |
| *** udesale has joined #oooq | 12:05 | |
| *** amoralej is now known as amoralej|lunch | 12:08 | |
| weshay | ykarel, the playbook is not available? | 12:08 |
| ykarel | weshay, the workaround | 12:08 |
| weshay | so weird | 12:09 |
| ykarel | to use single playbook instead of multiple | 12:09 |
| soniya29|ruck | weshay yeah | 12:11 |
| weshay | soniya29|ruck, want to give that a go in a test project? | 12:16 |
| soniya29|ruck | weshay, okay. give me a moment | 12:17 |
| weshay | thanks rlandy|rover | 12:23 |
| rlandy|rover | soniya29|ruck: weshay: started a tsetproject for the stein standalone failure | 12:24 |
| rlandy|rover | 39 and 38 are not in criteria | 12:25 |
| rlandy|rover | ugh - 30 failed | 12:25 |
| rlandy|rover | in master | 12:25 |
| weshay | rlandy|rover, see yatin's comments | 12:25 |
| weshay | soniya29|ruck, is looking at it | 12:26 |
| weshay | rlandy|rover, it's just sitting on 2020-10-14 10:26:49.539481 | primary | TASK [ensure the deployment result has been read into memory] ****************** | 12:26 |
| weshay | hanging | 12:26 |
| weshay | weird | 12:26 |
| rlandy|rover | weshay: https://review.opendev.org/#/c/736468/? | 12:26 |
| rlandy|rover | that review | 12:26 |
| weshay | ya | 12:26 |
| *** ratailor has quit IRC | 12:27 | |
| rlandy|rover | weshay: that's super weird - but I actually remember this bug | 12:30 |
| rlandy|rover | why in fs030 now though? | 12:30 |
| rlandy|rover | that was july | 12:30 |
| weshay | no clue | 12:30 |
| rlandy|rover | cacheable: true? | 12:31 |
| chandankumar | sshnaidm: weshay meeting time | 12:31 |
| *** rfolco has joined #oooq | 12:31 | |
| chandankumar | akahat: ^^ | 12:32 |
| *** jpena|lunch is now known as jpena | 12:35 | |
| *** ysandeep|afk is now known as ysandeep | 12:38 | |
| marios | * provider jobs pipeline https://hackmd.io/ermQSlQ-Q-mDtZkNN2oihQ standalone-upgrade https://review.opendev.org/753403 & https://review.opendev.org/753708 & https://review.opendev.org/755472 | 12:45 |
| ysandeep | hey rlandy|rover weshay when you have time.. can you please review https://code.engineering.redhat.com/gerrit/#/c/214949/ | 12:48 |
| rlandy|rover | yep | 12:51 |
| ysandeep | thanks a bunch! | 12:51 |
| *** skramaja has joined #oooq | 12:55 | |
| kopecmartin | chandankumar: i have a team meeting (with my manager) at the same time we have tempest mtg today .. the conflict is there only every 3 weeks .. if you have any questions on me during the meeting ping me or leave me a note in the hackmd, I'll answer after the meeting :) | 12:56 |
| chandankumar | soniya29|ruck: ^^ | 12:56 |
| soniya29|ruck | kopecmartin sure | 12:57 |
| kopecmartin | thansk | 12:58 |
| rlandy|rover | ysandeep: we built 17 containers for the first time in a month | 13:01 |
| soniya29|ruck | bhagyashris, weshay, pojadhav , akahat, tempest meeting | 13:02 |
| ysandeep | rlandy|rover: yay that's a very good news :) | 13:02 |
| rlandy|rover | ysandeep: weshay: there are failures in the line - we may need to choose whether to promote those failures to clear the component lines | 13:02 |
| rlandy|rover | the code base is very behind | 13:02 |
| ysandeep | rlandy|rover: i agree with you.. some fixes might be sitting in component line | 13:03 |
| soniya29|ruck | akahat, bhagyashri, pojadhav tempest meeting? | 13:04 |
| rlandy|rover | ysandeep: promoted 16.2 yesterday | 13:04 |
| *** Goneri has joined #oooq | 13:04 | |
| soniya29|ruck | s/bhagyashri/bhagyashris | 13:04 |
| ysandeep | rlandy|rover: yes i saw that, thanks for promoting it :) | 13:04 |
| soniya29|ruck | bhagyashris ^^ | 13:04 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| *** Goneri has quit IRC | 13:18 | |
| rlandy|rover | sshnaidm: how's it going with the rhos-13 job? | 13:19 |
| rlandy|rover | edited the pre yesterday | 13:20 |
| bhagyashris | weshay, chandankumar marios sshnaidm zbr hi, please review these patches when you get time - https://review.opendev.org/#/c/757861/ , https://review.opendev.org/#/c/758030/ , https://review.opendev.org/#/c/757803/ we need those patches for full integration victoria pipeline https://review.rdoproject.org/r/3003 | 13:21 |
| rfolco | sshnaidm, namespace is still docker on scen004, but ceph_namespace is correct ?? wtf ? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9b3/757917/1/check/tripleo-ci-centos-8-scenario004-standalone/9b39539/logs/undercloud/home/zuul/containers-prepare-parameters.yaml | 13:23 |
| rfolco | namespace: docker.io/tripleotraincentos8 | 13:23 |
| weshay | k | 13:23 |
| weshay | thanks bhagyashris | 13:23 |
| *** TrevorV has joined #oooq | 13:24 | |
| soniya29|ruck | weshay, rlandy|rover, https://review.rdoproject.org/r/30220 | 13:24 |
| weshay | rlandy|rover, fyi.. prod-chain a few.. I have on the agenda perf issues w/ upshift | 13:24 |
| weshay | ysandeep, ^ | 13:25 |
| sshnaidm | rfolco, yeah, docker.io shouldn't be there | 13:25 |
| weshay | periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2openstack/tripleo-cimasteropenstack-periodic-integration-rhos-16.2master5 hrs 51 mins 20 secs2020-10-14 00:59:32TIMED_OUT | 13:25 |
| weshay | so... | 13:25 |
| sshnaidm | rfolco, all should be 198.72.124.20:5001/tripleotraincentos8 | 13:26 |
| rlandy|rover | weshay: we've been passing since we increased the timeout I think | 13:26 |
| rfolco | sshnaidm, the job looks correct | 13:26 |
| rfolco | https://review.opendev.org/#/c/757917/1/zuul.d/layout.yaml | 13:26 |
| rfolco | sshnaidm, I'll check the condition to see if branch interferes | 13:27 |
| sshnaidm | rfolco, yeah, seems like miss something.. | 13:27 |
| ysandeep | weshay: ack | 13:27 |
| weshay | rlandy|rover, we can show https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable2&job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train and https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-periodic-integration-rhos-16.2&job_name=periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2 | 13:27 |
| rlandy|rover | ok - sure | 13:28 |
| rfolco | sshnaidm, thanks | 13:28 |
| rlandy|rover | ysandeep: should scenario010 be passing now? 16.2 line | 13:29 |
| rlandy|rover | periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-16.2 failure | 13:30 |
| ysandeep | yes | 13:30 |
| ysandeep | rlandy|rover: let me check why it failed | 13:30 |
| ysandeep | rlandy|rover: git clone timedout :) | 13:35 |
| ysandeep | 2020-10-14 09:11:10.839405 | primary | ERROR: Command errored out with exit status 128: git clone -q https://opendev.org/openstack/ansible-config_template/ /tmp/pip-install-vf3anlq9/ansible-config-template Check the logs for full command output. | 13:35 |
| rlandy|rover | k - will rerun | 13:35 |
| ysandeep | rlandy|rover: i am shooting a testpatch to rerun | 13:36 |
| rlandy|rover | thanks | 13:36 |
| weshay | rlandy|rover, can you speak to the continued fun we're having w/ 17 after we highlight infra issues | 13:38 |
| rlandy|rover | weshay: I plan to speak about 17 | 13:38 |
| weshay | thanks | 13:38 |
| rlandy|rover | infra issue being what aspect? | 13:38 |
| rlandy|rover | the ovb timing you mentioned? | 13:38 |
| ysandeep | rlandy|rover weshay fyi.. i am also faced some timeouts with ovb jobs, not sure of reason yet http://pastebin.test.redhat.com/910259 | 13:40 |
| ysandeep | rlandy|rover, testpatch to rerun sc010 https://code.engineering.redhat.com/gerrit/#/c/211643/ | 13:41 |
| akahat | sshnaidm, i think docker.io getting set from here: https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2#L4-L6 | 13:45 |
| sshnaidm | akahat, need to check then why docker_registry_host is docker.io | 13:46 |
| akahat | sshnaidm, it's in the defaults | 13:47 |
| akahat | a min. | 13:47 |
| akahat | sshnaidm, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/extras-common/defaults/main.yml#L42 | 13:48 |
| *** Goneri has joined #oooq | 13:48 | |
| akahat | and here: https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/config/environments/rdocloud.yml#L31 | 13:49 |
| chandankumar | akahat: what is the issue you are seeing? | 13:50 |
| akahat | chandankumar, https://bdd909f1eb86fc3b0b74-fb80ccde54a33fa3e67c7ac44822586a.ssl.cf5.rackcdn.com/757829/1/check/tripleo-ci-centos-8-containers-multinode/ec18137/logs/undercloud/home/zuul/containers-prepare-parameter.yaml | 13:51 |
| akahat | docker.io in DockerInsecureRegistryAddress; | 13:51 |
| chandankumar | akahat: you need something like this https://review.opendev.org/#/c/752419/51/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 | 13:54 |
| akahat | chandankumar, yeah.. already on it. :) | 13:56 |
| chandankumar | akahat: marios and I are working and both have same fix, if it is blocking the work, feel free to go ahead and create a seperate patch https://review.opendev.org/#/c/753708/23/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 is much better | 13:56 |
| akahat | chandankumar, it's not a blocker.. i came across it and found docker.io is there, if you guys working on it then it should be okay. | 13:58 |
| marios | akahat: chandankumar: another one there https://review.opendev.org/#/c/753708/23/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 | 14:00 |
| marios | :) | 14:00 |
| marios | brb | 14:01 |
| sshnaidm | chandankumar, marios probably it's better to extract these fixes to a separate patch | 14:01 |
| sshnaidm | so we don't duplicate in code and investigations | 14:01 |
| chandankumar | akahat: working on seperating code? | 14:07 |
| akahat | chandankumar, yes | 14:08 |
| chandankumar | akahat: cool | 14:08 |
| marios | sshnaidm: yeah, well in the end as we discussed in the call earlier it will have to be like https://review.opendev.org/#/c/753708/23/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 i.e. registry_ip_address_branch ... | 14:10 |
| marios | sshnaidm: not sure if extracting will make it simpler or more complex :) | 14:11 |
| sshnaidm | marios, well, at least we'll have fixes for known issues | 14:11 |
| marios | sshnaidm: personally its ok that we are aware of them and we can deal with any conflicts.. maybe i will change my mind in few days :) | 14:11 |
| sshnaidm | marios, if it will be merged as is, you probably shouldn't have conflicts | 14:12 |
| marios | sshnaidm: ack lets see | 14:12 |
| rfolco | marios, sshnaidm can you please point where is the the code that updates container prepare yaml with registry_ip_address ? I suspect there is another task/condition for stable branches in scen004 | 14:15 |
| rfolco | is it in tht ? | 14:15 |
| rlandy|rover | weshay: soniya29|ruck: wrt https://review.rdoproject.org/r/30220 ... should that be running with a change depends-On? | 14:16 |
| weshay | rlandy|rover, yes.. soniya29|ruck ^ | 14:18 |
| soniya29|ruck | rlandy|rover, weshay, depends-On the yatin's above suggested upstream change | 14:19 |
| soniya29|ruck | ? | 14:19 |
| rfolco | marios, sshnaidm nevermind I found it | 14:22 |
| rlandy|rover | soniya29|ruck: weshay: iiuc, https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/multinode-jobs.yaml#L364 should have: | 14:25 |
| rlandy|rover | playbooks: | 14:25 |
| rlandy|rover | - multinode.yml | 14:25 |
| rlandy|rover | that should be the depends-on change. correct? | 14:25 |
| ykarel | rlandy|rover, ^ correct | 14:26 |
| ykarel | go with it and observer the runs in next couple of days | 14:27 |
| ykarel | s/observer/observer | 14:27 |
| ykarel | s/observer/observe | 14:27 |
| rlandy|rover | ykarel: thanks for confirming | 14:27 |
| ykarel | TIMEOUT shouldn't be seen post it | 14:27 |
| rlandy|rover | soniya29|ruck: sec - I'll put in that change and you can add it as a depends-on on your testproject | 14:27 |
| soniya29|ruck | rlandy|rover okay | 14:28 |
| *** skramaja has quit IRC | 14:31 | |
| rlandy|rover | soniya29|ruck: https://review.rdoproject.org/r/#/c/30224/ | 14:31 |
| *** Goneri has quit IRC | 14:31 | |
| *** Goneri has joined #oooq | 14:36 | |
| soniya29|ruck | rlandy|rover done | 14:44 |
| weshay | ysandeep, can you look into that please | 14:46 |
| weshay | ysandeep, make sure both jobs are indentical | 14:47 |
| ysandeep | weshay: sure | 14:47 |
| rlandy|rover | thanks | 14:48 |
| ysandeep | first thing tommorow's morning | 14:48 |
| chandankumar | arxcruz: hello | 14:51 |
| arxcruz | chandankumar: sup | 14:52 |
| chandankumar | arxcruz: I was looking at openstack-tempest-skiplist list-skipped role https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/list_skipped/tasks/main.yaml | 14:52 |
| chandankumar | it does not have feature to filter skip tests for undercloud | 14:53 |
| arxcruz | chandankumar: hmmmm | 14:53 |
| arxcruz | chandankumar: can you work on that ? | 14:53 |
| weshay | rlandy|rover, ping | 14:53 |
| arxcruz | chandankumar: do we still run tempest on undercloud actually ? | 14:53 |
| chandankumar | arxcruz: yes | 14:54 |
| chandankumar | arxcruz: it is always running there | 14:54 |
| arxcruz | chandankumar: run tempest on undercloud pointing to overcloud is okay, my question was do we run tempest on undercloud pointing to undercloud ? | 14:54 |
| chandankumar | arxcruz: it all started from bhagyashris patch https://review.opendev.org/#/c/758030/ | 14:54 |
| rlandy|rover | weshay: you rang? | 14:55 |
| chandankumar | arxcruz: sorry, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset027.yml#L91 one takes care of running tempest on undercloud | 14:56 |
| arxcruz | chandankumar: do we still run jobs that test undercloud only? I thought we were done with that, if it is still a thing, we can add an option | 14:57 |
| chandankumar | arxcruz: yes, tripleo-ci-centos-8-undercloud-containers we test undercloud | 14:57 |
| chandankumar | arxcruz: since bhagyashris is working on above patch, I will work with her to get the support added | 14:58 |
| chandankumar | arxcruz: I might also need to take a look at this list https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml as undercloud is missing there | 14:59 |
| ysandeep | weshay, to_build: false in upstream vs to_build: true in downstream , What should we do enable image build in upstream ? | 15:00 |
| ysandeep | http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/ovb.yaml#n97 | 15:00 |
| arxcruz | chandankumar: or... you can filter the job | 15:00 |
| arxcruz | chandankumar: you can have a test skipped by job name on tempest-skiplist | 15:00 |
| chandankumar | arxcruz: there are branched jobs also | 15:00 |
| chandankumar | and periodic one | 15:00 |
| arxcruz | chandankumar: okay, I'll add support to that | 15:00 |
| chandankumar | let me take a look at job logic | 15:01 |
| ysandeep | rlandy|rover fyi.. image build is contributing(~25-30 mins) time difference b/w ovb fs001 upstream and downstream .. we are building in downstream but not in upstream. | 15:02 |
| chandankumar | arxcruz: I think we can plan first on undercloud support and then start working on that | 15:03 |
| arxcruz | chandankumar: isn't that hard to be honest | 15:03 |
| chandankumar | arxcruz: ok then | 15:03 |
| weshay | rlandy|rover, hey.. can we chat for a sec | 15:04 |
| rlandy|rover | weshay: ack | 15:04 |
| rlandy|rover | ysandeep: we can try download images | 15:04 |
| weshay | rlandy|rover, https://meet.google.com/cfo-gtmx-ook?authuser=1 | 15:04 |
| rlandy|rover | sec | 15:05 |
| ysandeep | rlandy|rover, ack will try download images in downstream | 15:05 |
| ysandeep | Just wondering with download images.. will we have all bits from component?? | 15:09 |
| rlandy|rover | ysandeep: just try integration first | 15:11 |
| rlandy|rover | component we should be | 15:12 |
| rlandy|rover | there we have a change | 15:12 |
| rlandy|rover | integration not | 15:12 |
| ysandeep | rlandy|rover, testing it here for integration line https://code.engineering.redhat.com/gerrit/#/c/215099/ | 15:18 |
| ysandeep | weshay: ^^ fyi.. | 15:18 |
| rlandy|rover | thanks | 15:22 |
| *** ysandeep is now known as ysandeep|away | 15:25 | |
| rlandy|rover | weshay: https://artifacts.ci.centos.org/rdo/jenkins-tripleo-quickstart-promote-ussuri-current-tripleo-delorean-minimal-101/undercloud/home/stack/overcloud_introspect.log | 15:29 |
| *** jmasud has quit IRC | 15:33 | |
| *** ykarel is now known as ykarel|away | 15:34 | |
| *** saneax has quit IRC | 15:38 | |
| *** ykarel|away has quit IRC | 15:42 | |
| *** saneax has joined #oooq | 15:51 | |
| *** derekh has quit IRC | 15:54 | |
| rlandy|rover | ugh - stein standalone tempest failure | 15:57 |
| *** marios has quit IRC | 15:58 | |
| rfolco | chandankumar, got a min? I am struggling to understand how registry wasn't updated in scen004 train, https://efc994b0f5041acef706-55d9f2ceb06593bca2aa650f4fd06759.ssl.cf5.rackcdn.com/757184/1/check/tripleo-ci-centos-8-scenario004-standalone/761d720/logs/undercloud/home/zuul/containers-prepare-parameters.yaml | 16:09 |
| rfolco | chandankumar, any clues ? | 16:09 |
| rfolco | akahat, looks like in ussuri namespace isn't updated either: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_852/757826/1/check/tripleo-ci-centos-8-scenario004-standalone/852b053/logs/undercloud/home/zuul/containers-prepare-parameters.yaml | 16:12 |
| akahat | rfolco, its tripleou | 16:13 |
| rfolco | akahat, registry, not namespace, sorry | 16:14 |
| rfolco | akahat, this namespace: docker.io/tripleou | 16:15 |
| rfolco | should be the ip of provider instead | 16:15 |
| akahat | rfolco, yess.. looking in to code. | 16:15 |
| rfolco | if you find what could be let me know :) | 16:16 |
| rfolco | there must be a condition for branches that docker_registry_host isn't what we wanted | 16:16 |
| rfolco | so when this task runs | 16:16 |
| rfolco | TASK [standalone : update registry if needed in container-prepare-parameters.yaml] | 16:16 |
| rfolco | it is not updated (unchanged), so the task is ok | 16:17 |
| rfolco | ok: [undercloud] | 16:17 |
| rfolco | while in a good run (master), the task is | 16:17 |
| rfolco | changed: [undercloud] | 16:17 |
| rfolco | akahat, this is what I discovered so far ^ | 16:18 |
| akahat | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/tasks/containers.yml#L100 | 16:19 |
| akahat | rfolco, ^^ | 16:19 |
| akahat | need to change this also.. | 16:19 |
| akahat | chandankumar, sshnaidm weshay ^^ | 16:19 |
| rfolco | this is ok for master akahat | 16:19 |
| rfolco | docker_registry_host is not loaded with the right content | 16:20 |
| rfolco | I suspect | 16:20 |
| akahat | rfolco, yes.. replacing it with job.registry_ip_address will work. | 16:21 |
| akahat | for all release. | 16:21 |
| *** tosky has quit IRC | 16:21 | |
| rfolco | akahat, where master replaces the file then ? | 16:21 |
| akahat | still one question.. it's nested calling so not sure it job will be accessible there.? | 16:21 |
| rfolco | akahat, that shouldn't be the place because master works, so where the registry is replaced in master ? | 16:23 |
| * akahat looking | 16:23 | |
| akahat | rfolco, yes. it's replaced in master: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_fba/756913/1/check/tripleo-ci-centos-8-standalone/fbaf601/logs/undercloud/home/zuul/containers-prepare-parameters.yaml | 16:25 |
| rfolco | akahat, right so the task is not skipped, means that the docker_registry_host is not empty... but I suspect that in master it has the content ptovider ip, but in stable branches it doesn't | 16:26 |
| rfolco | so I am searching where docker_registry_host is set | 16:27 |
| rfolco | hope this makes sense | 16:27 |
| akahat | rfolco, it's in tripleo-quickstart-extras | 16:27 |
| akahat | rfolco, https://review.opendev.org/#/c/758136/1 | 16:27 |
| akahat | rfolco, how we overcome this problem? | 16:28 |
| akahat | rfolco, this is in the quickstart-extras branchless project.. IMO we need to add come conditions there | 16:30 |
| rfolco | https://review.opendev.org/#/c/758136/1/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 should not be needed. How master works without this patch ? | 16:31 |
| rfolco | probably because docker_registry_host has the right thing | 16:32 |
| akahat | rfolco, we need to add conditions: http://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_852/757826/1/check/tripleo-ci-centos-8-scenario004-standalone/852b053/logs/undercloud/var/log/tripleo-container-image-prepare.log | 16:33 |
| *** rlandy|rover is now known as rlandy|rover|brb | 16:33 | |
| rfolco | akahat, what do you mean by conditions? in master the file is replaced just fine from docker.io/tripleomaster to ip/tripleomaster. But in stable branches keeps as docker.io. And the var is docker_registry_host. | 16:35 |
| akahat | rfolco, this was adding insecure registry as docker.io in master: https://review.opendev.org/#/c/758136/1/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2 which we don't want. | 16:37 |
| akahat | and for other release if it adding docker.io then we need to change it. | 16:38 |
| *** saneax has quit IRC | 16:46 | |
| *** saneax has joined #oooq | 16:48 | |
| *** udesale has quit IRC | 17:01 | |
| rfolco | akahat, I am going to test with this fix https://review.opendev.org/758214 | 17:02 |
| *** amoralej is now known as amoralej|off | 17:02 | |
| *** Trevor_V has joined #oooq | 17:02 | |
| *** TrevorV has quit IRC | 17:03 | |
| *** jmasud has joined #oooq | 17:04 | |
| akahat | rfolco, add port also. | 17:05 |
| rfolco | akahat, oops | 17:06 |
| rfolco | thx | 17:06 |
| *** jmasud has quit IRC | 17:09 | |
| *** rlandy|rover|brb is now known as rlandy|rover | 17:13 | |
| *** jpena is now known as jpena|off | 17:22 | |
| *** jmasud has joined #oooq | 17:28 | |
| rlandy|rover | weshay: 1-on-1? | 17:32 |
| weshay | aye | 17:32 |
| weshay | rlandy|rover, https://code.engineering.redhat.com/gerrit/215120 | 17:33 |
| weshay | rlandy|rover, https://gitlab.cee.redhat.com/whayutin/compare_rpm_set_between_builds | 17:37 |
| weshay | rlandy|rover, http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/jenkins-phase1-16.2_director-rhel-8.3-virthost-1cont_1comp_1ceph-ipv4-geneve-ceph-59/undercloud-0/var/log/extra/all_available_packages.txt.gz | 17:38 |
| *** Goneri has quit IRC | 17:45 | |
| *** Goneri has joined #oooq | 17:47 | |
| *** ykarel|away has joined #oooq | 17:48 | |
| rlandy|rover | weshay: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_04c/757875/2/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/04c2aa1/logs/158.69.65.5/etc/unbound/unbound.conf | 17:48 |
| weshay | rlandy|rover, https://www.redhat.com/sysadmin/forwarding-dns-2 | 17:49 |
| *** dsneddon has joined #oooq | 17:50 | |
| *** ykarel|away has quit IRC | 17:53 | |
| *** jmasud has quit IRC | 18:09 | |
| *** saneax has quit IRC | 18:39 | |
| rfolco | akahat, around? what you mean? https://review.opendev.org/#/c/757889/ | 18:44 |
| rlandy|rover | weshay; hey ... wrt 17 - I think you are right - we should promote the components | 19:29 |
| rlandy|rover | and then let the pipeline run | 19:30 |
| rlandy|rover | whatever is in component-ci-testing | 19:30 |
| *** Trevor_V has quit IRC | 19:30 | |
| rlandy|rover | weshay, in other news ... | 19:31 |
| *** TrevorV has joined #oooq | 19:31 | |
| rlandy|rover | periodic-tripleo-ci-centos-8-standalone-centos8stream-container-build-mastertestprojectmastercheck25325,491 hr 48 mins 39 secs2020-10-14 17:22:05SUCCESS | 19:31 |
| rlandy|rover | periodic-tripleo-ci-centos-8-standalone-centos8stream-mastertestprojectmastercheck25325,491 hr 19 mins 33 secs2020-10-14 17:21:43SUCCESS | 19:31 |
| weshay | sec | 19:33 |
| weshay | rlandy|rover, want to go over it? | 19:38 |
| weshay | OH.. look at STREAM | 19:38 |
| weshay | that's nice!! | 19:38 |
| rlandy|rover | weshay: 17? sure | 19:38 |
| rlandy|rover | weshay: pls vote on the related patch | 19:38 |
| *** fuzzball81 has quit IRC | 19:38 | |
| weshay | https://meet.google.com/asp-fumd-tso?authuser=1 | 19:39 |
| weshay | rlandy|rover, which patch? | 19:39 |
| rlandy|rover | https://review.opendev.org/#/c/758218/1 | 19:39 |
| *** fuzzball81 has joined #oooq | 19:40 | |
| *** jmasud has joined #oooq | 19:52 | |
| *** tosky has joined #oooq | 19:53 | |
| *** jmasud has quit IRC | 20:00 | |
| *** saneax has joined #oooq | 20:10 | |
| *** saneax has quit IRC | 20:14 | |
| *** jtomasek has quit IRC | 20:15 | |
| *** jbadiapa has quit IRC | 20:45 | |
| weshay | rlandy|rover, soniya29|ruck master is promoting.. thanks for your work there | 21:18 |
| rlandy|rover | weshay: yep - just don;t look at 17 :( | 21:19 |
| rlandy|rover | will deal with that tomorrow | 21:19 |
| rlandy|rover | queens is missing fs020 | 21:20 |
| rlandy|rover | rerrunning | 21:20 |
| *** jtomasek has joined #oooq | 21:24 | |
| *** jfrancoa has quit IRC | 21:26 | |
| *** rfolco has quit IRC | 21:38 | |
| *** rf0lc0 has joined #oooq | 21:38 | |
| rf0lc0 | weshay, replied your email, perhaps extend the question to sagi or marios | 21:44 |
| *** jtomasek has quit IRC | 21:46 | |
| weshay | ah k | 21:53 |
| *** rf0lc0 has quit IRC | 21:56 | |
| rlandy|rover | weshay: soniya29|ruck: how is this test running for stein if it's in the skip list? | 21:57 |
| rlandy|rover | https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L76 | 21:57 |
| rlandy|rover | https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-stein/c86251c/logs/undercloud/home/zuul/tempest/tempest.html.gz | 21:57 |
| rlandy|rover | see failure | 21:57 |
| rlandy|rover | what am I missing here? | 21:57 |
| *** chem has quit IRC | 21:58 | |
| rlandy|rover | https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/ | 21:58 |
| rlandy|rover | it's in the master and train lists as well | 21:58 |
| *** chem has joined #oooq | 22:00 | |
| *** rlandy|rover has quit IRC | 22:16 | |
| *** TrevorV has quit IRC | 22:45 | |
| *** tosky has quit IRC | 23:27 | |
| *** holser has quit IRC | 23:51 | |
| *** Goneri has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!