| *** tosky has quit IRC | 00:01 | |
| *** jmasud has quit IRC | 00:13 | |
| *** jmasud has joined #oooq | 00:22 | |
| *** jmasud has quit IRC | 00:23 | |
| *** jmasud has joined #oooq | 00:24 | |
| *** jmasud_ has joined #oooq | 00:41 | |
| *** jmasud_ has quit IRC | 00:43 | |
| *** jmasud has quit IRC | 00:43 | |
| *** jmasud has joined #oooq | 00:48 | |
| *** jmasud has quit IRC | 00:55 | |
| *** jmasud has joined #oooq | 01:21 | |
| *** saneax has quit IRC | 01:42 | |
| *** apetrich has quit IRC | 02:10 | |
| *** rlandy has quit IRC | 02:16 | |
| *** jmasud has quit IRC | 02:23 | |
| *** saneax has joined #oooq | 03:15 | |
| *** ratailor has joined #oooq | 04:14 | |
| *** ykarel|away is now known as ykarel | 04:24 | |
| *** ratailor has quit IRC | 04:27 | |
| *** ratailor has joined #oooq | 04:28 | |
| *** raukadah is now known as chandankumar | 04:36 | |
| *** skramaja has joined #oooq | 04:42 | |
| *** jmasud has joined #oooq | 04:44 | |
| *** udesale has joined #oooq | 05:04 | |
| *** jmasud has quit IRC | 05:11 | |
| *** jfrancoa has joined #oooq | 05:20 | |
| *** marios has joined #oooq | 05:33 | |
| *** ccamacho has joined #oooq | 05:34 | |
| *** jmasud has joined #oooq | 05:39 | |
| *** gkadam has joined #oooq | 05:40 | |
| *** gkadam has quit IRC | 05:40 | |
| *** ccamacho has quit IRC | 05:42 | |
| *** dpawlik has joined #oooq | 05:57 | |
| *** ccamacho has joined #oooq | 06:19 | |
| *** jmasud has quit IRC | 06:26 | |
| *** yolanda has joined #oooq | 06:33 | |
| *** ysandeep|away is now known as ysandeep | 06:39 | |
| *** apetrich has joined #oooq | 06:55 | |
| *** dmellado has quit IRC | 07:02 | |
| *** holser has joined #oooq | 07:14 | |
| *** tosky has joined #oooq | 07:30 | |
| *** jmasud has joined #oooq | 07:34 | |
| *** amoralej|off is now known as amoralej | 07:39 | |
| *** jpena|off is now known as jpena | 07:52 | |
| chandankumar | cgoncalves, Hello | 08:17 |
|---|---|---|
| chandankumar | cgoncalves, I am trying to run octavia nested kvm here https://review.rdoproject.org/r/#/c/27636/ | 08:18 |
| chandankumar | cgoncalves, here is the logs https://logserver.rdoproject.org/36/27636/2/check/periodic-tripleo-ci-centos-8-scenario011-standalone-master/2affe0a/ please verify it whether it is correct or not | 08:18 |
| zbr | bhagyashris|ruck: is broken sova job on ruck board? https://review.rdoproject.org/zuul/builds?job_name=sova-tracking-jobs | 08:29 |
| zbr | we need to do something about it | 08:29 |
| *** dmellado has joined #oooq | 08:34 | |
| *** derekh has joined #oooq | 08:35 | |
| *** jmasud has quit IRC | 08:39 | |
| *** jmasud has joined #oooq | 08:40 | |
| bhagyashris|ruck | zbr, ack | 08:50 |
| bhagyashris|ruck | let me check | 08:50 |
| bhagyashris|ruck | will look into it | 08:51 |
| *** ykarel is now known as ykarel|lunch | 08:57 | |
| *** chem has quit IRC | 09:09 | |
| *** chem has joined #oooq | 09:11 | |
| sshnaidm | bhagyashris|ruck, zbr need to delete this job, not required anymore | 09:17 |
| zbr | do drop sova? | 09:18 |
| sshnaidm | yes, everything is going to be in grafana | 09:19 |
| zbr | super! i like consolidation | 09:19 |
| zbr | sshnaidm: does this mean removal of sova role or only the tracking job for now? | 09:23 |
| sshnaidm | ony this particular job for now | 09:23 |
| bhagyashris|ruck | sshnaidm, ack | 09:26 |
| *** ysandeep is now known as ysandeep|lunch | 09:29 | |
| zbr | panda: chandankumar: https://review.rdoproject.org/r/#/c/27594/ please | 09:40 |
| marios | chandankumar: when you have 5 please https://code.engineering.redhat.com/gerrit/200927 | 09:49 |
| cgoncalves | chandankumar, ack. looking | 09:57 |
| cgoncalves | chandankumar, https://review.rdoproject.org/zuul/build/2affe0a8e5734cbc997f1bc679d13a6e/log/logs/undercloud/home/zuul/tempest.log.txt.gz#4 | 10:02 |
| cgoncalves | /home/zuul/tempest-setup.sh: line 26: /home/zuul/overcloudrc: No such file or directory | 10:02 |
| chandankumar | cgoncalves, that one I can fix that | 10:03 |
| chandankumar | cgoncalves, I am mainly concerned about the nested kvm stuff testing | 10:03 |
| cgoncalves | chandankumar, we need tempest to verify nested virt | 10:03 |
| cgoncalves | I can see that nova is set to use KVM | 10:04 |
| cgoncalves | https://review.rdoproject.org/zuul/build/2affe0a8e5734cbc997f1bc679d13a6e/log/logs/undercloud/var/lib/config-data/puppet-generated/nova_libvirt/etc/nova/nova.conf.txt.gz#2812 | 10:04 |
| chandankumar | cgoncalves, any specific test to run to verify that? | 10:06 |
| *** gthiemonge has joined #oooq | 10:08 | |
| *** ysandeep|lunch is now known as ysandeep | 10:09 | |
| cgoncalves | chandankumar, octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest.test_basic_traffic | 10:10 |
| zbr | panda: are you around? | 10:19 |
| chandankumar | cgoncalves, one more thing on queens fs038 after applying this one https://review.opendev.org/728797 ,https://logserver.rdoproject.org/87/27587/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset038-queens/63b3a32/logs/undercloud/home/zuul/tempest.log.txt.gz show_loadbalancer provisioning_status updated to an invalid state of ERROR | 10:20 |
| cgoncalves | chandankumar, looks like there isn't an amphora image in glance yet | 10:34 |
| cgoncalves | https://logserver.rdoproject.org/87/27587/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset038-queens/63b3a32/logs/subnode-1/var/log/containers/octavia/worker.log.txt.gz | 10:34 |
| cgoncalves | ComputeBuildException: Failed to build compute instance due to: No Glance images are tagged with amphora-image tag. | 10:34 |
| chandankumar | cgoncalves, oh I think i got the issue Download amphora image for octavia playbook is not called in fs038 | 10:39 |
| chandankumar | let me see how to enable that one | 10:40 |
| *** ykarel|lunch is now known as ykarel | 10:46 | |
| chandankumar | sshnaidm, Hello | 10:48 |
| chandankumar | sshnaidm, here https://logserver.rdoproject.org/87/27587/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset038-queens/63b3a32/job-output.txt | 10:48 |
| chandankumar | sshnaidm, [Download amphora image for octavia is getting skipped | 10:48 |
| zbr | today seems to be the WTF day, take a look at last two replies from zuul on https://review.rdoproject.org/r/#/c/27639/ | 10:49 |
| zbr | in-between only a recheck | 10:49 |
| chandankumar | sshnaidm, but I have defined required vars in fs https://review.opendev.org/728797 here https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/multinode-undercloud.yml#L88 | 10:50 |
| chandankumar | ah sorry I forgot to pass the extra tag octavia | 10:53 |
| sshnaidm | chandankumar, yeah, tags.. | 10:53 |
| chandankumar | marios, can I reuse this patch https://code.engineering.redhat.com/gerrit/#/c/197197/ for build test packages internal testing? | 10:59 |
| *** ysandeep is now known as ysandeep|brb | 11:00 | |
| marios | chandankumar: looking | 11:00 |
| marios | chandankumar: well we use that in containers | 11:01 |
| marios | chandankumar: can you create a new one? | 11:01 |
| marios | chandankumar: i mean there ./playbooks/tripleo-buildcontainers/pre_rhel8.yaml:135: - name: 'Patch tripleo-common https://code.engineering.redhat.com/gerrit/#/c/197197/' | 11:01 |
| chandankumar | marios, sure | 11:02 |
| *** jmasud has quit IRC | 11:04 | |
| *** jmasud has joined #oooq | 11:05 | |
| *** ysandeep|brb is now known as ysandeep | 11:13 | |
| *** jpena is now known as jpena|lunch | 11:30 | |
| *** jmasud has quit IRC | 11:32 | |
| chandankumar | cgoncalves, https://logserver.rdoproject.org/36/27636/3/check/periodic-tripleo-ci-centos-8-scenario011-standalone-master/38283de/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 11:34 |
| chandankumar | cgoncalves, test failed due to tempest.lib.exceptions.SSHTimeout: Connection to the 192.168.24.131 via SSH timed out. | 11:36 |
| chandankumar | in octavia and worker log https://logserver.rdoproject.org/36/27636/3/check/periodic-tripleo-ci-centos-8-scenario011-standalone-master/38283de/logs/undercloud/var/log/containers/octavia/ there is no error related to that | 11:38 |
| chandankumar | please have a look when free | 11:39 |
| zbr | panda: you know why we get 404 from /api-centos-master-uc/api/promotions was not found on this server. | 11:39 |
| panda | zbr: try /api-centos8-master-uc | 11:41 |
| *** sshnaidm is now known as sshnaidm|afk | 11:42 | |
| zbr | maybe I a not clear, unittests are broken: https://review.rdoproject.org/r/#/c/27639/ | 11:46 |
| zbr | unrelated to my change | 11:46 |
| zbr | and this happened in between two rechecks | 11:47 |
| zbr | rfolco|rover: weshay|ruck: FYI, reviving elastic-recheck is going to be bumpy, as I uncovered a log of infra work needed around it, but I am working with clarks. | 11:50 |
| zbr | mainly i need to drop py27 support but this requires redeploying in production with py3, and that part of infra is puppet stuff. | 11:51 |
| zbr | infra plans to migrate all puppet to ansible, but that is not fresh news, someone needs to do the leg work | 11:51 |
| rfolco|rover | bhagyashris|ruck, train failed criteria on fs030 and fs035 | 11:54 |
| zbr | panda: are you trying to raise a patch to fix py* jobs on ci-config? | 12:00 |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| weshay|ruck | zbr, well.. do as you wish. I am not asking for you to fix elastic recheck or improve it.. just to be core | 12:04 |
| rfolco|rover | chandankumar, weshay|ruck bhagyashris|ruck arxcruz: train failing fs020 on a tempest test: https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-train/fee88a5/logs/undercloud/var/log/tempest/stestr_results.html.gz | 12:06 |
| rfolco|rover | you know anything about it? | 12:06 |
| zbr | weshay|ruck: i bet I cannot become one without fixing it | 12:08 |
| weshay|ruck | zbr, have you asked? | 12:08 |
| zbr | yesterday | 12:09 |
| zbr | if you want i can explain over a meet | 12:09 |
| weshay|ruck | rfolco|rover, you have lolz https://bugs.launchpad.net/tripleo/+bug/1878248 | 12:10 |
| openstack | Launchpad bug 1878248 in tripleo "NetworkSecGroupTest failing on fs020 stein/train" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 12:10 |
| rfolco|rover | weshay|ruck, it should be on skip list | 12:10 |
| weshay|ruck | k | 12:11 |
| rfolco|rover | chandankumar, arxcruz: ^ https://review.opendev.org/#/c/727287/3/roles/validate-tempest/vars/tempest_skip_stein.yml | 12:13 |
| chandankumar | rfolco|rover, keep the test name to this neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest | 12:15 |
| chandankumar | test_multiple_ports_portrange_remote | 12:15 |
| rfolco|rover | chandankumar, replace 'neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest' w/ 'test_multiple_ports_portrange_remote' ? | 12:16 |
| rfolco|rover | shouldn't it skip all in that class/group of tests ? | 12:17 |
| chandankumar | replace 'neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest to neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest.test_multiple_ports_portrange_remote | 12:17 |
| chandankumar | neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest.test_multiple_ports_portrange_remote | 12:18 |
| *** rlandy has joined #oooq | 12:21 | |
| *** udesale_ has joined #oooq | 12:23 | |
| *** udesale has quit IRC | 12:25 | |
| *** jpena|lunch is now known as jpena | 12:26 | |
| akahat | arxcruz, chandankumar it is good to go: https://review.opendev.org/#/c/727975/, https://review.opendev.org/#/c/722919/ | 12:32 |
| cgoncalves | chandankumar, tempest test created a cirros VM but cannot connect to it via FIP. I wonder if this is https://bugzilla.redhat.com/show_bug.cgi?id=1829201 | 12:32 |
| openstack | bugzilla.redhat.com bug 1829201 in openstack-neutron "Cannot connect to IPv4/IPv6 dual-stack VM in ML2 OVS environment" [High,Modified] - Assigned to skaplons | 12:32 |
| rlandy | weshay|ruck: ysandeep: hello ... if you want to meet sometime, I can show you where things stand with baremetal | 12:42 |
| *** derekh has quit IRC | 12:42 | |
| ysandeep | rlandy, I am up.. whenever you guys decide.. | 12:43 |
| rlandy | ysandeep: ok - let's meet for a few because I have meeting afterwards | 12:44 |
| rlandy | will catch up with weshay|ruck in the afternoon | 12:44 |
| ysandeep | rlandy, ack | 12:45 |
| weshay|ruck | rlandy, I can join now if you want | 12:45 |
| weshay|ruck | just on program call | 12:45 |
| rlandy | ysandeep: weshay|ruck: https://meet.google.com/dtr-ywht-bne | 12:45 |
| *** Goneri has joined #oooq | 12:45 | |
| chandankumar | cgoncalves, as per review bug, https://review.opendev.org/#/c/725369/ is linked, it is used in the job as python3-neutron.noarch 1:16.1.0-0.20200516222418.be8cab9.el8 @delorean-component-network | 12:46 |
| chandankumar | not sure it is caused by this | 12:46 |
| chandankumar | net_mlx5: cannot load glue library: libibverbs.so.1: cannot open shared object file: No such file or directory | 12:46 |
| chandankumar | net_mlx5: cannot initialize PMD due to missing run-time dependency on rdma-core libraries (libibverbs, libmlx5) | 12:46 |
| chandankumar | PMD: net_mlx4: cannot load glue library: libibverbs.so.1: cannot open shared object file: No such file or directory | 12:46 |
| chandankumar | PMD: net_mlx4: cannot initialize PMD due to missing run-time dependency on rdma-core libraries (libibverbs, li | 12:46 |
| rfolco|rover | bhagyashris|ruck, I'll get a coffee and we sync ok? | 12:50 |
| bhagyashris|ruck | rfolco|rover, ack | 12:51 |
| *** sshnaidm|afk is now known as sshnaidm | 12:53 | |
| rfolco|rover | bhagyashris|ruck, https://meet.google.com/oiv-geho-mai | 12:55 |
| *** derekh has joined #oooq | 12:59 | |
| cgoncalves | chandankumar, those messages are harmless. I have been seeing them for ages in centos | 12:59 |
| cgoncalves | chandankumar, I will cross-check with the working job in openstack CI | 12:59 |
| chandankumar | cgoncalves, sure thanks :-) | 13:00 |
| weshay|ruck | chandankumar, ya.. those are in every job.. noise.. we got rid of it in one release but they came back | 13:05 |
| chandankumar | weshay|ruck, Do we have patch where it got fixed? | 13:09 |
| weshay|ruck | chandankumar, there is a bug on it.. in lp.. probably a few | 13:09 |
| chandankumar | ok | 13:09 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| rfolco|rover | https://review.opendev.org/729594 [skiplist] NetworkSecGroupTest timeout (train) | 13:16 |
| rfolco|rover | bhagyashris|ruck, weshay|ruck chandankumar arxcruz ^ | 13:16 |
| rfolco|rover | I'll do a pass on gate failures... when you have a time, please take a look at fs035 train, https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-train/0f657cb/logs/undercloud/var/log/ | 13:22 |
| rfolco|rover | bhagyashris|ruck, ^ | 13:22 |
| *** ratailor has quit IRC | 13:24 | |
| bhagyashris|ruck | rfolco|rover, ack | 13:39 |
| rfolco|rover | bhagyashris|ruck, thanks | 13:39 |
| chandankumar | rfolco|rover, sorry? | 13:40 |
| rfolco|rover | chandankumar, nevermind, we added to stein skip list and not train. that's why | 13:40 |
| chandankumar | aye sir | 13:41 |
| rfolco|rover | chandankumar, there are some failures on gate related to tempest tests... I am a bit clueless on what to do other than recheck | 13:41 |
| *** TrevorV has joined #oooq | 13:41 | |
| bhagyashris|ruck | weshay|ruck, hi, container build push on c8 train is failing so i fixed that partially, i need your suggestion for currentl failure | 13:42 |
| chandankumar | rfolco|rover, if it is the same issue, please file a bug and move it to skip side by side we can look into it | 13:42 |
| rfolco|rover | chandankumar, different ones, random | 13:43 |
| bhagyashris|ruck | weshay|ruck, here are more details https://hackmd.io/2MdkNAUuT7aBcM0Yck4xnw?both#May-20th | 13:43 |
| rfolco|rover | chandankumar, example https://0668011f33af6364883c-c555fae2d8c498523cc4b2c363541725.ssl.cf1.rackcdn.com/725623/1/gate/tripleo-ci-centos-7-standalone/6b78e1d/logs/undercloud/var/log/tempest/stestr_results.html | 13:44 |
| chandankumar | rfolco|rover, if it repeats let me know | 13:45 |
| rfolco|rover | chandankumar, I'll keep looking | 13:45 |
| rfolco|rover | thx | 13:45 |
| *** ykarel is now known as ykarel|afk | 13:46 | |
| marios | rlandy: ysandeep: chandankumar: fyi getting NODE_FAILURE on tripleo-ci-internal-jobs juts pinged rhos ops | 13:53 |
| *** ykarel|afk is now known as ykarel | 14:03 | |
| rlandy | marios: any progress on the node failures? | 14:25 |
| *** holser has quit IRC | 14:29 | |
| marios | rlandy: no failed again nhicher said he will check after his meeting | 14:30 |
| marios | rlandy: i am just rechecking now | 14:30 |
| chandankumar | marios, last time tobiko patch caused it | 14:32 |
| marios | chandankumar was working fine all day | 14:34 |
| marios | if the US can go back to sleep for couple morehours please k thanks | 14:34 |
| marios | chandankumar: I'd say about hour and half ago started going weird | 14:34 |
| chandankumar | marios, now it is ok? | 14:38 |
| marios | chandankumar: no jobs queued for 22 mins | 14:40 |
| marios | chandankumar: then they will fail at least that happened last 2/3 times | 14:40 |
| chandankumar | jpena, ^^ can you take a look on that | 14:40 |
| chandankumar | when free | 14:41 |
| chandankumar | marios, please https://review.opendev.org/#/c/728797/ +w it | 14:41 |
| chandankumar | jpena, sorry tristan is looking into that | 14:42 |
| weshay|ruck | bhagyashris|ruck, ceph-common rpm is not found eh? | 14:44 |
| marios | chandankumar: ack | 14:44 |
| weshay|ruck | bhagyashris|ruck, can you lean on ykarel or chandankumar re: packaging there? | 14:45 |
| bhagyashris|ruck | weshay|ruck, ok i will check with him... | 14:46 |
| chandankumar | is it container build train? | 14:46 |
| bhagyashris|ruck | chandankumar, yes | 14:46 |
| bhagyashris|ruck | container build train c8 | 14:46 |
| chandankumar | bhagyashris|ruck, we need to enable few repos tjere | 14:46 |
| chandankumar | weshay|ruck, https://review.opendev.org/#/c/721329/13/docker/base/Dockerfile.j2 | 14:47 |
| chandankumar | 'centos-release-nfs-ganesha28', | 14:47 |
| chandankumar | 'centos-release-openstack-train', | 14:47 |
| chandankumar | may be using tripleo-repos | 14:47 |
| chandankumar | https://opendev.org/openstack/tripleo-common/src/branch/master/container-images/tripleo_kolla_template_overrides.j2#L41 it is removed, can we enable it | 14:50 |
| chandankumar | bhagyashris|ruck, ^^ | 14:52 |
| *** holser has joined #oooq | 14:53 | |
| bhagyashris|ruck | chandankumar, ack | 14:54 |
| chandankumar | brb for an hour | 14:55 |
| weshay|ruck | rfolco|rover, bhagyashris|ruck AHHH.. the neutron project was also skipping the NetworkSecGroupPort tempest test :) | 15:02 |
| weshay|ruck | CIX call working :) | 15:02 |
| rfolco|rover | weshay|ruck, thx, pls help merge this one https://review.opendev.org/#/c/729594/ | 15:03 |
| rfolco|rover | chandankumar, bhagyashris|ruck ^ | 15:03 |
| *** EmilienM has joined #oooq | 15:05 | |
| EmilienM | hi folks | 15:06 |
| EmilienM | what is the RDO zuul job in our promotion pipeline which build && push containers into docker.io ? | 15:06 |
| EmilienM | I see tripleo-ci-base-singlenode-rdo-containers-build-push as the base layer | 15:07 |
| EmilienM | and then periodic-tripleo-centos-8-ussuri-containers-build-push | 15:07 |
| EmilienM | I guess that's this one | 15:07 |
| weshay|ruck | EmilienM, ur looking for the workflow.. that pushes containers to docker.io? | 15:08 |
| weshay|ruck | EmilienM, it's not a job, but a service that runs http://promoter.rdoproject.org/ we can get you access | 15:08 |
| weshay|ruck | and I can point at the code | 15:09 |
| weshay|ruck | panda, ^ | 15:09 |
| *** skramaja has quit IRC | 15:09 | |
| EmilienM | I'm basically looking at duplicating the existing job to build container images with our new tooling that Kevin and I are doing | 15:09 |
| weshay|ruck | https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/dlrnapi_promoter | 15:09 |
| weshay|ruck | EmilienM, right.. so you don't need to adjust the code that pushes the containers to docker.io | 15:10 |
| weshay|ruck | we just want to flip the job from kolla to tripleo bulider | 15:10 |
| EmilienM | I don't want to flip in the existing job | 15:10 |
| weshay|ruck | the end result is the same... contianers in rdo-registry that are then promoted | 15:10 |
| weshay|ruck | EmilienM, we can just start w/ a voting check job in upstream | 15:10 |
| weshay|ruck | and we'll work it into the promotion lines | 15:10 |
| weshay|ruck | EmilienM, so just continue as you were by getting a proper upstream job | 15:11 |
| weshay|ruck | that's all that's needed.. we'll take that job.. inherit from that in rdo... and use it in the promtion lines | 15:11 |
| weshay|ruck | sound ok? | 15:11 |
| EmilienM | right but i'm interested by the push aspect of things | 15:12 |
| EmilienM | I want to see the code that pushes the container images into the registry | 15:12 |
| EmilienM | that job is building, i want to see where we run the push | 15:12 |
| weshay|ruck | k.. so let me shed light | 15:12 |
| EmilienM | BTW the correct answer will be to use our tooling to push the images | 15:13 |
| EmilienM | and not do any manual buildah/podman push commands | 15:13 |
| weshay|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-centos-8-master-containers-build-push | 15:13 |
| weshay|ruck | EmilienM, it's the same as the upstream check build containers job.. w/ an extra zuul post playbook to push | 15:13 |
| EmilienM | ok | 15:13 |
| * EmilienM reading the job | 15:14 | |
| weshay|ruck | EmilienM, 2020-05-20 09:01:00.323246 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base/containers-push-podman-login-push.yaml@master] | 15:14 |
| EmilienM | yeah that's my point | 15:14 |
| EmilienM | we don't use the tooling correctly, even for the kolla containers :/ | 15:14 |
| EmilienM | openstack overcloud container image build has the ability to push images, we don't use it | 15:15 |
| weshay|ruck | EmilienM, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/containers-push-podman-login-push.yaml | 15:15 |
| EmilienM | in the new tooling, i want to make it a requirement that we use the same command to build and push the images, if possible | 15:15 |
| EmilienM | so that: | 15:15 |
| EmilienM | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/containers-push-podman-login-push.yaml | 15:15 |
| EmilienM | is wrong | 15:15 |
| EmilienM | it's a re-implementation (again) of what tripleoclient does | 15:15 |
| weshay|ruck | k k.. we can use tripleo-common I *thin* panda ? | 15:16 |
| EmilienM | I'll repeat: tripleo can already push container images for you | 15:16 |
| ykarel | bhagyashris|ruck, which packaging changes? | 15:16 |
| EmilienM | i don't know why you re-wrote that part.. | 15:16 |
| weshay|ruck | EmilienM, I heard you the first time | 15:16 |
| EmilienM | anyway, for the new thing I don't want this playbook | 15:16 |
| weshay|ruck | k... /me notes that.. Let's chat w/ panda about this.. so he's in the loop | 15:17 |
| bhagyashris|ruck | ykarel, here https://logserver.rdoproject.org/34/27634/4/check/periodic-tripleo-centos-8-train-containers-build-push/b8bf039/logs/buildah-builds/kolla-builds/aed6abec-8abe-4cbd-883d-a26ed33d44a6/docker/cinder/cinder-base/cinder-base-build.log | 15:17 |
| EmilienM | it brings too much overhead and there is no need to maintain this playbook | 15:17 |
| bhagyashris|ruck | ceph-common is not present | 15:17 |
| ykarel | bhagyashris|ruck, so you need ceph repos to setup there | 15:17 |
| bhagyashris|ruck | ykarel, and that's causing job failure | 15:17 |
| panda | weshay|ruck: EmilienM can we set a meeting for this ? | 15:18 |
| ykarel | bhagyashris|ruck, in kolla it's being picked by centos-release-openstack-train, but in tripleo we skip that rpm to use delorean builds | 15:18 |
| EmilienM | panda: sure let me know when you're available | 15:19 |
| bhagyashris|ruck | ykarel, ok. how can we do that? here i have added https://review.opendev.org/#/c/729519/4/container-images/tripleo_kolla_template_overrides.j2@60 | 15:19 |
| bhagyashris|ruck | ykarel, 'centos-release-nfs-ganesha28' is that correct ? | 15:19 |
| ykarel | bhagyashris|ruck, no that will not help, ^^ is nfs, you need ceph | 15:20 |
| ykarel | and fortunately that rpm is not published yet | 15:20 |
| EmilienM | panda: are you available now? | 15:21 |
| ykarel | centos-release-ceph-nautilus | 15:21 |
| EmilienM | I see chandankumar created containers-push-podman-login-push.yaml | 15:22 |
| EmilienM | can I know why you didn't re-use the tripleoclient to push the containers? | 15:22 |
| bhagyashris|ruck | ykarel, ohh any plan when those will be published | 15:22 |
| ykarel | bhagyashris|ruck, gfidente was working on it, i don't know ETA | 15:23 |
| EmilienM | panda: let me know when you're free and Kevin / I can meet to present you about the new tooling if you missed that in the all hands | 15:23 |
| weshay|ruck | EmilienM, he was following the patten set in https://github.com/rdo-infra/review.rdoproject.org-config/blame/master/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml | 15:24 |
| pojadhav | rlandy, did some minor changes to https://review.opendev.org/#/c/729601/ and testing the changes at https://review.rdoproject.org/r/#/c/27642/ | 15:24 |
| bhagyashris|ruck | ykarel, yeah thats what i was searching .... so adding 'centos-release-ceph-nautilus' and 'centos-release-qemu-ev' at https://review.opendev.org/#/c/729519/4/container-images/tripleo_kolla_template_overrides.j2@60 will help? | 15:24 |
| pojadhav | rlandy, lets see how it goes :) | 15:24 |
| EmilienM | weshay|ruck: right; i just find it odd we write playbooks in RDO infra repos; while these things can alraedy be done with existing tooling in TripleO... | 15:24 |
| ykarel | bhagyashris|ruck, the rpm doesn't exist, so adding in kolla_template_override will not help | 15:25 |
| *** holser has quit IRC | 15:25 | |
| bhagyashris|ruck | ykarel, ok. | 15:25 |
| ykarel | bhagyashris|ruck, the rpm needs to exist at http://mirror.centos.org/centos/8/extras/x86_64/os/Packages/ , which doesn't exist yet | 15:25 |
| EmilienM | weshay|ruck: take a look at https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/container_image.py#L233 | 15:26 |
| pojadhav | rlandy, what will be final decision for gating the jobs ( need to create new template or need to add in scenarios-full) ?? | 15:26 |
| weshay|ruck | EmilienM, true.. just let's get context first.. EmilienM We spent A LOT OF TIME reusing some calls from container registry and other roles w/ logins | 15:26 |
| EmilienM | this can push containers into registries | 15:26 |
| pojadhav | rlandy, need just confirmation :) | 15:26 |
| bhagyashris|ruck | ykarel, i see... | 15:26 |
| weshay|ruck | EmilienM, that too be honest was NOT easy to work into CI.. as to not not duplicate stuff | 15:26 |
| *** pojadhav is now known as pojadhav|dinner | 15:26 | |
| EmilienM | whatever | 15:26 |
| EmilienM | in the new thing we won't do it :D | 15:27 |
| weshay|ruck | ok.. let's make sure we can.. no one here is saying NO | 15:27 |
| EmilienM | once panda is ready for a meeting, I'll discuss the reqs on your side to build && push and i'll write the job myself | 15:27 |
| EmilienM | which is basically what was done in https://review.opendev.org/#/c/724193/ except it'll push the containers into a registries, given some credentials | 15:28 |
| ykarel | EmilienM, iirc that extra podman playbook was added as at that time rhel had too old podman ^ and push didn't used to work | 15:28 |
| ykarel | but now the story changed so can be cleaned up | 15:28 |
| *** holser has joined #oooq | 15:29 | |
| EmilienM | ykarel: I see | 15:29 |
| EmilienM | ykarel: beside registry login, what's needed between build && push? | 15:30 |
| ykarel | push_containers: true | 15:30 |
| EmilienM | ykarel: no I mean, without these RDO playbooks | 15:31 |
| EmilienM | for example, I found out that you use registry token | 15:31 |
| EmilienM | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/push.yaml#L9 | 15:31 |
| EmilienM | so that's a req, we need to address that in the BuildahBuilder code in tripleo-common | 15:31 |
| EmilienM | to take a user/token used when pushing images | 15:31 |
| EmilienM | I'm asking what do you folks need after "openstack tripleo container image build" command to push the images where you need to | 15:32 |
| EmilienM | 1) login, 2) ... etc | 15:32 |
| weshay|ruck | EmilienM, tagging | 15:32 |
| EmilienM | ok tagging. /me looks at playbook | 15:32 |
| EmilienM | i'm not sure why we retag the local image before the push | 15:33 |
| panda | EmilienM: because remote tagging requires access to the API, and we're not there yet. | 15:35 |
| weshay|ruck | chandankumar, you got a sec? | 15:35 |
| weshay|ruck | - project: ironicclient | 15:35 |
| weshay|ruck | tags: | 15:35 |
| weshay|ruck | ussuri: | 15:35 |
| weshay|ruck | source-branch: 4.1.0 | 15:35 |
| weshay|ruck | chandankumar, https://github.com/redhat-openstack/rdoinfo/blob/master/tags/ussuri.yml#L240-L243 | 15:35 |
| weshay|ruck | or ykarel if we wanted to test head of the ironic client w/ a ussuri ovb job. | 15:36 |
| weshay|ruck | by removing the tag in a review | 15:36 |
| weshay|ruck | can we do that? | 15:36 |
| EmilienM | panda: what do you mean remote tagging? If i build my image localy with tag "foo", I can push myimage:foo to docker://quay.io/tripleo/myimage:foo directly without retagging, no? | 15:36 |
| EmilienM | with buildah push | 15:36 |
| EmilienM | (that's what I'm doing when building images on https://quay.io/organization/tripleomaster/ | 15:37 |
| panda | EmilienM: if the tag is the same, of course, if you need to add another tag you have to retag the image locally | 15:37 |
| EmilienM | you mean that "buildah push --tls-verify=False quay.io/tripleomaster/newtag:newtag docker://quay.io/tripleomaster/foo:newtag" does not work? | 15:39 |
| EmilienM | if docker://quay.io/tripleomaster/foo:newtag doesn't exist? | 15:39 |
| panda | EmilienM: docker push doesn't. I suspect builda puh doesn't either. | 15:40 |
| EmilienM | ok let me try | 15:40 |
| panda | EmilienM: because it would not know which source image to push | 15:40 |
| panda | EmilienM: would be like git review without commit | 15:41 |
| bhagyashris|ruck | ykarel, any other solution to over come this issue | 15:41 |
| EmilienM | panda: i'm not sure I follow, let me show you what the BuildahBUilder does : | 15:42 |
| ykarel | weshay|ruck, you can try a dnm patch in ironicclient stable/ussuri, and add depends-on on it in testproject stable/ussuri branch | 15:42 |
| weshay|ruck | sshnaidm, ^ | 15:42 |
| EmilienM | panda: http://paste.openstack.org/show/793815/ | 15:42 |
| EmilienM | panda: it only runs buildah bud, then buildah push | 15:43 |
| EmilienM | https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L142 | 15:43 |
| EmilienM | https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L171 | 15:43 |
| panda | EmilienM: I can chat , not sure if weshay|ruck wants to be present | 15:46 |
| sshnaidm | weshay|ruck, maybe inspector server, it shuts down | 15:46 |
| EmilienM | panda: https://meet.google.com/ymu-nfrm-vzr | 15:46 |
| ykarel | bhagyashris|ruck, until the rpm exist, u can try adding the repo manually in base_footer https://review.opendev.org/#/c/729519/4/container-images/tripleo_kolla_template_overrides.j2@459 | 15:46 |
| weshay|ruck | panda, yes | 15:47 |
| bhagyashris|ruck | ykarel, ok | 15:52 |
| *** bogdando has joined #oooq | 15:57 | |
| bogdando | o/ PTAL https://review.opendev.org/#/c/729640/ | 15:57 |
| bogdando | not sure how is this tested and where, but this unblocks libvirt zuul reproducer at least for me :) | 15:57 |
| *** marios is now known as marios|out | 15:58 | |
| *** marios|out has quit IRC | 15:58 | |
| bogdando | other thing is https://github.com/rdo-infra/ansible-role-tripleo-ci-reproducer/blob/d141adebd9a27faf514f14f9b60a2b95ed37b5fe/tasks/libvirt/prepare.yaml#L32 why on earth do we install it? | 15:58 |
| chandankumar | sshnaidm, from which release openstack ansible collection is supported? | 15:59 |
| chandankumar | sshnaidm, os_tempest is receiving ansible collection patches https://review.opendev.org/718639 | 15:59 |
| bogdando | (removing that queens leftovers from master unblocks me a tiny step ahead) | 16:02 |
| sshnaidm | chandankumar, they test it with latest release from yesterday | 16:05 |
| sshnaidm | chandankumar, it's not really "supported" yet | 16:05 |
| chandankumar | sshnaidm, then it will break our jobs then | 16:06 |
| chandankumar | from train onwards | 16:06 |
| bogdando | https://review.rdoproject.org/r/#/c/27643/ | 16:06 |
| sshnaidm | chandankumar, why will break? | 16:06 |
| weshay|ruck | ysandeep, can you make sure this job https://zuul.openstack.org/job/tripleo-ci-centos-8-standalone-on-multinode-ipa | 16:07 |
| weshay|ruck | is in the ussuri / master upstream component pipelines and gets into the internal compnent pipeline? | 16:07 |
| chandankumar | sshnaidm, since it is not supported so saying it might break os_tempest jobs | 16:07 |
| sshnaidm | chandankumar, what do you mean by "supported"? | 16:08 |
| chandankumar | I mean openstack ansible collections is not support | 16:08 |
| chandankumar | *supported | 16:08 |
| ysandeep | weshay|ruck, sure will add in my internal pipeline list.. Will check for upstream too. | 16:08 |
| *** bogdando has left #oooq | 16:08 | |
| chandankumar | or I missed read this <sshnaidm> chandankumar, it's not really "supported" yet . | 16:09 |
| sshnaidm | chandankumar, define "supported" | 16:09 |
| rlandy | pojadhav|dinner: new templates | 16:09 |
| sshnaidm | chandankumar, os-tempest isn't supported from my view as well | 16:09 |
| chandankumar | supported means it should work with ansible-2.9 which is used in ci | 16:10 |
| sshnaidm | chandankumar, it does | 16:10 |
| sshnaidm | not sure about 2.8, but should | 16:10 |
| chandankumar | sshnaidm, ok then it will work , I will test the above patch with train and comment back | 16:11 |
| weshay|ruck | ysandeep, thanks! rlandy pojadhav|dinner fyi ^ | 16:11 |
| sshnaidm | chandankumar, and why train? do they backport it to train? | 16:11 |
| chandankumar | sshnaidm, we run os_tempest from master in our ci | 16:11 |
| chandankumar | not from branched one | 16:12 |
| sshnaidm | chandankumar, we run the same ansible version in our ci for all branches | 16:12 |
| sshnaidm | chandankumar, I'm not sure I understand what it the problem with train | 16:12 |
| weshay|ruck | panda, before we drop let's explain to Emilien about quay performance | 16:12 |
| sshnaidm | yesterday was the whole day of quay performance.. | 16:13 |
| EmilienM | lol | 16:14 |
| *** pojadhav|dinner is now known as pojadhav | 16:14 | |
| ysandeep | weshay|ruck, For internal component pipeline - even though I have posted review for almost every stanalone scenario - Now we are starting with one and so far we were struggling with some standalone ceph containers and once we are over them.. I will need some review on design of parenting of the job - https://hackmd.io/sMAvQmxCTnC6FLSa_4oycg?both#Rework-parenting | 16:16 |
| chandankumar | sshnaidm, does openstack ansible collection going to be branchless? | 16:16 |
| weshay|ruck | k | 16:16 |
| sshnaidm | chandankumar, yes | 16:16 |
| sshnaidm | chandankumar, it will have release though | 16:17 |
| sshnaidm | *releases | 16:17 |
| chandankumar | ok then I think it will work with train, thanks! | 16:18 |
| ysandeep | weshay|ruck, please feel free to check https://hackmd.io/sMAvQmxCTnC6FLSa_4oycg?both#Rework-parenting whenever time permits , I will be happy to have more eyes. | 16:18 |
| sshnaidm | chandankumar, shouldn't be any train specific problem.. | 16:18 |
| sshnaidm | chandankumar, collections work even with queens | 16:19 |
| *** ykarel is now known as ykarel|away | 16:23 | |
| *** jmasud has joined #oooq | 16:24 | |
| *** ysandeep is now known as ysandeep|afk | 16:42 | |
| *** jmasud has quit IRC | 17:00 | |
| rlandy | oh man, did we upset the infra gods? | 17:00 |
| rlandy | what's up with all our clouds? | 17:00 |
| *** udesale_ has quit IRC | 17:07 | |
| *** jmasud has joined #oooq | 17:08 | |
| *** amoralej is now known as amoralej|off | 17:10 | |
| pojadhav | rlandy, ok | 17:10 |
| *** derekh has quit IRC | 17:11 | |
| *** holser has quit IRC | 17:12 | |
| *** dpawlik has quit IRC | 17:15 | |
| *** jpena is now known as jpena|off | 17:15 | |
| *** holser has joined #oooq | 17:19 | |
| *** ysandeep|afk is now known as ysandeep | 17:22 | |
| *** holser has quit IRC | 17:22 | |
| *** holser has joined #oooq | 17:23 | |
| weshay|ruck | rlandy, we think we have a fix on introspection | 17:47 |
| weshay|ruck | rlandy, sshnaidm in fact it did fix it :) | 17:48 |
| chandankumar | weshay|ruck, what was the fix? | 17:48 |
| ysandeep | weshay|ruck, fix | 17:48 |
| ysandeep | ? | 17:48 |
| weshay|ruck | chandankumar, ysandeep packaging fixed it.. ykarel|away updated something.. sshnaidm would have details bug is here.. https://bugs.launchpad.net/tripleo/+bug/1879577 | 17:50 |
| openstack | Launchpad bug 1879577 in tripleo "Ussuri ovb deployment hangs in introspection step. " [Critical,Triaged] | 17:50 |
| weshay|ruck | chandankumar, new bug on the deployment though | 17:50 |
| weshay|ruck | might be the same as master | 17:50 |
| chandankumar | https://review.opendev.org/#/c/724822/ | 17:51 |
| chandankumar | we added construct bump few days back in master by yatin | 17:52 |
| chandankumar | ykarel++ | 17:53 |
| chandankumar | sshnaidm++ | 17:53 |
| ysandeep | weshay|ruck, ohh great! | 17:53 |
| chandankumar | weshay|ruck, new bug is introspection or something else? | 17:54 |
| weshay|ruck | chandankumar, hasn't been written up yet.. | 17:54 |
| weshay|ruck | sec | 17:54 |
| chandankumar | aye | 17:56 |
| chandankumar | weshay|ruck, we got two fixes for downstream dlrn build issue https://softwarefactory-project.io/r/#/c/18410/ and https://softwarefactory-project.io/r/18408 | 17:57 |
| chandankumar | may be tomorrow we will be able to test changes downstream | 17:57 |
| rlandy | weshay|ruck: nice | 17:57 |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/27558/ when free | 17:59 |
| weshay|ruck | chandankumar, latest issue https://bugs.launchpad.net/tripleo/+bug/1879766 | 18:01 |
| openstack | Launchpad bug 1879766 in tripleo "master ovb jobs failing on Destination directory /etc/pki/tls/private does not exis" [Critical,Triaged] | 18:01 |
| rlandy | chandankumar: looks good | 18:01 |
| *** jmasud has quit IRC | 18:04 | |
| chandankumar | weshay|ruck, will take a look tomorrow | 18:06 |
| chandankumar | see ya | 18:06 |
| *** chandankumar is now known as raukadah | 18:06 | |
| rfolco|rover | weshay|ruck, master image build https://bugs.launchpad.net/tripleo/+bug/1879767 | 18:10 |
| openstack | Launchpad bug 1879767 in tripleo "master image build failed to install ansible" [Critical,Triaged] | 18:10 |
| *** ysandeep is now known as ysandeep|away | 18:10 | |
| *** holser_ has joined #oooq | 18:30 | |
| *** holser has quit IRC | 18:30 | |
| *** holser_ has quit IRC | 18:40 | |
| *** holser has joined #oooq | 18:40 | |
| raukadah | rlandy, weshay|ruck sshnaidm please take some time to review this patch https://review.opendev.org/727200 a big change for downstream | 18:42 |
| raukadah | once jpena|off dlrn patches merges we are good to go | 18:42 |
| weshay|ruck | raukadah, do you have a sec to chat w/ sshnaidm re: missing files | 18:42 |
| weshay|ruck | in images | 18:42 |
| raukadah | It opens a new door | 18:43 |
| raukadah | weshay|ruck, right now gmeet> | 18:43 |
| raukadah | weshay|ruck, sshnaidm https://review.opendev.org/727200 | 18:44 |
| raukadah | weshay|ruck, sshnaidm https://meet.google.com/zqm-xkyn-rkx?pli=1&authuser=0 | 18:44 |
| weshay|ruck | I'll be there in a sec | 18:44 |
| raukadah | weshay|ruck, sshnaidm https://review.opendev.org/#/c/718946/ | 18:48 |
| raukadah | weshay|ruck, rlandy sshnaidm https://review.opendev.org/#/c/727200/ | 19:07 |
| *** jmasud has joined #oooq | 19:08 | |
| rlandy | why the -2 on https://review.opendev.org/#/c/727200/? | 19:10 |
| rlandy | weshay|ruck: raukadah: ^^ still stands? | 19:11 |
| weshay|ruck | rlandy, take a closer look | 19:11 |
| weshay|ruck | at the patch | 19:11 |
| raukadah | rlandy, I am still alive taking with sshnaidm and weshay|ruck | 19:11 |
| rlandy | raukadah: well I'm happy you're still alive | 19:13 |
| raukadah | rlandy, hehe | 19:13 |
| *** jmasud has quit IRC | 19:23 | |
| *** jmasud has joined #oooq | 19:29 | |
| *** jfrancoa has quit IRC | 19:32 | |
| weshay|ruck | rfolco|rover, closed that overcloud bug | 19:46 |
| rfolco|rover | weshay|ruck, and why it failed if the rpm is there | 19:48 |
| weshay|ruck | rfolco|rover, that's ur job :) | 19:48 |
| rfolco|rover | how nice | 19:49 |
| weshay|ruck | rfolco|rover, if you want we can chat about it | 19:49 |
| weshay|ruck | but you won't like what you hear | 19:50 |
| rfolco|rover | how news | 19:50 |
| weshay|ruck | rfolco|rover, ? | 19:51 |
| rlandy | weshay|ruck: holy cow!!!!! PXE boot | 20:02 |
| weshay|ruck | NICE | 20:02 |
| weshay|ruck | so you are on overcloud deploy? | 20:03 |
| *** jmasud has quit IRC | 20:04 | |
| rlandy | Successfully provided nodes: ['3330397d-5d92-4806-9c72-9ad0f9e7dcb3', 'ef4e1a54-4a8d-4950-b9ae-e7cf2e5781c1', 'c06d6c33-48a5-4478-b360-73e1d671f072', 'b82ab942-0d08-4074-8311-590bdeeb9c3a'] | 20:05 |
| rlandy | weshay|ruck: introspection passed | 20:05 |
| weshay|ruck | rlandy, GREAT!! this is which release? | 20:05 |
| rlandy | weshay|ruck: ussuri | 20:05 |
| weshay|ruck | NICE | 20:05 |
| rlandy | overcloud deploy starting now | 20:05 |
| rlandy | OMG | 20:06 |
| rlandy | now I just need to figure out which of these hacks actually worked | 20:06 |
| weshay|ruck | k k.. /me notes new bug | 20:07 |
| weshay|ruck | rlandy, debugging it now https://bugs.launchpad.net/tripleo/+bug/1879766 | 20:07 |
| openstack | Launchpad bug 1879766 in tripleo "master ovb jobs failing on Destination directory /etc/pki/tls/private does not exis" [Critical,Triaged] | 20:07 |
| *** jmasud has joined #oooq | 20:08 | |
| rlandy | weshay|ruck: it's on provision instances atm | 20:08 |
| rlandy | almost there | 20:08 |
| rlandy | and then you can have the box to work on | 20:08 |
| weshay|ruck | :) | 20:09 |
| weshay|ruck | rlandy, no prob.. will be great to have one potentially.. we're on a timer w/ ovb | 20:10 |
| rlandy | weshay|ruck: this has been months in working PXE out | 20:10 |
| weshay|ruck | rlandy, I have the last_promotions working internally now.. things look normal | 20:10 |
| rlandy | the new normal | 20:10 |
| weshay|ruck | re: promotions | 20:10 |
| weshay|ruck | ya.. not life | 20:10 |
| rlandy | I owe Tengu a beer | 20:11 |
| rlandy | weshay|ruck: you need master as well? | 20:11 |
| weshay|ruck | rlandy, ya.. so interested in hearing about the fix | 20:11 |
| weshay|ruck | rlandy, pretty much the same release atm.. | 20:12 |
| weshay|ruck | ussuri should be fine | 20:12 |
| weshay|ruck | rlandy, when you have a sec https://review.rdoproject.org/r/#/c/27608/ | 20:12 |
| rlandy | weshay|ruck: well did a lot of things. Not sure which one worked :) | 20:12 |
| *** jmasud has quit IRC | 20:12 | |
| weshay|ruck | rlandy, luckily you guys have 5 more environments to perfect it with :) | 20:12 |
| rlandy | weshay|ruck: so it's definitely firewalld | 20:14 |
| weshay|ruck | ah geez | 20:14 |
| rlandy | added dhcp etc. to the public zone and then open some ports | 20:14 |
| rlandy | a lot of them | 20:14 |
| rlandy | I got desperate | 20:14 |
| weshay|ruck | adding ports? | 20:15 |
| rlandy | to firewalld libvirt zone | 20:15 |
| weshay|ruck | roger | 20:15 |
| rlandy | it could be we just needed dhcp and friends on the public zone as well | 20:15 |
| rlandy | weshay|ruck: ok - need the undercloud to debug? | 20:17 |
| rlandy | I'm going to look at scenario tests again while it runs | 20:17 |
| rlandy | all yours | 20:17 |
| weshay|ruck | sshnaidm, fyi.. rlandy has a baremetal for us too if needed.. coming up | 20:17 |
| rlandy | weshay|ruck: sshnaidm: env D - overcloud deploy is running now | 20:18 |
| *** ccamacho has quit IRC | 20:25 | |
| *** rlandy is now known as rlandy|biab | 20:32 | |
| weshay|ruck | rlandy|biab, think you must have docker specificied in your config somewhere 2020-05-20 20:39:27 | stderr: '/bin/sh: docker: command not found' | 20:57 |
| weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/70/200870/2/check/periodic-tripleo-ci-centos-8-bm_envD-3ctlr_1comp-featureset001-ussuri/d7f4ded/logs/undercloud/home/zuul/overcloud_deploy.log | 20:57 |
| *** rlandy|biab is now known as rlandy | 20:59 | |
| rlandy | checking | 20:59 |
| rlandy | weshay|ruck: you on the bm? | 21:00 |
| weshay|ruck | rlandy, ya | 21:01 |
| weshay|ruck | that deployment failed because it tried to use docker | 21:01 |
| rlandy | weshay|ruck: checking the env settings | 21:02 |
| rlandy | there may be an old setting there | 21:02 |
| *** rfolco|rover is now known as rfolco|rover|off | 21:04 | |
| weshay|ruck | rlandy, internal promotions :) http://tripleo-cockpit.usersys.redhat.com/d/Wj-ao_sWz/full-component-pipeline?orgId=1 | 21:32 |
| rlandy | weshay|ruck, very nice | 21:33 |
| *** holser has quit IRC | 21:43 | |
| *** Goneri has quit IRC | 22:06 | |
| *** TrevorV has quit IRC | 22:35 | |
| *** jmasud has joined #oooq | 22:52 | |
| *** jmasud has quit IRC | 23:03 | |
| *** jmasud has joined #oooq | 23:05 | |
| *** jmasud has quit IRC | 23:09 | |
| *** tosky has quit IRC | 23:48 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!