| *** chem_ has quit IRC | 00:05 | |
| *** ysandeep has joined #oooq | 00:06 | |
| *** chem_ has joined #oooq | 00:07 | |
| *** holser has quit IRC | 00:07 | |
| *** dsneddon has joined #oooq | 00:13 | |
| *** dsneddon has quit IRC | 00:19 | |
| *** ysandeep has quit IRC | 00:29 | |
| *** dsneddon has joined #oooq | 00:41 | |
| *** dsneddon has quit IRC | 00:50 | |
| *** rlandy|bbl is now known as rlandy | 00:58 | |
| rlandy | rfolco|bbl++ looks like it's working now | 01:03 |
|---|---|---|
| *** ysandeep has joined #oooq | 01:22 | |
| *** dsneddon has joined #oooq | 01:36 | |
| *** dsneddon has quit IRC | 01:41 | |
| rlandy | rfolco|bbl: https://review.rdoproject.org/r/#/c/24207/ | 02:03 |
| rfolco|bbl | \o/ | 02:03 |
| rlandy | rfolco|bbl: I'm not merging ^^ tonight. will merge it tomorrow when I can watch for damage | 02:06 |
| rfolco|bbl | rlandy, I am leaving comments | 02:06 |
| rlandy | tenant looks aok after upgrade | 02:07 |
| rlandy | I'm out | 02:08 |
| *** rlandy has quit IRC | 02:08 | |
| *** dsneddon has joined #oooq | 02:15 | |
| *** dsneddon has quit IRC | 02:20 | |
| *** Goneri has quit IRC | 02:21 | |
| *** dsneddon has joined #oooq | 02:30 | |
| *** dsneddon has quit IRC | 02:35 | |
| *** rfolco|bbl has quit IRC | 02:46 | |
| *** dsneddon has joined #oooq | 02:47 | |
| *** dsneddon has quit IRC | 02:52 | |
| *** dsneddon has joined #oooq | 02:56 | |
| *** dsneddon has quit IRC | 03:01 | |
| *** apetrich has quit IRC | 03:09 | |
| *** dsneddon has joined #oooq | 03:32 | |
| *** dsneddon has quit IRC | 03:44 | |
| *** ykarel|away has joined #oooq | 03:46 | |
| *** dsneddon has joined #oooq | 04:01 | |
| *** dsneddon has quit IRC | 04:06 | |
| *** dsneddon has joined #oooq | 04:10 | |
| *** dsneddon has quit IRC | 04:15 | |
| *** epoojad1 has joined #oooq | 04:26 | |
| *** epoojad1 has left #oooq | 04:26 | |
| *** epoojad1 has joined #oooq | 04:26 | |
| *** ykarel|away has quit IRC | 04:32 | |
| *** dsneddon has joined #oooq | 04:42 | |
| *** dsneddon has quit IRC | 04:49 | |
| *** ykarel|away has joined #oooq | 04:52 | |
| *** ykarel|away is now known as ykarel | 04:53 | |
| *** dsneddon has joined #oooq | 04:56 | |
| *** dsneddon has quit IRC | 05:01 | |
| *** dsneddon has joined #oooq | 05:23 | |
| *** dsneddon has quit IRC | 05:24 | |
| *** dsneddon has joined #oooq | 05:25 | |
| *** soniya29 has joined #oooq | 05:31 | |
| *** raukadah is now known as chkumar|rover | 05:33 | |
| *** marios|ruck has joined #oooq | 06:04 | |
| *** epoojad1 has quit IRC | 06:14 | |
| marios|ruck | chkumar|rover: looks ok lets try a recheck https://review.rdoproject.org/r/#/c/23919/ | 06:20 |
| chkumar|rover | marios|ruck: yes done | 06:21 |
| *** holser has joined #oooq | 06:22 | |
| marios|ruck | chkumar|rover: hmm not sure we need that one any more then https://review.opendev.org/#/c/698883/ going to remove from depends-on and try again | 06:25 |
| chkumar|rover | marios|ruck: ok, let's try that | 06:26 |
| *** bhagyashris has joined #oooq | 06:26 | |
| marios|ruck | chkumar|rover: removed fs1 also FYI (it was red there looks like we need something more than https://review.opendev.org/#/c/699170/ ? | 06:29 |
| marios|ruck | chkumar|rover: so we can get some quick runs on the image builds | 06:29 |
| chkumar|rover | marios|ruck: I am working on updating that, will wait till it fails | 06:30 |
| chkumar|rover | marios|ruck: How can i set selinux pemrissive for undercloud? | 06:30 |
| marios|ruck | chkumar|rover: thers a undercloud_selinux_enabled var | 06:30 |
| marios|ruck | chkumar|rover: have to grep for it | 06:30 |
| marios|ruck | ./roles/undercloud-deploy/defaults/main.yml:87:undercloud_selinux_enabled: >- | 06:31 |
| marios|ruck | chkumar|rover: ^ | 06:31 |
| chkumar|rover | marios|ruck: got it https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/undercloud-deploy/defaults/main.yml#L87 | 06:31 |
| chkumar|rover | again hardcoded | 06:31 |
| chkumar|rover | proposing the same as weshay suggested | 06:31 |
| chkumar|rover | marios|ruck: is it ok if update my selinux patch? | 06:46 |
| marios|ruck | chkumar|rover: i removed the depends in https://review.rdoproject.org/r/#/c/23919/ if that is what you mean | 06:46 |
| marios|ruck | 08:29 < marios|ruck> chkumar|rover: so we can get some quick runs on the image builds | 06:46 |
| chkumar|rover | marios|ruck: it was about fs01 master, no problem | 06:47 |
| marios|ruck | chkumar|rover: ack we can re-add there later if you want ^ but want to confirm the rhel81 image and image build etc are ok | 06:49 |
| chkumar|rover | marios|ruck: image build passed | 06:52 |
| chkumar|rover | marios|ruck: Here is the selinux patch https://review.opendev.org/#/c/698883/ | 06:52 |
| chkumar|rover | sorry | 06:52 |
| chkumar|rover | marios|ruck: https://review.opendev.org/#/c/699170/ | 06:52 |
| marios|ruck | chkumar|rover: one more time | 06:58 |
| marios|ruck | chkumar|rover: (rechecked) | 06:59 |
| marios|ruck | chkumar|rover: sory don't trust it any more ;) | 06:59 |
| marios|ruck | chkumar|rover: then i'll re-add the fs1 job and add the depends ^ | 06:59 |
| chkumar|rover | ok cool | 07:07 |
| *** jfrancoa has joined #oooq | 07:15 | |
| *** jbadiapa has joined #oooq | 07:16 | |
| marios|ruck | k restored chkumar|rover v11 https://review.rdoproject.org/r/#/c/23919/ | 07:17 |
| chkumar|rover | marios|ruck: ok, let's see how it goes | 07:18 |
| *** bhagyashris has quit IRC | 07:26 | |
| *** whoami-rajat__ has joined #oooq | 07:33 | |
| *** bhagyashris has joined #oooq | 07:41 | |
| *** ykarel is now known as ykarel|lunch | 07:41 | |
| *** holser has quit IRC | 07:47 | |
| *** bhagyashris has quit IRC | 08:06 | |
| chkumar|rover | marios|ruck: can we merge this https://review.opendev.org/#/c/697992/ ? | 08:10 |
| chkumar|rover | marios|ruck: regarding this https://review.rdoproject.org/r/#/c/23919/ we also need to run build containers job as a deps | 08:12 |
| chkumar|rover | it got failed with image not found during undercloud install | 08:12 |
| marios|ruck | chkumar|rover: hmm wonder if its cos periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing just ran | 08:15 |
| chkumar|rover | marios|ruck: yes, let's wait for image build to finish in master perioidic then we can just do a recheck by removing other jobs and keep only fs01 | 08:17 |
| marios|ruck | chkumar|rover: master periodic rhel image build *should* be green now cos of https://review.rdoproject.org/r/24197 lets see | 08:19 |
| marios|ruck | chkumar|rover: we've had like 3/4 green now on the test so hopefully we can say its ok | 08:20 |
| marios|ruck | ;) | 08:20 |
| chkumar|rover | yes | 08:20 |
| *** tosky has joined #oooq | 08:20 | |
| *** saneax has joined #oooq | 08:22 | |
| *** tesseract has joined #oooq | 08:25 | |
| *** ykarel|lunch is now known as ykarel | 08:31 | |
| *** amoralej|off is now known as amoralej | 08:38 | |
| *** apetrich has joined #oooq | 08:47 | |
| *** jpena|off is now known as jpena | 08:49 | |
| *** bhagyashris has joined #oooq | 09:01 | |
| *** ykarel_ has joined #oooq | 09:03 | |
| *** tosky_ has joined #oooq | 09:04 | |
| *** skramaja_ has joined #oooq | 09:04 | |
| *** akahat has joined #oooq | 09:04 | |
| *** tesseract has quit IRC | 09:10 | |
| *** tosky has quit IRC | 09:10 | |
| *** ykarel has quit IRC | 09:10 | |
| *** baha has quit IRC | 09:10 | |
| *** skramaja has quit IRC | 09:10 | |
| *** dtantsur|afk has quit IRC | 09:10 | |
| *** radez has quit IRC | 09:10 | |
| *** skramaja_ is now known as skramaja | 09:13 | |
| *** tesseract has joined #oooq | 09:17 | |
| *** tosky_ is now known as tosky | 09:19 | |
| *** ykarel_ is now known as ykarel | 09:20 | |
| *** derekh has joined #oooq | 09:33 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:34 | |
| *** jbadiapa has quit IRC | 09:37 | |
| marios|ruck | chkumar|rover: seen that one/any idea? * http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-full-tempest-master/85662f6/logs/undercloud/home/zuul/tempest/tempest.log.txt.gz | 09:50 |
| marios|ruck | * 2019-12-17 04:58:09.544 82398 ERROR tempest.test [-] teardown of resources failed: Sfc Extension not enabled.: SkipTest: Sfc Extension not enabled. | 09:50 |
| *** jbadiapa has joined #oooq | 09:51 | |
| chkumar|rover | marios|ruck: nope | 09:52 |
| chkumar|rover | checking | 09:53 |
| *** dsneddon has quit IRC | 09:57 | |
| *** dsneddon has joined #oooq | 09:57 | |
| marios|ruck | panda: around? chkumar|rover is anyone doing sthing to the promoter? afaics nothing ran for half hour http://38.145.34.55/centos7_master.log http://38.145.34.55/centos7_train.log http://38.145.34.55/centos7_stein.log | 10:02 |
| chkumar|rover | marios|ruck: nope | 10:02 |
| marios|ruck | chkumar|rover: ack thanks. strange. maybe is nothing will keep eye but it should have run at least once in last half hour (unless there is promotion hapening but there is not) | 10:03 |
| chkumar|rover | marios|ruck: currently checking on #rhos-opes | 10:05 |
| marios|ruck | chkumar|rover: ack not sure it would be infra issue... just got on the node looks like it is running Active: active (running) since Thu 2019-10-31 21:23:06 UTC; 1 months 16 days ago | 10:07 |
| marios|ruck | ● dlrn-promoter.service - Tripleo CI DLRN promoter | 10:07 |
| chkumar|rover | hmm ok | 10:10 |
| marios|ruck | chkumar|rover: sorry false alarm | 10:11 |
| marios|ruck | chkumar|rover: stein is promoting that is why | 10:11 |
| marios|ruck | 2019-12-17 09:28:42,041 24660 INFO promoter Promoting the container images for dlrn hash f6d32a684f0426655c618721c4f4e71bd6b747ff on stein to current-tripleo | 10:11 |
| chkumar|rover | ok | 10:12 |
| marios|ruck | chkumar|rover: let's call it 'going promoter crazy' | 10:12 |
| marios|ruck | oh noe he has promotion sickness | 10:12 |
| marios|ruck | etc | 10:12 |
| chkumar|rover | http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-train-promote-consistent-to-tripleo-ci-testing/4a91560/ | 10:12 |
| chkumar|rover | it is going crazy | 10:12 |
| chkumar|rover | timeout twice | 10:12 |
| marios|ruck | chkumar|rover: 2019-12-16 21:12:10.975062 | rdo-centos-7 | OSError: [Errno 13] Permission denied: '/dlrnapi_venv' | 10:18 |
| marios|ruck | wtf | 10:18 |
| marios|ruck | the whole pipeline got fcucked | 10:18 |
| chkumar|rover | check the patches merged late night | 10:18 |
| *** ysandeep has quit IRC | 10:19 | |
| marios|ruck | chkumar|rover: the one just now timed out, the one yesterday had that error ^^ http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-train-promote-consistent-to-tripleo-ci-testing/8d75387/job-output.txt | 10:19 |
| marios|ruck | 2019-12-17 09:12:57.925391 | rdo-centos-7 | commit 6a616e5db26a18e9e9d842e3979de2ad3e394219 / distro 7b91151405fb7a6c0d2f1d403c625eaaba60fb72 combination not found in RHEL | 10:20 |
| marios|ruck | just before timeout ^ | 10:20 |
| chkumar|rover | yes | 10:20 |
| marios|ruck | chkumar|rover: https://review.rdoproject.org/r/24211 | 10:25 |
| marios|ruck | lets see | 10:25 |
| chkumar|rover | marios|ruck: on tempest failure side, may be a hickup issue nothing in glance or neutron logs | 10:25 |
| marios|ruck | chkumar|rover: https://review.rdoproject.org/r/#/c/24211/ periodic-tripleo-centos-7-train-promote-consistent-to-tripleo-ci-testingSUCCESS in 1m 40s | 10:31 |
| marios|ruck | :/ | 10:31 |
| chkumar|rover | marios|ruck: yes it is succees there, but during perioidc time it gets timeout | 10:32 |
| marios|ruck | chkumar|rover: well 1 timout and one fail | 10:32 |
| chkumar|rover | marios|ruck: yes, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing | 10:33 |
| chkumar|rover | marios|ruck: train and master one time out | 10:33 |
| marios|ruck | chkumar|rover: latest master one is ok still running the pipeline but promote consistent was green | 10:34 |
| chkumar|rover | yes | 10:34 |
| chkumar|rover | I hate fs01 maste rhel8 job seriously still running and stuck at a single place | 10:36 |
| chkumar|rover | master | 10:36 |
| *** holser has joined #oooq | 10:36 | |
| *** holser has quit IRC | 10:37 | |
| *** holser has joined #oooq | 10:38 | |
| marios|ruck | chkumar|rover: https://bugs.launchpad.net/tripleo/+bug/1853028/comments/17 agree? (\o/) | 10:40 |
| openstack | Launchpad bug 1853028 in tripleo "Build overcloud image for rhel8 fails sometimes on in_target.d/post-install.d/51-enable-network-service" [Critical,Fix released] | 10:40 |
| *** holser has quit IRC | 10:44 | |
| *** holser has joined #oooq | 10:45 | |
| chkumar|rover | marios|ruck: sounds good, or Do we want to wait for getting comments on RHEL 8 bug? last night sshnaidm posted strace output | 10:50 |
| *** holser has quit IRC | 10:54 | |
| *** holser has joined #oooq | 10:54 | |
| marios|ruck | chkumar|rover: not sure ... they are independent anyway, the job is now green with the 8.1 switch. if there is also a rhel bug then the bz will take care of that | 10:54 |
| marios|ruck | chkumar|rover: i don't think we need to wait on the bz | 10:54 |
| chkumar|rover | marios|ruck: ok, good to close with fix released | 10:54 |
| marios|ruck | chkumar|rover: and apparently that can take a very long time per weshay | 10:54 |
| chkumar|rover | yes | 10:55 |
| marios|ruck | chkumar|rover: can you see https://review.opendev.org/#/c/688945/6/roles/validate-tempest/vars/tempest_skip_master.yml | 11:10 |
| marios|ruck | chkumar|rover: do any of the jobs in that patch run those tests or only fs21? | 11:10 |
| marios|ruck | chkumar|rover: i thought standalone should run them ? | 11:10 |
| chkumar|rover | marios|ruck: checking | 11:16 |
| marios|ruck | chkumar|rover: thanks. another thing. these are duplicates or no ? https://bugs.launchpad.net/tripleo/+bug/1856016 https://bugs.launchpad.net/tripleo/+bug/1855985 | 11:17 |
| openstack | Launchpad bug 1856016 in tripleo "Tempest basic ops test_cross_tenant_traffic tests failed on fs020 train with Timed out waiting for 10.0.0.102 to become reachable from 10.0.0.117" [Critical,Won't fix] | 11:17 |
| openstack | Launchpad bug 1855985 in tripleo "tempest network test_list_agent test failed with mismatch error in train fs020" [Critical,Confirmed] | 11:17 |
| chkumar|rover | marios|ruck: there is no fs020 job there | 11:17 |
| marios|ruck | chkumar|rover: per comments there they are but yesterday terry said maybe they are not | 11:17 |
| marios|ruck | chkumar|rover: i am looking at their trello cards | 11:18 |
| *** bhagyashris has quit IRC | 11:19 | |
| marios|ruck | fooood biab | 11:20 |
| chkumar|rover | marios|ruck: https://review.rdoproject.org/zuul/builds?change=688945 | 11:20 |
| chkumar|rover | as per this fs020 should run there | 11:21 |
| chkumar|rover | marios|ruck: I have done check-rdo there, now fs020 job will run, we will know about the status | 11:22 |
| chkumar|rover | marios|ruck: regarding above two bugs, both are different | 11:24 |
| *** bhagyashris has joined #oooq | 11:25 | |
| chkumar|rover | marios|ruck: https://bugs.launchpad.net/tripleo/+bug/1855985 have got the proper fix | 11:26 |
| openstack | Launchpad bug 1855985 in tripleo "tempest network test_list_agent test failed with mismatch error in train fs020" [Critical,Confirmed] | 11:26 |
| chkumar|rover | marios|ruck: for second bug, need to find more info | 11:33 |
| marios|ruck | chkumar|rover: ok can you please reply to jbuchta on cix | 11:33 |
| chkumar|rover | marios|ruck: done | 11:36 |
| chkumar|rover | marios|ruck: let's merge this https://review.opendev.org/#/c/698435/1 till I gather more info about the other bug | 11:37 |
| marios|ruck | chkumar|rover: thanks and done | 11:39 |
| *** surpatil has joined #oooq | 11:41 | |
| *** SurajPatil has joined #oooq | 11:41 | |
| sshnaidm | chkumar|rover, marios|ruck so what was the root cause? | 11:54 |
| sshnaidm | for rhel8 building | 11:54 |
| chkumar|rover | sshnaidm: donot know, just updating it to RHEL-8.1 fixes the issue | 11:54 |
| chkumar|rover | I think we cannot the selinux mode there also? | 11:55 |
| sshnaidm | chkumar|rover, so rhel bug | 11:55 |
| chkumar|rover | sshnaidm: what do you think about this? https://review.opendev.org/#/c/699170/ | 11:55 |
| marios|ruck | sshnaidm: yeah only difference between 8.0 and 8.1 guest image was selinux afaik | 11:55 |
| marios|ruck | sshnaidm: we had few green runs in a row today https://bugs.launchpad.net/tripleo/+bug/1853028/comments/17 | 11:56 |
| openstack | Launchpad bug 1853028 in tripleo "Build overcloud image for rhel8 fails sometimes on in_target.d/post-install.d/51-enable-network-service" [Critical,Fix released] | 11:56 |
| sshnaidm | great | 11:56 |
| sshnaidm | interesting if they have same chkconfig version | 11:57 |
| *** rfolco|bbl has joined #oooq | 11:57 | |
| sshnaidm | chkumar|rover, seems fine to me | 11:58 |
| *** jbadiapa has quit IRC | 12:09 | |
| *** amoralej is now known as amoralej|lunch | 12:16 | |
| *** jbadiapa has joined #oooq | 12:19 | |
| chkumar|rover | marios|ruck: Tengu is taking care of https://bugs.launchpad.net/tripleo/+bug/1853652 this one | 12:19 |
| openstack | Launchpad bug 1853652 in tripleo "openstack overcloud node provide --all-manageable timing out and failing periodic rhel-8-ovb-3ctlr_1comp-featureset001-master" [Critical,Triaged] | 12:19 |
| Tengu | :) | 12:19 |
| Tengu | that was an easy one once we get the full logs. | 12:19 |
| chkumar|rover | Tengu: :-0 | 12:20 |
| chkumar|rover | :-) | 12:20 |
| Tengu | https://github.com/redhat-openstack/openstack-selinux/pull/52 fyi | 12:20 |
| Tengu | will comment the LP as well. | 12:20 |
| marios|ruck | chkumar|rover: ack but i thought it was that? https://review.opendev.org/699170 | 12:21 |
| marios|ruck | Tengu: looking at pull request | 12:21 |
| chkumar|rover | marios|ruck: that is the fix | 12:21 |
| chkumar|rover | for making rhel8 to permissive and there are other issues also there | 12:21 |
| marios|ruck | chkumar|rover: which one? or bohth | 12:22 |
| chkumar|rover | marios|ruck: yes | 12:22 |
| marios|ruck | chkumar|rover: ok thanks Tengu | 12:22 |
| chkumar|rover | both | 12:22 |
| Tengu | marios|ruck: so, chkumar|rover pushed something in order to set RHEL to permissive, and I just pushed the missing selinux policy in order to avoid breaking selinux enforcing systems, such as customers|prod ;) | 12:22 |
| chkumar|rover | Tengu: https://review.opendev.org/#/c/699170/ is the fix to make RHEL8 jobs to permissive | 12:22 |
| marios|ruck | great thanks Tengu chkumar|rover | 12:22 |
| Tengu | chkumar|rover: what I said ;) | 12:23 |
| chkumar|rover | Tengu: Now I owe you 2 beers :-) | 12:23 |
| Tengu | hehehe | 12:23 |
| * marios|ruck offers help hold one of Tengu beers | 12:24 | |
| marios|ruck | ;) | 12:24 |
| chkumar|rover | for marios|ruck , I will buy the whole bucket of beers :-) | 12:24 |
| marios|ruck | chkumar|rover: yes we can have beer while we are waiting for the mojito to defrost | 12:25 |
| chkumar|rover | :-) | 12:25 |
| marios|ruck | chkumar|rover: should star taking them out of freezer now i think | 12:25 |
| chkumar|rover | just one day and few hours left now and we are done :-) | 12:25 |
| *** rfolco|bbl is now known as rfolco | 12:27 | |
| *** tesseract has quit IRC | 12:38 | |
| *** tesseract has joined #oooq | 12:38 | |
| *** jpena is now known as jpena|lunch | 12:38 | |
| *** ksambor_ has joined #oooq | 12:43 | |
| *** ksambor_ is now known as ksambor | 12:45 | |
| *** dsneddon has quit IRC | 12:51 | |
| *** surpatil has quit IRC | 12:54 | |
| *** SurajPatil has quit IRC | 12:55 | |
| *** surpatil has joined #oooq | 12:55 | |
| *** SurajPatil has joined #oooq | 12:55 | |
| *** dsneddon has joined #oooq | 12:58 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:58 | |
| rfolco | marios|ruck, chkumar|rover if you get a min to review this quick one | 12:59 |
| rfolco | https://review.rdoproject.org/r/24215 | 12:59 |
| rfolco | its a quick fix | 12:59 |
| *** rlandy has joined #oooq | 12:59 | |
| rfolco | see ci job in https://review.rdoproject.org/r/#/c/24199/ | 12:59 |
| rfolco | rlandy, great timing, good morning, not so good mood, please +w this one https://review.rdoproject.org/r/24215 | 13:00 |
| *** SurajPatil has quit IRC | 13:00 | |
| marios|ruck | rfolco: make me | 13:00 |
| *** SurajPatil has joined #oooq | 13:01 | |
| *** surpatil has quit IRC | 13:01 | |
| rlandy | rfolco: could be worse than breaking component | 13:01 |
| rlandy | tenant upgrade could have been worse | 13:02 |
| *** surpatil has joined #oooq | 13:02 | |
| *** dsneddon has quit IRC | 13:02 | |
| rfolco | marios|ruck, make && make install --marios | 13:03 |
| marios|ruck | :D | 13:03 |
| *** dsneddon has joined #oooq | 13:09 | |
| *** whoami-rajat__ has quit IRC | 13:09 | |
| *** udesale has joined #oooq | 13:11 | |
| chkumar|rover | ah merged already | 13:12 |
| *** ykarel is now known as ykarel|afk | 13:12 | |
| *** udesale has quit IRC | 13:12 | |
| *** udesale has joined #oooq | 13:13 | |
| rlandy | rfolco: can I explain https://review.rdoproject.org/r/#/c/24207/? | 13:14 |
| *** dsneddon has quit IRC | 13:14 | |
| rlandy | component_release is not downstream only | 13:14 |
| rlandy | it's a case that comes up right now in dowsntream due to the build schedule | 13:15 |
| rlandy | it supports the case where we want to run a component from one release and a build from another | 13:15 |
| rlandy | we are required to support that | 13:15 |
| rfolco | and where is the component_release var then ? | 13:16 |
| rfolco | in the job definition I see release: master | 13:16 |
| rfolco | just trying to understand it, not nitpicking your change | 13:17 |
| rlandy | rfolco: https://code.engineering.redhat.com/gerrit/#/c/187453/18/zuul.d/standalone-jobs.yaml | 13:17 |
| *** ykarel|afk has quit IRC | 13:17 | |
| rfolco | thats internal | 13:17 |
| rlandy | branch_override: "stable/rhos-16" | 13:17 |
| rlandy | release: rhos-16 | 13:17 |
| rlandy | rhos_release_version: 16 | 13:17 |
| rlandy | release_file: rhos-16 | 13:17 |
| rlandy | component_release: osp17 | 13:17 |
| rfolco | downstream :) | 13:17 |
| rlandy | rfolco: you are correct | 13:17 |
| rlandy | but how are we supposed to reuse upstream code and avoid duplication w/o modifying upstream code to take out assumptions that upstream and dowsntream run exactly the same way? | 13:18 |
| rlandy | rfolco: feel free to ask more at the meeting | 13:19 |
| rfolco | ok, then change the job definition to component_release | 13:19 |
| rlandy | there are a bunch of changes to support downstream | 13:19 |
| rfolco | if you don't change it, the upstream job will break | 13:19 |
| rlandy | I can't because of the product install | 13:19 |
| rlandy | I will explain more at the meeting | 13:19 |
| rfolco | ok | 13:19 |
| *** bhagyashris has quit IRC | 13:28 | |
| rfolco | ci community call starting at https://meet.google.com/bqx-xwht-wky | 13:30 |
| rfolco | zbr, chkumar|rover marios|ruck sshnaidm|afk rlandy panda arxcruz|pto ^ | 13:31 |
| rfolco | rlandy, pls join us | 13:32 |
| rfolco | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 13:33 |
| *** udesale has quit IRC | 13:39 | |
| *** jpena|lunch is now known as jpena | 13:41 | |
| *** dsneddon has joined #oooq | 13:45 | |
| *** amoralej|lunch is now known as amoralej | 13:47 | |
| *** soniya29 has quit IRC | 13:53 | |
| *** ksambor has quit IRC | 13:57 | |
| *** akahat has quit IRC | 13:59 | |
| *** sshnaidm|afk is now known as sshnaidm | 14:02 | |
| *** ksambor has joined #oooq | 14:02 | |
| chkumar|rover | marios|ruck: you need to take rest sir :-) | 14:04 |
| marios|ruck | chkumar|rover: you too ;) | 14:06 |
| * chkumar|rover heading home | 14:08 | |
| *** ksambor has quit IRC | 14:11 | |
| *** ksambor has joined #oooq | 14:12 | |
| *** surpatil has quit IRC | 14:12 | |
| *** SurajPatil has quit IRC | 14:13 | |
| rlandy | marios|ruck: chkumar|rover: rfolco: heads up ... https://review.rdoproject.org/r/#/c/24207/1/ci-scripts/tripleo-upstream/promote-hash.sh has possibility to break promotions | 14:21 |
| rlandy | will merge it after you go :) | 14:21 |
| rlandy | and watch my damage | 14:21 |
| marios|ruck | ack rlandy thanks | 14:22 |
| rlandy | as usual, I break it, I own it | 14:22 |
| rfolco | rlandy, let me make a quick final review ? | 14:22 |
| rlandy | rfolco: sure | 14:22 |
| rfolco | rlandy, gimme a few | 14:22 |
| rfolco | k | 14:22 |
| rlandy | rfolco: no rush - waiting for marios|ruck and chkumar|rover to leave so they don;t die from shock if I break stuff | 14:22 |
| *** whoami-rajat__ has joined #oooq | 14:23 | |
| marios|ruck | rlandy: let me just check cos we were waiting for master | 14:24 |
| rlandy | ok | 14:25 |
| marios|ruck | rlandy: go ahead fwiw... master still running stein finished promote | 14:26 |
| marios|ruck | chkumar|rover: ^^^ | 14:26 |
| rfolco | rlandy, lgtm | 14:26 |
| rfolco | +1 | 14:26 |
| marios|ruck | rlandy: i mean master pipeline (fs20) still running so it isn't in the middle of promotion | 14:26 |
| rfolco | release could be 'master' by default for promote-hash role maybe.... just to make sure something is assigned in case job definition misses it | 14:27 |
| rfolco | but looks good | 14:27 |
| * rlandy look sat how long fs020 is still going to run | 14:31 | |
| rlandy | its' nearly done | 14:31 |
| rlandy | and it succeeded | 14:32 |
| rlandy | uploading logs | 14:32 |
| rlandy | marios|ruck: rfolco: ok - here we go - revert button at hand | 14:33 |
| chkumar|rover | marios|ruck: from recent fs01 master rhel8 run http://logs.rdoproject.org/89/24189/3/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/59fb39e/job-output.txt | 14:42 |
| chkumar|rover | undercloud log dir is missing | 14:42 |
| rfolco | chkumar|rover, marios|ruck: ruck/rover scoreboard updated https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both#RuckRover-Registry | 14:43 |
| *** panda has quit IRC | 14:44 | |
| *** panda has joined #oooq | 14:44 | |
| rlandy | ok - I don't think I hosed anything .... | 14:47 |
| rlandy | dlrnapi --url https://trunk-staging.rdoproject.org/api-centos-master-uc --username review_rdoproject_org repo-promote --commit-hash 94da09e9c72d2d3820e97edaa02f2ffce94a7d21 --distro-hash b6c485f3eb7fafb1582c5578f73c3dabc2c5a370 --promote-name tripleo-ci-testing | 14:47 |
| *** TrevorV has joined #oooq | 14:47 | |
| *** ykarel|afk has joined #oooq | 14:47 | |
| rfolco | rlandy, I am fixing promote-to-current-tripleo job | 14:48 |
| rfolco | 2019-12-17 13:13:38.122257 | rdo-centos-7 | /home/zuul/src/review.rdoproject.org/config/ci-scripts/tripleo-upstream/dlrnapi_check_reports.sh: line 5: WORKSPACE: unbound variable | 14:48 |
| rfolco | 2019-12-17 13:13:38.750513 | rdo-centos-7 | ERROR | 14:48 |
| rlandy | rfolco: ok - promote stuff looks ok from above | 14:49 |
| rfolco | rlandy, this is specific to component promote to current-tripleo job | 14:49 |
| rfolco | environment: "{{ zuul | zuul_legacy_vars | combine({'DLRNAPI_PASSWORD': dlrnapi.password,'DLRNAPI_USERNAME': dlrnapi_user}) }}" | 14:49 |
| rfolco | this is the fix again ^ | 14:49 |
| rlandy | rfolco: ok - I am just worried about breaking current promotions - which I think is ok ... your change is fine by me | 14:50 |
| *** ykarel|afk is now known as ykarel | 14:51 | |
| rlandy | OMG yay .... | 14:51 |
| rlandy | 2019-12-17 09:51:13.964898 | primary | "commit_hash": "1c2b7d8f01814adfd6d28b97013a40cca51dfbdf", | 14:52 |
| rlandy | 2019-12-17 09:51:13.964905 | primary | "distro_hash": "c9bfa013c3a219d28abaea7b544163dd819e908e", | 14:52 |
| rlandy | 2019-12-17 09:51:13.964909 | primary | "promote_name": "tripleo-ci-testing", | 14:52 |
| rlandy | 2019-12-17 09:51:13.964914 | primary | "repo_hash": "1c2b7d8f01814adfd6d28b97013a40cca51dfbdf_c9bfa013", | 14:52 |
| rlandy | 2019-12-17 09:51:13.964919 | primary | "repo_url": "http://xxx/rhel8-osp17/component/compute/1c/2b/1c2b7d8f01814adfd6d28b97013a40cca51dfbdf_c9bfa013_3b22bd1c", | 14:52 |
| rlandy | 2019-12-17 09:51:13.964924 | primary | "timestamp": 1576594187, | 14:52 |
| rlandy | 2019-12-17 09:51:13.964929 | primary | "user": "xxx" | 14:52 |
| rlandy | finally!! | 14:52 |
| rlandy | migi: ^^ we have a tagged downstream component build | 14:53 |
| rlandy | step 1 | 14:53 |
| rlandy | woohoo | 14:53 |
| rfolco | rlandy, please... https://review.rdoproject.org/r/24225 | 14:53 |
| rfolco | rlandy, \o/ | 14:53 |
| migi | rlandy: cool, this is build from 3rd of Dec right? | 14:54 |
| rlandy | it was the build marked consistent | 14:55 |
| migi | rlandy: yep I see it | 14:55 |
| rlandy | now we can test standalone with that | 14:55 |
| rlandy | thanks to jpena - for the fixes yesterday | 14:55 |
| rlandy | we're in the dlrn downstream business now | 14:56 |
| rlandy | ok - now let's see if standalone picks that build up | 14:56 |
| marios|ruck | rlandy: thanks | 14:56 |
| marios|ruck | err sorry rfolco thanks rlandy sorry for noise | 14:57 |
| rlandy | marios|ruck: lol - you need a break from ruck/rover | 14:57 |
| marios|ruck | rlandy: yes | 15:00 |
| marios|ruck | chkumar|rover: fyi full-tempest master failed again might be real issue posted that https://review.rdoproject.org/r/#/c/24224/ for test | 15:00 |
| marios|ruck | chkumar|rover: and it is the only fail/blocks promote | 15:00 |
| rlandy | migi: next step is to see if the standlaone job reports to the correct dlrn server with the correct hash | 15:01 |
| chkumar|rover | marios|ruck: full tempest image one? | 15:01 |
| rlandy | if so, we're pipeline ready | 15:01 |
| marios|ruck | chkumar|rover: yeah noted it on etherpad with link if you want to check | 15:02 |
| *** ykarel has quit IRC | 15:03 | |
| *** ykarel has joined #oooq | 15:03 | |
| chkumar|rover | marios|ruck: let me check plain standalone job | 15:04 |
| chkumar|rover | and that test does not run in plain standalone | 15:07 |
| marios|ruck | chkumar|rover: k, i can file a new bug for it cos happened on both runs today same test looks like | 15:07 |
| chkumar|rover | marios|ruck: ok | 15:07 |
| chkumar|rover | marios|ruck: rlandy sshnaidm https://review.opendev.org/#/c/699170/ please +w selinux patch | 15:12 |
| chkumar|rover | thanks! | 15:15 |
| marios|ruck | https://bugs.launchpad.net/tripleo/+bug/1856723 chkumar|rover | 15:16 |
| openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 15:16 |
| chkumar|rover | marios|ruck: ok, will poke people | 15:17 |
| *** jaosorior has joined #oooq | 15:26 | |
| *** skramaja has quit IRC | 15:36 | |
| chkumar|rover | marios|ruck: I am done with harassing people for today, see ya tomorrow, may rlandy/rfolco can hold the fort , Have a nice evening ahead | 15:50 |
| chkumar|rover | marios|ruck: please take some rest bro :-) | 15:50 |
| rlandy | chkumar|rover: have a good night | 15:50 |
| *** chkumar|rover is now known as raukadah | 15:50 | |
| *** saneax has quit IRC | 15:52 | |
| marios|ruck | have a good one raukadah | 15:58 |
| raukadah | marios|ruck: I poked concerned people to look into tempest issue, we might something tomorrow | 15:58 |
| marios|ruck | raukadah: ack | 15:58 |
| *** ykarel is now known as ykarel|away | 16:04 | |
| *** gkadam has joined #oooq | 16:06 | |
| *** whoami-rajat__ has quit IRC | 16:06 | |
| *** baha has joined #oooq | 16:06 | |
| rlandy | migi: pls check https://code.engineering.redhat.com/gerrit/#/c/187923/. Would run once a day | 16:11 |
| rlandy | I have one more iteration of https://code.engineering.redhat.com/gerrit/#/c/187453/ to make - to add keystone | 16:14 |
| rlandy | can merge the next version there | 16:14 |
| *** gkadam has quit IRC | 16:15 | |
| *** fmount has quit IRC | 16:17 | |
| *** fmount has joined #oooq | 16:18 | |
| rfolco | rlandy, marios|ruck need a +w here | 16:31 |
| rfolco | https://review.rdoproject.org/r/#/c/24225/ | 16:31 |
| *** jfrancoa has quit IRC | 16:33 | |
| marios|ruck | rfolco: sorry on the all hands | 16:38 |
| marios|ruck | rfolco: looks like rlandy +A | 16:39 |
| rfolco | thx | 16:41 |
| *** jpena is now known as jpena|brb | 16:45 | |
| *** jfrancoa has joined #oooq | 16:53 | |
| *** ykarel|away has quit IRC | 16:59 | |
| *** marios|ruck is now known as marios|out | 17:00 | |
| *** tesseract has quit IRC | 17:00 | |
| *** marios|out has quit IRC | 17:03 | |
| *** Goneri has joined #oooq | 17:20 | |
| *** jpena|brb is now known as jpena | 17:23 | |
| rlandy | migi: rfolco: we've got it ... reported to dlrn | 17:57 |
| rlandy | { | 17:57 |
| rlandy | "commit_hash": "1c2b7d8f01814adfd6d28b97013a40cca51dfbdf", | 17:57 |
| rlandy | "component": "compute", | 17:57 |
| rlandy | "distro_hash": "c9bfa013c3a219d28abaea7b544163dd819e908e", | 17:57 |
| rlandy | "in_progress": false, | 17:57 |
| rlandy | "job_id": "periodic-tripleo-ci-rhel-8-standalone-rhos-17-compute-rhos-16", | 17:57 |
| rlandy | "notes": "", | 17:57 |
| rlandy | "success": false, | 17:57 |
| rlandy | "timestamp": 1576602395, | 17:58 |
| rlandy | "url": "https://sf.hosted.upshift.rdu2.redhat.com/logs/53/187453/19/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17-compute-rhos-16/8269612" | 17:58 |
| rlandy | } | 17:58 |
| rfolco | cool | 17:58 |
| rlandy | rfolco: how's the promotion pipeline looking? | 17:59 |
| rlandy | can I add that equivalent to downstream yet? | 17:59 |
| rfolco | rlandy, final job failing... waiting for new results to fix next issue | 18:00 |
| *** derekh has quit IRC | 18:00 | |
| rlandy | rfolco: ok - no rush - waiting to merge standalone job updates | 18:00 |
| rfolco | rlandy, I am fixing this | 18:01 |
| rfolco | 2019-12-17 17:04:27.505213 | rdo-centos-7 | "message": "Could not find or access '/home/zuul/src/review.rdoproject.org/config/ci-scripts/dlrnapi_promoter/config/CentOS-7/component/master.yaml' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"\ | 18:01 |
| *** jaosorior has quit IRC | 18:04 | |
| *** amoralej is now known as amoralej|off | 18:06 | |
| *** rlandy has quit IRC | 18:15 | |
| *** rlandy has joined #oooq | 18:16 | |
| *** jpena is now known as jpena|off | 18:33 | |
| rfolco | rlandy, next fix https://review.rdoproject.org/r/24234 | 18:42 |
| rfolco | pls | 18:42 |
| *** panda has quit IRC | 18:49 | |
| *** panda has joined #oooq | 18:49 | |
| *** jaosorior has joined #oooq | 19:00 | |
| rfolco | sshnaidm, https://review.rdoproject.org/r/24234 need to merge this to fix this http://logs.rdoproject.org/99/24199/4/check/periodic-tripleo-centos-7-master-component-compute-promote-to-current-tripleo/624894e/job-output.txt | 19:05 |
| rlandy | rfolco: done | 19:07 |
| rfolco | thanks rlandy | 19:07 |
| *** TrevorV has quit IRC | 19:20 | |
| *** holser has quit IRC | 19:30 | |
| *** TrevorV has joined #oooq | 19:37 | |
| rlandy | well for better or worse, downstream pipeline is merged | 19:40 |
| *** holser has joined #oooq | 20:28 | |
| *** jaosorior has quit IRC | 20:45 | |
| rfolco | rlandy, https://review.rdoproject.org/r/24236 | 20:47 |
| rfolco | previous fix did not work | 20:47 |
| rfolco | rlandy, feel free to revert it first, or here is the fix ^ | 20:47 |
| rlandy | wow - you really have to use raw content? | 20:48 |
| rlandy | just submitting something - will look more in a bit | 20:48 |
| rlandy | rfolco: this doesn't make sense to me ... https://review.rdoproject.org/r/#/c/24236/1/roles/promote-hash/tasks/check-promotion-criteria.yaml | 20:54 |
| rlandy | - name: load criteria for component promotion | 20:54 |
| rlandy | vars: | 20:54 |
| rlandy | criteria_base_path: "{{ rdo_infra_ci_config_repo }}/ci-scripts/dlrnapi_promoter/config" | 20:54 |
| rlandy | include_vars: | 20:54 |
| rlandy | file: "{{ workspace }}/component-{{ release }}.yaml" | 20:54 |
| rlandy | name: "criteria" | 20:54 |
| rlandy | the include_vars I get | 20:54 |
| rlandy | what are the vasr applied to? | 20:55 |
| rlandy | vars | 20:55 |
| rfolco | this is a yaml file | 20:55 |
| rfolco | loads all vars from that yaml file into "criteria" var | 20:55 |
| rfolco | so we query like | 20:55 |
| rfolco | criteria[var1] | 20:56 |
| rfolco | rlandy, aaah | 20:58 |
| rfolco | you are right, the criteria_base_path is no longer required | 20:58 |
| rfolco | let me fix this | 20:58 |
| rfolco | sorry | 20:58 |
| rlandy | you shouldn't need the raw file | 20:59 |
| rlandy | and that var has no effect | 20:59 |
| rfolco | rlandy, yes | 20:59 |
| rlandy | back in 15 | 20:59 |
| rfolco | fixin | 20:59 |
| *** kopecmartin is now known as kopecmartin|off | 21:04 | |
| *** jaosorior has joined #oooq | 21:09 | |
| *** jaosorior has quit IRC | 21:15 | |
| *** TrevorV has quit IRC | 21:40 | |
| *** panda has quit IRC | 22:07 | |
| *** panda has joined #oooq | 22:10 | |
| *** holser has quit IRC | 22:25 | |
| *** jfrancoa has quit IRC | 22:26 | |
| *** holser has joined #oooq | 22:31 | |
| *** saneax has joined #oooq | 23:03 | |
| *** holser has quit IRC | 23:19 | |
| *** jbadiapa has quit IRC | 23:38 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!