| *** jmasud has quit IRC | 00:01 | |
| *** jmasud has joined #oooq | 00:38 | |
| *** jmasud has quit IRC | 00:47 | |
| *** jmasud has joined #oooq | 00:57 | |
| *** jmasud has quit IRC | 01:01 | |
| *** jmasud has joined #oooq | 01:09 | |
| *** jmasud has quit IRC | 01:12 | |
| *** jmasud has joined #oooq | 01:17 | |
| *** jmasud has quit IRC | 01:19 | |
| *** jmasud has joined #oooq | 01:21 | |
| *** jmasud has quit IRC | 01:24 | |
| *** rlandy has quit IRC | 02:18 | |
| *** apetrich has quit IRC | 02:29 | |
| *** skramaja_ has joined #oooq | 02:35 | |
| *** skramaja has quit IRC | 02:37 | |
| *** jmasud has joined #oooq | 03:09 | |
| *** jmasud has quit IRC | 03:10 | |
| *** udesale has joined #oooq | 04:23 | |
| *** saneax has quit IRC | 04:25 | |
| *** dsneddon has quit IRC | 04:37 | |
| *** dmellado has quit IRC | 04:37 | |
| *** ykarel has joined #oooq | 04:38 | |
| *** dsneddon has joined #oooq | 04:42 | |
| *** dmellado has joined #oooq | 04:42 | |
| *** ysandeep|away is now known as ysandeep|rover | 04:49 | |
| *** openstackstatus has quit IRC | 04:58 | |
| *** openstack has joined #oooq | 04:59 | |
| *** ChanServ sets mode: +o openstack | 04:59 | |
| *** ysandeep|rover is now known as ysandeep|brb | 05:13 | |
| *** ysandeep|brb is now known as ysandeep|rover | 05:35 | |
| *** saneax has joined #oooq | 05:36 | |
| *** ykarel has quit IRC | 05:55 | |
| *** marios has joined #oooq | 05:55 | |
| *** ratailor has joined #oooq | 06:05 | |
| *** ykarel has joined #oooq | 06:12 | |
| *** jmasud has joined #oooq | 06:14 | |
| *** jpodivin has joined #oooq | 06:58 | |
| *** jpodivin has joined #oooq | 06:59 | |
| pojadhav | sshnaidm, hey 0/ | 07:14 |
|---|---|---|
| pojadhav | sshnaidm, yesterday I fixed telegraf script tests to make green py36-config job by modifying expected empty list to None, but now I am facing some weired issue like same tests are failing on my other 2 patches ( https://review.rdoproject.org/r/#/c/31721/ and https://review.rdoproject.org/r/#/c/31898/) and again it expecting empty list instead of None. Do you have any idea what wrong with it..? | 07:24 |
| *** jmasud has quit IRC | 07:25 | |
| *** ysandeep|rover is now known as ysandeep|lunch | 07:54 | |
| ykarel | ysandeep|lunch, i have reported https://bugs.launchpad.net/tripleo/+bug/1915242 which i mentioned couple of days back | 08:05 |
| openstack | Launchpad bug 1915242 in tripleo "[Train] [CentOS7] Undercloud jobs puppet task ertmonger_certificate[haproxy-external-cert] fails with Unrecognized parameter or wrong value type" [Undecided,New] | 08:05 |
| ykarel | didn't find related bug so reported | 08:05 |
| *** frenzy_friday has quit IRC | 08:13 | |
| *** frenzy_friday has joined #oooq | 08:14 | |
| *** amoralej|off is now known as amoralej | 08:21 | |
| *** slaweq|away is now known as slaweq | 08:29 | |
| *** zbr|pto is now known as zbr | 08:35 | |
| *** ysandeep|lunch is now known as ysandeep|rover | 08:52 | |
| ysandeep|rover | ykarel, ack | 08:53 |
| *** jpena|off is now known as jpena | 08:57 | |
| *** tosky has joined #oooq | 09:12 | |
| arxcruz|ruck | ysandeep|rover: i'm gonna fix scen10 on train | 09:19 |
| arxcruz|ruck | ysandeep|rover: good morning btw :) | 09:19 |
| ysandeep|rover | arxcruz|ruck, good morning :) | 09:23 |
| ysandeep|rover | arxcruz|ruck, https://bugs.launchpad.net/tripleo/+bug/1914600 is blocking ussuri from promoting, victoria is also failing on tempest(possibly with same issue).. but for some reason undercloud dir is not captured in logs | 09:23 |
| openstack | Launchpad bug 1914600 in tripleo "periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-master/ussuri is failing on tempest test - octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest" [Critical,Triaged] | 09:23 |
| arxcruz|ruck | ysandeep|rover: that's what i'm fixing :) | 09:24 |
| arxcruz|ruck | ysandeep|rover: i'm still getting ModuleNotFoundError: No module named 'setuptools_rust' | 09:25 |
| ysandeep|rover | arxcruz|ruck, your patch id? | 09:25 |
| ysandeep|rover | arxcruz|ruck, and thanks for taking care of this o/ fyi.. i just marked this bug ^^ as promotion blocker as its blocking ussuri from promoting | 09:26 |
| arxcruz|ruck | ysandeep|rover: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/774419 | 09:28 |
| ysandeep|rover | arxcruz|ruck, i think adding a task here to make sure pip is atleast 19.1.1 in venv will solve the issue - https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/install_skiplist/tasks/main.yaml#L8 | 09:32 |
| arxcruz|ruck | ysandeep|rover: but it's marked as latest | 09:33 |
| *** derekh has joined #oooq | 09:33 | |
| ysandeep|rover | in logs -> upgrade to the latest pip and try again. This will fix errors for most\n | 09:34 |
| *** ykarel is now known as ykarel|lunch | 09:34 | |
| ysandeep|rover | arxcruz|ruck, fyi.. we had to do this for image build job https://review.opendev.org/c/openstack/tripleo-ci/+/774603/3/roles/oooci-build-images/tasks/pre.yaml | 09:35 |
| arxcruz|ruck | ysandeep|rover: the ensure_pip should take care of that, but whatever | 09:37 |
| ysandeep|rover | virtualenv is not specified in other tasks https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/774419/3/roles/install_skiplist/tasks/main.yaml#16 , not sure if they are installing in same venv | 09:49 |
| *** udesale_ has joined #oooq | 10:18 | |
| sshnaidm | pojadhav, hi | 10:19 |
| sshnaidm | pojadhav, you changed [] to None, right? So now it expects to get [], not None: https://logserver.rdoproject.org/10/31910/5/check/tox-py36-ci-config/3bd8093/job-output.txt | 10:20 |
| sshnaidm | pojadhav, take a look: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/storyboard.py#L14 | 10:21 |
| *** udesale has quit IRC | 10:21 | |
| sshnaidm | if data.ok: | 10:21 |
| sshnaidm | return data.json() | 10:21 |
| sshnaidm | but if it's not ok, for example storyboard fails to connect, it will return None | 10:21 |
| sshnaidm | pojadhav, you should be aware of that ^ | 10:22 |
| sshnaidm | I think yesterday storyboard was down, that's why it returned None | 10:22 |
| sshnaidm | pojadhav, we shouldn't depend on that and need to mock it | 10:22 |
| jbadiapa | Hi, is anyone using tripleo-quickstart to deploy environments or just using it for the gate? | 10:32 |
| pojadhav | sshnaidm, ahh got your point | 10:33 |
| jbadiapa | Recently there have been some changes, that make me imposible to deploy a 3contr-2com-3ceph scenario | 10:34 |
| jbadiapa | the vars run_tripleo_validations & run_tripleo_validations_negative_tests are missing or maybe I need to add an scenario to have them configured. | 10:37 |
| jbadiapa | overcloud-instrospectio.sh fails, "openstack overcloud node introspect --all-manageable" is no longer needed, the nodes are already in the managable state | 10:37 |
| arxcruz|ruck | ysandeep|rover: thanks, it works | 10:37 |
| soniya29 | arxcruz, kopecmartin , Do you have anything to discuss in tempest meeting today? | 10:37 |
| arxcruz|ruck | https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/774419 | 10:37 |
| ysandeep|rover | arxcruz|ruck, great! :) | 10:38 |
| *** dtantsur|afk is now known as dtantsur | 10:38 | |
| jbadiapa | The overcloud-deploy script fails at "Check Default IPv4 Gateway availability" more info http://paste.openstack.org/show/802505/ | 10:40 |
| jbadiapa | should I file bugs for them? | 10:41 |
| ysandeep|rover | jbadiapa, yes please file a bug | 10:44 |
| jbadiapa | sure, I will create three different ones, thx | 10:45 |
| kopecmartin | soniya29: nothing special from my side | 10:45 |
| soniya29 | arxcruz|ruck, ^^ | 10:46 |
| arxcruz|ruck | sshnaidm: ysandeep|rover marios i would like to merge it asap to unblock ussuri, train and master https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/774419 | 10:46 |
| arxcruz|ruck | soniya29: same for me | 10:46 |
| ysandeep|rover | arxcruz|ruck, commenting.. i have one to say about this | 10:47 |
| marios | arxcruz|ruck: ack | 10:47 |
| soniya29 | arxcruz|ruck, kopecmartin, since raukadah is also on PTO and there's nothing to discuss, is that okay with you all to cancel the meeting for today? | 10:48 |
| kopecmartin | soniya29: yep | 10:48 |
| arxcruz|ruck | soniya29: yup | 10:50 |
| *** dsneddon has quit IRC | 10:50 | |
| soniya29 | arxcruz|ruck, kopecmartin , okay so let's cancel the meeting | 10:51 |
| *** dsneddon has joined #oooq | 10:51 | |
| ysandeep|rover | arxcruz|ruck, commented | 10:52 |
| arxcruz|ruck | ysandeep|rover: i think your comment was in the previous patch | 10:53 |
| arxcruz|ruck | i have added those jobs | 10:53 |
| arxcruz|ruck | check it out | 10:53 |
| ysandeep|rover | checking | 10:53 |
| arxcruz|ruck | maybe you comment when the review was being uploaded | 10:53 |
| *** ykarel|lunch is now known as ykarel | 10:53 | |
| ysandeep|rover | arxcruz|ruck, what about component version of these jobs? sc10 run in component line as well | 10:54 |
| ysandeep|rover | arxcruz|ruck, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-standalone-network-master&project=openstack/tripleo-ci they are affected as well | 10:56 |
| *** dsneddon has quit IRC | 10:57 | |
| *** dsneddon has joined #oooq | 10:57 | |
| ysandeep|rover | arxcruz|ruck, fyi.. periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-16.2 is failing in downstream as well.. | 11:24 |
| ysandeep|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/33/227233/2/check/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-16.2/911cb74/logs/undercloud/var/log/tempest/stestr_results.html | 11:24 |
| arxcruz|ruck | ysandeep|rover: is downstream uses skiplist ? | 11:25 |
| ysandeep|rover | arxcruz|ruck, I am not sure about that.. this error seems same as train - https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-16.2/44aa144/logs/undercloud/var/log/tempest/stestr_results.html | 11:26 |
| arxcruz|ruck | ysandeep|rover: yeah | 11:26 |
| arxcruz|ruck | we should skip it | 11:26 |
| akahat | arxcruz|ruck, o/ | 11:27 |
| arxcruz|ruck | but not sure if how it works on downstream | 11:27 |
| arxcruz|ruck | akahat: hey | 11:27 |
| akahat | arxcruz|ruck, https://0b48b99a1954caa6a5cb-d177fea3a813a6c3857df2d202d4eaea.ssl.cf5.rackcdn.com/774580/1/check/tripleo-buildimage-ironic-python-agent-centos-7/241c5c8/build.log | 11:27 |
| ysandeep|rover | arxcruz|ruck, lets wait for rlandy to confirm | 11:27 |
| akahat | arxcruz|ruck, history looks pretty good only for that patch it is failing: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-buildimage-ironic-python-agent-centos-7+ | 11:28 |
| *** dsneddon has quit IRC | 11:28 | |
| *** dsneddon has joined #oooq | 11:30 | |
| arxcruz|ruck | ysandeep|rover: rhel8 does use skiplist, we can add the name of that job in the skiplist | 12:23 |
| ysandeep|rover | arxcruz|ruck, yes we can add, also we have component jobs of sc10 and sc10-ovn (In both upstream and downstream)- do we also need to add those jobs in skiplist. | 12:25 |
| arxcruz|ruck | ysandeep|rover: can you give me the list? | 12:25 |
| ysandeep|rover | arxcruz|ruck, yes i can share after prgm call but it will be number of jobs - master/victoria/ussuri/train component jobs.. Can't we just disable them on all jobs, till neutron team fixes this issue. | 12:27 |
| ysandeep|rover | if i speak for this bug: https://bugs.launchpad.net/tripleo/+bug/1914600 | 12:27 |
| openstack | Launchpad bug 1914600 in tripleo "periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-master/victoria/ussuri is failing on tempest test - octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest" [Critical,Triaged] | 12:27 |
| arxcruz|ruck | ysandeep|rover: the problem is that there are some jobs upstream using it | 12:27 |
| arxcruz|ruck | skiplist doesn't have a skip_job list | 12:27 |
| arxcruz|ruck | ysandeep|rover: yes, the patch i submit will fix it on victoria, ussuri and train | 12:28 |
| *** rlandy has joined #oooq | 12:28 | |
| ysandeep|rover | arxcruz|ruck, skiplist accept regex in jobs? | 12:28 |
| arxcruz|ruck | beagles have jobs running that test, that is passing upstream, so we can't just skip everywhere | 12:28 |
| arxcruz|ruck | ysandeep|rover: sadly no | 12:28 |
| rlandy | ysandeep|rover: you ok to speak at the program call? | 12:28 |
| arxcruz|ruck | but it's a good idea tbh | 12:28 |
| rlandy | I will join as well | 12:29 |
| ysandeep|rover | rlandy, yes | 12:29 |
| arxcruz|ruck | rlandy: is it okay to add the downstream job name on skiplist ? | 12:29 |
| rlandy | arxcruz|ruck: yeah | 12:29 |
| arxcruz|ruck | ack | 12:29 |
| ysandeep|rover | rlandy, pm | 12:30 |
| *** ysandeep|rover is now known as ysandeep|call | 12:31 | |
| *** jpena is now known as jpena|lunch | 12:36 | |
| *** amoralej is now known as amoralej|lunch | 12:41 | |
| bhagyashris | weshay|ruck, hi gm, i just want to ask about the promoter stuff, i see the dlrn-promoter service is inactive on test promoter server 10.0.111.180 so is that made inactive purposely | 12:42 |
| weshay|ruck | bhagyashris, ya.. I was running the python command by hand | 12:43 |
| bhagyashris | me and amol see that inactive so we haven't touched to that | 12:43 |
| bhagyashris | weshay|ruck, ok | 12:43 |
| akahat | weshay|ruck, fyi.. I updated the password and login is successful. | 12:45 |
| weshay|ruck | bhagyashris, akahat rlandy ah.. sometimes the most simple explanation is the correct one | 12:46 |
| weshay|ruck | bhagyashris, akahat rlandy /me jumps on tmux and tries a train promotion | 12:46 |
| weshay|ruck | c7 train | 12:46 |
| akahat | weshay|ruck, okay.. i'll also join | 12:47 |
| rlandy | ok | 12:47 |
| bhagyashris | weshay|ruck, me too wants to join the same | 12:47 |
| rlandy | weshay|ruck: I am abandoning the patch to exclude fluentd for rocky - should be there | 12:48 |
| bhagyashris | weshay|ruck, fyi will need to change from "release: rocky" to "release: train" in ci-scripts/dlrnapi_promoter/config_environments/rdo/defaults.yaml | 12:54 |
| weshay|ruck | ah.. that's what I was missing | 12:54 |
| bhagyashris | weshay|ruck, can you share the tmux session name | 12:54 |
| bhagyashris | i cant see the name in tmux ls | 12:55 |
| weshay|ruck | it's the promoter user.. tmux | 12:55 |
| weshay|ruck | bhagyashris, tmux a | 12:55 |
| weshay|ruck | bhagyashris, akahat so the rdo passwd was updated.. phun | 12:57 |
| bhagyashris | weshay|ruck, yes | 12:58 |
| weshay|ruck | soniya29, is there a tempest mtg today? | 13:02 |
| weshay|ruck | arxcruz|ruck, you got a second? | 13:04 |
| arxcruz|ruck | weshay|ruck: yes | 13:04 |
| *** ratailor has quit IRC | 13:04 | |
| arxcruz|ruck | weshay|ruck: we cancel today's tempest meeting | 13:04 |
| weshay|ruck | arxcruz|ruck, https://meet.google.com/zvw-hnds-ncu?authuser=1 | 13:04 |
| *** pojadhav is now known as pojadhav|afk | 13:04 | |
| weshay|ruck | rlandy, https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/container-push/roles/containers-promote | 13:04 |
| pojadhav|afk | \ME going out a bit.. will be back in 1-2 hrs | 13:05 |
| arxcruz|ruck | weshay|ruck: http://38.102.83.131/quay/copy-quay.txt | 13:10 |
| arxcruz|ruck | weshay|ruck: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push-victoria/b42e2fd/logs/containers-built.log | 13:15 |
| weshay|ruck | arxcruz|ruck, https://termbin.com/iuthg | 13:16 |
| *** ysandeep|call is now known as ysandeep|rover | 13:16 | |
| *** ykarel_ has joined #oooq | 13:24 | |
| sshnaidm | weshay|ruck, https://review.rdoproject.org/r/#/c/31929/ - this should fix not updating grafana on site | 13:25 |
| sshnaidm | weshay|ruck, frenzy_friday discovered that renaming this file failed updating of dashboards | 13:26 |
| weshay|ruck | sshnaidm, is that a private import? | 13:27 |
| * weshay|ruck not familiar w/ _module | 13:27 | |
| *** ykarel has quit IRC | 13:27 | |
| sshnaidm | weshay|ruck, ? | 13:28 |
| *** amoralej|lunch is now known as amoralej | 13:30 | |
| weshay|ruck | sshnaidm, https://review.rdoproject.org/r/#/c/31929/2/ci-scripts/infra-setup/roles/rrcockpit/files/grafana/grafana-alert-notification-server.py | 13:30 |
| weshay|ruck | line 3 | 13:30 |
| sshnaidm | weshay|ruck, it's _thread in py3 | 13:30 |
| weshay|ruck | ah k | 13:31 |
| weshay|ruck | that is all :) | 13:31 |
| sshnaidm | but just renaming it failed in https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/grafana/entrypoint.sh#L23 | 13:31 |
| sshnaidm | grafana sidecar was restarting non-stop | 13:32 |
| sshnaidm | and didn't update | 13:32 |
| *** jpena|lunch is now known as jpena | 13:33 | |
| weshay|ruck | sshnaidm, ah.. thanks .. good catch | 13:34 |
| *** ykarel_ is now known as ykarel | 13:40 | |
| weshay|ruck | ysandeep|rover, is this one ready? | 13:42 |
| weshay|ruck | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445 | 13:42 |
| ysandeep|rover | weshay|ruck, testproject is currently running https://review.rdoproject.org/r/#/c/28537/ , but we have passed the earlier error | 13:43 |
| ysandeep|rover | green run on stein https://logserver.rdoproject.org/37/28537/7/check/periodic-tripleo-ci-centos-7-standalone-stein/e19d373/ | 13:43 |
| weshay|ruck | ysandeep|rover, k.. thanks | 13:44 |
| ysandeep|rover | I will remove wip as soon as all jobs reports and green | 13:44 |
| weshay|ruck | ysandeep|rover, what's missing from this bug? https://bugs.launchpad.net/tripleo/+bug/1914993 | 13:45 |
| openstack | Launchpad bug 1914993 in tripleo "Jobs fails on stein and older branches with ERROR! the role 'tripleo_validations' was not found" [Undecided,Triaged] | 13:45 |
| weshay|ruck | re: the settings not content | 13:45 |
| ysandeep|rover | weshay|ruck, https://review.opendev.org/c/openstack/tripleo-validations/+/774747 is in gate | 13:46 |
| weshay|ruck | k | 13:46 |
| weshay|ruck | ysandeep|rover, https://bugs.launchpad.net/tripleo/+bug/1914993 | 13:46 |
| weshay|ruck | ysandeep|rover, what's wrong w/ thaat bug? | 13:47 |
| ysandeep|rover | weshay|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445 is for ^^ | 13:47 |
| weshay|ruck | ysandeep|rover, look at how it's triaged | 13:48 |
| weshay|ruck | what's incorrect? | 13:48 |
| ysandeep|rover | weshay|ruck, oops, corrected | 13:48 |
| ysandeep|rover | rlandy, weshay|ruck https://code.engineering.redhat.com/gerrit/#/c/227239/ to fix BM jobs in 16.2 | 13:50 |
| ysandeep|rover | periodic-tripleo-ci-rhel-8-scenario001-standalone-rhos-16.2 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/1854132f63f64bf38b12a5c2a834c241 : SUCCESS in 1h 33m 55s (non-voting) is green with ^^ | 13:50 |
| weshay|ruck | ysandeep|rover, k.. thanks.. also it's blocking multiple branches atm.. IMO that's worth socializing on the cix board | 13:50 |
| ysandeep|rover | fs001 - periodic-tripleo-ci-rhel-8-bm_envB-3ctlr_1comp-featureset001-baremetal-rhos-16.2 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/2a0068d66cb64ecdb44fd82453af308e : SUCCESS in 4h 49m 13s | 13:50 |
| weshay|ruck | ysandeep|rover, can you please update it w/ "promotion-blocker" .. I want the validations team to look at preventative actions on this | 13:50 |
| ysandeep|rover | weshay|ruck, adding | 13:51 |
| rlandy | weshay|ruck: frenzy_friday: want to meet later today wrt testproject job and testing stream? | 13:51 |
| weshay|ruck | akahat, bhagyashris | 13:52 |
| weshay|ruck | 2021-02-10 13:47:40,375 p=782735 u=promoter n=ansible | fatal: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specif│················ied for this result", "changed": false} │················2021-02-10 13:47:40,382 p | 13:52 |
| weshay|ruck | =782735 u=promoter n=ansible | TASK [containers-promote : list all local images from source registry] | 13:52 |
| rlandy | I abandoned the testproject job - so it has not run yet | 13:52 |
| weshay|ruck | I probably did not resource registry | 13:52 |
| frenzy_friday | weshay|ruck, sure 17 UTC? | 13:54 |
| weshay|ruck | frenzy_friday, ? | 13:54 |
| weshay|ruck | akahat, bhagyashris ok.. remove the no_log from code on the server..... | 13:54 |
| weshay|ruck | rerun the command I'm running | 13:54 |
| weshay|ruck | akahat, bhagyashris understood? | 13:54 |
| sshnaidm | weshay|ruck, wrt https://review.opendev.org/c/openstack/tripleo-ci/+/773629 - it's exactly what configured in ci and has nothing to do with the patch: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/multinode-jobs.yaml#L326-L348 | 13:56 |
| jbadiapa | ysandeep|rover, weshay|ruck: the tripleo_validations is also failing in master branch https://bugs.launchpad.net/tripleo/+bug/1915265 | 13:57 |
| openstack | Launchpad bug 1915265 in tripleo "The tripleo_validations & run_tripleo_validations_negative_tests are missing from the minimal scenario" [Undecided,New] | 13:57 |
| weshay|ruck | sshnaidm, k.. any suggestions? seems odd to have a run through the gate w/ 3-4 content providers and no deployments.. Is there anything we should do? | 13:57 |
| sshnaidm | weshay|ruck, to add these job in gate in link I pasted | 13:57 |
| sshnaidm | weshay|ruck, idk if it's required though, it's just jobs definitions changes | 13:58 |
| ysandeep|rover | matbu, ^^ fyi.. https://bugs.launchpad.net/tripleo/+bug/1915265 | 13:58 |
| openstack | Launchpad bug 1915265 in tripleo "The tripleo_validations & run_tripleo_validations_negative_tests are missing from the minimal scenario" [Undecided,New] | 13:58 |
| weshay|ruck | sshnaidm, k.. I'll remove my -1 but let's get other cores on it.. marios has a +1, perhaps rlandy can vote | 13:59 |
| weshay|ruck | https://review.opendev.org/c/openstack/tripleo-ci/+/773629 | 13:59 |
| akahat | weshay|ruck, okay. let me try it. | 13:59 |
| bhagyashris | weshay|ruck, you mean no_log value should be false right? | 14:01 |
| jbadiapa | matbu, ysandeep|rover: I dont know why the patch https://review.opendev.org/c/openstack/tripleo-quickstart/+/774840 was not linked to the bug https://bugs.launchpad.net/tripleo/+bug/1915265 | 14:01 |
| openstack | Launchpad bug 1915265 in tripleo "The tripleo_validations & run_tripleo_validations_negative_tests are missing from the minimal scenario" [Undecided,New] | 14:01 |
| weshay|ruck | bhagyashris, aye.. we need to see what the error is | 14:01 |
| ysandeep|rover | jbadiapa, new gerrit, we are posting comments on launchpad for now | 14:02 |
| bhagyashris | weshay|ruck, ok | 14:03 |
| jbadiapa | ack, thx | 14:03 |
| *** ksambor has joined #oooq | 14:09 | |
| akahat | weshay|ruck, we ran the script again you can check logs here http://10.0.111.180/20210210-140831.log | 14:10 |
| weshay|ruck | akahat, aye.. I'm on the box | 14:10 |
| akahat | cool | 14:13 |
| * akahat will be back after some time. | 14:14 | |
| ysandeep|rover | arxcruz|ruck, list of jobs http://paste.openstack.org/show/802516/ | 14:18 |
| arxcruz|ruck | ysandeep|rover: thanks, i'll write a patch | 14:18 |
| *** jlarriba has joined #oooq | 14:19 | |
| ysandeep|rover | arxcruz|ruck, thanks! I am yet to try add tempest skiplist cli.. i will try later today/ tomorrow morning | 14:19 |
| arxcruz|ruck | ysandeep|rover: if you need help, let me know | 14:21 |
| arxcruz|ruck | ysandeep|rover: weshay|ruck rlandy marios https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/774868 | 14:21 |
| marios | arxcruz|ruck: NEVER | 14:22 |
| arxcruz|ruck | sudo | 14:22 |
| ysandeep|rover | arxcruz|ruck, thanks! | 14:24 |
| ysandeep|rover | arxcruz|ruck, when you have time.. can you please give pointer on why this job timedout while running tempest :) | 14:25 |
| ysandeep|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset035-internal-rhos-16.2/17f758e/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 14:25 |
| ysandeep|rover | weare strugging with 16.2 promotion and tempest timeout is one of the failure we are hitting | 14:26 |
| ysandeep|rover | we* are | 14:26 |
| ysandeep|rover | rlandy, weshay|ruck whenever you have time https://code.engineering.redhat.com/gerrit/#/c/227239/ | 14:27 |
| arxcruz|ruck | ysandeep|rover: too many tests running ? | 14:27 |
| weshay|ruck | ysandeep|rover, re: http://tripleo-cockpit.usersys.redhat.com/d/KyHCwLHMk/rhos-16-2-full-component-pipeline?viewPanel=483&orgId=1 | 14:28 |
| weshay|ruck | is metalsmith in 16.2 the supported provisioning for bm now? | 14:28 |
| weshay|ruck | and we should promote that component based on your results? | 14:29 |
| ysandeep|rover | weshay|ruck, yes its in tech preview not fully supported | 14:29 |
| weshay|ruck | k | 14:29 |
| ysandeep|rover | weshay|ruck, the keystone error we are facing in ovb job is not consistent(hitting both component/promotion line) - yes i think we can promote that component | 14:31 |
| ysandeep|rover | weshay|ruck, fyi.. I replied to your email on 16.2 | 14:31 |
| ysandeep|rover | rlandy, rhos_release_args is defined above in same file https://code.engineering.redhat.com/gerrit/#/c/227239/2/config/release/promotion-testing-hash-rhos-16.2.yml@3 | 14:37 |
| ysandeep|rover | all 16.2 and 17 files have that defined | 14:37 |
| rlandy | revoted | 14:38 |
| ysandeep|rover | thanks! | 14:39 |
| jbadiapa | does anyone hit the error "Check Default IPv4 Gateway availability" deploying the overcloud https://bugs.launchpad.net/tripleo/+bug/1915278? | 14:41 |
| openstack | Launchpad bug 1915278 in tripleo "Error at "Check Default IPv4 Gateway availability" deploying the overcloud" [Undecided,New] | 14:41 |
| ysandeep|rover | jbadiapa, i have not , arxcruz|ruck, ^^ have you seen this in ci? | 14:46 |
| jbadiapa | ysandeep|rover, not ci, depoying it manually... besides I had the run_tripleo_validations=false and run_tripleo_validations_negative_tests=false when I deployed the env | 14:47 |
| jbadiapa | just one last question, is the undercloud able to deploy an environment without swift? | 14:48 |
| weshay|ruck | rlandy, just informed our candidates about the outtage | 14:48 |
| rlandy | weshay|ruck: k - unfortunate | 14:49 |
| weshay|ruck | shitty communication | 14:49 |
| rlandy | should be fine - couple hours | 14:49 |
| rlandy | we just need to make sure the nodes come back in good order | 14:49 |
| rlandy | weshay|ruck: I had to nuke mine to have enough RAM | 14:49 |
| jbadiapa | cos I also hit an error when enable_swift=false on the undercloud.conf | 14:49 |
| ysandeep|rover | jbadiapa, when you disable nova in undercloud too / we can have an env without swift | 14:49 |
| rlandy | will put mine back on internal | 14:50 |
| jbadiapa | ysandeep|rover, thx, but that's not the default setup, isnt it? | 14:51 |
| ysandeep|rover | ykarel, reviews please whenever you have time https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445 | 14:51 |
| weshay|ruck | ysandeep|rover, so metalsmith is working in 16.2 on bm env.. however the older job.. periodic-tripleo-ci-rhel-8-bm_envB-3ctlr_1comp-featureset001-baremetal-rhos-16.2 is not | 14:51 |
| ysandeep|rover | weshay|ruck, ^^ it passed here https://code.engineering.redhat.com/gerrit/#/c/211494/ | 14:52 |
| ysandeep|rover | periodic-tripleo-ci-rhel-8-bm_envB-3ctlr_1comp-featureset001-baremetal-rhos-16.2 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/2a0068d66cb64ecdb44fd82453af308e : SUCCESS in 4h 49m 13s | 14:52 |
| ysandeep|rover | weshay|ruck, https://code.engineering.redhat.com/gerrit/#/c/227239/ is needed to fix bm jobs | 14:53 |
| ysandeep|rover | old ovb jobs is failing with random issue infra issue/ keystone one is on cix | 14:54 |
| ysandeep|rover | jbadiapa, for master - nova less deploy is way to go , see this https://specs.openstack.org/openstack/tripleo-specs/specs/stein/nova-less-deploy.html | 14:55 |
| ysandeep|rover | jbadiapa, swift removal is not completely done yet https://specs.openstack.org/openstack/tripleo-specs/specs/wallaby/excise-swift.html few patches are left | 14:56 |
| jbadiapa | ysandeep|rover, ack, thx | 14:57 |
| ykarel | ysandeep|rover, +2 | 14:59 |
| ysandeep|rover | ykarel, thanks! | 14:59 |
| ysandeep|rover | jbadiapa, I will try manual deployment tomorrow morning to see if i can replicate the issue, but in the meantime if you can ping your bug 1915278 on #tripleo.. we might get some good help. | 15:02 |
| openstack | bug 1915278 in tripleo "Error at "Check Default IPv4 Gateway availability" deploying the overcloud" [Undecided,New] https://launchpad.net/bugs/1915278 | 15:02 |
| jbadiapa | thx I will | 15:03 |
| ysandeep|rover | weshay|ruck, rlandy matbu Tengu request for review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445 whenever time permits. | 15:04 |
| Tengu | how much do you pay? :) | 15:04 |
| ysandeep|rover | Tengu, as many karma point you want on internal channel :) | 15:05 |
| Tengu | :D | 15:05 |
| Tengu | can't really +A, it's way out of the validations context, even if it talks about validations... | 15:07 |
| Tengu | but it sure does sound reasonable and legit. | 15:07 |
| ysandeep|rover | Tengu, thanks! i will request someone from ci to +W it | 15:08 |
| Tengu | sounds good! | 15:08 |
| *** ysandeep|rover is now known as ysandeep|dinner | 15:09 | |
| arxcruz|ruck | ysandeep|dinner: nope | 15:14 |
| marios | rlandy: weshay|ruck: sshnaidm: ysandeep|dinner: please add to your reviews list thank you https://review.rdoproject.org/r/#/c/31539/ (https://projects.engineering.redhat.com/browse/TRIPLEOCI-197 centos) https://code.engineering.redhat.com/gerrit/#/c/226592/ https://code.engineering.redhat.com/gerrit/#/c/224480/ https://code.engineering.redhat.com/gerrit/#/c/224481/ | 15:25 |
| marios | (https://projects.engineering.redhat.com/browse/TRIPLEOCI-294 rhel) | 15:25 |
| marios | some of thos just need worfklow/i don't have perms on internal sf | 15:25 |
| * marios raises iced tea | 15:26 | |
| marios | thanks | 15:26 |
| *** ysandeep|dinner is now known as ysandeep|rover | 15:29 | |
| ysandeep|rover | marios, ack | 15:29 |
| ysandeep|rover | arxcruz|ruck, cix time :D | 15:29 |
| arxcruz|ruck | ysandeep|rover: i'm already there | 15:29 |
| arxcruz|ruck | waiting | 15:29 |
| *** saneax has quit IRC | 15:43 | |
| weshay|ruck | ysandeep|rover, can you jump on w/ me | 15:51 |
| ysandeep|rover | weshay|ruck, sure | 15:51 |
| weshay|ruck | ysandeep|rover, meet.google.com/hin-bpry-zcs | 15:51 |
| *** ykarel is now known as ykarel|away | 15:54 | |
| *** skramaja_ has quit IRC | 15:56 | |
| *** pojadhav|afk is now known as pojadhav | 15:57 | |
| ysandeep|rover | weshay|ruck, https://review.rdoproject.org/r/#/c/31849/ fyi.. still wip | 16:02 |
| ysandeep|rover | weshay|ruck, i lost you | 16:03 |
| *** jmasud has joined #oooq | 16:12 | |
| *** ykarel|away has quit IRC | 16:17 | |
| ysandeep|rover | weshay|ruck, fyi.. testing fs001 in integration line https://code.engineering.redhat.com/gerrit/#/c/215285/ , will switch to fs035 if it passes | 16:27 |
| weshay|ruck | ++ | 16:27 |
| *** jmasud has quit IRC | 16:28 | |
| *** jmasud has joined #oooq | 16:29 | |
| *** marios has quit IRC | 16:31 | |
| ysandeep|rover | weshay|ruck, rlandy https://code.engineering.redhat.com/gerrit/#/c/227361/ dropping ovb version of jobs from component criteria , we will rely on real bm jobs | 16:45 |
| weshay|ruck | ysandeep|rover, can you add a comment in the code.. referring to the stablity of the cloud and that we can change it back if stability improves | 16:47 |
| ysandeep|rover | weshay|ruck, adding | 16:47 |
| ysandeep|rover | weshay|ruck, https://code.engineering.redhat.com/gerrit/#/c/227361/3 | 16:52 |
| weshay|ruck | ysandeep|rover++ | 16:52 |
| * ysandeep|rover leaves for the day, see you tomorrow | 16:53 | |
| *** ysandeep|rover is now known as ysandeep|away | 16:54 | |
| ysandeep|away | weshay|ruck, rlandy fyi.. Today in 16.2 run - ovb job didn't hit retry_limit.. lets see how it goes.. fyi.. sc010 failure is expected - we added test in skiplist later | 16:55 |
| weshay|ruck | ++ | 16:56 |
| rlandy | ysandeep|away++ thanks | 17:01 |
| weshay|ruck | rlandy, https://cloud.centos.org/centos/8-stream/x86_64/images/ | 17:08 |
| weshay|ruck | rlandy, CentOS-Stream-GenericCloud-8-20201217.0.x86_64.qcow2 | 17:09 |
| weshay|ruck | frenzy_friday, https://cloud.centos.org/centos/8-stream/x86_64/images/CentOS-Stream-GenericCloud-8-20201217.0.x86_64.qcow2 | 17:10 |
| weshay|ruck | https://opendev.org/openstack/tripleo-repos/src/branch/master/tripleo_repos/main.py#L498-L507 | 17:16 |
| weshay|ruck | frenzy_friday, ^ | 17:16 |
| *** jmasud has quit IRC | 17:17 | |
| *** udesale_ has quit IRC | 17:17 | |
| weshay|ruck | frenzy_friday, https://opendev.org/openstack/tripleo-repos/commit/a25bdf7233a6d1397cff8442ea304161e4d42303 | 17:21 |
| weshay|ruck | https://opendev.org/openstack/tripleo-repos/commit/a25bdf7233a6d1397cff8442ea304161e4d42303 | 17:23 |
| *** amoralej is now known as amoralej|off | 17:29 | |
| *** jpodivin has quit IRC | 17:30 | |
| *** jmasud has joined #oooq | 17:42 | |
| akahat | weshay|ruck, \o/ login succeed. | 17:47 |
| weshay|ruck | akahat, oh hell ya | 17:47 |
| weshay|ruck | akahat, 2021-02-10 17:45:35,289 p=803019 u=promoter n=ansible | changed: [localhost] => {"changed": true, "login_result": {"IdentityToken": "", "Status": "Login Succeeded"}} | 17:48 |
| weshay|ruck | akahat, bhagyashris ok.. let's catch up tomorrow | 17:49 |
| weshay|ruck | frenzy_friday, rlandy fyi https://hackmd.io/9Xve-rYpRaKbk5NMe7kukw | 17:50 |
| weshay|ruck | frenzy_friday, obviously do not update both jira and this | 17:51 |
| *** jbadiapa has quit IRC | 17:51 | |
| weshay|ruck | imho keep it in the hackmd.. it's easier to socialize the change everywhere we need to | 17:51 |
| frenzy_friday | weshay|ruck, ok, thanks for the hackmd | 17:52 |
| weshay|ruck | akahat, ok.. it's pulling the containers now.. next you'll see it push | 17:52 |
| rlandy | thank you | 17:52 |
| weshay|ruck | akahat, it will not promote though, and that's fine.. because of the overcloud images | 17:53 |
| weshay|ruck | akahat, bhagyashris success at this moment = "we see a few of these containers in docker.io" | 17:53 |
| akahat | that's great!! | 17:54 |
| weshay|ruck | aye | 17:54 |
| *** derekh has quit IRC | 18:00 | |
| *** jpena is now known as jpena|off | 18:01 | |
| *** saneax has joined #oooq | 18:13 | |
| rlandy | weshay|ruck: merging marios's downstream dep work | 18:25 |
| weshay|ruck | rock | 18:25 |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/224481/20 | 18:26 |
| weshay|ruck | rlandy, seems like the ansible dep pipeline is very much up in the air | 18:27 |
| weshay|ruck | but could be very handy if we have to maintain it ourselves | 18:27 |
| rlandy | weshay|ruck: yeah - may need to shelve that until DF works out what will be viable | 18:28 |
| rlandy | weshay|ruck: ysandeep|away is rucking anyways this sprint | 18:28 |
| rlandy | so work on that is halted anyways | 18:28 |
| weshay|ruck | rlandy, funny how that's not top of the agenda eh | 18:28 |
| rlandy | weshay|ruck: we are just ahead of our times | 18:28 |
| rlandy | merging downstream and rdo for openvswitch | 18:32 |
| rlandy | now for container tools | 18:32 |
| rlandy | weshay|ruck: ok - afaict marios and chan's dep work is all merged up | 18:39 |
| weshay|ruck | k | 18:40 |
| rlandy | weshay|ruck: what do you want to do about 16.2 | 18:44 |
| rlandy | see latest results fs020 passed | 18:45 |
| *** dtantsur is now known as dtantsur|afk | 18:45 | |
| rlandy | ysandeep|away, said sc010 failure would be added to skip | 18:45 |
| rlandy | hmm .. fs001 is still with the keystone failure "824605934912.288025", "ansible_loop_var": "tripleo_keystone_resources_user_role_async_result_item", "attempts": 30, "changed": false, "finished": 0, "started": 1, "tripleo_keystone_resources_user_role_async_result_item": {"ansible_job_id": "824605934912.288025", "ansible_loop_var": "tripleo_keystone_resources_data_user", "changed": true, "failed": false, "finished": 0, | 18:46 |
| rlandy | "results_file": "/root/.ansible_async/824605934912.288025", "started": 1, "tripleo_keystone_resources_data_user": {"placement": {"project": "service"}}}} | 18:46 |
| rlandy | 2021-02-10 12:29:29 | 2021-02-10 12:29:28.427925 | fa163ec1-b785-2403-ee5a-000000004501 | TIMING | tripleo-keystone-resources : Check Keystone user assign | 18:46 |
| rlandy | weshay|ruck: ^^ before the hash changes, do we want to promote this 16.2 or leave it ... following on ysandeep|away's comment ... | 18:51 |
| rlandy | weshay|ruck, rlandy fyi.. Today in 16.2 run - ovb job didn't hit retry_limit.. lets see how it goes.. fyi.. sc010 failure is expected - we added test in skiplist later | 18:51 |
| rlandy | <weshay|ruck> ++ | 18:51 |
| rlandy | otherwise starting work back on 8.4 | 18:51 |
| weshay|ruck | rlandy, the context of a conversation I had w/ ysandeep|away this morning was... | 18:52 |
| weshay|ruck | rlandy, while we are seeing inconsistent results from the internal cloud | 18:52 |
| weshay|ruck | replace ovb jobs w/ real bm | 18:53 |
| weshay|ruck | use 035 in leui of 001 to save hardware | 18:53 |
| weshay|ruck | and remove 001 from criteria where needed | 18:53 |
| rlandy | weshay|ruck: ok - so leave the promotion for today | 18:53 |
| rlandy | weshay|ruck: k - ... going back to 8.4 work unless you want me on something else | 18:54 |
| weshay|ruck | rlandy, afaik.. we also have scenario010 and a few other failing for 16.2 | 18:54 |
| weshay|ruck | 8.4 sounds fine | 18:54 |
| rlandy | yep scen010 was going in skiplist | 18:54 |
| rlandy | cool | 18:54 |
| *** jmasud has quit IRC | 19:15 | |
| *** jmasud has joined #oooq | 19:16 | |
| *** jmasud has quit IRC | 19:20 | |
| *** slaweq has quit IRC | 19:49 | |
| *** jfrancoa has joined #oooq | 20:05 | |
| *** jmasud has joined #oooq | 20:45 | |
| *** jmasud has quit IRC | 21:28 | |
| rlandy | weshay|ruck: ugh can're reproduce the dnf mark install error on am 8.4 node but the image build job fails consistently with it | 21:42 |
| rlandy | hmmm ... node update | 21:43 |
| *** jfrancoa has quit IRC | 21:45 | |
| *** jmasud has joined #oooq | 22:35 | |
| *** jmasud has quit IRC | 23:07 | |
| *** rlandy has quit IRC | 23:30 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!