Tuesday, 2020-02-18

*** jmasud has quit IRC00:12
*** jmasud has joined #oooq00:13
*** jmasud has quit IRC00:58
*** jmasud has joined #oooq00:59
*** rlandy has quit IRC01:10
*** Goneri has quit IRC01:25
*** jbadiapa has quit IRC01:29
*** rfolco has quit IRC02:33
*** rfolco has joined #oooq02:33
*** rfolco has quit IRC02:38
*** udesale has joined #oooq04:10
*** jmasud has quit IRC04:12
*** jmasud has joined #oooq04:13
*** ykarel|away is now known as ykarel05:16
*** ykarel is now known as ykarel|mtg05:47
*** skramaja has joined #oooq05:49
*** udesale_ has joined #oooq05:51
*** udesale has quit IRC05:52
*** raukadah is now known as chandankumar06:02
*** marios|ruck has joined #oooq06:10
*** ratailor has joined #oooq06:23
*** saneax has joined #oooq07:01
*** ykarel|mtg is now known as ykarel07:10
marios|ruckbrb07:33
*** marios|ruck has quit IRC07:33
*** ccamacho has quit IRC07:34
*** ccamacho has joined #oooq07:34
*** dpawlik has joined #oooq07:38
*** marios has joined #oooq07:38
*** marios is now known as marios|ruck07:40
dpawlikchandankumar, o/07:46
dpawlikchandankumar, if jpena|off comes, we can start change the DNS records07:46
*** tesseract has joined #oooq08:02
*** jmasud has quit IRC08:13
*** jmasud has joined #oooq08:14
marios|ruckanyone to hit +A there please https://review.opendev.org/#/c/701937/08:31
*** tosky has joined #oooq08:32
*** amoralej|off is now known as amoralej08:32
*** bogdando has joined #oooq08:36
chandankumarmarios|ruck, done08:43
chandankumardpawlik, sure, I have putted the patches in place08:44
chandankumardpawlik, marios|ruck sshnaidm|afk find round of patches for image server migration https://review.rdoproject.org/r/24984 -> https://review.opendev.org/708299 -> https://review.opendev.org/708300 fs01 is expected to fail new address dns is not yet populated08:45
chandankumardpawlik, need one more help08:45
zbrmarios|ruck: chandankumar: based on my tests, it is now safe to upgrade molecule to 3.0a9 (fixes all issues appeared after a5)08:45
chandankumardpawlik, please upload centos-8 qcow2 image on image server08:45
chandankumardpawlik, it was the c7 image https://images.rdoproject.org/CentOS-7-x86_64-GenericCloud.qcow2 we need c8 image now there08:46
zbrplease help w/ https://review.opendev.org/#/c/708021/ https://review.opendev.org/#/c/708022/08:47
chandankumarzbr, do we have a taiga task for that?08:48
zbri want to upgrade all our jobs to that version today08:48
marios|ruckthanks zbr08:48
zbrchandankumar: do you have a taga for your breakfast cereals? ;)08:49
chandankumarzbr, hehe08:49
zbrin fact we have, but i forgot to add it to the reviews08:50
zbris https://tree.taiga.io/project/tripleo-ci-board/task/1540?kanban-status=144727508:50
chandankumarzbr, https://review.opendev.org/#/c/708022/308:51
*** jpena|off is now known as jpena08:52
chandankumarzbr, can we add more info related to files addition in job in the commit message?08:55
zbrdone08:58
zbrsome of them take a very long time to run, but if there is another change needed, i will also add the link.08:59
*** fmount has quit IRC09:01
dpawlikweshay|ruck, https://review.rdoproject.org/r/#/c/24926/ => I hope it will be ok. It base on jpena + david script https://review.rdoproject.org/r/gitweb?p=rdo-infra/rdo-infra-playbooks.git;a=blob;f=roles/rdo-infra/image-server/files/prune_tripleo_images.sh;h=5a0d070a1d1b9151713e50285636bd6cafd7e332;hb=HEAD09:02
dpawlikchandankumar, searching centos-8 qcow209:03
dpawlikchandankumar, is this https://cloud.centos.org/centos/8/x86_64/images/CentOS-8-GenericCloud-8.1.1911-20200113.3.x86_64.qcow2 ?09:04
chandankumardpawlik, I think yes09:06
dpawlikShould I change the name or not required?09:06
chandankumardpawlik, it is not required09:07
dpawlikchandankumar, so its done on images-vexxhost09:10
dpawlikchandankumar, can we start changing the DNS etries?09:10
chandankumardpawlik, updating the commit message09:11
chandankumarmarios|ruck, can you check the commit message now https://review.opendev.org/708300 ?09:13
dpawlikchandankumar, but... those CI tests will fail, so its not better to abandon temporary and restore after migration?09:16
chandankumardpawlik, yes, we can do that09:16
chandankumardpawlik, does the new address got populated?09:17
chandankumarlet me do a test run on rdo side09:17
*** jfrancoa has joined #oooq09:18
marios|ruckchandankumar: thanks helps09:18
dpawlikchandankumar, I'm waiting for you to notice me that we can do the change xD09:19
chandankumardpawlik, +1 on merging this patch https://softwarefactory-project.io/r/#/c/17428/09:19
dpawlikjpena, we can change the DNS for images host09:20
jpenadpawlik: done!09:24
jpenanow it's time to wait for propagation09:25
*** derekh has joined #oooq09:25
chandankumardpawlik, jpena marios|ruck, https://review.rdoproject.org/r/#/c/24984/ once propogation done, merge this also09:25
chandankumarso that we can fire up test project changes to test periodic and check with new url09:27
*** fmount has joined #oooq09:32
marios|ruckchandankumar: ack09:33
zbrchandankumar: marios|ruck help me merge https://review.opendev.org/#/c/706237/ -- it improves only testing, no production effects.09:34
zbrit is quite important, because until now, the publish.yml was never run by any molecule tests.09:34
*** ccamacho has quit IRC09:34
zbrthis runs most of it.09:34
zbrto be more exact ~70z coverage, is more than 0%.09:35
marios|ruckzbr: ack09:37
zbrgating with do the recheck09:37
zbrnotest is quite a nice tag that we ofter forget about09:38
zbrcan prove very useful09:38
chandankumardpawlik, one query does dns propogation is done manually?09:43
chandankumaras https://softwarefactory-project.io/r/#/c/17428/ this one is not merged yet09:43
dpawlikchandankumar, propagation is still ongoinh09:45
dpawlikimages.rdoproject.org.  3359    IN      CNAME   images-vexxhost.rdoproject.org.09:45
dpawlikimages-vexxhost.rdoproject.org. 3359 IN A       38.102.83.15209:45
dpawlikchandankumar, if we merge that, sf CI will fail09:46
dpawlikon creating the new cert for the host09:46
jpenasshnaidm|afk: the rhel-8 images are now updated and should not have any python 2 bits. Once you have a chance to test it, please let me know if everything looks fine09:58
sshnaidm|afkchandankumar, commented on patches09:58
sshnaidm|afkjpena, thanks, will recheck jobs now. let's check09:59
*** sshnaidm|afk is now known as sshnaidm09:59
*** holser has joined #oooq10:03
dpawlikchandankumar, FYI google and lcoud flare dns is resolving correctly, merging 1742810:04
*** dtantsur|afk is now known as dtantsur10:05
chandankumardpawlik, sshnaidm sorry was in a meeting10:17
sshnaidmmarios|ruck, did we start to run ci.centos jobs again on patches? :o https://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-full-featureset052/3810/console10:18
sshnaidmRedHat RDO CI  tripleo-quickstart-extras-gate-master-delorean-full-featureset05210:19
sshnaidmlast time it ran a year ago10:20
marios|rucksshnaidm: not that I'm aware of ... at least I haven't changed something related. i was looking at the https://bugs.launchpad.net/tripleo/+bug/1863632 now getting vm but didn't change something in triggers/any related10:20
openstackLaunchpad bug 1863632 in tripleo "lastest virtenv workarounds broke native tripleo-quickstart install" [Critical,Triaged]10:20
sshnaidmmarios|ruck, zombie jobs10:21
chandankumarsshnaidm, https://review.rdoproject.org/r/#/c/24984/ please +w it10:21
chandankumardpawlik, thanks!10:21
sshnaidmchandankumar, done, please add ovb-vexxhost changes in other patch10:22
chandankumarsshnaidm, done that also10:22
marios|rucksshnaidm: maybe weshay|ruck enabled last night or something10:25
sshnaidmmarios|ruck, yeah, it was checking quickstart.sh workflow once10:27
marios|rucksshnaidm: guess he added it again cos of that new bug hitting ci centos yesterday10:28
chandankumardpawlik, Does the c8 image added to the image server?10:32
chandankumarwhatis the address10:32
dpawlikchandankumar, http://images-vexxhost.rdoproject.org/CentOS-8-GenericCloud-8.1.1911-20200113.3.x86_64.qcow2 and also http://images.rdoproject.org/CentOS-8-GenericCloud-8.1.1911-20200113.3.x86_64.qcow210:38
chandankumardpawlik, thanks!10:43
dpawlikboth domains are working10:44
dpawlikchandankumar, doing final sync and then disable uploader on old server10:44
chandankumardpawlik, sure10:44
*** udesale_ has quit IRC10:57
*** ykarel is now known as ykarel|afk11:09
dpawlikchandankumar, sync ongoing... it goes very slow11:14
dpawlikso you need to be patient with https://review.opendev.org/#/c/708300/ and https://review.opendev.org/#/c/708299/11:14
chandankumardpawlik, we will wait for your final ack ont hose11:15
*** ykarel|afk is now known as ykarel11:26
*** rfolco has joined #oooq11:55
*** amoralej is now known as amoralej|lunch11:59
chandankumarmarios|ruck, https://bugs.launchpad.net/tripleo/+bug/1863750 bug added to promotion blocker , failing in stable/stein gate till I investigate soniya29 is moving the test to ksip list12:02
openstackLaunchpad bug 1863750 in tripleo "test_create_server_from_volume_snapshot tests failing with Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating" [Critical,Confirmed]12:02
marios|ruckthanks chandankumar looking12:04
*** ykarel is now known as ykarel|afk12:09
soniya29chandankumar: marios|ruck, moved test to skip list.12:12
marios|rucksoniya29: nice thanks review ?12:12
marios|rucksoniya29: never mind see it in tripleo thanks12:12
weshay|ruckmarios|ruck, 0/12:13
*** jmasud has quit IRC12:13
soniya29marios|ruck, review:- https://review.opendev.org/#/c/708368/12:13
*** jmasud has joined #oooq12:14
weshay|rucksoniya29++12:14
marios|rucksoniya29: looks like weshay|ruck beat me to it... for next time please consider the comment in the commit message thanks12:15
weshay|ruckzbr, 0/12:15
marios|ruckweshay|ruck: o/ morgen12:15
weshay|ruckmarios|ruck, howdy.. let's sync before we loose the day :)12:16
soniya29marios|ruck, i will update commit message right now. give me a min. :)12:16
marios|ruckweshay|ruck: sure gime 2 mins12:16
marios|ruckweshay|ruck: ack12:16
weshay|ruckzbr, /me wondering what you did in python land to fix virtenv12:16
weshay|ruckTo join the video meeting, click this link: https://meet.google.com/hfq-hnrp-mbi12:16
weshay|ruckOtherwise, to join by phone, dial +1 336-715-1725 and enter this PIN: 855 175#12:16
weshay|ruckTo view more phone numbers, click this link: https://tel.meet/hfq-hnrp-mbi?hs=512:16
weshay|ruckmarios|ruck, ^12:16
soniya29marios|ruck: weshay|ruck, Done!12:18
marios|ruckweshay|ruck: joining12:19
chandankumardpawlik, does the sync done?12:21
weshay|ruckmarios|ruck,12:22
weshay|ruck19:51:18 checking python modules12:22
weshay|ruck19:51:18 pip:10.0.0 virtualenv:15.2.0 setuptools:0.9.812:22
weshay|ruckmarios|ruck, https://review.opendev.org/#/c/708264/1/install-deps.sh12:23
weshay|rucknot working12:23
*** marios|ruck is now known as marios|ruck|call12:23
weshay|ruckmarios|ruck, https://review.opendev.org/#/c/707525/ https://review.opendev.org/#/c/707062/12:24
marios|ruck|callchecking python modules12:30
marios|ruck|callpip:8.1.2 virtualenv:15.1.0 setuptools:0.9.812:30
marios|ruck|callweshay|ruck: mine like ^12:31
chandankumarweshay|ruck, marios|ruck|call does the venv issue again poped up?12:32
chandankumarbrb12:32
weshay|rucksshnaidm, one sec12:33
weshay|ruckmarios|ruck|call, https://virtualenv.pypa.io/en/latest/changelog.html12:33
weshay|ruckzbr++12:33
weshay|ruckzbr++ https://github.com/pypa/virtualenv/pull/160612:33
weshay|rucksshnaidm, you avail?12:36
sshnaidmweshay|ruck, yep, joined12:37
*** TrevorV has joined #oooq12:37
*** jpena is now known as jpena|lunch12:39
marios|ruck|callchandankumar: we think workarounds related to the ci.centos bug @ https://bugs.launchpad.net/tripleo/+bug/186363212:39
openstackLaunchpad bug 1863632 in tripleo "lastest virtenv workarounds broke native tripleo-quickstart install" [Critical,Triaged]12:39
*** marios|ruck|call is now known as marios|ruck12:44
*** ykarel|afk is now known as ykarel12:46
chandankumarmarios|ruck, ah ok12:52
marios|ruckchandankumar: doing12:53
*** rlandy has joined #oooq12:56
*** beagles is now known as beagles_mtg13:01
rlandychandankumar: sync meeting13:01
weshay|ruckchandankumar, https://meet.google.com/oiv-geho-mai?authuser=113:01
weshay|ruckpanda, ^13:01
rlandypanda: ^^13:01
rlandyhttps://review.rdoproject.org/r/#/c/24512/13:04
zbro/ i am back13:04
rlandyhttps://review.rdoproject.org/r/#/c/24938/13:05
*** amoralej|lunch is now known as amoralej13:08
rlandyhttps://hackmd.io/4K_NU1PxSDiTYGecnAZNCA13:09
dpawlikchandankumar, almost done13:21
dpawlikchandankumar, but I see that required files for CI to pass are available13:21
dpawlikchandankumar, disabling uploader user13:21
*** marios|ruck is now known as marios|ruck|call13:31
chandankumardpawlik, where in old image server na?13:32
chandankumardpawlik, for new image server, we need uploader user for centos13:32
chandankumardpawlik, https://review.rdoproject.org/r/#/c/24984/2/ci-scripts/tripleo-upstream/upload-cloud-images.sh13:32
dpawlikchandankumar, for centos, uploader user is uploader13:36
dpawlikso its ok13:36
*** ccamacho has joined #oooq13:36
chandankumardpawlik, ok13:36
*** ratailor has quit IRC13:37
chandankumardpawlik, https://logserver.rdoproject.org/99/708299/3/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/9701ec9/job-output.txt13:38
chandankumardpawlik, can you check the image http://images.rdoproject.org/master/rdo_trunk/93d9626ccd00c3b2a34a969ab2894101e0cc1735_b0b132d2/overcloud-full.tar.md5 exists or not in new server?13:39
*** jbadiapa has joined #oooq13:41
chandankumardpawlik, just check-rdo13:41
*** jpena|lunch is now known as jpena13:42
*** ykarel is now known as ykarel|afk13:44
dpawlikchandankumar, it exists13:45
dpawlikchandankumar, recheck-rdo => done13:45
*** Goneri has joined #oooq13:46
chandankumardpawlik, jpena can you check why it is not merged? https://softwarefactory-project.io/r/#/c/17428/13:46
dpawlikchandankumar, it was aggregated with some other PS13:47
dpawliknow its ongoing alone13:47
chandankumardpawlik, ok, thanks!13:47
marios|ruck|callweshay|ruck:         * 2020-02-18 13:46:00,058 24290 INFO     promoter SUCCESS promoting centos7-rocky tripleo-ci-testing as current-tripleo ({'timestamp': 1581832873,13:51
marios|ruck|callweshay|ruck: finally (we needed https://review.rdoproject.org/r/#/c/24999/ )13:52
marios|ruck|callweshay|ruck: it was trying since last night13:52
*** udesale has joined #oooq14:02
*** marios|ruck|call is now known as marios|ruck14:04
chandankumarmarios|ruck, weshay|ruck rlandy sshnaidm please merge this https://review.opendev.org/#/q/topic:vexxhostimage+(status:open+OR+status:merged) once dpawlik gives +114:06
chandankumarthen we are done with migration14:06
sshnaidmchandankumar, ack, just tell when to push the button..14:07
chandankumardpawlik, ^^14:07
* chandankumar headed home14:09
rlandylooking14:10
amoralejchandankumar, we are still using rhel8 deps repo for centos8, https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/multi-node-bridge/templates/zuul-multi-node-bridge-ovs.repo.j2#L2514:12
rlandyrfolco: updating standalone patch - then we can merge14:12
amoralejcan i send a patch to move to chents8 deps or i will break something?14:12
rfolcorlandy, great14:12
amoraleji'm adding a rdo-openvswitch providing rhosp-openvswitch there14:12
rfolcorlandy, do we have a task for centos8 repareting ?14:12
rfolcorlandy, if not, I'd like to create one14:13
rlandyrfolco: yeah - it's under chandankumar's name atm14:13
rfolcoaaaah ok14:13
rfolcochandankumar, you driving repareting work ?14:13
rfolcoreparenting*14:13
rlandyrfolco: getting14:14
rlandyhttps://tree.taiga.io/project/tripleo-ci-board/task/1518?kanban-status=144727514:14
rfolcorlandy, thx14:18
chandankumarrfolco, rlandy is doing that, I am currently taking care of image build, will pull it from tomorrow morning14:18
rfolcowhaaat14:18
rfolcowho is doing then?14:19
rfolco:)14:19
* rfolco looks at rlandy 14:19
rlandyrfolco: chandankumar and I planned to work on it together14:19
rlandythere is a lot to do there14:19
chandankumardpawlik, can we hit +w button now?14:19
rlandyhttps://review.rdoproject.org/r/#/c/24938/14:20
rlandyupdated14:20
rlandyrfolco: chandankumar: ^^14:20
rfolcorlandy, ok, I am stepping back from it as we have 2 people on the same task...14:20
rlandyno 7-8 parenting14:20
rfolcolet me know if any help needed14:20
rlandyok14:20
rlandyrfolco: k - let's get https://review.rdoproject.org/r/#/c/24512/ merged afterwards14:20
rlandythere may be fallout there14:20
chandankumarrlandy, so we are not touching c7 jobs14:21
chandankumarrlandy, just re-use the base parent from c7 and change the nodeset for c8?14:22
rlandychandankumar: following our discussion, I decide to just create a new job14:24
rlandychandankumar: we will redo all that parenting14:24
rlandyI just needed one centos 8 job to allow the standalone component jobs to go14:25
amoralejbtw chandankumar it may be easier to just set ovs_package to openvswitch in https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/multi-node-bridge/vars/CentOS.yaml ?14:25
amoralejwdyt?14:25
amoralejto avoid wrapping it14:25
*** owalsh_ is now known as owalsh14:26
dpawlikchandankumar, sure :)14:28
*** Tengu has quit IRC14:30
*** Tengu has joined #oooq14:31
*** udesale has quit IRC14:41
rlandyrfolco: do you know what the issue is here withe registry login? https://review.rdoproject.org/r/#/c/24995/14:44
rfolcorlandy, no, as long as it parents config job w/ secrets, it should work14:53
chandankumarsshnaidm, rlandy time to +w https://review.opendev.org/#/q/topic:vexxhostimage+(status:open+OR+status:merged) got ack from dpawlik15:00
rlandychandankumar: ok - here we go15:01
dpawlikchandankumar, thanks for that PS. We can go with that :)15:01
chandankumarweshay|ruck, marios|ruck ^^15:02
chandankumarthank you dpawlik for all the help on migration :-)15:02
chandankumardpawlik++15:02
weshay|ruckthanks dpawlik15:03
*** Goneri has quit IRC15:03
chandankumaramoralej, looking15:04
marios|ruckchandankumar: ack15:05
amoralejchandankumar, now install rhosp-openvswitch from centos8 deps repo should work15:06
amoraleji've created a rdo-openvswitch wrapper for compatibility15:06
amoraleji've sent https://review.opendev.org/#/c/708402/15:06
chandankumarrlandy, https://review.rdoproject.org/r/#/c/24835/15:09
chandankumarsorry15:09
chandankumaramoralej, here you go https://review.rdoproject.org/r/#/c/24835/15:10
*** Goneri has joined #oooq15:11
amoralejchandankumar, my patch was mainly intended to fix c8 jobs, but it may also help on using centos8 deps on rhel815:11
chandankumaramoralej, using depends on above15:11
amoralejyeah, i see15:11
amoralejlet's see how that goes15:11
rlandywatching that15:11
chandankumarrlandy, regarding parenting https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L280 will i keep this base as it is and create new c8 jobs https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/build-image.yaml#L19 with c8 nodeset?15:15
rlandychandankumar: I don;t think we have settled on a strategy yet15:19
rlandybut iiuc, you would have a new job from https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L28015:19
rlandychandankumar: maybe build images is a different case15:20
chandankumarrlandy, it is going to be same only ostype will change rest will stay same15:20
rlandy  nodeset: single-centos-7-node15:22
chandankumarsoniya29, can you propose a patch here also https://github.com/rdo-packages/tempest-distgit/blob/rpm-master/openstack-tempest.spec to remove tempest-account generator coming from this patch https://review.opendev.org/#/c/700514/15:23
rlandyif the playbook stay the same, then yeah, you could keep the current base15:23
chandankumarotherwise we will have again one ftbfs15:23
rlandyit's a trade off between duplication and independence15:24
chandankumarrlandy, yes one more thing I also need to refactor this role https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images it is too much rhel8 specifics15:25
chandankumarweshay|ruck, do you know why this jobs ripleo-quickstart-extras-gate-master-delorean-full-featureset052 https://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-full-featureset052/3817/ : FAILURE15:26
chandankumar started running again?15:26
rlandychandankumar: the more you think about it, the crazier it makes you15:26
chandankumarrlandy, c8 is already crazy stuff15:26
weshay|ruckchandankumar, yup15:26
weshay|ruckignore it15:26
chandankumarok15:27
chandankumarweshay|ruck, rlandy, https://review.opendev.org/#/c/708368/ +w this15:28
chandankumarsshnaidm, weshay|ruck https://review.rdoproject.org/r/#/c/24938/ more +w15:29
chandankumarrlandy, https://review.rdoproject.org/r/2494415:30
chandankumarrlandy, https://review.rdoproject.org/r/2451215:30
chandankumarthat's it15:30
rlandyok - let's do this ...15:31
rlandyrfolco: here we go15:31
rlandyhttps://review.rdoproject.org/r/#/c/24938/ - w+'ed15:32
tristanCchandankumar: sshnaidm: regarding dhall in sf-infra, we find it better to avoid repetition and manage the vars file, but you don't have to use it, feel free to use YAML if you prefer.15:32
*** jaosorior has joined #oooq15:34
chandankumartristanC, thanks, do we have dhal links to getting started? if needed in future for us15:35
chandankumaror may be a session in tripleo community call will also work15:35
tristanCchandankumar: sure, https://softwarefactory-project.io/cgit/software-factory/sf-infra/tree/doc/dhall-onboarding/README.md  and https://review.opendev.org/#/c/705535/3/CONTRIBUTE.md15:36
chandankumartristanC, thanks, will go through that15:38
tristanCchandankumar: nice, i hope you'll find this useful, even if you don't use it, i find it very interesting. Feel free to reach out to discuss it in more details.15:39
rlandyrfolco: https://review.rdoproject.org/r/#/c/24512/ is going now15:42
rlandywe need to test that15:42
rlandypost merge15:42
chandankumaramoralej, we have results15:45
chandankumaramoralej,  cannot install the best update candidate for package openvswitch2.11-2.11.0-0.20190129gitd3a10db.el8fdb.x86_6415:46
chandankumar- problem with installed package rhosp-openvswitch-2.11-0.3.el8ost.noarch15:46
chandankumarhttps://logserver.rdoproject.org/35/24835/6/check/periodic-tripleo-ci-rhel-8-standalone-master/a0fe132/job-output.txt15:46
chandankumaramoralej, more info here https://logserver.rdoproject.org/35/24835/6/check/periodic-tripleo-ci-rhel-8-standalone-master/a0fe132/logs/undercloud/home/zuul/repo_setup.log.txt.gz15:46
amoralejme checking15:46
rlandyrfolco: https://review.rdoproject.org/r/#/c/24512/ is in15:47
rlandynow we need to test this15:48
amoralejchandankumar, yeah, right, my initial patch only uses centos repo for centos, not rhel15:48
rlandyweshay|ruck: marios|ruck: ^^ just in case you see fallout - should not though15:49
amoraleji'll do a WIP patch to update it in rhel and make depends on15:49
chandankumaramoralej, sure, feel free to recheck on this patch https://review.rdoproject.org/r/2483515:49
*** udesale has joined #oooq15:51
marios|ruckrlandy: ack rlandy15:52
dpawlikchandankumar, you're welcome :)15:52
marios|ruckthanks15:52
rlandymarios|ruck: I'm doing some post-merge testing now15:53
marios|ruckrlandy: ack15:53
dpawlikchandankumar, Im also thanks for sharing the knowledge :)15:53
marios|ruckrlandy: noted on etherpad in case anyway15:53
marios|ruckrlandy: plus by day is almost over15:54
rlandysure15:54
*** tesseract has quit IRC15:55
*** Trevor_V has joined #oooq15:58
*** saneax has quit IRC15:59
chandankumarsee ya tomorrow people16:00
*** chandankumar is now known as raukadah16:00
rlandyraukadah: have a good night16:01
*** TrevorV has quit IRC16:01
*** beagles_mtg is now known as beagles16:02
*** marios|ruck is now known as marios|ruck|call16:04
migiweshay|ruck: rlandy: look here: https://registry-console-default.cloud.registry.upshift.redhat.com/registry#/images/rhosp1716:04
*** bogdando has quit IRC16:05
rlandyweshay|ruck: rfolco: fyi ... I am running a test of periodic-tripleo-centos-8-master-component-compute-promote-consistent-to-component-ci-testing and security component16:05
rlandymigi: woohoo16:06
rfolcocool rlandy16:06
rlandymigi: I guess 17 is ready to go16:06
migirlandy: yep I am scheduling tome tomorrow to test deployment with d/s16:06
migirlandy: yep16:06
weshay|ruckmarios|ruck|call, I've figured out the problem16:06
*** udesale_ has joined #oooq16:06
marios|ruck|callweshay|ruck: which bit16:06
weshay|ruckinstall_deps16:06
rlandymigi: I am knee deep in centos 8 - but let me know how it goes16:06
weshay|ruckmarios|ruck|call, don't have a working solution yet though16:07
migirlandy: will do :) happy days16:07
marios|ruck|callweshay|ruck: cool do you want to comment on the review i can update or go ahead or just post something new16:07
*** udesale has quit IRC16:07
rlandymigi: yep - the joys of changing priorities16:07
rlandyhttps://review.rdoproject.org/r/2499516:08
*** jmasud has quit IRC16:12
rlandy2020-02-18 16:12:20.899621 | TASK [get_hash : create hash_info file]16:12
rlandy2020-02-18 16:12:31.291876 | primary | ERROR16:12
rlandy2020-02-18 16:12:31.292334 | primary | {16:12
rlandy2020-02-18 16:12:31.292408 | primary |   "msg": "The task includes an option with an undefined variable. The error was: 'full_hash' is undefined\n\nThe error appears to be in '/var/lib/zuul/builds/d58a92b5a084487b9ba4c41247f7f909/trusted/project_3/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml': line 89, column 3, but may\nbe elsewhere in the file depending on the exact syntax16:12
rlandyproblem.\n\nThe offending line appears to be:\n\n\n- name: create hash_info file\n  ^ here\n"16:12
rlandy2020-02-18 16:12:31.292485 | primary | }16:13
rlandyrfolco: ^^16:13
*** ccamacho has quit IRC16:13
rfolcorlandy, let me fix this16:13
marios|ruck|callweshay|ruck: am going to go after this call did you want me to hang around longer/need something else?16:13
*** jmasud has joined #oooq16:14
rfolcorlandy, can you paste log link16:15
rlandyrfolco: https://logserver.rdoproject.org/95/24995/4/check/periodic-tripleo-centos-8-master-component-compute-promote-consistent-to-component-ci-testing/d58a92b/16:16
rfolcorlandy, thx16:16
weshay|ruckmarios|ruck|call, I don't think the ci.centos job is pulling the change https://review.rdoproject.org/r/#/c/25015/16:16
rfolcorlandy, its skipping all 3 use cases :( checking why16:17
*** udesale_ has quit IRC16:17
rfolcoI don't get it! component is defined == 'compute'16:23
rfolco2020-02-18 16:12:20.174434 | TASK [get_hash : discover the hashes url (component)]16:23
rfolco2020-02-18 16:12:20.223004 | primary | skipping: Conditional result was False16:23
*** udesale has joined #oooq16:23
weshay|ruckmigi, ya.. we can get started w/ those for sure16:23
rlandyweshay|ruck: downstream is a disaster area now - but not looking - blinkers on for centos 816:28
weshay|ruckrlandy, blinders :)16:29
weshay|ruckya16:29
rlandywill go and clean up that mess later16:29
weshay|ruckmarios|ruck|call, https://ci.centos.org/view/rdo/view/tripleo-gate/job/tripleo-quickstart-gate-master-delorean-quick-basic/1/console16:35
marios|ruck|callupdate_containers' is undefined weshay|ruck16:38
weshay|ruckmarios|ruck|call, that's a b.s error.. I think it's the job def16:39
weshay|ruckmarios|ruck|call, I'll check that out.16:40
weshay|ruck bash quickstart.sh --working-dir /home/jenkins/workspace/tripleo-quickstart-gate-master-delorean-quick-basic/ --no-clone --bootstrap --playbook gate-quickstart.yml --release centosci/master -e deploy_timeout=120 172.19.2.10316:40
weshay|ruckit's unrelated to install_deps.sh16:40
marios|ruck|callweshay|ruck: ack will check for any updates in my morning and see if i can progress16:43
weshay|ruckmarios|ruck|call, let's just roll w/ https://review.opendev.org/70826416:44
weshay|ruckget it over with16:44
marios|ruck|callweshay|ruck: checking16:45
*** holser has quit IRC16:45
*** jpena is now known as jpena|brb16:46
marios|ruck|callweshay|ruck: ack did it work ?16:46
marios|ruck|callvoting there so it goes in my queue16:46
weshay|ruckmarios|ruck|call, ya.. it's getting through install-deps.sh now16:47
weshay|ruckmarios|ruck|call, this job is soo old16:47
weshay|ruck09:46:42         "container_build_id": "current-tripleo-rdo"16:47
weshay|ruckwe haven't tagged containers w/ current-tripleo or current-tripleo-rdo in a very long time16:48
weshay|ruckbut it's enough of a job to tell use the setup worked16:48
weshay|ruckraukadah, for tomorrow https://review.opendev.org/#/c/708264/16:49
*** udesale_ has joined #oooq16:58
*** marios|ruck|call is now known as marios|ruck16:58
* marios|ruck ready to go 16:58
*** udesale has quit IRC16:59
weshay|ruckrlandy, rfolco anything I can do to help w/ the pinning jobs?17:00
weshay|ruckdebug?17:00
rlandyweshay|ruck: pls remind me why we still don;t have containers for centos 817:00
weshay|ruck?17:01
rlandywe merged jpena's job17:01
rfolcoI am debugging get_hash bug here https://review.rdoproject.org/r/#/c/25020/17:01
rfolcoperiodic job is not merged afaik17:01
rfolcoisn't ?17:01
rlandyperiodic-tripleo-centos-8-master-promote-promoted-components-to-tripleo-ci-testing filure17:02
rlandyfailure17:02
weshay|ruckis rfolco around?17:02
rlandyyes17:02
rfolco?17:02
rfolco?17:02
rfolco?17:02
weshay|rucklet's chat17:03
rlandyyes, let's17:03
rfolcois raukadah off ? he owns task 144217:03
rlandyhttps://meet.google.com/rau-rqpe-cim?pli=1&authuser=017:03
rlandyweshay|ruck: rfolco: ^^17:03
rfolcoraukadah, if you online please join us ^17:04
*** jfrancoa has quit IRC17:04
*** marios|ruck is now known as marios|out17:04
*** dtantsur is now known as dtantsur|afk17:06
*** marios|out has quit IRC17:08
*** udesale_ has quit IRC17:12
*** udesale has joined #oooq17:14
pandaweshay|ruck: rfolco jpena|brb we also need this to use the integration pipeline I guess https://softwarefactory-project.io/r/#/c/17328/17:15
pandajpena|brb: when do you plan to release the new dlrn and dlrnapi packages ?17:15
pandaweshay|ruck: rfolco until they are relased, we are not using them17:16
weshay|ruckpanda, can we borrow you?17:19
weshay|ruckhttps://meet.google.com/rau-rqpe-cim?pli=1&authuser=017:19
weshay|ruckrlandy, rfolco https://softwarefactory-project.io/r/#/c/17328/17:22
*** jpena|brb is now known as jpena17:23
jpenapanda: oh, true17:23
weshay|ruckhttps://softwarefactory-project.io/logs/28/17328/5/check/dlrn-api-functional-centos-8/10a6074/logs/DLRN/repos/17:23
*** udesale has quit IRC17:27
*** jaosorior has quit IRC17:28
weshay|ruckpanda, https://gist.github.com/weshayutin/c77a2aa33c0d7a4c9b93481dc2f789f417:44
weshay|ruckpanda, https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ17:53
pandaweshay|ruck: https://review.rdoproject.org/r/2467717:57
weshay|ruckrfolco, rlandy https://review.rdoproject.org/r/#/c/24677/17:58
pandarfolco: you had a question ?17:58
rfolconm17:59
pandarfolco: a question nm ? you want to list symbols from object files ? what are you trying to debug ?18:01
*** derekh has quit IRC18:04
pandals -lart18:04
* panda facepalm18:04
rfolcopanda, the question was about adding debug tasks to ansible playbooks/roles. I added molecules tests but apparently it was not enough to catch the bug with major_version|int for example. So how do you see it ?18:05
rfolcopanda, like here https://review.rdoproject.org/r/#/c/25018/1/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml18:06
weshay|ruckrfolco,  :)18:07
weshay|ruck2020-02-18 18:07:22.840956 | TASK [get_hash : get md5 file]18:07
weshay|ruck2020-02-18 18:07:24.059623 | primary | ERROR18:07
weshay|ruck2020-02-18 18:07:24.060306 | primary | {18:07
weshay|ruck2020-02-18 18:07:24.060456 | primary |   "dest": "/home/zuul/workspace/delorean.repo.md5",18:07
weshay|ruck2020-02-18 18:07:24.060578 | primary |   "elapsed": 0,18:07
weshay|ruck2020-02-18 18:07:24.060689 | primary |   "msg": "Request failed",18:07
weshay|ruck2020-02-18 18:07:24.060800 | primary |   "response": "HTTP Error 404: Not Found",18:07
weshay|ruck2020-02-18 18:07:24.060930 | primary |   "status_code": 404,18:07
weshay|ruck2020-02-18 18:07:24.061053 | primary |   "url": "https://trunk.rdoproject.org/centos8-master/tripleo-ci-testing/delorean.repo.md5"18:07
weshay|ruck2020-02-18 18:07:24.061200 | primary | }18:07
weshay|ruck2020-02-18 18:07:24.085537 |18:07
weshay|ruckso that failed in the right place18:08
weshay|ruckhttps://review.rdoproject.org/zuul/stream/6f728c1bfb0a479aa603e2b98c221ff2?logfile=console.log18:08
rfolcoweshay|ruck, which job is this18:09
rfolco2020-02-18 18:07:22.285294 | TASK [get_hash : discover the hashes url (integration)]18:11
rfolco2020-02-18 18:07:22.372642 | primary | ok18:11
rfolcook cool18:11
zbrsshnaidm: weshay|ruck: after many attempts I was able to makde the sova artcl scenario behave via https://review.opendev.org/#/c/703781/  passed with https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b2f/703781/16/check/openstack-tox-molecule/b2f7db0/tox/reports.html18:11
zbrthat one pyyaml install in prepare was a permanent PITA18:11
rfolcopanda, another question18:13
rfolcopanda, https://review.rdoproject.org/r/#/c/24677/ - which are the tests relevant to this patch ? tripleo-ci-promotion-staging ?18:13
rfolcopanda, nm nm nm18:22
rfolcofound it https://logserver.rdoproject.org/77/24677/27/check/tox-py36/feb7937/tox/reports.html18:24
rfolcothanks rfolco18:24
rfolcoyw rfolco18:24
pandarfolco: and also the on ein py27, because the promoter is stillin centos718:27
pandarfolco: regarding your question, if it's not a syntax error, you don't catch it unless you specificaly check for it. You need to set the ansible_version, run your role, and make your tasks leave a trace, like resgister a variable, the back to the test you assert that the variable was set correctly18:30
rfolcopanda, I did set major_version in molecules test, probably mocking the var wasn't the same as getting the var from ansible itself18:33
*** jpena is now known as jpena|off18:33
pandarfolco: in summary: 1) set version=8 2) run role, task that should run on version 8 will have to register var 3) assert ver is set18:34
pandarfolco: the mock should be as close as possible to the original, yes.18:34
*** tosky has quit IRC18:35
rfolcopanda, yes test ran and task was executed so assumed the job done18:35
pandarfolco: well you also need the negative test, set a different var, and ensure the tast is NOT executed.18:35
pandarfolco: and in molecule there should be no need to mock the major version, just run the test on centos8 containers.18:36
rfolcoright, right18:37
rfolcolessons learned for next time18:38
pandarfolco: the only real way to learn is through pain18:40
* panda takes his belt off18:40
rfolcolol18:40
pandarfolco: turn away and show your back, my belt hungers.18:40
rfolcoshhhtaaaaa18:41
*** amoralej is now known as amoralej|off18:41
rlandyok - build containers fails on hash - expected18:41
rlandyrfolco: you know about https://logserver.rdoproject.org/95/24995/5/check/periodic-tripleo-centos-8-master-component-compute-promote-consistent-to-component-ci-testing/38fd12b/job-output.txt?18:42
rfolcorlandy, yes skipped all 3 possible use cases (legacy, component, integration)18:43
rlandyeven with patch?18:43
rlandyrfolco: need help or have it covered?18:44
rfolcoweid18:44
rfolcodepends-on didn't work18:45
rlandywas your depends on in config?18:45
rlandyci-config18:46
rlandyshould take18:46
rlandyrfolco: rebased - try again18:46
rfolcorlandy, testproject is not applying patch from ci-config18:49
* rlandy looks18:50
rlandyhttps://logserver.rdoproject.org/95/24995/5/check/periodic-tripleo-centos-8-master-component-compute-promote-consistent-to-component-ci-testing/38fd12b/zuul-info/inventory.yaml18:51
rlandysays it gets the patch18:51
rfolcorlandy, it may be overridden somwehere in the code18:56
rfolcolooking18:56
rlandyrfolco: look at it now18:56
rlandylooking18:56
rlandyrfolco: you rekicked?19:04
rfolcorlandy, not now, I rechecked once after rebasing19:05
rfolcorlandy, I removed the debugging and I am testing molecule now to merge my patch as is19:05
rlandyrekicking testproject19:05
rfolcorlandy, did you find anything ?19:08
rlandyrfolco: still failing with the same error19:08
rlandymaybe your patch didn;t address it?19:09
rlandyor we need to skip testproject and run elsewhere19:09
rfolcorlandy, it should have the debugging message (before my last update to my patch)19:09
rfolcoI don't see them19:09
rfolcothat's why I say my patch is not applied19:09
rlandy discover the hashes url (component) doesn't run19:16
rlandyrfolco: why not merge https://review.rdoproject.org/r/#/c/25018/?19:16
rlandyand then we try run again?19:16
rfolcorlandy, would be an idea. Ideally I should add a molecule test to cover the bug19:17
rfolcorlandy, lets do it then, lets merge and test and meanwhile I send another patch for molecule19:18
rlandyrfolco: k - I +2'ed it19:21
rlandygo ahead and merge19:21
rlandyremove depends from testproject19:21
rfolcothx let me merge and reckici19:21
rlandyrun again19:21
zbrrlandy: rfolco: https://review.opendev.org/#/q/topic:molecule-yolo+(status:open+OR+status:merged)19:25
rlandyrfolco: still no?19:52
rfolcorlandy, no... debugging19:52
*** Goneri has quit IRC19:58
*** jmasud has quit IRC20:13
*** jmasud has joined #oooq20:14
rlandyrfolco: how goes it? need help debugging?20:23
rfolcorlandy, if you are blocked on this, yes20:25
rlandyI'm not ...20:25
* rlandy has other work to do - no worries20:25
rfolcorlandy, I am working on it at https://review.rdoproject.org/r/#/c/25026/20:25
rfolcorlandy, how this can happen ? The error was: 'ansible_distribution' is undefined20:27
*** Trevor_V has quit IRC20:27
rlandyrfolco: gather_facts?20:28
rfolco  gather_facts: false20:28
rfolcomeh20:28
rfolcothanks20:28
rlandytrue set that to true20:28
*** beagles has quit IRC20:44
rlandyweshay|ruck: should we w+ https://review.rdoproject.org/r/#/c/24677/?20:46
rlandyor panda does that?20:46
weshay|ruckhe approved it.. let me jump on the promoter and see what's what20:46
rlandyhttps://review.rdoproject.org/r/24948 Add all component standalone jobs for centos 820:48
rlandy^^ that can go20:48
weshay|ruckrlandy, all things look normal.. merging.. rlandy fyi.. for ci.centos https://review.opendev.org/#/c/708264/20:52
rlandylooking20:53
rlandywhat is tripleo-quickstart-gate-master-delorean-quick-basic?20:54
rlandyoh - jenkins actually voting20:55
rlandyweshay|ruck: ^^ that's cool20:55
rlandysince when?20:55
weshay|ruckrlandy, since I needed to test a patch for ci.centos20:56
weshay|ruckrlandy, envD avail?20:56
rlandyweshay|ruck: env D is rhel20:56
rlandyweshay|ruck: you can take E20:56
rlandyweshay|ruck: https://review.opendev.org/#/c/708264/ fails jenkins20:57
rlandywhich is what it is supposed to fix20:57
weshay|ruckrlandy, it fixes install-deps20:57
weshay|ruckwhich it gets through20:58
weshay|ruckrlandy, it's looking for containers tagged w/ current-tripleo-rdo20:58
weshay|ruckwhich we stopped doing months and months ago20:58
rlandyweshay|ruck: +2'ed20:59
weshay|ruckhttps://code.engineering.redhat.com/gerrit/#/c/190672/ updated20:59
weshay|rucksshnaidm, fyi https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status21:01
weshay|ruck190672,521:01
weshay|ruckrlandy++21:02
sshnaidmrlandy, weshay|ruck does it test upstream patch on real bm?21:03
weshay|rucksshnaidm, yes sir21:03
rlandysshnaidm: yep21:03
sshnaidmwow, that's great21:03
rlandyfancy, no?21:03
sshnaidmrlandy+++21:03
rlandyand if you want to fix the rhel image refs, you do the same there21:03
weshay|ruckci is a big place isn't it?21:04
sshnaidmrlandy, so I need to make a patch on testproject with depends on upstream, right?21:04
rlandysshnaidm: testproject downstream21:05
sshnaidmrlandy, I see.. cool!21:05
weshay|ruckooff.. master ovb is fucked21:05
* weshay|ruck gives up trying.. when we move to vexx and it's stable21:06
weshay|ruck3rd party is -2 failing patches21:06
weshay|ruckthat's what they get for making me ptl21:06
weshay|ruckEmilienM, ^21:07
EmilienMpfft -221:07
weshay|ruck:)21:07
rlandyweshay|ruck: do you want the Depends-On: https://review.opendev.org/#/c/695893/?21:08
*** Goneri has joined #oooq21:08
rlandyweshay|ruck: ping ... https://sf.hosted.upshift.rdu2.redhat.com/logs/72/190672/5/check/periodic-tripleo-ci-centos-7-bm_envE-3ctlr_1comp-featureset001-master/a80c017/job-output.txt21:17
weshay|ruckrlandy, I did https://code.engineering.redhat.com/gerrit/#/c/190672/21:17
rlandyThe error was: 'libvirt_packages' is undefined21:17
weshay|ruckit failed :(21:17
weshay|ruckya.. is that rhel8 host?21:17
weshay|ruckrlandy, think that's my patch breaking21:17
*** jfrancoa has joined #oooq21:18
rlandyweshay|ruck: that's cento4s 721:18
rlandyenv D is rhel21:18
rlandyyou're on E21:18
weshay|ruckhttps://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/environment/vars/redhat-8.yml21:18
rlandybut yeah - your patch is broken21:18
weshay|ruckoh.. so it's centos?21:18
rlandyyou're not on rhel21:18
rlandyhttps://github.com/openstack/tripleo-quickstart/blob/master/roles/environment/vars/centos-7.yml21:18
rlandythat should work21:19
weshay|ruckrlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/72/190672/5/check/periodic-tripleo-ci-centos-7-bm_envE-3ctlr_1comp-featureset001-master/a80c017/logs/rdoci-hp-07.v100.rdoci.lab.eng.rdu2.redhat.com/etc/redhat-release21:20
weshay|ruckit's rhel 7.621:20
weshay|ruckrlandy, /me adds patch21:20
rlandyweshay|ruck: we can update the host if that helps21:21
weshay|ruckhttps://review.opendev.org/70851921:22
rlandyok - let's add that depends-on to patch21:22
rlandysorry - must update that host soon21:23
rlandyrfolco: going ok?21:33
weshay|ruckrlandy, seems to be working21:34
rlandyweshay|ruck: ack - sorry - forgot that host was still rhel21:35
weshay|rucknp21:35
weshay|ruckit's a good catch21:35
* rlandy goes back to the parenting saga21:36
*** jfrancoa has quit IRC21:47
rlandyweshay|ruck: pls see https://hackmd.io/4K_NU1PxSDiTYGecnAZNCA - standalone parenting22:11
rlandyshows where we would diverge centos 7 centos 822:12
*** rfolco has quit IRC22:26
weshay|ruckrlandy, k.. will check it.. kid duty begins22:30
*** jmasud has quit IRC22:31
*** jbadiapa has quit IRC22:41
*** Goneri has quit IRC22:54
rlandyweshay|ruck: no worries - will discuss at tomorrow's meeting23:23
*** jmasud has joined #oooq23:25
*** rlandy has quit IRC23:41
*** jmasud has quit IRC23:45
*** jmasud_ has joined #oooq23:45
*** jmasud_ has quit IRC23:49
*** jmasud has joined #oooq23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!