*** ysandeep has joined #oooq | 00:05 | |
zbr | rlandy: weshay|ruck https://review.opendev.org/#/c/702735/2 | 00:36 |
---|---|---|
*** skramaja has quit IRC | 02:04 | |
*** raukadah has quit IRC | 03:31 | |
*** chandankumar has joined #oooq | 03:33 | |
*** bhagyashris has joined #oooq | 03:48 | |
*** udesale has joined #oooq | 04:05 | |
*** rlandy has quit IRC | 04:07 | |
*** ysandeep has quit IRC | 04:14 | |
*** ykarel|away has joined #oooq | 04:35 | |
*** ykarel|away is now known as ykarel | 04:37 | |
*** ysandeep has joined #oooq | 05:00 | |
*** ysandeep has quit IRC | 05:24 | |
*** surpatil has joined #oooq | 05:27 | |
*** akahat has joined #oooq | 05:37 | |
*** ratailor has joined #oooq | 06:08 | |
*** saneax has joined #oooq | 06:18 | |
*** jtomasek has joined #oooq | 06:25 | |
*** marios has joined #oooq | 06:32 | |
*** jfrancoa has joined #oooq | 07:02 | |
*** soniya29 has joined #oooq | 07:19 | |
marios | matbu: looks like it worked http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-stein&job_name=tripleo-ci-centos-7-standalone-upgrade-train | 07:21 |
marios | sshnaidm: ^ | 07:21 |
marios | ( it https://review.opendev.org/#/c/702625/ ) | 07:21 |
sshnaidm | marios, great | 07:22 |
sshnaidm | marios, if you want to run it on master of non-branched repos, we'll need a different job though | 07:22 |
marios | sshnaidm: hmmm not sure if we want it voting on master. definitely it should block train and not let it break upgrads on train but i think for master we never enforce voting upgrade jobs cos upgrades expected to break while new features are developed | 07:28 |
marios | matbu: wdyt ^ | 07:28 |
marios | sshnaidm: we've always had pushback when trying to make upgrades vote on master | 07:28 |
sshnaidm | marios, I mean not upgrade to master, but running the same job on tripleo-ci, quickstart or other non-branched repos | 07:29 |
sshnaidm | marios, for example to check if we don't break it with some patch on tripleo-ci | 07:29 |
sshnaidm | marios, but not sure it's so relevant today | 07:29 |
marios | sshnaidm: you mean, to run standalone-upgrade-train on tripleo-quickstart, we need a different job? not sure i follow the issue but maybe irc isn't best for that... we can discuss later in scrum perhaps. i se some q/e and quickstart there though http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-stein&job_name=tripleo-ci-centos-7-standalone-upgrade-train | 07:31 |
sshnaidm | marios, yeah, we do need a different job, because tripleo-quickstart runs on master and master is not included in job branches. But maybe that's fine and we don't need to run it there | 07:33 |
marios | sshnaidm: yeah i see what you mean now. like we explicitly set the branch and it doesn't include master for -train or -steinjobs | 07:43 |
*** ykarel is now known as ykarel|lunch | 07:56 | |
matbu | marios: hey | 07:57 |
matbu | marios: yep agree, i should block only train | 07:57 |
marios | matbu: o/ k there is slightly different problem. the -train job won't run on quickstart/extras or tripleo-ci. we need somethign further if we want that | 07:58 |
matbu | and not be run on non-branched repo | 07:58 |
marios | matbu: i.e. won't run on any of the non-branched repos | 07:58 |
marios | right | 07:58 |
matbu | marios: yep not sure its really need ? | 07:58 |
matbu | since we have a master job that runs on those non branched repos | 07:59 |
marios | matbu: yeah me too. i mean it would be nice. it means you get what you want WRT not breaking the upgrade process in changes to tripleo project deployment tools | 07:59 |
marios | matbu: but we might break the job with some change in tripleo-ci role for example | 07:59 |
matbu | anyway thank you sshnaidm and marios for fixing this | 07:59 |
marios | matbu: yeah ack on the master job though... but as you know its non voting thus ignored ;) | 07:59 |
matbu | marios: yep, i think we probably need it (standalone-upgrade) voting on master and undercloud containerized upgrade as well | 08:00 |
marios | matbu: whenever we tried that we got push back but bring it up on next weekly tripleo irc | 08:00 |
marios | or whever else | 08:00 |
matbu | marios: we lost a lot of time fixing UC upgrade before the shutdown | 08:00 |
marios | matbu: i mean now is acceptable to make it voting. i think as the cycle matures it might break. its a long conversation we've had it many times ;) | 08:01 |
marios | matbu: i mean you me and many others have talked about that | 08:01 |
*** jpena|off is now known as jpena | 08:01 | |
*** bhagyashris is now known as bhagyashris|NHO | 08:03 | |
matbu | marios: hehe yep | 08:05 |
*** tesseract has joined #oooq | 08:10 | |
matbu | hm why im unregistered | 08:15 |
* matbu reconnect | 08:15 | |
*** matbu has quit IRC | 08:15 | |
*** matbu has joined #oooq | 08:15 | |
*** surpatil has quit IRC | 08:22 | |
*** udesale_ has joined #oooq | 08:25 | |
*** amoralej|off is now known as amoralej | 08:26 | |
*** udesale has quit IRC | 08:28 | |
*** tosky has joined #oooq | 08:32 | |
*** surpatil has joined #oooq | 08:34 | |
*** dmellado has quit IRC | 08:35 | |
*** dmellado has joined #oooq | 08:37 | |
*** ykarel|lunch is now known as ykarel | 08:38 | |
*** bogdando has joined #oooq | 08:50 | |
*** ykarel is now known as ykarel|afk | 09:03 | |
*** marios has quit IRC | 09:04 | |
*** udesale_ has quit IRC | 09:04 | |
*** ccamacho has joined #oooq | 09:29 | |
*** apetrich has joined #oooq | 09:39 | |
*** marios has joined #oooq | 10:05 | |
*** zbr is now known as zbr|rover | 10:09 | |
marios | zbr|rover: any idea why that rdo-tox-molecule is running rdo-fedora-28 http://logs.rdoproject.org/52/24552/1/check/rdo-tox-molecule/fecc567/job-output.txt did we define it that way and do you know why it fails | 10:35 |
marios | ERROR: molecule: could not install deps | 10:35 |
*** soniya29 has quit IRC | 10:36 | |
*** soniya29 has joined #oooq | 10:36 | |
*** ykarel|afk is now known as ykarel | 10:36 | |
zbr|rover | marios: i know, docker needs. but it can be upgraded to newer OS. | 10:37 |
*** udesale has joined #oooq | 10:38 | |
zbr|rover | marios: mainly we need docker-ce with molecule, as old one is too buggy. 28 was picked for convenience at that time but is not a hard req | 10:38 |
zbr|rover | any fedora newer or centos-8 will do the trick too. | 10:39 |
zbr|rover | now that we have centos-8 it would worth making the change. | 10:39 |
zbr|rover | just don't try centos-7, please. | 10:39 |
*** soniya29 has quit IRC | 10:41 | |
*** soniya29 has joined #oooq | 10:42 | |
*** soniya29 has joined #oooq | 10:43 | |
*** d0ugal has quit IRC | 10:46 | |
*** d0ugal has joined #oooq | 10:46 | |
marios | sshnaidm: we have a problem re https://review.opendev.org/#/c/702625/1/zuul.d/standalone-jobs.yaml | 10:47 |
marios | 12:44 <@jistr> marios: thanks, so on stein we should only have upgrade-stein? | 10:47 |
marios | 12:44 < marios> jistr: checking puppet-tripleo layout sec | 10:47 |
marios | 12:45 < marios> jistr: ah damnit ... i see why now. so yeah jistr we need in stein only the stein job | 10:47 |
marios | 12:45 -!- gfidente [~gfidente@ovpn-116-26.ams2.redhat.com] has quit [Quit: quit] | 10:47 |
marios | 12:46 < marios> jistr: problem is https://review.opendev.org/#/c/702625/1/zuul.d/standalone-jobs.yaml | 10:47 |
marios | 12:46 < marios> matbu: ^^ ;D | 10:48 |
marios | 12:47 < marios> jistr: they now all match so we get master/train/stein. we did that ^^ because before it wasn't matching and we were not running stein or train anywhere | 10:48 |
marios | so now we are getting master/stein/train running in https://review.opendev.org/#/c/702696 for stein | 10:48 |
sshnaidm | marios, I see | 10:49 |
sshnaidm | marios, so tripleo-ci-centos-7-standalone-upgrade should run on master only, right? | 10:50 |
marios | sshnaidm: yeah like the master/train upgrade is useless for changes to stein | 10:50 |
sshnaidm | marios, I'd try to remove "branch" in tripleo-ci-centos-7-standalone-upgrade and see what happens | 10:51 |
marios | sshnaidm: hmm (default master( | 10:51 |
sshnaidm | marios, idk, maybe it will work with implicit.. | 10:51 |
*** d0ugal has quit IRC | 10:52 | |
sshnaidm | marios, other option - just to define 3 different jobs, w/o inheritance and tie each one to its branch explicitly | 10:52 |
marios | zuul config moved oh noe 404 https://zuul-ci.org/docs/zuul/user/config.html | 10:52 |
marios | anyone know? | 10:52 |
sshnaidm | marios, https://zuul-ci.org/docs/zuul/ ? | 10:53 |
marios | sshnaidm: thanks :D | 10:53 |
*** d0ugal has joined #oooq | 10:55 | |
sshnaidm | marios, I read branches section there multiple times, but not much helped me :D | 10:56 |
*** dsneddon has quit IRC | 11:03 | |
marios | sshnaidm: i find the explanation quite convoluted not very clear to me | 11:13 |
marios | sshnaidm: seems it matter when trusted or not | 11:13 |
marios | sshnaidm: and i need to read it few more times ;) | 11:13 |
marios | sshnaidm: thanks i will chekc your reviews too.. they ping me from upgrades team is why i was looking there i.e. now all of the jobs are running for stein and unnecessary | 11:13 |
sshnaidm | marios, yeah, it's most vague section there | 11:14 |
*** udesale has quit IRC | 11:14 | |
*** surpatil has quit IRC | 11:31 | |
*** chandankumar has left #oooq | 11:33 | |
*** dsneddon has joined #oooq | 11:33 | |
*** chandankumar has joined #oooq | 11:40 | |
*** panda is now known as panda|drappt | 11:46 | |
*** epoojad1 has joined #oooq | 11:57 | |
*** bhagyashris|NHO is now known as bhagyashris | 12:02 | |
*** jpena is now known as jpena|lunch | 12:05 | |
kopecmartin | weshay_: joining? | 12:06 |
*** dtantsur|afk is now known as dtantsur | 12:07 | |
ykarel | weshay_, zbr|rover, is the issue related to upstream logs already known, logs files are not browsable, forced to download those to check contents | 12:24 |
ykarel | is there fix already ? | 12:24 |
ykarel | i noticed few days back also, but forgot to ask | 12:24 |
ykarel | for reference example:- https://1b29e59047137324253b-6f1974401b778e56e9b593a6fc2d8e70.ssl.cf2.rackcdn.com/702430/1/check/tripleo-ci-centos-7-undercloud-containers/b1773df/logs/undercloud/home/zuul/ | 12:26 |
ykarel | i know this is related to upstream change http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html | 12:26 |
ykarel | but don't know if it's known for tripleo jobs and is being fixed | 12:26 |
zbr|rover | ykarel: on my today radar, getting back to logs in few minutes (i am on meeting) | 12:28 |
ykarel | zbr|rover, ack take your time | 12:28 |
weshay|ruck | kopecmartin, sorry man | 12:40 |
weshay|ruck | kopecmartin, I slept through my alarm | 12:40 |
weshay|ruck | did you guys have a mtg? | 12:40 |
*** ykarel has quit IRC | 12:43 | |
*** ykarel has joined #oooq | 12:43 | |
weshay|ruck | marios, /me was looking at the zuul config for standalone upgrade yesterday | 12:49 |
kopecmartin | weshay_: no problem, yes, i did a little presentation of what we have and what i'm working on atm | 12:49 |
weshay|ruck | kopecmartin, ok.. so sorry I screwed up there | 12:50 |
weshay|ruck | kopecmartin, so who is on board to help you? | 12:50 |
kopecmartin | weshay_: arie, avi and vadim told me the were going to run the collect logs in their jobs and experiment with it a little | 12:51 |
weshay|ruck | marios, I saw two standalone jobs fail... in gate.. 1 in drln-build and one w/ deploy | 12:51 |
marios | weshay|ruck: ack yeah lets talk about it on scrum. the branchs helped to unblock jobs https://review.opendev.org/702625 but now its running on stein all the jobs sshnaidm posted some fixes for that bit today | 12:51 |
kopecmartin | i mentioned what i need and we kind of agreed on next steps | 12:51 |
weshay|ruck | kopecmartin, ok.. | 12:51 |
weshay|ruck | kopecmartin, this is all getting started too late this sprint to present anything... | 12:52 |
weshay|ruck | so kopecmartin let's just call this an early start on next sprint :) | 12:52 |
*** ykarel is now known as ykarel|afk | 12:52 | |
weshay|ruck | kopecmartin, can you summarize the next steps in an email? and send to openstack-pcci? | 12:53 |
weshay|ruck | + arie | 12:53 |
kopecmartin | weshay_: sure, also lots of other distractions happened this sprint, like setuptools upgrade dropping python2 .. | 12:53 |
kopecmartin | weshay_: sure, I'll send it | 12:53 |
weshay|ruck | kopecmartin++ | 12:54 |
weshay|ruck | thanks man.. | 12:54 |
*** ykarel|afk has quit IRC | 12:54 | |
*** ykarel_ has joined #oooq | 12:54 | |
*** ykarel_ is now known as ykarel | 12:54 | |
kopecmartin | weshay_: can we move this forward? https://review.opendev.org/#/c/682042/ | 12:55 |
* weshay|ruck looks | 12:56 | |
weshay|ruck | kopecmartin, of course.. looks good https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d2d/682042/18/check/openstack-tox-molecule/d2dc03e/tox/reports.html | 12:57 |
*** ykarel is now known as ykarel|afk | 12:58 | |
*** ratailor has quit IRC | 12:58 | |
*** rlandy has joined #oooq | 12:59 | |
rfolco | scrum time rlandy marios sshnaidm arxcruz|off zbr|rover panda|drappt | 12:59 |
*** epoojad1 is now known as epoojad1|afk | 13:02 | |
*** marios is now known as marios|call | 13:02 | |
*** amoralej is now known as amoralej|lunch | 13:02 | |
*** d0ugal has quit IRC | 13:04 | |
*** soniya29 has quit IRC | 13:05 | |
*** epoojad1|afk has quit IRC | 13:06 | |
*** d0ugal has joined #oooq | 13:10 | |
*** jpena|lunch is now known as jpena | 13:10 | |
zbr|rover | put link to broken molecule job inside https://etherpad.openstack.org/p/ruckroversprint20 -- so I can watch it. | 13:11 |
*** panda|drappt is now known as panda | 13:25 | |
marios|call | https://review.rdoproject.org/r/#/c/24339/ | 13:37 |
weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master%09 | 13:42 |
weshay|ruck | marios|call, ^ | 13:42 |
weshay|ruck | https://softwarefactory-project.io/r/#/c/17307/ | 13:48 |
*** akahat has quit IRC | 13:49 | |
*** akahat has joined #oooq | 13:50 | |
*** udesale has joined #oooq | 13:52 | |
*** akahat has quit IRC | 13:56 | |
*** dtantsur is now known as dtantsur|brb | 14:03 | |
*** amoralej|lunch is now known as amoralej | 14:04 | |
*** epoojad1 has joined #oooq | 14:06 | |
*** bhagyashris has quit IRC | 14:18 | |
weshay|ruck | https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ | 14:20 |
chandankumar | zbr|rover, Hello | 14:30 |
chandankumar | zbr|rover, https://review.rdoproject.org/zuul/builds?job_name=podman-package-centos-8 | 14:31 |
*** derekh has joined #oooq | 14:31 | |
chandankumar | zbr|rover, is showing post failure , needs fix | 14:31 |
zbr|rover | chandankumar: yeah, needs but i am already over my head | 14:32 |
zbr|rover | chandankumar: can you propose a patch? | 14:32 |
chandankumar | zbr|rover, ok looking | 14:32 |
*** epoojad1 has quit IRC | 14:35 | |
weshay|ruck | https://softwarefactory-project.io/r/#/c/17307/ | 14:36 |
marios|call | https://tree.taiga.io/project/tripleo-ci-board/us/1440?milestone=249270 | 14:36 |
*** marios|call is now known as marios | 14:37 | |
weshay|ruck | zbr|rover, https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/tasks/publish.yml | 14:38 |
zbr|rover | weshay|ruck: https://review.rdoproject.org/r/#/c/24580/ | 14:38 |
chandankumar | kopecmartin, please have a look https://review.opendev.org/702808 | 14:42 |
*** TrevorV has joined #oooq | 14:42 | |
*** epoojad1 has joined #oooq | 14:43 | |
* kopecmartin looking | 14:52 | |
weshay|ruck | zbr|rover, | 14:52 |
weshay|ruck | "artcl_gzip_only": true, | 14:52 |
weshay|ruck | "artcl_publish": true, | 14:52 |
weshay|ruck | "artcl_rsync_logs": false, | 14:52 |
weshay|ruck | "artcl_txt_rename": true | 14:52 |
weshay|ruck | https://d0b9bb7d6fcef48d96ec-efd5ea2c2502e38b3629faa5d1e6d102.ssl.cf5.rackcdn.com/702862/1/check/tripleo-ci-centos-7-standalone/ae948fa/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz | 14:52 |
weshay|ruck | marios, I guess we're having some success w/ standalone-upgrade-$branch | 15:07 |
weshay|ruck | http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-stein | 15:07 |
weshay|ruck | oof http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-train# | 15:08 |
marios | weshay|ruck: 2 issues. 1 is train broken but matbu fixing with https://review.opendev.org/#/c/701970/ | 15:08 |
marios | 13:28 < matbu> and the quick and (a bit) dirty one: https://review.opendev.org/701920 | 15:08 |
marios | weshay|ruck: the other issue is that now e.g. for stein there https://review.opendev.org/#/c/702696 it runs all the variants cos of the way we have branches | 15:09 |
rlandy | chandankumar: hi ... want to review the baremetal and internal slides? | 15:09 |
marios | weshay|ruck: sshnaidm trying to fix it with https://review.opendev.org/702843 OR https://review.opendev.org/702844 | 15:09 |
rlandy | let me know if they make sense to you | 15:09 |
weshay|ruck | rlandy, what's the osp dlrn link? | 15:11 |
chandankumar | rlandy, email the link, will get reviews up | 15:11 |
rlandy | weshay|ruck, http://10.0.76.142/rhel8-osp17/ | 15:12 |
weshay|ruck | htanks | 15:12 |
weshay|ruck | rlandy, ah.. so | 15:13 |
weshay|ruck | http://10.0.76.142/rhel8-osp17/component/ | 15:13 |
weshay|ruck | but go back one dir | 15:14 |
weshay|ruck | rlandy, http://10.0.76.142/rhel8-osp17/ | 15:14 |
weshay|ruck | both kinds of builds are avail there | 15:14 |
weshay|ruck | and we wouldn't have to go through this mess | 15:14 |
chandankumar | weshay|ruck, please have a look at this [InfraRed] Python-waitress - Is your DFG affected? internal thread | 15:14 |
weshay|ruck | chandankumar, k | 15:14 |
rlandy | weshay|ruck: yeah downstream is actually easier :) | 15:18 |
weshay|ruck | ya | 15:18 |
rlandy | if you look at tripleo-ci-testing ... | 15:18 |
rlandy | http://10.0.76.142/rhel8-osp17/tripleo-ci-testing/delorean.repo | 15:18 |
rlandy | it's the two components we promoted | 15:19 |
weshay|ruck | chandankumar, so we're good re: waitress? | 15:19 |
weshay|ruck | ya | 15:19 |
chandankumar | weshay|ruck, yes, it is taken care, all blame goes to neutron-lib or python-pecan which does not comes under our DFG | 15:26 |
weshay|ruck | chandankumar++ | 15:29 |
weshay|ruck | thanks for responding | 15:29 |
*** epoojad1 has quit IRC | 15:38 | |
*** holser has quit IRC | 15:40 | |
*** holser__ has joined #oooq | 15:41 | |
rlandy | marios: should I w+ https://review.rdoproject.org/r/#/c/24549/? | 15:43 |
rlandy | the impact will be jenkins | 15:43 |
weshay|ruck | rlandy, he said is was a mistake | 15:48 |
*** rfolco is now known as rfolco|doctor | 15:48 | |
rlandy | ? | 15:48 |
marios | rlandy: thinking /checking | 15:49 |
marios | 17:48 < weshay|ruck> rlandy, he said is was a mistake | 15:49 |
marios | weshay|ruck: ? | 15:49 |
rlandy | weshay|ruck: what was a mistake? | 15:49 |
marios | rlandy: indeed concerned about the jenkins since its in the same repo ... i could maybe not chang that bit? | 15:50 |
marios | rlandy: before we merge it | 15:50 |
marios | rlandy: https://review.rdoproject.org/r/#/c/24549/2/jenkins/jobs/tripleo-upstream-builders.yml this | 15:50 |
marios | wdyt? | 15:50 |
rlandy | marios: ok - let's play this safe | 15:50 |
rlandy | just add the get-hash | 15:50 |
rlandy | we merge that | 15:50 |
rlandy | change jenkins last | 15:50 |
rlandy | imho | 15:50 |
marios | rlandy: yeah -2 it just now | 15:50 |
rlandy | I think it's fine | 15:50 |
marios | rlandy: i'll update sec | 15:50 |
weshay|ruck | rlandy, the osp dlrn server and components | 15:53 |
chandankumar | rlandy, marios, weshay|ruck zbr|rover https://review.rdoproject.org/r/24581 | 15:54 |
chandankumar | for molecule job | 15:54 |
marios | rlandy: weshay|ruck: thanks done https://review.rdoproject.org/r/24549 | 15:55 |
rlandy | weshay|ruck: can he make the same mistake upstream? | 15:56 |
rlandy | marios: thanks - will merge that when CI completes | 15:57 |
rlandy | then you can start testing | 15:57 |
weshay|ruck | chandankumar, are you done for the day? | 15:57 |
zbr|rover | chandankumar: be careful about bindep, i have to -W it, see notes. | 15:58 |
chandankumar | weshay|ruck, nope | 15:58 |
marios | rlandy: thanks for bringing it up and keeping us safe ;) | 15:58 |
rlandy | marios: jenkins is a murky underworld where we proceed with intense caution | 15:59 |
weshay|ruck | chandankumar, am I not seeing something obvious here? https://bugs.launchpad.net/tripleo/+bug/1860000 | 16:00 |
openstack | Launchpad bug 1860000 in tripleo "ERROR: cp cannot stat docker, no such file dlrn builds of tht" [Critical,Triaged] | 16:00 |
* weshay|ruck needs another pair of eyes.. | 16:00 | |
weshay|ruck | chandankumar, https://review.opendev.org/#/c/702737/ rlandy please vote | 16:01 |
*** dtantsur|brb is now known as dtantsur | 16:02 | |
chandankumar | zbr|rover, done | 16:03 |
zbr|rover | chandankumar: here is a hint, look at https://github.com/ansible/molecule/pull/2486/files as it could prove useful. is not merged yet but I suspect is right. | 16:05 |
weshay|ruck | chandankumar, ah fixed the last time https://review.rdoproject.org/r/#/c/20218/ | 16:05 |
zbr|rover | chandankumar: ping me when confirmed by zuul. | 16:05 |
rlandy | marios: k - want to try flip the switch on config? | 16:06 |
rlandy | https://review.rdoproject.org/r/#/c/24552/ | 16:06 |
*** jpena is now known as jpena|off | 16:07 | |
rlandy | marios: fyi ... https://github.com/rdo-infra/rdo-jobs/search?q=get-hash.sh&unscoped_q=get-hash.sh | 16:07 |
rlandy | legacy - probably doesn't matter | 16:07 |
marios | rlandy: ack thanks | 16:09 |
rlandy | looking at tox-molecule failure | 16:09 |
chandankumar | rlandy, https://review.rdoproject.org/r/24581 | 16:10 |
chandankumar | pleas take over this on now looking into podman failure | 16:10 |
rlandy | zbr|rover: chandankumar: k - adding a dep job to run tox-molecule | 16:14 |
zbr|rover | rlandy: better enable the job directly in rdo-jobs, even with a placeholder scenario. | 16:15 |
weshay|ruck | ok.. I need eyes | 16:15 |
weshay|ruck | zbr|rover, can I borrow you | 16:15 |
rlandy | zbr|rover: yep - that is what I am doing | 16:15 |
weshay|ruck | this is fucking crazy | 16:15 |
zbr|rover | in fact likely it only needs file patterns updated | 16:15 |
zbr|rover | weshay|ruck: i know, link | 16:16 |
weshay|ruck | zbr|rover, check out and clone https://review.opendev.org/#/c/702485/ | 16:16 |
weshay|ruck | it's stable/rocky afaict | 16:16 |
weshay|ruck | zbr|rover, in the base dir.. look for a docker dir | 16:17 |
weshay|ruck | then look at https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/rocky | 16:17 |
weshay|ruck | HOW IS THE DOCKER DIR MISSING | 16:18 |
zbr|rover | is not missing forme, refresh page | 16:20 |
weshay|ruck | it's in git.. on rocky | 16:20 |
weshay|ruck | missing from the patch | 16:20 |
weshay|ruck | BUT HOW | 16:21 |
weshay|ruck | do you see what I see? </me sings> | 16:21 |
zbr|rover | weshay|ruck: lucky guess: a branch override somewhere and zuul cherrypicks this commit on top of.... master? | 16:22 |
zbr|rover | or something like this | 16:22 |
marios | weshay|ruck: every day as warren g? | 16:22 |
weshay|ruck | maybe.. this is fucked | 16:22 |
weshay|ruck | marios, and nate dogg of course :) | 16:23 |
zbr|rover | clearly gerrit does clone the right stuff, must be zuul related or how the code is cloned. | 16:23 |
weshay|ruck | zbr|rover, nothing to do w/ zuul | 16:23 |
weshay|ruck | when I git-review -d Icaba7a58f458d853912d038f24c0cb4f853e0166 the docker dir is gone | 16:23 |
weshay|ruck | when I checkout rocky it's there | 16:23 |
weshay|ruck | WHAT THE F>... now it's workign? | 16:24 |
weshay|ruck | zbr|rover, I need u | 16:26 |
weshay|ruck | zbr|rover, https://meet.google.com/rwm-azpb-doj?authuser=1 | 16:26 |
marios | weshay|ruck: that album is one of my favs | 16:26 |
* marios almost out | 16:26 | |
weshay|ruck | zbr|rover, you avail? | 16:29 |
zbr|rover | now... multitasking overload | 16:29 |
weshay|ruck | zbr|rover, aye.. sorry part of the ruck/rover job | 16:29 |
weshay|ruck | this is blowing my mind.. I need to show you this | 16:29 |
chandankumar | marios sshnaidm thank you for looking and working on upgrade jobs upstream :-) | 16:30 |
chandankumar | marios++ sshnaidm++ | 16:30 |
*** bogdando has quit IRC | 16:31 | |
*** bogdando_ has joined #oooq | 16:31 | |
rlandy | marios: if we can get my and chandankumar's patches though to clear rdotox-molecule, should we try the switch then? | 16:31 |
rlandy | really rattle ruck/rovers | 16:31 |
*** holser has joined #oooq | 16:32 | |
*** holser has quit IRC | 16:32 | |
*** holser__ has quit IRC | 16:32 | |
*** holser has joined #oooq | 16:33 | |
*** bogdando_ is now known as bogdando | 16:33 | |
marios | rlandy: add me to reviews will check tomorrow | 16:34 |
marios | rlandy: looking at some of my slides now but will be going in few mins | 16:34 |
rlandy | marios: ack - understood | 16:35 |
weshay|ruck | zbr|rover, https://bugs.launchpad.net/tripleo/+bug/1860000 | 16:38 |
openstack | Launchpad bug 1860000 in tripleo "ERROR: cp cannot stat docker, no such file dlrn builds of tht" [Critical,Triaged] | 16:38 |
*** chem has quit IRC | 16:39 | |
*** tesseract has quit IRC | 16:39 | |
rlandy | zbr|rover: ok ... pls review https://review.rdoproject.org/r/#/c/24582/ rebased off https://review.rdoproject.org/r/#/c/24581) | 16:43 |
chandankumar | weshay|ruck, sorry not able to look at that bug, will look into that now or tomorrow morning | 16:43 |
rlandy | see the rdo-tox-molecule test run in the first patch | 16:43 |
rlandy | chandankumar: zbr|rover: ^^ | 16:43 |
weshay|ruck | zbr|rover, "artg_repos_dir": "/home/zuul/src/opendev.org/openstack", | 16:44 |
rlandy | zbr|rover: if ok - pls remove your -2 from https://review.rdoproject.org/r/#/c/24581/ | 16:44 |
rlandy | and we can merge both | 16:44 |
*** chem has joined #oooq | 16:44 | |
*** marios is now known as marios|out | 16:46 | |
weshay|ruck | chandankumar, np.. we figured out.. issue w/ gerrit | 16:48 |
chandankumar | weshay|ruck, :-) | 16:49 |
* chandankumar heads to my cave, see ya tomorrow | 16:49 | |
*** chandankumar is now known as raukadah | 16:49 | |
weshay|ruck | raukadah, should I merge the centos8 image change? | 16:49 |
weshay|ruck | looks fine | 16:49 |
raukadah | See ya people tomorrow | 16:50 |
raukadah | weshay|ruck, we need ack from tristinc and zbr|rover | 16:50 |
zbr|rover | weshay|ruck: apparently is ok to keep the change id on cherry picks | 16:50 |
*** marios|out has quit IRC | 16:54 | |
zbr|rover | rlandy: raukadah: this is what I asked: https://review.rdoproject.org/r/#/c/24581/ | 16:59 |
zbr|rover | to assure that when bindep.txt is touched, we also run the job, avoiding breaking it. | 17:00 |
rlandy | zbr|rover: that is what I did | 17:00 |
rlandy | in a separate patch | 17:01 |
zbr|rover | rlandy: why sep patch? i do not want others to mess with this file and break the job by mistake. | 17:01 |
rlandy | zbr|rover: does it matter? | 17:01 |
zbr|rover | these jobs a not heavy like deploymens, we should run them. | 17:01 |
rlandy | https://review.rdoproject.org/r/#/c/24582/ | 17:02 |
zbr|rover | matters because it makes review harder and does not prevent future regression. | 17:02 |
rlandy | whatever | 17:02 |
*** baha has quit IRC | 17:13 | |
*** bogdando_ has joined #oooq | 17:16 | |
*** bogdando has quit IRC | 17:17 | |
*** bogdando_ is now known as bogdando | 17:17 | |
rlandy | zbr|rover: merging https://review.rdoproject.org/r/#/c/24581/ | 17:19 |
zbr|rover | rlandy: super | 17:20 |
*** baha has joined #oooq | 17:23 | |
*** fmount is now known as fmount|afk | 17:28 | |
*** jpena|off is now known as jpena | 17:29 | |
*** udesale has quit IRC | 17:31 | |
*** amoralej is now known as amoralej|off | 17:35 | |
*** saneax has quit IRC | 17:40 | |
*** rfolco|doctor is now known as rfolco | 17:42 | |
*** bogdando has quit IRC | 17:44 | |
mjturek | yooooo, could you take a ook here? https://review.rdoproject.org/r/#/c/24560/ | 17:48 |
mjturek | whoops | 17:48 |
mjturek | rfolco ^ | 17:48 |
rfolco | mjturek, heh I just asked baha on #rdo about it | 17:50 |
rfolco | mjturek, what did happen to the blacklist approach ? | 17:50 |
rfolco | mjturek, +w I won't hold you, just was curious on the previous blacklist approach :) | 17:57 |
mjturek | it's making progress but we're impatient | 17:57 |
rfolco | mjturek, ok | 17:58 |
mjturek | we're willing to revert if/when it happens | 17:58 |
*** derekh has quit IRC | 18:01 | |
weshay|ruck | rlandy, rfolco was someone fixing the config molecule job w/ a bindep change? http://logs.rdoproject.org/52/24552/2/check/rdo-tox-molecule/efaaa78/job-output.txt | 18:25 |
rlandy | weshay|ruck: ack | 18:25 |
rlandy | just merged it | 18:25 |
rlandy | https://review.rdoproject.org/r/#/c/24581/ | 18:26 |
rlandy | looking | 18:26 |
rlandy | weshay|ruck: my recheck should have been after merge | 18:27 |
weshay|ruck | rlandy, yup.. ur right | 18:28 |
rlandy | the change was in rdo-jobs | 18:28 |
rlandy | this one fails config | 18:28 |
weshay|ruck | zbr|rover, can we change that from a f28 node? | 18:30 |
*** dtantsur is now known as dtantsur|afk | 18:30 | |
zbr|rover | yes | 18:30 |
zbr|rover | but i was waiting for rdo to finish upating centos-8 image | 18:31 |
weshay|ruck | zbr|rover, do you think they will be done today? | 18:31 |
weshay|ruck | is there a review for that? | 18:32 |
zbr|rover | yes | 18:32 |
weshay|ruck | zbr|rover, busy day eh? | 18:32 |
weshay|ruck | zbr|rover, the molecule install deps work fine on f30 | 18:33 |
weshay|ruck | but running from the base dir of config | 18:34 |
weshay|ruck | I get ERROR: file not found: molecule | 18:34 |
zbr|rover | yeah! and I didn't tell you all things I went on. | 18:34 |
rlandy | https://review.rdoproject.org/zuul/builds?job_name=rdo-tox-molecule | 18:35 |
rlandy | so we have passes on rdo-jobs | 18:36 |
rlandy | but failures on config | 18:36 |
weshay|ruck | missing env dir for just the molecule command | 18:36 |
weshay|ruck | zbr|rover, where is the review on the centos8 stuff | 18:37 |
weshay|ruck | zbr|rover, is rhel8 a quick option? | 18:38 |
zbr|rover | nope | 18:38 |
weshay|ruck | it's configured in tox.ini | 18:38 |
weshay|ruck | k | 18:38 |
weshay|ruck | zbr|rover, so.. if I have a python3 virt env | 18:39 |
weshay|ruck | and run tox molecule | 18:39 |
zbr|rover | give me few minutes | 18:39 |
weshay|ruck | that should work | 18:39 |
weshay|ruck | k | 18:39 |
weshay|ruck | deps are working | 18:39 |
weshay|ruck | \0/ https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_fec/702286/2/check/tripleo-ci-centos-7-standalone/fecdf85/logs/README.html | 18:39 |
weshay|ruck | rlandy, ^ | 18:40 |
weshay|ruck | https://review.opendev.org/#/c/702286/ | 18:40 |
*** jpena is now known as jpena|off | 18:41 | |
weshay|ruck | rlandy, can you hook /me up w/ a +2 | 18:41 |
rlandy | weshay|ruck: congrats | 18:42 |
rlandy | zbr: do you know why the rdo-tox-molecule job passes on rdo-jobs and fails on config? | 18:48 |
rlandy | only defined in rdo-jobs | 18:48 |
rlandy | and called from projects in config | 18:48 |
rlandy | zbr|rover: ^^? | 18:48 |
zbr|rover | rlandy: because bindep is taken from builded repo, so you need to keep it in sync | 18:48 |
rlandy | bindep in config ... | 18:48 |
zbr|rover | alternative is to put these in playbook that prepares molecule to avoid having to copy/paste it everywhere. | 18:49 |
rfolco | does anybody know what happened to centos-release-opstools on centos8 ? | 18:49 |
rfolco | centos-release-opstools-1-8.el7.noarch : Config to enable the repository for OpsTools SIG | 18:49 |
rfolco | Repo : extras | 18:49 |
rlandy | and if there is none?? | 18:49 |
rfolco | available in extras on centos7, it does not exist in centos8 | 18:50 |
rlandy | zbr|rover: ^^ ... so we need to get marios job through | 18:50 |
rlandy | a playbook that calls a single bindep? | 18:51 |
zbr|rover | rlandy: weshay|ruck : I will take care of switching molecule to centos-8 via https://review.rdoproject.org/r/#/c/24584/ but we need bit of patience to allow tristanC to finish updating the image. | 18:51 |
weshay|ruck | zbr|rover, I have no patience on this one | 18:51 |
weshay|ruck | if it's not ready.. let's use f30 | 18:51 |
zbr|rover | ahh sure, why not. | 18:51 |
rlandy | we may live to regret that | 18:52 |
tristanC | zbr|rover: weshay|ruck: the cloud-centos-8 should be ready and usable now | 18:52 |
rlandy | weshay|ruck: ^^ request to let zbr|rover try that first | 18:52 |
tristanC | and we can get more capacity for it with https://softwarefactory-project.io/r/17333 | 18:52 |
weshay|ruck | aye | 18:52 |
rlandy | otherwise we will be debugging f30 next | 18:52 |
* rlandy has appt at the DMV to get that new Real ID license thing ... | 18:53 | |
weshay|ruck | rlandy, you don't have one w/ real id? | 18:53 |
rlandy | will be back soon-ish | 18:53 |
weshay|ruck | u sure? | 18:53 |
rlandy | weshay|ruck: pretty sure | 18:53 |
zbr|rover | tristanC: what is the correct nodeset name to use for it? | 18:53 |
weshay|ruck | look for a star | 18:53 |
rlandy | I have no stars | 18:54 |
rlandy | its' very sad | 18:54 |
*** rlandy is now known as rlandy|afk | 18:54 | |
weshay|ruck | rlandy|afk, heh k | 18:54 |
*** dsneddon has quit IRC | 18:54 | |
tristanC | zbr|rover: i didn't create a nodeset, just a label | 18:54 |
tristanC | so, should we merge https://review.rdoproject.org/r/#/c/24583/ ? | 18:58 |
rlandy|afk | tristanC: I will when CI passes | 19:01 |
tristanC | rlandy|afk: what job/change are you using to validate it? | 19:01 |
rlandy|afk | it's ruuning tests now | 19:03 |
zbr|rover | something is broken in bindep... aparently [compile test platform:centos-7 platform:rpm] evaluates as true on centos-8 | 19:13 |
*** holser has quit IRC | 19:13 | |
zbr|rover | wtf.... | 19:13 |
*** holser has joined #oooq | 19:14 | |
*** ccamacho has quit IRC | 19:18 | |
zbr|rover | in fact I thin that this broken bindep comes from another place, but I have no clue from where | 19:18 |
zbr|rover | or maybe not,.... condition was not working as expected. | 19:18 |
zbr|rover | personally I would ditch bindep tool and replace it with a bindep.yaml playbook. | 19:19 |
*** holser has quit IRC | 19:20 | |
zbr|rover | obviously that ensure-tox chokes .... failing to find tox and pip | 19:22 |
raukadah | zbr|rover, need some help here https://review.rdoproject.org/r/#/c/24579/ | 19:26 |
*** dsneddon has joined #oooq | 19:29 | |
zbr|rover | and obviously that now i hit fixes I propose 3 months ago but that were not merged https://review.opendev.org/#/c/690057/3 | 19:29 |
zbr|rover | time to chaise ianw as I think his vote was wrong | 19:29 |
*** dsneddon has quit IRC | 19:34 | |
zbr|rover | tristanC: by any chance do we use an outdated clone of zuul-jobs on rdo? because I see a bug that was fixed long time ago in ensure-tox | 19:35 |
tristanC | zbr|rover: perhaps, there is a fetch-zuul-cloner-fork/ in rdo-jobs, not sure it's used | 19:45 |
zbr|rover | tristanC: i was not able to find any occurence of fetch-zuul-cloner-fork on eiher sf nor rdo zuul instances, so i guess not. | 19:47 |
zbr|rover | apparently we no longer have tox in centos-8,... should I dare to do a 'pip install tox' when we build the image...? | 19:49 |
*** tosky has quit IRC | 20:04 | |
*** dsneddon has joined #oooq | 20:07 | |
sshnaidm | zbr|rover, try to use ! conditions in bindep, like !platform:centos-8 if you want to exclude | 20:11 |
*** sshnaidm is now known as sshnaidm|afk | 20:14 | |
*** dsneddon has quit IRC | 20:15 | |
weshay|ruck | tristanC, in the dib build for centos | 20:22 |
weshay|ruck | can we make sure pip3 and tox are installed | 20:22 |
tristanC | weshay|ruck: yes sure, probably using an elements or editing an existing one | 20:22 |
weshay|ruck | so we can avoid issues like https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-tox/tasks/main.yaml | 20:22 |
weshay|ruck | zbr|rover, that will do it right? | 20:23 |
tristanC | iirc zbr|rover proposed something already? | 20:23 |
zbr|rover | tristanC: working on it, it seems that my fixes on ensure-tox where not merged upstream. | 20:23 |
*** jfrancoa has quit IRC | 20:31 | |
*** dsneddon has joined #oooq | 20:49 | |
*** dsneddon has quit IRC | 20:56 | |
*** TrevorV has quit IRC | 20:59 | |
*** rlandy|afk is now known as rlandy | 21:03 | |
rlandy | podman-package-centos-8NODE_FAILURE in 0s (non-voting) | 21:05 |
rlandy | rebasing | 21:06 |
zbr|rover | good progress on upstream, we will have a fix today for ensure-tox | 21:07 |
rlandy | weshay|ruck: can you explain your email re: downstream rrcockpit? | 21:07 |
weshay|ruck | rlandy, so I was poking around sshnaidm|afk's patches.. I think he has everything merged he has up | 21:08 |
weshay|ruck | rlandy, I guess I need to check the internal repo | 21:08 |
weshay|ruck | to see if we've added the internal zuul config for telegraf | 21:08 |
rlandy | weshay|ruck: getting internal repo | 21:09 |
weshay|ruck | https://code.engineering.redhat.com/gerrit/#/q/owner:%22Sagi+Shnaidman+%253Csshnaidm%2540redhat.com%253E%22+project:openstack/rrcockpit | 21:09 |
rlandy | weshay|ruck: it would be good if this was added to the tenant | 21:10 |
rlandy | and actually ran tests :) | 21:10 |
rlandy | weshay|ruck: ok - so in downstream we want both upstream and downstream data | 21:12 |
weshay|ruck | rlandy, aye | 21:12 |
weshay|ruck | rlandy, so we'll start w/ just a 1 downstream page.. and experiment from there | 21:12 |
rlandy | weshay|ruck: and right now we only have upstream data | 21:12 |
rlandy | so we don;t want to intermingle the two | 21:13 |
weshay|ruck | rlandy, don't know yet :) | 21:13 |
rlandy | weshay|ruck: this fight again :) | 21:13 |
weshay|ruck | but I for sure I want a page that is downstream only so I can check to see if everything we should see.. is visible | 21:13 |
rlandy | podman-package-centos-8success (non-voting) | 21:14 |
rlandy | woohoo | 21:14 |
rlandy | raukadah: ^^ | 21:15 |
sshnaidm|afk | weshay|ruck, I'll add a page to downstream repo and telegraf file | 21:15 |
sshnaidm|afk | weshay|ruck, we'll see if it works as designed | 21:15 |
sshnaidm|afk | I hope it is :) | 21:15 |
weshay|ruck | rock on | 21:15 |
*** dsneddon has joined #oooq | 21:23 | |
rfolco | shutdown | 21:23 |
rfolco | https://hackmd.io/dSagCbocQ4KSVEZR1uf8Tw weshay|ruck 86 containers built so far | 21:23 |
rfolco | ttyl | 21:23 |
weshay|ruck | rock | 21:24 |
rlandy | weshay|ruck: for a manual standalone deployment, are these the docs to follow: https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/standalone.html? | 21:28 |
zbr|rover | weshay|ruck: fix https://review.opendev.org/#/c/702978/ | 21:29 |
weshay|ruck | rlandy, yes.. Emilien also has a nice blog w/ a how to | 21:29 |
*** rfolco has quit IRC | 21:29 | |
weshay|ruck | rlandy, in the bootcamp notes I think | 21:29 |
rlandy | https://my1.fr/blog/developer-workflow-with-tripleo/ | 21:29 |
weshay|ruck | zbr|rover, looking | 21:29 |
weshay|ruck | rlandy, aye | 21:30 |
rlandy | ok | 21:30 |
zbr|rover | the fact that rdo does not work with depdens-on on zuul-jobs could prove to be a testing problem | 21:30 |
weshay|ruck | zbr|rover++ | 21:30 |
zbr|rover | i wonder if is possible to address this | 21:30 |
weshay|ruck | don't go too deep :) | 21:31 |
zbr|rover | because I sure there is a LOT of work to about making zuul-roles centos-8 ready, a lot. | 21:31 |
weshay|ruck | zbr|rover, should be baked into the image imho | 21:31 |
zbr|rover | weshay|ruck: baking stuff in the images is not a panacea, images are build in many places, using many methods,... bug zuul roles are here to stay. | 21:32 |
zbr|rover | baking stuff in an image is more of an optimization AFAIK, but should not be a replacement for having these roles ready. | 21:32 |
zbr|rover | in fact these roles may be used to bake those images. | 21:33 |
weshay|ruck | zbr|rover, /me just saying.. I think tox sould be installed and ready to go in a ci system | 21:37 |
*** brault has joined #oooq | 22:07 | |
zbr|rover | weshay|ruck: rlandy: gz fix: https://review.opendev.org/#/c/702937/1 | 22:09 |
zbr|rover | weshay|ruck: true that it does not solve all, but we will get there. | 22:12 |
zbr|rover | there is also https://review.opendev.org/#/c/702949/ which is a collection optimization. | 22:15 |
zbr|rover | mainly it makes no sense to perform a local disk rsync, instead of creating hardlinks. | 22:15 |
zbr|rover | --link-dest= feature in rsync is not very well known, but can help a lot, especially on filesystems that do not have CoW | 22:16 |
zbr|rover | and if i remember well, we do not have CoW in VMs | 22:16 |
zbr|rover | there is something weird there as I see the zero date (1970) on some files. | 22:18 |
zbr|rover | look at https://1a26646eddef9988f4a8-d413fbe3672f31435774ef2983026d41.ssl.cf5.rackcdn.com/702949/1/check/tripleo-build-containers-centos-7/38f0ec6/logs/buildah-builds/kolla-2020-01-16_18-33-39_ub0uZY/ | 22:18 |
zbr|rover | and go inside | 22:18 |
weshay|ruck | zbr|rover, ya.. that works | 22:40 |
weshay|ruck | re: the build-contianers | 22:40 |
weshay|ruck | but note.. it doesn't use collect-logs | 22:40 |
weshay|ruck | so it's pretty clear clark fixed what ever he needed to | 22:40 |
weshay|ruck | I guess | 22:40 |
*** chem has quit IRC | 23:01 | |
*** chem has joined #oooq | 23:03 | |
rlandy | weshay|ruck: when you run standalone, how many nics is the box expected to have? | 23:17 |
weshay|ruck | rlandy, it's easier w/ two | 23:18 |
rlandy | so create eth1 ahead of time | 23:18 |
sshnaidm|afk | rlandy, weshay|ruck, https://review.rdoproject.org/r/#/q/topic:down+(status:open+OR+status:merged) | 23:51 |
rlandy | thanks - leaving comments from testing patch that we abandoned | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!