| *** honza has quit IRC | 00:57 | |
| *** pliu has quit IRC | 00:57 | |
| *** panda|ruck has quit IRC | 00:59 | |
| *** panda has joined #oooq | 01:02 | |
| *** agopi has quit IRC | 01:03 | |
| *** honza has joined #oooq | 01:04 | |
| *** panda has quit IRC | 01:06 | |
| *** panda has joined #oooq | 01:07 | |
| *** ykarel|away has joined #oooq | 03:02 | |
| *** ykarel|away has quit IRC | 03:34 | |
| *** skramaja has joined #oooq | 03:52 | |
| *** udesale has joined #oooq | 03:53 | |
| *** saneax has joined #oooq | 04:20 | |
| *** agopi has joined #oooq | 04:31 | |
| *** ykarel|away has joined #oooq | 05:05 | |
| *** ykarel|away is now known as ykarel | 05:11 | |
| *** Tengu_ is now known as Tengu | 05:25 | |
| *** apetrich has joined #oooq | 05:26 | |
| *** ratailor has joined #oooq | 05:47 | |
| ykarel | chandankumar, arxcruz is a bug created for that tempest issue? currently that's the only blocker for all releases | 05:48 |
|---|---|---|
| ykarel | chandankumar, arxcruz any plan to promote without fs020? and fix issue side by side | 05:48 |
| ykarel | weshay, was https://review.rdoproject.org/r/#/c/15438/ for promoting, if yes need fs020 as well | 05:52 |
| ykarel | ok promoting hash from 10th August in progress | 05:55 |
| *** kopecmartin has joined #oooq | 06:13 | |
| *** jfrancoa has joined #oooq | 06:48 | |
| *** pliu_ has joined #oooq | 06:49 | |
| *** ccamacho has joined #oooq | 07:01 | |
| *** amoralej|off is now known as amoralej | 07:09 | |
| *** bogdando has joined #oooq | 07:36 | |
| *** holser_ has joined #oooq | 07:47 | |
| *** ykarel is now known as ykarel|lunch | 07:56 | |
| *** openstackstatus has quit IRC | 08:12 | |
| *** dtantsur|afk is now known as dtantsur | 08:15 | |
| *** ykarel|lunch is now known as ykarel | 08:36 | |
| *** rfolco|rover has quit IRC | 08:46 | |
| *** sshnaidm|off is now known as sshnaidm | 08:48 | |
| *** jaosorior has quit IRC | 08:53 | |
| amoralej | panda, i just left a comment in https://review.rdoproject.org/r/#/c/15374/ | 09:13 |
| amoralej | btw we also need to fix ci-config to add rocky to promoter, right? | 09:14 |
| *** ratailor has quit IRC | 09:17 | |
| *** gkadam has joined #oooq | 09:18 | |
| *** ratailor has joined #oooq | 09:19 | |
| *** openstackstatus has joined #oooq | 09:40 | |
| *** ChanServ sets mode: +v openstackstatus | 09:40 | |
| *** ratailor has quit IRC | 09:48 | |
| *** ratailor has joined #oooq | 09:49 | |
| *** ykarel is now known as ykarel|afk | 09:58 | |
| *** saneax has quit IRC | 10:13 | |
| *** saneax has joined #oooq | 10:14 | |
| *** rfolco|rover has joined #oooq | 10:16 | |
| *** saneax has quit IRC | 10:24 | |
| panda | amoralej: updated thanks | 10:24 |
| *** panda is now known as panda|ruck | 10:24 | |
| panda|ruck | amoralej: creating promoter configuration too | 10:24 |
| amoralej | ok, cool | 10:25 |
| panda|ruck | didn't think it was the very first step | 10:25 |
| *** saneax has joined #oooq | 10:26 | |
| panda|ruck | amoralej: I imagin I have to configure also phase1 ? | 10:41 |
| amoralej | you mean jobs in ci.centos.org? | 10:41 |
| amoralej | yeap | 10:41 |
| panda|ruck | yeah .. | 10:41 |
| *** jaosorior has joined #oooq | 10:51 | |
| *** udesale has quit IRC | 10:59 | |
| panda|ruck | amoralej: https://review.rdoproject.org/r/15444 | 11:00 |
| *** faceman has joined #oooq | 11:08 | |
| *** jaosorior has quit IRC | 11:17 | |
| *** holser_ has quit IRC | 11:17 | |
| *** jaosorior has joined #oooq | 11:17 | |
| panda|ruck | amoralej: job definition is correct in https://review.rdoproject.org/r/15374 , proposed https://review.rdoproject.org/r/15445 as fix | 11:25 |
| panda|ruck | and fixed https://review.rdoproject.org/r/15444 thanks | 11:27 |
| amoralej | panda|ruck, but in master is legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master | 11:29 |
| amoralej | multinode-1ctrlr, not singlenode | 11:29 |
| amoralej | is rocky different? | 11:29 |
| panda|ruck | no | 11:29 |
| panda|ruck | the job is really a single node | 11:29 |
| amoralej | ok | 11:30 |
| panda|ruck | it was added recently with the wrong job type | 11:30 |
| amoralej | ack | 11:30 |
| amoralej | merging the fix | 11:30 |
| panda|ruck | then I fixed the job type, but fixing the job name required a lot more changes, so as first step I changed only the important part | 11:30 |
| amoralej | ok | 11:31 |
| *** ssbarnea has quit IRC | 11:44 | |
| *** ykarel|afk is now known as ykarel | 11:47 | |
| *** ssbarnea has joined #oooq | 11:51 | |
| *** saneax has quit IRC | 11:54 | |
| *** saneax has joined #oooq | 11:55 | |
| *** ratailor has quit IRC | 12:09 | |
| rfolco|rover | panda|ruck, is cockpit buggy or we have a serious gate issue? | 12:13 |
| panda|ruck | rfolco|rover: infra disaster this night | 12:13 |
| rfolco|rover | zuul node failures | 12:13 |
| rfolco|rover | oh I see | 12:13 |
| panda|ruck | rfolco|rover: should be fixed now | 12:13 |
| *** holser_ has joined #oooq | 12:17 | |
| *** trown|outtypewww is now known as trown | 12:32 | |
| *** udesale has joined #oooq | 12:33 | |
| *** jaosorior has quit IRC | 12:39 | |
| *** rnoriega has quit IRC | 12:39 | |
| *** faceman has quit IRC | 12:40 | |
| *** pliu_ has quit IRC | 12:40 | |
| *** rlandy has joined #oooq | 12:47 | |
| *** amoralej is now known as amoralej|lunch | 12:48 | |
| rfolco|rover | panda|ruck, question about this one https://bugs.launchpad.net/tripleo/+bug/1786520 | 12:53 |
| openstack | Launchpad bug 1786520 in tripleo "3node jobs failing due to missing file UpgradeInitDeployment" [Critical,Triaged] | 12:53 |
| rfolco|rover | not sure if should change to critical to get more attention. | 12:53 |
| panda|ruck | arxcruz: stackvix still not working, is there a way to see ehich tests are failing here https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/ad464c7/logs/undercloud/home/zuul/tempest.log.txt.gz ? | 12:53 |
| panda|ruck | rfolco|rover: isn't already critical ? | 12:54 |
| rfolco|rover | panda|ruck, 3node jobs are nv right? | 12:54 |
| rfolco|rover | and they failed 75%, although always in the same spot when fail | 12:55 |
| panda|ruck | rfolco|rover: yeah | 12:56 |
| panda|ruck | rfolco|rover: I don't think it need more visibility | 12:56 |
| rfolco|rover | ok thx | 12:56 |
| *** skramaja has quit IRC | 13:11 | |
| weshay | marios, make any progress on the deployed server? | 13:15 |
| weshay | meh.. ci is phoooked | 13:16 |
| weshay | marios, did you see the doc links I posted in the review? | 13:16 |
| marios | weshay: not really, been poking at logs mostly trying to see i have some ideas but nothing concrete yet. was hoping to catch you maybe on the community call? | 13:17 |
| weshay | sure thing | 13:17 |
| * weshay trying to figure out why my patch re: deployed server doesn't pass on queens | 13:17 | |
| weshay | so we can get you going | 13:17 |
| rlandy | myoung: rfolco|rover: https://softwarefactory-project.io/r/#/c/13256/ are we in a place to try merge this? (noting it needs rebase) | 13:25 |
| rlandy | myoung: rfolco|rover: worth rebasing now even if we are not merging it? | 13:26 |
| rfolco|rover | rlandy, lets find another review there, could be a noop change so we confirm zuul loads config/inheritance without breaking jobs | 13:26 |
| rlandy | rfolco|rover: what do you mean by find another review? | 13:27 |
| rlandy | rfolco|rover: this is our last morning this sprint to try this | 13:28 |
| rfolco|rover | rlandy, rebase --> +2 +W --> merge --> recheck a noop dummy change to run a job on sf and make sure zuul is happy | 13:28 |
| rfolco|rover | yep yep | 13:28 |
| rfolco|rover | lets do it | 13:28 |
| rfolco|rover | another change => any other patch to recheck | 13:29 |
| rfolco|rover | if we break zuul we'll see it in the next job that runs (any job, any patch) | 13:29 |
| rfolco|rover | rlandy, thats what I meant | 13:29 |
| rlandy | rfolco|rover: ok - I'll rebase while we wait for myoung to join | 13:30 |
| rlandy | rebase complete | 13:31 |
| rlandy | rfolco|rover: we can use https://review.openstack.org/#/c/579161/ | 13:35 |
| rlandy | needs rebase anyways | 13:35 |
| rfolco|rover | :) | 13:36 |
| rlandy | rfolco|rover; who has +2 around in case we need to revert? | 13:36 |
| rlandy | chandankumar? | 13:36 |
| rfolco|rover | rlandy, I see nhicher's +2 on the config patch | 13:36 |
| rfolco|rover | rlandy, I think chandankumar has +2 on rdo-jobs | 13:37 |
| rfolco|rover | might be wrong though | 13:37 |
| rfolco|rover | rlandy, we need to orchestrate this with someone from sf-dfg to quickly revert it if we break zuul | 13:37 |
| rfolco|rover | get the patches rebased, wait for myoung and we call someone on sf-dfg channel to watch | 13:39 |
| rfolco|rover | what you find? | 13:39 |
| rlandy | rfolco|rover: ok - let's ping nhicher to see if he is around to w+1 and revert if necessary | 13:39 |
| rfolco|rover | rlandy, ^ | 13:39 |
| rfolco|rover | yep | 13:39 |
| marios | weshay: which docs review sorry re 16:16 #oooq: < weshay> marios, did you see the doc links I posted in the review? | 13:39 |
| marios | weshay: reached out to slagle to in pvt chat in case he has some ideas too before we talk later | 13:39 |
| rlandy | rfolco|rover: https://softwarefactory-project.io/r/#/c/13256/ is already rebased | 13:39 |
| weshay | marios, I think I see what's going on | 13:40 |
| weshay | marios, /me grabs the links | 13:40 |
| *** dtrainor has quit IRC | 13:41 | |
| chandankumar | rlandy: let me check | 13:41 |
| weshay | marios, on https://review.openstack.org/#/c/588527/ | 13:41 |
| weshay | The deploy configs need to be updated in CI, and we should NOT manually install these packages for PIKE.. | 13:42 |
| weshay | We need to include the following. | 13:42 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/stable/pike/environments/deployed-server-bootstrap-environment-centos.yaml | 13:42 |
| weshay | Which will call | 13:42 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/stable/pike/deployed-server/deployed-server-bootstrap-centos.yaml | 13:42 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/stable/pike/deployed-server/deployed-server-bootstrap-centos.sh | 13:42 |
| rlandy | rfolco|rover: https://review.openstack.org/#/c/579161/ is ready to be used as the rebase check | 13:42 |
| marios | weshay: its there already | 13:42 |
| marios | weshay: with your review | 13:42 |
| weshay | sec | 13:42 |
| weshay | ya | 13:42 |
| marios | weshay: i mean *=* 14:31:47 *=*=*= "deploy command includes the -e from wes review " http://logs.openstack.org/95/583195/19/check/tripleo-ci-centos-7-containers-multinode-pike/4a8d8e4/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-13_13_53_23 | 13:42 |
| marios | 2018-08-13 13:53:23 | + openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu --timeout 118 -e /home/zuul/cloud-names.yaml -e /home/zuul/hostnamemap.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-environment.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-bootstrap-environment-centos.yaml -e /usr/share/openstack-tripleo-heat-templat | 13:42 |
| weshay | marios, so I think I'm overriding the other releases incorrectly | 13:42 |
| weshay | pike is right.. but I f'd up queens/master | 13:42 |
| marios | weshay: also... 16:41 < weshay> marios, on https://review.openstack.org/#/c/588527/ | 13:43 |
| marios | ^^is that a mistake? | 13:43 |
| rlandy | rfolco|rover: pinging nhicher on #rdo to see if he can be around to help us | 13:43 |
| marios | weshay: i mean https://review.openstack.org/#/c/588527/ is -2 is the proposal i posted a you -2 it | 13:43 |
| marios | weshay: perhaps you meant the https://review.openstack.org/#/c/583195/ | 13:43 |
| rfolco|rover | rlandy, oh ok, I was almost pinging on sf-dfg | 13:44 |
| rfolco|rover | seems like he is on a mumble mtg | 13:44 |
| rlandy | rfolco|rover: you go ahead | 13:44 |
| myoung | rlandy, rfolco|rover: o/ | 13:44 |
| * myoung reads scrollback | 13:44 | |
| rfolco|rover | rlandy, ok, let me do it | 13:44 |
| weshay | marios, meh.. I thought I posted the RHOSP doc for pike on thes | 13:44 |
| weshay | this | 13:44 |
| *** dtrainor has joined #oooq | 13:44 | |
| *** jaosorior has joined #oooq | 13:44 | |
| weshay | I can go get it again if you want.. | 13:45 |
| weshay | if it's helpful | 13:45 |
| myoung | rlandy, rfolco|rover, aye, i think we should go ahead (when we have a core to revert if needed on standby) and merge https://softwarefactory-project.io/r/#/c/13256/ | 13:45 |
| marios | weshay: sure i can't commit to it being helpful without seeing it first :) but i'm sure it will be | 13:45 |
| myoung | rlandy, rfolco|rover, I'm not sure how to test this ahead of time in some other way | 13:45 |
| marios | weshay: please thank you | 13:45 |
| rlandy | myoung: yep - waiting on rfolco|rover to secure nhicher's support | 13:45 |
| rlandy | we have a test patch to try | 13:46 |
| myoung | rlandy, rfolco|rover, IMHO it would make sense to have a patch that pulls in more than just "job" (e.g. the other elements from https://zuul-ci.org/docs/zuul/admin/tenants.html#attr-tenant.untrusted-projects), so if we need to pull additional things in we don't have this terrible "untestable world breaking hammer" aspect...but that's clearly a patch for another day/sprint | 13:46 |
| myoung | after this we should be able to control our own destiny, at least as it matters for job definitions via tripelo-ci and rdo-jobs repos | 13:47 |
| weshay | marios, https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/12/html-single/director_installation_and_usage/#sect-Creating_the_Overcloud_with_Pre_Provisioned_Nodes | 13:49 |
| rfolco|rover | myoung, rlandy nicolas is merging it | 13:49 |
| marios | weshay: thx | 13:49 |
| rlandy | let's say a little prayer | 13:50 |
| weshay | marios, https://review.openstack.org/#/c/588623/2..3/config/general_config/featureset-multinode-common.yml | 13:50 |
| weshay | marios, by specifying pike.. I borked the other releases | 13:50 |
| rlandy | rfolco|rover: myoung: do we have a patch to revert it if necessary yet? | 13:52 |
| rlandy | otherwise will add one in case | 13:52 |
| rlandy | in the mean time | 13:52 |
| rlandy | rfolco|rover: myoung: ok - here goes rebase to check | 13:54 |
| rlandy | 579161 | 13:54 |
| *** amoralej|lunch is now known as amoralej | 13:54 | |
| *** vinaykns has joined #oooq | 13:55 | |
| rlandy | ugh - I think I was too early | 13:55 |
| rlandy | rfolco|rover: myoung: trying another patch | 13:55 |
| rlandy | 577230 | 13:56 |
| rfolco|rover | rlandy, zuul config errors are seen immediately | 13:56 |
| rlandy | 577230 | 13:56 |
| rfolco|rover | if nay | 13:56 |
| rfolco|rover | any | 13:56 |
| rlandy | rfolco|rover: ^^ | 13:56 |
| rlandy | that patch rebased after merge | 13:56 |
| rlandy | rfolco|rover: um, jobs are not starting | 13:58 |
| rlandy | oh nvm | 13:58 |
| *** agopi has quit IRC | 13:59 | |
| myoung | heart stopped lol | 13:59 |
| myoung | went to get coffee from the kitchen and came back to "all jobs are not starting" | 13:59 |
| * myoung takes a deep breath | 13:59 | |
| rfolco|rover | lol | 13:59 |
| rlandy | rfolco|rover: myoung: does this mean we didn't break anything: https://review.rdoproject.org/zuul/stream.html?uuid=95fb3c444c9244d584171581cccf530f&logfile=console.log? | 14:03 |
| ykarel | weshay, phase 1 failing after https://review.openstack.org/#/c/591087 | 14:05 |
| ykarel | missing: fi | 14:05 |
| weshay | lolz | 14:06 |
| weshay | k | 14:06 |
| rfolco|rover | rlandy, I guess so... my noop change also did not complain | 14:06 |
| weshay | ykarel, sorry will fix | 14:06 |
| rfolco|rover | https://softwarefactory-project.io/r/#/c/13404/ | 14:06 |
| ykarel | weshay, ack | 14:06 |
| weshay | I'm an idiot | 14:06 |
| weshay | ykarel, https://review.openstack.org/591678 | 14:09 |
| ykarel | weshay, +1 | 14:09 |
| weshay | thank you | 14:10 |
| weshay | ykarel, you want core on tq/tqe? | 14:10 |
| weshay | think about it.. get back to me.. we'll propose you if you want it | 14:10 |
| ykarel | weshay, okk | 14:11 |
| *** vinaykns has quit IRC | 14:11 | |
| weshay | panda|ruck, rfolco|rover thoughts on promoting w/o fs50 and fs20? | 14:12 |
| weshay | oh wait | 14:12 |
| weshay | fs50 is working | 14:12 |
| chandankumar | https://review.openstack.org/591322 will fix fs020 | 14:13 |
| weshay | jfrancoa, rfolco|rover https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master/4ed43ea/job-output.txt.gz | 14:13 |
| *** vinaykns has joined #oooq | 14:13 | |
| rlandy | myoung: https://review.openstack.org/#/c/590090/ | 14:13 |
| rlandy | what's with that? | 14:13 |
| rlandy | Verified | 14:14 |
| rlandy | -2 Zuul | 14:14 |
| jfrancoa | weshay: is this the undercloud-upgrades job too? | 14:14 |
| rlandy | zuul check passes | 14:14 |
| rlandy | myoung: recheck? | 14:14 |
| rlandy | we need to see rdo jobs pass there | 14:14 |
| rfolco|rover | weshay, whaaat?! how?? | 14:15 |
| weshay | jfrancoa, ya.. same job you are looking at | 14:15 |
| weshay | double check me.. I only briefly looked | 14:15 |
| jfrancoa | weshay: weird...although something similar happend too when I ran the reproducer..everything went fine | 14:15 |
| panda|ruck | weshay: on fs20 I see a million tempest failures | 14:16 |
| myoung | rlandy: sec, doing TC stuff for #tripleo meeting, need a few | 14:16 |
| rlandy | myoung: nvm - I rebased it | 14:16 |
| weshay | panda|ruck, k.. lean on arxcruz chandankumar | 14:17 |
| myoung | rfolco|rover, panda|ruck, any additional notes for weekly status from our squad --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L34 | 14:17 |
| chandankumar | weshay: panda|ruck https://review.openstack.org/591322 | 14:17 |
| weshay | kopecmartin, what is your schedule for the next 3 weeks? any pto? | 14:17 |
| weshay | chandankumar, why are we white listing.. the run all? | 14:18 |
| * weshay looks | 14:18 | |
| weshay | at results | 14:18 |
| kopecmartin | weshay, yes, PTO 17.8 - 22.8 and then 31.8 | 14:18 |
| panda|ruck | chandankumar: I see failure in magnum too | 14:18 |
| weshay | kopecmartin, k | 14:18 |
| panda|ruck | chandankumar: magnum_tempest_plugin | 14:19 |
| panda|ruck | chandankumar: and congress | 14:19 |
| chandankumar | weshay: https://review.openstack.org/#/c/577780/ -> changes the tempest format to container | 14:19 |
| chandankumar | in tempest container all the tempes tplugin resides | 14:19 |
| panda|ruck | chandankumar: ooh white list | 14:19 |
| panda|ruck | chandankumar: I see | 14:19 |
| chandankumar | weshay: and the test_regex was * it means all the tempest + tempes tplugins tests will be executed | 14:19 |
| chandankumar | that's why milion failures is seen | 14:20 |
| chandankumar | weshay: full tempest = tempest.api + tempest.scenario and keystone + neutron tempest plugins as it is installed and runned by default in fs 20 from earlier | 14:20 |
| chandankumar | so i had to whitelist the tests | 14:20 |
| weshay | chandankumar, k.. so arxcruz kopecmartin is that white list sufficient? | 14:20 |
| rlandy | panda|ruck: weshay: myoung: requesting review - https://review.openstack.org/#/c/583576/ - other patches for browbeat depend on this | 14:20 |
| weshay | tempest.api, scenario keystone and neutron | 14:21 |
| weshay | storage? | 14:21 |
| ykarel | chandankumar, and why only keystone/neutron tempest plugin listed seperately | 14:21 |
| chandankumar | ykarel: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/defaults/main.yml#L45 | 14:22 |
| chandankumar | weshay: tempest.api <blah blah> covers storage identity compute swift and othetr tests | 14:22 |
| chandankumar | ykarel: mistral temepst plugin is also working now | 14:23 |
| chandankumar | ykarel: if needed , we can add mistral tempest plugin to fs020 also | 14:23 |
| *** agopi has joined #oooq | 14:24 | |
| ykarel | chandankumar, but afaik mistral not deployed in fs020 | 14:24 |
| myoung | rlandy: looks fine, related patch --> should we also update https://review.openstack.org/#/c/587228/7/playbooks/tripleo-ci/templates/toci_gate_test.sh.j2 to include the additional bits as well? | 14:25 |
| myoung | for the v3 templated workflow? | 14:25 |
| chandankumar | ykarel: mistral is on undercloud | 14:25 |
| ykarel | chandankumar, but those tests are for overcloud | 14:25 |
| chandankumar | ykarel: but we are running tests on overcloud | 14:25 |
| rlandy | myoung: that work is in https://review.openstack.org/#/c/587228 - rebasing now | 14:26 |
| chandankumar | ykarel: sorry ignore | 14:26 |
| * myoung backs away from https://review.openstack.org/#/c/587228, was in the middle of doing same | 14:27 | |
| myoung | rlandy: ^^ | 14:27 |
| rlandy | myoung: np - know you are busy with tc work | 14:27 |
| myoung | was just prepping an etherpad for 5 mins ;) | 14:27 |
| myoung | #tripleo meeting ongoing, community meeting starts shortly, etc | 14:27 |
| myoung | thx | 14:27 |
| ykarel | chandankumar, so why only two plugins were installed, why not others like cinder etc, | 14:30 |
| ykarel | chandankumar, if that's the case this mean fs020 was not testing those test cases | 14:30 |
| weshay | panda|ruck, rfolco|rover my vote is to promote w/o fs20 and fs001 https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/9386445/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz | 14:31 |
| ykarel | chandankumar, i think it's time to correctly install the required plugins and make fs020 run tests against all the deployed services in overcloud | 14:31 |
| chandankumar | ykarel: let me take a look at failed tests | 14:32 |
| ykarel | chandankumar, ack | 14:32 |
| rfolco|rover | weshay, refresh my mind, whats the fs001 issue ? | 14:33 |
| panda|ruck | weshay: yeah, updates is blocked and we are just skipping all the tests that fail with chandankumar patch | 14:33 |
| rfolco|rover | this ? https://bugs.launchpad.net/tripleo/+bug/1786223 | 14:33 |
| openstack | Launchpad bug 1786109 in tripleo "duplicate for #1786223 did not reach state "available", the state is "clean wait", error: None'" [Medium,Triaged] - Assigned to wes hayutin (weshayutin) | 14:33 |
| *** ccamacho has quit IRC | 14:34 | |
| *** jfrancoa has quit IRC | 14:51 | |
| *** jfrancoa has joined #oooq | 14:52 | |
| weshay | rfolco|rover, there isn't one | 14:52 |
| weshay | that was infra bs | 14:52 |
| *** ccamacho has joined #oooq | 14:56 | |
| *** ccamacho has quit IRC | 15:19 | |
| rfolco|rover | weshay, now looking at https://review.openstack.org/#/c/565642/7/config/general_config/featureset027.yml I completely understand the issue | 15:25 |
| rlandy | rfolco|rover: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch - failing deploy - I think it's unrelated to our sf change - you agree? | 15:28 |
| rfolco|rover | rlandy, our change would prevent zuul job to even start... so totally :) | 15:29 |
| rlandy | rfolco|rover: anyways, I see that ocata failure now on a few jobs | 15:29 |
| rlandy | seen that? | 15:29 |
| *** vinaykns has quit IRC | 15:35 | |
| weshay | https://trello.com/b/svMk5sV9/rhel8-openstack-changes | 15:38 |
| rfolco|rover | weshay, private board :( | 15:40 |
| *** ykarel is now known as ykarel|away | 15:41 | |
| chandankumar | weshay: panda|ruck I am taking a different approach, putting unwanted tests jn skip list with unwanted plugins | 15:44 |
| chandankumar | for fs020 | 15:44 |
| *** saneax has quit IRC | 15:48 | |
| weshay | http://38.145.34.41/console-logs/ | 15:50 |
| weshay | http://38.145.34.41/testenv-worker.log | 15:51 |
| *** ccamacho has joined #oooq | 15:56 | |
| myoung | Howdy, Sprint 17 retrospective tag has been created. Feel free to populate cards prior to retrospective tomorrow morning: https://trello.com/b/0VFswmht/rdo-infra-retrospective?menu=filter&filter=label:Sprint%2017 | 15:58 |
| *** ykarel|away has quit IRC | 15:59 | |
| *** myoung is now known as myoung|lunch | 15:59 | |
| *** kopecmartin has quit IRC | 16:04 | |
| rlandy | myoung|lunch: rfolco|rover: weshay: I updated https://trello.com/c/TVsZ3Ut6/877-clean-up-rdo-sf-legacy-code-after-zuulv3-migration - there are six patches there waiting for CI results and reviews | 16:05 |
| rlandy | marios: is this review still useful or should I abandon it? https://review.openstack.org/#/c/585032/ | 16:06 |
| panda|ruck | lol | 16:07 |
| panda|ruck | as soon as I assign allocate a FIP in the tenant, it's stolen by a test instance | 16:07 |
| *** jfrancoa has quit IRC | 16:11 | |
| *** jrist has quit IRC | 16:12 | |
| *** bogdando has quit IRC | 16:13 | |
| rlandy | panda|ruck: rfolco|rover: requesting your reviews on https://review.openstack.org/#/c/590090/ | 16:19 |
| *** jfrancoa has joined #oooq | 16:20 | |
| *** jaganathan has quit IRC | 16:21 | |
| panda|ruck | FYI new address for the te-broker is 38.145.33.166 | 16:23 |
| panda|ruck | weshay: ^ | 16:23 |
| panda|ruck | rlandy: nice change number | 16:23 |
| *** jfrancoa has quit IRC | 16:25 | |
| rlandy | panda|ruck: I'm waiting for change number 666666 | 16:25 |
| *** d0ugal has quit IRC | 16:28 | |
| weshay | thanks | 16:33 |
| *** jrist has joined #oooq | 16:38 | |
| *** ccamacho has quit IRC | 16:39 | |
| rfolco|rover | chandankumar, arxcruz can I invalidated this bug ? https://bugs.launchpad.net/tripleo/+bug/1785886 | 16:39 |
| openstack | Launchpad bug 1785886 in tripleo "tempest: test_attach_interfaces failed to detach port" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:39 |
| *** rlandy is now known as rlandy|brb | 16:46 | |
| *** udesale has quit IRC | 16:54 | |
| weshay | panda|ruck, rfolco|rover https://review.rdoproject.org/r/#/c/15459/ | 16:54 |
| weshay | panda|ruck, rfolco|rover ? | 17:06 |
| *** myoung|lunch is now known as myoung | 17:11 | |
| weshay | myoung, fyi.. don't think this is working atm https://dashboards.rdoproject.org/master | 17:15 |
| myoung | weshay: i just noticed, it's been down for some time by the timestamps | 17:19 |
| myoung | weshay: will have to ping rdo folk (I'll do it) - I don't have access to even the logs | 17:20 |
| *** rlandy|brb is now known as rlandy | 17:24 | |
| weshay | rlandy, myoung you guys see the zuul error? https://review.rdoproject.org/r/#/c/15097 | 17:37 |
| rlandy | looking | 17:38 |
| weshay | Job tripleo-ci-base not defined | 17:38 |
| rlandy | that is concerning | 17:41 |
| myoung | that doesn't make sense, the other patch should have enabled this to be found | 17:41 |
| myoung | include: job | 17:41 |
| myoung | rfolco|rover: ^^ | 17:42 |
| rlandy | weshay: myoung: that should have worked | 17:43 |
| myoung | hrm...is there some "step" after https://softwarefactory-project.io/r/#/c/13256/ merged that needs to happen before that change is live and used? | 17:43 |
| rlandy | when https://softwarefactory-project.io/r/#/c/13256/ merged | 17:43 |
| weshay | ssbarnea, rfolco|rover there is an infra mtg today on #openstack-infra | 17:44 |
| rlandy | rfolco|rover; any idea - if now we will have to ask pabelanger | 17:44 |
| rlandy | if not | 17:44 |
| *** holser_ has quit IRC | 17:45 | |
| myoung | rlandy: https://review.openstack.org/#/c/590090 is into gates fyi | 17:45 |
| *** holser_ has joined #oooq | 17:49 | |
| *** holser_ has quit IRC | 17:49 | |
| *** holser_ has joined #oooq | 17:50 | |
| *** gkadam has quit IRC | 17:53 | |
| rlandy | weshay: myoung: asked on sf-dfg | 17:53 |
| weshay | k thanks | 17:53 |
| rfolco|rover | looking if anything on namespace | 17:53 |
| rlandy | if this does not work, we are out of the water on reparenting | 17:53 |
| *** amoralej is now known as amoralej|off | 17:59 | |
| *** holser_ has quit IRC | 18:01 | |
| weshay | panda|ruck, this is good for you? https://review.openstack.org/#/c/589448/5 | 18:04 |
| weshay | where is featureset_conf: used? | 18:05 |
| *** trown is now known as trown|lunch | 18:11 | |
| myoung | fyi... | 18:11 |
| myoung | <pabelanger> possible we likey need a full reconfigure of zuul to pick it up | 18:11 |
| myoung | <pabelanger> next version of zuul will allow us to do that via CLI | 18:11 |
| myoung | <rlandy> what does a full reconfigure of zuul entail? | 18:11 |
| myoung | <pabelanger> but now likely needs stop / start | 18:11 |
| myoung | <pabelanger> let me check logs | 18:11 |
| myoung | <-> amoralej is now known as amoralej|off | 18:11 |
| myoung | <rlandy> thank you | 18:11 |
| myoung | ^^ so i guess that's "extra steps needed" heh | 18:11 |
| rlandy | still waiting for final diagnosis | 18:11 |
| rlandy | watching rfolco|rover's reactions on this one :) | 18:13 |
| *** dtantsur is now known as dtantsur|afk | 18:15 | |
| rfolco|rover | rlandy, I apologize for not catching that duplicate entry | 18:18 |
| rlandy | rfolco|rover: np - I saw that but didn't realize it would be a problem | 18:18 |
| rfolco|rover | its acceptable if you did not hit this before | 18:18 |
| rfolco|rover | but I did | 18:18 |
| rfolco|rover | :( | 18:19 |
| rlandy | rfolco|rover: can you vote on that change? | 18:19 |
| rfolco|rover | rlandy, pauls? | 18:19 |
| rlandy | yes, pld | 18:19 |
| rlandy | pls | 18:19 |
| rlandy | we need to get it meregd | 18:19 |
| rfolco|rover | +1 only... I don't get +2 on sf.io config | 18:20 |
| rlandy | rfolco|rover: besides two other cores signed off on that change | 18:21 |
| rlandy | nobody corrected it | 18:21 |
| rfolco|rover | rlandy, from that perspective I feel better | 18:22 |
| rlandy | weshay: panda|ruck: had to update https://review.openstack.org/#/c/583576/ - pls will you vote again ( I know this is legacy only - the update for templates is in another review) | 18:41 |
| *** trown|lunch is now known as trown | 18:53 | |
| *** jaosorior has quit IRC | 19:45 | |
| rlandy | ssbarnea: ping re: https://review.openstack.org/#/c/590748/ | 19:49 |
| rlandy | weshay: ^^ you +2'ed this patch - what is the goal? | 19:50 |
| *** jaosorior has joined #oooq | 19:58 | |
| *** dsneddon has quit IRC | 20:18 | |
| *** dsneddon has joined #oooq | 20:22 | |
| *** apetrich has quit IRC | 20:24 | |
| weshay | rlandy, on the terminal.. if you run you'll get color | 20:31 |
| weshay | true the commit message does not meet openstack requirements | 20:32 |
| weshay | rlandy, I'll remind him | 20:32 |
| weshay | https://review.openstack.org/#/c/571180/2/roles/provision/local/tasks/main.yml | 20:42 |
| *** jaosorior has quit IRC | 20:56 | |
| *** trown is now known as trown|outtypewww | 21:06 | |
| *** dsneddon has quit IRC | 21:30 | |
| *** dsneddon has joined #oooq | 21:35 | |
| weshay | arxcruz, +2 this :) https://review.openstack.org/#/c/570719/41 | 21:52 |
| weshay | rlandy, or someone | 21:52 |
| rlandy | looking | 21:52 |
| rlandy | weshay: myoung: panda|ruck: pls vote on https://review.openstack.org/#/c/587228/ | 22:03 |
| rlandy | and https://review.openstack.org/#/c/581488/ | 22:04 |
| rlandy | ^^ for the reproducer workflow | 22:04 |
| weshay | for EXTERNAL_REPO in 'browbeat' | 22:11 |
| weshay | lolz.. sounds funny in my head for some reason | 22:12 |
| rlandy | weshay: the plan is to extend that to more repos | 22:13 |
| weshay | yup | 22:13 |
| weshay | I got that :) | 22:13 |
| rlandy | for EXTERNAL_REPO in 'browbeat' 'tripleo-ha-utils' etc. | 22:13 |
| * rlandy tries to have forward vision :) | 22:13 | |
| weshay | FOR EXERNAL_REALLY_LONG_NAME_REPOS in 'mice';do | 22:13 |
| rlandy | yeah, I know it looks weird now | 22:14 |
| weshay | rlandy, you still want it like this | 22:14 |
| weshay | https://review.openstack.org/#/c/581488/24/playbooks/baremetal-quickstart-extras.yml | 22:14 |
| weshay | given how we broke it out yesterday? | 22:14 |
| rlandy | weshay: yes - for consistency | 22:14 |
| weshay | ? | 22:14 |
| weshay | but it's not consistent | 22:14 |
| rlandy | well .. let me think about that ... | 22:15 |
| * weshay gets | 22:15 | |
| weshay | rlandy, https://review.openstack.org/#/c/590090/6/playbooks/tripleo-ci/vars/environment_type/ovb.yaml | 22:16 |
| weshay | rlandy, so it make it consistent w/ the above.. | 22:16 |
| weshay | you would have two playbooks ya? | 22:16 |
| weshay | bm-quickstart-extras.yml | 22:16 |
| weshay | and bm-quickstart-extras-browbeat.yml | 22:16 |
| weshay | or no? | 22:17 |
| weshay | am I reading it wrong | 22:17 |
| rlandy | weshay: https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/baremetal-quickstart-extras.yml would have an include when, I think | 22:18 |
| weshay | where? | 22:18 |
| rlandy | or actually | 22:19 |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/baremetal-full-deploy.yml would have an include when | 22:19 |
| rlandy | weshay: we need something that will run outside of zuul | 22:20 |
| weshay | rlandy, yes | 22:20 |
| weshay | rlandy, do you want to use the one playbook? | 22:20 |
| weshay | it's fine by me.. just trying to think what would be most consistent w/ what we discussed yesterday | 22:20 |
| weshay | https://review.openstack.org/#/c/590090/6/playbooks/tripleo-ci/vars/environment_type/ovb.yaml | 22:21 |
| weshay | rlandy, we could put an include: when statement in that playbook | 22:21 |
| weshay | and if featureset ==053.. include browbeat | 22:21 |
| weshay | that way it's EXACTLY the same | 22:21 |
| rlandy | can you include when in a playbook | 22:21 |
| rlandy | on featureset? | 22:22 |
| rlandy | if zuul is not in the picture | 22:22 |
| weshay | rlandy, bah.. let's talk | 22:22 |
| weshay | blue | 22:22 |
| rlandy | weshay: https://review.openstack.org/#/c/581488/25/playbooks/baremetal-full-deploy.yml | 22:35 |
| rlandy | awaiting your depends-on | 22:35 |
| weshay | rlandy, https://review.openstack.org/591864 | 22:40 |
| weshay | ssbarnea, wondering if we could add a lint test to ensure the filename matches the featureset config # in ^ | 22:41 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!