| *** ade_lee has quit IRC | 00:09 | |
| *** vinaykns has quit IRC | 00:13 | |
| *** tosky has quit IRC | 00:27 | |
| rlandy | yay - I got images | 00:32 |
|---|---|---|
| *** hamzy_ has joined #oooq | 01:07 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445 | 01:53 |
| *** apetrich has quit IRC | 03:15 | |
| *** ykarel|away has joined #oooq | 03:22 | |
| *** rlandy has quit IRC | 03:31 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445 | 03:53 |
| *** udesale has joined #oooq | 04:01 | |
| *** ratailor has joined #oooq | 04:50 | |
| *** ykarel|away has quit IRC | 05:24 | |
| *** ykarel|away has joined #oooq | 05:39 | |
| *** ykarel|away is now known as ykarel | 05:39 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445 | 05:53 |
| *** jfrancoa has joined #oooq | 06:31 | |
| *** quiquell|off is now known as quiquell | 07:03 | |
| quiquell | sshnaidm|off: I think I found my issue | 07:06 |
| quiquell | ^[[32mscheduler_1 |^[[0m 0046e1a01b1faa629d45487a9702735adc4379e85816 refs/changes/04/545604/3 | 07:06 |
| quiquell | ^[[36mexecutor_1 |^[[0m 2018-11-29 15:58:34,285 - zuul.AnsibleJob - DEBUG - [build: d8327e9581004ed39f0bbd681ab05913] Ansible output: b"bwrap: No permissions to creating new namespace, likely because the kernel does not allow non-privileged user namespaces. On e.g. debian this can be enabled with 'sysctl kernel.unprivileged_userns_clone=1'." | 07:06 |
| quiquell | ^[[32mscheduler_1 |^[[0m 0046fca8d78211c89190e59d709f3ad4a370f7c1ac60 refs/changes/04/545604/4 | 07:06 |
| quiquell | ^[[36mexecutor_1 |^[[0m 2018-11-29 15:58:34,286 - zuul.AnsibleJob - DEBUG - [build: d8327e9581004ed39f0bbd681ab05913] Ansible output terminated | 07:06 |
| quiquell | sshnaidm|off: I need privileged at the docker images | 07:07 |
| *** kopecmartin|off has quit IRC | 07:10 | |
| *** hamzy__ has joined #oooq | 07:11 | |
| *** hamzy_ has quit IRC | 07:12 | |
| *** kopecmartin has joined #oooq | 07:13 | |
| *** apetrich has joined #oooq | 07:16 | |
| *** skramaja has joined #oooq | 07:19 | |
| ykarel | quiquell, can u please review https://review.openstack.org/#/c/621075/(Fixing OVB jobs) and https://review.rdoproject.org/r/#/c/17597/(rocky promotion criteria) | 07:19 |
| quiquell | ykarel: I can +2 it but not workflow they are fixing gate | 07:22 |
| ykarel | quiquell, ack | 07:22 |
| quiquell | ykarel: nbo problem with ci-config one | 07:22 |
| ykarel | yup need to land non-voting scenario patches | 07:23 |
| ykarel | quiquell, ack | 07:26 |
| quiquell | ykarel: Cannot find periodic-singlenode-featureset050 | 07:30 |
| quiquell | ykarel: config, rdo-jobs | 07:30 |
| ykarel | quiquell, search singlenode-featureset050 | 07:31 |
| ykarel | periodic is the pipeline | 07:31 |
| quiquell | ykarel: Yep but job name is missing at definitions | 07:31 |
| quiquell | ykarel: since this is periodic it shoudl be at "config" repo, it's a trusted one | 07:32 |
| quiquell | ykarel: well the base | 07:32 |
| ykarel | quiquell, see https://trunk.rdoproject.org/api-centos-rocky/api/civotes_detail.html?commit_hash=e77cead2ef9f3669b9dbd65229f4c01e28d13615&distro_hash=689771707fb5a44fbeb78a001092af22266690cf | 07:32 |
| ykarel | CI Name Column | 07:33 |
| ykarel | this is waht reported to dlrn | 07:33 |
| quiquell | ykarel: Wait... thi sis the toci_jobtype, silly me | 07:33 |
| ykarel | got it? | 07:33 |
| ykarel | quiquell, yup | 07:34 |
| quiquell | ykarel: rocky.ini workflowed | 07:38 |
| ykarel | quiquell, Thanks | 07:38 |
| ykarel | but we will not be availale to promote without fs020 | 07:39 |
| ykarel | as ovb jobs are now broken | 07:39 |
| quiquell | ykarel: we have to wait for gates to be ok for the other fix | 07:40 |
| ykarel | yes | 07:40 |
| *** ykarel is now known as ykarel|lunch | 07:43 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445 | 07:54 |
| *** jtomasek has joined #oooq | 08:06 | |
| marios_|ruck | quiquell: o/ | 08:13 |
| marios_|ruck | quiquell: are you looking at https://tree.taiga.io/project/tripleo-ci-board/task/415?kanban-status=1447275 i see your face there | 08:14 |
| marios_|ruck | i'm about to look there | 08:14 |
| quiquell | marios_|ruck: Was fixing my local env, now it's working, let me reproduce it | 08:17 |
| quiquell | marios_|ruck: Impossible to do upstream since there is no traces | 08:17 |
| marios_|ruck | quiquell: i saw panda related fix is already there for https://bugs.launchpad.net/tripleo/+bug/1803561 | 08:17 |
| openstack | Launchpad bug 1803561 in tripleo "Collect logs in OVB job fails to fetch overcloud nodes and their logs" [Critical,In progress] - Assigned to yatin (yatinkarel) | 08:17 |
| quiquell | marios_|ruck: This is the same ? | 08:18 |
| marios_|ruck | quiquell: they are both on the taiga | 08:18 |
| marios_|ruck | quiquell: https://tree.taiga.io/project/tripleo-ci-board/task/415 | 08:18 |
| quiquell | marios_|ruck: Don't know why, I am possitive it was related to python3 and podman geting volumes | 08:18 |
| marios_|ruck | quiquell: i came here from https://review.rdoproject.org/etherpad/p/ruckrover-sprint23 "Notes from wes" | 08:18 |
| quiquell | marios_|ruck: Let me repro it, so we can confirm it's not related, ack ? | 08:19 |
| marios_|ruck | quiquell: k i'll look at the other things there then | 08:19 |
| *** amoralej|off is now known as amoralej | 08:24 | |
| marios_|ruck | panda|pto: weshay do i need special permissions to edit wiki on taiga? | 08:30 |
| marios_|ruck | quiquell: do you know? ^ | 08:30 |
| quiquell | marios_|ruck: I think you need them | 08:30 |
| marios_|ruck | k thanks quiquell | 08:30 |
| marios_|ruck | cant find any way to edit or im blind | 08:31 |
| *** ykarel|lunch is now known as ykarel | 08:38 | |
| *** tosky has joined #oooq | 08:42 | |
| *** ccamacho has joined #oooq | 08:46 | |
| ssbarnea|rover | marios_|ruck: morning! anything special? | 08:53 |
| marios_|ruck | morning | 08:57 |
| marios_|ruck | ssbarnea|rover: apparently zuul queue still hours but not like yesterday so slowly getting better | 08:57 |
| marios_|ruck | ssbarnea|rover: wana do quick sync? | 08:57 |
| marios_|ruck | ssbarnea|rover: bluejeans? | 08:57 |
| marios_|ruck | http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000368.html && https://review.openstack.org/#/q/topic:scenarios-nv+(status:open+OR+status:merged | 08:57 |
| marios_|ruck | also this ^ | 08:58 |
| ssbarnea|rover | sure, bj in 3 mins. | 08:58 |
| marios_|ruck | ssbarnea|rover: and some notes from wes on the etherpad | 08:58 |
| marios_|ruck | ssbarnea|rover: ack | 08:58 |
| ssbarnea|rover | marios_|ruck: https://bluejeans.com/2655417928 | 09:04 |
| marios_|ruck | ssbarnea|rover: joining | 09:04 |
| *** holser_ has joined #oooq | 09:05 | |
| marios_|ruck | master: tht centos standalone fail? failing for https://bugs.launchpad.net/tripleo/+bug/1803544 added comment #4 here http://logs.openstack.org/98/604298/105/check/tripleo-ci-centos-7-standalone/5b9e669/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-11-29_20_50_50 | 09:08 |
| openstack | Launchpad bug 1803544 in tripleo "unable to find user root: no matching entries in passwd file" [High,Triaged] | 09:08 |
| ssbarnea|rover | https://review.openstack.org/#/c/620975/ | 09:08 |
| marios_|ruck | seen this before /etc/heat/policy.json | 09:08 |
| marios_|ruck | http://logs.openstack.org/24/567224/140/check/tripleo-ci-centos-7-undercloud-upgrades/f34ff3f/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-11-28_19_58_30 https://url.corp.redhat.com/queens-etc-policy-json | 09:08 |
| *** bogdando has joined #oooq | 09:12 | |
| *** dsneddon has quit IRC | 09:19 | |
| *** derekh has joined #oooq | 09:33 | |
| marios_|ruck | ssbarnea|rover: this is the bug i was referring to https://bugs.launchpad.net/tripleo/+bug/1796639 | 09:38 |
| openstack | Launchpad bug 1796639 in tripleo "[stable/queens] The tripleo-ci-centos-7-undercloud-upgrades is failing on queens for No such file or directory: '/etc/heat/policy.json" [Critical,Triaged] | 09:38 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022 @ https://review.openstack.org/602248, master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo- (1 more message) | 09:54 |
| quiquell | marios_|ruck: About logs timeout, it was easdier, the f28 have logs in the review with the fix, so yes it's related | 10:19 |
| quiquell | chandan_kumar, arxcruz: are you there ? | 10:22 |
| quiquell | I have a live system with the f28 stuff | 10:22 |
| quiquell | the only subunit package I see there is python3-subunit | 10:22 |
| quiquell | I see there is a TempestParser pip3 stuff that have the subunit2junitxml | 10:23 |
| quiquell | chandan_kumar, arxcruz: well pip3 install subunit2junit2xml have it | 10:30 |
| marios_|ruck | thanks quiquell | 10:31 |
| marios_|ruck | quiquell: there was a nit here https://review.openstack.org/620556 forgotten ; so i updated and recheck on scen1/4 | 10:31 |
| quiquell | marios_|ruck: You can simplify this using "defaults" I think | 10:33 |
| quiquell | default | 10:33 |
| quiquell | Let me do some experiments | 10:33 |
| *** jfrancoa has quit IRC | 10:34 | |
| *** dsneddon has joined #oooq | 10:37 | |
| *** jfrancoa has joined #oooq | 10:53 | |
| marios_|ruck | ssbarnea|rover: have we seen this one? about to file a bug for it http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build/8e6e3bc/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 10:55 |
| marios_|ruck | master promotions blocker | 10:55 |
| marios_|ruck | ssbarnea|rover: undercloud install error | 10:55 |
| ssbarnea|rover | nope | 10:55 |
| marios_|ruck | well 'undercloud' is standalone but yeah . ok gonna file it | 10:56 |
| marios_|ruck | ssbarnea|rover: ah its this? https://trello.com/c/VbJ6HPdG/836-cixlp1805589tripleociproa-master-container-build-job-failed-while-deploying-undercloud-with-httpinternalservererror-error-intern | 10:56 |
| marios_|ruck | ssbarnea|rover: yeah its that adding acomment then | 10:57 |
| ssbarnea|rover | could be but the message is too generic' | 10:57 |
| *** udesale has quit IRC | 10:59 | |
| marios_|ruck | ssbarnea|rover: pretty sure it is at least the trace is same | 10:59 |
| marios_|ruck | and description etc matches | 10:59 |
| *** dtantsur|mtg is now known as dtantsur|afk | 11:00 | |
| quiquell | marios_|ruck: what do you think of this approach ? https://paste.fedoraproject.org/paste/Zh30BTRGm94kiuO6RR2eJQ | 11:03 |
| quiquell | marios_|ruck: So we don't touch the shell script | 11:04 |
| marios_|ruck | quiquell: ack, i tried playing with jinja in the environment yesterday but didn't work. I was using > not| though maybe that is the difference | 11:05 |
| quiquell | marios_|ruck: I have play a little now, it's better if we don't add more noise to the shell script and also not adding a new task to gather facts | 11:05 |
| quiquell | marios_|ruck: 'vars' is enough | 11:05 |
| marios_|ruck | quiquell: i didn't add a new var though, see comment at https://review.openstack.org/#/c/620556/2/roles/standalone/tasks/main.yml@47 | 11:05 |
| quiquell | marios_|ruck: and not repeating the extra path | 11:05 |
| marios_|ruck | quiquell: ok once this run finishes i'll update later with this idea | 11:06 |
| marios_|ruck | quiquell: also need to update with the tempest stuff you added in scn2 | 11:06 |
| quiquell | marios_|ruck: ack, damn forbot about the scenario | 11:06 |
| quiquell | marios_|ruck: let's see results | 11:06 |
| quiquell | marios_|ruck: we have to update 1/3/4 same way | 11:06 |
| marios_|ruck | quiquell: heh man that's why we're doing any of this for those jobs :) | 11:06 |
| marios_|ruck | quiquell: yeah i need to update 1/4 with the tempest stuff gonna do that in a sec | 11:07 |
| quiquell | marios_|ruck: arggg "This change depends on a change that failed to merge." | 11:07 |
| quiquell | hate it hate it hate it | 11:07 |
| *** rfolco is now known as rfolco_doctor | 11:09 | |
| marios_|ruck | quiquell: your way works gonna update now fk it https://paste.fedoraproject.org/paste/JjT2ld9bso6jNCb-RjfNkA zuul queue is screwed the scen 1 isn't even running yet | 11:13 |
| marios_|ruck | quiquell: gonna add the tempest stuff too so we get it in next run | 11:14 |
| quiquell | marios_|ruck: Do you want to spin the local zuul we are testing ? | 11:14 |
| quiquell | marios_|ruck: is very wip yet | 11:14 |
| marios_|ruck | quiquell: yes but not right now | 11:14 |
| quiquell | marios_|ruck: ack | 11:14 |
| marios_|ruck | https://review.openstack.org/#/c/620556/4/roles/standalone/tasks/main.yml quiquell | 11:21 |
| quiquell | marios_|ruck: nicer, we just add stuff at the end | 11:21 |
| quiquell | let's wait for CI | 11:22 |
| *** holser_ is now known as holser|lunch | 11:33 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024, tripleo-ci-centos-7-ovb-1ctlr_1comp- (3 more messages) | 11:54 |
| *** udesale has joined #oooq | 12:26 | |
| *** rfolco_doctor is now known as rfolco | 12:34 | |
| *** holser|lunch is now known as holser_ | 12:39 | |
| weshay | marios_|ruck, ssbarnea|rover have you guys seen | 12:45 |
| weshay | 2018-11-30 12:28:39.473042 | primary | "registered_overcloud_nodes.stdout": "VARIABLE IS NOT DEFINED!" | 12:45 |
| marios_|ruck | weshay: nop where is that one | 12:46 |
| weshay | marios_|ruck, ssbarnea|rover https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 | 12:46 |
| ykarel | weshay, marios_|ruck see alert | 12:46 |
| weshay | ykarel++ | 12:46 |
| hubbot1 | weshay: ykarel's karma is now 7 | 12:46 |
| ssbarnea|rover | nope, seen other things preventing fixes mentioned on rock/rover board. see my last comment on https://review.openstack.org/#/c/620457/ | 12:46 |
| marios_|ruck | ykarel: ha oh :) | 12:47 |
| marios_|ruck | weshay: do you want to do a sync this afternoon me and ssbarnea|rover had some question too | 12:48 |
| ssbarnea|rover | sure, we already have few questions. | 12:48 |
| marios_|ruck | weshay: we synced already our morning | 12:48 |
| * marios_|ruck going to dig into that ovb job | 12:48 | |
| marios_|ruck | ykarel: was there something done there already? | 12:48 |
| marios_|ruck | ykarel: do we have bug / should we file one | 12:49 |
| ykarel | marios_|ruck, https://bugs.launchpad.net/tripleo/+bug/1805972 | 12:49 |
| openstack | Launchpad bug 1805972 in tripleo "OVB jobs failing with: "registered_overcloud_nodes.stdout": "VARIABLE IS NOT DEFINED!"" [Undecided,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 12:49 |
| ykarel | marios_|ruck, i think i pinged u when i filed it so u get aware but i think u missed as u were not up that time | 12:50 |
| weshay | marios_|ruck, sure | 12:50 |
| marios_|ruck | ykarel: thanks and sorry to miss the ping | 12:50 |
| ykarel | it happens due to lots of messages in IRC :) | 12:51 |
| marios_|ruck | ssbarnea|rover: added to our etherpad https://review.rdoproject.org/etherpad/p/ruckrover-sprint23 | 12:52 |
| marios_|ruck | ykarel: fwiw that is the best way to reach us async ^^ but will try to do better review of irc ping in the morning thanks | 12:52 |
| ykarel | marios_|ruck, is it possible to follow some pattern for the etherpads u create | 12:53 |
| ykarel | it's good if the link not change, last sprint is moved to old etherpad, etc | 12:53 |
| marios_|ruck | ykarel: what do you have in mind. we generally just update depends on who is ruck/rover and what tools they use. here we'll keep latest at the top | 12:53 |
| marios_|ruck | ykarel: yeah e.g. previous sprint status https://review.rdoproject.org/etherpad/p/ruckrover-sprint22 | 12:54 |
| weshay | marios_|ruck, ssbarnea|rover let's jump on blue and figure this out | 12:54 |
| marios_|ruck | ykarel: oh i see what you mean you want the same link | 12:54 |
| ykarel | yes no one else knows what sprint is being worked on or what's the link of etherpad | 12:55 |
| ssbarnea|rover | weshay: marios_|ruck https://bluejeans.com/2655417928 | 12:55 |
| marios_|ruck | ykarel: welli guess the one link to rule them all is this one then and you can find the current ruck rover etherpad https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 12:55 |
| marios_|ruck | weshay: joining | 12:55 |
| weshay | https://bluejeans.com/4113567798 | 12:55 |
| weshay | oops | 12:55 |
| weshay | joining ssbarnea|rover's | 12:55 |
| ykarel | marios_|ruck, okk | 12:56 |
| ykarel | ssbarnea|rover, can u also review https://review.openstack.org/#/c/620927/(container rpm list missing issue) that we discussed yesterday, combined ur patch with the updates and adjusted some more parts as explained in commit message | 13:02 |
| ykarel | weshay ^^ | 13:04 |
| *** zul has joined #oooq | 13:05 | |
| weshay | marios_|ruck, <mwhahaha> marios_|ruck, ssbarnea|rover, weshay: fyi i just realized -> https://bugs.launchpad.net/tripleo/+bug/1805968 Probably need to fix that before all the scenario standalone jobs get turned on :D | 13:08 |
| openstack | Launchpad bug 1805968 in tripleo "standalone job does not run yum update during the container image prepare" [Critical,Triaged] | 13:08 |
| weshay | marios_|ruck, ssbarnea|rover https://trunk.rdoproject.org/centos7-rocky/ | 13:10 |
| *** ratailor has quit IRC | 13:11 | |
| weshay | I need access to the promotion server | 13:11 |
| *** trown|outtypewww has quit IRC | 13:17 | |
| *** trown|brb has joined #oooq | 13:18 | |
| quiquell | marios_|ruck: fuck standalone job has fail at gates merging the container_cli override :-(((( | 13:25 |
| weshay | quiquell, can you join my call | 13:30 |
| weshay | er.. not mine | 13:30 |
| weshay | https://bluejeans.com/2655417928 | 13:30 |
| quiquell | weshay: ack | 13:30 |
| *** skramaja has quit IRC | 13:33 | |
| weshay | promoter SUCCESS promoting tripleo-ci-testing as current-tripleo ({'timestamp': 1543445251, 'distro_hash': '71caf8127f9f10f508ce9d2b5f093bd334ad4b9b', 'promote_name': 'tripleo-ci-testing', 'user': 'review_rdoproject_org', 'repo_url': 'https://trunk.rdoproject.org/centos7-rocky/14/32/143213958b627378113bd58008fe44118043fb54_71caf812', 'full_hash': '143213958b627378113bd58008fe44118043fb54_71caf812', 'repo_hash': '143213958b627378113bd58008fe44 | 13:35 |
| weshay | 118043fb54_71caf812', 'commit_hash': '143213958b627378113bd58008fe44118043fb54'}) | 13:35 |
| weshay | 2018-11-29 03:48:24,484 3698 INFO promoter Trying to promote current-tripleo-rdo to current-tripleo-rdo-internal | 13:35 |
| weshay | quiquell, marios_|ruck ur right ^ | 13:35 |
| *** rlandy has joined #oooq | 13:36 | |
| quiquell | rlandy: o/ | 13:37 |
| rlandy | quiquell: hello there! | 13:38 |
| quiquell | rlandy: mtg now, let's talk after it | 13:38 |
| quiquell | rlandy: updated ether and task | 13:38 |
| rlandy | quiquell: ack .. yep - guess you saw the doc I started :) | 13:38 |
| quiquell | rlandy: totally has adapt stuff to pipenv so we don't need tox | 13:40 |
| rlandy | quiquell: ok - my run failed last night at ... | 13:41 |
| rlandy | TASK [ci-reproducer : Start up zuul and friends] *************************************************************************************************************** | 13:41 |
| rlandy | fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error connecting: Error while fetching server API version: ('Connection aborted.', PermissionError(13, 'Permission denied'))"} | 13:41 |
| rlandy | starting there today to investigate | 13:41 |
| rlandy | quiquell: we can discuss after your meeting - we need to settle on v2 or v3 | 13:41 |
| *** vinaykns has joined #oooq | 13:45 | |
| *** udesale has quit IRC | 13:48 | |
| *** udesale has joined #oooq | 13:49 | |
| quiquell | rlandy: try to follow etherpad after cleanup | 13:50 |
| quiquell | rlandy: I think pipenv is going to help us with deps | 13:50 |
| rlandy | quiquell: I'm an idiot, I forgot to add my key to the centos image :( ... uploading again | 13:50 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 13:54 |
| quiquell | rlandy: add your user to docker group and the like | 13:56 |
| rlandy | ^^ a step before the playbook runs? | 13:58 |
| rlandy | ok - image is uploaded | 13:59 |
| rlandy | ready to rerun - getting latest changes | 14:00 |
| rlandy | quiquell: ^^ | 14:00 |
| quiquell | rlandy: sudo usermod -aG docker $USER | 14:01 |
| weshay | https://bluejeans.com/2655417928 | 14:04 |
| rlandy | hmmm ...pipenv fedora28 only? | 14:04 |
| quiquell | rlandy: you can install it with pip with is kind of meta | 14:04 |
| *** amoralej is now known as amoralej|lunch | 14:04 | |
| quiquell | rlandy: there is a centos-7 version | 14:04 |
| quiquell | pip install --user pipenv | 14:05 |
| weshay | rlandy, may want to join https://bluejeans.com/2655417928 | 14:05 |
| *** ykarel is now known as ykarel|away | 14:07 | |
| weshay | "http://localhost:9000│sport thread │··········································· | 14:22 |
| quiquell | rlandy: continue at a blue with tasks and the like ? | 14:25 |
| rlandy | quiquell: sure | 14:26 |
| quiquell | rlandy: https://bluejeans.com/7891065232 | 14:26 |
| ssbarnea|rover | weshay: regarding elastic-recheck: we need help from QA, do we have one or two people that can help us? | 14:32 |
| weshay | chandan_kumar, ^ | 14:33 |
| weshay | arxcruz, ^ | 14:33 |
| weshay | kopecmartin, ^ | 14:33 |
| *** ykarel|away has quit IRC | 14:33 | |
| kopecmartin | ssbarnea|rover, what exactly? | 14:35 |
| weshay | ssbarnea|rover, ? | 14:44 |
| weshay | kopecmartin, we need upstream QA core | 14:44 |
| weshay | kopecmartin, can you please grab attila f maybe | 14:44 |
| kopecmartin | weshay, i can, but for what? what is the problem? | 14:45 |
| ssbarnea|rover | kopecmartin: here is one example of kind of help needed from QA: https://review.openstack.org/#/c/617579/5 | 14:47 |
| ssbarnea|rover | i do not expect QA to add new queries but their input would be of huge help while defining the searches for different bugs. | 14:48 |
| *** brault has quit IRC | 14:51 | |
| *** ykarel|away has joined #oooq | 14:52 | |
| *** ykarel|away is now known as ykarel | 14:52 | |
| kopecmartin | ssbarnea|rover, I'm sorry, but I don't understand how that doesn't mean creating new queries | 14:58 |
| ssbarnea|rover | kopecmartin: i can create CRs to add new queries myself, but what to look for is the question, also to answer questions like the one added by clark. | 15:00 |
| kopecmartin | ssbarnea|rover, oh, so as the problem appears to be outside of of tripleo, you're trying to find any information about that from other people from other projects , to find out if someone else deals with similar issue | 15:04 |
| kopecmartin | i can ask around if anyone experienced that, | 15:04 |
| weshay | kopecmartin, we need upstream QA core | 15:14 |
| *** chandan_kumar is now known as chkumar|off | 15:14 | |
| weshay | I know attila f is | 15:14 |
| *** afazekas has joined #oooq | 15:17 | |
| kopecmartin | weshay, afazekas joined the channel, so you can ask him | 15:17 |
| rlandy | hmmm ...bakc to complaining about sdk | 15:20 |
| quiquell | rlandy: where ? | 15:22 |
| rlandy | quiquell: added a line to the etherpad to fix | 15:23 |
| rfolco | quiquell, question: what is preventing us to vote on fedora28? what needs fixing ? | 15:23 |
| quiquell | rfolco: well... it' deploys but does not run tempest | 15:24 |
| quiquell | rfolco: tempest will take time they have to creat new package at fedora for this to work | 15:24 |
| quiquell | rfolco: but maybe we can voting on f28 without tempest if it's passing | 15:24 |
| rfolco | quiquell, just tempest ? | 15:24 |
| quiquell | rfolco: well, tempest is not a small thing, but yest 'just' tempest | 15:24 |
| quiquell | rfolco: deploy is solid now | 15:25 |
| rfolco | quiquell, cool, thanks for the heads up | 15:25 |
| marios_|ruck | ssbarnea|rover: i'll take #1 you take #2 ? | 15:25 |
| marios_|ruck | filing 1 | 15:25 |
| chkumar|off | quiquell: what package is missing? I will try to patch it tomorrow | 15:25 |
| quiquell | chkumar|off: they have to create python3-subunit-filters, number80 is doing it | 15:25 |
| chkumar|off | quiquell: please pass me the info I can get it on fedora side | 15:25 |
| quiquell | chkumar|off: I am testing installing subunit with pip it includes de subunit2junitmlx | 15:26 |
| chkumar|off | quiquell: yes good to go | 15:26 |
| rfolco | weshay, I misunderstood what sagi is doing on the 'create new ovb environment' story. Can you please describe what is new there (ovb on rdo-cloud)? | 15:26 |
| quiquell | chkumar|off: At the comments in the card https://tree.taiga.io/project/tripleo-ci-board/task/375?kanban-status=1447276 | 15:26 |
| rlandy | quiquell: ok - reorg'ed the etherpad into sections- my playbook is running now :) | 15:26 |
| quiquell | rlandy: \o/ !!! | 15:27 |
| chkumar|off | quiquell: as it is needed in last to generate subunit we can use venv there and install stuff using pip3 | 15:27 |
| quiquell | chkumar|off: using pip is not a no-no ? | 15:27 |
| *** dsneddon has quit IRC | 15:28 | |
| quiquell | rlandy: we only need to install docker and pipenv | 15:29 |
| quiquell | rlandy: docker-compose and openstack are install at pipenv run | 15:29 |
| quiquell | rlandy: I mean openstacksdk | 15:29 |
| rlandy | quiquell: I needed to install them to get the playbook to run w/o error | 15:30 |
| quiquell | rlandy: humm that's weird | 15:30 |
| quiquell | rlandy: how did you run the playbook ? | 15:30 |
| quiquell | rlandy: you have to prefix it with "pipenv run" | 15:30 |
| rlandy | exactly as etherpad says | 15:30 |
| * rlandy gets | 15:30 | |
| rlandy | pipenv run ansible-playbook playbooks/start-ci-reproducer.yaml -e ansible_python_interpreter="/usr/bin/python3" -e upstream_gerrit_user=rlandy | 15:30 |
| rlandy | just got a failure ... | 15:30 |
| *** dsneddon has joined #oooq | 15:31 | |
| quiquell | ahh damn it | 15:31 |
| quiquell | Don't know why I remove pipenv install | 15:31 |
| quiquell | :-/ | 15:31 |
| chkumar|off | quiquell: but as a workaround why not just install subunit-filters from pip3 | 15:31 |
| quiquell | silly me | 15:31 |
| chkumar|off | till the package available here | 15:31 |
| chkumar|off | quiquell: https://github.com/openstack/tripleo-quickstart-extras/blob/7fcb5c2801c93b2cf90f49195cccff8909753263/roles/validate-tempest/tasks/tempest-results.yml adding a task here | 15:31 |
| quiquell | rlandy: need a pipenv install before pipenv run I think, if you don't do say it uses system | 15:32 |
| afazekas | This case looks like L3 connectivity issue http://logs.openstack.org/51/619351/1/check/devstack-plugin-ceph-tempest/f351bf2/job-output.txt#_2018-11-29_18_23_10_049699 , the other gate time failures not that verbose, someone should check the neutron logs. The issue with the generic ssh connection failed it can match everything especially on the check gate. Usually multiple small chance things can lead to the same error message so based on the elastick | 15:32 |
| afazekas | recheck the bug will not be closed ever, unless openstack become perfect .. . Would be better to find some anomaly in the service logs which is related to the issue | 15:32 |
| quiquell | chkumar|off: there is no subunit-filters from pip | 15:32 |
| quiquell | chkumar|off: only package that have them is python-subunit | 15:32 |
| quiquell | chkumar|off: And this replaces python3-subunit also | 15:32 |
| quiquell | chkumar|off: I am testing those bits now | 15:32 |
| rlandy | quiquell: http://pastebin.test.redhat.com/676750 - latest error | 15:33 |
| rlandy | will try pipenv install | 15:33 |
| quiquell | rlandy: Check that with the pipenv install you don't need to install the others | 15:33 |
| rlandy | trying | 15:33 |
| quiquell | rlandy: so do clean stuff from guide | 15:33 |
| quiquell | rlandy: cool thanks | 15:33 |
| rlandy | quiquell: did you see paste with latest error? | 15:33 |
| quiquell | &/me connecting to the vpn | 15:34 |
| * quiquell connecting to the vpn | 15:34 | |
| chkumar|off | quiquell: we need to subunit to html results na? | 15:35 |
| chkumar|off | quiquell: just remove python0subunit part from fedora and try that it will work | 15:35 |
| quiquell | rlandy: timeout getting the docker images, that's new too :-( | 15:35 |
| chkumar|off | quiquell: sorry subunit-filters part | 15:35 |
| rlandy | quiquell,: hmmm ... I think I am hitting weshay's error now | 15:35 |
| quiquell | chkumar|off: we don't need to call subunit2junitxml ? | 15:35 |
| rlandy | FAILED - RETRYING: Wait for zuul upstream tenant (55 retries left). | 15:35 |
| chkumar|off | quiquell: nope | 15:35 |
| quiquell | chkumar|off: cool then it's better will try that | 15:36 |
| rlandy | weshay: ^^ did you get by your error? | 15:36 |
| chkumar|off | quiquell: we are not using xml output anywhere we are are just dependent on html part | 15:36 |
| quiquell | rlandy: weshay error was faulty ssh key | 15:36 |
| rlandy | quiquell: previous error may have been timing | 15:36 |
| rlandy | not I am at TASK [ci-reproducer : Wait for zuul upstream tenant] | 15:36 |
| quiquell | rlandy: It takes around 20 min to start up, you are still good | 15:36 |
| rlandy | quiquell: awesome | 15:36 |
| rlandy | we will wait | 15:36 |
| quiquell | rlandy: If you are at Wait then everything is installed and docker-compose up is ok | 15:37 |
| rlandy | cool beans | 15:37 |
| rlandy | quiquell++ | 15:37 |
| hubbot1 | rlandy: quiquell's karma is now 14 | 15:37 |
| quiquell | rlandy: Let me put some lines on the ether to monitor stuff | 15:37 |
| * rlandy checks logs | 15:37 | |
| quiquell | rlandy: line51 for monitor how it's going | 15:38 |
| *** amoralej|lunch is now known as amoralej | 15:39 | |
| rlandy | quiquell: ack - doing that now | 15:39 |
| quiquell | rlandy: ok have to drope | 15:39 |
| rlandy | quiquell: k - have a good weekend | 15:39 |
| quiquell | rlandy: after finish it will show you info how to acceess stuff | 15:39 |
| quiquell | rlandy: u2 | 15:39 |
| rlandy | k - I look forward to that | 15:39 |
| *** quiquell is now known as quiquell|off | 15:39 | |
| rlandy | ERROR: Couldn't connect to Docker daemon | 15:41 |
| rlandy | hmm ... | 15:41 |
| *** ade_lee has joined #oooq | 15:52 | |
| rlandy | weshay: ping re: docker error | 15:52 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 15:54 |
| *** brault has joined #oooq | 16:28 | |
| marios_|ruck | weshay: nice one allowing the people to add you to reviews again in gerrit. | 16:32 |
| marios_|ruck | i can spam you all the time now! | 16:32 |
| marios_|ruck | openstack-dev emails > /dev/null probably though :) | 16:32 |
| *** holser_ has quit IRC | 16:32 | |
| ssbarnea|rover | marios_|ruck: please see my last comment on https://review.openstack.org/#/c/621221/1 -- i don't want to slow down but some info is missing. | 16:33 |
| marios_|ruck | ssbarnea|rover: ack agree will reply there. the request was for us to file a skip until the 'tempest folks' can own the bug to find out more | 16:34 |
| *** ccamacho has quit IRC | 16:35 | |
| marios_|ruck | ssbarnea|rover: but lets not block the job on it hence the skip | 16:35 |
| *** ccamacho has joined #oooq | 16:35 | |
| *** bogdando has quit IRC | 16:37 | |
| *** udesale has quit IRC | 16:49 | |
| *** trown|brb is now known as regain | 16:55 | |
| *** regain is now known as trown | 16:55 | |
| *** trown is now known as trown|lunch | 16:56 | |
| *** rnoriega- has quit IRC | 16:56 | |
| *** rnoriega has joined #oooq | 16:58 | |
| rlandy | OMG - I've got!!!! | 17:03 |
| rlandy | hello reprodocer zuul | 17:03 |
| rlandy | and quiquell|off not here to see it | 17:03 |
| rlandy | weshay: ^^ finally :) | 17:07 |
| weshay | rlandy, oh man | 17:07 |
| weshay | what | 17:07 |
| rlandy | hello reprodocer zuul | 17:07 |
| weshay | will catch up w/ you in a bit | 17:07 |
| rlandy | install complete and running | 17:08 |
| weshay | I need to be able to do it as well.. but need to handle a few things | 17:08 |
| * rlandy work on the libvirt case | 17:08 | |
| rlandy | static driver test | 17:08 |
| *** ykarel is now known as ykarel|away | 17:22 | |
| *** kopecmartin is now known as kopecmartin|off | 17:26 | |
| *** weshay is now known as he_hates_me | 17:35 | |
| *** he_hates_me is now known as weshay | 17:36 | |
| weshay | ok.. rlandy I'm going to try again on a clean system | 17:36 |
| weshay | rlandy, you around in about 1hr? | 17:37 |
| weshay | maybe? hopefully? | 17:37 |
| rlandy | weshay: ack - I'm around | 17:37 |
| weshay | k | 17:37 |
| rlandy | weshay: change your keypair | 17:37 |
| rlandy | to remove the password | 17:37 |
| rlandy | I had the same problem | 17:38 |
| weshay | rlandy, ok... I did | 17:38 |
| rlandy | I updated the ethrepad | 17:38 |
| weshay | rlandy, just curious how you did that... w/ ssh-keygen? | 17:38 |
| rlandy | yes | 17:38 |
| weshay | I used sshkey-gen | 17:38 |
| weshay | and my pub key remained the same | 17:38 |
| weshay | so that was good | 17:38 |
| rlandy | -p | 17:38 |
| weshay | ya | 17:38 |
| rlandy | worked fine | 17:38 |
| weshay | scary | 17:38 |
| weshay | I think I created that key in 2006 | 17:39 |
| weshay | rlandy, so.. maybe I should try once more from my original system | 17:39 |
| weshay | you are saying? | 17:39 |
| weshay | meh.. will try both | 17:39 |
| rlandy | weshay: it was the sam ekey | 17:40 |
| rlandy | just after the ssh-keygen -p | 17:40 |
| rlandy | restarted docker | 17:40 |
| ssbarnea|rover | weshay: i posted the ticket about SSL on internal #rhos-ops as I suppose that is the place to post it but I do not know whom to ping to better to assign the bug to. | 17:44 |
| rlandy | ssbarnea|rover: yeah - that's legit - I could reproduce it | 17:44 |
| ssbarnea|rover | i wonder if I could create a LP account for ticket-rdo-cloud at osci.io email address. | 17:45 |
| *** brault has quit IRC | 17:46 | |
| *** amoralej is now known as amoralej|off | 17:53 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 17:54 |
| *** derekh has quit IRC | 18:00 | |
| weshay | ssbarnea|rover, it's not #rhos-ops | 18:13 |
| weshay | ssbarnea|rover, is #prodchain-infra-dfg | 18:13 |
| ssbarnea|rover | weshay: ... their irc description can be confusing as the prodchain mentiones one domain and the other another,... too many channels and domains. | 18:15 |
| ssbarnea|rover | lucky that dmsimard was also on the other one. | 18:15 |
| *** jfrancoa has quit IRC | 18:16 | |
| *** ykarel|away has quit IRC | 18:17 | |
| weshay | rlandy, so.. the docker that ships w/ fedora won't work? | 18:48 |
| rlandy | weshay: not fedora27 | 18:58 |
| rlandy | docker-ce worked fine for me | 18:59 |
| rlandy | I gather f28 will be ok | 18:59 |
| weshay | grr | 19:01 |
| rlandy | what happened? | 19:01 |
| weshay | well.. having issues on f28 | 19:01 |
| weshay | and my other machine is f29 | 19:02 |
| weshay | and docker-ce is not supported yet | 19:02 |
| weshay | rlandy, so are sshnaidm|off and quiquell|off using docker-ce? | 19:02 |
| rlandy | weshay: no - quique is using docker from f28 | 19:03 |
| rlandy | I don't know what sshnaidm is using as I think he is also on f27 | 19:03 |
| rlandy | I can upgrade to f28 and retry | 19:03 |
| rlandy | I just want to test out the libvirt connection | 19:03 |
| weshay | rlandy, no.. don't mess up your system | 19:06 |
| weshay | I just need your help from time to time today | 19:06 |
| rlandy | weshay: k - I am here until 4:11 | 19:07 |
| weshay | dam | 19:08 |
| weshay | now docker doesnt work at all | 19:08 |
| * weshay bbiab | 19:08 | |
| rlandy | do you want to tmux? | 19:10 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 19:54 |
| weshay | rlandy, going to reboot and try this again | 19:55 |
| weshay | bb | 19:55 |
| rlandy | weshay: k | 19:55 |
| weshay | k.. docker is running again | 20:00 |
| rlandy | weshay: k - great | 20:01 |
| rlandy | I have a job to schedule on libvirt nodes | 20:01 |
| weshay | SHUT UP | 20:01 |
| weshay | it's working? | 20:01 |
| rlandy | not quite | 20:01 |
| rlandy | I need to get rid of rdocloud provider - I think it's trying o schedule there | 20:02 |
| rlandy | but I have the driver nodes | 20:02 |
| weshay | hrm.. do your thing | 20:02 |
| weshay | that is awesome | 20:02 |
| rlandy | what happened? | 20:11 |
| rlandy | tmux gone | 20:12 |
| *** matbu has joined #oooq | 20:46 | |
| rlandy | weshay: any progress? | 21:07 |
| weshay | rlandy, for sure my images were not right | 21:07 |
| weshay | so reuploading those | 21:07 |
| rlandy | weshay: ok - working now? | 21:07 |
| weshay | takes a while | 21:07 |
| weshay | will know more on monday | 21:07 |
| weshay | :) | 21:07 |
| weshay | good shabbos :) | 21:07 |
| rlandy | weshay - need to drop now - will be on line on sunday if you need anything | 21:08 |
| weshay | rlandy, k.. thanks :) | 21:08 |
| rlandy | have a good shabbos!! | 21:08 |
| *** rlandy has quit IRC | 21:08 | |
| *** vinaykns has quit IRC | 21:34 | |
| *** chem has quit IRC | 21:34 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 21:54 |
| *** apetrich has quit IRC | 22:47 | |
| *** apetrich has joined #oooq | 23:02 | |
| *** tosky has quit IRC | 23:42 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (3 more messages) | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!