| *** tosky has quit IRC | 00:14 | |
| *** d0ugal has quit IRC | 00:24 | |
| *** d0ugal has joined #oooq | 00:26 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 00:51 |
|---|---|---|
| *** vinaykns has joined #oooq | 01:56 | |
| *** dtrainor_ has quit IRC | 02:06 | |
| *** dtrainor_ has joined #oooq | 02:09 | |
| *** dtrainor_ has quit IRC | 02:14 | |
| *** rlandy|bbl is now known as rlandy | 02:32 | |
| *** sanjayu_ has joined #oooq | 02:46 | |
| *** holser_ has joined #oooq | 02:48 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 02:51 |
| *** holser_ has quit IRC | 03:05 | |
| *** chandankumar has joined #oooq | 03:17 | |
| *** ykarel|away has joined #oooq | 03:23 | |
| *** apetrich has quit IRC | 03:23 | |
| *** rlandy has quit IRC | 03:42 | |
| *** chandankumar has quit IRC | 03:51 | |
| *** rfolco has quit IRC | 03:54 | |
| *** skramaja has joined #oooq | 04:07 | |
| *** vinaykns has quit IRC | 04:07 | |
| *** gkadam__ has joined #oooq | 04:17 | |
| *** udesale has joined #oooq | 04:17 | |
| *** chandankumar has joined #oooq | 04:32 | |
| *** chandankumar is now known as chkumar|ruck | 04:32 | |
| *** jtomasek has joined #oooq | 04:44 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 04:51 |
| *** chkumar|ruck has quit IRC | 04:56 | |
| *** chkumar|ruck has joined #oooq | 04:57 | |
| *** ykarel|away is now known as ykarel | 04:59 | |
| *** dtrainor_ has joined #oooq | 05:12 | |
| *** dtrainor_ has quit IRC | 05:13 | |
| *** ratailor has joined #oooq | 05:13 | |
| *** dtrainor_ has joined #oooq | 05:13 | |
| *** dtrainor_ has quit IRC | 05:18 | |
| *** jtomasek has quit IRC | 05:43 | |
| *** ykarel has quit IRC | 05:44 | |
| *** chkumar|ruck has quit IRC | 05:48 | |
| *** chkumar|ruck has joined #oooq | 05:48 | |
| *** ykarel has joined #oooq | 05:53 | |
| *** quique|rover|off is now known as quiquell|rover | 06:20 | |
| *** sanjayu_ has quit IRC | 06:29 | |
| chkumar|ruck | quiquell|rover, \o/ | 06:42 |
| chkumar|ruck | quiquell|rover, f28 standalone job is passing now | 06:43 |
| *** jfrancoa has joined #oooq | 06:46 | |
| *** saneax has joined #oooq | 06:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 06:51 |
| quiquell|rover | chkumar|ruck: hello tehere | 06:57 |
| quiquell|rover | chkumar|ruck: Yep I saw it | 06:57 |
| *** chkumar|ruck has quit IRC | 07:10 | |
| *** jtomasek has joined #oooq | 07:18 | |
| *** ratailor has quit IRC | 07:21 | |
| *** quiquell|rover is now known as quiquell|brb | 07:32 | |
| *** chkumar|ruck has joined #oooq | 07:47 | |
| chkumar|ruck | quiquell|brb, periodic jobs are in queue state from last 2 hours https://review.rdoproject.org/zuul/status | 07:49 |
| *** ccamacho has joined #oooq | 07:58 | |
| *** apetrich has joined #oooq | 08:00 | |
| *** kopecmartin|off is now known as kopecmartin | 08:03 | |
| *** quiquell|brb is now known as quiquell|rover | 08:05 | |
| quiquell|rover | chkumar|ruck: looks like centos are stuck again | 08:05 |
| quiquell|rover | Let me check | 08:05 |
| *** panda is now known as panda|ko | 08:05 | |
| quiquell|rover | panda|ko: ? | 08:10 |
| quiquell|rover | chkumar|ruck: Looks like all upstream-centos-7 noddes are in building state | 08:11 |
| quiquell|rover | https://review.rdoproject.org/zuul/nodes | 08:11 |
| chkumar|ruck | quiquell|rover, around 9 nodes goes in deleting state now | 08:14 |
| *** saneax has quit IRC | 08:25 | |
| panda|ko | quiquell|rover: I have one eye out of order | 08:29 |
| panda|ko | blurry vision and double image on the left. Today will be a challenging day, reading is a struggle | 08:31 |
| *** jpena|off is now known as jpena | 08:33 | |
| quiquell|rover | panda|ko: I see :-P | 08:34 |
| quiquell|rover | panda|ko: Joking, take care of it man | 08:34 |
| chkumar|ruck | sshnaidm, Hello | 08:43 |
| chkumar|ruck | sshnaidm, I have tested the script it works as expected | 08:43 |
| chkumar|ruck | sshnaidm, I have pasted the stdout https://review.rdoproject.org/r/18666 | 08:44 |
| *** ykarel is now known as ykarel|lunch | 08:44 | |
| *** tosky has joined #oooq | 08:50 | |
| *** dtrainor has joined #oooq | 08:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 08:51 |
| quiquell|rover | Damn something is bad at RDO gerrit | 09:00 |
| *** bogdando has joined #oooq | 09:01 | |
| sshnaidm | chkumar|ruck, +w | 09:02 |
| quiquell|rover | sshnaidm: I think we are having issues with reproducer and RDO gerrit ssh | 09:04 |
| quiquell|rover | sshnaidm: Now it does not authenticate | 09:04 |
| quiquell|rover | sshnaidm: 200~http://logs.rdoproject.org/58/18558/33/gate/tripleo-ci-reproducer-fedora-28-host/78bcc71/tripleo-ci-reproducer/scheduler.log | 09:05 |
| *** quiquell|rover has quit IRC | 09:06 | |
| *** quiquell has joined #oooq | 09:06 | |
| *** jtomasek has quit IRC | 09:06 | |
| sshnaidm | chkumar|ruck, is test_white_regex overriding tempest_skip_master.yaml? | 09:06 |
| quiquell | damn https://softwarefactory-project.io/r/gitweb?p=software-factory%2Fsf-config.git;a=commit;h=27110c9477b34785850723ba7fcd064a0b604012 | 09:06 |
| sshnaidm | quiquell, and rdo works fine? they were in outage | 09:07 |
| *** jtomasek has joined #oooq | 09:07 | |
| sshnaidm | quiquell, heh | 09:07 |
| quiquell | sshnaidm: not related to outage | 09:07 |
| quiquell | sshnaidm: we have to do RDO optinal at reproducer | 09:08 |
| quiquell | sshnaidm: I am trying to run upstream job I don't care RDO | 09:08 |
| quiquell | Will put a review for that | 09:08 |
| sshnaidm | quiquell, so this users key is not ssh-rsa? | 09:08 |
| quiquell | sshnaidm: I think is the host key not the user key | 09:08 |
| quiquell | sshnaidm: as stated at TristanC fix | 09:08 |
| chkumar|ruck | sshnaidm, sorry where, if test_white_regex is in skip list it will not run | 09:18 |
| sshnaidm | chkumar|ruck, thanks | 09:18 |
| sshnaidm | quiquell, but Tristans code is about ansible role for sf | 09:19 |
| sshnaidm | quiquell, we don't use it | 09:20 |
| chkumar|ruck | quiquell, I am taking a look at this one https://bugs.launchpad.net/tripleo/+bug/1813546 from https://tree.taiga.io/project/tripleo-ci-board/us/702 | 09:25 |
| openstack | Launchpad bug 1813546 in tripleo "ansible-role-modify-image is not py3 and fedora 28+ ready" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 09:25 |
| quiquell | chkumar|ruck: ack good one | 09:27 |
| quiquell | sshnaidm: could be same issues | 09:32 |
| quiquell | sshnaidm: keys are RDO | 09:32 |
| quiquell | RSA | 09:32 |
| *** saneax has joined #oooq | 09:35 | |
| quiquell | Yep is with the host key | 09:35 |
| quiquell | HostKey agreed: ssh-ed25519 | 09:35 |
| quiquell | sshnaidm: another parsing error from telegraf and rdocloud | 09:39 |
| quiquell | comma missing now :-/ | 09:40 |
| quiquell | today change was not enough | 09:40 |
| quiquell | sshnaidm: https://review.rdoproject.org/r/#/c/18719/ | 09:54 |
| quiquell | fultonj: ping | 09:57 |
| quiquell | panda|ko: do you have a minute ? | 09:59 |
| chkumar|ruck | panda|ko, hello | 10:01 |
| chkumar|ruck | panda|ko, is this bug f28 https://bugs.launchpad.net/tripleo/+bug/1813913 planned for this sprint? | 10:01 |
| openstack | Launchpad bug 1813913 in tripleo "periodic-tripleo-fedora-28-master-containers-build failing with unauthorized access to rdo registry" [Wishlist,Triaged] - Assigned to Gabriele Cerami (gcerami) | 10:01 |
| chkumar|ruck | panda|ko, f28 container build is still hitting the same problem | 10:02 |
| *** ykarel|lunch is now known as ykarel | 10:05 | |
| *** chkumar|ruck has quit IRC | 10:09 | |
| *** chandankumar has joined #oooq | 10:15 | |
| *** chandankumar is now known as chkumar|ruck | 10:15 | |
| zbr|ssbarnea | sshnaidm: hi! please let me know if you have any questions about molecule, it would be better if i would have time to investigate before the meeting. i also made a brief presentation at https://docs.google.com/presentation/d/1qjJsz8zcV88R4LFsxD5syobUeitki8yFX7_jzgCxJ1w/edit?ts=5c584679#slide=id.p | 10:19 |
| quiquell | Puff RDO down | 10:19 |
| quiquell | :-/ | 10:19 |
| chkumar|ruck | quiquell, working for me | 10:20 |
| quiquell | chkumar|ruck: it's working now | 10:20 |
| sshnaidm | zbr|ssbarnea, I don't have questions about molecule, iirc we didn't agree on how to use it in CI | 10:21 |
| sshnaidm | zbr|ssbarnea, I don't need jobs that tests quickstart install deps in molecule and other useless things | 10:21 |
| zbr|ssbarnea | sshnaidm: so is not so much about the tools, is more about when/where to use it? | 10:21 |
| sshnaidm | zbr|ssbarnea, maybe it's worth to re-read comments in the patch to refresh | 10:22 |
| panda|ko | quiquell: yes | 10:25 |
| panda|ko | chkumar|ruck: yes, but it's not on ruck and rover | 10:25 |
| quiquell | panda|ko: when we do a branch_override | 10:26 |
| zbr|ssbarnea | sshnaidm: i will. so answer your concern: the proposed patch covered some areas where I has to make and test changes, molecule helped me do that. And I think this is the right approach: when you have to touch a specific area/role, you also add some testing code for it to validate your change. is more of add it where you need it, when you need it. | 10:26 |
| quiquell | panda|ko: we still are using "master" branch for thinks like tripleo-upgrade ? | 10:26 |
| arxcruz | panda|ko: what's wrong here? | 10:26 |
| arxcruz | ImageNotFoundException: Not found image: docker://docker.io/tripleomaster/centos-binary-cron:bf97151ce15feccd98be3b43c06656939841eb9b_8fb61313 | 10:27 |
| panda|ko | quiquell: tripleo-upgrade is branches, so no, we shouln't | 10:27 |
| sshnaidm | zbr|ssbarnea, I've already told, will continue on mtg | 10:27 |
| arxcruz | I mean, is that correct url to get the image? | 10:27 |
| chkumar|ruck | panda|ko, just asked as it is failing in promotion job and f28 is not a part of it so asked | 10:27 |
| panda|ko | arxcruz: where do you see it ? | 10:29 |
| arxcruz | panda|ko: in my reproducer | 10:29 |
| panda|ko | chkumar|ruck: working on the promotion pipeline for fedora is a topic for this sprint, hope we can get that partially sorted before the end | 10:30 |
| chkumar|ruck | panda|ko, thanks :-) | 10:30 |
| quiquell | panda|ko: I need this for ruck rovering https://review.rdoproject.org/r/#/c/18720/ | 10:30 |
| panda|ko | arxcruz: there is not such tag in thata container | 10:30 |
| quiquell | panda|ko: TL;DR skip rdo at reproducer | 10:30 |
| quiquell | panda|ko: also there is some issues with RDO host keys and reproducer now | 10:31 |
| arxcruz | panda|ko: where can i see the tag ? | 10:31 |
| panda|ko | arxcruz: in the registry ? | 10:31 |
| arxcruz | i'm trying to reproduce featureset021 | 10:31 |
| arxcruz | but i can't because of this | 10:31 |
| panda|ko | arxcruz: https://hub.docker.com/r/tripleomaster/centos-binary-cron/tags/ | 10:31 |
| arxcruz | i try to use a different tag | 10:31 |
| quiquell | zbr|ssbarnea: I don't have the molecule event at my calendar | 10:35 |
| quiquell | zbr|ssbarnea: when it is ? | 10:35 |
| zbr|ssbarnea | quiquell: there is no event, is during/after our community meeting, as Sagi recommended. I added it to the agenda. | 10:36 |
| quiquell | zbr|ssbarnea: ack | 10:36 |
| panda|ko | quiquell: can I get a skip_upstream option too ? :) | 10:37 |
| quiquell | panda|ko: Then we are screw | 10:37 |
| quiquell | panda|ko: noop reproducer | 10:37 |
| quiquell | panda|ko: always pass and make you happy is like puppy therapy | 10:37 |
| panda|ko | quiquell: so if I already set up my reproducer to use rdo, and rdo breaks and I want to continue testing with upstream only, I have to rebuild the containers and the configuration ? | 10:38 |
| quiquell | panda|ko: just call the playbook again | 10:38 |
| quiquell | Is what I did | 10:39 |
| *** jtomasek has quit IRC | 10:39 | |
| panda|ko | quiquell: ok | 10:39 |
| quiquell | it restart the reproducer | 10:39 |
| quiquell | running job just now | 10:39 |
| panda|ko | arxcruz: were you able to find a working tag ? | 10:40 |
| arxcruz | panda|ko: it's running now | 10:40 |
| sshnaidm | zbr|ssbarnea, you added it to wrong agenda, please remove it from there | 10:40 |
| arxcruz | panda|ko: it seems so, already pass the task | 10:40 |
| arxcruz | panda|ko: thanks | 10:40 |
| arxcruz | panda++ | 10:40 |
| arxcruz | panda|ko++ | 10:40 |
| hubbot1 | arxcruz: panda|ko's karma is now 1 | 10:40 |
| sshnaidm | zbr|ssbarnea, this agenda is for tripleo-all mtg in IRC, and we're going to discuss it in tripleo-ci bluejeans mtg | 10:41 |
| *** saneax has quit IRC | 10:42 | |
| *** saneax has joined #oooq | 10:42 | |
| zbr|ssbarnea | sshnaidm: i copied agenda from the tripleo meeting to the CI one. | 10:47 |
| panda|ko | quiquell: two doubts about the review | 10:48 |
| panda|ko | quiquell: 1) how where you passing the jobs.yaml previously 2) we don't need base-minimal anymore ? | 10:49 |
| quiquell | panda|ko: jobs.yaml was just at "files" at role copied into same place as template | 10:50 |
| quiquell | panda|ko: base-minimal I can remove it from the review | 10:50 |
| quiquell | panda|ko: was just some cleanup we are not using it we use just base | 10:50 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 10:51 |
| zbr|ssbarnea | sshnaidm: re jjb question from last week on https://review.rdoproject.org/r/#/c/18649/ -- yes we still need jjb because of the jobs that do run on ci.centos.org which are defined there. | 10:51 |
| sshnaidm | zbr|ssbarnea, yeah, they're defined and we didn't touch their jjb for years | 10:51 |
| chkumar|ruck | sshnaidm, please join internal prodchain-infra dfg channel | 10:52 |
| zbr|ssbarnea | sshnaidm: and hopefully we will not need to touch it. that chance is only moving jjb testing from tox-linters to tox-jjb (explained there). | 10:53 |
| chkumar|ruck | sshnaidm, we have more than 2000 down ports on openstack-nodepool tenant | 10:53 |
| quiquell | chkumar|ruck: what was the channel ? | 10:53 |
| chkumar|ruck | quiquell, #prodchain-infra-dfg | 10:53 |
| quiquell | chkumar|ruck: confirmed we are not cloning correct branch at tripleo-upgrade with branch-override :-/ | 10:54 |
| quiquell | jfrancoa: ^ | 10:54 |
| panda|ko | quiquell: ok | 10:54 |
| quiquell | panda|ko: ^ | 10:54 |
| quiquell | damn... | 10:54 |
| panda|ko | quiquell: how do you see it ? | 10:54 |
| quiquell | panda|ko: well I am in the machine right now | 10:55 |
| zbr|ssbarnea | chkumar|ruck: are you sure that the change made by quiquell regarding deleting of ports really runs? | 10:55 |
| panda|ko | quiquell: and what do you see ? | 10:56 |
| jfrancoa | quiquell: so what are we cloning then? a different branch? | 10:56 |
| quiquell | what change did I do ? | 10:56 |
| quiquell | master | 10:56 |
| zbr|ssbarnea | quiquell: ahh, sorry it was made by chkumar|ruck : that one https://review.rdoproject.org/r/#/c/18666/ | 10:56 |
| zbr|ssbarnea | i am curious if this code really runs on te-broker host | 10:57 |
| quiquell | panda|ko, jfrancoa: Now we have tripleo-upgrade as required project https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L30 | 10:58 |
| quiquell | So it's always cloned | 10:58 |
| panda|ko | quiquell: what job are you testing ? | 10:58 |
| quiquell | panda|ko: https://bugs.launchpad.net/tripleo/+bug/1814531 | 10:58 |
| openstack | Launchpad bug 1814531 in tripleo "pike: Running tripleo-upgrade at normal job" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:58 |
| jfrancoa | quiquell: but shouldn't zuul recognize that if the patch is for stable/pike, then it must download stable/pike branch for that project? or isn't it that clever? | 10:59 |
| quiquell | jfrancoa: at _pike jobs the "patch" is for master | 10:59 |
| quiquell | jfrancoa: we override that | 10:59 |
| quiquell | jfrancoa: but need to confirm stuff | 11:00 |
| jfrancoa | quiquell: ups...in that case that upgrade will never work..the process is quite different from pike to master | 11:00 |
| quiquell | jfrancoa: I don't know if we do much of upgrade jobs with branch_override | 11:00 |
| quiquell | jfrancoa: That's why is was not so obvious | 11:01 |
| quiquell | panda|ko: you can see at _pike here http://logs.openstack.org/45/560445/239/check/tripleo-ci-centos-7-containers-multinode-pike/cedc2ec/job-output.txt.gz#_2019-02-05_00_22_50_411958 | 11:01 |
| quiquell | panda|ko: this is pointing to master | 11:01 |
| quiquell | panda|ko: tripleo-upgrade is a required_project | 11:02 |
| quiquell | But want to confirm first | 11:02 |
| *** derekh has joined #oooq | 11:03 | |
| quiquell | Yep, master | 11:03 |
| *** fmount has quit IRC | 11:04 | |
| quiquell | We have this at requirements generated file:///home/zuul/src/git.openstack.org/openstack/tripleo-upgrade/#egg=tripleo-upgrade | 11:04 |
| quiquell | And this is master | 11:04 |
| quiquell | :-/ | 11:04 |
| *** fmount has joined #oooq | 11:04 | |
| *** bogdando has quit IRC | 11:04 | |
| *** bogdando has joined #oooq | 11:04 | |
| quiquell | I think I have a fix | 11:04 |
| quiquell | If we don't have a change for tripleo-upgrade just use as before ZUUL_BRANCH with is changed with override | 11:05 |
| *** ccamacho has quit IRC | 11:05 | |
| *** kopecmartin has quit IRC | 11:05 | |
| quiquell | The other projects we don't care we use build-test-packages and DLRN | 11:06 |
| quiquell | And they work alright | 11:06 |
| zbr|ssbarnea | chkumar|ruck: i think that the cleanup logic for ports is faulty because I see ~1900 ports down and ~all of those were updated in the last 3h hours. | 11:08 |
| zbr|ssbarnea | openstack port list --long -c id -c updated_at -c status --sort-column updated_at | grep DOWN | wc -l | 11:08 |
| *** kopecmartin has joined #oooq | 11:10 | |
| chkumar|ruck | zbr|ssbarnea, yes I need to change the time to 2 hours | 11:11 |
| chkumar|ruck | zbr|ssbarnea, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-cleanup/ovb-tenant-cleanup.sh#L163 | 11:12 |
| *** ccamacho has joined #oooq | 11:12 | |
| panda|ko | quiquell: if what you're saying is right, than we've never get the branch right since we switched to zuulv3 | 11:12 |
| chkumar|ruck | zbr|ssbarnea, it will delete the ports which are not updated after 5 hours | 11:12 |
| panda|ko | quiquell: https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/templates/toci_gate_test.sh.j2#L155 | 11:15 |
| panda|ko | quiquell: if there's an error in the logic, it's here | 11:16 |
| panda|ko | quiquell: we're always taking what zuul offers us here | 11:16 |
| quiquell | panda|ko: since we added tripleo-upgrade to required-projects at least | 11:16 |
| quiquell | panda|ko: before that the dir was present if we have a change on it only | 11:16 |
| quiquell | panda|ko: now the directory is always there | 11:16 |
| quiquell | panda|ko: but we don't run much upgrade with override_branch I think | 11:16 |
| quiquell | panda|ko: the other projects are alrigth we take them from DLRN | 11:16 |
| quiquell | panda|ko: is just stuff that we can only clone | 11:17 |
| quiquell | panda|ko: well... not sure | 11:17 |
| panda|ko | quiquell: when we were using devstack and zuulv2, setting OVERRIDE_ZUUL_BRANCH was enough to get all the projects with the overrid branch | 11:17 |
| panda|ko | quiquell: now we would need to set checkout_override for the branchful jobs | 11:18 |
| quiquell | panda|ko: yep was reading about it | 11:18 |
| quiquell | panda|ko: problem with that if that maybe it override the change ? | 11:19 |
| quiquell | panda|ko: Going to try | 11:19 |
| quiquell | panda|ko: if it works we can remove the else there | 11:20 |
| quiquell | is not execise | 11:20 |
| panda|ko | quiquell: if we are running on a tripleo-upgrade change, our good should be good, because the repo in the TRIPLEO_ROOT directory is already checked out with the right ref | 11:22 |
| quiquell | panda|ko: yep | 11:22 |
| quiquell | panda|ko: For example a change at tq with Depends-On on tripleo-upgrade master | 11:23 |
| quiquell | panda|ko: the stable branch will test with the correct one | 11:23 |
| quiquell | panda|ko: maybe even backporting that change will also work | 11:24 |
| quiquell | panda|ko: like multiple Depends-On per stable branch backporting | 11:24 |
| *** amoralej has joined #oooq | 11:26 | |
| amoralej | hi, two oooq jobs have failed in rdoinfo gate in tripleo-container-image-prepare with same error | 11:27 |
| amoralej | - 'http://mirror.centos.org/centos/7/storage/x86_64/ceph-luminous/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: mirror.centos.org; Unknown error"' | 11:27 |
| amoralej | is this somehow known issue? | 11:28 |
| amoralej | quiquell, ^ | 11:28 |
| *** udesale has quit IRC | 11:28 | |
| amoralej | ykarel, ^ | 11:28 |
| quiquell | amoralej: let me look I am rovering | 11:28 |
| amoralej | http://logs.rdoproject.org/92/18692/5/check/rdoinfo-tripleo-master-centos-7-scenario001-standalone/ea13990/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 11:28 |
| amoralej | http://logs.rdoproject.org/92/18692/5/check/rdoinfo-tripleo-master-testing-centos-7-multinode-1ctlr-featureset010/62f76ba/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 11:28 |
| amoralej | a third job in the same review seems to be passing | 11:28 |
| amoralej | still running | 11:28 |
| quiquell | panda|ko: this ? https://review.openstack.org/#/c/634917 | 11:29 |
| panda|ko | mmmhh DNS again ... | 11:29 |
| quiquell | panda|ko: Do we have issues with DNSs ? | 11:29 |
| panda|ko | quiquell: less recently, but 8.8.8.8 is rate limited for us now. | 11:31 |
| quiquell | jfrancoa: To try to fix branchfull, pike job has to fail there https://review.openstack.org/#/c/634917/ | 11:32 |
| quiquell | amoralej: btw do you know if RDO gerrit has change host key or something ? | 11:34 |
| amoralej | not afaik | 11:34 |
| quiquell | Or regenerate it ? | 11:34 |
| amoralej | dunno | 11:35 |
| amoralej | i didn't notice anything strange | 11:35 |
| panda|ko | quiquell: this patch should work: 1) it sets the starting ref, but still honours the change ref, if it's releate to the overridden branch, 2) even the previous version, if an overridden branch did not exist then mster was used as default | 11:37 |
| quiquell | panda|ko: so it has all the proper fallbacks | 11:38 |
| quiquell | panda|ko: At least is better than what we have now | 11:38 |
| marios | anyone else seen issues with chrony doing a standalone deploy? like this http://pastebin.test.redhat.com/707687 (am using a f28 virt host ) | 11:38 |
| quiquell | panda|ko: will also simplify toci | 11:38 |
| panda|ko | quiquell: it may, but we need to study how to replace the old mechanism. We're still partially tied to zuulv2 behaviour ... | 11:40 |
| quiquell | panda|ko: ok will just add the override thing | 11:41 |
| quiquell | panda|ko: It's working I see at "use-cached-repos : Find locally cached git repos" | 11:43 |
| quiquell | pike for tripleo-upgrade | 11:43 |
| quiquell | If -pike job fails we are good | 11:43 |
| *** jtomasek has joined #oooq | 11:45 | |
| quiquell | panda|ko: also in the reproduce is cloned pike | 11:45 |
| quiquell | so is good | 11:45 |
| quiquell | panda|ko: do we need to do similar at RDO ' | 11:46 |
| quiquell | ? | 11:46 |
| *** quiquell has quit IRC | 11:52 | |
| *** quiquell has joined #oooq | 11:52 | |
| panda|ko | quiquell: I don't remember if we have bnranchful jobs there | 11:52 |
| panda|ko | quiquell: but if we have, yes | 11:52 |
| panda|ko | but it's delicate, I hope we're not breaking anything else, stuyff like browbeat and such | 11:53 |
| quiquell | panda|ko: we have http://dashboard-ci.tripleo.org/d/FEdraO0ik/jobs-exploration?orgId=1&var-influxdb_filter=job_name%7C%3D~%7C%2F.*pike$%2F&var-influxdb_filter=type%7C%3D%7Crdo | 11:54 |
| quiquell | we have like a lot https://codesearch.rdoproject.org/?q=branch_override&i=nope&files=&repos= | 11:55 |
| quiquell | argg... | 11:55 |
| *** jpena is now known as jpena|lunch | 11:57 | |
| ykarel | quiquell, where pike is not cloned by zuul? patches in stable/pike? | 11:57 |
| quiquell | ykarel: at branchful jobs nope | 11:57 |
| quiquell | ykarel: we have found a bug at toci | 11:57 |
| quiquell | Possible fix https://review.openstack.org/#/c/634917/ | 11:58 |
| ykarel | [1] is missing in commit message | 11:58 |
| ykarel | issue description? | 11:58 |
| ykarel | since when issue is there? | 11:58 |
| quiquell | exactly this since we have branchful projects at "required-projects" | 11:59 |
| quiquell | They are always cloned | 11:59 |
| *** amoralej is now known as amoralej|lunch | 11:59 | |
| ykarel | quiquell, job link with issue? | 12:00 |
| ykarel | logs i mean | 12:00 |
| quiquell | ykarel: [1] https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L27-L37 | 12:01 |
| quiquell | All thos projects if they are branchfull we are geting them wrong at branch_override jobs | 12:01 |
| quiquell | ykarel: This is the noop changet at as stable/branch change http://logs.openstack.org/48/602248/23/check/tripleo-ci-centos-7-containers-multinode/141c28f/job-output.txt.gz#_2019-02-04_09_51_50_883398 | 12:02 |
| quiquell | ykarel: It fails and it's legit | 12:02 |
| quiquell | ykarel: we discover the issue at -pike jobs not failing at the same place | 12:02 |
| quiquell | http://logs.openstack.org/45/560445/239/check/tripleo-ci-centos-7-containers-multinode-pike/cedc2ec/ | 12:02 |
| quiquell | ykarel: Have reproduce it and se use master | 12:03 |
| quiquell | ykarel: the toci was expected the clone not to be there | 12:03 |
| *** quiquell is now known as quique|rover|eat | 12:03 | |
| ykarel | quique|rover|eat, but here i see stable/pike for tripleo-upgrade:- http://logs.openstack.org/48/602248/23/check/tripleo-ci-centos-7-containers-multinode/141c28f/zuul-info/inventory.yaml | 12:04 |
| ykarel | do you want to checkout master tripleo-upgrade when running in stable/pike branch? | 12:06 |
| ykarel | panda|ko, ^^ | 12:06 |
| *** quique|rover|eat is now known as quiquell|rover | 12:06 | |
| quiquell|rover | ykarel: as expected | 12:06 |
| quiquell|rover | ykarel: that one comes from a pike change | 12:06 |
| quiquell|rover | ykarel: problem is master change with branch_override | 12:06 |
| quiquell|rover | ykarel: toci was expecting zuul not to clone tripleo-upgrade | 12:06 |
| quiquell|rover | ykarel: and it was using branch_override infor to clone correct branch | 12:07 |
| quiquell|rover | ykarel: https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/templates/toci_gate_test.sh.j2#L155-L161 | 12:07 |
| quiquell|rover | ykarel: just for tripleo-upgrade | 12:07 |
| zbr|ssbarnea | chkumar|ruck: i am afraid that 2h is not safe as deployment can take 3h. I would setup the value to 200m which is bit over 3h (as we still have collection). we do not want to recycle stuff that may be still in use. sounds ok? | 12:09 |
| zbr|ssbarnea | chkumar|ruck: also when doing this, move the timer variable a top of the file and make it overridable, like the rest of them. | 12:10 |
| quiquell|rover | panda|ko: I think we have to remove the phase2 from promoter ini files | 12:10 |
| chkumar|ruck | zbr|ssbarnea, I have not changed the timing, the script is still running | 12:10 |
| chkumar|ruck | zbr|ssbarnea, I will update the patch | 12:11 |
| quiquell|rover | sshnaidm: we need this https://review.rdoproject.org/r/#/c/18719/ | 12:13 |
| *** quiquell|rover is now known as quique|rover|eat | 12:14 | |
| sshnaidm | quique|rover|eat, commented | 12:17 |
| ykarel | quiquell|rover, but issue seems is why at all upgrade running in non-upgrade jobs | 12:19 |
| ykarel | -pike jobs running correctly | 12:19 |
| chkumar|ruck | sshnaidm, https://review.rdoproject.org/r/18725 ssh key updated | 12:25 |
| fultonj | quique: you pinged me a few hours ago. i'm here now. | 12:26 |
| *** quique|rover|eat is now known as quiquell|rover | 12:28 | |
| quiquell|rover | fultonj: o/ | 12:28 |
| quiquell|rover | fultonj: gfidente is doing the ceph upgrade stuff | 12:28 |
| quiquell|rover | ykarel: -pike jobs should fail similar to noop review for pike branch | 12:29 |
| quiquell|rover | ykarel: but they are not | 12:29 |
| quiquell|rover | ykarel: triple-upgrade role is not runing but is being expanded by ansible | 12:29 |
| *** vinaykns has joined #oooq | 12:29 | |
| quiquell|rover | ykarel: but the expansion is ok at master branch from tripleo-upgrade | 12:30 |
| quiquell|rover | ykarel: that's why -pike jobs are working because branch is wrong | 12:30 |
| ykarel | quiquell|rover, yup this makes sense | 12:30 |
| fultonj | quiquell|rover: ok | 12:31 |
| quiquell|rover | sshnaidm: Going to add some pytest there | 12:31 |
| zbr|ssbarnea | i just realized the rdo gerrit was updated to 2.14, cool :D | 12:31 |
| quiquell|rover | zbr|ssbarnea: when ? | 12:31 |
| quiquell|rover | zbr|ssbarnea: that can be the issue with the reproducer | 12:31 |
| zbr|ssbarnea | probably today or yesterday | 12:32 |
| quiquell|rover | zbr|ssbarnea: so possibly they have update the host key | 12:32 |
| quiquell|rover | :-/ | 12:32 |
| quiquell|rover | and now we are screw | 12:32 |
| zbr|ssbarnea | i don't know exactly, but I realised few moments ago when I seen the "assignee" field. | 12:32 |
| quiquell|rover | I think zuul is geting the non RSA host key and that's why is failing | 12:32 |
| zbr|ssbarnea | quiquell|rover: my gerrit-review didn't complain about it, so I doubt the key was changed. | 12:33 |
| zbr|ssbarnea | quiquell|rover: we are not screwed, we just have the opportunity to improve the reproducer code ;) | 12:33 |
| ykarel | zbr|ssbarnea, quiquell|rover it's updated today | 12:34 |
| quiquell|rover | zbr|ssbarnea: is paramiko issue | 12:34 |
| quiquell|rover | we will see | 12:34 |
| ykarel | there was a mail regarding it | 12:34 |
| quiquell|rover | ykarel: sure there was and sure I didn't check it :-/ | 12:34 |
| *** skramaja_ has joined #oooq | 12:35 | |
| *** skramaja has quit IRC | 12:35 | |
| *** rfolco has joined #oooq | 12:37 | |
| *** vinaykns has quit IRC | 12:41 | |
| ykarel | quiquell|rover, chkumar|ruck seeing No more IP addresses available on network 1f6dd7c9-1c87-4310-a1c3-bd7c0346d6ad. in some jobs, is the issue known | 12:46 |
| ykarel | https://review.rdoproject.org/zuul/builds?result=RETRY_LIMIT | 12:47 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 12:51 |
| quiquell|rover | chkumar|ruck: is this related to the ports issue ? | 12:51 |
| *** gkadam__ has quit IRC | 12:58 | |
| chkumar|ruck | quiquell|rover, yes | 12:59 |
| chkumar|ruck | quiquell|rover, we have seen this issue last week | 12:59 |
| chkumar|ruck | quiquell|rover, ykarel we still have 1421 ports in down state from ovb script | 13:01 |
| weshay | chkumar|ruck, quiquell|rover you guys on top of the post build error in https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build/4d33e53/job-output.txt.gz | 13:01 |
| ykarel | ack | 13:01 |
| *** trown|outtypewww is now known as trown | 13:02 | |
| weshay | chkumar|ruck, quiquell|rover I beleive the error is the same as the check job atm | 13:03 |
| weshay | quiquell|rover, did rdo go offline again w/ problematic stacks? | 13:03 |
| quiquell|rover | weshay: yep, centos nodes were broken | 13:04 |
| chkumar|ruck | weshay, so last night they have cleaned up the stack till afternoon centos nodes were broken | 13:04 |
| weshay | great.. | 13:04 |
| chkumar|ruck | weshay, now we have 2000 ports are in down state | 13:04 |
| weshay | ya | 13:04 |
| weshay | fun | 13:04 |
| chkumar|ruck | weshay, clean up in progress | 13:04 |
| weshay | quiquell|rover, chkumar|ruck so the containers build job.. | 13:04 |
| weshay | "ERROR:kolla.common.utils:rabbitmq Failed with status: error | 13:04 |
| weshay | and the check build job are failing | 13:04 |
| weshay | no promotion blockers? | 13:04 |
| weshay | no alerts? | 13:05 |
| quiquell|rover | weshay: RDO was so broken I didn't really check too much | 13:05 |
| weshay | I need bugs | 13:05 |
| weshay | upstream is working | 13:05 |
| quiquell|rover | weshay: Ok let me iterate it | 13:05 |
| quiquell|rover | weshay: we have something interesting with branch_override | 13:05 |
| chkumar|ruck | weshay, we have dns issue also http://logs.rdoproject.org/92/18692/5/check/rdoinfo-tripleo-master-centos-7-scenario001-standalone/ea13990/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 13:06 |
| chkumar|ruck | few hours back | 13:06 |
| weshay | chkumar|ruck, quiquell|rover actually this may be fixed now | 13:06 |
| weshay | http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-7 | 13:06 |
| weshay | so the next promotion job that runs.. may work | 13:07 |
| weshay | so quiquell|rover you can hold on that bug | 13:07 |
| quiquell|rover | weshay: ack | 13:07 |
| quiquell|rover | weshay: looks we have being broken with branchful jobs for long | 13:08 |
| weshay | chkumar|ruck, hrm.. why is that not using the upstream mirror? | 13:08 |
| quiquell|rover | weshay: branch_override was not working as expected | 13:08 |
| weshay | fun | 13:08 |
| rascasoft | I love when weshay writes he need bugs :D | 13:08 |
| weshay | rascasoft, hey hey folks :) | 13:08 |
| weshay | we have a guest tonight... I'd like to welcome back rascasoft!!! | 13:09 |
| weshay | you might remember rascasoft from such films as... get buggy and squash it! | 13:09 |
| rascasoft | weshay, yo man, I missed you all too much, need to pass and say bye | 13:09 |
| weshay | rascasoft, tell what life is like on the outside | 13:09 |
| chkumar|ruck | weshay, checking on that | 13:10 |
| weshay | chkumar|ruck, the image prep should be using 2019-02-05 10:35:23.352802 | primary | + echo ' baseurl: http://mirror.regionone.rdo-cloud.rdoproject.org/centos/7/os/x86_64/' | 13:10 |
| weshay | not - 'http://mirror.centos.org/centos/7/storage/x86_64/ceph-luminous/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: mirror.centos.org; Unknown error"' | 13:11 |
| rascasoft | weshay, busy, sleepless, poorer but what is important is that it is... Satisfactory | 13:11 |
| weshay | lolz... sleepless??? you should be sleeping like baby man.. we're all about to do performance reviews | 13:11 |
| rascasoft | weshay, ah ah you win! | 13:12 |
| quiquell|rover | weshay: That's DNS | 13:12 |
| quiquell|rover | weshay: panda|ko you say there were some DNS issue before ? | 13:13 |
| weshay | rascasoft, :) | 13:13 |
| chkumar|ruck | weshay, http://codesearch.openstack.org/?q=%27http%3A%2F%2Fmirror.centos.org%2Fcentos&i=nope&files=&repos= | 13:13 |
| chkumar|ruck | weshay, at each place it will look for nodepool mirror but if it is not there i think then it moves to mirrors.centos.org | 13:13 |
| weshay | chkumar|ruck-- | 13:14 |
| hubbot1 | weshay: chkumar|ruck's karma is now 4 | 13:14 |
| weshay | https://logs.rdoproject.org/92/18692/5/check/rdoinfo-tripleo-master-centos-7-scenario001-standalone/ea13990/job-output.txt.gz#_2019-02-05_10_35_34_535254 | 13:14 |
| weshay | it needs to be using the mirror... it may be a tripleo bug | 13:14 |
| chkumar|ruck | opening a bug and looking into it | 13:15 |
| weshay | chkumar|ruck, do we have a bug on infra? | 13:15 |
| weshay | chkumar|ruck, maybe we can ask alan why they block mirror.regionone.rdo-cloud.rdoproject.org | 13:15 |
| weshay | from port 80 | 13:15 |
| weshay | chkumar|ruck++ | 13:16 |
| hubbot1 | weshay: chkumar|ruck's karma is now 5 | 13:16 |
| weshay | I reread your comment | 13:16 |
| ykarel | weshay, chkumar|ruck seems issue with rdoinfo tripleo jobs as using custom release files | 13:16 |
| *** jpena|lunch is now known as jpena | 13:17 | |
| quiquell|rover | panda|ko, jfrancoa: -pike has failed as expected https://zuul.openstack.org/stream/13d56e3e1e9b4477b5b5610806e46667?logfile=console.log | 13:17 |
| weshay | ykarel, sorry? | 13:17 |
| quiquell|rover | ykarel: ^ | 13:17 |
| weshay | ykarel, more detail there please | 13:17 |
| jfrancoa | quiquell: something I don't really get is what's the difference between both executions (the master one and the stable/pike) if underneath they're calling both to the same tripleo-upgrade role branch (master), and from the very same playbook file (multinode-ovecloud-upgrade.yml)..why does one start running tripleo-upgrade while the other just skips it as expected.. | 13:19 |
| ykarel | weshay, the logs you guys were discussion against mirror.centos is from the job which uses custom release files to inject rdo repos:- https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/run-rdoinfo.yaml#L84-L197 | 13:19 |
| ykarel | so might have some missing related to mirror | 13:20 |
| quiquell|rover | jfrancoa: the noop changes is at stable/pike | 13:20 |
| quiquell|rover | jfrancoa: the -pike is running master everywhere | 13:20 |
| quiquell|rover | jfrancoa: master branch of tripleo-upgrade does not have the issue | 13:20 |
| quiquell|rover | jfrancoa: only stable/pike branch | 13:20 |
| quiquell|rover | jfrancoa: blue ? | 13:20 |
| ykarel | weshay, specifically https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/run-rdoinfo.yaml#L117 seems issue | 13:20 |
| jfrancoa | quiquell|rover: ok | 13:21 |
| ykarel | weshay, makes sense? | 13:21 |
| *** amoralej|lunch is now known as amoralej | 13:22 | |
| quiquell|rover | jfrancoa: your blue I am | 13:22 |
| ykarel | amoralej, ^^ | 13:22 |
| weshay | ykarel, I wanted to -2 all of that | 13:22 |
| weshay | but refrained | 13:23 |
| weshay | ykarel, do you think we can create a regular release file for rdo-info? | 13:23 |
| weshay | amoralej, ^ | 13:23 |
| weshay | I know we just carried that release info but we should get it more in line for maint | 13:24 |
| weshay | sshnaidm, you ready in 5? | 13:24 |
| amoralej | we'd need to parametrize the regular release files to add arbitrary repos | 13:24 |
| sshnaidm | weshay, yep | 13:25 |
| ykarel | yup we inject custom things in release files | 13:25 |
| rfolco | arxcruz, https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L45 - added for you, feel free to change | 13:25 |
| amoralej | i think that's the only that we need | 13:25 |
| weshay | looking for a merge https://review.openstack.org/#/c/634301/ | 13:25 |
| amoralej | and have for rdo trunk and cloudsig released and testing | 13:26 |
| amoralej | but yes, it's possible | 13:26 |
| weshay | marios, thanks for pointing out f28 | 13:27 |
| weshay | will look in a bit | 13:27 |
| chkumar|ruck | quiquell|rover, weshay rabbitmq one https://bugs.launchpad.net/tripleo/+bug/1814763 | 13:27 |
| openstack | Launchpad bug 1814763 in tripleo "[Master][periodic] container build job got failed with No package rabbitmq-server-3.7.10 available" [Critical,Triaged] | 13:27 |
| marios | weshay: ? | 13:27 |
| marios | weshay: which bit | 13:27 |
| weshay | amoralej, cool.. thanks | 13:27 |
| amoralej | is it possible to override parameters in release files with otheeeeeer yaml? | 13:27 |
| marios | weshay: (some review maybe?) | 13:27 |
| weshay | marios, libselinux on my patch | 13:27 |
| marios | weshay: ah ack | 13:27 |
| amoralej | i.e. gating_repo_name | 13:27 |
| ykarel | artg_skipped_project also | 13:28 |
| quiquell|rover | chkumar|ruck: thanks sorry I didn't get that | 13:28 |
| chkumar|ruck | quiquell|rover, in current promotion pipeline job https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build/4d33e53/logs/kolla/logs/000_FAILED_rabbitmq.log goes to post_failure while doing kolla build | 13:32 |
| chkumar|ruck | quiquell|rover, rabbitmq-server-3.7.10 available. is not available, the promotion pipeline jobs are still running. | 13:34 |
| chkumar|ruck | quiquell|rover, it is the bug for the same https://bugs.launchpad.net/tripleo/+bug/1814763 | 13:34 |
| openstack | Launchpad bug 1814763 in tripleo "[Master][periodic] container build job got failed with No package rabbitmq-server-3.7.10 available" [Critical,Triaged] | 13:34 |
| quiquell|rover | chkumar|ruck: ^ this is not related to the DNS issue ? | 13:36 |
| chkumar|ruck | quiquell|rover, nope | 13:36 |
| chkumar|ruck | quiquell|rover, rdoinfo was dns issue | 13:36 |
| quiquell|rover | chkumar|ruck: then looks like we have a bad dependency somewhere | 13:37 |
| quiquell|rover | chkumar|ruck: so the kolla container depends on a RDO package that we don't have build yet ? | 13:37 |
| *** rlandy has joined #oooq | 13:38 | |
| quiquell|rover | chkumar|ruck: but can be indirectly related to DNSs | 13:39 |
| chkumar|ruck | quiquell|rover, it comes from deps | 13:39 |
| quiquell|rover | chkumar|ruck: If we cannot get new version of rabbitmq-server at rdoinfo | 13:39 |
| quiquell|rover | kolla is going to fail | 13:39 |
| quiquell|rover | didn't they have an issue with DNS at rdoinfo regarding rabbitmq ? | 13:39 |
| quiquell|rover | Or I am totally lost ? | 13:39 |
| quiquell|rover | amoralej: what was the issue with rabbitmq ? | 13:39 |
| chkumar|ruck | quiquell|rover, yes | 13:40 |
| chkumar|ruck | quiquell|rover, last package built is https://cbs.centos.org/koji/packageinfo?packageID=398 | 13:40 |
| chkumar|ruck | rabbitmq-server-3.6.16-1.el7 | 13:40 |
| quiquell|rover | chkumar|ruck: so rdoinfo is not able to create the new one | 13:40 |
| quiquell|rover | chkumar|ruck: and they cannot do it because the DNS | 13:40 |
| quiquell|rover | is that it ? | 13:40 |
| quiquell|rover | or the release file ? | 13:41 |
| quiquell|rover | rlandy: There are issues with reproducer and RDO new gerrit | 13:41 |
| quiquell|rover | rlandy: did have to bypass RDO to use it | 13:41 |
| quiquell|rover | sshnaidm: ^ | 13:41 |
| quiquell|rover | https://review.rdoproject.org/r/#/c/18720/ | 13:42 |
| rlandy | ok | 13:42 |
| amoralej | quiquell|rover, no idea about rabbitmq problem | 13:43 |
| chkumar|ruck | quiquell|rover, I got the culprit http://git.openstack.org/cgit/openstack/kolla/tree/docker/rabbitmq/Dockerfile.j2#n17 | 13:44 |
| ykarel | amoralej, chkumar|ruck, quiquell|rover you nead https://review.openstack.org/#/c/634405/ for rabbitmq issue, this will be available with next promotion issue, master repo will be consistent soon: https://trunk.rdoproject.org/centos7-master/queue.html | 13:44 |
| ykarel | s/promotion issue/promotion run | 13:44 |
| chkumar|ruck | ykarel, promotion jobs were in queue state for very long time today so | 13:45 |
| ykarel | chkumar|ruck, tripleo-common patch was not there | 13:45 |
| amoralej | epel should not be enabled with rdo | 13:46 |
| quiquell|rover | ykarel: Thanks | 13:47 |
| chkumar|ruck | ykarel, thanks! | 13:47 |
| quiquell|rover | Humm last run from periodic-tripleo-centos-7-master-containers-build | 13:48 |
| chkumar|ruck | quiquell|rover, we need to wait for next run may be tomorroew | 13:53 |
| quiquell|rover | chkumar|ruck: I see almost all the jobs finished or skipped | 13:53 |
| quiquell|rover | chkumar|ruck: Yep let's wait for tomorrow | 13:53 |
| quiquell|rover | chkumar|ruck: At least now jobs are running again | 13:54 |
| chkumar|ruck | quiquell|rover, if container-builds passes, other promotion jobs kicks off | 13:54 |
| chkumar|ruck | if fails, others got skipped | 13:54 |
| quiquell|rover | chkumar|ruck: has already fail | 13:57 |
| quiquell|rover | chkumar|ruck: we have to wait next run | 13:57 |
| chkumar|ruck | quiquell|rover, sshnaidm down ports still left 1149 | 13:57 |
| chkumar|ruck | quiquell|rover, sshnaidm does the port cleanup script will be running on te-broker server? | 13:58 |
| arxcruz | panda|ko: well, ImageNotFoundException: Not found image: docker://docker.io/tripleomaster/centos-binary-cron:bf97151ce15feccd98be3b43c06656939841eb9b_8fb61313 | 13:58 |
| chkumar|ruck | or do we need there to kick it manually? | 13:58 |
| panda|ko | arxcruz: ? again ? | 13:58 |
| quiquell|rover | chkumar|ruck: te-broker is gone, toolbox I think is the palce | 13:58 |
| *** ykarel is now known as ykarel|away | 13:58 | |
| quiquell|rover | sshnaidm: ? | 13:58 |
| arxcruz | panda|ko: wait, althoug i change the hash still getting the old one | 13:59 |
| chkumar|ruck | quiquell|rover, new repo? | 13:59 |
| panda|ko | arxcruz: yep, and that one doesn't exist | 13:59 |
| arxcruz | panda|ko: yeah, wondering where I'm missing ... | 14:00 |
| chkumar|ruck | arxcruz, feel free to update the notes on os_tempest on tripleo meeting | 14:00 |
| chkumar|ruck | i need to leave in some time | 14:00 |
| panda|ko | arxcruz: which is weird, we never remove tags, so taht tag actually never existed | 14:00 |
| chkumar|ruck | arxcruz, thanks :-) | 14:00 |
| sshnaidm | quiquell|rover, what is the question? | 14:01 |
| panda|ko | arxcruz: since containters creation, it has never been there | 14:01 |
| arxcruz | chkumar|ruck: don't know why, but you're welcome :D | 14:01 |
| chkumar|ruck | weshay, sshnaidm quiquell|rover I am logging out, will take a look at down ports tomorrow if stills stays there | 14:03 |
| chkumar|ruck | see ya! | 14:03 |
| *** skramaja_ is now known as skramaja | 14:03 | |
| sshnaidm | chkumar|ruck, is script is still running? | 14:03 |
| quiquell|rover | chkumar|ruck: bye | 14:04 |
| chkumar|ruck | sshnaidm, I am terminating the script from my side once my laptop goes to sleep | 14:04 |
| sshnaidm | chkumar|ruck, ok, I'll continue to run it then | 14:05 |
| chkumar|ruck | still left 1123 | 14:05 |
| chkumar|ruck | see ya | 14:05 |
| *** chkumar|ruck has quit IRC | 14:05 | |
| sshnaidm | chkumar|ruck, thanks, see you | 14:05 |
| *** vinaykns has joined #oooq | 14:06 | |
| *** holser_ has joined #oooq | 14:09 | |
| sshnaidm | quiquell|rover, this patch made impossible to send patches in test1 project: https://review.rdoproject.org/r/#/c/18279/ | 14:12 |
| sshnaidm | quiquell|rover, this first commit is stuck somehow.. it's not submitted, but in origin/master anyhow | 14:12 |
| sshnaidm | quiquell|rover, all further commits are rejected | 14:13 |
| sshnaidm | quiquell|rover, oh, sorry, seems like I had this repo from previous run.. deleted and cloned again, it worked | 14:14 |
| quiquell|rover | sshnaidm: ack | 14:14 |
| sshnaidm | quiquell|rover, false alarm :D | 14:14 |
| quiquell|rover | sshnaidm: do you have issues git RDO gerrit ? | 14:14 |
| sshnaidm | quiquell|rover, when I ran reproducer script I had | 14:14 |
| sshnaidm | quiquell|rover, but my setup is working fine so far | 14:15 |
| quiquell|rover | sshnaidm: ack | 14:15 |
| quiquell|rover | In case you have problem test this https://review.rdoproject.org/r/#/c/18720/ | 14:15 |
| sshnaidm | but I think any new one will have this problem | 14:15 |
| quiquell|rover | Have work for me | 14:15 |
| quiquell|rover | but we have issues with RDO new gerrit :-/ | 14:15 |
| quiquell|rover | jfrancoa: https://review.openstack.org/#/c/634917/ | 14:16 |
| quiquell|rover | jfrancoa: Let's see if it works now | 14:16 |
| jfrancoa | quiquell|rover: great, thanks for preparing it | 14:16 |
| sshnaidm | quiquell|rover, I work with ovb jobs, so I need it :( | 14:23 |
| quiquell|rover | sshnaidm: then we are screw | 14:26 |
| quiquell|rover | sshnaidm: after gerrit upgrade at RDO host key is not RSA or zuul is not asking for RSA one and paramiko fails :-/ | 14:26 |
| sshnaidm | quiquell|rover, did you talk with Tristan? | 14:27 |
| sshnaidm | quiquell|rover, maybe it's possible to revert | 14:27 |
| sshnaidm | quiquell|rover, for me it still works, I think it remembers my host | 14:27 |
| quiquell|rover | hell of a day | 14:27 |
| sshnaidm | quiquell|rover, np, let's catch with him tomorrow | 14:27 |
| *** holser_ has quit IRC | 14:29 | |
| *** holser_ has joined #oooq | 14:30 | |
| *** udesale has joined #oooq | 14:32 | |
| sshnaidm | quiquell|rover, damn.. my setup is also screwed: Signature verification (ssh-ed25519) failed | 14:33 |
| quiquell|rover | Yep that's it | 14:33 |
| quiquell|rover | Tristan have found similar issue with paramiko | 14:33 |
| quiquell|rover | https://softwarefactory-project.io/r/gitweb?p=software-factory%2Fsf-config.git;a=commit;h=27110c9477b34785850723ba7fcd064a0b604012 | 14:33 |
| quiquell|rover | Don't know if we can force zuul to ask for RSA host key | 14:34 |
| rlandy | marios: I hit the selinux vpn issue yesterday - did you do anything to correct it - or you just live with changing to permissive? | 14:35 |
| *** zbr has joined #oooq | 14:39 | |
| *** zbr|ssbarnea has quit IRC | 14:40 | |
| rlandy | quiquell|rover: been more concentrated on the users setup but I'll retry your patch | 14:42 |
| rlandy | need to get these things through ... https://review.rdoproject.org/r/#/c/18665/ | 14:42 |
| quiquell|rover | rlandy: Well, we cannot connect with RDO gerrit with reproducer | 14:43 |
| quiquell|rover | rlandy: this has more priority than nothing I think ? | 14:43 |
| quiquell|rover | rlandy: they have update gerrit at RDO | 14:44 |
| rlandy | quiquell|rover; who are you talking with in RDO? | 14:49 |
| quiquell|rover | rlandy: Tried tristan | 14:49 |
| rlandy | quiquell|rover: Tristan is on a diff timezone, I think | 14:50 |
| rlandy | did you reach him? | 14:51 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 14:51 |
| quiquell|rover | rlandy: :-( | 14:51 |
| *** zbr|ssbarnea has joined #oooq | 14:53 | |
| rlandy | quiquell|rover: nhicher maybe? | 14:55 |
| *** zbr has quit IRC | 14:55 | |
| quiquell|rover | sshnaidm: added pytest to rdocloud.py https://review.rdoproject.org/r/18719 | 14:56 |
| quiquell|rover | sshnaidm: Now is tested | 14:56 |
| quiquell|rover | rlandy: CI is screw there | 14:57 |
| quiquell|rover | rlandy: you can bypass while we fix it with the skip_rdo | 14:57 |
| *** jtomasek has quit IRC | 14:59 | |
| rlandy | quiquell|rover: no worries about that CI - can wait | 14:59 |
| weshay | marios, I may need to take that back.. or most of the role defined in tripleo.. ansible-role-tripleo* just shell's and filled in w/ jinja? | 15:00 |
| *** dtrainor has quit IRC | 15:01 | |
| *** udesale has quit IRC | 15:06 | |
| *** sanjayu_ has joined #oooq | 15:06 | |
| *** saneax has quit IRC | 15:08 | |
| *** zbr has joined #oooq | 15:13 | |
| *** zbr|ssbarnea has quit IRC | 15:15 | |
| quiquell|rover | weshay, sshnaidm: to fix cockpit stack panel https://review.rdoproject.org/r/18719 | 15:31 |
| *** skramaja has quit IRC | 15:34 | |
| weshay | rfolco, that was your meeting right? | 15:43 |
| weshay | in bluejeans? | 15:43 |
| rfolco | no, its yours | 15:43 |
| weshay | ok.. ha | 15:43 |
| weshay | thanks | 15:43 |
| sshnaidm | quiquell|rover++ | 15:48 |
| hubbot1 | sshnaidm: quiquell|rover's karma is now 4 | 15:48 |
| sshnaidm | quiquell|rover, great tests on rdocloud.py | 15:48 |
| quiquell|rover | sshnaidm: We need more of this at all telegraf stuff | 15:48 |
| quiquell|rover | sshnaidm: but its costly | 15:48 |
| sshnaidm | quiquell|rover, yeah, totally | 15:48 |
| panda|ko | arxcruz: ping | 15:54 |
| arxcruz | panda|ko: pong | 15:54 |
| *** dsneddon__ has quit IRC | 15:54 | |
| panda|ko | arxcruz: any particular objection in merging https://review.openstack.org/509728 ? I need it to move on on my task. Without a working multinode scenario012, I have nothing to compere the failures that I'm seeing in standalone | 15:55 |
| *** zbr|ssbarnea has joined #oooq | 15:56 | |
| *** quiquell|rover is now known as quique|rover|off | 15:57 | |
| panda|ko | arxcruz: I don't know how would we test this on fs20, but unless tha flag "ironic" is there, nothing should change | 15:59 |
| *** zbr has quit IRC | 15:59 | |
| arxcruz | panda|ko: checking | 15:59 |
| panda|ko | arxcruz: thanks | 16:00 |
| *** jtomasek has joined #oooq | 16:00 | |
| arxcruz | panda|ko: done, i believe it's okay | 16:00 |
| panda|ko | arxcruz: thanks | 16:03 |
| rlandy | weshay: ping re: failing f28 on https://review.openstack.org/#/c/634329/ ... http://logs.openstack.org/29/634329/12/check/tripleo-ci-fedora-28-standalone/38ce3a4/job-output.txt.gz#_2019-02-04_22_45_57_456883\ | 16:03 |
| weshay | rlandy, ok.. rdo has some nodes now | 16:03 |
| weshay | it looks like | 16:03 |
| weshay | maybe we'll get a thing merged | 16:03 |
| rlandy | weshay: ack - jobs were still failing for me - but point aside | 16:03 |
| rlandy | weshay: reproducer ci is failing | 16:03 |
| * weshay looks at ur review | 16:04 | |
| rlandy | due to rdo gerrit change | 16:04 |
| weshay | ya.. I'm looking at that now | 16:04 |
| weshay | rlandy, you are referring to marios's comment | 16:04 |
| weshay | ? | 16:04 |
| weshay | rlandy, oh wait | 16:05 |
| weshay | rlandy, quique|rover|off dang it | 16:05 |
| weshay | do we know why https://logs.rdoproject.org/65/18665/4/check/tripleo-ci-reproducer-fedora-28-host/16bb2fc/job-output.txt.gz#_2019-02-05_03_04_26_436115 | 16:05 |
| weshay | is failing? | 16:06 |
| rlandy | weshay: see rdo dicussion | 16:06 |
| rlandy | <nhicher> quiquell|rover: we've got this issue on sf, if the ssh-ed25519 is defined before the rsa one it fails, we fixed that with https://softwarefactory-project.io/cgit/software-factory/sf-config/tree/ansible/roles/sf-base/tasks/upgrade.yml#n84 | 16:07 |
| *** dsneddon__ has joined #oooq | 16:14 | |
| *** ccamacho has quit IRC | 16:19 | |
| *** ccamacho has joined #oooq | 16:20 | |
| panda|ko | sorry folks, working with only one eye is giving me the headache, leaving early today. | 16:22 |
| *** panda|ko is now known as panda|off | 16:22 | |
| *** jtomasek has quit IRC | 16:27 | |
| *** ccamacho has quit IRC | 16:41 | |
| weshay | rlandy, ok.. I think I fixed the f28 issue marios found.. anything else I can do atm? | 16:50 |
| weshay | or we just waiting on rdo to come back to life | 16:50 |
| rlandy | weshay: I am reinstalling on my test box | 16:50 |
| rlandy | we should be able to get by the ssh issue there | 16:50 |
| rlandy | by clearing known_hosts | 16:50 |
| rlandy | weshay: wrt more to do- don;t think so | 16:50 |
| rlandy | until we know how ci reacts | 16:51 |
| weshay | rfolco, did you get my pm's? | 16:51 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 16:51 |
| rlandy | weshay: that one thing I did not do is the self extracting tar file | 16:51 |
| rlandy | didn;t think it added much | 16:51 |
| rlandy | but I can be wrong | 16:51 |
| rlandy | would rather merge what we have atm | 16:51 |
| *** hamzy has quit IRC | 16:51 | |
| weshay | rlandy, not including a self extracting tar is fine by me | 16:52 |
| rlandy | I think our users can tar -xvf | 16:53 |
| *** agopi is now known as agopi|brb | 17:03 | |
| *** bogdando has quit IRC | 17:06 | |
| *** agopi|brb has quit IRC | 17:07 | |
| *** kopecmartin is now known as kopecmartin|off | 17:12 | |
| *** jtomasek has joined #oooq | 17:18 | |
| rlandy | weshay: install_package_deps_via_bindep does nothing on my system | 17:22 |
| *** holser_ has quit IRC | 17:22 | |
| rlandy | task path: /tmp/reproduce-tmp.VLpLx/roles/ansible-role-tripleo-ci-reproducer/tasks/openstack/main.yaml:2 | 17:22 |
| rlandy | failed: [localhost] (item=19885) => {"changed": false, "item": 19885, "msg": "openstacksdk is required for this module"} | 17:22 |
| rlandy | failed: [localhost] (item=22) => {"changed": false, "item": 22, "msg": "openstacksdk is required for this module"} | 17:22 |
| rlandy | ^^ get that error | 17:22 |
| *** jtomasek has quit IRC | 17:23 | |
| weshay | rlandy, can I get the script you are using | 17:24 |
| rlandy | https://review.openstack.org/#/c/634329/13/install-deps.sh | 17:24 |
| rlandy | I pulled the other files from http://logs.openstack.org/67/631067/50/check/tripleo-ci-centos-7-standalone/b341b8c/logs/ | 17:24 |
| rlandy | edited then to avoid errors due to files not merged | 17:25 |
| weshay | are you sourcing it and then calling the function? | 17:25 |
| weshay | or running ./install-deps.sh | 17:25 |
| * rlandy updates per ... sec | 17:26 | |
| rlandy | The task includes an option with an undefined variable. The error was: 'playbooks_dir' is undefined | 17:33 |
| rlandy | my mistake - fixing | 17:34 |
| weshay | rlandy, I thought that was a ansible internal var | 17:34 |
| weshay | https://docs.ansible.com/ansible/latest/reference_appendices/special_variables.html | 17:35 |
| weshay | laybook_dir | 17:35 |
| weshay | The path to the directory of the playbook that was passed to the ansible-playbook command line. | 17:35 |
| weshay | rlandy, it's playbook_dir | 17:35 |
| rlandy | weshay: ack | 17:36 |
| rlandy | you have to spell it right for it to work :) | 17:36 |
| weshay | lolz | 17:36 |
| rlandy | {"msg": "An unhandled exception occurred while running the lookup plugin 'file'. Error was a <class 'ansible.errors.AnsibleError'>, original message: could not locate file in lookup: /tmp/reproduce-tmp.VLpLx/playbooks/bindep_python2.txt"} | 17:36 |
| rlandy | it's one back | 17:36 |
| *** ykarel|away has quit IRC | 17:38 | |
| *** ykarel|away has joined #oooq | 17:42 | |
| *** derekh has quit IRC | 17:45 | |
| *** jpena is now known as jpena|off | 17:46 | |
| gouthamr | o/ has anyone hit an issue with executing "chronyc waitsync 20" on a compute node during oooq deployment? (from: https://github.com/openstack/tripleo-heat-templates/blob/1282bc/deployment/timesync/chrony-baremetal-ansible.yaml#L125) | 17:53 |
| weshay | rlandy, it's not merged | 17:54 |
| weshay | rlandy, hrm.. that is the wrong dir too | 17:55 |
| weshay | hrm | 17:55 |
| rlandy | yep - testing fix | 17:55 |
| *** trown is now known as trown|lunch | 17:59 | |
| *** ykarel|away has quit IRC | 18:03 | |
| weshay | rlandy, I have a bug too on systems w/o python | 18:05 |
| weshay | + python2 -c 'from __future__ import print_function; import setuptools; print('\''setuptools:%s '\'' % setuptools.__version__, end='\'''\'')' | 18:05 |
| weshay | breaks me | 18:05 |
| rlandy | weshay: checking packages with check_mode also requires become | 18:05 |
| rlandy | so that's not a good check | 18:06 |
| rlandy | for the sudo issue | 18:06 |
| weshay | rlandy, that's too bad | 18:06 |
| weshay | so you have to hand craft.. | 18:06 |
| weshay | that would be a nice fix for ansible | 18:06 |
| rlandy | weshay: yep - reworking | 18:06 |
| weshay | zbr|ssbarnea, can we chat for a hot second? | 18:07 |
| weshay | or is it too late? | 18:07 |
| zbr|ssbarnea | sure. joining now. | 18:08 |
| *** hamzy has joined #oooq | 18:12 | |
| *** agopi has joined #oooq | 18:13 | |
| *** sanjayu_ has quit IRC | 18:16 | |
| *** sanjayu_ has joined #oooq | 18:16 | |
| *** sanjayu__ has joined #oooq | 18:18 | |
| *** sanjayu_ has quit IRC | 18:20 | |
| weshay | rlandy, found this helpful | 18:29 |
| weshay | $ PS4='Line ${LINENO}: ' bash -x | 18:29 |
| weshay | $ PS4='Line ${LINENO}: ' bash -x reproducer-foo.sh | 18:29 |
| weshay | prints the line numbers as it executes | 18:29 |
| *** dtrainor has joined #oooq | 18:34 | |
| *** dtrainor_ has joined #oooq | 18:36 | |
| *** dtrainor has quit IRC | 18:39 | |
| *** holser_ has joined #oooq | 18:41 | |
| *** holser_ has quit IRC | 18:42 | |
| *** holser_ has joined #oooq | 18:43 | |
| *** jfrancoa has quit IRC | 18:44 | |
| *** ccamacho has joined #oooq | 18:44 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 18:51 |
| *** sanjayu__ has quit IRC | 18:56 | |
| *** amoralej is now known as amoralej|off | 19:07 | |
| *** jtomasek has joined #oooq | 19:19 | |
| *** holser_ has quit IRC | 19:22 | |
| *** holser_ has joined #oooq | 19:23 | |
| rlandy | weshay: updated ... https://review.rdoproject.org/r/#/c/18664/15..16 | 19:26 |
| * weshay looks | 19:26 | |
| weshay | I updated too | 19:26 |
| rlandy | failed: [localhost] (item=19885) => {"changed": false, "item": 19885, "msg": "openstacksdk is required for this module"} | 19:29 |
| rlandy | failed: [localhost] (item=22) => {"changed": false, "item": 22, "msg": "openstacksdk is required for this module"} | 19:29 |
| rlandy | ^^ still failing with | 19:29 |
| weshay | one comment | 19:30 |
| weshay | oh.. did that make in bindep? | 19:30 |
| weshay | https://review.rdoproject.org/r/#/c/18665/4/bindep_python2.txt | 19:30 |
| rlandy | weshay: see quique|rover|off comment - he told me to take that out | 19:30 |
| weshay | it's here though https://review.rdoproject.org/r/#/c/18665/4/requirements.txt | 19:30 |
| rlandy | another conflicting review | 19:30 |
| weshay | ? | 19:30 |
| rlandy | I know its' there | 19:30 |
| rlandy | Félix Enrique Llorente Pastora | 19:31 |
| rlandy | 2:36 AM | 19:31 |
| rlandy | Patch Set 14: | 19:31 |
| rlandy | (1 comment) | 19:31 |
| rlandy | playbooks/tripleo-ci-reproducer/pre.yaml | 19:31 |
| rlandy | Line 124: | 19:31 |
| rlandy | Not needed if it's started it's ok, previous one is the one needed for idempotency. | 19:31 |
| rlandy | weshay: ^^ | 19:31 |
| weshay | which line is | 19:31 |
| weshay | <rlandy> failed: [localhost] (item=22) => {"changed": false, "item": 22, "msg": "openstacksdk is required for this module"} | 19:31 |
| weshay | <rlandy> ^^ still failing with | 19:31 |
| *** jtomasek has quit IRC | 19:32 | |
| rlandy | weshay: I really don;t know - must be my python installs | 19:32 |
| weshay | hrm.. | 19:32 |
| weshay | can you tmate? | 19:32 |
| rlandy | uninstalling and running again | 19:32 |
| weshay | rlandy, module os_security_group_rule: | 19:36 |
| *** trown|lunch is now known as trown | 19:37 | |
| rlandy | weshay: need 10 minutes - quick lunch - feel free to work on tmate | 19:38 |
| weshay | rlandy, I think that's the error | 19:40 |
| rlandy | os_service_types? | 19:41 |
| weshay | rlandy, add --force | 19:42 |
| weshay | rlandy, :) | 19:45 |
| rlandy | weshay: sorry - back | 19:48 |
| rlandy | weshay: where did you add force? | 19:48 |
| rlandy | got to update review anyways for tox linters | 19:50 |
| weshay | rlandy, right next to --user | 19:50 |
| weshay | so.. extra-args: --user --force | 19:51 |
| rlandy | got it | 19:54 |
| rlandy | can I kill this to try out the syntax changes? | 19:55 |
| rlandy | ugh - that's waht tox required | 19:56 |
| *** sshnaidm is now known as sshnaidm|afk | 19:58 | |
| rlandy | 2019-02-05 19:28:15.841349 | rdo-centos-7 | [0;34mplaybooks/tripleo-ci-reproducer/pre.yaml[0m:[0;36m46[0m: [[1;31mE104[0m] [0;31mFound a bare variable 'cat '{{ playbook_dir }}/../requirements.txt'' used in a 'with_lines' loop. You should use the full variable syntax ('{{cat '{{ playbook_dir }}/../requirements.txt'}}')[0m | 20:01 |
| rlandy | 2019-02-05 19:28:15.841461 | rdo-centos-7 | Examining files/projects/test1/playbooks/run.yaml of type playbook | 20:01 |
| weshay | rlandy, what ever you want/need to do | 20:03 |
| weshay | fine by me | 20:03 |
| rlandy | weshay: of I don;t change that, the tox text fails | 20:04 |
| rlandy | if I do, the actual test fails | 20:04 |
| rlandy | ANSIBLE0015: Using bare variables is deprecated | 20:04 |
| rlandy | Using bare variables is deprecated. Update your playbooks so that the environment value uses the full variable syntax ("{{your_variable}}"). | 20:04 |
| weshay | rlandy, wait what? | 20:04 |
| * weshay looks | 20:04 | |
| weshay | if you do what tox fails? | 20:05 |
| rlandy | https://logs.rdoproject.org/64/18664/16/check/tox-linters/e610a28/job-output.txt.gz#_2019-02-05_19_28_15_841349 | 20:05 |
| rlandy | objects to with_lines: cat '{{ playbook_dir }}/../bindep_python2.txt' }} | 20:05 |
| weshay | rlandy, why are you not using the requirements option? | 20:06 |
| weshay | did you try that | 20:06 |
| weshay | rlandy, why cat a file? https://docs.ansible.com/ansible/latest/modules/pip_module.html | 20:07 |
| rlandy | which requirements option? | 20:07 |
| weshay | oh.. I see you have the same message on bindeps and pip | 20:07 |
| rlandy | `bindep -b -f bindep_$(python_cmd).txt` | 20:08 |
| rlandy | ^^ does not work | 20:08 |
| weshay | rlandy, you pointed me at | 20:08 |
| weshay | 0;34mplaybooks/tripleo-ci-reproducer/pre.yaml[0m:[0;36m46[0m: [[1;31mE104[0m] [0;31mFound a bare variable 'cat '{{ playbook_dir }}/../requirements.txt'' used in a 'with_lines' loop. You should use the full variable syntax ('{{cat '{{ playbook_dir }}/../requirements.txt'}}')[0m | 20:08 |
| weshay | k.. maybe we do use the bindep module | 20:08 |
| * weshay looks | 20:08 | |
| *** holser_ has quit IRC | 20:12 | |
| *** holser_ has joined #oooq | 20:13 | |
| weshay | rlandy, let's uninstall a package | 20:14 |
| weshay | see if it works :) | 20:14 |
| rlandy | sec | 20:14 |
| rlandy | ok - go4it | 20:14 |
| rlandy | uninstall something | 20:14 |
| weshay | brb 2 secs | 20:24 |
| weshay | rlandy, k.. back | 20:26 |
| weshay | communication over tmate is hard | 20:26 |
| weshay | rlandy, what's up? | 20:31 |
| rlandy | ok: [localhost] => (item=docker) => {"changed": false, "item": "docker", "msg": "Nothing to do", "rc": 0, "results": []} | 20:32 |
| weshay | cool | 20:32 |
| rlandy | weshay: sorry exited out | 20:32 |
| rlandy | will restart | 20:32 |
| weshay | np | 20:32 |
| weshay | np | 20:32 |
| rlandy | fatal: [localhost]: FAILED! => {"changed": false, "msg": "Could not find the requested service docker: host"} | 20:32 |
| rlandy | weird | 20:32 |
| weshay | hrm | 20:32 |
| rlandy | thinks docker is installed | 20:33 |
| weshay | via rpm? | 20:33 |
| rlandy | but dnf says not | 20:33 |
| weshay | rlandy, hrm.. and rpm? | 20:34 |
| weshay | rpm -q docker | 20:34 |
| weshay | ansible I think is just using the python-rpm package | 20:34 |
| rlandy | ok: [localhost] => (item=docker) => {"changed": false, "item": "docker", "msg": "Nothing to do", "rc": 0, "results": []} | 20:46 |
| rlandy | skipping: [localhost] => (item=gcc) => {"changed": false, "item": "gcc", "skip_reason": "Conditional result was False"} | 20:46 |
| rlandy | skipping: [localhost] => (item=git) => {"changed": false, "item": "git", "skip_reason": "Conditional result was False"} | 20:46 |
| rlandy | skipping: [localhost] => (item=python2-libselinux) => {"changed": false, "item": "python2-libselinux", "skip_reason": "Conditional result was False"} | 20:46 |
| rlandy | skipping: [localhost] => (item=python2-netaddr) => {"changed": false, "item": "python2-netaddr", "skip_reason": "Conditional result was False"} | 20:46 |
| rlandy | skipping: [localhost] => (item=python2-setuptools) => {"changed": false, "item": "python2-setuptools", "skip_reason": "Conditional result was False"} | 20:46 |
| rlandy | skipping: [localhost] => (item=python2-virtualenv) => {"changed": false, "item": "python2-virtualenv", "skip_reason": "Conditional result was False"} | 20:47 |
| rlandy | skipping: [localhost] => (item=python2-pip) => {"changed": false, "item": "python2-pip", "skip_reason": "Conditional result was False"} | 20:47 |
| rlandy | skipping: [localhost] => (item=rsync) => {"changed": false, "item": "rsync", "skip_reason": "Conditional result was False"} | 20:47 |
| weshay | ah nice | 20:48 |
| weshay | what was the trick? | 20:48 |
| rlandy | not nice | 20:48 |
| weshay | oh | 20:48 |
| weshay | those are not installed? | 20:48 |
| rlandy | ok: [localhost] => (item=docker) => {"changed": false, "item": "docker", "msg": "Nothing to do", "rc": 0, "results": []} | 20:48 |
| rlandy | it picks up the right item | 20:48 |
| rlandy | but Nothing to do | 20:48 |
| weshay | can we blue? | 20:48 |
| rlandy | ^^ it should do something | 20:48 |
| weshay | understood now | 20:49 |
| rlandy | yeah - joining your blue | 20:49 |
| weshay | rlandy, let's fire up tmate too again | 20:50 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 20:51 |
| *** zbr has joined #oooq | 20:56 | |
| *** zbr|ssbarnea has quit IRC | 20:58 | |
| *** dtrainor_ has quit IRC | 21:01 | |
| *** trown is now known as trown|outtypewww | 21:14 | |
| rlandy | for i in `bindep -b -f bindep_$(python_cmd).txt`; do | 21:37 |
| rlandy | sudo $(package_manager) -y install $i; | 21:37 |
| rlandy | done | 21:37 |
| *** hamzy has quit IRC | 21:46 | |
| rlandy | https://review.rdoproject.org/r/#/c/18664/12..17/tasks/install-packages.yaml | 21:54 |
| rlandy | weshay: ^^ | 21:54 |
| rlandy | weshay: do you hear me? | 22:07 |
| rlandy | weshay: woohoo green linters ... https://logs.rdoproject.org/64/18664/19/check/tox-linters/465f4e7/job-output.txt.gz | 22:26 |
| rlandy | ci on https://review.openstack.org/#/c/631067/ running again | 22:27 |
| *** rlandy is now known as rlandy|afk | 22:27 | |
| *** zbr|ssbarnea has joined #oooq | 22:32 | |
| *** zbr has quit IRC | 22:33 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 22:51 |
| *** zbr has joined #oooq | 22:55 | |
| *** holser_ has quit IRC | 22:55 | |
| *** zbr|ssbarnea has quit IRC | 22:56 | |
| *** vinaykns has quit IRC | 23:10 | |
| *** rascasoft has quit IRC | 23:12 | |
| *** agopi is now known as agopi|off | 23:13 | |
| *** agopi|off has quit IRC | 23:17 | |
| *** rlandy|afk is now known as rlandy | 23:51 | |
| *** agopi|off has joined #oooq | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!