| *** agopi has joined #oooq | 00:07 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci- (1 more message) | 00:35 |
|---|---|---|
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to- (1 more message) | 02:35 |
| *** brault has quit IRC | 02:54 | |
| *** brault has joined #oooq | 02:55 | |
| *** udesale has joined #oooq | 03:55 | |
| *** jaganathan has joined #oooq | 03:59 | |
| *** jaganathan has quit IRC | 04:04 | |
| *** jaganathan has joined #oooq | 04:05 | |
| *** ykarel has joined #oooq | 04:09 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 04:35 |
| ykarel | chkumar|ruck, hooks like tempest container failing post https://review.openstack.org/#/c/583940/, can you check | 04:55 |
| *** pgadiya has joined #oooq | 05:02 | |
| *** skramaja has joined #oooq | 05:06 | |
| *** brault_ has joined #oooq | 05:07 | |
| *** brault has quit IRC | 05:09 | |
| *** brault has joined #oooq | 05:11 | |
| *** skramaja_ has joined #oooq | 05:11 | |
| *** skramaja has quit IRC | 05:11 | |
| *** brault_ has quit IRC | 05:13 | |
| *** ratailor has joined #oooq | 05:21 | |
| *** brault has quit IRC | 05:30 | |
| *** links has joined #oooq | 05:38 | |
| *** udesale_ has joined #oooq | 05:42 | |
| *** udesale has quit IRC | 05:45 | |
| *** quiquell|off is now known as quiquell | 05:48 | |
| *** pgadiya has quit IRC | 06:00 | |
| *** sanjayu has joined #oooq | 06:01 | |
| *** gvrangan has joined #oooq | 06:03 | |
| *** jfrancoa has joined #oooq | 06:03 | |
| *** jtomasek has joined #oooq | 06:12 | |
| *** jtomasek has quit IRC | 06:13 | |
| *** brault has joined #oooq | 06:14 | |
| *** bogdando has joined #oooq | 06:17 | |
| bogdando | folks, where do we have ansible vars dumps in CI jobs? | 06:23 |
| bogdando | need to check values for undercloud_templates_* in https://review.openstack.org/#/c/583515/ | 06:23 |
| *** jtomasek has joined #oooq | 06:30 | |
| ykarel | bogdando, have u checked undercloud/var/log/extra/dump* ? | 06:35 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 06:35 |
| bogdando | ykarel: thanks, found it | 06:38 |
| *** ccamacho has joined #oooq | 06:39 | |
| *** links has quit IRC | 06:41 | |
| *** udesale__ has joined #oooq | 06:43 | |
| *** udesale_ has quit IRC | 06:45 | |
| *** dtantsur|afk is now known as dtantsur | 06:45 | |
| quiquell | sshnaidm|afk, chkumar|ruck: Found the issue with duplicated entries at rrockpit | 06:55 |
| *** jaosorior has joined #oooq | 06:55 | |
| quiquell | sshnaidm|afk, chkumar|ruck: I have to do a cleanup | 06:56 |
| *** links has joined #oooq | 07:00 | |
| *** florianf has joined #oooq | 07:00 | |
| *** zoli is now known as zli|wfh | 07:00 | |
| *** holser_ has joined #oooq | 07:00 | |
| *** zli|wfh is now known as zoli|wfh | 07:00 | |
| bogdando | ykarel: is it only me, or the jobs time in https://review.openstack.org/#/c/584380/3 look shorter than normally? prolly tempest execution times cut down? | 07:08 |
| bogdando | would be interesting to know from logstash data :) | 07:08 |
| *** zoli|wfh is now known as zoli | 07:11 | |
| *** amoralej|off is now known as amoralej | 07:13 | |
| *** skramaja has joined #oooq | 07:16 | |
| quiquell | marios: Good morning | 07:17 |
| *** skramaja_ has quit IRC | 07:20 | |
| quiquell | marios: Let's sync on QE https://review.openstack.org/#/c/583179/ | 07:20 |
| quiquell | marios: And try to merge it today or tomorrow | 07:21 |
| *** tesseract has joined #oooq | 07:21 | |
| *** quiquell is now known as quiquell|bbl | 07:22 | |
| ykarel | bogdando, yes it's good to know, but i haven't looked at it | 07:26 |
| *** links has quit IRC | 07:34 | |
| *** tosky has joined #oooq | 07:36 | |
| *** ykarel is now known as ykarel|lunch | 07:38 | |
| *** links has joined #oooq | 07:47 | |
| marios | quiquell|bbl: o/ | 07:50 |
| marios | quiquell|bbl: ack | 07:50 |
| quiquell|bbl | marios: Do you know what we mean by a test review ? | 07:52 |
| quiquell|bbl | marios: Like this https://review.openstack.org/#/c/583179/ | 07:52 |
| marios | quiquell|bbl: sure like against tht with depends-on | 07:52 |
| marios | quiquell|bbl: i used your test review to qe the card | 07:52 |
| quiquell|bbl | marios: nice | 07:52 |
| *** quiquell|bbl is now known as quiquell | 07:52 | |
| quiquell | marios: Added test revies to the card | 07:53 |
| marios | quiquell|bbl: i mean https://trello.com/c/BKG23i1O/870-replace-bash-environment-variables-in-tociquickstartsh-with-ansible-variables-from-zuul-inventory#comment-5b51f31124ad855a794d03cb | 07:53 |
| quiquell | marios: Is there a way to rebase the change without losing +1 ¿ | 07:53 |
| marios | quiquell: not that i know of but that isn't a problem | 07:54 |
| marios | just ask folks | 07:54 |
| marios | :) | 07:54 |
| marios | quiquell: s/ask/harrass ;) | 07:54 |
| quiquell | marios: Going to rebase it and recheck the test review of the common.yaml change | 07:54 |
| marios | quiquell: ack | 07:55 |
| *** kopecmartin has joined #oooq | 08:06 | |
| *** dtantsur is now known as dtantsur|brb | 08:18 | |
| *** chem has joined #oooq | 08:18 | |
| *** holser_ has quit IRC | 08:22 | |
| *** ykarel|lunch is now known as ykarel | 08:28 | |
| *** holser_ has joined #oooq | 08:29 | |
| *** holser_ has joined #oooq | 08:31 | |
| *** holser_ has quit IRC | 08:31 | |
| *** gvrangan has quit IRC | 08:33 | |
| *** gvrangan has joined #oooq | 08:33 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:35 |
| *** jaosorior has quit IRC | 08:50 | |
| *** sanjayu has quit IRC | 09:15 | |
| *** saneax has joined #oooq | 09:19 | |
| *** links has quit IRC | 09:34 | |
| *** dtantsur|brb is now known as dtantsur | 09:38 | |
| *** links has joined #oooq | 09:41 | |
| *** panda|off is now known as panda | 09:48 | |
| *** saneax has quit IRC | 09:49 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 09:56 | |
| sshnaidm|rover | chkumar|ruck, hi | 09:56 |
| chkumar|ruck | sshnaidm|rover: Hello | 09:58 |
| chkumar|ruck | sshnaidm|rover: my own patch broke the promotion chain pipeline https://bugs.launchpad.net/tripleo/+bug/1783055 | 09:59 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 09:59 |
| sshnaidm|rover | chkumar|ruck, wanna switch to rover this week? | 09:59 |
| chkumar|ruck | sshnaidm|rover: https://review.openstack.org/#/c/584771/ | 09:59 |
| chkumar|ruck | sshnaidm|rover: you mean for two days ? | 09:59 |
| chkumar|ruck | sshnaidm|rover: yes, sure | 10:00 |
| *** sshnaidm|rover is now known as sshnaidm|ruck | 10:00 | |
| *** chkumar|ruck is now known as chkumar|rover | 10:01 | |
| sshnaidm|ruck | chkumar|rover, anything except tempest issue? | 10:01 |
| chkumar|rover | sshnaidm|ruck: currently no | 10:01 |
| chkumar|rover | sshnaidm|ruck: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/1cce35b/logs/tempest.html.gz one test fail but in next run it passed | 10:03 |
| chkumar|rover | so no worry here in periodic | 10:03 |
| chkumar|rover | sshnaidm|ruck: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch job has given too much node_failure today 5-6 hours back | 10:04 |
| sshnaidm|ruck | chkumar|rover, yeah, so it's still the problem.. | 10:04 |
| chkumar|rover | sshnaidm|ruck: i asked kforde , he is looking into that | 10:05 |
| chkumar|rover | sshnaidm|ruck: is it possible to gate kolla with tripleo UC CI? | 10:07 |
| sshnaidm|ruck | chkumar|rover, not sure about gate, but possible to suggest jobs | 10:08 |
| sshnaidm|ruck | chkumar|rover, it they run stable some time, then we can ask to make them gating | 10:08 |
| chkumar|rover | sshnaidm|ruck: I will speak with mandre about that | 10:11 |
| sshnaidm|ruck | chkumar|rover, ok, I think he'll be fine with that | 10:11 |
| chkumar|rover | sshnaidm|ruck: https://trello.com/c/dFDuV3pX/668-cixlp1783055tripleociproa-mastermultinode-periodic-promotion-jobs-are-failing-where-tempest-is-runned-from-container so this card is automatically crreated | 10:13 |
| chkumar|rover | so i am moving it to prod chain outage | 10:13 |
| quiquell | sshnaidm|ruck: Good morning | 10:14 |
| sshnaidm|ruck | quiquell, morning | 10:14 |
| sshnaidm|ruck | chkumar|rover, ack | 10:15 |
| quiquell | sshnaidm|ruck: Has fix all the pending issues with rrcockpit also aded a pep8 job | 10:23 |
| sshnaidm|ruck | quiquell, great! | 10:24 |
| quiquell | sshnaidm|ruck: I have some ideas for new jobs to test it at zuul | 10:24 |
| quiquell | sshnaidm|ruck: But we can try to merge this, deploy at infra and continue | 10:24 |
| sshnaidm|ruck | quiquell, ok, will test it later on my tennt | 10:24 |
| quiquell | sshnaidm|ruck: Ok, thanks, let me know of everything you see | 10:25 |
| quiquell | sshnaidm|ruck: Not going to add any more changes except for possible fixes | 10:25 |
| *** saneax has joined #oooq | 10:27 | |
| quiquell | sshnaidm|ruck: btw do you need help with the ara-report thing ? | 10:28 |
| *** jaosorior has joined #oooq | 10:28 | |
| ssbarnea | marios: what should reproducer do if one of ZUUL_CHANGES reviews was already merged. | 10:30 |
| sshnaidm|ruck | quiquell, thanks, need to fix mistral part for now.. and need to talk with slagle about parameter type, he's not fine with having it as path | 10:31 |
| ssbarnea | at this moment I get a failure to cherry picky | 10:31 |
| quiquell | sshnaidm|ruck: Let me know if you need another code monkey | 10:31 |
| sshnaidm|ruck | quiquell, sure | 10:31 |
| *** skramaja has quit IRC | 10:33 | |
| ssbarnea | i also found that the reproducer does not use bash strict mode, in fact not even "set -e", which is not quite the best practice as it would hide errors. Any special reasons for not using -e mode on it? | 10:35 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:35 |
| *** quiquell is now known as quiquell|bbl | 10:39 | |
| marios | ssbarnea: o/ ack right, hadn't thought of that ... in my comment i was thinking about the cherrypick being in the right order when i said messy but indeed if something merged you may get conflicts | 10:39 |
| marios | ssbarnea: so then add a comment and keep using review sounds like. its just that with git review, the first two invocations will be redundant, you will just get all of them with the inner most/child review | 10:39 |
| marios | ssbarnea: i.e. i think it brings in the parents too/branch | 10:40 |
| ssbarnea | not sure, we will see. for the moment I want to fix the total lack of cherry picking. | 10:41 |
| ssbarnea | if we discover that it fails in 1/50 cases is it still be 49x better than now | 10:41 |
| ssbarnea | i found other more problematic issues in reproducer, like the fact it does not fail on errors by default. | 10:42 |
| *** links has quit IRC | 10:44 | |
| ssbarnea | marios: should I take this line our of this review? https://review.openstack.org/#/c/582963/4/roles/create-reproducer-script/templates/reproducer-quickstart.sh.j2 or keep it? | 10:45 |
| ssbarnea | they are not really related. | 10:46 |
| *** links has joined #oooq | 10:48 | |
| chkumar|rover | sshnaidm|ruck: how to fix this type of issue ssh_exchange_identification: Connection closed by remote host ? | 10:51 |
| sshnaidm|ruck | chkumar|rover, where? | 10:51 |
| chkumar|rover | sshnaidm|ruck: so i was creating a setup using TQ, it deployed the undercloud, then i have to run some script on the undercloud then i entered in to the UC, runned from there | 10:51 |
| chkumar|rover | after it lost the ssh connection, when I tried to do ssh into undercloud mahcine, each time it is giving this error | 10:52 |
| chkumar|rover | it is one of my box in france | 10:52 |
| chkumar|rover | and the bad thing is that all the virt instance went into paused state | 10:53 |
| *** zoli is now known as zoli|lunch | 10:53 | |
| *** lucasagomes is now known as lucas-hungry | 11:03 | |
| *** lucas-hungry is now known as lucasagomes | 11:03 | |
| quiquell|bbl | marios, panda: common.yaml is good to merge https://review.openstack.org/#/c/583179/ | 11:03 |
| *** quiquell|bbl is now known as quiquell | 11:03 | |
| quiquell | reproducer works fine too | 11:03 |
| *** links has quit IRC | 11:13 | |
| *** links has joined #oooq | 11:15 | |
| chkumar|rover | sshnaidm|ruck: quiquell does it looks ok https://review.rdoproject.org/r/#/q/topic:fs21-master ? | 11:17 |
| chkumar|rover | I will add for queens and pike also | 11:17 |
| sshnaidm|ruck | chkumar|rover, yep | 11:19 |
| *** ratailor has quit IRC | 11:20 | |
| quiquell | chkumar|rover: yep | 11:20 |
| quiquell | ssbarnea: Looking at your change to honor zuul_changes at reproducer | 11:25 |
| *** udesale__ has quit IRC | 11:25 | |
| sshnaidm|ruck | quiquell, commented on review, I'm afraid we can't replace $EXTRA_VARS currently | 11:25 |
| *** holser_ has joined #oooq | 11:25 | |
| sshnaidm|ruck | quiquell, this is calculated depending on various scenarios, it's not a constant | 11:25 |
| quiquell | ssbarnea: Have an idea, maybe we can just change the template at make those repos point to the refspec they are pointing at zuul | 11:26 |
| quiquell | ssbarnea: What do you think ? | 11:26 |
| ssbarnea | thanks, i had to update it as wes asked to avoid using git-review, but current form worked on my test. | 11:26 |
| ssbarnea | quiquell: not really because we have a list of changes, is possible to have more than one review per repository. | 11:27 |
| quiquell | sshnaidm|ruck: quickstart reproducer is th eonly one adding stuff | 11:27 |
| sshnaidm|ruck | quiquell, also when you run reproducer, there are additional $EXTRA_VARS that are added with dlrn hashes, need to check that it really takes these hashes for example | 11:27 |
| ssbarnea | so the only way to do it would be to do sequential cherry picking, which is not bad. | 11:27 |
| quiquell | ssbarnea: Reviews from the same repo, have to be parented, I think | 11:28 |
| quiquell | ssbarnea: but maybe I am wrong | 11:28 |
| quiquell | sshnaidm|ruck: Reproducer will pass the correct extra_vars, when we change it | 11:29 |
| ssbarnea | regarding parents, i am afraid nobody can be sure there because you can have conflicts. The only thing that we can work is to cherry pick these changes on tip of master, withoyut parents. | 11:31 |
| ssbarnea | it may sound bad but think twice: now we don't cherry pick anything, we run with master,.... | 11:32 |
| chkumar|rover | quiquell: sshnaidm|ruck another batch https://review.rdoproject.org/r/#/q/topic:fs21-queens | 11:32 |
| quiquell | ssbarnea: Let me ask at #zuul, I think that it's mandatory that changes are parented | 11:32 |
| quiquell | ssbarnea: I mean, if they are not parented how is zuul going to see them ? | 11:33 |
| *** brault has quit IRC | 11:33 | |
| quiquell | ssbarnea: Either you have a Depends-On other project or a parent | 11:33 |
| quiquell | ssbarnea: No other way zuul can figure out what to test | 11:33 |
| quiquell | ssbarnea: So, just taking the refspec is good | 11:33 |
| *** brault has joined #oooq | 11:34 | |
| ssbarnea | i think at the point where the script is created, zuul already decided how to compose the changes (ZULL_CHANGES) and thus is why i was able to cherry pick them without any problems (so far). But is a good idea to ask them. | 11:35 |
| quiquell | ssbarnea: The input for zuul job is just one refspec | 11:37 |
| quiquell | ssbarnea: To calculate dependencies either they are parent not yet merged or have Depends-On | 11:37 |
| *** amoralej is now known as amoralej|lunch | 11:37 | |
| quiquell | ssbarnea: So the only stuff needed if checkout the tip of the required-projects at zuul jobs | 11:38 |
| quiquell | ssbarnea: But let's wait for zuul guys | 11:38 |
| quiquell | sshnaidm|ruck: Commented on EXTRA_VARS | 11:38 |
| quiquell | ssbarnea: confirmed | 11:38 |
| quiquell | ssbarnea: Going to comment on the review | 11:39 |
| ssbarnea | i seen the comment but I am not sure i understand the answer. | 11:40 |
| quiquell | sshnaidm|ruck: Added the places where we use EXTRA_VARS to t he review https://review.openstack.org/#/c/582885/ | 11:50 |
| quiquell | ssbarnea: reproducer-quickstart.sh is generated after the job has finish | 11:52 |
| quiquell | ssbarnea: At this point the required repos have beign already correctly set by zuul | 11:52 |
| quiquell | ssbarnea: We can get the refspec of them before the calculation of jinja template for reproducer-quickstart.sh.j2 | 11:53 |
| quiquell | ssbarnea: And then just do checkout of them in the template | 11:53 |
| quiquell | ssbarnea: That's it, so we donÂ't have to parse zuul_changes | 11:53 |
| ssbarnea | i know, still the moment when you run the reproducer is different, meaning that the master tip can be different, and that some of the CRs from the list may already have being merged. | 11:53 |
| quiquell | ssbarnea: I mean just point to the sample place that the zuul job is pointing after finish | 11:53 |
| quiquell | ssbarnea: They are not merged, they are already parented | 11:54 |
| quiquell | ssbarnea: You have to manually parent them at gerrit if you want them to be tested | 11:54 |
| ssbarnea | what I am trying to say is that a user my run reproducer two weeks after the job run... and at this point I am sure repository status would be different. | 11:55 |
| quiquell | ssbarnea: Also afther that, parenting of a respec cannot change, that would be different refspec | 11:57 |
| quiquell | s/afther/after/ | 11:57 |
| *** quiquell is now known as quiquell|lunch | 11:59 | |
| quiquell|lunch | ssbarnea: We can do a bj after lunch, I am very new too sure I am missing something | 12:00 |
| ssbarnea | quiquell: can you please show me what needs to be done in the template to clone the repositories? | 12:00 |
| ssbarnea | sure, i will go to eat too | 12:00 |
| quiquell|lunch | ssbarnea: Let's meet with a full stomach | 12:00 |
| ssbarnea | always a good idea | 12:00 |
| chkumar|rover | ssbarnea: quiquell|lunch all patches up https://review.rdoproject.org/r/#/q/topic:fs21 | 12:00 |
| sshnaidm|ruck | chkumar|rover, I think you can combine all patches.. | 12:04 |
| quiquell|lunch | ssbarnea, sshnaidm|ruck: The two 's' is starting to be an issue :-Ã-P | 12:05 |
| *** zoli|lunch is now known as zoli | 12:11 | |
| *** zoli is now known as zoli|wfh | 12:12 | |
| *** zoli|wfh is now known as zoli | 12:12 | |
| *** agopi has quit IRC | 12:14 | |
| *** bogdando has quit IRC | 12:23 | |
| sshnaidm|ruck | quiquell|lunch, I told to ssbarnea *sigh | 12:23 |
| sshnaidm|ruck | quiquell|lunch, +w on patch, thanks for explanations | 12:24 |
| quiquell|lunch | sshnaidm|ruck: Thanks to you man | 12:24 |
| *** quiquell|lunch is now known as quiquell | 12:24 | |
| *** trown|outtypewww is now known as trown | 12:24 | |
| *** atoth has joined #oooq | 12:24 | |
| quiquell | sshnaidm|ruck: what version of ansible we are suppose to use with reproducer ? | 12:28 |
| chkumar|rover | sshnaidm|ruck: doing that, | 12:29 |
| chkumar|rover | time to abandon most of the patches | 12:29 |
| *** saneax has quit IRC | 12:29 | |
| *** bogdando has joined #oooq | 12:30 | |
| sshnaidm|ruck | quiquell, we can't limit user to use it, but if using virtualenv option with reproducer - that from quickstart requirements (2.5.5. now) | 12:30 |
| *** saneax has joined #oooq | 12:30 | |
| marios | ack quiquell looks like it is merging now sorry i was looking at something else but already verified via logs as per my last comment at v 25 | 12:34 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.open | 12:35 |
| quiquell | ssbarnea: Thinking about it at lunch, the only beneficts from what I say it's just few noop cherry-picks | 12:36 |
| quiquell | ssbarnea: It's better to leave ZUUL_CHANGES as they are so we can copy paste in case of changes | 12:36 |
| quiquell | marios: ack, will add it to the card | 12:37 |
| marios | quiquell: i already did | 12:38 |
| marios | quiquell: sec | 12:38 |
| ssbarnea | yep, so far worst case was some noop picks, but in rest it did the picking well | 12:38 |
| marios | quiquell: https://trello.com/c/BKG23i1O/870-replace-bash-environment-variables-in-tociquickstartsh-with-ansible-variables-from-zuul-inventory#comment-5b51f31124ad855a794d03cb | 12:38 |
| *** holser_ has quit IRC | 12:38 | |
| marios | (friday) | 12:38 |
| quiquell | ok | 12:39 |
| *** rlandy has joined #oooq | 12:39 | |
| rlandy | rook: hello | 12:40 |
| rlandy | rook: https://logs.rdoproject.org/17/583717/7/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/e63ebf8/job-output.txt.gz#_2018-07-22_21_36_12_471521 | 12:40 |
| rlandy | I've got the browbeat test triggering | 12:41 |
| *** holser_ has joined #oooq | 12:41 | |
| rlandy | but it fails at a bunch of steps that are hardcoded for an expected user/env | 12:41 |
| rlandy | https://review.openstack.org/#/c/583717 | 12:41 |
| rlandy | I've made some changed but I've been digging through where the files get placed and it's not simple | 12:42 |
| rlandy | I think - at this point, either you guy scan use the reproducer to address these errors or I'd need someone to work with me here | 12:43 |
| rlandy | since the work is all in the browbeat repo now | 12:43 |
| *** agopi has joined #oooq | 12:44 | |
| *** holser_ has quit IRC | 12:47 | |
| rook | rlandy: one sec | 12:48 |
| rook | rlandy what is the user running the script | 12:49 |
| rook | something other than stack? | 12:49 |
| rlandy | rook: in this case, zuul | 12:50 |
| rlandy | and I have been hacking with that name | 12:50 |
| rook | ok, so that is the issue - whatever is cloning browbeat is using /home/stack it should be using /home/zuul | 12:50 |
| rlandy | but really it should use ansible_user | 12:50 |
| rook | then in the browbeat install/group_vars/all we just need to update the browbeat path | 12:51 |
| rlandy | and other matter | 12:51 |
| *** holser_ has joined #oooq | 12:51 | |
| rlandy | like lockin the version of virtualenv | 12:51 |
| rlandy | we can switch case everything but I think it's better to generalize it | 12:51 |
| rlandy | ie: I think the fixes I have put in place should not stay as they are | 12:52 |
| rook | so you recommend we switch how we install browbeat, to use ansible_user. https://github.com/openstack/browbeat/blob/master/ansible/install/group_vars/all.yml#L7-L22 | 12:52 |
| rlandy | https://review.openstack.org/#/c/583717/7/ansible/gather/group_vars/all.yml | 12:52 |
| *** holser_ has quit IRC | 12:52 | |
| rlandy | rook: I tried that in the current patch | 12:53 |
| *** arxcruz is now known as arxcruz|off | 12:53 | |
| rlandy | rook: the bigger issue is that I can't make sense of https://github.com/openstack/browbeat/blob/master/setup.cfg#L32 | 12:53 |
| agopi | morning rlandy, rook | 12:53 |
| rlandy | rook: I have a reproducer env I am working from | 12:54 |
| rlandy | but I can't decipher what files go where | 12:54 |
| rlandy | I am trying to debug and run locally | 12:54 |
| rlandy | so we don;t have to wait for the CI | 12:54 |
| rlandy | I am running just that playbook | 12:54 |
| *** jbadiapa_ is now known as jbadiapa | 12:55 | |
| *** holser_ has joined #oooq | 12:55 | |
| sshnaidm|ruck | arxcruz|off, chkumar|rover can you please check what is about https://trello.com/c/Q5aFkQF7/653-cixlp1773325tripleociproa-tempestapiobjectstoragetestobjectservices-is-failing-on-scenario002 | 12:55 |
| chkumar|rover | sshnaidm|ruck: will do that | 12:56 |
| *** udesale has joined #oooq | 12:56 | |
| *** holser_ has quit IRC | 12:56 | |
| rlandy | rook: agopi: https://review.openstack.org/#/c/583717/7/ansible/gather/group_vars/all.yml didnt help but I can't tell what does then | 12:57 |
| rlandy | rook: agopi: currently my reproducer hangs on: TASK [browbeat/browbeat : Generate hosts and ssh-config on Browbeat Machine] | 12:58 |
| rook | what does verbose output show? | 12:58 |
| rook | where is it hanging | 12:58 |
| rook | because that will drop ssh_configs in ~/browbeat/ansible | 12:59 |
| rook | which, with oooq do we really need to run that? | 12:59 |
| * rlandy will rerun with verbose | 12:59 | |
| sshnaidm|ruck | quiquell, wrong meeting :) | 13:00 |
| quiquell | sshnaidm|ruck: That's me in general :-) | 13:00 |
| agopi | umm rlandy, we are still running browbeat from undercloud, so browbeat_user should still be stack | 13:00 |
| rlandy | rook: agopi: have to go to scrum- will be back | 13:00 |
| agopi | we will have to change local_remote_user afaik | 13:00 |
| rlandy | agopi: negative | 13:01 |
| agopi | okay rlandy. | 13:02 |
| *** gvrangan has quit IRC | 13:14 | |
| *** dtrainor has quit IRC | 13:18 | |
| *** vinaykns has joined #oooq | 13:20 | |
| *** ccamacho has quit IRC | 13:20 | |
| *** dtrainor has joined #oooq | 13:21 | |
| ssbarnea | panda: marios if you can revote on https://review.openstack.org/#/c/582963/ it would be great, i had to implement a change asked by wes | 13:32 |
| panda | marios: your change should work also on the other workflow, I don't see any test for this change in the static bash toci_gate_test.sh | 13:33 |
| marios | ssbarnea: will check it out on next reviews run | 13:43 |
| marios | panda: ack i will check comments | 13:44 |
| marios | panda: do you mean, add some bash in toci_gate_test.sh to create dev/loop3 ? | 13:44 |
| marios | panda: and remove the tripleo.sh --bootstrap-subnodes | 13:44 |
| panda | marios: I mean create the pre.yaml playbook and add it to the old job configuration parents | 13:48 |
| panda | marios: then remove tripleo.sh --bootstrap-subnodes | 13:49 |
| marios | panda: ack i see so we can use in both ok will do | 13:49 |
| marios | panda: yeah i saw your comment on the review | 13:49 |
| marios | panda: about moving the tasks | 13:49 |
| *** myoung has joined #oooq | 13:49 | |
| panda | marios: also, it's in the definition of done, this should work with all workflow | 13:49 |
| panda | maybe it wasn't clear | 13:49 |
| myoung | panda: sshnaidm|ruck: don't have responses for triage (in an hour) - we still on? | 13:50 |
| marios | panda: ack my bad and no problem since this doesn't mean any extra/more work anyway | 13:50 |
| sshnaidm|ruck | myoung, up to you | 13:50 |
| marios | panda: thanks for review | 13:50 |
| panda | marios: it may mean some more testing to do | 13:50 |
| marios | panda: have another call starting in few minutes so may not update till the morning depdening | 13:50 |
| *** amoralej|lunch is now known as amoralej | 13:50 | |
| marios | panda: and lets see what other comments there are too | 13:50 |
| *** ykarel is now known as ykarel|away | 13:51 | |
| panda | marios: any call that can be taken from ruck/rover ? | 13:51 |
| marios | panda: no it is for the bootcamp prep | 13:51 |
| *** ykarel|away has quit IRC | 13:51 | |
| panda | marios: ok | 13:51 |
| rlandy | rook: agopi: to get back to you ... the hang is happening in https://paste.fedoraproject.org/paste/UYLqWenkdA32HYmJPF4AUw | 13:59 |
| rlandy | I think we need to understand which team is responsible for what work | 13:59 |
| *** dougbtv has joined #oooq | 13:59 | |
| rlandy | rook; agopi: is it in CI's bucket or perf term's bucket to get the test running in CI? | 14:00 |
| rlandy | for example: | 14:00 |
| rlandy | I took a shot with https://review.openstack.org/#/c/583717/7/ansible/gather/group_vars/all.yml | 14:00 |
| rlandy | but that didn;t work | 14:00 |
| rlandy | why? | 14:00 |
| rlandy | where is that really set? | 14:00 |
| rlandy | setting zuul user is not ideal etc. | 14:00 |
| *** quiquell is now known as quiquell|off | 14:02 | |
| rook | so, the zuul user - is this running from the UC? | 14:02 |
| myoung | rlandy, rook, agopi: would it make sense to schedule a brief meeting/call in the next 1-2 days to (briefly) discuss remaining work and set expectations all round w.r.t. who's doing what, and in what timeframe? As we're nearing the end of Sprint 16 (Weds), and Planning Sprint 17 (Thurs) I would prefer to have some clarity. | 14:02 |
| myoung | panda: ^^ | 14:03 |
| rlandy | rook; yes | 14:03 |
| rlandy | you can follow the job logs | 14:03 |
| panda | myoung: I'd also like to understand if we need to crate cards for the general topics | 14:04 |
| rlandy | rook; your playbook run starts here: https://logs.rdoproject.org/17/583717/7/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/e63ebf8/job-output.txt.gz#_2018-07-22_21_35_47_282428 | 14:05 |
| rlandy | rook: if I made the wrong change, what is the right change? | 14:05 |
| panda | rfolco: in https://review.openstack.org/#/c/582384 where are we not defining featuresets ? | 14:07 |
| rfolco | panda, looking | 14:07 |
| myoung | panda: I think generally we should track work with cards, browbeat integration is no exception. | 14:07 |
| agopi | rook, rlandy i still think browbeat_user needs to be stack as we are running from UC. | 14:07 |
| agopi | local_remote_user can be zuul and i think that'll work | 14:08 |
| agopi | ack myoung, i'll create a meeting then. | 14:08 |
| rlandy | agopi: when you run in CI, there is no stack user | 14:09 |
| rlandy | upstream | 14:09 |
| myoung | rook, panda, rlandy, agopi: following feedback from scrum (just a few mins ago) - I want to ensure that we're not engaged in open ended work with ambiguity around expectations w.r.t. timeframe, scope, etc. I (personaly) think what we're doing makes sense and I'm thrilled that we're bringing browbeat into upstream. | 14:09 |
| *** ccamacho has joined #oooq | 14:09 | |
| myoung | rook, agopi: context --> https://trello.com/c/yxnO7GGf/871-create-a-job-to-test-browbeat#comment-5b55d7a65c6c45aa6951a046 | 14:10 |
| rfolco | panda, these variables have been defined in previous patch... https://review.openstack.org/#/c/582465 | 14:10 |
| rlandy | myoung: I am not sure there is enough knowledge transfer yet | 14:10 |
| panda | rfolco:I'll rephrase: I see you put if "feaatureset is not defined". ins which job we don't define featureset ? | 14:11 |
| rook | rlandy what is the user running the script | 14:12 |
| rook | sorry | 14:12 |
| rook | hit up... ignore above. | 14:12 |
| rlandy | zuul | 14:12 |
| rook | yeah | 14:12 |
| rook | that is why that line is faling | 14:12 |
| rlandy | https://logs.rdoproject.org/17/583717/7/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/e63ebf8/logs/undercloud/var/log/extra/dump_variables_hostvars.json.txt.gz | 14:12 |
| rook | stack doesn't exist, and we need to update the browbeat_user to zuul | 14:12 |
| myoung | rlandy: ack, I think what we discussed in scrum (merge support needed from our repos == DoD for sprint 16, continue to work/collab with rook+agpopi in s17 timeframe | 14:12 |
| myoung | panda: ^^ does that scan? | 14:12 |
| rfolco | panda, I am not changing functionality, this is how it worked with bash | 14:13 |
| radez | rlandy: if I try and deploy my quickstart with --release master-tripleo-ci would that "work" | 14:13 |
| rlandy | rook: ok - where https://review.openstack.org/#/c/583717/7/ansible/gather/group_vars/all.yml if this is not the right place? | 14:13 |
| radez | it's trying to pull the images from 66.187.229.139 and can't reach the host | 14:13 |
| rook | well that is gather rlandy | 14:14 |
| rook | that set of playbooks needs to be udpated too but | 14:14 |
| rlandy | rook: pls update the review then | 14:14 |
| rook | you don;t need to run that since we are not indexing the values. | 14:14 |
| panda | rfolco: we never checked for existence of featureset part in toci_gate_test, we assumed it was there. | 14:14 |
| panda | rfolco: wanna chat ? | 14:14 |
| rfolco | panda, sure | 14:14 |
| agopi | brb rlandy in a meeting | 14:14 |
| rfolco | your room? | 14:14 |
| panda | myoung: ack from me. not sure how to address out of sprint topics tough | 14:15 |
| rlandy | radez: pls rebase your repo: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L22 | 14:15 |
| panda | rfolco: yep | 14:15 |
| radez | rlandy: oh, heh, that would make sense, thx | 14:16 |
| myoung | panda: ack, we can talk in retro or whenver. I'm fine with us doing out of sprint work if it's the right thing to do, just want to be clear and intentional about it. | 14:16 |
| panda | quiquell|off: I'm watching you | 14:17 |
| rlandy | rook: also, while you are updating that commit, can you see what is happening with this hang? https://paste.fedoraproject.org/paste/UYLqWenkdA32HYmJPF4AUw | 14:18 |
| rlandy | rook: it's not clear to me where these changes need to be made | 14:19 |
| *** yolanda__ has joined #oooq | 14:19 | |
| rook | this output makes no sense to me. | 14:19 |
| *** yolanda_ has quit IRC | 14:21 | |
| rlandy | me neither | 14:22 |
| *** links has quit IRC | 14:22 | |
| rlandy | the failure is somewhere in browbeat/ansible/generate_tripleo_hostfile.sh | 14:23 |
| rlandy | but there is no logging out out | 14:23 |
| rook | rlandy i wonder... | 14:24 |
| rook | rlandy: can i get onto the system? | 14:24 |
| rook | curious if there is something assuming stack | 14:24 |
| rook | yeah | 14:25 |
| rook | i think that might be it | 14:25 |
| rlandy | rook: yes ... https://paste.fedoraproject.org/paste/~6xe5AWUQcnttqowotoONg | 14:25 |
| rook | cat ~stack/.ssh/id_rsa.pub >> ~stack/.ssh/authorized_keys | 14:25 |
| rlandy | there are a bunch of updates to be done | 14:25 |
| rook | where ~stack should/could be more generic | 14:25 |
| rlandy | rook: pls send your keys | 14:25 |
| rook | we could switch to the boostrap.py | 14:25 |
| rlandy | rook; or update to get rid of stack hardcoding | 14:26 |
| rook | http://perf1.perf.lab.eng.bos.redhat.com/jtaleric/OpenStack/.rook | 14:26 |
| *** yolanda__ is now known as yolanda | 14:26 | |
| rlandy | rook: ssh zuul@38.145.34.140 | 14:28 |
| rook | yup :/ | 14:28 |
| rook | ok | 14:28 |
| rlandy | rook; I have been running with https://paste.fedoraproject.org/paste/XPxB69iH1CFJ8Ao2cGr-Xw | 14:30 |
| rook | ok - so there is a issue here | 14:30 |
| rook | much of our code is assuming stack | 14:30 |
| rook | one sec | 14:30 |
| rook | ok, i have a fix for bootstrap.py | 14:34 |
| rook | let me get that in | 14:34 |
| rlandy | rook; cool | 14:35 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.open | 14:35 |
| agopi | sent invites rook rlandy myoung | 14:42 |
| panda | rfolco: quiquell|off next time you do a sandwich like this, I swear I'll put tobasco on it. | 14:44 |
| * Tengu loves tabasco in his sandwiches | 14:45 | |
| rfolco | panda, our tasks were so tied... tabasco makes me cry, you are evil | 14:49 |
| panda | Tengu: when your turn comes, I'll make sure I use something stronger | 14:50 |
| Tengu | panda: try... already tried a lot of spicy things, like harissa, tabasco (red/green), curry, jalapeño... ;) | 14:51 |
| panda | rfolco: sorry, need to break the sandwich, in https://review.openstack.org/582387 what happens if dryruyn is defined as dryrun: false | 14:51 |
| *** jfrancoa has quit IRC | 14:51 | |
| *** jfrancoa has joined #oooq | 14:55 | |
| panda | Tengu: have you ever been in Brno HQ yet ? | 14:56 |
| Tengu | panda: not yet, unfortunately. Do they have some nice spicy things? | 14:57 |
| rook | agopi rlandy one more patch | 15:00 |
| panda | Tengu: last time I was there, thre was this I think turkish burger peddler. For onw of our team his food was not spicy enough (I requested a NO SPICE burger and my mouth was on fire). So he covere himself with a space suit, and took a small bottle with a jolly roger flag on it. Then dipped a toothpick on it, and while it was dissolving he asked our colleague to taste it. I think he's still running, and that was | 15:01 |
| panda | 3 years ago. | 15:01 |
| Tengu | uhuhuhu | 15:02 |
| marios | panda: is the place opposite the office next to the tram stop? | 15:03 |
| marios | panda: jistr from the office there calls it mystery meat | 15:03 |
| Tengu | panda: well, I had tasted some really strong things in the carabbeans. not really affraid in fact. But not trying to get real burns ;). | 15:03 |
| panda | marios: I remember a pedestrian bridge next to it. | 15:04 |
| panda | lucasagomes: do you have time for a question regarding neutron dhcp agent ? | 15:06 |
| lucasagomes | panda, sure, we don't use that in OVN so I'm not super familar with its code but if I don't know the answer I can find someone that does | 15:07 |
| panda | lucasagomes: you can just point me to it. I need to filter the hosts that are allowed a DHCPOFFER. in dnsmasq I can set dhcp-range=x.x.x.x/y, static, so no lease will be offered unless there is a specific host definition. Do you know where if there's a place in configuration to add this optioon, or add arbitrary otpions to dnsmasq ? Do you know where I can specify this host definitions ? | 15:10 |
| chkumar|rover | panda: I am hitting this error http://paste.openstack.org/show/726449/ | 15:10 |
| panda | lucasagomes: point me to HIM/HER | 15:10 |
| chkumar|rover | while using libvirt reproducer | 15:11 |
| chkumar|rover | bash -x reproducer-quickstart.sh --libvirt --workspace /home/stack/tripleo/ --create-virtualenv true | 15:11 |
| chkumar|rover | this is the command i have invoked | 15:11 |
| chkumar|rover | I am running it on a clean cenots box | 15:11 |
| chkumar|rover | 7.5 | 15:11 |
| myoung | panda, sshnaidm|ruck, wes isn't here, and we're all busy. happy to postpone triage unless there's hot issues to discuss...no responses to invite so unless you want to have it let's cancel | 15:12 |
| panda | chkumar|rover: is the pool definition file present ? | 15:14 |
| panda | myoung: ack | 15:15 |
| chkumar|rover | panda: nope full playbook run http://paste.openstack.org/show/726450/ | 15:15 |
| panda | chkumar|rover: something's wrong, line 152 | 15:16 |
| lucasagomes | panda, oh I think you can do that... If I'm not mistaken we used something similar in Ironic where we overwrote some of the default config options for dnsmasq | 15:16 |
| myoung | chkumar|rover: thanks, was going to ask what happens here: https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/common/tasks/main.yml#L19 | 15:16 |
| lucasagomes | panda, give me a minute I will try to find it | 15:16 |
| panda | chkumar|rover: what happens if you try to run that command manually ? | 15:17 |
| panda | lucasagomes: thanks. | 15:18 |
| *** jaganathan has quit IRC | 15:18 | |
| lucasagomes | panda, here https://docs.openstack.org/project-install-guide/baremetal/newton/setup-drivers.html | 15:18 |
| myoung | chkumar|rover, panda 152 is fine, it's a check with ignored error for existence of pool. what's going on after 156, is the xml file present? | 15:19 |
| lucasagomes | panda, tl;dr in the /etc/neutron/dhcp_agent.ini configuration you can set an option called "dnsmasq_config_file" which takes a path to a file with custom configuration for dnsmasq | 15:19 |
| lucasagomes | panda, https://docs.openstack.org/project-install-guide/baremetal/newton/setup-drivers.html#networking-service-configuration (the link with the Ironic example) | 15:19 |
| lucasagomes | that's not needed anymore, but was something that we used n the past | 15:19 |
| panda | lucasagomes: do you have the same doc updated for queens ? | 15:20 |
| *** apetrich has quit IRC | 15:20 | |
| *** sdoran has quit IRC | 15:20 | |
| chkumar|rover | panda: virsh command not found | 15:20 |
| chkumar|rover | panda: that's why it is failing | 15:21 |
| lucasagomes | panda, that doc is just an example of how we used that in Ironic. But we no longer need to set a custom dnsmasq for Ironic anymore (we create the ipxe tag in Neutron now) | 15:21 |
| panda | myoung: line 152 is not ok | 15:21 |
| lucasagomes | panda, you that configuration in the DHCP agent still exist (I just checked) | 15:21 |
| lucasagomes | so you can use for your use case there | 15:21 |
| chkumar|rover | panda: earlier when used to run quickstart.sh script that time it used to install the required dependencies | 15:21 |
| panda | lucasagomes: and that can contain both range specification and host definition ... | 15:22 |
| panda | lucasagomes: I'll give it a try, thanks! | 15:22 |
| lucasagomes | panda, that file will overwrite the default options, so it will take precedent | 15:22 |
| lucasagomes | should work for you | 15:22 |
| lucasagomes | lemme know | 15:22 |
| *** sdoran has joined #oooq | 15:23 | |
| myoung | panda: i.c., i just meant that we check if pool exists and ignore the failure, so that task failing is expected if pool doesn't exist. it failing for missing virsh command however is diff. /me hates this "ignore_error" idiom. | 15:23 |
| *** sdoran has quit IRC | 15:24 | |
| *** sdoran has joined #oooq | 15:24 | |
| *** jaganathan has joined #oooq | 15:24 | |
| *** sdoran has quit IRC | 15:25 | |
| *** sdoran has joined #oooq | 15:26 | |
| *** sdoran has quit IRC | 15:27 | |
| *** sdoran has joined #oooq | 15:27 | |
| rook | agopi rlandy can you try the latest | 15:31 |
| rook | need to add to the ansible-playbook to use --user zuul | 15:31 |
| rlandy | rook: I'll test with ansible_user | 15:32 |
| rlandy | pathc 8? | 15:32 |
| rlandy | patch | 15:32 |
| rook | generate will need --user | 15:32 |
| chkumar|rover | myoung: panda http://paste.openstack.org/show/726455/ | 15:32 |
| rook | the generate_host script | 15:32 |
| rook | agopi: can you amend that | 15:32 |
| agopi | aah | 15:32 |
| agopi | got it | 15:32 |
| rlandy | rook; running now | 15:33 |
| rlandy | TASK [browbeat/rally : Install rally into rally-venv] | 15:33 |
| myoung | chkumar|rover: can you run the virt-resize by hand? | 15:33 |
| *** apetrich has joined #oooq | 15:33 | |
| panda | chkumar|rover: do you have /usr/bin/supermin ? | 15:33 |
| chkumar|rover | panda: myoung http://paste.openstack.org/show/726456/ | 15:35 |
| rlandy | rook: agopi: got this far https://paste.fedoraproject.org/paste/rhQxQ5yuTf2nUZ~q1233Xg | 15:35 |
| rook | rlandy: ssl cloud? | 15:37 |
| rlandy | rook: https://review.openstack.org/#/c/583578/3/config/general_config/featureset053.yml line 8 | 15:39 |
| rlandy | we can disable that | 15:39 |
| rlandy | if need be | 15:39 |
| panda | chkumar|rover: permission denies | 15:40 |
| panda | d | 15:40 |
| chkumar|rover | panda: myoung I am running as a non root user with passwordless sudo access | 15:41 |
| *** holser_ has joined #oooq | 15:41 | |
| *** holser_ has quit IRC | 15:42 | |
| myoung | chkumar|rover: do you have a tmate? | 15:42 |
| panda | chkumar|rover: what's ls -ld /home/stack/tripleo ? | 15:42 |
| chkumar|rover | panda: drwxrwxr-x 5 stack stack 4096 Jul 23 17:31 /home/stack/tripleo | 15:43 |
| myoung | chkumar|rover: also LIBGUESTFS_BACKEND: direct is set in the task, not saying it's root cause but add that as well to manual run | 15:43 |
| chkumar|rover | myoung: pub key | 15:44 |
| myoung | 'chkumar|rover @194 "export LIBGUESTFS_BACKEND=direct" | 15:44 |
| arxcruz|off | sshnaidm|ruck: rlandy trown https://review.openstack.org/#/c/573220/ | 15:45 |
| panda | chkumar|rover: then it's selinux fault | 15:45 |
| chkumar|rover | panda: selinux is disabled | 15:45 |
| rlandy | rook: can rally work with ssl overcloud, otherwise will set that to false | 15:45 |
| chkumar|rover | panda: if I enabled it, the box does not boot | 15:46 |
| myoung | chkumar|rover: http://libguestfs.org/guestfs-faq.1.html | 15:48 |
| myoung | chkumar|rover: does that issue repro with LIBGUESTFS_BACKEND=direct when run manually? | 15:49 |
| *** bogdando has quit IRC | 15:54 | |
| *** udesale has quit IRC | 15:56 | |
| chkumar|rover | myoung: i donot know what happened | 15:57 |
| chkumar|rover | myoung: but it has wored | 15:57 |
| chkumar|rover | when i do eport LIBGUESTFS_BACKEND=direct | 15:57 |
| chkumar|rover | *worked | 15:58 |
| *** holser_ has joined #oooq | 16:02 | |
| *** tcw1 has joined #oooq | 16:12 | |
| *** tcw has quit IRC | 16:16 | |
| rfolco | myoung, rlandy sshnaidm|ruck marios: perhaps we can +w these 3 patches and I work on the comments in follow-up changes to not block the chain. If there is a strong -1, I'll be happy to fix though: https://review.openstack.org/#/c/582384/, https://review.openstack.org/#/c/582385/ and https://review.openstack.org/#/c/582386 | 16:16 |
| * myoung looks | 16:17 | |
| myoung | rfolco: the first 2 already have +1 | 16:17 |
| myoung | from me...looking at the 3rd | 16:17 |
| rlandy | just checking the failure | 16:18 |
| myoung | rfolco: thanks for answering my question | 16:18 |
| *** tcw1 is now known as tcw | 16:18 | |
| rfolco | myoung, quiquell|off and I made a "chaindwich" with these patches | 16:20 |
| rfolco | this made panda so mad | 16:21 |
| panda | tobasco! tobasco! | 16:23 |
| *** zoli is now known as zoli|gone | 16:27 | |
| *** zoli|gone is now known as zoli | 16:28 | |
| *** panda is now known as panda|off | 16:30 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.open | 16:35 |
| *** trown is now known as trown|lunch | 16:42 | |
| rlandy | rook: agopi: https://logs.rdoproject.org/17/583717/8/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/4954a77/job-output.txt.gz#_2018-07-23_16_21_08_026239 | 16:46 |
| rlandy | missing a commit in the review? | 16:46 |
| agopi | rlandy, https://review.openstack.org/584957 this should work i guess. | 16:48 |
| agopi | i'll also need to ake changes here https://github.com/openstack/browbeat/blob/master/ansible/install/roles/browbeat/tasks/main.yml#L79 | 16:49 |
| agopi | wanted to make sure the hosts gen script im using is right. | 16:49 |
| *** ccamacho has quit IRC | 16:49 | |
| rlandy | agopi; ok - when you have those changes in, we can rebase the current patch on this one and rerun | 16:50 |
| agopi | okay rlandy. | 16:50 |
| *** tesseract has quit IRC | 17:02 | |
| *** dtantsur is now known as dtantsur|afk | 17:24 | |
| agopi | https://review.openstack.org/#/c/583717/8..9 along with https://review.openstack.org/584957 should work i hope? | 17:25 |
| agopi | rlandy, ^ rook ^ | 17:25 |
| rlandy | agopi: any reason https://review.openstack.org/584957 can't be included in https://review.openstack.org/#/c/583717/? | 17:27 |
| agopi | can do that rlandy, btw do you have the updated generate_tripleo_hostfile.sh ? that rook made changes on your reproducer? | 17:29 |
| *** myoung is now known as myoung|bbl | 17:29 | |
| rlandy | agopi: yes - I'll copy | 17:34 |
| rlandy | agopi: adding a depends -on for the same repo is not correct | 17:37 |
| rlandy | Depends-On: I875273a21d7d3d6cb5b027dce00052693e2da044 | 17:37 |
| rlandy | you need to rebase or actually add that change | 17:38 |
| agopi | my bad rlandy, nvm rook verified my patch, i'll just add the actual change | 17:38 |
| rlandy | cool | 17:38 |
| rlandy | hmmm ... | 17:38 |
| rlandy | I don;t see changes to generate_tripleo_hostfile.sh | 17:38 |
| agopi | adding a sec | 17:39 |
| rlandy | in home/zuul/browbeat | 17:39 |
| rlandy | where they added elsewhere? | 17:39 |
| rlandy | rook:?? | 17:39 |
| rook | really? | 17:39 |
| rook | rlandy: I added it to your patc | 17:39 |
| rook | one sec | 17:39 |
| agopi | https://review.openstack.org/#/c/583717/10/ansible/generate_tripleo_hostfile.sh rlandy rook | 17:40 |
| rook | https://review.openstack.org/#/c/583717/ | 17:40 |
| rook | just look at the latest | 17:40 |
| * rook just added to the --help | 17:40 | |
| rlandy | rook: agopi: thanks - let's see what CI does with that | 17:41 |
| agopi | oh cool forgot that | 17:41 |
| rlandy | will test locally as well | 17:41 |
| rook | ack | 17:43 |
| rook | thanks | 17:43 |
| *** amoralej is now known as amoralej|off | 17:46 | |
| *** trown|lunch is now known as trown | 17:47 | |
| *** vinaykns has quit IRC | 17:49 | |
| agopi | rlandy, | 17:50 |
| agopi | one sec | 17:50 |
| agopi | has been updated by rook's patch | 17:51 |
| rook | yeah my bad | 17:51 |
| rook | and that patch could of waited | 17:51 |
| rook | :( | 17:51 |
| agopi | okay done, should be runnable now | 17:55 |
| agopi | rlandy, rook ^ | 17:55 |
| agopi | https://review.openstack.org/#/c/583717/10..11/ansible/install/roles/browbeat/tasks/main.yml was updated so had to correct it | 17:55 |
| rook | rlandy: you asked about an SSL cloud, yes we cna | 17:58 |
| rook | but we need to update the browbeat install :) | 17:58 |
| rlandy | rook; the choice is yours - ssl or not | 17:59 |
| rlandy | it's in the fs | 17:59 |
| rook | *not* is preferred unless the default is ssl | 17:59 |
| rook | then we can bend | 17:59 |
| rook | hm | 17:59 |
| rook | we used to have support of ssl | 18:00 |
| rlandy | rook: I'll update the featureset to ssl_overcloud: false | 18:00 |
| rook | ack | 18:00 |
| rlandy | it's your featureset | 18:00 |
| * rlandy updates | 18:00 | |
| rlandy | and then we can reckick testing | 18:00 |
| *** tosky has quit IRC | 18:23 | |
| *** jfrancoa has quit IRC | 18:24 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.open | 18:36 |
| *** dougbtv has quit IRC | 18:46 | |
| rook | agopi rlandy how are things cookin | 18:53 |
| agopi | https://review.rdoproject.org/zuul/stream.html?uuid=77590f0a279240e6baa83765755dad42&logfile=console.log i'm guessing its here | 18:54 |
| agopi | amirite rlandy ? ^ | 18:55 |
| *** holser_ has quit IRC | 18:58 | |
| *** dsneddon has quit IRC | 18:58 | |
| rlandy | https://review.rdoproject.org/zuul/stream.html?uuid=77590f0a279240e6baa83765755dad42&logfile=console.log - yep | 19:01 |
| *** kopecmartin has quit IRC | 19:01 | |
| *** atoth has quit IRC | 19:32 | |
| rfolco | trying to concatenate tags + upgrade_tags here https://review.openstack.org/#/c/584508/1/playbooks/tripleo-ci/vars/environment_type/multinode.yaml | 19:50 |
| *** vinaykns has joined #oooq | 19:50 | |
| *** brault has quit IRC | 20:08 | |
| *** dsneddon has joined #oooq | 20:10 | |
| *** brault has joined #oooq | 20:15 | |
| rfolco | rlandy, how do I concatenate var + str on a yaml above ^? tags: "bla"{{ upgrade_tags }} or + | 20:20 |
| *** brault has quit IRC | 20:23 | |
| *** brault has joined #oooq | 20:23 | |
| rlandy | rfolco: just like you have "bla{{ upgrade_tags }}" | 20:32 |
| rfolco | rlandy, great thank you. Is there a live ansible test for this that you use ? | 20:34 |
| rlandy | live ansible? | 20:35 |
| rlandy | I usually keep a reproducer env going | 20:35 |
| rlandy | test there | 20:35 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, (1 more message) | 20:36 |
| rfolco | rlandy, I see. For simple syntax, etc... web live test | 20:36 |
| rlandy | I don't | 20:39 |
| *** dougbtv has joined #oooq | 20:40 | |
| rook | so agopi rlandy there is a task that does genereates a hosts file for the overcloud... i wonder if we could just use that | 20:44 |
| rook | instead of having browbeat generate it, yet again | 20:44 |
| rook | just copy it to the browbeat directory | 20:44 |
| rook | the ssh_config and hosts file | 20:44 |
| rlandy | you can | 20:44 |
| * rook will have to look at what gets generated | 20:44 | |
| rook | i just saw a task scroll by | 20:44 |
| *** brault_ has joined #oooq | 20:48 | |
| rook | browbeat is rolling | 20:50 |
| *** brault has quit IRC | 20:51 | |
| *** trown is now known as trown|outtypewww | 20:56 | |
| rlandy | rook: failure on TASK [browbeat/images : Remove image from dictionary of images if image exists] | 20:58 |
| rlandy | we're getting there | 20:58 |
| rook | ugh | 20:58 |
| rook | so | 20:58 |
| rook | you guys ship with some preinstalled images | 20:58 |
| rook | we need to disable that IMHO | 20:58 |
| rook | agopi: ^ | 20:58 |
| agopi | okay rook i'll get it done | 21:40 |
| agopi | going afk now, heading home | 21:40 |
| agopi | ^ rlandy brb | 21:42 |
| *** agopi is now known as agopi|brb | 21:42 | |
| rlandy | agopi|brb: rook: ok you can edit the review and retest as needed | 21:43 |
| *** agopi|brb has quit IRC | 21:47 | |
| *** holser_ has joined #oooq | 21:52 | |
| *** vinaykns has quit IRC | 22:06 | |
| *** holser_ has quit IRC | 22:06 | |
| *** agopi has joined #oooq | 22:12 | |
| *** rlandy has quit IRC | 22:28 | |
| *** vinaykns has joined #oooq | 22:29 | |
| *** florianf has quit IRC | 22:32 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, (1 more message) | 22:36 |
| *** tosky has joined #oooq | 22:58 | |
| *** myoung|bbl is now known as myoung | 22:59 | |
| *** tosky has quit IRC | 23:27 | |
| *** brault has joined #oooq | 23:53 | |
| *** brault_ has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!