| *** agopi|brb has quit IRC | 00:00 | |
| *** agopi|brb has joined #oooq | 00:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages) | 00:37 |
|---|---|---|
| *** agopi|brb has quit IRC | 00:39 | |
| *** agopi|brb has joined #oooq | 00:39 | |
| *** dsneddon2 has joined #oooq | 01:14 | |
| *** dsneddon3 has joined #oooq | 01:14 | |
| *** dsneddon__ has quit IRC | 01:16 | |
| *** dsneddon_ has quit IRC | 01:18 | |
| *** huynq has joined #oooq | 01:20 | |
| *** dsneddon2 has quit IRC | 01:55 | |
| *** dsneddon2 has joined #oooq | 01:56 | |
| *** dsneddon2 has quit IRC | 02:12 | |
| *** dsneddon2 has joined #oooq | 02:20 | |
| *** dsneddon2 has quit IRC | 02:25 | |
| *** dsneddon2 has joined #oooq | 02:29 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ (3 more messages) | 02:37 |
| *** dsneddon2 has quit IRC | 02:40 | |
| *** dsneddon2 has joined #oooq | 02:43 | |
| *** dsneddon2 has quit IRC | 02:48 | |
| *** dsneddon2 has joined #oooq | 02:52 | |
| *** dsneddon2 has quit IRC | 03:09 | |
| *** dsneddon2 has joined #oooq | 03:09 | |
| *** dsneddon2 has quit IRC | 03:18 | |
| *** ykarel|away has joined #oooq | 03:25 | |
| *** dsneddon2 has joined #oooq | 03:26 | |
| *** dsneddon2 has quit IRC | 03:30 | |
| *** dsneddon2 has joined #oooq | 03:47 | |
| *** udesale has joined #oooq | 03:51 | |
| *** dsneddon2 has quit IRC | 03:56 | |
| *** dsneddon2 has joined #oooq | 04:05 | |
| *** dsneddon2 has quit IRC | 04:09 | |
| *** dsneddon2 has joined #oooq | 04:23 | |
| *** dsneddon2 has quit IRC | 04:32 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (2 more messages) | 04:38 |
| *** dsneddon2 has joined #oooq | 04:48 | |
| *** dsneddon2 has quit IRC | 04:53 | |
| *** dsneddon2 has joined #oooq | 05:02 | |
| *** dsneddon2 has quit IRC | 05:11 | |
| *** dsneddon2 has joined #oooq | 05:25 | |
| *** jaganathan has joined #oooq | 05:35 | |
| *** ratailor has joined #oooq | 05:35 | |
| *** trown has joined #oooq | 05:49 | |
| *** kopecmartin has joined #oooq | 05:50 | |
| *** dsneddon2 has quit IRC | 05:51 | |
| *** dsneddon2 has joined #oooq | 05:52 | |
| *** quiquell|off is now known as quiquell | 05:53 | |
| *** irclogbot_0 has quit IRC | 05:55 | |
| *** apetrich has quit IRC | 05:55 | |
| *** kopecmartin|off has quit IRC | 05:55 | |
| *** nhicher has quit IRC | 05:55 | |
| *** cgoncalves has quit IRC | 05:55 | |
| *** chkumar|off has quit IRC | 05:55 | |
| *** trown|outtypewww has quit IRC | 05:55 | |
| *** apetrich has joined #oooq | 06:02 | |
| *** dsneddon2 has quit IRC | 06:04 | |
| *** chandankumar has joined #oooq | 06:06 | |
| *** dsneddon2 has joined #oooq | 06:08 | |
| *** ykarel|away is now known as ykarel | 06:10 | |
| ykarel | quiquell, ssbarnea|bkp2 https://review.openstack.org/#/c/610491/13 still failing The error was: 'ansible_user_dir' is undefined | 06:10 |
| *** dsneddon2 has quit IRC | 06:13 | |
| *** dsneddon2 has joined #oooq | 06:17 | |
| quiquell | ykarel: ack, will look into it | 06:18 |
| *** ccamacho has quit IRC | 06:20 | |
| *** holser_ has joined #oooq | 06:33 | |
| *** dsneddon2 has quit IRC | 06:34 | |
| *** holser_ has quit IRC | 06:35 | |
| quiquell | ykarel: Looks like now we have only the ansible_user_dir if we run it with become: yes | 06:36 |
| quiquell | ykarel: Going to try one thing | 06:37 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (2 more messages) | 06:38 |
| quiquell | ykarel: uploaded ps let's see if it works | 06:39 |
| *** dsneddon2 has joined #oooq | 06:40 | |
| quiquell | shit... I have remove it from gates... :-( | 06:40 |
| quiquell | ykarel: The other jobs were working fine ? | 06:41 |
| *** ccamacho has joined #oooq | 06:41 | |
| ykarel | quiquell, as per https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch it's passing | 06:43 |
| ykarel | but in that patch i have never seen it passing | 06:43 |
| ykarel | so if that merges without, upstream ovb jobs would have new failures apart from infra | 06:44 |
| ykarel | without fixing | 06:44 |
| quiquell | ykarel: I don't kno wwhat's the difference between them and the other jobes | 06:44 |
| quiquell | They run at RDO... | 06:45 |
| quiquell | holy jesus... | 06:45 |
| quiquell | Even branchless OVB jobs are failing at build-test-pakages https://logs.rdoproject.org/91/610491/13/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035/ae36430/job-output.txt.gz#_2018-10-25_13_28_22_308337 | 06:46 |
| ykarel | yes all are affected, i shared the one as an example | 06:46 |
| quiquell | ykarel: all RDO that's right ? | 06:46 |
| ykarel | yes | 06:46 |
| ykarel | ovb ones | 06:46 |
| quiquell | ykarel: Maybe it affects our periodic jobs too | 06:48 |
| *** dsneddon2 has quit IRC | 06:48 | |
| *** ccamacho has quit IRC | 06:49 | |
| ykarel | quiquell, there we don't build packages | 06:50 |
| ykarel | so at least this error will not be there | 06:50 |
| *** ccamacho has joined #oooq | 06:51 | |
| *** dsneddon2 has joined #oooq | 06:52 | |
| quiquell | ykarel: It's a clean up stuff I think it's not conditional | 06:57 |
| *** quiquell is now known as quiquell|brb | 06:57 | |
| quiquell|brb | Go back in a few | 06:58 |
| quiquell|brb | But want to understand why we don' thave ansible_user_dir | 06:58 |
| quiquell|brb | It can affect post build-test-package roles | 06:58 |
| quiquell|brb | And affect periodic jobs they run at RDO | 06:58 |
| quiquell|brb | This can be more important than just "third party jobs" thing | 06:59 |
| ykarel | i didn't dig much on it so can't say, ssbarnea|bkp2 may have some idea | 07:00 |
| *** dsneddon2 has quit IRC | 07:00 | |
| *** dsneddon2 has joined #oooq | 07:03 | |
| *** amoralej|off is now known as amoralej | 07:06 | |
| *** dsneddon2 has quit IRC | 07:08 | |
| *** dsneddon2 has joined #oooq | 07:09 | |
| *** quiquell|brb is now known as quiquell | 07:14 | |
| quiquell | ykarel: I see multinode at RDO is passing | 07:15 |
| ykarel | quiquell, | 07:16 |
| ykarel | <ykarel> yes | 07:16 |
| ykarel | <ykarel> ovb ones | 07:16 |
| ykarel | one which consumes: https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/ovb-setup.yml | 07:16 |
| quiquell | ykarel: Huff there is a lot of gather_facts there and also setting ansible_user | 07:20 |
| quiquell | ykarel: That's no good | 07:20 |
| ykarel | no idea, good to check reasoning why it's there | 07:21 |
| ykarel | may be git history or the person worked there have idea | 07:21 |
| quiquell | ykarel: Good finding though | 07:21 |
| quiquell | ykarel: That's all stuff we have to adapt it for sure | 07:21 |
| quiquell | ykarel: The problem is OVB were failing so much at networkiing issue that we were not looking at them | 07:22 |
| ykarel | ack, but good to check there results to avoid merging bad stuffs | 07:23 |
| quiquell | ykarel: Ok my fix works, but now it fails later on | 07:23 |
| quiquell | https://logs.rdoproject.org/91/610491/14/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/a91574d/job-output.txt.gz | 07:23 |
| ykarel | ack, good to fix all before merging please | 07:23 |
| *** ykarel is now known as ykarel|lunch | 07:24 | |
| *** holser_ has joined #oooq | 07:34 | |
| *** dsneddon_ has joined #oooq | 07:36 | |
| *** dsneddon has joined #oooq | 07:37 | |
| ssbarnea|bkp2 | ykarel|lunch quiquell : i have no idea what is causing this failure because it does not make any sense for that change to have this side effect | 07:37 |
| quiquell | ssbarnea|bkp2: I have fix that point adding another gather_fact, but now it fails later on | 07:37 |
| quiquell | ssbarnea|bkp2: At another one, we have to fix this, sorry about missing gates :-( | 07:38 |
| *** dsneddon3 has quit IRC | 07:38 | |
| *** dsneddon2 has quit IRC | 07:38 | |
| quiquell | ssbarnea|bkp2: noop ovb have no issues there | 07:39 |
| quiquell | ssbarnea|bkp2: It make sense to add another patch to gather the new missing var ? | 07:39 |
| ssbarnea|bkp2 | patch will not merge, failed again due to infra on one job http://logs.openstack.org/77/612677/8/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/2d02f44/job-output.txt.gz | 07:40 |
| ssbarnea|bkp2 | related to browbeat stuff,... failed to download the huge numpy | 07:40 |
| *** bogdando has joined #oooq | 07:41 | |
| quiquell | ssbarnea|bkp2, ykarel|lunch: Good one https://logs.rdoproject.org/45/560445/171/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky-branch/1012a45/job-output.txt.gz | 07:42 |
| quiquell | bad one https://logs.rdoproject.org/91/610491/13/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky-branch/fa6f0e4/job-output.txt.gz#_2018-10-25_13_43_16_638941 | 07:42 |
| *** tosky has joined #oooq | 07:46 | |
| quiquell | ssbarnea|bkp2: Why now we need gather_subset: "!min,python_version" | 07:47 |
| quiquell | ssbarnea|bkp2: And the others ? | 07:47 |
| quiquell | ssbarnea|bkp2: Have we change something in the gathering ? | 07:47 |
| quiquell | ssbarnea|bkp2: undercloud-setup is run before build-test-package I think that's the change that it's affecting OVB | 07:51 |
| *** dsneddon_ has quit IRC | 07:51 | |
| *** dsneddon has quit IRC | 07:51 | |
| *** dsneddon_ has joined #oooq | 07:52 | |
| *** dsneddon has joined #oooq | 07:52 | |
| quiquell | ssbarnea|bkp2: confirmed at OVB 'gather ansible_pkg_mgr' get executed | 07:54 |
| quiquell | ssbarnea|bkp2: at multinode don't | 07:54 |
| quiquell | ssbarnea|bkp2: everytime we do a gather min it cleans up the other facts I think | 07:57 |
| ssbarnea|bkp2 | let me give some background, we seen errors about missing some facts (the ones gathered). | 07:58 |
| quiquell | ssbarnea|bkp2: Also confirmed that containers skips "gather ansible_pkg_mgr" | 07:58 |
| quiquell | ssbarnea|bkp2: They don't install packages I suppose | 07:58 |
| ssbarnea|bkp2 | i also discovered that values of the facts depends on the become value at the time of the gathering,... something that was happening outside the roles | 07:59 |
| quiquell | ssbarnea|bkp2: I can fix the new missing one, but I don't know if it's going to be proper solution | 07:59 |
| ssbarnea|bkp2 | mainly if you run with become: ansible_user_dir will be root and stay root even if your next task does not run as root.... | 07:59 |
| ssbarnea|bkp2 | even worse: become seems to be inheritable, which means that you have no ... idea what you will get. | 08:00 |
| quiquell | ssbarnea|bkp2: forget about become | 08:00 |
| quiquell | ssbarnea|bkp2: problem is gather_subset: "!min | 08:00 |
| ssbarnea|bkp2 | also ansible_user_dir is included in implicit "min" set of facts, so "!min" makes it gather nothign. | 08:01 |
| quiquell | ssbarnea|bkp2: Looks like it reset previous gatherings | 08:01 |
| quiquell | even ansible_user_dir | 08:01 |
| ssbarnea|bkp2 | ohh... it should not but I am going to test right now.... i am starting to hate the person that wrote the setup module.... | 08:01 |
| ssbarnea|bkp2 | i assumed it does not do any resets, but this may explain it. | 08:02 |
| quiquell | ssbarnea|bkp2: Just my guts talking to me | 08:02 |
| ssbarnea|bkp2 | test, test, test. | 08:02 |
| quiquell | ssbarnea|bkp2: !min undefines the min | 08:03 |
| quiquell | ssbarnea|bkp2: "Values can also be used with an initial ! to specify that that specific subset should not be collected" | 08:03 |
| quiquell | ssbarnea|bkp2: So it really resets min vars and collect the one you put after | 08:04 |
| quiquell | "To avoid collecting even the min subset, specify !all,!min" | 08:04 |
| quiquell | So we call undecloud-setup that cleans up min subset | 08:05 |
| quiquell | That's all | 08:05 |
| quiquell | we have to do | 08:05 |
| quiquell | all!,variable | 08:05 |
| quiquell | all! does not cleanup min (even a little missleading | 08:05 |
| ssbarnea|bkp2 | what?1... OMFG. setup module written by the devil. can you confirm it? so solution is "!all,!min,farname". ? | 08:06 |
| quiquell | ssbarnea|bkp2: I think solution is !all,foobar.." | 08:07 |
| quiquell | ssbarnea|bkp2: Doing a small test | 08:07 |
| quiquell | ssbarnea|bkp2: give me a min | 08:07 |
| ssbarnea|bkp2 | trying the same,... | 08:07 |
| ssbarnea|bkp2 | not true: apparently works as I was expecting: https://gist.github.com/ssbarnea/1fbd691dc5f637ce2a785b45c18b1bcf | 08:09 |
| quiquell | ssbarnea|bkp2: Yep for me too | 08:09 |
| quiquell | :-/ | 08:09 |
| ssbarnea|bkp2 | time to downgrade ansible to match our version and try to use it inside a role, maybe there is something special about the usage in a role. | 08:10 |
| quiquell | ssbarnea|bkp2: The thing is, that setup are not suppose to reset previously gathered stuff | 08:11 |
| quiquell | ssbarnea|bkp2: It does not gather what you specify with ! but it does not undefine them either (Or it suppose to) | 08:11 |
| ssbarnea|bkp2 | my theory is that this error comes from another place, not our code. still need to fix it. | 08:12 |
| quiquell | ssbarnea|bkp2: We can do the gathering at all places for OVB but I don't know if this is a good solution | 08:12 |
| quiquell | ssbarnea|bkp2: What do you think ? | 08:12 |
| quiquell | ssbarnea|bkp2: wait | 08:13 |
| quiquell | ssbarnea|bkp2: The question is, why "ansible_pkg_mgr" is not defined at OVB but it's defined at multinode | 08:14 |
| ssbarnea|bkp2 | i thin i know, putting a fix now. | 08:19 |
| quiquell | ssbarnea|bkp2: what is ? | 08:20 |
| quiquell | ssbarnea|bkp2: I found weird that ansible_pkg_mgr is defined at multinode jobs but not the case at OVB | 08:20 |
| quiquell | ssbarnea|bkp2: At least the condition say so | 08:20 |
| ssbarnea|bkp2 | this depends on what happens before the role is called, best to make the role work regardless preexisting conditions | 08:22 |
| quiquell | ssbarnea|bkp2: So we force gather stuff one by one ? | 08:23 |
| ssbarnea|bkp2 | yep, whenever we find such case we add gatherings at the begining of the role(s). when we will start testing roles it will be easier to catch locally (molecule) | 08:23 |
| quiquell | ssbarnea|bkp2: ok I have already put one at the review | 08:24 |
| quiquell | next one was ansible_distribution | 08:24 |
| ssbarnea|bkp2 | quiquell: where? please show me the error line | 08:25 |
| quiquell | ssbarnea|bkp2: have some time for blue ? is going to be easier | 08:25 |
| quiquell | marios: ovb not affected by this, we can workflow it https://review.openstack.org/#/c/612633 | 08:27 |
| ssbarnea|bkp2 | https://bluejeans.com/2655417928 | 08:27 |
| chandankumar | panda|off: arxcruz kopecmartin please have a look at this card https://tree.taiga.io/project/tripleo-ci-board/us/193 | 08:30 |
| *** ccamacho has quit IRC | 08:32 | |
| *** panda|off is now known as panda | 08:32 | |
| *** ccamacho has joined #oooq | 08:33 | |
| *** rfolco|rover has quit IRC | 08:35 | |
| quiquell | marios: thanks | 08:36 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (3 more messages) | 08:38 |
| quiquell | ssbarnea|bkp2: btw, are you ok with this https://review.openstack.org/#/c/612290 ? | 08:38 |
| quiquell | panda: Can you help with f28 job review https://review.openstack.org/#/c/612290/ ? | 08:41 |
| quiquell | marios: Already changed commit msg ^ | 08:41 |
| panda | quiquell: looking | 08:42 |
| *** ykarel|lunch is now known as ykarel | 08:42 | |
| quiquell | panda, marios: Also this one can be workflowed https://review.openstack.org/#/c/613084/ | 08:42 |
| *** holser_ has quit IRC | 08:45 | |
| ssbarnea|bkp2 | to read during coffee break https://github.com/ansible/ansible/blob/stable-2.7/changelogs/CHANGELOG-v2.7.rst#v2-7-1 | 08:50 |
| quiquell | ssbarnea|bkp2: Could be fedora28 ansible-python3 more restrictive ? | 08:51 |
| quiquell | ssbarnea|bkp2: maybe ansible.cfg there ? | 08:51 |
| quiquell | ssbarnea|bkp2: https://tree.taiga.io/project/tripleo-ci-board/task/285?kanban-status=1447275 | 08:51 |
| ssbarnea|bkp2 | since Ansible 1.9~ i read each new release notes, proved to save me a lot of time (avoding bugs) | 08:51 |
| ssbarnea|bkp2 | quiquell: nice catch! wonder why linting didn't catch it. | 08:52 |
| quiquell | ssbarnea|bkp2: Yes but why not is an error and not a warning ? it was a warning before | 08:53 |
| ssbarnea|bkp2 | well, i remember not getting much help on addressing warnings, maybe this will change. i can post a long list of pending reviews. | 08:54 |
| ssbarnea|bkp2 | quiquell panda chandankumar https://review.openstack.org/#/c/611844/ | 08:54 |
| ssbarnea|bkp2 | another one https://review.openstack.org/#/c/611853/ | 08:56 |
| quiquell | ssbarnea|bkp2: you have my little +1 | 08:56 |
| chandankumar | ssbarnea|bkp2: mine also, can we https://review.openstack.org/#/c/611844/3/roles/tripleo-validations/tasks/main.yml@3 something meaningful? | 08:57 |
| ssbarnea|bkp2 | chandankumar: true that it could be better, on my defense "name is unique" which is good enough for me to find it with grep ;) | 08:58 |
| chandankumar | ssbarnea|bkp2: :-) | 08:59 |
| ssbarnea|bkp2 | maybe one day we can enable linting errors on missing names, 2020-ish | 08:59 |
| ssbarnea|bkp2 | i would personally prefer to merge it like this without waiting one day for a new check | 08:59 |
| quiquell | ssbarnea|bkp2: Is the only way, clean up everything then turn warning to errors, is what I did at previous jobs | 09:00 |
| ssbarnea|bkp2 | we will never be able to "clean up everything", but we can do it feature by feauture: addressing each issue and enabling it. is a progressive work, also a never ending one. | 09:01 |
| ssbarnea|bkp2 | clean everything works for small projects, especially ones with small number of changes. | 09:01 |
| ssbarnea|bkp2 | by the time I fix one problem, someone will merge a breakage. | 09:01 |
| ssbarnea|bkp2 | on the other hand there is something brilliant able using pre-commit for linting: it can lint just the file you are touching. meaning that we can put "severe" rules for touched files only, forcing people to fix them when they touch the file. | 09:02 |
| ssbarnea|bkp2 | so instead of fixing 200 files, you make people fix them when they need a change to them. | 09:03 |
| ssbarnea|bkp2 | "delegation" ;) | 09:03 |
| quiquell | ssbarnea|bkp2: Can we activate "warning to errors" per role ? | 09:04 |
| quiquell | ssbarnea|bkp2: so we clean the mines and put some enemies detector | 09:04 |
| ssbarnea|bkp2 | i doubt that is easily doable, anyway time to go back to f28 stuff. for the moment lets fix what we find. for me is easy to spot them because they are highligted on logs due to https://github.com/openstack/coats (bit of product placement) | 09:06 |
| quiquell | marios, panda: Let's merge the fedora release file, so we don't fail fast at the f28 job https://review.openstack.org/#/c/610468/ | 09:06 |
| quiquell | will be easier to debug small changes to make it work | 09:06 |
| bogdando | hi, please merge https://review.openstack.org/#/c/610039/ | 09:09 |
| bogdando | and https://review.openstack.org/#/c/603069/ . thanks | 09:10 |
| ssbarnea|bkp2 | does anyone know away to move an issue in taiga? having them separated makes hard to track them | 09:18 |
| quiquell | ssbarnea|bkp2: what do you mean with move ? | 09:20 |
| panda | people are going to hat e me today | 09:21 |
| quiquell | ssbarnea|bkp2: You can drag them | 09:21 |
| quiquell | panda: more ? | 09:21 |
| panda | I'm -1 everything so far | 09:21 |
| quiquell | panda: why ? | 09:21 |
| panda | quiquell: yeah, I know it's difficult to hate me more | 09:21 |
| quiquell | panda: we can try :-P | 09:21 |
| panda | quiquell: for various reasons | 09:21 |
| panda | ssbarnea|bkp2: move an issue ? | 09:21 |
| ssbarnea|bkp2 | quiquell: so they will be listed as part of the story. cannot reliably drag and scroll few screens as the same time. we need to raise a bug on taiga about this. it should be assignable from edit screen. | 09:21 |
| panda | ssbarnea|bkp2: still don't understand what you're trying to do | 09:22 |
| ssbarnea|bkp2 | mainly i want to convert an issue to a task, but i am afraid is not possible | 09:23 |
| ssbarnea|bkp2 | another question would be why I often see issue marked with "NEW" inside the "DONE" column. In fact it seems that the status of an issue is unrelated to the column: see https://s3.sbarnea.com/ss/181026-Sprint_21Unified_Sprint_0_-_Sprint_taskboard_-_TripleO_CI_production_.png | 09:25 |
| panda | ssbarnea|bkp2: the issue area is separated from the rest | 09:27 |
| panda | ssbarnea|bkp2: it has no columns | 09:27 |
| panda | ssbarnea|bkp2: and yes issues are issues, cannot be automatically converted to task, you'll have to create a task and copy the informations manually | 09:28 |
| quiquell | panda: Can you elaborate on -1 stuff ? | 09:28 |
| panda | ssbarnea|bkp2: but it should happen often that you create an issue for a user story we have, they should topic external to what we have for scheduling in sprints | 09:28 |
| panda | quiquell: -1 on releae file stuff | 09:29 |
| panda | ssbarnea|bkp2: -1 on ansible-playbook-3 review | 09:29 |
| panda | you get a -1, you get a -1, everybody gets a -1 | 09:29 |
| quiquell | panda: That -1 is legit you are right about defaults, release file will everride it | 09:31 |
| quiquell | panda: I was thinking that you going to put -1 for a bigger issue | 09:31 |
| panda | quiquell: why would you think that ? | 09:32 |
| quiquell | panda: Not enough coffe maybe | 09:32 |
| quiquell | panda: Also you know better the big picture of stuff | 09:33 |
| quiquell | panda: So maybe we were missing something | 09:33 |
| quiquell | panda, marios: Fixed the release file https://review.openstack.org/610468 | 09:36 |
| quiquell | panda: commented https://review.openstack.org/#/c/612290 | 09:41 |
| panda | ssbarnea|bkp2: why are we moving to use ansible from package ? | 09:50 |
| panda | or quiquell | 09:51 |
| panda | quiquell: also the commit message is about fedora28, but the change is changinthe workflow for everything | 09:51 |
| quiquell | panda: I suppose we have to use the stuff from DLRN | 09:53 |
| quiquell | ssbarnea|bkp2: ^ isn't that right ? | 09:54 |
| panda | quiquell: we setup dlrn repo in quickstart, that is after we install ansible | 09:55 |
| *** saneax has joined #oooq | 09:58 | |
| quiquell | panda: Then the question if why we want to install from PIP to pin the ansible version ? | 10:01 |
| quiquell | panda: btw, quickstart.sh is already installing ansible, so for centos7 we are using the ansible from pip I think | 10:02 |
| quiquell | :-/ | 10:02 |
| quiquell | panda: Also maybe this review is totally wrong and we have to depend on ansible install by quickstart.sh | 10:05 |
| panda | quiquell: yes | 10:09 |
| panda | quiquell: also, the install script will take care of the dependencies | 10:09 |
| panda | quiquell: the unified | 10:09 |
| quiquell | panda: Ok, after sorin changes quickstart.sh is suppose to install ansible with python3 pip install | 10:09 |
| quiquell | panda: So it has to be the right now | 10:10 |
| quiquell | panda: But it will be in the venv ? | 10:10 |
| quiquell | Going to check again | 10:10 |
| *** ssbarnea has joined #oooq | 10:12 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (3 more messages) | 10:38 |
| panda | bogdando: does 603069 work for you ? I'm not sure the command module can handle the nested quotes | 10:38 |
| quiquell | panda: Confirmed with my repro that https://review.openstack.org/#/c/612290/ is not needed | 10:39 |
| quiquell | panda: Maybe I followed a red herring | 10:39 |
| quiquell | panda: thanks mate one less to have f28 working | 10:39 |
| quiquell | panda: I delete the task or do you want to park it or something ? | 10:40 |
| panda | quiquell: mark as done, adda comment saying the review is not necessary | 10:41 |
| panda | quiquell: I always like to leave track of things that we didn't do. Deleting things just removes pieces of our history | 10:41 |
| quiquell | panda: Yep agree with that | 10:42 |
| panda | bogdando: also, where do we use the getthelogs script ? | 10:43 |
| *** dtantsur|afk is now known as dtantsur | 10:48 | |
| *** ssbarnea has quit IRC | 10:49 | |
| ssbarnea|bkp2 | is friday so I am trying to cleanup few old CRs I have, so if some can help with it would be great | 10:55 |
| ssbarnea|bkp2 | panda bogdando : https://review.openstack.org/#/c/570546/ -- with mention that I don't care about py3 for this tasks ATM. | 10:56 |
| ssbarnea|bkp2 | panda chandankumar arxcruz : https://review.openstack.org/#/c/613250/ - two lines, no risk. https://review.openstack.org/#/c/613250/ | 10:58 |
| panda | ssbarnea|bkp2: where do we still use devstack-gate ? | 10:59 |
| ssbarnea|bkp2 | panda tbh, I do not remember when/where I encountered it, but clearly I did as I would have not raised it otherwise. | 11:00 |
| panda | ssbarnea|bkp2: we are not using devstack-gate anywher anymore. | 11:02 |
| panda | well, not true | 11:02 |
| panda | the rdoinfo jobs still use the old workflow | 11:02 |
| panda | but they should | 11:03 |
| *** huynq has quit IRC | 11:05 | |
| panda | anyway, we have no +2 power in devstack-gate, and I don't really understand the change. | 11:07 |
| *** chem has quit IRC | 11:12 | |
| ssbarnea|bkp2 | panda: is very simple: if the venv already exists but does not have zuul inside code would fail to install it and go on. The test is incorrent, existence of one does not assume the other. | 11:12 |
| ssbarnea|bkp2 | anyway, is not important. | 11:13 |
| *** holser_ has joined #oooq | 11:23 | |
| ssbarnea|bkp2 | i am curious if I am too picky about https://bugzilla.redhat.com/show_bug.cgi?id=1642399 (rh only) | 11:26 |
| openstack | ssbarnea|bkp2: Error: Error getting bugzilla.redhat.com bug #1642399: NotPermitted | 11:26 |
| *** udesale has quit IRC | 11:28 | |
| *** panda is now known as panda|lunch | 11:29 | |
| chandankumar | panda|lunch: weshay please have a look at this user stroy 2nd comment https://tree.taiga.io/project/tripleo-ci-board/us/193?milestone=203564 what do you think? | 11:31 |
| quiquell | ssbarnea|bkp2, panda|lunch: I have squash all the changes we have for the f28 and run a hacked reproducer and it's failing at standalone deploy | 11:44 |
| quiquell | but I think it's just related to my reproducer :-) | 11:45 |
| quiquell | so we are near to have something \o/ | 11:45 |
| chandankumar | panda|lunch: weshay kopecmartin arxcruz need feedback on this https://tree.taiga.io/project/tripleo-ci-board/issue/289?kanban-status=2027733 | 11:52 |
| *** ykarel is now known as ykarel|away | 11:58 | |
| weshay | chandankumar, this bug has not been triaged, nor has it been prioritized afaict https://bugzilla.redhat.com/show_bug.cgi?id=1643046 | 12:00 |
| openstack | bugzilla.redhat.com bug 1643046 in openstack-tempest "missing microversion in transfer and backup related test http responses" [Unspecified,New] - Assigned to chkumar | 12:00 |
| *** ykarel|away has quit IRC | 12:02 | |
| *** ratailor has quit IRC | 12:04 | |
| quiquell | weshay: Do you know what the br-ex is ? | 12:05 |
| quiquell | weshay: And if we are suppose to have it at RDO ? | 12:05 |
| weshay | quiquell, which part of rdo? | 12:05 |
| weshay | ci.centos | 12:05 |
| weshay | or rdo-cloud | 12:05 |
| weshay | nodepool | 12:05 |
| quiquell | weshay: reproducer reproducing at my RDO tenant | 12:05 |
| quiquell | weshay: so rdo-cloud | 12:06 |
| weshay | quiquell, it can be eth1 or br-ex for the reproducer eth1 would be eaiser | 12:06 |
| quiquell | weshay: trying to run standalone there | 12:06 |
| weshay | quiquell, no.. | 12:06 |
| weshay | not rdo-cloud | 12:06 |
| weshay | quiquell, libvirt repro | 12:06 |
| weshay | not ovb | 12:06 |
| weshay | quiquell, you are running it in rdo-cloud? | 12:06 |
| quiquell | weshay: ok standalone_interface: eth1 should work ? | 12:07 |
| quiquell | weshay: yep, libvirt always failing somwhere | 12:07 |
| quiquell | weshay: hacked a rdo one to run f28 + ci workflow + standalone | 12:07 |
| weshay | quiquell, do you have all your deps installed? | 12:07 |
| quiquell | weshay: yep | 12:07 |
| weshay | hrm.. k | 12:07 |
| quiquell | weshay: just failing at standalone deploy for the br-ex | 12:07 |
| weshay | ok.. quiquell we'll look at that next sprint I guess | 12:07 |
| weshay | quiquell, ya.. you need a second interface | 12:07 |
| quiquell | weshay: Was just a tool to find stuff and not wait for zuul | 12:07 |
| weshay | br-ex is a native linux bridge | 12:08 |
| quiquell | weshay: It's not producion wise | 12:08 |
| weshay | quiquell, are you familiar w/ linux bridges? | 12:08 |
| quiquell | weshay: will use eth1 | 12:08 |
| quiquell | weshay: yep | 12:08 |
| *** panda|lunch is now known as panda | 12:24 | |
| panda | ssbarnea|bkp2: can you point me to you os detection code ? | 12:27 |
| ssbarnea|bkp2 | panda: tq -> quickstart.sh | 12:27 |
| ssbarnea|bkp2 | panda initially developer inside https://github.com/ssbarnea/me/blob/master/distros.yml -- in order to ease testing it. | 12:28 |
| panda | ssbarnea|bkp2: it's already merged ? | 12:31 |
| ssbarnea|bkp2 | panda yes | 12:31 |
| panda | mmmhhh | 12:32 |
| *** rf0lc0 has joined #oooq | 12:33 | |
| panda | ssbarnea|bkp2: in quickstart.sh ? | 12:33 |
| panda | ssbarnea|bkp2: I don't see it ... | 12:33 |
| *** rf0lc0 is now known as rfolco|rover | 12:33 | |
| ssbarnea|bkp2 | panda: ahh,.. i must have being dreaming about that part. still in the queue: https://review.openstack.org/#/c/612677/ | 12:35 |
| quiquell | ssbarnea|bkp2: yep queue is huge | 12:36 |
| quiquell | :-( | 12:36 |
| *** rlandy has joined #oooq | 12:36 | |
| quiquell | no promotion -> timeouts -> long queues | 12:36 |
| ssbarnea|bkp2 | and this is not the only problem,... it often fails. | 12:36 |
| quiquell | At least is raining here so I am happy | 12:36 |
| *** quiquell is now known as quiquell|lunch | 12:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb- (2 more messages) | 12:38 |
| panda | quiquell|lunch: if you get too happy, please tell me and I will come to slap you. | 12:40 |
| chandankumar | quiquell|lunch: take a cup of tea with some pakoras and enjoy the rain :-) | 12:40 |
| *** agopi|brb is now known as agopi | 12:41 | |
| *** chem has joined #oooq | 12:41 | |
| rlandy | weshay: can I cancel this request: https://projects.engineering.redhat.com/browse/CENTRALCI-2417? | 12:45 |
| rlandy | this was almost a year ago | 12:45 |
| rlandy | they hadn't filled it in 9 months, I forgot about it | 12:46 |
| * tosky sighs | 12:46 | |
| tosky | downstream | 12:46 |
| weshay | rlandy, aye | 12:48 |
| quiquell|lunch | ssbarnea|bkp2: I have pass os-net-config at my repro run for f28 and new workflow | 12:52 |
| quiquell|lunch | ssbarnea|bkp2: Doing puppet stuff now | 12:52 |
| quiquell|lunch | ssbarnea|bkp2: It has all the changes we have | 12:53 |
| ssbarnea|bkp2 | quiquell|lunch : sounds promising. | 12:53 |
| arxcruz | marios: another meeting in the wall ? | 12:59 |
| rlandy | panda: meeting | 13:01 |
| arxcruz | panda: https://redhat.bluejeans.com/7661925373/ | 13:01 |
| quiquell|lunch | ssbarnea|bkp2, weshay: Deploy success with rdo + reproducer + new workflow + f28 + standalone | 13:02 |
| quiquell|lunch | we have the needed reviews to make it work | 13:02 |
| weshay | quiquell|lunch, which hash are you using? | 13:02 |
| quiquell|lunch | weshay: Changed to 'current' to be able to use hte latest openstackclient RPM | 13:03 |
| quiquell|lunch | weshay: for containers is tripleo-current | 13:03 |
| weshay | ah cool | 13:03 |
| weshay | quiquell|lunch, which repo is that rpm built from? | 13:03 |
| *** quiquell|lunch is now known as quiquell | 13:03 | |
| quiquell | the distgit | 13:04 |
| weshay | quiquell, not the rpm you knucklehead | 13:04 |
| weshay | quiquell, the src for openstackclient | 13:04 |
| quiquell | weshay: give me a min | 13:04 |
| weshay | k k | 13:05 |
| weshay | rfolco|rover, ok.. we should sync | 13:05 |
| quiquell | weshay: 200~[zuul@subnode-0 ~]$ rpm -qa |grep openstackclient | 13:05 |
| quiquell | python3-openstackclient-3.16.1-0.20181026111454.3e5a2d2.fc28.noarch | 13:05 |
| rfolco|rover | weshay, bj? | 13:05 |
| weshay | https://github.com/openstack/openstackclient quiquell | 13:05 |
| weshay | rfolco|rover, ya | 13:06 |
| weshay | https://review.openstack.org/#/q/project:openstack/openstackclient | 13:06 |
| weshay | quiquell, sorry.. I've just never poked at the src for openstackclient | 13:07 |
| weshay | wanted to see who and what was going on there | 13:07 |
| weshay | not a busy repo | 13:07 |
| quiquell | weshay: sure give me a sec to find inside | 13:07 |
| weshay | quiquell, I just posted it | 13:07 |
| quiquell | weshay: commit id 3e5a2d227c813937ad7ea23d334f7d23c1f8a2cc from that repo | 13:08 |
| chandankumar | weshay: arxcruz friday is a good day jaint patch is going to land https://review.openstack.org/591424 | 13:20 |
| arxcruz | chandankumar: i still think this should not be done right now... but... | 13:21 |
| *** ratailor has joined #oooq | 13:24 | |
| *** irclogbot_0 has joined #oooq | 13:31 | |
| chandankumar | see ya, have a nice weekend | 13:33 |
| *** chandankumar is now known as chkumar|off | 13:33 | |
| *** ratailor has quit IRC | 13:35 | |
| *** agopi is now known as agopi|brb | 13:35 | |
| *** agopi|brb has quit IRC | 13:40 | |
| *** amoralej is now known as amoralej|lunch | 13:44 | |
| weshay | panda, rfolco|rover need a few | 13:59 |
| rfolco|rover | ack | 13:59 |
| panda | weshay: rfolco|rover mee too | 14:02 |
| rfolco|rover | ack | 14:02 |
| *** agopi|brb has joined #oooq | 14:05 | |
| *** agopi|brb is now known as agopi | 14:05 | |
| rlandy | marios: quiquell: if we get stuck on the zuul vars to get at playbooks - any thoughts on parsing the logs for the list of playbooks? | 14:10 |
| rlandy | not ideal | 14:10 |
| rlandy | but workable | 14:10 |
| quiquell | rlandy: I would prefer ara stuff | 14:10 |
| quiquell | rlandy: But we have the task not the plabooks in the jsons | 14:11 |
| rlandy | quiquell: yeah - last resort | 14:11 |
| quiquell | rlandy: We can even read the sqlite we ahve | 14:11 |
| marios | rlandy: yeah i'll be exploring that too | 14:11 |
| marios | quiquell: or ara | 14:11 |
| quiquell | rlandy, marios: better ara is formatted data logs can change with ansible versions | 14:11 |
| marios | quiquell: rlandy its already here http://logs.openstack.org/68/604768/6/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/12f8acd/ara-report/ | 14:12 |
| rlandy | marios: quiquell: ok - we have options | 14:12 |
| rlandy | yeah - as long as we don;t get stuck on zuul var we can't access | 14:12 |
| * rlandy keep quiet now | 14:12 | |
| quiquell | rlandy, marios: Puff zuul QUEUED stuff is killing me, we can not even run a 1 min proto there | 14:13 |
| quiquell | marios: runnig proto https://softwarefactory-project.io/zuul/t/rdoproject.org/stream/982c15605dba46e3bd0ebc5b57ab2ce3?logfile=console.log | 14:14 |
| quiquell | weshay, rlandy, panda: Let's merge the release file for f28 https://review.openstack.org/#/c/610468/ | 14:15 |
| weshay | rfolco|rover, panda k.. ready | 14:16 |
| rlandy | quiquell: looks ok | 14:17 |
| weshay | quiquell, just fyi | 14:17 |
| weshay | quiquell, if we continue to use current | 14:17 |
| weshay | shit will break immediately w/o warning | 14:17 |
| weshay | quiquell, pin to the hash that worked for you on line 55 | 14:18 |
| weshay | https://review.openstack.org/#/c/610468/37/config/release/tripleo-ci/Fedora-28/master.yml | 14:18 |
| weshay | quiquell, understood? | 14:18 |
| weshay | than I'll merge | 14:18 |
| quiquell | weshay: Agree | 14:18 |
| quiquell | weshay: and change to current when we have a promotion | 14:18 |
| quiquell | weshay: Ohh wait, we can manually tag with DLRN commands ? | 14:18 |
| quiquell | weshay: So we point the release file to tripleo-current ? | 14:19 |
| weshay | ssbarnea|bkp2, ^ help quiquell please | 14:20 |
| weshay | panda, ?? | 14:20 |
| *** amoralej|lunch is now known as amoralej | 14:20 | |
| *** jaganathan has quit IRC | 14:23 | |
| quiquell | panda, ssbarnea|bkp2: The hash is 1e506094949d68b452d044941c0d6f85ef997b9e_c7bc20cd | 14:25 |
| *** tosky has quit IRC | 14:25 | |
| quiquell | humm we are using consistent | 14:26 |
| quiquell | for tripleo dlrn | 14:26 |
| ssbarnea|bkp2 | me getting bit (more) confused, i only remember that weshay have me a hash to inject in one change, yesterday. was this the same or another one.... | 14:26 |
| quiquell | ssbarnea|bkp2: Give a sec I will force it | 14:27 |
| *** tosky has joined #oooq | 14:29 | |
| bogdando | panda: yes 603069 wfm | 14:31 |
| bogdando | panda: I have no idea if there is users of the getthelogs script but me | 14:32 |
| *** vinaykns has joined #oooq | 14:33 | |
| bogdando | just found it exists and made it working for me better :) | 14:33 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb- (3 more messages) | 14:38 |
| quiquell | weshay: marked https://review.openstack.org/610468 | 14:40 |
| quiquell | rlandy, panda: Can you vote again ? | 14:41 |
| quiquell | https://review.openstack.org/#/c/610468/ | 14:41 |
| *** quiquell is now known as quiquell|off | 14:42 | |
| rlandy | done | 14:49 |
| *** ssbarnea|bkp2 has quit IRC | 14:51 | |
| *** saneax has quit IRC | 14:51 | |
| *** ssbarnea has joined #oooq | 15:00 | |
| marios | rlandy: panda merge theses please https://review.openstack.org/#/c/613598/ https://review.openstack.org/#/c/613597/ needed for https://review.openstack.org/#/c/609708 | 15:16 |
| rlandy | looking | 15:17 |
| rlandy | weshay: ^^ your thoughts on ditching the 3-node job? | 15:20 |
| rlandy | we have gone through this before | 15:20 |
| rlandy | slagle's job? | 15:20 |
| marios | rlandy: its a done thing | 15:21 |
| marios | rlandy: i mean master/rocky already merged | 15:21 |
| rlandy | ok then | 15:21 |
| marios | rlandy: and also for tq https://review.openstack.org/#/c/609710/ | 15:21 |
| marios | rlandy: so i was also trying to remove the job definition too, since we no longer call it anywhere at least on master but it failed https://review.openstack.org/#/c/609708/ because ocata/pike still have it, hence those cherrypicks | 15:22 |
| marios | thanks | 15:22 |
| rlandy | marios: I approved calling the reviews that call the job | 15:23 |
| rlandy | do we have no plan to revive it at all? | 15:23 |
| marios | rlandy: not that i'm aware | 15:23 |
| rlandy | ie; remove the definition and be done? | 15:23 |
| rlandy | I know I am being pedantic about this | 15:23 |
| marios | rlandy: maybe for 'edge' where we have one node overcloud but who nodes | 15:24 |
| rlandy | but I went down this road a while back | 15:24 |
| * rlandy explains | 15:24 | |
| marios | rlandy: if you think we shouldn't then -1 the g/#/c/609708/ and write there? | 15:24 |
| marios | rlandy: so we can ask others to look too | 15:24 |
| marios | rlandy: but those cherypick we probably want regardless if we are no longer running that job on master/rocky/queens | 15:25 |
| rlandy | marios: left some notes in pvt | 15:25 |
| rlandy | if slagle approves, I'm fine with it | 15:25 |
| rlandy | it was his job to start | 15:26 |
| *** apetrich has quit IRC | 15:44 | |
| *** zul has quit IRC | 15:52 | |
| *** agopi is now known as agopi|food | 15:52 | |
| rlandy | panda: would you like to be QE on either of the toci_gate_test ot toci_quickstart variables tasks? | 15:55 |
| rlandy | https://tree.taiga.io/project/tripleo-ci-board/task/271 | 15:56 |
| rlandy | I am filling out details there now as I work on it | 15:56 |
| rlandy | marios: ^^ fyi | 15:56 |
| marios | rlandy: i could also do that if needed fyi | 15:56 |
| marios | i mean qe | 15:56 |
| rlandy | sure - if panda says no | 15:56 |
| rlandy | nota big deal - just asking as I work on the card | 15:56 |
| marios | yes never say no to panda | 15:56 |
| marios | https://www.youtube.com/watch?v=X21mJh6j9i4 | 15:57 |
| * marios runs | 15:57 | |
| rlandy | lol | 15:58 |
| *** apetrich has joined #oooq | 15:58 | |
| rlandy | marios; that's hysterical | 15:58 |
| rlandy | our new team theme | 15:59 |
| *** bogdando has quit IRC | 16:07 | |
| *** dtantsur is now known as dtantsur|afk | 16:07 | |
| *** dsneddon has quit IRC | 16:07 | |
| *** holser_ has quit IRC | 16:08 | |
| *** holser_ has joined #oooq | 16:08 | |
| *** holser_ has quit IRC | 16:12 | |
| *** kopecmartin is now known as kopecmartin|off | 16:13 | |
| weshay | rfolco|rover, panda for example "[openstack-dev] [tripleo] retirement of instack-undercloud" | 16:20 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb- (3 more messages) | 16:38 |
| *** agopi|food is now known as agopi | 16:38 | |
| *** trown is now known as trown|lunch | 16:43 | |
| *** amoralej is now known as amoralej|off | 17:20 | |
| ssbarnea | wow... it did merge. | 17:22 |
| *** dsneddon has joined #oooq | 17:25 | |
| *** ykarel|away has joined #oooq | 17:34 | |
| *** trown|lunch is now known as trown | 17:50 | |
| rascasoft | ssbarnea, me crosses fingers :D | 18:06 |
| rascasoft | last time it was the apocalypse | 18:07 |
| weshay | rfolco|rover, panda https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1 | 18:12 |
| *** dsneddon has quit IRC | 18:32 | |
| *** apetrich has quit IRC | 18:34 | |
| *** apetrich has joined #oooq | 18:35 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (4 more messages) | 18:38 |
| *** dsneddon has joined #oooq | 18:42 | |
| weshay | rfolco|rover, any updates on https://review.rdoproject.org/r/#/c/17102/ | 19:47 |
| rfolco|rover | weshay, testing now | 19:48 |
| rfolco|rover | weshay, btw tmate is still open... do not close pls | 19:49 |
| rlandy | panda: still around? | 19:54 |
| rlandy | panda: any reason we don;t collect files in tripleo_root? | 19:55 |
| weshay | rlandy, what is in tripleo_root? | 20:08 |
| rlandy | weshay: https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/run-v3.yaml#L73 | 20:08 |
| rlandy | weshay: we render the .j2 templates from jobs there | 20:09 |
| rlandy | for the reproducer, | 20:09 |
| rlandy | we could recreate all those file | 20:09 |
| rlandy | or just pick them up with the RIGHT vars in place | 20:09 |
| rlandy | if we saved them out in logs | 20:09 |
| rlandy | weshay: I made this change to see ... https://review.openstack.org/613678 | 20:10 |
| weshay | rlandy, oh.. collect them for the reproducer to consume them | 20:10 |
| rlandy | but the logs list is overridden in so many p;aces, not sure I have th right one | 20:10 |
| rlandy | weshay: yeah | 20:10 |
| weshay | interesting | 20:10 |
| rlandy | run-v3 actually creates them | 20:10 |
| rlandy | with a ton of vars | 20:10 |
| weshay | rlandy, I wonder if some of the values need to change based on where it's running | 20:10 |
| rlandy | weshay: that is what I am trying to compare | 20:11 |
| rlandy | we may get lucky | 20:11 |
| rlandy | or have to sed out a couple vars | 20:11 |
| weshay | rfolco|rover, I need you and sshnaidm|off to focus on ovb jobs across all brances as soon as you clear up | 20:12 |
| rlandy | I should probably make a change in rdocloud settings | 20:12 |
| weshay | rfolco|rover, afaict rdo-cloud is back on it's feet | 20:12 |
| rlandy | that one will run sooner | 20:12 |
| rfolco|rover | weshay, ack | 20:12 |
| weshay | rfolco|rover, rlandy fyi https://review.openstack.org/#/c/613575/5 | 20:14 |
| weshay | https://review.openstack.org/#/c/613640/ | 20:14 |
| rlandy | looks ok | 20:17 |
| rlandy | 29hr queue | 20:19 |
| rlandy | that's a first | 20:19 |
| rlandy | weshay: do you know where the artcl_collect_list: for rdocloud CI is kept? | 20:23 |
| rlandy | I think it's different | 20:23 |
| weshay | rlandy, I think it's default for the role | 20:23 |
| weshay | in collect_logs/defaults/main | 20:23 |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/collect-logs/defaults/main.yml#L4 | 20:24 |
| * rlandy tries | 20:24 | |
| rlandy | I edited https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/collect-logs.yml | 20:24 |
| rlandy | I think that changes upstream | 20:25 |
| * rlandy forgets what uses what | 20:25 | |
| weshay | rfolco|rover, while you are at it.. | 20:30 |
| weshay | <kforde> I spent a few hours this morning trying to get a grip on the ovb job failure | 20:30 |
| weshay | <weshay> kforde so I think y | 20:30 |
| weshay | oops | 20:30 |
| weshay | rfolco|rover, can you add something to roll this dir http://38.145.33.166/console-logs/ | 20:30 |
| rfolco|rover | weshay, ok | 20:30 |
| rfolco|rover | weshay, holy sh*t that dir has millions of files | 20:32 |
| rfolco|rover | 87468 | 20:32 |
| *** ykarel|away has quit IRC | 20:34 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (4 more messages) | 20:38 |
| rfolco|rover | weshay, where those files come from (under tebroker/console-logs) | 20:41 |
| *** openstackstatus has quit IRC | 20:42 | |
| *** openstack has joined #oooq | 20:43 | |
| *** ChanServ sets mode: +o openstack | 20:43 | |
| weshay | rfolco|rover, go to tmate | 20:45 |
| weshay | rfolco|rover, any blockers ping me | 20:46 |
| rfolco|rover | weshay, I see a bunch of bmc and baremetal logs... so I assume I can rotate those daily and compress one more time | 20:46 |
| weshay | rfolco|rover, let's do it weekly | 20:46 |
| weshay | on the dir | 20:47 |
| weshay | like every saturday | 20:47 |
| rfolco|rover | k | 20:47 |
| weshay | rfolco|rover, thanks.. panda fyi ^ | 20:47 |
| rfolco|rover | now requirements started to appear | 20:47 |
| rfolco|rover | customer never tells you that first time | 20:47 |
| rfolco|rover | :) | 20:48 |
| weshay | first one is always free :) | 20:49 |
| chkumar|off | weshay: panda left some comment on LT slides | 20:51 |
| chkumar|off | weshay: can we add tempest docs needs attension on customer portal which is kind of lagging behind | 20:53 |
| chkumar|off | as a known challeges | 20:53 |
| chkumar|off | where RHOS-13 tempest docs never got updated | 20:54 |
| chkumar|off | weshay: last one, need calloboration of different dfg to add more tempest tests to tempest plugin instead of adding of adding it to polarian -> is kind of challange also | 20:56 |
| weshay | chkumar|off, ya.. so I think we can push on that while we push on dfg's to get a standalone in their project | 20:56 |
| weshay | chkumar|off, we're not there yet | 20:57 |
| weshay | chkumar|off, we need to stablize the standalone deployment and it's testing | 20:58 |
| weshay | and doc | 20:58 |
| chkumar|off | weshay: but I looked at polarian they mapped data from test failures to polarain using reportal portal | 20:59 |
| chkumar|off | weshay: https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/DFG-opendaylight-odl-netvirt-13_director-rhel-virthost-3cont_2comp-ipv4-vxlan-ha-tempest-l2gw/65/artifact/.sh/ir-reportportal.log/ | 20:59 |
| chkumar|off | weshay: http://reportportal.io/ | 21:00 |
| chkumar|off | weshay: I will provide some more data on monday | 21:00 |
| weshay | chkumar|off, hey man | 21:00 |
| weshay | we're talking about two different things | 21:00 |
| chkumar|off | weshay: np, we can talk on monday | 21:01 |
| weshay | chkumar|off, you are a little out in left field | 21:01 |
| chkumar|off | weshay: feel free to check out this https://github.com/rhos-infra/reportportal it might be useful for us | 21:01 |
| weshay | chkumar|off, you are prposing upstream infra sets up reportportal? | 21:02 |
| *** trown is now known as trown|outtypewww | 21:03 | |
| chkumar|off | weshay: np, we have two projects, logreduce and reportportal home grown, we might merge together to get some useful data related to test matrix, I still need to evaluate | 21:04 |
| chkumar|off | weshay: I am not proposing I got these stuff through email so sharing | 21:04 |
| weshay | chkumar|off, k.. let's chat for 15 min monday | 21:05 |
| chkumar|off | weshay: sure | 21:05 |
| * chkumar|off hides back | 21:06 | |
| *** jbadiapa has quit IRC | 21:34 | |
| *** rlandy has quit IRC | 21:41 | |
| *** holser_ has joined #oooq | 22:33 | |
| *** holser_ has quit IRC | 22:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (4 more messages) | 22:38 |
| *** agopi has quit IRC | 23:02 | |
| *** holser_ has joined #oooq | 23:21 | |
| *** holser_ has quit IRC | 23:26 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
