| *** dtantsur|afk has quit IRC | 00:16 | |
| *** dsneddon__ has joined #oooq | 00:23 | |
| *** dsneddon__ has quit IRC | 00:36 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 00:50 |
|---|---|---|
| *** dsneddon__ has joined #oooq | 01:08 | |
| *** dsneddon__ has quit IRC | 01:21 | |
| *** dsneddon__ has joined #oooq | 01:52 | |
| *** dsneddon__ has quit IRC | 02:05 | |
| *** dsneddon__ has joined #oooq | 02:33 | |
| *** dsneddon__ has quit IRC | 02:46 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 02:50 |
| *** holser_ has joined #oooq | 03:06 | |
| *** holser_ has quit IRC | 03:13 | |
| *** dsneddon__ has joined #oooq | 03:19 | |
| *** dsneddon__ has quit IRC | 03:32 | |
| *** ykarel|away has joined #oooq | 03:34 | |
| *** ykarel|away has quit IRC | 03:36 | |
| *** ykarel|away has joined #oooq | 03:37 | |
| *** dsneddon__ has joined #oooq | 03:38 | |
| *** gkadam has joined #oooq | 03:48 | |
| *** dsneddon__ has quit IRC | 03:51 | |
| *** skramaja has joined #oooq | 03:52 | |
| *** udesale has joined #oooq | 04:07 | |
| *** dsneddon__ has joined #oooq | 04:22 | |
| *** dsneddon__ has quit IRC | 04:35 | |
| *** ratailor has joined #oooq | 04:41 | |
| *** ykarel|away is now known as ykarel | 04:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 04:50 |
| *** ykarel has quit IRC | 04:54 | |
| *** ratailor has quit IRC | 04:58 | |
| *** ratailor has joined #oooq | 04:59 | |
| *** dsneddon__ has joined #oooq | 05:04 | |
| *** ykarel has joined #oooq | 05:10 | |
| *** dsneddon__ has quit IRC | 05:17 | |
| chkumar|ruck | quique|rover|off: \o/ | 05:33 |
| *** dsneddon__ has joined #oooq | 05:44 | |
| *** dsneddon__ has quit IRC | 05:57 | |
| *** dsneddon__ has joined #oooq | 06:15 | |
| *** quique|rover|off is now known as quiquell|rover | 06:49 | |
| quiquell|rover | chkumar|ruck: o/ | 06:49 |
| quiquell|rover | chkumar|ruck: looks like tebroker is down | 06:49 |
| quiquell|rover | chkumar|ruck: all de centros nodes at RDO have issues | 06:49 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 06:50 |
| *** matbu has joined #oooq | 06:57 | |
| chkumar|ruck | quiquell|rover: can we restart it? | 06:58 |
| quiquell|rover | will check in a few | 06:59 |
| *** jfrancoa has joined #oooq | 07:05 | |
| quiquell|rover | zbr|ssbarnea: want to see issues at libvirt before refactor it, thats why I -1 your review | 07:07 |
| chkumar|ruck | brb going for lunch | 07:11 |
| *** saneax has joined #oooq | 07:11 | |
| *** dsneddon__ has quit IRC | 07:19 | |
| *** sshnaidm|off is now known as sshnaidm | 07:30 | |
| sshnaidm | chkumar|ruck, quiquell|rover zuul queue is 64 ours in rdo cloud :D | 07:33 |
| sshnaidm | it's down, right? | 07:34 |
| *** dtrainor has joined #oooq | 07:35 | |
| *** dtrainor_ has joined #oooq | 07:36 | |
| *** dtrainor has quit IRC | 07:39 | |
| marios | quiquell|rover: you guys seen this http://logs.openstack.org/67/631067/45/check/tripleo-ci-centos-7-containers-multinode/600f57c/job-output.txt.gz#_2019-02-03_18_48_54_214167 | 07:40 |
| marios | chkumar|ruck: ^ | 07:40 |
| marios | oh maybe is just on that patch ( from https://review.openstack.org/#/c/631067/) | 07:41 |
| marios | quiquell|rover: chkumar|ruck ^ all the jobs fail there likely from the patch | 07:41 |
| marios | sorry for alert | 07:41 |
| quiquell|rover | marios: rdo centos nodes are screw | 07:42 |
| *** ratailor_ has joined #oooq | 07:42 | |
| *** ratailor has quit IRC | 07:44 | |
| *** dtrainor_ has quit IRC | 07:47 | |
| *** dtrainor has joined #oooq | 07:48 | |
| *** ykarel is now known as ykarel|lunch | 07:51 | |
| *** dsneddon__ has joined #oooq | 07:54 | |
| *** quiquell|rover is now known as quique|rover|brb | 07:57 | |
| chkumar|ruck | marios: tristin is working on that | 08:01 |
| *** kopecmartin|off is now known as kopecmartin | 08:02 | |
| marios | chkumar|ruck: which one rdo nodes you mean ? thanks quique|rover|brb :/ let me know if you need votes on fixes etc | 08:03 |
| chkumar|ruck | marios: yes on rdo nodes, there is some problem with zookeeper | 08:04 |
| marios | chkumar|ruck: thanks | 08:04 |
| chkumar|ruck | sshnaidm: Hello | 08:06 |
| chkumar|ruck | sshnaidm: I am working on script to compare fs20/fs21 tempest tests results where should I keep it? | 08:06 |
| *** dsneddon__ has quit IRC | 08:07 | |
| sshnaidm | chkumar|ruck, what is purpose? To compare manually or to run it automatically? | 08:11 |
| chkumar|ruck | sshnaidm: wes asked to have a script the compare the results so that we can cleanup the skip list periodically | 08:12 |
| chkumar|ruck | I think the comparison would be manually or running automatically I have to grab the subunit files from fs021 and fs020 on each run | 08:12 |
| chkumar|ruck | let me finish the script and send it to the rdo-infra/ci-config | 08:13 |
| *** quique|rover|brb is now known as quiquell|rover | 08:16 | |
| *** dsneddon__ has joined #oooq | 08:35 | |
| *** dtrainor has quit IRC | 08:37 | |
| chkumar|ruck | marios: Hello | 08:38 |
| chkumar|ruck | marios: We donot run standalone scenario jobs against TQE? | 08:38 |
| chkumar|ruck | marios: I was trying to unskip telemetry tempest plugins tests | 08:38 |
| chkumar|ruck | marios: https://review.openstack.org/#/c/604311/ | 08:38 |
| *** d0ugal has quit IRC | 08:39 | |
| marios | chkumar|ruck: we do afaik /me checks | 08:39 |
| marios | chkumar|ruck: https://github.com/openstack-infra/tripleo-ci/blob/8776f84b0377cbc31c98d9548ec9719b4d17b09e/zuul.d/standalone-jobs.yaml#L120 | 08:39 |
| marios | chkumar|ruck: we restrict it to the role though | 08:40 |
| marios | chkumar|ruck: so if iyou want it somewhere else propose a change in ^ | 08:40 |
| *** ykarel|lunch is now known as ykarel | 08:40 | |
| chkumar|ruck | marios: let me do that | 08:40 |
| marios | chkumar|ruck: ack yeah i just checked your change if you want it on the validate tempest role we need to add to files for the jobs you want | 08:41 |
| chkumar|ruck | marios: yes on it | 08:41 |
| *** tosky has joined #oooq | 08:42 | |
| *** ccamacho has joined #oooq | 08:43 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** rascasoft has joined #oooq | 08:47 | |
| *** dsneddon__ has quit IRC | 08:48 | |
| *** dtrainor has joined #oooq | 08:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 08:50 |
| *** d0ugal has joined #oooq | 08:52 | |
| *** jtomasek has joined #oooq | 08:56 | |
| marios | zbr|ssbarnea: wut is zbr please | 08:59 |
| *** bogdando has joined #oooq | 09:01 | |
| zbr|ssbarnea | marios: me picking a new irc nick in order to avoid clashing with sshnaidm :p -- i will remove the suffix after a while. | 09:03 |
| marios | zbr|ssbarnea: ah ok. well fwiw, it would be indeed better to make it a suffix, rather than the prefix it currently is. like i would go looking for ssba<tab> and it would find you | 09:04 |
| marios | now it does not | 09:04 |
| marios | zbr|ssbarnea: oh i see.. sshn clash | 09:05 |
| marios | zbr|ssbarnea: but really? | 09:05 |
| marios | does it? | 09:05 |
| zbr|ssbarnea | marios: i didn't want to do it initially but the increase in miss-tagging convinced me. i think is good to avoid overlapping of the two first characters. | 09:06 |
| marios | zbr|ssbarnea: sorisbarn has a certain ring to it | 09:12 |
| quiquell|rover | sshnaidm: o/ what do we doo with https://review.openstack.org/#/c/633444/ ? | 09:14 |
| *** apetrich has joined #oooq | 09:19 | |
| sshnaidm | quiquell|rover, libvirt job fails there, but jobs here pass: https://review.rdoproject.org/r/#/c/18558/ | 09:21 |
| *** dsneddon__ has joined #oooq | 09:21 | |
| sshnaidm | quiquell|rover, I'm fine to merge it, need weshay to remove his -1 | 09:21 |
| quiquell|rover | sshnaidm: but pssing jobs there end up at a good hypervisor | 09:25 |
| quiquell|rover | sshnaidm: I am possitive that when we forced it it was working | 09:25 |
| quiquell|rover | sshnaidm: but it's good if we at least have a log with the latest and bad hypervisor and success | 09:25 |
| sshnaidm | quiquell|rover, log of what? | 09:25 |
| quiquell|rover | sshnaidm: for example this centos7 one is passing http://logs.rdoproject.org/58/18558/33/check/tripleo-ci-reproducer-centos-7-libvirt/fb7d554/tripleo-ci-reproducer/libguestf-env.sh | 09:26 |
| quiquell|rover | sshnaidm: but there is not force_tcg because was not needed | 09:26 |
| sshnaidm | quiquell|rover, I se | 09:27 |
| quiquell|rover | sshnaidm: weshay has a point, let's ensure that we have both success and force_tcg | 09:32 |
| quiquell|rover | sshnaidm: I am sure the latest issue is not related but let's confirm | 09:32 |
| *** dsneddon__ has quit IRC | 09:34 | |
| *** derekh has joined #oooq | 09:34 | |
| marios | sshnaidm: do you know where the extend time script is on beaker boxes i can't see it in /root | 09:42 |
| sshnaidm | marios, hmm.. I don't find it too, I think it was somewhere in /opt | 09:48 |
| chkumar|ruck | quiquell|rover: I am taking a look at fedora 28 failure https://bugs.launchpad.net/tripleo/+bug/1814516 | 09:52 |
| openstack | Launchpad bug 1814516 in tripleo "[Fedora 28] [standalone]'NoneType' object is not iterable while generating template" [Critical,Triaged] | 09:52 |
| chkumar|ruck | it is unrelated from my changes added in the gates, I am seeing why it is coming | 09:52 |
| quiquell|rover | chkumar|ruck: let me check | 09:53 |
| quiquell|rover | chkumar|ruck: Maybe this just miss a check for network_data | 09:54 |
| quiquell|rover | chkumar|ruck: and fail or no iterate if None | 09:54 |
| sshnaidm | marios, maybe they don't exist anymore | 09:54 |
| *** gkadam_ has joined #oooq | 09:55 | |
| *** gkadam has quit IRC | 09:58 | |
| *** chkumar|ruck has quit IRC | 09:58 | |
| *** holser_ has joined #oooq | 10:00 | |
| *** gkadam__ has joined #oooq | 10:02 | |
| *** dsneddon__ has joined #oooq | 10:04 | |
| *** gkadam_ has quit IRC | 10:05 | |
| *** chem has joined #oooq | 10:05 | |
| *** sanjayu_ has joined #oooq | 10:09 | |
| *** saneax has quit IRC | 10:10 | |
| *** dsneddon__ has quit IRC | 10:17 | |
| *** chandan_kumar has joined #oooq | 10:24 | |
| *** chandan_kumar is now known as chkumar|ruck | 10:24 | |
| *** dtrainor has quit IRC | 10:46 | |
| *** dsneddon__ has joined #oooq | 10:46 | |
| *** holser_ has quit IRC | 10:46 | |
| *** dtrainor has joined #oooq | 10:48 | |
| *** dtrainor_ has joined #oooq | 10:49 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (3 more messages) | 10:50 |
| *** dtrainor has quit IRC | 10:52 | |
| *** chem has quit IRC | 10:53 | |
| *** holser_ has joined #oooq | 10:53 | |
| arxcruz | chkumar|ruck: what do you mean need that to enable telemetry tests? | 10:53 |
| chkumar|ruck | arxcruz: sorry, commented | 10:57 |
| *** dsneddon__ has quit IRC | 10:59 | |
| arxcruz | chkumar|ruck: so, you're saying that on validate-tempest change you don't get all jobs running ? | 10:59 |
| chkumar|ruck | arxcruz: yes | 10:59 |
| chkumar|ruck | arxcruz: https://review.openstack.org/#/c/634644/2/zuul.d/standalone-jobs.yaml -> only it was running on roles/standlone | 11:00 |
| quiquell|rover | sshnaidm: I don't see http://38.145.33.166/influxdb_stats | 11:14 |
| quiquell|rover | sshnaidm: is tebroker down for good ? | 11:14 |
| *** udesale has quit IRC | 11:14 | |
| quiquell|rover | sshnaidm: or we still have it to count stacks ? | 11:14 |
| sshnaidm | quiquell|rover, I think everything is screwed on rdo cloud | 11:16 |
| chkumar|ruck | quiquell|rover: sshnaidm mhu and cshatri is working on clean up the nodes | 11:16 |
| chkumar|ruck | it is more than 10000, I think | 11:17 |
| quiquell|rover | ack | 11:17 |
| sshnaidm | quiquell|rover, try again http://38.145.33.166/influxdb_stats | 11:17 |
| quiquell|rover | huff it will take time | 11:17 |
| sshnaidm | quiquell|rover, works for me | 11:17 |
| chkumar|ruck | ykarel: marios http://logs.openstack.org/11/604311/8/check/tripleo-ci-centos-7-scenario001-standalone/ed6f18f/logs/tempest.html telemetry issue still not fixed | 11:18 |
| sshnaidm | wow | 11:18 |
| ykarel | chkumar|ruck, yup that's what i anticipated, as i seen this issue in poi time to time | 11:18 |
| sshnaidm | chkumar|ruck, I think it's 1000 nodes, not 10 000 | 11:18 |
| chkumar|ruck | oh sorry got extra 0 | 11:18 |
| sshnaidm | quiquell|rover, you can see ports_down=25 there, need to add a graph with ports also. | 11:19 |
| sshnaidm | ACTIVE=0,BUILD=2,ERROR=998,DELETED=0 | 11:19 |
| *** ccamacho has quit IRC | 11:20 | |
| quiquell|rover | sshnaidm: I think this is breaking grafana | 11:20 |
| quiquell|rover | sshnaidm: yep | 11:24 |
| sshnaidm | quiquell|rover, how? | 11:24 |
| quiquell|rover | sshnaidm: try to run telegraf --test --config telegraf.d/rdocloud.conf | 11:24 |
| sshnaidm | quiquell|rover, I'm not on the server.. | 11:25 |
| quiquell|rover | sshnaidm: best way is to do in vim a "goto" to go to the char | 11:25 |
| quiquell|rover | sshnaidm: don't ned the server | 11:25 |
| quiquell|rover | sshnaidm: at a clone just run the command is in test mode | 11:25 |
| sshnaidm | quiquell|rover, can you paste the output? | 11:25 |
| sshnaidm | I don't have it installed | 11:26 |
| quiquell|rover | sshnaidm: found the issue let me fix | 11:27 |
| quiquell|rover | sshnaidm: total=1000, | 11:27 |
| quiquell|rover | extra comma | 11:27 |
| quiquell|rover | maybe we can run the telegraf --test | 11:27 |
| quiquell|rover | at reviews | 11:27 |
| quiquell|rover | but depends on input adata so it's not reliable | 11:28 |
| *** dsneddon__ has joined #oooq | 11:28 | |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/r/18697 | 11:30 |
| sshnaidm | quiquell|rover, hmm.. but it worked anyhow | 11:32 |
| panda|off | arxcruz: https://review.openstack.org/634380 ready to be reviewed ? | 11:32 |
| panda|off | marios: how's the design going ? I remember you posted some patch on friday but I don't know where they are ... | 11:33 |
| *** dtrainor_ has quit IRC | 11:33 | |
| *** dtrainor has joined #oooq | 11:33 | |
| zbr|ssbarnea | quiquell|rover: chkumar|ruck : i am unable to find the etherpad for the ruck/rover, please make a note that one hour before community meeting is LP-bug bashing session with jaosorior -- one of you should attend. | 11:38 |
| zbr|ssbarnea | is a private session to sort LP bugs (likely BJ) | 11:39 |
| zbr|ssbarnea | it worked quite nice for the last sprint, and i think we should make it a common practice. | 11:39 |
| arxcruz | panda|off: not ready for review yet, i'm still workong on it | 11:40 |
| quiquell|rover | zbr|ssbarnea: https://review.rdoproject.org/etherpad/p/ruckrover-unisprint5 | 11:40 |
| quiquell|rover | zbr|ssbarnea: this is new stuff ? | 11:40 |
| panda|off | arxcruz: ok thanks | 11:40 |
| *** dsneddon__ has quit IRC | 11:42 | |
| *** ratailor__ has joined #oooq | 11:42 | |
| *** ratailor_ has quit IRC | 11:45 | |
| panda|off | Tengu: ping about https://review.openstack.org/634635 | 11:45 |
| quiquell|rover | sshnaidm: Do we have to load the new rdocloud.py at nodepool ? | 11:46 |
| quiquell|rover | sshnaidm: or is infra as code ? | 11:46 |
| Tengu | panda|off: ? | 11:46 |
| panda|off | Tengu: ! | 11:46 |
| Tengu | does it create some issues? | 11:46 |
| panda|off | Tengu: no, I'd like to understand what it does, have time to explain ? | 11:47 |
| Tengu | panda|off: ah, yes, of course. I thought the commit message and embeded comments were sufficient. | 11:47 |
| panda|off | Tengu: it is for the what and why, a bit less for the how. | 11:48 |
| Tengu | panda|off: so basically, until now, we didn't get any chance to have failed container stdout logs, hence no way to understand what's going on | 11:48 |
| Tengu | panda|off: for instance, I was pointed to a failed upgrade CI task, and saw a couple of container in Exited (1) state - but we actually don't have any way to know WHY | 11:48 |
| Tengu | -> the collect.yaml code didn't loop on the stopped containers, so no log, no debug, nothing. | 11:49 |
| Tengu | my patch intends to provide all the stdout for all containers, running or not. We might want to filter that in order to only get Exited (non-zero) if it creates some issues regarding disk space. | 11:49 |
| Tengu | panda|off: does it make sense? | 11:50 |
| sshnaidm | quiquell|rover, should upload it, but worth to check anyway | 11:50 |
| panda|off | Tengu: ok, 1 doubt and three concerns: the doubt is if this keeps track of all the execution of the containers in the past. The concerns are 1) space 2) time 3) you're logging on a dir named after the container id, how do you expect to find what you're looking for in the logs | 11:52 |
| Tengu | panda|off: nope, we're logging in a dirname with the container name | 11:52 |
| Tengu | panda|off: that will loop on all containers from the output of "$engine ps -a" - so yeah, that might be "big", but not that big either. Time might be more a concern, although the main concern I have is space (hence the -w for analysis) | 11:53 |
| zbr|ssbarnea | sshnaidm: can you please have a look at https://review.rdoproject.org/r/#/c/18699/2 ? (ovb cleanup filter fix). thanks. | 11:54 |
| *** dsneddon__ has joined #oooq | 11:55 | |
| panda|off | Tengu: mmhh, sorry for the dumb question, but if you use always the same name, two containers that have diff id because diff execution will have the same name and you'll overwrite the logs ? I don't have a clear view how how docker ps looks at the end of a deployment .. | 11:55 |
| Tengu | panda|off: can't get the same name for container | 11:56 |
| Tengu | it's refused by the engine itself. | 11:56 |
| Tengu | so that solve this concern ;). | 11:56 |
| Tengu | panda|off: so, basically, we shouldn't get that much time difference with this new thing. name are unique for containers, so we won't override anything. and we keep a clean, readable directory tree as we are using the container name instead of id. So the main issue is the space, although on that part I'm not that worried | 11:59 |
| Tengu | panda|off: most of the application/runtime logs aren't present in the container stdout. | 11:59 |
| zbr|ssbarnea | panda|off or rfolco can you also send add me to the invite on trupleo-ci-community meeting, I see only your two added. | 12:01 |
| *** jfrancoa is now known as jfrancoa|lunch | 12:01 | |
| panda|off | Tengu: is thre a change dependent on this that tests this in jobs ? | 12:02 |
| panda|off | Tengu: It may be beneficial to see this in action | 12:03 |
| Tengu | panda|off: hmmm nope, but we should get the logs present directly in the CI for that precise job | 12:03 |
| Tengu | panda|off: for instance: http://logs.openstack.org/35/634635/3/check/tripleo-ci-centos-7-standalone-os-tempest/e0066de/logs/undercloud/var/log/extra/podman/containers/ | 12:03 |
| zbr|ssbarnea | it seems that weshay organized this one and I cannot add myself to it. probably he did not allow us to add ourselves, not sure. | 12:04 |
| Tengu | zbr|ssbarnea: btw: here's the result for my patch on quickstart-extra and the new logging: http://logs.openstack.org/35/634635/3/check/tripleo-ci-centos-7-standalone-os-tempest/e0066de/logs/undercloud/var/log/extra/podman/containers/ :) | 12:04 |
| zbr|ssbarnea | Tengu: i think that is kinda obvious that having folders does not help with the UX here. | 12:05 |
| panda|off | my is my gertty not showing this job ? :/ | 12:05 |
| Tengu | zbr|ssbarnea: what do you mean? you'd rather get /var/log/extra/podman/container_name_stdout directly? | 12:05 |
| Tengu | panda|off: CI still not over, I'm picking it directly from zuul | 12:06 |
| Tengu | zbr|ssbarnea: or /var/log/extra/podman/stdouts/container_name.txt.gz ? | 12:07 |
| *** dsneddon__ has quit IRC | 12:08 | |
| zbr|ssbarnea | Tengu: yes, i would but i see that (very) few do also have other files. wait for feedback from others before acting on my question. i am in favour of a flatter structure. | 12:08 |
| Tengu | zbr|ssbarnea: yeah, so the other files are taken from the running containers, in the loop just above the one I'm adding. | 12:08 |
| sshnaidm | zbr|ssbarnea, commented | 12:08 |
| sshnaidm | zbr|ssbarnea, can I ask you just to fix the string and not to change anything? is it really so difficult to do? | 12:09 |
| Tengu | zbr|ssbarnea: https://review.openstack.org/#/c/634635/3/roles/collect-logs/tasks/collect.yml@271 (not sure I made the correct link, sorry) | 12:09 |
| Tengu | that block loops "only" over running containers - and it wasn't that easy to make it loop also on non-running due to the "exec" calls. | 12:10 |
| panda|off | Tengu: ok,I misunderstood the whole point probably, I see what you're doing. I'll ping again after you remove the -W | 12:13 |
| panda|off | Tengu: you also probably already noticed there's a bit of nesting there, logs inside logs with the same content. | 12:14 |
| Tengu | panda|off: cool :). and thank you for your questions ;). Do you think I should update the commit message maybe? | 12:14 |
| panda|off | Tengu: no, probably more a lack of kwnledge on container deployment on my part | 12:15 |
| Tengu | panda|off: ok :). the nesting is indeed a "thing" - but I will probably avoid digging further in it. Especially if we can do the move toward 'service logging to stdout' - the whole collect.yaml thing will be much more different. | 12:17 |
| Tengu | zbr|ssbarnea: soo about disk space, any bad news? | 12:18 |
| sshnaidm | panda|off, why not to add blackregex of tempest in required featureset here? https://review.openstack.org/#/c/634144/1 | 12:19 |
| zbr|ssbarnea | Tengu: seems 104M reported at http://logs.openstack.org/35/634635/3/check/tripleo-ci-centos-7-standalone-os-tempest/e0066de/logs/log-size.txt | 12:20 |
| *** ccamacho has joined #oooq | 12:20 | |
| Tengu | zbr|ssbarnea: is it a problem? | 12:21 |
| Tengu | 4.5M /home/zuul/workspace/logs/undercloud/var/log/extra/podman/containers seems "nice" enough? | 12:21 |
| zbr|ssbarnea | Tengu: no. is quite small. we can fix it later if we spot a issue and we can add a tail to it. | 12:21 |
| Tengu | cool | 12:22 |
| Tengu | So I can drop the -w then. | 12:22 |
| *** rf0lc0 is now known as rfolco | 12:26 | |
| quiquell|rover | chkumar|ruck: who goes to the ci scalation ? | 12:30 |
| chkumar|ruck | quiquell|rover: /em taking care of | 12:30 |
| *** holser_ has quit IRC | 12:31 | |
| quiquell|rover | chkumar|ruck: ack | 12:31 |
| quiquell|rover | chkumar|ruck: thanks mate | 12:31 |
| chkumar|ruck | quiquell|rover: just need to some update on manila temepst failure | 12:31 |
| chkumar|ruck | *need some | 12:32 |
| panda|off | sshnaidm: it's a rapidly moving situation, I thing featureset30 is destined to scenario007, but last time I checked was not ready to be moved to ML2/OVS, so it would require coordination to put everythign in place at the right time | 12:32 |
| sshnaidm | panda|off, the question is whether this test runs in jobs w/o ovn | 12:33 |
| quiquell|rover | chkumar|ruck: We need new version of ceph, previous one didn't have the fix | 12:35 |
| quiquell|rover | chkumar|ruck: they are building new one at koji and then we will update containers | 12:36 |
| quiquell|rover | ykarel: ^ is that it about ceph version ? | 12:36 |
| *** ccamacho has quit IRC | 12:36 | |
| chkumar|ruck | quiquell|rover: Did we get ceph 12.2.10 got built in order to fix manila tempest issue? | 12:37 |
| quiquell|rover | chkumar|ruck: yep but It didn't have the fix | 12:38 |
| ykarel | quiquell|rover, who is buildling? | 12:38 |
| *** ccamacho has joined #oooq | 12:40 | |
| *** jpena is now known as jpena|lunch | 12:40 | |
| quiquell|rover | ykarel: alphacc | 12:40 |
| ykarel | quiquell|rover, ack , maybe fultonj knows about gfindente | 12:40 |
| ykarel | and his plan for ceph | 12:40 |
| quiquell|rover | fultonj: ack, better to say to alphacc to wait for gfidente ? | 12:41 |
| chkumar|ruck | quiquell|rover: thanks, updated :-) | 12:41 |
| chkumar|ruck | arxcruz: Hello | 12:41 |
| chkumar|ruck | arxcruz: Can we do a new release of python-temepstconf? | 12:42 |
| quiquell|rover | panda|off: damn... rdo is down no periodics for fedora :-/ | 12:42 |
| arxcruz | chkumar|ruck: why? | 12:42 |
| *** dsneddon__ has joined #oooq | 12:42 | |
| chkumar|ruck | arxcruz: current release does not have py3 version | 12:42 |
| chkumar|ruck | arxcruz: it is needed by afazekas | 12:43 |
| chkumar|ruck | arxcruz: https://github.com/openstack/releases/blob/147d14e6c93275b8145e6e9bf5e6b42ef26153e0/deliverables/_independent/python-tempestconf.yaml needs to be updated | 12:43 |
| arxcruz | chkumar|ruck: ok | 12:46 |
| quiquell|rover | sshnaidm: are you taking care of https://review.rdoproject.org/r/#/c/18621 ? | 12:46 |
| sshnaidm | quiquell|rover, yeah, I'll check it | 12:48 |
| quiquell|rover | sshnaidm: now it dumps daemon.json but I don't see it it also dumps docker system info but registry is not there | 12:49 |
| quiquell|rover | :-/ | 12:49 |
| quiquell|rover | sshnaidm: But I see the ansible tasks that write that running | 12:49 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-undercloud-containers @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq- (2 more messages) | 12:50 |
| *** ratailor__ has quit IRC | 12:51 | |
| *** ccamacho has quit IRC | 12:51 | |
| sshnaidm | quiquell|rover, where do you see it running? | 12:51 |
| quiquell|rover | sshnaidm: I see "Write modified docker daemon config"Â changed | 12:52 |
| quiquell|rover | sshnaidm: at ansible execution | 12:52 |
| *** rlandy has joined #oooq | 12:53 | |
| sshnaidm | quiquell|rover, you create it in pre.yml, right? | 12:53 |
| quiquell|rover | sshnaidm: daemon.json at run.yaml | 12:54 |
| sshnaidm | quiquell|rover, https://github.com/rdo-infra/ansible-role-tripleo-ci-reproducer/blob/master/playbooks/tripleo-ci-reproducer/pre.yaml#L88 | 12:54 |
| *** dsneddon__ has quit IRC | 12:55 | |
| quiquell|rover | sshnaidm: Ahh yep we create at pre and modify at run I mean | 12:56 |
| *** jfrancoa|lunch is now known as jfrancoa | 12:56 | |
| *** trown|outtypewww is now known as trown | 12:58 | |
| quiquell|rover | sshnaidm: do we update toolbox with changes at ci-config ? | 12:58 |
| sshnaidm | quiquell|rover, should be, doesn't it work? | 12:58 |
| sshnaidm | quiquell|rover, if no, need to check why | 12:58 |
| quiquell|rover | sshnaidm: ci-config clone has old version there | 13:00 |
| weshay | quiquell|rover, chkumar|ruck morning.. so something fixed the centos krb5 issue? | 13:00 |
| quiquell|rover | weshay: noop is ok now so looks like | 13:01 |
| quiquell|rover | chkumar|ruck: was looking into it | 13:01 |
| weshay | ya.. zbr|ssbarnea k k.. so thinking of preventative action there w/ me is a ++ | 13:01 |
| quiquell|rover | weshay: have mariadb stuff ready, have change it a little take a look at your patches | 13:02 |
| quiquell|rover | weshay: if you are ok I will workflow it | 13:02 |
| weshay | k .. /me looks | 13:02 |
| chkumar|ruck | weshay: the error got vanished , might happened both krb5 and libkadm5 landed at same time | 13:02 |
| chkumar|ruck | weshay: asked for help from centos-devel, no help | 13:02 |
| chkumar|ruck | weshay: https://bugs.centos.org/view.php?id=15775 | 13:02 |
| weshay | chkumar|ruck, anything posted to cetos-devel? | 13:03 |
| chkumar|ruck | weshay: I mean on Irc | 13:03 |
| quiquell|rover | panda|off: this is the only periodic f28 job I have to check 200~periodic-tripleo-ci-fedora-28-standalone-master ? | 13:04 |
| weshay | quiquell|rover, ah thanks... I forgot I left it in that state.. thanks man | 13:05 |
| weshay | brb | 13:05 |
| quiquell|rover | weshay: no problem I have ideas to propagate that to queue size and noops | 13:06 |
| quiquell|rover | weshay: they are one shot | 13:06 |
| quiquell|rover | weshay: no need for series db | 13:06 |
| quiquell|rover | panda|off: they are all skipped | 13:08 |
| *** ykarel is now known as ykarel|away | 13:08 | |
| quiquell|rover | panda|off: since periodic-tripleo-fedora-28-master-containers-build is failing | 13:08 |
| quiquell|rover | panda|off: So we don't have a good periodic jobs for f28 | 13:09 |
| quiquell|rover | panda|off: I think I am going to do a manual promotion to unblock upstream f28 job | 13:09 |
| weshay | ah cool | 13:09 |
| quiquell|rover | weshay: we need a f28 promotion | 13:10 |
| quiquell|rover | weshay: but f28 periodic jobs are screw | 13:10 |
| quiquell|rover | weshay: what do we do ? | 13:10 |
| weshay | quiquell|rover, same thing we do everyday quique.. https://goo.gl/images/E83dZR | 13:12 |
| weshay | get it fixed :) | 13:12 |
| * weshay looks | 13:12 | |
| weshay | quiquell|rover, rdo cloud was down most of the weekend | 13:12 |
| quiquell|rover | weshay: I know, but I think they were kind of WIP | 13:12 |
| quiquell|rover | weshay: Or do we have to fix this http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-fedora-28-master-containers-build/1800043/logs/undercloud/home/zuul/undercloud_install.log.txt.gz ? | 13:12 |
| weshay | looks like zuul in rdo-cloud is still f'd | 13:12 |
| weshay | see jobs at 64hrs chkumar|ruck <--- | 13:13 |
| quiquell|rover | yep | 13:13 |
| weshay | ya.. rdo is still f'd | 13:13 |
| weshay | quiquell|rover, since when is the promoter running on a container? | 13:14 |
| weshay | how did I not know this ... lolz | 13:15 |
| weshay | quiquell|rover, can we move to done? https://trello.com/c/vV4WR3r2/868-cixlp1814059tripleociproa-full-disk-at-promoter | 13:15 |
| quiquell|rover | weshay: what ? | 13:16 |
| weshay | chkumar|ruck, https://trello.com/c/xUy82HzR/869-cixlp1813913tripleociproa-periodic-tripleo-fedora-28-master-containers-build-failing-with-unauthorized-access-to-rdo-registry | 13:16 |
| quiquell|rover | weshay: promoter in a container ? | 13:16 |
| quiquell|rover | weshay: No, this is the docker images we push | 13:17 |
| weshay | https://review.rdoproject.org/r/#/c/18654/4/ci-scripts/infra-setup/roles/promoter/tasks/main.yml | 13:17 |
| weshay | oh | 13:17 |
| weshay | chkumar|ruck, when you mark https://trello.com/c/xUy82HzR/869-cixlp1813913tripleociproa-periodic-tripleo-fedora-28-master-containers-build-failing-with-unauthorized-access-to-rdo-registry | 13:17 |
| quiquell|rover | weshay: panda|off suggested to move to overlay2 so we can do parallel promotion | 13:17 |
| weshay | DFG OOOCI that means the root cause is due to OOOCI | 13:18 |
| quiquell|rover | weshay: remember we went from parallel to sequencial because of that | 13:18 |
| chkumar|ruck | weshay: we fixed the fedora 28 issue cirrently we need manual promotion to know whether that issue is fixed or not | 13:18 |
| weshay | chkumar|ruck, help me understand how ^ unauthorized access is tripleo-ci's root cause | 13:18 |
| weshay | chkumar|ruck, panda|off we're still manually promoting fedora28 jobs right? | 13:19 |
| chkumar|ruck | weshay: updated the root cause | 13:19 |
| weshay | chkumar|ruck, /me still see's OOOCI | 13:19 |
| weshay | what is the root cause? | 13:20 |
| *** ccamacho has joined #oooq | 13:20 | |
| weshay | can you explain that? | 13:20 |
| *** ccamacho has quit IRC | 13:20 | |
| *** ccamacho has joined #oooq | 13:20 | |
| weshay | chkumar|ruck, quiquell|rover who is joining the cix call? | 13:21 |
| quiquell|rover | weshay: chkumar|ruck | 13:22 |
| panda|off | quiquell|rover: look at the fedora28 with centos8 contaeinrs periodic job | 13:22 |
| * panda|off about to finish the lunch | 13:22 | |
| quiquell|rover | panda|off: ahh ok | 13:22 |
| chkumar|ruck | weshay: when tripleo is getting deployed, it tried to read file that time, it is trying to read the file that time unclosedfile error that I fixed it and part from that it is tryign to acees the registery that'gives unauthorized error | 13:23 |
| chkumar|ruck | weshay: I will be joining the cix call | 13:23 |
| weshay | chkumar|ruck, k.. thanks | 13:23 |
| chkumar|ruck | weshay: what shoudl I put the root cause here https://trello.com/c/xUy82HzR/869-cixlp1813913tripleociproa-periodic-tripleo-fedora-28-master-containers-build-failing-with-unauthorized-access-to-rdo-registry ? | 13:23 |
| *** ykarel|away has quit IRC | 13:23 | |
| *** dsneddon__ has joined #oooq | 13:24 | |
| weshay | chkumar|ruck, is the fix in tripleo-ci/tripleo-quickstart/extras or ci-scripts? | 13:25 |
| chkumar|ruck | weshay: fix is in python-tripleoclient | 13:25 |
| weshay | is the fix in tripleo-common or python-tripleoclient | 13:25 |
| weshay | ya.. so then it's DF | 13:26 |
| weshay | we can fix it of course | 13:26 |
| weshay | but DFG = DF | 13:26 |
| quiquell|rover | panda|off: there is a pass with http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-fedora-28-centos-7-containers-standalone-master/374f5f6/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz | 13:26 |
| weshay | chkumar|ruck, make sense? | 13:26 |
| quiquell|rover | panda|off: going to promote manually | 13:26 |
| quiquell|rover | weshay: ^ | 13:26 |
| weshay | +1 | 13:26 |
| chkumar|ruck | weshay: yes | 13:26 |
| weshay | quiquell|rover, chkumar|ruck f28 IS manual promotions only | 13:26 |
| weshay | for now | 13:26 |
| weshay | unless I've missed something | 13:27 |
| quiquell|rover | weshay: yes but we have to look at periodic-tripleo-ci-fedora-28-centos-7-containers-standalone-master | 13:27 |
| weshay | ok.. | 13:27 |
| quiquell|rover | weshay: that's what I mean panda|off just point it out to me | 13:27 |
| weshay | when I went to bed last night.. both upstream and rdo were broken.. so | 13:27 |
| weshay | IMHO.. today is turning out pretty well | 13:27 |
| weshay | just rdo is broken | 13:27 |
| quiquell|rover | Pufff I need y our spirit :-/ | 13:27 |
| quiquell|rover | sshnaidm: I am going to remove te-broker stuff from creds doc | 13:28 |
| zbr|ssbarnea | weshay: chkumar|ruck got reply from centos team: they say is our fault we got into this issue due to out of sync mirrors | 13:29 |
| zbr|ssbarnea | it seems that this can happen when base and updates get out of sync. they told me that many people forget to sync both and if only updates gets refreshed this can happen. | 13:30 |
| zbr|ssbarnea | now I am not sure which mirrors were used, but we clearly need to dig it and assure we avoid it in the future. | 13:30 |
| *** chem has joined #oooq | 13:30 | |
| *** jpena|lunch is now known as jpena | 13:31 | |
| weshay | chkumar|ruck, u hear me? | 13:31 |
| *** ccamacho has quit IRC | 13:33 | |
| quiquell|rover | chkumar|ruck: promoted f28, will re-run my reproducer | 13:35 |
| *** ccamacho has joined #oooq | 13:36 | |
| *** dsneddon__ has quit IRC | 13:37 | |
| *** quiquell|rover is now known as quique|rover|lun | 13:38 | |
| *** quique|rover|lun is now known as quique|rover|lch | 13:38 | |
| sshnaidm | quique|rover|lch, just |eat | 13:39 |
| *** panda|off is now known as panda | 13:40 | |
| quique|rover|lch | sshnaidm: silly me | 13:40 |
| *** quique|rover|lch is now known as quique|rover|eat | 13:40 | |
| panda | quique|rover|lch: try also deliveroo | 13:40 |
| *** ykarel has joined #oooq | 13:41 | |
| zbr|ssbarnea | panda: deliveroooq | 13:41 |
| chkumar|ruck | quique|rover|eat: cool, thanks! | 13:43 |
| weshay | arxcruz, can you help get bz on this https://trello.com/c/DfQAjJrJ/819-cixlp1802971tripleociproa-tempest-volumebootpattern-and-basicops-running-concurrently-causing-timeouts | 13:45 |
| arxcruz | weshay: ok, checking | 13:45 |
| weshay | https://trello.com/c/ro5E87Dy/852-cixlp1809974tripleociproa-master-check-jobs-failing-undercloud-install-with-mistralclientapiexception-authorization-failed-canno | 13:46 |
| weshay | apetrich, good morning sir.. so we need an equiv bz open on that issue that blocks a release | 13:47 |
| weshay | apetrich, can you help me out there? | 13:47 |
| weshay | arxcruz, same w/ you.. the bz needs to be marked blocker | 13:47 |
| weshay | and trello card updated w/ the bz | 13:47 |
| apetrich | weshay, I can. just a moment that I'm on a meeting. | 13:47 |
| weshay | apetrich, ya.. no rush man.. thanks | 13:48 |
| apetrich | weshay, we have it https://bugzilla.redhat.com/show_bug.cgi?id=1670067 | 13:49 |
| openstack | bugzilla.redhat.com bug 1670067 in openstack-mistral "master check jobs failing undercloud install with "mistralclient...APIException Authorization failed: Cannot authenticate without an auth_url"" [High,Assigned] - Assigned to apetrich | 13:49 |
| *** zul has joined #oooq | 13:49 | |
| weshay | apetrich, rock.. update the card w/ it. .and ur off the hook | 13:50 |
| apetrich | weshay, but not sure that is a real blocker because I was unable to reproduce and the gate wasn't locked by it it happened a few times and after that almost all passed | 13:50 |
| arxcruz | weshay: well... the logs are missing, can we unskip the test to collect the logs? | 13:50 |
| arxcruz | without data, it's kinda hard to debug it | 13:51 |
| arxcruz | :/ | 13:51 |
| weshay | apetrich, ok.. /me moves to done .. cut and paste these comments into the card :) | 13:51 |
| apetrich | weshay, aye we removed the blocker | 13:51 |
| apetrich | doing that | 13:51 |
| weshay | arxcruz, what does fs21 say :) | 13:51 |
| apetrich | weshay, done | 13:52 |
| weshay | apetrich, thanks | 13:52 |
| apetrich | no worries :) I spent some time last week chasing that | 13:52 |
| arxcruz | weshay: it's passing :) | 13:53 |
| arxcruz | weshay: nevermind, network_basic_ops is failing | 13:54 |
| arxcruz | weshay: i'm deploying a fs021 to debug | 13:56 |
| weshay | arxcruz, ok.. that job will take all day to run.. but you know this | 13:56 |
| arxcruz | weshay: well, the failure on fs021 is different from the bug | 13:56 |
| weshay | arxcruz, still interested in cleaning up the skip list.. | 13:56 |
| weshay | is that something you are thinking about? | 13:56 |
| weshay | re: what we discussed | 13:57 |
| arxcruz | weshay: that also, but problem is that the fs021 the logs are not showing the same failure as in the bug, so i don't know if it's related or not | 13:57 |
| weshay | arxcruz, ok.. if it's just not relevant any more.. than kill the card w/ our conversation | 13:58 |
| weshay | arxcruz, however... we really do need some movement / progress on leveraging f21 to keep the skip list up to date | 13:59 |
| arxcruz | weshay: well, the test is skipped, we should at least unskip to see if the problem still remains | 13:59 |
| arxcruz | weshay: okay, i'll work on the python tool to check that | 13:59 |
| weshay | arxcruz, right.. but is what fs21 is for | 13:59 |
| weshay | arxcruz, maybe we can chat after the scrum | 13:59 |
| *** sanjayu_ has quit IRC | 13:59 | |
| arxcruz | weshay: fs021 is failing with another error | 13:59 |
| weshay | k k | 14:00 |
| rfolco | ping scrum | 14:00 |
| weshay | arxcruz, perhaps we need to think about this a bit more re: how to efficiently monitor skipped tests | 14:00 |
| rfolco | ping scrum marios, quiquell, sshnaidm, weshay, panda, rlandy, arxcruz, mwhahaha, rfolco, chkumar, ssbarnea, kopecmarti | 14:01 |
| *** quique|rover|eat is now known as quiquell|rover | 14:02 | |
| *** ccamacho has quit IRC | 14:08 | |
| *** ccamacho has joined #oooq | 14:08 | |
| panda | chkumar|ruck: arxcruz do you have time to review https://review.openstack.org/509728 ? we need to move it to standalone job, so it's ok for now if it's not using OStempest, we'll deal with that after the migration to standalone | 14:10 |
| chkumar|ruck | panda: looking | 14:10 |
| *** dsneddon__ has joined #oooq | 14:12 | |
| quiquell|rover | sshnaidm: dashboard workign now thanks, what was the issue there ? | 14:15 |
| sshnaidm | quiquell|rover, idk, I think it's "rdo cloud" happened there | 14:16 |
| quiquell|rover | sshnaidm: ack | 14:16 |
| sshnaidm | there was outage before | 14:16 |
| chkumar|ruck | sshnaidm: quiquell|rover https://review.rdoproject.org/r/#/c/18666/ anything thing more needed on this? | 14:16 |
| sshnaidm | chkumar|ruck, did you run it? does it work ok? | 14:17 |
| *** rnoriega has joined #oooq | 14:18 | |
| chkumar|ruck | sshnaidm: I have runned in dry mode, it works, Do You want to delte some ports and report it? | 14:18 |
| *** gkadam__ has quit IRC | 14:18 | |
| *** jjoyce has quit IRC | 14:19 | |
| sshnaidm | chkumar|ruck, would be nice I think | 14:20 |
| sshnaidm | chkumar|ruck, but please make sure it deletes right ports :) | 14:21 |
| chkumar|ruck | sshnaidm: let me create some resouces in down state and | 14:21 |
| *** jjoyce has joined #oooq | 14:22 | |
| sshnaidm | chkumar|ruck, I think we have such on openstack-nodepool | 14:22 |
| sshnaidm | chkumar|ruck, just write them down and check that script deleted them, not something else | 14:22 |
| *** dsneddon__ has quit IRC | 14:25 | |
| fultonj | ykarel quiquell|rover gfidente PTO but will be back tomorrow. best to wait for him regarding issue disucssed above. | 14:26 |
| ykarel | fultonj, ack | 14:26 |
| *** skramaja has quit IRC | 14:26 | |
| *** jtomasek has quit IRC | 14:27 | |
| *** chandankumar has joined #oooq | 14:28 | |
| quiquell|rover | fultonj: will tell alphacc | 14:29 |
| quiquell|rover | fultonj: thanks | 14:30 |
| *** ccamacho has quit IRC | 14:34 | |
| *** jpena is now known as jpena|off | 14:34 | |
| *** fultonj has quit IRC | 14:36 | |
| *** fultonj has joined #oooq | 14:36 | |
| *** chkumar|ruck has quit IRC | 14:38 | |
| chandankumar | quiquell|rover, weshay I am logging out, see ya tomorrow :-) | 14:40 |
| *** jpena|off is now known as jpena | 14:40 | |
| quiquell|rover | chandankumar: bye see you tomorrow | 14:40 |
| *** chandankumar has quit IRC | 14:41 | |
| *** vinaykns has joined #oooq | 14:42 | |
| quiquell|rover | sshnaidm: Can we do the http://cockpit-ci.tripleo.org redirection ? | 14:44 |
| *** fultonj has quit IRC | 14:44 | |
| *** fultonj has joined #oooq | 14:47 | |
| *** fultonj has quit IRC | 14:47 | |
| sshnaidm | quiquell|rover, argh, forgot.. will make a task about it :) | 14:47 |
| *** fultonj has joined #oooq | 14:47 | |
| *** dtrainor has quit IRC | 14:48 | |
| *** zul has quit IRC | 14:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-undercloud-containers @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq- (2 more messages) | 14:50 |
| *** dsneddon__ has joined #oooq | 14:52 | |
| rlandy | rebooting | 14:58 |
| *** rlandy has quit IRC | 14:58 | |
| rfolco | marios, do you get a min to bj ? | 14:58 |
| rfolco | weshay, do you get a min then? | 15:00 |
| rfolco | ok nm brb | 15:01 |
| *** rfolco is now known as rfolco_lunch | 15:01 | |
| *** jtomasek has joined #oooq | 15:03 | |
| zbr|ssbarnea | @oooq early feedback on molecule intro presentation would be appreciated: https://docs.google.com/presentation/d/1qjJsz8zcV88R4LFsxD5syobUeitki8yFX7_jzgCxJ1w/edit?usp=sharing | 15:04 |
| *** marios_ has joined #oooq | 15:05 | |
| *** marios_ has quit IRC | 15:05 | |
| *** dsneddon__ has quit IRC | 15:05 | |
| *** jtomasek has quit IRC | 15:10 | |
| *** zul has joined #oooq | 15:11 | |
| *** holser_ has joined #oooq | 15:11 | |
| *** rlandy has joined #oooq | 15:12 | |
| *** holser_ has quit IRC | 15:13 | |
| *** rlandy has quit IRC | 15:13 | |
| *** rlandy has joined #oooq | 15:14 | |
| rlandy | back now on VPN through phx but response is slow | 15:15 |
| rlandy | sshnaidm: quiquell|rover: linters are failing on finding /var/ssh/id_rsa ... https://logs.rdoproject.org/64/18664/11/check/tox-linters/c472e7e/job-output.txt.gz#_2019-02-03_20_46_41_500304 | 15:17 |
| rlandy | was not changed in this patch | 15:18 |
| quiquell|rover | rlandy: red herring | 15:18 |
| quiquell|rover | rlandy: look up | 15:18 |
| quiquell|rover | rlandy: happend the same to me | 15:18 |
| quiquell|rover | rlandy: https://logs.rdoproject.org/64/18664/11/check/tox-linters/c472e7e/job-output.txt.gz#_2019-02-03_20_46_41_495332 | 15:19 |
| rlandy | yeah | 15:19 |
| quiquell|rover | rlandy: install pre-commit | 15:19 |
| quiquell|rover | pre-commit install --isntall-hooks | 15:20 |
| rlandy | yeah | 15:20 |
| quiquell|rover | You will find this stuff before review <- thanks zbr|ssbarnea | 15:20 |
| sshnaidm | rlandy, skip_ansible_lint tag on this task will prevent linting | 15:20 |
| quiquell|rover | rlandy: did you see the zuul-jobs role bindep ? | 15:21 |
| quiquell|rover | rlandy: Don't know if it can be of any use for us | 15:21 |
| rlandy | quiquell|rover: didn't look into it too much | 15:23 |
| rlandy | adding package checking - seeing of that works as is | 15:23 |
| quiquell|rover | rlandy: ack, looks like is the way openstack projects install RPM from CI at zuul | 15:24 |
| quiquell|rover | ok closing now | 15:24 |
| *** quiquell|rover is now known as quique|rover|off | 15:24 | |
| *** rfolco_lunch is now known as rfolco | 15:25 | |
| *** marios_ has joined #oooq | 15:25 | |
| marios_ | rfolco: in 1-1 now sorry (and irc/vpn issues) | 15:25 |
| marios_ | rlandy: vpn issues are a thing indeed | 15:26 |
| rlandy | marios_: ack - reports started on outage | 15:26 |
| rlandy | I could get in through phx | 15:26 |
| rlandy | although kind of slow | 15:26 |
| rlandy | weshay: let me know when you want to touch base re: deps install | 15:27 |
| *** holser_ has joined #oooq | 15:29 | |
| *** dsneddon__ has joined #oooq | 15:33 | |
| *** holser_ has quit IRC | 15:36 | |
| zbr|ssbarnea | weshay: i am no longer able to reproduce the krb5 issue with you but I think i know what caused it.... *networking* and this is the perfect use-case why we need to use rule E405: Remote package tasks should have a retry” in Ansible. | 15:36 |
| zbr|ssbarnea | a "yum update" can fail by its own nature, while repo is updated (many times during the day). a simple retry solves the problem. | 15:37 |
| zbr|ssbarnea | and is damn easy to avoid, we only need to agree on two numbers retries and delay: https://devops.stackexchange.com/questions/5829/how-to-solve-e405-remote-package-tasks-should-have-a-retry-in-ansible/5837 | 15:38 |
| sshnaidm | rlandy, question about https://review.openstack.org/#/c/631067/45/roles/create-zuul-based-reproducer/templates/launcher-playbook.yaml.j2 | 15:39 |
| sshnaidm | rlandy, when you set up featureset_override: in job, do you override all featureset_override from parent job? | 15:40 |
| *** holser_ has joined #oooq | 15:41 | |
| zbr|ssbarnea | sshnaidm: i know that you were against this at some point, so now it would be a good time to argue why you don't find it useful. any chance to convince you to embrace E405? | 15:42 |
| rlandy | sshnaidm: no - just the one you specify | 15:42 |
| sshnaidm | zbr|ssbarnea, what are we talking about? | 15:42 |
| sshnaidm | rlandy, so it's kind of merging? | 15:43 |
| rlandy | sshnaidm: gets passed as extra vars | 15:43 |
| rlandy | so it's after fs settings | 15:43 |
| sshnaidm | rlandy, I mean job configuration, not how fs override is passed to ansible | 15:44 |
| rlandy | sshnaidm: hmm - I see what you are asking ... | 15:45 |
| sshnaidm | rlandy, for example in standalone job: https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L402 | 15:45 |
| rlandy | that is a good question | 15:46 |
| rlandy | sshnaidm: probably yes | 15:46 |
| rlandy | sshnaidm: that is a problem for fs override evrywhere | 15:46 |
| *** dsneddon__ has quit IRC | 15:46 | |
| sshnaidm | rlandy, so we need to discover it and include it there | 15:46 |
| sshnaidm | rlandy, I believe it should be in some of zuul.* vars.. | 15:46 |
| rlandy | sshnaidm: we should fix that in fs override itself | 15:47 |
| sshnaidm | rlandy, what do you mean? | 15:47 |
| rlandy | sshnaidm: in any job you specify fs override, you would override the parent | 15:48 |
| rlandy | not just in this situation | 15:48 |
| sshnaidm | rlandy, yeah, od course | 15:48 |
| sshnaidm | rlandy, but it's configured only in end jobs afaik | 15:48 |
| rlandy | sshnaidm: true - so far | 15:49 |
| rlandy | sshnaidm: nothing stopping anyone configuring jobs lower down the chain with that | 15:49 |
| sshnaidm | rlandy, except the fact it won't work.. | 15:49 |
| rlandy | sshnaidm: so we can fix it at a reproducer level - but we should fix the fs override mechanism as a whole | 15:50 |
| sshnaidm | rlandy, yeah, I think there is a big task about it.. | 15:50 |
| rlandy | sshnaidm: for the reproducer, we may be able to do something about it | 15:51 |
| rlandy | if we can pick it up from the job | 15:51 |
| rlandy | and merge the two | 15:51 |
| sshnaidm | rlandy, yeah, I think that's the way | 15:52 |
| rlandy | sshnaidm: for this - the real fix is a bigger problem | 15:52 |
| sshnaidm | need to try to dump everything in zuul dict | 15:52 |
| rlandy | sshnaidm: that is a good catch | 15:53 |
| zbr|ssbarnea | sshnaidm: this was the issues I was referring to https://bugs.launchpad.net/tripleo/+bug/1814492 -- see my last two comments. | 15:59 |
| openstack | Launchpad bug 1814492 in tripleo " Error: Package: libkadm5-1.15.1-34.el7.x86_64 (base)" [Critical,Triaged] | 15:59 |
| weshay | rlandy, k.. I have bug triage for about an hour | 15:59 |
| weshay | zbr|ssbarnea, I think it was out of sync mirrors | 15:59 |
| rlandy | weshay:np - we can meet this afternnon | 16:00 |
| rfolco | weshay, ping bug triage | 16:00 |
| weshay | aye.. I'm joining | 16:01 |
| rlandy | sshnaidm: well - we already collect the file - so that will help ... | 16:01 |
| rlandy | - name: Check if featureset-override exists | 16:01 |
| rlandy | stat: | 16:01 |
| rlandy | path: "/home/{{ undercloud_user }}/src/git.openstack.org/openstack/tripleo-ci/featureset-override.yaml" | 16:01 |
| rlandy | register: featureset_override_file | 16:01 |
| zbr|ssbarnea | weshay: cannot blame mirrors, it can happen even without mirrors (far less likely anyway). is timing, and i am ready to bet that a retry(3) delay(30s) would be more than enough to avoid this kind of issue. | 16:01 |
| sshnaidm | zbr|ssbarnea, no way | 16:03 |
| zbr|ssbarnea | i was just trying to build a case for us to be more careful to assume the worst and to ass some limited retries in flaky places. | 16:03 |
| zbr|ssbarnea | type /ass/add :D | 16:03 |
| *** ykarel has quit IRC | 16:08 | |
| *** ykarel has joined #oooq | 16:08 | |
| *** ykarel is now known as ykarel|away | 16:08 | |
| weshay | https://bugs.launchpad.net/tripleo/+bugs?field.searchtext=&orderby=-importance&field.status%3Alist=NEW&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.importance%3Alist=UNKNOWN&field.importance%3Alist=UNDECIDED&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.structural_subscriber=&field.tag=ci&field.tags_combinator= | 16:13 |
| weshay | ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on&search=Search | 16:13 |
| rlandy | sshnaidm: while I am changing the launcher playbook - what is your opinion on whether we should keep lines 48-57? Those are the role defaults anyway but I left them there as the script overwrites them and a user using just the playbooks should know that can specify those values. agree? | 16:14 |
| weshay | rfolco, panda http://bit.ly/2UGzBrB | 16:14 |
| sshnaidm | rlandy, in which file? | 16:15 |
| rlandy | https://review.openstack.org/#/c/631067/45/roles/create-zuul-based-reproducer/templates/launcher-playbook.yaml.j2 | 16:15 |
| rlandy | sshnaidm: ^^ | 16:15 |
| sshnaidm | rlandy, how does user specify them? | 16:17 |
| rlandy | sshnaidm: you mean outside the script? | 16:18 |
| rlandy | if you are just running playbooks, you would edit the values in the playbook on those lines | 16:18 |
| sshnaidm | rlandy, yeah, or you mean he should edit the file? | 16:18 |
| rlandy | correct | 16:18 |
| rlandy | expert user | 16:18 |
| rlandy | not going through the bash script | 16:19 |
| rlandy | someone like you | 16:19 |
| rlandy | you want to reproduce a job, | 16:19 |
| rlandy | you take this file | 16:19 |
| rlandy | edit to to reference your gerrit users and gp | 16:19 |
| rlandy | go | 16:19 |
| sshnaidm | rlandy, I think we can just copy this mechanism from previous reproducer script, ansible-like with -e and -e@ | 16:19 |
| rlandy | sshnaidm: so you think we should remove those vars? | 16:20 |
| rlandy | they are default anyways | 16:20 |
| rlandy | the bash script uses the -e mechanism | 16:20 |
| *** dsneddon__ has joined #oooq | 16:20 | |
| rlandy | sshnaidm: put in fix for featureset_override - let's see if it works | 16:28 |
| *** marios_ has quit IRC | 16:29 | |
| *** agopi has quit IRC | 16:37 | |
| *** ykarel|away has quit IRC | 16:45 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-undercloud-containers @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq- (2 more messages) | 16:50 |
| *** ykarel|away has joined #oooq | 16:52 | |
| *** ykarel|away has quit IRC | 17:07 | |
| *** dmellado has quit IRC | 17:07 | |
| *** dmellado has joined #oooq | 17:08 | |
| *** dmellado has quit IRC | 17:08 | |
| *** dmellado has joined #oooq | 17:09 | |
| *** agopi has joined #oooq | 17:11 | |
| sshnaidm | weshay, what's about https://review.openstack.org/#/c/633444/ ? can you un-w it? | 17:28 |
| weshay | sshnaidm, /me looks | 17:29 |
| weshay | sshnaidm, pretty sure.. someone else had a -1 workflow on it.. I rebased it.. and put it back on | 17:30 |
| weshay | but /me looking now | 17:30 |
| *** bogdando has quit IRC | 17:31 | |
| *** ykarel|away has joined #oooq | 17:31 | |
| weshay | sshnaidm, oh.. was looking to see where it was tested | 17:31 |
| weshay | wes hayutin | 17:31 |
| weshay | Feb 1 1:53 PM | 17:31 |
| weshay | ↩ | 17:31 |
| weshay | Patch Set 26: Code-Review-1 Workflow-1 | 17:31 |
| weshay | sorry, point me at a working log of {{ working_dir }}/libguestfs-test.log 2>&1; | 17:31 |
| sshnaidm | weshay, I pasted in the comments | 17:32 |
| weshay | k | 17:32 |
| sshnaidm | weshay, both patch where it's tested and link to logs | 17:32 |
| *** dsneddon__ has quit IRC | 17:32 | |
| sshnaidm | weshay, Sagi Shnaidman | 17:33 |
| sshnaidm | Jan 31 15:18 UTC | 17:33 |
| sshnaidm | Patch Set 26: Code-Review+2 | 17:33 |
| sshnaidm | worked here: https://review.rdoproject.org/r/#/c/18558/ | 17:33 |
| *** jtomasek has joined #oooq | 17:46 | |
| *** trown is now known as trown|lunch | 17:46 | |
| *** jtomasek has quit IRC | 17:51 | |
| *** kopecmartin is now known as kopecmartin|off | 17:59 | |
| *** chandankumar has joined #oooq | 17:59 | |
| *** derekh has quit IRC | 18:00 | |
| weshay | rlandy, ok.. ready when ever | 18:03 |
| *** jpena is now known as jpena|off | 18:04 | |
| rlandy | weshay: in a bit - just spent an hour hacking to fix my vpn - only to remember marios' comment that I had to disabled selinux | 18:04 |
| rlandy | reproducer messes with that | 18:05 |
| rlandy | what a waste of time :( | 18:05 |
| weshay | oh noes | 18:05 |
| weshay | the reproducer messes w/ the vpn? | 18:05 |
| weshay | or selinux/ | 18:05 |
| rlandy | you have to set selinux to permission to get on to vpn | 18:07 |
| rlandy | marios reported it | 18:07 |
| *** dsneddon__ has joined #oooq | 18:08 | |
| rlandy | anyways my testbox is back on vpn now - after I blamed IT for not really fixing the VPN issue :( | 18:08 |
| rlandy | back in 5 | 18:08 |
| *** chandankumar has quit IRC | 18:19 | |
| rlandy | weshay: k - ready to meet when you are | 18:37 |
| zbr|ssbarnea | weshay: rlandy : another example of using molecule to test a role: te-broker - https://review.rdoproject.org/r/#/c/18627/ | 18:37 |
| weshay | rlandy, k /me goes to blue | 18:37 |
| weshay | zbr|ssbarnea, ya... that is a good use.. to test those infra roles.. you don't have to convince me man.. just making sure you know the te-broker is dead code we don't use | 18:38 |
| weshay | I think you do | 18:38 |
| zbr|ssbarnea | weshay: te-broker role is deploying the ovb-cleanup-tenant.sh script... which is essential piece of code for us. drop the script and i bet we are in trouble in less than 48h. | 18:40 |
| zbr|ssbarnea | i wanted to add testing before the refactoring of the role, to validate that my changes do no break other stuff. | 18:40 |
| zbr|ssbarnea | i need to go now, but it would be helpful to know if we do have a syslog server where we can send the logs from our services (and still be able to access them). | 18:42 |
| zbr|ssbarnea | while logstash is not really a syslog server it seems quite attractive to me to consider it as an option | 18:44 |
| weshay | ah.. makes sense | 18:45 |
| zbr|ssbarnea | weshay: what i want is to eliminate the http sharing of logs approach we had with te-broker. sending logs to a centralized place seems more appropiate for multiple reasons. | 18:46 |
| zbr|ssbarnea | so mainly we should only identify how to configured journald to send data to the right server. | 18:47 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-undercloud-containers @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq- (2 more messages) | 18:50 |
| *** trown|lunch is now known as trown | 18:57 | |
| weshay | rlandy, system_u:object_r:container_file_t:s0 /etc/pki/tls/certs/ca-bundle.crt | 19:00 |
| weshay | for i in `openstack server list --status Error | cut -d " " -f 2 | head -n -1`; do echo $i; openstack server delete $i; sleep 2; done | 19:21 |
| *** ykarel|away has quit IRC | 19:27 | |
| *** dtrainor has joined #oooq | 19:35 | |
| *** dtrainor_ has joined #oooq | 19:36 | |
| rlandy | weshay: openstack server list -f json | jq -r '.[] | select(.["Status"] == "ERROR") | .["ID"]' | 19:37 |
| *** dtrainor has quit IRC | 19:39 | |
| *** jfrancoa has quit IRC | 19:42 | |
| *** agopi has quit IRC | 19:51 | |
| *** agopi has joined #oooq | 19:51 | |
| *** jaosorior has quit IRC | 19:58 | |
| weshay | rlandy, -n, --non-interactive | 20:05 |
| weshay | Avoid prompting the user for input of any kind. If a password is required for the command to run, sudo will display an error message and exit. | 20:05 |
| weshay | rlandy, https://review.openstack.org/#/c/634329/11/install-deps.sh | 20:14 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 20:50 |
| rlandy | weshay: https://review.openstack.org/#/c/631067 updated | 20:53 |
| rlandy | https://review.openstack.org/#/c/631067/46..48/roles/create-zuul-based-reproducer/templates/reproducer-zuul-based-quickstart.sh.j2 | 20:54 |
| weshay | k | 21:03 |
| weshay | looks good | 21:05 |
| rlandy | let's see what ci thinks | 21:09 |
| vinaykns | weshay: I have a question...I'm deploying overcloud(including telemetry)...in my overcloud deploy command I don't have disable-telemetry.yaml environment file being passed to that command | 21:27 |
| vinaykns | weshay: but still I couldn't see any of the telemetry services in the overcloud | 21:28 |
| weshay | vinaykns, so that means the tripleo default is to not install it | 21:28 |
| vinaykns | weshay: okay...how could i override it | 21:29 |
| vinaykns | this is my command http://pastebin.test.redhat.com/707345 | 21:30 |
| weshay | vinaykns, here are some examples | 21:34 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml | 21:34 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-standalone.yaml | 21:34 |
| vinaykns | so I should pass this to overcloud deploy command as env file..? | 21:35 |
| weshay | vinaykns, you would just have to override parameter_defaults: | 21:35 |
| weshay | ControllerServices: | 21:35 |
| vinaykns | okay..gotcha.! | 21:38 |
| vinaykns | thx.! | 21:38 |
| weshay | vinaykns, the context on that is .. it's not a good idea for tq to provide an interface to tripleo for most options | 21:50 |
| weshay | better to interface directly | 21:50 |
| vinaykns | weshay: could you elaborate more on this..? | 21:53 |
| weshay | just that it's better if people work directly w/ tripleo and the ways to adjust services etc.. rather than having a tool on top of a tool | 21:54 |
| weshay | just enough tool | 21:54 |
| weshay | is what we're shooting for | 21:54 |
| vinaykns | yeah..make sense.! | 22:03 |
| *** trown is now known as trown|outtypewww | 22:06 | |
| *** agopi has quit IRC | 22:16 | |
| weshay | rlandy, I did have some updates | 22:19 |
| weshay | updating in review now | 22:19 |
| rlandy | weshay: ok - which review | 22:20 |
| weshay | couple more minutes sec | 22:20 |
| weshay | rlandy, https://review.openstack.org/#/c/634329/12/install-deps.sh | 22:29 |
| weshay | https://review.rdoproject.org/r/#/c/18665/ | 22:29 |
| weshay | rlandy, so.. all you should need in your script now ;) | 22:29 |
| weshay | is | 22:29 |
| weshay | lines 205 - 220 https://review.openstack.org/#/c/634329/12/install-deps.sh | 22:30 |
| weshay | rlandy, let me know if that makes sense | 22:30 |
| weshay | tested it a few times | 22:30 |
| weshay | all the rpm deps are in https://review.rdoproject.org/r/#/c/18665/3/bindep_python2.txt | 22:33 |
| rlandy | looking | 22:34 |
| rlandy | USER_OVERRIDE_SUDO_CHECK - new | 22:35 |
| weshay | ya | 22:36 |
| weshay | rlandy, I think bootstrap_ansible_via_rpm can change right... I think it can now be... | 22:37 |
| weshay | install_deps | 22:37 |
| weshay | install_bindep | 22:37 |
| weshay | install_package_deps_via_bindep | 22:37 |
| weshay | and we're done installing anything | 22:37 |
| weshay | oh no | 22:38 |
| weshay | I'm wrong | 22:38 |
| rlandy | I need to recheck because depends-on changeds | 22:38 |
| rlandy | so ... | 22:38 |
| weshay | because install_deps.sh is not there yet | 22:38 |
| weshay | leave it as it | 22:38 |
| weshay | is | 22:38 |
| rlandy | what about USER_OVERRIDE_SUDO_CHECK? | 22:38 |
| vinaykns | weshay: It Could not fetch contents for file:///docker/services/ceilometer-agent-compute.yaml | 22:39 |
| rlandy | needs to be added to script? | 22:39 |
| weshay | so folks like Sagi will get prompted if something needs to be installed vs.. skipping | 22:39 |
| vinaykns | weshay: but that file is there in the templates directory | 22:39 |
| *** holser_ has quit IRC | 22:39 | |
| weshay | rlandy, I think we should | 22:40 |
| rlandy | weshay: so I'm confused about what changes are needed on my side | 22:40 |
| weshay | rlandy, if you want further context.. I provide that | 22:40 |
| weshay | rlandy, ok.. let's chat for a hot sec | 22:40 |
| weshay | so we can let this run before we leave | 22:40 |
| weshay | vinaykns, sorry .. need a few.. and would need more details | 22:40 |
| weshay | that's not enough info to help | 22:40 |
| rlandy | k - joining blue | 22:40 |
| vinaykns | weshay: http://pastebin.test.redhat.com/707357 | 22:41 |
| vinaykns | weshay: I'm not sure why it is fetching templates from tmp/tripleoclient-vkg903/tripleo-heat-templates | 22:42 |
| vinaykns | instead of my custom ones. | 22:42 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003 (2 more messages) | 22:50 |
| *** vinaykns has quit IRC | 23:06 | |
| weshay | rlandy, https://review.rdoproject.org/r/#/c/18665/ | 23:11 |
| weshay | rlandy, https://review.rdoproject.org/r/gitweb?p=rdo-infra/ansible-role-tripleo-ci-reproducer.git;a=blob_plain;f=bindep_python2.txt;h=1c5a49ffd7e297eadac5fbe3c81d23d600be371d;hb=2d689e7bf8d49bf0f46d2f381665fac7dc68be47 | 23:12 |
| *** rlandy is now known as rlandy|bbl | 23:22 | |
| *** dtrainor_ has quit IRC | 23:31 | |
| *** agopi has joined #oooq | 23:34 | |
| *** panda has quit IRC | 23:40 | |
| *** dtrainor_ has joined #oooq | 23:40 | |
| *** panda has joined #oooq | 23:41 | |
| *** dtrainor_ has quit IRC | 23:44 | |
| *** dtrainor_ has joined #oooq | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!