Tuesday, 2018-11-06

hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)00:43
*** dsneddon has quit IRC01:08
*** rlandy has quit IRC01:09
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)02:43
*** agopi_ has joined #oooq03:03
*** agopi has quit IRC03:06
*** ykarel has joined #oooq04:20
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)04:43
*** udesale has joined #oooq04:55
*** udesale has quit IRC04:58
*** udesale has joined #oooq04:58
*** udesale has quit IRC04:58
*** udesale has joined #oooq05:05
*** jtomasek has joined #oooq05:07
*** jtomasek has quit IRC05:07
*** ratailor has joined #oooq05:12
*** jtomasek has joined #oooq05:14
*** agopi_ has quit IRC05:22
*** rascasoft has quit IRC05:32
*** nhicher has quit IRC05:33
*** udesale has quit IRC05:40
*** udesale has joined #oooq05:53
*** jtomasek has quit IRC06:39
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)06:44
ratailorDoes anyone know, How can I have overcloud images bulid with centos7.4 using oooq for master release ?06:45
*** saneax has joined #oooq06:47
*** quiquell|off is now known as quiquell06:49
*** jfrancoa has joined #oooq06:51
*** udesale has quit IRC06:54
*** huynq has joined #oooq07:05
quiquellssbarnea: This is the fix for heat-config-notify 3aa3c07570827dc8183e636b5ebff887cd4b373407:32
quiquellssbarnea: I mean this https://review.rdoproject.org/r/#/c/17216/07:33
quiquellssbarnea: It's already merged let me check the hashes07:33
*** udesale has joined #oooq07:35
*** gkadam_ has joined #oooq07:45
*** quiquell is now known as quiquell|brb07:50
*** ccamacho has joined #oooq08:03
*** kopecmartin|off is now known as kopecmartin08:06
*** quiquell|brb is now known as quiquell08:14
*** ykarel_ has joined #oooq08:19
*** rascasoft has joined #oooq08:20
*** ykarel has quit IRC08:22
*** jtomasek has joined #oooq08:41
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)08:44
*** amoralej|off is now known as amoralej08:44
*** bogdando has joined #oooq08:56
*** ratailor_ has joined #oooq09:08
*** ykarel__ has joined #oooq09:11
ssbarneamorning!09:11
*** ratailor has quit IRC09:11
*** ykarel_ has quit IRC09:12
ssbarneaanyone that can help me identify what happened on https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/7774/console ?09:13
pandassbarnea: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: u'/home/jenkins/workspace/tripleo-quickstart-gate-master-delorean-quick-basic/tripleo-quickstart-extras'09:18
ssbarneapanda : yes, i know, the question is why? i checked before that but didn't see anything to hint me about the reason09:19
*** ykarel__ is now known as ykarel09:19
ssbarneai am aware of outcome, not the root cause09:19
quiquellssbarnea: o/09:20
quiquellssbarnea: it's also happening before the last line09:23
pandassbarnea: 17:00:29 ++ sed -i.bak /extras/d /home/jenkins/workspace/tripleo-quickstart-gate-master-delorean-quick-basic/tripleo-quickstart/quickstart-extras-requirements.txt09:24
pandassbarnea: I think something is wrong wtih this09:24
quiquellssbarnea: problem is here file:///home/jenkins/workspace/tripleo-quickstart-gate-master-delorean-quick-basic/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras09:25
*** huynq has quit IRC09:25
quiquellssbarnea: And I think it's not cloning tqe there09:25
*** huynq has joined #oooq09:25
quiquellups panda already said it09:25
quiquellpanda: Do you have another blue time for me ? it's about fedora release file09:26
pandaquiquell: following the all hands at the moment09:26
quiquellpanda: Connecting09:27
pandaquiquell: connecting to the all hands ?09:27
quiquellpanda: Was interested09:28
*** chem has joined #oooq09:43
*** sshnaidm|afk is now known as sshnaidm|rover09:45
ssbarneapanda: quiquell not sure what caused the missing extras but I ended up improving the error dealing with https://review.openstack.org/#/c/615805/10:01
*** arxcruz has quit IRC10:03
pandaquiquell: relocating, if you want to talk we can either do in 1h, or you can hear me taking the train.10:10
*** ykarel is now known as ykarel|lunch10:12
quiquellpanda: I like the sound of trains, but prefer to wait, just ping me.10:15
*** ykarel|lunch is now known as ykarel10:33
*** arxcruz has joined #oooq10:36
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)10:44
arxcruzmarios: https://review.openstack.org/#/c/615133/ check my comment, and if possible +2+w10:48
mariosarxcruz: ack, well if the idea/goal is tempest < 1 hr then it is ok ?10:58
arxcruzmarios: yes, it is okay, it’s running in 45 minutes :)10:58
mariosarxcruz: yeah i guess i don't have a measure of how long it was running before. it just feels like we are losing some of the benefit of the standalone which is like 1 hour deploy/ci time and then almost another hour for tempest so its closer to 2 hours not 110:59
arxcruzmarios: 1:35 min before if i recall correctly10:59
*** huynq has quit IRC11:03
sshnaidm|roverquiquell, hi11:08
quiquellsshnaidm|rover: Hello11:09
sshnaidm|roverquiquell, do you know how I can filter by patchset in grafana? I try "patchset" filter by patchset number, but it's empty..11:09
* quiquell getting the link11:10
quiquellsshnaidm|rover: http://dashboard-ci.tripleo.org/d/FEdraO0ik/jobs-exploration?orgId=1&var-influxdb_filter=change%7C%3D%7C604293&var-influxdb_filter=patchset%7C%3D%7C5111:11
quiquellsshnaidm|rover: This will show stuff from change 604293 and ps 5111:11
sshnaidm|roverquiquell, oooh, it's "change"11:12
sshnaidm|roverquiquell, thanks!11:12
quiquellsshnaidm|rover: you have change for the review number and patchset for the patchset number11:12
sshnaidm|roverquiquell, right, confused these11:13
quiquellsshnaidm|rover: Yep happend to me last time11:14
quiquellssbarnea: tqe py3 by default review in the gates let's cross fingers11:26
quiquellpanda: Are you relocated ?11:26
*** brault has joined #oooq11:28
ssbarneaquiquell meanwhile fix https://review.openstack.org/#/c/615831/1 :D11:30
ssbarneaand don't forget to notify me here on others, we can speedup progress.11:31
*** dtantsur|afk is now known as dtantsur11:33
quiquellssbarnea: Thanks fixed, also you where in the review of the fix for the shebag11:33
quiquellssbarnea: answered to that11:34
pandaquiquell: yes11:34
quiquellpanda: your room ?11:34
pandaquiquell: let me undress first11:35
quiquellpanda: So average :-(11:35
pandaquiquell: wait until I'm ready11:36
quiquellquiquell: ok just ping me11:37
pandaquiquell: there11:38
ssbarneano need to touch shebang line, impossible to fix. lets hope is not used.11:38
quiquellssbarnea: it's replaces at RPM generation11:38
quiquellssbarnea: In the review I paste it asnwering at your comment is the code that do that11:38
quiquellssbarnea: rpmbuild script where replacing env python with /usr/bin/python2 (and also warning about it)11:39
ssbarneapython scripts used to be considered portable, similar to bash until they decided to change interpreter name.11:39
ssbarneaquiquell: curious: wans't this supposed to be replaced by python3 on py3 systems?11:40
ykarelssbarnea, quiquell but i can't find six.text_types as what quiquell updated in patch11:40
quiquellssbarnea: is not11:40
quiquell:-(11:40
quiquellssbarnea: pytho2 is harcoded in the rpmbuild replacing script11:40
quiquellssbarnea: Give me a minute I show you the code11:40
pandaquiquell: I'm cold and lonely11:40
quiquellpanda: Going there with some beers sorry11:41
ssbarneapanda not sure what this means but it starting to sound like a subject title from misc list.11:41
ykarelssbarnea, were u mentioning for plural, six.string_types or six.text_types?11:41
ykarelhttps://review.openstack.org/#/c/615831/1..2/heat-config/os-refresh-config/configure.d/55-heat-config11:42
ssbarneaykarel https://pythonhosted.org/six/  fix example11:43
ssbarneafirst11:43
ykareli can't find six.text_types https://pythonhosted.org/six/ which quiquell updated ^^11:43
ykarelokk so test failed, so it's wrong11:43
ykarelquiquell, fix that also remember to fix commit message11:44
*** gkadam_ has quit IRC11:46
*** gkadam has joined #oooq11:46
quiquellykarel: Damn it I know it, at heat-templtes is was not plural11:53
arxcruzchandankumar: is the serial patch supposed to be reviewed or is just a POC ?11:57
chandankumararxcruz: kind of poc, if we want to include this functionality it is also good to go11:57
arxcruzchandankumar: I think would be good to add directly to os_tempest, we need to stop add new functionalities on validate-tempest, otherwise we will double our effort to move to os_tempest, what do you think ?11:59
chandankumararxcruz: yes11:59
rfolco|ruckchandankumar, arxcruz how does serial help us ?11:59
quiquellssbarnea: it was text_type not text_types is not plural11:59
chandankumarrfolco|ruck: it timed out11:59
rfolco|ruckchandankumar, parallel timed out?11:59
quiquellykarel: what's the issue with commit message ?12:00
chandankumarrfolco|ruck: serial timed out12:00
chandankumarrfolco|ruck: let me pass th epatch link12:00
rfolco|ruckchandankumar, I don't see any reason to run all tempest serially12:00
chandankumarrfolco|ruck: https://review.openstack.org/60604612:01
rfolco|ruckwhat is the problem you are trying to solve with this?12:01
quiquellssbarnea: please remove the -1 from https://review.openstack.org/#/c/615831/12:01
quiquellssbarnea: it's text_type not text_types12:01
*** amoralej is now known as amoralej|lunch12:01
ssbarneadocst, wrong testing now, apparently I not the first to fall for it.  six.string_types seems to be a list.12:01
quiquellssbarnea: damn really ?12:02
quiquellssbarnea: then the testing is failing for other reasons, maybe missing six as dependency12:02
ssbarneaquiquell the downvote is still correct, you need to use six.string_types12:03
ssbarneaand I can explain you why...12:03
quiquellssbarnea: ok, let me change it I think I have also to update requirements.txt12:03
quiquellwith six12:03
ssbarneaunicode is a basestring, string is a basestring.12:03
ssbarneatext_type evaluates as unicode which is wrong,12:04
quiquellssbarnea: Humm heat-templates is not using plural though12:04
ssbarneayou would break py2 logic of testing for a string.12:04
quiquellssbarnea: I remember using string_types at other one12:04
ssbarneaso just use six.string_types - this one works correctly12:05
quiquellssbarnea: Just copied the staff at heat-templates maybe that is wrong too12:05
quiquellssbarnea: ack, thanks12:05
quiquellssbarnea: so this is wrong too ? http://git.openstack.org/cgit/openstack/heat-templates/tree/hot/software-config/elements/heat-config/os-refresh-config/configure.d/55-heat-config#n9712:06
quiquellmaybe this too12:06
quiquellhttp://git.openstack.org/cgit/openstack/heat-templates/tree/hot/software-config/elements/heat-config-docker-cmd/install.d/hook-docker-cmd.py#n10712:06
chandankumarplease donot cancel Tripleo Community meeting :-)12:07
ssbarneayep, maybe. regarding the wrong string test, based on case by case, you may get lucky and miss to hit the bug but better not to.12:08
quiquellssbarnea: Going to be a little reactive here, don't want to change the galaxy, let's see where we are after this12:08
ssbarneathis reminded me that I wanted to fix the hiddeous b'...' lines in the build output.12:09
ssbarneasure, you could grep on codesearch and spend your best years fixing that :D12:09
quiquellssbarnea: :-D too old for that12:09
chandankumarrfolco|ruck: sorry hopping on multiple channels12:11
rfolco|rucksshnaidm|rover, 12 gate failures, 12 different ones... don't know what is a real bug...12:13
rfolco|ruckchandankumar, community mtg ? wes scheduled on rhos mtg cal12:13
rfolco|ruckit was dup12:13
chandankumarrfolco|ruck: thanks :-)12:14
sshnaidm|roverrfolco|ruck, yeah, I didn't see a common case there, queue time is pretty small, so let's just keep an eye at latest jobs12:14
rfolco|ruckack sshnaidm|rover12:15
quiquellpanda: tripleo-current at fedora tagged at 64b57bfef7bcc45cb127c8d228e53f84a07f8028_8023fbde12:18
quiquellmarios: ^12:18
quiquellcurrent-tripleo I mean12:19
mariosquiquell: ack did you do the manual thing you said?12:27
quiquellmarios: Yep, you can check in the fedora DLRN repos to find the tag12:29
pandawhere's the change that put current-tripleo in the release file ?12:29
quiquellpanda: https://tree.taiga.io/project/tripleo-ci-board/task/321?kanban-status=144727612:29
*** ratailor_ has quit IRC12:29
quiquellssbarnea: Changed saharaclient but they say something about not checking it at designateclient12:30
quiquellssbarnea: added a comment on it12:30
ssbarneaquiquell: my knowledge of puppet is very limited. but I have one question as we will have LOTs of conditionals for package names based on py: is $::os['family'] == 'RedHat'  true on CentOS ?12:39
ssbarneasooner or later we will have a CentOS-8 and RHEL-8 and we need to be sure *now* that we do the right condition, as we do not want to repeat the "fun" we have now with f28 :D12:39
quiquellssbarnea: It is, it was working already, supose it's what we have a /etc/os-release12:40
quiquellssbarnea: Don't know much of puppet either I want to change the minimal there to have f2812:40
quiquellssbarnea: We will see what we have in the future12:40
ssbarneai do not agree here, expecially at https://review.openstack.org/#/c/615235/1/manifests/params.pp12:41
quiquellssbarnea: Yep, don't know man, I think they where talking about it at  #tripleo yesterday12:41
ssbarneaquiquell : good news: https://sedden.github.io/blog/2013/03/27/use-osfamily-instead-of-operatingsystem/ -- should work (if the doc is good)12:42
ssbarneawell code is buggy as it will never work for fedora < 28 but we don't care about that.12:43
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)12:44
quiquellssbarnea: yep, nah let's just keep it for now12:44
quiquellssbarnea: we have a lot to fix12:44
ssbarneai asked for this sole reason, trying to avoid more future work :D12:44
quiquellssbarnea: ok, let me change both review I see what they say12:45
quiquellssbarnea: Like it better too12:45
quiquellssbarnea: thanks12:45
chandankumarpanda: weshay arxcruz quiquell rfolco|ruck kopecmartin I will be on PTO from tomorrow till this week (2 days public holiday for Diwali and friday PTO as extended Diwali)12:46
kopecmartinchandankumar, enjoy12:46
rfolco|ruckchandankumar, ack enjoy12:46
arxcruzchandankumar: have fun12:47
chandankumarkopecmartin: rfolco|ruck arxcruz thanks :-)12:49
ssbarneaquiquell: should we continue to use standalone-f28 topic for anything related to this? i would prefer as I have a special dashbboard for it.12:49
chandankumararxcruz: for additional reviews related to os_tempest where to track it on taiga?12:49
quiquellssbarnea: I would say that no, at the end this was more about CI related but it's extending to non CI12:50
quiquellssbarnea: Going to remove checking of fedora version does not make sense if we are not running it at < 2812:52
quiquellHumm have another idea > 27 or > 7 with family redhat should work too12:53
quiquelland nah forget12:53
quiquellit's not my day12:53
*** rlandy has joined #oooq13:02
ssbarneaindeed, changing order should fix it because or evaluates left-to-right stopping at first true.13:08
quiquellssbarnea: nah let's just leave it as it is13:08
*** ykarel_ has joined #oooq13:11
arxcruzchandankumar: what do you mean?13:13
chandankumararxcruz: https://tree.taiga.io/project/tripleo-ci-board/issue/330?kanban-status=202773713:14
*** ykarel has quit IRC13:14
sshnaidm|roverrfolco|ruck, join #rdo please13:15
*** quiquell is now known as quiquell|lunch13:15
rfolco|rucksshnaidm|rover, done13:16
*** quiquell|lunch is now known as quiquell13:17
ssbarneasshnaidm|rover rfolco|ruck : something here does look weird: http://logs.openstack.org/05/615805/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/c1d6ac4/logs/undercloud/home/zuul/ -- undercloud-install-20181106111713.tar.bzip2.gz filename looks.... weird and is not the only weird name.13:17
sshnaidm|roverrfolco|ruck, and #softwarefactory , these are channels "must" for ruck rover13:17
arxcruzchandankumar: you must check with panda he’s the UA13:17
sshnaidm|roverssbarnea, what's the problem?13:18
rfolco|rucksshnaidm|rover, ack... I don't know why autojoin is not working for the registered nick, got to fix it in hexchat13:18
ssbarneatwo levels of compression? just to make it more accesible?13:18
sshnaidm|roverssbarnea, oh.. we gzip all by default13:19
sshnaidm|roverssbarnea, not sure who creates bzip file though13:19
ssbarneawhy not adding a rar too, just in case ;)13:19
*** amoralej|lunch is now known as amoralej13:19
quiquellhypercompression !!!13:19
weshaysshnaidm|rover, rfolco|ruck what's the story w/ all the gate failures this morning?13:19
weshayI see 1313:19
rfolco|ruckweshay, all different and inconsistent13:19
ssbarneai personally find the .gz stuff really not user friendly. this should be up to storage layer, totally transparent to the user.13:20
sshnaidm|roverweshay, each one has its own story..\13:20
sshnaidm|roverssbarnea, the more compression - the less place, it's obvious13:20
weshayhrm.. ok.. thanks guys13:20
sshnaidm|roverssbarnea, add zip and rar, and you can write all tripleo logs on floppy13:20
sshnaidm|roverweshay, there is no common case in them, so we continue to keep an eye13:21
sshnaidm|roverweshay, at least I didn't find it..13:21
*** ykarel_ is now known as ykarel13:21
weshayrfolco|ruck, get reviews on https://review.rdoproject.org/r/#/c/17245/ from sshnaidm|rover13:22
weshayhttps://review.rdoproject.org/r/#/c/17243/13:22
sshnaidm|roverweshay, rfolco|ruck we accidentally had phase1 promotion for master13:22
ssbarneasshnaidm|rover this reminded me about one friend from hischol who wrote an a 10:1 compression tool, that was always 10:1, until we looked inside to discover it was saving the original data a hidden files on the FAT pertition. He now works for symantec :D13:22
weshaysshnaidm|rover, ?13:23
weshaysshnaidm|rover, last promotion was 9d ago in tripleo13:23
sshnaidm|roverweshay, phase1 promoted today13:23
weshaysshnaidm|rover, oh.. if that one was bad, the impact is not huge13:23
weshaysshnaidm|rover, how did they all promote? https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/dlrnapi_promoter/config13:24
weshayhttp://rhos-release.virt.bos.redhat.com:3030/rhosp13:24
rlandymarios: https://review.openstack.org/#/c/615635/ updated per your comment13:25
weshaysshnaidm|rover, rfolco|ruck join my blue13:25
weshayI need an update13:25
* weshay gets coffee13:25
rlandyI think that is really the only patch I will push for this sprint13:25
rlandymarios: the other patch is really nect sprint's work13:25
rlandynext13:25
*** quiquell is now known as quiquell|lunch13:26
weshaysshnaidm|rover, rfolco|ruck https://bluejeans.com/411356779813:26
mariosrlandy: checking13:27
weshayrfolco|ruck, http://38.145.33.166/13:27
mariosrlandy: ack and you mean this for next sprint? https://review.openstack.org/#/c/614638/213:28
quiquell|lunchrlandy, marios: I see the stuff about creating a directory with the reproducer things, In case you want to create a self-extracting script with it https://www.linuxjournal.com/node/100581813:28
rlandymarios: well there is no way to test it - no harm in its current form13:29
ssbarneamarios rlandy : review f28: https://review.openstack.org/#/c/591540/ -- still running check but you can look at previous results where it had one flaky post failure.13:29
rlandyquiquell|lunch: thanks - a good thought for next sprint13:30
mariosrlandy: right for 614638 is should have no effect ack quiquell|lunch something to consider but probably next sprint task13:30
quiquell|lunchrlandy, marios: Are they reviewable ?13:30
mariosquiquell|lunch: yes i think so but they are rlandys13:30
rlandymarios: we can put that patch through this sprint - I have one change to make in it when override is not defined13:31
rlandyquiquell|lunch: https://review.openstack.org/#/c/615635/ is reviewable13:31
rlandysee previous patch for results13:31
rlandyin CI13:31
rlandyquiquell|lunch: also this ... https://review.openstack.org/#/c/614638/2/playbooks/tripleo-ci/run-v3.yaml13:32
rlandybut in concept only13:32
rlandysince we did not actually change the reproducer this sprint13:32
rlandyto add the var to check it13:32
rlandyand the file would be in the wrong place13:32
rlandythe idea is that we would decide where to extract the files in that reproducer dir13:33
rlandyand then use them13:33
rlandyin place of the templates13:33
*** quiquell|lunch is now known as quiquell13:37
rlandyrascasoft: hello - do you get errors when installing the undercloud on rhos-14? https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-14-baremetal-hp_dl360_envE-single_nic_vlans-48/undercloud/home/stack/undercloud_install.log.txt.gz#_2018-11-05_19_08_1413:39
rascasoftyes I'm opening a bug right now13:39
rascasoftrlandy ^^^13:39
rlandyrascasoft: thank you13:40
rlandyrascasoft: are you running rhos-13 as well?13:42
*** ykarel has quit IRC13:42
rascasoftrlandy, yes13:42
rascasoftand 12 and 1013:42
rlandymy rhos-13 job is now falling over in prep-containers13:42
rlandyyours?13:42
rlandyhttps://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-13-baremetal-hp_dl360_envE-single_nic_vlans-33/undercloud/home/stack/overcloud_prep_containers.log.txt.gz#_2018-11-06_02_48_5913:43
rascasoftrlandy, last time it ran it was successful13:43
rlandyhmmm - when was last time?13:43
weshaysshnaidm|rover, rfolco|ruck please review https://review.openstack.org/#/c/615730/4/roles/undercloud-setup/tasks/hostname.yml13:45
rascasoftrlandy, maybe last week, I can recheck it btw13:49
rascasoftrlandy, https://bugzilla.redhat.com/show_bug.cgi?id=164700113:49
openstackbugzilla.redhat.com bug 1647001 in instack-undercloud "Undercloud installation fails looking for non existing containers" [High,New] - Assigned to jslagle13:49
rlandyrascasoft: thanks - no need to recheck - I am running again now13:50
rascasoftrlandy, at least we finally merged the pending review about the "build" thing13:50
rlandyyeah13:50
sshnaidm|roverweshay, also added minutes from yesterday discussion https://tree.taiga.io/project/tripleo-ci-board/epic/29813:50
sshnaidm|roverrlandy, ^^13:50
rlandywondering if that did not kill rhos-13 though13:51
sshnaidm|roverrlandy, please add if I missed something13:51
rlandysshnaidm|rover: will look - thanks13:51
rfolco|ruckweshay, get 5 min before tripleo mtg?13:51
weshaysure13:52
rfolco|ruckyour bj pls weshay13:52
rlandyrascasoft: this is the rhos-13 error I get https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-13-baremetal-hp_dl360_envE-single_nic_vlans-33/undercloud/home/stack/overcloud_prep_containers.log.txt.gz#_2018-11-06_02_48_5913:56
rlandyauth for containers13:57
quiquellrlandy: Since we are using expanded toci_gate_test.sh and friends why do we run run-v3.yaml at all ?13:59
*** saneax has quit IRC14:00
rlandyquiquell: to try be as close as possible to CI14:00
rlandyI need to make one more change to the v3 patch14:00
quiquellrlandy: But if we put a 'reproduce' if statement at all of the playbook we are already very far14:00
rlandywhen override does not exist, it will fail as is14:01
quiquellrlandy: Maybe we have to skip the render altogether if we are with tag/flag reproducer14:01
quiquellWill put in the review14:01
pandaI think the templates will skip rendering if the file is already there14:02
rlandyquiquell: that we could do14:02
rlandyjust the copy is there14:02
rlandyfrom .sh to .sh really14:02
rlandywhich is just a location move14:02
rlandythe rest we need14:02
rlandylike swap etc.14:02
pandaoh, no force is yes by default14:03
quiquellrlandy: Using expanded bash we don't have to get some variables, is that it ?14:03
*** ykarel has joined #oooq14:03
rlandyquiquell: exactly14:04
rlandyquiquell: I don;t plan on pushing that review thsi sprint so comment away14:04
quiquellrlandy: Ok, my two cents are to use 'reproducer' flag to skip stuff14:05
rlandyquiquell: pls comment on the patch and I'll work on it - thanks14:05
rlandymakes the tracking easier14:05
quiquellrlandy: Will do14:05
rlandythank you!14:06
sshnaidm|roverweshay, is it ok to shut down patch based triggers for ovb jobs, but to leave comment trigger? So if you want RDO cloud job to run you can post a specific comment in a patch14:06
sshnaidm|roverweshay, seems like useful stuff if you want to check quickly something for rdo cloud or ovb14:06
weshaysshnaidm|rover, ya.. +1 shutdown patch based triggers, leave comment triggers and periodic job14:07
*** agopi_ has joined #oooq14:09
arxcruzkopecmartin: https://review.openstack.org/612423 is recheck fix the problem?14:10
kopecmartinarxcruz, i don't know, we will see14:11
arxcruzkopecmartin: checking the logs, it’s a failure on packstack14:12
arxcruzwondering if there’s some bug open upstream for that14:12
arxcruzor is just $random shit14:12
kopecmartinarxcruz, problem also is, that it happens only some time, not every time14:13
*** matbu has joined #oooq14:13
arxcruzkopecmartin: last two rechecks was in the same job14:13
arxcruzI’m just wondering, that’s all :)14:13
kopecmartinarxcruz, yes, but before that .. and I saw it in other patches too, but then it automagically disappeared14:15
kopecmartinanyway, last recheck, if it fails again, we will need to escalate it14:15
*** nhicher has joined #oooq14:16
sshnaidm|roverweshay, rfolco|ruck https://review.rdoproject.org/r/#/c/17272/14:21
sshnaidm|roverweshay, can you merge it please? ^14:37
weshayrlandy, do you have +2? https://review.rdoproject.org/r/#/c/17272/14:41
rlandyweshay: ack14:42
rlandyweshay: ready for w?14:43
weshayrlandy, yes.. workflow14:43
rlandydone14:43
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)14:44
*** agopi_ is now known as agopi14:47
jaosorioro/14:51
weshaypanda, sshnaidm|rover community mtg14:52
weshayor in 8 min14:52
weshayI guess14:52
rfolco|ruckweshay, ping community call14:53
*** derekh has joined #oooq14:55
sshnaidm|roverrfolco|ruck, what is the link?14:59
rfolco|rucksshnaidm|rover, https://bluejeans.com/587845809715:00
sshnaidm|roverrfolco|ruck, please send me an invite later, I don't have it in my cal15:00
rfolco|rucksshnaidm|rover, rhos mtg cal, there is no invite anymore15:01
rfolco|rucksorry for the confusion15:01
ssbarneaweshay arxcruz panda https://review.openstack.org/#/c/615831/  - f28 two liner heat-agents fix, passed check.15:07
quiquellssbarnea: I think they don't have super powers there15:08
*** vinaykns has joined #oooq15:09
sshnaidm|roverweshay, please join #rdo15:20
*** ykarel is now known as ykarel|away15:22
mariosrlandy: almost :) http://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/reproducer-quickstart.sh15:29
mariosrlandy: we have the playbooks \o/ panda++ ^15:30
hubbot1marios: panda's karma is now 815:30
mariosrlandy: but the repos are https://nope15:30
*** gkadam has quit IRC15:30
rlandymarios: wow - that's progress15:30
rlandy  zuul_playbooks+="nope;"15:30
quiquellmarios, rlandy: Maybe you can forget about the repos and store them in the reproducer directory15:31
mariosrlandy: right too much nope15:31
quiquellmarios, rlandy: Just copying what's inside /home/zuul/src/...15:31
rlandywe got one nope in the playbooks15:31
rlandyquiquell: I thought about that15:31
rlandyquiquell: there is another patch collecting stuff in src15:31
rlandybut it's a lot to carry around in the logs15:31
quiquellrlandy: this way we are really going to reproduce it, exactly the same versions15:32
rlandyif we can just clone, there is no need to carry them15:32
rlandywell - we keep a track of versions15:32
rlandypoint aside15:32
rlandyrepos are not like templates15:32
rlandywe don't generate them15:32
quiquellrlandy: ack, we should clone exactly the same version of stuff like openstack-infra/zuul-jobs15:32
rlandyit's an idea if we totally cannot get the repos15:32
rlandybut we already get shouted out for our usage of logs15:33
quiquellgit clone is not enough we have to put them in the same version15:33
quiquellrlandy: then let's just get what revision we have cloned there and put it in the reproducer15:33
rlandyif anything we should store the hash15:33
rlandythat is all15:33
quiquellrlandy: yep the hash15:34
rlandymarios: ^^ do you have access to the hash on the repos as well?15:34
mariosrlandy: sec (check any job zuul-variables)15:34
quiquellrlandy, marios: I suppose is a matter or run 'git' at the repo dir to get the current hash15:34
quiquellAhh is at zuul vars15:35
rlandyquiquell:yep15:35
quiquellyep15:35
rlandythat is all we need15:35
marioshttp://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/zuul-variables.yaml15:35
mariosrlandy: for repos yes its from zuul vars at projects: ^15:35
rlandynot to carry around the whole repo cloned15:35
rlandygreat15:35
rlandywe need to capture that as well15:35
rlandyso we clone correct version15:35
mariosrlandy: so which field do we need from there ? the hash ? from?15:36
rlandyhmmm... I don;t see it15:36
rlandythat's really a step above what we had previously15:36
quiquellrlandy: I think we don't have it, we will have to retrieve it running git at the dir15:37
rlandystepping back ...15:37
quiquellmarios: ^15:37
rlandylet's get the repo names right first15:37
mariosquiquell: rlandy ok, going to try work about those nopes with another run before eod15:37
mariosso close...15:37
rlandymarios: need help there?15:37
quiquellmarios: sure, that's a good progress15:37
mariosrlandy: well if you can think of something wrt those nopes add note on the review?15:38
mariosrlandy: otherwise its a matter of edit and wait 1 hour for the job, its unfortunate this is right at the end of the deploy15:38
jaosoriorcould I get some reviews for https://review.openstack.org/#/c/615730/ ?15:39
rlandymarios: will look quickly15:42
*** ykarel|away has quit IRC15:43
rlandymarios: let's start with why we have one nope playbook in    zuul_playbooks+="nope;" ... http://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/reproducer-quickstart.sh15:43
rlandydo you know atm?15:43
mariosrlandy: no i didn't check that yet i assume one of the things in zuul_console_log is not like th eothers (i.e. has no playbook attribute)15:44
marioswe could just guard for that maybe?15:44
marioshttp://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/zuul_console.json15:45
mariosrlandy: yeah the 4th one there15:45
*** kopecmartin is now known as kopecmartin|off15:46
rlandymaybe our search is too wide15:50
mariosrlandy: ack sec am debugging locally15:52
mariosrlandy: gona try something for the projects in a sec15:52
rlandyk - sorry  just checking the drains outside - it's pouring with rain here and prefer not to have a flood15:53
mariosrlandy: ack thanks for your help15:53
rlandymarios: why  zuul_variables: "{{ (lookup('file', artcl_collect_dir + '/zuul-variables.yaml') | from_yaml)['zuul'] }}"?16:00
rlandyif you can pass zuul_vars to the collect_logs playbooks16:00
rlandydo you still not have access to the zuul vars?16:00
rlandy zuul_variables['projects']16:01
rlandy^^ wondering what that puts out16:01
mariosrlandy: local debug like http://paste.openstack.org/show/734262/16:06
rlandymarios: wouldn't you still need canonical_name in that?16:06
*** panda is now known as panda|ko16:06
mariosrlandy: and you can wget that zuul-variables.yaml file16:06
mariosrlandy: no so the key is enough it is the same as canonical_name.. for some reason i can't get to it (*see my paste)16:06
marios    "msg": "git.openstack.org/openstack-infra/tripleo-ci;git.openstack.org/openstack/tripleo-quickstart-extras;git.openstack.org/openstack/tripleo-ha-utils;git.openstack.org/openstack/browbeat;git.openstack.org/openstack/tripleo-upgrade;git.openstack.org/openstack/tripleo-quickstart"16:07
mariosusing         msg: "{{ zuul_variables['projects'] | join(';') }}"16:07
*** quiquell is now known as quiquell|off16:08
marioshttp://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/zuul-variables.yaml i.e. the key for each of the things under projects is the same as the canonical_name16:08
rlandyI see the key ok16:08
panda|komarios: rlandy I don't understand anymore if in the end the variables you're collecting are useful or not16:08
rlandypanda|ko: which variables are referring to?16:09
rlandythere are multiple vars under discussion here16:09
mariospanda|ko: we are getting the playbooks executed and the project we want to clone like http://logs.openstack.org/72/613572/21/check/tripleo-ci-centos-7-standalone/72d15a9/logs/reproducer-quickstart.sh (grep zuul_playbooks)16:10
rlandymarios:   msg: "{{ zuul_variables['projects'] | join(';') }}" looks positive16:10
mariospanda|ko: ignore the 'nope' we are working on that bit ;)16:10
mariosrlandy: right lets see16:11
*** hamzy_ has quit IRC16:19
weshaysshnaidm|rover, rlandy marios reminder 5min16:26
rlandyack16:26
marioswethanks16:26
mariosweshay: thanks :)16:26
mariosall these americans coming online and increasing the zuul queue16:27
* marios shakes fist16:27
mariosgets coffee16:27
*** ccamacho has quit IRC16:27
sshnaidm|rovermarios, canadians also, you can't ignore Emilien16:28
mariossshnaidm|rover: right16:29
*** udesale has quit IRC16:32
*** panda|ko is now known as panda|off16:34
jaosoriorso... should we merge this https://review.openstack.org/#/c/615730/ ?16:35
chandankumarweshay: jaosorior rfolco|ruck panda|off arxcruz kopecmartin|off * Enable stackviz support - https://review.openstack.org/60310016:35
chandankumar* Added support for installing tempest from distro - https://review.openstack.org/59142416:35
chandankumar* Fixed missing ; from if statement in tempest_run - https://review.openstack.org/61452116:35
chandankumar* Added task to list tempest plugins - https://review.openstack.org/61583716:35
chandankumar* Remove apt_package_pinning dependency from os_tempest role - https://review.openstack.org/60999216:35
chandankumarSupport added to openstack/rpm-packaging project (will be consumed in os_tempest role):16:35
chandankumar* Added spec file for stackviz - https://review.openstack.org/60933716:35
chandankumar* Add initial spec for python-tempestconf - https://review.openstack.org/59814316:35
chandankumarWork In Progrees:16:35
chandankumar* Enable python-tempestconf support - https://review.openstack.org/61296816:35
chandankumarsorry16:36
chandankumarweshay: jaosorior rfolco|ruck panda|off arxcruz kopecmartin|off https://docs.google.com/document/d/10YG9hgjui6Fn7zrc-zYfyUM7V3NAc97EwlMO0uz9BJw/edit?usp=sharing16:36
chandankumarwe can use this doc to update status16:36
jaosoriorawesome16:37
chandankumararxcruz: feel free to add reviews If I missed anything16:38
*** quiquell|off is now known as quiquell16:38
*** quiquell is now known as quiquell|off16:38
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)16:44
*** hamzy_ has joined #oooq16:44
*** chandankumar is now known as chkumar|pto16:59
*** jfrancoa has quit IRC17:13
ssbarnearlandy: what is the update about f26 nodes, do we still have them or they were updated? just wanted to know if f26 is something i need to keep an eye open for or not.17:18
rlandyssbarnea: they're f27 now17:21
rlandymarios: weshay: the more I think about the reproducer, the more I think we're going to hit a wall17:21
rlandyand going the zuul standard way id going to serve us better17:22
rlandyright now we have a need to get something out17:22
rlandybut if we want to keep it maintainable, I think we will have to go zuul in the end17:22
rlandyjust my $0.0217:22
*** ccamacho has joined #oooq17:22
rfolco|ruckrlandy, weshay sshnaidm|rover: not urgent but this one left behind ... https://review.openstack.org/#/c/608051/17:23
rlandyrfolco|ruck: if you pull ^^ setting out of base - where is it going now?17:24
rlandywe had a reason for setting that17:24
sshnaidm|roverrlandy, rfolco|ruck  we (actually dmsimard) set it for having dns cached for more time than it's configured in dns record itself (ttl)17:26
mariosrlandy: /me outa here add comment on reviews? (*watching http://zuul.openstack.org/stream/fc269e4eeb5a4c9ebe153d0d5ce1e8c4?logfile=console.log ) for v2217:26
sshnaidm|roverotherwise this record is wiped out from unbound db and it sends a request again17:26
mariosrlandy: i'll check in the morning17:26
sshnaidm|roverrfolco|ruck, rlandy and because we have sometimes problem with networking or dns servers, this request can fail - and it fails the whole job17:27
sshnaidm|roverrfolco|ruck, rlandy so our interest is to keep the cached result and use it as long as possible without asking external dns servers17:27
sshnaidm|roverand if it fails or there is some problem with it, we need to investigate why it happens17:27
sshnaidm|rovergithub has pretty short ttl, because of their HA technology (round robin or kind of) which cause jobs to send requests multiple times during the run17:28
sshnaidm|roverand some of these requests failed and jobs failed17:29
rlandysshnaidm|rover: ok - checking CI from previous patch17:30
rlandyhard to vote with no results to check against17:30
rfolco|rucksshnaidm|rover, ok17:32
*** ccamacho has quit IRC17:33
rlandyweshay: what do you actually want to see running on upshift when the patches merge to allow OVB?17:33
rlandyweshay: I've been testing with rhos-1417:33
rlandybut I guess that some rdo rhel testing, if possible, would be more valuable?17:34
weshayrlandy, osp-14 is good17:34
weshayrlandy, rdo on rhel is possible17:34
weshayyou'd still be running w/ centos containers17:34
rlandyweshay: it would see, that people care more about that?17:35
rlandywe are running osp-14 and I don't think there is much interest17:35
weshayrlandy, restate that?17:35
rlandythere is work to keep these jobs up - there should be value17:35
weshaythere is value in the fidelity of the CI tools, that they work both on rdo and OSP1417:36
weshayrlandy, actually spend 5 min w/ me on blue17:36
ssbarnearlandy weshay marios : low prio, but i love to remove ~2700 lines out of tqci https://review.openstack.org/#/c/610937/17:36
weshayrlandy, this is import re: packages and rdo / osp fork17:36
rlandyk17:36
weshayhttps://bluejeans.com/u/whayutin/17:37
weshayreal quick17:37
weshayrlandy, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/master.ini17:40
*** bogdando has quit IRC17:48
*** sshnaidm|rover is now known as sshnaidm|afk17:56
rfolco|rucksshnaidm|afk, weshay trying a new fix on logrotate just fyi17:57
rfolco|ruckthere is no escape now, it will rotate for the honor of my OCD17:58
*** derekh has quit IRC18:01
*** apetrich has quit IRC18:03
*** dtantsur is now known as dtantsur|afk18:06
*** rook has joined #oooq18:08
rookssbarnea: hey - in https://review.openstack.org/#/c/612975 you mention browbeat failures, can you share those?18:08
*** amoralej is now known as amoralej|off18:10
*** jtomasek has quit IRC18:18
ssbarnearook: i think that the but to track browbeat interaction is https://tree.taiga.io/project/tripleo-ci-board/issue/25318:19
ssbarneai do see any links to logs on it now. still, i do not want to see numpy installed on each tripleo install, as this has a serious footprint. that is why want to make browbeat an extras (optional dependency).18:21
ssbarneanot to be confused with tripleo-quickstart-extras :D ... just happen to use the same word.18:21
*** rfolco|ruck is now known as rfolco|doctor18:30
weshayrfolco|doctor, can you start the planning meeting on thrs 1/2 hour ealier18:32
rookssbarnea: as mentioned, I am not against moving numpy/my insights code out of browbeat proper18:33
rookand create a browbeat-insights repo18:33
rookto query results18:33
rookWe might be able to get around this to only import where needed.18:33
rookagopi: ^18:33
rookssbarnea: what is this tool i am looking at18:33
ssbarnearook: if numpy is not needed for all use-cases of browbeat, there is no need to move it out, just make it an extra and install browbeat with numpy.18:34
rookssbarnea: right, not necessary for all aspects of browbea.18:34
rookbrowbeat*18:34
ssbarneaif someone needs the "fat" browbeat, they can install it using "pip install browbeat[numpy]" (or whatever extra name you prefer). I used setuptools extras for many years, with decent results.18:36
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)18:44
ssbarneaquiquell|off started quite a few params.pp changes, I wonder how many we will have to do, one of those days where I am missing a monorepo.18:44
rlandymarios++18:47
hubbot1rlandy: marios's karma is now 518:47
rlandyyay!!!18:48
agopisomehting like this you mean rook ssbarnea https://review.openstack.org/#/c/615974/ >18:48
rlandyweshay: fyi ... marios has it now ... http://logs.openstack.org/72/613572/22/check/tripleo-ci-centos-7-standalone/fc269e4/logs/reproducer-quickstart.sh (see projects and playbooks lines)18:49
ssbarneaagopi: exactly! :)18:51
ssbarneaagopi ideally you would want to assure that you do at least one "pip install .[insights] && pip check" somewhere inside tox, just to check that your extras are installable and they do not create conflicts.18:53
*** hamzy_ is now known as hamzy18:53
ssbarneasshnaidm|afk++. for your https://gist.github.com/sshnaidm/aa551578229b076b20740c000f40dfd9#file-shellpipefail-py-L23 -- i hope to see it part of ansible-lint!18:58
weshaysshnaidm|afk, which reviews are you using to kick vexx vs rdo?18:59
sshnaidm|afkweshay, https://review.openstack.org/614633  https://review.openstack.org/61463219:06
sshnaidm|afkweshay, I shut it down19:06
*** agopi has quit IRC19:09
*** rlandy is now known as rlandy|vote19:26
weshaysshnaidm|afk, hrm.. k19:45
weshaysshnaidm|afk, might be worth to trigger w/ comments19:46
weshayso we can monitor this situation19:46
*** dsneddon has joined #oooq19:46
*** rlandy|vote is now known as rlandy19:58
*** rfolco|doctor is now known as rfolco|off20:16
*** jtomasek has joined #oooq20:21
*** jtomasek has quit IRC20:24
sshnaidm|afkweshay, ok, will enable it then20:31
weshaysshnaidm|afk, thanks20:31
sshnaidm|afkweshay, but w/o load it behaves ok, so not sure it will give us the whole picture20:34
weshaysshnaidm|afk, sure.. well the other good thing about keeping it running is that we may be able to spot bugs that would have just sat there20:34
weshaysshnaidm|afk, is it just running against current-tripleo?20:35
sshnaidm|afkweshay, yeah20:35
weshayk20:35
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)20:44
rlandypanda|off: ping if you come back re: vars in zuul inventory20:51
*** apetrich has joined #oooq21:29
rlandyugh - we're missing vars for pre21:42
*** dsneddon_ has quit IRC21:43
*** hamzy has quit IRC21:45
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages)22:44
*** rfolco|off has quit IRC23:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!