Monday, 2018-10-29

*** dsneddon has joined #oooq00:03
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @  (3 more messages)00:40
*** weshay_afk is now known as weshay00:48
weshaysshnaidm, nice work on the promotion man00:54
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (4 more messages)02:40
*** chem has quit IRC02:54
*** chem has joined #oooq02:55
*** apetrich has quit IRC03:03
*** apetrich has joined #oooq03:09
*** d0ugal has quit IRC03:11
*** d0ugal has joined #oooq03:40
*** udesale has joined #oooq03:54
*** d0ugal has quit IRC04:00
*** d0ugal has joined #oooq04:11
*** ratailor has joined #oooq04:14
*** d0ugal has quit IRC04:17
*** jaganathan has joined #oooq04:33
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)04:40
*** chkumar|off is now known as chandankumar04:44
*** huynq has joined #oooq05:17
sshnaidmhello, new ibmers05:29
*** apetrich has quit IRC05:42
*** apetrich has joined #oooq05:43
*** ratailor has quit IRC05:56
*** ykarel has joined #oooq06:03
*** jbadiapa has joined #oooq06:30
mariossshnaidm: :*06:32
marios:(06:33
Tengudon't know what to think about that.06:33
sshnaidmrip rh06:33
Tengugot the news via a friend on telegram. bam.06:33
Tenguwell apparently we should stay distinct unit.06:34
Tengufor how long though... ?06:34
*** saneax has joined #oooq06:34
sshnaidmI bet for 1-2 years06:39
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)06:40
*** jfrancoa has joined #oooq06:44
*** ratailor has joined #oooq06:48
*** huynq has quit IRC06:51
*** quiquell|off is now known as quiquell06:51
*** ccamacho has joined #oooq07:07
quiquellsshnaidm, marios, Tengu: blue clouds we are07:30
quiquellmorning btw07:30
marios:((07:31
sshnaidmhow does rfolco|rover feel to escape from ibm to get back there in a year :)07:31
TenguTime to unearth this old classic: https://www.youtube.com/watch?v=zA52uNzx7Y407:31
marioslol Tengu07:32
Tenguguess I chose my time to enter Red Hat...07:32
Tengunew logo (bug polemics already), IBM in da place (polemic just started)...07:32
Tenguwhat else will fall upon us before the end of the year? ;)07:33
quiquellTengu: the video give me the creeps07:33
quiquellTengu: teleworking ?07:33
Tenguhu?07:34
TenguI'm remote - please, don't push me in an office ;_;07:34
Tenguespecially, NOT an openspace07:34
*** ykarel is now known as ykarel|lunch07:34
quiquellTengu: me too :-(07:34
sshnaidmibm force people to work in office :(07:35
Tenguyeah, heard so.07:35
sshnaidmI don't have already have a sit there..07:35
Tenguthat might make me think twice about my future, tbh07:35
quiquellLet's settle things  little though07:35
Tenguyeah.07:35
Tengulet dust fall, and let's see what's going on.07:35
Tenguanyway, I think nothing will change for the next 1-2 years07:35
quiquellTengu: is a very big merge it will take time to discover the direction07:37
* sshnaidm have been in 3 acquisitions and always big fish ate small fish07:37
Tenguwait'n'see.07:38
Tengufact is, the dominant emotion right now is "disapointment": when I was to the 3-days thingy for new employee, I was told "we don't want to be bought, so we keep stock high" and so on. Now, that's done. Well. we'll see.07:39
quiquellTengu: They tell me that like few months ago, in the NHO :-(07:40
Tenguyeah.07:40
sshnaidmTengu, yeah, heard this too, tbh I wouldn't be against acquisition by google maybe07:40
TenguI've added a question on that in the gdoc.07:40
quiquellsshnaidm: Do you know if the deal is close or depends on the market ?07:41
Tenguwell, even microsoft would be good I think, given their current politic/direction.07:41
Tenguaaanyway. we don't have a word in that.07:41
quiquellsshnaidm: maybe google or microsoft make amove07:41
sshnaidmquiquell, I think it's close if it's widely announced07:41
Tengupapers are already signed imho.07:41
sshnaidmTengu, yeah, M$ i changing, or at least declares about that07:42
Tengubut if we can get some power8 cheap, I'd be happy anyway XD07:42
*** gkadam has joined #oooq07:44
*** d0ugal has joined #oooq07:49
*** quiquell is now known as quiquell|brb07:51
*** d0ugal has quit IRC07:56
*** jtomasek has joined #oooq07:58
*** d0ugal has joined #oooq08:01
*** arxcruz has joined #oooq08:06
quiquell|brbsshnaidm: Did you have something about noop jobs graphs not using dots ?08:14
sshnaidmquiquell|brb, well, for me it's more convenient to see list of noop jobs in table, I don't really can easily track them in dots08:15
*** quiquell|brb is now known as quiquell08:15
quiquellsshnaidm: yep, the dot stuff is only to have an alert, since only graph can have alert08:16
quiquellsshnaidm: I don't like it either08:16
quiquellsshnaidm: They are in a table at the main part08:16
sshnaidmquiquell, but they are mixed with all other jobs afaiu08:16
sshnaidmquiquell, to have them in separate table to see what exactly failed instead of going to each of patches to see08:17
quiquellsshnaidm: yep, can you make a review with it ?08:17
sshnaidmquiquell, yeah, will do08:17
*** sshnaidm is now known as sshnaidm|ruck08:18
quiquellsshnaidm|ruck: Cool, ruck/rover perspective is always the best to figure out that stuff08:18
sshnaidm|ruckquiquell, yeah, that's mostly people that use it heavily :)08:19
quiquellsshnaidm|ruck: About the email from wes I am ok with sova doing the stuff too, I just see grafana more flexible for searching stuff08:20
quiquellsshnaidm|ruck: But you have to compose the search at the browser and all08:20
quiquellsshnaidm|ruck: Maybe we can create a new dashboard with the sova stuff so it's grafana too and we can doo searching there08:21
*** gkadam has quit IRC08:22
*** gkadam has joined #oooq08:22
sshnaidm|ruckquiquell, if we talk about fail/pass statistics, sova just has it by default. The issue with grafana is that you need to make an effort to get this info and to represent it08:22
sshnaidm|ruckquiquell, and it's not obvious to do for people that deal with grafana less than we do :)08:23
quiquellsshnaidm|ruck: It's like coocked stuff vs raw stuff08:23
quiquellsshnaidm|ruck: I see sova a coocked easier to get the info and grafana as raw more powerfull for exploration08:24
sshnaidm|ruckquiquell, for making new dashboard I need to change the way sova works.. for now we can make a dashboard with each job statistics for last weeks08:24
quiquellsshnaidm|ruck: Maybe some links to coocked search is enough08:24
quiquellsshnaidm|ruck: in the front page of the dashboard-ci08:25
sshnaidm|ruckquiquell, it'll require a new dashboard, but I think it could be useful to have each jobs statistics and place we can track its success08:25
quiquellsshnaidm|ruck: Agree08:25
sshnaidm|ruckquiquell, or maybe some graph in 'exporing dashboard", but then you need to explain to everybody how to use it08:26
sshnaidm|ruckquiquell, when we do "cook" stuff, we avoid all this questions08:26
quiquellsshnaidm|ruck: Best stuff if to have booth dashboard, coocked and searchable08:27
sshnaidm|ruckquiquell, yeah, we can always search or use variables08:28
quiquellsshnaidm|ruck: another question, is there something we can do about undercloud ARA or it's a no-no ?08:28
*** matbu has quit IRC08:28
sshnaidm|ruckquiquell, yeah, I'll start to poke there08:29
sshnaidm|ruckquiquell, it's possible, but will require some effort08:29
sshnaidm|ruckquiquell, ara for undercloud should be in venv and we need to figure out the way to disable it when running tripleo prepare containers role08:30
sshnaidm|ruckquiquell, I'll prepare the venv patch, but disabling ara when running ansible in parallel will be the key08:30
sshnaidm|ruckquiquell, sqlite doesn't allow simultaneous writes to db08:31
quiquellsshnaidm|ruck: And two differnt sqlites ?08:31
quiquellsshnaidm|ruck: changing the db file ?08:31
*** jaganathan has quit IRC08:31
quiquellsshnaidm|ruck: maybe we can merge them together later on08:31
quiquellsshnaidm|ruck: or has just different ARA report08:32
*** apetrich has quit IRC08:32
sshnaidm|ruckquiquell, every ansible stream needs a separate file then, it's same amount as containers count08:32
*** d0ugal has quit IRC08:32
sshnaidm|ruckquiquell, the non obvious problem is how we change this settings on the fly, because everything uses the same ansible.cfg08:32
sshnaidm|ruckquiquell, well, all this is possible, but need an investigation08:33
quiquellsshnaidm|ruck: Yep the problem is to know where to touch, like alawys with this ARA thing08:33
*** amoralej|off is now known as amoralej08:36
*** bogdando has joined #oooq08:39
*** ykarel|lunch is now known as ykarel08:40
*** d0ugal has joined #oooq08:40
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)08:40
chandankumararxcruz: kopecmartin I have added some docs on how to do backport for tempest for RDO and RHOS, feel free to take it once panda|off is ok, https://tree.taiga.io/project/tripleo-ci-board/issue/289?kanban-status=202773308:45
*** apetrich has joined #oooq08:49
*** gkadam has quit IRC08:53
*** gkadam has joined #oooq08:55
*** matbu has joined #oooq08:56
*** huynq has joined #oooq08:57
*** tosky has joined #oooq09:02
*** matbu has quit IRC09:07
*** panda|off is now known as panda09:19
quiquellpanda: o/09:19
* panda is looking for a job.09:19
quiquellpanda: I have one for you :-P09:20
quiquellpanda: Do you have some blue time to talk aboit fedora + promoter ?09:21
ssbarnearegarding what I call "going purple" subject: lets try not to panic, there is a lot to digest and nothing is set in stone, even to get it approved will take more than 6mo, things can change,.... maybe even IBM culture.09:22
pandaquiquell: It's holiday here today09:22
pandaand I'm spending it looking for a new job.09:23
quiquellpanda: Ahh then whenever you are back, there is no hurry for it09:23
quiquellpanda: it or stuff like being a farmer ?09:23
quiquellpanda: sheeps are like clouds maybe you can work with them too :-)09:23
*** d0ugal has quit IRC09:27
pandato think how many jobs with double the salary I declined to stay here and do good open source...09:29
ssbarneasshnaidm|ruck: FYI, I did see the message and I am working withc quiquell to test the fix for the qs.sh.09:30
sshnaidm|ruckssbarnea, please keep me posted, it's currently blocker for phase1 promotion and pretty urgent09:31
ssbarneasshnaidm|ruck you are welcomed to check the latest version too if you want, it passed my local testing, soon jenkins will post an answer.09:32
ssbarneasshnaidm|ruck: few lessons to learn from this... to add something for retro.09:32
ssbarneasshnaidm|ruck even CI engineers stop looking at jobs when they fail too often, and at least 3 failed to do so in this case and the bug went in. in addition to the obvious "be more careful" i would also try to find a way to avoid this by making CI more reliable, like running extra testing upstream.09:35
pandathere is only one lesson to learn here, and it has been the same for the last months, it's time to start testing better what we do.09:36
ssbarneapanda: are you specific about human-testing, or ci-testing? or just "both".09:37
quiquellWe have to make them more stable first at letast phase1 jenkins jobs.09:37
pandassbarnea: human testing is not sustainable in the long run09:37
pandassbarnea: a change must be tested everyway it creates an impact09:38
ssbarneapanda: totally agree with you, just wanted to check.09:38
pandaautomate or die.09:38
ssbarneathis should be the channel topic09:38
quiquelland maked by a bot the topic so we demostrate that everything is automatic here09:39
quiquelland then we remove ourself from the equation09:39
ssbarneaso now let me go back to polish my linkedin profile,... :D09:39
quiquellssbarnea: searching...09:39
quiquellssbarnea: your user09:39
*** holser_ has joined #oooq09:42
chandankumarquiquell: do we have working patch which I can try the new workflow with reproducer on fedora 28?09:45
quiquellchandankumar: I have the stuff I have being using this sprint, but it's not productin wise09:45
quiquellchandankumar: You can try it09:45
quiquellchandankumar: https://review.openstack.org/#/q/topic:f28-tracer-bullet+(status:open+OR+status:merged)09:46
chandankumarquiquell: I am firing a job on rdo cloud09:47
quiquellchandankumar: has let me discover bugs faster09:47
quiquellchandankumar: You can try above stuff in parallel, but you will need some manual steps09:47
quiquellto make it work09:47
quiquellIT's RDO reproducer09:47
quiquellDidn't want to add libvirt to the queation09:47
quiquellequation09:47
chandankumarquiquell: ok, no free machines for libvirt one09:49
pandaquiquell: why fedora + promotion by the way ? It' probably next step09:54
*** d0ugal has joined #oooq09:54
quiquellpanda: Just thinking some design abou it09:55
pandaquiquell: ok, we can talk tomorrow morning09:56
quiquellpanda: Sure no problem, continue with the searching09:56
pandammhh, on the other hand, tomorrow I may not be here anymore.09:59
quiquellpanda: No one is going to be at rh tomorrow :-)09:59
arxcruz:(10:06
rfolco|roverarxcruz, welcome back to the mother ship10:07
arxcruzrfolco|rover: :(10:08
arxcruzrfolco|rover: same for you10:08
pandathere's no escape10:09
Tenguwell, all communications seem to point to the fact RH will stay "as is" and independant...10:13
Tengulet's just hope it's not only words.10:13
Tenguwe'll probably know a bit more this afternoon.10:13
sshnaidm|ruckTengu, quite a naive to think so10:13
Tengunah, just trying to stay positive ;)10:14
TenguI've read enough about IBM....10:14
Tengulemme keep my illusions please, it's only Monday10:14
*** sshnaidm|ruck is now known as sshnaidm|afk10:18
*** sshnaidm|afk has quit IRC10:23
ssbarneamarking new it... that is why they told us not to use new logo for the next 6months :D10:34
*** dtantsur|afk is now known as dtantsur10:35
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)10:40
ssbarneapanda (or others): if you have few minutes to review https://review.openstack.org/#/c/613753/1/specs/zuulv3-priority.rst it would be great. i want some feedback before making a more format proposal to infra.10:52
*** rfolco|rover has quit IRC11:10
panda"Red hat linux enterprise"11:13
panda"7000 applicant a day to IBM" that means we'll be replaced soon11:15
*** vkmc has quit IRC11:17
*** vkmc has joined #oooq11:22
*** udesale has quit IRC11:26
quiquellssbarnea: At jenkins sudo is installed but jenkins user does not have permissions ?11:32
ssbarneaquiquell nobody sane allows jenkins user to sudo, not on classic jenkins slaves at least.11:36
quiquellssbarnea: The jenkins execution there has already virtualenv installed in the nodes ?11:39
quiquellssbarnea: I don't see install-deps executed11:39
*** jaganathan has joined #oooq11:40
ssbarneaquiquell: install-deps is run as part of bootstraping but on jenkins we should never reach the sudo code, we should already have all deps available.11:40
ssbarneaquiquell the major bug was that the condition was not working11:41
quiquellssbarnea: Yep, was just testing blackbox way11:41
*** ccamacho has quit IRC11:44
*** ccamacho has joined #oooq11:45
ssbarneain order to keep the channel dress code, lets move all "news" to intranet #ibm channel11:45
quiquellssbarnea: so jenkins slaves has pip + python2 already installed11:49
quiquellalso git ip and gcc ?11:49
ssbarneaquiquell: i think so, otherwise the execution would fail.11:50
quiquellssbarnea: I am testing it with a vanilla docker image11:50
*** sshnaidm has joined #oooq11:51
ssbarneaif you have time please try to play with https://review.openstack.org/#/c/613672/ (molecule poc), i am trying now to find a way to test qs.sh with it.11:51
ssbarneait is a bit outside the original scope of molecule, but i hope it can make it run with it.11:51
weshayfyi https://docs.google.com/forms/d/e/1FAIpQLScAFNzht1m0MluPAwBGOXV5xb1xeyy080mXCd6kb9YsXZigig/viewform11:52
ssbarneais more coveninet to use docker images11:52
ssbarneayeah, already submitted a couple of questions, it would be fun to have a more open survey, one with visible questions where we can vote on their priority...11:53
quiquellssbarnea: found weird issue11:55
quiquellssbarnea: I needed to add an space " " after bash line wrapping to make it work there11:55
ssbarneaquiquell where?11:56
weshaymarios, need a few11:57
*** amoralej is now known as amoralej|lunchb11:57
*** amoralej|lunchb is now known as amoralej|lunch11:57
mariosweshay: ack11:58
quiquellssbarnea: commented in the review12:01
quiquellssbarnea: Also vim changes the color if I add a space after12:01
*** rlandy has joined #oooq12:02
quiquellssbarnea: line 677 it's like no wrapping the line for me :-/12:05
quiquellssbarnea: Didn't have the working directory, but failure is not the best one :-/12:09
quiquellssbarnea: Nothing bad with your review there12:09
quiquellssbarnea: python-devel is missing of the dependency list12:14
quiquellssbarnea: and again this is not related to the issue12:15
ssbarneai can try to mkdir working directory as an improvement12:16
quiquellnah let's focus12:16
quiquellwe  have to fix this12:16
ssbarneafor the moment i just want to fix that bug and later we want work to improve the overall logic, especially better testing of it.12:16
*** trown|outtypewww is now known as trown12:18
quiquellssbarnea: With zuul we install stuff with sudo ? is that right ?12:20
quiquellssbarnea: The code is a littel missleading12:23
quiquellssbarnea: If you can isntall sudo you don't need sudo12:24
quiquellssbarnea: NEED_SUDO is NEED_PACKAGES12:24
quiquellssbarnea: but it's working fine at a vanilla centos with jenkins user without sudo permissions12:24
*** rfolco has joined #oooq12:30
ssbarneaquiquell: yes and no... i also find NEED_PACKAGES misleading, which packages? wheels are still packages? I am more inclined to rename it to NEED_ROOT or similar12:36
ssbarneathe idea is: try to do everything at user level, and fallback to escalation if needed.12:37
quiquellssbarnea: You are installing packages with this variable more than using root12:37
ssbarneahow we name is less important, but i am open to suggestions.12:37
quiquellssbarnea: How you install them is sudoing stuff if you are not root already, but this is just naming, we can work it out late r12:37
quiquellssbarnea: Let's merge this12:37
quiquellssbarnea: If it's working at ci.centos.org12:38
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)12:40
pandarfolco: the meeting with russel ?12:42
weshaypanda, quiquell ssbarnea rlandy anyone who needs a 1-1 let me know12:43
weshaychandankumar, I need to chat w/ you today12:43
chandankumarweshay: sure12:44
rlandyweshay: sure - if you have time in the afternoon12:44
rlandywe should probably talk re: hardware12:44
weshayrlandy, sure do.. let's chat then12:45
quiquellweshay: I missed it last week we can do it if you have time12:45
weshayk k12:46
ssbarneaweshay: maybe an appointment to the shrink would be better.... we just need to get used to the idea.12:46
weshay:)12:46
ssbarneaquiquell : this is also needed, just found it while testing the other one https://review.openstack.org/#/c/613920/12:46
*** zul has joined #oooq12:46
*** udesale has joined #oooq12:47
quiquellssbarnea: that one is refactoring more or less12:47
rfolcopanda, its later today, weshay scheduled that12:48
rfolconot me12:48
rlandymarios: do we need to touch base re: reproducer work?12:48
mariosrlandy: not yet, at least i don't have somethign specific but happy to sync if you wanted to?12:48
rlandymarios: not really - only one idea to run by you that I would like your input12:49
ssbarneaweshay panda : see https://review.openstack.org/#/c/613920/ -- found it causing failure of https://logs.rdoproject.org/97/613797/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch/a5c31f5/job-output.txt.gz12:49
mariosrlandy: ok sure is it a review or do you want to call?12:49
rlandymarios: I am experimenting with saving the toci-quickstart etc. files in the job and reusing them in the reproducer if possible12:49
rlandywith the vars there12:50
mariosrlandy: ah ack yeah it makes sense12:50
rlandymarios: so far CI hasn't produced any results I can compare12:50
mariosrlandy: i mean, i thought the same, especially for the toci_tquickstart ones cos they are probably quite a few vars12:50
rlandybut it may save us12:50
rlandymarios; ok - as long as I know you are fine with it - I will continue down that path12:50
rlandythe rest of the info is in the card12:50
mariosrlandy: cool thanks add me to review12:51
quiquellrlandy, marios: The read inheritance little experiment doesn't work quite well12:51
mariosquiquell: ack i saw the comment on the review earlier12:51
*** ratailor has quit IRC12:51
mariosquiquell: i am also trying with jq here rlandy for the job vars we already have like required_projects but it isn't so simple :) http://logs.openstack.org/71/613571/2/check/tripleo-ci-centos-7-containers-multinode/1bfc8af/job-output.txt.gz#_2018-10-26_17_35_33_34970212:51
mariosrlandy: just have to find the right incantation of jq12:52
ykarelsshnaidm, hi12:52
rlandyjq is never as it looks12:53
rlandyI struggled with the clouds files12:53
rlandymarios: ^^ ... any easier to pull it from ara?12:53
rfolcoweshay, looks like you forgot to invite panda ???12:54
quiquellrlandy, marios: This is what we see at inventory.xml12:54
quiquellinventory.yaml12:54
quiquellhttps://github.com/openstack-infra/zuul/blob/master/zuul/model.py#L116712:54
quiquellWe have to be able to access the attributes from Job12:54
pandarfolco: because i wasn't supposed to be here today12:54
rfolcopanda, ok so 2pm my time would be 5pm utc I guess12:55
mariosrlandy: yah maybe rlandy we spoke of this last week quiquell https://review.openstack.org/#/c/613571/2/playbooks/tripleo-ci/run-v3.yaml@112 yeah thats where i'm getting it from zuul.projects12:55
pandaAnd I would have gladly stayed away if it wasn't for the news12:56
* rlandy looks12:56
mariosrlandy: not ara i meant the inventory zuul attributes that quiquell was asking about12:56
*** agopi has quit IRC12:57
quiquellrlandy, marios: I have not lose hope yet on using directly the python object, will try with other attribtues12:57
rfolcoweshay, or panda let me know if you want me to help with the scrum notes today or weshay can cover me12:57
mariosquiquell: ack hope is all we have amigo12:57
marios:(12:57
* marios cries12:57
rlandyoh dear12:57
rlandythis is sad12:57
marioskeep calm and carry on12:57
* quiquell :(12:58
rlandyssbarnea, suggested an appointment with the shrink - maybe we can all go12:59
mariosrlandy: scrum #group therapy12:59
quiquell /nick -all quiquell|lunch13:00
quiquellups13:00
*** quiquell is now known as quiquell|lunch13:01
*** quiquell|lunch is now known as quiquell13:02
quiquellups we have the scrum now ?13:02
pandasorry can't attend, I have a problem between the chair and the keyboard. Took the form of my daughter playing with an elastic band13:04
quiquellpanda: it's just a therapy meeting :-)13:05
pandaoh I would certainly need it right now13:06
*** d0ugal has quit IRC13:09
*** huynq has quit IRC13:20
*** jaosorior has quit IRC13:30
*** agopi has joined #oooq13:30
ssbarneaand while digesting the news.... please review two really needed changes https://review.openstack.org/#/c/613797/ and https://review.openstack.org/#/c/613920/13:40
*** apetrich has quit IRC13:46
*** apetrich has joined #oooq14:00
pandaweshay: you waid you didn't have anything officially lined up for the day, what about meeting with russell ?14:04
weshayrfolco, panda, he accepted14:04
pandaok14:05
*** jaosorior has joined #oooq14:05
weshayinteresting timing to talk to leadership14:05
pandain 3 hours then14:05
pandayep, I thought everything was cancelled ... :)14:05
panda6400 people on bluejans, and usually I can't hear the other in a 1-1 meeting ? :(14:11
quiquellThis is not bidirectional14:15
pandaoh, that's why14:15
pandaquiquell: next time we meet, you shut up :)14:16
quiquellpanda: or like walkie talkie14:16
*** sshnaidm is now known as sshnaidm|ruck14:18
*** quiquell has quit IRC14:21
*** quiquell has joined #oooq14:21
*** rfolco has quit IRC14:38
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages)14:40
*** rfolco has joined #oooq14:49
sshnaidm|ruckquiquell, ssbarnea I think this is also is broken by f28 patch: https://logs.rdoproject.org/42/611842/7/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky-branch/4090cf2/job-output.txt.gz#_2018-10-29_10_54_23_56181714:49
quiquellsshnaidm|ruck: This could be the fix ? https://review.openstack.org/#/c/613920/14:49
weshaychandankumar, can we chat for 5min?14:53
weshaypanda, then I need to speak w/ you14:54
chandankumarweshay: yes14:54
pandaweshay: ok14:54
chandankumarweshay: bj link14:54
weshayhttps://bluejeans.com/u/whayutin/14:55
quiquellsshnaidm|ruck: With the review OVB job is failing at different place, but feels weird https://logs.rdoproject.org/20/613920/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/6e14bce/job-output.txt.gz#_2018-10-29_12_57_11_27364715:01
ssbarneaquiquell i am trying to figure out what caused this failure https://logs.rdoproject.org/20/613920/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/1aa9f02/job-output.txt.gz15:01
quiquellssbarnea: They are at different places, look also this https://logs.rdoproject.org/20/613920/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky-branch/23938a8/job-output.txt.gz#_2018-10-29_12_50_11_00600415:02
quiquellssbarnea: directly in the review15:02
ssbarneai do not see any reason for bash to exist at that line15:02
quiquellssbarnea: check out https://logs.rdoproject.org/20/613920/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky-branch/23938a8/job-output.txt.gz#_2018-10-29_12_50_11_00600415:02
quiquellssbarnea: this is over the review itself, and fails witouth much reason15:02
*** jaganathan has quit IRC15:03
ssbarneais like stderr is hidden or something like this, i do not see what caused the exit code15:03
quiquellssbarnea: But the place of error all all different in all the OVB jobs at the review15:04
quiquellAlso this https://logs.rdoproject.org/20/613920/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/1aa9f02/job-output.txt.gz#_2018-10-29_12_52_24_83618215:04
quiquellrlandy, marios: Confirmed we cannot use the parents at python objects, they are just unicode objects15:08
quiquellrlandy, marios: It' just that the string represntation is '<.foobar.>'15:08
rlandyeek15:09
*** dtantsur is now known as dtantsur|brb15:10
*** rfolco is now known as rfolco|rover15:10
weshaypanda, k15:10
weshayhttps://bluejeans.com/u/whayutin/15:10
ssbarneainstalling gear fails on my centos machine with a clear error but why is this not visible on CI logs15:10
weshayssbarnea, I need to chat w/ you for a minute after panda15:11
ssbarneasure15:11
weshaypanda, you around? if not /me chats w/ arx15:12
pandaweshay: coming15:13
rfolco|rovercan someone please fix my key at 38.145.33.16615:14
rfolco|roverrlandy, would you please ?15:14
weshaypanda, 1 sec15:14
rlandyrfolco|rover: fix your key?15:14
* rlandy looks15:14
pandaweshay: ok, staning by.15:15
rfolco|roverrlandy, cannot log in. sent you in pvt my key15:16
rlandyI'm permission denied15:16
rfolco|roverrlandy, can you log in as root?15:16
rlandynegative15:16
rfolco|roverrlandy, thanks for trying15:17
rfolco|roversshnaidm|ruck, can you log in to 38.145.33.166 and fix my pub key there15:18
ykarelrfolco|rover, mmm looks like te-broker is rebuild, it's saying host key changed, i too can't login15:18
rfolco|roveroh oh15:19
ykarelor ip floated to some other host, not sure15:19
rfolco|roverno good15:19
rfolco|roverweshay, you logged on that server on friday. Could you check pls ?15:19
rfolco|rover38.145.33.166 weshay15:19
*** ykarel is now known as ykarel|away15:20
pandarfolco|rover: no access for me too15:20
rfolco|rover:(15:21
pandarfolco|rover: is that still the floating ip ?15:21
pandaof te-broker ?15:21
rfolco|roverpanda, I tmate it with wes last friday15:21
pandarfolco|rover: check the floating ip value in the tenant15:22
rfolco|roveryeah thanks15:22
quiquellsshnaidm|ruck: O ddon't see the isue at the OVB job15:23
quiquellOVB noop job15:23
quiquellhttps://logs.rdoproject.org/93/604293/42/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035/aac9e66/job-output.txt.gz15:23
*** amoralej|lunch is now known as amoralej15:23
*** d0ugal has joined #oooq15:24
sshnaidm|ruckrfolco|rover, te-broker lost its IP15:29
rfolco|roverwhere is the cloud lost and found dept?15:30
rfolco|rovertripleo-infra tenant does not show tebroker, its a diff one15:31
sshnaidm|ruckrfolco|rover, it's in openstack-nodepool tenant15:32
sshnaidm|ruckrfolco|rover, see #rhos-ops15:32
rlandyrfolco|rover: te-broker is in openstack-nodepool15:32
sshnaidm|ruckI see some dns-server on openstack-nodepool tenant too, not sure what it does there, any ideas?15:33
sshnaidm|ruckrlandy, rfolco|rover panda ^15:33
quiquellrlandy, sshnaidm|ruck: Do you know when a job creates the br-ex bridge thing ?15:34
pandaNo idea.15:34
rlandysshnaidm|ruck: from way back I think15:35
*** d0ugal has quit IRC15:37
*** jaosorior has quit IRC15:38
*** d0ugal has joined #oooq15:38
sshnaidm|ruckquiquell, in undercloud install?15:39
quiquellsshnaidm|ruck: is the new f28 stanadalone job15:39
quiquellsshnaidm|ruck: centos7 one is working fine, can fix it setting standalone_interface var15:40
quiquellsshnaidm|ruck: But want to know why the bridge is not up at fedora15:40
quiquellsshnaidm|ruck: It's ovs ?15:40
sshnaidm|ruckquiquell, I think so, but sorry, don't have too much knowledge about standalone15:42
quiquellsshnaidm|ruck: Feels more like something at pre playbooks not being executd for stanadlone15:42
quiquellsshnaidm|ruck: more than stnadalone thing15:42
quiquellsshnaidm|ruck: Have to discover where, happend the same at RDO15:42
*** ykarel|away has quit IRC15:43
sshnaidm|ruckquiquell, what does mean same for rdo?15:43
quiquellsshnaidm|ruck: Humm no forgot about it it was a quick hack15:44
quiquellsshnaidm|ruck: maybe the RPMs to start ovs don't work well at fedora15:44
weshaypanda, ready15:45
sshnaidm|ruckquiquell, you can compare step by step playbooks in f28 and centos7 to see where it doesn't work15:46
quiquellsshnaidm|ruck: Yep that's what I was trying to avoid :-), but it's going to be the way15:46
quiquellsshnaidm|ruck: thanks man15:46
sshnaidm|ruckquiquell, I think we do some ovs commands in collect-logs role, you can see there ovs status15:46
sshnaidm|ruckquiquell, or in host-info file, or network related files15:47
quiquellsshnaidm|ruck: humm f28 job has no undercloud/var/log/openvswitch/15:47
quiquellsshnaidm|ruck: centos one have it15:47
bogdandohi folks, shall I submit a reproducer script bug into https://tree.taiga.io/project/tripleo-ci-board/issues or LP ?15:49
bogdandofor the former, cannot find the submit button :(15:49
sshnaidm|ruckbogdando, we still submit bugs in LP15:50
bogdandosshnaidm|ruck: ack15:50
bogdandohttps://bugs.launchpad.net/tripleo/+bug/180049515:54
openstackLaunchpad bug 1800495 in tripleo "reproducer script installs wrong puppet-tripleo package from delorian-current instead of the gating repo built locally" [Undecided,New]15:54
sshnaidm|ruckbogdando, did you have "depends-on" in your patch?16:00
bogdandoyes, the manually installed packages from /opt/gating-repo works for me16:00
bogdandoand brings in what I wanted16:01
sshnaidm|ruckrfolco|rover, I see ovb stack are created, so goes fine so far16:01
bogdandojust not from the beginning16:01
bogdandothe script runs with bad installs16:01
bogdandooriginally16:01
sshnaidm|ruckbogdando, there is some problem with rebasing and depends-on, derekh also reported it..\16:01
bogdandoack16:01
bogdandobut not sure this is the issue16:01
bogdandoseems like priority bugs16:02
*** d0ugal has quit IRC16:02
mariospanda: so re https://tree.taiga.io/project/tripleo-ci-board/epic/15716:02
sshnaidm|ruckbogdando, you code is not rebased and then delorean-current has a higher version and installed instead of your patch, afaiu16:02
bogdandoyum should've been shown the gating repo not dlrn current16:02
bogdandoah, I see16:02
bogdandomay be16:02
bogdandothanks!16:02
bogdando(it was not repased by that point indeed)16:02
sshnaidm|ruckbogdando, if you can post in bug your git versions for packages it would help16:02
sshnaidm|ruckbogdando, I mean package versions16:02
bogdandoI did16:03
mariospanda: i see you're moving things into a pre.yaml and creating install.sh16:03
sshnaidm|ruckbogdando, ok, thanks16:03
mariospanda: one question is why don't we just make quickstart.sh the existing one the single/consolidated place, and instead create this new 'install.sh'16:03
mariospanda: maybe i should comment on the review16:03
*** sshnaidm|ruck is now known as sshnaidm|bbl16:13
*** zul has quit IRC16:14
*** quiquell is now known as quiquell|off16:15
rlandyquiquell|off: it's in the multinode job16:16
*** dtantsur|brb is now known as dtantsur16:16
weshayrfolco|rover, are you prepared to go through the slide w/ russel?16:17
rfolco|roverweshay, yeah, want to do a pre-pre-run now?16:17
weshayrfolco|rover, naw.. but we'll spend a few minutes after the chat w/ him in case we need to fix things up16:17
rfolco|roverk16:18
*** tosky has quit IRC16:18
*** ykarel|away has joined #oooq16:23
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (4 more messages)16:40
*** jfrancoa has quit IRC16:47
*** matbu has joined #oooq16:48
*** trown is now known as trown|lunch16:48
*** gkadam has quit IRC16:52
*** kopecmartin is now known as kopecmartin|off16:55
rfolco|roverweshay, did not find location or bj on your invite16:59
rfolco|roverguess its your bj16:59
*** udesale has quit IRC17:00
*** zul has joined #oooq17:00
weshayrfolco|rover, panda sorry https://bluejeans.com/4113567798/17:01
pandamarios: sorry It's supposed to be holiday here today17:04
pandamarios: anyway, it's still very WIP17:04
*** d0ugal has joined #oooq17:04
*** d0ugal has quit IRC17:12
ssbarneamarios bogdando  panda : regarding the qs.sh code reusability, i have an idea that avoids creating new file, just making qs.sh sourceable so we can reuse code defined in it in other places.17:12
ssbarneathis should not be very hard, but we need to take care of some of the "exit" calls inside it and replace them with returns. i think is doable.17:13
pandassbarnea: add a card to retrospective17:16
ssbarneasure,i will.17:16
*** bogdando has quit IRC17:17
*** saneax has quit IRC17:18
*** matbu is now known as matbu|brb17:38
*** trown|lunch is now known as trown17:41
*** vinaykns has joined #oooq17:49
pandamarios: you there perchance ?17:51
*** dsneddon has quit IRC17:53
*** amoralej is now known as amoralej|off17:56
*** dsneddon has joined #oooq18:03
*** ykarel|away has quit IRC18:17
*** holser_ has quit IRC18:23
rlandyweshay: around? want to meet sometime?18:34
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (4 more messages)18:40
rlandyssbarnea: I'm a bit behind here - but I assume you're working on a fix for https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-master-baremetal-dell_fc430_envB-single_nic_vlans/29/console - failure in quickstart18:42
ssbarnearlandy yes, working but there are two reviews involved, you could help reviewing them.18:43
rlandyssbarnea: k - looking for those18:43
ssbarnearlandy https://review.openstack.org/#/c/613920/ and https://review.openstack.org/#/c/613797/18:44
rlandyssbarnea: going to test these in the bm jobs18:44
ssbarneai found some weird things related to missing output from qs.sh execution and i suspect the cause could be related to the two magic lines at the top doing redirection to log file.18:45
ssbarneai think that in some contexts they break stdout/stderr output, and we endup looking at an error exit code without an error message.18:46
rlandyssbarnea: same requirement for sudo18:51
rlandyhmmm ... is that something we want to require for quickstart to run?18:51
ssbarnearlandy: once the bugfix is merged, not.18:52
ssbarneait fixes a wrong condition.18:52
rlandyas before, sudo true fails18:52
*** jaosorior has joined #oooq18:52
rlandywell not fails bit asks18:52
rlandybut18:52
ssbarnearlandy : the if SUDO_NEEDED is the broken one, it should not reach the sudo code.18:53
ssbarneacondition was wrong18:53
rlandyI added the user to /etc/sudoers18:57
rlandynot sure if that is an ok condition but let's see if it gets further18:57
rlandy18:57:30 Package python2-virtualenv-15.1.0-1.fc26.noarch is already installed, skipping.18:58
rlandy18:57:30 Package redhat-rpm-config-65-1.fc26.noarch is already installed, skipping.18:58
rlandy18:57:30 Error: Unable to find a match18:58
rlandyssbarnea: ^^ so we expect it not to work?19:06
ssbarnearlandy interesting, it should not fail.19:09
rlandyrfolco|rover: ping re: zuul clone19:09
ssbarnearlandy is this a standard centos-7 ?19:09
rlandyrfolco|rover: I want to collect the toci_quickstart, toci_gatetest etc. files from the jobs19:09
rlandyssbarnea: fedora slave19:09
rfolco|roverrlandy, collect files ?19:10
rfolco|roverpls ellaborate19:10
rlandyrfolco|rover: afaict they are in /tripleo_root19:10
rlandyyes19:10
ssbarneaahh, f28?19:10
rlandyhttps://review.openstack.org/#/c/613684/3/roles/collect-logs/defaults/main.yml19:10
rlandydidn't work19:10
rlandyrfolco|rover: what did I miss?19:10
ssbarneaneed to go to eat, but I will be back.19:10
rlandyssbarnea: sure - no rush19:10
ssbarneamainly the yum install function was not supposed to fail with such error, if it does there is a bug i need to fix.19:11
*** dtantsur is now known as dtantsur|afk19:11
ssbarneaon my tests the exclusion worked and packages were installed succesfully on noth c7/f2819:11
rfolco|roverrlandy, looking... sorry for the delay...19:14
rlandyrfolco|rover: np - we are all processing a little slower today :(19:14
rlandyrfolco|rover: basically we need that for the reproducer19:21
rlandyssbarnea: older version of fedora19:21
rfolco|roverso you trying to copy entire dir from repos cloned at tripleo_root: "{{ ansible_user_dir }}/src/git.openstack.org/openstack"19:22
rfolco|roverrlandy, just curious why19:22
rfolco|roverso every project in required-projects will be there19:24
weshayrlandy, sorry yes.. I'm available19:25
rlandyweshay:k - whenever works for you19:26
rlandyrfolco|rover: I tried that19:26
weshayrlandy, k.. 3min19:26
rfolco|roverrlandy, did not work ?19:27
rfolco|roverrlandy, logs please ?19:27
rfolco|rovertripleo_ci_dir: "{{ ansible_user_dir }}/{{ zuul.projects['git.openstack.org/openstack-infra/tripleo-ci'].src_dir }}"19:27
rlandyrfolco|rover: see ci on that change19:27
rlandyI think I hav ethe dir wrong19:27
*** Tengu has quit IRC19:28
rlandyrfolco|rover: so tripleo_root?19:29
*** Tengu has joined #oooq19:29
rlandydefined as19:29
rfolco|rover{{ ansible_user_dir }}/src/git.openstack.org/openstack19:29
rfolco|roverthis is tripleo_root ^19:29
weshayrlandy, k.. in chat now19:29
rfolco|roveris this what you want ?19:29
rfolco|roverI don't think this is what you want19:30
rfolco|rovercopy all repos over to the logs19:30
*** holser_ has joined #oooq19:36
rlandyrfolco|rover: sorry - was in meeting20:15
rlandyrfolco|rover: I don't necessarily need all he repos, I just want the 4 file20:15
rlandyfiles20:15
rlandybut he CI logs collected nothing20:15
rfolco|roverrlandy, hmm, can you please point me to the log... I tried to find.20:16
rlandyhttps://review.openstack.org/#/c/613684/20:16
rlandythe rdocloud jobs20:16
rlandybut I think the change is wrong20:16
rlandy{{ ansible_user_dir }}/src/git.openstack.org/openstack20:16
rlandy^^ what will that collect?20:17
rlandyrfolco|rover: so that should be {{ ansible_user_dir }}/src/git.openstack.org/openstack/*.sh20:26
rlandyand .bash?20:27
rfolco|roverhmmm20:27
rfolco|roverare those tripleo-ci repo only ?20:27
rlandywe need these files with the vars resolved20:27
rlandywhat do you mean?20:27
rfolco|roverrlandy, if its only tripleo-ci repo... you can use tripleo_ci_dir20:29
rfolco|rover"{{ ansible_user_dir }}/{{ zuul.projects['git.openstack.org/openstack-infra/tripleo-ci'].src_dir }}"20:29
rlandyrfolco|rover: I don't want the repo, just the four files with vars resolved from https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/run-v3.yaml#L7020:30
rlandyyou see why I used tripleo_root?20:30
rlandy{{ ansible_user_dir }}/src/git.openstack.org/openstack/*.sh and *.bash might work20:31
rfolco|roverrlandy, no :)20:32
rfolco|roverrlandy, this is the root20:32
rfolco|rover*.sh in the root does not work20:32
rfolco|rover.../tripleo-ci/*.sh20:33
rlandy"{{ tripleo_root }}/tripleo-ci/toci_gate_test.sh"20:33
rlandy"{{ tripleo_root }}/tripleo-ci/*.sh"20:33
rlandyor20:34
rfolco|roveryeah20:34
rfolco|roverbut not this -->20:34
rfolco|rover<rlandy> {{ ansible_user_dir }}/src/git.openstack.org/openstack/*.sh and *.bash might work20:34
rlandy{{ ansible_user_dir }}/src/git.openstack.org/openstack/tripleo-ci/*.sh20:34
rlandywhich is better>20:34
rlandyrfolco|rover: ^^?20:34
rfolco|roverrlandy, both should work I guess... let me see if tripleo_root is set20:35
rlandy  --extra-vars tripleo_root=/home/zuul/src/git.openstack.org/openstack20:35
rfolco|roveryep... "{{ tripleo_root }}/tripleo-ci/*.sh"20:36
rfolco|roverdid you try this already rlandy ^20:36
rlandynot with the tripleo-ci20:36
rlandyI am trying {{ ansible_user_dir }}/src/git.openstack.org/openstack/tripleo-ci/*.sh20:37
rfolco|roverI think* that's it20:37
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (4 more messages)20:40
*** trown is now known as trown|outtypewww20:58
*** vinaykns has quit IRC22:08
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (4 more messages)22:40
*** chem has quit IRC23:05
*** holser_ has quit IRC23:45
*** rlandy has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!