hubbot | All check jobs are working fine on stable/ocata, stable/ocata, master, stable/queens. | 00:32 |
---|---|---|
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 02:32 |
*** rlandy|rover|bbl is now known as rlandy|rover | 02:35 | |
*** rlandy|rover has quit IRC | 02:39 | |
*** d0ugal_ has joined #oooq | 02:50 | |
*** d0ugal has quit IRC | 02:51 | |
*** udesale has joined #oooq | 04:02 | |
*** jaganathan has quit IRC | 04:05 | |
*** jaganathan has joined #oooq | 04:05 | |
*** ccamacho has quit IRC | 04:05 | |
*** links has joined #oooq | 04:28 | |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 04:33 |
*** brault has joined #oooq | 04:44 | |
*** brault has quit IRC | 04:48 | |
*** pgadiya has joined #oooq | 05:08 | |
*** pgadiya has quit IRC | 05:08 | |
*** ykarel|training has joined #oooq | 05:17 | |
*** skramaja has joined #oooq | 05:20 | |
*** alee has quit IRC | 05:41 | |
*** saneax has joined #oooq | 05:56 | |
*** ykarel|training has quit IRC | 06:02 | |
*** ykarel|training has joined #oooq | 06:05 | |
*** ykarel|training has quit IRC | 06:14 | |
*** quiquell|off is now known as quiquell | 06:22 | |
*** holser__ has joined #oooq | 06:30 | |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 06:33 |
*** zoli is now known as zoli|wfh | 06:38 | |
*** zoli|wfh is now known as zoli | 06:38 | |
*** ccamacho has joined #oooq | 06:52 | |
*** kopecmartin has joined #oooq | 07:04 | |
*** gkadam has joined #oooq | 07:07 | |
*** amoralej|off is now known as amoralej | 07:14 | |
*** tosky has joined #oooq | 07:26 | |
*** brault has joined #oooq | 07:47 | |
*** jaosorior has joined #oooq | 07:52 | |
*** tcw has quit IRC | 08:05 | |
*** jaosorior has quit IRC | 08:10 | |
*** tcw has joined #oooq | 08:13 | |
*** ykarel|training has joined #oooq | 08:26 | |
*** ratailor has joined #oooq | 08:28 | |
*** d0ugal_ has quit IRC | 08:29 | |
*** d0ugal has joined #oooq | 08:29 | |
hubbot | All check jobs are working fine on stable/ocata, stable/ocata, master, stable/queens. | 08:33 |
*** jaosorior has joined #oooq | 08:54 | |
*** dtantsur|afk is now known as dtantsur | 09:09 | |
*** links has quit IRC | 09:48 | |
*** links has joined #oooq | 10:05 | |
*** ykarel|training has quit IRC | 10:30 | |
quiquell | arxcruz|ruck: Another two legit alarms about master and queens promotions | 10:33 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 10:33 |
arxcruz|ruck | quiquell: where? | 10:33 |
quiquell | #tripleo-ci | 10:33 |
quiquell | arxcruz|ruck: Have check on http://rhos-release.virt.bos.redhat.com:3030/rhosp and it's legit | 10:33 |
quiquell | arxcruz|ruck: but is master not pike, the alarm is wrong | 10:34 |
arxcruz|ruck | quiquell: there's an issue with master, hrybacki is working on that | 10:35 |
quiquell | arxcruz|ruck: Ok, was just checking the alarm system, thanks | 10:35 |
* quiquell give another beer to arxcruz|ruck | 10:35 | |
arxcruz|ruck | quiquell: also a problem with queens | 10:35 |
arxcruz|ruck | both are known issues so, we are "good" | 10:36 |
arxcruz|ruck | i check this morning ;) | 10:36 |
quiquell | arxcruz|ruck: nice | 10:36 |
quiquell | arxcruz|ruck: sorry for the noise | 10:36 |
arxcruz|ruck | np | 10:36 |
quiquell | arxcruz|ruck: pike is ok ? | 10:38 |
quiquell | https://dashboards.rdoproject.org/pike two days too | 10:39 |
*** links has quit IRC | 10:39 | |
quiquell | http://rhos-release.virt.bos.redhat.com:3030/rhosp is not accurate there | 10:39 |
*** apetrich has quit IRC | 10:40 | |
arxcruz|ruck | quiquell: i think it just not run https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-pike-current-tripleo/ | 10:42 |
arxcruz|ruck | quiquell: seems to be ok, last run was june 5 | 10:42 |
quiquell | arxcruz|ruck: 4 days was the alarming threshold ? | 10:43 |
arxcruz|ruck | quiquell: 5 | 10:44 |
arxcruz|ruck | quiquell: it seems there's no hash to promote | 10:44 |
arxcruz|ruck | http://38.145.34.55/pike.log | 10:44 |
arxcruz|ruck | 2018-06-07 10:40:37,576 629 DEBUG promoter Remaining hashes after removing already promoted ones: [] | 10:44 |
quiquell | arxcruz|ruck: ok, the alarm is legit too, thanks | 10:45 |
* quiquell gives directly the beer keg to arxcruz|ruck | 10:46 | |
*** links has joined #oooq | 10:56 | |
*** udesale has quit IRC | 11:07 | |
*** ykarel|training has joined #oooq | 11:38 | |
*** brault has quit IRC | 11:42 | |
*** tcw has quit IRC | 11:55 | |
*** tcw has joined #oooq | 11:55 | |
*** amoralej is now known as amoralej|lunch | 11:59 | |
*** jbadiapa has joined #oooq | 12:12 | |
*** brault has joined #oooq | 12:13 | |
weshay | quiquell, arxcruz|ruck you discussing promotion_blocker bugs on the dashboard? | 12:22 |
arxcruz|ruck | weshay: no, i just notice your message there regarding the keystone one | 12:23 |
weshay | quiquell, btw.. came up w/ a new design for the build-test-packages work we discussed earlier | 12:23 |
weshay | arxcruz|ruck, oh.. ya.. I removed it.. I don't want to freak out hrybacki :) | 12:23 |
arxcruz|ruck | lol | 12:23 |
arxcruz|ruck | no pressure hrybacki, but the world needs you | 12:23 |
weshay | but I do want to make it clear to jbuchta that one bug.. can set the branch to red | 12:24 |
quiquell | weshay: Good morning, reimplementing it, sorry about my previous fucked up patchset | 12:24 |
weshay | quiquell, there was nothing that bad about your patchset | 12:24 |
weshay | and it implemented the design we discussed | 12:24 |
quiquell | weshay: btw, to test it i have use this https://review.openstack.org/#/c/571435/ | 12:24 |
quiquell | weshay: harcoded n -> n + 1, trown was asking | 12:25 |
weshay | sometimes it just takes a couple days and review to come up w/ a better design | 12:25 |
*** apetrich has joined #oooq | 12:30 | |
arxcruz|ruck | quiquell: was you who saw this error before? 2018-06-07 09:33:51 | time="2018-06-07T09:33:51Z" level=fatal msg="Error determining repository tags: Get https://registry-1.docker.io/v2/tripleomaster/centos-binary-heat-engine/tags/list: EOF" | 12:30 |
quiquell | arxcruz|ruck: Similar, could not resolve registry-1.docker.io host | 12:32 |
quiquell | This one is more about docker.io returning an empty file | 12:32 |
weshay | rasca, ping https://bugs.launchpad.net/tripleo/+bug/1773837 | 12:32 |
openstack | Launchpad bug 1773837 in tripleo "Overcloud deployment failed with node unreachable even if the node is available" [Critical,Triaged] | 12:32 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 12:33 |
rasca | weshay, hey | 12:33 |
weshay | rasca, you have a second? | 12:34 |
rasca | weshay, always for you | 12:34 |
weshay | rasca, oh baby.. /me puts on my dress https://bluejeans.com/u/whayutin/ | 12:34 |
arxcruz|ruck | quiquell: how can i check on your r&r stuff how many times a particular job fails ? | 12:37 |
quiquell | arxcruz|ruck: what job ? | 12:38 |
arxcruz|ruck | quiquell: tripleo-ci-centos-7-undercloud-containers | 12:38 |
rfolco | cores could please push this forward (fs037 queens on check) ? https://review.openstack.org/#/c/570902/ | 12:38 |
quiquell | arxcruz|ruck: two days ? | 12:41 |
*** trown|outtypewww is now known as trown | 12:41 | |
quiquell | rfolco: also the other ones are needed | 12:41 |
arxcruz|ruck | quiquell: two days failing? | 12:41 |
quiquell | arxcruz|ruck: You want to see how many times it's failing for how long, 2 days ? | 12:41 |
rfolco | quiquell, aren't those fake patches ? | 12:42 |
arxcruz|ruck | quiquell: yeah, 2 days is okay | 12:42 |
*** jbadiapa has quit IRC | 12:44 | |
quiquell | rfolco: nope, they serve two purposes, trigger fs037 on master and also, specify files that trigger it | 12:44 |
*** bogdando has joined #oooq | 12:45 | |
*** bogdando has quit IRC | 12:45 | |
quiquell | Arx http://38.145.34.131:3000/d/_6Qu9TIik/arx?panelId=2&fullscreen&orgId=1 | 12:48 |
weshay | trown, 1-1 | 13:01 |
weshay | https://bluejeans.com/4113567798/ | 13:01 |
weshay | quiquell, arxcruz|ruck what is your opinion re: listing out the lp's that are triaged in tripleo w/ promotion_blocker | 13:02 |
arxcruz|ruck | chandankumar: the job you asked failed only twice, perhaps was some network issue when trying to connect to docker.io | 13:03 |
arxcruz|ruck | weshay: looks okay to me | 13:04 |
quiquell | weshay: That's a good one, now in the r&r we have the urgents only | 13:04 |
quiquell | weshay: Every stuff that is in the r&r doc and can be put in the dashboard will help | 13:05 |
*** myoung|off is now known as myoung | 13:05 | |
quiquell | myoung: Good morning, sorry I was not here for you yesterday | 13:05 |
myoung | quiquell: morning! | 13:06 |
myoung | quiquell: timezones and schedules are real constructs, no worries. | 13:06 |
*** skramaja has quit IRC | 13:06 | |
quiquell | myoung: Do you want some help with https://trello.com/c/pfQ867XP/779-differentiate-the-same-featureset-to-do-the-two-begin-release-end-release-combinations ? | 13:07 |
* myoung joins #tripleo-ci, he didn't know it was a thing :) | 13:09 | |
*** udesale has joined #oooq | 13:09 | |
myoung | quiquell: catching up on scrollback and cards. Yesterday I went thru trown's patch to the python script (including the base script itself created last sprint), and had digested your changes and created some patches to invoke the workflow where we actually build new RPM's for THT. That was the background work to understand context for what we'll need to change in TOCI to enable leveraging all these deltas. I don't think the redesign proposed | 13:12 |
myoung | yesterday by weshay/trown changes that. | 13:12 |
*** ratailor has quit IRC | 13:13 | |
*** apetrich has quit IRC | 13:13 | |
myoung | regarding differentiate, I think the DoD shoudl probably include cleaving and/or adding jobs that use the (to be added) variable/input (both ways) | 13:13 |
quiquell | myoung: Will try to copy the DoD from the inject at the end it's similar | 13:14 |
myoung | quiquell: I think the small POC / patches you posted last week are sane/rational to support this. happy to sync on this and your card in a few mins, I'm checking on the results of last night's patches to THT to start covering the base cases (1 patch, 2 patches, multiple branches, etc). I think they will need to be rebased and/or re-run, using the jobs that ran last night as starting point / baseline | 13:15 |
myoung | trown: regarding the QE tasks for your modifications to the python script, I'm not sure what's left there, you included UT's for your changes that look complete. I'm planning today/tomorrow to just run those UT's locally and test via inspection, until we have all this wired up end to end I'm not sure what else there is to QE for that card | 13:16 |
myoung | trown: will +1 your patches when that's done (this afternoon) | 13:17 |
*** atoth has joined #oooq | 13:19 | |
myoung | quiquell: ahh... https://review.openstack.org/#/c/572736 has PS 3,4,5,6 :) /me looks... | 13:21 |
myoung | time-shifted team is amazing. go to bed, wake up, nearly 5 hours of dev occurs hah. eat. | 13:21 |
myoung | neat. | 13:21 |
quiquell | myoung: coding time machine | 13:22 |
*** apetrich has joined #oooq | 13:26 | |
*** ykarel|training has quit IRC | 13:27 | |
myoung | quiquell: i find it exhilerating / racing, and sometimes challenging as we don't really have designs for things that go more than a few days into the future. So can spend time understanding/grokking an approach, kick off tests/jobs, wake up and iteration has already happened. It's super cool/fast, but requires some degree of thrash in the absense of more concrete planning. Will talk in retro... To be clear...IMHO we're running really fast, | 13:28 |
myoung | and that's awesome. | 13:28 |
quiquell | myoung: you can not have it all | 13:29 |
* myoung is happy to talk after scrums, he needs a quiet 30 to catch up / reviews. | 13:29 | |
* myoung smiles at quiquell and nods in agreement. | 13:29 | |
myoung | quiquell: The flip side is also worth discussing in retrospective. I think it might be interesting if you / arxcruz|ruck / panda or others that wake up while the Americas are sleeping and are solo on the early side shared "a day in the life" - don't want to belabor here/now. TL;DR I would listen with interest experience(s) around this topic. | 13:32 |
quiquell | myoung: playing well we can benefict from the follow the sun approach | 13:34 |
hrybacki | arxcruz|ruck: running reproducer w/ changes now :) | 13:38 |
*** rlandy has joined #oooq | 13:46 | |
*** rlandy is now known as rlandy|rover | 13:47 | |
rlandy|rover | arxcruz|ruck: hi there - sorry about late arrival - how are things? | 13:47 |
arxcruz|ruck | rlandy|rover: hey, no problem, got your message, everything is same as yesterday | 13:48 |
arxcruz|ruck | no big news | 13:48 |
rlandy|rover | arxcruz|ruck: cool - thanks | 13:48 |
myoung | quiquell: left comments circa PS6, but I see you're still iterating, catch up after scrums if you have time today | 13:51 |
*** brault has quit IRC | 13:52 | |
weshay | arxcruz|ruck, how you doing w/ the get_nodes issue? | 13:52 |
arxcruz|ruck | weshay: working on it submited a new patchset | 13:53 |
arxcruz|ruck | now the issue is that the client isn't get authenticated | 13:53 |
arxcruz|ruck | but i'm investigating | 13:53 |
quiquell | myoung: Yep, testing in the RDO cloud and uploading changes | 13:53 |
quiquell | myoung: I can wait for it to pass to upload to gerrit | 13:53 |
myoung | CI squad: o/ morning! scrum in 5 min | 13:55 |
quiquell | myoung: Have tech difficulties | 13:57 |
hrybacki | arxcruz|ruck: looks like mistral side has a fix in. I'm testing the puppet-keystone fix now | 13:57 |
arxcruz|ruck | hrybacki: cool :) | 13:58 |
weshay | arxcruz|ruck++ | 13:58 |
hubbot | weshay: arxcruz|ruck's karma is now 3 | 13:58 |
weshay | arxcruz|ruck, re: doc creation | 13:59 |
arxcruz|ruck | oh, forgot about that one, let me check | 13:59 |
arxcruz|ruck | weshay: https://review.openstack.org/#/c/568783/ need a +2 +w | 13:59 |
weshay | arxcruz|ruck, /me is going to +2 and merge as I see things working.. I don't see tempest doc in your patch.. which I suspect is just a depends-on issue | 13:59 |
weshay | w/ chandankumar's patch | 13:59 |
weshay | but it's good to merge | 13:59 |
* weshay looking at | 14:00 | |
weshay | https://logs.rdoproject.org/83/568783/5/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zac4551e603da4f7083dbf1049b596103/docs/build/ | 14:00 |
weshay | https://thirdparty.logs.rdoproject.org/jenkins-tqe-gate-rhos-12-ci-rhos-ovb-minimal-pacemaker-public-bond-1201/docs/build/overcloud-validate.html | 14:00 |
quiquell | myoung: pass me the blue jeans link please | 14:00 |
arxcruz|ruck | weshay: https://review.openstack.org/#/c/566527/ | 14:00 |
arxcruz|ruck | also +2 +w | 14:00 |
myoung | CI Squad: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting, https://bluejeans.com/7050859455 | 14:00 |
weshay | arxcruz|ruck, chandankumar ++++= | 14:00 |
myoung | ^^ (or bluejeans.com/matyoung) | 14:00 |
rlandy|rover | arxcruz|ruck: weshay: here's a first since April 13 - https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-newton/ | 14:02 |
myoung | weshay, (rlandy|rover || arxcruz|ruck), panda - CI scrum? | 14:02 |
arxcruz|ruck | myoung: ruck and rover don't participate on ci scrum | 14:03 |
arxcruz|ruck | afaik | 14:03 |
weshay | ruck does not | 14:03 |
weshay | rover does | 14:03 |
rlandy|rover | I am there | 14:03 |
arxcruz|ruck | but if you want, just a sec, i'll join you | 14:03 |
rlandy|rover | arxcruz|ruck: np - I am covering us | 14:03 |
*** gkadam has quit IRC | 14:03 | |
*** udesale has quit IRC | 14:03 | |
myoung | thx...is just the first few mins | 14:03 |
*** gkadam has joined #oooq | 14:04 | |
*** udesale has joined #oooq | 14:04 | |
*** dtrainor has joined #oooq | 14:06 | |
*** amoralej|lunch is now known as amoralej | 14:07 | |
*** links has quit IRC | 14:23 | |
trown | quiquell: can I quickly bug you about comments on UT for https://review.openstack.org/#/c/572420/ | 14:27 |
trown | quiquell: I think I understand the confusion from your last comment now... those unittests do not test get_dlrn_hash, we have other unittests to test get_dlrn_hash | 14:28 |
trown | quiquell: ie we are not "excercising target_hash = get_dlrn_hash(target_release, CURRENT_HASH_NAME)" we are "excercising assert (compose_releases_dictionary(stable_release, featureset, upgrade_from) == expected_releases)" | 14:29 |
trown | quiquell: we specifically mock get_dlrn_hash entirely, because we are not testing it there | 14:30 |
trown | quiquell: thanks for your reviews btw, the 'false' vs False issue is legit | 14:31 |
trown | I will fix that up | 14:31 |
quiquell | trown: we mock get_dlrn_hash what I mean is that we are exercising the use of it | 14:32 |
weshay | arxcruz|ruck, no luck re: get_nodes :( | 14:33 |
weshay | arxcruz|ruck, I wonder if we're looking at the right thing | 14:33 |
quiquell | trown: the use have to be to pass A y and get B, to test it we A and B have to be different. | 14:33 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 14:33 |
weshay | arxcruz|ruck, wonder if you should spend some time to better understand if/when the task is executed vs skipped | 14:33 |
quiquell | trown: If you want we can check on bj | 14:33 |
trown | quiquell: sure | 14:35 |
trown | quiquell: lets talk on bluejeans | 14:35 |
arxcruz|ruck | weshay: my bad... :( | 14:35 |
weshay | arxcruz|ruck, no worries mate.. just trying to help | 14:36 |
quiquell | trown: give a minute to set up blue jeans (have a fresh fedora now) | 14:38 |
trown | quiquell: your example of the code breaking will also happen if we change the mock side_effect to ['foo', 'bar'] and change all the expected releases to match... | 14:39 |
quiquell | trown: I have to be missing something | 14:39 |
quiquell | trown: calling | 14:41 |
*** ccamacho has quit IRC | 14:42 | |
rlandy|rover | chandankumar: https://review.openstack.org/#/c/572858/? Doesn't look like it picked up tempest | 14:43 |
trown | quiquell: on your bluejeans? | 14:44 |
quiquell | trown: I am at your bj | 14:44 |
rasca | trown, hey man, can I have your eyes on this https://review.openstack.org/#/c/573255/1/roles/collect-logs/tasks/collect.yml ? myoung suggestion feels really good to me, but what we prefer in general for oooq? Is it better a default in defaults/main.yml or is an addition to the docs enough and so we can compact like matt suggested? | 14:44 |
myoung | trown, rasca, updated with a +1 | 14:45 |
trown | quiquell: pinche bluejeans... some day I will get there | 14:45 |
myoung | fine with either approach, both have merit | 14:45 |
myoung | trown, quiquell, mind if I listen in ? | 14:45 |
quiquell | myoung: no problem from my side | 14:46 |
myoung | quiquell: link/ | 14:46 |
myoung | ? | 14:46 |
quiquell | myoung: trowns room | 14:46 |
trown | bluejeans is completely failing to load for me :( | 14:46 |
quiquell | trown: redjeans !!! | 14:47 |
myoung | trown: has been happening to me too...hence the phone useage as a backup when I run meetings | 14:48 |
*** apetrich has quit IRC | 14:48 | |
*** saneax has quit IRC | 14:48 | |
myoung | trown: what's your meeting id#? sometimes having someone else join it kicks it over on server side (join existing room vs. first create) | 14:48 |
trown | myoung: u/jtrowbri | 14:49 |
myoung | wow...that crashes for me too | 14:50 |
myoung | heh BJ: "Oops... we'll be right back" | 14:50 |
myoung | my room is open/working for another 10 mins...or we can use quiquell's room | 14:51 |
myoung | trown: maybe something with your room specifically | 14:51 |
myoung | and it's working | 14:51 |
rlandy|rover | arxcruz|ruck: hi - looking at the newton failures ... is this different to the one you are working on?https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-newton-delorean-minimal-954/undercloud/home/stack/undercloud_install.log.gz | 14:55 |
rlandy|rover | 2018-06-07 10:17:49 | 2018-06-07 10:17:49 - [mNotice: /Stage[main]/Heat::Db::Sync/Exec[heat-dbsync]/returns: ERROR: (pymysql.err.OperationalError) (1045, u"Access denied for user 'heat'@'192.168.24.1' (using password: YES)")[0m | 14:56 |
arxcruz|ruck | rlandy|rover: i think the one i was working on is a dead end, the guys from certmonger puppet doesn''t want to merge my patch | 14:56 |
rlandy|rover | arxcruz|ruck: :( | 14:56 |
arxcruz|ruck | rlandy|rover: yes, this is the problem all because of dbus, so keystone doesn''t create the credentials | 14:56 |
rlandy|rover | arxcruz|ruck: hmmm ... we need to decide what to do here ultimately | 14:57 |
rlandy|rover | do you have the bug handy? | 14:57 |
rlandy|rover | let's add these failures as well so they are tracked | 14:57 |
rlandy|rover | now that we actually get to run this testing | 14:57 |
arxcruz|ruck | rlandy|rover: i need to check the bug | 14:58 |
myoung | chandankumar, kopecmartin, tempest squad scrum | 15:01 |
*** saneax has joined #oooq | 15:04 | |
*** apetrich has joined #oooq | 15:04 | |
rlandy|rover | arxcruz|ruck: requesting your review - to add to promotion https://review.rdoproject.org/r/#/c/14093/ | 15:04 |
*** quiquell is now known as quiquell|off | 15:04 | |
*** d0ugal has quit IRC | 15:07 | |
rlandy|rover | arxcruz|ruck: weshay:doing cleanup of openstack-nodepool tenant - 7 stacks that should go - nothing major | 15:07 |
*** zoli is now known as zoli|gone | 15:07 | |
*** zoli|gone is now known as zoli | 15:07 | |
rlandy|rover | make that 8 stacks | 15:09 |
rlandy|rover | when is panda coming back? | 15:15 |
weshay | https://bugzilla.redhat.com/buglist.cgi?action=wrap&bug_status=NEW&bug_status=ASSIGNED&bug_status=POST&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&bug_status=RELEASE_PENDING&chfield=%5BBug%20creation%5D&chfieldto=-9d&f1=product&f10=flagtypes.name&f11=CP&f12=cf_internal_whiteboard&f2=cf_internal_whiteboard&f3=component&f4=cf_conditional_nak&f5=cf_qe_conditional_nak&f6=OP&f7=keywords&f8=priority&f9=bug_severity&ke | 15:15 |
weshay | ywords=FutureFeature%2C%20Tracking%2C%20Documentation%2C%20&keywords_type=nowords&list_id=8949811&n6=1&o1=equals&o10=substring&o12=equals&o2=substring&o3=notsubstring&o4=isempty&o5=isempty&o7=substring&o8=notsubstring&o9=notsubstring&order=changeddate%2Copendate%2Cbug_id&query_format=advanced&saved_report_id=1949&v1=Red%20Hat%20OpenStack&v10=rhos&v12=DFG%3ARDOCI&v2=DFG%3A&v3=doc&v7=Triaged&v8=unspecified&v9=unspecified | 15:15 |
rlandy|rover | that was not the answer I was expecting :) | 15:16 |
*** saneax has quit IRC | 15:17 | |
*** apetrich has quit IRC | 15:22 | |
-openstackstatus- NOTICE: Zuul update for Ansible 2.5 in progress. Scheduler crashed as unexpected side effect of pip upgrade. Will be back and running shortly. | 15:29 | |
rlandy|rover | arxcruz|ruck: ^^ happy times | 15:40 |
arxcruz|ruck | rlandy|rover: (╯°□°)╯︵ ┻━┻ | 15:40 |
arxcruz|ruck | we are done for today then :P | 15:41 |
rlandy|rover | arxcruz|ruck: lol - not quite - I have phase 2 work | 15:41 |
arxcruz|ruck | rlandy|rover: actually, i'm almost done for today, for real, it's almost 6pm here :P | 15:41 |
rlandy|rover | arxcruz|ruck; ack - will watch for any disasters on return | 15:42 |
rlandy|rover | have a good night | 15:42 |
arxcruz|ruck | rlandy|rover: but of course, if you need me for something just ping, i'm always closer to my computer :P | 15:42 |
rlandy|rover | k - hope not to have to disturb you late at night | 15:43 |
*** holser__ has quit IRC | 15:46 | |
chandankumar | arxcruz|ruck: https://review.openstack.org/#/q/topic:tempestconf_200+(status:open+OR+status:merged) | 15:50 |
arxcruz|ruck | chandankumar: what's the job that uses featureset10 ? | 16:00 |
-openstackstatus- NOTICE: The zuul upgrade to ansible 2.5 is complete and zuul is running again. Changes uploaded or approved between 15:25 and 15:45 will need to be rechecked. Please report any problems in #openstack-infra | 16:09 | |
rlandy|rover | %gatestatus | 16:15 |
hubbot | All check jobs are working fine on stable/ocata, stable/ocata, master, stable/queens. | 16:15 |
chandankumar | arxcruz|ruck++ | 16:22 |
hubbot | chandankumar: arxcruz|ruck's karma is now 4 | 16:22 |
*** myoung is now known as myoung|biaf | 16:23 | |
*** myoung|biaf is now known as myoung|lunch | 16:32 | |
hubbot | All check jobs are working fine on stable/ocata, stable/ocata, master, stable/queens. | 16:33 |
chandankumar | myoung|lunch: weshay can we get a push on this https://bugzilla.redhat.com/show_bug.cgi?id=1574931 | 16:45 |
openstack | bugzilla.redhat.com bug 1574931 in documentation "Update the tempest documentation for RHOS-13" [High,New] - Assigned to rhos-docs | 16:45 |
weshay | chandankumar, a push? | 16:46 |
weshay | meaning to next release? | 16:46 |
chandankumar | weshay: nope, getting it done | 16:46 |
*** tbarron has quit IRC | 16:46 | |
chandankumar | weshay: with rhos-13 release | 16:46 |
weshay | 14ok? | 16:47 |
weshay | should be | 16:47 |
chandankumar | weshay: As last discussed we have kept tempest container as tech preview | 16:47 |
chandankumar | weshay: so we need documentation update | 16:47 |
weshay | done | 16:48 |
chandankumar | weshay: thanks | 16:48 |
*** tbarron has joined #oooq | 16:50 | |
*** ccamacho has joined #oooq | 16:57 | |
*** jaganathan has quit IRC | 16:59 | |
weshay | myoung|lunch, re: https://review.openstack.org/#/c/544696/13/tasks/upgrade/main.yml I suggest removing the log commands from the scripts in question and using the established pattern we have in ci | 17:01 |
*** dtantsur is now known as dtantsur|afk | 17:04 | |
*** kopecmartin has quit IRC | 17:07 | |
*** ccamacho has quit IRC | 17:08 | |
*** ccamacho has joined #oooq | 17:08 | |
*** ccamacho has quit IRC | 17:09 | |
*** ccamacho has joined #oooq | 17:09 | |
*** gkadam has quit IRC | 17:14 | |
*** ccamacho has quit IRC | 17:21 | |
*** ccamacho has joined #oooq | 17:21 | |
*** trown is now known as trown|lunch | 17:25 | |
*** udesale has quit IRC | 17:28 | |
*** atoth has quit IRC | 17:30 | |
*** myoung|lunch is now known as myoung | 17:32 | |
*** amoralej is now known as amoralej|off | 17:33 | |
myoung | weshay: ack | 17:35 |
weshay | arxcruz|ruck, rlandy|rover you guys familiar w/ the cix board? | 17:39 |
weshay | arxcruz|ruck, rlandy|rover fyi.. if we opened a promotion_blocker it will land in New/Triage. We need to move to "Critical PChain Outage" or "CIX Failing Jobs" | 17:40 |
weshay | and set the appropriate trello tag for the release | 17:40 |
weshay | quiquell|off, would be interesting to add to the dashboard.. any card in https://trello.com/b/j4IcIomh/production-chain-escalation in the new/Triage column that contains [tripleoci] | 17:41 |
*** atoth has joined #oooq | 17:42 | |
*** atoth has quit IRC | 17:46 | |
rlandy|rover | weshay: yes ... moving that card | 17:47 |
weshay | rlandy|rover, thanks | 17:47 |
weshay | rlandy|rover, we could do this automatically.. w/ a keyword in the bug name.. or a tag | 17:48 |
weshay | probably is annoying at this point | 17:48 |
rlandy|rover | weshay: well, is there a reason the card does not land in Critical PChain Outage automatically? | 17:49 |
rlandy|rover | we always move it there | 17:49 |
rlandy|rover | addthe bug | 17:49 |
weshay | rlandy|rover, the process and design is have a human do it.. but meh | 17:49 |
weshay | rlandy|rover, I have to rewrite the code that does this anyway for storyboard | 17:49 |
rlandy|rover | it just seems we always follow the same process | 17:50 |
weshay | so.. I'll take that as an RFE | 17:50 |
weshay | it's not 100%, but close | 17:50 |
rlandy|rover | weshay: well, we may need to keep updating the cards | 17:50 |
rlandy|rover | as we add people and assign RCA | 17:50 |
*** atoth has joined #oooq | 17:50 | |
rlandy|rover | it would be super nice if it did that automatically | 17:51 |
weshay | k k | 17:56 |
weshay | rlandy|rover, fyi.. the undercloud install bug looks fixed for master https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/986/console | 17:57 |
rlandy|rover | ooo - good | 17:58 |
rlandy|rover | weshay: now to see what lurks behind that | 17:59 |
rlandy|rover | no job runs for a few days | 17:59 |
weshay | rlandy|rover, ya | 18:00 |
*** saneax has joined #oooq | 18:09 | |
*** apetrich has joined #oooq | 18:11 | |
rlandy|rover | trown|lunch: myoung: weshay: I had to revert this change because I switched the order of playbook arguments and it broke periodic. I resubmitted keeping playbook args in tact. Checked with periodic reproducer and we get the correct containers (rdoproject registry) projects ones now. Please review. we should not merge this on a fruday again - in case I killed something else :( | 18:16 |
weshay | rlandy|rover, which review? | 18:16 |
rlandy|rover | oh sorry | 18:17 |
rlandy|rover | https://review.openstack.org/#/c/570694/ | 18:17 |
rlandy|rover | kind of an important detail | 18:17 |
weshay | heh.. /me looks | 18:22 |
weshay | rlandy|rover, fyi https://review.openstack.org/#/c/553465/5 | 18:22 |
myoung | weshay: thanks for feedback, and good idea. I've implemented your feedback, and also tried to make this a little more clear here: https://review.openstack.org/#/c/544696/13..15 | 18:26 |
myoung | rlandy|rover, weshay: regarding automatically moving to critical outage for all cards, if I recall correctly from setting up process, some folks felt strongly that cards are not moved to critical outage until (specifically) a human puts it there, as there are SLA and update implications (update every 4 hours was a goal talked about) for things in that column. Pragmatically / realistically I agree, and we nearly always indeed move it there.... | 18:29 |
myoung | but IMHO there might be some parties that disagree with the autotriage --> pchain outage idea. {shrug} | 18:29 |
myoung | rlandy|rover: looking | 18:30 |
myoung | @review | 18:30 |
weshay | myoung, have you double checked that we haven't mixed update/upgrade w/ template and log names? https://review.openstack.org/#/c/544696/15/tasks/update/create-undercloud-update-scripts.yaml | 18:32 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 18:33 |
myoung | weshay: in looking at the logging, we are today doing 2 things that were confusing... 1.) using undercloud_upgrade.sh.j2 for *both* update and upgrade workflows. 2.) had 2 seperate copies of undercloud_upgrade.sh.j2 - one used for both (normal) upgrade+update, and a second (different yet identically named) template for FFU upgrades. I've renamed the latter with an ffu_ prefix. | 18:37 |
*** trown|lunch is now known as trown | 18:38 | |
myoung | for #1 I created 2 different variables that point to the same file, opting not to rename it for fear of making too many changes at once (described in commit message at end), and for #2 the rename | 18:38 |
* myoung looks at it again anywahy | 18:38 | |
rlandy|rover | weshay: fyi ... I made this adjustment for env E when running fs001 ... http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/hardware_environments/hp_dl360_envE/network_configs/single_nic_vlans/env_settings.yml#n41 | 18:40 |
rlandy|rover | I am not sure if that will be the same on all envs - probably we can fix it | 18:40 |
rlandy|rover | I am duplicating it in the review for the other envs for testing - I can adjust if you think it's no good | 18:41 |
weshay | rlandy|rover, line 41 | 18:42 |
weshay | is probably best left for the fs ya? | 18:42 |
rlandy|rover | weshay: it's in the fs | 18:42 |
rlandy|rover | but if we use fs001 as is, it failed that step | 18:42 |
rlandy|rover | I took it out to re-enable the env for master | 18:42 |
weshay | oh | 18:42 |
rlandy|rover | but now that we are redoing the whole lot, we should think about that more | 18:43 |
weshay | so the deployment fails w/ ssl overcloud | 18:43 |
weshay | huh | 18:43 |
rlandy|rover | it did in my initial tests | 18:43 |
rlandy|rover | but that was rather quick | 18:43 |
rlandy|rover | I did what we needed to get the env back | 18:43 |
weshay | ya | 18:43 |
weshay | understood | 18:43 |
rlandy|rover | ok - just something to review in new set | 18:43 |
rlandy|rover | I will test on another env with ssl enabled - let's see | 18:44 |
weshay | nice containers in master/queens were built successfully | 18:46 |
rlandy|rover | and osp gate is not looking good - will check that out later | 18:46 |
rlandy|rover | upstream zuul looks still functional - that's good | 18:47 |
*** gkadam has joined #oooq | 18:51 | |
myoung | trown, rfolco, quiquell|off, panda, weshay: regarding https://trello.com/c/vJwmd6SD/771-indexing-upgrade-logs-in-logstash, effectively this is my patch (that have just reworked)...I'm happy to be QE + author for this (minor) card, but with TC hat on I see QE is patch author. If anyone wants to have a look once CI on it is done might make sense. Probably not a big deal either way. | 18:53 |
myoung | (well it is my patch lol) | 18:54 |
myoung | s/effectively// | 18:54 |
weshay | marios, fyi ^ | 18:54 |
myoung | ahh sorry marios...muscle memory :) | 18:54 |
weshay | myoung, he'd be a good person to review it | 18:57 |
weshay | rlandy|rover, oh btw.. I asked arxcruz|ruck to double check attila was removed from any rdo cloud tenants and instances | 18:57 |
weshay | not sure if that happened, but probably good to check w/ him tomorrow | 18:57 |
myoung | weshay: ack, indeed. | 18:58 |
rlandy|rover | ok - I'll check with him tomorrow | 18:58 |
rlandy|rover | I think adarazs is still on a lot of our access points | 18:58 |
rlandy|rover | he's probably having too good a time in the south of Spain (?) to access anything though | 18:59 |
myoung | marios: I've added you btw just now to the QE custom field dropdown that's on our cards. You can pick your own color! :) | 18:59 |
myoung | rlandy|rover: sangria yields "don't care about ssh keys" {grin} | 19:00 |
*** Goneri has joined #oooq | 19:11 | |
weshay | myoung, marios k k.. was just looking for review on gerrit change as he's not officially on the team yet | 19:12 |
weshay | myoung, marios however he probably won't mind either | 19:13 |
weshay | myoung, you can still QE sagi's change | 19:13 |
*** atoth has quit IRC | 19:22 | |
*** tcw has quit IRC | 19:23 | |
*** holser__ has joined #oooq | 19:23 | |
myoung | weshay: ack, i didn't put him as QE on the card, I just added him to the available choices for the drop-down, as part of onboarding (meetings, boards, etc) | 19:24 |
weshay | ah roger | 19:24 |
weshay | thanks | 19:24 |
rlandy|rover | we got some promotion failures | 19:26 |
rlandy|rover | Install the undercloud | 19:26 |
*** tcw has joined #oooq | 19:26 | |
rlandy|rover | Failed to establish a new connection: [Errno 111] Connection refused',))\\n\", \"deploy_status_code\": 1}", | 19:27 |
*** d0ugal has joined #oooq | 19:29 | |
weshay | "+ openstack quota set --cores -1 --instances -1 --ram -1 5e38b3f0fccb448386cdb39ba3d45d8b", | 19:29 |
weshay | 2018-06-07 19:12:14 | "Unknown Error (HTTP 503)" | 19:29 |
weshay | rlandy|rover, ya.. that's worth running a recreate on | 19:30 |
weshay | rlandy|rover, need help? | 19:30 |
rlandy|rover | weshay: I am looking through the jobs | 19:30 |
rlandy|rover | we got 2 failures | 19:30 |
rlandy|rover | so the far the other jobs are getting by that | 19:30 |
rlandy|rover | that was the error on fs016 | 19:30 |
rlandy|rover | comparing fs001 error | 19:30 |
rlandy|rover | 2018-06-07 19:11:59 | "stderr: Unknown Error (HTTP 503)", | 19:31 |
rlandy|rover | 2018-06-07 19:11:59 | "Unknown Error (HTTP 503)" | 19:31 |
rlandy|rover | 2018-06-07 19:11:59 | ] | 19:31 |
weshay | Unable to establish connection to http://192.168.24.1:8774/v2.1/os-quota-sets/e68b399367024f39849bf1deaccb67fe: HTTPConnectionPool(host='192.168.24.1', port=8774): Max retries exceeded with url: /v2.1/os-quota-sets/e68b399367024f39849bf1deaccb67fe (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7ff21a83dd10>: Failed to establish a new connection: [Errno 111] Connection refused',))", | 19:31 |
rlandy|rover | "stderr: /usr/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-processing service filter: No module named data_processing.data_processing_service", | 19:33 |
rlandy|rover | weshay: going to run reproducer on my tenant | 19:34 |
rlandy|rover | your tenant may be the better reproducer if we are looking at quotas | 19:34 |
weshay | rlandy|rover let's use ovb obviously for fs001 and libvirt for fs016 | 19:35 |
weshay | rlandy|rover, want me to take fs001? | 19:35 |
weshay | not seeing much here https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/cc496dd/undercloud/var/log/extra/errors.txt.gz | 19:35 |
rlandy|rover | weshay: sure - just want to lock down the original eror | 19:36 |
rlandy|rover | error | 19:36 |
rlandy|rover | there are a few spewing out | 19:36 |
weshay | rlandy|rover, http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/extraconfig/post_deploy/undercloud_post.sh#n69 | 19:37 |
rlandy|rover | weshay: nobody else reporting quota issues on rhos-ops atm ( not that that means anything unto itself) | 19:37 |
rlandy|rover | yes - but that's not the original error, at least I don't think | 19:37 |
rlandy|rover | something happens before that | 19:37 |
rlandy|rover | weshay: ok - let's kick the reproducers and see where we go | 19:38 |
rlandy|rover | you on fs001 | 19:38 |
rlandy|rover | then I'll do fs016 | 19:38 |
weshay | if [ "$(hiera nova_api_enabled)" = "true" ]; then | 19:38 |
rlandy|rover | oh no - we're all red now | 19:38 |
weshay | # Disable nova quotas | 19:38 |
weshay | openstack quota set --cores -1 --instances -1 --ram -1 $(openstack project show admin | awk '$2=="id" {print $4}' | 19:38 |
rlandy|rover | weshay: mass red incoming | 19:39 |
rlandy|rover | this is the first error: | 19:40 |
weshay | k.. one at a time | 19:40 |
rlandy|rover | 2018-06-07 19:25:46 | "Found 1 unmapped computes in cell: 212b1b3a-2c67-4935-8380-0297f480f136", | 19:40 |
rlandy|rover | 2018-06-07 19:25:46 | "stderr: Unable to establish connection to http://192.168.24.1:8774/v2.1/os-services: HTTPConnectionPool(host='192.168.24.1', port=8774): Max retries exceeded with url: /v2.1/os-services (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fae48b486d0>: Failed to establish a new connection: [Errno 111] Connection refused',))", | 19:40 |
rlandy|rover | then we get | 19:41 |
rlandy|rover | Max retries exceeded with url: /v2.1/os-quota-sets/0e15632013534926a3b02f9f2cacead4 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f3ec7a0cb90>: Failed to establish a new connection: [Errno 111] Connection refused',))\\n\", \"deploy_status_code\": 1}\n[2018-06-07 19:25:59,291] (heat-config) [DEBUG] [2018-06-07 19:25:54,777] (heat-config) [INFO] | 19:41 |
rlandy|rover | TASK [Output for UndercloudPostDeployment | 19:41 |
rlandy|rover | weshay: checking queens | 19:42 |
rlandy|rover | queens is good | 19:42 |
rlandy|rover | so probably a real master problem | 19:43 |
weshay | rlandy|rover, what do you think of | 19:43 |
weshay | 2018-06-07 19:11:59 | "Status: Downloaded newer image for trunk.registry.rdoproject.org/tripleomaster/centos-binary-nova-compute-ironic:d596a4ea9f0b0d9255f21bbd4c3757eec6017669_ceffe88f", | 19:43 |
weshay | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/60b4155/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-06-07_19_11_59 | 19:43 |
weshay | rlandy|rover, seems like nova is def not working here | 19:43 |
rlandy|rover | timing on upload/download? | 19:43 |
rlandy|rover | weshay: ok to log a bug and edit the description/details as we go? | 19:44 |
rlandy|rover | somewhere we were can keep our thoughts outside of irc | 19:44 |
weshay | yes please.. but be specific.. I think the deployment of the undercloud stops here http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/extraconfig/post_deploy/undercloud_post.sh#n69 | 19:45 |
weshay | although the error is before that | 19:45 |
rlandy|rover | we will adjust - let's just start somewhere - bug incoming | 19:45 |
weshay | rlandy|rover, bluejeans for a minute | 19:49 |
weshay | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/0830d9b/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-06-05_05_55_03 | 19:49 |
weshay | compare that good log | 19:49 |
rlandy|rover | k | 19:49 |
weshay | rlandy|rover, search for repository trunk.registry.rdoproject.org/tripleomaster/centos-binary-nova-compute-ironic | 19:49 |
weshay | rlandy|rover, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/60b4155/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-06-07_19_11_59 | 19:51 |
*** dtrainor has quit IRC | 20:04 | |
weshay | rlandy|rover, v | 20:06 |
weshay | https://github.com/openstack/nova/commit/79304c1d15742ba04db19204a7c4aa87faaaa2f5 | 20:06 |
*** dtrainor has joined #oooq | 20:06 | |
*** gkadam has quit IRC | 20:11 | |
weshay | rlandy|rover, http://paste.openstack.org/show/722923/ | 20:14 |
*** d0ugal has quit IRC | 20:21 | |
weshay | rlandy|rover, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/cc496dd/undercloud/var/log/extra/nova_list.txt.gz | 20:28 |
weshay | rlandy|rover, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/0830d9b/undercloud/var/log/extra/nova_list.txt.gz | 20:29 |
weshay | rlandy|rover, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/0830d9b/undercloud/var/log/extra/network.txt.gz | 20:33 |
arxcruz|ruck | weshay: | 20:33 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 20:33 |
arxcruz|ruck | 16:39:27 TASK [tripleo-inventory : fetch overcloud node names and IPs] ****************** | 20:33 |
arxcruz|ruck | 16:39:27 Thursday 07 June 2018 16:39:27 +0000 (0:00:04.056) 1:28:56.812 ********* | 20:33 |
arxcruz|ruck | 16:39:31 changed: [undercloud] | 20:34 |
arxcruz|ruck | weshay: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch/2241/console | 20:34 |
arxcruz|ruck | weshay: https://review.openstack.org/#/c/572709/ | 20:34 |
arxcruz|ruck | \o/ | 20:34 |
weshay | arxcruz|ruck, you are the rockinist | 20:34 |
weshay | arxcruz++ | 20:34 |
weshay | rlandy|rover, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/cc496dd/undercloud/var/log/extra/network.txt.gz | 20:34 |
arxcruz|ruck | rlandy|rover: weshay so, if you guys can +2+w so next periodic run we have it tomorrow would be nice :) | 20:35 |
*** brault has joined #oooq | 20:35 | |
arxcruz|ruck | now i'm out :) | 20:35 |
weshay | arxcruz|ruck, thanks brotha | 20:37 |
rlandy|rover | arxcruz|ruck: reviewed and +2 w+1 | 20:37 |
rlandy|rover | https://github.com/openstack/tripleo-heat-templates/blob/master/environments/docker.yaml | 20:40 |
*** brault has quit IRC | 20:40 | |
*** trown is now known as trown|outtypewww | 20:52 | |
*** Goneri has quit IRC | 21:01 | |
*** myoung is now known as myoung|off | 21:14 | |
*** holser__ has quit IRC | 21:26 | |
*** brault has joined #oooq | 21:27 | |
*** hamzy has quit IRC | 22:04 | |
*** hamzy has joined #oooq | 22:05 | |
weshay | rfolco, https://review.openstack.org/573457 | 22:32 |
hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 22:34 |
*** Goneri has joined #oooq | 23:00 | |
*** Goneri has quit IRC | 23:27 | |
rlandy|rover | containerized undercloud deployment failed.\ | 23:42 |
rlandy|rover | Error (HTTP 503)\\n\", \"deploy_status_code\": 1}", | 23:44 |
rlandy|rover | weshay: ^^ reproducer reproduced | 23:44 |
rlandy|rover | as I see so did yours | 23:44 |
rlandy|rover | oh and it kicked again | 23:45 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!