| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 00:21 |
|---|---|---|
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 02:21 |
| *** yolanda_ has quit IRC | 02:41 | |
| *** rasca has quit IRC | 02:41 | |
| *** yolanda_ has joined #oooq | 02:42 | |
| *** rasca has joined #oooq | 02:42 | |
| *** apetrich has quit IRC | 02:44 | |
| *** rnoriega has quit IRC | 02:44 | |
| *** rfolco has quit IRC | 02:44 | |
| *** myoung has quit IRC | 02:44 | |
| *** apetrich has joined #oooq | 02:45 | |
| *** rnoriega has joined #oooq | 02:45 | |
| *** rfolco has joined #oooq | 02:45 | |
| *** myoung has joined #oooq | 02:45 | |
| *** bandini has quit IRC | 02:45 | |
| *** bandini has joined #oooq | 02:46 | |
| *** ssbarnea has quit IRC | 02:46 | |
| *** panda|pto has quit IRC | 02:46 | |
| *** dougbtv_ has quit IRC | 02:46 | |
| *** sai_ has quit IRC | 02:46 | |
| *** strattao has quit IRC | 02:46 | |
| *** ssbarnea has joined #oooq | 02:47 | |
| *** panda|pto has joined #oooq | 02:47 | |
| *** dougbtv_ has joined #oooq | 02:47 | |
| *** sai_ has joined #oooq | 02:47 | |
| *** strattao has joined #oooq | 02:47 | |
| *** jrist has quit IRC | 02:50 | |
| *** jschluet has quit IRC | 02:50 | |
| *** jaganathan has quit IRC | 02:50 | |
| *** weshay_pto has quit IRC | 02:50 | |
| *** fuzzball81 has quit IRC | 02:50 | |
| *** bandini has quit IRC | 02:50 | |
| *** sshnaidm has quit IRC | 02:50 | |
| *** jaosorior has quit IRC | 02:50 | |
| *** hamzy has quit IRC | 02:50 | |
| *** rook has quit IRC | 02:50 | |
| *** dalvarez has quit IRC | 02:50 | |
| *** jrist has joined #oooq | 02:50 | |
| *** jschluet has joined #oooq | 02:50 | |
| *** bandini has joined #oooq | 02:51 | |
| *** sshnaidm has joined #oooq | 02:51 | |
| *** jaosorior has joined #oooq | 02:51 | |
| *** hamzy has joined #oooq | 02:51 | |
| *** rook has joined #oooq | 02:51 | |
| *** dalvarez has joined #oooq | 02:51 | |
| *** jaganathan has joined #oooq | 02:51 | |
| *** weshay_pto has joined #oooq | 02:51 | |
| *** fuzzball81 has joined #oooq | 02:51 | |
| *** ykarel|away has joined #oooq | 03:46 | |
| *** ykarel|away is now known as ykarel | 04:18 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 04:21 |
| *** udesale has joined #oooq | 04:26 | |
| *** ykarel has quit IRC | 04:31 | |
| *** ykarel has joined #oooq | 04:46 | |
| *** yolanda has joined #oooq | 05:33 | |
| *** yolanda_ has quit IRC | 05:35 | |
| *** quiquell|off is now known as quiquell | 05:36 | |
| *** pgadiya has joined #oooq | 05:41 | |
| *** pgadiya has quit IRC | 05:41 | |
| *** jfrancoa has joined #oooq | 05:41 | |
| *** marios has joined #oooq | 05:44 | |
| *** ratailor has joined #oooq | 05:46 | |
| *** kopecmartin has joined #oooq | 05:55 | |
| *** matbu has joined #oooq | 05:58 | |
| *** links has joined #oooq | 06:02 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 06:21 |
| *** saneax has joined #oooq | 06:39 | |
| *** dmellado has joined #oooq | 07:12 | |
| *** tosky has joined #oooq | 07:14 | |
| *** tesseract has joined #oooq | 07:14 | |
| *** amoralej|off is now known as amoralej | 07:20 | |
| myoung | arxcruz|ruck, quiquell, check mail about promoter | 07:24 |
| myoung | arxcruz|ruck, quiquell late friday night it was not working...so we've been running it locally on a box in westford over the long weekend. | 07:25 |
| myoung | does this mean we have 2 promoters running now? | 07:25 |
| * myoung checks before going to bed | 07:25 | |
| myoung | arxcruz|ruck: promoter is still running on my machine... | 07:26 |
| *** bogdando has joined #oooq | 07:26 | |
| myoung | arxcruz|ruck: check mail | 07:28 |
| *** myoung is now known as myoung|zzz | 07:28 | |
| quiquell | myoung|zzz: We have two promoters | 07:30 |
| quiquell | myoung|zzz: Has no email | 07:30 |
| *** quiquell is now known as quiquell|afk | 07:30 | |
| *** jtomasek has joined #oooq | 07:39 | |
| *** ykarel is now known as ykarel|lunch | 07:40 | |
| *** zoli is now known as zoli|wfh | 07:45 | |
| *** zoli|wfh is now known as zoli | 07:45 | |
| *** jaosorior has quit IRC | 07:48 | |
| bogdando | o/ folks. Do you have any ideas how to debug https://logs.rdoproject.org/16/566916/5/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/Zca96f34da3724dd89cb0c5ae271cc953/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-05-28_09_29_09 ? It can not be reproduced via the CI reproduce script on RDO cloud | 08:00 |
| *** yolanda has quit IRC | 08:01 | |
| arxcruz|ruck | bogdando: no idea... | 08:01 |
| * bogdando sigh | 08:02 | |
| bogdando | at first glance the difference may come from the images used for jobs prolly | 08:02 |
| bogdando | but I'm not sure | 08:02 |
| bogdando | for the fs035 job vs that reproduce script does | 08:03 |
| arxcruz|ruck | weird, reproduce should 'reproduce' hehe :/ | 08:03 |
| bogdando | indeed :D | 08:03 |
| arxcruz|ruck | !gatestatus | 08:03 |
| openstack | arxcruz|ruck: Error: "gatestatus" is not a valid command. | 08:03 |
| arxcruz|ruck | !gate | 08:03 |
| openstack | arxcruz|ruck: Error: "gate" is not a valid command. | 08:03 |
| bogdando | try elleven? :) | 08:04 |
| arxcruz|ruck | didn't get the reference... :/ | 08:04 |
| *** dtantsur|afk is now known as dtantsur | 08:04 | |
| arxcruz|ruck | oh, it's the cmd2 problem :/ | 08:05 |
| bogdando | https://www.youtube.com/watch?v=NMS2VnDveP8 | 08:05 |
| arxcruz|ruck | LOL | 08:05 |
| arxcruz|ruck | bogdando: i know that from britsh elevator | 08:05 |
| arxcruz|ruck | you said elleven i thought was something about stranger things | 08:05 |
| bogdando | :) | 08:06 |
| chandankumar | !hannah | 08:11 |
| openstack | chandankumar: Error: "hannah" is not a valid command. | 08:11 |
| chandankumar | hubbot: it is yes or no | 08:12 |
| hubbot | chandankumar: Error: "it" is not a valid command. | 08:12 |
| *** yolanda has joined #oooq | 08:17 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 08:21 |
| *** holser__ has joined #oooq | 08:30 | |
| *** jaosorior has joined #oooq | 08:32 | |
| *** ykarel|lunch is now known as ykarel | 08:35 | |
| arxcruz|ruck | rasca: around ? | 08:43 |
| rasca | arxcruz|ruck, sure | 08:43 |
| arxcruz|ruck | rasca: cmd2 still failing | 08:43 |
| *** d0ugal has joined #oooq | 08:43 | |
| rasca | arxcruz|ruck, where exactly? Isn't it the mirror thing that bandini was talking about earlier? | 08:44 |
| arxcruz|ruck | rasca: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch/4916/console | 08:44 |
| quiquell|afk | arxcruz|ruck: I am going to shutdown the promoter in the promoter server | 08:44 |
| arxcruz|ruck | quiquell|afk: why ? | 08:48 |
| arxcruz|ruck | quiquell|afk: did you saw my email ? | 08:48 |
| arxcruz|ruck | rasca: it seems the problem is with ara | 08:48 |
| quiquell|afk | arxcruz|ruck: Looks like myoung has a promoter already running ? | 08:49 |
| arxcruz|ruck | quiquell|afk: seems so | 08:49 |
| quiquell|afk | arxcruz|ruck: That's why I want to shutdown the one at promoter server | 08:52 |
| arxcruz|ruck | quiquell|afk: ok | 08:52 |
| rasca | arxcruz|ruck, please help me to understand. The log you linked above is failing for the same reason, but my question is: is it quickstart or not? | 08:54 |
| arxcruz|ruck | rasca: that's what i'm trying to identify | 08:54 |
| quiquell|afk | sshnaidm: If I want to force a n -> n + 1 | 08:54 |
| quiquell|afk | meaning queens -> master | 08:55 |
| quiquell|afk | This is enough ? | 08:55 |
| *** bogdando has quit IRC | 08:55 | |
| quiquell|afk | https://review.openstack.org/#/c/570823/ | 08:55 |
| arxcruz|ruck | rasca: doesn't seems to be only us http://logs.openstack.org/03/565703/11/check/nova-live-migration/fd8785e/job-output.txt.gz | 08:56 |
| *** quiquell|afk is now known as quiquell | 08:56 | |
| arxcruz|ruck | rasca: 10:24 <CrayZee> Hi Infra, cmd2 0.9.1 was released about 10 hours ago and broke zuul. Is anyone looking at it? (See http://logs.openstack.org/61/566961/3/gate/neutron-fullstack/11b8515/job-output.txt.gz#_2018-05-28_15_56_36_548759) | 08:56 |
| rasca | arxcruz|ruck, I see, as I was saying yesterday... This will hit us hard | 08:56 |
| arxcruz|ruck | on o-infra | 08:56 |
| arxcruz|ruck | rasca: seems to be ara -> cliff -> cmd2 | 08:57 |
| rasca | arxcruz|ruck, well, at least for my deployments (rdophase2) it's just cmd2 and my patch does the trick | 08:57 |
| arxcruz|ruck | rasca: yeah, because you don't use ara right ? | 08:58 |
| rasca | arxcruz|ruck, in quickstart, inside the requirements ara==0.14.5 | 08:59 |
| rasca | arxcruz|ruck, so we can't be touched by this | 08:59 |
| ykarel | arxcruz|ruck, rasca in case u have missed updates about cmd2:- https://github.com/python-cmd2/cmd2/issues/421, no only mirrors needs to be fixed | 09:00 |
| ykarel | somehow rdo mirror is fixed | 09:00 |
| ykarel | and phase1 passed | 09:01 |
| ykarel | amoralej, do you know about ^^ mirror fixes? | 09:01 |
| quiquell | sshnaidm: +1v https://review.openstack.org/#/c/570167/ export ZUUL_CHANGES | 09:02 |
| amoralej | ykarel, what mirror fixes? | 09:02 |
| ykarel | amoralej, cmd2 0.9.1 is removed from pypi, | 09:03 |
| ykarel | so mirror should be updated for this removal, rdo mirror fixed somehow, | 09:03 |
| ykarel | but openstack-infra mirrors still have this broken cmd2 | 09:03 |
| *** skramaja has joined #oooq | 09:03 | |
| amoralej | ykarel, i still see 0.9.1 in pypi | 09:04 |
| ykarel | amoralej, https://github.com/python-cmd2/cmd2/issues/421 | 09:05 |
| *** ratailor has quit IRC | 09:05 | |
| *** bogdando has joined #oooq | 09:05 | |
| ykarel | hmm got it on phase1 mirror was not used, that'w why it fixed there | 09:06 |
| ykarel | https://files.pythonhosted.org/packages/53/e5/5ec46c74d13b488dedc93d5ff951f459bd898f4315c7564fb67f30d7aec9/ is used | 09:06 |
| ykarel | amoralej, try: pip install cmd2==0.9.1, | 09:07 |
| amoralej | yes, i'm testing it | 09:07 |
| *** ratailor has joined #oooq | 09:08 | |
| ykarel | ack | 09:08 |
| amoralej | yeah, it looks fixed now | 09:09 |
| ykarel | so they fixed it for python2, 0.9+ are available only for python3 | 09:09 |
| amoralej | yeah, that's what i see | 09:10 |
| ykarel | pip3 install cmd2==0.9.1 works | 09:10 |
| amoralej | i'm not sure how mirrors get updated | 09:10 |
| amoralej | in rdo-ci and upstream | 09:10 |
| amoralej | i just saw a job failing still arounc one hour ago https://review.rdoproject.org/jenkins/job/rdoinfo-tripleo-pike-release-centos-7-multinode-1ctlr-featureset006-nv/331/console | 09:10 |
| ykarel | hmm then we need to wait for infra guys, as those needs to be update | 09:10 |
| arxcruz|ruck | jaosorior: hey man, last time i touch a puppet file was 5 years ago, come on, i don't know how to do those stuff :P | 09:13 |
| sshnaidm | arxcruz|ruck, fyi: http://logs.openstack.org/67/570167/2/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/cf9ccc3/job-output.txt.gz#_2018-05-29_09_13_53_496173 | 09:22 |
| arxcruz|ruck | sshnaidm: we are aware | 09:23 |
| sshnaidm | arxcruz|ruck, oh, just saw it in alerts | 09:23 |
| arxcruz|ruck | sshnaidm: everything that uses ara is broken | 09:23 |
| arxcruz|ruck | sshnaidm: https://review.openstack.org/#/c/570822/ | 09:23 |
| arxcruz|ruck | this will fix it | 09:23 |
| *** jfrancoa has quit IRC | 09:24 | |
| sshnaidm | great | 09:25 |
| ykarel | may be they will go with mirror fix instead of ^^ | 09:25 |
| arxcruz|ruck | ykarel: no idea, whatever works, i'm okay :) | 09:27 |
| ykarel | yup | 09:27 |
| *** moguimar has joined #oooq | 09:28 | |
| sshnaidm | quiquell, need to think how better to detect/alert such issues in grafana ^^ | 09:29 |
| *** panda|pto is now known as panda | 09:32 | |
| quiquell | sshnaidm: This goes beyond the build result | 09:32 |
| sshnaidm | does anybody have problems with internal IRC? | 09:32 |
| sshnaidm | quiquell, yeah, need some alert about check jobs too, not only gates.. | 09:33 |
| quiquell | sshnaidm: But you don't know error is legit and what not | 09:33 |
| sshnaidm | quiquell, I think if specific job fails >3 times for various patches, it could be thought as broken | 09:34 |
| sshnaidm | quiquell, it's possible that 3 broken patches in a row, but chance is not big | 09:35 |
| quiquell | sshnaidm: We have to group per review and patchset | 09:36 |
| quiquell | panda: Good come back | 09:36 |
| panda | quiquell: hold it, this is a weird sprint for me, PTO tomorrow morning too | 09:37 |
| quiquell | panda: Holy shit, what are you doing here today | 09:37 |
| panda | quiquell: then all next week, then maybe some other days the one after | 09:37 |
| panda | quiquell: it's a long story | 09:37 |
| quiquell | panda: Ok | 09:38 |
| *** moguimar has quit IRC | 09:38 | |
| panda | quiquell: and anyway, it's holy shift | 09:39 |
| quiquell | panda: fs051 (overcloud upgrade) has a success in upstream | 09:40 |
| quiquell | Maybe we can add it to check/gate | 09:40 |
| quiquell | upgrade guys fixed it | 09:40 |
| arxcruz|ruck | rasca: do you have any idea here ? https://thirdparty.logs.rdoproject.org/jenkins-oooq-master-rdo_trunk-bmu-haa16-lab-float_nic_with_vlans-166/console.txt.gz#_2018-05-26_01_47_29_226 | 09:42 |
| rasca | arxcruz|ruck, you don't have to worry about this one, this is an ha test failed, but the deployment was successful, and in any case the next job was fine | 09:43 |
| rasca | arxcruz|ruck, https://thirdparty.logs.rdoproject.org/jenkins-oooq-master-rdo_trunk-bmu-haa16-lab-float_nic_with_vlans-167/console.txt.gz | 09:43 |
| arxcruz|ruck | rasca: phase3 2 is 4 days behind | 09:44 |
| rasca | phase3 ? | 09:44 |
| rasca | arxcruz|ruck ^^^ | 09:44 |
| arxcruz|ruck | rasca: phase 2 | 09:44 |
| arxcruz|ruck | sorry | 09:44 |
| arxcruz|ruck | hehehe | 09:44 |
| rasca | arxcruz|ruck, uhm before job 167 (which as I said was successful) this maste job failed a gazillion of time... So why we care about it today? | 09:45 |
| *** anande has joined #oooq | 09:49 | |
| arxcruz|ruck | rasca: if you say we are good, i'm good, was just checking phase 2 jobs | 09:50 |
| rasca | arxcruz|ruck, we are good. At least on that side :) | 09:51 |
| quiquell | panda: Reading https://trello.com/c/ZPNYHG3F/775-ci-job-make-job-50-gate | 09:53 |
| quiquell | There is already a job that does that, how do we ensure that we move it to gate ? | 09:53 |
| jaosorior | arxcruz|ruck: that's why I gave the docs :D. But yeah, unfortunately I don't have merge rights in that repo. I'm set as a collaborator but can't merge stuff :/ | 09:54 |
| panda | quiquell: you have to move it to the gate pipeline | 09:54 |
| *** Tengu has joined #oooq | 09:54 | |
| Tengu | hello there! I have a small question regarding a patch I'm submitting: https://review.openstack.org/#/c/570841/ in the comment, there's a remark from jaosorior - and I don't really know the answer. Care to have a look? | 09:55 |
| arxcruz|ruck | jaosorior: yeah, but i don't know exactly what to do, add in the service start in certmonger ? | 09:56 |
| quiquell | panda: We have to ensure that is working first | 09:58 |
| jaosorior | arxcruz|ruck: no, so, just add notify => Service['certmonger'] | 09:58 |
| jaosorior | arxcruz|ruck: and that'll restart certmonger if 'dbus' is restarted | 09:59 |
| arxcruz|ruck | jaosorior: it's not needed | 09:59 |
| jaosorior | it isn't? | 09:59 |
| arxcruz|ruck | jaosorior: nope, because you will install certmonger first, then start the service | 09:59 |
| arxcruz|ruck | the failure is just if dbus is updated without a reboot | 09:59 |
| jaosorior | arxcruz|ruck: right, so lets say that happens | 09:59 |
| panda | quiquell: and that is working at least 94% of the time | 09:59 |
| jaosorior | dbus is restarted, certmonger fails | 10:00 |
| jaosorior | * dbus is updated | 10:00 |
| quiquell | panda: also fs050 is working now | 10:00 |
| jaosorior | and certmonger fails | 10:00 |
| jaosorior | we then run the manifest | 10:00 |
| quiquell | panda: Going to add a patch to put both in the gate | 10:00 |
| jaosorior | dbus is restarted... wouldn't we then need to restart certmonger? | 10:00 |
| arxcruz|ruck | jaosorior: no because certmonger isn't even installed yet | 10:00 |
| jaosorior | OK, I'm getting confused. Is this issue happening on updates? wouldn't that mean that we had already an undercloud running with certmonger? | 10:01 |
| jaosorior | (this could also happen in an overcloud if TLS everyhwere is enabled) | 10:01 |
| arxcruz|ruck | jaosorior: hmmmm it might happen that certmonger is already installed | 10:01 |
| arxcruz|ruck | jaosorior: but if I add a Service['certmonger'] and the service doesn't exist, will it fail ? | 10:02 |
| jaosorior | arxcruz|ruck: no, because it's defined below | 10:02 |
| jaosorior | arxcruz|ruck: puppet first evaluates the whole manifest, then executes it. So it knows what's in the resource catalog | 10:02 |
| arxcruz|ruck | jaosorior: i'm not puppet master (pun intended) so i'll believe in you :P | 10:03 |
| jaosorior | arxcruz|ruck: Tengu is :D we could double check. | 10:04 |
| jaosorior | Tengu: could you check this out https://github.com/saltedsignal/puppet-certmonger/pull/20 ? | 10:04 |
| quiquell | panda: https://review.openstack.org/#/c/570882/ Added to the gates, if we forget about today (ara problem) the job is working | 10:10 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 10:22 |
| Tengu | jaosorior: err yeah, sorry, was away | 10:28 |
| Tengu | arxcruz|ruck jaosorior added a small comment, take it or leave it, not a big issue. | 10:33 |
| Tengu | arxcruz|ruck: short note: puppet will build the catalog and evaluate the dependency tree as a whole. | 10:34 |
| Tengu | arxcruz|ruck: no real order is needed for that. | 10:34 |
| Tengu | that said... wondering whether there isn't a puppet-dbus thingy. | 10:35 |
| jaosorior | Tengu: it might be, but we don't use it in OpenStack. It would be quite painful to introduce a new dependency on a puppet library just for a restart. | 10:35 |
| Tengu | ok :) | 10:36 |
| Tengu | although it might be good to check if there are subtilities. | 10:36 |
| Tengu | 2s | 10:36 |
| jaosorior | Tengu: thansk for checking it out | 10:36 |
| Tengu | https://github.com/bodgit/puppet-dbus/blob/master/manifests/service.pp arxcruz|ruck | 10:36 |
| Tengu | might be good to set the same parameters | 10:36 |
| Tengu | added as a comment to the whole review. | 10:38 |
| Tengu | I let you decide :). | 10:38 |
| *** yolanda has quit IRC | 10:38 | |
| *** yolanda has joined #oooq | 10:42 | |
| arxcruz|ruck | Tengu: cool, thanks :) | 11:07 |
| Tengu | np :). | 11:07 |
| arxcruz|ruck | Tengu: do i need to keep the notify ? | 11:08 |
| Tengu | arxcruz|ruck: the notify will kick in of the daemon is stopped and puppet start it | 11:09 |
| Tengu | as I understand, this is the goal of this patch right? | 11:09 |
| Tengu | *kick in IF the daemon - sorry | 11:09 |
| arxcruz|ruck | Tengu: yup \ | 11:09 |
| Tengu | also *startS - hungry, can't think, sorry | 11:10 |
| *** lucasagomes is now known as lucas-hungry | 11:11 | |
| *** lucas-hungry is now known as lucasagomes | 11:11 | |
| quiquell | panda: do you have a minute ? | 11:23 |
| panda | quiquell: yes | 11:24 |
| quiquell | Doing a noop change on tripleo-upgrade stable/queens | 11:24 |
| quiquell | to trigger something with STABLE_RELEASE=queens | 11:24 |
| quiquell | but I don't see the fs050 check job running on it | 11:25 |
| quiquell | panda: https://review.openstack.org/#/c/570823/ | 11:25 |
| panda | quiquell: probably the job definition is missing for queens | 11:26 |
| quiquell | Damn that's right | 11:27 |
| quiquell | panda: Thanks man | 11:28 |
| *** udesale_ has joined #oooq | 11:33 | |
| *** myoung|zzz is now known as myoung | 11:33 | |
| myoung | quiquell: sent mail... | 11:33 |
| quiquell | myoung: Just readed it | 11:33 |
| myoung | arxcruz|ruck: did you see mail from weekend? should I halt the promoter I have running? | 11:33 |
| quiquell | myoung: Good morning btw | 11:34 |
| quiquell | myoung: I have stop the promoter at the promoter-server | 11:34 |
| arxcruz|ruck | myoung: hey, quiquell already stop the promoter on the promoter-server | 11:34 |
| *** udesale has quit IRC | 11:34 | |
| arxcruz|ruck | myoung: i did saw it, and fwd to quiquell | 11:34 |
| arxcruz|ruck | he wasn't in the list :( | 11:34 |
| myoung | arxcruz|ruck: ya, it was a "world on fire late friday night" event...i had just put ruck/rover on | 11:35 |
| myoung | quiquell: sorry! | 11:35 |
| myoung | arxcruz|ruck, quiquell will be back in 1 hr... | 11:35 |
| * myoung transmogrifies into a kindertaxi | 11:35 | |
| quiquell | myoung: No problem, too much fire | 11:35 |
| arxcruz|ruck | fire exclamation point, fire exclamation point | 11:35 |
| myoung | %gatestatus | 11:36 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 11:36 |
| arxcruz|ruck | myoung: everything is messed | 11:36 |
| quiquell | myoung: I have some proposals for the promoter, do you have a bj minute later ? | 11:36 |
| myoung | quiquell: sure...i have a prototype as well. panda has some opinions here too. | 11:36 |
| arxcruz|ruck | myoung: cmd2 release a new version python 3.4 only, mostly of infra are down, a patch is on the way to fix | 11:37 |
| myoung | quiquell: i was playing with a reimplementation over weekend | 11:37 |
| myoung | i need to dash to take kiddo to school. back inna bit | 11:37 |
| quiquell | myoung: Let's talk later on | 11:37 |
| *** udesale_ has quit IRC | 11:37 | |
| *** ratailor has quit IRC | 11:42 | |
| *** anande has quit IRC | 11:44 | |
| quiquell | Hi, anyone knows why i have the repos disabled in the undercloud ? | 11:53 |
| quiquell | +(/opt/stack/tripleo-ci/toci_gate_test-oooq.sh:60): sudo rm -f '/etc/yum.repos.d/epel*' | 11:54 |
| quiquell | +(/opt/stack/tripleo-ci/toci_gate_test-oooq.sh:62): sudo yum clean all | 11:54 |
| quiquell | Loaded plugins: fastestmirror | 11:54 |
| quiquell | Loading mirror speeds from cached hostfile | 11:54 |
| quiquell | There are no enabled repos. | 11:54 |
| quiquell | Run "yum repolist all" to see the repos you have. | 11:54 |
| quiquell | To enable Red Hat Subscription Management repositories: | 11:54 |
| quiquell | subscription-manager repos --enable <repo> | 11:54 |
| quiquell | To enable custom repositories: | 11:54 |
| quiquell | yum-config-manager --enable <repo> | 11:54 |
| *** atoth has joined #oooq | 11:55 | |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| *** tcw has joined #oooq | 11:58 | |
| quiquell | ok | 12:00 |
| quiquell | sudo yum-config-manager --enable "*" | 12:00 |
| *** sshnaidm has quit IRC | 12:06 | |
| *** sshnaidm has joined #oooq | 12:10 | |
| *** udesale has joined #oooq | 12:11 | |
| *** moguimar has joined #oooq | 12:13 | |
| *** sshnaidm has quit IRC | 12:15 | |
| *** udesale has quit IRC | 12:17 | |
| *** sshnaidm has joined #oooq | 12:18 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 12:22 |
| *** sshnaidm has quit IRC | 12:24 | |
| *** rlandy has joined #oooq | 12:28 | |
| *** rlandy is now known as rlandy|rover | 12:29 | |
| rlandy|rover | arxcruz|ruck: hello - how's it going? | 12:29 |
| arxcruz|ruck | rlandy|rover: hi, good | 12:30 |
| rlandy|rover | arxcruz|ruck: nice :) | 12:30 |
| arxcruz|ruck | rlandy|rover: we ha some issues today that block the entire openstack, not only tripleo | 12:30 |
| rlandy|rover | was expecting some fun after the long weekend | 12:30 |
| arxcruz|ruck | but it's fixed now, so we should start to see some problems soon :D | 12:30 |
| Tengu | :) | 12:30 |
| rlandy|rover | arxcruz|ruck: any particular bug I need to look at now? | 12:31 |
| arxcruz|ruck | rlandy|rover: nope | 12:31 |
| rfolco | arxcruz|ruck, is the cmd2 issue fixed ? | 12:31 |
| arxcruz|ruck | rlandy|rover: i digg into the newton problem, found solution and working on that | 12:31 |
| rlandy|rover | arxcruz|ruck: awesome | 12:31 |
| arxcruz|ruck | rfolco: yup, fixed in infra few minutes ago | 12:31 |
| rfolco | thanks | 12:31 |
| arxcruz|ruck | rfolco: i post comments in the bug | 12:31 |
| rlandy|rover | arxcruz|ruck: ocata is still an issue | 12:31 |
| arxcruz|ruck | rlandy|rover: ^ | 12:31 |
| arxcruz|ruck | rlandy|rover: yeah, i was digging into it today, but the cmd2 cat me | 12:32 |
| arxcruz|ruck | :/ | 12:32 |
| arxcruz|ruck | rlandy|rover: do you know the problem ? | 12:32 |
| rlandy|rover | arxcruz|ruck: and looks like phase2 | 12:32 |
| rlandy|rover | arxcruz|ruck: I'll look into phase 2 | 12:32 |
| *** moguimar has quit IRC | 12:32 | |
| rlandy|rover | wrt ocata | 12:32 |
| arxcruz|ruck | yeah, i saw phase 2 has 4 days | 12:32 |
| rlandy|rover | been trying to reproduce for days | 12:32 |
| rlandy|rover | it's a diff error every time | 12:32 |
| *** moguimar has joined #oooq | 12:33 | |
| rlandy|rover | I think the hardware is not reliable | 12:33 |
| rlandy|rover | but i can't prove it | 12:33 |
| rlandy|rover | arxcruz|ruck: going to look into phase2 and ocata | 12:33 |
| rlandy|rover | ping me if there is something else burning | 12:33 |
| arxcruz|ruck | rlandy|rover: i saw ssh failures | 12:33 |
| rlandy|rover | sometimes introspection fails | 12:34 |
| rlandy|rover | sometimes deploy | 12:34 |
| arxcruz|ruck | rlandy|rover: i also saw stack creation failures, but i check the tenant and the stacks are clean | 12:34 |
| rlandy|rover | sometimes undercloud insta;; | 12:34 |
| rlandy|rover | stack creation failures? | 12:34 |
| rlandy|rover | phase 2? | 12:34 |
| rlandy|rover | ok - I'm on it | 12:34 |
| *** udesale has joined #oooq | 12:34 | |
| rlandy|rover | ykarel: can you review this one for me ... https://review.openstack.org/#/c/570694/ | 12:35 |
| rlandy|rover | it's the redone patch | 12:35 |
| rlandy|rover | panda: ^^ | 12:35 |
| rlandy|rover | I tried to keep the order of args for playbooks | 12:35 |
| arxcruz|ruck | rlandy|rover: yeah, on phase2 but i log into dashboard and stacks are created properly | 12:35 |
| rlandy|rover | ok - I'll look into it | 12:36 |
| ykarel | rlandy|rover, have u tried this with promotion job | 12:36 |
| ykarel | i mean where PERIODIC=1 | 12:37 |
| rlandy|rover | ykarel: will do - you had some other comments that you would check what else was wrong. not sure what you refered to there | 12:38 |
| ykarel | rlandy|rover, ok will look | 12:38 |
| rlandy|rover | myoung: have you seen this on phase 2 before ""2018-05-29 08:26:09 | 2018-05-29 08:26:09,462 INFO: 12: Timeout on http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=stock: (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds') | 12:56 |
| rlandy|rover | 2018-05-29 08:26:09 | 2018-05-29 08:26:09,475 DEBUG: An exception occurred | 12:56 |
| rlandy|rover | maybe we just need to rerun | 12:56 |
| rlandy|rover | myoung: after the meeting, can we talk about phase 2 jobs in master | 12:57 |
| rlandy|rover | looks like they have been failing for a long time | 12:57 |
| rlandy|rover | yet we promote | 12:57 |
| myoung | ci squad: scrum! | 12:59 |
| myoung | rlandy|rover: ack, can chat after meeting | 12:59 |
| *** jaganathan has quit IRC | 13:04 | |
| *** trown|outtypewww is now known as trown | 13:04 | |
| *** ykarel is now known as ykarel|away | 13:06 | |
| *** sshnaidm has joined #oooq | 13:10 | |
| *** ykarel|away has quit IRC | 13:10 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** links has quit IRC | 13:20 | |
| *** sshnaidm has quit IRC | 13:25 | |
| *** sshnaidm has joined #oooq | 13:27 | |
| *** zoli is now known as zoli|lunch | 13:31 | |
| *** dtantsur is now known as dtantsur|brb | 13:31 | |
| *** yolanda_ has joined #oooq | 13:40 | |
| *** yolanda has quit IRC | 13:42 | |
| myoung | arxcruz|ruck: could you send me your key please, will add to the promoter I have running on internal server. I'm moving logs now to the actual promoter from the weekend | 13:44 |
| arxcruz|ruck | myoung: https://github.com/arxcruz.keys | 13:44 |
| myoung | arxcruz|ruck: you should have access now | 13:45 |
| *** dtrainor has joined #oooq | 13:47 | |
| *** ykarel|away has joined #oooq | 13:51 | |
| *** ykarel|away is now known as ykarel | 13:55 | |
| *** moguimar has quit IRC | 13:58 | |
| *** sanjay__u has quit IRC | 14:02 | |
| *** moguimar has joined #oooq | 14:08 | |
| quiquell | I have force a n -> n + 1 for fs050 and has work well | 14:08 |
| quiquell | just reversing the releases stuff at toci_quickstart.sh | 14:09 |
| quiquell | and using rlandy|rover patch | 14:09 |
| quiquell | https://review.openstack.org/#/c/570823/ | 14:09 |
| *** skramaja has quit IRC | 14:11 | |
| quiquell | With stable_release as queens | 14:11 |
| quiquell | build-test-package works at undercloud install but not install-build-repo | 14:11 |
| *** quiquell is now known as quiquell|off | 14:20 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 14:22 |
| *** bogdando has quit IRC | 14:29 | |
| panda | I think we need to cap the initial presentation at 15 minutes | 14:31 |
| trown | initial presentation? | 14:32 |
| sshnaidm | panda, arxcruz|ruck rlandy|rover trown, should we discuss interview? | 14:32 |
| arxcruz|ruck | sshnaidm: up to you | 14:33 |
| sshnaidm | arxcruz|ruck, it shouldn't be up to me :) | 14:33 |
| arxcruz|ruck | up to trown then | 14:33 |
| arxcruz|ruck | :D | 14:33 |
| panda | trown: who we are, who you are what we do | 14:33 |
| trown | we can discuss now I suppose... I thought we would discuss all 3 after tomorrow | 14:33 |
| trown | but easier for me to say since I was taking notes | 14:34 |
| trown | i rejoined the bluejeans | 14:34 |
| trown | panda: oh did we spend more than 15 minutes on that? I thought we had plenty of technical questions | 14:34 |
| sshnaidm | trown, I won't be tomorrow | 14:34 |
| panda | trown: 20 minutes | 14:35 |
| trown | panda: arxcruz|ruck rlandy|rover sshnaidm: ok, lets rejoin and discuss now, and I will add more notes for our team discussion | 14:35 |
| sshnaidm | trown, rejoin to the same bj? | 14:35 |
| panda | trown: ok, cancelling the community meeting | 14:35 |
| panda | no on there again | 14:36 |
| trown | panda: ya, seems to much with interviews anyways | 14:36 |
| trown | sshnaidm: ya | 14:36 |
| chandankumar | sshnaidm: myoung trown please have a look these patches https://review.openstack.org/#/q/topic:refstack-support+(status:open+OR+status:merged) | 14:37 |
| arxcruz|ruck | panda: rlandy|rover https://bluejeans.com/4113567798/?src=calendarLink | 14:37 |
| panda | trown: sshnaidm rlandy|rover there is also the community meeting to discuss the combination of injections | 14:39 |
| panda | trown: sshnaidm rlandy|rover I'll need a summary of what you discussed before the next interview | 14:44 |
| kopecmartin | chandankumar, arxcruz|ruck myoung I'm sorry, I can't make it to today's meeting, I need to leave earlier | 14:49 |
| kopecmartin | I've updated my cards and write a summary for each of them, | 14:49 |
| kopecmartin | tomorrow and the next day I'm on PTO but I'm checking emails if anything urgent :) | 14:50 |
| chandankumar | kopecmartin: enjoy your pto :-) | 14:50 |
| kopecmartin | chandankumar, thanks | 14:51 |
| myoung | arxcruz|ruck, rlandy|rover, the promoter logs until we move promoter off internal server are here: http://sol.usersys.redhat.com/promoter_logs/ | 14:51 |
| arxcruz|ruck | myoung: fancy, i like it | 14:51 |
| myoung | arxcruz|ruck: fancy? | 14:51 |
| myoung | arxcruz|ruck: ahh the apache config :) | 14:52 |
| arxcruz|ruck | myoung: yup | 14:52 |
| myoung | arxcruz|ruck: for ruck stuff I find this useful too, http://sol.usersys.redhat.com/dlrnapi-reports | 14:52 |
| myoung | ^^ to augment http://dashboards.rdoproject.org/{release} | 14:53 |
| *** ykarel is now known as ykarel|away | 14:54 | |
| *** kopecmartin has quit IRC | 14:56 | |
| *** dtantsur|brb is now known as dtantsur | 15:00 | |
| *** zoli|lunch is now known as zoli|wfh | 15:04 | |
| rlandy|rover | myoung: 2018-05-29 11:08:26,223 11521 INFO promoter Skipping promotion of current-tripleo-rdo to current-tripleo-rdo-internal, missing successful jobs: ['periodic-master-rdo_trunk-featureset020-1ctlr_1comp_64gb'] | 15:10 |
| rlandy|rover | should be succeddful? | 15:11 |
| rlandy|rover | successful? | 15:11 |
| myoung | rlandy|rover: ack, rdo2 criteria has generally been fs020 (which runs tempest in same manner as upstream) + BM pass | 15:11 |
| myoung | rlandy|rover: or do you mean "there is a success logged and promoter should have found it?" | 15:12 |
| rlandy|rover | will ping in a bit - interview | 15:13 |
| arxcruz|ruck | myoung: this failures that hubbot is reporting at https://review.openstack.org/564291 isn't getting rebased, is that correct? | 15:19 |
| *** ccamacho has quit IRC | 15:20 | |
| myoung | arxcruz|ruck: in TC meeting, responses delayed. the hubbot job is watching the jobs listed in https://review.rdoproject.org/etherpad/p/ruckrover-sprint14 at the top | 15:21 |
| myoung | hubbot check jobs: | 15:21 |
| myoung | TQE, https://review.openstack.org/#/c/560445, I214272a6f25feb75496e44eb0a16269c6ee4cfe2 | 15:21 |
| myoung | THT, https://review.openstack.org/#/c/567224, I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1, stable/queens | 15:21 |
| myoung | THT, https://review.openstack.org/#/c/564285, If12c8fe9bd0bea98a4842f279399285344f22246, stable/pike | 15:21 |
| myoung | THT, https://review.openstack.org/#/c/564291, I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab, stable/ocata | 15:21 |
| hubbot | myoung: Error: "check" is not a valid command. | 15:21 |
| myoung | %config plugins.GateStatus.changeIDs | 15:22 |
| hubbot | myoung: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 15:22 |
| myoung | arxcruz|ruck: ^^ | 15:22 |
| myoung | arxcruz|ruck, or at least it should be. IF we need/want to add patches to what's watched/monitored by the bot and automatically rechecked, that can be done via IRC or (better) by modifying the hubbot .conf files on the hubbot instance | 15:34 |
| arxcruz|ruck | myoung: yeah, it seems that the change doesn't rebase since may 24 | 15:34 |
| *** moguimar has quit IRC | 15:38 | |
| *** marios has quit IRC | 15:48 | |
| *** jtomasek has quit IRC | 15:52 | |
| *** saneax has quit IRC | 15:53 | |
| *** udesale_ has joined #oooq | 15:54 | |
| *** jtomasek has joined #oooq | 15:54 | |
| rfolco | arxcruz|ruck, or chandankumar: python-stestr... where do I install this from ? you know ? | 15:56 |
| chandankumar | rfolco: on undercloud | 15:56 |
| arxcruz|ruck | chandankumar: i think he meant the repo right ? | 15:56 |
| rfolco | yep, which repo | 15:56 |
| *** udesale has quit IRC | 15:57 | |
| chandankumar | rfolco: it is available in rhos-release 13 repo | 15:57 |
| rfolco | rhos-12 does not have it ? | 15:57 |
| chandankumar | rfolco: nope | 15:57 |
| chandankumar | rfolco: look for | 15:58 |
| chandankumar | rhos-12.0-rhel-7-override | 15:58 |
| chandankumar | repo | 15:58 |
| chandankumar | enable it then you can install python-stestr | 15:58 |
| chandankumar | myoung: I might not be able to standup today sorry for the late notice | 16:01 |
| rfolco | chandankumar, I think I have it already | 16:02 |
| rfolco | https://softwarefactory.usersys.redhat.com/logs/95/95/23/check/osp-rhel-7-undercloud-oooq/ffc333e/logs/undercloud/etc/yum.repos.d/rhos-release-12.repo.txt.gz | 16:02 |
| rfolco | [rhelosp-12.0-image-build-override] | 16:02 |
| rfolco | oh different one | 16:02 |
| myoung | chandankumar, also martin isn't here, shall we just cancel? | 16:04 |
| myoung | arxcruz|ruck: ^^ | 16:04 |
| chandankumar | myoung: yup | 16:04 |
| myoung | chandankumar: ack | 16:04 |
| arxcruz|ruck | myoung: i'm in an interview | 16:04 |
| arxcruz|ruck | myoung: plus, i'm rucking :P | 16:04 |
| myoung | chandankumar, arxcruz|ruck anything for tempest squad that needs doing/chasing of note? | 16:04 |
| myoung | "virtualmeetinggo" | 16:05 |
| chandankumar | myoung: most of the work is in progress | 16:05 |
| myoung | chandankumar: ack. just checking :) | 16:05 |
| myoung | if anything out of band | 16:05 |
| chandankumar | myoung: I need reviews on this https://review.openstack.org/#/q/topic:refstack-support+(status:open+OR+status:merged) | 16:05 |
| *** udesale__ has joined #oooq | 16:07 | |
| *** udesale_ has quit IRC | 16:10 | |
| *** udesale__ has quit IRC | 16:14 | |
| chandankumar | rfolco: mburns will tag it under rhelosp-12.0-unittest repo | 16:14 |
| chandankumar | rfolco: then you will able to use it | 16:15 |
| chandankumar | just make sure you enable repo | 16:15 |
| rfolco | [rhelosp-12.0-unittest] | 16:15 |
| rfolco | name=RHOS-12.0 Unit Test Dependency | 16:15 |
| rfolco | baseurl=http://download.eng.bos.redhat.com/rel-eng/repos/rhos-12.0-rhel-7-testdeps/$basearch/ | 16:15 |
| rfolco | chandankumar, waiting for your signal | 16:15 |
| *** panda is now known as panda|off | 16:21 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 16:22 |
| rlandy|rover | myoung: bug triage? | 16:33 |
| myoung | yes incoming, thought yall were interviewing still | 16:34 |
| rlandy|rover | myoung: I think panda|off is gone | 16:34 |
| rlandy|rover | late for arxcruz|ruck as well | 16:35 |
| *** holser__ has quit IRC | 16:52 | |
| rlandy|rover | trown: can we get a review on https://review.rdoproject.org/r/#/c/13945/ | 17:02 |
| rlandy|rover | I am working on fixing envE for fs001 | 17:03 |
| rlandy|rover | sshnaidm: ^^ can you review? we're trying to get a pike promotion through | 17:08 |
| rlandy|rover | envE hasn't passed since 05/07 | 17:08 |
| *** trown is now known as trown|lunch | 17:11 | |
| *** dsneddon has joined #oooq | 17:23 | |
| myoung | rlandy|rover: https://review.rdoproject.org/r/#/c/13904 | 17:29 |
| chandankumar | rfolco: good to go ahead | 17:36 |
| chandankumar | rfolco: sorry I went out for food | 17:36 |
| chandankumar | rfolco: https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=617309 | 17:36 |
| rfolco | chandankumar, does it take a while to show up in the repo ? http://download-node-02.eng.bos.redhat.com/rel-eng/repos/rhos-12.0-rhel-7-testdeps/x86_64/ | 17:38 |
| chandankumar | rfolco: yup it will take some time to show up there | 17:38 |
| rfolco | chandankumar, cool. Thanks for building it ;) | 17:39 |
| chandankumar | rfolco: let me know if any more package are missed | 17:39 |
| rfolco | I am very close to a successful run, hope this was the last one | 17:40 |
| *** jaosorior has quit IRC | 17:49 | |
| *** zoli|wfh is now known as zoli|gone | 18:16 | |
| *** zoli|gone is now known as zoli | 18:16 | |
| *** atoth has quit IRC | 18:20 | |
| *** atoth has joined #oooq | 18:21 | |
| *** rlandy|rover is now known as rlandy|rover|brb | 18:21 | |
| rfolco | chandankumar, python2-future is a dep of python-stestr. Had to install it manually. | 18:22 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-nonha-multinode-oooq, tripleo-ci-centos-7-scenario001-multinode-oooq, tripleo-ci-centos-7-scenario004-multinode-oooq, tripleo-ci-centos-7-scenario002-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq, tripleo-ci-centos-7-undercloud-oooq @ https://review.openstack.org/564291, master: (5 more messages) | 18:22 |
| *** trown|lunch is now known as trown | 18:22 | |
| *** dtantsur is now known as dtantsur|afk | 18:28 | |
| *** tesseract has quit IRC | 18:30 | |
| *** amoralej is now known as amoralej|off | 18:38 | |
| *** jaganathan has joined #oooq | 18:41 | |
| *** tcw1 has joined #oooq | 18:45 | |
| *** jjoyce has joined #oooq | 18:50 | |
| *** tcw has quit IRC | 18:52 | |
| *** weshay_pto has quit IRC | 18:53 | |
| *** fuzzball81 has quit IRC | 18:53 | |
| *** weshay has joined #oooq | 18:54 | |
| *** rlandy|rover|brb is now known as rlandy|rover | 19:03 | |
| rlandy|rover | current-tripleo-rdo-internal | 19:03 |
| rlandy|rover | 379 MB | 19:03 |
| rlandy|rover | 14 minutes ago | 19:03 |
| rlandy|rover | pike promotion ... hello | 19:04 |
| *** holser__ has joined #oooq | 20:11 | |
| *** ykarel|away has quit IRC | 20:14 | |
| hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 20:22 |
| rlandy|rover | woohoo | 20:29 |
| myoung | rlandy|rover: boomsauce: 2018-05-29 16:26:05, https://trunk.rdoproject.org/centos7-pike/8e/96/8e9629b551b41fa689517dfd9d3be1359b203acd_940a986d, current-tripleo-rdo-internal | 20:37 |
| myoung | rlandy|rover: anything else a priority or should i kick off the normal loop of promotions? | 20:38 |
| *** trown is now known as trown|outtypewww | 20:45 | |
| rlandy|rover | myou: we're all good except ocata | 21:01 |
| rlandy|rover | thank you | 21:01 |
| rlandy|rover | myoung,: normal promotions | 21:01 |
| rlandy|rover | myoung: do you have any access to the ci.centos nodes? | 21:02 |
| rlandy|rover | I can't figure this out | 21:02 |
| rlandy|rover | sshnaidm: do you have any access to hold ci.centos nodes by any chance? | 21:11 |
| rlandy|rover | I think adarazs used to | 21:11 |
| rlandy|rover | ocata phase 1 is doing us in | 21:11 |
| sshnaidm | rlandy|rover, nope :( | 21:11 |
| rlandy|rover | sshnaidm: you reported the ocata phase1 failure and I still can't get a reliable reproducer | 21:12 |
| rlandy|rover | I need to get on the nodes - asked david simard | 21:12 |
| rlandy|rover | we really need envs we can reproduce :( | 21:12 |
| sshnaidm | rlandy|rover, doesn't it reproduce with usual libvirt? | 21:13 |
| sshnaidm | rlandy|rover, it should be libvirt job, right? | 21:13 |
| rlandy|rover | sshnaidm: it doesn't even reproduce on itself | 21:13 |
| rlandy|rover | one job undercloud install fails | 21:13 |
| rlandy|rover | then images fail | 21:13 |
| rlandy|rover | then deploy fails | 21:13 |
| sshnaidm | mmm.. yeah, seems like infrastructure problem | 21:13 |
| rlandy|rover | the best I can do is try debug why we get 'no available nodes' on the overclodu deployment | 21:14 |
| rlandy|rover | right | 21:14 |
| rlandy|rover | but I can't prove it | 21:14 |
| rlandy|rover | and I have no access to the infra | 21:14 |
| sshnaidm | rlandy|rover, cpu/mem/disk is ok? | 21:14 |
| *** holser__ has quit IRC | 21:14 | |
| sshnaidm | no oom killers or kind of? | 21:14 |
| rlandy|rover | not from what I can tell from looking at logs - but will recheck | 21:15 |
| sshnaidm | rlandy|rover, maybe also network problem, worth to check if we got failed yum installs | 21:15 |
| sshnaidm | rlandy|rover, is it the same slave or slave group? | 21:16 |
| rlandy|rover | sshnaidm: david has node access | 21:16 |
| rlandy|rover | getting a node to debug | 21:16 |
| sshnaidm | ok | 21:17 |
| *** sanjay__u has joined #oooq | 21:19 | |
| rlandy|rover | rdo-ci-cloudslave05 | 21:19 |
| rlandy|rover | rdo-ci-cloudslave05 ( on previous job) | 21:19 |
| *** jtomasek has quit IRC | 21:53 | |
| *** tosky has quit IRC | 22:02 | |
| *** tosky has joined #oooq | 22:06 | |
| hubbot | All check jobs are working fine on stable/queens, stable/ocata, stable/ocata, master. | 22:22 |
| myoung | rlandy|rover: no we don't have access | 22:36 |
| myoung | we can ping amoralej|off typically or yatin | 22:37 |
| myoung | rlandy|rover: do we already have a LP for the phase 1? at this point we've dumped some time into debugging and coming up with we don't have access... LP --> promotion-blocker --> CIX card, mobilize. I think ruck/rover should have access to rdo1 nodes for debugging. Until we do we're basically stuck on rdo1 | 22:38 |
| myoung | ^^ (IMHO) | 22:38 |
| rlandy|rover | myoung: agreed - I'm logging a LP with debug details | 22:59 |
| myoung | rlandy|rover: ack. back inna bit...making banana bread with my tween-now-teen-omg | 23:08 |
| rlandy|rover | happy birthday? | 23:09 |
| myoung | every day is a good day for banana bread | 23:17 |
| myoung | lol | 23:17 |
| *** tosky has quit IRC | 23:25 | |
| rlandy|rover | myoung: https://bugs.launchpad.net/tripleo/+bug/1774079 | 23:29 |
| openstack | Launchpad bug 1774079 in tripleo "[ocata promotion] phase1 (ci.centos) job tripleo-quickstart-promote-ocata-rdo_trunk-minimal fails introspection/deploy "No valid host found"" [Critical,Triaged] | 23:29 |
| *** openstackstatus has joined #oooq | 23:42 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!