Tuesday, 2018-09-11

« Monday, 2018-09-10 Index Wednesday, 2018-09-12 »
*** Goneri has quit IRC00:14
*** agopi|brb has joined #oooq00:26
*** agopi|brb is now known as agopi00:29
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (2 more messages)01:38
*** gouthamr has quit IRC02:18
*** dmellado has quit IRC02:18
*** hubbot1 has quit IRC02:19
*** apetrich_ has joined #oooq02:57
*** jaganathan has joined #oooq03:00
*** apetrich has quit IRC03:00
*** yolanda has joined #oooq03:07
*** skramaja has joined #oooq03:25
*** nottypenguin has quit IRC03:46
*** udesale has joined #oooq04:04
*** ykarel|away has joined #oooq04:05
*** ykarel|away is now known as ykarel04:05
*** ykarel has quit IRC04:29
*** saneax has joined #oooq04:41
*** ykarel has joined #oooq04:56
*** yolanda has quit IRC05:11
*** ratailor has joined #oooq05:33
*** quiquell has joined #oooq05:36
*** quiquell is now known as quiquell|rover05:36
quiquell|roverchkumar|ruck: Good morning sir05:41
chkumar|ruckquiquell|rover: Good morning sir05:41
chkumar|ruckquiquell|rover: some bad news, RDO cloud is down05:41
quiquell|roverchkumar|ruck: Looks like we are hit by timeouts a lot05:41
chkumar|ruckquiquell|rover: yes05:41
quiquell|roverchkumar|ruck: :-(05:41
quiquell|roverchkumar|ruck: Have recheck tor volume min/max review05:42
chkumar|ruckquiquell|rover: nope05:42
quiquell|roverchkumar|ruck: At least the renaming for pike has merge :-)05:42
chkumar|ruckquiquell|rover: the patch worked , thanks you rechecked :-)05:43
quiquell|roverchkumar|ruck: https://semaphore.cloud.upshift.engineering.redhat.com/05:45
quiquell|roverchkumar|ruck: major outage05:45
quiquell|roverso it's pretty f.. up05:46
chkumar|ruckquiquell|rover: yes05:46
chkumar|ruckoutage email came just right now05:46
quiquell|roverchkumar|ruck: we didn't have a queens promotion I think... https://trunk.rdoproject.org/centos7-queens/current-tripleo/?C=M;O=D05:47
quiquell|rover20d puff05:48
chkumar|ruckyes05:48
quiquell|roverHave to leave go back in a few05:50
chkumar|rucksure05:51
*** quiquell|rover is now known as quique|rover|brb05:51
*** quique|rover|brb is now known as quiquell|rover06:09
quiquell|roverchkumar|ruck: Going to the office06:45
*** quiquell|rover is now known as quique|rover|bbl06:46
chkumar|ruckquiquell|rover: will have 1:106:46
quique|rover|bblchkumar|ruck: ack06:46
*** quique|rover|bbl has quit IRC06:50
*** tesseract has joined #oooq06:51
*** gouthamr has joined #oooq07:13
*** dmellado has joined #oooq07:16
*** hubbot1 has joined #oooq07:24
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (2 more messages)07:39
*** ykarel is now known as ykarel|lunch07:46
*** ccamacho has joined #oooq07:57
*** quiquell has joined #oooq08:11
*** quiquell is now known as quiquell|rover08:11
quiquell|roverchkumar|ruck: I am back08:11
quiquell|roverLooks like RDO is up08:12
chkumar|ruckquiquell|rover: it appears the manila tempest plugin package is still not there08:12
quiquell|roverchkumar|ruck: I am checking the promotion08:13
quiquell|roverchkumar|ruck: we have no promotin run from today08:14
chkumar|ruckquiquell|rover: http://logs.openstack.org/85/564285/44/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/f254ee9/logs/tempest.html.gz08:14
chkumar|ruckwe are hitting the same manila issue in pike also08:14
chkumar|ruckafter package fix08:14
chkumar|ruckquiquell|rover: http://logs.openstack.org/85/564285/44/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/f254ee9/logs/subnode-2/var/log/containers/manila/manila-scheduler.log.txt.gz#_2018-09-11_01_57_08_44108:15
chkumar|ruckfrom stable/pike noop jobs08:15
quiquell|roverchkumar|ruck: run from periodics, they are suppose to be running like now, but RDO autage in the middle has stop it08:16
quiquell|roverykarel|lunch, chkumar|ruck: Can we force run of periodic jobs ?08:17
*** gkadam has joined #oooq08:17
chkumar|ruckquiquell|rover: I think we cna change the periodic job timing and trigerr early08:18
chkumar|ruckykarel|lunch: ^^08:18
quiquell|roverchkumar|ruck: Let me change "config"08:19
*** pgadiya has joined #oooq08:25
chkumar|ruckgouthamr: tbarron if you are around please have a look at https://bugs.launchpad.net/tripleo/+bug/1790857/comments/14 stable/pike failure08:26
openstackLaunchpad bug 1790857 in tripleo "Queens tripleo-ci-centos-7-scenario004-multinode-oooq-container failing tempest manila_tempest_tests.tests.api.test_shares.SharesCephFSTest " [Critical,Fix released] - Assigned to Goutham Pacha Ravi (gouthamr)08:26
*** pgadiya has quit IRC08:26
quiquell|roverchkumar|ruck: so we need to update manila tempest plugin in pike too ?08:27
chkumar|ruckarxcruz|ptg: https://github.com/rdo-infra/review.rdoproject.org-config/commit/f1996595e7efe09d6197480a386e1729910e596f08:27
chkumar|ruckquiquell|rover: https://github.com/rdo-infra/review.rdoproject.org-config/commit/f1996595e7efe09d6197480a386e1729910e596f08:28
chkumar|ruckto reschedule periodic job08:28
chkumar|ruckquiquell|rover: we just fixed the name of manila tempest plugin then manila tempest tests got triggered08:28
chkumar|ruckand then the actual failure comes08:28
quiquell|roverchkumar|ruck: Did a change at config08:29
quiquell|roverchkumar|ruck: the pipeline is the other https://review.rdoproject.org/r/1622108:30
quiquell|roverTo run in in half an 9 UTC08:30
chkumar|ruckquiquell|rover: if we merge right now it will take around 5-10 mins to apply changes08:30
quiquell|roverchkumar|ruck: jpena did the honors :-)08:31
chkumar|ruck:-)08:31
quiquell|roverwe have to remember to revert this08:31
quiquell|roverchkumar|ruck: so for pikes we have to also update manila tempest plugin ?08:32
*** ykarel|lunch is now known as ykarel08:32
chkumar|ruckquiquell|rover: I donot think so, there might be some problem with microversion or ceph08:33
chkumar|ruckdigging08:33
quiquell|roverchkumar|ruck: maybe we can disable the tempest tests there while we fix it ?08:33
chkumar|ruckquiquell|rover: yes, let me check if backporting that fixes the issue or not08:35
quiquell|roverchkumar|ruck: ack08:36
chkumar|ruckquiquell|rover: https://github.com/openstack/manila-tempest-plugin/commit/f6bc6fa7bc0e46857aba2b141f31b516a7d30a41 it is a big patch08:38
chkumar|ruckif we backport it, then it will work ? But I will wait whether queens passes or not08:38
quiquell|roverchkumar|ruck: we are not that bad a pike promotions08:39
quiquell|roverchkumar|ruck: a no... we are very bad08:39
quiquell|roverlet's disable the test for pike and test te solution for queens, what do you think ? we have 20 minutes to dice :-)08:39
quiquell|roverdecide08:39
quiquell|roverchkumar|ruck: Create a generic share type (api tests) does not apply to pike if we update manila-tempest-plugin ?08:42
chkumar|ruckquiquell|rover: we cannot update manila-tempest-plugin in pike as the plugin is in tree means it exists with in manila project08:43
chkumar|ruckquiquell|rover: sending review to disable the tests08:43
quiquell|roverchkumar|ruck: Ahh you told me yesterday, it embedded08:43
*** bogdando has joined #oooq08:44
quiquell|roverchkumar|ruck: periodics has just kick in08:44
chkumar|ruckquiquell|rover: disabling test will go tq so will take time08:45
quiquell|roverchkumar|ruck: Ahh they are just executions in the middle of RDO outage I think08:46
quiquell|roverchkumar|ruck: master and rocky08:47
chkumar|rucklet's hope it passes this time, it has annoyed a lot08:47
quiquell|roverchkumar|ruck: Don't even bother looking at them08:50
quiquell|roverchkumar|ruck: periodics running09:26
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (1 more message)09:40
*** tesseract has quit IRC09:46
chkumar|ruckquiquell|rover: numbers of jobs timing out is increasing10:22
quiquell|roverchkumar|ruck: I am looking at it10:23
quiquell|roverchkumar|ruck: Can you open a bug for it ?10:23
chkumar|rucksure10:23
quiquell|roverchkumar|ruck: suspect is tripleo-container-image-prepare, looks like now we are using a script to run it not openstack command10:24
quiquell|roverchkumar|ruck: Also for rabbitmq is using https to build it, don't know if this can be a problem too10:24
quiquell|roverchkumar|ruck: I am looking at the kolla build logs10:24
*** ratailor has quit IRC10:55
*** ratailor has joined #oooq10:55
quiquell|roverchkumar|ruck: Maybe I am not able to attend CIX11:04
chkumar|ruckquiquell|rover: I will cover that for you11:04
*** quiquell|rover is now known as quique|rover|lch11:04
*** quique|rover|lch has quit IRC11:09
*** udesale has quit IRC11:12
*** gkadam_ has joined #oooq11:20
*** gkadam has quit IRC11:22
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (2 more messages)11:40
rfolcofor the love of cloud computing gods and patron saint of intermittent ci jobs, can we merge https://review.openstack.org/#/c/589448 ?11:48
*** ratailor has quit IRC11:56
*** ykarel is now known as ykarel|afk11:58
*** quiquell has joined #oooq11:59
chkumar|ruckquiquell: welcome back12:00
chkumar|ruckquiquell: now github clone is showing issue12:00
quiquellchkumar|ruck: Yep fatal: unable to access 'https://github.com/redhat-openstack/rdoinfo/': TCP connection reset by12:00
quiquellchkumar|ruck: Your patch failining in it, also the timeout12:00
chkumar|ruckperioidc jobs impacted,12:00
quiquellchkumar|ruck: How lucky we are, let's connect to CIX12:01
quiquellchkumar|ruck: going to revert my change on periodics12:04
quiquellSo they run at the expected time12:04
chkumar|ruckquiquell: ack12:04
*** ykarel|afk has quit IRC12:05
*** jaganathan has quit IRC12:09
*** jaganathan has joined #oooq12:12
*** dtantsur is now known as dtantsur|brb12:13
chkumar|ruckquiquell: do we need card for github dependency?12:16
quiquellchkumar|ruck: I think so, we are not suppose to use github12:17
quiquellchkumar|ruck: I will take it12:18
chkumar|ruckquiquell: filign a bz12:18
chkumar|ruckquiquell: https://bugs.launchpad.net/tripleo/+bug/179194112:24
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,Triaged]12:24
*** yolanda has joined #oooq12:30
quiquellchkumar|ruck: I have dmellado next to me, question, do we have requirements.txt with stuff we install before running tempoest ?12:37
quiquellchkumar|ruck: so we can install the openshift python wrapper from there ?12:37
chkumar|ruckquiquell: is it?12:42
*** quiquell is now known as quiquell|rover12:42
chkumar|ruckquiquell|rover: in RPM packaging, we donot install stuff from requiremts.txt12:43
quiquell|roverchkumar|ruck: Can we install pip libraries in the Dockerfile from containerized tempest ?12:43
quiquell|roverchkumar|ruck: ack12:44
chkumar|ruckquiquell|rover: sorry12:51
chkumar|ruckquiquell|rover: we can use centos-binary-source  there and do a jinja template overrides in tht and it will wiork12:54
chkumar|ruckquiquell|rover: I think we never ship pip in containerized tempest12:55
chkumar|ruckquiquell|rover: dmellado you guys are sitting together in spain office?12:58
*** skramaja has quit IRC12:58
dmelladochkumar|ruck: yep, today12:59
dmelladoI'm trying to debug that with quiquell|rover12:59
dmelladobut basically we can do12:59
dmellado1) for now, pin the commit12:59
dmellado2) create python-openshift rpm ASAP12:59
*** jrist has quit IRC12:59
dmelladooptional, and not ideal, if you can make rpm creation depend on a non-merged commit12:59
dmelladothen https://review.openstack.org/#/c/601591/13:00
*** ykarel has joined #oooq13:00
chkumar|ruckdmellado: sir please donot revert13:02
chkumar|ruckdmellado: the kuryr tempest plugin is already pinned in RDO13:02
chkumar|ruckdmellado: we are waiting for next periodic run13:02
dmelladochkumar|ruck: yep, was that a proof of concept, no worries13:03
dmelladoin any case, I replied on the email13:03
chkumar|ruckdmellado: long reply /me needs to read that13:04
dmelladochkumar|ruck: in any case, if by now you're not even running kuryr tests13:04
dmelladoyou can for now just not import the plugin, as the import is loaded by setuptools on the tempest plugin load ;)13:05
chkumar|ruckdmellado: we are runnning tempest list-plugins in tempest container to find dependency issue13:06
quiquell|roverchkumar|ruck: Do we really need the tempest-kuryr-plugin ? I mean do tripleo use kuryr ?13:06
dmelladochkumar|ruck: that was my guess, but if and I want to be explicit13:06
dmellado*for now*13:06
dmelladoyou don't even run kuryr tests at all13:07
chkumar|ruckdmellado: yes, we donot run13:07
dmelladothen the easiest way for this to be worked around would be to just remove kuryr tests for now13:07
dmelladoit'd only make sense in an environment where openstack + kubernetes/openshift is run13:07
dmellado+ kuryr is set as sdn in k8s cni13:07
chkumar|ruckdmellado: we need to make to sure all tempest plugin we ship should be installabale13:07
chkumar|ruckwithout import errors13:08
chkumar|ruckrunning is second part13:08
chkumar|ruckdmellado: for current situation is handled13:08
dmelladochkumar|ruck: I know, I know, but if you need to do a promotion13:08
chkumar|ruckdmellado: regaridng packaging openshift package, we donot need to worrry about, it is suppose to come from openshift13:08
dmelladothat'd be an option13:08
dmelladoI'd do13:08
chkumar|ruckdmellado: we will get the promotion13:09
dmellado1) either keep the pin for now13:09
dmelladoand wait for python-openshift package13:09
dmellado2) drop kuryr-tempest-plugin for now13:09
dmelladoso up to you folks!13:09
quiquell|roverchkumar|ruck, dmellado: If we see that RPM openshift-python take too much we can remove the plugin from the list13:09
chkumar|ruckdmellado: mere bhaia https://review.rdoproject.org/r/16202 and https://review.rdoproject.org/r/16206 merged13:09
*** panda|ptg has joined #oooq13:09
dmelladochkumar|ruck: got it13:10
chkumar|ruckquiquell|rover: we donot need to worry about openshit rpm package13:10
dmelladoin any case IIRC there wasn't even a python-openshift package done over fedora13:10
dmelladoso you might need to bootstrap one13:10
quiquell|roverchkumar|ruck: Nah pin is ok, let's just wait for the RPM13:14
chkumar|ruckquiquell|rover: yup13:15
quiquell|roverchkumar|ruck: At the end we are not even using kuryr so we don't care about new versions13:15
quiquell|roverchkumar|ruck: At the moment of use it for suer the RPM is there13:15
*** yolanda has quit IRC13:29
*** toure|gone is now known as toure13:30
chkumar|ruckquiquell|rover: I am leaving see ya tomorrow13:32
quiquell|roverchkumar|ruck: see you man I leave soon too13:32
quiquell|roverchkumar|ruck: Let's see if we have a promotion tomorrow13:32
weshayquiquell|rover, anything I can do for you?13:32
chkumar|ruckyup13:32
chkumar|ruckfingers crossed13:32
weshayhowdy13:32
weshaychkumar|ruck, thanks for holding the fort :)13:33
quiquell|roverweshay: Hello there, some review power give me a minute to paste some13:33
weshayquiquell|rover, aye... I saw some notes in trello13:33
chkumar|ruckquiquell|rover: http://zuul.openstack.org/builds.html?job_name=tripleo-ci-centos-7-scenario004-multinode-oooq-container this job is ting out too much13:34
chkumar|rucksorry for weshay ^^13:34
*** agopi has quit IRC13:36
quiquell|roverchkumar|ruck, weshay: looks like tripleo-container-image-prepare task increase in time13:37
weshaychkumar|ruck, hrm.. timeouts suck13:37
weshayquiquell|rover, hrm.. k steve baker is here13:37
*** bogdando has quit IRC13:37
quiquell|roverat undercloud install, but overcloud increases too, very difficult to diagnose13:37
quiquell|roverweshay: maybe there are some changes in the prepare script or in the kolla dockerfiles that affects it13:38
weshayk.. I'll take a look in a bit13:38
*** jaganathan has quit IRC13:39
quiquell|roverweshay: I also found some 100% CPU utilizatoin at extras/docker starting rabbitmq13:39
quiquell|roverweshay: Don't find the log now13:39
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (2 more messages)13:40
weshayquiquell|rover, chkumar|ruck looks like scen04 is failing in tempest13:40
weshayhttp://cistatus.tripleo.org/13:40
*** bogdando has joined #oooq13:40
quiquell|roverweshay: http://logs.openstack.org/31/591731/3/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/4701c03/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz13:40
quiquell|roverweshay: Yep, this is regarding the manila issue, we didn't have a promotion so we didn't have the plugin updated13:41
weshayk13:41
weshaywill look at pomotion jobs in a bit13:41
quiquell|roverweshay: There were a RDO outage this morning and a github issue in the promotions now...13:41
myoungrascasoft: are you unstuck / unblocked w.r.t. rdo2/osp0, and executor/slaves at this point?13:42
rascasofthey myoung didn't check today but yesterday things seemed fine13:42
myoungrascasoft: ack, great13:42
quiquell|roverweshay: we need this review to be merge so we remove the github dep from build-test-package https://review.openstack.org/60160113:42
* weshay looks13:43
*** yolanda has joined #oooq13:45
weshayquiquell|rover, how sure are we about those new urls?13:46
quiquell|roverweshay: They clone13:47
quiquell|roverweshay: and they are in the .gitreview13:47
weshayquiquell|rover, what lp is that bug fixing?13:47
weshaysorry.. what lp is that review fixing?13:47
weshayah. .see the topic13:47
quiquell|roveryep13:48
weshayquiquell|rover, can you update the commit message please13:48
weshayrelated-bug13:48
weshayor closes-bug13:48
quiquell|roverAdded13:49
quiquell|roverweshay: review power for https://review.openstack.org/#/c/601248/ and https://review.openstack.org/#/c/600730/13:49
*** leifmadsen has joined #oooq13:50
quiquell|roverweshay: about timeout mandre say something about https://github.com/openstack/tripleo-common/commit/699d5002ccf43f8f20594116b9e5e0ea3b2d6d1813:51
quiquell|roverweshay: I though this was suspicious https://github.com/openstack/kolla/commit/27bab79096584b50947f0d81d41ad2e143c1041e#diff-2dff6e61179a7288370fd4023369c74013:51
quiquell|roverTaking more time using https13:51
quiquell|roverweshay: We also have POST_FAILURES that are timeouts at collection logs13:52
quiquell|rovereven with post timeout increased to 40m13:52
*** dtantsur|brb is now known as dtantsur14:03
weshayquiquell|rover, throw a retry on14:09
weshay- name: Fetch local rdoinfo copy14:09
weshay  git:14:09
weshay    repo: '{{ artg_rdoinfo_repo_url }}'14:09
weshay    dest: '{{ build_repo_dir }}/DLRN/rdoinfo'14:09
weshay    version: 'master'14:09
weshayquiquell|rover, http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/build-test-packages/tasks/main.yml#n8014:09
weshayquiquell|rover, make sense?14:10
quiquell|roverweshay: use mirror would be a best option, retry don't work on downtime14:11
*** yolanda has quit IRC14:11
weshaysec14:13
quiquell|roverweshay: going to add the retry though14:15
weshayquiquell|rover, please do.. yes we need a mirror but we don't control that14:16
weshayquiquell|rover, bbi 514:16
quiquell|roverweshay: ok added retries, leavining now, let's see if we have a promotion tomorrow14:19
quiquell|roverweshay: One more thing fs020 is disable at queens promotion criteria14:21
*** jtomasek has joined #oooq14:26
panda|ptgquiquell|rover: can you paste again you review number ?14:36
weshaypanda|ptg, https://review.openstack.org/#/c/601601/4/roles/build-test-packages/tasks/main.yml14:38
weshayquiquell|rover, anything else you need help w/?14:46
*** quiquell|rover has quit IRC14:49
*** yolanda has joined #oooq14:49
*** zul has joined #oooq14:53
*** tosky_ has joined #oooq15:01
*** jaosorior has joined #oooq15:07
*** holser|ptg has joined #oooq15:15
*** jaosorior has quit IRC15:19
*** chem has joined #oooq15:19
*** thrash|g0ne is now known as thrash|ptg15:22
*** agopi has joined #oooq15:27
*** jtomasek has quit IRC15:31
*** kopecmartin has joined #oooq15:32
*** tosky_ is now known as tosky15:36
panda|ptgweshay: where are you ? I have questions on the standalone job.15:38
*** jaosorior has joined #oooq15:39
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (2 more messages)15:40
arxcruz|ptgykarel: around ?15:43
ykarelarxcruz|ptg, yes15:43
arxcruz|ptgpanda|ptg: we are in the big thompson room15:44
arxcruz|ptgykarel: did you saw my patch for stackviz ?15:44
ykarelarxcruz|ptg, not reviewed yet, will check that tomorrow15:44
panda|ptgarxcruz|ptg: I prefer the Garand M115:44
arxcruz|ptgykarel: so, i wondering do i need to add the logic for fedora? some packages are dependency broken15:45
arxcruz|ptgpanda|ptg: ¯\_(ツ)_/¯15:45
ykarelarxcruz|ptg, yes good to add support for fedora as well, as we are transitioning to fedora15:46
arxcruz|ptgykarel: ok... i'll see how to do it15:47
*** jtomasek has joined #oooq15:47
chkumar|ruckarxcruz|ptg: same for me15:53
arxcruz|ptgchkumar|ruck: same what?15:53
chkumar|ruckarxcruz|ptg: have not got a chance to look at the stackviz package15:54
arxcruz|ptgchkumar|ruck: problem is testrepository is broken on fedora15:54
arxcruz|ptgit depends on pacakges that doesn't exist ...15:54
*** thrash|ptg has quit IRC16:04
*** ykarel is now known as ykarel|away16:05
*** jrist has joined #oooq16:05
*** jaosorior has quit IRC16:08
*** yolanda has quit IRC16:08
*** agopi has quit IRC16:09
*** yolanda has joined #oooq16:10
weshaypanda|ptg, big thompson16:12
*** gkadam_ has quit IRC16:13
*** jaganathan has joined #oooq16:20
*** Goneri has joined #oooq16:21
*** bogdando has quit IRC16:32
*** jrist has quit IRC16:33
*** jrist has joined #oooq16:34
*** holser|ptg has quit IRC16:37
*** sshnaidm has joined #oooq16:38
*** chem has quit IRC16:40
*** holser|ptg has joined #oooq17:01
*** chem has joined #oooq17:02
*** chem has quit IRC17:05
*** chem has joined #oooq17:05
*** chem has quit IRC17:14
*** sshnaidm has quit IRC17:14
*** yolanda has quit IRC17:14
*** jaosorior has joined #oooq17:39
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy- (1 more message)17:40
weshaymarios, seconds)17:40
weshay* Disconnected ()17:40
weshaymarios, https://bugs.launchpad.net/tripleo/+bug/179133217:41
openstackLaunchpad bug 1791332 in tripleo "[CI] New image prepare workflow is incompatible with updates and upgrades" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:41
mariosweshay: thanks17:43
*** jaosorior has quit IRC17:44
chkumar|ruckweshay: we are hitting multiple node_failures on rdo third party jobs17:54
weshaychkumar|ruck, thank you.. the admins in rhos-ops are working to clean up the cloud17:54
weshaychkumar|ruck, don't stress /me looks at rdo-cloud17:55
weshaychkumar|ruck,17:55
weshayA quick email to notify you of an outage on RDO-Cloud.17:55
weshayDate:17:55
weshay2018-09-1117:55
weshayTime:17:55
weshay8:00 AM IST17:55
weshayPerformed By:17:55
weshayChaitanya Shastri17:55
chkumar|ruckweshay: it was the email from morning, RDO cloud was restarted, all were back in normal state17:56
chkumar|ruckstarted happening in last 1 hour17:56
weshaychkumar|ruck, ok llolz18:02
weshaydang it18:02
*** zul has quit IRC18:02
*** agopi has joined #oooq18:02
chkumar|ruckToday was a bad day, timedout and outage from rdo-cloud and github18:03
chkumar|ruckweshay: few more logs from github timedout http://logs.openstack.org/55/599355/9/check/tripleo-ci-centos-7-containers-multinode-pike/76c841e/job-output.txt.gz#_2018-09-11_15_22_39_83339318:07
weshaychkumar|ruck, did alan or someone from infra tell us to use the sf repo > github?18:08
weshaypanda|ptg, ^18:08
weshaychkumar|ruck, we are wondering why the sf repo would be more reliable than the github repo18:08
chkumar|ruckweshay: I spoke about this during CIX call, so we filed a bug18:08
chkumar|ruckwe need to tackle it18:08
chkumar|ruckweshay: logs from #rdo channel discussion on same http://eavesdrop.openstack.org/irclogs/%23rdo/%23rdo.2018-09-11.log.html#t2018-09-11T13:55:3618:09
panda|ptgweshay: I think the last thing he said to me was: "RUN , YOU FOOLS"18:10
*** dtantsur is now known as dtantsur|afk18:11
*** dtrainor__ has joined #oooq18:16
*** dtrainor_ has quit IRC18:18
*** jtomasek has quit IRC18:23
*** ykarel|away has quit IRC18:24
chkumar|ruckarxcruz|ptg++ tosky++ kopecmartin++ Thanks a lot for leading adoption of python-tempestconf much appreciated :-)18:24
hubbot1chkumar|ruck: arxcruz|ptg's karma is now 118:24
hubbot1chkumar|ruck: tosky's karma is now 218:24
hubbot1chkumar|ruck: kopecmartin's karma is now 318:24
*** holser|ptg has quit IRC18:25
*** panda|ptg has quit IRC18:26
*** jrist has quit IRC18:27
*** tosky has quit IRC18:29
*** kopecmartin has quit IRC18:29
*** ccamacho has quit IRC18:39
*** jaganathan has quit IRC18:58
*** agopi is now known as agopi|brb19:09
*** agopi|brb has quit IRC19:14
*** panda|ptg has joined #oooq19:27
panda|ptgweshay: in ballroom B again, working on that patch.19:27
*** kopecmartin has joined #oooq19:35
*** jrist has joined #oooq19:35
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci- (2 more messages)19:40
*** jtomasek has joined #oooq19:40
*** zul has joined #oooq19:43
*** rootameen has joined #oooq19:56
*** dtrainor__ has quit IRC20:00
*** nottypenguin has joined #oooq20:01
*** nottypenguin has quit IRC20:03
panda|ptgweshay: marios check if you agree with the approach https://review.openstack.org/60160120:04
*** rootameen has quit IRC20:05
weshay- block:20:05
weshay    - name: Fetch local rdoinfo copy20:05
weshay      git:20:05
weshay        repo: '{{ artg_rdoinfo_repo_url }}'20:05
weshay        dest: '{{ build_repo_dir }}/DLRN/rdoinfo'20:05
weshay        version: 'master'20:05
weshay      register: result20:05
weshay      until: not result|failed20:05
weshay      retries: 1020:05
*** rootameen has joined #oooq20:05
weshay      delay: 520:05
weshay  rescue:20:05
weshay    - name: Fetch local rdoinfo copy from fallback host if needed20:05
weshay      git:20:05
weshay        repo: '{{ fallback_url[artg_rdoinfo_repo_url] }}'20:05
weshay        dest: '{{ build_repo_dir }}/DLRN/rdoinfo'20:06
weshay        version: 'master'20:06
weshay      register: result20:06
weshay      until: not result|failed20:06
weshay      retries: 1020:06
weshay      delay: 520:06
panda|ptgI'm tempted to kick you for flooding :)20:06
weshay      failed_when: fallback_url[artg_rdoinfo_repo_url] is not defined20:06
weshaypanda|ptg, that looks exactly like what we discussed and seems ok to me..20:06
weshaylol20:06
panda|ptgyep and I don't like ignore_errors at all, it's only block rescue from now on.20:06
weshaypanda|ptg, ya.. +1 to rescue20:08
rootameenhey guys, could someone point me to the new documentation for rocky that doesn't require an undercloud on AIOs?20:08
weshayrootameen, standalone?20:08
rootameenweshay, yep20:09
weshayhttp://tripleo.org/install/containers_deployment/standalone.html?highlight=standalone20:09
rootameenawesome, thanks!20:10
*** holser|ptg has joined #oooq20:11
*** holser|ptg has quit IRC20:11
*** holser|ptg has joined #oooq20:12
weshaypanda|ptg, you want to go through stand alone f28 work w/ me ?20:16
weshaywe're in the lobby20:16
panda|ptgweshay: sure, coming20:17
*** jtomasek has quit IRC20:20
*** jtomasek has joined #oooq20:27
*** agopi|brb has joined #oooq20:28
arxcruz|ptgchkumar|ruck: still around ?20:28
*** tosky has joined #oooq20:30
*** jaosorior has joined #oooq20:46
*** dtrainor has joined #oooq21:15
*** jtomasek has quit IRC21:31
*** holser|ptg has quit IRC21:32
*** sshnaidm has joined #oooq21:34
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci- (2 more messages)21:40
*** jtomasek has joined #oooq21:47
*** jtomasek has quit IRC21:48
*** zul has quit IRC21:48
*** agopi|brb has quit IRC22:08
*** jtomasek has joined #oooq22:12
*** agopi|brb has joined #oooq22:13
*** zul has joined #oooq22:17
*** chuck_ has joined #oooq22:19
*** zul has quit IRC22:20
*** holser|ptg has joined #oooq22:32
*** rootameen has quit IRC22:40
*** jtomasek has quit IRC22:47
*** kopecmartin has quit IRC22:50
*** tosky has quit IRC22:53
*** panda|ptg has quit IRC22:53
*** jaosorior has quit IRC23:02
*** jrist has quit IRC23:15
*** holser|ptg has quit IRC23:20
*** d0ugal has quit IRC23:29
*** sshnaidm has quit IRC23:31
*** d0ugal has joined #oooq23:39
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci- (2 more messages)23:40
*** sshnaidm has joined #oooq23:40
*** sshnaidm is now known as sshnaidm|afk23:40
*** chuck_ has quit IRC23:45
« Monday, 2018-09-10 Index Wednesday, 2018-09-12 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!