| *** dougbtv_ has joined #oooq | 00:27 | |
| *** dougbtv has quit IRC | 00:30 | |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:52 |
|---|---|---|
| *** yolanda_ has joined #oooq | 01:05 | |
| *** yolanda has quit IRC | 01:08 | |
| *** yolanda has joined #oooq | 01:09 | |
| *** yolanda_ has quit IRC | 01:11 | |
| *** yolanda_ has joined #oooq | 01:13 | |
| *** yolanda has quit IRC | 01:16 | |
| *** yolanda__ has joined #oooq | 01:19 | |
| *** yolanda_ has quit IRC | 01:22 | |
| *** rlandy has quit IRC | 01:33 | |
| *** links has joined #oooq | 02:30 | |
| *** links has quit IRC | 02:30 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: openstack-tox-linters @ https://review.openstack.org/560445 | 02:52 |
| *** skramaja has joined #oooq | 03:43 | |
| *** udesale has joined #oooq | 03:53 | |
| *** jaganathan has joined #oooq | 04:39 | |
| *** brault has joined #oooq | 04:52 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445 | 04:52 |
| *** ykarel has joined #oooq | 05:00 | |
| *** jbadiapa has quit IRC | 05:17 | |
| *** bogdando has joined #oooq | 05:21 | |
| *** ratailor has joined #oooq | 05:27 | |
| *** pgadiya has joined #oooq | 05:36 | |
| *** pgadiya has quit IRC | 05:36 | |
| *** quiquell|off is now known as quiquell|rover | 05:37 | |
| *** waleedm has joined #oooq | 05:42 | |
| *** quiquell|rover is now known as quique|rover|bbl | 05:45 | |
| *** openstackstatus has quit IRC | 05:51 | |
| *** openstackstatus has joined #oooq | 05:51 | |
| *** yolanda__ is now known as yolanda | 05:59 | |
| *** quique|rover|bbl is now known as quiquell|rover | 06:10 | |
| *** quiquell|rover is now known as quique|rover|afk | 06:17 | |
| *** ccamacho has quit IRC | 06:29 | |
| *** saneax has joined #oooq | 06:30 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445 | 06:52 |
| *** quique|rover|afk is now known as quiquell|rover | 06:53 | |
| *** agopi has quit IRC | 06:56 | |
| *** tesseract has joined #oooq | 07:11 | |
| *** jbadiapa has joined #oooq | 07:17 | |
| *** amoralej|off is now known as amoralej | 07:26 | |
| *** yolanda_ has joined #oooq | 07:35 | |
| *** agopi has joined #oooq | 07:36 | |
| *** yolanda is now known as Guest63448 | 07:37 | |
| *** yolanda_ is now known as yolanda | 07:37 | |
| *** Guest63448 has quit IRC | 07:38 | |
| *** ccamacho has joined #oooq | 07:41 | |
| *** gkadam has joined #oooq | 07:56 | |
| *** tosky has joined #oooq | 07:58 | |
| *** brault has quit IRC | 08:03 | |
| *** ykarel is now known as ykarel|lunch | 08:03 | |
| *** brault has joined #oooq | 08:04 | |
| *** d0ugal has joined #oooq | 08:08 | |
| *** sshnaidm is now known as sshnaidm|afk | 08:09 | |
| *** holser_ has joined #oooq | 08:10 | |
| *** kopecmartin has joined #oooq | 08:13 | |
| *** holser_ has quit IRC | 08:20 | |
| *** matbu has quit IRC | 08:27 | |
| *** matbu has joined #oooq | 08:34 | |
| *** holser_ has joined #oooq | 08:35 | |
| hubbot | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:52 |
| *** saneax has quit IRC | 09:07 | |
| *** saneax has joined #oooq | 09:08 | |
| *** d0ugal has quit IRC | 09:16 | |
| *** d0ugal has joined #oooq | 09:17 | |
| *** ykarel|lunch is now known as ykarel | 09:23 | |
| *** zoli is now known as zoli|lunch | 09:34 | |
| *** gkadam has quit IRC | 09:46 | |
| *** gkadam has joined #oooq | 09:47 | |
| *** dtantsur|afk is now known as dtantsur | 09:49 | |
| ykarel | quiquell|rover, queens containers build passed after qpid changes | 10:17 |
| ykarel | other jobs running, let's see how those goes | 10:17 |
| quiquell|rover | ykarel: Found something about ironic | 10:18 |
| ykarel | quiquell|rover, Good | 10:19 |
| ykarel | what's that? | 10:19 |
| quiquell|rover | ykarel: Going to try a review, directory /var/lib/ironic/httpboot has no permisions | 10:19 |
| quiquell|rover | ykarel: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/5be41b4/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-06-22_14_21_34_399 | 10:20 |
| ykarel | quiquell|rover, but i have seen this earlier also, is this the cause? | 10:20 |
| *** gkadam has quit IRC | 10:20 | |
| quiquell|rover | ykarel: I know is everywhere, but maybe now we are really using the directory | 10:20 |
| *** gkadam has joined #oooq | 10:21 | |
| quiquell|rover | ykarel: After the erro I see "topped RPC server for service ironic.conductor_manager on host undercloud.localdomain." | 10:21 |
| quiquell|rover | ykarel: And the problem is ironic not being able to do an introspection | 10:21 |
| ykarel | but if u look the error is at very beginning, so doesn't seem this is the issue, | 10:21 |
| quiquell|rover | is the only ironic error I see | 10:21 |
| ykarel | hmm the issue is ironic specific | 10:21 |
| ykarel | quiquell|rover, i see this error in fs001 also, but there overcloud-prep-images is passing | 10:23 |
| ykarel | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/8814bdf/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-06-28_00_08_42_599 | 10:23 |
| ykarel | so good to find why seeing only in fs002 and fs020 and not in fs001 | 10:23 |
| quiquell|rover | ykarel: Last passing build has no containers https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/033c6ec/undercloud/var/log/ | 10:24 |
| ykarel | yup | 10:24 |
| ykarel | it started after switching to containerized | 10:24 |
| ykarel | but we missed seeing fs020, and focused only on idempotency part | 10:24 |
| quiquell|rover | ykarel: I would say to try to fix it, and see what happends | 10:24 |
| quiquell|rover | ykarel: And also a lot of time without promotions so we miss broken stuff | 10:25 |
| quiquell|rover | :-/ | 10:25 |
| ykarel | yes , anyway permission issue needs to be fixed | 10:25 |
| quiquell|rover | ykarel: Let me try | 10:25 |
| quiquell|rover | ykarel: Doesn't look difficult | 10:25 |
| ykarel | ack, did you get why it's not happening in fs001 | 10:26 |
| * quiquell|rover comparing | 10:28 | |
| *** apetrich has quit IRC | 10:30 | |
| *** udesale has quit IRC | 10:32 | |
| ykarel | from today fs002 is almost same as fs001, so let's see how next run goes | 10:34 |
| ykarel | next/current | 10:34 |
| quiquell|rover | ykarel: The only differnt is to_build and now the idempotency | 10:34 |
| quiquell|rover | uc idempotency | 10:34 |
| ykarel | hmm, if it passes in current run then should see fs020 | 10:35 |
| ykarel | and see how current run goes | 10:35 |
| quiquell|rover | humm to_build can recreate the IPA image | 10:36 |
| quiquell|rover | I think | 10:36 |
| quiquell|rover | ykarel: So maybe it's contucting a bad IPA image that is unable to start the nodes | 10:37 |
| quiquell|rover | ykarel: I am reproducing it already will try without to_build | 10:37 |
| ykarel | hmm, but fs020 don't have it, but we are seeing there as well | 10:37 |
| quiquell|rover | ykarel: Then I am lost... | 10:38 |
| quiquell|rover | ykarel: We will have a live system in a few to do some investigations | 10:39 |
| ykarel | ack | 10:39 |
| quiquell|rover | will be able to look at startup logs of baremetal nodes | 10:39 |
| quiquell|rover | Pufff another stuff blocking at checks... | 10:41 |
| quiquell|rover | That's impossible :-( | 10:41 |
| ykarel | :( | 10:47 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445 | 10:52 |
| *** zoli|lunch is now known as zoli | 10:55 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:58 | |
| *** apetrich has joined #oooq | 11:11 | |
| *** marios has quit IRC | 11:30 | |
| *** marios has joined #oooq | 11:30 | |
| *** dtantsur is now known as dtantsur|brb | 11:32 | |
| *** agopi has quit IRC | 11:34 | |
| *** amoralej is now known as amoralej|lunch | 11:54 | |
| quiquell|rover | sshnaidm: You there ? | 12:04 |
| sshnaidm | quiquell|rover, yes | 12:04 |
| quiquell|rover | What's the difference between this releases files ? | 12:05 |
| quiquell|rover | master.yml and promotion-testing-hash-master.yml | 12:05 |
| sshnaidm | first is for jobs, seconds - for promotions | 12:09 |
| sshnaidm | quiquell|rover, they are different because we use temporary hash "tripleo-ci-testing" for job repo in promotion | 12:09 |
| sshnaidm | quiquell|rover, btw, commented on https://review.rdoproject.org/r/#/c/14507 | 12:09 |
| quiquell|rover | sshnaidm: So we still need to use the promotion-testing-hash- ones for the periodic jobs ? | 12:10 |
| sshnaidm | quiquell|rover, why "still"? we do use them | 12:10 |
| quiquell|rover | sshnaidm: is broken, we use master.yml | 12:11 |
| quiquell|rover | sshnaidm: I am going to fix it, but need to know | 12:11 |
| sshnaidm | quiquell|rover, doesn't it work? https://github.com/openstack-infra/tripleo-ci/blob/c605fd193f35aee1ddbe7ae08dc054d98d84d4f7/toci_gate_test.sh#L184 | 12:12 |
| quiquell|rover | sshnaidm: give me a fiew | 12:12 |
| *** rlandy has joined #oooq | 12:13 | |
| sshnaidm | quiquell|rover, do you have log of periodic job? | 12:14 |
| ykarel | sshnaidm, accidently master.yml is used in fs010 promotion job, others are find | 12:16 |
| ykarel | fine | 12:16 |
| quiquell|rover | ykarel, sshnaidm: working a review for that | 12:16 |
| ykarel | sshnaidm, btw job link:- https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/389/consoleText | 12:17 |
| sshnaidm | quiquell|rover, what is the problem? it uses promotion-testing-hash-master.yml - https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/a0b5b9e/console.txt.gz#_2018-06-28_10_12_39_297 | 12:20 |
| quiquell|rover | sshnaidm: We need to specify the periodic into the new emit releases | 12:22 |
| sshnaidm | quiquell|rover, oh, I see.. only first playbook uses promotion release file | 12:22 |
| quiquell|rover | sshnaidm: Yep let me implement it, and give you the review | 12:22 |
| quiquell|rover | sshnaidm: Do we have periodics with oc upgrade ? | 12:26 |
| sshnaidm | quiquell|rover, could be | 12:26 |
| quiquell|rover | those would use master-undercloud-queens-overcloud.yml and the like | 12:27 |
| rlandy | panda|bike: will miss scrum - will be afk for an hour | 12:27 |
| *** trown|outtypewww is now known as trown | 12:28 | |
| *** kopecmartin has quit IRC | 12:28 | |
| panda|bike | rlandy: ok | 12:30 |
| *** panda|bike is now known as panda | 12:30 | |
| quiquell|rover | rlandy, sshnaidm, weshay|ruck: To unlock gates https://review.openstack.org/#/c/578776/ | 12:30 |
| weshay|ruck | python-tripleo-common? | 12:32 |
| ykarel | quiquell|rover, currently it's unblocked by revert of the patch that caused issue:- https://review.rdoproject.org/r/#/c/14514/ | 12:32 |
| ykarel | weshay|ruck, issue was caused by https://review.rdoproject.org/r/#/c/14232/ | 12:32 |
| ykarel | it added python2-tripleo-common | 12:32 |
| * weshay|ruck looks | 12:33 | |
| weshay|ruck | ohh.. I see | 12:33 |
| quiquell|rover | ykarel: we can live with the revert ? | 12:33 |
| weshay|ruck | ykarel, was this announced on a list or anything? | 12:34 |
| ykarel | weshay|ruck, i don't think so | 12:34 |
| weshay|ruck | ykarel, not in the rdo minutes | 12:35 |
| quiquell|rover | ykarel: The review will not break anything and we will be prepare for the un-revert | 12:35 |
| weshay|ruck | ykarel, k.. just feedback.. it helps if there is a heads up on these kinds of changes. | 12:35 |
| ykarel | weshay|ruck, yup agree | 12:35 |
| weshay|ruck | it's not a big deal.. thanks for explaining it | 12:35 |
| ykarel | quiquell|rover, ack | 12:36 |
| *** agopi has joined #oooq | 12:37 | |
| *** ratailor has quit IRC | 12:37 | |
| sshnaidm | weshay|ruck, please unset +w | 12:38 |
| *** apetrich has quit IRC | 12:38 | |
| *** kopecmartin has joined #oooq | 12:38 | |
| sshnaidm | quiquell|rover, we need to add this to promotion and consistent repos too, right? | 12:38 |
| weshay|ruck | sshnaidm, not to the promotion | 12:39 |
| weshay|ruck | they would get it automatically no? | 12:39 |
| *** rlandy is now known as rlandy|afk | 12:40 | |
| sshnaidm | oh, right | 12:41 |
| sshnaidm | is it for master only? | 12:41 |
| *** waleedm has quit IRC | 12:42 | |
| quiquell|rover | sshnaidm: Don't know if they are going to do a backport of that | 12:42 |
| *** waleedm has joined #oooq | 12:42 | |
| weshay|ruck | sshnaidm, you have a sec to chat w/ quiquell|rover and I re: ARA after the standup? | 12:44 |
| sshnaidm | weshay|ruck, sure | 12:44 |
| quiquell|rover | sshnaidm: looks like the diskcache has a 1gb limit by default | 12:47 |
| quiquell|rover | sshnaidm: This is not enough so we don't have to put expire ? | 12:47 |
| quiquell|rover | sshnaidm: Na, will add it always better to be explicit | 12:50 |
| sshnaidm | quiquell|rover, yeah, and this is /tmp, so I don't know how will be space there | 12:51 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:52 |
| quiquell|rover | sshnaidm: 3 days is good, let's explictily set i t | 12:52 |
| sshnaidm | quiquell|rover, great, thanks | 12:53 |
| quiquell|rover | sshnaidm: Nah thanks to you man | 12:53 |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/r/14507 | 12:53 |
| sshnaidm | quiquell|rover, cool, will test it today and merge | 12:54 |
| sshnaidm | quiquell|rover, please take a look at my patch too: https://review.rdoproject.org/r/#/c/14498/ | 12:54 |
| quiquell|rover | sshnaidm: We cannot run the RDO part at the RR server because credentials ? | 12:54 |
| quiquell|rover | sshnaidm: ack | 12:54 |
| sshnaidm | quiquell|rover, yep | 12:54 |
| quiquell|rover | sshnaidm: What's the ip ? | 12:55 |
| quiquell|rover | Ahh ok te-broker | 12:55 |
| sshnaidm | quiquell|rover, 38.145.34.41 | 12:55 |
| *** dtantsur|brb is now known as dtantsur | 12:55 | |
| quiquell|rover | sshnaidm: ack | 12:55 |
| panda | rfolco: are your jobs working by linking the repo dirs insteaf of copying then ? | 12:57 |
| panda | them | 12:57 |
| weshay|ruck | panda, rlandy|afk trown rfolco marios stand up in 2min | 12:58 |
| rfolco | panda, yes. ln -s and I am using src directly as the base workspace dir.... This is minor, if copy process is not taking too long, its ok. | 12:58 |
| panda | I'd prefer to remain seated. | 12:59 |
| weshay|ruck | yuk yuk yuk | 12:59 |
| weshay|ruck | arxcruz, do you have permissions to add me to the cal invite.. as a modifier? | 13:00 |
| panda | rfolco: centos-7 | ok: Runtime: 0:00:00.069971 | 13:01 |
| panda | rfolco: it takes a whole 6 centiseconds | 13:01 |
| *** myoung|pto has quit IRC | 13:03 | |
| *** myoung has joined #oooq | 13:04 | |
| rfolco | panda, ok, this is temp anyway | 13:05 |
| *** sanjay__u has quit IRC | 13:12 | |
| *** kopecmartin has quit IRC | 13:14 | |
| *** amoralej|lunch is now known as amoralej | 13:14 | |
| ykarel | amoralej, ZUUL ci issue fixed after adding project to sf rdo zuul config | 13:14 |
| ykarel | amoralej, can you now check https://review.rdoproject.org/r/#/c/14508/ | 13:15 |
| quiquell|rover | sshnaidm, weshay|ruck, ykarel: https://review.openstack.org/578793 to fix releease file | 13:15 |
| amoralej | ykarel, and where those projects were added to zuul config? | 13:15 |
| *** kopecmartin has joined #oooq | 13:15 | |
| ykarel | amoralej, https://softwarefactory-project.io/r/#/c/12800/ | 13:16 |
| amoralej | oh, good to know | 13:16 |
| amoralej | let's move to #rdo | 13:16 |
| ykarel | ack i pinged here by mistake :) | 13:16 |
| ykarel | quiquell|rover, ack | 13:17 |
| quiquell|rover | ykarel: Using the wrong release file, could have the effect to the instrospection issue ?= | 13:17 |
| *** quiquell|rover is now known as quique|rover|lch | 13:18 | |
| ykarel | quiquell|rover, i think that's something different | 13:18 |
| ykarel | quique|rover|lch, also all queens jobs except fs020(tempest failed) passed | 13:18 |
| ykarel | amoralej, ^^ weshay|ruck ^^ | 13:19 |
| *** agopi has quit IRC | 13:19 | |
| quique|rover|lch | ykarel: At least we are near to some promotions... let do it fast before other SH.. appears | 13:19 |
| ykarel | waiting for logs to see which tests failed | 13:19 |
| ykarel | yeah | 13:19 |
| amoralej | we were close | 13:20 |
| amoralej | let's see what tempest test failed | 13:20 |
| *** udesale has joined #oooq | 13:20 | |
| amoralej | ykarel, fs020 is promotion criteria en queens, right? | 13:20 |
| ykarel | yes | 13:20 |
| ykarel | but it's not run in any check job, so we skip it from promotion criteria sometime | 13:20 |
| *** saneax has quit IRC | 13:23 | |
| *** apetrich has joined #oooq | 13:39 | |
| weshay|ruck | quique|rover|lch, hey | 13:43 |
| panda | trown: https://en.wikipedia.org/wiki/Divide_and_conquer_algorithm | 13:43 |
| quique|rover|lch | weshay|ruck: | 13:43 |
| *** quique|rover|lch is now known as quiquell|rover | 13:43 | |
| trown | panda: ah ya I would get divide and conquer | 13:44 |
| weshay|ruck | quiquell|rover, sshnaidm https://bluejeans.com/u/whayutin/ | 13:44 |
| quiquell|rover | going | 13:44 |
| trown | I didnt lookup what impera means | 13:44 |
| *** gkadam has quit IRC | 13:46 | |
| *** tcw has joined #oooq | 13:47 | |
| *** tcw1 has quit IRC | 13:47 | |
| *** gkadam has joined #oooq | 13:49 | |
| *** rlandy|afk is now known as rlandy | 13:50 | |
| rfolco | sshnaidm, https://softwarefactory.usersys.redhat.com/r/#/c/125/ - This change depends on a change that failed to merge. | 13:53 |
| rfolco | sshnaidm, the upstream patch does not have merge conflicts | 13:53 |
| rfolco | sshnaidm, where am I newbie'ing ? | 13:53 |
| rlandy | panda: hi - could you fill me in for a few on what missed re: scrum? | 13:56 |
| rlandy | trown: lol - I had to google 'impera' yesterday as well | 13:56 |
| *** ykarel is now known as ykarel|afk | 13:59 | |
| panda | rlandy: trown so now you can understand how we feel most of the time. | 13:59 |
| panda | trown: I don't understand why we are not collecting any logs here http://logs.openstack.org/47/578447/9/check/tripleo-ci-centos-7-undercloud-oooq/15cd259/job-output.txt.gz | 14:00 |
| *** agopi has joined #oooq | 14:00 | |
| panda | trown: undercloud install fails, can't understand why | 14:00 |
| rfolco | sshnaidm, changed depends on patch anyway... job starting | 14:02 |
| panda | anyway, translated now, no more latin | 14:02 |
| rlandy | panda: a bit confused - all the cards were moved to complete but the reviews were not merged | 14:02 |
| rlandy | all included in yours? | 14:02 |
| rlandy | oh I see | 14:02 |
| panda | rlandy: yes, I forgot to Co-author on mine .. | 14:02 |
| rlandy | panda: np, I ma just trying to catch up and figure what is going on next - can chat when you have a moment | 14:03 |
| rlandy | am | 14:03 |
| panda | rlandy: now is ok, I'll be in my channel | 14:04 |
| *** ykarel|afk has quit IRC | 14:04 | |
| trown | panda: hmm... it was collecting logs before... | 14:04 |
| rlandy | joining | 14:04 |
| panda | trown: I had to change your patch a little, I inverted the quotes | 14:05 |
| panda | trown: otherwise $ENV_VARS was not resolved | 14:05 |
| trown | panda: ah right | 14:06 |
| trown | panda: still weird logs did not get collected when it failed there | 14:06 |
| quiquell|rover | sshnaidm: Have put some comments at the RDO stuff | 14:12 |
| sshnaidm | rfolco, I think it's because both patches deal with zuul jobs config | 14:14 |
| sshnaidm | rfolco, anyway, better to start from something simpler like you did | 14:15 |
| rfolco | sshnaidm, right, required: false now for tripleo-ci (depends-on patch)... talking to nhicher | 14:16 |
| *** apetrich has quit IRC | 14:16 | |
| sshnaidm | rfolco, maybe better to start with some patch that doesn't touch zuul config at all, just some code.. | 14:16 |
| rfolco | sshnaidm, ack | 14:19 |
| *** quiquell|rover is now known as quiquell|off | 14:21 | |
| quiquell|off | sshnaidm: Try to merge the RR stuff, forget about my comments so we keep going and I will also add a save of the dashboard | 14:24 |
| quiquell|off | Leave now | 14:24 |
| sshnaidm | quiquell|off, ack | 14:26 |
| *** lhinds has quit IRC | 14:27 | |
| *** rnoriega has quit IRC | 14:27 | |
| *** weshay|ruck has quit IRC | 14:27 | |
| *** jschlueter has quit IRC | 14:27 | |
| *** rnoriega has joined #oooq | 14:28 | |
| *** weshay has joined #oooq | 14:28 | |
| *** waleedm has quit IRC | 14:29 | |
| *** lhinds has joined #oooq | 14:31 | |
| *** jschlueter has joined #oooq | 14:31 | |
| *** weshay has quit IRC | 14:37 | |
| *** myoung has quit IRC | 14:37 | |
| *** rasca has quit IRC | 14:37 | |
| *** weshay has joined #oooq | 14:38 | |
| *** rasca has joined #oooq | 14:39 | |
| *** myoung has joined #oooq | 14:44 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 14:52 |
| *** bogdando has quit IRC | 15:06 | |
| weshay | rook, rlandy I think you guys want personal tenants.. not a project level tenant to start | 15:07 |
| weshay | rook and the ovb job will just use the tripleo-ci aggregate / tenant | 15:07 |
| weshay | kopecmartin, arxcruz sorry | 15:10 |
| weshay | got distracted.. need to standup or no? | 15:10 |
| kopecmartin | weshay, well, probably not, i was there alone | 15:11 |
| *** hamzy has quit IRC | 15:11 | |
| weshay | kopecmartin, k. /me checks doc patch | 15:11 |
| *** jaganathan has quit IRC | 15:11 | |
| kopecmartin | weshay, it got merged, even the other patch which fixed a few typos | 15:12 |
| kopecmartin | weshay, so i guess, we can move this card to complete https://trello.com/c/0sFajjCB/821-review-bugs-requested-by-martin-re-docs | 15:12 |
| *** jaganathan has joined #oooq | 15:12 | |
| *** skramaja_ has joined #oooq | 15:13 | |
| *** skramaja has quit IRC | 15:13 | |
| weshay | k.. cool | 15:14 |
| weshay | kopecmartin, and the bug is verified? | 15:18 |
| kopecmartin | weshay, the one about containerized tempest is verified, yes | 15:19 |
| weshay | thanks kopecmartin | 15:19 |
| weshay | kopecmartin, arxcruz I'll go through the cards today and see where you guys are at | 15:19 |
| weshay | please respond to any questions | 15:19 |
| weshay | in the cards | 15:20 |
| kopecmartin | sure | 15:20 |
| rlandy | weshay: rook and agopi need personal tenants for reproducers | 15:22 |
| agopi | ive sent in the request rlandy. | 15:32 |
| agopi | for rdo cloud. | 15:32 |
| agopi | requested an account as well ^ | 15:32 |
| rlandy | agopi: you had some questions on tuesday, anything you still want to address? | 15:33 |
| rlandy | did you manage to work with the reproducer? | 15:33 |
| rlandy | well, stupid question | 15:33 |
| rlandy | you'll need a tenant first :) | 15:33 |
| agopi | nothing specifically for now, will lyk if anything pops up. thanks rlandy | 15:34 |
| rlandy | agopi: sure - ping me when you get your tenant and we'll go through it | 15:34 |
| agopi | ack | 15:35 |
| weshay | agopi, so you requested a project level tenant | 15:40 |
| weshay | agopi, you need personal tenants | 15:40 |
| *** hamzy has joined #oooq | 15:40 | |
| weshay | agopi, rlandy and I will get your job up and running.. then we should consider how much more we want to do w/ ovb + browbeat.. | 15:40 |
| agopi | okay weshay will send a request for personal tenant too then. | 15:40 |
| rlandy | weshay: ack - can get started on that job tomorrow if ok by you | 15:41 |
| weshay | agopi, the rhosops guys think you want to split out the tripleo aggregate into tripleo-ci and perf.. that should not be the case.. at least not yet | 15:41 |
| weshay | rlandy, that is fine.. thank you | 15:41 |
| *** zoli is now known as zoli|gone | 15:43 | |
| *** zoli|gone is now known as zoli | 15:44 | |
| *** ykarel has joined #oooq | 15:45 | |
| *** kopecmartin has quit IRC | 15:45 | |
| weshay | panda, happy birthday! | 15:46 |
| agopi | no weshay, we'd like our job to run as part of tripleo-ci at least for now. not looking to split out. | 15:46 |
| weshay | cool.. ya.. I think that is the best idea atm.. get check jobs up, get a promotion job up .. and then evaluate | 15:47 |
| agopi | weshay++ | 15:47 |
| hubbot | agopi: weshay's karma is now 4 | 15:47 |
| panda | weshay: thanks. | 15:52 |
| weshay | rlandy, can I help w/ rhos-13? | 15:53 |
| rlandy | weshay: I am waiting on the response to our request for bigger flavors | 15:54 |
| rlandy | checking that ticket ... sec | 15:54 |
| rlandy | weshay: https://redhat.service-now.com/pnt?id=ticket&table=x_redha_pnt_devops_table&sys_id=deede177db321f00a9e306e2ca961993 is our request | 15:55 |
| weshay | rlandy, k.. thanks | 15:55 |
| rlandy | feel free to push on it with you manager power | 15:55 |
| rlandy | weshay: here is the poc job to move to fs001 ... | 15:56 |
| *** udesale has quit IRC | 15:56 | |
| weshay | lolz | 15:56 |
| rlandy | weshay: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tq-gate-rhos-13-ci-rhos-ovb-featureset001 | 15:56 |
| rlandy | you can work on it/edit it as you like | 15:56 |
| *** udesale has joined #oooq | 15:56 | |
| rlandy | you will need this review ... | 15:56 |
| rlandy | https://review.openstack.org/#/c/577230/ | 15:56 |
| rlandy | the ~/network-environment file is not possed to regular fs001 | 15:57 |
| rlandy | and it is need for ci-rhos | 15:57 |
| rlandy | weshay: other than that - we have seen deploys go as far as oevrcloud deploy and fail on 'no available hosts" | 15:58 |
| rlandy | also, we have seem some undercloud install errors | 15:58 |
| rlandy | some are pasisng ( rhos-13 issues) some may be space related | 15:58 |
| rlandy | we are working on a flavor with half the disk size | 15:58 |
| rlandy | weshay: that job runs on the stage tenant so you can mess with it w/o impacting the gates | 15:59 |
| rlandy | have fun! | 15:59 |
| weshay | rlandy, is it worth trying in the internal sf? | 15:59 |
| rlandy | weshay: definitely - if we can | 15:59 |
| rlandy | what access do we have there to cloud? | 15:59 |
| weshay | Support Target | 15:59 |
| weshay | Priority: Low | 15:59 |
| rlandy | do we have better flavors? | 15:59 |
| weshay | rfolco, ^ | 16:00 |
| weshay | rlandy, can you update the priority of that ticket? | 16:00 |
| weshay | I don't have the powa | 16:00 |
| rfolco | weshay, currently nodepool slaves in SF are identical to upstream (8GB) | 16:01 |
| rlandy | weshay: unfortunately, I am powerless there as well | 16:02 |
| rlandy | I tried to up the urgency | 16:02 |
| rfolco | weshay, max 10 servers | 16:02 |
| *** amoralej is now known as amoralej|off | 16:02 | |
| rlandy | but priority remained low | 16:02 |
| rlandy | I can't even edit my stupid spelling mistake on the title :( | 16:03 |
| rlandy | tnh - I am not sure how ci-rhos is useful to anyone with such small flavors | 16:05 |
| rlandy | containerized deployment | 16:05 |
| *** ccamacho has quit IRC | 16:09 | |
| *** panda is now known as panda|off | 16:12 | |
| *** ccamacho has joined #oooq | 16:14 | |
| *** d0ugal has quit IRC | 16:17 | |
| *** udesale has quit IRC | 16:31 | |
| *** tesseract has quit IRC | 16:38 | |
| *** apetrich has joined #oooq | 16:42 | |
| *** jbadiapa has quit IRC | 16:44 | |
| rlandy | panda|off: reproducer bailed out :( | 16:47 |
| *** trown is now known as trown|lunch | 16:49 | |
| *** dsneddon has quit IRC | 16:52 | |
| *** dsneddon has joined #oooq | 16:52 | |
| hubbot | FAILING CHECK JOBS on master: tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 16:52 |
| *** jaosorior has quit IRC | 17:10 | |
| *** gkadam has quit IRC | 17:15 | |
| *** ccamacho has quit IRC | 17:18 | |
| *** dtantsur is now known as dtantsur|afk | 17:22 | |
| *** skramaja has joined #oooq | 17:25 | |
| *** skramaja_ has quit IRC | 17:28 | |
| *** ykarel has quit IRC | 17:32 | |
| rlandy | oh because the changes are needed before the reproducer | 17:40 |
| *** trown|lunch has quit IRC | 17:50 | |
| *** trown has joined #oooq | 17:57 | |
| *** yolanda_ has joined #oooq | 18:25 | |
| *** yolanda has quit IRC | 18:27 | |
| *** rfolco is now known as rfolco_afk | 18:46 | |
| hubbot | FAILING CHECK JOBS on master: tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 18:52 |
| trown | weshay: thanks for sending that greasemonkey script ... pretty awesome. I found a hack to make gate queue show up too https://gist.github.com/mpeterson/bb351543c4abcca8e7bb1205fcea4c75 | 18:58 |
| weshay | oh cool | 18:59 |
| * weshay looks | 18:59 | |
| weshay | weird after changing it.. | 19:03 |
| weshay | a job running gate | 19:03 |
| weshay | I only see | 19:03 |
| weshay | Zuul checkStill running | 19:03 |
| weshay | trown, hrm.. odd.. setting queue_data[1] shows the gate | 19:10 |
| weshay | so.. you are saying if (queue.items_behind.length < 2){ | 19:11 |
| weshay | right? | 19:11 |
| rlandy | trown: I am testing out panda's POC sets of patches using the reproducer (not libvirt) ... multinode. The work to create zuul-hosts is required in both libvirt and multinode | 19:12 |
| weshay | meh.. /me looking at https://review.openstack.org/#/c/578776/ | 19:12 |
| rlandy | one is in tq and one in tqe | 19:12 |
| rlandy | think of moving that work to a new standalone role | 19:13 |
| rlandy | thinking | 19:13 |
| *** skramaja_ has joined #oooq | 19:15 | |
| *** skramaja has quit IRC | 19:18 | |
| trown | weshay: ya that is what I changed setting the items_behind.length so it loads | 19:20 |
| weshay | like so? (queue.items_behind.length < 2){ | 19:20 |
| weshay | trown, ^ | 19:20 |
| weshay | didn't work for me.. :( | 19:20 |
| trown | ya | 19:20 |
| trown | hmm | 19:20 |
| *** rfolco_afk is now known as rfolco | 19:20 | |
| weshay | if I set queue = data[i] | 19:20 |
| weshay | to queue = data[1] | 19:21 |
| weshay | I see the gate | 19:21 |
| weshay | tripleo-ci-centos-7-scenario000-multinode-oooq-container-updatesRUNNING (21%) | 19:21 |
| weshay | so it should work | 19:22 |
| weshay | trown, chrome or ff? | 19:22 |
| trown | weshay: ff | 19:22 |
| weshay | bet that's it | 19:23 |
| *** holser_ has quit IRC | 19:33 | |
| *** ssbarnea has quit IRC | 19:50 | |
| *** strattao has quit IRC | 19:51 | |
| *** ssbarnea[m] is now known as ssbarnea | 19:53 | |
| rook | rlandy weshay ack | 20:08 |
| weshay | ack ack ack | 20:08 |
| rook | I need to read through emails | 20:09 |
| rook | i saw agopi request his personal account | 20:09 |
| rook | but i also Kieran's ping on trello | 20:10 |
| rook | I honestly don't know the resources necessary | 20:10 |
| rook | do you have reocmmendations weshay ? | 20:10 |
| weshay | looking at mine | 20:11 |
| weshay | they didn't give me much | 20:11 |
| rlandy | imho, you don't need a specific project tenant - just a personal tenant with regular quotas | 20:12 |
| weshay | enough to run 1 env | 20:12 |
| weshay | 10 instance | 20:12 |
| weshay | 80 vcpu | 20:12 |
| weshay | 64gb ram | 20:12 |
| weshay | 10 flt | 20:12 |
| rook | so i want 11 instances, 81vcpus, 65Gb and 11flt | 20:12 |
| rook | :P | 20:12 |
| rook | just one more than wes | 20:12 |
| weshay | DOH | 20:12 |
| weshay | I'm always looosin | 20:13 |
| rook | :P | 20:14 |
| *** holser_ has joined #oooq | 20:31 | |
| *** d0ugal has joined #oooq | 20:39 | |
| rfolco | trown, good catch on primary node | 20:46 |
| rfolco | https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/zuul.d/nodesets.yaml#L149 | 20:46 |
| trown | rfolco: ya Im not positive about it... but worht a shot... odd that we get no logs and that seems plausible | 20:47 |
| rfolco | not having logs there is a good signal it did not match 'primary' node | 20:48 |
| hubbot | FAILING CHECK JOBS on master: tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 20:52 |
| *** d0ugal has quit IRC | 20:57 | |
| *** trown is now known as trown|outtypewww | 21:03 | |
| *** strattao has joined #oooq | 21:19 | |
| *** holser_ has quit IRC | 22:06 | |
| *** rlandy has quit IRC | 22:12 | |
| *** hamzy has quit IRC | 22:30 | |
| *** hamzy has joined #oooq | 22:30 | |
| *** hamzy has quit IRC | 22:35 | |
| *** holser_ has joined #oooq | 22:36 | |
| *** hamzy has joined #oooq | 22:37 | |
| *** holser_ has quit IRC | 22:38 | |
| hubbot | FAILING CHECK JOBS on master: tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 22:52 |
| *** tosky has quit IRC | 22:53 | |
| *** agopi has quit IRC | 22:58 | |
| *** yolanda__ has joined #oooq | 23:07 | |
| *** yolanda_ has quit IRC | 23:11 | |
| *** yolanda__ has quit IRC | 23:18 | |
| *** agopi has joined #oooq | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!