| *** rlandy has quit IRC | 00:10 | |
| *** ccamacho has quit IRC | 00:14 | |
| *** ccamacho has joined #oooq | 00:48 | |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 01:00 |
|---|---|---|
| *** jbadiapa has quit IRC | 01:08 | |
| *** jbadiapa has joined #oooq | 01:10 | |
| *** yolanda__ has joined #oooq | 01:33 | |
| *** yolanda_ has quit IRC | 01:36 | |
| *** ccamacho has quit IRC | 01:41 | |
| *** rodrigod` has joined #oooq | 02:18 | |
| *** dsneddon_ has joined #oooq | 02:19 | |
| *** rnoriega has quit IRC | 02:19 | |
| *** dsneddon has quit IRC | 02:19 | |
| *** jschlueter has quit IRC | 02:19 | |
| *** bandini has quit IRC | 02:19 | |
| *** rodrigods has quit IRC | 02:19 | |
| *** jaganathan has quit IRC | 02:19 | |
| *** jaganathan has joined #oooq | 02:19 | |
| *** rnoriega has joined #oooq | 02:20 | |
| *** bandini has joined #oooq | 02:25 | |
| *** yolanda_ has joined #oooq | 02:28 | |
| *** yolanda__ has quit IRC | 02:31 | |
| *** jschlueter has joined #oooq | 02:31 | |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 03:00 |
| *** ccamacho has joined #oooq | 03:18 | |
| *** udesale has joined #oooq | 03:48 | |
| *** ccamacho has quit IRC | 04:09 | |
| *** ykarel|away has joined #oooq | 04:24 | |
| *** saneax has quit IRC | 04:26 | |
| *** yolanda__ has joined #oooq | 04:46 | |
| *** yolanda_ has quit IRC | 04:49 | |
| *** brault has joined #oooq | 04:49 | |
| *** brault has quit IRC | 04:54 | |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ (1 more message) | 05:00 |
| *** ykarel|away is now known as ykarel | 05:21 | |
| *** links has joined #oooq | 05:22 | |
| *** pgadiya has joined #oooq | 05:22 | |
| *** pgadiya has quit IRC | 05:22 | |
| *** ratailor has joined #oooq | 05:32 | |
| *** quiquell|off is now known as quiquell | 05:33 | |
| *** bogdando has joined #oooq | 05:38 | |
| *** brault has joined #oooq | 05:45 | |
| *** skramaja has joined #oooq | 05:46 | |
| *** brault has quit IRC | 05:50 | |
| *** brault has joined #oooq | 05:51 | |
| *** jfrancoa has joined #oooq | 06:03 | |
| *** saneax has joined #oooq | 06:15 | |
| *** jtomasek has joined #oooq | 06:27 | |
| *** anande has joined #oooq | 06:30 | |
| *** hamzy has quit IRC | 06:31 | |
| *** yolanda_ has joined #oooq | 06:36 | |
| *** links has quit IRC | 06:38 | |
| *** yolanda__ has quit IRC | 06:39 | |
| *** ccamacho has joined #oooq | 06:50 | |
| *** links has joined #oooq | 06:53 | |
| chkumar|ruck | sshnaidm|rover: Good morning | 06:58 |
| sshnaidm|rover | chkumar|ruck, hi | 06:59 |
| chkumar|ruck | sshnaidm|rover: we are red because of this https://bugs.launchpad.net/tripleo/+bug/1780855 | 06:59 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 06:59 |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ (1 more message) | 07:00 |
| chkumar|ruck | sshnaidm|rover: https://bugs.launchpad.net/tripleo/+bug/1780910 | 07:01 |
| openstack | Launchpad bug 1780910 in tripleo "[pike][ocata][24 hrs][periodic]CREATE_FAILED ResourceInError: resources.CephStorage: Went to status ERROR due to "Message: No valid host was found. , Code: 500"" [Critical,Triaged] | 07:01 |
| chkumar|ruck | 24 hrs periodic jobs | 07:01 |
| *** holser_ has joined #oooq | 07:02 | |
| sshnaidm|rover | chkumar|ruck, about validations - which jobs are affected? | 07:02 |
| chkumar|ruck | sshnaidm|rover: https://bugs.launchpad.net/tripleo/+bug/1780855 | 07:02 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 07:02 |
| chkumar|ruck | second comment | 07:02 |
| chkumar|ruck | and 3rd also | 07:02 |
| chkumar|ruck | scenario-1 to 4 and 7 | 07:02 |
| sshnaidm|rover | chkumar|ruck, do you know about any patches of it? | 07:06 |
| chkumar|ruck | sshnaidm|rover: https://review.openstack.org/#/c/564204 got merged recently | 07:07 |
| chkumar|ruck | sshnaidm|rover: ykarel is checking on this https://review.openstack.org/#/c/581083/ | 07:07 |
| ykarel | chkumar|ruck, i can see jobs moving ahead in ^^ -oooq is at tempest | 07:08 |
| chkumar|ruck | ykarel: yup oooq-containers has passed | 07:09 |
| chkumar|ruck | ykarel: sorry excuting tempest | 07:09 |
| *** tesseract has joined #oooq | 07:13 | |
| chkumar|ruck | ykarel: what about triggering against testproject? | 07:21 |
| ykarel | chkumar|ruck, trying https://review.rdoproject.org/r/#/c/13943/ | 07:21 |
| chkumar|ruck | ykarel: thanks :-) | 07:22 |
| sshnaidm|rover | chkumar|ruck, I see jobs pass, so https://bugs.launchpad.net/tripleo/+bug/1780855 is solved? | 07:22 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 07:22 |
| chkumar|ruck | sshnaidm|rover: checking | 07:23 |
| chkumar|ruck | sshnaidm|rover: against this one https://review.openstack.org/581083 install the undercloud passed | 07:24 |
| chkumar|ruck | sshnaidm|rover: will we wait till the jobs finishes? | 07:24 |
| sshnaidm|rover | chkumar|ruck, I see last jobs pass in grafana | 07:25 |
| chkumar|ruck | sshnaidm|rover: removing promotion blocker once https://review.rdoproject.org/r/#/c/13943/ it passes | 07:25 |
| chkumar|ruck | sshnaidm|rover: ack | 07:25 |
| chkumar|ruck | sshnaidm|rover: let's mark it as solved then | 07:25 |
| sshnaidm|rover | chkumar|ruck, yep | 07:27 |
| *** hamzy has joined #oooq | 07:27 | |
| quiquell | marios: Can we add new cards to the sprint ? | 07:27 |
| marios | quiquell: i don't know i get the impression panda wants to do that ? or maybe at least cc/add him so he is aware? | 07:28 |
| quiquell | marios: Ok | 07:29 |
| chkumar|ruck | sshnaidm|rover: we need this https://review.openstack.org/#/c/581202/ to fix master everything | 07:32 |
| chkumar|ruck | instack undercloud job | 07:32 |
| *** ykarel is now known as ykarel|lunch | 07:36 | |
| sshnaidm|rover | chkumar|ruck, can we talk on one channel please? :) | 07:37 |
| chkumar|ruck | sshnaidm|rover: sure here | 07:37 |
| chkumar|ruck | sshnaidm|rover: sorry | 07:37 |
| sshnaidm|rover | chkumar|ruck, I'd like not to jump on 3 :) | 07:38 |
| *** kopecmartin has joined #oooq | 07:38 | |
| sshnaidm|rover | chkumar|ruck, usually all-tripleo things are discussed in #tripleo, like validations for example | 07:38 |
| sshnaidm|rover | chkumar|ruck, promotions are better here, rdo packaging issues - #rdo | 07:38 |
| chkumar|ruck | sshnaidm|rover: yup | 07:39 |
| sshnaidm|rover | chkumar|ruck, about secret issue - let's use the same bug, we already collected there a lot of them | 07:39 |
| *** tosky has joined #oooq | 07:39 | |
| *** links has quit IRC | 07:44 | |
| *** amoralej|off is now known as amoralej | 07:48 | |
| quiquell | marios: the test-testenv, would be the OVB counterpart of tripleo.sh --bootstrap-subnodes ? | 07:52 |
| quiquell | s/test-testenv/testenv-client/ | 07:52 |
| *** holser_ has quit IRC | 07:55 | |
| marios | quiquell: i haven't considered that. yesterday i was just trying to understand what that --bootstrap-subnodes does and lay out the parts that need transnferring with https://review.openstack.org/#/c/581026/ | 07:55 |
| marios | quiquell: reading testenv-client :) | 07:56 |
| quiquell | marios: Yep, doing similar exercise with this, will try to add a description and DoD | 07:56 |
| quiquell | marios: What I see is basically it use te-broker to startup nodes and run toci_quickstart.sh | 07:56 |
| quiquell | marios: Also outputs a file | 07:57 |
| *** links has joined #oooq | 07:57 | |
| chkumar|ruck | sshnaidm|rover: ykarel|lunch legacy-periodic-tripleo-centos-7-master-containers-build passed | 07:58 |
| quiquell | marios: mayeb this part has to run at run-v3.yaml | 07:58 |
| chkumar|ruck | from testproject | 07:58 |
| chkumar|ruck | https://review.rdoproject.org/r/#/c/13943/ | 07:58 |
| marios | quiquell: yeah so one of the unkowns was where the ansible would be invoked. yesterday i was playing with adding to toci_quickstart as we already have ansible there | 07:59 |
| marios | quiquell: but i wasn't sure | 07:59 |
| *** yolanda__ has joined #oooq | 07:59 | |
| *** yolanda__ is now known as yolanda | 07:59 | |
| *** yolanda_ has quit IRC | 08:02 | |
| quiquell | marios: I think it goes like this (just to try to understand this) | 08:04 |
| quiquell | marios: multinode, zuul gives you the nodes and you start to work at one subnode | 08:05 |
| *** anande has quit IRC | 08:05 | |
| quiquell | marios: ovb (only runs at RDO) you need to explicitly ask for nodes for the baremetal | 08:06 |
| quiquell | marios: so OVB, runs toci_gate_test at the slaves and toci_quickstart baremetals ? | 08:08 |
| quiquell | marios: No I am wrong, in OVB toci_quickstart.sh is run at slave too, but using TE_DATAFILE to know where to deploy | 08:11 |
| marios | quiquell: honestly i don't know i'd have to dig to have this conversationw ith you i didn't check the ovb stuff at all. am checking your https://review.openstack.org/#/c/580974/ just now i see what you meant about running in the run-v3.yaml | 08:16 |
| *** ykarel|lunch is now known as ykarel | 08:17 | |
| quiquell | marios: We have like tree big phases at zuulv3 | 08:18 |
| quiquell | marios: pre/run/post and we can hook there a playbook (more or less) | 08:18 |
| quiquell | marios: All of them run at zuul slaves | 08:18 |
| quiquell | marios: now we do everything at run step | 08:19 |
| quiquell | marios: It ends up runnig the install playbooks at the undercloud node | 08:19 |
| marios | quiquell: ack yea i am checking the zuul.d/base.yaml now (with the pre-run/run at https://github.com/openstack-infra/tripleo-ci/blob/76c0ab4f8be72bb4209925f9d0e28e2c50aa72d8/zuul.d/base.yaml#L28-L32 | 08:19 |
| marios | quiquell: (thanks this is helpful) | 08:20 |
| quiquell | marios: for me too, I think it like that | 08:20 |
| *** gkadam has joined #oooq | 08:20 | |
| quiquell | marios: Maybe you cask describe me the nodepool thing a little so we can comment on that | 08:22 |
| quiquell | marios: bootstrap-sunodes I mean | 08:23 |
| *** gkadam has quit IRC | 08:24 | |
| marios | quiquell: sure but i didn't dig into details yet i probably should iterate the skeleton (if i understood yetserday it is in scope and looking at your review just now i think it can fit into the end of that run-v3.yaml... its like the last step so we can remove the bash and add another task to include the role | 08:24 |
| marios | quiquell: so the main invocation is one of https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/bootstrap-overcloud-full-minimal.sh or https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/bootstrap-overcloud-full.sh | 08:25 |
| quiquell | marios: Yep, looking at code, a lot of devops code there, perfect for ansible | 08:25 |
| marios | quiquell: yeah so they both basically do dependencies first | 08:26 |
| *** holser_ has joined #oooq | 08:26 | |
| quiquell | marios: Also TOCI_JOBTYPE is involve | 08:26 |
| *** sshnaidm|rover has quit IRC | 08:26 | |
| *** anande has joined #oooq | 08:27 | |
| marios | quiquell: so that is the 'main' bootstrap bit | 08:27 |
| marios | quiquell: there is some more stuff in pre first though | 08:27 |
| marios | quiquell: here https://github.com/openstack-infra/tripleo-ci/blob/b5b979f34a3f53d6a662d78c19c60468439f99a7/toci_gate_test.sh#L290-L291 | 08:28 |
| marios | quiquell: from common_functions https://github.com/openstack-infra/tripleo-ci/blob/b5b979f34a3f53d6a662d78c19c60468439f99a7/scripts/common_functions.sh#L376-L406 | 08:28 |
| marios | quiquell: other than that ... then ??? and of course profit is inevitable | 08:29 |
| marios | quiquell: or keep it simple for first iteration | 08:29 |
| marios | quiquell: just do the stuff in function bootstrap_subnodes https://github.com/openstack-infra/tripleo-ci/blob/b5b979f34a3f53d6a662d78c19c60468439f99a7/scripts/tripleo.sh#L1462 | 08:30 |
| quiquell | marios: We can move to bash templates still in small pieces | 08:30 |
| marios | quiquell: and leave the pre stuff since looking at your example you are already sourcing the common functions so ... | 08:30 |
| marios | quiquell: if we are going to use bash for everything else for now | 08:30 |
| marios | ? | 08:30 |
| marios | quiquell: anyway we'll see | 08:30 |
| marios | quiquell: right or maybe j2 is another option | 08:30 |
| quiquell | marios: That what I mean, ansible interface j2 implementation for first iteration | 08:32 |
| quiquell | marios: Then convert j2 into ansible/python | 08:32 |
| *** sshnaidm|rover has joined #oooq | 08:32 | |
| marios | quiquell: yes i was agreeing with what you said before 'right or maybe j2 ...' | 08:32 |
| quiquell | marios: Humm also it's noly newton using the bootstrap-overcloud-full.sh | 08:33 |
| quiquell | marios: Do we have to support newton ? | 08:33 |
| *** bogdando has quit IRC | 08:34 | |
| *** bogdando has joined #oooq | 08:35 | |
| marios | quiquell: ah cool. well yeah we need newton for ffwd jobs | 08:35 |
| marios | quiquell: which are newton to queens | 08:35 |
| quiquell | marios: That's right... also it affects removing the upgrade bash code | 08:36 |
| quiquell | marios: This part is not using the releases.sh file :-/ | 08:36 |
| *** Goneri has joined #oooq | 08:36 | |
| quiquell | marios: looking at your patch https://review.openstack.org/#/c/581026 | 08:42 |
| quiquell | marios: Why do we need a pre and a post ? | 08:42 |
| marios | quiquell: well the post is more like nice to have for any validation for example | 08:43 |
| marios | quiquell: the pre was for the stuff from common_functions | 08:43 |
| marios | quiquell: so we may remove them if we don't use them (like if we keep the functions) | 08:43 |
| quiquell | marios: If we have a pre, we cannot use .j2 for this part | 08:45 |
| quiquell | marios: as they the pre .j2 will have to communicate wiuth the bootstrap.yml | 08:45 |
| marios | quiquell: well depends if they need to pass variable if that is what you mean? | 08:46 |
| marios | brb | 08:46 |
| quiquell | marios: Added sone comments to the review | 08:51 |
| quiquell | marios: But basically we can move coomon code from the two bootstrap script at pre | 08:52 |
| quiquell | marios: and have two bootstrap roles, selected reading from release | 08:52 |
| quiquell | panda: Are you there ? | 08:53 |
| marios | quiquell: i'd rather keep one role and just set the different playbook if you mean wrt overcloud-minimal vs normal? | 08:58 |
| marios | quiquell: but maybe will becoming clearer what works once we get more specific on those reviews. | 08:59 |
| marios | quiquell: like i should start making ansible tasks at some point :) | 08:59 |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ (1 more message) | 09:00 |
| quiquell | marios: It's not better two have to different roles one for overcloud-minmal and one for normal | 09:01 |
| quiquell | marios: More than roles, I mean includes | 09:01 |
| quiquell | marios: In the role select between the two includes | 09:02 |
| quiquell | marios: reading release | 09:02 |
| *** sshnaidm|rover has quit IRC | 09:04 | |
| panda | quiquell: more or less | 09:05 |
| quiquell | panda: Added a card to the sprint | 09:05 |
| *** sshnaidm|rover has joined #oooq | 09:05 | |
| panda | NOOOOOOOOoooooo...... | 09:05 |
| quiquell | panda: https://trello.com/c/DBDv4ge7/860-create-ansible-module-around-testenv-client | 09:06 |
| quiquell | panda: That's why I am telling, we can remove it | 09:06 |
| panda | quiquell: create ansible module around testenv-client ? | 09:06 |
| quiquell | panda: Yep, it's already a python script | 09:06 |
| quiquell | panda: Also it outpus the TE_DATAFILE, as a environment variable don't know if this can be a problem | 09:07 |
| quiquell | panda: If we can move everything to ansible | 09:07 |
| quiquell | panda: And running command inside maybe it's not necessary if we set TE_DATAFILE correctly | 09:08 |
| panda | quiquell: one of the design goal is to understand how we cna get rid of the te-broker and all its workflow completely | 09:08 |
| panda | testenv-client is the client part of te-broker | 09:08 |
| quiquell | panda: Ok, so we don't speend time refactoring it, | 09:09 |
| panda | quiquell: nope | 09:09 |
| quiquell | panda: Ok, removing it | 09:09 |
| quiquell | panda: Also I see this card https://trello.com/c/X6VWGH9H/858-translate-commonvarsshj2-piece-by-piece-to-ansible-tasks | 09:11 |
| quiquell | panda: As part of this https://trello.com/c/Rsvd2acu/836-translate-tocigatetestshj2-piece-by-piece-to-ansible-tasks | 09:11 |
| panda | this is the overflow card | 09:11 |
| quiquell | panda: common_vars is only used at goci_gate_test | 09:11 |
| quiquell | s/goci/toci/g | 09:11 |
| panda | quiquell: is that bad ? | 09:13 |
| panda | quiquell: also those card are for AFTER we translate everything into templated bash | 09:14 |
| *** ccamacho has quit IRC | 09:16 | |
| quiquell | panda: Ok, so maybe we will need more small cards like that for toci_gate_test.sh | 09:16 |
| *** ratailor has quit IRC | 09:17 | |
| quiquell | panda: What I mean is there are parts at toci_gate_test.sh that don't do a sources | 09:18 |
| *** ratailor has joined #oooq | 09:19 | |
| panda | quiquell: reading the scrollback log | 09:20 |
| panda | quiquell: you want to break toci_gate_test.sh into smaller part and assign a card to each of them ? | 09:20 |
| quiquell | panda: Maybe ? | 09:21 |
| quiquell | panda: the common_vars.sh is like that | 09:21 |
| panda | quiquell: because it's a different file to render | 09:22 |
| quiquell | panda: The output of moving stuff to j2 doesn't have to define the ansible task we need to creaste | 09:22 |
| panda | marios: I took a look at the bootstrap, have you checked that we reallyu need ALL there is in the bootstrapo code ? | 09:23 |
| panda | quiquell: ah, sure, you can create smalle card for smal pieces of those files. What we found in previous sprint is that the correct size is hard to identify. Large cards are confusing, small card are usually grouped together anyway | 09:24 |
| quiquell | panda: Yep difficult matter. | 09:26 |
| marios | panda: no i mean as you can see it is literally skeleton pointing to the bits in bash we want to transfer. on next iteration i will dig in more | 09:26 |
| marios | panda: like quiquell pointed out the minimal stuff which uses the toci_jobtype is not as important but still needed for n..q ffwd upgrade jobs for example | 09:26 |
| panda | marios: yes, just wanted to point out that maybe we need to translate to ansible only a smal part of what's there currently, because most of the tasks are already done alsewhere | 09:29 |
| marios | panda: ack | 09:29 |
| quiquell | panda: thinks like this source /etc/nodepool/provider, are no longer needed ? | 09:30 |
| quiquell | panda: inventory will provide I suppose | 09:30 |
| *** ccamacho has joined #oooq | 09:33 | |
| panda | quiquell: yes, the provider is a variable in the inventory, but what's different now is that is part of the host definition. | 09:34 |
| panda | quiquell: so provider is not global anymore, but host specific | 09:34 |
| quiquell | panda: ack | 09:35 |
| ssbarnea | Who knows who is behind rhos.op.redhat.com ? as it appears hosted on aws but down. | 09:37 |
| chkumar|ruck | ykarel: sshnaidm|rover one check job is hitting node failure https://review.rdoproject.org/zuul3/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch is it related to log_url issue? | 09:37 |
| ykarel | chkumar|ruck, no, log_url is just reporting issue | 09:38 |
| quiquell | panda: What jobs have beign migrated in the previous sprint ? | 09:40 |
| panda | quiquell: all undercloud jobs, all multinode 2 nodes jobs. Remains to migrate 3 nodes jobs 4 nodes jobs and standalone | 09:43 |
| quiquell | panda: ack | 09:44 |
| panda | quiquell: and of course RDO sf jobs | 09:44 |
| *** ratailor has quit IRC | 09:47 | |
| *** ratailor has joined #oooq | 09:48 | |
| *** jbadiapa has quit IRC | 09:53 | |
| quiquell | panda: Do we need to support the monolithic playbooks like multinode.yaml ? | 09:56 |
| quiquell | or baremetal-full-deploy.yaml ? | 09:56 |
| panda | quiquell: yes | 10:16 |
| quiquell | panda: Checking you review https://review.openstack.org/#/c/580612 | 10:17 |
| quiquell | panda: We just specify the list of playbooks and tags per job | 10:17 |
| quiquell | panda: We just specify multinode.yaml at those jobs | 10:18 |
| panda | quiquell: exactly | 10:20 |
| quiquell | panda: This is not too much redundancy specify playbooks per job ? | 10:20 |
| panda | quiquell: it may yes, we could group the list of playbooks and in zuul configuration specify the name of the group | 10:24 |
| panda | quiquell: so the only logic that remains is to extend the name to the proper list | 10:24 |
| quiquell | panda: tags maybe are a good candidate to be there too | 10:25 |
| quiquell | panda: they have a 1 to 1 relation to the job and they can also be grouped | 10:25 |
| marios | panda: quiquell can you add your skeleton reviews to the cards on trello | 10:47 |
| quiquell | marios: I think I have it all added, also added gabriel's one | 10:48 |
| marios | quiquell: thanks | 10:48 |
| quiquell | marios, panda: Do we need a reproducer card ? | 10:55 |
| *** udesale has quit IRC | 10:56 | |
| panda | quiquell: ah, that's what I was missing yesterday | 10:58 |
| panda | quiquell: creating | 10:58 |
| quiquell | panda: Ahh ok | 10:59 |
| quiquell | thanks | 10:59 |
| quiquell | panda: Have see this at #tripleo "test job that don't use any nodepool node" | 10:59 |
| quiquell | panda: What it means ? | 11:00 |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002 (2 more messages) | 11:00 |
| panda | quiquell: I'm investigating how to remove te broker | 11:00 |
| panda | quiquell: I'm trying some approaches | 11:01 |
| quiquell | panda: cool! one thing to consider, if we use zuul encryption maybe we can not use tripleo-ci for jobs definition | 11:01 |
| panda | quiquell: What I'm doing requires some eplxanation on how te broker works. We cna chat if you want | 11:02 |
| panda | quiquell: wat ? | 11:02 |
| quiquell | panda: They have to be in the same project that define secrets | 11:02 |
| quiquell | panda: And not all the projects can have them | 11:02 |
| quiquell | panda: Also, you cannot test job not merged if they use secrets | 11:02 |
| panda | quiquell: hhmm | 11:02 |
| panda | quiquell: where's the documentation for that ? | 11:03 |
| quiquell | panda: better you continue with the investigation and explain it to all of us | 11:03 |
| quiquell | panda: In the trello card, I paste it a test I did for secrets | 11:03 |
| quiquell | panda: It laso has the ref for docs | 11:03 |
| quiquell | panda: https://review.rdoproject.org/r/#/c/14677/ | 11:04 |
| quiquell | panda: te-broker is only needed for OVB jobs ? | 11:04 |
| * marios school run biab | 11:12 | |
| panda | quiquell: yes | 11:14 |
| quiquell | panda: Maybe we need to define a rdo repo with them | 11:16 |
| quiquell | panda: Are we going to remove playbooks/openstack-zuul-jobs/legacy/pre.yaml dependency ¿? | 11:17 |
| *** holser_ has quit IRC | 11:23 | |
| *** holser_ has joined #oooq | 11:26 | |
| panda | quiquell: not sure, only if we are able to replace now all the variables | 11:33 |
| *** atoth has joined #oooq | 11:34 | |
| quiquell | panda: Was taking a look at ZUUL_CHANGES | 11:34 |
| *** holser_ has quit IRC | 11:35 | |
| panda | quiquell: and ? | 11:36 |
| quiquell | panda: Looks like ZUUL_CHANGES is not a variable that we create | 11:37 |
| quiquell | panda: It depends on we executing the zuul legacy mode | 11:38 |
| *** anande has quit IRC | 11:38 | |
| quiquell | panda: So when do we plan to totally deactivate leagcy mode ? | 11:38 |
| quiquell | panda: but better be prepare though | 11:38 |
| panda | quiquell: yep, it's a legacy variable, it's passe to the job with the environment: argument of shell ansible tasks | 11:39 |
| panda | quiquell: no, the goal is always the same: "what's the smallest step we can take to remove all the legacy parts ? | 11:39 |
| panda | we'll remove any legacy part as a last step for sure | 11:40 |
| quiquell | panda: ok, got it, thanks | 11:40 |
| *** anande has joined #oooq | 11:45 | |
| *** holser_ has joined #oooq | 11:50 | |
| *** holser_ has quit IRC | 11:51 | |
| *** jbadiapa has joined #oooq | 11:55 | |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| *** holser_ has joined #oooq | 11:57 | |
| *** rfolcOUT is now known as rfolco | 11:59 | |
| *** hamzy has quit IRC | 12:18 | |
| rfolco | panda, why j2 is mentioned in https://trello.com/c/6xqcXtM7/859-translate-oooqcommonfunctionsshj2-piece-by-piece-to-ansible-tasks ? the script is not j2. | 12:18 |
| *** yolanda has quit IRC | 12:21 | |
| panda | rfolco: not yet | 12:23 |
| panda | rfolco: it will be before we can take that card into consideration | 12:24 |
| panda | hhmm cards are still not in order | 12:24 |
| panda | of priority | 12:24 |
| rfolco | panda, can you please help finding a card ? The 2 that are more clear are owned by marios and quiquell | 12:25 |
| panda | rfolco: are you free to chat ? | 12:27 |
| rfolco | panda, yes | 12:27 |
| panda | rfolco: in my ready room | 12:28 |
| panda | number 1, you have the bridge | 12:29 |
| *** rlandy has joined #oooq | 12:35 | |
| rlandy | weshay: why did you you add promotion-blocker to https://bugs.launchpad.net/tripleo/+bug/1780780? | 12:37 |
| openstack | Launchpad bug 1780780 in tripleo "multi-node-bridge role in zuul-jobs uses a released OVS package " [High,Triaged] | 12:37 |
| weshay | rlandy, well if we get blocked moving to zuulv3 I thought I'd call it out as a promotion blocker | 12:38 |
| rlandy | weshay: ok - putting aside apevec's comments in https://review.openstack.org/#/c/580518/, what do you think of hos suggestion to add update steps ( restrart OVS) https://bugs.launchpad.net/tripleo/+bug/1780780/comments/1? | 12:41 |
| openstack | Launchpad bug 1780780 in tripleo "multi-node-bridge role in zuul-jobs uses a released OVS package " [High,Triaged] | 12:41 |
| *** holser_ has quit IRC | 12:41 | |
| rlandy | I am not sure if this belongs in CI | 12:41 |
| rlandy | ie: if doing update steps are part of a workflow we want to follow | 12:41 |
| quiquell | panda: Working review only with the j2 so we can play with zuul variables https://review.openstack.org/#/c/581331/ | 12:41 |
| *** yolanda has joined #oooq | 12:42 | |
| weshay | rlandy, ugh.. /me chats w/ him on #rdo | 12:42 |
| rlandy | k - following | 12:42 |
| weshay | rlandy, we should not have to add steps after updating a package for things to work | 12:42 |
| weshay | it's a broken package | 12:43 |
| rlandy | weshay: that is my impression from our discussion yesterday | 12:43 |
| rlandy | but we can't reparent until this is sorted | 12:43 |
| rlandy | panda: pls see my question in https://trello.com/c/95AvKjpX/845-migrate-3-and-4-nodes-jobs-to-tripleo-ci-base-parent | 12:44 |
| *** holser_ has joined #oooq | 12:47 | |
| *** amoralej|lunch is now known as amoralej | 12:49 | |
| weshay | rlandy, I think Alan may be ok w/ https://review.openstack.org/#/c/580518/ | 12:49 |
| weshay | he is just indicatng it may be a problem if RHEL ever makes it into the ecosystem | 12:49 |
| rlandy | weshay: yeah - he didn't -1 it - so that is a start | 12:50 |
| rlandy | I guess the bug can remain open for discussion | 12:50 |
| rlandy | if we can get the reviews in, that would move the migration to zuulv3 forward | 12:50 |
| rlandy | panda: marios: could I get another core vote on https://review.openstack.org/#/c/581116/? | 12:55 |
| rlandy | related to https://review.openstack.org/#/c/580518/ | 12:56 |
| *** yolanda_ has joined #oooq | 13:00 | |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001 (2 more messages) | 13:00 |
| *** skramaja has quit IRC | 13:02 | |
| *** yolanda has quit IRC | 13:02 | |
| rasca | rlandy, hi there! Do you happen to know why the promotion jobs in rdophase2 for master, queens and pike are all disabled? | 13:03 |
| *** ykarel is now known as ykarel|afk | 13:03 | |
| rasca | rlandy, oh, my mistake, they are not disabled, it's just that there were no jobs since last week | 13:04 |
| rasca | rlandy, I think it's because we're not sseing promotions before in the chain | 13:05 |
| *** yolanda_ has quit IRC | 13:05 | |
| marios | rlandy: ack | 13:06 |
| rlandy | rasca: probably, the ruck/rover cloud confirm that | 13:07 |
| *** sanjay__u has quit IRC | 13:10 | |
| chkumar|ruck | rasca: rlandy two bugs | 13:13 |
| chkumar|ruck | https://bugs.launchpad.net/tripleo/+bug/1780726 | 13:13 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Fix released] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 13:13 |
| chkumar|ruck | https://bugs.launchpad.net/tripleo/+bug/1780855 | 13:14 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,In progress] - Assigned to yatin (yatinkarel) | 13:14 |
| chkumar|ruck | because of those promotion has not happened | 13:14 |
| rasca | chkumar|ruck, fair enough, thanks. rlandy, do you think it would be possible to structure the jobs so that even if we don't have any promotion the execution happen in any case ate least once a week? | 13:14 |
| sshnaidm|rover | rasca, it doesn't make sense to rerun them on them same dlrn hash | 13:15 |
| sshnaidm|rover | rasca, it won't test anything new | 13:16 |
| rasca | sshnaidm|rover, not from the promotion perspective, no. But from a patch perspective yes | 13:16 |
| sshnaidm|rover | rasca, patch perspective..? | 13:16 |
| rasca | what if in the meantime I've changed HA tests, increased them, and so on | 13:16 |
| rasca | sshnaidm|rover ^^^ | 13:17 |
| sshnaidm|rover | rasca, are we talking about periodic jobs? | 13:17 |
| rasca | sshnaidm|rover, rdophase2 in this case | 13:17 |
| rasca | so I'd say no | 13:17 |
| rlandy | rasca: you can manually rekick those jobs if you wish | 13:17 |
| rasca | rlandy, sure, I know | 13:17 |
| rasca | I was just wondering if this could be an automated task | 13:17 |
| rlandy | but running them w/o a new hash is not common | 13:18 |
| sshnaidm|rover | rasca, if it's still jenkins, it's possible to add a trigger | 13:18 |
| rlandy | it could be | 13:18 |
| *** yolanda_ has joined #oooq | 13:18 | |
| rasca | sshnaidm|rover, yes, it's Jenkins, I'll investigate on that, thanks | 13:18 |
| sshnaidm|rover | rasca, rlandy I don't know well about HA tests - are they part of rdophase2? | 13:18 |
| rasca | sshnaidm|rover, yes, take this as an example https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/oooq-master-rdo_trunk-bmu-haa16-lab-float_nic_with_vlans/ | 13:19 |
| rlandy | I think the concern is that because we are using the same hardware the two could clash for priority | 13:19 |
| *** arxcruz_ has joined #oooq | 13:19 | |
| sshnaidm|rover | rlandy, the two..? | 13:20 |
| rlandy | sshnaidm|rover: the daily triggered run and the one triggered by a new hash | 13:21 |
| rasca | rlandy, yes, you're right, but at that point they will get into the queue, isn't it? | 13:21 |
| rlandy | if there is no new hash - no harm | 13:21 |
| rlandy | rasca - correct | 13:21 |
| rlandy | they will just queue up | 13:21 |
| sshnaidm|rover | rlandy, yeah, it should be queued | 13:21 |
| rasca | rlandy, so no big deal, at worst we'll need to wait | 13:21 |
| rlandy | you can try it with your jobs and see how it goes | 13:21 |
| panda | rlandy: so scenarios007 and 008 work with paul's workaround ? | 13:21 |
| rlandy | I can show you have to create a daily trigger in jenkins | 13:21 |
| rlandy | panda: ask - see results posted in card | 13:22 |
| panda | rlandy: commending on the cards for the 2 and 4 nodes | 13:22 |
| rlandy | panda: thanks - I can pick that up today | 13:22 |
| rlandy | hoping it's not too big of a deal | 13:22 |
| *** arxcruz_ has quit IRC | 13:23 | |
| weshay | marios, you have a minute.. rlandy and I probably have some questions about ovs | 13:26 |
| rlandy | panda: to confirm, there are *no* definitions outside of tripleo-ci? | 13:29 |
| weshay | sshnaidm|rover, 1-1 | 13:31 |
| marios | weshay: o/ sure are you on a call? | 13:31 |
| weshay | marios, bad timing, will catch you in abit | 13:32 |
| marios | weshay: ok np | 13:32 |
| panda | rlandy: tripleo-ci is the only place where the job is configured and the parent is specified. | 13:34 |
| rlandy | marios: to give you some background - we're having a debate on what should/needs to be done when upgrading OVS | 13:34 |
| rlandy | panda: fine, thanks. just checking that I don't miss other cases | 13:35 |
| *** holser_ has quit IRC | 13:42 | |
| *** holser_ has joined #oooq | 13:44 | |
| *** ratailor has quit IRC | 13:50 | |
| *** ykarel|afk is now known as ykarel | 13:51 | |
| *** anande has quit IRC | 13:54 | |
| *** yolanda_ has quit IRC | 14:03 | |
| *** rfolco has quit IRC | 14:06 | |
| *** bogdando has quit IRC | 14:18 | |
| *** yolanda_ has joined #oooq | 14:18 | |
| weshay | marios, will catch you at the community mtg | 14:23 |
| marios | weshay: sure | 14:23 |
| *** hamzy has joined #oooq | 14:24 | |
| weshay | rlandy, when you have a second today.. can we sync up on the perf work | 14:25 |
| rlandy | weshay: ack - whenever you are ready | 14:26 |
| rlandy | panda: pls take a quick look at https://review.openstack.org/#/c/581376 and let me know if this is what you had in mind | 14:30 |
| *** EmilienM is now known as EvilienM | 14:42 | |
| *** quiquell is now known as quiquell|off | 14:43 | |
| *** ykarel is now known as ykarel|away | 14:44 | |
| *** quiquell|off is now known as quiquell | 14:45 | |
| *** quiquell is now known as quiquell|off | 14:46 | |
| *** quiquell|off is now known as quiquell | 14:47 | |
| *** quiquell is now known as quiquell|off | 14:48 | |
| rlandy | panda: https://review.openstack.org/#/c/581376 - redone ... 7-4 makes no sense in the job it's used in though multinode-1ctlr-featureset009 | 14:54 |
| chkumar|ruck | sshnaidm|rover: weshay today's stuff https://review.rdoproject.org/etherpad/p/ruckrover-sprint16 line: 78-112 | 14:55 |
| sshnaidm|rover | chkumar|ruck, I think it's better to strikethrough not-relevant/fixed items | 14:57 |
| chkumar|ruck | sshnaidm|rover: sure will do that | 14:58 |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001 (2 more messages) | 15:00 |
| *** udesale has joined #oooq | 15:01 | |
| *** ccamacho has quit IRC | 15:05 | |
| *** ccamacho has joined #oooq | 15:06 | |
| rlandy | marios: checking your drac now ... rdo-ci-fx2-02-s3 correct? | 15:07 |
| *** ykarel|away has quit IRC | 15:07 | |
| rlandy | what's the issue exactly? you can't login? reprovision with beaker? | 15:08 |
| rlandy | could hrybacki? | 15:08 |
| rlandy | I won't be able to see the setup in beaker as I don;t own that box | 15:08 |
| rlandy | I can try from drac and give you a fresh start to work from | 15:08 |
| weshay | sshnaidm|rover, panda https://review.openstack.org/#/c/580361/ | 15:12 |
| weshay | sshnaidm|rover, panda https://bugs.launchpad.net/tripleo/+bug/1778291 | 15:14 |
| openstack | Launchpad bug 1778291 in tripleo "/home/zuul/workspace/devstack-gate/functions.sh: line 184: declare: gate_hook: not found" [High,Triaged] | 15:14 |
| marios | rlandy: yeah | 15:17 |
| marios | rlandy: sorry momentarily afk | 15:17 |
| marios | rlandy: (was) | 15:17 |
| marios | rlandy: https://rdo-ci-fx2-01-s3-drac.mgmt.lab.eng.rdu.redhat.com/login.html | 15:17 |
| marios | rlandy: right so problem is reprovision doesn't seem to be working, ssh just says connectino refused. i tried playing with the drac passwords/created new user even for sanity but same | 15:18 |
| marios | rlandy: i set things back to default | 15:19 |
| marios | rlandy: except the install options (Kernel options for the mac addr you told me about | 15:19 |
| marios | rlandy: actually i since set that back to the default too | 15:19 |
| marios | rlandy: 'the default' what was there before i mean | 15:20 |
| marios | you should be able to view the install options in beaker | 15:20 |
| marios | rlandy: but let me add you to the box | 15:21 |
| weshay | sshnaidm|rover, panda https://review.openstack.org/#/c/576429/2/roles/virtbmc/tasks/configure-vbmc.yml | 15:23 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1777609 | 15:23 |
| openstack | Launchpad bug 1777609 in tripleo "TripleO: Problems installing just the undercloud" [Medium,In progress] - Assigned to wes hayutin (weshayutin) | 15:23 |
| *** saneax has quit IRC | 15:23 | |
| *** ccamacho has quit IRC | 15:26 | |
| *** links has quit IRC | 15:26 | |
| hrybacki | rlandy: marios I don't have any rights on that box anymore | 15:27 |
| marios | hrybacki: ack was provision working ok for you/done it any time recently via beaker for that box? | 15:28 |
| *** jfrancoa has quit IRC | 15:30 | |
| hrybacki | marios: it must have worked for me at some point but it's been over a year since I touched the box (or logged into beaker). tbh I didn't know I was still the owner of anything in beaker until I saw the email | 15:30 |
| marios | hrybacki: ack thanks | 15:31 |
| *** rfolco has joined #oooq | 15:31 | |
| rlandy | marios: ok - on drac atm | 15:36 |
| rlandy | marios: your box is stuck in the middle of a reboot | 15:37 |
| rlandy | what did you try to reprovision to centos7? | 15:37 |
| weshay | panda, https://bugs.launchpad.net/tripleo/+bug/1775826 | 15:38 |
| openstack | Launchpad bug 1775826 in tripleo "Can't reproduce more than one stack using reproducer-quickstart." [Medium,Incomplete] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 15:38 |
| marios | rlandy: yeah | 15:39 |
| weshay | sshnaidm|rover, https://review.openstack.org/#/c/571256/ | 15:39 |
| marios | rlandy: centos 7.4 | 15:39 |
| weshay | rlandy, we fixed this? https://bugs.launchpad.net/tripleo/+bug/1773569 | 15:39 |
| openstack | Launchpad bug 1773569 in tripleo "TQE: ovb-create-stack.yml role overrides are not working as expected" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 15:39 |
| rlandy | marios: ok - so let's just confirm https://rdo-ci-fx2-01-s3-drac.mgmt.lab.eng.rdu.redhat.com - I think you mean rdo-ci-fx2-02-s3-drac.mgmt.lab.eng.rdu.redhat.com | 15:40 |
| rlandy | ^^ that is what you are assigned on the sreadsheet | 15:40 |
| rlandy | weshay: I'll look at it in a bit and comment | 15:40 |
| rlandy | marios: https://rdo-ci-fx2-01-s3 is a virthost | 15:41 |
| marios | rlandy: oh damn in beaker its a different box then. drac is https://rdo-ci-fx2-01-s3-drac.mgmt.lab.eng.rdu.redhat.com/login.html and beaker is https://beaker.engineering.redhat.com/view/rdo-ci-fx2-02-s3.v101.rdoci.lab.eng.rdu.redhat.com#access-policy | 15:41 |
| marios | rlandy: yeah fx2-02 vs fx2-01 | 15:42 |
| marios | rlandy: and in fact that one isn't in beaker | 15:42 |
| rlandy | marios: ack | 15:42 |
| marios | rlandy: :/ so i will try register it tomorrow | 15:42 |
| marios | rlandy: thanks for help | 15:42 |
| rlandy | marios: let me see what I can do with it | 15:43 |
| rlandy | I'll do the beaker stuff | 15:43 |
| rlandy | https://beaker.engineering.redhat.com/view/rdo-ci-fx2-02-s3.v101.rdoci.lab.eng.rdu.redhat.com#power-settings\\ | 15:44 |
| marios | rlandy: thanks but i don't want to take more time from you :/ | 15:44 |
| weshay | marios, I can help you get it going | 15:47 |
| marios | rlandy: but that is wrong (what you just pointed at) it should be rdo-ci-fx2-01-s3- fyi | 15:47 |
| marios | weshay: thanks i'll should if i can't make progress on it by tomorrow | 15:48 |
| marios | weshay: s/should/shout | 15:48 |
| rlandy | marios: pls check the spreadsheet | 15:48 |
| rlandy | we need to clear this up | 15:48 |
| rlandy | rdo-ci-fx2-02-s3.v101.rdoci.lab.eng.rdu.redhat.com | 15:48 |
| rlandy | rdo-ci-fx2-01-s3 is a virthost | 15:48 |
| rlandy | rdo-ci-fx2-02-s3.v101.rdoci.lab.eng.rdu.redhat.com is correctly assigned to you | 15:49 |
| marios | rlandy: then beaker is OK | 15:49 |
| rlandy | marios: yes - it juts got stuck in reboot | 15:49 |
| marios | rlandy: earlier you said 18:40 < rlandy> marios: ok - so let's just confirm https://rdo-ci-fx2-01-s3-drac.mgmt.lab.eng.rdu.redhat.com - I think you mean rdo-ci-fx2-02-s3-drac.mgmt.lab.eng.rdu.redhat.com | 15:49 |
| rlandy | my mistake then - sorry | 15:49 |
| marios | rlandy: and beaker (the one i was working with today ) at https://beaker.engineering.redhat.com/view/rdo-ci-fx2-02-s3.v101.rdoci.lab.eng.rdu.redhat.com#power-settings | 15:50 |
| rlandy | I am rebooting and reprovisioning now to confirm | 15:50 |
| rlandy | it looks like you worked on rdo-ci-fx2-02-s3-drac.mgmt.lab.eng.rdu.redhat.com | 15:50 |
| marios | rlandy: but you are right. i mean the two are different. the drac address i have is https://rdo-ci-fx2-01-s3-drac.mgmt.lab.eng.rdu.redhat.com/login.html | 15:50 |
| rlandy | from beaker | 15:50 |
| marios | rlandy: but in beaker it is the 02 one | 15:50 |
| rlandy | rdo-ci-fx2-02-s3-drac.mgmt.lab.eng.rdu.redhat.com is the power address | 15:50 |
| rlandy | that is correct | 15:50 |
| marios | rlandy: ah ok, i was just lokoing at the email weshay sent me and it has both :) | 15:51 |
| rlandy | mandreouHTTP2018-07-10 08:21:49 -04:002018-07-10 08:22:20 -04:002018-07-10 08:22:26 -04:00onCompleted | 15:51 |
| marios | rlandy: ok | 15:51 |
| marios | brb | 15:51 |
| rlandy | ^^ you have been operating fine through beaker | 15:51 |
| *** Goneri has quit IRC | 15:53 | |
| marios | rlandy: ack | 15:54 |
| rlandy | marios: this machine never goes to PXE boot | 15:56 |
| rlandy | will have to check the boot options | 15:57 |
| marios | rlandy: :/ ok from drac the nic is Embedded NIC 1 Intel(R) Gigabit 2P I350 LOM - 10:98:36:14:C5:6F FYI | 15:59 |
| marios | rlandy: but note that the power options uses a different address. i tried both but same result | 15:59 |
| *** sshnaidm|rover is now known as sshnaidm|bbl | 16:12 | |
| *** udesale has quit IRC | 16:15 | |
| rlandy | marios: reseating the machine | 16:20 |
| marios | rlandy: thanks | 16:20 |
| marios | rlandy: am going to go afk in a minute | 16:20 |
| rlandy | k | 16:21 |
| marios | rlandy: do you mean reboot? or reset beaker to some defaults or? | 16:21 |
| rlandy | vitula reseat from the drac crontroller | 16:21 |
| marios | rlandy: oh | 16:21 |
| *** holser_ has quit IRC | 16:32 | |
| rlandy | hmmm ... this machine never goes to PXE boot | 16:32 |
| marios | rlandy: ack thanks for poking at it | 16:34 |
| rlandy | marios: theboot order is correct | 16:35 |
| marios | rlandy: i managed to get reproducer to complete on rdo cloud today so i'll continue to use that for now | 16:35 |
| rlandy | and so is the boot nic | 16:35 |
| marios | rlandy: otherwise i have this beaker box that irssi is running on too for now, though its pretty small | 16:35 |
| rlandy | but not getting pxe boot | 16:35 |
| marios | rlandy: ok | 16:35 |
| rlandy | stuck in edd | 16:35 |
| rlandy | will hav eto ping the lab guys | 16:35 |
| rlandy | I have no further access | 16:35 |
| marios | rlandy: ack thanks for the help! i have to run now tho please carry on with your life | 16:38 |
| marios | rlandy: without this box ! | 16:38 |
| marios | rlandy: ! | 16:38 |
| rlandy | | primary | "msg": "Failed to connect to repos.fedorapeople.org at port 443: [Errno 101] Network is unreachable" | 16:38 |
| rlandy | ^^ anyone else see this? | 16:38 |
| marios | rlandy: :/ | 16:38 |
| rlandy | https://review.openstack.org/#/c/581376/ | 16:39 |
| * marios off ttyl | 16:39 | |
| panda | rlandy: isn't that the workaround for the ovs problem ? | 16:45 |
| panda | rlandy: nevermind | 16:46 |
| rlandy | panda: hasn't merged yet https://review.openstack.org/#/c/580518/ | 16:46 |
| *** atoth has quit IRC | 16:57 | |
| *** atoth has joined #oooq | 17:00 | |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002 (2 more messages) | 17:00 |
| panda | rlandy: do you have time for a question on ovb-stack-create ? | 17:01 |
| rlandy | yes | 17:02 |
| *** amoralej is now known as amoralej|off | 17:03 | |
| *** holser_ has joined #oooq | 17:04 | |
| panda | rlandy: I lied, they may be more than one. Do we need to specify a virthost always ? | 17:04 |
| rlandy | panda: pls link where you are refering to a virthost | 17:05 |
| rlandy | mostly that is where ansible runs | 17:05 |
| *** holser_ has quit IRC | 17:06 | |
| *** holser_ has joined #oooq | 17:07 | |
| *** holser_ has quit IRC | 17:07 | |
| *** tesseract has quit IRC | 17:07 | |
| panda | rlandy: mmh, I wanted to paste something but I'm confused | 17:09 |
| rlandy | ctrl+V will paste - it's not that confusing :) | 17:09 |
| panda | rlandy: do we have an example of the simplest invocation for the ovb-create-stack playbook ? | 17:09 |
| rlandy | yep - in the reproducer | 17:10 |
| panda | rlandy: ok, perfect | 17:10 |
| rlandy | panda: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-reproducer-script/templates/reproducer-quickstart.sh.j2#L221 | 17:10 |
| panda | rlandy: in terminal + weechat ctrl+v doesn't work ... :( | 17:10 |
| panda | rlandy: exaclty, we are passing a virthost as extra var | 17:11 |
| *** ykarel|away has joined #oooq | 17:11 | |
| rlandy | -e virthost=localhost | 17:11 |
| rlandy | hmmm ... I am not sure what happens if we leave it out | 17:13 |
| *** holser_ has joined #oooq | 17:13 | |
| *** holser_ has quit IRC | 17:13 | |
| panda | rlandy: where is openstack-virtual-baremetal repo usually cloned ? | 17:14 |
| rlandy | in the workspace | 17:14 |
| *** holser_ has joined #oooq | 17:14 | |
| rlandy | probably more its reliance on common-extras stuff | 17:15 |
| rlandy | panda: when you are done, pls see my question on https://review.openstack.org/#/c/581376/ | 17:17 |
| rlandy | the 4 node thing looks wrong with that job_type | 17:17 |
| panda | rlandy: where's the question ? | 17:18 |
| weshay | ssbarnea, how's it going? need anything? | 17:20 |
| ssbarnea | weshay: hi! nope, everything in order I started following the training materials. I want to fast-track the courses, mainly to finish CL110 asap. | 17:22 |
| weshay | rock on | 17:22 |
| ssbarnea | i had to request an extension on RHU subscription as mine expired in april. | 17:22 |
| ssbarnea | weshay: btw, you will have to update the roster, we do not have edit rights aparently. | 17:23 |
| weshay | email anton | 17:23 |
| weshay | not me | 17:23 |
| rlandy | panda: https://review.openstack.org/#/c/581376/2/zuul.d/multinode-jobs.yaml | 17:24 |
| rlandy | ^^ the 4 node job | 17:24 |
| rlandy | multinode-1ctlr-featureset009 | 17:24 |
| rlandy | as the job_type | 17:24 |
| rlandy | that seems wring | 17:24 |
| rlandy | wrong | 17:24 |
| ssbarnea | marios already did, i hope mentioned me. i am bit surprised that there is no git repo to update the roster :) | 17:25 |
| ssbarnea | a CR would be more openstack way of updating it :D | 17:25 |
| panda | rlandy: that's definitely wrong | 17:25 |
| rlandy | panda: yep - I just blanket converted the nodeset | 17:26 |
| rlandy | but it can't be correct | 17:26 |
| *** quiquell|off has quit IRC | 17:31 | |
| *** rfolco is now known as rfolco_brb | 17:31 | |
| panda | rlandy: it was wrong also in zullv2 configuration. | 17:34 |
| panda | rlandy: I don't think that job ever worked | 17:34 |
| panda | properly | 17:34 |
| panda | and it's even better if we shut it down | 17:35 |
| rlandy | panda: well it's one of two things - 4 node or one node | 17:35 |
| rlandy | it's never called but we need to define it correctly | 17:35 |
| rlandy | I can leave the 4 node definition in the nodesets | 17:35 |
| rlandy | since we will eventually use it | 17:35 |
| rlandy | but I think that job should be regular own node | 17:35 |
| rlandy | one | 17:35 |
| *** ykarel|away has quit IRC | 17:35 | |
| panda | rlandy: yes, but I have not idea what's the node configuration for taht job | 17:35 |
| rlandy | panda: ok - I am updating the review accordingly | 17:36 |
| *** holser_ has quit IRC | 17:36 | |
| panda | rlandy: wait, there's more | 17:37 |
| *** holser_ has joined #oooq | 17:37 | |
| rlandy | do I win a pony???? | 17:37 |
| panda | rlandy: a Unicorn. | 17:38 |
| panda | rlandy: there is no scenario005 | 17:38 |
| panda | rlandy: anywhere | 17:38 |
| rlandy | lol | 17:38 |
| panda | that job is a joke | 17:38 |
| rlandy | ok - I think we can just delete it | 17:38 |
| panda | rlandy: in newton the max is 004, in pike they start with 006 | 17:39 |
| rlandy | panda: it's like platform Platform 9¾ at King's Cross Station - you can see it with magic | 17:40 |
| *** atoth_ has joined #oooq | 17:41 | |
| panda | rlandy: I was imagining more the Order of the Phoenix HQ. A special git command and a secret directory appears | 17:42 |
| panda | weshay: I asked in #tripleo too, but 4 nodes job never never tested anything. | 17:42 |
| panda | weshay: we don't even understand what's the use case associated | 17:43 |
| rlandy | panda: fine - I ma deleting the 4 node nodeset and that sceanrio005 job | 17:43 |
| rlandy | unless there is a particular objection | 17:43 |
| panda | rlandy: I would say nuke it for now, if we later understand what's needed there we'll add it | 17:43 |
| rlandy | panda: ack | 17:44 |
| *** atoth has quit IRC | 17:44 | |
| *** panda is now known as panda|off | 17:44 | |
| *** atoth_ has quit IRC | 17:45 | |
| *** atoth has joined #oooq | 17:46 | |
| *** atoth has quit IRC | 17:48 | |
| weshay | sshnaidm|bbl, ping me when you are back or tomorrow | 17:55 |
| *** holser_ has quit IRC | 18:02 | |
| *** kopecmartin has quit IRC | 18:14 | |
| *** rlandy is now known as rlandy|brb | 18:56 | |
| hubbot` | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002 (2 more messages) | 19:00 |
| *** atoth has joined #oooq | 19:06 | |
| *** rlandy|brb is now known as rlandy | 19:27 | |
| *** trown is now known as trown|lunch | 19:32 | |
| *** sshnaidm|bbl has quit IRC | 19:45 | |
| *** sshnaidm|bbl has joined #oooq | 19:52 | |
| *** rfolco_brb is now known as rfolco | 19:56 | |
| sshnaidm|bbl | weshay, ping | 19:57 |
| *** holser_ has joined #oooq | 20:17 | |
| *** atoth has quit IRC | 20:27 | |
| *** atoth has joined #oooq | 20:27 | |
| rlandy | weshay: have a moment to chat re: perf job? | 20:31 |
| weshay | rlandy, ya | 20:31 |
| weshay | sshnaidm|bbl, will chat w/ you tomorrow | 20:31 |
| weshay | rlandy, sec | 20:33 |
| rlandy | weshay: bj? | 20:33 |
| *** trown|lunch is now known as trown | 20:33 | |
| ssbarnea | can I use a magic comment to retry a specific zuul job? like "recheck jobname"? | 20:38 |
| rlandy | no - but that would be nice | 20:39 |
| *** rfolco has quit IRC | 20:40 | |
| weshay | back | 20:41 |
| weshay | rlandy, k | 20:41 |
| rlandy | weshay: joining your bj | 20:41 |
| *** tcw1 has joined #oooq | 20:51 | |
| *** tcw has quit IRC | 20:51 | |
| *** holser_ has quit IRC | 20:57 | |
| weshay | sshnaidm|bbl, see you there | 20:59 |
| weshay | should we just chat now? | 20:59 |
| sshnaidm|bbl | weshay, we can | 21:00 |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ (1 more message) | 21:00 |
| weshay | sshnaidm|bbl, meh... it's not urget | 21:00 |
| weshay | urgent | 21:00 |
| sshnaidm|bbl | weshay, ok, then tomorrow | 21:00 |
| weshay | rlandy, this was fixed right? https://bugs.launchpad.net/tripleo/+bug/1773569 | 21:03 |
| openstack | Launchpad bug 1773569 in tripleo "TQE: ovb-create-stack.yml role overrides are not working as expected" [High,Triaged] - Assigned to Ronelle Landy (rlandy) | 21:03 |
| * weshay looks at code.eng | 21:03 | |
| rlandy | i don;t think I ever saw that problem | 21:04 |
| rlandy | I'll comment when I have this review in | 21:04 |
| weshay | rlandy, k | 21:04 |
| weshay | rlandy, no worries about that bug | 21:05 |
| rlandy | sorry -trying not to mess up this fs matrix | 21:05 |
| *** trown is now known as trown|outtypewww | 21:05 | |
| *** yolanda__ has joined #oooq | 21:18 | |
| weshay | rlandy, this seems to be working just fine for me https://review.openstack.org/#/c/579161/ | 21:19 |
| rlandy | weshay: happy to hear that | 21:20 |
| weshay | rlandy, how close are are we to taking off the WIP | 21:20 |
| rlandy | it's missing one change | 21:20 |
| rlandy | if you add that, sure | 21:20 |
| * rlandy gets | 21:20 | |
| *** yolanda_ has quit IRC | 21:21 | |
| rlandy | weshay: https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L19 | 21:22 |
| rlandy | ^^ missing that - after we add that, it can go out of WIP | 21:22 |
| *** tcw1 is now known as tcw | 21:37 | |
| *** agopi has joined #oooq | 22:10 | |
| *** yolanda_ has joined #oooq | 22:29 | |
| *** yolanda__ has quit IRC | 22:32 | |
| *** rlandy is now known as rlandy|bbl | 22:44 | |
| hubbot` | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ (1 more message) | 23:00 |
| *** tosky has quit IRC | 23:08 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!