| *** saneax has quit IRC | 00:13 | |
| *** dtrainor has joined #oooq | 00:22 | |
| *** saneax has joined #oooq | 00:46 | |
| *** Goneri has quit IRC | 00:53 | |
| hubbot1 | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, (2 more messages) | 01:40 |
|---|---|---|
| *** rlandy|bbl is now known as rlandy | 01:43 | |
| *** rlandy has quit IRC | 02:13 | |
| hubbot1 | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, (2 more messages) | 03:40 |
| *** jtomasek has joined #oooq | 03:41 | |
| *** jtomasek has quit IRC | 03:46 | |
| *** agopi|off has joined #oooq | 04:39 | |
| *** quiquell has joined #oooq | 05:38 | |
| *** quiquell is now known as quiquell|rover | 05:40 | |
| quiquell|rover | chkumar|ruck: hello | 05:40 |
| hubbot1 | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, (2 more messages) | 05:40 |
| quiquell|rover | damn we don't have te-broker ? | 05:44 |
| *** dtrainor has quit IRC | 06:09 | |
| sshnaidm|ptg | quiquell|rover, don't we? | 06:24 |
| sshnaidm|ptg | quiquell|rover, 602096 is still in gate :( | 06:24 |
| sshnaidm|ptg | quiquell|rover, after it's merged we should be good | 06:25 |
| quiquell|rover | sshnaidm|ptg: promotion is running now :-(, I think if we merge this today I will force periodics to run | 06:30 |
| quiquell|rover | sshnaidm|ptg: thanks | 06:32 |
| quiquell|rover | hubbot1: help | 06:38 |
| hubbot1 | quiquell|rover: (help [<plugin>] [<command>]) -- This command gives a useful description of what <command> does. <plugin> is only necessary if the command is in more than one plugin. You may also want to use the 'list' command to list all available plugins and commands. | 06:38 |
| quiquell|rover | hubbot1: help config | 06:38 |
| hubbot1 | quiquell|rover: (config <name> [<value>]) -- If <value> is given, sets the value of <name> to <value>. Otherwise, returns the current value of <name>. You may omit the leading "supybot." in the name if you so choose. | 06:38 |
| quiquell|rover | hubbot1: config.changeIDs | 06:40 |
| hubbot1 | quiquell|rover: Error: "config.changeIDs" is not a valid command. | 06:40 |
| quiquell|rover | hubbot1: config.GateStatus.changeIDs | 06:40 |
| hubbot1 | quiquell|rover: Error: "config.GateStatus.changeIDs" is not a valid command. | 06:40 |
| quiquell|rover | hubbot1: config GateStatus changeIDs | 06:40 |
| hubbot1 | quiquell|rover: Error: 'supybot.GateStatus' is not a valid configuration variable. | 06:40 |
| quiquell|rover | hubbot1: config.GateStatus changeIDs | 06:40 |
| hubbot1 | quiquell|rover: Error: "config.GateStatus" is not a valid command. | 06:40 |
| quiquell|rover | hubbot1: config plugins.GateStatus.changeIDs | 06:41 |
| hubbot1 | quiquell|rover: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 06:41 |
| quiquell|rover | sshnaidm|ptg: rocky is missing ? ^ | 06:41 |
| sshnaidm|ptg | If12c8fe9bd0bea98a4842f279399285344f22246 is problematic.. | 06:45 |
| sshnaidm|ptg | it's for multiple branches | 06:45 |
| quiquell|rover | sshnaidm|ptg: Going to make new ones for pike too | 06:45 |
| quiquell|rover | sshnaidm|ptg: Do I have permissions to add changes to hubbot ? | 06:45 |
| sshnaidm|ptg | I think do, just connect to hubbot server | 06:46 |
| sshnaidm|ptg | s/do/so | 06:46 |
| sshnaidm|ptg | quiquell|rover, sorry, too much drunk to write.. | 06:46 |
| quiquell|rover | sshnaidm|ptg: Hahaha you are my hero :-) | 06:47 |
| sshnaidm|ptg | quiquell|rover, well, If12c8fe9bd0bea98a4842f279399285344f22246 should be removed | 06:47 |
| quiquell|rover | sshnaidm|ptg: Will do go to bed man | 06:47 |
| sshnaidm|ptg | it has the same change id which causes hubbot to ducking fail | 06:48 |
| sshnaidm|ptg | quiquell|rover, will do man | 06:49 |
| quiquell|rover | hubbot1: config plugins.GateStatus.changeIDs I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab Ia5bcd5568086a6afbcebe4cbdc86c26502039f23 I67ba1d4f80d8cc34fd3735d647b62e3179aaaa14 | 06:49 |
| hubbot1 | quiquell|rover: Error: You don't have the owner capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified. | 06:49 |
| quiquell|rover | sshnaidm|ptg: ^ argg | 06:49 |
| sshnaidm|ptg | quiquell|rover, just do it in the server itself | 06:49 |
| quiquell|rover | sshnaidm|ptg: ack | 06:49 |
| sshnaidm|ptg | /opt/hubbot/hubbot.conf | 06:49 |
| sshnaidm|ptg | or duck kind of | 06:50 |
| quiquell|rover | hubbot1: config plugins.GateStatus.changeIDs | 07:00 |
| hubbot1 | quiquell|rover: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 07:00 |
| *** apetrich has quit IRC | 07:01 | |
| *** tesseract has joined #oooq | 07:01 | |
| rascasoft | quiquell|rover, hey have you ever seen this error I'm getting on Rocky in RDOPhase? https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/undercloud/home/stack/overcloud_deploy.log.txt.gz | 07:03 |
| rascasoft | quiquell|rover, what "jq: error: Could not open file /var/lib/heat-config/deployed/094fb881-a857-4957-a92d-dfd6c258f3dd.notify.json: No such file or directory" could mean? | 07:03 |
| quiquell|rover | rascasoft: Yes, I remember something | 07:04 |
| quiquell|rover | rascasoft: have to leave for a few, let's look at it later | 07:07 |
| *** quiquell|rover is now known as quique|rover|bbl | 07:07 | |
| quique|rover|bbl | hubbot1: config plugins.GateStatus.changeIDs | 07:07 |
| hubbot1 | quique|rover|bbl: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 07:07 |
| *** hubbot1 has quit IRC | 07:08 | |
| *** hubbot1 has joined #oooq | 07:08 | |
| quique|rover|bbl | hubbot1: config plugins.GateStatus.changeIDs | 07:08 |
| hubbot1 | quique|rover|bbl: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 07:08 |
| quique|rover|bbl | fuck | 07:09 |
| quique|rover|bbl | hubbot1: config plugins.GateStatus.changeIDs | 07:13 |
| hubbot1 | quique|rover|bbl: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 07:13 |
| *** hubbot1 has quit IRC | 07:17 | |
| *** hubbot1 has joined #oooq | 07:17 | |
| quique|rover|bbl | hubbot1: config plugins.GateStatus.changeIDs | 07:17 |
| hubbot1 | quique|rover|bbl: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 07:17 |
| quique|rover|bbl | Damn now I really leave | 07:18 |
| *** dtrainor has joined #oooq | 07:22 | |
| chkumar|ruck | quique|rover|bbl: Good mroning | 07:25 |
| *** quique|rover|bbl is now known as quiquell|rover | 07:41 | |
| quiquell|rover | chkumar|ruck: I am back | 07:41 |
| *** hubbot1 has quit IRC | 07:44 | |
| *** hubbot1 has joined #oooq | 07:44 | |
| chkumar|ruck | quiquell|rover: we need to wait for te-broker patch to land | 07:44 |
| quiquell|rover | hubbot1: config plugins.GateStatus.changeIDs | 07:45 |
| hubbot1 | quiquell|rover: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab Ia5bcd5568086a6afbcebe4cbdc86c26502039f23 I67ba1d4f80d8cc34fd3735d647b62e3179aaaa14 | 07:45 |
| quiquell|rover | chkumar|ruck: noop for rocky configured, going to push a change for the dashboard-ci | 07:45 |
| chkumar|ruck | quiquell|rover: https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-queens/85952e4/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-09-13_06_04_49 | 07:45 |
| chkumar|ruck | quiquell|rover: I have seen this issue twice in a week | 07:46 |
| chkumar|ruck | quiquell|rover: is it familiar? | 07:46 |
| quiquell|rover | chkumar|ruck: humm nope, but it's RDO related, and we have an outage the other day, maybe something is not right | 07:48 |
| rascasoft | quiquell|rover, chkumar|ruck, do you have time to take a look at https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/undercloud/home/stack/overcloud_deploy.log.txt.gz ? | 07:58 |
| quiquell|rover | rascasoft: Yep | 07:58 |
| quiquell|rover | rascasoft: looks like compute didn't start up, maybe ironic issue | 07:58 |
| quiquell|rover | rascasoft: wait non of them, similar I saw was only one compute in thise case is all of them | 07:59 |
| quiquell|rover | controllers and ocmputes | 08:00 |
| rascasoft | quiquell|rover, since I still have access to the env this sounds strange to me | 08:02 |
| rascasoft | quiquell|rover, all the overcloud nodes are up and running | 08:02 |
| quiquell|rover | rascasoft: Did we have problems with hardware at rocky in phase2 ? | 08:03 |
| rascasoft | quiquell|rover, what do you mean? | 08:03 |
| quiquell|rover | rascasoft: weshay say something about it yesterday, not much detail | 08:04 |
| rascasoft | quiquell|rover, machines are sane if you mean that | 08:04 |
| rascasoft | quiquell|rover, those were correctly introspected and provisioned | 08:05 |
| quiquell|rover | rascasoft: Looks like the deployment_uuid is wrong | 08:05 |
| rascasoft | quiquell|rover, what is the deployment_uuid | 08:06 |
| rascasoft | ? | 08:06 |
| *** bogdando has joined #oooq | 08:13 | |
| *** d0ugal has joined #oooq | 08:20 | |
| *** d0ugal has quit IRC | 08:29 | |
| *** d0ugal has joined #oooq | 08:29 | |
| *** d0ugal has quit IRC | 08:35 | |
| *** ykarel|away has joined #oooq | 08:36 | |
| *** d0ugal has joined #oooq | 08:36 | |
| *** d0ugal has quit IRC | 08:44 | |
| *** d0ugal has joined #oooq | 08:44 | |
| chkumar|ruck | looking | 08:54 |
| quiquell|rover | chkumar|ruck: #tripleo | 08:56 |
| quiquell|rover | chkumar|ruck: We have make some investigations already | 08:56 |
| chkumar|ruck | ack | 08:56 |
| *** ykarel|away has quit IRC | 09:00 | |
| *** quiquell|rover is now known as mistral-bot | 09:04 | |
| *** dtantsur|afk is now known as dtantsur | 09:04 | |
| *** mistral-bot is now known as quiquell|rover | 09:04 | |
| quiquell|rover | chkumar|ruck: featureset019 has failed in rocky | 09:10 |
| chkumar|ruck | quiquell|rover: it is witht he same mistral error state | 09:11 |
| chkumar|ruck | quiquell|rover: sorry | 09:14 |
| quiquell|rover | chkumar|ruck: We don't have new master runs... | 09:17 |
| quiquell|rover | chkumar|ruck: Ok mistral timeout there | 09:17 |
| quiquell|rover | chkumar|ruck: Again let's wait for tebroker and we re run periodics | 09:17 |
| chkumar|ruck | quiquell|rover: failed at overcloud deploy , itrying to understand from puppet failure | 09:18 |
| quiquell|rover | chkumar|ruck: Have abug for it | 09:18 |
| quiquell|rover | chkumar|ruck: https://bugs.launchpad.net/tripleo/+bug/1792296 | 09:18 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell) | 09:18 |
| quiquell|rover | chkumar|ruck: I think is transitory, but take a look deeper | 09:18 |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, (3 more messages) | 09:44 |
| chkumar|ruck | quiquell|rover: regarding above bug | 09:52 |
| chkumar|ruck | based on my investigation, manila and glance api died dbconnection error | 09:52 |
| chkumar|ruck | which resulted in timed out | 09:52 |
| * chkumar|ruck updates the bug | 09:53 | |
| quiquell|rover | chkumar|ruck: So feels like transitory stuff | 09:53 |
| chkumar|ruck | yes | 09:53 |
| quiquell|rover | chkumar|ruck: What a week man :-( | 09:53 |
| *** dtrainor_ has joined #oooq | 09:54 | |
| chkumar|ruck | quiquell|rover: yes | 09:57 |
| *** dtrainor has quit IRC | 09:58 | |
| chkumar|ruck | quiquell|rover: I will vanish any time as today is holiday here but will back in evening | 09:58 |
| *** dtrainor__ has joined #oooq | 09:59 | |
| quiquell|rover | chkumar|ruck: No problem, take your time | 09:59 |
| *** dtrainor_ has quit IRC | 10:01 | |
| *** saneax has quit IRC | 10:02 | |
| quiquell|rover | chkumar|ruck: Can we summarize ? | 10:05 |
| quiquell|rover | chkumar|ruck: about manila issue ? | 10:05 |
| chkumar|ruck | quiquell|rover: sure, getting the data at one place | 10:09 |
| quiquell|rover | chkumar|ruck: Add it to the etherpad | 10:10 |
| quiquell|rover | chkumar|ruck: fs019 failed again in the same point | 10:13 |
| quiquell|rover | chkumar|ruck: Looks like it's not transitory, let me dig | 10:13 |
| quiquell|rover | https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-13_09_00_52 | 10:14 |
| chkumar|ruck | quiquell|rover: I looked throigh exeqution id in mistral execution log nothing found | 10:16 |
| quiquell|rover | Looks like MySQL is no tup | 10:17 |
| quiquell|rover | same for manila | 10:18 |
| chkumar|ruck | quiquell|rover: the same error message in master and rocky | 10:18 |
| chkumar|ruck | yes | 10:18 |
| quiquell|rover | chkumar|ruck: Let's talk about it in #tripleo | 10:18 |
| quiquell|rover | more chances someone say something | 10:18 |
| *** dtrainor_ has joined #oooq | 11:04 | |
| *** dtrainor__ has quit IRC | 11:06 | |
| *** d0ugal has quit IRC | 11:07 | |
| *** d0ugal has joined #oooq | 11:08 | |
| *** dtrainor__ has joined #oooq | 11:09 | |
| *** dtrainor_ has quit IRC | 11:11 | |
| quiquell|rover | chkumar|ruck: we dont have tripleo-ci-centos-7-undercloud-oooq in master | 11:23 |
| quiquell|rover | It's featureset003 not in the promotion criteria | 11:26 |
| quiquell|rover | But it's in the gates | 11:26 |
| *** jtomasek has joined #oooq | 11:27 | |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, (3 more messages) | 11:44 |
| *** saneax has joined #oooq | 11:45 | |
| quiquell|rover | chkumar|ruck: Let's update CIX card to make the meeting short | 11:57 |
| *** apetrich has joined #oooq | 11:58 | |
| chkumar|ruck | quiquell|rover: ack | 11:59 |
| chkumar|ruck | quiquell|rover: https://trello.com/c/BgBpry6v/739-cixlp1792343tripleociproa-tripleo-rocky-baremetal-deployment-fails-with-jq-error-could-not-open-file-var-lib-heat-config-deploye one untriaged | 12:02 |
| chkumar|ruck | what should be RCA and which dfg will own it | 12:02 |
| *** apetrich has quit IRC | 12:10 | |
| *** apetrich has joined #oooq | 12:11 | |
| *** jtomasek has quit IRC | 12:28 | |
| *** rlandy has joined #oooq | 12:35 | |
| quiquell|rover | chkumar|ruck: Do you know if tebroker tenant instant will kick in automatically or do we have to execute something ? | 12:39 |
| quiquell|rover | sshnaidm|ptg: ^ ? | 12:39 |
| chkumar|ruck | quiquell|rover: no idea | 12:42 |
| chkumar|ruck | quiquell|rover: going out, will come online in night see ya | 12:44 |
| quiquell|rover | chkumar|ruck: See you man, will continue with the virtualenv stuff in case it progresses | 12:44 |
| quiquell|rover | chkumar|ruck: enjoy | 12:44 |
| rlandy | quiquell|rover, chkumar|ruck; I'll check the te-broker | 12:48 |
| quiquell|rover | rlandy: cool! | 12:49 |
| quiquell|rover | rlandy: thanks so much | 12:49 |
| quiquell|rover | I supose is about running the infra-setup stuff, but that's dangerous | 12:49 |
| rlandy | quiquell|rover: it looks like there are stacks created today | 12:49 |
| rlandy | 730e7be2-c228-48d8-be08-56bd768d3ea3 | baremetal_9 | CREATE_COMPLETE | 2018-09-13T11:47:15Z | None | 12:49 |
| rlandy | we should be able to check the logs as well | 12:50 |
| quiquell|rover | rlandy: I don't see tebroker at tripleo-infra tenant | 12:50 |
| rlandy | quiquell|rover: it's in openstack-nodepool | 12:51 |
| rlandy | it has to be in the same tenant as the stacks it creates | 12:51 |
| quiquell|rover | rlandy: ack | 12:51 |
| rlandy | do you have the access creds for that tenant? | 12:51 |
| quiquell|rover | rlandy: Let's re-sping the promotion jobs | 12:51 |
| rlandy | quiquell|rover: | 0b820839-86a7-4f03-ae92-9178ef71449b | te-broker | ACTIVE | private=192.168.100.250 | 12:52 |
| rlandy | instance is there and active | 12:52 |
| quiquell|rover | rlandy: Cool, then we are good | 12:53 |
| * rlandy digs for the logs | 12:53 | |
| quiquell|rover | rlandy: https://review.rdoproject.org/r/16257 | 12:54 |
| quiquell|rover | To run periodics in half an hour | 12:54 |
| rlandy | quiquell|rover: do we really need to do that? wouldn't they kick soon enough? | 12:55 |
| rlandy | how desperate are we?? | 12:55 |
| *** jtomasek has joined #oooq | 12:56 | |
| quiquell|rover | rlandy: very, timeout at gates are also related to promotions | 12:56 |
| *** jtomasek has quit IRC | 12:56 | |
| quiquell|rover | rlandy: queens 21d without promotions for example | 12:56 |
| quiquell|rover | rlandy: master is pretty old too | 12:57 |
| rlandy | when was the last start time? | 12:57 |
| quiquell|rover | rlandy: and the timeout thing is a problem for fixing stuff too | 12:57 |
| quiquell|rover | at 4 UTC | 12:57 |
| quiquell|rover | all the OVBs failed | 12:59 |
| quiquell|rover | So tebroker was not up | 12:59 |
| rlandy | in the last run | 13:00 |
| rlandy | https://review.openstack.org/#/c/602096/ was needed | 13:00 |
| rlandy | and only merged an hour ago | 13:00 |
| quiquell|rover | rlandy: Yup that why we want a re-run | 13:01 |
| rlandy | quiquell|rover: ok - let's kick it as long as you have an immediate revert | 13:01 |
| rlandy | to the time change | 13:01 |
| quiquell|rover | rlandy: At least queens is suppose to promote | 13:01 |
| quiquell|rover | rlandy: sure, let's do the revert after it kicks in | 13:01 |
| rlandy | quiquell|rover, https://review.rdoproject.org/r/#/c/16257/ w+1 | 13:02 |
| rlandy | please submit the revert patch | 13:02 |
| rlandy | are we meeting??? | 13:03 |
| rlandy | myoung:^^? | 13:03 |
| myoung | rlandy: I had assumed so, i'm in channel now, but not sure what's up with PTG folk | 13:03 |
| rlandy | quiquell|rover: ^^ | 13:04 |
| quiquell|rover | rlandy: thanks, the revert https://review.rdoproject.org/r/#/c/16258/ | 13:04 |
| quiquell|rover | rlandy: Let's merge the revert after jobs started up | 13:04 |
| rlandy | quiquell|rover: ack - as soon as the jobs starts, I'll +2 your revert | 13:05 |
| *** panda|ptg has joined #oooq | 13:06 | |
| quiquell|rover | rlandy: thanks | 13:06 |
| quiquell|rover | rlandy, panda|ptg: emilien's patch to fix rocky gates https://review.openstack.org/#/c/602042/ | 13:07 |
| quiquell|rover | just missing the +2 it already has the +w | 13:07 |
| rlandy | quiquell|rover:it has a +2 and a w | 13:08 |
| quiquell|rover | rlandy: is missing another +2 no ? | 13:08 |
| rlandy | quiquell|rover: not technically required | 13:08 |
| rlandy | just a convention | 13:08 |
| quiquell|rover | Then, why is not in the gates ? | 13:08 |
| rlandy | I can't +2 undercloud repos | 13:08 |
| quiquell|rover | Depends-On are merged too :-/ | 13:09 |
| rlandy | checking | 13:09 |
| rlandy | quiquell|rover: one sec - talking to myoung | 13:10 |
| *** jtomasek has joined #oooq | 13:10 | |
| rascasoft | myoung, hi you around? so about rhos-dev jenkins we need an upgrade from 2.60.3 to 2.121.3, do you see it as a problem or can we plan to do it ASAP? | 13:11 |
| rascasoft | myoung, I'm talking of course about the influxdb plugin | 13:12 |
| rlandy | quiquell|rover: sorry - back with you | 13:12 |
| myoung | rascasoft: hiya | 13:12 |
| * rlandy checks patch | 13:12 | |
| myoung | rascasoft: let me see what the latest CSB jenkins (supported version) is | 13:13 |
| myoung | rascasoft: hop in my BJ if you want, i'm there | 13:13 |
| myoung | https://bluejeans.com/7050859455 | 13:13 |
| myoung | rascasoft: looking at https://projects.engineering.redhat.com/browse/CENTRALCI-2655, I say we let them go ahead and upgrade it. It's painless and they will just do it for us. | 13:14 |
| myoung | rascasoft: we can run a quick test as well (stand up jenkins 2.121.33 test server, fire off JJB at it to see if there's any issue) | 13:15 |
| myoung | rascasoft: the issues we might expect to find are if some plugin that we're using in our existing JJB has been deprecated, but that's easy to fix, and afaik I've already removed all the stuff that was generating warnings already | 13:16 |
| rlandy | quiquell|rover: no idea why we don't see gate jobs on that - maybe because the depends merged at 1:04 and it was workflow'ed before | 13:16 |
| rlandy | if you recheck it gates should kick | 13:16 |
| quiquell|rover | rlandy: could be | 13:17 |
| *** jtomasek has quit IRC | 13:17 | |
| rlandy | quiquell|rover: zuul is it's own special little world | 13:19 |
| rlandy | quiquell|rover: anything else you need me to look at? I see you are flying solo here | 13:20 |
| * rlandy checks rdo jobs | 13:20 | |
| rlandy | quiquell|rover: ovb jobs look functional now ... https://review.rdoproject.org/zuul/stream.html?uuid=c905be6093bb40ad92cb38c1a372e161&logfile=console.log | 13:22 |
| quiquell|rover | rlandy: cool :-) we need a promotion so much | 13:22 |
| rlandy | quiquell|rover: k - go4it | 13:22 |
| quiquell|rover | rlandy: +w here https://review.openstack.org/#/c/601522/ | 13:22 |
| quiquell|rover | rlandy: we are also facing fs019 issues with haproxy but we are on it | 13:23 |
| quiquell|rover | rlandy: thanks | 13:23 |
| *** quiquell|rover is now known as quique|rover|lch | 13:23 | |
| rlandy | looking | 13:28 |
| rlandy | quique|rover|lch: https://review.openstack.org/#/c/601522/ w'ed | 13:29 |
| myoung | rascasoft: https://trello.com/c/k2EmHA4U/26-mvp-dlrn-api-for-downstream | 13:29 |
| myoung | rascasoft: https://trello.com/c/k2EmHA4U/26-mvp-dlrn-api-for-downstream#comment-5af48fadbd13a233d15fbcda | 13:29 |
| myoung | rascasoft: ruck/rover cockpit dashboard; https://docs.google.com/document/d/1MHflTy9krTFGrZ4nL_PG4AJDlcynWVkau9Mjvnkq094/edit (quique|rover|lch is an expert here) | 13:33 |
| rlandy | quique|rover|lch, https://review.openstack.org/#/c/601522/ still needs to complete recheck | 13:38 |
| rlandy | myoung: who owns the jenkins we use? | 13:38 |
| *** jaganathan has quit IRC | 13:43 | |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, (3 more messages) | 13:44 |
| *** thrash has joined #oooq | 13:46 | |
| *** thrash has quit IRC | 13:46 | |
| *** thrash has joined #oooq | 13:46 | |
| *** thrash is now known as thrash|biab | 13:48 | |
| chkumar|ruck | rlandy: need +w on this https://review.openstack.org/#/c/599355/ | 13:52 |
| quique|rover|lch | /nick quiquell|rover | 13:54 |
| *** quique|rover|lch is now known as quiquell|rover | 13:54 | |
| quiquell|rover | lowtech | 13:54 |
| quiquell|rover | :-) | 13:54 |
| rlandy | chkumar|ruck: done | 13:55 |
| chkumar|ruck | Hope both patches gets merged by the mercy of ci | 13:55 |
| chkumar|ruck | rlandy: https://review.openstack.org/602347 please have a look this one also | 13:56 |
| *** d0ugal has quit IRC | 13:56 | |
| *** d0ugal has joined #oooq | 13:56 | |
| quiquell|rover | chkumar|ruck: would be nice... in this infernal week | 13:56 |
| quiquell|rover | chkumar|ruck: promotion kicking it | 13:56 |
| quiquell|rover | chkumar|ruck: I mean jobs not promotion :-/ | 13:57 |
| quiquell|rover | myoung, rascasoft: what's up with dashboard-ci ? | 13:57 |
| rlandy | chkumar|ruck: would have to test that one out - also would like to see ci results before voting | 13:59 |
| myoung | rlandy: regarding jenkins, it's owned and managed by the RH Central CI group | 14:00 |
| quiquell|rover | myoung: What you were saying about dashboard-ci ? | 14:01 |
| rlandy | is this correct - to join with a newline? '{{ subnodes | join("\n") }}' | 14:04 |
| rlandy | quiquell|rover: rfolco: ^^ | 14:04 |
| quiquell|rover | humm | 14:05 |
| rlandy | save me the testing here :) | 14:05 |
| quiquell|rover | I prefer python way | 14:05 |
| quiquell|rover | "\n".join(subnodes) | 14:05 |
| rlandy | yeah - I thought of that ... | 14:05 |
| *** vinaykns has joined #oooq | 14:05 | |
| rlandy | sub_nodes="{{ subnodes | join(' ') }}" | 14:05 |
| rlandy | ^^ doing that atm | 14:05 |
| rlandy | but actually it's a newline split | 14:05 |
| quiquell|rover | same thing... don't know what happends with undef tough | 14:06 |
| rlandy | and we have no real test it | 14:06 |
| rlandy | test of it | 14:06 |
| rlandy | as there is never more that one subnode atm | 14:06 |
| quiquell|rover | rlandy: subnode elements are strings or dictionaries ? | 14:07 |
| rlandy | quiquell|rover: we are creating them as in https://review.openstack.org/#/c/596906/17/roles/undercloud-setup/tasks/vxlan_networking.yml | 14:08 |
| rlandy | list | 14:09 |
| quiquell|rover | rlandy: this works ? | 14:09 |
| rlandy | maybe the space will work just fine | 14:09 |
| rlandy | which part of this? | 14:09 |
| rlandy | the whole thing is a ridiculous legacy patch | 14:10 |
| rlandy | truth is there is really always only one node | 14:10 |
| rlandy | so it really doen't matter | 14:10 |
| quiquell|rover | subnodes: "{{ nodes.stdout_lines }}" is not enough ? | 14:10 |
| rlandy | I just want to do the right thing here | 14:10 |
| rlandy | I am changing that | 14:11 |
| myoung | quiquell|rover: rascasoft is looking at building dashboards to express what's happening for internal CI. He's looking at a stack w/ influxdb and grafana, I pointed him at what you've built | 14:11 |
| quiquell|rover | And remove the when ? | 14:11 |
| rlandy | wich when? | 14:11 |
| quiquell|rover | task on line 18 | 14:11 |
| rlandy | no - the when stays | 14:11 |
| rlandy | that is different | 14:11 |
| quiquell|rover | myoung: ack | 14:12 |
| quiquell|rover | rlandy: instead of joining subnode, maybe you just need to use "nodes" it has already a newline list ? | 14:13 |
| quiquell|rover | rascasoft: you there ? | 14:13 |
| rlandy | nodes from where? | 14:15 |
| quiquell|rover | I see you are reading {{ nodes }} iterating over it and storing it a subnodes | 14:16 |
| quiquell|rover | but nodes.stdout_lines already give you the list | 14:16 |
| rlandy | oh I see | 14:16 |
| quiquell|rover | you just need to copy this list to the fact | 14:16 |
| quiquell|rover | and remove the when and also the empty subnodes as you have already the defaulting | 14:17 |
| rlandy | well, nodes only exists if you have the /etc/nodepool files | 14:17 |
| rlandy | which w will remove | 14:17 |
| quiquell|rover | also vlxlan_networking.yaml is the same a overclud and undercloud | 14:17 |
| quiquell|rover | then you just need a when statement | 14:18 |
| quiquell|rover | for defined and store subnodes: nodes.stdout_lines | 14:18 |
| quiquell|rover | so you don't have to iterate | 14:18 |
| quiquell|rover | rlandy: if the sub_nodes_private does not exists the block is going to stop ? | 14:19 |
| rlandy | quiquell|rover: so - I think if ... | 14:20 |
| quiquell|rover | Ahh i see ok | 14:20 |
| rlandy | I just use subnodes='{{ nodes.stdout_lines | default([]) }} | 14:20 |
| quiquell|rover | so it's quite simple just one task doing set_fact: subnodes: "{{ nodes.stdout_lines |default([]) }}" | 14:20 |
| quiquell|rover | yep | 14:20 |
| rlandy | then I can assign sub_nodes="{{ subnodes }}" | 14:20 |
| quiquell|rover | and remove the create empty | 14:20 |
| rlandy | and it will have the right newline spacing | 14:21 |
| quiquell|rover | nope | 14:21 |
| quiquell|rover | the avobe just simplifies | 14:21 |
| quiquell|rover | you still have a list not a string with newlines | 14:21 |
| quiquell|rover | where do you need the list separated by newlines ? | 14:21 |
| quiquell|rover | Also with slurp you can remove the cat over sub_nodes_private | 14:22 |
| quiquell|rover | https://docs.ansible.com/ansible/2.6/modules/slurp_module.html | 14:23 |
| quiquell|rover | rlandy: where do you do the sub_nodes=... ? | 14:23 |
| rlandy | quiquell|rover: only in the template | 14:24 |
| rlandy | https://review.openstack.org/#/c/596906/ updated | 14:24 |
| rlandy | this is really all going away | 14:24 |
| weshay | chkumar|ruck, quiquell|rover :) ovb is back | 14:25 |
| weshay | the root cause was infra deleted the te-broker | 14:25 |
| rlandy | quiquell|rover: ok if I +2 the revert now? | 14:25 |
| *** agopi|off is now known as agopi | 14:26 | |
| quiquell|rover | weshay: yep we know, we kicked in a promotion, we need it | 14:26 |
| weshay | quiquell|rover, chkumar|ruck aye.. it merged 3hrs ago.. so the current promotion is foooooked | 14:26 |
| weshay | don't stress i | 14:26 |
| weshay | it | 14:26 |
| quiquell|rover | weshay: we have master promotion blocker for fs019 regarding haproxy not starting up | 14:26 |
| weshay | k | 14:27 |
| quiquell|rover | weshay: new sh... is in the etherpad https://review.rdoproject.org/etherpad/p/ruckrover-sprint19 | 14:27 |
| rlandy | stdout_lines is a list of strings, each containing one item per line from the original output. | 14:27 |
| weshay | k | 14:27 |
| quiquell|rover | rlandy: yep, you need to join them | 14:27 |
| weshay | rlandy, you have luck w/ osp14? | 14:27 |
| weshay | rlandy, welcome back | 14:27 |
| rlandy | thanks - rhos-14 failed undercloud install - checking on that | 14:28 |
| quiquell|rover | rlandy, weshay: rhos-14 can be affected by this https://review.openstack.org/#/c/602042/ ? | 14:29 |
| quiquell|rover | rhos 14 is rocky ? | 14:29 |
| weshay | ya | 14:30 |
| chkumar|ruck | rlandy: ack | 14:30 |
| quiquell|rover | so maybe the rocky gate issue it's what apperas at rlandy deploy | 14:30 |
| rlandy | quiquell|rover: actually, I think the original was wrong - I think the join with the space is right | 14:30 |
| quiquell|rover | rlandy: yep you need the join, but the other stuff get simpler | 14:30 |
| rlandy | quiquell|rover: if you look at this stuff to long, it all gets messed up in your head :( | 14:31 |
| * rlandy gets rhos-14 error | 14:31 | |
| quiquell|rover | rlandy: sure it does hehe, in the template you can use the register from the cat though | 14:31 |
| quiquell|rover | rlandy: so you don't need the join | 14:31 |
| rlandy | quiquell|rover: no - the cat doesn't always exist though | 14:32 |
| *** thrash|biab is now known as thrash | 14:32 | |
| rlandy | anyways, I think will work | 14:32 |
| rlandy | just legacy we will delete next week | 14:32 |
| quiquell|rover | rlandy: you have a chek before | 14:32 |
| quiquell|rover | ahh ok | 14:32 |
| quiquell|rover | you are right | 14:32 |
| rlandy | at least I am right about something today | 14:33 |
| quiquell|rover | bah just keep the join | 14:33 |
| rlandy | yeah - I did | 14:33 |
| rlandy | with a space | 14:33 |
| quiquell|rover | it's not supose to be newlines ? | 14:33 |
| rlandy | you just land up confusing yourself the more you think about it | 14:33 |
| rlandy | it's not going to matter | 14:34 |
| rlandy | we never have more than one subnode that uses this code | 14:34 |
| quiquell|rover | yep, also I have my brain is "pure" right now | 14:34 |
| rlandy | weshay: how's it going at PTG? anything we should listen today of today's meetings? | 14:35 |
| rlandy | quiquell|rover: back to ovb - can I +2 the revert? | 14:37 |
| quiquell|rover | rlandy: sure | 14:37 |
| rlandy | quiquell|rover: k - can you post link again? | 14:38 |
| weshay | rlandy, I suspect you guys could not hear much | 14:38 |
| quiquell|rover | rlandy: https://review.rdoproject.org/r/#/c/16258/ | 14:38 |
| rlandy | weshay: I could here you a bit and the person sitting next to Emilien (Alex maybe?) - everyone else was a wash | 14:39 |
| weshay | everyone is pretty jazzed about the standalone | 14:39 |
| weshay | meh.. I'll give a full report when we're back.. I'll look at the agenda | 14:39 |
| weshay | rlandy, how well can you guys hear on blue? | 14:40 |
| rlandy | weshay: hit or miss | 14:40 |
| rlandy | depends how far the speaker is | 14:40 |
| rlandy | probably not worth it | 14:40 |
| bogdando | PTAL https://review.openstack.org/#/c/594055/ looking for 2nd +2 :) | 14:40 |
| rlandy | you hear a lot of mumbling | 14:40 |
| rlandy | quiquell|rover: ok revert is +2 and w+ | 14:41 |
| quiquell|rover | rlandy: ack, will drop now, and put back my real brain | 14:42 |
| bogdando | and a few more https://review.openstack.org/#/c/593103/ https://review.openstack.org/#/c/595265/ please | 14:42 |
| rlandy | quiquell|rover: ok - does that mean I am watching promotions? | 14:43 |
| weshay | chkumar|ruck, can you update this? https://review.openstack.org/#/c/572830/15/config/general_config/featureset052.yml | 14:43 |
| weshay | chkumar|ruck, and https://review.openstack.org/#/c/600586/2/roles/validate-tempest/templates/configure-tempest.sh.j2 | 14:45 |
| weshay | arxcruz|ptg, ^ | 14:45 |
| *** zul has joined #oooq | 14:45 | |
| weshay | let's get the standalone job back to voting please | 14:45 |
| quiquell|rover | weshay what's missing to get it voting ? | 14:46 |
| weshay | quiquell|rover, it was voting | 14:46 |
| weshay | alex made it non-voting because tempest was not running | 14:46 |
| quiquell|rover | weshay: ack | 14:46 |
| weshay | FYI.. all... we have approval to merge tq and tqe into one repo | 14:47 |
| weshay | panda|ptg, is working on that now | 14:47 |
| rlandy | oh wow | 14:47 |
| quiquell|rover | new name too ? | 14:47 |
| panda|ptg | tripleo-wow | 14:48 |
| quiquell|rover | triplewow | 14:48 |
| panda|ptg | tripleo-slowstart | 14:48 |
| rlandy | panda|ptg: see my email explanation? | 14:48 |
| quiquell|rover | hahaha rlandy found you :-) | 14:48 |
| rlandy | tripleo-oh-no | 14:48 |
| chkumar|ruck | weshay: ack | 14:49 |
| chkumar|ruck | 3o | 14:49 |
| panda|ptg | rlandy: yes thanks | 14:49 |
| rlandy | quiquell|rover: yep - you can run but you can't hide | 14:50 |
| weshay | bogdando, +2 | 14:50 |
| chkumar|ruck | weshay: working on it | 14:50 |
| weshay | chkumar|ruck, you can patch on top if needed.. | 14:51 |
| weshay | would follow alex's lead | 14:51 |
| chkumar|ruck | weshay: I am updating the same pathcset | 14:51 |
| weshay | chkumar|ruck, thanks | 14:52 |
| weshay | chkumar|ruck, he's online now | 14:53 |
| bogdando | weshay: \o/ | 14:53 |
| bogdando | thanks | 14:53 |
| *** quiquell|rover has quit IRC | 14:57 | |
| *** jaosorior has joined #oooq | 14:59 | |
| *** d0ugal has quit IRC | 14:59 | |
| *** jtomasek has joined #oooq | 15:01 | |
| *** dtrainor_ has joined #oooq | 15:10 | |
| *** dtrainor__ has quit IRC | 15:12 | |
| *** sshnaidm|ptg has quit IRC | 15:14 | |
| *** dtrainor__ has joined #oooq | 15:14 | |
| *** sshnaidm|ptg has joined #oooq | 15:14 | |
| *** jrist has joined #oooq | 15:15 | |
| *** holser|ptg has joined #oooq | 15:15 | |
| rlandy | weshay; https://code.engineering.redhat.com/gerrit/150055 Move rhos-14 release file to passed p2 - review pls | 15:16 |
| arxcruz|ptg | weshay: done | 15:17 |
| arxcruz|ptg | chkumar|ruck: still around ? | 15:17 |
| *** dtrainor_ has quit IRC | 15:17 | |
| chkumar|ruck | arxcruz|ptg: yup | 15:17 |
| arxcruz|ptg | chkumar|ruck: https://review.rdoproject.org/r/#/c/16216/ | 15:17 |
| chkumar|ruck | arxcruz|ptg: will take a look | 15:18 |
| arxcruz|ptg | chkumar|ruck: thanks ! | 15:18 |
| chkumar|ruck | arxcruz|ptg: is there any browbeat people at ptg? | 15:18 |
| arxcruz|ptg | chkumar|ruck: no idea | 15:19 |
| arxcruz|ptg | rlandy: so, did ospd13 pass ? | 15:19 |
| arxcruz|ptg | :) | 15:19 |
| rlandy | arxcruz|ptg: it did indeed | 15:19 |
| rlandy | with kvm | 15:19 |
| chkumar|ruck | just wanted to check how they are consuming tempest inside browbeat | 15:19 |
| weshay | rlandy, merged | 15:19 |
| rlandy | thanks | 15:19 |
| rlandy | we had container issue before - p2 should be more stable | 15:20 |
| *** chem has joined #oooq | 15:22 | |
| *** tosky has joined #oooq | 15:25 | |
| chkumar|ruck | arxcruz|ptg: Can I consume your stackviz apckage in tripleo ci and install it there and try out? | 15:25 |
| arxcruz|ptg | chkumar|ruck: is the package already being generated? if so, yeah, go for it :) | 15:26 |
| chkumar|ruck | arxcruz|ptg: no no time to use depends on rdo in openstack infra | 15:26 |
| arxcruz|ptg | chkumar|ruck: can you do that? | 15:31 |
| chkumar|ruck | arxcruz|ptg: trying out sir | 15:33 |
| *** dtrainor__ has quit IRC | 15:34 | |
| *** dtrainor__ has joined #oooq | 15:34 | |
| rlandy | chkumar|ruck: I think we need to recheck https://review.openstack.org/#/c/602042/ | 15:35 |
| rlandy | gates did not start | 15:35 |
| rlandy | chatted with quiquell about it above | 15:35 |
| rlandy | oh nvm | 15:36 |
| rlandy | already rechecked | 15:36 |
| rlandy | refresh on page helps :) | 15:36 |
| chkumar|ruck | rlandy: thanks for letting us know :-) | 15:42 |
| rlandy | weshay: what's the deal with the vexhost work? how closely should we be tracking those reviews? | 15:42 |
| weshay | rlandy, just an eye | 15:43 |
| rlandy | chkumar|ruck: sorry - ignore me - I missed that quique already rechecked it | 15:43 |
| weshay | rlandy, the communication has been pretty crappy about it | 15:43 |
| weshay | so.. might as well watch the struggle in real time | 15:43 |
| *** hamzy has quit IRC | 15:43 | |
| rlandy | weshay: there is a lot going on in those reviews - don't want vexhost to arrive one day and never thought it look at it | 15:43 |
| *** dtrainor_ has joined #oooq | 15:44 | |
| weshay | rlandy, right | 15:44 |
| rlandy | vexxhost | 15:44 |
| rlandy | mustn't forget the xx | 15:44 |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, (3 more messages) | 15:44 |
| *** dtrainor__ has quit IRC | 15:46 | |
| *** yolanda has joined #oooq | 15:55 | |
| *** bogdando has quit IRC | 15:57 | |
| *** kopecmartin has joined #oooq | 16:05 | |
| *** vinaykns has quit IRC | 16:11 | |
| *** Goneri has joined #oooq | 16:13 | |
| rlandy | rfolco: fyi ... https://review.openstack.org/#/c/601584 | 16:16 |
| rlandy | doesn't work for me | 16:16 |
| rfolco | rlandy, ouch | 16:16 |
| rfolco | need to find a better place then | 16:16 |
| rlandy | either in the wrong place or the wring host | 16:16 |
| rlandy | wrong | 16:16 |
| rfolco | oh wait.... ovb? | 16:17 |
| rfolco | that one applies for baremetal (libvirt) | 16:17 |
| rlandy | I am baremetal | 16:18 |
| rlandy | barmetal with virt undercloud | 16:18 |
| rlandy | problem is the same | 16:18 |
| rlandy | overcloud nodes are not added at that point | 16:18 |
| rfolco | ok, let me see if i add the role somewhere else | 16:18 |
| rfolco | rlandy, did you test manually ? how did you test? | 16:19 |
| *** dtrainor_ has quit IRC | 16:24 | |
| *** dtrainor has joined #oooq | 16:28 | |
| *** jaganathan has joined #oooq | 16:30 | |
| *** jaganathan has quit IRC | 16:30 | |
| *** jaganathan has joined #oooq | 16:30 | |
| *** dtantsur is now known as dtantsur|afk | 16:43 | |
| *** kopecmartin_ has joined #oooq | 16:45 | |
| *** kopecmartin_ has quit IRC | 16:45 | |
| rlandy | rfolco: added your review to https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-rhos-13-passed-p2-baremetal-hp_dl360_envE-single_nic_vlans/8/consoleFull | 16:52 |
| rfolco | rlandy, cool, working on that change now | 16:54 |
| *** tesseract has quit IRC | 17:00 | |
| *** brault has quit IRC | 17:00 | |
| *** vinaykns has joined #oooq | 17:01 | |
| *** brault has joined #oooq | 17:02 | |
| *** brault has quit IRC | 17:05 | |
| *** jtomasek has quit IRC | 17:06 | |
| *** jtomasek has joined #oooq | 17:09 | |
| *** brault has joined #oooq | 17:12 | |
| sshnaidm|ptg | rfolco, rlandy I left some comments in https://review.openstack.org/#/c/596887 , it's not critical and could be changed in next patches, no need to block it | 17:15 |
| sshnaidm|ptg | rlandy, rfolco for this to work https://review.openstack.org/#/c/596906/ - maybe we need dependencies on other patches | 17:16 |
| *** hamzy has joined #oooq | 17:18 | |
| rlandy | k - will look in a sec | 17:19 |
| *** dtrainor_ has joined #oooq | 17:28 | |
| *** dtrainor has quit IRC | 17:30 | |
| *** dtrainor__ has joined #oooq | 17:32 | |
| *** dtrainor_ has quit IRC | 17:35 | |
| rlandy | rfolco: https://review.openstack.org/#/c/601584/3/playbooks/baremetal-full-overcloud.yml - may need to move after inventory | 17:40 |
| rlandy | sshnaidm|ptg: can you explain your comment that http://logs.openstack.org/06/596906/19/check/tripleo-ci-centos-7-containers-multinode-pike/6fa495a/logs/undercloud/home/zuul/deployed_server_prepare.sh.txt.gz sis not work | 17:42 |
| rlandy | did not work | 17:42 |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, (3 more messages) | 17:44 |
| sshnaidm|ptg | rlandy, as I understand it should be IPs in that file, but we still have subnode file like: (sed -n 1,1p /etc/nodepool/sub_nodes_private) | 17:56 |
| *** dtrainor_ has joined #oooq | 17:58 | |
| rfolco | rlandy, after? after overcloud-deploy role there is no point in setting libvirt_type | 17:59 |
| rlandy | no - in that role after inventory | 17:59 |
| *** dtrainor__ has quit IRC | 18:00 | |
| *** zul has quit IRC | 18:00 | |
| *** dtrainor__ has joined #oooq | 18:01 | |
| rlandy | sshnaidm|ptg: it can be overwritten ... https://github.com/openstack/tripleo-quickstart/commit/b1c53d911621d2079cca423fe1bce344a916abeb | 18:01 |
| rlandy | just merged | 18:02 |
| sshnaidm|ptg | rlandy, ok, let's rebase it then | 18:03 |
| rlandy | sshnaidm|ptg: well - recheck | 18:03 |
| rlandy | change is in tqe | 18:03 |
| rlandy | merge was in tq | 18:03 |
| rlandy | sshnaidm|ptg: sorry - duplicated | 18:03 |
| sshnaidm|ptg | rlandy, ok,np | 18:04 |
| *** dtrainor_ has quit IRC | 18:05 | |
| rlandy | marios: http://logs.openstack.org/91/564291/20/check/tripleo-ci-centos-7-scenario002-multinode-oooq/031461e/job-output.txt.gz#_2018-09-13_17_04_18_878821 | 18:09 |
| rlandy | ^^ that might be from what just merged | 18:09 |
| *** zul has joined #oooq | 18:09 | |
| rlandy | https://review.openstack.org/#/c/596887/ | 18:10 |
| *** kopecmartin has quit IRC | 18:12 | |
| rlandy | sshnaidm|ptg: panda|ptg: marios: ^^ going to have to revert | 18:13 |
| rlandy | ugh | 18:13 |
| rfolco | rlandy, "openstack overcloud deploy --libvirt_type..." will be called when overcloud-deploy role runs in line 13 https://review.openstack.org/#/c/601584/3/playbooks/baremetal-full-overcloud.yml. So after inventory in line 18 if we set libvirt_args it does not take any effect for the deployment. Notice the kvm role does NOT switch by loading modules and refreshing libvirt daemon to start new guests using kvm. | 18:14 |
| rlandy | rfolco: k - will look at that in a bit | 18:14 |
| marios | rlandy: o/ i wrote a comment on the review i guess you saw it already :) https://review.openstack.org/#/c/596906/19 | 18:16 |
| *** panda|ptg has quit IRC | 18:16 | |
| marios | rlandy: yeah i noticed the other one merged and this one hadn't (was momentarily confused since they have same title :) had to refresh browser) | 18:16 |
| rlandy | marios: that is a real issue though | 18:17 |
| marios | rlandy: few of the jobs on the ocata check are failing i think the same issue lemme confirm | 18:17 |
| marios | rlandy: yeah looks like... scn 1 at http://logs.openstack.org/91/564291/20/check/tripleo-ci-centos-7-scenario001-multinode-oooq/e76b25d/job-output.txt.gz#_2018-09-13_16_59_18_903905 | 18:17 |
| rlandy | marios: https://review.openstack.org/#/c/596887/ is at fault | 18:18 |
| rlandy | not sure why we didn't see those failures | 18:18 |
| rlandy | on the job itself | 18:18 |
| marios | rlandy: going afk for a bit now back in a while | 18:19 |
| *** zul has quit IRC | 18:20 | |
| *** jtomasek has quit IRC | 18:21 | |
| *** jrist has quit IRC | 18:25 | |
| *** sshnaidm|ptg has quit IRC | 18:27 | |
| *** chem has quit IRC | 18:28 | |
| rlandy | weshay: rfolco: https://review.openstack.org/#/c/602417/ - revert ... broke tripleo-ci-centos-7-scenario001-multinode-oooq | 18:30 |
| *** yolanda has quit IRC | 18:30 | |
| rlandy | somehow that didn't show up in the patch tests | 18:30 |
| rfolco | :( | 18:30 |
| *** tosky has quit IRC | 18:36 | |
| rlandy | rfolco: will see if I can fix ocata in the mean time so we don't have to revert everything | 18:37 |
| rfolco | what else is merged ? | 18:37 |
| *** vinaykns has quit IRC | 18:41 | |
| weshay | rlandy, we need a bug attached to that review | 18:44 |
| rlandy | weshay: I am going to try fix it rather than revert everything | 18:44 |
| rlandy | second review coming up | 18:44 |
| weshay | rlandy, rfolco would be helpful to have a scenario job execute against tq changes to config/* | 18:44 |
| rlandy | will add bug | 18:44 |
| weshay | thanks | 18:44 |
| rfolco | rlandy, want me to add the scenario job for the config filter ? | 18:45 |
| rlandy | sure | 18:48 |
| rfolco | k | 18:49 |
| rlandy | we need to fix deployed server in the other review as well | 18:51 |
| *** vinaykns has joined #oooq | 18:53 | |
| rlandy | rfolco: weshay; https://review.openstack.org/#/c/602423/ | 19:00 |
| rlandy | need to add a scenario test to that | 19:00 |
| rlandy | adding a dep | 19:01 |
| rfolco | rlandy, working on that | 19:01 |
| rfolco | rlandy, scn001 is enough ? | 19:01 |
| rlandy | rfolco: I think so | 19:01 |
| rlandy | edit the job when you need to | 19:01 |
| rlandy | what a nightmare - this whole change | 19:02 |
| rlandy | maybe we should just pull out all this subnodes stuff | 19:03 |
| rlandy | and keep the mock playbook forever | 19:03 |
| rlandy | where is everyone? | 19:07 |
| rfolco | o/ | 19:08 |
| rfolco | rlandy, do we have a bug related to the scenario breakage ? | 19:08 |
| *** zul has joined #oooq | 19:11 | |
| rfolco | rlandy, pls take a look at https://review.openstack.org/#/c/602425/1/zuul.d/layout.yaml | 19:12 |
| rfolco | onfig/* also covers the featureset yml... ps 2 | 19:13 |
| *** zul has quit IRC | 19:17 | |
| rlandy | Closes-Bug: #1792440 | 19:18 |
| openstack | bug 1792440 in tripleo "Chage to use subnodes in place of /etc/nodepool/* files breaks scenario tests" [Critical,In progress] https://launchpad.net/bugs/1792440 - Assigned to Ronelle Landy (rlandy) | 19:18 |
| rlandy | we need to rethink this whole approach | 19:19 |
| rfolco | rlandy, will set as Related-Bug: # in 602425 when test works | 19:21 |
| rlandy | rfolco: when the ptg people get back, I want to discuss ditching all this work | 19:23 |
| rlandy | other than replacing legacy with mock | 19:23 |
| * rfolco agrees | 19:27 | |
| rlandy | we revert what merged | 19:27 |
| rlandy | but will wait to talk with others | 19:28 |
| rlandy | weshay: pls ping me and rfolco when the team members at ptg have some time - need to discuss ^^ | 19:30 |
| rlandy | I'd like to change legacy for the mock role and do minimal other changes | 19:30 |
| weshay | rlandy, I have time now | 19:31 |
| rlandy | weshay: I would like to confirm with panda ... what we need to from https://review.openstack.org/#/c/596422/ | 19:33 |
| rlandy | if we can leave everything other than switching out mock and the zuul.d change | 19:33 |
| rlandy | leave the depends-on changes | 19:34 |
| rlandy | move rdo out of legacy | 19:34 |
| rlandy | and be done | 19:34 |
| rlandy | get rid of mock role at some scheduled time | 19:34 |
| *** tosky has joined #oooq | 19:35 | |
| *** panda|ptg has joined #oooq | 19:36 | |
| rlandy | if we keep /etc/nodepool - it will save us a headache | 19:36 |
| rlandy | panda|ptg: ha - just the person I need to see | 19:36 |
| * panda|ptg runs | 19:36 | |
| *** kopecmartin has joined #oooq | 19:36 | |
| weshay | https://bluejeans.com/u/whayutin/ | 19:36 |
| rlandy | panda|ptg: no where to hide now | 19:36 |
| rlandy | nice tour of the hotel | 19:38 |
| *** zul has joined #oooq | 19:40 | |
| *** vinaykns has quit IRC | 19:43 | |
| hubbot1 | FAILING CHECK JOBS on stable/pike: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike, tripleo-ci-centos-7-scenario004-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, (4 more messages) | 19:44 |
| *** vinaykns has joined #oooq | 19:48 | |
| *** jrist has joined #oooq | 19:52 | |
| panda|ptg | weshay: https://trello.com/c/JN4UIjWv/854-replace-zuulchanges-handling-in-build-test-packages-role | 19:55 |
| rlandy | weshay: panda|ptg: https://review.openstack.org/#/c/602417/ | 19:58 |
| *** yolanda has joined #oooq | 20:05 | |
| *** jtomasek has joined #oooq | 20:05 | |
| rlandy | https://review.openstack.org/#/c/602417/ | 20:11 |
| rlandy | sorry - pls revote- updated commit message | 20:11 |
| rlandy | rfolco: ^^ | 20:11 |
| rlandy | we are going with the full revert | 20:12 |
| weshay | panda|ptg, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/tasks/main.yml#L138 | 20:12 |
| weshay | panda|ptg, let's make sure zuul_deps is populated w/ either legacy or zuul v3 native inventory | 20:13 |
| panda|ptg | weshay: on it | 20:17 |
| *** jrist has quit IRC | 20:18 | |
| *** kopecmartin has quit IRC | 20:21 | |
| *** sshnaidm|ptg has joined #oooq | 20:25 | |
| *** saneax has quit IRC | 20:28 | |
| *** jrist has joined #oooq | 20:31 | |
| *** jrist has quit IRC | 20:31 | |
| *** jrist has joined #oooq | 20:31 | |
| myoung | o/ | 20:31 |
| *** myoung has quit IRC | 20:31 | |
| rlandy | panda|ptg: weshay: https://review.openstack.org/#/c/602445/2/playbooks/openstack-zuul-jobs/legacy/pre.yaml | 20:32 |
| rlandy | removed roles | 20:32 |
| rlandy | including zuul-cloner | 20:32 |
| *** trown is now known as trown|outtypewww | 20:36 | |
| *** hamzy has quit IRC | 20:48 | |
| weshay | sshnaidm|ptg, https://review.openstack.org/#/c/600836/ | 20:49 |
| panda|ptg | weshay: https://review.openstack.org/602456 testing with https://review.openstack.org/602457 | 21:13 |
| *** rlandy is now known as rlandy|brb | 21:34 | |
| *** yolanda has quit IRC | 21:38 | |
| *** yolanda has joined #oooq | 21:39 | |
| hubbot1 | FAILING CHECK JOBS on stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ (3 more messages) | 21:44 |
| *** jrist has quit IRC | 22:03 | |
| *** vinaykns has quit IRC | 22:10 | |
| *** rlandy|brb is now known as rlandy | 22:11 | |
| *** jtomasek has quit IRC | 22:12 | |
| *** dtrainor__ is now known as dtrainor | 22:13 | |
| *** jtomasek has joined #oooq | 22:25 | |
| *** tosky has quit IRC | 22:31 | |
| rlandy | panda|ptg: check jobs are looking ok so far - will have to trigger a scenario test as well since we broke that last time - any word on zuul-changes? | 22:35 |
| *** jaosorior has quit IRC | 22:43 | |
| weshay | panda|ptg, sshnaidm|ptg https://review.openstack.org/602485 | 22:44 |
| *** zul has quit IRC | 22:50 | |
| *** holser|ptg has quit IRC | 22:50 | |
| *** chem has joined #oooq | 22:56 | |
| *** chem has quit IRC | 22:57 | |
| *** chem has joined #oooq | 22:57 | |
| panda|ptg | rlandy: https://review.openstack.org/602456 testing with https://review.openstack.org/602457 | 23:03 |
| rlandy | I see | 23:04 |
| *** panda|ptg has quit IRC | 23:13 | |
| *** tosky has joined #oooq | 23:14 | |
| *** tosky has quit IRC | 23:22 | |
| *** tosky_ has joined #oooq | 23:22 | |
| *** chem has quit IRC | 23:27 | |
| *** sshnaidm|ptg has quit IRC | 23:28 | |
| *** tosky_ is now known as tosky | 23:29 | |
| *** sshnaidm|ptg has joined #oooq | 23:32 | |
| hubbot1 | FAILING CHECK JOBS on stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike @ https://review.openstack.org/602248, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ (3 more messages) | 23:45 |
| *** jrist has joined #oooq | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!