| *** yolanda has quit IRC | 00:06 | |
| *** tosky has quit IRC | 00:08 | |
| *** yolanda has joined #oooq | 00:09 | |
| *** matbu has quit IRC | 00:09 | |
| *** matbu has joined #oooq | 00:10 | |
| *** ysandeep has joined #oooq | 01:02 | |
| *** jmasud has joined #oooq | 01:11 | |
| *** hamzy has quit IRC | 01:56 | |
| *** hamzy has joined #oooq | 01:56 | |
| *** jrist has quit IRC | 01:57 | |
| *** jpena|off has quit IRC | 01:57 | |
| *** weshay has joined #oooq | 01:57 | |
| *** kopecmartin has quit IRC | 01:57 | |
| *** weshay|ruck has quit IRC | 01:57 | |
| *** migi has quit IRC | 01:58 | |
| *** kopecmartin has joined #oooq | 02:00 | |
| *** jpena|off has joined #oooq | 02:05 | |
| *** rfolco has joined #oooq | 02:31 | |
| *** rfolco has quit IRC | 02:36 | |
| *** rlandy|bbl is now known as rlandy | 03:29 | |
| *** rlandy has quit IRC | 03:42 | |
| *** jmasud has quit IRC | 04:12 | |
| *** jmasud has joined #oooq | 04:13 | |
| *** udesale has joined #oooq | 04:13 | |
| *** skramaja has joined #oooq | 04:17 | |
| *** ykarel|away is now known as ykarel | 04:35 | |
| weshay | zbr, upstream logs are still busted.. please check it out... zipped logs :( | 05:00 |
|---|---|---|
| *** raukadah is now known as chkumar|rover | 05:13 | |
| *** saneax has joined #oooq | 05:19 | |
| *** marios has joined #oooq | 06:17 | |
| *** dsneddon has quit IRC | 06:45 | |
| *** ratailor has joined #oooq | 06:45 | |
| *** dsneddon has joined #oooq | 06:45 | |
| *** jfrancoa has joined #oooq | 07:00 | |
| *** soniya29 has joined #oooq | 07:08 | |
| *** ykarel is now known as ykarel|lunch | 07:42 | |
| *** dtantsur|afk is now known as dtantsur | 07:54 | |
| *** saneax has quit IRC | 07:55 | |
| zbr | yep. i seen | 07:59 |
| *** chem has quit IRC | 08:00 | |
| *** chem has joined #oooq | 08:01 | |
| *** tesseract has joined #oooq | 08:03 | |
| *** jmasud has quit IRC | 08:11 | |
| *** jtomasek has joined #oooq | 08:12 | |
| *** jmasud has joined #oooq | 08:14 | |
| *** holser has joined #oooq | 08:14 | |
| *** holser has quit IRC | 08:19 | |
| *** holser has joined #oooq | 08:20 | |
| *** bogdando has joined #oooq | 08:25 | |
| *** holser has quit IRC | 08:26 | |
| *** soniya29 has quit IRC | 08:31 | |
| *** soniya29 has joined #oooq | 08:31 | |
| marios | biab | 08:32 |
| *** marios has quit IRC | 08:32 | |
| *** tosky has joined #oooq | 08:35 | |
| *** soniya29 has quit IRC | 08:50 | |
| *** soniya29 has joined #oooq | 08:50 | |
| *** jpena|off is now known as jpena | 08:54 | |
| *** amoralej|off is now known as amoralej | 08:58 | |
| *** ykarel|lunch is now known as ykarel | 09:04 | |
| chkumar|rover | matbu, hello, please have a look at this review https://review.rdoproject.org/r/#/c/24719/ it requires in tht spec file, thanks :-) | 09:20 |
| *** jbadiapa has joined #oooq | 09:27 | |
| *** holser has joined #oooq | 09:36 | |
| *** marios has joined #oooq | 09:41 | |
| matbu | chkumar|rover: yep i will change that aspa thx :) | 09:48 |
| zbr | panda: I am doing some cleanups in very old tq* repos, i hope you do not mind me abandoning stuff like https://review.opendev.org/#/c/583916/ | 09:49 |
| zbr | i would assume that any review >1y that is unmergeable, broken or with unaswered questions is safe to abandon. (abandon != delete ) | 09:50 |
| zbr | lucky for us, infra disabled delete | 09:50 |
| panda | zbr: Noooooo that's absolutely a critical patch ! | 09:53 |
| panda | zbr: another couple of years and I surely can get it merged. | 09:54 |
| chkumar|rover | ykarel, https://bugs.launchpad.net/tripleo/+bug/1832166/comments/10 | 09:54 |
| openstack | Launchpad bug 1832166 in tripleo "[FUll Tempest job][master][periodic]3 Tempest tests related to DNS failing " [Critical,Fix released] - Assigned to Ronelle Landy (rlandy) | 09:54 |
| zbr | panda: right after openstack moves from irc to something else. | 09:55 |
| ykarel | chkumar|rover, ack | 09:57 |
| panda | zbr: unix talk ? | 09:59 |
| *** ysandeep has quit IRC | 10:02 | |
| sshnaidm | zbr, I think you can abandon only if it has -1, either from CI or people | 10:08 |
| sshnaidm | zbr, not sure about patches with +2 | 10:08 |
| zbr | i think we need to use common sense, making a decision based on all factors. we should either aim to workflow it or abandon it. clearly that +2 pushes towards merging. | 10:11 |
| zbr | but a +2 added two years ago on a change that needs rebase may not be a real +2 :D | 10:11 |
| zbr | few months back I was inclined to support typo fixes, but since some people tried to game the system and to a single typo per patch, I decided to abandon them. | 10:12 |
| zbr | i suspect they even used bots to create them | 10:13 |
| marios | sshnaidm: zbr: imho if they are that old/untouched... to be clear zbr IMO 'untouched six months' means from the latest comment there, not from the patch submission date right? | 10:13 |
| *** derekh has joined #oooq | 10:13 | |
| marios | sshnaidm: zbr: if you disagree just click restore. this is too much wasted effort on typing for discussion, imho ;D | 10:13 |
| zbr | marios: true+ last touch matterns, not age. | 10:13 |
| chkumar|rover | arxcruz, testing ssh tempest patch here https://review.rdoproject.org/r/24723 | 10:14 |
| zbr | we all know we age like wine | 10:14 |
| sshnaidm | marios, yeah, untouched, but not mergeable | 10:14 |
| sshnaidm | marios, if you see untouched patch with +2 you can also +w it :) | 10:14 |
| marios | sshnaidm: wll, not really. at least you would have to recheck it first | 10:14 |
| marios | sshnaidm: and maybe ping them say hey wassup with that? should we merge it? | 10:15 |
| sshnaidm | yes, and then +w after recheck | 10:15 |
| marios | sshnaidm: s/would/should recheck it first, at least everyone on this team should | 10:15 |
| marios | sshnaidm: yeah thats fair. i mean if in six months it didn't need rebase for conflict, and it has green ci run. then its like the jesus patch | 10:15 |
| marios | :D | 10:15 |
| marios | sshnaidm: like we HAVE to merge it! | 10:16 |
| sshnaidm | I like these patches with changing one letter in comment | 10:17 |
| sshnaidm | so like that I'd -2 them all.. | 10:17 |
| marios | sshnaidm: yeah i'm conflicted sometimes on those ones. like where is the line. on one hand it could be folks looking to get involved. on the other hand it could also just be folks looking to say 'i have a commit in openstack' | 10:18 |
| sshnaidm | marios, yeah, seems like that | 10:19 |
| marios | sshnaidm: usually i like to make them work more first. Like if its fixing a typo ... then 'challenge accepted' its like auto -1. you can easily find more typos in that file (assuming it's not just 5 line function in one file) | 10:19 |
| marios | sshnaidm: or maybe fix lots of typos/minor things across the whole repo ;) | 10:20 |
| sshnaidm | marios, like "If you started..." :D | 10:20 |
| marios | sshnaidm: sometimes they don't even bother responding to that request ^^ so thn you can just ignore them and they go away | 10:20 |
| marios | sshnaidm: yeah try it | 10:20 |
| marios | sshnaidm: it at least gives you some satisfaction and the result is it becomes more of a contribution ;) | 10:20 |
| *** holser has quit IRC | 10:21 | |
| *** holser has joined #oooq | 10:28 | |
| *** ykarel is now known as ykarel|away | 10:31 | |
| *** soniya29 has quit IRC | 10:36 | |
| marios | reviews please when you next have time thank you "Refresh start_named_hashes after promotion to prevent false positive" https://review.rdoproject.org/r/#/c/24665/ | 11:01 |
| *** udesale has quit IRC | 11:01 | |
| *** saneax has joined #oooq | 11:18 | |
| *** saneax has quit IRC | 11:19 | |
| *** saneax has joined #oooq | 11:20 | |
| *** migi has joined #oooq | 11:21 | |
| *** saneax has quit IRC | 11:25 | |
| migi | owalsh++ | 11:29 |
| *** soniya29 has joined #oooq | 11:36 | |
| marios | arxcruz: fyi cos you had the same question looks like the regex works at tempest white/black https://review.opendev.org/#/c/701016/10/config/general_config/featureset020.yml | 11:38 |
| *** ykarel|away is now known as ykarel | 11:49 | |
| arxcruz | marios: you already told me that iirc | 11:52 |
| marios | arxcruz: k | 11:59 |
| *** amoralej is now known as amoralej|lunch | 12:05 | |
| *** rfolco has joined #oooq | 12:10 | |
| *** jmasud has quit IRC | 12:12 | |
| *** jmasud has joined #oooq | 12:13 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:15 | |
| marios | chkumar|rover: arxcruz: kopecmartin: do you folks recall what happens if black/white list clash? what wins? /me goes looking but maybe you already know | 12:17 |
| kopecmartin | that's a good question, i don't know, I'd need to check too | 12:18 |
| marios | kopecmartin: ack thx | 12:18 |
| kopecmartin | marios: i think that black list wins | 12:19 |
| marios | kopecmartin: cool thanks i hope so, can't quickly find but i can more easily just try it and see | 12:20 |
| kopecmartin | if we're talking about tempest parameters | 12:20 |
| marios | kopecmartin: yah tempest_test_whitelist and tempest_test_blacklist | 12:20 |
| kopecmartin | ok, because it wouldn't make sense otherwise, the white list can contain regexes .. in case the regex is not very specific I might want to exclude some specific tests .. therefore i think that black list wins | 12:21 |
| marios | kopecmartin: sec i'll point to what i mean . in my case they both contain regex but the blacklist has a bigger one and i hope it wins. i'll work it out if its the other way around but sec i'll post th update and point | 12:24 |
| kopecmartin | marios: https://stestr.readthedocs.io/en/latest/MANUAL.html#test-selection | 12:25 |
| kopecmartin | $ stestr run --black-regex 'slow_tests|bad_tests' ui\.interface | 12:25 |
| kopecmartin | 'Here first we selected all tests which matches to ui\.interface, then we are dropping all test which matches slow_tests|bad_tests from the final list.' | 12:25 |
| arxcruz | marios: iirc blacklist wins | 12:27 |
| *** holser has quit IRC | 12:29 | |
| *** holser has joined #oooq | 12:31 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| marios | arxcruz: thanks arxcruz | 12:33 |
| marios | thank you for digging kopecmartin | 12:34 |
| chkumar|rover | owalsh, migi, Thank you for finding the issue, preparing the bug report :-) | 12:39 |
| weshay | zbr, how we doing w/ logs? | 12:58 |
| weshay | zbr, upstream unzipped.. 3rd party check and periodic zipped is what we're after | 12:59 |
| zbr | weshay: use gzip topic to see progress, https://review.opendev.org/#/q/topic:gzip+(status:open+OR+status:merged) | 12:59 |
| zbr | weshay: https://review.opendev.org/#/c/704738/ needs to be wf asap, | 13:01 |
| zbr | that one brings back unzip to upstream, and not affecting rdo, at least on the clicks i did. better if you can double check | 13:02 |
| *** rlandy has joined #oooq | 13:02 | |
| chkumar|rover | weshay, zbr few of the jobs are timing out, having no logs collected | 13:03 |
| chkumar|rover | basically fs021 | 13:03 |
| weshay | chkumar|rover, yup... zbr not all the jobs were getting gzipped | 13:03 |
| weshay | the log server was faull | 13:03 |
| weshay | chkumar|rover, /me looks again | 13:03 |
| chkumar|rover | weshay, last night train promoted na | 13:04 |
| zbr | i am now polishing the optimization on collection, which should bring its duration to ~50%. | 13:04 |
| weshay | u'@/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-7/promotion-testing-hash-master.yml', u'@/home/zuul/src/opendev.org/openstack/tripleo-quickstart/config/general_config/featureset001.yml', u'@/home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/testenv/ovb.yml', u'@/home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/testenv/ovb-rdocloud.yml', u'@/home/zuul/workspace/logs/role-vars.yaml', | 13:06 |
| weshay | u'local_working_dir=/home/zuul/workspace/.quickstart', u'virthost=undercloud', u'tripleo_root=/home/zuul/src/opendev.org/openstack', u'working_dir=/home/zuul', u'@/home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/collect-logs.yml', u'artcl_collect_dir=/home/zuul/workspace/logs', u'@/home/zuul/workspace/logs/zuul-variables.yaml', u'@/home/zuul/workspace/logs/hostvars-variables.yaml') | 13:06 |
| weshay | that should zip it | 13:06 |
| chkumar|rover | Does anyone knows how role_networks got set in tripleo? | 13:07 |
| chkumar|rover | weshay, regarding server tempest tests failure like parallel migration or ssh issue due to missing of internal api in compute0 node | 13:08 |
| chkumar|rover | weshay, I will open a bug soon may be seperate one | 13:09 |
| migi | owalsh: ^^ | 13:09 |
| chkumar|rover | weshay, owalsh and migi were looking in to the issue | 13:09 |
| weshay | really? | 13:09 |
| owalsh | internal api missing in ssh_known_hosts | 13:09 |
| owalsh | weshay: ^^^ | 13:09 |
| chkumar|rover | with comparising to https://b73800ba39ea3e53b9d3-9ff934c0eeb3c69295fc2c5d6afc2bc8.ssl.cf5.rackcdn.com/649418/12/check/tripleo-ci-centos-7-containers-multinode/2463fd9/logs/subnode-1/etc/hosts and https://b73800ba39ea3e53b9d3-9ff934c0eeb3c69295fc2c5d6afc2bc8.ssl.cf5.rackcdn.com/649418/12/check/tripleo-ci-centos-7-containers-multinode/2463fd9/logs/subnode-1/etc/ssh/ssh_known_hosts | 13:10 |
| chkumar|rover | and check bm logs | 13:10 |
| weshay | chkumar|rover, rock on | 13:10 |
| chkumar|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/189436/2/check/periodic-tripleo-ci-centos-7-bm_envD-1ctlr_2comp-featureset021-master/19aef03/logs/overcloud-novacompute-0/etc/hosts and https://sf.hosted.upshift.rdu2.redhat.com/logs/36/189436/2/check/periodic-tripleo-ci-centos-7-bm_envD-1ctlr_2comp-featureset021-master/19aef03/logs/overcloud-novacompute-0/etc/ssh/ssh_known_hosts | 13:10 |
| weshay | migi++, chkumar|rover++ | 13:10 |
| owalsh | I suspect it's a Camelcase vs lowercase issue for network names - running a quick test in https://review.opendev.org/#/c/704781/1/tripleo_ansible/roles/tripleo_ssh_known_hosts/tasks/main.yml | 13:11 |
| chkumar|rover | it is for ssh issue and there are other issues there also | 13:11 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| chkumar|rover | weshay, we can see those error in fs021 job also http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master/7c6d1fc/logs/overcloud-novacompute-0/var/log/containers/nova/nova-compute.log | 13:14 |
| chkumar|rover | owalsh, testing this patch in rdoside | 13:15 |
| owalsh | weshay, chkumar|rover: could we add something to catch this in CI? E.g try sshing from the nova_compute container to the same hosts internal_api ip | 13:16 |
| chkumar|rover | owalsh, https://review.rdoproject.org/r/24726 | 13:18 |
| chkumar|rover | owalsh, you mean from podman side where we collect data related to containers that time? | 13:19 |
| *** holser has quit IRC | 13:22 | |
| owalsh | chkumar|rover: not sure where yet... need to look into it | 13:23 |
| rlandy | weshay: do you want https://code.engineering.redhat.com/gerrit/#/c/190564 merged or was it a once off? | 13:24 |
| *** skramaja has quit IRC | 13:24 | |
| tosky | *cough* downstream | 13:28 |
| *** jpena|lunch is now known as jpena | 13:29 | |
| chkumar|rover | weshay, rlandy sshnaidm|afk https://review.opendev.org/#/q/topic:cellv2+(status:open+OR+status:merged) will be good to go today | 13:29 |
| chkumar|rover | we need a promotion version of that job | 13:29 |
| *** ratailor has quit IRC | 13:32 | |
| dtantsur | heya, folks! does quickstart currently work on RHEL/CentOS 8 as both virthost and VM OS? | 13:32 |
| *** holser has joined #oooq | 13:35 | |
| *** ykarel is now known as ykarel|away | 13:36 | |
| migi | owalsh: weshay: chkumar|rover: I am thinking laud here, is the health-check of container right plac to add such test - it's deployment issue imo | 13:37 |
| migi | kind of connectivity between containers that have services | 13:38 |
| owalsh | migi: don't think that's the right place to check the config isn't junk | 13:38 |
| chkumar|rover | weshay, heading home see you in some hours | 13:39 |
| weshay | chkumar|rover++++ | 13:40 |
| weshay | chkumar|rover, thank you sir | 13:40 |
| migi | owalsh: well it's not the config imo, it's the connectivity between the services that are broken | 13:41 |
| *** soniya29 has quit IRC | 13:42 | |
| migi | the config is the cause of problem | 13:42 |
| owalsh | yup | 13:42 |
| migi | but maybe other time it's different cause of connectivity issue | 13:42 |
| dtantsur | https://opendev.org/openstack/tripleo-quickstart/commit/b8b85b348da761906a28e74995a8c4ccb92785ae gives me some hope | 13:42 |
| owalsh | migi: don't see how it could be a container healthcheck - 1 sshd container running, 2 potential client containers - which runs the healthcheck? | 13:43 |
| *** ratailor has joined #oooq | 13:44 | |
| *** saneax has joined #oooq | 13:44 | |
| migi | from each container that uses external api services health check to ensure that service IP(s) is/are accessible and ssh-able? | 13:45 |
| migi | ran from overcloud where container is running | 13:45 |
| weshay | panda, want to go early? | 13:46 |
| owalsh | migi: client is a compute node nova_compute or nova_libvirt container, service is another compute node nova_migration_target container... | 13:46 |
| migi | owalsh: nova_compute one that speaks to another nova_compute, but yeah maybe it's just this particular case | 13:47 |
| owalsh | nope, nova_migration_target runs sshd | 13:47 |
| *** ratailor has quit IRC | 13:48 | |
| owalsh | nova_compute or nova_libvirt ssh to it | 13:48 |
| migi | owalsh: whatever IP is specified as internalapi from the nova_compute client | 13:49 |
| *** ratailor has joined #oooq | 13:50 | |
| weshay | panda, paging panda | 13:51 |
| owalsh | migi: don't failure to ssh back to the same host should fail a healthcheck. migration would be to a different host and we can't realistically ssh to N compute nodes in a healthcheck | 13:55 |
| owalsh | don't think | 13:55 |
| migi | owalsh: ok that makes sense | 13:55 |
| migi | owalsh: config check then | 13:56 |
| owalsh | migi: also last time I looked failing healthchecks were ignored during deployment | 13:56 |
| panda | weshay: joining | 13:56 |
| owalsh | migi: a validation task might be the correct place, but do we run any validations in CI jobs? | 13:57 |
| *** ratailor has quit IRC | 13:59 | |
| panda | panda: sorry need a couple minutes more ... | 13:59 |
| *** ykarel|away is now known as ykarel | 14:02 | |
| migi | owalsh: dunno | 14:02 |
| migi | owalsh: I saw some in the past, but maybe they are ignored as you say | 14:02 |
| arxcruz | marios: the fs020 was timeing out with how much time ? | 14:03 |
| marios | arxcruz: fs20 had tempest fail on last run | 14:06 |
| marios | arxcruz: * http://logs.rdoproject.org/39/24339/8/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/3364398/job-output.txt | 14:06 |
| marios | * 2020-01-28 01:37:50.715515 | primary | TASK [os_tempest : Execute tempest tests] ************************************** | 14:06 |
| marios | 2020-01-28 01:37:50.739220 | primary | Tuesday 28 January 2020 01:37:50 +0000 (0:00:00.090) 0:02:38.544 ******* | 14:06 |
| marios | arxcruz: didn't check what/where | 14:06 |
| arxcruz | shit, even changing the bmc_flavor still have 8 cpus the controller | 14:08 |
| arxcruz | rlandy: how can i change the flavor of a ovb job? | 14:09 |
| arxcruz | i tried bmc_flavor and baremetal_flavor, i see it change from medium to xlarge, but still have 8 cpus | 14:09 |
| rlandy | arxcruz: yep - there are multiple nodes with different flavors | 14:09 |
| arxcruz | rlandy: any node with a ci.m1.xlarge flavor ? | 14:10 |
| rlandy | the undercloud is the largest node we use so far | 14:10 |
| rlandy | checking what's the latest | 14:10 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/defaults/main.yml#L40 | 14:12 |
| rlandy | arxcruz: ^^ | 14:12 |
| rlandy | if it's not overridden elsewhere | 14:12 |
| rlandy | arxcruz: which node do you need a larger flavor for? | 14:13 |
| arxcruz | rlandy: i've override these and vm created still with 8 cpu and 16gb ram | 14:13 |
| rlandy | arxcruz: we need to clarify which vm you want to change ... | 14:14 |
| rlandy | the undercloud comes from the zuul nodes | 14:14 |
| rlandy | the overcloud nodes you can change the settings | 14:14 |
| rlandy | ie: baremetal_flavor: ci.m1.xlarge | 14:14 |
| rlandy | or the bmc flavor | 14:14 |
| arxcruz | rlandy: https://review.rdoproject.org/r/#/c/24709/ | 14:14 |
| arxcruz | I can see setting ci.m1.xlarge | 14:15 |
| arxcruz | but it doesn't seems to be working | 14:15 |
| arxcruz | rlandy: https://logs.rdoproject.org/09/24709/7/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/c717e89/job-output.txt | 14:15 |
| chkumar|rover | arxcruz, it was a config chnage na? | 14:17 |
| rlandy | 2020-01-29 09:03:16.544746 | primary | "disk": 160, | 14:17 |
| rlandy | 2020-01-29 09:03:16.544768 | primary | "arch": "x86_64", | 14:17 |
| rlandy | 2020-01-29 09:03:16.544787 | primary | "cpu": 8, | 14:17 |
| rlandy | 2020-01-29 09:03:16.544809 | primary | "pm_user": "admin" | 14:17 |
| rlandy | 2020-01-29 09:03:16.544822 | primary | }, | 14:17 |
| chkumar|rover | wothout merging it does not works | 14:17 |
| arxcruz | so xlarge still uses 8 cpus ? | 14:18 |
| arxcruz | rlandy: i can see the amount of memory is higher | 14:18 |
| arxcruz | i want to increase the cpu | 14:18 |
| rlandy | arxcruz: well - there are two parts here ... | 14:18 |
| rlandy | the node that gets created | 14:18 |
| rlandy | and the node that is deployed | 14:18 |
| arxcruz | i want to increase cpu on computer and controller nodes | 14:19 |
| owalsh | chkumar|rover, migi: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_287/704781/1/check/tripleo-ci-centos-7-containers-multinode/287e000/logs/subnode-1/etc/ssh/ssh_known_hosts | 14:19 |
| rlandy | arxcruz: bmc node at medium should be more than big enough | 14:19 |
| rlandy | so don't worry about that | 14:19 |
| owalsh | chkumar|rover, migi: so it's not that they are using different cases... but for some reason the ips/hostnames for these networks were not added | 14:19 |
| rlandy | arxcruz: the only one I would guess you want to change is the baremetal flavor | 14:20 |
| rlandy | take a look at ... 2020-01-29 09:03:05.743145 | TASK [ovb-manage : Build nodes.json file to be used as instackenv.json] | 14:20 |
| *** TrevorV has joined #oooq | 14:21 | |
| rlandy | confirming flavor attributes | 14:21 |
| rlandy | arxcruz: so a general baremetal instance - uses ci.m1.large ... 4vcpus 8GB RAM 80 GB disk ... | 14:24 |
| rlandy | comparing with your instackev.json | 14:24 |
| rlandy | "cpu": 8, "disk": 160, "memory": 16384, | 14:24 |
| rlandy | arxcruz: ^^ so you must have sized up | 14:25 |
| arxcruz | rlandy: yeah, it seems doesn't matter for tempest :/ | 14:25 |
| rlandy | arxcruz: drop the bmc and undercloud flavors back ... they won't help you | 14:25 |
| arxcruz | i was betting it would be faster... | 14:25 |
| rlandy | arxcruz: I guess if the original node was big enough, so no diff | 14:25 |
| rlandy | arxcruz: best suggestion would be to deploy the same on your own tenant | 14:26 |
| rlandy | get on the nodes and try | 14:26 |
| rlandy | arxcruz: you can see the difference on real bm | 14:26 |
| rlandy | there the nodes are HUGE | 14:26 |
| owalsh | migi, chkumar|rover: ah, it's a jinja scoping issue - https://github.com/pallets/jinja/issues/641 | 14:26 |
| rlandy | tempest is not speedy either | 14:26 |
| owalsh | chkumar|rover: do you have an LP for this yet? I'll push a fix | 14:27 |
| chkumar|rover | owalsh, getting lp, give me 10 mins | 14:27 |
| owalsh | ack, thanks | 14:27 |
| *** holser__ has joined #oooq | 14:29 | |
| *** holser__ has quit IRC | 14:29 | |
| *** holser has quit IRC | 14:29 | |
| *** holser has joined #oooq | 14:30 | |
| arxcruz | rlandy: thanks for the tips | 14:31 |
| arxcruz | i need to go buy a gift to my daughter, it's her birthday today, brb | 14:31 |
| rlandy | arxcruz: happy birthday!! | 14:32 |
| rfolco | arxcruz, happy bday !! :) | 14:32 |
| marios | arxcruz: all the best :D mm cake | 14:33 |
| *** jmasud has quit IRC | 14:39 | |
| chkumar|rover | migi, owalsh https://bugs.launchpad.net/tripleo/+bug/1861296 | 14:40 |
| openstack | Launchpad bug 1861296 in tripleo "multiple nova server related test failure due to Host key verification failed on compute node" [Critical,Confirmed] | 14:40 |
| *** saneax has quit IRC | 14:43 | |
| chkumar|rover | weshay, ^^ | 14:44 |
| weshay | chkumar|rover, NICE | 14:45 |
| chkumar|rover | weshay, https://review.opendev.org/#/c/703953/3 to fix fs039 master error | 14:47 |
| chkumar|rover | weshay, all most all cards updated for prodchain call | 14:48 |
| chkumar|rover | rlandy, around? | 14:54 |
| chkumar|rover | rlandy, what to do with podman downstream work? | 14:54 |
| chkumar|rover | do we want to merge and add the job? | 14:54 |
| *** Trevor_V has joined #oooq | 14:55 | |
| rlandy | chkumar|rover: we should merge the tq patch first | 14:55 |
| rlandy | chkumar|rover: once that merges, we can merge the downstream work - but not as is | 14:56 |
| rlandy | I need to fix the projects file | 14:56 |
| rlandy | so that we add the job to the periodic pipeline | 14:56 |
| rlandy | chkumar|rover: so the job will run once a day | 14:56 |
| rlandy | is that enough? | 14:56 |
| *** sshnaidm|afk is now known as sshnaidm | 14:56 | |
| *** Trevor__V has joined #oooq | 14:57 | |
| rlandy | chkumar|rover: will make those edits now - give me a few | 14:57 |
| chkumar|rover | rlandy, yes | 14:57 |
| chkumar|rover | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/config-errors what about these one | 14:57 |
| chkumar|rover | rlandy, we may need to work with delivery team on how to gate podman from rhel stream | 14:57 |
| rlandy | chkumar|rover: so the config-errors are a diff problem | 14:58 |
| rlandy | one at a time | 14:58 |
| *** TrevorV has quit IRC | 14:58 | |
| rlandy | the config errors come from the fact that we inclued zuul-jobs jobs | 14:58 |
| rlandy | per inheritance | 14:58 |
| rlandy | one sec - updating review | 14:59 |
| chkumar|rover | ok | 14:59 |
| *** Trevor_V has quit IRC | 15:00 | |
| rlandy | marios: just before you go ... left some notes in the osp containers card wrt osp-17 build s- can discuss at the meeting tomorrow | 15:01 |
| weshay | zbr, can you join #sf-ops internal please | 15:03 |
| weshay | rlandy, migi fyi.. first pass http://tripleo-cockpit.usersys.redhat.com/d/Wj-ao_sWz/full-component-pipeline?orgId=1 | 15:03 |
| marios | rlandy: i saw those thanks, and i checked https://code.engineering.redhat.com/gerrit/#/q/topic:17-standup+status:open | 15:03 |
| marios | rlandy: thanks for that | 15:04 |
| marios | rlandy: i moved us to hack md finally had enough of taiga and markdown | 15:04 |
| rlandy | marios++ | 15:04 |
| rlandy | we outran taiga usage | 15:04 |
| migi | weshay++++++ | 15:04 |
| marios | rlandy: heh, just copy paste. but honestly the bug with the removal of http from the shell stuff was really really annoying it was the final straw | 15:05 |
| rlandy | chkumar|rover: https://code.engineering.redhat.com/gerrit/#/c/190384/ - pls review | 15:07 |
| rlandy | that should be mergeable after tq patch merges | 15:07 |
| rlandy | marios: yep - markdown was leading to personal breakdown | 15:08 |
| marios | rlandy: just to demonstrate the extend of the issue, and warning language follows you may want to ensure young children are not watching your screen, from my notes today | 15:09 |
| marios | *=* 15:50:57 *=*=*= "fucking move to hackmd... " | 15:09 |
| marios | :D | 15:09 |
| marios | weshay: hr violation! ^ | 15:09 |
| rlandy | chkumar|rover: before we work on gate podman from rhel stream, we should look at roles - otherwise we will have a ton of duplication = debug/maintenance nightmare | 15:09 |
| chkumar|rover | rlandy, yes | 15:10 |
| rlandy | lol | 15:10 |
| chkumar|rover | rlandy, small typo rest looks ok | 15:11 |
| *** TrevorV has joined #oooq | 15:12 | |
| rlandy | marios: with kolla-build.conf, that has to be diff for downstream | 15:12 |
| * rlandy will comment on hackmd | 15:12 | |
| marios | rlandy: different registry? | 15:12 |
| marios | rlandy: cool thank you | 15:12 |
| rlandy | yep | 15:12 |
| marios | rlandy: just update it | 15:12 |
| marios | rlandy: or comment if you aren't sure needs more digging | 15:12 |
| rlandy | tag | 15:12 |
| rlandy | etc. | 15:12 |
| rlandy | not with my changes, I had any success or anything ;( | 15:13 |
| *** chem has quit IRC | 15:13 | |
| marios | rlandy: k for tag i just went to | 15:13 |
| marios | * https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags/ | 15:13 |
| marios | rlandy: and found a recent one | 15:13 |
| rlandy | osp containers are not there | 15:13 |
| marios | rlandy: but anyway it seems we are missing lots of patches | 15:13 |
| chkumar|rover | rfolco, marios etcd is available now | 15:13 |
| rlandy | ? | 15:13 |
| marios | rlandy: according to the comments | 15:13 |
| chkumar|rover | in centos 8 | 15:13 |
| rlandy | chkumar|rover: looking | 15:13 |
| marios | rlandy: k, i probably looked for * "name": "rhel-binary-base:f2d10ed08cd893efa29d4d2610f5abcc4b0682b1_73e77d2b", | 15:14 |
| marios | * "name": "rhel-binary-base:cbfcf18d489feeba5e78e0f8b2fd3eaebec3f504_b7487084", | 15:14 |
| marios | that on ei used i think | 15:14 |
| marios | rlandy: but fine anyway please go ahead | 15:14 |
| rlandy | rhel-binary for rdo? | 15:14 |
| marios | thanks chkumar|rover | 15:14 |
| rfolco | chkumar|rover, thx, anyone else? | 15:14 |
| *** chem has joined #oooq | 15:15 | |
| *** Trevor__V has quit IRC | 15:15 | |
| chkumar|rover | rfolco, uwsgi also | 15:16 |
| chkumar|rover | we are waiting on gfidente for ceph repos | 15:16 |
| rlandy | chkumar|rover: we have a linter issue: https://sf.hosted.upshift.rdu2.redhat.com/logs/84/190384/18/check/tox-linters/811addf/job-output.txt | 15:17 |
| rfolco | chkumar|rover, you know if shellinabox is really required ? | 15:17 |
| rfolco | for ironic-conductor | 15:17 |
| rfolco | and the last one is collectd-ping | 15:18 |
| chkumar|rover | rfolco, not required | 15:18 |
| chkumar|rover | rfolco, https://opendev.org/openstack/tripleo-common/src/branch/master/container-images/tripleo_kolla_template_overrides.j2#L176 | 15:19 |
| rfolco | ok so maybe only ceph | 15:19 |
| chkumar|rover | rfolco, for collectd mathias runge is the person | 15:19 |
| rlandy | zuul_log_path should include all that | 15:20 |
| rlandy | zuul_log_url: "https://sf.hosted.upshift.rdu2.redhat.com/logs" | 15:22 |
| chkumar|rover | rlandy, will that fixed tomorrow, if no urgency | 15:25 |
| rlandy | no rush | 15:26 |
| chkumar|rover | weshay, my home network not working properly please take care of escalation call | 15:35 |
| *** Trevor_V has joined #oooq | 15:38 | |
| *** dpawlik has joined #oooq | 15:41 | |
| dpawlik | Hello | 15:41 |
| zbr | o/ | 15:41 |
| *** TrevorV has quit IRC | 15:41 | |
| dpawlik | I'm a member of RDO team. We would like to switch images server (images.rdoproject.org) to new provider (name will be still same, but during the migration, you can run jobs using other address: images-vexxhost.rdoproject.org) | 15:44 |
| dpawlik | question is: when can we do that | 15:45 |
| dpawlik | I saw in few points, that you are using in CI scripts hardcoded value (https://review.rdoproject.org/r/#/c/24725/) and Im trying to change that to be set as a variable | 15:45 |
| dpawlik | because in the meantime of switching servers, there can be situation that some hosts can upload image(old server),some download(new server) because of DNS propagation | 15:47 |
| rlandy | dpawlik: the images server is referenced in a lot of places | 15:48 |
| rlandy | promotion server, release files etc. | 15:48 |
| rlandy | if you are asking for a suitable date when you can switch the server, the ruck, rovers can advise you best | 15:49 |
| rlandy | chkumar|rover and weshay | 15:49 |
| rlandy | getting references | 15:49 |
| weshay | dpawlik, what did you find out re: the rhel protected image server? | 15:50 |
| zbr | as the server is new geo location. it would worth testing the effects of the change before doing the DNS flip | 15:50 |
| dpawlik | cc jpena ^^ | 15:50 |
| chkumar|rover | weshay, https://review.rdoproject.org/r/#/c/24726/ | 15:50 |
| dpawlik | and cc tristanC | 15:50 |
| dpawlik | weshay: AFAIK rhel image server is a separated server | 15:52 |
| weshay | it is.. but it's the same subject | 15:53 |
| dpawlik | weshay, could you be more verbose? | 15:55 |
| *** dmsimard has joined #oooq | 15:58 | |
| dmsimard | dpawlik: o/ can I help | 15:58 |
| dmsimard | (I don't have backlog history for this channel) | 15:58 |
| dpawlik | let me paste you on priv dmsimard | 15:59 |
| weshay | dpawlik, before moving the images.rdoproject.. my expectation is there is at least a plan for the RHEL protected server as well | 16:00 |
| weshay | dpawlik, until I see that.... I'm nacking | 16:00 |
| dmsimard | weshay: the rhel protected server ? | 16:00 |
| weshay | the.. server zoli put up | 16:01 |
| * weshay forgets the name you guys used | 16:01 | |
| *** nhicher has joined #oooq | 16:02 | |
| jpena | weshay: is that the rcm share ? | 16:02 |
| * jpena tries to find | 16:02 | |
| chkumar|rover | see ya people tomorrow | 16:04 |
| chkumar|rover | have a nice day ahead | 16:04 |
| *** chkumar|rover is now known as raukadah | 16:04 | |
| jpena | dmsimard, dpawlik: I think I found it. That's https://github.com/rdo-infra/rdo-infra-playbooks/blob/master/doc/source/rcm-share_about.rst | 16:04 |
| weshay | jpena, yup rcm | 16:04 |
| dmsimard | jpena: what tenant is that in ? I don't see it | 16:05 |
| jpena | So... this is an interesting one, I had forgotten about it. It seems to be located in another tenant, which we don't have access to (just zoli it seems) | 16:05 |
| dmsimard | T_T | 16:06 |
| dpawlik | xD | 16:06 |
| jpena | let's sync about it internally, we'll need some more info about the server | 16:07 |
| dmsimard | yup | 16:07 |
| weshay | :) | 16:07 |
| weshay | thanks guys!! | 16:08 |
| dpawlik | weshay, so I will come back with the topic later ;) | 16:08 |
| weshay | dpawlik, sounds fine.. thank you :) | 16:08 |
| marios | reviews please when you next have time thank you "Refresh start_named_hashes after promotion to prevent false positive" https://review.rdoproject.org/r/#/c/24665/ | 16:08 |
| weshay | zbr, can I borrow you for 5 min? re: logs | 16:09 |
| zbr | sure | 16:09 |
| *** ykarel is now known as ykarel|away | 16:09 | |
| arxcruz | back | 16:09 |
| weshay | zbr, thanks.. /me sends meet link | 16:10 |
| weshay | zbr, https://meet.google.com/eqr-rkpn-upt?authuser=1 | 16:10 |
| weshay | arxcruz, need you for a sec too :) | 16:14 |
| weshay | re: logging | 16:14 |
| weshay | https://meet.google.com/eqr-rkpn-upt?authuser=1 | 16:15 |
| arxcruz | weshay: logging | 16:16 |
| weshay | zbr, https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/tasks/publish.yml#L81-L108 | 16:17 |
| marios | kopecmartin: raukadah: arxcruz: rlandy: sshnaidm: please check update in https://review.opendev.org/#/c/701016/ fs20 split when you next have some time thanks. I made it only fs1 per discussions. | 16:19 |
| rlandy | k | 16:20 |
| arxcruz | marios: sure, i'm doing some tests, and i'll update as soon as I get it, in like 3 hours | 16:20 |
| arxcruz | probably tomorrow morning i'll do it | 16:20 |
| marios | arxcruz: ack whenever you next have reviews time thank you | 16:20 |
| sshnaidm | marios, I think you want to do it only for periodic fs001, right? | 16:21 |
| marios | https://review.rdoproject.org/r/#/c/24665/ reviews please when you next have time thank you "Refresh start_named_hashes after promotion to prevent false positive" | 16:21 |
| marios | sshnaidm: yes i updated https://review.opendev.org/#/c/701016/ I made it only fs1 per discussions. | 16:21 |
| marios | sshnaidm: i mean fs1 and fs20 split removed all the fs10 stuffs | 16:22 |
| sshnaidm | marios, would be great to see list of tests from old 020 and from new jobs | 16:22 |
| marios | sshnaidm: and needed a new depends-on for fs1 timeout bump please check there too when you have time for reviews | 16:22 |
| marios | sshnaidm: there is from th eold one in th taiga | 16:22 |
| marios | sshnaidm: and i attached it in https://tree.taiga.io/project/tripleo-ci-board/task/1383 | 16:22 |
| marios | sshnaidm: and also your script for generating the ordered list | 16:22 |
| marios | sshnaidm: we can re-run once we get green one on test review https://review.rdoproject.org/r/#/c/24339 | 16:23 |
| sshnaidm | marios, is there periodic fs001 running with this patch? | 16:23 |
| marios | sshnaidm: on test review https://review.rdoproject.org/r/#/c/24339 | 16:23 |
| weshay | zbr, one more odd thing.. | 16:23 |
| weshay | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/a642ca9/logs/quickstart_files/ | 16:23 |
| sshnaidm | marios, ack, thanks | 16:23 |
| marios | sshnaidm: all the things are linked in taiga | 16:23 |
| weshay | doens't have the log file sizes in it | 16:23 |
| marios | sshnaidm: welcom thanks for checking | 16:23 |
| sshnaidm | marios, cool | 16:23 |
| weshay | zbr, where http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-master/b14b570/logs/quickstart_files/log-size.txt | 16:24 |
| weshay | does | 16:24 |
| weshay | I think again an ovb thing or setting | 16:24 |
| zbr | lower prio, let me do them one by one | 16:24 |
| zbr | maybe someone can explain me why there is a "not artcl_collect|bool" on publish task from mian.. | 16:26 |
| weshay | zbr, aye.. thanks | 16:26 |
| zbr | it seems that collect and publish are exclusive | 16:27 |
| sshnaidm | weshay, I see downstream dashboard is doing well now | 16:27 |
| weshay | sshnaidm, :) | 16:28 |
| weshay | sshnaidm++ | 16:28 |
| weshay | sshnaidm, really nice work there!! | 16:28 |
| weshay | makes me happy | 16:28 |
| weshay | rlandy, baremetal jobs visible \0/ | 16:28 |
| rlandy | weshay: yay!! | 16:29 |
| rlandy | I see | 16:29 |
| sshnaidm | charts and dashboard always make management happy | 16:29 |
| rlandy | sshnaidm: lol - you forgot spreadsheets | 16:29 |
| sshnaidm | rlandy, oh, this is the hardcore | 16:30 |
| rlandy | weshay: do you want to merge the unpinning of rhos-15? https://code.engineering.redhat.com/gerrit/#/c/190564/ | 16:30 |
| zbr | i am not sure where the move of tempest report should be done, in collect or in publish. | 16:31 |
| weshay | rlandy, I think it may be a good test use case for doing so... osp-15 is very low impact / priority | 16:31 |
| rlandy | weshay: fine - merging | 16:31 |
| weshay | rlandy, the other interesting bit... is that the issue w/ the osp job was real | 16:31 |
| rlandy | meaning? | 16:31 |
| weshay | rlandy, /me wonders if we could run fs010 containers-multinode | 16:31 |
| zbr | i am inclined to believe that publish should not do any "post processing" like moving tempest files | 16:31 |
| weshay | rlandy, meaning changing the pin will have no real consequence | 16:32 |
| weshay | so let's do it.. | 16:32 |
| weshay | zbr++ | 16:32 |
| rlandy | it's done | 16:32 |
| rlandy | you want fs10 downstream periodic? | 16:32 |
| weshay | rlandy, rock.. I'll put up a multinode job there and see if it recreates the overcloud deploy issue | 16:32 |
| weshay | rlandy, ya.. I'll have a go at it | 16:32 |
| rlandy | sure | 16:32 |
| weshay | rlandy, no need for to ruck / rover | 16:33 |
| raukadah | weshay, rlandy may be instead of fs10, I would suggest fs001 | 16:33 |
| weshay | until I'm stuck again | 16:33 |
| * weshay runs | 16:33 | |
| rlandy | you may hit a inheritance issue - just ping if you dp | 16:33 |
| weshay | raukadah, so.. there is that | 16:33 |
| rlandy | do | 16:33 |
| weshay | but.. let's see if multinode gets the job done first | 16:33 |
| weshay | raukadah, but that is what I'm wondering... fs001 vs. fs010 | 16:33 |
| weshay | to discover terrible overcloud deployment issues | 16:34 |
| raukadah | fs010 more stable but fs001 has given use more hidden issues | 16:34 |
| raukadah | better run both and see | 16:34 |
| *** marios is now known as marios|out | 16:45 | |
| raukadah | zbr, weshay, rlandy https://review.rdoproject.org/zuul/builds?result=TIMED_OUT%20 timeout is growing please have a look | 17:04 |
| rlandy | oh dear | 17:04 |
| rlandy | ok | 17:05 |
| rlandy | will look in a bit | 17:05 |
| weshay | need ara | 17:08 |
| weshay | rlandy, don't worry | 17:08 |
| rlandy | weshay: k - np | 17:15 |
| *** dtantsur is now known as dtantsur|afk | 17:19 | |
| rlandy | weshay: zuul quickstart works great | 17:21 |
| rlandy | just need to update git | 17:21 |
| weshay | rlandy, ah .. very cool | 17:21 |
| rlandy | think it's a worthwhile exercise | 17:21 |
| rlandy | I'm going to run through it in training | 17:22 |
| rlandy | it's setup on my hardware box | 17:22 |
| *** bogdando has quit IRC | 17:23 | |
| *** marios|out has quit IRC | 17:24 | |
| raukadah | rlandy, zbr weshay panda rfolco more python standards https://github.com/rednafi/py-sanity | 17:25 |
| *** jmasud has joined #oooq | 17:25 | |
| raukadah | zbr, we can inforce isort also with black changes | 17:25 |
| zbr | not yet. thre is a bug they need to fix | 17:25 |
| zbr | also we need to pace it, first lets gets used to black | 17:26 |
| zbr | isort bug prevented pip from adopting black | 17:26 |
| raukadah | we have lots of stuff in town pyproject.toml poetry and many more | 17:27 |
| *** holser has quit IRC | 17:29 | |
| *** jmasud has quit IRC | 17:30 | |
| *** amoralej is now known as amoralej|off | 17:34 | |
| *** jmasud has joined #oooq | 17:34 | |
| *** jfrancoa has quit IRC | 17:38 | |
| *** holser has joined #oooq | 17:38 | |
| *** jmasud has quit IRC | 17:41 | |
| *** jmasud has joined #oooq | 17:46 | |
| *** jmasud has quit IRC | 17:52 | |
| *** jfrancoa has joined #oooq | 17:53 | |
| *** jmasud has joined #oooq | 17:57 | |
| *** jpena is now known as jpena|off | 17:58 | |
| raukadah | rlandy, https://review.opendev.org/#/c/704583/ sslverify patch merged now, I will setup a call tomorrow for next course of action on downstream, weshay do you want to join the party? | 18:02 |
| raukadah | regarding podman | 18:02 |
| *** derekh has quit IRC | 18:03 | |
| raukadah | rlandy, invite sent | 18:05 |
| raukadah | please modify based on availability | 18:05 |
| *** jmasud has quit IRC | 18:06 | |
| weshay | raukadah, was that related to a bug? | 18:06 |
| raukadah | weshay, nope, related to podman downstream gating with all ideas captured on prod chain council board | 18:07 |
| weshay | ah.. thought it may be that | 18:09 |
| raukadah | weshay, will discuss one bug also | 18:10 |
| raukadah | will file tomorrow | 18:10 |
| raukadah | and debug | 18:10 |
| weshay | raukadah, k.. claim a 1/2 hour my cal | 18:10 |
| weshay | please | 18:10 |
| weshay | raukadah, can be early | 18:10 |
| raukadah | weshay, feel free to change that | 18:10 |
| raukadah | I just need 30 mins | 18:10 |
| raukadah | made it to 30 mins | 18:12 |
| *** holser has quit IRC | 18:15 | |
| weshay | thanks | 18:15 |
| *** jmasud has joined #oooq | 18:18 | |
| rlandy | raukadah: sure | 18:19 |
| *** tosky has quit IRC | 18:22 | |
| *** jmasud has quit IRC | 18:27 | |
| *** jmasud has joined #oooq | 18:30 | |
| zbr | who has time for a quick explanation about... re-collection? | 18:31 |
| zbr | my https://review.opendev.org/#/c/703586/ produced the desired output https://review.opendev.org/#/c/703586/ | 18:31 |
| rlandy | zbr: unrelated to ^^ ... I see you commented on this error in other reports ... is there a way around this error: https://sf.hosted.upshift.rdu2.redhat.com/logs/84/190384/19/check/tox-linters/133f8da/job-output.txt | 18:32 |
| rlandy | safe to just ignore? | 18:33 |
| zbr | rlandy: not for a long time, i can fix, too complex to explain, but you can see the CR | 18:34 |
| zbr | rlandy: weird, unable to reproduce locally on master | 18:36 |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/190384/20/playbooks/podman/run.yaml | 18:37 |
| rlandy | code is legit - can we just add something to ignore that? | 18:37 |
| rlandy | it won't resolve | 18:37 |
| rlandy | w/o the dependent job | 18:38 |
| zbr | rlandy: give me few minutes, i will try to fix it | 18:38 |
| rlandy | zbr: thanks - no rush | 18:38 |
| zbr | it does reproduce with that patch | 18:38 |
| rlandy | ack three times so far | 18:38 |
| zbr | i know how to fix it | 18:38 |
| rlandy | awesome | 18:41 |
| *** jmasud has quit IRC | 18:41 | |
| zbr | mainly the linter fails to find zuul_return ansible module. yep you can ignore but is not a good practice | 18:42 |
| zbr | making it find, is a little bit tricky but doable. | 18:42 |
| zbr | something like here https://opendev.org/opendev/base-jobs/src/branch/master/tox.ini#L22 | 18:42 |
| *** jmasud has joined #oooq | 18:44 | |
| *** jmasud has quit IRC | 18:49 | |
| zbr | weshay: IMHO updates/upgrades should never gate. | 18:52 |
| zbr | this is not an acceptable failure rate | 18:53 |
| zbr | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates&pipeline=gate | 18:53 |
| weshay | zbr, well.. luckily I also have opinions :) | 18:53 |
| weshay | zbr, I respectfully disagree w/ you :) | 18:54 |
| zbr | the never ending negociation about what goes where... | 18:54 |
| weshay | ya | 18:54 |
| weshay | well that is tru | 18:54 |
| zbr | on the other hand, happy that i do not see more tripleo on rhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates&pipeline=gate | 18:56 |
| zbr | wrong link, correct https://zuul.opendev.org/t/openstack/builds?pipeline=gate&result=failure# | 18:56 |
| zbr | who fails at the gate, we need a big shaming dasboard for that :D | 18:57 |
| zbr | rlandy: ignore it for the moment. watch https://github.com/ansible/ansible-lint/issues/372#issuecomment-579903645 for details | 18:59 |
| *** tesseract has quit IRC | 18:59 | |
| zbr | is not a bug in the linter, is a missing module, one that is not easy to make available. | 18:59 |
| rlandy | ok | 19:02 |
| weshay | zbr, in other news https://review.rdoproject.org/zuul/stream/fb2e24e897d54373b9885c9f41778821?logfile=console.log | 19:04 |
| weshay | check the time stamp on collect logs there | 19:05 |
| weshay | le yikes | 19:05 |
| weshay | rlandy, qq.. doesn't look like we have an internal-base job for multinode.. in your humble opinion which would be better.. | 19:08 |
| weshay | maybe easier | 19:08 |
| weshay | standing up ovb or multinode | 19:08 |
| rlandy | weshay: multinode | 19:08 |
| rlandy | easier on the resources | 19:08 |
| weshay | and psi still is flaky I think | 19:08 |
| rlandy | works fairly well for us | 19:09 |
| rlandy | as opposed to what other rock solid cloud??? | 19:09 |
| weshay | heh | 19:09 |
| weshay | rlandy, seen issues w/ ovb | 19:10 |
| weshay | in psi | 19:10 |
| weshay | rlandy, hence https://code.engineering.redhat.com/gerrit/#/c/185863/7 | 19:10 |
| rlandy | yeah - so multinode may be easier to go with | 19:10 |
| *** holser has joined #oooq | 19:10 | |
| rlandy | weshay: so here's the funny thing | 19:11 |
| rlandy | http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/tree/zuul.d/jobs.yaml#n25 for example | 19:12 |
| rlandy | parents off | 19:12 |
| rlandy | https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L7 | 19:12 |
| rlandy | which parents off multinode | 19:12 |
| rlandy | so if you look at standalone | 19:12 |
| rlandy | and make the same modifications on an internal job parenting off https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L68 | 19:13 |
| weshay | ah.. right | 19:13 |
| weshay | that's right. | 19:13 |
| rlandy | it should be ok | 19:13 |
| weshay | so I just need to define the node | 19:13 |
| rlandy | be careful of the nodeset | 19:13 |
| weshay | or look if it already is | 19:13 |
| rlandy | you need one that supports multinode | 19:13 |
| *** jmasud has joined #oooq | 19:15 | |
| rlandy | zbr: um .. how do I find which rule number this error is to skip? | 19:17 |
| *** jmasud has quit IRC | 19:20 | |
| zbr | rlandy: you cannot use a skip rule on that. | 19:24 |
| *** jmasud has joined #oooq | 19:24 | |
| zbr | is not a rule, is an internal failure, at this moment. | 19:24 |
| weshay | rfolco, ping | 19:24 |
| rfolco | weshay, o/ | 19:24 |
| rlandy | k - suggestion on how to ignore this? | 19:24 |
| weshay | rfolco, you have 5min? | 19:25 |
| rfolco | weshay, yep | 19:25 |
| weshay | https://meet.google.com/erg-zoyg-jnz?authuser=1 | 19:25 |
| rlandy | trying the tag | 19:28 |
| rlandy | 2020-01-29 19:32:27.543362 | upstream-centos-7 | linters: commands succeeded | 19:32 |
| rlandy | 2020-01-29 19:32:27.543393 | upstream-centos-7 | congratulations :) | 19:32 |
| rlandy | woohoo | 19:32 |
| rlandy | zbr: ^^ thanks | 19:33 |
| rlandy | raukadah: yay ... merging podman jobs | 19:34 |
| weshay | rfolco, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/get-hash.yaml | 19:34 |
| *** jmasud has quit IRC | 19:48 | |
| weshay | rlandy, have you ever seen a bm job get a node failure? | 19:59 |
| weshay | rlandy, https://code.engineering.redhat.com/gerrit/#/c/189436/ | 19:59 |
| rlandy | weshay: yes for the nodepool node | 20:00 |
| weshay | oh.. right.. it runs as the slave | 20:00 |
| weshay | dam them | 20:00 |
| rlandy | weshay: yeah ... we still rely on a nodepool 'jumpbox' | 20:00 |
| weshay | rlandy, you know we should start socializing that as an option for infrared folks | 20:01 |
| weshay | to use all their hardware.. but move to zuul | 20:01 |
| weshay | meh | 20:01 |
| rlandy | weshay: yeah - that was suggested on the call today, no? | 20:02 |
| rlandy | I'm all for it | 20:02 |
| *** holser has quit IRC | 20:02 | |
| rlandy | remember when we tried to update our tests still using jenkins? shoot me | 20:02 |
| weshay | rlandy, looks like it's nothing we did | 20:57 |
| * rlandy is not so sure | 20:59 | |
| rlandy | there is something up with that floating ip allocation | 20:59 |
| weshay | omg.. I just learned something new about tmux | 21:03 |
| weshay | and it's the feature I've waiting for.. | 21:03 |
| weshay | \0/ | 21:03 |
| rlandy | weshay: that's almost as good as my getting by the linter error earlier | 21:04 |
| weshay | rlandy, https://review.opendev.org/#/c/680571/ | 21:07 |
| rlandy | weshay: let's give that a run on real bm | 21:09 |
| weshay | github sucks | 21:25 |
| weshay | rfolco, help me find this "Pull ppc64le tagged container images from trunk.registry.rdoproject.org registry" task | 21:28 |
| weshay | rfolco, nvrmind | 21:30 |
| weshay | containers-push.. | 21:30 |
| weshay | not promoter | 21:30 |
| weshay | duh | 21:30 |
| *** apetrich has quit IRC | 21:43 | |
| *** jmasud has joined #oooq | 21:55 | |
| *** jmasud has quit IRC | 22:06 | |
| *** jtomasek has quit IRC | 22:06 | |
| *** jmasud has joined #oooq | 22:09 | |
| *** tosky has joined #oooq | 22:10 | |
| *** holser has joined #oooq | 22:12 | |
| *** jmasud has quit IRC | 22:16 | |
| *** jfrancoa has quit IRC | 22:30 | |
| *** Trevor_V has quit IRC | 22:31 | |
| *** rfolco has quit IRC | 22:33 | |
| *** rlandy is now known as rlandy|bbl | 23:14 | |
| owalsh | weshay: hey, ok if i just change the depends on for https://review.rdoproject.org/r/#/c/24726/ to check if the fix is good? | 23:30 |
| *** ysandeep has joined #oooq | 23:37 | |
| owalsh | meh, no logs from that job anyway but if it passes I'll assume it's all good | 23:37 |
| *** sshnaidm is now known as sshnaidm|afk | 23:45 | |
| *** jmasud has joined #oooq | 23:52 | |
| *** tosky has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!