*** LaurentDumont has joined #oooq | 00:05 | |
*** ykarel has joined #oooq | 01:11 | |
*** ykarel has quit IRC | 01:15 | |
*** LaurentDumont has quit IRC | 01:45 | |
*** yolanda has quit IRC | 01:51 | |
*** yolanda has joined #oooq | 01:54 | |
*** ykarel has joined #oooq | 01:55 | |
*** altlogbot_0 has quit IRC | 02:12 | |
*** altlogbot_2 has joined #oooq | 02:12 | |
*** ykarel has quit IRC | 02:15 | |
*** dsneddon has quit IRC | 03:20 | |
*** ykarel has joined #oooq | 03:26 | |
*** dsneddon has joined #oooq | 03:45 | |
*** ykarel has quit IRC | 04:08 | |
*** aakarsh has joined #oooq | 04:09 | |
*** ykarel has joined #oooq | 04:24 | |
*** raukadah is now known as chandankumar | 04:59 | |
*** dsneddon has quit IRC | 05:21 | |
*** marios has joined #oooq | 05:29 | |
*** marios_|ruck has joined #oooq | 05:29 | |
*** quiquell has joined #oooq | 05:48 | |
*** dsneddon has joined #oooq | 06:16 | |
*** holser_ has joined #oooq | 06:20 | |
*** dsneddon has quit IRC | 06:21 | |
*** jfrancoa has joined #oooq | 06:29 | |
chandankumar | marios_|ruck: hello | 06:47 |
---|---|---|
chandankumar | marios_|ruck: we fixed queens member roles | 06:47 |
chandankumar | jobs passing in promotion pipeline | 06:47 |
chandankumar | fs020 queens afailures are again back | 06:47 |
marios_|ruck | chandankumar: i saw there was some update on kopecmartin|afk patch? | 06:47 |
marios_|ruck | chandankumar: i mean it wasn't merged and there was some issue like pep/tox fail | 06:48 |
* marios_|ruck checks again | 06:48 | |
chandankumar | marios_|ruck: we have taken a different approach all toagther | 06:48 |
chandankumar | marios_|ruck: https://review.rdoproject.org/r/#/c/20909/ | 06:48 |
*** yolanda has quit IRC | 06:49 | |
marios_|ruck | chandankumar: so we don't want that? https://review.opendev.org/#/c/660748 | 06:49 |
chandankumar | marios_|ruck: we need that | 06:49 |
*** yolanda has joined #oooq | 06:49 | |
chandankumar | marios_|ruck: but it will come with more polished, in a new tempestconf tag | 06:49 |
chandankumar | which will take time | 06:49 |
chandankumar | we have cherry -picked first patchset in the spec file to unblock the ci | 06:50 |
chandankumar | which is working in our jobs | 06:50 |
marios_|ruck | chandankumar: so short term https://review.rdoproject.org/r/#/c/20909/ but longer term fix https://review.opendev.org/#/c/660748 | 06:50 |
chandankumar | marios_|ruck: yes | 06:50 |
chandankumar | marios_|ruck: it will not cause any regression in downstream jobs also | 06:50 |
marios_|ruck | chandankumar: ack thanks for update | 06:51 |
ykarel | marios_|ruck, hi | 06:53 |
marios_|ruck | ykarel: o/ | 06:54 |
ykarel | marios_|ruck, can you check failed ovb stacks | 06:54 |
ykarel | marios_|ruck, and also collect some info before cleaning those, like port list | 06:54 |
marios_|ruck | ykarel: we have a ticket already at https://tickets.osci.io/rt/Ticket/Display.html?id=1768 | 06:54 |
marios_|ruck | ykarel: or we need a new one? | 06:54 |
marios_|ruck | ykarel: but didn't get chance to cycle back to that (weshay opened it last week). | 06:55 |
marios_|ruck | ykarel: or lots of fails today/yesterday/new thing? | 06:55 |
ykarel | marios_|ruck, how many stacks are there with ^^ ticket? | 06:55 |
ykarel | from cockpit i saw 5 stack fails | 06:55 |
marios_|ruck | ykarel: ok, let me finish what am doing and will look into that | 06:55 |
chandankumar | marios_|ruck: I am looking with ykarel | 06:59 |
chandankumar | thanks :-) | 06:59 |
*** ratailor has joined #oooq | 07:06 | |
*** dsneddon has joined #oooq | 07:15 | |
marios_|ruck | ykarel: chandankumar ack are you on a call? | 07:18 |
marios_|ruck | ykarel: there are 6 stacks in that ticket | 07:18 |
ykarel | marios_|ruck, ack, me and chandankumar sit in same office: Pune | 07:19 |
marios_|ruck | ykarel: yeah i know but sometimes folks work from home or don't directly sit next to each other :D | 07:20 |
*** dsneddon has quit IRC | 07:20 | |
*** amoralej|off is now known as amoralej | 07:22 | |
ykarel | marios_|ruck, hmm possible :) | 07:23 |
ykarel | marios_|ruck, i ran browbeat fs053 job with rally-openstack master and it passed:- https://review.opendev.org/#/c/661180/ | 07:23 |
marios_|ruck | ykarel: chandankumar so did you collect logs is there something for me to do there | 07:23 |
marios_|ruck | ykarel: yah i'm sorry about that | 07:23 |
marios_|ruck | https://bugs.launchpad.net/tripleo/+bug/1828559 | 07:23 |
openstack | Launchpad bug 1829030 in Rally "duplicate for #1828559 [rally 1.5.0] rally deployment create --fromenv creates wrong spec for openstack platform" [High,Fix released] - Assigned to Andrey Kurilin (andreykurilin) | 07:23 |
marios_|ruck | ykarel: i have been trying to find time to get to it all week | 07:24 |
marios_|ruck | ykarel: today :D :/ | 07:24 |
marios_|ruck | ykarel: so their fix has been released looks like | 07:24 |
ykarel | marios_|ruck, np, you can pick whenever free, i just tried to narrow down it | 07:24 |
marios_|ruck | ykarel: is that what you meant | 07:24 |
*** jtomasek has joined #oooq | 07:25 | |
ykarel | marios_|ruck, currently rally-openstack 1.4.0 is used which is failing | 07:26 |
ykarel | and 1.4.0 is last releae currently https://github.com/openstack/rally-openstack/releases | 07:26 |
marios_|ruck | ykarel: right i see you confirmed that th efix (from master) is ok though | 07:26 |
ykarel | marios_|ruck, yes, so we need a new release of rally-openstack | 07:27 |
ykarel | and update rally_openstack_version: <new release> | 07:27 |
*** apahim_ has joined #oooq | 07:27 | |
marios_|ruck | ykarel: ack ... wondering if folco meant to file that against tripleo but filed it against rally by mistake (title is 'fs 053' tripleo specific) anyway | 07:28 |
ykarel | hmm may be i didn't checked that | 07:28 |
*** apahim_ has quit IRC | 07:29 | |
*** apahim_ has joined #oooq | 07:29 | |
*** apahim has quit IRC | 07:30 | |
*** dtantsur|afk is now known as dtantsur | 07:30 | |
*** hrybacki has quit IRC | 07:33 | |
chandankumar | marios_|ruck: https://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/7865943/logs/tempest.html.gz | 07:35 |
chandankumar | queens periodic passed fs017 | 07:35 |
marios_|ruck | chandankumar: nice ok so it just didn't report yet? i dont' see it in https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens | 07:37 |
*** hrybacki has joined #oooq | 07:39 | |
chandankumar | marios_|ruck: once the periodic runs completed then it reports to zuul dashboard | 07:40 |
marios_|ruck | chandankumar: ack so is ongoing you mean | 07:41 |
chandankumar | sshnaidm: panda marios_|ruck dstat upstream deprecated replaced with new project https://www.redhat.com/en/blog/implementing-dstat-performance-co-pilot | 07:41 |
*** hrybacki has quit IRC | 07:44 | |
*** hrybacki has joined #oooq | 07:45 | |
*** jpena|off is now known as jpena | 07:50 | |
*** apahim_ has quit IRC | 07:51 | |
*** apahim_ has joined #oooq | 07:52 | |
*** jtomasek has quit IRC | 08:02 | |
*** hrybacki has quit IRC | 08:09 | |
*** bogdando has joined #oooq | 08:09 | |
*** hrybacki has joined #oooq | 08:09 | |
*** tosky has joined #oooq | 08:10 | |
*** apetrich has quit IRC | 08:12 | |
*** apetrich has joined #oooq | 08:13 | |
*** dsneddon has joined #oooq | 08:15 | |
*** zbr has joined #oooq | 08:19 | |
chandankumar | zbr: Hello | 08:21 |
*** ykarel is now known as ykarel|lunch | 08:21 | |
zbr | chandankumar: hi. | 08:22 |
chandankumar | zbr: https://docs.google.com/spreadsheets/d/1HMdPAiohKEfSeIosz0RzFBjdf4Qc9fZiuFIfjBzEQwc/edit#gid=1187359835 -> on resolved section | 08:22 |
chandankumar | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON -> related to this bug https://bugzilla.redhat.com/show_bug.cgi?id=1710955 | 08:22 |
openstack | bugzilla.redhat.com bug 1710955 in openstack-tripleo "tenant_network_type is misconfigured as vxlan even though gre was chosen" [High,Closed: notabug] - Assigned to beagles | 08:23 |
*** jtomasek has joined #oooq | 08:24 | |
chandankumar | zbr: do you have logs for this test tempest.api.volume.test_volumes_clone_negative.VolumesCloneNegativeTest.test_create_from_volume_decreasing_size ? | 08:28 |
*** kopecmartin|afk is now known as kopecmartin | 08:29 | |
*** bogdando has quit IRC | 08:33 | |
*** bogdando has joined #oooq | 08:34 | |
zbr | chandankumar: nope | 08:36 |
zbr | chandankumar: ready for a quick bj? | 08:37 |
chandankumar | zbr: yes sir | 08:37 |
zbr | https://bluejeans.com/2655417928 | 08:37 |
chandankumar | zbr: http://pastebin.test.redhat.com/766042 | 08:38 |
chandankumar | zbr: https://tree.taiga.io/project/tripleo-ci-board/task/1080 | 08:42 |
*** tesseract has joined #oooq | 08:48 | |
*** ccamacho has joined #oooq | 08:56 | |
*** derekh has joined #oooq | 08:57 | |
*** apahim has joined #oooq | 09:04 | |
*** apahim_ has quit IRC | 09:07 | |
marios_|ruck | panda: updated https://review.opendev.org/#/c/661030/3 whn you get a chance thanks - you're right i posted it in a rush before leaving, we only want the upgrade jobs there | 09:10 |
*** ykarel|lunch is now known as ykarel | 09:11 | |
*** saneax has joined #oooq | 09:13 | |
*** dsneddon has quit IRC | 09:18 | |
*** apahim_ has joined #oooq | 09:20 | |
*** apahim has quit IRC | 09:24 | |
ykarel | marios_|ruck, chandankumar so only fs020 failed in queens promotion pipeline | 09:27 |
ykarel | some tempest test failed related to backup, can you guys promote queens skipping fs020 from promotion criteria | 09:28 |
ykarel | promotion is needed to clear upstream gate jobs | 09:28 |
marios_|ruck | ykarel: ack ... do you have pointer? i'll post the skip for fs020 sec | 09:29 |
ykarel | marios_|ruck, https://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens/b5ffa14/logs/tempest.html.gz | 09:29 |
ykarel | marios_|ruck, instead of skip need to fix it | 09:30 |
ykarel | issue is tests are running when backup service is not enabled | 09:30 |
ykarel | there must be already bug for it, as it was seeen few days back also | 09:30 |
marios_|ruck | ykarel: ok, i thought that's what you meant by "skipping fs020 from promotion criteria" | 09:30 |
*** holser_ is now known as holser|lunch | 09:30 | |
marios_|ruck | ykarel: so we can promote queens w/out it today | 09:31 |
ykarel | marios_|ruck, yes i mean ^^ | 09:31 |
ykarel | by removing https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-7/queens.ini#L27 | 09:32 |
marios_|ruck | ykarel: right ok so we're saying same | 09:33 |
marios_|ruck | ykarel: /me was confused when you said 12:30 < ykarel> marios_|ruck, instead of skip need to fix it | 09:33 |
ykarel | marios_|ruck, okk sorry for creating confusion | 09:34 |
marios_|ruck | ykarel: ack np ... obv we have to fix it but just making sure i understood what you said about the skip ok posting sec | 09:34 |
marios_|ruck | and will file a bug for that tempest if we don't have one | 09:34 |
marios_|ruck | chandankumar: are you aware of a bug for that fs20 issue already /me can't find one quickly | 09:37 |
marios_|ruck | chandankumar: https://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens/b5ffa14/logs/tempest.html.gz | 09:37 |
marios_|ruck | tempest.api.volume.admin.test_volumes_backup.VolumesBackupsAdminTest | 09:37 |
ykarel | backup = False is needed in Tempestconf | 09:41 |
ykarel | under volume-feature-enabled | 09:41 |
marios_|ruck | ykarel: ack ok but will file the bug so i can reference it in the skip so we don't forget to unskip | 09:42 |
ykarel | marios_|ruck, ack, | 09:43 |
chandankumar | marios_|ruck: sorry I was drafting ane email | 09:48 |
chandankumar | zbr: replied the email osp-15 one, | 09:48 |
marios_|ruck | chandankumar: np here https://bugs.launchpad.net/tripleo/+bug/1830351 | 09:48 |
openstack | Launchpad bug 1830351 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens fails tempest run for tempest.api.volume.admin.test_volumes_backup test group" [Critical,Triaged] | 09:48 |
marios_|ruck | chandankumar: if we have one already can close np | 09:48 |
chandankumar | zbr: I have attached few infrared failures link | 09:48 |
chandankumar | from few tests | 09:49 |
chandankumar | we can take a look if needed or we want to cleanup the skip tests for stein | 09:49 |
chandankumar | zbr: feel free to add more info to the email anything missed | 09:49 |
marios_|ruck | ykarel: chandankumar https://review.rdoproject.org/r/#/c/20920/ | 09:50 |
marios_|ruck | Tengu: did you and zbr talk (about molecule?) he's back :) | 09:52 |
zbr | marios_|ruck: not yet but there is a meeting today, in ~5h from how. -- still I can talk about it at any time. | 09:53 |
*** apahim_ has quit IRC | 09:53 | |
marios_|ruck | zbr: i just remembered Tengu was asking us about molecule few days back | 09:53 |
ykarel | marios_|ruck, +1 | 09:54 |
*** apahim_ has joined #oooq | 09:55 | |
*** tesseract has quit IRC | 09:56 | |
*** tesseract has joined #oooq | 09:59 | |
*** tesseract has quit IRC | 10:00 | |
*** tesseract has joined #oooq | 10:01 | |
*** apahim_ has quit IRC | 10:10 | |
*** apahim_ has joined #oooq | 10:16 | |
chandankumar | sshnaidm: Hello | 10:20 |
chandankumar | sshnaidm: panda can we merge this https://review.rdoproject.org/r/#/c/20902/-> https://review.rdoproject.org/r/#/c/20898/ -> https://review.rdoproject.org/r/#/c/20919/ | 10:21 |
chandankumar | in sequence | 10:21 |
*** holser|lunch is now known as holser_ | 10:34 | |
*** panda has quit IRC | 10:38 | |
chandankumar | sshnaidm: marios_|ruck can we merge this https://review.rdoproject.org/r/#/c/20920/ if you have super powers | 10:42 |
marios_|ruck | chandankumar: i do not | 10:43 |
*** panda has joined #oooq | 10:46 | |
*** panda is now known as panda|rover | 10:48 | |
chandankumar | panda|rover: please merge this patch https://review.rdoproject.org/r/#/c/20902/ | 10:51 |
chandankumar | panda|rover: sorry this one https://review.rdoproject.org/r/#/c/20920/ | 10:51 |
panda|rover | chandankumar: can I review before merging it ? | 10:53 |
chandankumar | panda|rover: feel free to review it | 10:53 |
*** dsneddon has joined #oooq | 11:00 | |
chandankumar | panda|rover: any example of checkout-override | 11:08 |
chandankumar | ? | 11:08 |
panda|rover | chandankumar: sorry, override-checkout, you were using this before Sagi's comment | 11:10 |
*** tesseract has quit IRC | 11:10 | |
chandankumar | panda|rover: ok, restoring my changes then | 11:11 |
panda|rover | chandankumar: but you still have to answer his question | 11:11 |
chandankumar | panda|rover: commented back | 11:16 |
zbr | panda|rover: marios_|ruck : how are we supposed to test python3 code on rhel7 when default python3 is 3.4 which was dropped by pip in march? | 11:38 |
zbr | I got: DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429). | 11:38 |
zbr | while trying to run a "pip freeze" | 11:38 |
panda|rover | zbr: and pip freeze doesn't work ? | 11:39 |
zbr | not sure, but returned nothing which was unexpected. going to test more. | 11:39 |
zbr | i think we do have a support issue, especially as we have lots of tox targets using basepython=python3 .... which happens to be 3.4 | 11:40 |
*** jpena is now known as jpena|lunch | 11:40 | |
zbr | i can obviously switch to f28 machine to run them from there but... | 11:40 |
zbr | pip is a never ending source of surprises | 11:41 |
panda|rover | zbr: why are you teting python3 in rhel 7 | 11:42 |
zbr | panda|rover: because of https://github.com/openstack/tripleo-ci/blob/master/tox.ini#L25 | 11:43 |
panda|rover | zbr: I think you'll need to add a linters-legacy, and set python2 as base python there, then in all the centos/rhel7 jobs there you don't use linters, but linters-legacy | 11:45 |
zbr | panda|rover: i am working now on a fix for that issue, give me few minutes. | 11:45 |
zbr | molecule cannot be installed on python34 because it uses a version of ansible-lint which is not available on py34. nice surprise. | 11:46 |
panda|rover | we are obsolete | 11:46 |
zbr | panda|rover: speak for yourself, I still see myself 20s-ish ;) | 11:47 |
*** ratailor has quit IRC | 11:47 | |
*** ratailor has joined #oooq | 11:48 | |
panda|rover | zbr: not even 20, you're just 16 + VAT . | 11:49 |
zbr | panda|rover: yep. btw, please wf https://review.opendev.org/#/c/655659/ | 11:50 |
*** rfolco is now known as rfolco|brb | 11:51 | |
chandankumar | arxcruz: Hello | 11:54 |
chandankumar | arxcruz: How we run check skip list script? | 11:54 |
arxcruz | chandankumar: sorry ? | 11:55 |
chandankumar | arxcruz: https://github.com/openstack/tripleo-quickstart-extras/tree/master/roles/validate-tempest/files/check-skip-list | 11:56 |
arxcruz | chandankumar:i don't remember | 11:57 |
chandankumar | trying from commit message | 11:57 |
arxcruz | check_skip.py --log-url http://log.o.o/tempest.log --skip-file | 11:57 |
arxcruz | path/to/skip/list | 11:57 |
chandankumar | arxcruz: perfect https://tree.taiga.io/project/tripleo-ci-board/task/1084?kanban-status=1447275 | 12:02 |
chandankumar | arxcruz: thanks! | 12:02 |
arxcruz | chandankumar: the idea is to make it automated but yeah, sometimes i write stuff that actually works :D | 12:03 |
chandankumar | arxcruz: I am have a big idea | 12:03 |
chandankumar | test matrix | 12:03 |
chandankumar | we can talk later some day | 12:03 |
*** dsneddon has quit IRC | 12:03 | |
*** jaosorior has joined #oooq | 12:06 | |
*** sshnaidm is now known as sshnaidm|afk | 12:06 | |
chandankumar | arxcruz: kopecmartin please add the agenda here https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting | 12:12 |
chandankumar | for tempest meeting | 12:12 |
arxcruz | chandankumar: all my thoughts are in go to a biergarten :D | 12:13 |
Tengu | marios_|ruck: zbr heya! I'm on PTO until Tuesday - I'll come back to you next week :). | 12:14 |
*** derekh has quit IRC | 12:15 | |
marios_|ruck | Tengu: nice :D enjoy | 12:15 |
marios_|ruck | its totally fine. we'll stay here and work | 12:15 |
Tengu | :) | 12:15 |
Tengu | getting married takes some time :3 | 12:15 |
marios_|ruck | Tengu: ah congrats! | 12:16 |
marios_|ruck | any reviews need reviews? | 12:16 |
* Tengu start feeling some stress for tomorrow | 12:16 | |
marios_|ruck | Tengu: tomorrow is the big day? | 12:16 |
Tengu | marios_|ruck: hmmm nope, nothing really urgent | 12:16 |
Tengu | yeah | 12:16 |
marios_|ruck | Tengu: just remember, if whisky doesn't solve all your problems then you're just not using enough of it! | 12:17 |
marios_|ruck | Tengu: you'll be fine - having some kind of party also? | 12:17 |
Tengu | marios_|ruck: whisky is good :). We have plenty here (my wife does like it as well). and yeah, we throw some small party, mostly FOOD | 12:18 |
marios_|ruck | panda|rover: rfolco|brb chandankumar sshnaidm|afk need reviews? | 12:18 |
Tengu | because food is good | 12:18 |
chandankumar | Tengu: congrats :-) | 12:18 |
marios_|ruck | Tengu: nice :D have fun then | 12:18 |
Tengu | chandankumar: thanks :) | 12:18 |
chandankumar | Tengu: try some heena on your hand :-) | 12:18 |
Tengu | marios_|ruck: we'll try. just hoping we'll not get all the thunderstorm announced, we'll be on our motorcycles :D | 12:19 |
panda|rover | everybody is getting married | 12:19 |
Tengu | chandankumar: not really a big fan, although some are really beautiful :). Not sure it would fit my hands though ;) | 12:19 |
panda|rover | like a virus | 12:19 |
Tengu | it's spreading | 12:19 |
panda|rover | ones gets married, then everyone gets married. | 12:19 |
panda|rover | one gets kids, all other get kids | 12:20 |
Tengu | ah, nah, no kids. | 12:20 |
Tengu | we already have a cat, and will probably get a dog soon. the kind of dog that can climb on a motorcycle :) | 12:20 |
panda|rover | that's what I was saying too says. | 12:20 |
panda|rover | s/says// | 12:21 |
Tengu | :D | 12:21 |
panda|rover | even the morning at the maternity ward. "I said no kids!" | 12:23 |
Tengu | nah. no kid, that's for sure. we're both on the same line regarding this topic :) | 12:23 |
Tengu | anyway. have to go ;). see you next week folks! | 12:25 |
panda|rover | not fair. everyone should get his share of suffering | 12:25 |
Tengu | panda|rover: I'm not crazy ;) | 12:25 |
panda|rover | Tengu: cheers. | 12:25 |
Tengu | (well, not THAT crazy at least ;)) | 12:26 |
chandankumar | marios_|ruck: arxcruz https://review.opendev.org/#/c/661265/ | 12:28 |
chandankumar | I am not sure what to put in commit message details here | 12:29 |
marios_|ruck | chandankumar: nice | 12:29 |
marios_|ruck | chandankumar: good to remove things there | 12:29 |
chandankumar | marios_|ruck: I will update other branches also in night | 12:30 |
*** rlandy has joined #oooq | 12:35 | |
*** jpena|lunch is now known as jpena | 12:38 | |
weshay | chandankumar we don't need to track pike etc.. anymore | 12:47 |
chandankumar | weshay: I am ignoring pike | 12:53 |
chandankumar | will update queens, rocky and master also | 12:53 |
weshay | rock on | 12:53 |
chandankumar | panda|rover: marios_|ruck do we have a docs on retiring tripleo project? | 13:00 |
*** dsneddon has joined #oooq | 13:00 | |
chandankumar | context tripleo-ui email on openstack-discuss list | 13:00 |
panda|rover | chandankumar: what kind of information are you looking for ? | 13:00 |
marios_|ruck | chandankumar: yeah not aware of docs on that though | 13:00 |
chandankumar | like removeing fs from tripleo and jobs related to it | 13:01 |
panda|rover | chandankumar: nope, you'll have to look at the code that uses it. I remember we were installing tripleo-ui only in some undercloud-only jobs | 13:02 |
chandankumar | they have merged a specical fs also last i remembered | 13:02 |
arxcruz | chandankumar: we are waiting for u | 13:03 |
chandankumar | arxcruz: joined | 13:03 |
chandankumar | arxcruz: weshay kopecmartin https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting | 13:04 |
rlandy | weshay: are you still using envD? | 13:12 |
weshay | rlandy no.. thank you for it | 13:14 |
*** rfolco|brb is now known as rfolco | 13:18 | |
ykarel | chandankumar, marios_|ruck queens promoted | 13:20 |
chandankumar | \o/ | 13:21 |
marios_|ruck | fantastic thanks ykarel++ chandankumar++ | 13:21 |
chandankumar | please someone sponsers beers lots | 13:21 |
chandankumar | of | 13:21 |
arxcruz | chandankumar: when you visit Berlin :) | 13:25 |
*** Goneri has joined #oooq | 13:29 | |
*** ykarel is now known as ykarel|meeting | 13:29 | |
*** quiquell has quit IRC | 13:31 | |
zbr | panda|rover: marios_|ruck : fixed the py34 issue with https://review.opendev.org/#/c/661286/ | 13:33 |
zbr | ... well, fix = configured tox to avoid using py34. | 13:33 |
*** Goneri has quit IRC | 13:36 | |
panda|rover | zbr: this means python3 test will continue to run on centos7/rhel7 ? | 13:37 |
zbr | panda|rover: yes, tested with .tox folder clean : tox will use the preference order mentioned in envlist. | 13:37 |
rfolco | rlandy, hope I am doing it right this time: https://code.engineering.redhat.com/gerrit/171375 | 13:38 |
zbr | panda|rover: i know is a relatively unknown/hidden feature of tox but it is supported by official maintainers, it was suggested to me few months ago. | 13:39 |
zbr | panda|rover: sidenote: if no py3* is installed, it will try to use py27, not really a big deal. | 13:39 |
*** ratailor has quit IRC | 13:40 | |
rlandy | rfolco: k - no way of checking from looking at the code | 13:40 |
rlandy | rfolco: but we may as well merge and try since the old one was def wrong | 13:41 |
rfolco | rlandy, I wish there was a way to check if decrypt works | 13:41 |
chandankumar | arxcruz: if someone sponsers | 13:41 |
rlandy | rfolco: w+ - yo can try it when it merges | 13:41 |
rfolco | rlandy, thx | 13:42 |
panda|rover | zbr: I;m missing some info, how does a change and globbing in envlist determin the preference for basepython for first element in such list | 13:42 |
panda|rover | ? | 13:42 |
zbr | panda|rover: this is what I was trying to tell you: it does! | 13:43 |
panda|rover | zbr: well you're removing all basepython, so I'll assume the default is python2 | 13:44 |
zbr | panda|rover: i bet tox is looking for the special list of interpreters in envlist and builds a preference list before starting to process the list. | 13:44 |
*** Goneri has joined #oooq | 13:45 | |
panda|rover | zbr: pics or it will not happen :) | 13:45 |
zbr | panda|rover: nope, basepython default is not python2, is default python of the current environment, which depends on the preference list. | 13:45 |
panda|rover | zbr: I need proof | 13:48 |
panda|rover | zbr: bring me evidence | 13:48 |
*** amoralej is now known as amoralej|lunch | 13:49 | |
panda|rover | zbr: put it on a transparent bag, and mark it "exhibit n.1" | 13:49 |
zbr | the code behind is even more complex as tox supports plugins to find alternative python versions (like pyenv). | 13:50 |
*** quiquell has joined #oooq | 13:58 | |
chandankumar | marios_|ruck: time for honey badger call | 14:00 |
marios_|ruck | chandankumar: yup there | 14:01 |
marios_|ruck | chandankumar: thanks | 14:01 |
*** dsneddon has quit IRC | 14:03 | |
arxcruz | chandankumar: come to Berlin, and i'll pay you some beers :) | 14:09 |
rfolco | rlandy, decryption apparently works, thank you! | 14:09 |
rfolco | rlandy, let's see if rdo registry (push) will work... | 14:10 |
rlandy | rfolco: \o/ | 14:10 |
weshay | zbr ur not on the call :P | 14:11 |
zbr | weshay: yes, bit late. | 14:15 |
marios_|ruck | panda|rover: talk now? | 14:17 |
panda|rover | marios_|ruck: knock knock | 14:18 |
marios_|ruck | panda|rover: in 12 mins is also fine | 14:18 |
marios_|ruck | panda|rover: k joining | 14:18 |
marios_|ruck | panda|rover: whats your blue dont see on invite (number please?) | 14:18 |
panda|rover | marios_|ruck: we usually use ruck's room | 14:18 |
panda|rover | marios_|ruck: I'm in your now | 14:18 |
marios_|ruck | panda|rover: k joining | 14:18 |
weshay | zbr k.. join my blue in a mintue.. /me brb | 14:19 |
zbr | weshay: re wrong python interpreter issue: fyi, ansible changed the way it detects python interpreter on remove machines, making it detect default python(3) on new systems, but they did this only on ansible2.8 and they will *not* backport this. | 14:19 |
zbr | this means that we may have either upgrade to ansible 2.8 or have to use workarounds of mentioning which interpreter to use on remove machines. | 14:19 |
*** jaosorior has quit IRC | 14:23 | |
weshay | zbr https://docs.google.com/document/d/1xm3LooXddibhyZncjsZSBw9ZxBqiVfRjXcS-II5tQHU/edit#heading=h.vqmiu6tkx7or | 14:23 |
weshay | zbr https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/phase2-15_director-rhel-8.0-virthost-1cont_1comp-ipv4-vxlan-lvm/32/console | 14:24 |
*** quiquell has quit IRC | 14:24 | |
rlandy | weshay: marios_|ruck: rhos-15 seems different ... https://sf.hosted.upshift.rdu2.redhat.com/logs/19/170519/10/check/tripleo-ci-rhel-8-standalone-rhos-15/a17a591/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 14:25 |
rlandy | see http://download.eng.bos.redhat.com/rcm-guest/puddles/OpenStack/15.0-RHEL-8/latest-RHOS_TRUNK-15-RHEL-8/container_image_prepare_parameter_defaults.yaml | 14:25 |
*** aakarsh has quit IRC | 14:26 | |
*** quiquell has joined #oooq | 14:26 | |
*** amoralej|lunch is now known as amoralej | 14:28 | |
panda|rover | marios_|ruck: congratulation on resisting 27 minutes :) | 14:45 |
marios_|ruck | panda|rover: thanks, getting stronger ! | 14:45 |
chandankumar | time to log out, see ya on monday! | 14:48 |
chandankumar | Happy weekend all :-) | 14:48 |
marios_|ruck | have a good w/e chandankumar | 14:48 |
*** ykarel|meeting is now known as ykarel | 14:48 | |
*** chandankumar is now known as raukadah | 14:48 | |
ykarel | panda|rover, hi | 14:48 |
ykarel | panda|rover, so remember i pushed a patch to collect: ip link output? | 14:49 |
ykarel | panda|rover, i got a reproducer, and mac address was not in ip link output, so mac address seems not in nodes itself | 14:50 |
ykarel | panda|rover, but while looking into it, i also thought about couple of things | 14:50 |
panda|rover | ykarel: another thing we can exclude | 14:50 |
ykarel | panda|rover, yes | 14:50 |
panda|rover | ykarel: you got a reproducer ? | 14:50 |
panda|rover | ykarel: did you signal the mac to kfode | 14:50 |
ykarel | panda|rover, by reproducer i meant on CI | 14:50 |
panda|rover | ykarel: how many times did you have to retry ? | 14:51 |
ykarel | panda|rover, 6 7 tries | 14:51 |
ykarel | let me get exact number of jobs | 14:51 |
panda|rover | ykarel: we have to change strategy with the irc alert, we wont' be able to inject anything before we run overcloud deploy | 14:51 |
panda|rover | ykarel: so I'm trying to push for something that runs in tht before os-net-config, like NodeUserData | 14:52 |
panda|rover | ykarel: also, what was the mac address ? | 14:52 |
*** quiquell has quit IRC | 14:52 | |
ykarel | panda|rover, so it got me 30+ jobs to get reproducer | 14:53 |
panda|rover | ykarel: wow ... | 14:53 |
panda|rover | ykarel: I have a patch taht in desperate cases just runs 10 ovb jobs at once | 14:53 |
ykarel | panda|rover, mac address: FA:FC:51:62:64:0E | 14:53 |
panda|rover | so I could get with 3 retries | 14:53 |
ykarel | (FA:FC:51:62:64:0E) already uses address 172.17.0.74 | 14:53 |
ykarel | panda|rover, hmm it's random, best case u get in 1st try, worst case can be any thing :) | 14:54 |
panda|rover | as usual, random, doesn't match any vendor | 14:54 |
ykarel | panda|rover, so getting back to things that i noticed which can be collected to narrow down further | 14:55 |
panda|rover | marios_|ruck: ^ maybe the manual path is not that bad, it just remains to understand how to correctly inject the irc notification | 14:55 |
ykarel | panda|rover, 1st so when the deploy fails on bmc node, good to collect port list for private network | 14:56 |
ykarel | panda|rover, and 2nd why we use private network which is shared across all stack, i think that made sense when te-broker was used | 14:57 |
ykarel | or there is some other reason to use private network? | 14:57 |
panda|rover | ykarel: probably just legacy | 14:57 |
panda|rover | ykarel: why would we collect the ports ? | 14:58 |
panda|rover | ykarel: all the macs from neutron start with the basemac | 14:58 |
ykarel | panda|rover, /me talking about the first case | 14:58 |
ykarel | where issue happens on bmc node | 14:58 |
ykarel | which we have found in past can be related to stack cleanup timings | 14:59 |
panda|rover | ykarel: so you think bmc would remort a mac in the range of the legit neutron ports | 15:00 |
weshay | zbr https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/phase2-15_director-rhel-8.0-virthost-1cont_1comp-ipv4-vxlan-lvm/32/artifact/ | 15:00 |
ykarel | panda|rover, yes possible, because afair we hit the same issue at time of te broker and when ever identified it was related to ports consumed by stacks which were delete failed | 15:01 |
panda|rover | ok, so collect port to say "here there are still ports undeleted taht get in the way" | 15:02 |
panda|rover | ykarel: do you have time/woll to bj ? I have to ask you something | 15:02 |
ykarel | panda|rover, okk bj link? | 15:03 |
panda|rover | ykarel: 3492508669 | 15:03 |
ykarel | in | 15:04 |
*** kopecmartin is now known as kopecmartin|off | 15:06 | |
*** bogdando has quit IRC | 15:08 | |
* marios_|ruck shutdown sequence | 15:18 | |
marios_|ruck | weshay: panda|rover need something before i goo | 15:18 |
weshay | high five 0/ | 15:19 |
weshay | ? | 15:19 |
marios_|ruck | \O | 15:19 |
panda|rover | marios_|ruck: nothing thanks | 15:19 |
*** marios has quit IRC | 15:23 | |
*** marios_|ruck has quit IRC | 15:23 | |
*** dsneddon has joined #oooq | 15:30 | |
ykarel | panda|rover, fyi logs for job where it reproduced and ip link collected:- https://logs.rdoproject.org/22/660922/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-stein-branch/ae2e1f4/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:31 |
ykarel | https://logs.rdoproject.org/22/660922/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-stein-branch/ae2e1f4/logs/overcloud-controller-1/var/log/extra/network.txt.gz | 15:31 |
panda|rover | ykarel: thanks, card updated. | 15:35 |
*** holser_ has quit IRC | 15:40 | |
*** jfrancoa has quit IRC | 15:50 | |
ykarel | panda|rover, ack | 15:56 |
*** ykarel is now known as ykarel|away | 15:56 | |
*** dtantsur is now known as dtantsur|afk | 16:01 | |
*** saneax has quit IRC | 16:06 | |
*** ykarel|away has quit IRC | 16:07 | |
rlandy | weshay: do you have access to the osp container registry - to view the tags. I think we are getting the update containers naming wrong | 16:09 |
weshay | last time I tried I did not, may want to ask in #release-delivery | 16:11 |
rlandy | asking | 16:15 |
*** brault has joined #oooq | 16:16 | |
*** brault has quit IRC | 16:21 | |
*** ccamacho has quit IRC | 16:30 | |
zbr | rlandy or weshay: https://review.opendev.org/#/c/661286/ tox fix | 16:31 |
*** dsneddon has quit IRC | 16:33 | |
*** tcw has quit IRC | 16:40 | |
*** quiquell has joined #oooq | 16:48 | |
*** dsneddon has joined #oooq | 17:00 | |
*** jpena is now known as jpena|off | 17:04 | |
*** quiquell has quit IRC | 17:07 | |
*** quiquell has joined #oooq | 17:08 | |
*** quiquell has quit IRC | 17:12 | |
*** ykarel|away has joined #oooq | 17:14 | |
rfolco | rlandy, weshay panda|rover zbr arxcruz raukadah: please review https://code.engineering.redhat.com/gerrit/171297 - need more eyes on it to make sure the push to rdo registry won't break anything (yes, review before I run it as check job) | 17:20 |
raukadah | rfolco: will take a look, thanks :-) | 17:53 |
rlandy | weshay: ok - is modify_append_tag: valid for osp? | 18:38 |
rfolco | rlandy, trying to find what is the ssh key used to upload images, the one that was used as input for this encrypted secret: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo-rdo-base.yaml#L105 | 19:06 |
rfolco | rlandy, if you know pls send me in pvt | 19:06 |
rlandy | I know there is an uploader user | 19:06 |
rlandy | panda|rover: ^^ may know | 19:06 |
rfolco | secret is uploader_ssh_key | 19:07 |
rfolco | so I assume it uses a ssh key, not password | 19:07 |
rlandy | yeah _ I would guess so | 19:09 |
rlandy | if it's not in the same file we looked at yesterday I'm not sure | 19:09 |
rlandy | rfolco:also check the google doc | 19:10 |
rlandy | there is a key listed there | 19:10 |
rfolco | rlandy, that one is for cloud log server | 19:11 |
rfolco | aaaah | 19:11 |
rfolco | rlandy, sorry, found it | 19:11 |
rfolco | uploader_ssh_priv_key | 19:12 |
rfolco | :) | 19:12 |
rfolco | thanks rlandy | 19:12 |
*** tosky has quit IRC | 19:16 | |
*** amoralej is now known as amoralej|off | 19:24 | |
weshay | rlandy sorry was at lunch... rlandy modify_append_tag is fine, it just changes the tag after the update | 19:26 |
rlandy | weshay: yeah - but look at what we land up with ... | 19:27 |
rlandy | rhosp15/openstack-cinder-volume:20190523.1-updated-20190524085625 | 19:28 |
rlandy | "error pulling image \"192.168.24.1:8787/rhosp15/openstack-cinder-volume:20190523.1-updated-20190524085625\" | 19:28 |
weshay | hrm | 19:29 |
weshay | the updated tags in other osp runs we've seen didn't impact the download | 19:29 |
rlandy | I have bugged jjoyce all morning ... I can't access this brew thing | 19:29 |
weshay | er.. pull | 19:29 |
rlandy | weshay: notice that the defaul params changed ... | 19:30 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/19/170519/10/check/tripleo-ci-rhel-8-standalone-rhos-15/a17a591/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 19:30 |
rlandy | the openshift stuff went bye-bye | 19:30 |
rlandy | maybe it's unrelated | 19:31 |
weshay | ya.. I think that's unrelated | 19:31 |
rlandy | https://code.engineering.redhat.com/gerrit/#/c/170519/ show rhos-14 and rhos-15 latest runs | 19:31 |
rlandy | with updated params | 19:31 |
rlandy | and standalone role | 19:31 |
rlandy | weshay: ok - will try that one again | 19:33 |
rlandy | will see if it changes the result | 19:33 |
rlandy | I think the params are right now | 19:33 |
rlandy | per https://review.opendev.org/#/c/659794/11/roles/standalone/tasks/main.yml | 19:34 |
weshay | rlandy my suggestion is to get on a deployment that is not ci | 19:35 |
weshay | and deploy w/ those params | 19:35 |
weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/40/167540/43/check/tripleo-ci-rhel-8-standalone-rhos-15/4990506/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 19:35 |
*** ykarel|away has quit IRC | 19:35 | |
weshay | and | 19:36 |
weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/19/170519/10/check/tripleo-ci-rhel-8-standalone-rhos-15/a17a591/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 19:36 |
weshay | are very different | 19:36 |
*** panda|rover has quit IRC | 19:36 | |
weshay | hrm.. 2019-05-23 13:19:49 | TASK [tripleo-container-tag : Tag 192.168.24.1:8787/rhosp15/openstack-mariadb:pcmklatest to latest 192.168.24.1:8787/rhosp15/openstack-mariadb:20190520.1 image] *** | 19:37 |
weshay | rlandy perhaps we need to turn off the setting modify_append_tag: "-updated-20190524085625" | 19:37 |
weshay | until we get the whole container update working | 19:37 |
rlandy | weshay: it's juts missing the openshift params | 19:37 |
rlandy | possibly | 19:37 |
rlandy | that was my next step if the current run fails | 19:38 |
weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/19/170519/10/check/tripleo-ci-rhel-8-standalone-rhos-15/a17a591/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz#_2019-05-24_13_12_37_415 | 19:38 |
weshay | the container update just dies... & | 19:38 |
weshay | ^ | 19:38 |
weshay | so I'm not suprised the updated tag is not on the containers in the undercloud registry | 19:38 |
*** panda has joined #oooq | 19:40 | |
weshay | rlandy we should turn off all the container update bits in the config for osp | 19:42 |
rlandy | weshay: ack | 19:43 |
rlandy | just extend the j2 | 19:43 |
rlandy | it worked for rhos-14 interestingly enough | 19:45 |
rlandy | unable to parse the registries configuration (/etc/containers/registries.conf): invalid URL '192.168.24.1:8787': parse 192.168.24.1:8787: first path segment in URL cannot contain colon | 19:46 |
rlandy | ^^ same error you emailed about yesterday | 19:47 |
weshay | rlandy ya.. I emailed Steve about that, you were on the email I think | 19:49 |
weshay | ya | 19:49 |
rlandy | k - we will see | 19:49 |
rlandy | moving on | 19:49 |
rfolco | weshay, rlandy pls merge this one (secrets for upload img) >> https://code.engineering.redhat.com/gerrit/#/c/171408/ | 19:53 |
weshay | rfolco merged | 20:05 |
rfolco | weshay, thx | 20:05 |
*** tcw has joined #oooq | 20:14 | |
rlandy | wow - really did myself in now wrt switching to centos virthost, rhel undercloud vm | 20:48 |
rlandy | weshay: build_test_packages: true/false? for centos virthost, rhel undercloud vm? | 21:06 |
rlandy | oh man - this is not going to work | 21:11 |
rlandy | keep baseos to use on the virt host and donwload images on the undercloud | 21:11 |
*** holser_ has joined #oooq | 21:33 | |
rlandy | weshay: you around? | 21:42 |
rlandy | oh my gosh - finally .... | 21:47 |
rlandy | check-tripleo-centos-7-stein-containers-buildopenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster362019-05-24T17:01:09SUCCESS | 21:47 |
rlandy | periodic-tripleo-ci-centos-7-bm_envB-3ctlr_1comp-featureset001-steinopenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster165192019-05-24T17:03:17SUCCESS | 21:47 |
rlandy | check-tripleo-centos-7-master-containers-build-pidoneopenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster402019-05-24T17:01:18SUCCESS | 21:47 |
rlandy | periodic-tripleo-ci-centos-7-ha_lab_andromeda-baremetal_3ctlr_2comp-featureset001-masteropenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster4302019-05-24T17:03:31FAILURE | 21:47 |
rlandy | check-tripleo-centos-7-master-containers-buildopenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster412019-05-24T17:00:18SUCCESS | 21:47 |
rlandy | periodic-tripleo-ci-centos-7-bm_envA-3ctlr_1comp-featureset001-masteropenstack/tripleo-ci-internal-jobsmasterperiodic-hourlymaster163932019-05-24T17:02:21SUCCESS | 21:47 |
rlandy | baremetal is green on rocky, stein, master | 21:47 |
*** rlandy has quit IRC | 22:16 | |
*** holser_ has quit IRC | 22:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!