| *** tosky has quit IRC | 00:02 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient master: WIP: support standalone ansible.cfg addition and extra args https://review.opendev.org/699137 | 00:37 |
|---|---|---|
| *** dmacpher has joined #tripleo | 00:49 | |
| *** dmacpher has quit IRC | 00:50 | |
| *** dmacpher has joined #tripleo | 00:51 | |
| *** dmacpher has quit IRC | 00:58 | |
| *** dmacpher has joined #tripleo | 00:58 | |
| *** gregwork has quit IRC | 01:05 | |
| *** d0ugal has quit IRC | 01:06 | |
| *** d0ugal has joined #tripleo | 01:08 | |
| *** ysandeep has joined #tripleo | 01:10 | |
| *** lbragstad has joined #tripleo | 03:27 | |
| *** psachin has joined #tripleo | 03:35 | |
| *** openstackgerrit has quit IRC | 04:08 | |
| *** fmount has quit IRC | 04:08 | |
| *** dmellado has quit IRC | 04:08 | |
| *** osmanlicilegi has quit IRC | 04:08 | |
| *** dmsimard has quit IRC | 04:08 | |
| *** jeremy__bouncer has quit IRC | 04:08 | |
| *** bdodd has quit IRC | 04:08 | |
| *** fultonj has quit IRC | 04:08 | |
| *** thrash has quit IRC | 04:08 | |
| *** tbarron has quit IRC | 04:08 | |
| *** baha has quit IRC | 04:08 | |
| *** ianw has quit IRC | 04:08 | |
| *** otherwiseguy_ has quit IRC | 04:08 | |
| *** mandre has quit IRC | 04:08 | |
| *** jjoyce has quit IRC | 04:08 | |
| *** larsks has quit IRC | 04:08 | |
| *** mjturek has quit IRC | 04:08 | |
| *** mburned has quit IRC | 04:08 | |
| *** openstackstatus has quit IRC | 04:11 | |
| *** openstackstatus has joined #tripleo | 04:14 | |
| *** ChanServ sets mode: +v openstackstatus | 04:14 | |
| *** dmacpher has quit IRC | 04:16 | |
| *** bhagyashris has joined #tripleo | 04:41 | |
| *** ykarel has joined #tripleo | 04:53 | |
| *** holser has joined #tripleo | 04:54 | |
| *** skramaja has joined #tripleo | 05:08 | |
| *** epoojad1 has joined #tripleo | 05:16 | |
| *** raukadah is now known as chkumar|rover | 05:22 | |
| *** surpatil has joined #tripleo | 05:33 | |
| *** soniya29 has joined #tripleo | 05:33 | |
| *** ramishra has joined #tripleo | 06:04 | |
| *** marios|ruck has joined #tripleo | 06:11 | |
| *** waleedm has joined #tripleo | 06:14 | |
| *** sri_ has joined #tripleo | 06:15 | |
| *** holser has quit IRC | 06:17 | |
| *** kozhukalov has joined #tripleo | 06:24 | |
| *** lmiccini has joined #tripleo | 06:34 | |
| *** saneax has joined #tripleo | 06:42 | |
| *** yprokule has joined #tripleo | 06:43 | |
| chkumar|rover | Tengu: Good morning | 06:44 |
| chkumar|rover | Tengu: can we get this patch https://review.opendev.org/#/c/698914/ backported to train? | 06:44 |
| *** sanjayu_ has joined #tripleo | 06:48 | |
| *** saneax has quit IRC | 06:51 | |
| *** kozhukalov has quit IRC | 06:51 | |
| *** jfrancoa has joined #tripleo | 06:53 | |
| *** slaweq has joined #tripleo | 06:54 | |
| *** ksambor has joined #tripleo | 06:58 | |
| *** rcernin has quit IRC | 06:58 | |
| *** bandini has joined #tripleo | 07:01 | |
| bandini | marios|ruck, chkumar|rover: did you guys notice this one already ? https://zuul.opendev.org/t/openstack/build/92332f0e85724a0c98f59aab935b50ba/log/job-output.txt#5083 | 07:05 |
| bandini | seems like most of the stuff has been failing over the weekend due to that | 07:05 |
| chkumar|rover | bandini: checking | 07:08 |
| *** akahat has joined #tripleo | 07:08 | |
| marios|ruck | bandini: o/ morning (me having coffee not noticed anything yet so, no i havent but looking now thanks ) ... review ? | 07:08 |
| marios|ruck | bandini: where is that from please? review (so i can see project/job etc) | 07:08 |
| bandini | marios|ruck, chkumar|rover: I noticed it first on that rocky upgrade oooq fix https://review.opendev.org/#/c/698219/ | 07:08 |
| bandini | i rechecked it over the weekend and saw it | 07:09 |
| marios|ruck | chkumar|rover: wonder if related to 09:04 < chkumar|rover> marios|ruck: Current rdo trunk dlrn is not yet consistent, waiting for these patches | 07:09 |
| marios|ruck | chkumar|rover: but it looks like package missing (six/?0 | 07:09 |
| bandini | i understand zilch about where these requirements come from and what broke where | 07:09 |
| chkumar|rover | bandini: https://pypi.org/project/six/#history the No matching distribution found for six===1.13.0 | 07:10 |
| chkumar|rover | it is there | 07:10 |
| marios|ruck | chkumar|rover: yeah but not in the job repo though must be | 07:10 |
| bandini | oh so we're missing it from some rdo repo? | 07:10 |
| chkumar|rover | marios|ruck: it is coming from pypi not from rdo repos | 07:11 |
| marios|ruck | chkumar|rover: ah ack so rdo builds/consistent not relevant | 07:11 |
| chkumar|rover | let https://review.opendev.org/#/c/694979/ might caused the issue need to check | 07:11 |
| marios|ruck | chkumar|rover: ack on pip I see it comes from a venv task "TASK [python_venv_build : Install python packages into the venv" | 07:12 |
| marios|ruck | bandini: chkumar|rover: weird thing is grafana isn't going crazy about it (8 fails) ah but 60% pass is VERY low | 07:13 |
| marios|ruck | http://dashboard-ci.tripleo.org/d/YRJtmtNWk/cockpit?orgId=1 i mean | 07:13 |
| marios|ruck | bandini: did you file bug ? going to now if not | 07:13 |
| bandini | marios|ruck: could be because it started yesterday? | 07:14 |
| bandini | marios|ruck: no let me file one on the fly | 07:14 |
| marios|ruck | bandini: ah k but still 60% is pretty badf | 07:14 |
| *** slaweq has quit IRC | 07:15 | |
| *** pcaruana has joined #tripleo | 07:16 | |
| bandini | marios|ruck, chkumar|rover: https://bugs.launchpad.net/tripleo/+bug/1856520 | 07:17 |
| openstack | Launchpad bug 1856520 in tripleo "pypi errors in CI" [Critical,Triaged] | 07:17 |
| ykarel | bandini, is ^^ happening on all infras? or only few | 07:17 |
| marios|ruck | thanks bandini | 07:18 |
| ykarel | if only few then it's possible some infra mirror have issues | 07:18 |
| chkumar|rover | bandini: marios|ruck on local system it is working fine | 07:18 |
| chkumar|rover | there is no issue there | 07:18 |
| chkumar|rover | so may be an infra issye | 07:18 |
| bandini | ykarel: can't really say, I noticed it on two reviews (mentioned in the LP bug) | 07:20 |
| bandini | then i gave up rechecking as i assumed it was a depper problem | 07:20 |
| ykarel | bandini, ack, marios|ruck chkumar|rover can u filter it out through cockpit | 07:20 |
| bandini | *deeper even | 07:20 |
| bandini | ykarel, chkumar|rover, marios|ruck: I just added a comment to https://bugs.launchpad.net/tripleo/+bug/1856520 that might be interesting/relevant (slightly different pypi failure on another review) | 07:24 |
| openstack | Launchpad bug 1856520 in tripleo "pypi errors in CI" [Critical,Triaged] | 07:24 |
| marios|ruck | bandini: ack thanks man... just fyi/fwiw can you use the other link for the bug (e.g. that kind of link https://eda9ce307a5a18d8fc06-e4bf83e7a0ad619f557d70ee5d0d9814.ssl.cf5.rackcdn.com/697930/1/check/tripleo-ci-centos-7-scenario002-standalone/1878a3e/job-output.txt cos it tells me the job name too... i thought it was only undercloud-containers but that one is scen2 standalone too so it really is | 07:25 |
| marios|ruck | 'bunch of jobs' | 07:26 |
| *** soniya29 has quit IRC | 07:26 | |
| bandini | marios|ruck: no way dude, I will always try and use the sneakiest and most annoying URLs, how dare you suggest otherwise :P | 07:26 |
| bandini | marios|ruck: will get the other links next time ;) | 07:26 |
| bandini | other -> more readable/useful | 07:27 |
| marios|ruck | bandini: sorry to complain after you filed the bug just saying :D it is an extra step for anyone that is looking to understand/fix the issue | 07:27 |
| bandini | eheh no worries you have a point | 07:27 |
| bandini | i did not even noticed that the URLs are a bit different now | 07:27 |
| marios|ruck | ykarel: not sure there likely is a way but i don't often filter with grafana like that i use zuul. but here we need to filter on the error ... it isn't just one job | 07:28 |
| marios|ruck | ykarel: not sure if we can do that... perhaps logstash is better for this | 07:28 |
| Tengu | hello there | 07:28 |
| ykarel | marios|ruck, yes logstash will give more accurate idea | 07:28 |
| ykarel | grafana might help, but we need to check failures if it's same or other | 07:29 |
| Tengu | chkumar|rover: heya! yes, as answered this weekend, that's the goal :). Lemme do the backport. | 07:29 |
| Tengu | meh.... doesn't cherry-pick as-is. | 07:29 |
| marios|ruck | ykarel: not having much luck there though fyi http://logstash.openstack.org/#dashboard/file/logstash.json?query=%5C%22ERROR%3A%20No%20matching%20distribution%20found%5C%22 | 07:32 |
| marios|ruck | urgh url | 07:32 |
| * marios|ruck recoffee and start living the dream for another week \o/ chkumar|rover | 07:33 | |
| bandini | lol | 07:33 |
| marios|ruck | chkumar|rover: what happens if we reach wednesday and wes says 'eh , just a few more days' | 07:33 |
| Tengu | chkumar|rover: https://review.opendev.org/699161 fyi | 07:33 |
| marios|ruck | ;) | 07:33 |
| chkumar|rover | marios|ruck: no way | 07:34 |
| marios|ruck | chkumar|rover: not sure we can get a refund on the honolulu tickets they already pushed them for us by 1 week and those mojitos are NOT going to last in the freezer forever! | 07:34 |
| Tengu | bandini: heya! care to push those two? https://review.opendev.org/698232 https://review.opendev.org/698238 would be great :) | 07:35 |
| *** slaweq has joined #tripleo | 07:36 | |
| ykarel | marios|ruck, ack, seems some issue with logstash and those jobs | 07:37 |
| *** ykarel is now known as ykarel|lunch | 07:37 | |
| *** mschuppert has joined #tripleo | 07:37 | |
| Tengu | bandini: thank youuu :) | 07:42 |
| bandini | np ;) | 07:44 |
| *** florianf has joined #tripleo | 07:48 | |
| *** tesseract has joined #tripleo | 07:48 | |
| *** sri_ has quit IRC | 07:51 | |
| *** bhagyashris has quit IRC | 07:59 | |
| *** cp- has quit IRC | 08:00 | |
| *** tosky has joined #tripleo | 08:02 | |
| *** tkajinam has quit IRC | 08:06 | |
| *** tesseract has quit IRC | 08:11 | |
| *** amoralej|off is now known as amoralej | 08:18 | |
| *** lmiccini has quit IRC | 08:18 | |
| *** lmiccini has joined #tripleo | 08:19 | |
| *** ykarel|lunch is now known as ykarel| | 08:30 | |
| *** ykarel| is now known as ykarel | 08:30 | |
| *** tmazur has joined #tripleo | 08:30 | |
| *** rpittau|afk is now known as rpittau | 08:34 | |
| *** pkopec has joined #tripleo | 08:35 | |
| *** sshnaidm|off is now known as sshnaidm | 08:41 | |
| *** yprokule has quit IRC | 08:43 | |
| *** yprokule_ has joined #tripleo | 08:44 | |
| *** yprokule_ is now known as yprokule | 08:45 | |
| *** jpena|off is now known as jpena | 08:52 | |
| *** rcernin has joined #tripleo | 08:54 | |
| *** jpich has joined #tripleo | 08:55 | |
| *** suuuper has joined #tripleo | 08:55 | |
| *** lucasagomes has joined #tripleo | 08:55 | |
| *** hberaud|gone has quit IRC | 08:55 | |
| *** hberaud has joined #tripleo | 08:56 | |
| *** shyamb has joined #tripleo | 08:59 | |
| *** d0ugal has quit IRC | 09:00 | |
| *** d0ugal has joined #tripleo | 09:01 | |
| shyamb | Hi | 09:01 |
| shyamb | I am deploying RHOSP14 | 09:01 |
| *** florianf has quit IRC | 09:02 | |
| *** tesseract has joined #tripleo | 09:03 | |
| *** tesseract has quit IRC | 09:04 | |
| *** tesseract has joined #tripleo | 09:04 | |
| shyamb | overcloud stack shows 'CREATE_COMPLETE' but there was an error on the stdout saying error ""No JSON object could be decoded" | 09:05 |
| shyamb | http://paste.openstack.org/show/787622/ | 09:05 |
| shyamb | thing to note here is overcloudrc not downloaded during deploy command | 09:05 |
| *** apetrich has joined #tripleo | 09:06 | |
| *** bhagyashris has joined #tripleo | 09:08 | |
| shyamb | Any idea? | 09:11 |
| shyamb | Is the behaviour changed in osp14, that overcloud rc file doesn't get downloaded automatically? | 09:13 |
| *** akahat has quit IRC | 09:17 | |
| *** mugsie has quit IRC | 09:19 | |
| *** mugsie has joined #tripleo | 09:21 | |
| *** iurygregory has joined #tripleo | 09:26 | |
| *** yolanda has quit IRC | 09:28 | |
| *** yolanda__ has joined #tripleo | 09:28 | |
| *** waleedm_ has joined #tripleo | 09:30 | |
| *** waleedm has quit IRC | 09:31 | |
| *** waleedm has joined #tripleo | 09:32 | |
| sshnaidm | shyamb, maybe error message is legit and something was broken, that's why no overcloudrc | 09:33 |
| *** waleedm_ has quit IRC | 09:36 | |
| shyamb | sshnaidm: possible, but I got confused with the stack status, it's saying state is 'CREATE_COMPLETE'. | 09:36 |
| *** rcernin has quit IRC | 09:36 | |
| *** rcernin has joined #tripleo | 09:36 | |
| sshnaidm | shyamb, it's heat stack that completed, but there are ansible stuff around also | 09:37 |
| sshnaidm | overcloud deploy now is more then just heat stack creation | 09:38 |
| shyamb | okay, got it | 09:39 |
| *** yog_ has joined #tripleo | 09:39 | |
| ykarel | shyamb, you can check output of openstack overcloud status to see what's status for ansible deployment | 09:39 |
| shyamb | that's helpful command | 09:40 |
| shyamb | I didn't knew it | 09:40 |
| shyamb | thank you | 09:40 |
| shyamb | ykarel: sshnaidm: so in this case, what should be the approach? debug and rerun deploy command? | 09:42 |
| shyamb | or just run remaining ansible commands? | 09:42 |
| shyamb | once we get the issue | 09:42 |
| shyamb | any doc for debugging ansible issues? | 09:43 |
| *** derekh has joined #tripleo | 09:44 | |
| ykarel | shyamb, http://tripleo.org/install/advanced_deployment/ansible_config_download.html | 09:44 |
| sshnaidm | shyamb, you can take a look in folders to find ansible command file http://logs.rdoproject.org/42/682042/5/openstack-check/tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset001/7cca699/logs/undercloud/var/lib/mistral/overcloud/ansible-playbook-command.sh.txt.gz | 09:44 |
| sshnaidm | shyamb, it's usually in /var/lib/mistral/overcloud | 09:45 |
| shyamb | okay, thank you ykarel, sshnaidm | 09:46 |
| shyamb | this is really helpful | 09:46 |
| sshnaidm | shyamb, because it stopped on "step4" run, I'd suspect some container failed, "docker ps -a | grep Exit" may help | 09:47 |
| yog_ | slagle, Hi.. it be wonderful if you could give your review for https://review.opendev.org/#/c/693994/ (Provide option to set reserved_huge_pages) | 09:47 |
| shyamb | sshnaidm: yes, I need to check for that | 09:47 |
| yog_ | slagle, have reimplemented by taking OvsDpdkSocketMemory into consideration while setting reserved_huge_pages | 09:48 |
| *** chem_ has joined #tripleo | 09:50 | |
| chkumar|rover | Tengu: please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/1853652 check last 2 comments | 09:50 |
| openstack | Launchpad bug 1853652 in tripleo "openstack overcloud node provide --all-manageable timing out and failing periodic rhel-8-ovb-3ctlr_1comp-featureset001-master" [Critical,Triaged] | 09:50 |
| Tengu | chkumar|rover: might be nice to get some logs for selinux.... | 09:52 |
| Tengu | chkumar|rover: do you have a recent run available with full logs? | 09:52 |
| *** jbadiapa has joined #tripleo | 09:52 | |
| chkumar|rover | Tengu: checking | 09:53 |
| chkumar|rover | Tengu: http://logs.rdoproject.org/20/698620/6/openstack-check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001/418799c/ | 09:53 |
| Tengu | chkumar|rover: I have a deploy running, osp-16 on rhel-8, no AVC here. | 09:53 |
| chkumar|rover | it is today's one | 09:53 |
| Tengu | lemme check. | 09:53 |
| Tengu | grumpf... dbus -.- | 09:54 |
| Tengu | yeah, we do have some AVCs. | 09:55 |
| Tengu | like.... "some". | 09:55 |
| Tengu | lemme comment. and check them. | 09:55 |
| chkumar|rover | Tengu: ok cool! | 09:55 |
| Tengu | usual thing with tripleo... | 09:58 |
| Tengu | change things, don't check SELinux, and cry after because it's failing at some point. | 09:58 |
| *** akahat has joined #tripleo | 09:59 | |
| *** paramite has joined #tripleo | 10:02 | |
| *** fultonj has joined #tripleo | 10:05 | |
| *** mjturek has joined #tripleo | 10:05 | |
| *** jeremy__bouncer has joined #tripleo | 10:05 | |
| *** jjoyce has joined #tripleo | 10:05 | |
| *** baha has joined #tripleo | 10:05 | |
| *** ysandeep has quit IRC | 10:06 | |
| *** mandre has joined #tripleo | 10:06 | |
| *** larsks has joined #tripleo | 10:06 | |
| *** otherwiseguy has joined #tripleo | 10:07 | |
| *** osmanlicilegi has joined #tripleo | 10:07 | |
| *** dmellado has joined #tripleo | 10:07 | |
| *** ianw has joined #tripleo | 10:07 | |
| *** irclogbot_1 has quit IRC | 10:08 | |
| *** thrash has joined #tripleo | 10:09 | |
| *** fmount has joined #tripleo | 10:09 | |
| *** irclogbot_1 has joined #tripleo | 10:10 | |
| *** bdodd has joined #tripleo | 10:11 | |
| *** fmount has quit IRC | 10:13 | |
| *** jaosorior has joined #tripleo | 10:16 | |
| *** rcernin has quit IRC | 10:16 | |
| *** fmount has joined #tripleo | 10:18 | |
| shyamb | ykarel: sshnaidm: just went through the document you provided regarding config-download. It has very helpful information | 10:21 |
| shyamb | thanks a lot | 10:21 |
| ykarel | marios|ruck, are u still seeing those errors? i mean jobs are still failing? | 10:22 |
| ykarel | on pip failures | 10:23 |
| marios|ruck | ykarel: i've seen it on some other patches but not sure if it is ongoing yet | 10:23 |
| marios|ruck | ykarel: yeah got different one that six added comment there | 10:23 |
| ykarel | marios|ruck, today? | 10:23 |
| marios|ruck | ykarel: * https://bugs.launchpad.net/tripleo/+bug/1856520/comments/2 | 10:23 |
| openstack | Launchpad bug 1856520 in tripleo "pypi errors in CI" [Critical,Triaged] | 10:23 |
| marios|ruck | ykarel: 2019-12-15 | 10:23 |
| ykarel | marios|ruck, yes that's yesterday | 10:24 |
| marios|ruck | ykarel: ack so you think resolved? you have anything to point to? | 10:24 |
| ykarel | marios|ruck, good to check if those are happening today as well, and it would be good to have some pattern so we can ask in infra if this issue is known | 10:25 |
| *** bhagyashris has quit IRC | 10:25 | |
| ykarel | marios|ruck, if this is is related to mirrors, these might be solved automatically | 10:25 |
| ykarel | and without us knowning | 10:25 |
| marios|ruck | ykarel: ack will update the bug if i see something | 10:26 |
| ykarel | ack | 10:26 |
| *** shyamb has quit IRC | 10:34 | |
| *** gfidente has joined #tripleo | 10:38 | |
| *** hberaud is now known as hberaud|lunch | 10:40 | |
| bandini | marios|ruck: so you reckon we should try a recheck on a review to see if the issue is gone? | 10:43 |
| marios|ruck | bandini: yeah sounds like for now at least we don't have any better info yet | 10:44 |
| bandini | ok i'll try on the rocky upgrade vars one | 10:44 |
| *** bhagyashris has joined #tripleo | 10:44 | |
| *** hrw has joined #tripleo | 10:46 | |
| hrw | morning | 10:46 |
| hrw | can 'openstack overcloud container image build' be called with python3? | 10:47 |
| hrw | it is probably last thing blocking getting rid of py2 | 10:48 |
| hrw | and centos 7 has enough py3 packages to get kolla running | 10:48 |
| *** bhagyashris_ has joined #tripleo | 10:51 | |
| *** bhagyashris has quit IRC | 10:53 | |
| chkumar|rover | hrw: yes | 10:54 |
| chkumar|rover | it gets called with python3 | 10:54 |
| hrw | chkumar|rover: https://3bef97670d6a1ae092d5-54a30f9e4df167ae2747c6c3ff2739ca.ssl.cf1.rackcdn.com/691316/13/check/tripleo-build-containers-centos-7/81c7aaf/logs/build.log.txt.gz | 10:54 |
| hrw | chkumar|rover: fails like with py2 | 10:55 |
| chkumar|rover | hrw: on centos7, it is py2 but on RHEL8 it is python3 | 10:55 |
| hrw | chkumar|rover: asked about c7 | 10:56 |
| hrw | chkumar|rover: https://review.opendev.org/#/c/691316/ is change. you can ignore centos jobs as they run on c8 now | 10:57 |
| chkumar|rover | ack | 11:00 |
| hrw | chkumar|rover: centos 7 has python 3.6 which is fine to use kolla | 11:01 |
| hrw | I have centos7 vm where I built centos/binary using 3.6.8 from centos7 | 11:01 |
| hrw | so once tripleo7 move to py3 there will be no py2 in project. | 11:01 |
| hrw | and 2020 is coming ;D | 11:01 |
| ykarel | marios|ruck, see http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22No%20matching%20distribution%20found%20for%5C%22 | 11:01 |
| ykarel | marios|ruck, select last two days | 11:02 |
| ykarel | and list onde_prodvider and build_name also | 11:02 |
| ykarel | multiple projects are affected not just tripleo | 11:02 |
| ykarel | fortneubula-regioneOne seems affected currently as per date | 11:03 |
| *** shyamb has joined #tripleo | 11:10 | |
| *** rpittau is now known as rpittau|bbl | 11:22 | |
| *** leanderthal has joined #tripleo | 11:28 | |
| marios|ruck | thanks ykarel bandini ^^ seems to have peaked yesterday | 11:29 |
| *** ysandeep has joined #tripleo | 11:30 | |
| bandini | marios|ruck: ack thanks I see that https://review.opendev.org/#/c/698219/ has just passed, so maybe the issue is now gone | 11:31 |
| *** SurajPatil has joined #tripleo | 11:34 | |
| chkumar|rover | slaweq: Hello | 11:34 |
| chkumar|rover | slaweq: Can I switch this job to https://review.opendev.org/#/c/698737/3/zuul.d/tripleo.yaml to ovn? | 11:34 |
| slaweq | chkumar|rover: hi | 11:35 |
| slaweq | chkumar|rover: no, this should works with ml2/ovs | 11:35 |
| slaweq | for ovn we will have another job when we will finish networking-ovn migration | 11:35 |
| chkumar|rover | slaweq: ok | 11:36 |
| *** surpatil has quit IRC | 11:36 | |
| *** surpatil has joined #tripleo | 11:40 | |
| *** surpatil has quit IRC | 11:40 | |
| *** tbarron has joined #tripleo | 11:41 | |
| *** SurajPatil has quit IRC | 11:43 | |
| tbarron | chkumar|rover: that failure in scenari0004 periodic job that you pointed out Friday seems to have been transient | 11:43 |
| tbarron | chkumar|rover: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-scenario004-standalone-master | 11:44 |
| tbarron | chkumar|rover: maybe a bad container image, manila-share service didn't get started | 11:44 |
| chkumar|rover | tbarron: thank you for checking that :-) | 11:47 |
| tbarron | chkumar|rover: np problem, thanks for brining the failure to my attention! | 11:48 |
| chkumar|rover | tbarron ++ | 11:49 |
| *** florianf has joined #tripleo | 11:50 | |
| *** epoojad1 is now known as epoojad1|afk | 11:56 | |
| *** hberaud|lunch is now known as hberaud | 11:58 | |
| *** epoojad1|afk has quit IRC | 12:01 | |
| *** rfolco has joined #tripleo | 12:03 | |
| *** hjensas has joined #tripleo | 12:06 | |
| *** ysandeep has quit IRC | 12:08 | |
| *** dmsimard has joined #tripleo | 12:12 | |
| chkumar|rover | Tengu: Here is the whole audit log http://logs.rdoproject.org/20/698620/6/openstack-check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001/418799c/logs/undercloud/var/log/audit/audit.log.txt.gz does it will help? | 12:16 |
| *** ansmith has quit IRC | 12:17 | |
| chkumar|rover | Tengu: for this bug https://bugs.launchpad.net/tripleo/+bug/1853652 ^^ | 12:18 |
| openstack | Launchpad bug 1853652 in tripleo "openstack overcloud node provide --all-manageable timing out and failing periodic rhel-8-ovb-3ctlr_1comp-featureset001-master" [Critical,Triaged] | 12:18 |
| Tengu | chkumar|rover: nope, we'd need a permissive log, in order to know if that's all, or if there are subsequent AVCs | 12:21 |
| Tengu | chkumar|rover: for instance, if we allow the current thing we see, it might show another one since it's masked due to the early failure. Also, it will allow us to know if it's an "easy and simple" policy, or something more complicated such as domain transition and so on | 12:21 |
| shyamb | Hi | 12:21 |
| shyamb | owalsh: Tengu: In RHOSP15, does old puppet script still works? | 12:22 |
| shyamb | for third party integrations? | 12:22 |
| Tengu | chkumar|rover: not running in permissive: permissive=0 | 12:22 |
| Tengu | shyamb: should be OK | 12:22 |
| shyamb | okay | 12:22 |
| shyamb | Tengu: I see we made some change in heat stack + ansible way of deployment | 12:23 |
| shyamb | For old heat templates will need any changes? | 12:24 |
| shyamb | or they should work? | 12:24 |
| shyamb | In long we need to move to ansible | 12:24 |
| shyamb | we may do it in Train | 12:24 |
| *** pcaruana has quit IRC | 12:27 | |
| Tengu | shyamb: should still be OK - but you might want totest your "old" stuff on some dev env just to be sure. | 12:28 |
| *** raildo has joined #tripleo | 12:30 | |
| chkumar|rover | Tengu: you mean to say that the current RHEL8 one is running using selinux mode enforcing as we have already setted it to https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/RedHat-8/master.yml#L121 Or Do I make something different change there to ser permissive to 1? | 12:30 |
| *** shyamb has quit IRC | 12:30 | |
| Tengu | chkumar|rover: at least the Director is running in Enforcing. That's 100% sure. | 12:32 |
| Tengu | else it wouldn't have failed… | 12:32 |
| Tengu | and we'd see "permissive=1" in the audit.log | 12:32 |
| chkumar|rover | ok | 12:32 |
| *** pcaruana has joined #tripleo | 12:33 | |
| chkumar|rover | Tengu: thanks got it | 12:34 |
| Tengu | :) | 12:36 |
| chkumar|rover | Tengu: trying out there https://review.rdoproject.org/r/24189 | 12:37 |
| Tengu | chkumar|rover: ok! | 12:38 |
| *** jpena is now known as jpena|lunch | 12:39 | |
| Tengu | cool, means we should be able to get some more info | 12:39 |
| Tengu | jpich: I'll wait for -^^^^ to finish so that we should get dbus logs in permissive :). | 12:39 |
| jpich | Cool! | 12:39 |
| fultonj | Tengu: do you have any cycles to review https://review.opendev.org/#/c/694673 ? | 12:46 |
| Tengu | fultonj: should be doable :) | 12:52 |
| fultonj | Thanks Tengu | 12:52 |
| fultonj | Tengu: i'm using the approach we talked about where you ' -e tht_env.yaml' | 12:52 |
| *** dpawlik has joined #tripleo | 12:53 | |
| *** sanjayu_ has quit IRC | 12:56 | |
| fultonj | gfidente: thanks for your review of https://review.opendev.org/#/c/694673 i updated it and replied to your comments | 12:56 |
| *** rlandy has joined #tripleo | 12:58 | |
| *** amoralej is now known as amoralej|lunch | 12:59 | |
| *** ykarel is now known as ykarel|afk | 13:05 | |
| *** holser has joined #tripleo | 13:06 | |
| *** rpittau|bbl is now known as rpittau | 13:09 | |
| gfidente | fultonj hi | 13:11 |
| *** ysandeep has joined #tripleo | 13:13 | |
| *** rh-jelabarre has joined #tripleo | 13:15 | |
| *** ykarel|afk has quit IRC | 13:15 | |
| EmilienM | sounds like openstackbot is dead | 13:17 |
| *** leanderthal has quit IRC | 13:18 | |
| *** bhagyashris_ has quit IRC | 13:19 | |
| *** ysandeep has quit IRC | 13:21 | |
| *** ansmith has joined #tripleo | 13:25 | |
| *** marios|ruck is now known as marios|ruck|call | 13:26 | |
| cloudnull | mornings | 13:31 |
| *** jpena|lunch is now known as pjena | 13:31 | |
| *** pjena is now known as jpena | 13:32 | |
| *** Goneri has joined #tripleo | 13:44 | |
| *** leanderthal has joined #tripleo | 13:44 | |
| *** amoralej|lunch is now known as amoralej | 13:50 | |
| *** haleyb has joined #tripleo | 13:56 | |
| *** ekultails has joined #tripleo | 13:56 | |
| *** morazi has joined #tripleo | 14:00 | |
| *** psachin has quit IRC | 14:01 | |
| *** jaosorior has quit IRC | 14:02 | |
| *** waleedm has quit IRC | 14:04 | |
| *** ykarel|afk has joined #tripleo | 14:06 | |
| *** mmethot has quit IRC | 14:08 | |
| *** mmethot has joined #tripleo | 14:08 | |
| *** epoojad1 has joined #tripleo | 14:10 | |
| *** mmethot has quit IRC | 14:12 | |
| *** mmethot has joined #tripleo | 14:13 | |
| *** hberaud has quit IRC | 14:15 | |
| *** openstackgerrit has joined #tripleo | 14:16 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-puppet-elements master: DNM: list files https://review.opendev.org/699178 | 14:16 |
| openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction https://review.opendev.org/695397 | 14:18 |
| *** mmethot has quit IRC | 14:18 | |
| *** mmethot has joined #tripleo | 14:18 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Update tripleo-validations roles with new validations framework https://review.opendev.org/675310 | 14:19 |
| *** mcornea has joined #tripleo | 14:19 | |
| *** hberaud has joined #tripleo | 14:20 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Update tripleo-validations roles with new validations framework https://review.opendev.org/675310 | 14:20 |
| openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient master: WIP: support standalone ansible.cfg addition and extra args https://review.opendev.org/699137 | 14:28 |
| *** saneax has joined #tripleo | 14:29 | |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-ansible master: Add SyslogIdenfier to healthcheck systemd unit https://review.opendev.org/699215 | 14:30 |
| mrunge | good morning, is there a chance to get an approval https://review.opendev.org/#/c/697665/3 ? | 14:32 |
| mrunge | this is just a backport of a cleanup | 14:33 |
| mrunge | and should not be controversial | 14:33 |
| *** bhagyashris has joined #tripleo | 14:33 | |
| *** epoojad1 has quit IRC | 14:34 | |
| *** ykarel|afk is now known as ykarel|away | 14:34 | |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/paunch master: Add SyslogIdenfier to healthcheck systemd unit https://review.opendev.org/699216 | 14:38 |
| *** beekneemech is now known as bnemec | 14:42 | |
| *** akahat has quit IRC | 14:46 | |
| mrunge | thanks again mwhahaha ! | 14:46 |
| *** yog_ has quit IRC | 14:47 | |
| *** marios|ruck|call is now known as marios|ruck | 14:49 | |
| mwhahaha | marios|ruck, https://review.opendev.org/#/c/698219/ should not have been merged | 14:50 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Revert "Configure UC rocky upgrade vars" https://review.opendev.org/699219 | 14:51 |
| marios|ruck | mwhahaha: k voting on revert | 14:51 |
| *** artom has joined #tripleo | 14:52 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Set containerized_undercloud to false https://review.opendev.org/699010 | 14:53 |
| mwhahaha | marios|ruck: -^ plz also approve that one (it's the fix for the job) | 14:53 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-puppet-elements master: [DNM] strace time to debug, welcome to collaborate! https://review.opendev.org/699221 | 14:54 |
| chkumar|rover | sshnaidm: marios|ruck ^^ | 14:54 |
| mwhahaha | marios|ruck: see https://review.opendev.org/#/c/697483/ as it's green | 14:54 |
| marios|ruck | mwhahaha: ack but zuul still running there | 14:54 |
| chkumar|rover | mwhahaha: fyi filed the bug here https://bugzilla.redhat.com/show_bug.cgi?id=1784001 | 14:55 |
| openstack | bugzilla.redhat.com bug 1784001 in chkconfig "chkconfig network on returing failed to glob pattern /etc/rc0.d/[SK][0-9][0-9]network" [High,New] - Assigned to lnykryn | 14:55 |
| marios|ruck | chkumar|rover: for fs1? | 14:55 |
| marios|ruck | chkumar|rover: i am d/loading the 8.1 guest now | 14:55 |
| sshnaidm | chkumar|rover, ack | 14:55 |
| chkumar|rover | marios|ruck: for image build | 14:55 |
| marios|ruck | chkumar|rover: yes | 14:55 |
| sshnaidm | chkumar|rover, I thought you're going to add strace to build command :) | 14:55 |
| chkumar|rover | sshnaidm: let's see how it goes | 14:56 |
| * marios|ruck ignore irc for a bit focus on rhel8.1 | 14:56 | |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-heat-templates master: Run update without yum update to apply hotfixes. https://review.opendev.org/698936 | 14:56 |
| chkumar|rover | sshnaidm: marios|ruck finally played with systemd header files today | 14:56 |
| chkumar|rover | https://github.com/containers/libpod/pull/4710 | 14:57 |
| *** chkumar|rover is now known as ignoreirc | 14:57 | |
| *** ignoreirc is now known as chkumar|rover | 14:58 | |
| sshnaidm | chkumar|rover, nice one, looking | 15:00 |
| *** morazi has quit IRC | 15:03 | |
| sshnaidm | chkumar|rover, damn, image build on my patch passed accidentally http://paste.openstack.org/show/787633/ | 15:05 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-puppet-elements master: DNM: list files https://review.opendev.org/699178 | 15:06 |
| *** leanderthal has quit IRC | 15:06 | |
| *** psachin has joined #tripleo | 15:07 | |
| openstackgerrit | Michael Turek proposed openstack/tripleo-ci master: ppc64le: Add altarch_excludes var for non x86 container builds https://review.opendev.org/699024 | 15:08 |
| chkumar|rover | sshnaidm: can you take a look at rhel bug ? when free, thanks :-) | 15:12 |
| chkumar|rover | https://bugzilla.redhat.com/show_bug.cgi?id=1784001 | 15:12 |
| openstack | bugzilla.redhat.com bug 1784001 in chkconfig "chkconfig network on returing failed to glob pattern /etc/rc0.d/[SK][0-9][0-9]network" [High,New] - Assigned to lnykryn | 15:12 |
| sshnaidm | chkumar|rover, well, I can add strace there | 15:13 |
| sshnaidm | mjturek, how is "rocky" package manager? I'm not sure I understand | 15:13 |
| mjturek | https://github.com/openstack/tripleo-ci/blob/master/roles/build-containers/vars/main.yaml#L23 | 15:14 |
| mjturek | sshnaidm ^ | 15:14 |
| mjturek | sorry, bad wording | 15:14 |
| mjturek | it's not a package manager | 15:14 |
| mjturek | but it is a category for container excludes | 15:14 |
| mjturek | a key in the exclude_containers dict | 15:14 |
| sshnaidm | mjturek, you use 'ansible_pkg_mgr' in your code, when can it be "rocky"? | 15:15 |
| sshnaidm | for item in altarch_excludes[ansible_pkg_mgr] | 15:16 |
| chkumar|rover | sshnaidm: strace command not found | 15:17 |
| sshnaidm | mjturek, I'm not sure this code is correct at all, but "rocky" is empty anyway in your patch, 1 less reason to use it | 15:17 |
| sshnaidm | chkumar|rover, ok, need to install | 15:17 |
| *** TrevorV has joined #tripleo | 15:17 | |
| mjturek | sshnaidm: hmm that's a really good point, but then why is it included in exclude_containers for x86? | 15:18 |
| sshnaidm | mjturek, no idea | 15:18 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-puppet-elements master: [DNM] strace time to debug, welcome to collaborate! https://review.opendev.org/699221 | 15:18 |
| mjturek | so just remove it you think? | 15:18 |
| sshnaidm | mjturek, yeah | 15:18 |
| mjturek | sshnaidm: will do, resubmitting | 15:19 |
| sshnaidm | mjturek, in worst case we'll see what is it for | 15:19 |
| mjturek | agreed! | 15:19 |
| *** jgwentworth is now known as melwitt | 15:21 | |
| openstackgerrit | Michael Turek proposed openstack/tripleo-ci master: ppc64le: Add altarch_excludes var for non x86 container builds https://review.opendev.org/699024 | 15:21 |
| *** ykarel|away has quit IRC | 15:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-puppet-elements master: [DNM] strace time to debug, welcome to collaborate! https://review.opendev.org/699221 | 15:24 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/train: Make containerized-undercloud-upgrades vote on train https://review.opendev.org/696872 | 15:24 |
| *** hberaud has quit IRC | 15:29 | |
| openstackgerrit | Luke Short proposed openstack/tripleo-heat-templates master: Use paunch to handle container removal. https://review.opendev.org/698806 | 15:30 |
| *** hberaud has joined #tripleo | 15:30 | |
| *** waleedm has joined #tripleo | 15:30 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: build-test-packages: add retries for git clones https://review.opendev.org/693734 | 15:33 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Create a dedicated log file for healthchecks for collectd https://review.opendev.org/699226 | 15:35 |
| *** artom has quit IRC | 15:35 | |
| *** bhagyashris has quit IRC | 15:35 | |
| *** suuuper has quit IRC | 15:39 | |
| *** fmount has quit IRC | 15:40 | |
| *** fmount has joined #tripleo | 15:43 | |
| *** fmount- has joined #tripleo | 15:50 | |
| *** fmount has quit IRC | 15:50 | |
| *** fmount- is now known as fmount | 15:51 | |
| *** hkominos has joined #tripleo | 15:53 | |
| hkominos | Hi all. Quick question. Is there a way to find/ get/ view the ansible variables used in a deployment? | 15:54 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Create a dedicated log file for healthchecks for collectd https://review.opendev.org/699226 | 15:55 |
| openstackgerrit | Luke Short proposed openstack/tripleo-common master: Default to 50 Ansible forks. https://review.opendev.org/698564 | 15:55 |
| *** ykarel|away has joined #tripleo | 15:56 | |
| *** iurygregory has quit IRC | 15:57 | |
| mwhahaha | hkominos: you can download the playbooks or look in the outputs in /var/lib/mistral/overcloud | 16:00 |
| hkominos | mwhahaha: Thx i just got them | 16:01 |
| *** jaosorior has joined #tripleo | 16:10 | |
| *** chkumar|rover is now known as raukadah | 16:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: actions/ansible: catch errors when cleaning the work directory https://review.opendev.org/699234 | 16:18 |
| *** artom has joined #tripleo | 16:19 | |
| *** ysandeep has joined #tripleo | 16:19 | |
| *** gregwork has joined #tripleo | 16:22 | |
| *** dpawlik has quit IRC | 16:24 | |
| *** bandini has quit IRC | 16:31 | |
| *** waleedm_ has joined #tripleo | 16:34 | |
| *** ysandeep has quit IRC | 16:34 | |
| *** dtrainor has quit IRC | 16:36 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/train: Fix the undefined operation_type variable. https://review.opendev.org/698911 | 16:36 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Install texttable and harmonize the way to install. https://review.opendev.org/693141 | 16:36 |
| *** waleedm has quit IRC | 16:36 | |
| *** ykarel|away has quit IRC | 16:38 | |
| hkominos | Just a quick question. Is the ansible user different from the "stack" user in terms of deployment ? Should they have different ssh keys or not ? (in Rocky) | 16:43 |
| *** ykarel|away has joined #tripleo | 16:47 | |
| mwhahaha | we generate an ssh key for the deployment and create a user to run the ansible bits on the overcloud nodes | 16:48 |
| mwhahaha | so it's not the stack user | 16:48 |
| mwhahaha | it is configurable i think tho | 16:48 |
| hkominos | Perfect. so there is an /var/lib/mistral/overcloud/ssh_private_key which I assumed is used by the ansible user (maybe heat-admin ?) | 16:50 |
| hkominos | I assume there is a public key somewhere as well | 16:51 |
| mwhahaha | it's not heat-admin, i think it's tripleo-admin | 16:51 |
| *** lucasagomes has quit IRC | 16:52 | |
| hkominos | thx ! | 16:53 |
| mwhahaha | sshnaidm: do you have a ansible collection structure defined for the openstack bits you're working on? | 16:56 |
| mwhahaha | sshnaidm: i'm starting to bootstrap the tripleo-operator-ansible thing and wanted to use a similar structure if one is already defined | 16:57 |
| sshnaidm | mwhahaha, what do you mean by defined structure? | 16:57 |
| mwhahaha | sshnaidm: how the repo is structured | 16:57 |
| mwhahaha | or are just doing ansible-galaxy collection init (or whatever it was) in a folder | 16:57 |
| sshnaidm | mwhahaha, I think it will be the default https://docs.ansible.com/ansible/latest/dev_guide/developing_collections.html#collection-structure | 16:58 |
| mwhahaha | when you do the init i think it creates a folder like <collection>/<namespace/<files & folders> | 16:58 |
| mwhahaha | right so are you having the collection/ as the base repo or are you nesting it some how | 16:59 |
| sshnaidm | mwhahaha, idk yet, but in mordred patch it seems like nested: https://review.opendev.org/#/c/684788/ | 16:59 |
| mwhahaha | no it's not nested | 17:00 |
| mwhahaha | so that's making the contents collections/ in the root | 17:00 |
| sshnaidm | mwhahaha, yeah, that's what I meant) | 17:00 |
| sshnaidm | mwhahaha, lemme find a better example.. | 17:01 |
| *** dtrainor has joined #tripleo | 17:01 | |
| *** ykarel|away has quit IRC | 17:01 | |
| *** ykarel|away has joined #tripleo | 17:02 | |
| sshnaidm | mwhahaha, like it's done in ansible-network by Paul: https://github.com/ansible-network/ansible_collections.cisco.iosxr | 17:02 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Remove Fluentd and SensuClient from roles_data. https://review.opendev.org/699245 | 17:02 |
| *** saneax has quit IRC | 17:05 | |
| mwhahaha | sshnaidm: cool thanks | 17:06 |
| sshnaidm | mwhahaha, are we going to publish it to galaxy? | 17:07 |
| mwhahaha | we can | 17:07 |
| sshnaidm | if need openstack namespace, we can ask mordred to create us a collection.. or request our own namespace "tripleo" | 17:08 |
| mwhahaha | i was just going to use tripleo | 17:09 |
| sshnaidm | mwhahaha, do we have a repo for it? | 17:12 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add initial structure for pep8 job https://review.opendev.org/699249 | 17:13 |
| mwhahaha | sshnaidm: -^ | 17:13 |
| pkopec | Hi, mwhahaha, EmilienM, re https://review.opendev.org/#/c/681092/ can we merge this, I'm working on follow up patch to address the comment made by Bogdan | 17:13 |
| pkopec | ? | 17:13 |
| mwhahaha | it was created on friday | 17:13 |
| *** udesale has joined #tripleo | 17:14 | |
| sshnaidm | oh, nice | 17:15 |
| *** ykarel|away has quit IRC | 17:16 | |
| *** marios|ruck is now known as marios|ruck|out | 17:18 | |
| sshnaidm | mwhahaha, so I'll request "tripleo" namespace in galaxy? | 17:18 |
| mwhahaha | works for me | 17:19 |
| sshnaidm | mwhahaha, do you have a user there? | 17:19 |
| mwhahaha | mwhahaha | 17:20 |
| sshnaidm | mwhahaha, https://github.com/ansible/galaxy/issues/2152 | 17:21 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add initial structure for pep8 job https://review.opendev.org/699249 | 17:21 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add initial structure https://review.opendev.org/699249 | 17:25 |
| *** jpich has quit IRC | 17:25 | |
| *** lmiccini has quit IRC | 17:32 | |
| raukadah | Tengu: sorry if still around http://logs.rdoproject.org/89/24189/1/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001/5ecd7dd/logs/undercloud/var/log/audit/audit.log.txt.gz something is not working there, need help https://review.rdoproject.org/r/#/c/24189/ please have alook | 17:33 |
| raukadah | it is still showing enforcing | 17:33 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add initial structure https://review.opendev.org/699249 | 17:36 |
| mwhahaha | raukadah: enforcing is a undercloud conf thing, you need to change the config | 17:36 |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-upgrade stable/stein: Fix the undefined operation_type variable. https://review.opendev.org/699254 | 17:37 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/stein: [stein only] WIP Make podman update from 1.0.5 to 1.4.2. https://review.opendev.org/699255 | 17:45 |
| *** yprokule has quit IRC | 17:46 | |
| raukadah | mwhahaha:I will take a look tomorrow :-) | 17:47 |
| *** ramishra has quit IRC | 17:48 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: WIP: Adapt overcloud upgrade workflow to Train. https://review.opendev.org/699256 | 17:49 |
| *** jfrancoa has quit IRC | 17:49 | |
| *** marios|ruck|out has quit IRC | 17:51 | |
| *** abishop_ has joined #tripleo | 17:54 | |
| *** abishop_ is now known as abishop | 17:54 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Delegate and run once debug start-at-task messages https://review.opendev.org/698339 | 17:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI/fs010: disable Paunch on the overcloud https://review.opendev.org/694076 | 18:00 |
| *** derekh has quit IRC | 18:02 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Delegate and run once debug start-at-task messages https://review.opendev.org/699266 | 18:05 |
| EmilienM | slagle: ^ fyi i proposed a backport in train | 18:05 |
| *** jpena is now known as jpena|off | 18:08 | |
| *** psachin has quit IRC | 18:19 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible https://review.opendev.org/696980 | 18:20 |
| *** sshnaidm is now known as sshnaidm|afk | 18:26 | |
| *** amoralej is now known as amoralej|off | 18:38 | |
| *** hberaud is now known as hberaud|gone | 18:39 | |
| m1p | Hi. I'm trying to customize a container as described in https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/container_image_prepare.html#modify-with-custom-dockerfile | 18:41 |
| m1p | This worked until Rocky. It stopped working in Stein, but I didn't need it anymore so I dropped the step entirely. Now I need to modify a container again, same issue with Train. | 18:41 |
| m1p | I seem to have found the issue. The docs are missing a `set:` int the containers-prepare-parameter.yaml | 18:41 |
| m1p | If I modify it like this, the step passes without errors: | 18:41 |
| m1p | https://www.irccloud.com/pastebin/VlODyrmq/ | 18:41 |
| m1p | Can anyone help me find out what changed and if this is really the issue, before I patch the docs? | 18:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: fix a typo for domains creation https://review.opendev.org/699274 | 18:51 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible https://review.opendev.org/696980 | 18:52 |
| openstackgerrit | Soniya Murlidhar Vyas proposed openstack/tripleo-quickstart-extras master: [Stein] Remove passing tests from skiplist https://review.opendev.org/699275 | 18:53 |
| *** rpittau is now known as rpittau|afk | 18:55 | |
| *** gfidente is now known as gfidente|afk | 18:57 | |
| *** waleedm_ has quit IRC | 18:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: Improve molecule tests for tripleo-keystone-resources https://review.opendev.org/699279 | 19:02 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: Improve molecule tests for tripleo-keystone-resources https://review.opendev.org/699279 | 19:02 |
| *** tesseract has quit IRC | 19:06 | |
| openstackgerrit | Terry Wilson proposed openstack/tripleo-quickstart-extras master: Revert "Skip dns related tests" https://review.opendev.org/688945 | 19:08 |
| openstackgerrit | Merged openstack/tripleo-operator-ansible master: Add initial structure https://review.opendev.org/699249 | 19:08 |
| *** rfolco has quit IRC | 19:09 | |
| *** rfolco has joined #tripleo | 19:10 | |
| *** waleedm_ has joined #tripleo | 19:11 | |
| *** lbragstad_ has joined #tripleo | 19:12 | |
| *** lbragstad has quit IRC | 19:14 | |
| *** rlandy is now known as rlandy|brb | 19:22 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-validations master: Introduce Ceph placement group validation https://review.opendev.org/694673 | 19:24 |
| *** waleedm_ has quit IRC | 19:30 | |
| *** kozhukalov has joined #tripleo | 19:36 | |
| *** rlandy|brb is now known as rlandy | 19:45 | |
| *** jbadiapa has quit IRC | 19:46 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-validations master: Introduce Ceph placement group validation https://review.opendev.org/694673 | 19:48 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Update override for keystone resources https://review.opendev.org/699282 | 19:50 |
| *** kozhukalov has quit IRC | 19:51 | |
| *** kozhukalov has joined #tripleo | 19:51 | |
| *** udesale has quit IRC | 19:52 | |
| *** Goneri has quit IRC | 19:53 | |
| *** jaosorior has quit IRC | 19:59 | |
| *** florianf has quit IRC | 20:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible https://review.opendev.org/696980 | 20:08 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: DNM test undercloud_enable_nova_metadata https://review.opendev.org/698327 | 20:11 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations master: Add a validation to fail if a Ceph dependency is not installed https://review.opendev.org/697453 | 20:17 |
| *** waleedm_ has joined #tripleo | 20:19 | |
| *** ekultails has quit IRC | 20:23 | |
| *** pkopec has quit IRC | 20:26 | |
| *** gregwork has quit IRC | 20:34 | |
| *** holser has quit IRC | 20:35 | |
| *** waleedm_ has quit IRC | 20:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: fix a typo for user/role assignment https://review.opendev.org/699286 | 20:40 |
| larsks | Is it possible to perform a standalone install with neutron_driver: ovn? We're getting "Property ContainerOvnControllerConfigImage not assigned" when we try that. | 20:42 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: OvS DPDK parameters failing in NIC Partitioning https://review.opendev.org/698621 | 20:43 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Use python -m pip instead pip command. https://review.opendev.org/693310 | 20:43 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/stein: Update: Run all roles update at once https://review.opendev.org/697521 | 20:43 |
| EmilienM | larsks: it's the default already | 20:44 |
| EmilienM | larsks: what version have you tried? what config ? | 20:44 |
| *** jfrancoa has joined #tripleo | 20:44 | |
| larsks | Deploying from recent RDO master (python2-tripleoclient-13.0.1-0.20191213135654.932fc67.el7.noarch), using a very simple config: https://termbin.com/fgjd | 20:46 |
| larsks | (That's container-prepare-parameters.yml) | 20:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: Revert "[stein only] WIP Make podman update from 1.0.5 to 1.4.2." https://review.opendev.org/699194 | 20:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: fix a typo for user/role assignment https://review.opendev.org/699286 | 20:46 |
| larsks | And standalone_parameters.yaml is https://termbin.com/ayr7 | 20:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible https://review.opendev.org/696980 | 20:47 |
| *** naved001 has joined #tripleo | 20:47 | |
| mwhahaha | it's likely failing on your NeutronMechanismDrivers | 20:48 |
| mwhahaha | i think we use that to check if it's ovn or not for magical container bits | 20:48 |
| larsks | Ah, I see that's not in sync with neutron_driver in the container-prepare-parameters file. I'll give that a shot. | 20:48 |
| larsks | Can we just unset NeutronMechanismDrivers and it will use a sane default? | 20:49 |
| *** slaweq has quit IRC | 20:49 | |
| EmilienM | https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/image/kolla_builder.py#L125 | 20:49 |
| EmilienM | mwhahaha: is right | 20:49 |
| mwhahaha | yes you don't need to specify it | 20:49 |
| mwhahaha | it'll give you the ovn default | 20:49 |
| larsks | Hmm, I guess if we want baremetal, though ,we need to specify [ovn, baremetal]. | 20:49 |
| larsks | We'll give that a try. Thank you! | 20:49 |
| mwhahaha | yea if you don't want ovn, check the ml2 environment file i think it specifies it in there | 20:49 |
| larsks | Will do. | 20:50 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo-repos role https://review.opendev.org/699288 | 20:51 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo-repos role https://review.opendev.org/699288 | 21:00 |
| *** Goneri has joined #tripleo | 21:06 | |
| *** artom has quit IRC | 21:08 | |
| m1p | Ok, so my last message is a bunch of garbage, sorry. Adding `set:` prevented the problem, because it didn't modify the container any more. The actual problem is here: `unable to pull and read image "undercloud.ctlplane.lab:8787/tripleotrain/centos-binary-horizon:current-tripleo": Error reading blob sha256:d03c4b2d8fdd6692563ca50a2fec858b4b87b628338de424eee02e82a8e71c70: Digest did not match, expected | 21:10 |
| m1p | sha256:d03c4b2d8fdd6692563ca50a2fec858b4b87b628338de424eee02e82a8e71c70, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855` | 21:10 |
| m1p | I deleted the tripleotrain/centos-binary-horizon dir from /var/lib/image-serve/v2 which apparently fixed it. | 21:11 |
| m1p | Apparently, if I try to modify an image that's already in the undercloud registry, something goes wrong. This didn't happen before with the Docker registry. | 21:12 |
| *** rcernin has joined #tripleo | 21:21 | |
| *** dsneddon has joined #tripleo | 21:25 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/stein: Update: Ensure parallel execution https://review.opendev.org/697522 | 21:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Fix neutron api TLS logging https://review.opendev.org/697334 | 21:26 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: kolla/overrides: add missing healthcheck for ironic-neutron-agent https://review.opendev.org/698580 | 21:26 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Revert "Configure UC rocky upgrade vars" https://review.opendev.org/699219 | 21:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable healthcheck script in clustercheck service https://review.opendev.org/698584 | 21:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Make sure glance_api_tls_proxy logs are persisted on the host https://review.opendev.org/696904 | 21:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: [Rocky and older] Actually install tmpwatch on overcloud nodes https://review.opendev.org/698238 | 21:26 |
| *** ansmith has quit IRC | 21:30 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add arm64 based functional test https://review.opendev.org/676111 | 21:31 |
| *** TrevorV has quit IRC | 21:35 | |
| *** raildo has quit IRC | 21:39 | |
| cloudnull | mwhahaha EmilienM weshay sshnaidm|afk - https://pasted.tech/pastes/6467296922ccadced979da3deb6363091d2e5108.raw - have any of you seen this error? | 21:39 |
| cloudnull | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e27/698620/6/check/tripleo-ci-centos-7-containers-multinode/e27dd99/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 21:39 |
| cloudnull | this is what the multi-node job is failing on ? | 21:39 |
| cloudnull | and I can't put my finger on why that is | 21:40 |
| *** slaweq has joined #tripleo | 21:40 | |
| mwhahaha | cloudnull: 2019-12-16 16:41:58 | "Error: error pulling image \"192.168.24.1:8787/tripleomaster/centos-binary-nova-api:3b5413fbc453d8ac0947382596735bcdc8fc56a6_9585c539-updated-20191216152107\": unable to pull 192.168.24.1:8787/tripleomaster/centos-binary-nova-api:3b5413fbc453d8ac0947382596735bcdc8fc56a6_9585c539-updated-20191216152107: unable to pull image: Error initializing source | 21:41 |
| mwhahaha | docker://192.168.24.1:8787/tripleomaster/centos-binary-nova-api:3b5413fbc453d8ac0947382596735bcdc8fc56a6_9585c539-updated-20191216152107: pinging docker registry returned: Get http://192.168.24.1:8787/v2/: dial tcp 192.168.24.1:8787: connect: no route to host", | 21:41 |
| mwhahaha | cloudnull: bad firewall rule? | 21:41 |
| *** mcornea has quit IRC | 21:42 | |
| cloudnull | I see that, however "no route to host" ? | 21:42 |
| cloudnull | like the routing table is jacked ? | 21:42 |
| mwhahaha | isn't that our reject | 21:42 |
| *** mcornea has joined #tripleo | 21:42 | |
| mwhahaha | not sure, but given the ovbs are timing otu, i'd say your iptables code doesn't work :D | 21:43 |
| cloudnull | agreed, I just have no idea what isn't working | 21:43 |
| mwhahaha | let's see | 21:43 |
| * cloudnull continues to dig | 21:43 | |
| mwhahaha | cloudnull: compare iptables output against a normal job | 21:44 |
| mwhahaha | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e27/698620/6/check/tripleo-ci-centos-7-containers-multinode/e27dd99/logs/undercloud/var/log/extra/network.txt.gz | 21:44 |
| *** holser has joined #tripleo | 21:44 | |
| cloudnull | oh, that's a handy file | 21:44 |
| cloudnull | thanks mwhahaha that gives me somthing to go look into | 21:49 |
| *** pcaruana has quit IRC | 21:55 | |
| *** paramite has quit IRC | 21:56 | |
| *** slaweq has quit IRC | 21:57 | |
| *** rfolco is now known as rfolco|bbl | 21:58 | |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates stable/train: Enable healthcheck script in clustercheck service https://review.opendev.org/699303 | 22:03 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/stein: Force facts cache refreshing before upgrade. https://review.opendev.org/698894 | 22:03 |
| *** jfrancoa has quit IRC | 22:09 | |
| *** ansmith has joined #tripleo | 22:16 | |
| *** kozhukalov has quit IRC | 22:18 | |
| *** tmazur has quit IRC | 22:23 | |
| *** holser has quit IRC | 22:25 | |
| *** rcernin has quit IRC | 22:39 | |
| *** rcernin has joined #tripleo | 22:39 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient stable/train: Add undercloud.conf enable_nova_metadata https://review.opendev.org/699308 | 22:46 |
| *** gfidente|afk has quit IRC | 22:48 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: DNM test undercloud_enable_nova_metadata https://review.opendev.org/698327 | 22:49 |
| *** rlandy is now known as rlandy|bbl | 22:51 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-ansible master: WIP: Add code to register the base host as an ipa client https://review.opendev.org/698297 | 22:51 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: WIP: Add code to register nodes as ipa-clients https://review.opendev.org/698292 | 22:53 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Update firewall role to use an action plugin https://review.opendev.org/698620 | 22:55 |
| *** mcornea has quit IRC | 22:56 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add filters for shell cmdline https://review.opendev.org/699309 | 23:02 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Action plugin for timestamping a file https://review.opendev.org/699310 | 23:02 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add basic role for undercloud function https://review.opendev.org/699311 | 23:02 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add filters for shell cmdline https://review.opendev.org/699309 | 23:07 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Action plugin for timestamping a file https://review.opendev.org/699310 | 23:07 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add basic role for undercloud function https://review.opendev.org/699311 | 23:07 |
| *** tkajinam has joined #tripleo | 23:07 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add filters for shell cmdline https://review.opendev.org/699309 | 23:09 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Action plugin for timestamping a file https://review.opendev.org/699310 | 23:09 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add basic role for undercloud function https://review.opendev.org/699311 | 23:09 |
| *** dsneddon has quit IRC | 23:09 | |
| *** rascasoft has quit IRC | 23:11 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo-repos role https://review.opendev.org/699288 | 23:12 |
| *** rascasoft has joined #tripleo | 23:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: handle multiple roles per user https://review.opendev.org/699286 | 23:15 |
| *** dsneddon has joined #tripleo | 23:16 | |
| *** dsneddon has quit IRC | 23:21 | |
| mwhahaha | cloudnull: for config_template is there a remote template option? | 23:30 |
| mwhahaha | cloudnull: or is it just remote src | 23:31 |
| *** rascasoft has quit IRC | 23:35 | |
| *** dsneddon has joined #tripleo | 23:36 | |
| *** rascasoft has joined #tripleo | 23:40 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Set containerized_undercloud to false https://review.opendev.org/699010 | 23:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix containers-common.yaml path for RsyslogSidecar service https://review.opendev.org/697254 | 23:41 |
| mwhahaha | cloudnull: I"m getting a file not found when it tries to stat local in http://paste.openstack.org/show/787648/ am i missing something? | 23:42 |
| *** tosky has quit IRC | 23:43 | |
| *** dsneddon has quit IRC | 23:46 | |
| *** dsneddon has joined #tripleo | 23:48 | |
| *** holser has joined #tripleo | 23:52 | |
| *** dsneddon has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!