| *** mcornea has quit IRC | 00:09 | |
| *** slaweq has joined #tripleo | 00:10 | |
| *** slaweq has quit IRC | 00:15 | |
| *** slaweq has joined #tripleo | 00:19 | |
| *** tosky has quit IRC | 00:22 | |
| *** slaweq has quit IRC | 00:24 | |
| *** slaweq has joined #tripleo | 00:37 | |
| *** slaweq has quit IRC | 00:42 | |
| *** slaweq has joined #tripleo | 00:51 | |
| *** slaweq has quit IRC | 00:55 | |
| *** brault has quit IRC | 00:58 | |
| *** brault has joined #tripleo | 00:59 | |
| *** slaweq has joined #tripleo | 01:05 | |
| *** slaweq has quit IRC | 01:13 | |
| *** slaweq has joined #tripleo | 01:17 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Switch to more specific include statements. https://review.opendev.org/694125 | 01:18 |
|---|---|---|
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Switch to more specific include modules for upgrades. https://review.opendev.org/694127 | 01:18 |
| *** slaweq has quit IRC | 01:21 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Switch to more specific include modules for updates. https://review.opendev.org/694128 | 01:31 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Switch to more specific include modules for ffwd. https://review.opendev.org/694129 | 01:31 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: [FFWD] Align workarounds templating with upgrades. https://review.opendev.org/694130 | 01:31 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Migrate from with_X loop. https://review.opendev.org/694131 | 01:31 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Introduce manual setting of DIB_INIT_SYSTEM https://review.opendev.org/414179 | 01:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add a Dockerfile and related jobs https://review.opendev.org/693971 | 01:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update bindep.txt for some missing dependencies https://review.opendev.org/693975 | 01:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Dockerfile: install vhd-util https://review.opendev.org/693976 | 01:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start a buildset registry with docker image creation https://review.opendev.org/694175 | 01:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Only wait for checksum processes https://review.opendev.org/695338 | 01:38 |
| *** slaweq has joined #tripleo | 01:51 | |
| *** ricolin has joined #tripleo | 01:55 | |
| *** slaweq has quit IRC | 01:55 | |
| *** slaweq has joined #tripleo | 01:59 | |
| *** slaweq has quit IRC | 02:10 | |
| *** mschuppert has quit IRC | 02:14 | |
| *** morazi has quit IRC | 02:22 | |
| *** dtrainor_ has joined #tripleo | 02:23 | |
| *** slaweq has joined #tripleo | 02:25 | |
| *** dtrainor has quit IRC | 02:26 | |
| *** slaweq has quit IRC | 02:30 | |
| *** morazi has joined #tripleo | 02:34 | |
| *** bdodd has quit IRC | 02:48 | |
| *** bdodd has joined #tripleo | 02:50 | |
| *** morazi has quit IRC | 02:52 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Only wait for checksum processes https://review.opendev.org/695338 | 03:04 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add a Dockerfile and related jobs https://review.opendev.org/693971 | 03:04 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update bindep.txt for some missing dependencies https://review.opendev.org/693975 | 03:04 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Dockerfile: install vhd-util https://review.opendev.org/693976 | 03:04 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start a buildset registry with docker image creation https://review.opendev.org/694175 | 03:04 |
| *** morazi has joined #tripleo | 03:05 | |
| *** apetrich has quit IRC | 03:08 | |
| *** rlandy|rover|bbl has quit IRC | 03:20 | |
| *** ysandeep has joined #tripleo | 03:31 | |
| *** udesale has joined #tripleo | 03:53 | |
| *** bhagyashris has joined #tripleo | 04:05 | |
| *** epoojad1 has joined #tripleo | 04:18 | |
| *** dsneddon has quit IRC | 04:26 | |
| *** skramaja has joined #tripleo | 04:34 | |
| *** ramishra has joined #tripleo | 04:37 | |
| *** bhagyashris has quit IRC | 04:39 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common stable/train: Ignore blacklisted nodes when rendering network config https://review.opendev.org/695348 | 04:41 |
| *** epoojad1 has quit IRC | 04:43 | |
| *** surpatil has joined #tripleo | 05:00 | |
| *** raukadah is now known as chandankumar | 05:09 | |
| *** bhagyashris has joined #tripleo | 05:09 | |
| *** dsneddon has joined #tripleo | 05:16 | |
| *** ratailor has joined #tripleo | 05:16 | |
| *** epoojad1 has joined #tripleo | 05:17 | |
| *** dsneddon has quit IRC | 05:20 | |
| *** artom has quit IRC | 05:27 | |
| *** skramaja has quit IRC | 05:29 | |
| *** bdodd has quit IRC | 05:34 | |
| *** bdodd has joined #tripleo | 05:37 | |
| *** soniya29 has joined #tripleo | 05:41 | |
| *** zaneb has joined #tripleo | 05:51 | |
| *** krypto has quit IRC | 06:07 | |
| *** udesale has quit IRC | 06:15 | |
| *** udesale has joined #tripleo | 06:16 | |
| *** marios|ruck has joined #tripleo | 06:22 | |
| *** numans has joined #tripleo | 06:28 | |
| *** skramaja has joined #tripleo | 06:29 | |
| *** slaweq has joined #tripleo | 06:39 | |
| *** udesale has quit IRC | 06:39 | |
| *** Tengu has quit IRC | 06:39 | |
| *** udesale has joined #tripleo | 06:39 | |
| *** yprokule has joined #tripleo | 06:41 | |
| *** dpawlik has joined #tripleo | 06:41 | |
| *** Tengu has joined #tripleo | 06:41 | |
| *** slaweq has quit IRC | 06:44 | |
| *** brault has quit IRC | 06:48 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-common master: Add healthcheck for nova-virtlogd container https://review.opendev.org/693674 | 06:57 |
| *** jfrancoa has joined #tripleo | 06:59 | |
| *** saneax has joined #tripleo | 07:01 | |
| *** lmiccini has joined #tripleo | 07:01 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Add healthcheck for nova-virtlogd container https://review.opendev.org/693675 | 07:01 |
| *** bandini has joined #tripleo | 07:02 | |
| *** dsneddon has joined #tripleo | 07:02 | |
| *** dsneddon has quit IRC | 07:07 | |
| *** xek_ has joined #tripleo | 07:10 | |
| *** rcernin has quit IRC | 07:12 | |
| *** florianf has joined #tripleo | 07:12 | |
| *** zaneb has quit IRC | 07:21 | |
| *** chandankumar is now known as chkumar|rover | 07:22 | |
| *** pcaruana has joined #tripleo | 07:27 | |
| *** epoojad1 has quit IRC | 07:28 | |
| *** tosky has joined #tripleo | 07:31 | |
| *** apetrich has joined #tripleo | 07:34 | |
| openstackgerrit | Merged openstack/os-net-config master: Adding testcases for sriov_config https://review.opendev.org/695040 | 07:36 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Revert "Remove containers before removing associated storage" https://review.opendev.org/695361 | 07:37 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/train: Revert "Remove containers before removing associated storage" https://review.opendev.org/695362 | 07:38 |
| *** brault has joined #tripleo | 07:44 | |
| *** zaneb has joined #tripleo | 07:47 | |
| *** ayoung has quit IRC | 07:48 | |
| *** kopecmartin|off is now known as kopecmartin | 07:49 | |
| *** ayoung has joined #tripleo | 07:51 | |
| *** zaneb has quit IRC | 07:51 | |
| *** ansmith_ has quit IRC | 07:52 | |
| *** ansmith has joined #tripleo | 07:52 | |
| *** bhagyashris has quit IRC | 07:55 | |
| *** surpatil has quit IRC | 07:55 | |
| *** dsneddon has joined #tripleo | 07:55 | |
| *** fmount has joined #tripleo | 07:57 | |
| *** brault has quit IRC | 08:01 | |
| *** tmazur has joined #tripleo | 08:04 | |
| *** sri_ has joined #tripleo | 08:06 | |
| *** ayoung has quit IRC | 08:06 | |
| *** surpatil has joined #tripleo | 08:11 | |
| *** jpich has joined #tripleo | 08:12 | |
| *** iurygregory has joined #tripleo | 08:16 | |
| *** ayoung has joined #tripleo | 08:16 | |
| *** rpittau|afk is now known as rpittau | 08:20 | |
| *** amoralej|off is now known as amoralej | 08:21 | |
| *** tkajinam has quit IRC | 08:28 | |
| openstackgerrit | Karthik S proposed openstack/os-net-config stable/train: Adding testcases for sriov_config https://review.opendev.org/695368 | 08:29 |
| *** jpena|off is now known as jpena | 08:35 | |
| *** bandini has quit IRC | 08:35 | |
| *** gfidente has joined #tripleo | 08:36 | |
| *** bogdando has joined #tripleo | 08:40 | |
| *** iurygregory has quit IRC | 08:40 | |
| *** hberaud|gone is now known as hberaud | 08:41 | |
| *** bhagyashris has joined #tripleo | 08:41 | |
| *** slaweq has joined #tripleo | 08:44 | |
| *** bandini has joined #tripleo | 08:51 | |
| d0ugal | marios|ruck: ping | 08:51 |
| d0ugal | marios|ruck: I am still having issues understanding CI :) if you have a moment to help that'd be great | 08:52 |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: Switch to use process executor https://review.opendev.org/690389 | 08:52 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Address ansible-lint issues https://review.opendev.org/694143 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Switch to more specific include statements. https://review.opendev.org/694144 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Adjust roles_data also for updates. https://review.opendev.org/694146 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: HTTP test during update/upgrade/ffwd. https://review.opendev.org/694147 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for upgrades. https://review.opendev.org/694148 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for updates. https://review.opendev.org/694149 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for ffwd. https://review.opendev.org/694150 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [FFWD] Align workarounds templating with upgrades. https://review.opendev.org/694151 | 08:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Migrate from with_X loop. https://review.opendev.org/694152 | 08:54 |
| ccamacho | hi mwhahaha good morning! are you around!? | 08:56 |
| ccamacho | quick question about puppet | 08:56 |
| *** iurygregory has joined #tripleo | 08:57 | |
| bogdando | ccamacho: hi, I think it's deep night there at his location atm. Try me. | 08:58 |
| ccamacho | im tracking a CI issue and there are several failures in train, but, do you think it can be because of this? | 08:58 |
| ccamacho | https://zuul.opendev.org/t/openstack/build/f0291ef68bb642a192d8bcbd83309ac8/log/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#2206 | 08:58 |
| ccamacho | The unknown variables makes several services to not configure correctly | 08:58 |
| ccamacho | bogdando thanks :) probably not around then :) | 08:59 |
| bogdando | those warnings was there for ages | 08:59 |
| bogdando | I don't think those break anything | 08:59 |
| Tengu | ccamacho: care to point to the actual failure? | 08:59 |
| ccamacho | ack bogdando ack so that might not be the root cause | 08:59 |
| marios|ruck | d0ugal: o/ | 08:59 |
| ccamacho | Tengu if you go down in the log you will see the job breaking | 09:00 |
| bogdando | it's 2019-11-20 22:25:08,647 ERROR: 127085 | 09:00 |
| d0ugal | marios|ruck: do you know if mistral-lib and oslo-utils are used from master? or do we need a package promotion before we see changes in CI? | 09:01 |
| d0ugal | marios|ruck: all of my changes are merged in master/train/stein but I am still not seeing the expected results | 09:01 |
| Tengu | ccamacho: https://zuul.opendev.org/t/openstack/build/f0291ef68bb642a192d8bcbd83309ac8/log/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#2623 | 09:01 |
| ccamacho | Tengu if you see this | 09:01 |
| ccamacho | https://zuul.opendev.org/t/openstack/build/f0291ef68bb642a192d8bcbd83309ac8/log/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#2322 | 09:01 |
| ccamacho | Its the first | 09:01 |
| ccamacho | error on mysql conainter | 09:01 |
| d0ugal | marios|ruck: this is all related to this CVE https://bugs.launchpad.net/tripleo/+bug/1850843 | 09:01 |
| openstack | Launchpad bug 1850843 in tripleo "Sensitive information leaked in mistral logs" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal) | 09:01 |
| bogdando | then https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/containers/stdouts/container-puppet-mysql.log.txt.gz | 09:01 |
| marios|ruck | d0ugal: well either way we've had promotions yesterday so should all be there but do you have log for me /pointer where you're testing it | 09:02 |
| bogdando | ccamacho, Tengu: but I can see no errors there | 09:02 |
| marios|ruck | d0ugal: ack on bug opening | 09:02 |
| Tengu | ccamacho: there is the stdout logs for that kind of issue. that would probably give some more info. | 09:03 |
| d0ugal | marios|ruck: so I just picked a recent job that passed. https://d5715351468bef8152d6-fdd116184899b7b6f5b04a2afa40351e.ssl.cf2.rackcdn.com/695348/1/check/tripleo-ci-centos-7-containers-multinode/cab2a92/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz | 09:03 |
| d0ugal | marios|ruck: KeystoneFernetKey1 (and other passwords) are visible if you search for them | 09:03 |
| marios|ruck | d0ugal: ah i see its all merged k, gimme few mins will dig a bit and see if i can help | 09:03 |
| d0ugal | marios|ruck: thanks | 09:03 |
| bogdando | Tengu: there was nothing wrong logged for container-puppet-swift_ringbuilder :/ | 09:04 |
| ccamacho | Tengu bogdando yeah the thing is that I know its failing but cant find an actual error there | 09:04 |
| bogdando | https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/containers/stdouts/container-puppet-swift_ringbuilder.log.txt.gz | 09:04 |
| Tengu | bogdando: in the mysql one probably. | 09:04 |
| Tengu | ccamacho: what I can say, seeing the output in the container-puppet-mysql.log is: not a puppet issue.. | 09:05 |
| ccamacho | yeahp Tengu like https://zuul.opendev.org/t/openstack/build/f0291ef68bb642a192d8bcbd83309ac8/log/logs/undercloud/var/log/containers/mysql/mariadb.log.txt.gz#88 | 09:06 |
| marios|ruck | d0ugal: i see https://review.opendev.org/#/c/694515/ oslo.utils you also mentioned mistral-libs? | 09:06 |
| Tengu | ccamacho: network issue? | 09:06 |
| Tengu | although it's *local*... | 09:06 |
| bogdando | those are ref herring as well | 09:07 |
| bogdando | ccamacho: | 09:07 |
| bogdando | may be we should check journal for podman! | 09:08 |
| *** lucasagomes has joined #tripleo | 09:08 | |
| Tengu | Nov 20 21:23:26 undercloud.localdomain podman[30876]: 2019-11-20 21:23:26.732891569 +0000 UTC m=+0.039851845 container died ba18075db40f5a50eb38e54447aa662ccee468cc11c9635a3a1661afcfdd1fee (image=docker.io/tripleostein/centos-binary-heat-api:current-tripleo, name=container-puppet-heat_api) | 09:10 |
| Tengu | "container died" | 09:10 |
| Tengu | meh. | 09:10 |
| Tengu | that might explain things? maybe? | 09:10 |
| Tengu | ah, nah. ok. "we killed it". | 09:10 |
| Tengu | misleading log.... | 09:10 |
| *** alexmcleod has joined #tripleo | 09:11 | |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-quickstart-extras master: Use python -m pip instead pip command. https://review.opendev.org/693310 | 09:11 |
| *** pkopec has joined #tripleo | 09:11 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-common stable/train: Pin ceph dashboard containers on a specific tag https://review.opendev.org/695372 | 09:11 |
| bogdando | yat | 09:12 |
| bogdando | yay | 09:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/train: Check if snmpd is enabled for upgrade_tasks https://review.opendev.org/695242 | 09:12 |
| bogdando | Tengu, ccamacho: 'container died' is the root cause yes | 09:12 |
| Tengu | bogdando: apparently nope - it's the message when we actuall stop/kill a container. | 09:12 |
| Tengu | or when the run inside it is ended. | 09:13 |
| Tengu | in addition:https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz no Exited with a non-0 | 09:13 |
| Tengu | https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/extra/errors.txt.txt.gz but here, we can see that mysql has some issues. | 09:14 |
| bogdando | Tengu: where do you check for the stop/kill event> | 09:14 |
| d0ugal | marios|ruck: Yeah, the mistral-lib patch is https://review.opendev.org/#/c/692967/ | 09:15 |
| d0ugal | marios|ruck: sorry, somebody came to the door | 09:15 |
| marios|ruck | d0ugal: so looks like it is being build/built now see https://trunk.rdoproject.org/centos7-master/b4/12/b41268417cecb12d1d5955ee3107067edf050221_ebca6917/rpmbuild.log | 09:15 |
| bogdando | Tengu: paunch.log prolly | 09:15 |
| Tengu | Nov 20 21:43:09 undercloud haproxy[13]: Backup Server mysql/undercloud.ctlplane.localdomain is DOWN, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms. 0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0 remaining in queue. | 09:15 |
| Tengu | Nov 20 21:43:09 undercloud haproxy[13]: proxy mysql has no server available! | 09:16 |
| Tengu | bogdando: no. that's container-puppet. | 09:16 |
| marios|ruck | d0ugal: i went there from https://trunk.rdoproject.org/centos7-master/status_report.html (python-oslo-utils gives you a link to latest build) | 09:16 |
| d0ugal | aha | 09:16 |
| marios|ruck | d0ugal: from the earlier logs you sent me it was using python2-oslo-utils-3.41.3-0.20191118053045.cae9aa7.el7.noarch | 09:16 |
| Tengu | bogdando, ccamacho according to HAProxy, mysql is apparently working (with some down-times, but this is probably due to container restart): https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/containers/haproxy/haproxy.log.txt.gz | 09:17 |
| Tengu | generally "working". | 09:17 |
| Tengu | unless the small downtime creates the "gone away" we have in the app logs. | 09:17 |
| *** dsneddon has quit IRC | 09:17 | |
| marios|ruck | d0ugal: perhaps that's it but not sure yet... but that build log is making creating oslo.utils-3.42.0 | 09:17 |
| d0ugal | marios|ruck: that is the 18th, right? That is when it merged so maybe it just missed it? | 09:17 |
| bogdando | Tengu: I can see no stop/kill related for that timestamp in https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/containers/stdouts/container-puppet-mysql.log.txt.gz | 09:17 |
| marios|ruck | d0ugal: if it persists then it might be somethign else | 09:17 |
| bogdando | compare to Nov 20 21:23:17 ... container died in journal | 09:17 |
| d0ugal | marios|ruck: ok, I guess I'll wait a bit longer and check some builds later today | 09:18 |
| marios|ruck | d0ugal: 11:17 < d0ugal> marios|ruck: that is the 18th, right? That is when it merged so maybe it just missed it? | 09:18 |
| Tengu | bogdando: unless you have another container name than "container-puppet-*", that might be an issue. But not even sure. | 09:18 |
| marios|ruck | d0ugal: which one is the 18th. I see the oslo utils patch merged yesterday https://review.opendev.org/#/c/694515/ 26hrs ago | 09:18 |
| Tengu | bogdando: and I'm pretty sure we have the exact same entries in any other deploy. | 09:18 |
| d0ugal | marios|ruck: from that link; ZuulNov 18 10:50 PMChange has been successfully merged by Zuul | 09:19 |
| *** sshnaidm|ruck is now known as sshnaidm | 09:19 | |
| d0ugal | marios|ruck: there are some comments from yesterday | 09:19 |
| Tengu | bogdando: for instance: http://paste.openstack.org/show/786474/ this is normal., | 09:20 |
| bogdando | Tengu: I'm not sure I understand why container dies in between of | 09:20 |
| bogdando | 2019-11-20T21:23:16.750802594+00:00 stderr F puppet-user: Puppet: 5.5.10 | 09:20 |
| bogdando | 2019-11-20T21:23:17.493919530+00:00 stderr F + rc=2 | 09:20 |
| bogdando | isn't the remaining part of the mysql puppet log is normally executed from that container? | 09:21 |
| *** ricolin has quit IRC | 09:22 | |
| Tengu | bogdando: life-cycle for those container-puppet: create, init, start, attach, die, remove | 09:22 |
| Tengu | "container died" is OK for them imho. | 09:22 |
| bogdando | an exciting debugging session yet absolutely confusing | 09:22 |
| bogdando | Tengu: those cleanup and stop look not by an expected place and time | 09:24 |
| bogdando | the container puppet log hasn't finished all the remaining dances AFAIK | 09:24 |
| Tengu | Nov 20 22:29:19 undercloud.localdomain podman[144812]: Error: non zero exit code: 1: OCI runtime error | 09:25 |
| bogdando | rsync things keep going in the died container?.. | 09:25 |
| Tengu | this is more concerning. | 09:25 |
| bogdando | Tengu: please see https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/var/log/containers/stdouts/container-puppet-mysql.log.txt.gz after 2019-11-20T21:23:17 | 09:26 |
| Tengu | hmmm. related to swift healthcheck. | 09:26 |
| bogdando | container afterlife | 09:26 |
| Tengu | bogdando: logs are appended to the file. | 09:26 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: ovn standalone: Start OVN ovsdb-servers using the kolla startup script https://review.opendev.org/690105 | 09:26 |
| Tengu | bogdando: since we run 10'000'000 times the same container-puppet, I'm not that surprised. | 09:26 |
| bogdando | IMO those healthcheck exit errors has nothing to the logged podman failure for puppet | 09:27 |
| bogdando | Tengu: nope, those evens logged a solid flow | 09:27 |
| bogdando | not sparse | 09:28 |
| Tengu | oh, and there's a retry. | 09:28 |
| bogdando | the real split is | 09:28 |
| bogdando | 2019-11-20T21:23:17.731825015+00:00 stderr F tar: Removing leading `/' from member names | 09:28 |
| bogdando | 2019-11-20T22:24:41.564367599+00:00 stderr F + mkdir -p /etc/puppet | 09:28 |
| bogdando | the latter is for another run | 09:28 |
| Tengu | https://github.com/openstack/tripleo-heat-templates/blob/master/common/container-puppet.py#L318-L334 | 09:29 |
| bogdando | so I don't think the death of the container look relevant to the logged events | 09:29 |
| Tengu | there's a retry, and rc=2 is OK. | 09:29 |
| bogdando | mhm | 09:29 |
| bogdando | I can't get what stopped him | 09:30 |
| bogdando | not container puppet tool for sure | 09:30 |
| bogdando | it was in the middle, after puppet execed and rsync continues | 09:30 |
| *** dpawlik has quit IRC | 09:30 | |
| bogdando | Tengu: oh sorry, those look correct: | 09:31 |
| bogdando | 2019-11-20T21:23:17.731825015+00:00 stderr F tar: Removing leading `/' from member names | 09:31 |
| bogdando | 2019-11-20T22:24:41.564367599+00:00 stderr F + mkdir -p /etc/puppet | 09:31 |
| bogdando | so yeah, the exiting was expected | 09:31 |
| bogdando | ccamacho: still no see the real cause :) | 09:32 |
| *** dsneddon has joined #tripleo | 09:32 | |
| Tengu | bogdando: told ya ;) | 09:32 |
| bogdando | Tengu: I better off repro it locally | 09:33 |
| *** dpawlik has joined #tripleo | 09:35 | |
| ccamacho | bogdando this issue is puzzling me xD | 09:35 |
| sshnaidm | dtantsur|afk, hi, can you please take a look at your time? https://bugs.launchpad.net/tripleo/+bug/1844989 we talked about it, I think it was something you changed | 09:35 |
| openstack | Launchpad bug 1844989 in tripleo "Tempest tests fail on standalone ironic job scenario012" [High,Triaged] - Assigned to Dmitry Tantsur (divius) | 09:35 |
| Tengu | bogdando: do you handle it? | 09:35 |
| bogdando | indeed | 09:35 |
| bogdando | Tengu: just reproducing yet | 09:36 |
| ccamacho | bogdando this can be part of the cause https://review.opendev.org/#/c/695234/ | 09:36 |
| bogdando | not sure if "handling" that mistery | 09:36 |
| Tengu | bogdando: ok. lemme know if you can reproduce it, and if you have an env we can access | 09:36 |
| bogdando | ok | 09:36 |
| *** dsneddon has quit IRC | 09:36 | |
| bogdando | ccamacho: wait, isn't T->U upgrade goes from containerised UC already? | 09:37 |
| bogdando | not sure if 695234 has something to that | 09:37 |
| Tengu | Train has already containerised UC | 09:37 |
| bogdando | yes | 09:38 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart master: Generate containers-prepare-parameter.yaml https://review.opendev.org/695234 | 09:38 |
| bogdando | Tengu: that's why I don't understand https://review.opendev.org/#/c/695234/4/config/general_config/featureset050.yml | 09:38 |
| ccamacho | yeahp | 09:39 |
| ccamacho | there must be some issues there | 09:39 |
| ccamacho | in fs50 | 09:39 |
| bogdando | ccamacho: fs50 == tripleo-ci-centos-7-containerized-undercloud-upgrades ? | 09:39 |
| ccamacho | yeahp yehap | 09:39 |
| bogdando | is it yet deploys the source UC as non containerized? | 09:39 |
| ccamacho | it was | 09:40 |
| bogdando | that's rather Q->U upgrade then :D | 09:40 |
| ccamacho | so I think that when running the upgrade in the UC it explodes | 09:40 |
| ccamacho | yeah Q--> Hell xD | 09:40 |
| bogdando | yeah into a thousand of peaces | 09:40 |
| bogdando | the Road to Hell | 09:41 |
| bogdando | R->H | 09:41 |
| bogdando | ok, let's see if repro deploys for me | 09:41 |
| bogdando | Tengu: we have UC containerized from Rocky, right? | 09:42 |
| *** saneax has quit IRC | 09:44 | |
| bogdando | ccamacho: but https://7a89c7d607922873abcd-a2a9d29289e3c443a1047aebafc6ba1b.ssl.cf2.rackcdn.com/695303/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f0291ef/logs/undercloud/home/zuul/install-undercloud.log.txt.gz installs UC (T) and looks like already containerized | 09:44 |
| *** saneax has joined #tripleo | 09:44 | |
| bogdando | then it tries to upgrade it to also containerized U | 09:44 |
| bogdando | so I still can't get the meaning of 695234/ | 09:44 |
| ccamacho | bogdando yeah there is a glitch somewhere, the thing is that containerized_undercloud should be true so maybe the variable is used in other place making the job to fail | 09:46 |
| ccamacho | thats what I will like to test | 09:46 |
| bogdando | oh. got it! | 09:46 |
| *** derekh has joined #tripleo | 09:53 | |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Introduce molecule tests in the tripleo-upgrade role https://review.opendev.org/687215 | 09:56 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: [Core] Change the author mail. https://review.opendev.org/694221 | 09:56 |
| *** sshnaidm has quit IRC | 10:01 | |
| *** derekh has quit IRC | 10:04 | |
| *** sshnaidm has joined #tripleo | 10:05 | |
| Tengu | bogdando: hmmm I think so yeah | 10:07 |
| *** derekh has joined #tripleo | 10:09 | |
| *** dsneddon has joined #tripleo | 10:09 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Add Octavia driver agent service https://review.opendev.org/658118 | 10:16 |
| openstackgerrit | Karthik S proposed openstack/os-net-config stable/stein: Adding testcases for sriov_config https://review.opendev.org/695386 | 10:24 |
| openstackgerrit | Karthik S proposed openstack/os-net-config stable/rocky: Adding testcases for sriov_config https://review.opendev.org/695387 | 10:25 |
| openstackgerrit | Karthik S proposed openstack/os-net-config stable/queens: Adding testcases for sriov_config https://review.opendev.org/695388 | 10:25 |
| *** cfontain has joined #tripleo | 10:33 | |
| openstackgerrit | Flavio Fernandes proposed openstack/tripleo-heat-templates master: DNM: Adding OVN Probe Interval to metadata and dbs https://review.opendev.org/691276 | 10:38 |
| *** dtantsur|afk is now known as dtantsur | 10:49 | |
| dtantsur | sshnaidm: the job should create the default pool. I thought derekh was looking into it.. | 10:50 |
| derekh | dtantsur: sorry missing chat history here, what are we talking about ? | 10:51 |
| dtantsur | derekh: https://bugs.launchpad.net/tripleo/+bug/1844989 | 10:52 |
| openstack | Launchpad bug 1844989 in tripleo "Tempest tests fail on standalone ironic job scenario012" [High,Triaged] - Assigned to Dmitry Tantsur (divius) | 10:52 |
| sshnaidm | derekh, https://bugs.launchpad.net/tripleo/+bug/1844989 | 10:52 |
| derekh | brb, at dentest | 10:52 |
| *** derekh has quit IRC | 10:52 | |
| sshnaidm | dtantsur, I also wanted to ask you how we can test this module: https://review.opendev.org/#/c/694751/ I thought maybe we can use this standalone job for that..? | 10:54 |
| sshnaidm | dtantsur, I'd propose it to ansible community modules too, just need to be sure it's covered somewhere | 10:54 |
| sshnaidm | d0ugal, hi | 10:55 |
| sshnaidm | d0ugal, do you have time today for a sync? | 10:55 |
| d0ugal | sshnaidm: Hey | 10:55 |
| d0ugal | sshnaidm: yup, I was just going to take the dog for a walk and get a early lunch. In 1hr? | 10:56 |
| sshnaidm | d0ugal, sure, cool | 10:56 |
| dtantsur | sshnaidm: before proposing anything to ansible upstream, could you sync with mordred and me? there is a rework planned for openstack ansible modules. | 10:56 |
| sshnaidm | dtantsur, of course | 10:56 |
| sshnaidm | dtantsur, when can we sync? | 10:56 |
| dtantsur | sshnaidm: for testing it you can use any job that has an undercloud working. You don't need any overcloud. | 10:56 |
| d0ugal | dtantsur: I didn't know a rework was planned. Do you have a reference? I am curious to learn more :) | 10:57 |
| dtantsur | sshnaidm: if you catch Monty (who might me on kubecon), I'm more or less available | 10:57 |
| dtantsur | a reference, hmmmm... | 10:57 |
| d0ugal | No worries if now | 10:57 |
| d0ugal | not* | 10:58 |
| dtantsur | at the very least we should stop calling things with their nicknames | 10:58 |
| d0ugal | Agreed | 10:58 |
| d0ugal | That bugged me too | 10:58 |
| dtantsur | i.e. os_baremetal_<stuff> not os_ironic | 10:58 |
| sshnaidm | like in openstacksdk | 10:58 |
| dtantsur | yep | 10:58 |
| dtantsur | and closely based on openstacksdk | 10:58 |
| d0ugal | I'm told there was some logic around that naming, but I didn't fully understand it when cloudnull explained it :D | 10:58 |
| * d0ugal will bbiab | 10:59 | |
| dtantsur | I think most of services use logical names. ironic is sort of an outlier | 10:59 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: [WIP] Add new validation_json callback https://review.opendev.org/695211 | 11:00 |
| dtantsur | d0ugal, sshnaidm, https://review.opendev.org/#/c/684740/ | 11:00 |
| sshnaidm | dtantsur, aha! I knew collections is the way :D | 11:01 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: [Configuration] Remove the build documentation. https://review.opendev.org/694222 | 11:01 |
| dtantsur | this is why we really need to sync with Monty | 11:01 |
| dtantsur | and other SDK folks. and ansible SIG folks apparently. | 11:01 |
| *** hberaud is now known as hberaud|lunch | 11:02 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/694223 | 11:04 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: [Documentation] Migrate the format. https://review.opendev.org/694132 | 11:04 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Use public network for external interface https://review.opendev.org/694308 | 11:04 |
| paramite | Hey guys, can anybody please review https://review.opendev.org/#/c/694307 ? | 11:05 |
| *** dsneddon has quit IRC | 11:08 | |
| *** rpittau is now known as rpittau|bbl | 11:11 | |
| *** dpawlik has quit IRC | 11:13 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: [WIP] TripleO Validations Logging CLI https://review.opendev.org/695397 | 11:14 |
| *** udesale has quit IRC | 11:14 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Synchronize connection configuration for metrics https://review.opendev.org/694307 | 11:15 |
| *** rfolco has joined #tripleo | 11:18 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Disable overcloud image validation https://review.opendev.org/694133 | 11:18 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Get rid of docker removing in post_upgrade tasks. https://review.opendev.org/695200 | 11:18 |
| *** rfolco is now known as rfolco|doctor | 11:18 | |
| *** epoojad1 has joined #tripleo | 11:19 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: [WIP] TripleO Validations Logging CLI https://review.opendev.org/695397 | 11:23 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Derive Pci passthrough whitelist disable option https://review.opendev.org/695160 | 11:23 |
| *** epoojad1 is now known as epoojad1|afk | 11:27 | |
| *** apetrich has quit IRC | 11:29 | |
| *** epoojad1|afk has quit IRC | 11:31 | |
| *** morazi has quit IRC | 11:34 | |
| *** ramishra has quit IRC | 11:38 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Port fs027 job to os_tempest https://review.opendev.org/694719 | 11:41 |
| *** dsneddon has joined #tripleo | 11:43 | |
| *** jpich has quit IRC | 11:45 | |
| *** dsneddon has quit IRC | 11:48 | |
| *** florianf has quit IRC | 11:51 | |
| *** surpatil has quit IRC | 11:52 | |
| *** cfontain has quit IRC | 11:53 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Use public network for external interface https://review.opendev.org/694308 | 11:58 |
| *** apetrich has joined #tripleo | 11:59 | |
| sshnaidm | dtantsur, and back to testing question, I was thinking if it's possible to test with molecule and minimum resources. Do we need undercloud for getting info from baremetal nodes? Or maybe we can just install ironic and "fake" nodes? | 12:02 |
| dtantsur | sshnaidm: yes, you need any ironic and fake nodes\ | 12:02 |
| sshnaidm | dtantsur, any examples you can point me to? | 12:02 |
| dtantsur | sshnaidm: something like https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html#exercising-the-services-locally ? | 12:03 |
| sshnaidm | dtantsur, looks exactly what the doctor ordered.. | 12:08 |
| dtantsur | good :) | 12:08 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-docs master: Impovements to additional cellv2 documentation https://review.opendev.org/695412 | 12:09 |
| sshnaidm | dtantsur, seems like something to be wrapped in container and published somewhere in dockerhub | 12:09 |
| dtantsur | hmmm | 12:09 |
| dtantsur | I can imagine a Dockerfile for that. But note that this doc is targeting local development. Container will quickly make it harder. | 12:10 |
| dtantsur | I know that we have some vagrant support, although it's definitely heavier | 12:10 |
| sshnaidm | dtantsur, we can mount installed repo to source code on host and restart container after a change | 12:11 |
| dtantsur | sure, yeah. I'm just explaining why it's not done already | 12:12 |
| sshnaidm | dtantsur, just using pip -e | 12:12 |
| sshnaidm | dtantsur, will do this if there is time | 12:12 |
| dtantsur | ++ | 12:12 |
| sshnaidm | anyway need this for tests in CI | 12:12 |
| *** derekh has joined #tripleo | 12:12 | |
| *** hberaud|lunch is now known as hberaud | 12:13 | |
| derekh | dtantsur: sshnaidm sorry about that I was in the waiting room and dentest called me, looking now | 12:13 |
| dtantsur | sshnaidm: note that we don't need rabbitmq any more. I need to update the docs probably, we support JSON RPC now. | 12:13 |
| *** jpena is now known as jpena|lunch | 12:14 | |
| sshnaidm | dtantsur, so even easier, for local tests sqlite is ok, and no need mysql too | 12:15 |
| derekh | dtantsur: sshnaidm So last we spoke about it, I pointed out where the problem occurred but never said I'd fix it, is somebody working on a fix or want me to look into it? | 12:16 |
| sshnaidm | derekh, I don't think anybody is working on it | 12:16 |
| derekh | sshnaidm: ok, I'll take a stab at it | 12:17 |
| sshnaidm | derekh, great, thanks! | 12:17 |
| dtantsur | oh, sorry, I guess I got confused | 12:21 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Port fs030 to os_tempest https://review.opendev.org/694720 | 12:22 |
| *** raildo has joined #tripleo | 12:26 | |
| *** ricolin has joined #tripleo | 12:27 | |
| *** bogdando has quit IRC | 12:31 | |
| *** morazi has joined #tripleo | 12:32 | |
| *** ysandeep has quit IRC | 12:33 | |
| *** ratailor has quit IRC | 12:36 | |
| d0ugal | sshnaidm: Hey, I have time now. | 12:39 |
| d0ugal | sshnaidm: almost 2 hours, so whenever suits you | 12:39 |
| *** slaweq has quit IRC | 12:39 | |
| d0ugal | almost 2 hours until my next meeting* | 12:40 |
| *** bfournie has quit IRC | 12:40 | |
| sshnaidm | d0ugal, great, https://meet.google.com/ssv-auqv-mbh | 12:42 |
| *** ansmith has quit IRC | 12:43 | |
| *** dpawlik has joined #tripleo | 12:48 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Add the containers prepare step for Undercloud upgrades. https://review.opendev.org/695419 | 12:52 |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-upgrade master: Stop configuring install_command in tox. https://review.opendev.org/694299 | 12:53 |
| *** bogdando has joined #tripleo | 12:54 | |
| *** dsneddon has joined #tripleo | 12:58 | |
| *** rlandy has joined #tripleo | 12:58 | |
| *** artom has joined #tripleo | 13:00 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-docs master: Impovements to additional cellv2 documentation https://review.opendev.org/695412 | 13:03 |
| *** dsneddon has quit IRC | 13:03 | |
| *** dsneddon has joined #tripleo | 13:06 | |
| *** dsneddon has quit IRC | 13:11 | |
| *** bhagyashris has quit IRC | 13:12 | |
| *** rpittau|bbl is now known as rpittau | 13:12 | |
| *** florianf has joined #tripleo | 13:12 | |
| *** slaweq has joined #tripleo | 13:17 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/train: Check if snmpd is enabled for upgrade_tasks https://review.opendev.org/695242 | 13:18 |
| *** jpena|lunch is now known as jpena | 13:20 | |
| *** rfolco|doctor is now known as rfolco | 13:23 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: Workarounds: remove --reverse from patch options https://review.opendev.org/694413 | 13:31 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: ceph_osds is list so we don't need to itemize it https://review.opendev.org/694422 | 13:31 |
| *** yolanda has quit IRC | 13:33 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/train: ceph_osds is list so we don't need to itemize it https://review.opendev.org/694421 | 13:34 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/train: Workarounds: remove --reverse from patch options https://review.opendev.org/694414 | 13:34 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/stein: ceph_osds is list so we don't need to itemize it https://review.opendev.org/694423 | 13:34 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/stein: Workarounds: remove --reverse from patch options https://review.opendev.org/694416 | 13:34 |
| *** yolanda has joined #tripleo | 13:36 | |
| *** mmethot has quit IRC | 13:36 | |
| *** udesale has joined #tripleo | 13:37 | |
| *** ansmith has joined #tripleo | 13:39 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Create the default storage pool before calling create-node.sh https://review.opendev.org/695437 | 13:40 |
| *** mcornea has joined #tripleo | 13:40 | |
| *** dsneddon has joined #tripleo | 13:41 | |
| *** bfournie has joined #tripleo | 13:43 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/rocky: Bump cirros version to 0.4.0 https://review.opendev.org/692086 | 13:46 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/rocky: ceph_osds is list so we don't need to itemize it https://review.opendev.org/694424 | 13:46 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/rocky: Sync up upgrades and updates workarounds mechanism. https://review.opendev.org/694134 | 13:46 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/rocky: Workarounds: remove --reverse from patch options https://review.opendev.org/694417 | 13:46 |
| sshnaidm | cloudnull, hi, fyi if you didn't see before: https://review.opendev.org/#/c/684740/1 | 13:47 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/train: Check if snmpd is enabled for upgrade_tasks https://review.opendev.org/695242 | 13:53 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Port fs027 job to os_tempest https://review.opendev.org/694719 | 13:54 |
| *** morazi has quit IRC | 13:57 | |
| d0ugal | sshnaidm: the GPL striles again | 13:57 |
| sshnaidm | d0ugal, where? | 13:57 |
| d0ugal | sshnaidm: Just reading the review you linked ^ | 13:58 |
| sshnaidm | d0ugal, oh, yeah.. I didn't fully get this point with SIGs | 13:58 |
| d0ugal | It is blocked because the code is GPLv3 | 13:58 |
| d0ugal | sshnaidmYeah, I am now reading that bit. I don't understand the SIG either | 13:58 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Get rid of custom "ini" plugin https://review.opendev.org/695441 | 14:06 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/tripleo-heat-templates master: Adding ReaR THT https://review.opendev.org/690074 | 14:08 |
| *** Goneri has quit IRC | 14:09 | |
| *** ekultails has joined #tripleo | 14:10 | |
| *** ramishra has joined #tripleo | 14:13 | |
| *** dpawlik has quit IRC | 14:15 | |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Get rid of custom "ini" plugin https://review.opendev.org/695441 | 14:15 |
| gchamoul | Tengu: I am ok with the builtin ini migration, but ceilometerdb-size is deprecated since Train and should be deleted in Master. I don't think implementing molecule test for that validation is a good idea, WDYT? | 14:22 |
| Tengu | gchamoul: well, in my case it allows to ensure a non-regression, and also a first attempt to move to the lookup | 14:22 |
| Tengu | gchamoul: apparently either I have some weird things with my local molecule, or there's something fishy with that "ini" lookup. I've started with that validation since it was the first one. | 14:23 |
| gchamoul | Tengu: ok, what will you do with the default value feature you've added in our custom ini? | 14:25 |
| Tengu | gchamoul: *apparently* there's a "default" we can pass to that lookup. | 14:25 |
| Tengu | if it works. | 14:25 |
| gchamoul | cool then | 14:25 |
| Tengu | still having some hard time with that thing - to be fair, it doesn't sound like something really usable. | 14:26 |
| Tengu | and the way it tries to be smart at finding file is a bit...... annoying. | 14:26 |
| Tengu | should detect if we pass an absolute path or not. I have a patch for that, just trying to figure out how to test it locally though... ansible dev env isn't really nice. | 14:27 |
| mwhahaha | ccamacho: sup? | 14:28 |
| *** epoojad1 has joined #tripleo | 14:29 | |
| *** tosky_ has joined #tripleo | 14:31 | |
| *** tosky has quit IRC | 14:32 | |
| *** jtomasek has quit IRC | 14:32 | |
| *** tosky_ is now known as tosky | 14:33 | |
| *** sri_ has quit IRC | 14:34 | |
| *** hberaud has quit IRC | 14:34 | |
| *** jtomasek has joined #tripleo | 14:35 | |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Get rid of custom "ini" plugin https://review.opendev.org/695441 | 14:41 |
| *** hberaud has joined #tripleo | 14:42 | |
| *** mmethot has joined #tripleo | 14:43 | |
| *** soniya29 has quit IRC | 14:43 | |
| cloudnull | mornings | 14:47 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Check if snmpd is enabled for upgrade_tasks https://review.opendev.org/695242 | 14:48 |
| *** morazi has joined #tripleo | 14:50 | |
| cloudnull | sshnaidm good looking out. I had not seen that. but im reading it now | 14:50 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Add the containers prepare step for Undercloud upgrades. https://review.opendev.org/695419 | 14:50 |
| *** tosky has quit IRC | 14:54 | |
| *** tosky has joined #tripleo | 14:57 | |
| *** TrevorV has joined #tripleo | 15:00 | |
| *** pcaruana has quit IRC | 15:02 | |
| *** dsneddon has quit IRC | 15:03 | |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Pin ceph dashboard containers on a specific tag https://review.opendev.org/695372 | 15:04 |
| *** amoralej is now known as amoralej|off | 15:08 | |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-common master: Use spawn method for multiprocessing https://review.opendev.org/694773 | 15:17 |
| *** dsneddon has joined #tripleo | 15:18 | |
| *** pcaruana has joined #tripleo | 15:20 | |
| *** dsneddon has quit IRC | 15:24 | |
| *** leanderthal has joined #tripleo | 15:31 | |
| *** jtomasek has quit IRC | 15:38 | |
| mwhahaha | ssbarnea: do you have access to the rhos-infra github namespace? | 15:39 |
| *** jpena is now known as jpena|off | 15:41 | |
| sshnaidm | mwhahaha, he's in pto this week | 15:47 |
| mwhahaha | slacker | 15:48 |
| mwhahaha | k i'll poke someone else | 15:48 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add new workflow playbook for enable-ssh-admin https://review.opendev.org/695015 | 15:49 |
| *** dsneddon has joined #tripleo | 15:52 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Disable legacy telemetry by default https://review.opendev.org/695302 | 15:52 |
| *** bogdando has quit IRC | 15:53 | |
| ssbarnea | yes | 15:54 |
| ssbarnea | what do you need? | 15:55 |
| *** dsneddon has quit IRC | 15:56 | |
| *** dsneddon has joined #tripleo | 15:57 | |
| *** dsneddon has quit IRC | 16:01 | |
| *** derekh has quit IRC | 16:03 | |
| *** udesale has quit IRC | 16:04 | |
| *** epoojad1 has quit IRC | 16:05 | |
| mwhahaha | ssbarnea: we can chat next week, i got unblocked for now. gerrithub -> github sync seems broken for rhos-infra/tripleo-config-changes, but i got access so i was able to manually sync | 16:05 |
| weshay | mwhahaha, that repo needs a new admin.. | 16:06 |
| mwhahaha | a novel concept | 16:07 |
| *** chkumar|rover is now known as raukadah | 16:08 | |
| *** leanderthal has quit IRC | 16:10 | |
| openstackgerrit | Martin Schuppert proposed openstack/python-tripleoclient master: For cell export add filter parameters to GlobalConfigExtraMapData https://review.opendev.org/695464 | 16:15 |
| *** bhagyashris has joined #tripleo | 16:22 | |
| *** lmiccini has quit IRC | 16:27 | |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-ansible master: [WIP] Add service management support. https://review.opendev.org/681017 | 16:31 |
| *** jaosorior has joined #tripleo | 16:33 | |
| *** dsneddon has joined #tripleo | 16:36 | |
| *** marios|ruck is now known as marios|ruck|out | 16:38 | |
| *** jaosorior has quit IRC | 16:38 | |
| *** jaosorior has joined #tripleo | 16:39 | |
| *** ricolin has quit IRC | 16:39 | |
| *** skramaja has quit IRC | 16:39 | |
| *** florianf has quit IRC | 16:41 | |
| *** dsneddon has quit IRC | 16:44 | |
| *** nighter has left #tripleo | 16:47 | |
| *** marios|ruck|out has quit IRC | 16:52 | |
| openstackgerrit | Merged openstack/tripleo-ci master: Added /etc/rear directory to be collected https://review.opendev.org/695000 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Address ansible-lint issues https://review.opendev.org/694143 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Switch to more specific include statements. https://review.opendev.org/694144 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Adjust roles_data also for updates. https://review.opendev.org/694146 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: HTTP test during update/upgrade/ffwd. https://review.opendev.org/694147 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for upgrades. https://review.opendev.org/694148 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for updates. https://review.opendev.org/694149 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Switch to more specific include modules for ffwd. https://review.opendev.org/694150 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: [FFWD] Align workarounds templating with upgrades. https://review.opendev.org/694151 | 16:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Migrate from with_X loop. https://review.opendev.org/694152 | 16:52 |
| *** morazi has quit IRC | 16:54 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ansible master: update bindep, remove older fedora support https://review.opendev.org/695528 | 16:56 |
| *** jaosorior has quit IRC | 17:00 | |
| *** bhagyashris has quit IRC | 17:01 | |
| *** mcornea has quit IRC | 17:05 | |
| *** tmazur has quit IRC | 17:05 | |
| *** rpittau is now known as rpittau|afk | 17:06 | |
| *** morazi has joined #tripleo | 17:08 | |
| *** dtantsur is now known as dtantsur|afk | 17:10 | |
| *** dsneddon has joined #tripleo | 17:10 | |
| *** lucasagomes has quit IRC | 17:12 | |
| *** yprokule has quit IRC | 17:19 | |
| *** mcornea has joined #tripleo | 17:21 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia driver agent service https://review.opendev.org/658118 | 17:25 |
| *** jpena|off is now known as jpena | 17:27 | |
| *** epoojad1 has joined #tripleo | 17:31 | |
| *** stee has quit IRC | 17:32 | |
| *** alexmcleod has quit IRC | 17:33 | |
| *** chem is now known as chem|eod | 17:46 | |
| *** pcaruana has quit IRC | 17:51 | |
| *** aedc has joined #tripleo | 18:02 | |
| *** hberaud is now known as hberaud|lunch | 18:03 | |
| *** epoojad1 has quit IRC | 18:05 | |
| *** weshay is now known as weshay|ruck | 18:08 | |
| *** pcaruana has joined #tripleo | 18:14 | |
| *** social has quit IRC | 18:15 | |
| *** iurygregory is now known as iurygregory_afk | 18:19 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: OpenStack Node Provide playbook https://review.opendev.org/692189 | 18:26 |
| *** iurygregory_afk has quit IRC | 18:28 | |
| *** tosky has quit IRC | 18:29 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Introspection Playbook https://review.opendev.org/689194 | 18:32 |
| cloudnull | sshnaidm d0ugal ^ there is a baremetal introspection module in that review, and I know sshnaidm was working on the ironic introspection module (or something similar) can we merge those two module efforts ? | 18:35 |
| cloudnull | are we solving different purposes with the modules ? | 18:35 |
| d0ugal | cloudnull: The primary purpose of mine is the introspect 20 nodes at a time | 18:35 |
| d0ugal | 20 is a example, it is configurable | 18:36 |
| d0ugal | so that code is really just to handle/limit concurrency | 18:36 |
| sshnaidm | cloudnull, module I wrote is about getting list of ironic nodes, like "baremetal node list" with filters | 18:36 |
| cloudnull | re: https://review.opendev.org/#/c/694751/2/tripleo_ansible/ansible_plugins/modules/os_ironic_info.py | 18:36 |
| cloudnull | ah I see | 18:36 |
| cloudnull | my bad. I was confused. | 18:36 |
| sshnaidm | cloudnull, it should be used in this playbook instead of calling openstack commands | 18:37 |
| sshnaidm | that was an idea | 18:37 |
| d0ugal | cloudnull: however, it was on my list to update it to use openstacksdk | 18:37 |
| cloudnull | ++ | 18:37 |
| openstackgerrit | Luke Short proposed openstack/python-tripleoclient master: WIP: Do not use Mistral when creating the overcloudrc and clouds.yaml files. https://review.opendev.org/694138 | 18:37 |
| cloudnull | d0ugal do you have some time to work on that? | 18:37 |
| sshnaidm | d0ugal, or maybe tweak existing ironic_introspection modules to support concurrency? | 18:37 |
| d0ugal | cloudnull: Hopefully soon, but if you are keen to do it go for it :) | 18:38 |
| cloudnull | sshnaidm agree - once that module is merged it'd be good to convert those tasks | 18:38 |
| d0ugal | sshnaidm: I don't know how it can be "tweaked" but sure if that is a normal ansible thing to do | 18:38 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Ignore blacklisted nodes when rendering network config https://review.opendev.org/695348 | 18:38 |
| sshnaidm | d0ugal, oh, well, there are licenses issues also, it's all gpl iirc.. | 18:39 |
| sshnaidm | cloudnull, we can't just copy module from ansible to our repo, right? | 18:40 |
| d0ugal | sshnaidm: nope :) | 18:40 |
| cloudnull | no | 18:40 |
| sshnaidm | but we can use module libraries | 18:41 |
| sshnaidm | to import them I mean | 18:41 |
| sshnaidm | like here: from ansible.module_utils.openstack import openstack_cloud_from_module https://review.opendev.org/#/c/694751/2/tripleo_ansible/ansible_plugins/modules/os_ironic_info.py | 18:42 |
| *** saneax has quit IRC | 18:42 | |
| *** pcaruana has quit IRC | 18:42 | |
| cloudnull | yes we can do that, which is confirmed by ansible itself | 18:43 |
| cloudnull | https://docs.ansible.com/ansible/latest/dev_guide/developing_module_utilities.html | 18:43 |
| cloudnull | which will work very well for the openstack modules | 18:43 |
| *** gfidente has quit IRC | 18:44 | |
| sshnaidm | great | 18:45 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia driver agent service https://review.opendev.org/658118 | 18:48 |
| sshnaidm | cloudnull, d0ugal I think I found a way to test all baremetal stuff with molecule | 18:53 |
| cloudnull | ORLY? | 18:53 |
| sshnaidm | we'll create a container with standalone ironic and test with it | 18:53 |
| sshnaidm | just did it and it works :o | 18:53 |
| cloudnull | that could be huge | 18:53 |
| d0ugal | sshnaidm, cloudnull: I think ekultails was looking into a way to test ironic etc with molecule | 18:54 |
| d0ugal | Anyway, I am not really here. cya tomorrow :) | 18:54 |
| sshnaidm | ekultails, did you? ^^ | 18:55 |
| sshnaidm | d0ugal, see ya | 18:55 |
| cloudnull | ++ inquiring minds want to know :D | 18:55 |
| *** pcaruana has joined #tripleo | 19:06 | |
| ekultails | Ironic testing via Molecule? No I don't have a solution for that specifically. I did try out a proof-of-concept of just overriding Ansible modules with dummy modules that just returns some results. | 19:06 |
| ekultails | So you could, in theory, have a dummy module for os_ironic. | 19:07 |
| ekultails | I've been meaning to write up a blog about that. | 19:07 |
| *** morazi has quit IRC | 19:10 | |
| ekultails | Here's an example of me faking the results of the SELinux module based on what parameters are passed to it: http://paste.openstack.org/show/786506/ | 19:10 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/train: Add configurable monitor timeouts for ovn dbs https://review.opendev.org/692114 | 19:10 |
| openstackgerrit | Andrew Austin proposed openstack/tripleo-heat-templates stable/stein: [Stein Only] Fix bad configuration path in nova-placement wait https://review.opendev.org/695555 | 19:10 |
| ekultails | Just add that to selinux.py and set the ANSIBLE_LIBRARY path to point to where that module is. | 19:11 |
| ekultails | sshnaidm: Sounds like what you're working on is the better direction for truly testing Ironic management. +1 | 19:13 |
| sshnaidm | ekultails, yeah, I'd like to use live ironic in case they change or break something | 19:14 |
| sshnaidm | so we'll see it | 19:14 |
| sshnaidm | ekultails, but please provide link to your blog when you write it :) | 19:14 |
| ekultails | Totally agree and I will definitely share that out once it's made. :-) | 19:17 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add configurable monitor timeouts for ovn dbs https://review.opendev.org/692127 | 19:17 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: Add configurable monitor timeouts for ovn dbs https://review.opendev.org/692130 | 19:17 |
| *** jpena is now known as jpena|off | 19:36 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Add configurable monitor timeouts for ovn dbs https://review.opendev.org/692133 | 19:37 |
| *** abishop has quit IRC | 19:50 | |
| *** abishop has joined #tripleo | 19:50 | |
| *** openstackstatus has quit IRC | 19:50 | |
| *** Trevor_V has joined #tripleo | 19:50 | |
| *** TrevorV has quit IRC | 19:50 | |
| *** openstackstatus has joined #tripleo | 19:52 | |
| *** ChanServ sets mode: +v openstackstatus | 19:52 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ci master: Add stein to oooq_common_functions.sh.j2 https://review.opendev.org/695562 | 20:01 |
| openstackgerrit | Merged openstack/ansible-role-collect-logs master: add molecule tox jobs for sova, collect https://review.opendev.org/694633 | 20:04 |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-ansible master: [WIP] Add service management support. https://review.opendev.org/681017 | 20:08 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/train: Check if snmpd is enabled for upgrade_tasks https://review.opendev.org/695242 | 20:12 |
| *** jfrancoa has quit IRC | 20:14 | |
| *** cfontain has joined #tripleo | 20:16 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ansible master: Add os_ironic_info module for retrieving nodes info https://review.opendev.org/694751 | 20:19 |
| *** ianw has quit IRC | 20:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ansible master: Add os_baremetal_node_info module for retrieving nodes info https://review.opendev.org/694751 | 20:21 |
| sshnaidm | cloudnull, renamed it to match openstacksdk ^ | 20:22 |
| cloudnull | nice ! | 20:22 |
| cloudnull | sshnaidm do you have some time to take a look at https://review.opendev.org/#/c/689194/17/tripleo_ansible/ansible_plugins/modules/baremetal_introspection.py ? | 20:24 |
| cloudnull | it'd be nice if we can tune that up to use the openstack module_utils | 20:24 |
| cloudnull | like you did for that node info module | 20:24 |
| sshnaidm | cloudnull, yep, will look | 20:24 |
| cloudnull | tyvm | 20:25 |
| openstackgerrit | Flavio Fernandes proposed openstack/puppet-tripleo master: Add the ability to configure ovn-remote-probe-interval https://review.opendev.org/695569 | 20:25 |
| *** ssbarnea has quit IRC | 20:26 | |
| *** ianw has joined #tripleo | 20:27 | |
| *** jfrancoa has joined #tripleo | 20:30 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Introspection Playbook https://review.opendev.org/689194 | 20:31 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Configure Playbook https://review.opendev.org/691667 | 20:37 |
| *** cfontain has quit IRC | 20:39 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Configure Playbook https://review.opendev.org/691667 | 20:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Introspection Playbook https://review.opendev.org/689194 | 20:44 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Rrename workflow file https://review.opendev.org/695574 | 20:46 |
| *** rfolco has quit IRC | 20:50 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-validations master: Introduce Ceph placement group validation https://review.opendev.org/694673 | 20:54 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add ironic-python-agent-builder to the dib elements path https://review.opendev.org/695575 | 21:03 |
| openstackgerrit | Tristan Cacqueray proposed openstack/tripleo-ci master: Ensure /etc/nodepool exists https://review.opendev.org/695576 | 21:03 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Switch HA containers to k8s-file log-driver and make it a parameter https://review.opendev.org/695578 | 21:03 |
| *** openstack has joined #tripleo | 21:15 | |
| *** ChanServ sets mode: +o openstack | 21:15 | |
| *** khyr0n has joined #tripleo | 21:16 | |
| *** pkopec has quit IRC | 21:21 | |
| *** sshnaidm has quit IRC | 21:21 | |
| *** pcaruana has quit IRC | 21:25 | |
| *** ansmith has quit IRC | 21:39 | |
| *** ekultails has quit IRC | 21:41 | |
| *** ekultails has joined #tripleo | 21:42 | |
| *** ayoung has quit IRC | 21:47 | |
| *** ayoung has joined #tripleo | 21:49 | |
| *** holser has joined #tripleo | 21:55 | |
| *** ramishra has quit IRC | 21:57 | |
| *** chem|eod has quit IRC | 22:03 | |
| *** mcornea has quit IRC | 22:04 | |
| *** rcernin has joined #tripleo | 22:09 | |
| *** sshnaidm has joined #tripleo | 22:17 | |
| *** ansmith has joined #tripleo | 22:17 | |
| weshay|ruck | mwhahaha, you still around? | 22:19 |
| mwhahaha | weshay|ruck: are you threatening me? | 22:19 |
| *** jfrancoa has quit IRC | 22:20 | |
| *** holser has quit IRC | 22:26 | |
| weshay|ruck | mwhahaha, if I were threatening you I'd be at your doorstep! | 22:26 |
| mwhahaha | pffft | 22:26 |
| weshay|ruck | lolz | 22:26 |
| mwhahaha | https://i.imgur.com/JpRbHIZ.gif | 22:27 |
| * weshay|ruck going on the field trip w/ my boy to teach him how to ring and run | 22:27 | |
| *** bfournie has quit IRC | 22:27 | |
| weshay|ruck | jrist, come along.. :) | 22:27 |
| *** raildo has quit IRC | 22:27 | |
| mwhahaha | yay for smart doorbells | 22:27 |
| *** ccamacho has quit IRC | 22:29 | |
| *** tosky has joined #tripleo | 22:35 | |
| *** holser has joined #tripleo | 22:37 | |
| *** lennyb has joined #tripleo | 22:41 | |
| *** holser has quit IRC | 22:48 | |
| jrist | "ring and run" | 23:03 |
| jrist | that's a new thing, right? | 23:03 |
| *** xek_ has quit IRC | 23:05 | |
| *** holser has joined #tripleo | 23:14 | |
| *** slaweq has quit IRC | 23:17 | |
| *** bfournie has joined #tripleo | 23:36 | |
| tonyb | newbie question ... I have a standalone tripleo install ... If I want to add additional services I can just add the appropriate environment files to the deploy line right (implying I'd destroy the system and start from a clean slate) | 23:41 |
| *** holser has quit IRC | 23:41 | |
| mwhahaha | tonyb: yes. you don't have to clean it if you are adding to the existing ones | 23:50 |
| tonyb | mwhahaha: | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
