Monday, 2020-02-03

openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config"  https://review.opendev.org/70231500:36
*** holser has quit IRC00:56
*** holser has joined #tripleo01:06
*** jmasud has joined #tripleo01:14
*** holser has quit IRC01:29
*** dpeacock has quit IRC01:41
*** jmasud has quit IRC01:45
*** jmasud has joined #tripleo01:46
*** dpeacock has joined #tripleo01:51
*** jmasud has quit IRC01:58
*** jmasud has joined #tripleo02:00
*** ramishra has joined #tripleo02:05
*** jmasud has quit IRC02:21
*** jmasud has joined #tripleo02:23
*** rcernin has joined #tripleo02:27
*** jdandrea has quit IRC02:40
*** mschuppert has quit IRC02:47
*** jmasud has quit IRC03:06
*** rcernin has quit IRC03:31
*** morazi has quit IRC03:52
*** ykarel|away is now known as ykarel04:07
*** psachin has joined #tripleo04:30
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Handle package builds when testing in rdoinfo  https://review.opendev.org/64941804:55
*** raukadah is now known as chkumar|rover04:55
*** jmasud has joined #tripleo05:18
*** evrardjp has quit IRC05:33
*** evrardjp has joined #tripleo05:34
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Run RDO jobs with baremetal provisioning  https://review.opendev.org/68057105:42
*** soniya29 has joined #tripleo05:45
openstackgerrityatin proposed openstack/ansible-role-collect-logs master: Rename .gz files in logs helper  https://review.opendev.org/70537805:48
*** skramaja has joined #tripleo05:49
*** udesale has joined #tripleo05:49
*** abdysn has joined #tripleo05:56
openstackgerrityatin proposed openstack/tripleo-ci master: Fix some logs path  https://review.opendev.org/70537906:01
*** sanjayu_ has joined #tripleo06:12
*** marios has joined #tripleo06:14
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Enable configuration of notifier publishers  https://review.opendev.org/70500606:16
*** ratailor has joined #tripleo06:17
*** bandini has joined #tripleo06:21
*** sanjayu__ has joined #tripleo06:22
*** sanjayu_ has quit IRC06:25
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Parse healthchecks.log instead fetching systemd data  https://review.opendev.org/70408006:33
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Enable sudo rule creation  https://review.opendev.org/70229606:36
*** lmiccini has joined #tripleo06:48
*** jfrancoa has joined #tripleo06:52
*** sanjayu__ has quit IRC06:56
*** saneax has joined #tripleo06:58
*** dpawlik has joined #tripleo07:12
*** dpawlik has quit IRC07:13
*** dpawlik has joined #tripleo07:14
*** numans has joined #tripleo07:20
*** dtantsur|afk is now known as dtantsur07:20
*** yprokule has joined #tripleo07:26
*** tkajinam has quit IRC07:36
*** tkajinam has joined #tripleo07:38
*** slaweq has joined #tripleo07:38
*** jbadiapa has joined #tripleo07:39
*** pcaruana has joined #tripleo07:43
*** iurygregory has joined #tripleo07:51
*** ykarel is now known as ykarel|lunch07:51
*** gfidente has joined #tripleo07:52
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Fix params in pcmk remote  https://review.opendev.org/70539107:52
*** mschuppert has joined #tripleo08:00
*** kopecmartin has joined #tripleo08:00
*** tkajinam_ has joined #tripleo08:01
*** tkajinam has quit IRC08:04
*** rpittau|afk is now known as rpittau08:05
*** jmasud has quit IRC08:13
*** jmasud has joined #tripleo08:14
*** tesseract has joined #tripleo08:14
*** apetrich has joined #tripleo08:16
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/queens: Enable Ceph RGW 'account in url' option  https://review.opendev.org/69605908:26
gfidentejistr ^^ thanks for the review :D08:29
*** tosky has joined #tripleo08:29
*** tmazur has joined #tripleo08:32
mschuppertchkumar|rover: hi! could we merge https://review.opendev.org/691685 and https://review.opendev.org/691688 ?08:34
*** tkajinam_ has quit IRC08:38
chkumar|rovermschuppert, will merge it, waiting for check-rdo jobs08:40
mschuppertchkumar|rover: ok, thank you!08:40
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-heat-templates stable/stein: [DNM] stein ostempest test  https://review.opendev.org/70539308:46
*** hberaud has joined #tripleo08:52
*** lucasagomes has joined #tripleo08:55
*** yolanda has joined #tripleo09:03
*** pbandark has joined #tripleo09:06
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Revert "update master skip list, nova issues and timeout"  https://review.opendev.org/70496209:07
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: DNM - Testing fs020 tempest  https://review.opendev.org/70494809:09
*** jpich has joined #tripleo09:10
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Revert "update master skip list, nova issues and timeout"  https://review.opendev.org/70496209:17
*** paramite has joined #tripleo09:17
*** suuuper has joined #tripleo09:19
*** d0ugal has quit IRC09:29
*** ykarel|lunch is now known as ykarel09:29
*** xek has joined #tripleo09:30
*** sshnaidm|off is now known as sshnaidm09:30
*** d0ugal has joined #tripleo09:31
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Swap tasks to avoid non-existing variable error.  https://review.opendev.org/70539709:33
*** pkopec has joined #tripleo09:35
*** derekh has joined #tripleo09:39
*** pbandark has quit IRC09:40
*** hberaud has quit IRC09:41
openstackgerritSorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct)  https://review.opendev.org/70495209:41
*** hberaud has joined #tripleo09:42
*** bogdando has joined #tripleo09:43
openstackgerritSorin Sbarnea proposed openstack/tripleo-ci master: Add warning about avoiding artl_gzip option  https://review.opendev.org/70495209:43
*** Tengu has quit IRC09:46
*** hjensas has joined #tripleo09:47
*** Tengu has joined #tripleo09:48
*** alexmcleod has joined #tripleo09:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Remove stray conditional from aodh-evaluator tasks  https://review.opendev.org/70540509:54
*** Tengu has quit IRC09:54
*** Tengu has joined #tripleo09:55
*** lucasagomes_ has joined #tripleo09:55
*** lucasagomes has quit IRC09:55
*** lucasagomes_ is now known as lucasagomes09:56
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Fix typoe in remote pcsd_bind_addr  https://review.opendev.org/70540609:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Update ffwd-upgrade branch names  https://review.opendev.org/70540709:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Fix undefined variable in cinder_backup service.  https://review.opendev.org/70540909:59
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: DNM: test logs  https://review.opendev.org/70541010:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Fix undefined variable in cinder_backup service.  https://review.opendev.org/70540910:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-common stable/train: Tune ansible configuration for better performance  https://review.opendev.org/70541110:01
*** jaosorior has joined #tripleo10:01
*** Tengu has quit IRC10:03
*** skramaja has quit IRC10:03
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Fix typo in remote pcsd_bind_addr  https://review.opendev.org/70540610:03
*** Tengu has joined #tripleo10:03
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Fix params in pcmk remote  https://review.opendev.org/70539110:03
*** holser has joined #tripleo10:07
*** Tengu has quit IRC10:08
*** Tengu has joined #tripleo10:13
*** Tengu_ has joined #tripleo10:14
*** Tengu_ has quit IRC10:15
*** lucasagomes has quit IRC10:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: zuul: all functional jobs now depend on linter job first  https://review.opendev.org/69336010:30
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: Make collect package list distro-aware  https://review.opendev.org/70517510:35
odyssey4mechkumar|rover: hmm, is this a known things? I see plenty of errors in https://9cec50bd524f94a2df4c-c6273b9a7cf594e426666eb2c4e7f818.ssl.cf5.rackcdn.com/704675/3/check/openstack-tox-py36/6fc484f/job-output.txt but they did not cause failures, and perhaps they should10:36
chkumar|roverodyssey4me, nope10:37
chkumar|roverodyssey4me, adding to my list10:37
odyssey4methere are loads of warnings there too10:38
*** hberaud is now known as hberaud|lunch10:39
owalshchkumar|rover, odyssey4me: aren't they mocked errors?10:39
openstackgerritMerged openstack/tripleo-quickstart master: Remove hardcoding of python interpreter for rhel8  https://review.opendev.org/70507010:39
*** lucasagomes has joined #tripleo10:41
odyssey4meowalsh: maybe10:41
odyssey4meI was looking into why https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/tests/utils/test_config.py#L167 isn't failing tests and saw a bunch of failures in something that merged, so I thought it better to just highlight it10:41
owalshodyssey4me: e.g the first ERROR is https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/tests/actions/test_baremetal.py#L40010:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: Deduplicate ffu release lists  https://review.opendev.org/70436710:44
owalshodyssey4me: why so you expect https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/tests/utils/test_config.py#L167 to file?10:46
owalshfail10:46
odyssey4meowalsh oh yes I see - ok never mind then about all those errors chkumar|rover10:46
odyssey4meowalsh: because that constant doesn't exist10:46
*** jbadiapa has quit IRC10:49
owalshodyssey4me: index looks wrong here - https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/tests/utils/test_config.py#L13210:51
abdysnxek: hi, i think i found the IPA configuration that is responsible for the validity interval10:51
abdysnand its default is 120 second10:52
owalshodyssey4me: outputs[1] is this I think - https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/tests/fake_config/fakes.py#L3410:52
abdysnso the overlap time should be two minutes10:52
abdysnright now i am testing the configuration10:53
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart master: Split fs20 periodic tempest - api* in fs1 scenario* in fs20  https://review.opendev.org/70101610:53
abdysnbut i gauss the way the CRL is checked should be changed altogether, or what do you think xek?10:54
odyssey4meowalsh: right, where I'm seeing this fail is in stable/stein, and comparing that to https://opendev.org/openstack/tripleo-common/src/branch/stable/stein/tripleo_common/tests/fake_config/fakes.py#L34 shows what may be the cause is that the new value was inserted, but the test wasn't updated to cater for the change in index10:54
xekabdysn, I think so, someone made me realize, that the ipa server might be used for other things, not just for tripleo10:55
abdysnhere is the conf auths.revocationChecking.validityInterval10:55
xekabdysn, this might be a company server, which might be hard to reconfigure10:55
abdysnexactly10:55
owalshodyssey4me: yup, https://review.opendev.org/66370610:59
*** holser has quit IRC11:00
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: Moves container log collection to standalone script  https://review.opendev.org/70541511:00
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support.  https://review.opendev.org/68101711:04
odyssey4meowalsh: I'm thinking that it may be better in the long term to change these tests to use something like jmespath to get the right data by name rather than directly use an index number11:05
owalshodyssey4me: +111:05
odyssey4meowalsh: lemme work out a patch and push it up11:06
odyssey4meowalsh: thanks for helping hunt it down :)11:06
owalshodyssey4me: even just add a function in the fakes module to return the list of roles11:06
odyssey4meowalsh: yeah, good idea!11:06
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Migrate the openstack overcloud delete command to use Ansible  https://review.opendev.org/68753111:15
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Remove Mistral from plan list and call the Mistral action directly  https://review.opendev.org/70525411:21
d0ugalapetrich: ^ You might find that last change interesting.11:21
apetrichd0ugal, looking11:23
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support.  https://review.opendev.org/68101711:23
d0ugalapetrich: if you look at patchset 1 it shows you the elegance of the change more :-D11:26
d0ugalapetrich: there is lots of noise from test fixing and stuff11:26
d0ugalapetrich: https://review.opendev.org/#/c/705254/1/tripleoclient/v1/overcloud_plan.py11:26
d0ugalapetrich: cut out Mistral in a 2 line change :)11:27
apetrichsomehow I've seen that code before :)11:27
d0ugalreally?11:27
apetrichd0ugal, :)11:28
*** tkajinam has joined #tripleo11:28
* d0ugal looks puzzled11:28
apetrichI tried something similar. when I wanted to use the tripleocommon clients in a custom ansible module11:29
apetrichyours look better though11:29
d0ugalapetrich: it is pretty nasty still, but seems to work11:29
d0ugaljust ignore all the 'private' variables we access :)11:30
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove the plan_list workflow  https://review.opendev.org/70542211:31
apetrichit is not nearly as bad as some stuff that I tried11:31
sshnaidmmarios, take a look please, rebased: https://review.opendev.org/#/c/702844/11:32
sshnaidmmatbu, ^^11:32
d0ugalapetrich: it took 4 of us most of the friday pairing session to figure out11:32
d0ugalapetrich: where the 4th was a keystone expert!11:32
apetrichd0ugal, thanks. I was kicking myself for not figuring that out by myself11:32
abdysnso xek: regarding the patch, the error in feature39 is caused because the undercloud uses the domain names for endpoints, but does not have the IP of the overcloud recorded.11:40
*** raildo has joined #tripleo11:41
abdysni faced this same issue when i tried to deploy master the last time. i edited the etc/hosts of the master to add the overcloud domain name? what do you think is appropriate here xek?11:41
*** rpittau is now known as rpittau|bbl11:42
openstackgerritMerged openstack/tripleo-operator-ansible master: Add tripleo_overcloud_node_configure role  https://review.opendev.org/70431611:43
xekabdysn, I think these are normally added by overcloud-deploy-post.sh11:44
mariossshnaidm: ack11:45
openstackgerritMerged openstack/tripleo-operator-ansible master: Add tripleo_overcloud_node_clean role  https://review.opendev.org/70456211:48
*** mburned_out is now known as mburned11:50
*** holser has joined #tripleo11:54
sshnaidmykarel, the only related to logs I found in 29 is https://review.opendev.org/#/c/704604/11:57
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: Revert "Fix keepalived logging on disk"  https://review.opendev.org/70542711:57
sshnaidmykarel, just for check ^11:57
ykarelsshnaidm, ack but i see logs are there11:58
sshnaidmyeah11:58
ykareli see logs in 2 runs, so should not be related11:59
*** jbadiapa has joined #tripleo12:03
sshnaidmmaybe we added a new service on compute..12:04
*** hberaud|lunch is now known as hberaud12:07
openstackgerritMerged openstack/tripleo-heat-templates master: Don't use pacemaker in ironic sa job  https://review.opendev.org/68241012:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: Remove unnecessary block/whitespace from step1 tasks  https://review.opendev.org/70478512:14
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Updated/corrected service_status  https://review.opendev.org/70542912:20
*** rfolco has joined #tripleo12:24
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Better task name and loop control  https://review.opendev.org/70543212:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-common master: tests: Get RoleData correctly  https://review.opendev.org/70543312:28
odyssey4meowalsh: https://review.opendev.org/705433 works for me - I'd appreciate your review12:29
odyssey4meslagle: you may also be interested in https://review.opendev.org/70543312:29
owalshodyssey4me: ack12:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-common master: tests: Get RoleData correctly  https://review.opendev.org/70543312:31
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-quickstart-extras master: Remove validate-services checks  https://review.opendev.org/70543412:38
Tenguweshay: -^^ let's avoid duplication, questions and doubts with that one :).12:38
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support.  https://review.opendev.org/68101712:39
*** soniya29 has quit IRC12:41
slagleodyssey4me: i'll take a look12:41
chkumar|roverdalvarez, hello12:49
chkumar|roverdalvarez, regarding this bug https://bugs.launchpad.net/tempest/+bug/1728886 and I am seeing test_port_security_macspoofing_port got enabled in neutron side https://review.opendev.org/#/c/702250/ , what changes we need on tripleo side in order to enable it?12:50
openstackLaunchpad bug 1728886 in tripleo "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Critical,Triaged]12:50
*** ramishra has quit IRC12:51
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction  https://review.opendev.org/69539712:53
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: WIP Groups from groups.yaml file  https://review.opendev.org/70452112:53
openstackgerritMerged openstack/ansible-role-collect-logs master: Fix artcl_gzip variable in infrared plugin spec  https://review.opendev.org/70536412:53
*** morazi has joined #tripleo12:53
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction  https://review.opendev.org/69539712:55
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: WIP Groups from groups.yaml file  https://review.opendev.org/70452112:55
*** udesale_ has joined #tripleo12:55
*** bfournie has quit IRC12:57
*** udesale has quit IRC12:57
*** ratailor has quit IRC12:57
*** ratailor has joined #tripleo12:58
*** rh-jelabarre has joined #tripleo12:58
*** marios is now known as marios|call13:01
*** jpich has quit IRC13:01
*** rlandy has joined #tripleo13:01
*** jpich has joined #tripleo13:01
openstackgerritEmilien Macchi proposed openstack/paunch stable/train: load_config: allow the config to be overriden  https://review.opendev.org/70543813:03
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: DNM-Testing  https://review.opendev.org/70543913:04
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: paunch: allow to override any container config  https://review.opendev.org/70544013:06
*** morazi has quit IRC13:06
*** morazi has joined #tripleo13:06
*** ramishra has joined #tripleo13:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-common master: tests: Get RoleData correctly  https://review.opendev.org/70543313:13
odyssey4meowalsh: thanks for the review on https://review.opendev.org/705433 -updated with your suggestions13:15
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: Moves container log collection to standalone script  https://review.opendev.org/70541513:15
*** hjensas has quit IRC13:16
*** psachin has quit IRC13:16
EmilienMgfidente: hey, you the yaql expert (lol) - can you please review https://review.opendev.org/#/c/705330/ ?13:20
*** ratailor has quit IRC13:21
openstackgerritDaniel Bengtsson proposed openstack/python-tripleoclient master: Stop configuring install_command in tox.  https://review.opendev.org/69350213:22
openstackgerritFrancesco Pantano proposed openstack/tripleo-heat-templates master: Add condition to generate ceph-rgw ceph-ansible variables  https://review.opendev.org/70544213:22
openstackgerritMerged openstack/puppet-pacemaker master: Fix params in pcmk remote  https://review.opendev.org/70539113:24
*** derekh has quit IRC13:24
*** hjensas has joined #tripleo13:27
*** rpittau|bbl is now known as rpittau13:34
cloudnullmornings13:35
*** ykarel is now known as ykarel|afk13:36
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert get_config to a direct call instead of using mistral  https://review.opendev.org/70529913:38
*** ykarel|afk is now known as ykarel|away13:39
gfidenteEmilienM hey nice, not sure if it can be simplified anyhow, have you got "sample" data to mess with somewhere?13:39
*** Goneri has joined #tripleo13:40
EmilienMgfidente: hey, yeah, I put some in the commit meesage13:40
weshaycloudnull, this patch helps to unblock about 30 scenario for compute https://review.opendev.org/#/c/704880/13:40
EmilienMgfidente: I used http://yaqluator.com/13:40
gfidenteah EmilienM whow13:41
* cloudnull looking 13:41
gfidenteso that gets +2 regardless then13:41
cloudnullweshay +2 from me13:41
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert deployment to use new ssh-admin playbook  https://review.opendev.org/70389413:43
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add additional strategy optimization  https://review.opendev.org/70444313:44
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Cleanup after rename-pocolyps  https://review.opendev.org/70347713:45
*** marios|call is now known as marios13:45
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support.  https://review.opendev.org/68101713:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232313:50
dalvarezchkumar|rover: reading13:51
dalvarezchkumar|rover: presumably here? https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/validate-tempest/vars/tempest_skip_master.yml#L2313:52
chkumar|rovermschuppert, Hello, can we add a periodic job for fs062 and enable it in periodic and add the same here https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L85 and in ltrain also13:52
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available  https://review.opendev.org/70505213:53
*** bfournie has joined #tripleo13:53
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available  https://review.opendev.org/70505213:54
chkumar|roverdalvarez, Yes, we have a job fs021 which runs skip list as a whitelist, I saw this patch https://review.opendev.org/#/c/702250/ on neutron side, so thought, we can fix on tripleo side also13:54
*** jdandrea has joined #tripleo13:54
dalvarezchkumar|rover: we can go ahead yeah :)13:56
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available  https://review.opendev.org/70505213:57
openstackgerritMerged openstack/tripleo-ci master: Use podman for scenario012  https://review.opendev.org/68234113:58
mschuppertchkumar|rover: yes that'd be good.13:59
chkumar|rovermschuppert, looking forward for the patch :-)13:59
mschuppertchkumar|rover: will do that when it landed, probably tomorrow13:59
*** ekultails has joined #tripleo13:59
chkumar|rovermschuppert, thanks :-)14:00
mschuppertchkumar|rover: thanks you!!14:00
*** morazi_ has joined #tripleo14:00
cloudnullif folks have time to give these a review, https://review.opendev.org/#/q/topic:mistral_to_ansible+(status:open+OR+status:merged)+status:open+label:verified%253D%252B1%252Cuser%253Dzuul it would be greatly appreciated.14:02
*** holser has quit IRC14:02
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Improve containers logs collection  https://review.opendev.org/70534714:04
*** morazi has quit IRC14:04
*** ykarel|away is now known as ykarel14:04
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Improve containers logs collection  https://review.opendev.org/70534714:07
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Fix logs collection with new docker  https://review.opendev.org/70544614:07
sshnaidmweshay, ykarel fixes for logs ^^14:07
*** ahosam has joined #tripleo14:07
ykarelsshnaidm, ack atleast it should confirm the issue, need to find why it's working for non-master though14:08
sshnaidmykarel, was it updated in stable branches repos?14:08
ykarelsshnaidm, docker comes from centos extras14:08
ykarelso should be same14:08
sshnaidmi see14:09
openstackgerritwes hayutin proposed openstack/ansible-role-collect-logs master: Fix logs collection with new docker  https://review.opendev.org/70544614:09
weshaysshnaidm, thanks14:09
weshayupdated commit msg14:10
*** holser has joined #tripleo14:14
openstackgerritMerged openstack/tripleo-operator-ansible master: Create role for molecule prep  https://review.opendev.org/70526414:15
*** mcornea has joined #tripleo14:16
*** tkajinam has quit IRC14:16
*** derekh has joined #tripleo14:17
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Improve containers logs collection  https://review.opendev.org/70534714:19
*** ykarel is now known as ykarel|mtg14:19
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: DNM: test logs  https://review.opendev.org/70541014:19
*** avivgt has joined #tripleo14:19
*** ahosam has quit IRC14:19
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Improve containers logs collection  https://review.opendev.org/70534714:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232314:22
openstackgerritMerged openstack/tripleo-ansible master: Remove the tripleo_job_ansible_args default  https://review.opendev.org/70487314:24
*** abdysn has quit IRC14:28
openstackgerritEmilien Macchi proposed openstack/tripleo-operator-ansible master: Add molecule jobs for undercloud and minion roles  https://review.opendev.org/70468514:31
*** marios is now known as marios|call14:32
openstackgerritEmilien Macchi proposed openstack/tripleo-operator-ansible master: Add molecule jobs for undercloud and minion roles  https://review.opendev.org/70468514:33
*** TrevorV has joined #tripleo14:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-operator-ansible master: Use test_molecule_prep for tests and fix filters  https://review.opendev.org/70532514:34
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Improve containers logs collection  https://review.opendev.org/70534714:37
*** chkumar|rover is now known as raukadah14:37
openstackgerritSagi Shnaidman proposed openstack/tripleo-operator-ansible master: Use test_molecule_prep for tests and fix filters  https://review.opendev.org/70532514:41
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Add sova reasons to influxdb  https://review.opendev.org/70533514:42
*** cdearborn has joined #tripleo14:42
*** ade_lee has joined #tripleo14:43
openstackgerritCarlos Camacho proposed openstack/tripleo-ansible master: remove extra folders in backup and restore role  https://review.opendev.org/70545314:44
openstackgerritCarlos Camacho proposed openstack/tripleo-ansible master: remove extra folders in backup and restore role  https://review.opendev.org/70545314:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232314:48
*** marios|call is now known as marios14:49
*** dtantsur is now known as dtantsur|brb14:50
*** ykarel|mtg is now known as ykarel14:52
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Run RDO jobs with baremetal provisioning  https://review.opendev.org/68057114:53
ykarelsshnaidm, u checked non-master thing?14:54
sshnaidmykarel, not yet, checking..14:54
ykarelsshnaidm, ack14:54
sshnaidmykarel, do you remember why we use docker on c7 compute node..?14:57
*** holser has quit IRC14:57
ykarelsshnaidm, i think we don't differentiate container engine on controller/compute14:58
ykarelbut was due to pacemaker on centos7 do not work with podman14:58
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Dynamic readme generate  https://review.opendev.org/70545414:58
*** jbadiapa has quit IRC15:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: container-puppet.sh: add -r to rm command  https://review.opendev.org/70545615:03
*** artom has joined #tripleo15:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: container-puppet.sh: add -r to rm command  https://review.opendev.org/70545615:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232315:05
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Ensure that ceph-ansible is installed in the undercloud.  https://review.opendev.org/70511415:05
sshnaidmykarel, in container looks like the difference in centos-binary-neutron-metadata-agent-ovn15:05
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support.  https://review.opendev.org/68101715:06
ykarelsshnaidm, what difference15:06
*** apetrich has quit IRC15:07
cloudnullping sshnaidm - I was going to start working on the bios apply / reset workflows but noticed that they rely on the manual cleaning workflow. I noticed that you were going to work on the cleaning workflows, do you have a review I can build on top of?15:09
cloudnullit would seem all of these changes depend on the "tripleo.baremetal.v1.manual_cleaning" workflow ?15:10
sshnaidmcloudnull, not yet :( busy currently with CI issues15:10
cloudnullnp15:10
sshnaidmcloudnull, can you continue without it or it's required?15:10
cloudnullits required, but I can move on to other workflows for now w15:10
sshnaidmcloudnull, cool, will submit when I'll have it ready15:11
cloudnullnp, its no rush, we have plenty of other work to do :D15:11
sshnaidmcloudnull, ack :)15:12
sshnaidmykarel, look at https://logserver.rdoproject.org/84/704384/4/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/884042e/logs/overcloud-novacompute-0/var/log/extra/docker/docker_allinfo.log15:12
sshnaidmykarel, first ovn container is "Up 4 minutes" and not "healthy"15:13
sshnaidmykarel, in train it's exited(?) https://logserver.rdoproject.org/09/705409/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/f1dc391/logs/overcloud-novacompute-0/var/log/extra/docker/docker_allinfo.log.txt.gz15:13
*** germs has joined #tripleo15:13
germs<3 @cloudnull15:13
germshope you're doing well sir.15:13
poopcatthe best15:13
sshnaidmykarel, https://logserver.rdoproject.org/84/704384/4/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/884042e/logs/overcloud-novacompute-0/var/log/extra/docker/containers/ovn_metadata_haproxy-ovnmeta-f8628e8b-9d86-4793-befb-6166e3fbeb87/docker_info.log.txt.gz15:14
cloudnullgerms ++ how you been brother ?15:15
germsalways well man ;]15:15
germsworking at a BI place right now, non openstacky.. but may be making a come back15:16
germswas hearing about the constant updates in here from some stranger named cloudnull, figured it was worth adding it to my list of channels15:16
cloudnulldont call it a come back, you've been here for years ! :D15:16
ykarelsshnaidm, looking15:16
germshell yeah man ;]15:16
cloudnullmiss you, glad you're doing great !15:17
artomo/ Hello from Nova land, folks. I have WIP CI job that uses tripleo do deploy a 2-compute-node env and then run a tempest plugin. Except... it passes without running any tests. Not sure what I'm doing wrong, would like some assistance please :) https://review.opendev.org/#/c/705113/15:17
germsyeah man, same. i don't think our paths are done crossing so if i don't see/talk to you soon... we'll talk/see each other again ;]15:17
ykarelsshnaidm, that's differnt15:18
sshnaidmykarel, I wonder if docker stats now freeze on unstable containers15:18
openstackgerritMerged openstack/tripleo-ci master: Use os_tempest flipswitch from fs052  https://review.opendev.org/70500715:18
sshnaidmykarel, if it's restarting non stop15:19
ykarelsshnaidm, i mean possibly u liking ovn_haproxy container, in train i don't see that15:19
ykarelinstead of Exited15:20
openstackgerritMerged openstack/python-tripleoclient stable/train: Revert "Remove panko"  https://review.opendev.org/70507415:20
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Dynamic readme generate  https://review.opendev.org/70545415:20
sshnaidmykarel, in train it's create_haproxy_wrapper15:23
ykarelsshnaidm, ack me not aware of these differences, need to check, but yes may be related15:25
*** hberaud is now known as hberaud|school-r15:25
sshnaidmovn metadata container with haproxy, who can be up to date with last changes?15:28
sshnaidmslaweq  bandini ? ^^15:28
ykarelsshnaidm, from my console history, i see 12 ovn_haproxy containers in docker ps output15:30
*** zbr has quit IRC15:30
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Add missing firewall rule for iscsid in HA deployments  https://review.opendev.org/70480515:30
ykareli guess ^^ rebased15:30
ykarelack it got rebased15:30
sshnaidmykarel, where is it?15:31
bandinisshnaidm: ovn folks, I am not up to date on that stuff15:33
ykarelsshnaidm, when i logged in to compute node, i ran docker ps, and it's output is there in my local15:33
ykarelsshnaidm, looks like http://paste.openstack.org/show/789068/15:34
*** zbr has joined #tripleo15:34
sshnaidmykarel, so it's not only restarting, but also breeding?15:34
sshnaidmdamn corona virus hit it too15:35
sshnaidmykarel, ok, I'll submit a bug, let's collect info there15:35
ykarel:)15:36
ykarelsshnaidm, ack15:36
sshnaidmykarel, https://bugs.launchpad.net/tripleo/+bug/186169415:36
openstackLaunchpad bug 1861694 in tripleo "Nonstop restarting ovn_metadata_haproxy container" [Critical,Triaged]15:36
raukadahsshnaidm, ykarel ^^ I think does it related to validate-services role?15:37
ykarelraukadah, me no idea15:38
weshaysshnaidm, so that container is restarting and blowing up collect logs in check and promotion?15:38
raukadahykarel, one min15:38
raukadahykarel, https://bugs.launchpad.net/tripleo/+bug/186148615:39
openstackLaunchpad bug 1861486 in tripleo "010-standalone is randomly failing" [Critical,Triaged] - Assigned to Cédric Jeanneret (cjeanner)15:39
sshnaidmweshay, probably, I don't see for now other differences, because it happens only in master15:39
openstackgerritMerged openstack/tripleo-operator-ansible master: Use test_molecule_prep for tests and fix filters  https://review.opendev.org/70532515:39
weshaysshnaidm++15:39
weshayok.. I don't think we've seen an issue like this before.. but sounds like we need to get defensive in the container logging15:39
sshnaidmbut this container is definitely sick..15:39
weshayif only there were health checks15:40
sshnaidmweshay, there are and I suspect they restart it again and again :D15:40
weshayheh15:40
weshaypyscho doctor15:40
raukadahsshnaidm, I think we need to fix errors which find in errors.txt logs collection not sure just a thought15:40
sshnaidmlike it would help him15:40
sshnaidmraukadah, which errors do you mean?15:41
*** hberaud|school-r is now known as hberaud15:41
*** ahosam has joined #tripleo15:41
ykarelsshnaidm, what about getting a reproducer up in local tenant15:42
ykareland get ovn folks there if needed15:42
*** ahosam has quit IRC15:43
*** rfolco is now known as rfolco|eats15:43
*** ykarel is now known as ykarel|away15:44
* ykarel|away leaving for dinner15:44
openstackgerritMerged openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role  https://review.opendev.org/70513115:45
sshnaidmykarel|away, I'm fine, just need a tenant, my is busy now..15:46
raukadahsshnaidm, about https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/e25774a/logs/undercloud/var/log/extra/errors.txt.txt some time random errors we ignore15:48
sshnaidmraukadah, do you mean to clean it up from red herrings and random errors?15:49
raukadahsshnaidm, yes15:49
sshnaidmraukadah, yeah, it would be great15:50
sshnaidmraukadah, maybe worth to open bugs for each of those, healthy software shouldn't throw errors in normal workflow15:51
raukadahsshnaidm, yes will start opening from tomorrow15:51
openstackgerritMerged openstack/tripleo-ci master: Separate upgrade jobs with stable branches  https://review.opendev.org/70284415:52
raukadahsshnaidm, ykarel|away https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master I was looking at this one first 10 runs has no logs15:53
raukadahsubnodes logs15:54
sshnaidmraukadah, yeah, it's what we discussed above, https://review.opendev.org/#/c/705446/15:55
slaweqsshnaidm: hi, if You have problems with ovn metadata containers I think that beagles or dalvarez can help You15:56
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Don't use defined  https://review.opendev.org/70546315:56
*** holser has joined #tripleo15:57
*** jbadiapa has joined #tripleo16:03
*** dtantsur|brb is now known as dtantsur16:05
sshnaidmslaweq, thanks16:09
sshnaidmbeagles, dalvarez can you please take a look folks?  https://bugs.launchpad.net/tripleo/+bug/186169416:09
openstackLaunchpad bug 1861694 in tripleo "Nonstop restarting ovn_metadata_haproxy container" [Critical,Triaged]16:09
dalvarezbeagles: maybe you know this better, seems yet again something related to docker+centos7 :? I would expect to ussuri using podman anyways as this container is not managed by pacemaker16:11
dalvarez:?16:11
Tengufolks, can we see this change merge? https://review.opendev.org/#/c/704117/   it's trivial :).16:12
dalvarezbeagles: sshnaidm also, the error description says that the container has been stopped, this can happen if by the time that whatever tasks fetches the running containers and executes the command, the VMs have been shut down16:12
dalvarezsshnaidm: beagles i wrote that in the bug anyways just in case it helps16:15
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert deployment to use new ssh-admin playbook  https://review.opendev.org/70389416:23
*** yprokule has quit IRC16:23
*** yprokule has joined #tripleo16:23
openstackgerritSagi Shnaidman proposed openstack/tripleo-operator-ansible master: Add molecule jobs for undercloud and minion roles  https://review.opendev.org/70468516:27
*** sshnaidm is now known as sshnaidm|afk16:27
*** udesale_ has quit IRC16:32
*** rpittau is now known as rpittau|afk16:33
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Dynamic readme generate  https://review.opendev.org/70545416:34
cloudnulld0ugal - https://pasted.tech/pastes/b9c64129c735707957d816bdb2387604e55fb101 - looks like a couple small issues on https://review.opendev.org/#/c/705254 - otherwise seems to work great!16:34
d0ugalcloudnull: whoops, yeah, I have a update to push to it16:35
d0ugalI changed a few more things to try and make it a easier pattern to copy16:35
cloudnullI built on top of that review with https://review.opendev.org/#/c/70529916:35
cloudnull I think that context class is going to work out great16:36
d0ugalcloudnull: that is fine, I have not changed anything in the plugin16:36
cloudnull++16:36
d0ugalyeah, I found somewhere else to use it too16:36
cloudnullI'd rebase my change it if you did, so no worries16:36
cloudnullI think many of the baremetal bios changes can benifit from it as well16:37
d0ugalnice16:37
*** paramite has quit IRC16:39
openstackgerritwes hayutin proposed openstack/ansible-role-collect-logs master: Moves container log collection to standalone script  https://review.opendev.org/70541516:46
*** ramishra has quit IRC16:48
*** marios is now known as marios|out16:50
*** rfolco|eats is now known as rfolco16:51
*** lmiccini has quit IRC16:54
*** mcornea has quit IRC16:58
*** mcornea has joined #tripleo16:58
*** marios|out has quit IRC16:58
*** bogdando has quit IRC16:59
*** suuuper has quit IRC17:04
*** lucasagomes has quit IRC17:07
openstackgerritLuke Short proposed openstack/tripleo-ansible master: WIP: Use the openrc role for generating credential files.  https://review.opendev.org/70549217:26
*** ayoung has quit IRC17:26
*** yprokule has quit IRC17:33
*** evrardjp has quit IRC17:33
*** evrardjp has joined #tripleo17:34
*** jpich has quit IRC17:36
*** jbadiapa has quit IRC17:40
openstackgerritSorin Sbarnea proposed openstack/ansible-role-collect-logs master: Improve containers logs collection (v2)  https://review.opendev.org/70550117:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: Generate startup configs files per step and per container  https://review.opendev.org/70182717:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: container-puppet: update 'env' when not null  https://review.opendev.org/70205817:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: [SQUASH] backport tripleo-container-manage to stable/train  https://review.opendev.org/70182917:46
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: paunch: use utils.load_config()  https://review.opendev.org/70174117:46
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: [SQUASH] backport tripleo-container-manage to stable/train  https://review.opendev.org/70184917:46
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: paunch: allow to override any container config  https://review.opendev.org/70544017:47
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient stable/train: undercloud: introduce undercloud_enable_paunch option  https://review.opendev.org/70183017:48
*** ayoung has joined #tripleo17:48
zbrcloudnull: ekultails : please check https://github.com/ansible-community/molecule/pull/2513 and preferably test locally, that is one ... big change.17:50
* cloudnull adds to todo-list17:50
zbrtesting locally means just "molecule lint", on existing scenarios.17:51
zbrit will likely give an error, but is the error clear enough?17:51
zbri am trying to minimize user confusion when they upgrade17:52
ekultailszbr: I've been having trouble with Molecule the last time I used it and need to reset my virtualenv anyways. I'll give a whirl. :-)17:55
openstackgerritMerged openstack/tripleo-heat-templates master: Remove all the "container_cli rmi -f" from HA containers  https://review.opendev.org/70527017:55
zbrthanks.17:55
zbris am keep working in slimming it down, used to bring the entire pypi on install.17:56
*** gfidente is now known as gfidente|afk17:59
*** derekh has quit IRC18:00
ekultailszbr: I get this error when trying to run a lint:18:01
ekultails{'lint': ['must be of string type']}18:01
raukadahweshay, slaweq, hello, based on this https://review.rdoproject.org/r/#/c/24683/, we are good to go ahead with new tag for new neutron tempest plugin and tempest tag18:01
weshayrock18:02
raukadahlet;s break the world together and fix it18:02
EmilienMI'm having serious issues with docker.io18:03
EmilienMin my local env18:03
EmilienMam I alone?18:04
EmilienMwhat the cool kids use now as a mirrro registry?18:04
weshayraukadah, so reviews on https://review.opendev.org/#/c/703072/ https://review.opendev.org/#/c/649418/ ??18:04
ekultailsEmilienM: Works for me *shrug* http://paste.openstack.org/show/789075/18:05
raukadahslaweq, I am confused, will I push the review to usseri or train? for neutron tempes tplugin18:05
ekultailsI also just spun up a Train lab and it seemed to be fine with pulling containers from upstream.18:05
EmilienMekultails: probably canadian's firewall.18:06
raukadahweshay, https://review.opendev.org/#/c/703072/ is different, does not solve our problem18:06
ekultailslol Could be18:06
weshayraukadah, your patch only has other DNM patches as deps18:06
raukadahweshay, https://review.opendev.org/#/c/649418/ is useful to test stuff in a train from upstream version, demo here https://review.rdoproject.org/r/#/c/24723/18:06
ekultailszbr: I manually added every `lint: name:` values based off of your docs and it still returns the same error. Probably just needs minor tweak somewhere.18:07
raukadahweshay, https://review.rdoproject.org/r/#/c/24723/ is tempest 23.0.0 and neutron tempest plugin master18:08
weshayraukadah, ok.. how can I help you merge the tempest plugin update18:08
ekultailszbr: Also, are you still interested in forming a study group for the Red Hat OpenStack certifications? Being in different time zones complicates things but I can wake up early. :-) Maybe we can sync up a few days a week about it.18:09
raukadahweshay, and this one https://review.rdoproject.org/r/#/c/24723/ to test different patches of tempest and neutron tempest plugin from master together, It was an experiment from ykarel|away and mine head18:09
raukadahweshay, donot worry, we will take care of that tomorrow when slaweq is online18:09
*** morazi_ has quit IRC18:10
ykarel|awaysshnaidm|afk, dalvarez commented https://bugs.launchpad.net/tripleo/+bug/1861694/comments/3 with what i found18:11
openstackLaunchpad bug 1861694 in tripleo "Nonstop restarting ovn_metadata_haproxy container" [Critical,Triaged]18:11
openstackgerritMerged openstack/tripleo-heat-templates master: Add ceph_ansible_repo variable on ceph-base  https://review.opendev.org/70133818:11
openstackgerritMerged openstack/tripleo-quickstart master: Add nova cellv2 multicell support  https://review.opendev.org/69168818:11
ykarel|awayu might have more insight there18:11
raukadahweshay, one more thing to note current deps on https://review.rdoproject.org/r/#/c/24683/ with temepst 23.00 and neutron tempest plugin master we used arxcruz concurreny patch https://review.opendev.org/#/c/704948/18:11
raukadahconcurrency one which he was speaking on last friday18:11
raukadahotherwise fs020 timingout18:12
weshayk18:13
weshaystill only see dnm patches.. I'll sync w/ you tomorrow18:13
raukadahweshay, multinode containers timeout on v2 patches unlrelated sorrry, https://zuul.opendev.org/t/openstack/build/d0e954e15e9248109a8cb193391376ad18:14
weshayraukadah, still not in context18:15
raukadahweshay, https://review.opendev.org/#/c/691685/ -> tripleo-ci-centos-7-containers-multinodeTIMED_OUT in 3h 30m 46s18:16
weshayI see18:16
weshayso should we not merge that patch18:16
weshayyou have a +2 on it right now18:16
raukadahweshay, unless it passed18:16
weshayare you going to remove your -2?18:17
weshayyour +2 rather18:17
raukadahweshay, https://review.opendev.org/#/c/691688/ patch passed18:17
raukadahweshay, need to recheck or rebase18:17
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Add nova cellv2 multicell support  https://review.opendev.org/69168518:17
raukadahweshay, ^6 done18:17
weshayraukadah, k .. lolz18:17
weshayI'll watch it18:18
raukadahweshay, aye sir :-)18:18
*** bandini has quit IRC18:19
artomo/ Heya from Nova-land folks - I have a WIP CI job using TripleO that I's like some assistance with18:29
weshayartom, what's up18:30
*** weshay is now known as weshay|ruck18:30
artomweshay, so, I'm trying to deploy 2 nodes - controller + compute, and compute, and run a tempest plugin that includes some live migration18:30
artomweshay|ruck, so far I have https://review.opendev.org/#/c/705113/3/.zuul.yaml18:31
artomAnd... I don't think it's even deploying anything18:31
artomBecause it finishes in minutes :/18:31
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert get_config to a direct call instead of using mistral  https://review.opendev.org/70529918:32
weshay|ruckartom, ya.. so afaict.. you are missing a number of things re: the job def and tripleo config18:34
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert get_config to a direct call instead of using mistral  https://review.opendev.org/70529918:34
weshay|ruckartom, probably best to ping michal w/ requirements and have michal work w/ us18:34
artomweshay|ruck, wait, even upstream?18:34
artomThis is opendev :)18:35
weshay|ruckartom, michal is engineering right?18:35
artomYou men migi? Yeah, he's in our DFG, but...18:35
weshay|ruckya18:35
weshay|ruckmigi18:35
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the discover_and_enroll workflow  https://review.opendev.org/70551018:36
artomweshay|ruck, because I basically want https://docs.openstack.org/tripleo-docs/latest/ci/check_gates.html18:36
artomSo if he's really the right person for that, yeah, I'll go to him18:36
weshay|ruckartom, oh ya.. I know what you want18:36
*** holser has quit IRC18:36
artomI was under the impression he was more for downstream stuff18:36
weshay|ruckI would never label migi.. he's an unstoppable force that defies labels18:37
artom*snerk* Alright then :)18:38
artomUnless that label is a -2 ;)18:38
weshay|rucklolz18:38
*** ayoung has quit IRC18:38
artomweshay|ruck, thanks for your time, I'll poke migi when he's back online tomorrow18:39
arxcruzraukadah: weshay|ruck the job fail in collect logs, i'm running again18:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - don't remove container-puppet-* containers  https://review.opendev.org/70551318:44
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config"  https://review.opendev.org/70231518:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232318:50
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the discover_and_enroll workflow  https://review.opendev.org/70551018:52
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add support for ceph_external_multi_config  https://review.opendev.org/70214318:54
openstackgerrityatin proposed openstack/tripleo-heat-templates stable/train: [DNM] docker stats stuck issue stable/train  https://review.opendev.org/70551718:56
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove discover_nodes workflows  https://review.opendev.org/70551818:57
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove discover_nodes workflows  https://review.opendev.org/70551818:59
EmilienMdciabrin: have you ever wondered yourself how container-puppet.sh doesn't fail to run rsync on the same config volume while another container-puppet.py script is running?19:05
EmilienMe.g. container-puppet-neutron_api and container-puppet-neutron_dhcp run at the same time19:06
EmilienMand do rsync at same time19:06
EmilienMwe have no mechanism preventing that to happen19:06
EmilienMunless we disabled concurrency in that script19:06
EmilienMhttps://github.com/openstack/tripleo-heat-templates/blob/master/common/container-puppet.py#L55619:06
*** pkopec has quit IRC19:07
EmilienMwe do 6 at same time: https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/common/deploy-steps.j2#L7919:07
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: DNM: test patterns  https://review.opendev.org/70552119:08
*** pkopec has joined #tripleo19:08
dciabrinEmilienM, oh??19:10
*** ayoung has joined #tripleo19:11
dciabrinEmilienM, so you're saying we run the same config generation 6 times, and 5 times for nothing?19:11
EmilienMdciabrin: no I'm saying that container-puppet.py loops over https://ccd11990bfe5f010fffe-e6e77a9441ae9cccde1b8ed58f97fc24.ssl.cf1.rackcdn.com/702315/39/check/tripleo-ci-centos-7-undercloud-containers/4a51893/logs/undercloud/var/lib/container-puppet/container-puppet.json19:12
dciabrinhence your yaql review from earlier today?19:12
EmilienMand do it via batch19:12
EmilienMdciabrin: no19:12
EmilienMmy review made it easier for me to separate the container names19:13
*** hberaud is now known as hberaud|gone19:14
*** stevebaker has joined #tripleo19:15
*** mcornea has quit IRC19:20
*** mcornea has joined #tripleo19:21
ade_leeEmilienM, mwhahaha - have a design question.  So, right now the service information per node for tls is stored in ansible variables.  thats well and good for deployments and also for scale down, but I need to be able to access this on stack delete to clean stuff up in ipa.19:22
ade_leeso I can put this info in the inventory -- or I can put it in the plan ..19:23
ade_leeEmilienM, mwhahaha any preference/ other suggestion?19:23
ade_leeultimately I need to be able to access this info in a standalone script that would be run before you did a stack delete19:24
ade_leeslagle, ^^19:24
openstackgerritMerged openstack/tripleo-ansible master: Add grafana vip on the storage network  https://review.opendev.org/70430819:26
openstackgerritMerged openstack/tripleo-ansible master: Skeleton role, get with the decade  https://review.opendev.org/70512419:26
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Introduce CephExternalMultiConfig  https://review.opendev.org/70214119:30
mwhahahaade_lee: what needs to be done to the ipd on stack delete?19:36
ade_leemwhahaha, there are a bunch of services that need to be deleted -- this in turn results in certs being revoked etc.19:42
mwhahahathat sounds awful19:42
ade_leemwhahaha, and hosts/subhosts being deleted19:42
mwhahahai don't suppose there's a way to tag them in ipa for cleanup19:42
ade_leemwhahaha, in ipa a lotof the work is done through referential integrity checks19:43
ade_leemwhahaha, we already have the code that will do the relevant deletes19:44
ade_leewe just need the data -- which is in service_metadata to get all the services19:45
mwhahahayea i get that, this just seems awful19:45
ade_leemwhahaha, its not that bad - there are just a few ipa calls needed - and the data needed is minimal19:46
mwhahahafamous last words19:47
ade_lee:/19:47
ade_leemwhahaha, we are already doing it with novajoin19:47
mwhahahayea i don't really have any real opinion on where to put the data, except that the plan is probably not a good place as we want to get away from that.19:48
fultonjade_lee: can the information be deduced from IPA itself? so rather than store state data in tripleo recreate that data instead?19:49
fultonjade_lee: then use something like scale-down tasks, e.g. https://review.opendev.org/#/c/653893/19:50
mwhahahafultonj: scale down tasks don't run on stack delete, that's the problem19:50
mwhahahaso thatys why i asked if you can tag it in the ipa and clean it up that way19:50
mwhahaharather than having to know the data19:50
mwhahahae.g. cleanup all things tagged 'overcloud-abc'19:51
ade_leemwhahaha, fultonj -- the data we need looks like this - for a controller/compute  -- https://paste.centos.org/view/6bb5ceba19:51
ade_leemwhahaha, yeah -  let me look into the tagging thing19:53
*** dtantsur is now known as dtantsur|afk19:53
*** gfidente|afk is now known as gfidente19:56
*** tesseract has quit IRC20:01
slagleade_lee: you can set host/group vars in t-h-t, and then they will be rendered out to the config-download directory20:04
slaglei'd prefer to keep it out of the inventory directly20:04
weshay|ruckseeing the following in update gate jobs.. but not in check20:04
weshay|ruck0-02-03 19:37:51 | puppet-user: Warning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/5.5/deprecated_language.html\n   (file & line not available)20:04
weshay|ruck2020-02-03 19:37:51 | puppet-user: Error: Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Class[Tripleo::Profile::Base::Haproxy] is already declared at (file: /etc/config.pp, line: 2); cannot redeclare (file: /etc/config.pp, line: 4) (file: /etc/config.pp, line: 4, column: 1) on node centos-7-rax-ord-0014302096.localdomain20:04
weshay|ruckwe're not logging /etc/config.pp for the container :(20:04
* weshay|ruck looking into it20:04
*** irclogbot_0 has quit IRC20:05
weshay|ruckcloudnull, EmilienM it's this patch https://review.opendev.org/#/c/704714/20:05
weshay|rucknot related afaict from the patch20:05
*** tmazur has quit IRC20:06
*** irclogbot_0 has joined #tripleo20:07
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates stable/train: Remove all the "container_cli rmi -f" from HA containers  https://review.opendev.org/70527120:07
*** alexmcleod has quit IRC20:08
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud image upload role  https://review.opendev.org/70370620:10
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Remove duplicate gate job  https://review.opendev.org/70554120:11
mwhahahaweshay|ruck: you can find the config.pp, it's the puppet bits from the .json in /var/lib/config-data/ somewhere20:12
weshay|ruckk.. thanks digging20:12
*** jmasud has quit IRC20:12
mwhahahaweshay|ruck: link to failed job?20:12
mwhahahasomething like that would be a THT failure not related to that tripleoclient change20:13
weshay|ruckmwhahaha, https://bugs.launchpad.net/tripleo/+bug/186172720:13
openstackLaunchpad bug 1861727 in tripleo " Duplicate declaration: Class[Tripleo::Profile::Base::Haproxy] is already declared at (file: /etc/config.pp, line: 2" [Critical,Triaged]20:13
mwhahaha2020-02-03 19:37:51 | + TAGS='--tags "file,file_line,concat,augeas,cron,haproxy_config,haproxy_config"'20:14
mwhahahathat's some nice duplication there20:14
*** jmasud has joined #tripleo20:14
mwhahahaweshay|ruck: haproxy is being done twice for some reason20:15
mwhahahahttp://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_58d/704714/2/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/58dd803/logs/subnode-1/var/lib/container-puppet/container-puppet.json20:15
mwhahahaseems like a role/server config?20:15
* weshay|ruck looks20:15
mwhahahait's defined twice20:18
mwhahahain THT/ci/enviornments/scenario000-multinode.containers.yaml20:18
openstackgerritTerry Wilson proposed openstack/tripleo-quickstart-extras master: Re-add agent list test  https://review.opendev.org/70269020:19
mwhahahahttps://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/scenario000-multinode-containers.yaml#L15-L2320:19
mwhahahadon't ask me how this is just failing now?20:19
mwhahahai blame EmilienM20:19
weshay|ruckheh.. or passing in check20:19
* weshay|ruck looks20:19
mwhahahait's probably a change earlier in the queue20:21
mwhahahafor THT that is not running the updates job20:21
mwhahahae.g. any of them20:21
mwhahahabecause non of them ahead of them in the queue is running the updates job20:21
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: remove duplicated HAproxy line from scen000  https://review.opendev.org/70554420:22
mwhahahabet it's https://review.opendev.org/#/c/705330/20:22
mwhahahafyi EmilienM -^20:22
mwhahahawhy is the updates job voting on tripleoclient and not enabled on THT20:23
* mwhahaha -2's20:24
Tenguhmm, an upgrade job did pass on that one20:24
mwhahahais non-voting20:24
mwhahahabecause who cares about upgrades20:25
Tenguright20:25
Tengustill... 2 were green20:25
mwhahahait's cause the scenario000 files are bad20:25
mwhahahabut there's likely another issue here20:25
EmilienMmwhahaha: I'll abandon the patch20:25
mwhahahaso 1) fix the scenario000 files to not have duplicated haproxy20:25
EmilienMI don't need it anymore20:25
mwhahahaorly20:26
mwhahahathough i wonder if we should be able to detect the duplicate services somewhere20:26
EmilienMif that helps20:26
*** artom has quit IRC20:26
Tengumwhahaha: might be something nice to do some |sort|unique...20:27
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: container-puppet.sh: add -r to rm command  https://review.opendev.org/70545620:27
Tengu(or whatever works)20:27
mwhahahayea not sure teh best place to do that20:27
EmilienMit had a .distinct()20:27
EmilienMYAQL!20:27
mwhahahaEmilienM: no the issue was that the service was duped in the role definition20:27
mwhahahawhich lead to the failure for some reason20:28
*** gfidente has quit IRC20:28
TenguEmilienM: you love yaq(l) shaving right? :)20:28
EmilienMok so I didn't break anything (yet)20:28
EmilienMTengu: lol no... i can only do basic queries20:29
Tengu:)20:29
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud image upload role  https://review.opendev.org/70370620:33
openstackgerritwes hayutin proposed openstack/tripleo-ci master: update ci log readme  https://review.opendev.org/70554920:37
*** avivgt has quit IRC20:37
openstackgerritwes hayutin proposed openstack/tripleo-ci master: update ci log readme  https://review.opendev.org/70554920:37
openstackgerritArie Bregman proposed openstack/ansible-role-collect-logs master: Extend infrared molecule tests  https://review.opendev.org/70555220:48
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud image upload role  https://review.opendev.org/70370620:52
openstackgerritArie Bregman proposed openstack/ansible-role-collect-logs master: Extend infrared molecule tests  https://review.opendev.org/70555220:53
*** paramite has joined #tripleo20:56
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add none test case to shell_args_list  https://review.opendev.org/70555420:58
*** jfrancoa has quit IRC21:14
openstackgerritwes hayutin proposed openstack/tripleo-repos master: add centos8 highavailability  https://review.opendev.org/70312521:14
openstackgerritwes hayutin proposed openstack/tripleo-repos master: add centos8 highavailability,powertools  https://review.opendev.org/70312521:15
*** Goneri has quit IRC21:16
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config"  https://review.opendev.org/70231521:17
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232321:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible  https://review.opendev.org/70232321:20
openstackgerritwes hayutin proposed openstack/tripleo-ci master: WIP: Changes for build-containers role to include centos8  https://review.opendev.org/70193721:20
*** paramite has quit IRC21:34
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config"  https://review.opendev.org/70231521:38
openstackgerritNate Johnston proposed openstack/tripleo-heat-templates master: Add setfacl statements for neutron metadata proxy  https://review.opendev.org/70556221:49
*** artom has joined #tripleo21:49
*** dpawlik has quit IRC21:53
*** raildo has quit IRC22:01
*** slaweq has quit IRC22:02
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the get_deployment_status workflow  https://review.opendev.org/70556422:10
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove Mistral from plan list and call the Mistral action directly  https://review.opendev.org/70525422:12
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert get_config to a direct call instead of using mistral  https://review.opendev.org/70529922:12
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the discover_and_enroll workflow  https://review.opendev.org/70551022:13
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the get_deployment_status workflow  https://review.opendev.org/70556422:13
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo deploy role  https://review.opendev.org/70556522:15
openstackgerritLuke Short proposed openstack/tripleo-ansible master: Install more required packages with tripleo_bootstrap.  https://review.opendev.org/70556622:18
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud image upload role  https://review.opendev.org/70370622:18
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove the get_deployment_status workflow  https://review.opendev.org/70556822:20
openstackgerritArie Bregman proposed openstack/ansible-role-collect-logs master: Extend infrared molecule tests  https://review.opendev.org/70555222:24
*** saneax has quit IRC22:25
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config"  https://review.opendev.org/70231522:28
*** xek has quit IRC22:29
*** bfournie has quit IRC22:33
*** rfolco has quit IRC22:36
*** dciabrin has quit IRC22:38
*** dciabrin has joined #tripleo22:43
*** TrevorV has quit IRC22:53
*** tkajinam has joined #tripleo22:53
*** ade_lee has quit IRC22:55
*** ade_lee has joined #tripleo22:56
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo deploy role  https://review.opendev.org/70556522:56
*** ade_lee has quit IRC23:00
*** ade_lee has joined #tripleo23:00
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the delete_node workflow  https://review.opendev.org/70557423:02
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo deploy role  https://review.opendev.org/70556523:02
*** ade_lee has quit IRC23:05
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove the get_deployment_status workflow  https://review.opendev.org/70556823:07
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove the delete_node workflow  https://review.opendev.org/70557623:07
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo deploy role  https://review.opendev.org/70556523:08
*** pkopec has quit IRC23:22
*** mcornea has quit IRC23:26
*** mcornea has joined #tripleo23:28
*** jaosorior has quit IRC23:34
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the config_download_export workflow  https://review.opendev.org/70558323:35
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove the config_download_export workflow  https://review.opendev.org/70558423:39
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Ensure Ceph dependencies are installed in pre-provisioned nodes  https://review.opendev.org/70492623:41
*** jdandrea has quit IRC23:41
weshay|ruckmerge event coming to a theature near you23:42
*** jaosorior has joined #tripleo23:50
*** ade_lee has joined #tripleo23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!