| *** threestrands has joined #tripleo | 00:00 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 00:04 |
|---|---|---|
| *** jmasud has quit IRC | 00:06 | |
| *** cdearborn has quit IRC | 00:23 | |
| *** jmasud has joined #tripleo | 00:27 | |
| openstackgerrit | Merged openstack/tripleo-common stable/stein: Add ssh timeout for baremetal_deploy https://review.opendev.org/717192 | 00:29 |
| openstackgerrit | Merged openstack/os-net-config stable/rocky: Run ifup on a bond when a slave interface is restarted https://review.opendev.org/718578 | 00:29 |
| *** rfolco has quit IRC | 00:30 | |
| *** jmasud has quit IRC | 00:39 | |
| *** jmasud has joined #tripleo | 00:46 | |
| *** jmasud has quit IRC | 00:47 | |
| *** jmasud has joined #tripleo | 01:12 | |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Hide passwords better https://review.opendev.org/719863 | 01:14 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Link tripleo-ansible inventory for ceph-ansible with force https://review.opendev.org/719470 | 01:16 |
| *** jmasud has quit IRC | 01:29 | |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: tripleo_bootstrap: do not fail if OVS rpm wasn't found https://review.opendev.org/720015 | 01:34 |
| *** Goneri has quit IRC | 01:37 | |
| *** lbragstad has quit IRC | 01:38 | |
| openstackgerrit | zhufl proposed openstack/tripleo-common master: Fix "import xx as xx" https://review.opendev.org/720115 | 01:50 |
| tkajinam | hmm... tripleo-ci-centos-8-standalone rarely succeeds ... :-( | 01:58 |
| *** apetrich has quit IRC | 02:09 | |
| *** ysandeep|away is now known as ysandeep|rover | 02:11 | |
| *** jmasud has joined #tripleo | 02:28 | |
| *** artom has quit IRC | 02:32 | |
| *** sanjayu__ has quit IRC | 02:47 | |
| EmilienM | tkajinam: yeah there is an issue | 02:57 |
| EmilienM | tkajinam: not sure it's tracked yet | 02:57 |
| *** jmasud has quit IRC | 03:00 | |
| tkajinam | EmilienM, I'll refrain recheck atm. I think we need to file a bug to track it if we don't have it yet... | 03:02 |
| tkajinam | ysandeep|rover, ^^^ https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-standalone | 03:02 |
| tkajinam | just fyi... | 03:02 |
| ysandeep|rover | tkajinam, looking | 03:04 |
| tkajinam | ysandeep|rover, thanks. sees it's caused by some failures in tempest, but I've not yet checked it's detail | 03:06 |
| tkajinam | * its * | 03:06 |
| ysandeep|rover | tkajinam, last night wes reopened https://bugs.launchpad.net/tripleo/+bug/1852770 and proposed https://review.opendev.org/#/c/720050/ .. checking if its related. | 03:07 |
| openstack | Launchpad bug 1852770 in tripleo "No more IP addresses available on network, neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest" [High,In progress] - Assigned to wes hayutin (weshayutin) | 03:07 |
| *** ramishra has quit IRC | 03:12 | |
| ysandeep|rover | nah.. its different - currently failing at tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario | 03:13 |
| ysandeep|rover | tempest.exceptions.VolumeResourceBuildErrorException: volume b975e166-9c64-4adb-93bd-2735821bd1fb failed to build and is in ERROR status | 03:13 |
| ysandeep|rover | tkajinam, i will open a bz | 03:14 |
| *** hamzy_ has joined #tripleo | 03:29 | |
| *** hamzy has quit IRC | 03:31 | |
| *** psachin has joined #tripleo | 03:34 | |
| *** ramishra has joined #tripleo | 03:35 | |
| ysandeep|rover | tkajinam, fyi.. opened a bz https://bugs.launchpad.net/tripleo/+bug/1872881 , Will check further | 03:44 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,Triaged] | 03:44 |
| tkajinam | ysandeep|rover, thanks a lot | 03:48 |
| *** ysandeep|rover is now known as ysandeep|BRB | 04:08 | |
| *** ysandeep|BRB is now known as ysandeep|rover | 04:23 | |
| *** ykarel|away is now known as ykarel | 04:25 | |
| *** evrardjp has quit IRC | 04:37 | |
| *** evrardjp has joined #tripleo | 04:37 | |
| *** jmasud has joined #tripleo | 04:38 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move OvercloudRcAction functionality to utils https://review.opendev.org/720125 | 04:38 |
| *** ed_b has quit IRC | 04:42 | |
| *** jmasud has quit IRC | 04:54 | |
| *** skramaja has joined #tripleo | 05:02 | |
| openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient master: Remove the unused _validate_skip_tags function https://review.opendev.org/708639 | 05:21 |
| *** ratailor has joined #tripleo | 05:23 | |
| *** elfGamal has quit IRC | 05:33 | |
| *** jmasud has joined #tripleo | 05:35 | |
| *** elGamal has joined #tripleo | 05:37 | |
| *** udesale has joined #tripleo | 05:37 | |
| *** pojadhav|away is now known as pojadhav | 05:48 | |
| *** xek has joined #tripleo | 05:50 | |
| *** lmiccini has joined #tripleo | 05:53 | |
| *** threestrands has quit IRC | 05:54 | |
| *** ratailor has quit IRC | 06:00 | |
| Tengu | ysandeep|rover: heya! are you aware of some zuul issues related to tripleo-ci-centos-8-standalone and tempest? it apparently fails on a consistent way on tempest run... | 06:01 |
| ysandeep|rover | Tengu, yes working on https://bugs.launchpad.net/tripleo/+bug/1872881 , cinder-volume vg was not created successfull , loop module was not loaded - checking further | 06:02 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,Triaged] | 06:02 |
| *** florianf has joined #tripleo | 06:02 | |
| Tengu | ysandeep|rover: ah, thanks! so gate is red ;_; | 06:02 |
| Tengu | ysandeep|rover: lemme know if I can help | 06:02 |
| *** marios has joined #tripleo | 06:03 | |
| *** dmacpher has quit IRC | 06:06 | |
| ysandeep|rover | Tengu, yes please feel free to give pointers - http://paste.openstack.org/show/792128/ - some information | 06:06 |
| *** jmasud has quit IRC | 06:09 | |
| *** jmasud has joined #tripleo | 06:11 | |
| *** ratailor has joined #tripleo | 06:12 | |
| *** bandini has joined #tripleo | 06:15 | |
| Tengu | ysandeep|rover: if there's some playbook related to the host preparation, we can call the "modprobe" ansible module in order to ensure loop (and other mandatory kernel modules?) are loaded. | 06:18 |
| *** jfrancoa has joined #tripleo | 06:25 | |
| tkajinam | ysandeep|rover, I think you already identified it, but seems like currently cinder is somehow broken in standalone job | 06:30 |
| tkajinam | because I don't see any failures in glance job and neutron job, which doesn't depend on cinder IIUC | 06:30 |
| tkajinam | glance: https://review.opendev.org/#/c/719759/ | 06:30 |
| tkajinam | neutron: https://review.opendev.org/#/c/719923/ | 06:30 |
| tkajinam | cinder: https://review.opendev.org/#/c/719914/ | 06:31 |
| tkajinam | ^^^ ysandeep|rover just fyi | 06:31 |
| ysandeep|rover | Tengu, tkajinam thanks! | 06:31 |
| Tengu | ysandeep|rover: if the /dev/loop2 exists prior its creation, it's maybe due to some bad cleaning at some point? I guess VMs are one-shot, used to test then destroyed completly right? no re-use nor recycling? | 06:32 |
| ysandeep|rover | afaik vms are destroyed after used once | 06:34 |
| Tengu | that's what I understand - but since you're saying the /dev/loop2 exists (last in the paste)..... | 06:35 |
| *** bdodd has quit IRC | 06:36 | |
| Tengu | ysandeep|rover: puppet-cinder apparently DOES stuff related to /dev/loop: https://opendev.org/openstack/puppet-cinder/src/branch/master/spec/classes/cinder_setup_test_volume_spec.rb#L12-L14 | 06:37 |
| Tengu | ysandeep|rover: maybe some ordering issue? | 06:37 |
| *** slaweq_ has joined #tripleo | 06:38 | |
| Tengu | https://opendev.org/openstack/puppet-cinder/src/branch/master/manifests/setup_test_volume.pp#L18 | 06:38 |
| Tengu | puppet-tripleo seems to call that cinder::setup_test_volume thing at step 4: https://opendev.org/openstack/puppet-tripleo/src/branch/master/manifests/profile/base/cinder/volume/iscsi.pp#L60 | 06:38 |
| *** bdodd has joined #tripleo | 06:38 | |
| Tengu | so this might be some race condition somewhere? | 06:39 |
| *** bogdando has joined #tripleo | 06:40 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/train: tripleo-validations failing on lower constraints https://review.opendev.org/718649 | 06:45 |
| openstackgerrit | Merged openstack/tripleo-validations stable/train: Fix multistack inventory https://review.opendev.org/718557 | 06:45 |
| *** dpawlik has joined #tripleo | 06:49 | |
| *** sanjayu__ has joined #tripleo | 06:55 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: [Q->T] Introduce Queens to Train Upgrade https://review.opendev.org/713482 | 06:59 |
| tkajinam | Tengu, seems like it is created by ansible instead of puppet, according to the log ? | 07:00 |
| tkajinam | Tengu, ysandeep|rover https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/cinder/cinder-common-container-puppet.yaml#L111-L119 | 07:01 |
| openstackgerrit | Sandeep Yadav proposed openstack/tripleo-heat-templates master: Rename loopback creates file https://review.opendev.org/720132 | 07:04 |
| *** maciejjozefczyk has joined #tripleo | 07:06 | |
| ysandeep|rover | tkajinam, Tengu testing something with ^^ | 07:07 |
| *** marbindrakon has joined #tripleo | 07:08 | |
| *** marbindrakon has joined #tripleo | 07:09 | |
| *** abdysn has joined #tripleo | 07:11 | |
| *** marbindrakon has quit IRC | 07:11 | |
| *** ccamacho has joined #tripleo | 07:11 | |
| *** marbindrakon has joined #tripleo | 07:12 | |
| *** jcapitao has joined #tripleo | 07:14 | |
| *** marbindrakon has quit IRC | 07:16 | |
| *** marbindrakon has joined #tripleo | 07:16 | |
| *** Abdallahyas has joined #tripleo | 07:18 | |
| *** abdysn has quit IRC | 07:19 | |
| *** tosky has joined #tripleo | 07:23 | |
| *** rpittau|afk is now known as rpittau | 07:28 | |
| *** iurygregory has quit IRC | 07:31 | |
| Tengu | tkajinam: in the working job, yep. in the non-working, I suspect puppet to kick in first | 07:32 |
| tkajinam | Tengu, I think we should remove that puppet module if we do that in ansible | 07:32 |
| Tengu | ysandeep|rover: this should work indeed. | 07:32 |
| Tengu | tkajinam: probably - not sure why it was done in both location. We'd need someone from Cinder team imho | 07:32 |
| *** iurygregory has joined #tripleo | 07:32 | |
| *** abdysn has joined #tripleo | 07:32 | |
| Tengu | tkajinam: we might create some LP and point it to the right folks. | 07:33 |
| ykarel | Tengu, is that puppet code being executed as per logs? | 07:33 |
| ykarel | can u share those logs where u see that | 07:33 |
| Tengu | but ysandeep|rover should help, since ansible will ensure it actually IS created. Another way would be to split the 3 commands in 3 ansible tasks (ping ysandeep|rover ) | 07:33 |
| Tengu | ykarel: I don't know about "is it being executed" - I've checked where that loop2 was created in hound. gimme a moment to scrap logs and fetch infos. | 07:34 |
| *** florianf has quit IRC | 07:34 | |
| ykarel | Tengu, ack if u find logs share please, afaic that puppet tasks shouldn't be executed | 07:35 |
| *** jmasud has quit IRC | 07:35 | |
| tkajinam | https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/cinder/volume/iscsi.pp#L61-L63 | 07:35 |
| tkajinam | this should be executed in step 4... :-( | 07:35 |
| Tengu | what I said :) | 07:35 |
| Tengu | IF we get iscsi | 07:35 |
| ykarel | tkajinam, Tengu only when exec is passed in TAGS | 07:36 |
| ykarel | that is exec task | 07:36 |
| *** Abdallahyas has quit IRC | 07:36 | |
| *** jmasud has joined #tripleo | 07:36 | |
| ykarel | which i don't see at https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/cinder/cinder-volume-pacemaker-puppet.yaml#L131 | 07:37 |
| ykarel | but if logs says it's executed, i need to look more, that's why i was seeking logs to confirm | 07:38 |
| Tengu | wait. digging in puppet - gimme a sec. tripleo::profile::base::cinder::volume::iscsi is calling that volume::iscsi thing | 07:39 |
| Tengu | that tripleo::profile::base::cinder::volume::iscsi is then called by tripleo::profile::base::cinder::volume IF $cinder_enable_iscsi_backend == True | 07:39 |
| Tengu | and tripleo::profile::base::cinder::volume is the vase of every cinder things | 07:40 |
| Tengu | sooo we want to chec $cinder_enable_iscsi_backend | 07:40 |
| * Tengu digs in hiera | 07:40 | |
| Tengu | manifests/profile/base/cinder/volume.pp: $cinder_enable_iscsi_backend = true, true by default. | 07:41 |
| Tengu | "oops". | 07:41 |
| Tengu | and in tht: deployment/cinder/cinder-common-container-puppet.yaml: cinder_enable_iscsi_backend: {get_param: CinderEnableIscsiBackend} | 07:41 |
| Tengu | and apparently, for tripleo-ci-centos-8-scenario002-standalone, I would say we don't override the default value, which is true. | 07:42 |
| *** amoralej|off is now known as amoralej | 07:42 | |
| Tengu | ykarel: -^^ | 07:43 |
| ykarel | Tengu, all ^^ true, but as said exec is not in tags, so it shouldn't execute | 07:43 |
| *** suuuper has joined #tripleo | 07:44 | |
| *** pkopec has joined #tripleo | 07:44 | |
| Tengu | the correct tag we want to check is cinder-support-package due to the dependency in puppet class | 07:45 |
| Tengu | but indeed.... doesn't seem to be called, at least in t-h-t. still, I'm now wondering why this code does exist. | 07:46 |
| ykarel | which code? | 07:46 |
| ykarel | puppet | 07:46 |
| ykarel | one? | 07:46 |
| Tengu | yup | 07:46 |
| ykarel | puppet scope is outside of tripleo | 07:47 |
| ykarel | packstack/puppet-openstack-integration uses those | 07:47 |
| ykarel | those do not rely on ansible | 07:47 |
| *** ysandeep|rover is now known as ysandeep|lunch | 07:48 | |
| Tengu | tripleo sets things for puppet - we should set it to false for puppet and ensure only ansible is actually launched, like explicitely. tagging is nice, but when you check params and other things, it's just messing around -.- | 07:48 |
| Tengu | over-engineering things is bad. | 07:48 |
| tkajinam | I think we can have that module in puppet-cinder, but it doesn't make sense to include it in puppet-tripleo | 07:48 |
| Tengu | and that's what we keep doing in tripleo -.- | 07:48 |
| ykarel | if we set to false we will likely miss other tasks | 07:49 |
| Tengu | the mix with ansible + puppet is creating confusion - and that's bad, really. well, just check the issues we get, the time we're taking to root-cause them and all | 07:51 |
| Tengu | we shouldn't duplicate things. Replacing is fine though. Here, in this case, that's nasty duplication. | 07:52 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Log stdout of HA containers https://review.opendev.org/719773 | 07:52 |
| openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Do not manage pv/vg for cinder iscsi backend https://review.opendev.org/720139 | 07:52 |
| *** jpena|off is now known as jpena | 07:53 | |
| ykarel | yes that can be cleaned up | 07:53 |
| ykarel | usage of setup_test_volume i mean | 07:53 |
| ykarel | in puppet-tripleo | 07:53 |
| tkajinam | just submitted a patch to remove it :-) | 07:53 |
| ykarel | okk cool | 07:53 |
| *** jpich has joined #tripleo | 07:54 | |
| Tengu | thank you :) | 07:54 |
| ykarel | possibly it was used before switching to ansible | 07:54 |
| ykarel | and missed cleanup | 07:54 |
| *** ykarel is now known as ykarel|lunch | 07:54 | |
| tkajinam | yeah agreed | 07:54 |
| Tengu | probably.. guess we should take a release-cycle in order to do some deep, deep scrubbing. | 07:55 |
| Tengu | we'd probably find some old treasures :) | 07:55 |
| *** jmasud has quit IRC | 07:56 | |
| tkajinam | that's what I recently found in all puppet modules :-P | 07:57 |
| tkajinam | I stopped counting all deprecated parameters and removed parameters I found there :-P | 07:57 |
| *** jmasud has joined #tripleo | 07:57 | |
| Tengu | tkajinam: might be interesting to actually get the count in launchpad... this might trigger a discussion in order to actually address this issue. | 07:58 |
| Tengu | things are getting more and more confusing | 07:58 |
| tkajinam | Tengu, I agree with you. | 07:59 |
| Tengu | if everyone finds things but doesn't communicate, nothing will be done | 07:59 |
| tkajinam | yeah that's true | 08:02 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ansible stable/train: Switch install-docker with ensure-docker https://review.opendev.org/720141 | 08:04 |
| *** slaweq_ is now known as slaweq | 08:10 | |
| *** lucasagomes has joined #tripleo | 08:14 | |
| *** skramaja has quit IRC | 08:17 | |
| *** skramaja has joined #tripleo | 08:17 | |
| *** ccamacho has quit IRC | 08:20 | |
| *** tkajinam has quit IRC | 08:21 | |
| *** jbadiapa has joined #tripleo | 08:28 | |
| *** ykarel|lunch is now known as ykarel | 08:37 | |
| *** alexmcleod has joined #tripleo | 08:39 | |
| *** ysandeep|lunch is now known as ysandeep|rover | 08:40 | |
| *** ccamacho has joined #tripleo | 08:40 | |
| *** ccamacho has quit IRC | 08:40 | |
| *** ratailor has quit IRC | 08:41 | |
| *** ratailor has joined #tripleo | 08:42 | |
| *** skramaja has quit IRC | 08:42 | |
| *** skramaja has joined #tripleo | 08:42 | |
| *** ccamacho has joined #tripleo | 08:45 | |
| zbr | gchamoul: why removing +W from https://review.opendev.org/#/c/717829/ ? | 08:47 |
| *** dtantsur|afk is now known as dtantsur | 08:49 | |
| gchamoul | zbr: yes I know it was too late | 08:52 |
| zbr | nopb, i added it. | 08:52 |
| gchamoul | zbr: just wanted to let you add the link in the commit msg | 08:53 |
| zbr | i doubt that change can break anything. | 08:53 |
| zbr | ahh. i added it to the next ones. | 08:53 |
| zbr | life's too short ;) | 08:53 |
| *** jmasud has quit IRC | 08:54 | |
| gchamoul | zbr: there are worse ... | 08:54 |
| gchamoul | :d | 08:54 |
| *** jmasud has joined #tripleo | 08:56 | |
| *** paramite has quit IRC | 08:56 | |
| *** holser has quit IRC | 09:03 | |
| *** holser has joined #tripleo | 09:05 | |
| *** holser has quit IRC | 09:06 | |
| *** jmasud has quit IRC | 09:07 | |
| *** holser has joined #tripleo | 09:10 | |
| *** d34dh0r53 has quit IRC | 09:15 | |
| *** apetrich has joined #tripleo | 09:16 | |
| *** pcaruana has quit IRC | 09:25 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Log stdout of HA containers https://review.opendev.org/719773 | 09:30 |
| *** holser has quit IRC | 09:37 | |
| *** pcaruana has joined #tripleo | 09:38 | |
| *** holser has joined #tripleo | 09:41 | |
| *** florianf has joined #tripleo | 09:44 | |
| *** ccamacho has quit IRC | 09:44 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: [install-deps] Use venv instead of virtualenv when possible https://review.opendev.org/707215 | 09:48 |
| *** gfidente|afk is now known as gfidente | 09:49 | |
| *** artom has joined #tripleo | 09:51 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move *OvercloudConfigAction functionality to utils https://review.opendev.org/720166 | 09:52 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 09:56 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Wait for compute services before sanity check. https://review.opendev.org/720169 | 09:59 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Wait for compute services before sanity check. https://review.opendev.org/720169 | 10:01 |
| *** ccamacho has joined #tripleo | 10:05 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 10:09 |
| *** pcaruana has quit IRC | 10:11 | |
| ysandeep|rover | #tripleo can i please get some reviews on https://review.opendev.org/#/c/720132/ to clear check/gate centos8 ci issue - lp#1872881 | 10:12 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 10:15 |
| *** rpittau is now known as rpittau|bbl | 10:23 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Log stdout of HA containers https://review.opendev.org/719773 | 10:23 |
| *** pcaruana has joined #tripleo | 10:30 | |
| *** jcapitao is now known as jcapitao_lunch | 10:38 | |
| *** skramaja has quit IRC | 10:42 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: WIP: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 10:46 |
| *** derekh has joined #tripleo | 10:49 | |
| *** jtomasek has quit IRC | 10:56 | |
| *** ysandeep|rover is now known as ysandeep|coffee | 11:00 | |
| *** jtomasek has joined #tripleo | 11:02 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Remove tripleo-buildimage-overcloud-hardened-full-centos-8 job https://review.opendev.org/719766 | 11:07 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 11:08 |
| *** cdearborn has joined #tripleo | 11:15 | |
| *** ysandeep|coffee is now known as ysandeep|rover | 11:17 | |
| openstackgerrit | Merged openstack/paunch stable/train: Process labels before building container run args https://review.opendev.org/718459 | 11:17 |
| openstackgerrit | Merged openstack/paunch stable/queens: Process labels before building container run args https://review.opendev.org/718463 | 11:17 |
| bandini | p/go 23 | 11:20 |
| *** pkopec_ has joined #tripleo | 11:26 | |
| *** pkopec has quit IRC | 11:26 | |
| *** weshay|ruck changes topic to "CI status: Upstream ORANGE 1872881 | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 11:26 | |
| weshay|ruck | ysandeep|rover++ | 11:28 |
| ysandeep|rover | weshay|ruck++ ykarel++ | 11:28 |
| *** jpena is now known as jpena|lunch | 11:30 | |
| *** iurygregory is now known as iurygregory_afk | 11:31 | |
| *** paramite has joined #tripleo | 11:49 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: Make /var/lib/mistral traversable by all users https://review.opendev.org/717320 | 11:50 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Set strategy free for upgrade_steps_playbook https://review.opendev.org/716676 | 11:51 |
| *** dsneddon has quit IRC | 11:53 | |
| *** ekultails has joined #tripleo | 11:54 | |
| cloudnull | mornings | 11:56 |
| *** jcapitao_lunch is now known as jcapitao | 11:58 | |
| *** udesale_ has joined #tripleo | 12:04 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Parametrize patch strip option in workarounds. https://review.opendev.org/720187 | 12:04 |
| *** udesale has quit IRC | 12:06 | |
| *** rh-jelabarre has joined #tripleo | 12:07 | |
| openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Remove code for handling multiple playbooks https://review.opendev.org/720189 | 12:08 |
| *** amoralej is now known as amoralej|lunch | 12:10 | |
| *** rfolco has joined #tripleo | 12:17 | |
| *** Goneri has joined #tripleo | 12:21 | |
| openstackgerrit | Sean McGinnis proposed openstack/tripleo-repos master: Use unittest.mock instead of third party mock https://review.opendev.org/717406 | 12:23 |
| *** raildo has joined #tripleo | 12:28 | |
| *** jpena|lunch is now known as jpena | 12:33 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: WIP: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 12:38 |
| *** artom has quit IRC | 12:39 | |
| *** Abdallahyas has joined #tripleo | 12:43 | |
| *** yolanda has quit IRC | 12:43 | |
| *** lmiccini has quit IRC | 12:45 | |
| *** abdysn has quit IRC | 12:47 | |
| *** lmiccini has joined #tripleo | 12:49 | |
| *** rpittau|bbl is now known as rpittau | 12:49 | |
| cgoncalves | EmilienM, weshay|ruck: hey! can non-openstack ansible modules in tech preview and with no backware compat guaranteed be used in tripleo-ansible? | 12:50 |
| cgoncalves | in this case, openssl_* ansible modules | 12:51 |
| weshay|ruck | cgoncalves, I'm getting mixed messages but looking for clarity and pushing to help get full support but atm I don't have a good answer | 12:52 |
| cgoncalves | weshay|ruck, hmm, I thought you were pushing only for openstack ansible modules | 12:52 |
| *** ykarel is now known as ykarel|afk | 12:55 | |
| *** pcaruana has quit IRC | 12:56 | |
| *** holser has quit IRC | 13:02 | |
| *** holser has joined #tripleo | 13:04 | |
| *** ratailor has quit IRC | 13:04 | |
| *** amoralej|lunch is now known as amoralej | 13:05 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: Make sure nova_api_ensure_cell0_database_url is deleted. https://review.opendev.org/720090 | 13:08 |
| *** pcaruana has joined #tripleo | 13:09 | |
| *** hkominos has joined #tripleo | 13:11 | |
| hkominos | Hi guys. Quick question . For an upgrade from Rocky --> Stein , it is mentioned in the release nodes that the "external_bridge" tag must be removed altogether from the Roles file. Is that still the case ? | 13:12 |
| *** lbragstad has joined #tripleo | 13:14 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Parametrize patch strip option in workarounds. https://review.opendev.org/720187 | 13:17 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Add ceph config overrides support https://review.opendev.org/719947 | 13:23 |
| *** artom has joined #tripleo | 13:25 | |
| *** abdysn has joined #tripleo | 13:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Migrate inflight validations to native podman healthchecks https://review.opendev.org/720089 | 13:30 |
| *** ysandeep|rover is now known as ysandeep|away | 13:32 | |
| *** Abdallahyas has quit IRC | 13:33 | |
| *** TrevorV has joined #tripleo | 13:37 | |
| *** rcernin has quit IRC | 13:37 | |
| weshay|ruck | cgoncalves, there is a podman module and a few others that there is some background chatter about.. | 13:38 |
| openstackgerrit | Luke Short proposed openstack/python-tripleoclient master: Expose --limit, --skip-tags, and --tags on the CLI. https://review.opendev.org/692421 | 13:41 |
| *** weshay|ruck changes topic to "CI status: Upstream 24hr queue RED 1872881 | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 13:55 | |
| mwhahaha | weshay|ruck: can we clear out the queue to get the tempest fix in | 13:57 |
| *** d34dh0r53 has joined #tripleo | 13:57 | |
| *** mcornea has joined #tripleo | 14:01 | |
| *** ykarel|afk is now known as ykarel | 14:03 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 14:06 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 14:09 |
| mgoddard | cloudnull: hi, know anyone who can help with https://review.opendev.org/#/c/715224/ ? | 14:10 |
| *** jcoufal has joined #tripleo | 14:10 | |
| mgoddard | cloudnull: specifically, with why https://review.opendev.org/#/c/718615/ didn't skip building the image | 14:11 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ansible master: Switch install-docker with ensure-docker https://review.opendev.org/717826 | 14:13 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 14:23 |
| mwhahaha | mgoddard: what are you talking about? are you talking about the 3rd party job? | 14:24 |
| mgoddard | mwhahaha: I need to add a rmq image to train with a different version for the CentOS 8 migration. It won't build for tripleo, so it needs to be excluded from the list of images to build | 14:26 |
| mgoddard | mwhahaha: my second patch was my attempt at doing that, but it didn't work | 14:26 |
| mwhahaha | right i got that, except the tripleo job in check passed | 14:26 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add IronicDhcpv6StatefulAddressCount parameter https://review.opendev.org/720207 | 14:27 |
| *** dmacpher has joined #tripleo | 14:27 | |
| mwhahaha | let me poke at the 3rd party job, the tripleo-ci change was pulled in | 14:29 |
| mgoddard | mwhahaha: yeah, it's the 3rd party job. Although now I think about it, this image should be skipped on CentOS/RHEL 8 | 14:30 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add IronicDhcpv6StatefulAddressCount parameter https://review.opendev.org/720207 | 14:30 |
| *** jmasud has joined #tripleo | 14:30 | |
| *** ysandeep|away is now known as ysandeep | 14:31 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 14:32 |
| *** bogdando has quit IRC | 14:39 | |
| *** jmasud has quit IRC | 14:41 | |
| *** hkominos has quit IRC | 14:43 | |
| *** jmasud has joined #tripleo | 14:43 | |
| *** tkajinam has joined #tripleo | 14:43 | |
| Tengu | weshay|ruck: heya! shall I create a "specs/victoria" directory in the tripleo-spec repos? | 14:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 14:45 |
| EmilienM | Tengu: very likely | 14:45 |
| mgoddard | mwhahaha: I think I have it | 14:48 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-specs master: Creates Victoria placeholder https://review.opendev.org/720212 | 14:48 |
| Tengu | EmilienM: iirc that's how we do it -^ | 14:48 |
| mwhahaha | mgoddard: well we handle the excludes in our code because for centos8 we don't use docker to builg | 14:48 |
| mwhahaha | mgoddard: so there's probably an issue in our code as well | 14:49 |
| mgoddard | mwhahaha: yeah, I think it's a substring match issue | 14:49 |
| weshay|ruck | Tengu, if you have access that would be great! | 14:49 |
| weshay|ruck | thank you | 14:49 |
| weshay|ruck | if not I'll rock it out | 14:49 |
| mwhahaha | https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/kolla_builder.py#L313-L316 | 14:50 |
| mwhahaha | is our check | 14:50 |
| mwhahaha | we look for the exclude list in image name | 14:50 |
| mwhahaha | i wonder if it's because the number bits | 14:50 |
| mgoddard | mwhahaha: I think it's actually this: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/kolla_builder.py#L509 | 14:51 |
| Tengu | weshay|ruck: https://review.opendev.org/#/c/720212/ | 14:51 |
| mgoddard | mwhahaha: and https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/kolla_builder.py#L411 needs ^$ | 14:51 |
| Tengu | weshay|ruck: added you as reviewer | 14:51 |
| mgoddard | mwhahaha: I'm putting together a patch, let's see how it goes | 14:51 |
| openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Do not manage pv/vg for cinder iscsi backend https://review.opendev.org/720139 | 14:51 |
| mwhahaha | mgoddard: sounds good | 14:51 |
| weshay|ruck | Tengu, thank you! | 14:51 |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Do not manage pv/vg for cinder iscsi backend by puppet https://review.opendev.org/720215 | 14:53 |
| abishop | ysandeep: thx for posting workaround for https://bugs.launchpad.net/tripleo/+bug/1872881 | 14:53 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,In progress] - Assigned to Sandeep Yadav (sandeepyadav93) | 14:53 |
| abishop | ysandeep: I have a full solution in mind, and want to coordinate w/ if you were already working on it | 14:54 |
| *** marbindrakon has quit IRC | 14:54 | |
| abishop | tkajinam: ^^ | 14:54 |
| *** dtantsur is now known as dtantsur|brb | 14:55 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: print message if no container action https://review.opendev.org/720217 | 14:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: print message if no container action https://review.opendev.org/720217 | 14:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 14:56 |
| tkajinam | abishop, I'm not working about the actual solution. I submitted a possible cleanup I found during debugging the issue, but that didn't solve the problem | 14:57 |
| openstackgerrit | Mark Goddard proposed openstack/tripleo-common stable/train: WIP: Use a full string match for container images https://review.opendev.org/720218 | 14:57 |
| tkajinam | abishop, and I have no idea about the real root cause now | 14:57 |
| openstackgerrit | Mark Goddard proposed openstack/tripleo-common stable/train: WIP: Use a full string match for container images https://review.opendev.org/720218 | 14:58 |
| ykarel | abishop, by chance u got the root cause? | 14:58 |
| tkajinam | abishop, as I posted on https://review.opendev.org/#/c/720139/, what I've confirmed so far is removing module to manage lvm doesn't solve current failure in standalone job, as we see it still fails with the patch. | 14:58 |
| abishop | tkajinam: something (not sure what) is "taking" /dev/loop2 before cinder, and my fix is to eliminate hardcoded loop device number | 14:58 |
| tkajinam | abishop, ahhh, yeah I didn't check that point | 14:59 |
| abishop | the "creates: /dev/loop2" causes the play to be skipped if that device is in use | 15:00 |
| abishop | but the big issue is the code should not assume that specific device is available | 15:00 |
| tkajinam | yeah so we should check actual relations between loop back devices and its backing file | 15:02 |
| tkajinam | to make sure that we have the required loop back device which is backed by cinder data file | 15:02 |
| Tengu | mwhahaha: hmmm... I think we'll want to enable to pass some environment variables, like "http_proxy" and friends, to the operators, especially for the ones running deploy commands.... wdyt? | 15:02 |
| mwhahaha | abishop, tkajinam: i bet it's related to our recent upgrade to puppet 6 where the puppet code is now being executed where it previously wasnt | 15:02 |
| abishop | tkajinam: sort of, my fix will use "losetup -f <file" followed by "losetup -j" to dynamically assign loopback dev | 15:02 |
| Tengu | ykarel: ah, see? :) -^^ | 15:02 |
| *** d34dh0r53 has quit IRC | 15:03 | |
| mwhahaha | Tengu: ehhhhhh no? seems like something that might be better to specify via an env file | 15:03 |
| mwhahaha | Tengu: for the system as a whole | 15:03 |
| abishop | mwhahaha, et al: I agree with patch that removes this from puppet-tripleo | 15:03 |
| ykarel | Tengu, yeap dynamic will solve it, but still i think root cause is unknown, why ci started hitting it now | 15:04 |
| tkajinam | mwhahaha, ahh I miss that update. I think I should add puppet-6 unit test job in that case. | 15:04 |
| Tengu | mwhahaha: yeah-ish-no - but this can be discussed. I need to think a bit more | 15:04 |
| Tengu | ykarel: updated puppet or something? it sounds like a race condition | 15:04 |
| Tengu | anyway, have to drop for today, have some other things to take care elsewhere :) | 15:05 |
| ykarel | mwhahaha, if it's puppet6 why it didn't hit in https://review.opendev.org/#/c/719409/ | 15:05 |
| mwhahaha | ykarel: int he containers? | 15:05 |
| ykarel | Tengu, yes puppet is updated to puppet6 recently | 15:05 |
| mwhahaha | ykarel: not certain the containers updated in that | 15:05 |
| ykarel | mwhahaha, from logs i see puppet: 6.14 | 15:05 |
| mwhahaha | in the container? | 15:05 |
| ykarel | mwhahaha, yes | 15:05 |
| mwhahaha | hmm ok was just a thought | 15:05 |
| ykarel | mwhahaha, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ba9/719409/1/check/tripleo-ci-centos-8-standalone/ba94509/logs/undercloud/var/log/containers/stdouts/cinder_volume_init_bundle.log | 15:06 |
| ykarel | also strange is it hit only in upstream jobs | 15:06 |
| ykarel | third party we didn't hit | 15:06 |
| ykarel | so may be related to infra images | 15:07 |
| tkajinam | IIUC we use puppet installed in container, while we use manifests installed on host | 15:09 |
| tkajinam | so I guess there is something different with puppet installed in container | 15:09 |
| mwhahaha | could also be that loop2 is created somewhere else | 15:10 |
| abishop | mwhahaha: that's my theory | 15:10 |
| mwhahaha | oh well | 15:10 |
| mwhahaha | anyway i cleared out the gate to try and get that THT patch landed | 15:11 |
| *** cdw has joined #tripleo | 15:11 | |
| *** cdw is now known as d34dh0r53 | 15:11 | |
| mwhahaha | the puppet-tripleo bits failed on standalone so it's unlikely to be that | 15:11 |
| abishop | mwhahaha: I won't argue with success (the workaround), but if that dev is actualy in use then I would think the rest of the pvcreate/vgcreate would fail | 15:11 |
| mwhahaha | do we ahve to name it loop2 or can it be anything we want | 15:13 |
| abishop | mwhahaha: anything works, so I'm working on patch that will use "losetup -f" and then more code to find the actual device it chose | 15:14 |
| mwhahaha | like to name it /dev/cinder-lvm-loop or something | 15:15 |
| abishop | the "-f" will let losetup choose the next available loop device number (/dev/loopN) | 15:15 |
| mwhahaha | well that's what i meant if we could change the loop name | 15:16 |
| mwhahaha | so it has to be loopN? | 15:16 |
| abishop | I'm checking now to see what our options are | 15:17 |
| mwhahaha | if you look in the failure log, we can see the loop2 code block does get called | 15:18 |
| mwhahaha | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c8f/717861/5/check/tripleo-ci-centos-8-standalone/c8fa85e/logs/undercloud/var/log/journal.txt | 15:18 |
| mwhahaha | ctrl+f loop2 | 15:18 |
| mwhahaha | so the file doesn't exist | 15:18 |
| mwhahaha | seems odd | 15:18 |
| abishop | mwhahaha: looks like losetup needs the format to be "loopN", but I can work with that | 15:19 |
| ykarel | i checked it needs to be loopN, and that to be till 7, unless and until we modify module | 15:19 |
| ykarel | mwhahaha, strange it's pass in some projects http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-standalone&job_name=tripleo-ci-centos-8-scenario002-standalone | 15:19 |
| mwhahaha | we use 3/4 for ceph | 15:20 |
| ykarel | atleast in CI projects it's passing | 15:20 |
| ykarel | and in periodic pipeline | 15:20 |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 15:22 |
| ykarel | the only thing i can think to know why it's happening only in upstream jobs, by asking a node held | 15:29 |
| ykarel | but now i need to leave, if someone else can check | 15:29 |
| *** ykarel is now known as ykarel|away | 15:29 | |
| *** Goneri has quit IRC | 15:30 | |
| *** Goneri has joined #tripleo | 15:33 | |
| *** iurygregory_afk is now known as iurygregory | 15:41 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/train: swift-external: deprecate External*Url https://review.opendev.org/720230 | 15:42 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 15:42 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 15:43 |
| *** amoralej is now known as amoralej|off | 15:43 | |
| ykarel|away | mwhahaha, i think i got the root cause now, it's likely related to recent updates of mock, so somehow DLRN run creates those /dev/loop[0-11] files now | 15:46 |
| Tengu | abishop, mwhahaha maybe we should split the ansible command in 3 different calls in order to check what's going on - it's easy with the "creates" parameter, and would probably help a bit | 15:46 |
| ykarel|away | since workaround is in place | 15:46 |
| ykarel|away | i will look at that tomorrow now | 15:46 |
| mwhahaha | fun | 15:46 |
| Tengu | ykarel|away: bleh... and mock|dlrn doesn't clean up things? | 15:47 |
| abishop | Tengu: I'm minutes away from posting a patch | 15:47 |
| openstackgerrit | Slawek Kaplonski proposed openstack/tripleo-heat-templates master: Add support for resource provider bandwidth in Neutron config https://review.opendev.org/714464 | 15:47 |
| ykarel|away | Tengu, likely not, anyway it's good not to not hardcode loop2 | 15:47 |
| Tengu | ykarel|away: +1 | 15:47 |
| *** jcoufal has quit IRC | 15:48 | |
| Tengu | BUT..... the loop kernel module has a default limit to the number of loop devices it can create | 15:48 |
| gfidente | EmilienM mwhahaha I picked up your stuff for a backport here https://review.opendev.org/720230 | 15:48 |
| Tengu | let's just hope it's not 11.... | 15:48 |
| gfidente | EmilienM mwhahaha so we start documenting it using the new params name | 15:49 |
| mwhahaha | k | 15:49 |
| Tengu | oh, btw.... I'm close to a full success with tripleo-lab + operator + OSP deploy | 15:50 |
| Tengu | mwhahaha: -^ that will make you happy :). It works© | 15:50 |
| mwhahaha | HEH | 15:50 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Remove hardcoded reference to cinder LVM loopback device https://review.opendev.org/720232 | 15:51 |
| abishop | Tengu: ^^ | 15:51 |
| fultonj | openstack overcloud deploy now runs ansible directly from tripleo client how to i pass verbosity options to that ansible run? | 15:51 |
| fultonj | was tripleo docs updated for that? | 15:51 |
| fultonj | ekultails: ^ ? | 15:52 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [FFWD2] Don't run leapp if we are already RHEL8 https://review.opendev.org/720233 | 15:52 |
| Tengu | abishop: can't we split the lvm commands into 2 distinct tasks? | 15:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 15:52 |
| *** jcoufal has joined #tripleo | 15:52 | |
| mwhahaha | abishop: probably need to check that in dry run mode, it probably needs some check_mode: false in a few places | 15:52 |
| Tengu | mwhahaha: true that | 15:53 |
| *** jmasud has quit IRC | 15:53 | |
| *** tkajinam has quit IRC | 15:53 | |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: (follow-up) run check mode for more molecule tests https://review.opendev.org/719969 | 15:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 15:58 |
| *** bdodd has quit IRC | 15:58 | |
| fultonj | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L704 | 15:58 |
| openstackgerrit | Merged openstack/tripleo-specs master: Creates Victoria placeholder https://review.opendev.org/720212 | 15:58 |
| fultonj | so there's no argument ^ but the variable exists | 15:59 |
| *** abdysn has quit IRC | 15:59 | |
| abishop | Tengu: I guess it could be split into two tasks, but I was trying to minimize changes (btw, I didn't create the original tht code) | 16:00 |
| abishop | mwhahaha: sorry, I'm not understanding you (check mode?) | 16:00 |
| *** bdodd has joined #tripleo | 16:01 | |
| Tengu | abishop: ansible-playbook --check - it's a feature used in order to check the playbooks before running them | 16:01 |
| Tengu | "command" module might be tricky with that check mode, there are examples within t-h-t | 16:02 |
| *** marios has quit IRC | 16:04 | |
| EmilienM | Tengu: ahve you seen that? | 16:05 |
| EmilienM | https://7ca510d0ea13e3c0c3d0-1751ddddfd5edaf634ba51a41bf8513f.ssl.cf5.rackcdn.com/720132/1/gate/tripleo-ci-centos-8-undercloud-containers/778f969/job-output.txt | 16:05 |
| EmilienM | ERROR:dlrn:Received exception Error in build_rpm_wrapper for validations-common: | 16:05 |
| fultonj | cloudnull: i'm trying to debug your cli-update-params.yaml playbook [1] because I it's failing for me on the last task [2] | 16:07 |
| fultonj | [1] https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/playbooks/cli-update-params.yaml#L41-L47 | 16:07 |
| fultonj | [2] http://paste.openstack.org/show/792116/ | 16:07 |
| *** lmiccini has quit IRC | 16:07 | |
| *** maciejjozefczyk has quit IRC | 16:09 | |
| cloudnull | fultonj - https://review.opendev.org/#/c/719466 - I have a series of reviews that is changing a lot of that, adding formula modules, filters, and creating a role. | 16:09 |
| cloudnull | mind giving that change a look ? | 16:09 |
| *** lucasagomes has quit IRC | 16:09 | |
| cloudnull | still all very much a WIP , but making progress. | 16:09 |
| fultonj | cloudnull: yes, i am going to dive into that when i get something else fixed which is currently blocked by that issue [2]. But this is releated? | 16:10 |
| *** dtantsur|brb is now known as dtantsur | 16:11 | |
| cloudnull | hum, ive seen that error before... | 16:11 |
| * cloudnull looking at something | 16:12 | |
| openstackgerrit | Mark Goddard proposed openstack/tripleo-common master: Use a full string match for container images https://review.opendev.org/720236 | 16:12 |
| mwhahaha | Tengu, matbu: validations-common is breaking in dlrn builds which fubars any changes in gate after it | 16:12 |
| mwhahaha | https://7ca510d0ea13e3c0c3d0-1751ddddfd5edaf634ba51a41bf8513f.ssl.cf5.rackcdn.com/720132/1/gate/tripleo-ci-centos-8-undercloud-containers/778f969/logs/delorean_logs/component/tripleo/99/05/99050941f49a8752c8b2a7f75af12039f21c1afe_dev/ | 16:12 |
| *** jcoufal has quit IRC | 16:12 | |
| fultonj | I imagine cli-update-params.yaml might do something with derrived params, but if i'm not using derived params wouldn't that not be releated? | 16:13 |
| mgoddard | mwhahaha: https://review.opendev.org/#/c/720236/ seemed to work | 16:13 |
| mwhahaha | mgoddard: k i'll have to see the impact of that because i know it's useful to not use the full string, eg. nova stops all nova containers from being built | 16:13 |
| fultonj | i'm doing a DCN deployment where i'm deploying a second stack which uses exported data from the first stack | 16:14 |
| mwhahaha | fultonj, cloudnull: wasn't that the error was fixed last week that was breaking all of ovb? | 16:14 |
| mgoddard | mwhahaha: it's more about how the list of tripleo container images gets mapped to regexes for kolla-build | 16:15 |
| cloudnull | fultonj do you have this change locally https://github.com/openstack/python-tripleoclient/commit/a947b57094f2fd5da6d54e1c98b2aa947bb37914 ? | 16:15 |
| mwhahaha | where we switched to use an env file passed to ansible-runner | 16:15 |
| mgoddard | rather than exclude | 16:15 |
| mwhahaha | mgoddard: yea possible, i'll check that out a bit more in depth. At the moment i think it's fine | 16:16 |
| *** psachin has quit IRC | 16:17 | |
| fultonj | python3-tripleoclient-13.1.1-0.20200404091914.624a61f.el8.noarch | 16:18 |
| fultonj | i'm using ^ | 16:18 |
| fultonj | no newer rpm, let me check if it contains that patch | 16:19 |
| fultonj | https://github.com/openstack/python-tripleoclient/compare/13.2.0...master | 16:19 |
| fultonj | i don't think i have that patch | 16:19 |
| fultonj | let me see if i can get a newer rpm | 16:20 |
| *** jcapitao has quit IRC | 16:20 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 16:20 |
| *** jcoufal has joined #tripleo | 16:20 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 16:21 |
| ekultails | fultonj: The ansible-playbook command inherits the verbosity of the OpenStack CLI. | 16:23 |
| *** jmasud has joined #tripleo | 16:24 | |
| fultonj | ekultails: which looks like it works the same way as per 'openstack --help | grep verbosity' | 16:25 |
| fultonj | ekultails: thanks! | 16:25 |
| fultonj | cloudnull: thanks very much, i updated and now it's working | 16:25 |
| fultonj | ekultails: so i guess we need --config-download-verbosity since config-download doesn't inherit the verbosity of the OpenStack CLI? | 16:26 |
| cloudnull | ++ fultonj | 16:28 |
| *** jpich has quit IRC | 16:30 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 16:30 |
| *** marbindrakon has joined #tripleo | 16:31 | |
| *** rpittau is now known as rpittau|afk | 16:33 | |
| *** maciejjozefczyk has joined #tripleo | 16:35 | |
| EmilienM | mwhahaha, weshay|ruck : do we have RCA for https://bugs.launchpad.net/tripleo/+bug/1872881 ? | 16:36 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 16:36 |
| weshay|ruck | EmilienM, ysandeep said he was still looking for the rc this morning when we spoke about it | 16:36 |
| *** evrardjp has quit IRC | 16:37 | |
| weshay|ruck | EmilienM, Alan just added https://review.opendev.org/#/c/720232/ | 16:37 |
| *** evrardjp has joined #tripleo | 16:37 | |
| *** jmasud has quit IRC | 16:37 | |
| *** maciejjozefczyk has quit IRC | 16:41 | |
| mwhahaha | EmilienM: weshay|ruck: ykarel|away indicated it might be mock for dlrn | 16:42 |
| *** jcoufal has quit IRC | 16:45 | |
| ekultails | fultonj: Sorry if my patch was confusing. We were trying to address issues with Mistral and Zaqar in <= Train. https://launchpad.net/bugs/1872823 | 16:46 |
| openstack | Launchpad bug 1872823 in tripleo "Overcloud Deploy Hangs During a Large Deployment" [High,In progress] - Assigned to Luke Short (ekultails) | 16:46 |
| ekultails | I'll most likely abandon the --config-download-verbosity patch. | 16:46 |
| ekultails | (And replace it with an alternative patch.) | 16:46 |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Do not manage pv/vg for cinder iscsi backend by puppet https://review.opendev.org/720215 | 16:47 |
| *** bandini has quit IRC | 16:47 | |
| fultonj | ekultails: i see, sorry yes, you did state that in the commit message | 16:48 |
| *** udesale_ has quit IRC | 16:49 | |
| fultonj | ekultails: so i gather then that config-download also inherrits the openstack client verbosity | 16:49 |
| ekultails | fultonj: Yeap. Currently, in all releases, `openstack overcloud -v` should be passed along as `ansible-playbook -vv` for any usage of Ansible (the OpenStack client defaults to no -v being 1 verbosity and --quiet being 0). | 16:51 |
| *** dtantsur is now known as dtantsur|afk | 16:53 | |
| fultonj | ekultails: ok, thanks for clarifying. i guess the docs will get updated to mention this? | 16:53 |
| fultonj | https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/install_overcloud. | 16:54 |
| fultonj | https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/install_overcloud.html | 16:54 |
| fultonj | or maybe there's already a story board item for that | 16:55 |
| ekultails | fultonj: +1 Good point, we should probably should mention that. It's come up a few in the past couple of months. We also tweaked how verbosity works in master so the logic is slightly different and not completely intuitive. I'll add some docs. | 16:56 |
| fultonj | thanks ekultails | 16:56 |
| *** jcoufal has joined #tripleo | 16:58 | |
| *** d34dh0r53 has quit IRC | 17:04 | |
| *** d34dh0r53 has joined #tripleo | 17:07 | |
| *** jmasud has joined #tripleo | 17:09 | |
| *** jpena is now known as jpena|off | 17:10 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Wait for compute services before sanity check. https://review.opendev.org/720169 | 17:16 |
| *** derekh has quit IRC | 17:17 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 17:18 |
| *** suuuper has quit IRC | 17:24 | |
| *** yolanda has joined #tripleo | 17:27 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Migrate inflight validations to native podman healthchecks https://review.opendev.org/720089 | 17:28 |
| EmilienM | zbr: why don't we run molecule jobs with --debug? | 17:34 |
| EmilienM | I'm trying to see where to enable it | 17:34 |
| EmilienM | looks like in tests/test_molecule.py | 17:35 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: DNM - run molecule with --debug https://review.opendev.org/720253 | 17:36 |
| cloudnull | EmilienM ++ that would be the place to add it | 17:36 |
| EmilienM | i wonder if we want to make it the default | 17:36 |
| cloudnull | seems sensible | 17:37 |
| * cloudnull doesn't know if the output is too much | 17:37 | |
| cloudnull | but makes sense, and should be able to better enable folks to troubleshoot jobs without having to run the tests locally . | 17:37 |
| *** gfidente is now known as gfidente|afk | 17:37 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: DNM - run molecule with --debug https://review.opendev.org/720253 | 17:40 |
| EmilienM | cloudnull: so my current issue is that i can run molecule successfuly locally but it fails in check | 17:40 |
| EmilienM | and i know the ansible debug will tell me why it fails | 17:40 |
| cloudnull | ++ | 17:42 |
| cloudnull | interesting that it passes locally ? | 17:42 |
| cloudnull | OS differences ? | 17:42 |
| EmilienM | same OS | 17:42 |
| *** dpawlik has quit IRC | 17:48 | |
| EmilienM | cloudnull: yeah --debug worked: https://f2130c99ce13dfbf575d-33179f0f89ff01c931f1a595d9a195a6.ssl.cf5.rackcdn.com/720253/2/check/tripleo-ansible-centos-8-molecule-tripleo_container_manage/8453766/reports.html | 17:54 |
| cloudnull | nice, that's a lot of good output | 18:01 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-common master: Use healthcheck_port for ironic_inspector_dnsmasq healthcheck https://review.opendev.org/720258 | 18:02 |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 18:03 |
| *** dsneddon has joined #tripleo | 18:11 | |
| *** dsneddon has quit IRC | 18:16 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: DNM - run molecule with --debug https://review.opendev.org/720253 | 18:27 |
| mwhahaha | weshay|ruck: scenario010 looks broke for train in the gate | 18:31 |
| *** alexmcleod has quit IRC | 18:31 | |
| weshay|ruck | k.. looking in a sec.. in 1-1.. lots of 1-1s | 18:34 |
| cloudnull | anyone around to give https://review.opendev.org/#/c/714217/ a push | 18:35 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: [Train only] Fix misused timeout values in the deployment workflow https://review.opendev.org/718339 | 18:35 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements master: overcloud-compute: add ndctl package to manage NVDIMMs https://review.opendev.org/719957 | 18:35 |
| openstackgerrit | Merged openstack/tripleo-ci master: don't narrow the grep too much in checking container builds https://review.opendev.org/720078 | 18:35 |
| * fultonj looking | 18:36 | |
| fultonj | cloudnull: i'm going to try to use https://review.opendev.org/#/c/714217 and see what I get | 18:39 |
| fultonj | and see if i can get started on my hci module derrive parm module | 18:39 |
| cloudnull | ++ | 18:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 18:40 |
| fultonj | i'm sure i'll have lots of questions :) | 18:40 |
| cloudnull | the underlying playbook is still effectively "hello world" but the interface should work | 18:40 |
| fultonj | cloudnull: right so I want to see "hello world" in my deployment plan | 18:41 |
| openstackgerrit | Mark Goddard proposed openstack/tripleo-common master: Use a full string match for container images https://review.opendev.org/720236 | 18:41 |
| cloudnull | 👍 | 18:41 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [FFWD2] Don't run leapp if we are already RHEL8 https://review.opendev.org/720233 | 18:45 |
| *** florianf has quit IRC | 18:48 | |
| *** jcoufal has quit IRC | 18:49 | |
| weshay|ruck | mwhahaha, if it is.. it's fresh.. NEW.. exciting http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario010-standalone&pipeline=gate | 18:53 |
| * weshay|ruck looks at details | 18:53 | |
| mwhahaha | yea | 18:55 |
| weshay|ruck | penstack image create --disk-format raw --container-format bare --tag amphora-image --file /tmp/ansible.dJ7985/amphora.img --property hw_architecture=x86_64 --private | 18:55 |
| weshay|ruck | failed | 18:55 |
| weshay|ruck | Read timed out. (read timeout=600.0)\", \"stderr_lines\": [\"Error communicating with http://192.168.24.1:9292/v2/images/c9b93c62-6a4d-4c41-9e0a-ef9bfd15b305: | 18:56 |
| weshay|ruck | I would guess that's a hiccup and will monitor it | 18:56 |
| *** sanjayu__ has quit IRC | 19:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps-tasks-step-1: update startup-configs with latest hashes https://review.opendev.org/720275 | 19:28 |
| openstackgerrit | Harald Jensås proposed openstack/openstack-virtual-baremetal master: radvd as timesever https://review.opendev.org/713077 | 19:32 |
| *** osmanlicilegi has quit IRC | 19:45 | |
| *** hkominos has joined #tripleo | 19:48 | |
| *** jmasud has quit IRC | 19:49 | |
| *** yolanda has quit IRC | 19:50 | |
| *** jmasud has joined #tripleo | 19:52 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Rename loopback creates file https://review.opendev.org/720132 | 19:55 |
| EmilienM | gate should be better now ^ | 19:56 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: create CentOS-8 train release config https://review.opendev.org/717850 | 19:59 |
| EmilienM | weshay|ruck: should we backport https://review.opendev.org/#/c/720132/ ? | 20:00 |
| *** EmilienM changes topic to "CI status: green | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 20:01 | |
| dciabrin | EmilienM, mind doing a little push for https://review.opendev.org/#/c/719971/ ? I think it shouldn't fail anymore now that https://review.opendev.org/#/c/720132/ got merged. | 20:03 |
| weshay|ruck | EmilienM, train is working currently... let's see what Sandeep says about root cause first | 20:03 |
| *** yolanda has joined #tripleo | 20:03 | |
| EmilienM | dciabrin: did recheck | 20:04 |
| EmilienM | feel free to push button when green | 20:04 |
| weshay|ruck | mwhahaha, scenario010 has now failed twice.. in a row :( | 20:05 |
| EmilienM | mwhahaha: i restored patches and did recheck | 20:05 |
| weshay|ruck | opening bug | 20:05 |
| EmilienM | damn | 20:05 |
| EmilienM | what is it again? | 20:05 |
| *** slaweq has quit IRC | 20:08 | |
| *** slaweq has joined #tripleo | 20:08 | |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1873067 | 20:09 |
| openstack | Launchpad bug 1873067 in tripleo "openstack image create --disk-format raw --container-format bare --tag amphora-image --file /tmp/ansible.JI3rrX/amphora.img fails w/ read timeout" [Critical,Triaged] | 20:09 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Log stdout of HA containers https://review.opendev.org/719773 | 20:10 |
| EmilienM | default] creating image d8313837-c7a9-4586-8d29-46f7c007ecd5 with order 23 and size 0 add /usr/lib/python2.7/site-packages/glance_store/_drivers/rbd.py:511 | 20:21 |
| EmilienM | 2020-04-15 16:32:37.143 66 WARNING glance_store._drivers.rbd [req-97df3555-4db5-409c-83df-ff432044042d 06b212c0c1f3404796dbce1af0b37026 16917f64d2d1443597b56439e17030ae - default default] since image size is zero we will be doing resize-before-write for each chunk which will be considerably slower than normal | 20:22 |
| weshay|ruck | ya | 20:22 |
| weshay|ruck | but assume we see that in working jobs as well | 20:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: utils/config: allows a when to have boolean conditions https://review.opendev.org/720283 | 20:23 |
| weshay|ruck | it did fail in two diff clouds too | 20:23 |
| EmilienM | weshay|ruck: maybe it doesn't fail but it's on the edge to fail | 20:23 |
| EmilienM | maybe there is an optim to run so it's faster | 20:23 |
| EmilienM | idk | 20:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Migrate inflight validations to native podman healthchecks https://review.opendev.org/720089 | 20:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Migrate inflight validations to native podman healthchecks https://review.opendev.org/720089 | 20:23 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Switch install-docker with ensure-docker https://review.opendev.org/720141 | 20:27 |
| *** slaweq has quit IRC | 20:28 | |
| EmilienM | weshay|ruck: https://opendev.org/openstack/glance_store/src/branch/master/glance_store/_drivers/rbd.py#L513-L515 | 20:28 |
| weshay|ruck | EmilienM, aye.. so we suspect the image is missing eh? | 20:29 |
| EmilienM | I'm digging | 20:29 |
| weshay|ruck | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/octavia-amphora-download/tasks/main.yml#L8 | 20:30 |
| EmilienM | it fails during "Configure octavia on overcloud" which runs on standalone | 20:30 |
| EmilienM | this should be renamed at some point | 20:30 |
| weshay|ruck | http://images.rdoproject.org/octavia/train/amphora-x64-haproxy-centos.qcow2 | 20:30 |
| weshay|ruck | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/octavia-amphora-download/tasks/main.yml#L33 | 20:31 |
| weshay|ruck | nothing to check that it downloaded correctly | 20:31 |
| *** mmethot has joined #tripleo | 20:34 | |
| EmilienM | weshay|ruck: well nothing to check if image would be downloaded correctly | 20:34 |
| EmilienM | good practice is to publish md5 file | 20:34 |
| EmilienM | so we can download it and compare with downloaded file. | 20:34 |
| weshay|ruck | agree | 20:34 |
| EmilienM | let me dig | 20:34 |
| EmilienM | weshay|ruck: the image was downloaded fine | 20:35 |
| EmilienM | http://paste.openstack.org/show/792185/ | 20:35 |
| EmilienM | it took 45s to do it | 20:35 |
| EmilienM | so it's not a 0b image | 20:35 |
| weshay|ruck | 0:00:00.075) | 20:35 |
| weshay|ruck | don't think so | 20:36 |
| EmilienM | no it's the previous task | 20:36 |
| abishop | mwhahaha: https://review.opendev.org/720232 is green, does that mean check_mode stuff is OK as is? | 20:36 |
| EmilienM | welcome to ansible | 20:36 |
| EmilienM | the timestamp is for the previous task | 20:36 |
| mwhahaha | abishop: no, we don't have a ci job for it | 20:36 |
| weshay|ruck | ya.. ur right | 20:36 |
| weshay|ruck | 44 seconds is quick too | 20:36 |
| EmilienM | abishop: hey | 20:36 |
| weshay|ruck | for 460M | 20:36 |
| mwhahaha | abishop: well we do but it's downstream | 20:36 |
| EmilienM | weshay|ruck: no it's ok | 20:36 |
| EmilienM | weshay|ruck: in my laptop it took 5 seconds at 87MB/s | 20:36 |
| weshay|ruck | ah k | 20:36 |
| EmilienM | abishop: while you're here :D | 20:36 |
| EmilienM | abishop: how familiar are you with glance_store/rbd backend | 20:37 |
| abishop | I can toss in a couple of check_mode: no in the command plays | 20:37 |
| * abishop ducks | 20:37 | |
| mwhahaha | abishop: emilien will help with check mode if you solve his octavia problems | 20:37 |
| * mwhahaha runs away | 20:37 | |
| EmilienM | what's the context with check_mode? | 20:38 |
| abishop | EmilienM: how can I help? something failing, I assume | 20:38 |
| EmilienM | I've seen bad practice on it recently | 20:38 |
| EmilienM | abishop: I'm digging https://bugs.launchpad.net/tripleo/+bug/1873067 | 20:38 |
| openstack | Launchpad bug 1873067 in tripleo "openstack image create --disk-format raw --container-format bare --tag amphora-image --file /tmp/ansible.JI3rrX/amphora.img fails w/ read timeout" [Critical,Triaged] | 20:38 |
| mwhahaha | EmilienM: https://review.opendev.org/#/c/720232/ i think has check mode problems | 20:38 |
| EmilienM | abishop: and noticed that log : "since image size is zero we will be doing resize-before-write for each chunk which will be considerably slower than normal" | 20:38 |
| EmilienM | abishop: https://9d2f1bd4e91979fa479a-218ec341821d13471e04f43a25678299.ssl.cf2.rackcdn.com/719368/1/gate/tripleo-ci-centos-7-scenario010-standalone/a2228b7/logs/undercloud/var/log/containers/glance/api.log | 20:38 |
| EmilienM | mwhahaha: ok will look | 20:38 |
| EmilienM | mwhahaha: oh yeah... i'll comment | 20:39 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Skip operating system upgrade tasks via OperatingSystemUpgrade param. https://review.opendev.org/713330 | 20:40 |
| abishop | EmilienM: I recall this coming up in discussion w/ glance folks, so let me work my contacts and see what I can learn | 20:40 |
| EmilienM | abishop: commented in https://review.opendev.org/#/c/720232/ | 20:40 |
| EmilienM | abishop: thx | 20:41 |
| *** dciabrin has quit IRC | 20:42 | |
| EmilienM | weshay|ruck: there is a way of fixing it probably | 20:44 |
| EmilienM | Error communicating with http://192.168.24.1:9292/v2/images/d8313837-c7a9-4586-8d29-46f7c007ecd5: HTTPConnectionPool(host='192.168.24.1', port=9292): Read timed out. (read timeout=600.0)\ | 20:44 |
| *** jmasud has quit IRC | 20:44 | |
| EmilienM | although I wonder why we have this: | 20:44 |
| EmilienM | The 'locations' list of image d8313837-c7a9-4586-8d29-46f7c007ecd5 is empty _format_image | 20:44 |
| weshay|ruck | EmilienM, aye.. /me notes it's only failed twice.. | 20:44 |
| EmilienM | (glance logs) | 20:44 |
| EmilienM | it really looks like the download failed | 20:44 |
| weshay|ruck | :) | 20:44 |
| *** jmasud has joined #tripleo | 20:45 | |
| EmilienM | weshay|ruck: it's sad they don't provide checksum | 20:46 |
| EmilienM | get_url module has support for checksum | 20:46 |
| EmilienM | so in quickstart extras we could download it and ensure it has the right checksum. | 20:46 |
| weshay|ruck | we could also use the role designed to do that | 20:46 |
| weshay|ruck | fetch_images | 20:46 |
| weshay|ruck | but ya know | 20:46 |
| weshay|ruck | +2 +2 | 20:47 |
| EmilienM | what role? | 20:47 |
| *** pcaruana has quit IRC | 20:47 | |
| EmilienM | what's fetch_images ? | 20:47 |
| weshay|ruck | EmilienM, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/fetch-images I think we require a md5 though | 20:47 |
| * weshay|ruck looks | 20:47 | |
| EmilienM | why do we have roles in oooq | 20:47 |
| EmilienM | we should have them in extras imo | 20:48 |
| EmilienM | legacy? | 20:48 |
| EmilienM | anyway | 20:48 |
| weshay|ruck | another country heard from | 20:48 |
| *** hkominos has quit IRC | 20:48 | |
| EmilienM | let me sent a patch | 20:49 |
| EmilienM | you'll like it :P | 20:49 |
| weshay|ruck | :) | 20:49 |
| *** pkopec_ has quit IRC | 20:50 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Skip operating system upgrade tasks via OperatingSystemUpgrade param. https://review.opendev.org/713472 | 20:51 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Skip operating system upgrade tasks via OperatingSystemUpgrade param. https://review.opendev.org/713472 | 20:52 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Skip operating system upgrade tasks via OperatingSystemUpgrade param. https://review.opendev.org/713472 | 20:52 |
| *** jmasud has quit IRC | 20:54 | |
| *** jmasud has joined #tripleo | 20:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Ensure that amphora image isn't 0-sized https://review.opendev.org/720287 | 20:57 |
| EmilienM | weshay|ruck: ^ maybe it'll help | 20:57 |
| EmilienM | who knows | 20:57 |
| weshay|ruck | 0 bad.. 1 good | 20:58 |
| weshay|ruck | lolz | 20:58 |
| weshay|ruck | :) | 20:58 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add ability to write scripts https://review.opendev.org/716093 | 20:58 |
| EmilienM | weshay|ruck: lol yeah | 20:59 |
| EmilienM | weshay|ruck: well glance-store reports it's empty so | 20:59 |
| EmilienM | anyway | 20:59 |
| EmilienM | I need to go, bbl | 20:59 |
| weshay|ruck | :) | 20:59 |
| weshay|ruck | ya.. good change | 20:59 |
| weshay|ruck | I'm just bustin | 20:59 |
| *** brault has joined #tripleo | 21:01 | |
| fultonj | cloudnull: i've now gotten my tripleo env to start running your playbook by passing -p ~/templates/plan-samples/plan-environment-derived-params.yaml | 21:03 |
| fultonj | progress | 21:03 |
| fultonj | :) | 21:03 |
| brault | Hello, would someone be able to take a look at the following patch https://review.opendev.org/#/c/717697/ that is blocked on verified label with tripleo-build-containers-rhel-8-train failure ? | 21:04 |
| fultonj | cloudnull: i'm having an issue which is purely environmental and i was curious how you personaly deal with it in your env | 21:04 |
| fultonj | http://paste.openstack.org/show/792188/ | 21:04 |
| fultonj | basically i use --override-ansible-cfg to an ansible.cfg i have modified to use my copy of tripleo-ansible from git in /home/stack | 21:05 |
| fultonj | i assume it's failing becuase it's not using the newer tripleo-ansible roles i have from git | 21:06 |
| *** dciabrin has joined #tripleo | 21:07 | |
| fultonj | cloudnull: so just wondering if when you do your work if you use your own ansible.cfg or if you directly put things from git into /usr/share etc | 21:08 |
| fultonj | i'll keep fidling with it | 21:08 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Make /var/lib/mistral traversable by all users https://review.opendev.org/717320 | 21:08 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add mode option when creating persistent directories. https://review.opendev.org/717861 | 21:10 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Make /var/lib/mistral traversable by all users https://review.opendev.org/717320 | 21:10 |
| cloudnull | fultonj sorry was afk, dont use a custom ansible.cfg when running various things locally | 21:15 |
| cloudnull | ** I dont use | 21:15 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Wait for compute services before sanity check. https://review.opendev.org/720169 | 21:15 |
| cloudnull | when developing I generally run tripleoclient from master, in a venv | 21:15 |
| cloudnull | then to be sure it all works I build it as a package, and reinstall it | 21:16 |
| fultonj | so your venv has your depdendent branches for tripleo-ansible, tht, etc? | 21:18 |
| cloudnull | sometimes for tripleo-ansible , never for tht | 21:19 |
| cloudnull | for tht I just shove things into /usr/share | 21:19 |
| *** jfrancoa has quit IRC | 21:22 | |
| *** brault is now known as brault-away | 21:24 | |
| fultonj | cloudnull: thanks, for sharing. i'll get this working in my env and update you | 21:24 |
| EmilienM | weshay|ruck: it would be useful (IMO) to run the collect-logs role against tripleo-ansible-centos-8-molecule-* jobs | 21:38 |
| EmilienM | i guess it's useful when you want to dig container infos or systemd logs | 21:38 |
| EmilienM | e.g. the kernel roles, the container roles, etc | 21:38 |
| *** jtomasek has quit IRC | 21:42 | |
| abishop | EmilienM: I got some info from rosmaita, but he couldn't stay online. Other glance experts (jokke, akekane) are in emea | 21:43 |
| *** raildo has quit IRC | 21:53 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Switch off nova/glance in featureset001 https://review.opendev.org/711364 | 21:56 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Fix delorean.repo url for centos-8 master https://review.opendev.org/713979 | 21:56 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Add login flag to container image prepare defaults https://review.opendev.org/720299 | 21:57 |
| *** mcornea has quit IRC | 21:59 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: WIP: additional inventory filters for tripleo-upgrade https://review.opendev.org/720300 | 22:00 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Add login flag to container image prepare defaults https://review.opendev.org/720299 | 22:01 |
| *** ccamacho has quit IRC | 22:11 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Remove hardcoded reference to cinder LVM loopback device https://review.opendev.org/720232 | 22:16 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-ansible master: Do not force ceph-ansible/{..} dirs to be ansible_user owned https://review.opendev.org/720306 | 22:17 |
| *** TrevorV has quit IRC | 22:18 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Remove hardcoded reference to cinder LVM loopback device https://review.opendev.org/720232 | 22:18 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add --enable-registry-login support https://review.opendev.org/720307 | 22:19 |
| *** jmasud has quit IRC | 22:22 | |
| *** rfolco has quit IRC | 22:24 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add ability to write scripts https://review.opendev.org/716093 | 22:25 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: deploy-steps-tasks-step-1: update startup-configs with latest hashes https://review.opendev.org/720275 | 22:26 |
| *** jmasud has joined #tripleo | 22:29 | |
| *** rcernin has joined #tripleo | 22:45 | |
| *** Goneri has quit IRC | 22:47 | |
| *** tkajinam has joined #tripleo | 22:59 | |
| *** jmasud has quit IRC | 23:09 | |
| *** jmasud has joined #tripleo | 23:10 | |
| *** rh-jelabarre has quit IRC | 23:12 | |
| *** gfidente|afk has quit IRC | 23:25 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Do not enable delorean current repo https://review.opendev.org/717186 | 23:32 |
| *** tosky has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!