| *** maharg101 has quit IRC | 00:02 | |
| *** cshen has joined #openstack-ansible | 00:54 | |
| *** cshen has quit IRC | 00:59 | |
| *** maharg101 has joined #openstack-ansible | 01:57 | |
| *** maharg101 has quit IRC | 02:03 | |
| *** macz_ has quit IRC | 02:15 | |
| *** spatel has joined #openstack-ansible | 02:47 | |
| *** cshen has joined #openstack-ansible | 02:54 | |
| *** cshen has quit IRC | 03:00 | |
| *** cshen has joined #openstack-ansible | 03:00 | |
| *** cshen has quit IRC | 03:04 | |
| *** macz_ has joined #openstack-ansible | 03:33 | |
| *** macz_ has quit IRC | 03:38 | |
| *** maharg101 has joined #openstack-ansible | 03:59 | |
| *** maharg101 has quit IRC | 04:03 | |
| *** spatel has quit IRC | 04:25 | |
| *** cshen has joined #openstack-ansible | 05:00 | |
| *** cshen has quit IRC | 05:05 | |
| *** yasemind has joined #openstack-ansible | 05:26 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:33 | |
| *** cshen has joined #openstack-ansible | 06:15 | |
| *** cshen has quit IRC | 06:19 | |
| *** djhankb has quit IRC | 06:27 | |
| *** cshen has joined #openstack-ansible | 07:08 | |
| *** cshen has quit IRC | 07:13 | |
| CeeMac | morning | 07:29 |
|---|---|---|
| *** rpittau|afk is now known as rpittau | 07:39 | |
| *** miloa has joined #openstack-ansible | 07:46 | |
| *** miloa has quit IRC | 07:50 | |
| *** cshen has joined #openstack-ansible | 08:05 | |
| *** maharg101 has joined #openstack-ansible | 08:41 | |
| jrosser | morning | 08:42 |
| *** tosky has joined #openstack-ansible | 08:46 | |
| *** andrewbonney has joined #openstack-ansible | 08:50 | |
| *** openstackgerrit has joined #openstack-ansible | 08:57 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Add barbican-ui repo package and zuul repo https://review.opendev.org/c/openstack/openstack-ansible/+/774053 | 08:57 |
| *** LowKey has joined #openstack-ansible | 08:59 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_horizon master: Install barbican-ui when the barbican service is deployed https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/774054 | 09:00 |
| LowKey | Hi, our openstack controller 3 is broken, all disk failed. Now the disk has been replaced and the server is up with the interface configured. How to run back contoller 3 to openstack ? do i need to rebuild everyting back on playbooks ? | 09:00 |
| jrosser | LowKey: yes, you'll need to re-run all the playbooks to put the openstack services back | 09:01 |
| jrosser | you could use --limit to exclude all the compute nodes to make it much quicker | 09:02 |
| LowKey | jrosser: i should ran back openstack-ansible setup-hosts.yml | 09:02 |
| LowKey | oh, how to use limit ? | 09:02 |
| jrosser | https://docs.ansible.com/ansible/latest/user_guide/intro_patterns.html | 09:02 |
| jrosser | just standard ansible stuff, not OSA specific | 09:03 |
| LowKey | openstack-ansible setup-hosts.yml --limit Controller_IP_Address | 09:03 |
| jrosser | no, i think thats probably hazardous | 09:04 |
| noonedeadpunk | morning | 09:04 |
| jrosser | i suggested the opposide, exclude the computes rather than include the specific infra host you want to re-deploy | 09:04 |
| LowKey | jrosser: still not get it :( | 09:06 |
| jrosser | if it's a standard OSA deployment your compute nodes will all be in the ansible group compute_all | 09:07 |
| jrosser | so you might be able to use --limit !compute_all | 09:07 |
| jrosser | if you try openstack-ansible setup-hosts.yml --limit !compute_all --list-hosts | 09:08 |
| jrosser | it will tell you which things will be targetted | 09:08 |
| jrosser | if you're doing this on a production deployment just take it slowly one step at a time | 09:08 |
| jrosser | in particular when you get to rabbitmq and galera check that the new nodes join the clusters properly | 09:09 |
| LowKey | i see, what happen if i'm running the playbooks without -- limit ? | 09:10 |
| jrosser | then you'll re-run on all your computes too, which doesnt sound necessary for fixing a broken controller | 09:11 |
| jrosser | you can do that if you want to | 09:11 |
| LowKey | i see | 09:11 |
| LowKey | jrosser: noted , got it now | 09:11 |
| LowKey | it's just will takes longer time | 09:12 |
| jrosser | right, and depending on how many nodes you have that may be ok | 09:13 |
| LowKey | jrosser: ok, currently only less than 10 computes.. , only tooks around 15-20 min | 09:14 |
| LowKey | i'm getting error during running openstack-ansible setup-openstack.yml -- https://pastebin.com/JzAVd6XE | 09:24 |
| *** yasemind has quit IRC | 09:24 | |
| jrosser | LowKey: have you already done setup-hosts.yml and setup-infrastructure.yml ? | 09:25 |
| LowKey | yes, it's done without error | 09:25 |
| LowKey | jrosser: only problem during setup-openstack.yml | 09:26 |
| jrosser | you'll have to debug it | 09:27 |
| jrosser | there is an ssh error | 09:27 |
| LowKey | yes , i got this on verbose : Failed to connect to the host via ssh: <error censored due to no log> | 09:27 |
| LowKey | it's weird, i can ssh to it without any issue | 09:28 |
| LowKey | able to ssh from the deploy server to the keystone container | 09:29 |
| jrosser | what is 172.29.238.225 | 09:29 |
| jrosser | this text means that the ansible task is delegated from the keystone container to whatever that IP is failed: [c3_keystone_container-xxxxxxx -> 172.29.238.225] | 09:30 |
| LowKey | it's galera_container | 09:30 |
| jrosser | noonedeadpunk: on interesting http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020218.html | 10:17 |
| jrosser | *oh | 10:17 |
| jrosser | thats pretty much exactly what we see failing in our octavia CI job | 10:17 |
| *** yasemind has joined #openstack-ansible | 10:18 | |
| noonedeadpunk | yep | 10:21 |
| noonedeadpunk | can't reply it since it's been filtered :( | 10:21 |
| noonedeadpunk | oh, it's in deleted, then I can | 10:22 |
| * jrosser also replying | 10:24 | |
| noonedeadpunk | does it meant we can legitimally mark centos as nv? | 10:39 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/train: Add neutron_keepalived_no_track variable https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/763337 | 10:43 |
| noonedeadpunk | oh, btw, debian has started failing same way | 10:43 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia stable/victoria: Add variable to override keypair setup python interpreter https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/773962 | 10:45 |
| jrosser | oh dear, debian too? | 10:47 |
| *** jbadiapa has joined #openstack-ansible | 10:47 | |
| noonedeadpunk | not 100% sure maybe it's just oom or smth... As it's 504 from nova in the logs | 10:47 |
| noonedeadpunk | yeah https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/767494 just passed it so I guess only centos :( | 10:49 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts stable/victoria: Set RDO repo to Victoria https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/773369 | 11:12 |
| *** ilush has joined #openstack-ansible | 11:15 | |
| *** yasemind has quit IRC | 11:17 | |
| *** yasemind has joined #openstack-ansible | 11:41 | |
| *** ilush has quit IRC | 11:42 | |
| yasemind | hi, i try to install trove, i get some error about create network service http://paste.openstack.org/show/802317/ any idea ? | 11:50 |
| openstackgerrit | Merged openstack/openstack-ansible-os_senlin stable/victoria: Remove unused variables from defaults https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/773956 | 11:52 |
| *** sshnaidm|afk is now known as sshnaidm | 11:53 | |
| noonedeadpunk | yasemind: I think you should define that network first. You may try following octavia doc for reference - it should be pretty simmilar case here https://docs.openstack.org/openstack-ansible-os_octavia/latest/configure-octavia.html#setup-a-neutron-network-for-use-by-octavia | 11:55 |
| admin0 | yasemind, you need to create a network.. can be a vlan network also .. or any network and pass it to trove | 11:58 |
| admin0 | i use vlan | 11:58 |
| admin0 | i don't think you can run multiple networks ontop of flat | 11:58 |
| noonedeadpunk | you can't | 11:58 |
| noonedeadpunk | unless you have multiple network interfaces | 11:59 |
| noonedeadpunk | then you can have multiple flats:) actually, you can even set a vlan network as "flat" | 11:59 |
| noonedeadpunk | but you should manage it in terms of interface creation intead of neutron then | 12:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/victoria: Fix nova_libvirt_images_rbd_pool check https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/773915 | 12:01 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/ansible-hardening master: Change openstack-dev to openstack-discuss in setup.cfg https://review.opendev.org/c/openstack/ansible-hardening/+/631464 | 12:03 |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Install rsync for CentOS bootstrap https://review.opendev.org/c/openstack/openstack-ansible/+/772665 | 12:21 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Cover aio usecase when default route not set https://review.opendev.org/c/openstack/openstack-ansible/+/774075 | 12:21 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/victoria: Fix lxc_hosts_container_image_url condition https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/773914 | 12:22 |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Bump ansible-base and OpenStack collections https://review.opendev.org/c/openstack/openstack-ansible/+/772808 | 12:30 |
| *** yasemind has quit IRC | 12:56 | |
| *** yasemind has joined #openstack-ansible | 13:01 | |
| *** djhankb has joined #openstack-ansible | 13:03 | |
| noonedeadpunk | jrosser: andrewbonney can we also merge this one https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/773916 ? | 13:16 |
| noonedeadpunk | or at least review) | 13:17 |
| *** yasemind has quit IRC | 13:30 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_senlin master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/769956 | 13:43 |
| *** spatel has joined #openstack-ansible | 13:49 | |
| *** cshen has quit IRC | 13:59 | |
| *** yasemind has joined #openstack-ansible | 14:01 | |
| *** Underknowledge has quit IRC | 14:17 | |
| *** Underknowledge1 has joined #openstack-ansible | 14:17 | |
| *** Underknowledge1 is now known as Underknowledge | 14:18 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/victoria: Bump SHAs for stable/victoria https://review.opendev.org/c/openstack/openstack-ansible/+/773264 | 14:37 |
| mgariepy | zuul is so slow during the day. | 14:40 |
| noonedeadpunk | a lot of ppl started using tampermonkey script from yoctozepto ?:) | 14:42 |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Return centos-8 jobs to voting https://review.opendev.org/c/openstack/openstack-ansible/+/773393 | 14:52 |
| *** ilush has joined #openstack-ansible | 14:57 | |
| *** cshen has joined #openstack-ansible | 14:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Allow OIDCClaimDelimiter to be set in the apache config file https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/773978 | 15:05 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/victoria: Allow OIDCClaimDelimiter to be set in the apache config file https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/773964 | 15:06 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/ussuri: Allow OIDCClaimDelimiter to be set in the apache config file https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/773965 | 15:06 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/train: Allow OIDCClaimDelimiter to be set in the apache config file https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/773966 | 15:08 |
| *** yasemind has quit IRC | 15:25 | |
| mgariepy | noonedeadpunk, skipping 1 release should work in theory ? | 15:46 |
| mgariepy | R > T > V ? | 15:47 |
| noonedeadpunk | Well R->T will be tricky as placement separation is during S->T | 15:47 |
| mgariepy | ha | 15:48 |
| noonedeadpunk | but if you're running manually it's more about mpassing flags that are needed | 15:48 |
| noonedeadpunk | so you should follow script carefully | 15:48 |
| *** sshnaidm is now known as sshnaidm|afk | 15:48 | |
| noonedeadpunk | but I think generally it should be pretty doable | 15:48 |
| mgariepy | k | 15:56 |
| mgariepy | i'll take a look then. | 15:56 |
| noonedeadpunk | eventually | 15:56 |
| noonedeadpunk | I guess I'm wrong and just upgrade script will do whatever needed for R->T | 15:57 |
| noonedeadpunk | so that should be probably fine at all | 15:57 |
| mgariepy | well. yep, need to do few other task before that but i'll take a look | 16:00 |
| mgariepy | if i can save a few upgrades it would be awesome. | 16:01 |
| *** macz_ has joined #openstack-ansible | 16:03 | |
| *** macz_ has quit IRC | 16:03 | |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Do not drop all wheels with venv_rebuild https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/773981 | 16:26 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build stable/ussuri: Do not drop all wheels with venv_rebuild https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/773971 | 16:27 |
| openstackgerrit | Jonathan Rosser proposed openstack/ansible-role-python_venv_build stable/victoria: Do not drop all wheels with venv_rebuild https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/773972 | 16:28 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build stable/victoria: Do not drop all wheels with venv_rebuild https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/773972 | 16:28 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build stable/train: Do not drop all wheels with venv_rebuild https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/773973 | 16:28 |
| jrosser | spatel: could you give these a test https://review.opendev.org/c/openstack/openstack-ansible/+/774053 https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/774054 | 16:33 |
| spatel | jrosser sure i can give it a quick shot in my lab to verify | 16:35 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Fix neutron_keepalived_no_track default logic https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/773916 | 16:37 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron stable/victoria: Fix neutron_keepalived_no_track default logic https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/773974 | 16:38 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron stable/ussuri: Fix neutron_keepalived_no_track default logic https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/773975 | 16:39 |
| noonedeadpunk | what a weird stuff with magnum on train :( https://bugs.launchpad.net/ubuntu/+source/magnum/+bug/1902293 | 16:41 |
| openstack | Launchpad bug 1902293 in magnum (Ubuntu) "fixed_network_name still exists in drivers except heat" [Undecided,Confirmed] | 16:41 |
| *** openstack has joined #openstack-ansible | 17:25 | |
| *** ChanServ sets mode: +o openstack | 17:25 | |
| *** maharg101 has quit IRC | 17:44 | |
| *** zul has quit IRC | 17:49 | |
| *** rpittau is now known as rpittau|afk | 18:10 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/ussuri: Ensure kuryr repo is available within CI images https://review.opendev.org/c/openstack/openstack-ansible/+/771608 | 18:32 |
| spatel | jrosser horizon playbook failed here - http://paste.openstack.org/show/802336/ | 18:44 |
| spatel | ERROR: Could not satisfy constraints for 'barbican-ui': installation from path or url cannot be constrained to a version | 18:46 |
| spatel | i did try with -e venv_rebuild=yes | 18:46 |
| spatel | bus still same error | 18:46 |
| spatel | *but | 18:46 |
| *** spatel has quit IRC | 18:57 | |
| *** lemko7 has quit IRC | 19:00 | |
| *** lemko has joined #openstack-ansible | 19:00 | |
| *** d34dh0r53 has quit IRC | 19:09 | |
| *** spatel has joined #openstack-ansible | 19:10 | |
| *** ilush has quit IRC | 19:12 | |
| *** d34dh0r53 has joined #openstack-ansible | 19:12 | |
| *** d34dh0r53 has quit IRC | 19:13 | |
| *** d34dh0r53 has joined #openstack-ansible | 19:14 | |
| *** andrewbonney has quit IRC | 19:20 | |
| *** spatel has quit IRC | 19:20 | |
| *** spatel has joined #openstack-ansible | 19:30 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_barbican master: DNM test patch https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/774150 | 19:39 |
| *** maharg101 has joined #openstack-ansible | 19:41 | |
| noonedeadpunk | jrosser: I guess it's bad time to drop functional tests http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020235.html | 19:44 |
| *** maharg101 has quit IRC | 19:45 | |
| noonedeadpunk | feels like we need to optimize execution time and decrease amount of tests | 19:47 |
| noonedeadpunk | maybe move bionic ci to experimental.... | 19:49 |
| spatel | noonedeadpunk why don't we just add more nodes in CI ? | 20:01 |
| jrosser | spatel: the capacity is all donated | 20:11 |
| jrosser | someone would need to donate more | 20:11 |
| spatel | hmm | 20:12 |
| spatel | Did you see ? http://paste.openstack.org/show/802336/ | 20:13 |
| jrosser | I did, I don’t have a Barbican AIO to look at | 20:18 |
| jrosser | would need the horizon .txt files off the repo server | 20:18 |
| jrosser | and the horizon container venv build log | 20:19 |
| spatel | let me debug and see what is wrong | 20:24 |
| jrosser | is your lab on Victoria? | 20:34 |
| jrosser | I may be assuming that patch is ok for Victoria, which it may not be | 20:35 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/773262 | 20:39 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/victoria: Bump SHAs for stable/victoria https://review.opendev.org/c/openstack/openstack-ansible/+/773264 | 20:40 |
| jrosser | noonedeadpunk: we will have to do something radical to reduce the runtime..... | 20:45 |
| spatel | jrosser yes I'm running Victoria in lab | 20:50 |
| spatel | in CI tempest taking majority of time. | 20:51 |
| noonedeadpunk | well, all pre setps for us take about halpf an hour I guess... | 20:52 |
| noonedeadpunk | we totally should drop ovn job from integarted repo to neutron | 20:53 |
| noonedeadpunk | and I think bionic as well | 20:53 |
| noonedeadpunk | not half an hour, but 15-20 mins... | 20:54 |
| noonedeadpunk | btw, I'm wondering if wheels build will reduce execution time because of a lot of common stuff will be locally | 20:56 |
| mgariepy | osa is fast if you compare to neutron directly.. | 20:57 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build master: Import wheels build only when necessary https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/774159 | 20:58 |
| jrosser | there are probably a bunch of things like that ^ in the roles used over and over again | 21:03 |
| jrosser | also i don't know what i make of this patch tbh https://review.opendev.org/c/openstack/openstack-ansible/+/762044 | 21:06 |
| *** waxfire has quit IRC | 21:13 | |
| *** waxfire has joined #openstack-ansible | 21:13 | |
| noonedeadpunk | I totally saw some more like that but can't recall | 21:14 |
| noonedeadpunk | btw, that failed heavily https://review.opendev.org/c/openstack/openstack-ansible/+/752311 | 21:15 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Enable venv_wheel_build_enable for CI https://review.opendev.org/c/openstack/openstack-ansible/+/752311 | 21:15 |
| noonedeadpunk | actually I can - systemd | 21:17 |
| jrosser | those roles have tons of tasks | 21:19 |
| jrosser | some of which are really rarely used | 21:19 |
| noonedeadpunk | well uwsgi should be buld just from wheels actually | 21:23 |
| jrosser | openstack_hosts has a real big lot of skipped tasks for containers | 21:27 |
| jrosser | which only apply to metal hosts | 21:27 |
| jrosser | heres where we spend the time on an lxc job http://paste.openstack.org/show/802347/ | 21:37 |
| *** maharg101 has joined #openstack-ansible | 21:42 | |
| *** maharg101 has quit IRC | 21:46 | |
| *** jbadiapa has quit IRC | 21:57 | |
| jrosser | and in terms of ansible tasks which run many times it's this http://paste.openstack.org/show/802349/ | 22:03 |
| *** spatel has quit IRC | 22:45 | |
| *** lemko3 has joined #openstack-ansible | 22:57 | |
| *** lemko has quit IRC | 22:57 | |
| *** lemko3 is now known as lemko | 22:57 | |
| *** LowKey has quit IRC | 23:10 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!