| openstackgerrit | Merged openstack/openstack-ansible master: Add zun to required-projects https://review.opendev.org/741493 | 00:36 |
|---|---|---|
| *** masterpe has quit IRC | 01:16 | |
| *** masterpe has joined #openstack-ansible | 01:20 | |
| *** mjwales has joined #openstack-ansible | 01:34 | |
| *** mjwales has quit IRC | 01:39 | |
| *** spatel has joined #openstack-ansible | 01:53 | |
| *** dave-mccowan has quit IRC | 02:26 | |
| *** gyee has quit IRC | 02:33 | |
| *** gyee has joined #openstack-ansible | 02:40 | |
| *** rh-jelabarre has quit IRC | 02:45 | |
| *** spatel has quit IRC | 03:16 | |
| *** gyee has quit IRC | 04:14 | |
| *** udesale has joined #openstack-ansible | 04:33 | |
| *** d34dh0r53 has quit IRC | 05:07 | |
| *** d34dh0r53 has joined #openstack-ansible | 05:07 | |
| *** d34dh0r53 has quit IRC | 05:15 | |
| *** d34dh0r53 has joined #openstack-ansible | 05:20 | |
| *** mjwales has joined #openstack-ansible | 05:44 | |
| *** mjwales has quit IRC | 05:48 | |
| *** d34dh0r53 has quit IRC | 05:59 | |
| *** yasemind has quit IRC | 06:27 | |
| *** yasemind has joined #openstack-ansible | 06:30 | |
| *** tinwood is now known as tinwood-afk | 06:33 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible stable/ussuri: Remove package cache proxy cleanup https://review.opendev.org/742800 | 06:55 |
| *** mjwales has joined #openstack-ansible | 07:00 | |
| *** mjwales has quit IRC | 07:05 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: Add centos-8 and ubuntu focal support https://review.opendev.org/742253 | 07:08 |
| jrosser | noonedeadpunk: regarding this patch https://github.com/openstack/openstack-ansible-os_ceilometer/commit/ab81ea24bb10fa4fe4955fb2975dc597f5ebdea4 | 07:13 |
| jrosser | should libvirt-devel have been added actually to ceilometer_devel_distro_packages? otherwise it gets installed on the target host rather than the repo server container when it's lxc not metal.... | 07:14 |
| *** tosky has joined #openstack-ansible | 07:37 | |
| noonedeadpunk | jrosser: I guess it's needed when ceilometer is installed on computes for it to gather some data | 07:46 |
| noonedeadpunk | so idea was to get it on hosts instead of only repo container | 07:47 |
| jrosser | i was just looking at the error message tow pasted ^ up there | 07:47 |
| jrosser | thats running against a compute node but building ceilometer venv on the repo server, i think | 07:48 |
| jrosser | my hunch is that ERROR: Failed building wheel for libvirt-python is because libvirt-devel isnt on the repo server | 07:49 |
| noonedeadpunk | oh, yes, I think you're right here.. | 07:51 |
| noonedeadpunk | then we have an issue about how to handle lists.... | 07:51 |
| jrosser | yeah, this has come up before | 07:51 |
| noonedeadpunk | so annoying that package module can't handle empty values of the list... | 07:51 |
| jrosser | we've got some use of inline jinja in places for these lists | 07:52 |
| noonedeadpunk | which is nasty.... | 07:52 |
| noonedeadpunk | but yeah | 07:52 |
| noonedeadpunk | oh, what if we just distinguish redhat-7 and redhat-8 for ceilometer... | 07:53 |
| jrosser | yeah, so spatel has a patch for centos-8 | 07:53 |
| noonedeadpunk | (eventually it was during that patch) | 07:53 |
| jrosser | we could use that to split this up | 07:53 |
| noonedeadpunk | yeah | 07:54 |
| noonedeadpunk | let me see what I can do | 07:54 |
| jrosser | cool | 07:54 |
| jrosser | also this is interesting https://review.opendev.org/#/c/742369/1 | 07:54 |
| jrosser | i think it's ok but worth a good look | 07:54 |
| jrosser | saves maybe 100 tasks (seems ridiculous big number but.....) | 07:54 |
| jrosser | then someone caught silly bug in my lxc changes too https://review.opendev.org/#/c/742698/ | 07:56 |
| noonedeadpunk | so we kind of get extra package for venv, but speedup CI and metal aio mostly | 07:58 |
| noonedeadpunk | but another way is to have several venvs - one for compute and another for api/scheduler | 08:01 |
| noonedeadpunk | so having just extra package is ok I think | 08:01 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Add centos-8 and ubuntu focal support https://review.opendev.org/742253 | 08:05 |
| *** markvoelker has joined #openstack-ansible | 08:11 | |
| *** markvoelker has quit IRC | 08:15 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Add remote_src parameter to ansible unarchive module for lxc_hosts task https://review.opendev.org/742698 | 08:18 |
| *** Ortet_ has joined #openstack-ansible | 08:19 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: Add remote_src parameter to ansible unarchive module for lxc_hosts task https://review.opendev.org/742821 | 08:20 |
| *** also_stingrayza has joined #openstack-ansible | 08:21 | |
| *** stingrayza has quit IRC | 08:23 | |
| *** jbadiapa has joined #openstack-ansible | 08:23 | |
| *** andrewbonney has joined #openstack-ansible | 08:33 | |
| *** tinwood-afk is now known as tinwood | 08:45 | |
| *** janno has quit IRC | 08:53 | |
| *** janno has joined #openstack-ansible | 08:54 | |
| *** janno has quit IRC | 08:55 | |
| *** janno has joined #openstack-ansible | 08:55 | |
| *** mjwales has joined #openstack-ansible | 09:04 | |
| *** mjwales has quit IRC | 09:09 | |
| *** yasemind has quit IRC | 09:11 | |
| *** gokhani has quit IRC | 09:11 | |
| *** mjwales has joined #openstack-ansible | 09:37 | |
| *** mjwales has quit IRC | 09:42 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Fix mysql binary name https://review.opendev.org/742841 | 10:01 |
| *** markvoelker has joined #openstack-ansible | 10:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/ussuri: Add remote_src parameter to ansible unarchive module for lxc_hosts task https://review.opendev.org/742821 | 10:04 |
| *** markvoelker has quit IRC | 10:08 | |
| *** spatel has joined #openstack-ansible | 10:18 | |
| *** spatel has quit IRC | 10:22 | |
| *** mjwales has joined #openstack-ansible | 10:34 | |
| *** Ortet_ has quit IRC | 10:57 | |
| *** stuartgr has joined #openstack-ansible | 10:59 | |
| *** mjwales has quit IRC | 11:09 | |
| *** udesale_ has joined #openstack-ansible | 11:11 | |
| *** udesale has quit IRC | 11:13 | |
| *** aedc has joined #openstack-ansible | 11:16 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_ironic master: [DNM] test patch https://review.opendev.org/727067 | 11:17 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/train: Ensure python3 mysql client libraries are present https://review.opendev.org/731290 | 11:37 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add centos-8 support https://review.opendev.org/739646 | 11:48 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ussuri: Bump role SHA for ussuri https://review.opendev.org/741939 | 11:50 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ussuri: Add Centos-8 support https://review.opendev.org/740289 | 11:53 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add centos-8 support https://review.opendev.org/739646 | 11:57 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Add centos-8 and ubuntu focal support https://review.opendev.org/742253 | 12:00 |
| *** markvoelker has joined #openstack-ansible | 12:04 | |
| *** markvoelker has quit IRC | 12:05 | |
| *** markvoelker has joined #openstack-ansible | 12:06 | |
| *** rh-jelabarre has joined #openstack-ansible | 12:07 | |
| *** gokhani has joined #openstack-ansible | 12:28 | |
| *** spatel has joined #openstack-ansible | 12:55 | |
| *** aedc has quit IRC | 13:15 | |
| *** dave-mccowan has joined #openstack-ansible | 13:15 | |
| *** zigo has quit IRC | 13:19 | |
| *** zigo has joined #openstack-ansible | 13:30 | |
| *** gokhani has quit IRC | 13:48 | |
| *** d34dh0r53 has joined #openstack-ansible | 14:04 | |
| *** d34dh0r53 has quit IRC | 14:05 | |
| *** d34dh0r53 has joined #openstack-ansible | 14:06 | |
| *** fnpanic has joined #openstack-ansible | 14:12 | |
| fnpanic | hi | 14:12 |
| fnpanic | i have a quick question, when i add a new service to osa and run setup-hosts the container gets created but no networking inside. | 14:13 |
| fnpanic | it gets also added correctly to the dynamic inventory | 14:13 |
| fnpanic | maybe someone has a hint. Is it not part of all_containers automatically? | 14:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Add centos-8 support https://review.opendev.org/742507 | 14:15 |
| jrosser | oh cool centos-8 merged for ussuri | 14:15 |
| noonedeadpunk | fnpanic: eventually networking should be created once container is | 14:18 |
| fnpanic | adding the new service to user_config is sufficent or am i missing something? | 14:18 |
| noonedeadpunk | jrosser: yeah, but we still have tons of stuff to backport:( | 14:19 |
| jrosser | noonedeadpunk: I just go look at reviews | 14:19 |
| jrosser | nit on this https://review.opendev.org/#/c/739647/3 which we can fix in a followup, or change that one | 14:27 |
| jrosser | mnaser: migration related cleanup https://review.opendev.org/#/c/741155/ and this is a related bug we have https://review.opendev.org/#/c/741167/ | 14:37 |
| jrosser | CeeMac: you may be interested in those too ^ | 14:37 |
| jrosser | mnaser: and also rather sadly libvirt.libvirtError: argument unsupported: post-copy is not supported with tunnelled migration | 14:40 |
| CeeMac | jrosser: thanks I'll take a look | 14:46 |
| mnaser | jrosser: looks good, and urgh, bummer. | 14:48 |
| mnaser | jrosser: probably moving to tls would be a nice goal anyways | 14:48 |
| mnaser | jrosser: tls for libvirt migrations + trying to eliminate unneeded ssh in nova | 14:49 |
| jrosser | we're going to make some patches for the nova docs because a bunch of this doesnt behave how they describe | 14:51 |
| jrosser | even going reading the code is hard because live_migration_inbound_addr is from the perspective to the "migrate to" side but the rest is all about "migrate from" and its all mixed up together | 14:53 |
| watersj | how do you handle adding new compute nodes. Modify openstack_user_config.yml and add new nodes. do you re-run setup-everything or how can I be more targeted? | 14:54 |
| *** udesale_ has quit IRC | 14:55 | |
| jrosser | watersj: https://docs.openstack.org/openstack-ansible/latest/admin/scale-environment.html#add-a-compute-host | 14:56 |
| spatel | watersj: this is nice doc - https://docs.openstack.org/openstack-ansible/newton/developer-docs/ops-add-computehost.html | 14:56 |
| spatel | jrosser: beat me :) | 14:56 |
| watersj | ty jrosser & spatel | 14:56 |
| jrosser | the later docs have an additional step in them to ensure the nova ssh keys are distributed properly which iirc is missing from earlier docs | 14:56 |
| jrosser | mnaser: would you have any preference about how the PKI stuff was deployed for TLS based migration, we'd need client and server certs for all compute nodes | 14:57 |
| jrosser | like just roll it all with ansible modules? | 14:57 |
| admin0 | what is the recommended way to install osa with a pre-existing ceph ? | 15:01 |
| admin0 | is just mentioning ceph mon ips ( that the deploy can ssh as root) is enough ? | 15:01 |
| kleini | admin0: you need to use the new Ceph configuration from files feature | 15:07 |
| jrosser | only if the deploy user can't ssh to the ceph nodes | 15:08 |
| jrosser | if it can then just mentioning the mon IP is sufficuent | 15:08 |
| admin0 | jrosser, that might be the case | 15:08 |
| jrosser | thats really the thing to decide about then, if you do, or do not want the OSA deployment to ssh to the mon IP you give | 15:08 |
| admin0 | kleini, is there an example config somewhere | 15:09 |
| jrosser | kleini: were you going to contribute some docs about this :) | 15:09 |
| watersj | and I should too | 15:09 |
| admin0 | it just copies right ? the ssh ? | 15:10 |
| admin0 | and if the pool is not created, it will create the pools | 15:10 |
| kleini | http://paste.openstack.org/show/796289/ <- my config | 15:10 |
| kleini | not exactly, changed IPs and anmes | 15:11 |
| watersj | admin0, you can provide root ssh creds into ceph mon and it should pull or you can provide details via user_variables.yml | 15:11 |
| kleini | jrosser: yes, I still need to contribute the docs | 15:11 |
| jrosser | kleini: can you provide some santised example of what goes inthe keyring files? | 15:11 |
| kleini | sorry, had to prepare Open-Xchange App Suite 7.10.4 release and two month no time to work on my OpenStack deployment | 15:12 |
| jrosser | with some real examples i can start a docs partch | 15:12 |
| jrosser | admin0: i don;t think the pools get created for you with external ceph just by passing the mon IP | 15:13 |
| jrosser | in my deployment with seperate ceph thats all done independantly by ceph-ansible | 15:13 |
| admin0 | ok | 15:13 |
| admin0 | kleini, in this config, how to tell nova which pool to use ? | 15:14 |
| kleini | http://paste.openstack.org/show/796290/ <- keyring file example | 15:14 |
| kleini | the keyring file MUST use the tab character for indentation | 15:15 |
| jrosser | admin0: there is a big chunk of config in ceph-ansible starting here https://github.com/ceph/ceph-ansible/blob/d490968fc8b5e4fcc236b21cc2debd486780268e/roles/ceph-defaults/defaults/main.yml#L606 | 15:15 |
| openstackgerrit | Merged openstack/openstack-ansible-os_mistral master: Add centos-8 support https://review.opendev.org/739650 | 15:16 |
| jrosser | kleini: thats great - i'll see if i can make a docs patch next week as this comes up a lot | 15:16 |
| admin0 | can routed and non-routed network exist .. like container and tunnel is non routed but only storage is routed ? | 15:17 |
| kleini | admin0: you mean for ephemeral storage? I don't use Ceph for ephemeral storage as it is terribly slow. I use local qcow2 files in /var/lib/nova/instances and /var/lib/nova is on a ZFS filesystem, which is stored on a local PCIe NVMe 4TB SSD with incredible performance | 15:17 |
| jrosser | kleini: is that smart enough to use zfs snapshots for VMs? | 15:21 |
| -openstackstatus- NOTICE: We are renaming projects in Gerrit and review.opendev.org will experience a short outage. Thank you for your patience. | 15:21 | |
| kleini | jrosser: unfortunately no as qcow2 files are used underneath libvirt and ZFS does not know anything about qcow2 files. to make that work, VM storage needs to be ZFS block devices. I never researched, whether this is possible. That would be a tremendous improvement. | 15:23 |
| *** andrewbonney has quit IRC | 15:23 | |
| *** fnpanic has quit IRC | 15:24 | |
| kleini | currently I have a setting in ZFS to return the write operation, when the block is written to memory. it is then later writen to the SSD by ZFS. I am loosing some seconds of data in case of a failure, which does not matter for me. otherwise libvirt writes to qcow2 are fully synchronous | 15:24 |
| admin0 | jrosser, can routed and non routed networks be mixed and matched .. like having 2 networks on l2 but one network on l3 ? | 15:25 |
| jrosser | i saw that LXD has grown support for libvirt VM and has good ZFS support already, i have been meaning to try that out | 15:25 |
| kleini | sorry, have to leave for today. moms birthday tomorrow and I still need something | 15:25 |
| kleini | LXC on ZFS works great bzw | 15:25 |
| jrosser | admin0: routed and not routed together in what context? | 15:28 |
| admin0 | br-mgmt and br-vxlan is a /22, br-storage is a /24 in 3 different pods | 15:29 |
| admin0 | br-storage is routed, br-mgmt and br-vxlan is not | 15:29 |
| jrosser | so long as you add the necessary static routes to the whole of the storage network on your hosts and containers, yes | 15:29 |
| jrosser | it's just IP :) | 15:30 |
| jrosser | storage network will be something larger than /24 in total so you give a route to the total cidr via the local pod gateway ip | 15:30 |
| admin0 | so in cidr_networks, do I have to use pod specific ones ? won't pod_1 and pod_2 container be the same /22 as they are l2 | 15:31 |
| admin0 | aah .. i mix and match and only in storage i use pod1_container pod_2 container etc | 15:31 |
| jrosser | its just like this https://docs.openstack.org/openstack-ansible/latest/user/l3pods/example.html | 15:34 |
| jrosser | except you only use the routed networks for pod1/2/3_storage | 15:35 |
| jrosser | and set up the other networks like a more usual deployment | 15:35 |
| admin0 | problem is also where do I add a acompute node or controller | 15:35 |
| admin0 | where its 2 networks are normal, but only storage is a part of a pod | 15:35 |
| jrosser | will need a little finessing of the ansible groups though, as the L2 networks will need to be for "all_computes" | 15:36 |
| jrosser | and the routed networks for "pod_N_computes" | 15:36 |
| jrosser | see in the example there is a group compute_hosts which contains all the compute hosts regardless of pod | 15:38 |
| jrosser | but they've also defined extra groups "pod<N>_hosts" and then used those in 'reference_group' for the routed networks | 15:39 |
| jrosser | thats how to approach this | 15:39 |
| *** gyee has joined #openstack-ansible | 15:42 | |
| spatel | jrosser: how far we are to release centos8 ? | 15:53 |
| mnaser | jrosser: i think the best thing to do is because we maintin that /etc/openstack_deploy is a 'static' area | 16:00 |
| mnaser | or not somethign that will disappear easily | 16:00 |
| mnaser | we can delegate teh deploy host to create a ca and then sign/ship certs from there | 16:00 |
| mnaser | and i think ansible has modules for that | 16:00 |
| mnaser | (in my new world, we use cert-manager to create a CA and issue certs from there but.. yeah, another world) | 16:00 |
| *** jbadiapa has quit IRC | 16:10 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_blazar master: Add centos-8 support https://review.opendev.org/739647 | 16:14 |
| *** chandankumar is now known as raukadah | 16:18 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Check libselinux-python3 instead of py2 alternative https://review.opendev.org/742937 | 16:21 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Fix ceph deployment for CentOS 7 https://review.opendev.org/742262 | 16:23 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_panko stable/ussuri: Add centos-8 support https://review.opendev.org/742939 | 16:30 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_mistral stable/ussuri: Add centos-8 support https://review.opendev.org/742940 | 16:31 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts stable/ussuri: Fix centos-8 functional tests https://review.opendev.org/742941 | 16:31 |
| *** vakuznet has joined #openstack-ansible | 16:35 | |
| vakuznet | https://review.opendev.org/#/c/716975/1 please review | 16:35 |
| openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Add centos-8 support https://review.opendev.org/739405 | 16:44 |
| *** maharg101 has quit IRC | 16:45 | |
| *** maharg101 has joined #openstack-ansible | 16:50 | |
| *** markvoelker has quit IRC | 16:52 | |
| *** vakuznet has quit IRC | 16:53 | |
| *** redrobot has joined #openstack-ansible | 16:58 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Add centos-8 support https://review.opendev.org/739648 | 17:01 |
| spatel | jrosser: After all these merge i don't need to patch indiviual right? i can just pull master and start building on centOS-8 | 17:36 |
| jrosser | for everything that is merged, yes | 17:40 |
| spatel | +1 | 17:50 |
| *** dave-mccowan has quit IRC | 20:20 | |
| *** dave-mccowan has joined #openstack-ansible | 20:25 | |
| *** mmethot_ has quit IRC | 20:26 | |
| *** mmethot has joined #openstack-ansible | 20:34 | |
| *** mmethot has quit IRC | 20:38 | |
| *** spatel has quit IRC | 20:42 | |
| tow | guys, it looks like the cause of the deployment error comes down to /var/www/repo/os-releases/21.0.0.0rc2/ceilometer-21.0.0.0rc2.constraints.txt not being found, it actually does not exist in the repo | 20:58 |
| tow | any clue? | 20:58 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko stable/ussuri: Add centos-8 support https://review.opendev.org/742939 | 20:59 |
| *** mmethot has joined #openstack-ansible | 21:05 | |
| jrosser | tow: that file is generated on the fly and deleted if the venv build fails | 21:06 |
| jrosser | tow: your error seemed to be due to failure to compile the libvirt python module which I think is fixed by this patch https://review.opendev.org/#/c/742253/ | 21:08 |
| tow | okay, thanks, will check out the patch | 21:15 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add rsync package for New CentOS-8 minimal installs https://review.opendev.org/740843 | 22:15 |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Add centos-8 support https://review.opendev.org/739647 | 22:18 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Avoid rebuilding the venv with every run https://review.opendev.org/742369 | 22:32 |
| *** dave-mccowan has quit IRC | 22:44 | |
| *** dave-mccowan has joined #openstack-ansible | 22:49 | |
| *** dave-mccowan has quit IRC | 22:56 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts stable/ussuri: Fix centos-8 functional tests https://review.opendev.org/742941 | 23:38 |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix management address lookup for metal hosts in some deployments https://review.opendev.org/741167 | 23:51 |
| *** tosky has quit IRC | 23:55 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!