| *** dave-mccowan has quit IRC | 00:00 | |
| *** evrardjp has quit IRC | 00:04 | |
| *** evrardjp has joined #openstack-ansible | 00:05 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Set force option to false by default https://review.opendev.org/c/openstack/openstack-ansible/+/769588 | 00:05 |
|---|---|---|
| *** macz_ has quit IRC | 00:09 | |
| *** macz_ has joined #openstack-ansible | 00:11 | |
| *** macz_ has quit IRC | 00:16 | |
| *** rfolco has joined #openstack-ansible | 00:17 | |
| *** rfolco has quit IRC | 00:22 | |
| *** antonym has quit IRC | 00:22 | |
| *** antonym has joined #openstack-ansible | 00:32 | |
| *** rfolco has joined #openstack-ansible | 00:43 | |
| *** maharg101 has joined #openstack-ansible | 00:45 | |
| *** maharg101 has quit IRC | 00:50 | |
| *** rh-jelabarre has joined #openstack-ansible | 01:29 | |
| *** rh-jelabarre has quit IRC | 01:41 | |
| *** tinwood has quit IRC | 02:08 | |
| *** tinwood has joined #openstack-ansible | 02:11 | |
| *** rfolco has quit IRC | 02:41 | |
| *** ianychoi__ has joined #openstack-ansible | 03:22 | |
| *** ianychoi_ has quit IRC | 03:25 | |
| *** lemko3 has joined #openstack-ansible | 04:24 | |
| *** lemko has quit IRC | 04:25 | |
| *** lemko3 is now known as lemko | 04:25 | |
| *** gyee has quit IRC | 04:25 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:33 | |
| *** miloa has joined #openstack-ansible | 06:18 | |
| *** pto has joined #openstack-ansible | 06:47 | |
| *** pto has joined #openstack-ansible | 06:48 | |
| *** sshnaidm has quit IRC | 08:02 | |
| *** sshnaidm has joined #openstack-ansible | 08:15 | |
| *** andrewbonney has joined #openstack-ansible | 08:16 | |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun stable/victoria: defaults: start kuryr service before docker https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769593 | 08:20 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun master: Add support for kata container runtime https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769555 | 08:29 |
| *** rpittau|afk is now known as rpittau | 08:37 | |
| *** tosky has joined #openstack-ansible | 08:39 | |
| *** MickyMan77 has joined #openstack-ansible | 08:53 | |
| *** maharg101 has joined #openstack-ansible | 09:02 | |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun master: Add cron cleanup script to handle old Docker data https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769688 | 09:17 |
| *** fanfi has joined #openstack-ansible | 09:25 | |
| *** gokhani has joined #openstack-ansible | 09:45 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-ops master: Allow longer timeouts for elasticsearch.service https://review.opendev.org/c/openstack/openstack-ansible-ops/+/769695 | 09:48 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-ops master: Fix elk 7 {conf,env}.d sample https://review.opendev.org/c/openstack/openstack-ansible-ops/+/762331 | 09:50 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-ops master: Fix 'str' vs int comparison https://review.opendev.org/c/openstack/openstack-ansible-ops/+/769698 | 09:56 |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/754193 | 10:02 |
| openstackgerrit | Jiaping LI proposed openstack/openstack-ansible-os_neutron master: Use PCI_SLOT_NAME cut instead of ls -ld cut more precisely https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/769700 | 10:17 |
| *** mgariepy has quit IRC | 10:18 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-ops master: Get elastic plugins via proxy https://review.opendev.org/c/openstack/openstack-ansible-ops/+/769701 | 10:22 |
| *** mgariepy has joined #openstack-ansible | 10:23 | |
| fanfi | Hi, i would like to change my OS distro from centos to ubuntu and on host.yml i got faild message for downloding unexists link for ubuntu image /ubuntu-base-20.04-base-amd64.tar.gz anybody have idea how i can fix it ? | 10:33 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun master: Add support for kata container runtime https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769555 | 10:48 |
| ebbex | fanfi: which release/version are you on? | 10:49 |
| ebbex | fanfi: check if you have this patch on your release https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/759300 | 10:51 |
| *** spatel has joined #openstack-ansible | 10:57 | |
| *** spatel has quit IRC | 11:02 | |
| fanfi | ebbex: Ussuri releease | 11:03 |
| ebbex | fanfi: 21.2.0? | 11:05 |
| ebbex | fanfi: check /etc/ansible/roles/lxc_hosts | 11:05 |
| ebbex | fanfi: `git log` top commit should be 'Determine latest base image available', if it's not you need to get that in there. | 11:06 |
| fanfi | ebbex: i can't find the version note :( | 11:13 |
| ebbex | fanfi: update your ussuri to atleast 21.2.0 (and re-bootstrap-ansible), or cherry-pick the patch in. | 11:16 |
| fanfi | ebbex: after git pull i see Already up to date. and last merge messige is Merge "Set force option to false by default" | 11:28 |
| ebbex | git pull what and where? | 11:47 |
| *** macz_ has joined #openstack-ansible | 12:05 | |
| *** macz_ has quit IRC | 12:09 | |
| *** rfolco has joined #openstack-ansible | 12:19 | |
| *** rh-jelabarre has joined #openstack-ansible | 12:40 | |
| fanfi | ebex: i am using this repo -b master https://opendev.org/openstack/openstack-ansible | 13:04 |
| fanfi | ebbex: i am using this repo -b master https://opendev.org/openstack/openstack-ansible | 13:14 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun master: Add support for kata container runtime https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769555 | 13:17 |
| *** macz_ has joined #openstack-ansible | 14:06 | |
| *** irclogbot_3 has quit IRC | 14:09 | |
| *** macz_ has quit IRC | 14:10 | |
| *** irclogbot_1 has joined #openstack-ansible | 14:12 | |
| *** spatel has joined #openstack-ansible | 14:18 | |
| *** dave-mccowan has joined #openstack-ansible | 14:37 | |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_zun master: Add support for kata container runtime https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/769555 | 14:37 |
| *** dave-mccowan has quit IRC | 14:42 | |
| *** dasp_ has joined #openstack-ansible | 15:00 | |
| *** dasp has quit IRC | 15:01 | |
| *** mjwales has joined #openstack-ansible | 15:33 | |
| mjwales | Hi, following a power outage our underpinning ceph cluster has failed to come back. The OSD disk are not auto mounting as they have done previously. Logs don't suggest anything is wrong apart from being unable to find the keyring as the drives are not mounted. | 15:34 |
| mjwales | Does anyone have thoughts on how to bring the ceph cluster back online? | 15:34 |
| spatel | mjwales: I am assuming you did some googling to find advice or suggestion | 15:41 |
| mjwales | I've spent many hours googling but nothing seemed to fit what we are seeing | 15:41 |
| mjwales | Tried restarting the osd service but it complains the keychain is missing which makes sense as the drive is not mounted. We've never had to mount the drives previously so a little confused | 15:42 |
| spatel | mjwales: did you see this - https://access.redhat.com/solutions/3524771 | 15:43 |
| mjwales | spatel: we are not even getting that far. In the osd log "auth: unable to find a keyring on /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory" | 15:45 |
| mgariepy | mjwales, are your mons up ? | 15:47 |
| mgariepy | is the network working correctly ? | 15:48 |
| mgariepy | are all your server ntp synched ? | 15:48 |
| mjwales | mons are showing as up and networking appears okay | 15:48 |
| mjwales | ntp is looking okay too | 15:49 |
| mjwales | Is it safe to manually mount /dev/sdb1 onto /var/lib/ceph/osd/ceph-0 then try restarting osd.0? | 15:52 |
| ThiagoCMC | Hey guys... The `./scripts/run-upgrade.sh` from Ussuri AIO, to Victoria AIO, fails at `openstack-ansible os-tempest-install.yml`, error: http://paste.openstack.org/show/801485/ | 15:54 |
| mgariepy | ins't ceph-osd service supposed to do that for you ? | 15:54 |
| *** macz_ has joined #openstack-ansible | 15:55 | |
| *** macz_ has quit IRC | 15:55 | |
| *** macz_ has joined #openstack-ansible | 15:56 | |
| mjwales | mgariepy : That is what I thought but it isn't and there is nothing in the log that indicates why it is not | 15:56 |
| mgariepy | what is in the logs of `systemctl status ceph-osd@0` | 15:57 |
| mgariepy | mjwales, what OS ? and which version of ceph are you running? | 15:59 |
| mjwales | mgariepy: https://pastebin.com/pr3wecMq | 16:00 |
| mjwales | Ubuntu 18.04 and nautilus | 16:00 |
| mgariepy | from a mon `ceph status` | 16:00 |
| mjwales | mgariepy : mon status https://pastebin.com/EEvXTCGj | 16:01 |
| mjwales | The 10 hosts it thinks are down are not actually down | 16:02 |
| mgariepy | ok, the osd that are up are on one server ? | 16:03 |
| mjwales | Yes they are apart from a select couple where a single OSD is up on a host | 16:05 |
| mjwales | In the case of a single OSD showing up it isn't actually yp | 16:05 |
| spatel | mjwales: Try IRC https://webchat.oftc.net/# use #ceph channel name. you will find lots of ceph expert there, they help me out in past :) | 16:07 |
| mjwales | spatel: thanks | 16:07 |
| mgariepy | i'm not quite sure what is happening there .. | 16:08 |
| mgariepy | when you find a solution. please let us know what was the issue. | 16:08 |
| mjwales | Will do :) | 16:09 |
| spatel | Did you try to re-run playbook to see if it can correct something? | 16:10 |
| mjwales | I did but that failed to restart the OSDs also | 16:10 |
| mjwales | Re-ran ceph-install across the entire deployment | 16:10 |
| spatel | In my cluster on OSD i have this - http://paste.openstack.org/show/801486/ | 16:18 |
| spatel | look like it mount that directory in tmpfs /var/lib/ceph/osd/ceph-0 which has keyring file | 16:18 |
| mjwales | spatel: i just need to do that tmpfs mount | 16:19 |
| *** gyee has joined #openstack-ansible | 16:37 | |
| *** miloa has quit IRC | 16:38 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/769397 | 16:50 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/769406 | 17:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/769398 | 17:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/769389 | 17:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Use systemd sockets for libvirt https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/769556 | 17:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/769400 | 17:17 |
| *** rpittau is now known as rpittau|afk | 17:18 | |
| *** mjwales has quit IRC | 17:20 | |
| spatel | noonedeadpunk: do you think we are ready for stable/victoria release or going toward RC2 ? | 17:37 |
| *** maharg101 has quit IRC | 18:31 | |
| *** yann-kaelig has joined #openstack-ansible | 18:49 | |
| *** andrewbonney has quit IRC | 19:25 | |
| *** pto_ has joined #openstack-ansible | 19:48 | |
| *** pto has quit IRC | 19:52 | |
| *** sshnaidm is now known as sshnaidm|afk | 19:52 | |
| *** maharg101 has joined #openstack-ansible | 20:28 | |
| *** maharg101 has quit IRC | 20:33 | |
| *** pto_ has quit IRC | 20:37 | |
| *** pto has joined #openstack-ansible | 20:37 | |
| *** pto has quit IRC | 20:42 | |
| *** lemko has quit IRC | 20:58 | |
| *** lemko has joined #openstack-ansible | 20:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Add trusted.gpg to the copy_from_host list for 20.04 https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/768337 | 21:03 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts stable/victoria: Add trusted.gpg to the copy_from_host list for 20.04 https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/769742 | 21:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: Add trusted.gpg to the copy_from_host list for 20.04 https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/769743 | 21:05 |
| *** noonedeadpunk has quit IRC | 21:47 | |
| *** noonedeadpunk has joined #openstack-ansible | 21:48 | |
| *** rfolco has quit IRC | 21:51 | |
| prometheanfire | anyone have issues with ovs? added some networks to some nodes and now neutron-ovs-agent is barfing on firewall rule changes | 22:06 |
| *** yann-kaelig has quit IRC | 22:07 | |
| *** spatel has quit IRC | 23:07 | |
| *** jbadiapa has quit IRC | 23:21 | |
| *** tosky has quit IRC | 23:53 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!