*** brinzhang0 has joined #openstack-kolla | 00:09 | |
*** brinzhang_ has quit IRC | 00:13 | |
*** LinPeiWen has joined #openstack-kolla | 00:46 | |
*** ivan_lin has joined #openstack-kolla | 00:47 | |
*** brinzhang_ has joined #openstack-kolla | 01:42 | |
*** ivan_lin has quit IRC | 01:43 | |
*** ivan_lin has joined #openstack-kolla | 01:44 | |
*** brinzhang0 has quit IRC | 01:45 | |
*** ricolin_ has joined #openstack-kolla | 02:27 | |
*** ricolin_ has quit IRC | 02:34 | |
*** ricolin_ has joined #openstack-kolla | 02:34 | |
*** ricolin_ has quit IRC | 03:04 | |
*** zzzeek has quit IRC | 03:25 | |
*** zul has joined #openstack-kolla | 03:28 | |
*** skramaja has joined #openstack-kolla | 03:28 | |
*** zzzeek has joined #openstack-kolla | 03:29 | |
*** LinPeiWen has quit IRC | 03:52 | |
*** ricolin_ has joined #openstack-kolla | 04:01 | |
*** ricolin_ has quit IRC | 04:07 | |
*** ricolin_ has joined #openstack-kolla | 04:08 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-kolla | 05:33 | |
*** vishalmanchanda has joined #openstack-kolla | 06:14 | |
*** bsanjeewa has joined #openstack-kolla | 06:26 | |
*** dcapone2004 has quit IRC | 06:30 | |
*** nikparasyr has joined #openstack-kolla | 07:15 | |
*** abdysn has joined #openstack-kolla | 07:15 | |
*** LinPeiWen has joined #openstack-kolla | 07:15 | |
*** cah_link has joined #openstack-kolla | 07:25 | |
*** ricolin_ has quit IRC | 07:27 | |
*** ricolin has joined #openstack-kolla | 07:27 | |
*** Abdallahyas has joined #openstack-kolla | 07:54 | |
*** abdysn has quit IRC | 07:55 | |
*** wuchunyang has joined #openstack-kolla | 07:56 | |
*** e0ne has joined #openstack-kolla | 07:58 | |
*** e0ne has quit IRC | 08:15 | |
*** vishalmanchanda has quit IRC | 08:34 | |
*** rpittau|afk is now known as rpittau | 08:51 | |
*** andrewbonney has joined #openstack-kolla | 08:53 | |
openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Update website URL for InfluxDB https://review.opendev.org/c/openstack/kolla-ansible/+/768980 | 08:54 |
---|---|---|
*** brinzhang0 has joined #openstack-kolla | 08:56 | |
*** brinzhang_ has quit IRC | 08:59 | |
*** devfaz has quit IRC | 09:08 | |
*** oyrogerg has quit IRC | 09:13 | |
*** devfaz has joined #openstack-kolla | 09:20 | |
*** devfaz has quit IRC | 09:24 | |
*** bsanjeewa has quit IRC | 09:34 | |
*** devfaz has joined #openstack-kolla | 09:35 | |
mgoddard | Morning koalas, happy new year | 09:36 |
mnasiadka | morning | 09:43 |
*** Abdallahyas has quit IRC | 09:45 | |
*** abdysn has joined #openstack-kolla | 09:46 | |
hrw | morning | 09:51 |
openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Fix Freezer & Cyborg API startup on CentOS https://review.opendev.org/c/openstack/kolla/+/769117 | 09:59 |
*** e0ne has joined #openstack-kolla | 10:04 | |
*** e0ne has quit IRC | 10:05 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/victoria: docs: add info on adding and removing hosts https://review.opendev.org/c/openstack/kolla-ansible/+/768748 | 10:06 |
*** oyrogerg has joined #openstack-kolla | 10:06 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: docs: add info on adding and removing hosts https://review.opendev.org/c/openstack/kolla-ansible/+/768749 | 10:07 |
*** wuchunyang has quit IRC | 10:26 | |
openstackgerrit | Merged openstack/kolla-ansible master: Fix Ceph links https://review.opendev.org/c/openstack/kolla-ansible/+/768567 | 10:28 |
*** bsanjeewa has joined #openstack-kolla | 10:40 | |
*** muhaha has joined #openstack-kolla | 11:29 | |
*** zzzeek has quit IRC | 11:50 | |
*** zzzeek has joined #openstack-kolla | 11:52 | |
*** Luzi has joined #openstack-kolla | 12:55 | |
*** ricolin has quit IRC | 13:06 | |
*** bsanjeewa has quit IRC | 13:30 | |
*** Abdallahyas has joined #openstack-kolla | 13:40 | |
*** abdysn has quit IRC | 13:44 | |
*** abdysn has joined #openstack-kolla | 13:44 | |
*** Abdallahyas has quit IRC | 13:45 | |
*** dave-mccowan has quit IRC | 13:52 | |
*** dave-mccowan has joined #openstack-kolla | 13:53 | |
mgoddard | Anyone have time to review https://review.opendev.org/c/openstack/kolla-ansible/+/767932 ? | 13:54 |
*** dougsz has joined #openstack-kolla | 14:00 | |
openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: octavia: fix typo in defaults https://review.opendev.org/c/openstack/kolla-ansible/+/769147 | 14:05 |
hrw | +2+w | 14:11 |
*** Luzi has quit IRC | 14:14 | |
*** TrevorV has joined #openstack-kolla | 14:18 | |
*** abdysn has quit IRC | 14:19 | |
openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Add `issue` reno for bug #1904062 https://review.opendev.org/c/openstack/kolla-ansible/+/767932 | 14:24 |
openstack | bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] https://launchpad.net/bugs/1904062 - Assigned to Michal Nasiadka (mnasiadka) | 14:24 |
openstackgerrit | Merged openstack/kolla-ansible stable/victoria: docs: add info on adding and removing hosts https://review.opendev.org/c/openstack/kolla-ansible/+/768748 | 14:24 |
openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: docs: add info on adding and removing hosts https://review.opendev.org/c/openstack/kolla-ansible/+/768749 | 14:30 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Add `issue` reno for bug #1904062 https://review.opendev.org/c/openstack/kolla-ansible/+/768750 | 14:39 |
openstack | bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] https://launchpad.net/bugs/1904062 - Assigned to Michal Nasiadka (mnasiadka) | 14:39 |
yoctozepto | happy new year, folks | 14:39 |
yoctozepto | mgoddard, hrw: care to repeat the approvals? ^^ | 14:40 |
yoctozepto | perhaps it's worth releasing everything now | 14:40 |
*** zzzeek has quit IRC | 14:44 | |
mgoddard | yoctozepto: yeah, that was my thinking | 14:47 |
mgoddard | would be good to get the docker prechecks fix out | 14:47 |
*** zzzeek has joined #openstack-kolla | 14:47 | |
yoctozepto | and kolla to build that centos 8.3 ;-) | 14:48 |
*** ysirndjuro has joined #openstack-kolla | 15:06 | |
*** nikparasyr has left #openstack-kolla | 15:31 | |
openstackgerrit | Buddhika Sanjeewa proposed openstack/kolla-ansible master: Fixes solum_api Listening on 127.0.0.1 https://review.opendev.org/c/openstack/kolla-ansible/+/769157 | 15:50 |
*** atmark has joined #openstack-kolla | 16:02 | |
openstackgerrit | Merged openstack/kolla stable/ussuri: Fix Freezer & Cyborg API startup on CentOS https://review.opendev.org/c/openstack/kolla/+/769117 | 16:09 |
openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Add `issue` reno for bug #1904062 https://review.opendev.org/c/openstack/kolla-ansible/+/768750 | 16:09 |
openstack | bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] https://launchpad.net/bugs/1904062 - Assigned to Michal Nasiadka (mnasiadka) | 16:09 |
*** LinPeiWen has quit IRC | 16:15 | |
atmark | Hello. elasticsearch curator cron job does not run. I'm using stabl/ussuri | 16:27 |
*** zzzeek has quit IRC | 16:39 | |
*** zzzeek has joined #openstack-kolla | 16:40 | |
*** cah_link has quit IRC | 16:43 | |
*** zzzeek has quit IRC | 16:46 | |
*** zzzeek has joined #openstack-kolla | 16:47 | |
dougsz | atmark: I recall a bug for that, but it was fixed some time ago | 16:51 |
dougsz | crontab looks sensible? correct ownership? | 16:52 |
atmark | dougsz: are you referring to https://bugs.launchpad.net/kolla-ansible/+bug/1885732 ? | 16:55 |
openstack | Launchpad bug 1885732 in kolla-ansible victoria "elasticsearch curator's cron job does not run" [Medium,Fix released] - Assigned to Radosław Piliszek (yoctozepto) | 16:55 |
atmark | elasticsearch cron has this perm /var/spool/cron/crontabs/elasticsearch | 16:56 |
atmark | -rw------- 1 elasticsearch elasticsearch 140 Dec 11 01:04 /var/spool/cron/crontabs/elasticsearch | 16:56 |
dougsz | atmark: that's the one | 16:57 |
dougsz | Hmm, anything in cron logs about not being able to read the script etc? | 16:58 |
dougsz | If you run the command in that file, does it work, or generate an error? | 16:58 |
atmark | I have that fix but the cron still does not cron | 16:58 |
atmark | it runs without error when I run the command | 16:59 |
dougsz | hmm, so we have narrowed it down to an issue with the cron config, hopefully there are some hints in the cron logs | 16:59 |
atmark | there is no cron log inside elasticsearch-curator container | 17:01 |
mnasiadka | Because cron logs to syslog :) | 17:03 |
yoctozepto | and sends local mails | 17:03 |
yoctozepto | cron is old folk | 17:03 |
yoctozepto | what distro is failing? | 17:04 |
atmark | ubuntu bionic | 17:04 |
dougsz | Anything in /var/log/kolla/elasticsearch/elasticsearch-curator.log or is it empty? | 17:05 |
dougsz | `docker logs --follow elasticsearch_curator` shows crond is launched? | 17:06 |
atmark | there's some cleanup logs in curator log but it came from the manual run | 17:08 |
atmark | crond is launched | 17:08 |
atmark | there is no syslog in curator container | 17:10 |
dougsz | you might get some output from the docker logs with the -x flag | 17:11 |
yoctozepto | dougsz: what's that? :o | 17:13 |
dougsz | crond | 17:13 |
dougsz | via config.json | 17:13 |
dougsz | final idea try listing the elastic crontab contents: `sudo docker exec -it -u elasticsearch elasticsearch_curator crontab -l ` | 17:13 |
*** zzzeek has quit IRC | 17:13 | |
yoctozepto | dougsz: ah, I read you want to use -x with `docker logs` | 17:14 |
yoctozepto | :D | 17:14 |
*** zzzeek has joined #openstack-kolla | 17:14 | |
dougsz | ah, sorry! | 17:14 |
*** rpittau is now known as rpittau|afk | 17:14 | |
yoctozepto | perhaps we should ditch cron for in-python cron, wdyt dougsz mnasiadka | 17:15 |
yoctozepto | that way we drop the unfriendly legacy daemon | 17:15 |
dougsz | sounds sensible - I think we have both spent way too long fiddling around with it | 17:16 |
dougsz | although it seems fine on Centos / Ussuri currently | 17:17 |
atmark | cron daemon was compiled without debugging enabled so -x flag didn't work | 17:18 |
dougsz | argh, Is log rotate working atmark | 17:18 |
dougsz | (cron container) | 17:19 |
atmark | root@logostack01a:~# docker exec -it -u elasticsearch elasticsearch_curator crontab -l | 17:19 |
atmark | PATH=/usr/local/bin:/usr/bin:/bin | 17:19 |
atmark | 0 0 * * * curator --config /etc/elasticsearch-curator/curator.yml /etc/elasticsearch-curator/actions.yml | 17:19 |
atmark | root@logostack01a:~# | 17:19 |
atmark | yep | 17:19 |
atmark | log rotate is working | 17:19 |
dougsz | weird - so that uses crond in the same way, and it looks like you can read the crontab fine in the curator container | 17:20 |
dougsz | no more ideas from me :/ | 17:20 |
*** dougsz has quit IRC | 17:29 | |
*** andrewbonney has quit IRC | 18:03 | |
*** jonaspaulo has joined #openstack-kolla | 18:20 | |
*** jonaspaulo has quit IRC | 18:23 | |
*** zzzeek has quit IRC | 18:26 | |
*** zzzeek has joined #openstack-kolla | 18:28 | |
*** e0ne has joined #openstack-kolla | 18:40 | |
*** muhaha has quit IRC | 18:46 | |
yoctozepto | priteau: re blazar: if I were you, I would just drop the l-c ;-) | 18:53 |
*** e0ne has quit IRC | 18:55 | |
*** e0ne has joined #openstack-kolla | 18:57 | |
*** e0ne has quit IRC | 18:57 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Fix Freezer & Cyborg API startup on CentOS https://review.opendev.org/c/openstack/kolla/+/769177 | 18:58 |
*** e0ne has joined #openstack-kolla | 18:59 | |
*** e0ne has quit IRC | 19:06 | |
*** zzzeek has quit IRC | 19:19 | |
*** zzzeek has joined #openstack-kolla | 19:20 | |
*** zzzeek has quit IRC | 19:27 | |
*** zzzeek has joined #openstack-kolla | 19:28 | |
*** hjensas is now known as hjensas|PTO | 19:31 | |
priteau | yoctozepto: I'm thinking of doing just that | 20:24 |
priteau | Oh, I had not seen fungi's answer yet | 20:39 |
priteau | Giving it another try… | 20:39 |
*** dave-mccowan has quit IRC | 20:40 | |
*** bengates has joined #openstack-kolla | 20:40 | |
*** bengates has quit IRC | 20:43 | |
*** bengates has joined #openstack-kolla | 20:44 | |
*** bengates has quit IRC | 20:48 | |
*** e0ne has joined #openstack-kolla | 21:05 | |
*** e0ne has quit IRC | 21:31 | |
*** TrevorV has quit IRC | 22:37 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!