| *** diga has joined #openstack-kolla | 00:10 | |
| *** igordc has joined #openstack-kolla | 00:12 | |
| *** jimcrowleyibm has joined #openstack-kolla | 00:35 | |
| *** jcmdln has quit IRC | 00:50 | |
| *** jimcrowl_ has joined #openstack-kolla | 01:06 | |
| *** jimcrowleyibm has quit IRC | 01:09 | |
| *** dmellado has quit IRC | 01:22 | |
| *** jimcrowleyibm has joined #openstack-kolla | 01:38 | |
| *** jimcrowl_ has quit IRC | 01:41 | |
| *** dmellado has joined #openstack-kolla | 01:46 | |
| *** tonythomas has quit IRC | 02:04 | |
| *** Tony31 has joined #openstack-kolla | 02:06 | |
| *** zhanglong has joined #openstack-kolla | 02:07 | |
| *** happyhemant has quit IRC | 02:09 | |
| *** jimcrowl_ has joined #openstack-kolla | 02:10 | |
| *** jimcrowleyibm has quit IRC | 02:12 | |
| *** hongbin has joined #openstack-kolla | 02:20 | |
| *** k_mouza has joined #openstack-kolla | 02:24 | |
| *** jimcrowl_ is now known as jimcrowleyibm[aw | 02:25 | |
| *** k_mouza has quit IRC | 02:29 | |
| *** openstackgerrit has joined #openstack-kolla | 02:29 | |
| openstackgerrit | Merged openstack/kolla-ansible master: support ipv6 for grafana.ini.j2 https://review.opendev.org/711379 | 02:29 |
|---|---|---|
| *** diurnalist has joined #openstack-kolla | 02:32 | |
| *** hongbin has quit IRC | 02:39 | |
| *** jcmdln has joined #openstack-kolla | 02:39 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix HAProxy monitor VIP precheck https://review.opendev.org/711924 | 02:43 |
| openstackgerrit | Yongjun Bai proposed openstack/kolla-ansible stable/train: support ipv6 for grafana.ini.j2 https://review.opendev.org/712228 | 02:45 |
| *** diurnalist has quit IRC | 02:52 | |
| *** ricolin_ has joined #openstack-kolla | 03:01 | |
| *** igordc has quit IRC | 03:30 | |
| *** ricolin_ has quit IRC | 03:38 | |
| *** ykarel|away is now known as ykarel | 03:44 | |
| *** diga has quit IRC | 03:47 | |
| *** TrevorV has joined #openstack-kolla | 03:57 | |
| *** ricolin has quit IRC | 04:44 | |
| *** shyamb has joined #openstack-kolla | 04:45 | |
| *** diurnalist has joined #openstack-kolla | 04:49 | |
| *** diurnalist has quit IRC | 04:54 | |
| *** TrevorV has quit IRC | 05:06 | |
| *** evrardjp has quit IRC | 05:35 | |
| *** evrardjp has joined #openstack-kolla | 05:35 | |
| *** ricolin has joined #openstack-kolla | 05:51 | |
| *** sri_ has joined #openstack-kolla | 05:54 | |
| sri_ | morning | 05:54 |
| osmanlicilegi | morning | 06:09 |
| *** abdysn has joined #openstack-kolla | 06:13 | |
| *** skramaja has joined #openstack-kolla | 06:16 | |
| *** shyamb has quit IRC | 06:20 | |
| Tony31 | morning! | 06:35 |
| *** Tony31 has quit IRC | 06:42 | |
| *** shyamb has joined #openstack-kolla | 06:59 | |
| *** jbadiapa has joined #openstack-kolla | 07:22 | |
| *** shyam89 has joined #openstack-kolla | 07:28 | |
| *** bengates has joined #openstack-kolla | 07:28 | |
| *** bengates has quit IRC | 07:29 | |
| *** shyamb has quit IRC | 07:32 | |
| *** shyam89 has quit IRC | 07:46 | |
| *** Tony31 has joined #openstack-kolla | 07:51 | |
| *** suff has joined #openstack-kolla | 07:52 | |
| yoctozepto | Tony31: no cheating! :D | 07:56 |
| yoctozepto | morning folks | 07:57 |
| yoctozepto | evening Tony31 | 07:57 |
| hrw | morning | 08:02 |
| hrw | horizon folks do not answer. time to check for their bug page | 08:03 |
| yoctozepto | hrw: and/or ml :-) | 08:03 |
| hrw | yoctozepto: ML wrote yesterday on | 08:04 |
| yoctozepto | hrw: you? did not see any | 08:04 |
| hrw | yoctozepto: [horizon][kolla] pyscss failure on newest setuptools | 08:04 |
| yoctozepto | hrw: not in my mailbox | 08:05 |
| yoctozepto | and I'm serious | 08:05 |
| yoctozepto | hrw: http://lists.openstack.org/pipermail/openstack-discuss/2020-March/thread.html neither here | 08:05 |
| hrw | fsck | 08:05 |
| yoctozepto | xD | 08:05 |
| hrw | sent again | 08:05 |
| yoctozepto | where did it go if I may ask? :D | 08:06 |
| hrw | openstack-discuss@lists.openstack.org | 08:06 |
| yoctozepto | hrw: I mean previously? | 08:06 |
| hrw | wtf. | 08:07 |
| hrw | same | 08:07 |
| yoctozepto | openstack-discuss@lists.openstack.org | 08:07 |
| yoctozepto | the one I am getting things from | 08:07 |
| yoctozepto | hrw: don't worry | 08:08 |
| hrw | yoctozepto: I sent you a copy | 08:08 |
| yoctozepto | my mails are not there either | 08:08 |
| hrw | wtf | 08:08 |
| yoctozepto | I sent one yesterday | 08:08 |
| hrw | asked on #opesntack-insfra | 08:10 |
| yoctozepto | hrw: yeah, I did just a bit earlier; called all I saw around recently | 08:12 |
| yoctozepto | hrw: hah and I was afraid I asked a dumb question and did not get an answer | 08:13 |
| hrw | https://bugs.launchpad.net/horizon/+bug/1866961 | 08:14 |
| openstack | Launchpad bug 1866961 in OpenStack Dashboard (Horizon) "ImportError: cannot import name 'Feature'" [Undecided,New] | 08:14 |
| yoctozepto | Features feature. | 08:15 |
| hrw | yep | 08:15 |
| Tony31 | @yoctozepto cheating? :-s | 08:15 |
| yoctozepto | Tony31: just kidding! :D | 08:16 |
| yoctozepto | Tony31: I mean it's still weird knowing it's evening there and greeting you with morning | 08:16 |
| yoctozepto | ;D | 08:16 |
| Tony31 | ah :) yes almost the end of my day now. Been a whirlwind of a day. Still working on 4 or 5 things simultaneously | 08:17 |
| hrw | UGT (abbr.): Universal Greeting Time. | 08:17 |
| hrw | UGT is convention initially established in #mipslinux on irc.openprojects.net (now irc.freenode.net) but slowly taking over the world. It states that it is always morning when person comes into a channel, and it is always late night when person leaves. Local time of any member of channel is irrelevant. Resistance is futile. Your ass will be laminated. (geoman is exception to this rule - his ass will | 08:17 |
| hrw | be fried instead). | 08:17 |
| hrw | Used as follows: | 08:17 |
| hrw | Good (UGT) Morning, Everyone! or good morning (ugt) (on entry to channel). | 08:17 |
| hrw | Good (UGT) Night - when leaving it. | 08:17 |
| hrw | The idea behind establishing this convention was to eliminate noise generated almost every time someone comes in and greets using some form of day-time based greeting, and then channel members on the other side of the globe start pointing out that it's different time of the day for them. Now, instead of spending time figuring out what time of day is it for every member of the channel, we spend time | 08:17 |
| hrw | explaining newcomers benefits of UGT. | 08:17 |
| hrw | ;D | 08:17 |
| Tony31 | So what do we do now? Just join and say "UGT!" | 08:18 |
| hrw | Tony31: no. 'morning' | 08:18 |
| *** tonythomas has joined #openstack-kolla | 08:18 | |
| yoctozepto | no, "fsck" | 08:18 |
| yoctozepto | for "friendly space check" | 08:18 |
| Tony31 | 🙈 :) | 08:18 |
| hrw | (venv3) 09:19 (236s) hrw@puchatek:kolla$ for branch in rocky stein train master;do time ~/devel/moje/docker-utils/kolla-build-images.sh ubuntu source horizon $branch;done | 08:20 |
| hrw | let do check to add to horizon bug | 08:20 |
| hrw | ops. not that line | 08:20 |
| *** bengates has joined #openstack-kolla | 08:21 | |
| hrw | (venv3) 09:20 (0s) hrw@puchatek:kolla$ for branch in rocky stein train;do git checkout stable/$branch; git up; time ~/devel/moje/docker-utils/kolla-build-images.sh ubuntu source horizon $branch;done;git checkout master;git up; time ~/devel/moje/docker-utils/kolla-build-images.sh ubuntu source horizon master | 08:21 |
| hrw | that one | 08:21 |
| hrw | yoctozepto: you are devstack core. consider marking devstack as affected in https://bugs.launchpad.net/kolla/+bug/1866961 | 08:23 |
| openstack | Launchpad bug 1866961 in kolla "ImportError: cannot import name 'Feature'" [Undecided,Confirmed] | 08:23 |
| yoctozepto | hrw: yeah, I am wondering why devstack gate is still happy | 08:24 |
| hrw | yoctozepto: maybe you already did 'install setuptools==45.0.3' or sth | 08:25 |
| yoctozepto | hrw: could be it, there was some dance before, could be not reverted yet | 08:25 |
| *** k_mouza has joined #openstack-kolla | 08:25 | |
| hrw | yoctozepto: we do not have problem with rocky due to py2 forcing setuptools <45 version. | 08:27 |
| hrw | yoctozepto: so stein+ | 08:27 |
| yoctozepto | hrw: yeah, but it's master | 08:27 |
| yoctozepto | hrw: nothing constraining setuptools so far | 08:27 |
| hrw | yoctozepto: 17:47 < hrw> mgoddard: https://paste.centos.org/view/b61823ce is nicer workaround | 08:28 |
| hrw | not a fan of it | 08:28 |
| yoctozepto | hrw: ah, I see global requirements blocked setuptools | 08:28 |
| yoctozepto | hrw: https://review.opendev.org/711930 | 08:28 |
| patchbot | patch 711930 - requirements - Skip setuptools 46.0.0 (MERGED) - 2 patch sets | 08:28 |
| yoctozepto | hence devstack gate is unaffected | 08:29 |
| yoctozepto | hrw: it's only on master so older devstack probably hit | 08:29 |
| *** k_mouza has quit IRC | 08:29 | |
| hrw | !46.0.0 is gonna hurt soon | 08:30 |
| openstack | hrw: Error: "46.0.0" is not a valid command. | 08:30 |
| *** abdysn has quit IRC | 08:31 | |
| *** abdysn has joined #openstack-kolla | 08:33 | |
| *** gkadam has joined #openstack-kolla | 08:34 | |
| *** gkadam has quit IRC | 08:34 | |
| yoctozepto | hrw: yup | 08:35 |
| *** abdysn has quit IRC | 08:36 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: support ipv6 for grafana.ini.j2 https://review.opendev.org/712262 | 08:37 |
| *** abdysn has joined #openstack-kolla | 08:37 | |
| hrw | the funny thing? requirements change probably does not help us | 08:38 |
| *** ykarel is now known as ykarel|lunch | 08:38 | |
| hrw | setuptools is installed as part of virtualenv. where versions are not limited and latest ones are used | 08:38 |
| yoctozepto | hrw: us as kolla? yup, it only fixes other gates | 08:38 |
| hrw | looks like horizon team does not use irc anymore | 08:49 |
| *** gouthamr has quit IRC | 08:49 | |
| hrw | or only on US time | 08:49 |
| *** mgoddard has quit IRC | 08:49 | |
| *** gouthamr has joined #openstack-kolla | 08:50 | |
| *** mgoddard has joined #openstack-kolla | 08:50 | |
| Tony31 | I noticed the storage nodes using all their memory. the Cinder-backup container was using 94g VIRT and almost all the host RES memory as seen with `top`. I already seen the cinder-backup service is showing as down after deployment. Do I need ceph or swift to make it up? Is there a way that I can exclude it from being deployed at the moment? | 08:55 |
| Tony31 | exclude it = exclude `cinder-backup` | 08:56 |
| *** abdysn has quit IRC | 08:56 | |
| *** abdysn has joined #openstack-kolla | 08:56 | |
| *** ykarel has joined #openstack-kolla | 08:56 | |
| *** abdysn has quit IRC | 08:57 | |
| *** ykarel|lunch has quit IRC | 08:57 | |
| *** rpittau|afk is now known as rpittau | 08:58 | |
| Tony31 | @mgoddard - I added my nameo to the listo for Kolla-SIG | 09:00 |
| *** gfidente|afk is now known as gfidente | 09:01 | |
| *** zhanglong has quit IRC | 09:03 | |
| *** Abdallahyas has joined #openstack-kolla | 09:03 | |
| openstackgerrit | Fabian Bermel proposed openstack/kolla master: Checks for heat_user_domain explicitly https://review.opendev.org/711923 | 09:04 |
| *** Abdallahyas has quit IRC | 09:04 | |
| *** Abdallahyas has joined #openstack-kolla | 09:05 | |
| *** jschlueter has quit IRC | 09:05 | |
| *** jschlueter has joined #openstack-kolla | 09:07 | |
| *** Abdallahyas is now known as abdysn | 09:07 | |
| *** Tony31 has quit IRC | 09:10 | |
| *** JangwonLee__ has joined #openstack-kolla | 09:12 | |
| sri_ | Tony31, I am not sure about kayobe, but in k-a you have to expestily enable cinder-backup with enable_cinder_backup: "yes", if you dont have any storage backend for cinder-backup you dont enable cinder-backup | 09:13 |
| *** shyamb has joined #openstack-kolla | 09:15 | |
| *** dougsz has joined #openstack-kolla | 09:15 | |
| *** JangwonLee_ has quit IRC | 09:16 | |
| *** k_mouza has joined #openstack-kolla | 09:24 | |
| mgoddard | morning | 09:44 |
| *** xinliang has joined #openstack-kolla | 09:50 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Fix HAProxy monitor VIP precheck https://review.opendev.org/711905 | 09:57 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Fix HAProxy monitor VIP precheck https://review.opendev.org/712300 | 09:57 |
| yoctozepto | hrw: yeah, I did not have lucky time there either | 10:02 |
| hrw | edited kolla whiteboard | 10:05 |
| hrw | kolla ci RED | 10:05 |
| *** Blinkiz has quit IRC | 10:15 | |
| yoctozepto | red indeed | 10:16 |
| *** Blinkiz has joined #openstack-kolla | 10:16 | |
| *** ktibi has joined #openstack-kolla | 10:24 | |
| ktibi | Hi guys, I try to inspect HP proliant with kayobe. The boot freeze during "Booting the kernel" step. Any suggestion for debug the issue ? mgoddard | 10:26 |
| -openstackstatus- NOTICE: The mail server for lists.openstack.org is currently not handling emails. The infra team will investigate and fix during US morning. | 10:26 | |
| hrw | ktibi: do you have bmc console access? | 10:27 |
| hrw | ktibi: remove 'quiet' from kernel command line | 10:27 |
| ktibi | Yes I have access. ok thx I'll try that, | 10:27 |
| ktibi | hrw, hum not quiet option in the pxelinux.cfg/default | 10:28 |
| hrw | ;( | 10:31 |
| openstackgerrit | Fabian Bermel proposed openstack/kolla master: Checks for heat_user_domain explicitly https://review.opendev.org/711923 | 10:36 |
| openstackgerrit | Fabian Bermel proposed openstack/kolla master: Checks for heat_user_domain explicitly https://review.opendev.org/711923 | 10:37 |
| mgoddard | ktibi: tcpdump to check for DHCP, PXE etc. | 10:48 |
| *** ktibi has quit IRC | 10:49 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: seed VM & bifrost https://review.opendev.org/712133 | 10:54 |
| *** priteau has joined #openstack-kolla | 11:02 | |
| *** shyam89 has joined #openstack-kolla | 11:03 | |
| *** hjensas has quit IRC | 11:06 | |
| *** shyamb has quit IRC | 11:07 | |
| yoctozepto | mgoddard: c8 binary train 2020-03-11 09:11:25.078 24 CRITICAL nova [req-ad60f5a9-25ac-426a-adbd-32e0913e1707 - - - - -] Unhandled error: RuntimeError: dictionary changed size during iteration | 11:08 |
| yoctozepto | xD | 11:08 |
| yoctozepto | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_dfe/712262/1/check/kolla-ansible-centos8-binary/dfe539e/primary/logs/kolla/all-CRITICAL.txt | 11:08 |
| yoctozepto | sounds hellish | 11:08 |
| mgoddard | yoctozepto: yeah | 11:08 |
| mgoddard | wonder why we don't see it on master | 11:09 |
| yoctozepto | mgoddard: is it same binary? | 11:11 |
| yoctozepto | should not be ;p | 11:11 |
| *** kplant has joined #openstack-kolla | 11:11 | |
| mgoddard | I shouldn't think so | 11:11 |
| mgoddard | but something must be different on master, maybe a backport needed | 11:11 |
| yoctozepto | or rdo pkgs broke | 11:12 |
| mgoddard | although we don't see it for source, maybe just needs a release | 11:12 |
| *** zhanglong has joined #openstack-kolla | 11:13 | |
| *** xinliang has quit IRC | 11:17 | |
| *** xinliang has joined #openstack-kolla | 11:17 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Check supported host OS distributions in prechecks https://review.opendev.org/699443 | 11:19 |
| *** hjensas has joined #openstack-kolla | 11:22 | |
| *** diurnalist has joined #openstack-kolla | 11:26 | |
| mgoddard | hrw, yoctozepto: are we ready to propose final rocky releases before EM? No backports open | 11:29 |
| yoctozepto | mgoddard: checked launchpad triage? | 11:29 |
| yoctozepto | any targeted for rocky? | 11:30 |
| mgoddard | yoctozepto: probably | 11:30 |
| yoctozepto | mgoddard: let's check if they are backportable | 11:30 |
| *** diurnalist has quit IRC | 11:31 | |
| yoctozepto | https://bugs.launchpad.net/kolla-ansible/rocky/+bugs?field.searchtext=&orderby=-importance&search=Search&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.tag=&field.tags_combinator=ANY&field.status_upstream-empty-marker=1&field.has_cve.use | 11:31 |
| yoctozepto | d=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on | 11:31 |
| mgoddard | yoctozepto: might as well do a backport scan | 11:31 |
| yoctozepto | https://bugs.launchpad.net/kolla/rocky/+bugs?field.searchtext=&orderby=-importance&search=Search&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.tag=&field.tags_combinator=ANY&field.status_upstream-empty-marker=1&field.has_cve.used=&field | 11:32 |
| yoctozepto | .omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on | 11:32 |
| *** xinliang has quit IRC | 11:32 | |
| mgoddard | (for all branches) | 11:32 |
| yoctozepto | mgoddard: please do | 11:32 |
| hrw | yoctozepto: use u.42.pl | 11:32 |
| *** xinliang has joined #openstack-kolla | 11:32 | |
| *** xinliang has quit IRC | 11:33 | |
| yoctozepto | closing things | 11:33 |
| yoctozepto | hrw: /me lazy :< | 11:33 |
| *** xinliang has joined #openstack-kolla | 11:34 | |
| yoctozepto | mgoddard: https://bugs.launchpad.net/kolla-ansible/rocky/+bug/1859145 sad about leaving this issue | 11:35 |
| openstack | Launchpad bug 1859145 in kolla-ansible stein "MariaDB deployment does not respect quorum and may break cluster" [High,In progress] - Assigned to Radosław Piliszek (yoctozepto) | 11:35 |
| yoctozepto | mgoddard: maybe I'll skip stein and fix rocky? | 11:36 |
| yoctozepto | mgoddard: https://bugs.launchpad.net/kolla-ansible/rocky/+bug/1821696 - anything here for us or close? | 11:37 |
| openstack | Launchpad bug 1821696 in kolla-ansible stein "Failed to start instances with encrypted volumes" [High,In progress] - Assigned to Mark Goddard (mgoddard) | 11:37 |
| *** sri_ has quit IRC | 11:39 | |
| *** shyamb has joined #openstack-kolla | 11:48 | |
| *** shyam89 has quit IRC | 11:50 | |
| *** shyamb has quit IRC | 11:53 | |
| *** sri_ has joined #openstack-kolla | 11:55 | |
| *** rpittau is now known as rpittau|bbl | 11:58 | |
| *** ktibi has joined #openstack-kolla | 12:05 | |
| *** cah_link has joined #openstack-kolla | 12:10 | |
| *** kplant has quit IRC | 12:13 | |
| *** kplant has joined #openstack-kolla | 12:18 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: support ipv6 for grafana.ini.j2 https://review.opendev.org/712262 | 12:22 |
| *** zhanglong has quit IRC | 12:24 | |
| *** zhanglong has joined #openstack-kolla | 12:26 | |
| *** gfidente has quit IRC | 12:33 | |
| *** zhanglong has quit IRC | 12:36 | |
| *** gfidente has joined #openstack-kolla | 12:38 | |
| *** cah_link has quit IRC | 12:45 | |
| *** jimcrowleyibm has joined #openstack-kolla | 12:56 | |
| mnasiadka | yoctozepto: will mariadb be fit one day? :D | 13:14 |
| yoctozepto | mnasiadka: it's not in stein&rocky (lack of time) | 13:15 |
| yoctozepto | mnasiadka: and stein needed dance with shutdown etc. :/ | 13:15 |
| mnasiadka | yoctozepto: never ending story, huh? | 13:20 |
| yoctozepto | mnasiadka: it ends with them going away or getting fixed by me ;p | 13:20 |
| mnasiadka | yoctozepto: and they come back once in a while :) | 13:21 |
| *** irclogbot_2 has quit IRC | 13:22 | |
| *** irclogbot_1 has joined #openstack-kolla | 13:23 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Adds python3-systemd for ansible deploy interface https://review.opendev.org/712419 | 13:26 |
| *** skramaja has quit IRC | 13:27 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/stein: Adds python3-systemd for ansible deploy interface https://review.opendev.org/712421 | 13:28 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Add ssh clients to Ironic Conductor container https://review.opendev.org/712422 | 13:31 |
| *** reph has joined #openstack-kolla | 13:31 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/stein: Add ssh clients to Ironic Conductor container https://review.opendev.org/712423 | 13:31 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/rocky: Add ssh clients to Ironic Conductor container https://review.opendev.org/712424 | 13:31 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: CI: Reduce unnecessary gate image builds https://review.opendev.org/712425 | 13:34 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Enable buffering to file for Monasca logs https://review.opendev.org/712426 | 13:35 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Enable buffering to file for Monasca logs https://review.opendev.org/671081 | 13:35 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Enable buffering to file for Monasca logs https://review.opendev.org/712427 | 13:35 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Swift: remove meta field from rsync command https://review.opendev.org/712428 | 13:36 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Swift: remove meta field from rsync command https://review.opendev.org/712429 | 13:36 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Swift: remove meta field from rsync command https://review.opendev.org/712430 | 13:36 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Use internal API for masakari-monitor https://review.opendev.org/712431 | 13:37 |
| ktibi | hrw, mgoddard haha I think I found :) | 13:39 |
| *** reph has quit IRC | 13:39 | |
| ktibi | I configure PXE boot with a VLAN, and when ipa try to send to RMQ a message, NIC doesn't have the VLAN TAG ^^ | 13:40 |
| *** zhanglong has joined #openstack-kolla | 13:40 | |
| hrw | ;d | 13:41 |
| *** dave-mccowan has joined #openstack-kolla | 13:42 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Construct service configuration urls using kolla_internal_fqdn https://review.opendev.org/712437 | 13:43 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Fix neutron-metadata-agent to use provided CA for Nova metadata https://review.opendev.org/712438 | 13:43 |
| ktibi | Hum maybe inspection doesn't support vlan network :/ | 13:44 |
| mgoddard | ktibi: NIC shouldn't need a VLAN. Configure it on the switch if necessary | 13:45 |
| ktibi | mgoddard, switch use trunk vlan mode | 13:45 |
| mgoddard | ktibi: native vlan? | 13:45 |
| ktibi | mgoddard, for now, I can't use native vlan :/ | 13:46 |
| *** dave-mccowan has quit IRC | 13:46 | |
| ktibi | mgoddard, maybe I can configure the pxelinux.cfg/default for configure the NIC with vlan :/ | 13:46 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Construct service configuration urls using kolla_internal_fqdn https://review.opendev.org/712437 | 13:48 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Construct service REST API urls using configured protocol https://review.opendev.org/712440 | 13:48 |
| mgoddard | ktibi: why can't you use the native vlan? | 13:48 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Fix HAProxy monitor VIP precheck https://review.opendev.org/712441 | 13:50 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Stop gzipping logs in get-logs.sh https://review.opendev.org/712442 | 13:50 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/stein: Stop gzipping logs in get-logs.sh https://review.opendev.org/712443 | 13:50 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/rocky: Stop gzipping logs in get-logs.sh https://review.opendev.org/712444 | 13:50 |
| ktibi | mgoddard, haha good question. | 13:54 |
| *** dave-mccowan has joined #openstack-kolla | 13:57 | |
| *** sri_ has quit IRC | 14:01 | |
| yoctozepto | mgoddard: heart attack, so much to review | 14:01 |
| mgoddard | yoctozepto: all backports | 14:02 |
| mgoddard | which you asked for :p | 14:02 |
| mgoddard | yoctozepto: btw, EM != EOL, so we don't need to close all bugs or stop accepting fixes | 14:02 |
| yoctozepto | mgoddard: yeah, I reflected late | 14:03 |
| mgoddard | good to get the house in order though | 14:03 |
| yoctozepto | mgoddard: but they were fugly ones | 14:03 |
| yoctozepto | indeed | 14:03 |
| yoctozepto | :D | 14:03 |
| mgoddard | probably time for some reviews | 14:03 |
| mgoddard | s/reviews/releases/ | 14:04 |
| *** reph has joined #openstack-kolla | 14:06 | |
| yoctozepto | mgoddard: after reviews | 14:06 |
| hrw | +2, -1 | 14:07 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/stein: Adds python3-systemd for ansible deploy interface https://review.opendev.org/712421 | 14:18 |
| *** xinliang has quit IRC | 14:21 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Fix HAProxy monitor VIP precheck https://review.opendev.org/711905 | 14:27 |
| mgoddard | yoctozepto, mnasiadka, osmanlicilegi: remember we are talking about infra images - if you have time, refresh your minds by looking at the reviews | 14:33 |
| cosmicsound | good day | 14:36 |
| mgoddard | hi cosmicsound | 14:41 |
| cosmicsound | hey mgoddard | 14:42 |
| cosmicsound | when using external ceph with kolla-ansible does the servers used in ceph have to be defined in the inventory under storage? | 14:43 |
| cosmicsound | and is this still valid docs? https://docs.openstack.org/kolla-ansible/4.0.2/external-ceph-guide.html | 14:45 |
| cosmicsound | got it https://docs.openstack.org/kolla-ansible/latest/reference/storage/external-ceph-guide.html | 14:46 |
| *** zhanglong has quit IRC | 14:46 | |
| *** abdysn has quit IRC | 14:47 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: Add seed deploy job https://review.opendev.org/712462 | 14:47 |
| mgoddard | cosmicsound: the servers do not need to be in the inventory | 14:48 |
| cosmicsound | great to know | 14:50 |
| *** diurnalist has joined #openstack-kolla | 14:50 | |
| cosmicsound | and does the ceph horizon dashboard | 14:50 |
| cosmicsound | also works with external ceph? | 14:50 |
| mgoddard | ceph horizon dashboard? | 14:51 |
| mgoddard | ceph has it's own dashboard IIUC | 14:51 |
| mgoddard | meeting in 10 | 14:51 |
| mgoddard | ^ mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi | 14:51 |
| hrw | mkey | 14:52 |
| ktibi | mgoddard, ok native vlan configured but same issue. I can't read the error because I can not read at the speed of light. Tips for slow or print the error during the boot ? | 14:53 |
| *** diurnalist has quit IRC | 14:54 | |
| mgoddard | ktibi: screen capture via bmc remote console? | 14:56 |
| ktibi | no with html5 I'll search this option | 14:56 |
| *** cah_link has joined #openstack-kolla | 14:56 | |
| cosmicsound | o/ | 15:00 |
| mgoddard | #startmeeting kolla | 15:01 |
| openstack | Meeting started Wed Mar 11 15:01:33 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:01 | |
| openstack | The meeting name has been set to 'kolla' | 15:01 |
| mgoddard | #topic rollcall | 15:01 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:01 | |
| mgoddard | \o | 15:01 |
| yoctozepto | o/ | 15:01 |
| hrw | /o\ | 15:01 |
| yoctozepto | mnasiadka: ? | 15:02 |
| yoctozepto | osmanlicilegi: ? | 15:02 |
| yoctozepto | (sad Christian does not join us) | 15:02 |
| *** scottsol has joined #openstack-kolla | 15:02 | |
| cosmicsound | yoctozepto , heya | 15:02 |
| yoctozepto | cosmicsound: hey-hey (meeting running) | 15:03 |
| mgoddard | #topic agenda | 15:04 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:04 | |
| mgoddard | * Roll-call | 15:04 |
| mgoddard | * Announcements | 15:04 |
| mgoddard | ** CentOS 7 jobs dropped on master | 15:04 |
| mgoddard | ** Kolla SIG/club signup: https://etherpad.openstack.org/p/kolla-sig | 15:04 |
| mgoddard | * Review action items from last meeting | 15:04 |
| mgoddard | * CI status | 15:04 |
| mgoddard | * infra images - what to do with patches? postpone to V proposal | 15:04 |
| mgoddard | * https://review.opendev.org/698753 adds support for Kolla | 15:04 |
| patchbot | patch 698753 - kolla - WIP: Create 'infra' type of images - 19 patch sets | 15:04 |
| mgoddard | * https://review.opendev.org/707599 adds 'non-infra-base' image (not required for ^^ but can be useful to show split) | 15:04 |
| patchbot | patch 707599 - kolla - WIP: introduce non-infra-base image - 5 patch sets | 15:04 |
| mgoddard | * https://review.opendev.org/706982 k-a patch | 15:04 |
| patchbot | patch 706982 - kolla-ansible - WIP: Use 'infra' type of images - 8 patch sets | 15:04 |
| mgoddard | * Kolla --SIG-- (aka Kolla Klub?) https://etherpad.openstack.org/p/kolla-sig | 15:04 |
| mgoddard | * Ussuri release planning (kayobe) | 15:04 |
| mgoddard | * Ussuri release planning (kolla & kolla ansible) | 15:04 |
| mgoddard | #topic announcements | 15:04 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:04 | |
| mgoddard | #info CentOS 7 jobs dropped on master | 15:04 |
| mgoddard | While we have not removed support for CentOS 7, prepare for it to break at any time | 15:05 |
| hrw | and we have https://review.opendev.org/692450 to eradicate c7 from master | 15:05 |
| patchbot | patch 692450 - kolla - WIP: Remove support for CentOS 7 - 11 patch sets | 15:05 |
| yoctozepto | ++ | 15:06 |
| mnasiadka | yoctozepto: busy like hell | 15:06 |
| * hrw at kolla and horizon meetings at same time | 15:06 | |
| mgoddard | true. Will need something similar for kolla-ansible at some point | 15:06 |
| mgoddard | #info Kolla SIG/club signup open | 15:07 |
| mgoddard | #link Kolla SIG/club signup: https://etherpad.openstack.org/p/kolla-sig | 15:07 |
| mgoddard | #undo | 15:07 |
| openstack | Removing item from minutes: #link https://etherpad.openstack.org/p/kolla-sig | 15:07 |
| mgoddard | #link https://etherpad.openstack.org/p/kolla-sig | 15:07 |
| mgoddard | All kolla users/operators/developers welcome - will discuss more later | 15:08 |
| mgoddard | Any others? | 15:08 |
| hrw | nope | 15:08 |
| mgoddard | #topic Review action items from last meeting | 15:08 |
| *** openstack changes topic to "Review action items from last meeting (Meeting topic: kolla)" | 15:08 | |
| mgoddard | dougsz to write bug report about nova SSH nproc issue | 15:09 |
| dougsz | dougsz finally did it | 15:09 |
| *** TrevorV has joined #openstack-kolla | 15:09 | |
| mgoddard | thanks | 15:09 |
| mgoddard | #link https://bugs.launchpad.net/bugs/1866190 | 15:09 |
| openstack | Launchpad bug 1866190 in kolla-ansible "Number of SSH connections can be restricted by nproc" [Undecided,New] - Assigned to Doug Szumski (dszumski) | 15:09 |
| mgoddard | #topic CI status | 15:09 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:09 | |
| mgoddard | #info Kolla CI broken due to horizon, pyscss & setuptools 46 | 15:10 |
| mgoddard | #link https://bugs.launchpad.net/kolla/+bug/1866961 | 15:10 |
| openstack | Launchpad bug 1866961 in kolla ussuri "ImportError: cannot import name 'Feature'" [Critical,Triaged] | 15:10 |
| hrw | we are going to discuss it with horizon team at the end of their meeting (same time as kolla one) | 15:10 |
| yoctozepto | with hrw on #openstack-meeting-alt | 15:11 |
| mgoddard | joined | 15:11 |
| hrw | there is a workaround for it - we can downgrade setuptools to <46 in openstack-base | 15:11 |
| hrw | imho for now it's the only way | 15:11 |
| mgoddard | well there is a blacklist in requirements, but it won't last long | 15:12 |
| hrw | its too late | 15:12 |
| hrw | virtualenv gets latest virtualenv | 15:12 |
| yoctozepto | we don't read gr | 15:12 |
| hrw | virtualenv gets latest setuptools | 15:12 |
| mgoddard | hmm | 15:12 |
| hrw | so once we use upper-constrains etc we have v46 | 15:12 |
| yoctozepto | we could reinstall based on gr | 15:12 |
| yoctozepto | just like devstack actually does | 15:13 |
| *** ykarel is now known as ykarel|away | 15:13 | |
| hrw | to be honest I prefer to install "setuptools<=46" rather than use GR there. | 15:13 |
| *** gmann has joined #openstack-kolla | 15:14 | |
| hrw | GR will fail once 46.0.1 came | 15:14 |
| mgoddard | <46 | 15:14 |
| hrw | yes. < | 15:14 |
| mgoddard | it seems like the best option at the moment | 15:14 |
| hrw | ok. will send patch for review after meetings | 15:14 |
| yoctozepto | gr does that | 15:14 |
| hrw | for master and train | 15:14 |
| mgoddard | hopefully distros will not pick up 46 | 15:14 |
| yoctozepto | <46 | 15:14 |
| mgoddard | gr does !=46 last I saw | 15:14 |
| hrw | yoctozepto: it does now? was !46.0.0 | 15:14 |
| yoctozepto | hmm | 15:14 |
| yoctozepto | sorry, you could be right, I saw too many things | 15:15 |
| mgoddard | can't unsee | 15:15 |
| hrw | I've seen things you people would not believe... and better do not try to google for them. | 15:15 |
| mgoddard | ok. Let's see what horizon say later, but sounds like we have a plan | 15:15 |
| yoctozepto | yeah, it was lame | 15:16 |
| hrw | next thing? | 15:16 |
| mgoddard | something odd happening in Stein&Train regarding in-kolla ceph (yoctozepto) | 15:16 |
| yoctozepto | mhm, observed, all jobs fail | 15:16 |
| yoctozepto | not ubuntu afair | 15:16 |
| yoctozepto | but centos | 15:16 |
| *** Fl1nt has joined #openstack-kolla | 15:16 | |
| mgoddard | doesn't look great | 15:17 |
| mgoddard | http://zuul.openstack.org/builds?project=openstack%2Fkolla-ansible&job_name=kolla-ansible-centos-source-ceph# | 15:17 |
| mgoddard | last pass on 4th | 15:18 |
| hrw | I am not a fan of ceph recently. too many rebuilds | 15:18 |
| mgoddard | cat: /var/lib/ceph/osd/a1ad5231-566a-4af1-aa47-038cbccbf2c0/whoami: Permission denied | 15:19 |
| mgoddard | https://bae8a59a03658584228a-8f7750086e5a0cc034f577473702e18b.ssl.cf2.rackcdn.com/711905/2/check/kolla-ansible-centos-source-ceph/5e93b6b/primary/logs/ansible/reconfigure | 15:19 |
| yoctozepto | weird, eh? | 15:19 |
| mgoddard | funky | 15:19 |
| mnasiadka | mgoddard: might be related to new packages from Storage SIG | 15:19 |
| yoctozepto | did not have time to deal with it | 15:19 |
| *** diurnalist has joined #openstack-kolla | 15:19 | |
| yoctozepto | oh right | 15:19 |
| mnasiadka | raise a bug, assign to me - I'll look into that (but soonest tomorrow) | 15:19 |
| mgoddard | #action mgoddard to raise a bug on Ceph job fails | 15:20 |
| mgoddard | #action mnasiadka to look into Ceph job fails | 15:20 |
| * yoctozepto to cheer them up | 15:20 | |
| Fl1nt | Hi everyone, quick question, let say I want to rebuild a container run command in order to test what's going on with a failing one | 15:20 |
| mgoddard | #topic infra images - what to do with patches? postpone to V proposal | 15:20 |
| *** openstack changes topic to "infra images - what to do with patches? postpone to V proposal (Meeting topic: kolla)" | 15:20 | |
| Fl1nt | if I want to use dumb-init | 15:20 |
| mgoddard | hi Fl1nt we're just in the meeting atm | 15:21 |
| mgoddard | https://review.opendev.org/698753 adds support for Kolla | 15:21 |
| patchbot | patch 698753 - kolla - WIP: Create 'infra' type of images - 19 patch sets | 15:21 |
| mgoddard | https://review.opendev.org/707599 adds 'non-infra-base' image (not required for ^^ but can be useful to show split) | 15:21 |
| patchbot | patch 707599 - kolla - WIP: introduce non-infra-base image - 5 patch sets | 15:21 |
| mgoddard | https://review.opendev.org/706982 k-a patch | 15:21 |
| patchbot | patch 706982 - kolla-ansible - WIP: Use 'infra' type of images - 8 patch sets | 15:21 |
| Fl1nt | @mgoddard, ok sorry, which time will be best to reach out lately? | 15:21 |
| hrw | ok, infra stuff | 15:21 |
| mgoddard | Fl1nt: in about 40 minutes | 15:21 |
| hrw | Fl1nt: in 50 minutes | 15:21 |
| yoctozepto | ;d | 15:21 |
| Fl1nt | ok noticed that, thx | 15:21 |
| hrw | non-infra-base is now dependency of infra patch | 15:22 |
| hrw | as it gives nice separation we need | 15:22 |
| hrw | it only stores INSTALL_TYPE variable basically as we do not need it in 'infra' images | 15:22 |
| hrw | https://blueprints.launchpad.net/kolla/+spec/infra-images has a bit more info | 15:23 |
| * yoctozepto diving in blueprint | 15:23 | |
| hrw | with feature freeze in ~month I would prefer to postpone it to V cycle and concentrate our efforts on adding C8 and removing C7 | 15:23 |
| hrw | as infra images do not give us nothing new basically and require time to test, improve docs etc | 15:24 |
| mgoddard | makes sense | 15:24 |
| mgoddard | although there may be some small things we could do in U | 15:25 |
| hrw | non-infra-base only iirc | 15:25 |
| hrw | rest of stuff is self contained and simple | 15:25 |
| mgoddard | do we need a non-infra-base image? It looks like it only adds ENV var | 15:25 |
| hrw | we need | 15:25 |
| hrw | if you have ENV in base then binary-base != source-base | 15:26 |
| hrw | and we need ENV for binary/source images | 15:26 |
| mgoddard | yeah, but only 2 images depend on it - kolla-toolbox and openstack-base | 15:26 |
| mgoddard | we could just add ENV to those | 15:26 |
| yoctozepto | +1 | 15:26 |
| hrw | so non-infra-base is better/easier than injecting ENV to all binary/source images like I did before | 15:26 |
| mgoddard | that's not what I'm suggesting | 15:27 |
| hrw | mgoddard: ok. can be done simply | 15:27 |
| mgoddard | ~unrelated: should kolla-toolbox depend on openstack-base? | 15:27 |
| hrw | mgoddard: there can be other binary.source images than those two | 15:27 |
| hrw | monasca-thresh and openswitch-netcontrold were on list | 15:27 |
| hrw | and we have to rewrite dockerfiles anyway then injecting ENV vars is simple | 15:28 |
| hrw | mgoddard: there was attempt to do that | 15:29 |
| hrw | mgoddard: k-t is always binary, o-b is binary/source | 15:29 |
| mgoddard | netcontrold should be infra | 15:29 |
| hrw | it is either binary or source | 15:30 |
| mgoddard | currently, yes | 15:30 |
| hrw | as 'only one way' | 15:30 |
| mgoddard | but it should be infra | 15:30 |
| hrw | ok | 15:30 |
| mgoddard | monasca-thresh is a weird one because it depends on storm | 15:30 |
| mgoddard | might need to make a special case for it | 15:31 |
| hrw | there will be some exceptions probably | 15:31 |
| mgoddard | yeah | 15:31 |
| mgoddard | always :) | 15:31 |
| mgoddard | ok, so that's non-infra-base | 15:32 |
| mgoddard | there are two hard parts IIRC | 15:32 |
| hrw | yes? | 15:32 |
| mgoddard | 1. how to build images with a common base | 15:32 |
| mgoddard | 2. how to provide a smooth transition | 15:33 |
| mgoddard | let's start with 1 | 15:33 |
| hrw | 1. build binary and then source on same machine, then push | 15:33 |
| hrw | the best option | 15:33 |
| hrw | otherwise you have to build binary, push, pull, build source, push | 15:33 |
| hrw | which result in huge network use | 15:34 |
| mgoddard | or | 15:34 |
| hrw | which is worse than we have now | 15:34 |
| mgoddard | build base, push | 15:34 |
| mgoddard | then 3 separate jobs to build binary, source, infra | 15:34 |
| hrw | or :D | 15:34 |
| hrw | right | 15:34 |
| mgoddard | with pipelines | 15:34 |
| yoctozepto | mgoddard: ++ | 15:34 |
| mgoddard | CI is one thing | 15:35 |
| mgoddard | we should also think about what users will want | 15:35 |
| mgoddard | generally they do not want to build both source & binary | 15:35 |
| hrw | --noinfra switch gives old style images | 15:35 |
| hrw | and then for k-a we need to implement "use_infra_images: boolean" in globals.yml | 15:35 |
| mgoddard | this is for the transition? | 15:36 |
| hrw | not only | 15:36 |
| hrw | if user1 wants own images then they can do kolla-build --noinfra to get only source images and deploy from them. | 15:37 |
| hrw | or builds source and gets infra+source ones | 15:37 |
| hrw | you do not need to build both binary/source images. | 15:37 |
| hrw | as user | 15:37 |
| hrw | we as project have | 15:38 |
| mgoddard | it would be good to aim to have everyone on the same pattern eventually | 15:39 |
| hrw | 2. transition - now upgrade is from blablah-horizon:stein -> blablah-horizon:train right? | 15:39 |
| mgoddard | i.e. remove --noinfra in the long term | 15:39 |
| hrw | so it will be blablah-binary-mariadb:train -> blablah-infra-mariadb:ussuri etc | 15:40 |
| hrw | when you run 'docker ps' is it still 'mariadb' container | 15:40 |
| yoctozepto | I don't see why we would want to keep them separate | 15:41 |
| hrw | but I never did k-a upgrade so hard to tell | 15:41 |
| yoctozepto | you mean for external integrations? | 15:41 |
| yoctozepto | k-a will handle it | 15:41 |
| hrw | mgoddard: --noinfra was added as someone asked for old way | 15:42 |
| mgoddard | +1, it will probably be required not to break tripleo | 15:42 |
| hrw | they can do --noinfra ;D | 15:42 |
| mgoddard | (and k-a) | 15:42 |
| mgoddard | yoctozepto: "I don't see why we would want to keep them separate" | 15:43 |
| mgoddard | could you expand? | 15:43 |
| yoctozepto | mgoddard: infra still source/binary | 15:43 |
| hrw | yoctozepto: expand? | 15:43 |
| yoctozepto | mgoddard: I guess we could fix up tripleo | 15:43 |
| yoctozepto | hrw, mgoddard: your discussion about --noinfra switch | 15:43 |
| mgoddard | so you think we should not provide a --noinfra switch? | 15:44 |
| yoctozepto | mgoddard: exactly | 15:44 |
| hrw | ok | 15:44 |
| yoctozepto | just my gut feeling | 15:44 |
| mgoddard | our way or the highway | 15:44 |
| yoctozepto | exactly | 15:44 |
| mgoddard | lol | 15:44 |
| yoctozepto | now switching topic a bit | 15:44 |
| yoctozepto | horizon stays with pyscss for ussuri | 15:44 |
| yoctozepto | so we must use the workaround forever | 15:45 |
| yoctozepto | thank you for your attention :-) | 15:45 |
| hrw | we will shout at then in V | 15:45 |
| mgoddard | is there no way to fix pyscss? | 15:45 |
| hrw | and then deprecate horizon | 15:45 |
| yoctozepto | mgoddard: very easy, harder to do release | 15:45 |
| hrw | mgoddard: fork, rename | 15:46 |
| mgoddard | why? | 15:46 |
| yoctozepto | mgoddard: abandoned :S | 15:46 |
| mgoddard | then fork? | 15:46 |
| *** reph has quit IRC | 15:46 | |
| hrw | mgoddard: 16:32 < rdopiera> hrw: we don't have the resources to take on more projects | 15:46 |
| yoctozepto | mgoddard: horizon does not like forks :-) | 15:46 |
| yoctozepto | so maybe we fork | 15:46 |
| mgoddard | kolla does not like pinning setuptools | 15:46 |
| hrw | it is logged channel so I will not comment | 15:46 |
| yoctozepto | and propose patch to horizon | 15:46 |
| hrw | yoctozepto: and will you maintain it? it has huge amount of issues and some PRs... | 15:47 |
| yoctozepto | hrw: issues closed :D "final version" | 15:47 |
| hrw | and once you fork people will came with ideas, changes, issues and expect you to maintain | 15:47 |
| mgoddard | we only need to get it past this issue | 15:47 |
| hrw | pyscss46 ;D | 15:47 |
| mgoddard | tbh, I don't mind pinning setuptools but I think it will come back to bite us | 15:48 |
| hrw | sooner or later but will | 15:48 |
| mgoddard | devstack will break on 46.0.1 | 15:48 |
| hrw | anything will | 15:48 |
| yoctozepto | ^ indeed | 15:49 |
| hrw | requirements fix was done in a rush without realizing what needs to be done | 15:49 |
| hrw | that's my personal opinion | 15:49 |
| mgoddard | +1 | 15:49 |
| yoctozepto | +1 | 15:49 |
| mgoddard | anyway, suggest we pin and ignore for now :D | 15:49 |
| hrw | ok, what's next on agenda? | 15:49 |
| yoctozepto | it's not longer yours, nor personal now | 15:49 |
| mgoddard | #topic Kolla --SIG-- (aka Kolla Klub?) https://etherpad.openstack.org/p/kolla-sig | 15:50 |
| *** openstack changes topic to "Kolla --SIG-- (aka Kolla Klub?) https://etherpad.openstack.org/p/kolla-sig (Meeting topic: kolla)" | 15:50 | |
| yoctozepto | almost ate you alive for calling it SIG | 15:50 |
| mgoddard | indeed | 15:50 |
| mgoddard | WILL EVERYONE JUST STOP CREATING SIGs | 15:50 |
| mgoddard | I thought they were supposed to be a lightweight thing | 15:51 |
| yoctozepto | yeah, we got the message there | 15:51 |
| mgoddard | nvm | 15:51 |
| yoctozepto | supposedly not | 15:51 |
| mgoddard | I don't really care what we call it | 15:51 |
| mgoddard | Kolla klub | 15:51 |
| yoctozepto | i like "Kollaborators" for members of Kolla Klub | 15:51 |
| mgoddard | yeah | 15:51 |
| mgoddard | shame the etherpad is now called kolla-sig :) | 15:51 |
| yoctozepto | let's do something good | 15:51 |
| yoctozepto | mgoddard: oopsie :-) | 15:52 |
| mgoddard | anyway, if anyone is listening/reading - do sign up https://etherpad.openstack.org/p/kolla-sig | 15:52 |
| yoctozepto | mgoddard: are we listing only one role? | 15:53 |
| yoctozepto | mgoddard: aren't you operators as well? | 15:53 |
| mgoddard | suggest if people start discussions here we direct them to the pad? | 15:53 |
| yoctozepto | mgoddard: +1 | 15:53 |
| mgoddard | yoctozepto: you can call yourself the fairy godmother if it pleases | 15:53 |
| hrw | you can always create new etherpad and add info in old one with link to proper one | 15:53 |
| *** vishalmanchanda has joined #openstack-kolla | 15:54 | |
| yoctozepto | mgoddard: oh yeah | 15:54 |
| mgoddard | I'll give it a few more days then start approaching some people more directly | 15:54 |
| cosmicsound | kolla club :D | 15:54 |
| mgoddard | you signing up cosmicsound ? | 15:54 |
| yoctozepto | mgoddard: :O | 15:54 |
| cosmicsound | nope | 15:54 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: openstack-base: pin setuptools < 46 to get horizon working https://review.opendev.org/712485 | 15:54 |
| yoctozepto | assassins among us | 15:55 |
| mgoddard | cosmicsound: out of interest, why not? | 15:55 |
| mgoddard | So once we have a few more names on the list, how should we proceed? | 15:56 |
| mgoddard | Schedule a first meeting, to discuss... | 15:56 |
| yoctozepto | ...how great we are | 15:57 |
| hrw | conspiracy theories about making openstack grate again | 15:57 |
| mgoddard | good idea | 15:58 |
| yoctozepto | it grates all the time, hrw | 15:58 |
| mgoddard | I think first meeting should be a meet and greet, and work out the scope of the group, plan future meetings etc. | 15:59 |
| yoctozepto | +1 | 15:59 |
| hrw | +2 | 15:59 |
| scottsol | +1 | 15:59 |
| yoctozepto | as we have no other idea | 15:59 |
| yoctozepto | we need to gather them ;D | 15:59 |
| mgoddard | get people to sign up for bios/case studies etc. | 15:59 |
| hrw | Tue/Thu same time as this meeting? | 15:59 |
| hrw | for start | 15:59 |
| mgoddard | I have other ideas (expressed on ML), but want to hear what others think | 16:00 |
| mgoddard | let's poll for times | 16:00 |
| mgoddard | we have emails | 16:00 |
| mgoddard | but often this time slot gets picked | 16:00 |
| mgoddard | #topic open discussion | 16:01 |
| *** openstack changes topic to "open discussion (Meeting topic: kolla)" | 16:01 | |
| hrw | none | 16:01 |
| mgoddard | Any other things to cover before we close? | 16:01 |
| *** reph has joined #openstack-kolla | 16:01 | |
| generalfuzz | one question | 16:02 |
| mgoddard | sure | 16:02 |
| generalfuzz | Not sure how to follow-up with tripleo regarding making uwsgi available for install | 16:03 |
| cosmicsound | mgoddard , i did not made any contribs to code for kolla | 16:03 |
| cosmicsound | was thinking is more suitable for whom contributed code | 16:04 |
| hrw | cosmicsound: nevermind. kolla-klub is kind of devs/users stuff | 16:04 |
| hrw | cosmicsound: to gather ideas from users etc | 16:04 |
| mgoddard | cosmicsound: it is primarily for operators | 16:04 |
| cosmicsound | right well me i | 16:04 |
| cosmicsound | +1 | 16:04 |
| cosmicsound | in* | 16:04 |
| hrw | generalfuzz: you mean? | 16:04 |
| mgoddard | other people have been confused about that, I will try to make it more clear | 16:05 |
| cosmicsound | if this brings me closer to a production ready k-a deployment | 16:05 |
| cosmicsound | seems best way to meet more people involved | 16:05 |
| generalfuzz | https://review.opendev.org/#/c/710879/ | 16:05 |
| patchbot | patch 710879 - kolla - Install uwsgi for Keystone - 14 patch sets | 16:05 |
| mgoddard | that is the plan :) | 16:05 |
| cosmicsound | exchange ideas or share knowledge alike | 16:05 |
| mgoddard | generalfuzz: there is the #tripleo channel | 16:05 |
| hrw | cosmicsound: I assume that we have far more users than developers in kolla. and we implement developers' ideas rather than users' ones as we do not know them | 16:05 |
| mgoddard | generalfuzz: and cloudnull is our local point of contact | 16:06 |
| generalfuzz | ok, thanks | 16:06 |
| hrw | generalfuzz: macros.enable_extra_repo(['epel']) is what you need btw | 16:06 |
| hrw | or sth like that I named it | 16:07 |
| generalfuzz | hrw: where? | 16:07 |
| hrw | will comment in gerrit | 16:07 |
| generalfuzz | thanks | 16:07 |
| mgoddard | generalfuzz: the package would be provided by RDO rather than tripleo, but both are connected teams | 16:08 |
| cosmicsound | ohmy | 16:08 |
| mgoddard | generalfuzz: I think for PoC EPEL is fine | 16:08 |
| cosmicsound | integrating external ceph, aint so simple as planed | 16:08 |
| mgoddard | generalfuzz: have you looked at how to run uwsgi? Does it need to be a second container, or second process in a container? | 16:09 |
| mgoddard | We can probably end the meeting and carry on | 16:09 |
| mgoddard | Thanks all | 16:09 |
| mgoddard | #endmeeting | 16:09 |
| *** openstack changes topic to "Please feel welcome to join Kolla SIG https://etherpad.openstack.org/p/kolla-sig | Kolla IRC meetings on Wednesdays @ 15:00 UTC - see agenda @ https://goo.gl/OXB0DL | Whiteboard: https://etherpad.openstack.org/p/KollaWhiteBoard | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:09 | |
| openstack | Meeting ended Wed Mar 11 16:09:41 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:09 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-03-11-15.01.html | 16:09 |
| hrw | thanks all | 16:09 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-03-11-15.01.txt | 16:09 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-03-11-15.01.log.html | 16:09 |
| generalfuzz | mgoddard: currently as a process in the container | 16:10 |
| cosmicsound | aww meeting wasnt yet done | 16:10 |
| mgoddard | cosmicsound: nope: you are recorded forever :) | 16:11 |
| mgoddard | no problem | 16:11 |
| *** reph has quit IRC | 16:11 | |
| ktibi | mgoddard, found issue on coreOS. Need to remove ip configuration in kernel line. | 16:12 |
| hrw | bye | 16:12 |
| ktibi | fix in ironic https://review.openstack.org/566390 | 16:12 |
| patchbot | https://review.opendev.org/#/c/566390/ - ironic - Remove ip parameter from ipxe command line (MERGED) - 1 patch set | 16:12 |
| mgoddard | generalfuzz: so the container runs two top-level processes? httpd and uwsgi? | 16:13 |
| mgoddard | cosmicsound: does this make it more clear? "A group aiming to bridge the gap between Kolla operators and developers." | 16:13 |
| ktibi | mgoddard, need fix in bifrost too | 16:14 |
| cosmicsound | mgoddard , perfect! | 16:14 |
| generalfuzz | mgoddard: no - afaik, just uwsgi which is configured to send requests to python entry to keystone | 16:14 |
| mgoddard | ktibi: https://review.opendev.org/#/c/687844/ | 16:15 |
| patchbot | patch 687844 - bifrost - Remove ip kernel command line argument (MERGED) - 1 patch set | 16:15 |
| ktibi | mgoddard, backport rocky ? | 16:15 |
| mgoddard | generalfuzz: so uwsgi is used as the web server? | 16:15 |
| generalfuzz | yes | 16:16 |
| cosmicsound | does cinder needs the lvm drivers and scsi when using external ceph? | 16:16 |
| cosmicsound | in globals.myl | 16:16 |
| cosmicsound | yml* | 16:16 |
| yoctozepto | cosmicsound: nope | 16:16 |
| cosmicsound | and these values from the exteral ceph on kolla ceph_glance_keyring are needed defined in globals.yml also and in /etc/kolla/config/{nova,cinder,glance} | 16:18 |
| mgoddard | ktibi: backporting it | 16:18 |
| ktibi | mgoddard, yeah, merge conflict, I'll backport soon can't with web interface :p | 16:19 |
| mgoddard | ktibi: doing it now :) | 16:19 |
| ktibi | yeah thx ;) don't forget rocky ! u're the best :p | 16:20 |
| mgoddard | ktibi: https://review.opendev.org/712493 | 16:20 |
| patchbot | patch 712493 - bifrost (stable/rocky) - Remove ip kernel command line argument - 1 patch set | 16:20 |
| priteau | cosmicsound: This is what an external Ceph config looks like (this is Kayobe but similar in kolla-ansible): http://paste.openstack.org/show/790549/ | 16:21 |
| ktibi | mgoddard, Timed out waiting for reploy from 2.coreos.pool.ntp.org T_T I'll sucess to remove internet to kayobe !! :D | 16:22 |
| mgoddard | nice :) | 16:22 |
| mgoddard | ktibi: https://etherpad.openstack.org/p/kolla-sig | 16:22 |
| cosmicsound | RUNNING HANDLER [rabbitmq : Waiting for rabbitmq to start on first node] ******************************************************************************************** | 16:22 |
| cosmicsound | fatal: [compute-1]: FAILED! => {"changed": true, "cmd": "docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid", "delta": "0:00:00.241797", "end": "2020-03-11 16:21:54.038928", "msg": "non-zero return code", "rc": 137, "start": "2020-03-11 16:21:53.797131", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | 16:22 |
| cosmicsound | anyone any idea why such? | 16:23 |
| cosmicsound | priteau , thanks for sharing | 16:23 |
| cosmicsound | i am more to see whats inside globals.yml related to ceph | 16:24 |
| cosmicsound | beside the default example/startup globals.yml | 16:24 |
| priteau | In globals.yml I just used the bits at https://docs.openstack.org/kolla-ansible/latest/reference/storage/external-ceph-guide.html#enabling-external-ceph | 16:24 |
| priteau | Everything else I've set via config/ files | 16:24 |
| cosmicsound | meaning you defined ceph_glance_keyring in globals.yml | 16:24 |
| priteau | Though if you follow defaults you don't have to override much | 16:24 |
| cosmicsound | as / docs | 16:24 |
| *** ricolin has quit IRC | 16:25 | |
| priteau | you don't need to define it if you follow defaults | 16:25 |
| cosmicsound | ok | 16:25 |
| priteau | That's only required if your key file is *not* named ceph.client.glance.keyring | 16:25 |
| cosmicsound | i am confused at every step 1 | 16:25 |
| cosmicsound | https://docs.openstack.org/kolla-ansible/latest/reference/storage/external-ceph-guide.html#glance | 16:25 |
| cosmicsound | when it says to define in globals.yml | 16:25 |
| cosmicsound | i got something like: http://paste.openstack.org/show/790550/ | 16:26 |
| cosmicsound | tree structure | 16:27 |
| *** bengates has quit IRC | 16:35 | |
| Fl1nt | And I'm back ^^ Is the meeting finished? | 16:35 |
| yoctozepto | Fl1nt: it is | 16:39 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: Add seed and overcloud CI jobs, drop CentOS 7 jobs https://review.opendev.org/709787 | 16:40 |
| mgoddard | yoctozepto: how does devstack use uwsgi? with a separate web server or not? | 16:43 |
| *** rpittau|bbl is now known as rpittau | 16:43 | |
| *** reph has joined #openstack-kolla | 16:44 | |
| yoctozepto | mgoddard: devstack does one httpd (apache2) proxying with mod_proxy_uwsgi | 16:46 |
| yoctozepto | mgoddard: it does not really smell production-like | 16:46 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Host OS prechecks follow up https://review.opendev.org/712502 | 16:46 |
| mgoddard | yoctozepto: what would be production-like? | 16:46 |
| yoctozepto | mgoddard: do we have a problem with uwsgi standalone? | 16:46 |
| priteau | cosmicsound: your structure looks fine. Feel free to define all documented variables in globals.yml, it's just not strictly necessary if you use the same as the default | 16:46 |
| Fl1nt | @yoctozepto, thx! | 16:47 |
| yoctozepto | mgoddard: uwsgi claim they are production-ready | 16:47 |
| mgoddard | yoctozepto: why does devstack not use it? | 16:47 |
| yoctozepto | mgoddard: services setup on one port, different urls | 16:47 |
| yoctozepto | mgoddard: much different story than k-a | 16:48 |
| yoctozepto | mgoddard: repeating myself - any issues with uwsgi standalone? | 16:48 |
| yoctozepto | mgoddard: must have lost thread | 16:49 |
| * mgoddard checks what OSA does | 16:49 | |
| yoctozepto | +1 | 16:49 |
| mgoddard | yoctozepto: I have no data | 16:49 |
| yoctozepto | mgoddard: no data, no problem | 16:49 |
| mgoddard | looks like OSA is standalone | 16:51 |
| yoctozepto | mgoddard: per uwsgi this is most sensible | 16:57 |
| yoctozepto | mgoddard: especially when running haproxy in front | 16:57 |
| mgoddard | yoctozepto: looks like they use a httpd or nginx as a reverse proxy for keystone at least: https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/defaults/main.yml#L186 | 17:00 |
| mgoddard | "Using a web server | 17:00 |
| mgoddard | # for endpoints is far better for scale and allows the use of additional | 17:00 |
| mgoddard | # modules to improve performance or security, leaving uWSGI to only have | 17:00 |
| yoctozepto | mgoddard: hmm, interesting comment there | 17:00 |
| mgoddard | # to be used for running the service. | 17:00 |
| yoctozepto | mgoddard: yeah, you can put apache in front to share namespace | 17:01 |
| yoctozepto | mgoddard: but we would have to do meta-container for apache for that | 17:01 |
| *** ricolin has joined #openstack-kolla | 17:01 | |
| yoctozepto | mgoddard: apache+uwsgi per service brings only issues | 17:01 |
| mgoddard | indeed | 17:02 |
| mgoddard | supervisord in the container? | 17:02 |
| mgoddard | or back to mod_wsgi :D | 17:02 |
| mgoddard | maybe this needs to go to the ML | 17:03 |
| mgoddard | seems like a minefield | 17:03 |
| Fl1nt | what's the issue with mod_uwsgi ? | 17:04 |
| cosmicsound | priteau , will give it a try | 17:06 |
| *** scottsol has quit IRC | 17:06 | |
| cosmicsound | still my config now fails on rabbitmq | 17:06 |
| cosmicsound | for some reassons | 17:06 |
| cosmicsound | docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid will fail | 17:07 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Host OS prechecks follow up https://review.opendev.org/712502 | 17:08 |
| yoctozepto | mgoddard: for our usecase uwsgi is seemingly sound | 17:09 |
| yoctozepto | mgoddard: well, except for that keystone federation thingy, which may require apache | 17:09 |
| yoctozepto | mgoddard: we could stay on mod_wsgi as long as it works ;p | 17:10 |
| yoctozepto | not seeing immediate issues | 17:10 |
| yoctozepto | but hardly future-proof | 17:10 |
| Fl1nt | @yoctozepto, what's your issue with uwsgi? didn't get it. | 17:10 |
| yoctozepto | Fl1nt: I have none | 17:10 |
| yoctozepto | mnasiadka: "+ virtualenv -p /usr/bin/python2 --system-site-packages /home/zuul/ceph-venv", | 17:10 |
| yoctozepto | "FileNotFoundError: [Errno 2] No such file or directory: '/home/zuul/.local/share/virtualenv/py-info/20.0.5/f92b2924b84ff19c1c3dc485f7644d4486f64738191026bf8e6de303969141b5.lock'" | 17:10 |
| yoctozepto | bad paste, eh | 17:10 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: seed VM & bifrost https://review.opendev.org/712133 | 17:11 |
| yoctozepto | but seemingly something went wrong with ceph-ansible | 17:11 |
| Fl1nt | ^^ was about to say that I don't saw any uwsgi related message ^^ | 17:11 |
| *** suff has quit IRC | 17:12 | |
| mnasiadka | yoctozepto: probably infra did something in image once again, will check | 17:12 |
| yoctozepto | Fl1nt: yeah, I have no uwsgi issue | 17:12 |
| cosmicsound | RUNNING HANDLER [rabbitmq : Waiting for rabbitmq to start on first node] ******************************************************************************************** | 17:12 |
| cosmicsound | fatal: [compute-1]: FAILED! => {"changed": true, "cmd": "docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid", "delta": "0:00:00.213370", "end": "2020-03-11 17:12:48.781434", "msg": "non-zero return code", "rc": 137, "start": "2020-03-11 17:12:48.568064", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | 17:12 |
| yoctozepto | Fl1nt: mgoddard was only asking about how it's used elsewhere | 17:13 |
| cosmicsound | how can ceph external config break rabbit? | 17:13 |
| yoctozepto | Fl1nt: atm we are running mod_wsgi almost everywhere | 17:13 |
| yoctozepto | sometimes just eventlet @mgoddard | 17:13 |
| yoctozepto | cosmicsound: it can't really | 17:13 |
| yoctozepto | must be something else :-) | 17:13 |
| cosmicsound | like? | 17:13 |
| cosmicsound | I did not made any other changes | 17:14 |
| Fl1nt | @cosmicsound, if you -vvvv your run, you could get kolla_docker to give you the complete json with the RC and messages of the error | 17:15 |
| Fl1nt | @yoctozepto, ok ok, I was a bit concerned because I saw supervisord poped out of the conversation ^^ Kolla-ansible is currently amazing, don't make it bloaty ^^ | 17:16 |
| Fl1nt | @cosmicsound, from your error, you've got a OOM Killer out there. | 17:17 |
| Fl1nt | Here is another question, would it be interesting to work on introducing multiple region and policies to swift role? | 17:33 |
| Fl1nt | I mean, is that something that is often requested and can interest some? | 17:33 |
| *** evrardjp has quit IRC | 17:35 | |
| mgoddard | Fl1nt: I don't know about regions, but I think swift_extra_ring_files was added for policies | 17:35 |
| *** evrardjp has joined #openstack-kolla | 17:35 | |
| Fl1nt | oh! sweet | 17:36 |
| mgoddard | kolla-ansible is multi-region, so if swift doesn't support it then we should fix that | 17:36 |
| Fl1nt | I'll have to check with the latest, but with the rocky release at least, there are plenty room for improvement with swift, like, add a bootstrap task that create the disks and the ring files for instance instead of doing it manually outside. | 17:37 |
| *** reph has quit IRC | 17:38 | |
| mgoddard | Fl1nt: you might want to checkout what we have in kayobe for this | 17:41 |
| mgoddard | Fl1nt: https://opendev.org/openstack/kayobe/src/branch/master/ansible/swift-block-devices.yml | 17:41 |
| mgoddard | Fl1nt: https://opendev.org/openstack/kayobe/src/branch/master/ansible/swift-rings.yml | 17:41 |
| Fl1nt | sweet ^^ that could definitely help on the long run, but for now I'm out of kayobe ^^ | 17:42 |
| Fl1nt | I'll however check that out and integrate it on our local kolla-ansible | 17:43 |
| mgoddard | Fl1nt: would be open to moving it to kolla-ansible | 17:43 |
| Fl1nt | ok, I'll check that out and look at if it does what our customer expect and give you the intel. | 17:43 |
| mgoddard | sure | 17:44 |
| *** JangwonLee__ has quit IRC | 17:45 | |
| mgoddard | Fl1nt: in case you didn't see it earlier, https://etherpad.openstack.org/p/kolla-sig | 17:45 |
| cosmicsound | OOM killer? | 17:46 |
| Fl1nt | Oh cool, I'll definitely add things on it. | 17:46 |
| cosmicsound | Fl1nt , this is the log with -vvvv http://paste.openstack.org/show/790557/ | 17:47 |
| Fl1nt | @cosmicsound, yep, your RMQ Container seems to have been killed with a OOM Killer (rc=137) | 17:47 |
| Fl1nt | and from your extended log, it seems like the command invoked don't exist. which is weird. | 17:48 |
| cosmicsound | So yeah. | 17:48 |
| cosmicsound | Like I said eof for what it can do this | 17:48 |
| cosmicsound | i had not touched anything but ceph settings | 17:49 |
| Fl1nt | @cosmicsound, OK, I know what's going on... do you use thin pool lvm ? | 17:49 |
| cosmicsound | i used to | 17:49 |
| cosmicsound | now is off in favor of ceph | 17:49 |
| *** dougsz has quit IRC | 17:49 | |
| Fl1nt | the error you get with the OCI exec failing and that 126 error code usually prompt when you're out of space for docker | 17:51 |
| cosmicsound | i got plenty of space Fl1nt | 17:53 |
| cosmicsound | 960 gb nvm | 17:53 |
| openstackgerrit | James Kirsch proposed openstack/kolla master: Install uwsgi for Keystone https://review.opendev.org/710879 | 17:53 |
| Fl1nt | @cosmicsound, what is your docker version? 19.03.5 ? | 17:55 |
| cosmicsound | 03.6 | 17:55 |
| Fl1nt | ok, so, just checked on docker, that error is coming when your container is OOM Killed or missing space. | 17:55 |
| cosmicsound | space could not be issue | 17:56 |
| cosmicsound | guess only OOM killed | 17:56 |
| cosmicsound | that im not sure what killed it | 17:56 |
| Fl1nt | You'll only know grepping the logs unfortunately ^^ | 17:56 |
| *** k_mouza has quit IRC | 17:59 | |
| cosmicsound | i think this task; TASK [kibana : Wait for kibana port] | 18:00 |
| *** vishalmanchanda has quit IRC | 18:00 | |
| cosmicsound | could use some help for what ever reason if to be said its repetitive | 18:00 |
| cosmicsound | and duplicable in my case several times | 18:01 |
| *** priteau has quit IRC | 18:03 | |
| cosmicsound | weird all this port waiting after cleaning the hosts with. destroy | 18:10 |
| *** tonythomas has quit IRC | 18:10 | |
| noxoid | ive seen a case or two where running kolla-ansible destroy does not actually destroy everything | 18:14 |
| noxoid | and if you try to re-deploy again itll pick up old data | 18:14 |
| openstackgerrit | Merged openstack/kolla stable/stein: Add ssh clients to Ironic Conductor container https://review.opendev.org/712423 | 18:22 |
| openstackgerrit | Merged openstack/kolla stable/rocky: Add ssh clients to Ironic Conductor container https://review.opendev.org/712424 | 18:25 |
| *** reph has joined #openstack-kolla | 18:35 | |
| *** reph has joined #openstack-kolla | 18:36 | |
| *** gfidente has quit IRC | 18:38 | |
| *** reph has quit IRC | 18:42 | |
| *** klindgren has quit IRC | 18:59 | |
| *** kplant has quit IRC | 19:00 | |
| *** klindgren has joined #openstack-kolla | 19:04 | |
| *** reph has joined #openstack-kolla | 19:05 | |
| *** reph has quit IRC | 19:10 | |
| *** reph has joined #openstack-kolla | 19:10 | |
| *** rpittau is now known as rpittau|afk | 19:40 | |
| *** cah_link has quit IRC | 19:55 | |
| *** reph has quit IRC | 19:56 | |
| *** reph has joined #openstack-kolla | 20:17 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Fix HAProxy monitor VIP precheck https://review.opendev.org/712300 | 20:24 |
| cosmicsound | ow stuck on TASK [keystone : Creating admin project, user, role, service, and endpoint] ***************************************************************************************** | 20:28 |
| cosmicsound | just great errors today | 20:28 |
| *** reph has quit IRC | 20:30 | |
| *** jimcrowleyibm has quit IRC | 20:34 | |
| cosmicsound | let tomorrow be a better day to troubleshoot, off | 20:52 |
| *** lile has joined #openstack-kolla | 20:57 | |
| *** reph has joined #openstack-kolla | 21:26 | |
| *** reph has quit IRC | 21:58 | |
| *** Fl1nt has quit IRC | 22:04 | |
| *** dave-mccowan has quit IRC | 22:05 | |
| *** dave-mccowan has joined #openstack-kolla | 22:12 | |
| *** diurnalist has quit IRC | 22:23 | |
| *** portdirect has quit IRC | 22:31 | |
| *** mwhahaha has quit IRC | 22:31 | |
| *** rwellum_ has quit IRC | 22:31 | |
| *** rm_work has quit IRC | 22:31 | |
| *** andrein has quit IRC | 22:31 | |
| *** rm_work has joined #openstack-kolla | 22:33 | |
| *** mwhahaha has joined #openstack-kolla | 22:33 | |
| *** portdirect has joined #openstack-kolla | 22:34 | |
| *** andrein has joined #openstack-kolla | 22:36 | |
| *** cz3 has quit IRC | 22:36 | |
| *** lile has quit IRC | 22:36 | |
| *** generalfuzz has quit IRC | 22:36 | |
| *** gmann has quit IRC | 22:36 | |
| *** vkmc has quit IRC | 22:36 | |
| *** crindi has quit IRC | 22:36 | |
| *** rwellum_ has joined #openstack-kolla | 22:38 | |
| *** vkmc has joined #openstack-kolla | 22:39 | |
| *** gmann has joined #openstack-kolla | 22:40 | |
| *** cz3 has joined #openstack-kolla | 22:42 | |
| *** k_mouza has joined #openstack-kolla | 22:43 | |
| *** TrevorV has quit IRC | 22:44 | |
| *** crindi has joined #openstack-kolla | 22:44 | |
| *** generalfuzz has joined #openstack-kolla | 22:44 | |
| *** lile has joined #openstack-kolla | 22:45 | |
| *** r3ap3r has quit IRC | 22:46 | |
| *** stackedsax has quit IRC | 22:46 | |
| *** irclogbot_1 has quit IRC | 22:47 | |
| *** stackedsax has joined #openstack-kolla | 22:47 | |
| *** k_mouza has quit IRC | 22:47 | |
| *** irclogbot_2 has joined #openstack-kolla | 22:48 | |
| *** r3ap3r has joined #openstack-kolla | 22:48 | |
| *** openstackstatus has quit IRC | 22:48 | |
| *** mnasiadka has quit IRC | 22:50 | |
| *** alanmeadows has quit IRC | 22:50 | |
| *** diurnalist has joined #openstack-kolla | 22:50 | |
| *** reph has joined #openstack-kolla | 22:52 | |
| *** alanmeadows has joined #openstack-kolla | 22:53 | |
| *** mnasiadka has joined #openstack-kolla | 22:54 | |
| *** emccormick has quit IRC | 22:56 | |
| *** dannins has quit IRC | 22:56 | |
| *** emccormick has joined #openstack-kolla | 23:01 | |
| *** reph has quit IRC | 23:06 | |
| *** reph has joined #openstack-kolla | 23:07 | |
| *** dave-mccowan has quit IRC | 23:08 | |
| *** dave-mccowan has joined #openstack-kolla | 23:11 | |
| *** jbadiapa has quit IRC | 23:13 | |
| *** ktibi has quit IRC | 23:15 | |
| *** reph has quit IRC | 23:22 | |
| *** diurnalist has quit IRC | 23:37 | |
| *** KeithMnemonic has quit IRC | 23:51 | |
| *** KeithMnemonic has joined #openstack-kolla | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!