| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Refactor mariadb to support multiple separate shards https://review.opendev.org/c/openstack/kolla-ansible/+/766952 | 00:10 |
|---|---|---|
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 00:10 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 00:10 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Refactor mariadb to support multiple separate shards https://review.opendev.org/c/openstack/kolla-ansible/+/766952 | 00:36 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 00:36 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 00:36 |
| *** LinPeiWen has joined #openstack-kolla | 00:40 | |
| *** ivan_lin has joined #openstack-kolla | 00:41 | |
| *** kevko has quit IRC | 00:53 | |
| *** kevinz has joined #openstack-kolla | 01:03 | |
| *** LinPeiWen has quit IRC | 01:08 | |
| *** LinPeiWen94 has joined #openstack-kolla | 01:19 | |
| *** xinliang has joined #openstack-kolla | 02:13 | |
| *** zzzeek has quit IRC | 02:30 | |
| *** zzzeek has joined #openstack-kolla | 02:31 | |
| *** zzzeek has quit IRC | 02:36 | |
| *** zzzeek has joined #openstack-kolla | 02:40 | |
| *** devfaz has quit IRC | 02:41 | |
| *** devfaz has joined #openstack-kolla | 02:54 | |
| *** ricolin_ has joined #openstack-kolla | 03:39 | |
| *** skramaja has joined #openstack-kolla | 03:40 | |
| *** xinliang has quit IRC | 03:53 | |
| *** ricolin_ has quit IRC | 03:54 | |
| *** vishalmanchanda has joined #openstack-kolla | 05:11 | |
| *** maharg101 has joined #openstack-kolla | 05:27 | |
| *** maharg101 has quit IRC | 05:33 | |
| *** nikparasyr has joined #openstack-kolla | 06:05 | |
| *** e0ne has joined #openstack-kolla | 06:31 | |
| *** e0ne has quit IRC | 06:49 | |
| *** sorin-mihai_ has joined #openstack-kolla | 06:52 | |
| *** kevko has joined #openstack-kolla | 07:20 | |
| kevko | morning | 07:21 |
| yoctozepto | morning kevko, morning all | 07:24 |
| *** zzzeek has quit IRC | 07:28 | |
| *** maharg101 has joined #openstack-kolla | 07:29 | |
| *** xinliang has joined #openstack-kolla | 07:30 | |
| *** zzzeek has joined #openstack-kolla | 07:31 | |
| *** maharg101 has quit IRC | 07:33 | |
| *** openstackgerrit has quit IRC | 07:47 | |
| *** kevko has quit IRC | 07:47 | |
| *** cah_link has joined #openstack-kolla | 07:50 | |
| *** devfaz_ has joined #openstack-kolla | 07:51 | |
| *** devfaz has quit IRC | 07:52 | |
| *** e0ne has joined #openstack-kolla | 07:54 | |
| *** e0ne has quit IRC | 07:54 | |
| *** e0ne has joined #openstack-kolla | 07:55 | |
| *** e0ne has quit IRC | 07:55 | |
| *** devfaz has joined #openstack-kolla | 07:59 | |
| *** devfaz_ has quit IRC | 08:00 | |
| *** kevko has joined #openstack-kolla | 08:01 | |
| kevko | i've done proxysql thing at night ..if I can ask someone to chech please :) ? zuul +1 for all ... but I would like to add test for switch to proxysql ..can someone help with it ? | 08:05 |
| *** openstackgerrit has joined #openstack-kolla | 08:07 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/victoria: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770506 | 08:07 |
| *** sorin-mihai__ has joined #openstack-kolla | 08:12 | |
| *** andrewbonney has joined #openstack-kolla | 08:13 | |
| *** sorin-mihai_ has quit IRC | 08:15 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770507 | 08:17 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770508 | 08:19 |
| *** e0ne has joined #openstack-kolla | 08:21 | |
| *** e0ne has quit IRC | 08:22 | |
| *** maharg101 has joined #openstack-kolla | 08:23 | |
| *** rpittau|afk is now known as rpittau | 08:25 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770508 | 08:27 |
| *** gfidente|afk is now known as gfidente | 08:32 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix remove libvirt apparmor disabled profile https://review.opendev.org/c/openstack/kolla-ansible/+/770510 | 08:51 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/victoria: Fix remove libvirt apparmor disabled profile https://review.opendev.org/c/openstack/kolla-ansible/+/770509 | 08:51 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Fix remove libvirt apparmor disabled profile https://review.opendev.org/c/openstack/kolla-ansible/+/770511 | 08:51 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770090 | 08:56 |
| *** xinliang has quit IRC | 08:58 | |
| *** e0ne has joined #openstack-kolla | 09:00 | |
| *** kevko has quit IRC | 09:02 | |
| *** kevko has joined #openstack-kolla | 09:03 | |
| yoctozepto | kevko: point me to where you need help | 09:05 |
| *** bengates has joined #openstack-kolla | 09:05 | |
| yoctozepto | (and please don't overwork yourself and sleep at night) | 09:05 |
| *** bengates has quit IRC | 09:09 | |
| *** bengates has joined #openstack-kolla | 09:10 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Remove footer block from intermediate images https://review.opendev.org/c/openstack/kolla/+/770087 | 09:10 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770090 | 09:10 |
| mgoddard | morning all | 09:10 |
| mgoddard | fg | 09:10 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770090 | 09:12 |
| hrw | morning | 09:15 |
| hrw | did someone had some time to look at 'allowed to fail' patch? | 09:16 |
| hrw | https://review.opendev.org/c/openstack/kolla/+/765807 one | 09:16 |
| *** dasp_ has quit IRC | 09:16 | |
| hrw | zuul is happy and 'test' image failed each time as it was expected | 09:16 |
| *** dasp has joined #openstack-kolla | 09:17 | |
| *** e0ne has quit IRC | 09:20 | |
| *** e0ne has joined #openstack-kolla | 09:21 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: re-add rabbitmq config for interfaces https://review.opendev.org/c/openstack/kolla-ansible/+/758576 | 09:25 |
| *** e0ne has quit IRC | 09:25 | |
| *** e0ne has joined #openstack-kolla | 09:26 | |
| *** e0ne has quit IRC | 09:26 | |
| yoctozepto | mgoddard: did you try to put us in the foreground? | 09:32 |
| mgoddard | yoctozepto: bg | 09:32 |
| *** hrw has quit IRC | 09:34 | |
| yoctozepto | mgoddard: but ^Z first | 09:36 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Support multiple environments from a single configuration https://review.opendev.org/c/openstack/kayobe/+/734867 | 09:40 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add a command to create a new Kayobe environment https://review.opendev.org/c/openstack/kayobe/+/770553 | 09:40 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add documentation for multiple environments https://review.opendev.org/c/openstack/kayobe/+/770554 | 09:40 |
| *** hrw has joined #openstack-kolla | 09:41 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add a command to create a new Kayobe environment https://review.opendev.org/c/openstack/kayobe/+/770553 | 09:41 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add documentation for multiple environments https://review.opendev.org/c/openstack/kayobe/+/770554 | 09:41 |
| hrw | btw - I skip today's meeting. have some other stuff to handle at that time | 09:41 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe-config master: Support specifying a Kayobe environment to use https://review.opendev.org/c/openstack/kayobe-config/+/770558 | 09:47 |
| hrw | mgoddard: thanks for review | 09:48 |
| mgoddard | hrw: np | 09:48 |
| hrw | mgoddard: self.conf was nice suggestion. simpler | 09:49 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe-config master: Support specifying a Kayobe environment to use https://review.opendev.org/c/openstack/kayobe-config/+/770558 | 09:50 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add a command to create a new Kayobe environment https://review.opendev.org/c/openstack/kayobe/+/770553 | 09:50 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add documentation for multiple environments https://review.opendev.org/c/openstack/kayobe/+/770554 | 09:50 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/ussuri: DNM: test seed jobs (ussuri) https://review.opendev.org/c/openstack/kayobe/+/770561 | 10:01 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: WIP: implement "allowed to fail" images https://review.opendev.org/c/openstack/kolla/+/765807 | 10:04 |
| hrw | mgoddard: comments acked, fixed | 10:04 |
| openstackgerrit | Merged openstack/kolla master: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770445 | 10:06 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/victoria: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770514 | 10:09 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Horizon: gentler `-o nounset` handling https://review.opendev.org/c/openstack/kolla/+/770566 | 10:12 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe-config-dev master: DNM: Test multiple environments https://review.opendev.org/c/openstack/kayobe-config-dev/+/752469 | 10:16 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: DNM: Test multiple environments https://review.opendev.org/c/openstack/kayobe-config-dev/+/752469 | 10:17 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [docs] Add templates and examples of renos https://review.opendev.org/c/openstack/kolla-ansible/+/759254 | 10:19 |
| kevko | yoctozepto: sorry, I was AFK ... well I have already pushed https://review.opendev.org/q/hashtag:%22proxysql%22+(status:open%20OR%20status:merged) which is switching LB for mariadb to proxysql based on global variable enable_proxysql (with sharding support :) ) , i would like to have test which 1. Change enable_proxysql to "yes" , run reconfigure .. | 10:27 |
| openstackgerrit | Merged openstack/kolla stable/ussuri: Remove footer block from intermediate images https://review.opendev.org/c/openstack/kolla/+/770086 | 10:30 |
| openstackgerrit | Merged openstack/kolla stable/ussuri: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770089 | 10:30 |
| yoctozepto | kevko: try this: create a new change which sets the enable_proxysql to yes for our jobs - this way you test both initial deployment (via normal jobs) and reconfig/upgrades (via upgrade jobs) | 10:30 |
| kevko | ah, ok , and what should be done after it will pass ? abandon this change ? or merge new behaviour ? | 10:31 |
| kevko | just asking what is "ussual way" | 10:32 |
| yoctozepto | kevko: we will see, perhaps we might want to add another "experimental" job which enables proxysql this way | 10:34 |
| yoctozepto | kevko: thanks for working on this; I left a biggur comment on one of the patches | 10:35 |
| *** dougsz has joined #openstack-kolla | 10:36 | |
| *** dougsz has quit IRC | 10:37 | |
| kevko | yoctozepto: ok, will process .. | 10:39 |
| kevko | yoctozepto: btw, when I was doing this work , i noticed or let's say i had feeling that nova-cell is not completly supported to install DBs on another location ... there is a mention about nova_cell_database_group ...but it is not defined anywhere ... only in defaults . . | 10:42 |
| kevko | found several docs about cells, and group names for cells ... etc ..but not about this variable .. | 10:42 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/victoria: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770514 | 10:43 |
| kevko | i had a feeling that all is implemented (superconductor ...etc etc ) .. but database is still unnamed "nova" located on origin DB hosts where all other services .. | 10:43 |
| kevko | is it like I'm saying ? | 10:44 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/victoria: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770514 | 10:44 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 10:45 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 10:46 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 10:47 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 10:47 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 10:49 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe-config-dev master: DNM: Test multiple environments https://review.opendev.org/c/openstack/kayobe-config-dev/+/752469 | 10:52 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770580 | 10:56 |
| kevko | yoctozepto: btw, i have some older change with central_logging/fluent , and it lies in oblivion because of dependency in kolla (dependency is to have python3-fluent-logger in image but not available for centos) | 10:56 |
| kevko | is going through to get the pound in pip installable form in all images (i mean binary/source) ? | 10:57 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770580 | 10:59 |
| *** abdysn has joined #openstack-kolla | 11:01 | |
| *** bengates has quit IRC | 11:04 | |
| *** bengates has joined #openstack-kolla | 11:04 | |
| *** bengates has quit IRC | 11:21 | |
| *** bengates has joined #openstack-kolla | 11:21 | |
| yoctozepto | kevko: re cells: yes, the support is incomplete, exactly in the sql department, you can get in touch with mgoddard and dougsz if you want to help | 11:29 |
| yoctozepto | there should be some patch lying around which started working on this | 11:29 |
| yoctozepto | but I might be wrong | 11:29 |
| kevko | some time ago Mark send me this -> https://review.opendev.org/#/c/619756/ | 11:30 |
| kevko | i think my proposed patches is solving the issue with installation of sql to another location in very nice way | 11:30 |
| yoctozepto | kevko: re oblivion: please link to patches you mention ;-) is only centos missing this? is there really no repo for centos that provides this? | 11:30 |
| kevko | yoctozepto: yes, it really no repo for centos :( | 11:31 |
| kevko | yoctozepto: they had python-fluent-logger in dist ..but some time ago ..i don't know why they decided to remove | 11:31 |
| yoctozepto | kevko: re nice way: obviously, one's own approach always feels best :-) I have yet to look at it, I will let you know how I like it ;-) | 11:31 |
| kevko | yoctozepto: well, you just specify shard_id group and that's it :) | 11:31 |
| yoctozepto | kevko: because they are upstream-driven and upstream supports a small subset of stuff; it usually makes sense - as long as one doesn't want to experiment; again, enterprise users *do not* experiment when they want to keep their jobs ;-) | 11:32 |
| kevko | dependency is only that schemaname has to have another name ... | 11:32 |
| kevko | not 'nova' ..but named cell | 11:32 |
| *** bengates has quit IRC | 11:33 | |
| kevko | yoctozepto: this two patches -> https://review.opendev.org/c/openstack/kolla-ansible/+/755775 , https://review.opendev.org/c/openstack/kolla/+/759855 | 11:33 |
| *** bengates has joined #openstack-kolla | 11:33 | |
| kevko | yoctozepto: we are using it from stein in our deployments ... and I am always doing merge with new version of kolla-ansible ...and it is painfull :P | 11:34 |
| kevko | and it is quite nice thing .. | 11:34 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/ussuri: Fix Python setup when venv is not used https://review.opendev.org/c/openstack/kayobe/+/764510 | 11:35 |
| yoctozepto | kevko: yes, I agree with you totally | 11:36 |
| mnasiadka | mrunge: alive? is there an option to get python-fluent-logger back in opstools repo for CentOS 8? (It seems it's been there for 7) | 11:39 |
| *** bengates has quit IRC | 11:40 | |
| yoctozepto | kevko: I left a comment on that kolla commit | 11:41 |
| yoctozepto | perhaps we should discuss this during the meeting | 11:41 |
| *** bengates has joined #openstack-kolla | 11:41 | |
| kevko | thank you guys | 11:42 |
| yoctozepto | mnasiadka: we are missing ubuntu as well | 11:43 |
| yoctozepto | it is seemingly the way neither tripleo nor charms took, hence no distro support | 11:44 |
| mnasiadka | yoctozepto: can we install the one from 20.10? https://launchpad.net/ubuntu/+source/python-fluent-logger | 11:45 |
| yoctozepto | mnasiadka: ooh, creepy | 11:46 |
| yoctozepto | ah, right; because it's in debian since bullseye as well | 11:48 |
| mnasiadka | well, we could survive probably by installing the pip package in openstack-base, since there is no binary.... for now. | 11:55 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770580 | 11:56 |
| yoctozepto | mnasiadka: wonder if it has no other deps we need; installing with deps from pip is a big no-no ;-) | 11:57 |
| yoctozepto | install_requires=['msgpack<1.0.0'], | 11:58 |
| yoctozepto | hmm | 11:58 |
| mnasiadka | yeah, doesn't look like a killer | 11:58 |
| mnasiadka | Successfully installed fluent-logger-0.9.6 msgpack-0.6.2 | 11:58 |
| mnasiadka | on clean centos 8 | 11:58 |
| kevko | it's simple library | 11:58 |
| mrunge | mnasiadka, totally busy, sorry | 11:59 |
| yoctozepto | yeah, but is there a valid msgpack in distro perhaps? that would be a no-brainer then as it would not (should not at least) affect anything else; though we should likely pin it somehow | 11:59 |
| mnasiadka | mrunge: no problem, feel free to reply when untangled :) | 12:00 |
| mrunge | mnasiadka, I already described kevko what to do and how to get it into centos 8 | 12:00 |
| mrunge | so, from my side, there is no action item | 12:00 |
| mnasiadka | ah ok | 12:00 |
| mnasiadka | yoctozepto: msgpack is in epel... | 12:01 |
| mrunge | personally, I have currently no interest in fluentd and there is no fluentd etc. in centos 8 | 12:01 |
| mnasiadka | or in RDO | 12:01 |
| kevko | mrunge: if i remember correctly, i need to get into fedora firstly ..etc , i also done some work ..but i am not familiar with it ..and unfortunately don't have a time to do it :* | 12:01 |
| mrunge | question there would be: what version? fluentd based on ruby (no....), fluentbit... | 12:02 |
| kevko | :( | 12:02 |
| mrunge | kevko, fedora is not a requirement | 12:02 |
| mrunge | I don't have time for this either ;-) | 12:02 |
| mnasiadka | yoctozepto: python3-msgpack from RDO + pip install fluent-logger probably will not kill us | 12:02 |
| mnasiadka | kevko: do we need fluent-logger outside of openstack-base children? | 12:03 |
| kevko | i think as small and simple library should be installed by pip ( as pyyaml is installed for example in base) | 12:03 |
| mrunge | no! no! | 12:03 |
| mrunge | nothing should be installed via pip in production | 12:03 |
| mrunge | do you have a pointer to the library on centos 7? | 12:03 |
| kevko | https://cbs.centos.org/koji/buildinfo?buildID=17129 | 12:04 |
| mrunge | ... if it was already there, we can skip the review part | 12:04 |
| mnasiadka | mrunge: you're the author - https://cbs.centos.org/koji/buildinfo?buildID=17129 | 12:04 |
| mnasiadka | :) | 12:04 |
| mnasiadka | https://bugzilla.redhat.com/show_bug.cgi?id=1445860 | 12:04 |
| openstack | bugzilla.redhat.com bug 1445860 in Package Review "Review request: python-fluent-logger - A structured logger for Fluentd (Python)" [Unspecified,Closed: currentrelease] - Assigned to chkumar | 12:04 |
| mrunge | it looks like it was never used | 12:04 |
| yoctozepto | mnasiadka: mhm, sounds like a plan; let me see ubuntu | 12:04 |
| yoctozepto | https://packages.ubuntu.com/bionic/python3-msgpack | 12:04 |
| yoctozepto | oh yeah | 12:04 |
| *** kevko has quit IRC | 12:05 | |
| yoctozepto | mnasiadka: so we only need to: 1) install distro's msgpack; 2) pip-install pinned fluent | 12:05 |
| yoctozepto | perhaps we already install msgpack somewhere | 12:06 |
| mrunge | okay, kevko now it looks like there is the task to get the package built on centos8, that's different | 12:06 |
| yoctozepto | as it sounds like something that could be used already | 12:06 |
| mrunge | I simply forgot about this. | 12:06 |
| *** kevko has joined #openstack-kolla | 12:07 | |
| kevko | mnasiadka: well, i think it is not needed outside of openstack-base children .. | 12:07 |
| kevko | mnasiadka: patch what I did is changing OS services to use native fluent logger | 12:08 |
| kevko | *only | 12:08 |
| mnasiadka | mrunge: well, I don't think any of us as cbs access, so if you would have some time to do it in foreseeable future - we would be more than happy | 12:14 |
| yoctozepto | mnasiadka, kevko: various oslo things bring in msgpack so we would be better off installing it in openstack-base anyway | 12:15 |
| yoctozepto | mnasiadka, kevko: I will propose it | 12:16 |
| kevko | yoctozepto: thank you ! | 12:16 |
| yoctozepto | mnasiadka, kevko: shucks, bad news, msgpack is no longer compatible in wallaby: https://github.com/openstack/requirements/blob/master/upper-constraints.txt | 12:21 |
| yoctozepto | 1.0.2 is set here | 12:21 |
| yoctozepto | fluent needs an upgrade now | 12:21 |
| kevko | no problem , i will upgrade in debian | 12:22 |
| yoctozepto | https://github.com/openstack/requirements/blob/stable/victoria/upper-constraints.txt | 12:22 |
| *** bengates has quit IRC | 12:22 | |
| mnasiadka | Not in debian, in pypi :) | 12:22 |
| yoctozepto | turns out in victoria it's already 1.0.0 | 12:22 |
| yoctozepto | yeah, fluent needs fixing upstream, in fluent itself | 12:22 |
| yoctozepto | duh | 12:22 |
| yoctozepto | btw, this new msgpack is already installed | 12:23 |
| yoctozepto | new pip will prevent this installation now | 12:23 |
| yoctozepto | as <1.0.0 and ==1.0.2 cannot be satisfied | 12:23 |
| *** bengates has joined #openstack-kolla | 12:24 | |
| kevko | rrrr | 12:25 |
| hrw | msgpack... looks like it would be nice to check which python packages gets installed in openstack-base children and decide which ones to move there | 12:25 |
| hrw | we had such changes in past | 12:25 |
| kevko | i will try to fork and create pull request ..and will see what travis.ci will say to update | 12:26 |
| kevko | and maybe upstream will be prompt | 12:26 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Add fluent-logger to images - source, binary-debian https://review.opendev.org/c/openstack/kolla/+/759855 | 12:26 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Support multiple environments from a single configuration https://review.opendev.org/c/openstack/kayobe/+/734867 | 12:27 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add a command to create a new Kayobe environment https://review.opendev.org/c/openstack/kayobe/+/770553 | 12:28 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add documentation for multiple environments https://review.opendev.org/c/openstack/kayobe/+/770554 | 12:28 |
| yoctozepto | hrw: it gets there transitively now but perhaps we should see if we can commonalise something more | 12:28 |
| yoctozepto | I also wonder if we already install something outside of u-c | 12:28 |
| *** skramaja has quit IRC | 12:40 | |
| *** devfaz_ has joined #openstack-kolla | 12:41 | |
| *** devfaz has quit IRC | 12:42 | |
| yoctozepto | kevko: is there a reason you call shards using integer numbers? or was it just a convention that you took? | 12:43 |
| kevko | that has a reason yes .. | 12:43 |
| kevko | in proxysql there are hostgroups , and they are integers | 12:44 |
| kevko | always you have 4 hostgroups per galera_cluster | 12:44 |
| kevko | WRITER_GROUP, READER_GROup, BACKUP_WRITER_GROUP | 12:44 |
| kevko | * OFFLINE_GROUP | 12:44 |
| kevko | and it is very simple to pass this int to configuration .. | 12:45 |
| kevko | also i am doying everywhere multiple with *10 because i wanted to have shard 1 writer hostgroup 10, backup_writer 11 .... 12 13 and continuing with shard 2 20,21,22,23 30,31.... | 12:46 |
| kevko | proxysql is then forwarding sql to this groups depends on writer_is_also_reader option in proxysql setting | 12:47 |
| kevko | (if write only, read-write-split ...etc) ... | 12:47 |
| yoctozepto | kevko: you mean you are using this for proxysql's hostgroup_id? | 12:48 |
| kevko | shard_id = 1 => ( writer_hostgroup = 10, backup_writer = 11, reader_hostgroup = 12, offline_hostgroup = 13 ) | 12:49 |
| *** wuchunyang has joined #openstack-kolla | 12:50 | |
| kevko | if there is N shards , you have to secure (if you want it automatically) that you will not have some override | 12:50 |
| kevko | every shard has 4 hostgroups which are changing internally in proxysql based on check to backends .. | 12:51 |
| kevko | i can give you an ssh key to my env if you want :) | 12:51 |
| yoctozepto | kevko: nah, I am fine with you explaining it to me and others :-) | 12:52 |
| kevko | https://proxysql.com/blog/proxysql-native-galera-support/ | 12:52 |
| kevko | i wanted to have simply ( user can choose whatever wants but INT) .. and everything is done automatically | 12:53 |
| kevko | and wanted to have it visible at first sight in proxysql internal db ..so I choose model int * 10 for writer ( primary ) group .. | 12:54 |
| * kevko is going to cigarette :) | 12:56 | |
| yoctozepto | kevko: bad habit :-) | 12:57 |
| yoctozepto | sleep more, smoke less | 12:57 |
| kevko | it is not possible to sleep when I dream in PyCharm or Vim :D | 12:59 |
| yoctozepto | haha | 13:01 |
| kevko | :D | 13:01 |
| *** vishalmanchanda has quit IRC | 13:01 | |
| kevko | quite often I find a solution in dreams :D | 13:01 |
| kevko | :D | 13:01 |
| *** eliaswimmer has joined #openstack-kolla | 13:03 | |
| yoctozepto | same here! | 13:04 |
| hrw | good that you do not dream in emacs ;D | 13:07 |
| *** brinzhang has quit IRC | 13:11 | |
| mnasiadka | what's wrong about emacs? :) | 13:11 |
| *** brinzhang has joined #openstack-kolla | 13:11 | |
| kevko | never used before :) | 13:15 |
| kevko | but google saying > Emacs tends to be relatively straightforward, similar to commonly used text editors like Notepad. On the other hand, Vim is a power-user's tool, using keyboard shortcuts to speed up tasks. Vim is known to have a much steeper learning curve than Emacs. | 13:16 |
| kevko | so... :D | 13:16 |
| kevko | ok, I'm very happy to belong to the power-users group :D :D | 13:17 |
| yoctozepto | I did a lot of emacs | 13:29 |
| yoctozepto | even learnt its own lisp flavour | 13:30 |
| yoctozepto | good ol' time | 13:30 |
| * yoctozepto crying inside | 13:30 | |
| kevko | probably i am younger :) | 13:33 |
| mrunge | kevko, could you please give https://cbs.centos.org/koji/taskinfo?taskID=1839169 a try? | 13:38 |
| mrunge | I don't have a setup | 13:38 |
| *** nikparasyr has left #openstack-kolla | 13:41 | |
| kevko | will try | 13:42 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 13:47 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 13:47 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Rename role haproxy to loadbalancer https://review.opendev.org/c/openstack/kolla-ansible/+/770618 | 13:47 |
| kevko | yoctozepto: could you check if proposed renaming of haproxy to loadbalancer is in good shape ? | 13:49 |
| dmsimard | yoctozepto, mgoddard: o/ question, have you considered using --diff in playbook runs ? I was looking to test a diff rendering patch in the ara interface but couldn't find any recorded kolla-ansible runs with --diff enabled | 13:51 |
| *** e0ne has joined #openstack-kolla | 13:55 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770090 | 13:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 13:56 |
| kevko | dmsimard: +1 | 13:56 |
| *** wuchunyang has quit IRC | 14:00 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CI: revert to public package mirrors after build https://review.opendev.org/c/openstack/kolla/+/770090 | 14:03 |
| yoctozepto | kevko: well, I believe you need to rename the references in a few places ;-) | 14:03 |
| *** wuchunyang has joined #openstack-kolla | 14:06 | |
| yoctozepto | mrunge: I assume you ignored the msgpack<1.0.0 dependency? | 14:07 |
| mrunge | yes | 14:07 |
| yoctozepto | mrunge: ack, thanks for confirming | 14:07 |
| mrunge | I did, I just rebuilt the version we had 3 years ago | 14:08 |
| mrunge | not sure if that works at all | 14:08 |
| kevko | yoctozepto: well it is on very lot places :) ... it is in follow-up patch | 14:08 |
| yoctozepto | kevko: the point is each commit needs to be in a working state :P | 14:09 |
| kevko | :( | 14:09 |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: octavia: support tenant management network https://review.opendev.org/c/openstack/kolla-ansible/+/755589 | 14:09 |
| kevko | i thought that it will be a problem :( .. | 14:10 |
| kevko | let me do it once again :) | 14:11 |
| *** vishalmanchanda has joined #openstack-kolla | 14:35 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770507 | 14:41 |
| *** TrevorV has joined #openstack-kolla | 14:41 | |
| openstackgerrit | Merged openstack/kolla-ansible master: [docs] Add templates and examples of renos https://review.opendev.org/c/openstack/kolla-ansible/+/759254 | 14:41 |
| yoctozepto | meeting in 9 minutes mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak | 14:51 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/ussuri: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770579 | 14:57 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770580 | 15:00 |
| yoctozepto | mgoddard ? | 15:00 |
| mgoddard | #startmeeting kolla | 15:01 |
| *** wuchunyang has quit IRC | 15:01 | |
| openstack | Meeting started Wed Jan 13 15:01:50 2021 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:01 | |
| openstack | The meeting name has been set to 'kolla' | 15:01 |
| mgoddard | #topic rollcall | 15:01 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:02 | |
| mgoddard | \o | 15:02 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Rename role haproxy to loadbalancer https://review.opendev.org/c/openstack/kolla-ansible/+/770618 | 15:02 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 15:02 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 15:02 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 15:02 |
| yoctozepto | \o/ | 15:02 |
| priteau | o/ | 15:02 |
| yoctozepto | meeting now mnasiadka hrw egonzalez rafaelweingartne cosmicsound osmanlicilegi bbezak | 15:03 |
| mnasiadka | o/ | 15:03 |
| bbezak | o/ | 15:03 |
| kevko | yoctozepto: better now , isn't it ? | 15:03 |
| yoctozepto | kevko: probably but we are in a meeting now | 15:04 |
| kevko | ah, ok | 15:04 |
| yoctozepto | ;-) | 15:04 |
| kevko | maybe i connect also | 15:04 |
| kevko | *join | 15:04 |
| yoctozepto | please do | 15:04 |
| yoctozepto | *this* is the meeting | 15:05 |
| mgoddard | #topic agenda | 15:05 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:05 | |
| mgoddard | * Roll-call | 15:05 |
| mgoddard | * Announcements | 15:05 |
| mgoddard | ** Victoria released! | 15:05 |
| mgoddard | * Review action items from the last meeting | 15:05 |
| mgoddard | * CI status | 15:05 |
| mgoddard | * Hot issues | 15:05 |
| mgoddard | ** Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits | 15:05 |
| mgoddard | ** Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 | 15:05 |
| openstack | Launchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka) | 15:05 |
| mgoddard | ** CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html | 15:05 |
| mgoddard | * Wallaby release planning | 15:05 |
| mgoddard | ** PTG actions | 15:05 |
| mgoddard | ** Guidance on non-uniform features: https://review.opendev.org/c/openstack/kolla/+/759855 | 15:05 |
| mgoddard | * Kayobe operator feedback from Tu Wien | 15:05 |
| mgoddard | #topic announcements | 15:06 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:06 | |
| mgoddard | #info Victoria released! | 15:06 |
| mgoddard | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019774.html | 15:06 |
| mgoddard | Any others? | 15:06 |
| mgoddard | #topic Review action items from the last meeting | 15:08 |
| *** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)" | 15:08 | |
| mgoddard | mgoddard send email to openstack-discuss about meeting cancellations | 15:08 |
| mgoddard | done | 15:08 |
| mgoddard | #topic CI status | 15:08 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:08 | |
| *** abdysn has quit IRC | 15:08 | |
| mgoddard | generally seems reasonably happy for now | 15:09 |
| yoctozepto | indeed, today infra has mirror issues | 15:09 |
| yoctozepto | but this is quite mild | 15:09 |
| mnasiadka | todays publish job although vanished without any logs - allegedly success | 15:09 |
| mnasiadka | but images were not published to docker hub | 15:10 |
| mgoddard | you read the logs daily? | 15:10 |
| yoctozepto | that bad | 15:10 |
| mnasiadka | mgoddard: not daily, tried to find out why images are 3 days old | 15:10 |
| yoctozepto | mgoddard: you don't? :D | 15:10 |
| mgoddard | ah | 15:10 |
| yoctozepto | joking aside, I thought this meeting is supposed to be time for us to check for things like that :P | 15:11 |
| yoctozepto | so mnasiadka ++ | 15:11 |
| mnasiadka | if it happens again tomorrow, I'm going to bug infra :) | 15:11 |
| yoctozepto | but yesterday's look fine | 15:12 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 15:12 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 15:12 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 15:12 |
| yoctozepto | the images should be from yesterday | 15:12 |
| mgoddard | ok, keep an eye on the publishing jobs then | 15:12 |
| mgoddard | #topic Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits | 15:12 |
| *** openstack changes topic to "Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits (Meeting topic: kolla)" | 15:12 | |
| mgoddard | Limits still exist, still no mitigation | 15:13 |
| mnasiadka | did we change to use pull through cache on Kolla jobs? | 15:14 |
| yoctozepto | I did not so I assume not? | 15:14 |
| yoctozepto | :D | 15:14 |
| mgoddard | no, and it actually hit our victoria tagged release publish job :) | 15:14 |
| mnasiadka | Ok, I can look into this tomorrow, if somebody gives me pointers :) | 15:15 |
| yoctozepto | let's indeed split the workload on this and decide on steps | 15:15 |
| yoctozepto | I have sincere progress in the cinder issue so am open to giving this one to mnasiadka | 15:16 |
| yoctozepto | let's find the latest notes | 15:16 |
| yoctozepto | #link https://etherpad.opendev.org/p/docker-pull-limits | 15:16 |
| *** ivan_lin has quit IRC | 15:19 | |
| yoctozepto | uhm, anyone here with me? | 15:19 |
| *** ivan_lin has joined #openstack-kolla | 15:19 | |
| mgoddard | yes | 15:19 |
| mnasiadka | I thought we're done with this topic to be honest :) | 15:20 |
| mgoddard | we can easily do the registry-mirrors config for kolla | 15:20 |
| mgoddard | that plugs most of the holes | 15:20 |
| yoctozepto | so action for mnasiadka and "we'll see"? :D | 15:20 |
| mgoddard | at which point our options are to switch registries or use the infra registry | 15:20 |
| yoctozepto | ok, then let's start lightweight | 15:21 |
| mgoddard | ok | 15:21 |
| mgoddard | #action mnasiadka configure registry mirror for kolla CI | 15:22 |
| mgoddard | #topic Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 | 15:22 |
| *** openstack changes topic to "Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 (Meeting topic: kolla)" | 15:22 | |
| openstack | Launchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka) | 15:22 |
| mgoddard | yoctozepto: you say you have some progress? | 15:22 |
| yoctozepto | yes, in gerrit already | 15:22 |
| yoctozepto | and some local testing | 15:22 |
| yoctozepto | redis as coordinator seems quite sane | 15:22 |
| yoctozepto | so regarding coordination the minimum is to improve docs in that regard, post a reno and to mailing list | 15:23 |
| yoctozepto | for the cinder `cluster` - it works without hassle for ceph | 15:23 |
| yoctozepto | the volumes get migrated to the "clusterised" version | 15:23 |
| yoctozepto | now unto open issues | 15:24 |
| mnasiadka | what about volumes in "-ing" state, like creating? | 15:24 |
| yoctozepto | mnasiadka: that's a very good question - I have had all them stable when changing the config | 15:24 |
| mnasiadka | unless we just cover that with a reno, or add a check | 15:24 |
| yoctozepto | and the open issues are: | 15:24 |
| yoctozepto | 1) backend_host is not that easy to undo | 15:25 |
| yoctozepto | but we should undo it | 15:25 |
| yoctozepto | (per the ml discussion) | 15:25 |
| mnasiadka | undo as in remove the agent from the db? | 15:25 |
| yoctozepto | yes, have all volumes be "served" from "real" hosts | 15:26 |
| mnasiadka | ah right, cinder-manage to reassign | 15:26 |
| yoctozepto | yup, and check whether it works 100% happily or not | 15:26 |
| yoctozepto | but that's the next step | 15:26 |
| yoctozepto | the other issue is | 15:26 |
| yoctozepto | 2) what about drivers that do not support active-active? | 15:26 |
| yoctozepto | what do we know about them? | 15:26 |
| yoctozepto | are they happy when we just slap coordination and "cluster" all around | 15:27 |
| yoctozepto | do note "cluster" is per cinder-volume daemon, not backend/driver | 15:27 |
| yoctozepto | (same coordination) | 15:27 |
| mgoddard | generally, AFAIU, most drivers do not support active/active | 15:27 |
| yoctozepto | do note also we were always doing it likely wrong due to no proper active-passice | 15:27 |
| yoctozepto | passive* | 15:27 |
| yoctozepto | mgoddard: yes | 15:27 |
| yoctozepto | so the other issue actually boils down we don't have proper active-passive | 15:28 |
| yoctozepto | though users never complained :-) | 15:28 |
| eliaswimmer | https://bugs.launchpad.net/kolla-ansible/+bug/1905542 same here for manila | 15:28 |
| openstack | Launchpad bug 1905542 in kolla-ansible "Manila ceph configuration won't work in HA mode" [Undecided,New] | 15:28 |
| yoctozepto | or cinder is good enough 99% of the time | 15:28 |
| yoctozepto | eliaswimmer: good point; I have confirmed our redis coordination should be fine so it is a similar matter for manila | 15:30 |
| mnasiadka | yoctozepto: we never had proper active/passive, so we need a word in the docs we only support active/active | 15:31 |
| yoctozepto | mnasiadka: sure, that's precisely my point for now | 15:32 |
| mnasiadka | good work :) | 15:34 |
| mgoddard | +1 | 15:34 |
| mgoddard | so, plan? | 15:34 |
| mgoddard | start with setting cluster | 15:34 |
| mgoddard | document coordination | 15:35 |
| yoctozepto | thanks :-) | 15:35 |
| mgoddard | then fiddle with backend_host? | 15:35 |
| yoctozepto | yes, let me write that down somewhere | 15:35 |
| yoctozepto | in the whiteboard | 15:35 |
| mgoddard | ok | 15:35 |
| mgoddard | will you be working on it yoctozepto? | 15:36 |
| mnasiadka | about coordination, I remember we test only redis as backend in the CI? | 15:36 |
| yoctozepto | mgoddard: yes | 15:36 |
| mgoddard | great | 15:36 |
| yoctozepto | mnasiadka: we don't at all | 15:36 |
| yoctozepto | mnasiadka: I am starting this | 15:36 |
| yoctozepto | well, started, as WIP | 15:36 |
| mnasiadka | ok, but redis should be less flakey, etcd will surely give us some headaches on slow disk setups | 15:36 |
| yoctozepto | etcd is not HA | 15:36 |
| mgoddard | we should fix that | 15:37 |
| yoctozepto | needs some serious love | 15:37 |
| mnasiadka | ok, I'll add it to my list | 15:37 |
| yoctozepto | etcd3gw also needs love | 15:37 |
| yoctozepto | I am a "core" in there as well | 15:37 |
| mgoddard | ok, let's keep going | 15:37 |
| yoctozepto | ok, I'll write it down for you to see | 15:37 |
| mgoddard | thanks | 15:37 |
| mgoddard | #topic CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html | 15:37 |
| *** openstack changes topic to "CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html (Meeting topic: kolla)" | 15:37 | |
| mgoddard | Do we have much more to say about this? | 15:38 |
| yoctozepto | kill it with fireeeeeeeeeeeeee | 15:38 |
| yoctozepto | nothing for now | 15:38 |
| mnasiadka | deprecate centos :) | 15:38 |
| mgoddard | ok, will remove from agenda | 15:38 |
| yoctozepto | I have not checked the "free rhel" news | 15:38 |
| mgoddard | #topic PTG actions | 15:38 |
| *** openstack changes topic to "PTG actions (Meeting topic: kolla)" | 15:38 | |
| *** ricolin has quit IRC | 15:38 | |
| mnasiadka | yoctozepto had a change for testing bootstrap/deploy with Stream, and we can't really do anything more now. | 15:39 |
| mgoddard | #link https://etherpad.opendev.org/p/kolla-wallaby-ptg | 15:39 |
| yoctozepto | [this is regarding Wallaby] | 15:39 |
| mgoddard | L1006 | 15:39 |
| yoctozepto | does not smell like me | 15:39 |
| mnasiadka | I would rather ask why we need to justify not using k8s? | 15:40 |
| mgoddard | I don't think any more TODOs have been done | 15:40 |
| mnasiadka | if somebody wants to use k8s, let him go to openstack-helm | 15:40 |
| yoctozepto | mnasiadka: but we should just summarise why it | 15:40 |
| yoctozepto | is docker | 15:40 |
| mnasiadka | well, let's support podman, and then we don't have to justify | 15:41 |
| yoctozepto | perhaps a simple faq | 15:41 |
| yoctozepto | duh, then you still justify but two | 15:41 |
| mgoddard | #topic Guidance on non-uniform features: https://review.opendev.org/c/openstack/kolla/+/759855 | 15:41 |
| *** openstack changes topic to "Guidance on non-uniform features: https://review.opendev.org/c/openstack/kolla/+/759855 (Meeting topic: kolla)" | 15:41 | |
| yoctozepto | mgoddard, our hero, ended this pointless discussion | 15:41 |
| yoctozepto | I have added this particular point | 15:42 |
| yoctozepto | so it's kevko's proposal | 15:42 |
| mgoddard | arguing over TODOs that will never get done :D | 15:42 |
| yoctozepto | I added it before it turned out to be problematic | 15:42 |
| yoctozepto | mgoddard: precisely! :D | 15:42 |
| yoctozepto | problematic for other reasons | 15:42 |
| yoctozepto | (fluent lagging behind u-c deps) | 15:42 |
| yoctozepto | but anyhow, what's our stance on such features | 15:43 |
| mgoddard | I'm going to go with 'it depends' | 15:43 |
| yoctozepto | thank you, that explains everything | 15:43 |
| yoctozepto | i.e. as soon as one secures +2 before any -2 | 15:43 |
| yoctozepto | 2 +2 * | 15:43 |
| mgoddard | for small features, or non-core projects, non-uniformity is ok | 15:44 |
| mgoddard | for core parts of kolla (which arguably this would be), I would strongly prefer to have broad support | 15:44 |
| yoctozepto | well, we have non-uniformity at very high level with entire projects from binary | 15:44 |
| yoctozepto | hmm, but still, this is something optional | 15:45 |
| yoctozepto | but nice to have | 15:45 |
| yoctozepto | otoh, this particular does not look well-loved upstream nor downstream | 15:45 |
| mgoddard | it also depends on the reason | 15:47 |
| mgoddard | if it is a fundamental limitation, that is easier to accept | 15:47 |
| yoctozepto | mgoddard: current parsing is fugly | 15:47 |
| yoctozepto | this is the "right way" | 15:47 |
| *** ricolin has joined #openstack-kolla | 15:47 | |
| yoctozepto | but seemingly not popular enough still | 15:47 |
| mgoddard | I mean the reason for non-uniformity | 15:47 |
| yoctozepto | ah | 15:48 |
| mgoddard | if it's the right way, shouldn't we support it everywhere if possible? | 15:48 |
| mnasiadka | well, for now there's nothing to talk about really - the ,,tool'' is using too old msgpack | 15:48 |
| yoctozepto | well, this here is low popularity and lack of packaging | 15:48 |
| mnasiadka | to be included anywhere | 15:48 |
| yoctozepto | mnasiadka: indeed | 15:48 |
| mnasiadka | once this is fixed, it needs to be packaged properly | 15:48 |
| yoctozepto | kevko is checking whether this is only superficial | 15:48 |
| mnasiadka | and then we can merge it | 15:48 |
| yoctozepto | will be hard for ubuntu | 15:49 |
| yoctozepto | or perhaps it is packaged but by uca? | 15:49 |
| yoctozepto | I have not checked | 15:49 |
| yoctozepto | though I doubt it | 15:49 |
| mnasiadka | yoctozepto: that's the reason for pinning - https://github.com/fluent/fluent-logger-python/issues/157 | 15:49 |
| mgoddard | sounds like we have a few unknowns to work through | 15:49 |
| mnasiadka | so it's not trivial | 15:49 |
| mgoddard | let's move on and come back to it | 15:49 |
| yoctozepto | it's not | 15:49 |
| yoctozepto | mnasiadka: "short term solution" | 15:50 |
| mgoddard | #topic Kayobe operator feedback from Tu Wien | 15:50 |
| *** openstack changes topic to "Kayobe operator feedback from Tu Wien (Meeting topic: kolla)" | 15:50 | |
| mgoddard | eliaswimmer: hi | 15:50 |
| eliaswimmer | hi | 15:51 |
| eliaswimmer | there is not so much to say | 15:51 |
| mgoddard | Thanks for agreeing to share your feedback | 15:51 |
| eliaswimmer | one thing is the manila active active setup I am using | 15:51 |
| eliaswimmer | the other thing is centos :) | 15:52 |
| eliaswimmer | but for now we will wait I guess | 15:52 |
| eliaswimmer | some things I would like to see is networkmanager support, but maybe this is just a kayobe issue | 15:52 |
| eliaswimmer | and disabling firewalld is also quite annoying, as I have a system that is partly exposed to the public | 15:54 |
| mgoddard | ok, let's work through it | 15:55 |
| eliaswimmer | Ah and also for kayobe, I would like to see kolla on kolla :) | 15:55 |
| mgoddard | manila active/active issue is https://bugs.launchpad.net/kolla-ansible/+bug/1905542 ? | 15:55 |
| openstack | Launchpad bug 1905542 in kolla-ansible "Manila ceph configuration won't work in HA mode" [Undecided,New] | 15:55 |
| yoctozepto | redis coordination should work in here as well, just need to try | 15:55 |
| yoctozepto | no idea about other manila bolts for it | 15:55 |
| mgoddard | have you tried either of the suggestions in the bug report - configure coordination and use separate Ceph keys? | 15:56 |
| openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Fix dpdk deploy failed https://review.opendev.org/c/openstack/kolla-ansible/+/770506 | 15:56 |
| yoctozepto | I just know that when I repeat "manila" a few times here, then manila angels fall from heavens and pick up questions | 15:56 |
| mnasiadka | tbarron is the Manila angel usually ;) | 15:56 |
| eliaswimmer | mgoddard: not yet | 15:57 |
| mgoddard | ok. Would be interesting to hear if it works, especially just coordination which doesn't require code changes | 15:57 |
| eliaswimmer | It was just before xmas when I stumbled upon it | 15:58 |
| eliaswimmer | ok, I will try it and report my results | 15:58 |
| tbarron | yoctozepto: beelzebub | 15:58 |
| mgoddard | talking to the manila folks would be a good idea | 15:58 |
| mgoddard | as if by magic | 15:58 |
| mgoddard | tbarron: we are discussing https://bugs.launchpad.net/kolla-ansible/+bug/1905542 | 15:59 |
| openstack | Launchpad bug 1905542 in kolla-ansible "Manila ceph configuration won't work in HA mode" [Undecided,New] | 15:59 |
| yoctozepto | tbarron: sorry, there is already an anime with that title: https://en.wikipedia.org/wiki/Beelzebub_(manga) try again | 15:59 |
| yoctozepto | :D | 15:59 |
| mgoddard | ok, out of time for the meeting. We can continue to discuss kayobe feedback if you have time eliaswimmer | 16:01 |
| mgoddard | Thanks all! | 16:01 |
| mgoddard | #endmeeting | 16:01 |
| *** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:01 | |
| openstack | Meeting ended Wed Jan 13 16:01:22 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-13-15.01.html | 16:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-13-15.01.txt | 16:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-13-15.01.log.html | 16:01 |
| yoctozepto | thanks mgoddard | 16:01 |
| eliaswimmer | thank you | 16:01 |
| tbarron | Any chance you guys can bring this issue to the manila weekly meeting tomorrow at 1500UTC in #openstack-meeting-alt | 16:02 |
| tbarron | ? | 16:02 |
| tbarron | manila-share is not currently supported for active-active thought it is a recognized goal | 16:03 |
| yoctozepto | uh-oh, more reason to go with active-passive | 16:03 |
| tbarron | we do have coordination integration but not all locks have been converted to tooz and we don't really have | 16:03 |
| yoctozepto | mgoddard: expanding my hacluster role to support this could make sense | 16:04 |
| tbarron | testing with tooz using etcd or whatever instead of file | 16:04 |
| yoctozepto | but it's a big chunk of work likely to get this all right | 16:04 |
| mgoddard | ugh pacemaker | 16:04 |
| tbarron | kolla-ansible may be an env where this could be enabled and we could make joint progress | 16:04 |
| yoctozepto | tbarron: `file` does not really coordinate between hosts :D | 16:04 |
| yoctozepto | tbarron: yeah, I agree | 16:04 |
| yoctozepto | we already support in-progress changes and stuff | 16:05 |
| tbarron | yoctozepto: correct, but it"s a tooz backend, so I'm pointing that there are two stages | 16:05 |
| tbarron | convert plain file locks to tooz | 16:05 |
| yoctozepto | yup, the fact that you are doing tooz right :-) | 16:05 |
| tbarron | use a back end for tooz that tryuly coordinates | 16:05 |
| tbarron | truly | 16:05 |
| tbarron | across nodes | 16:05 |
| yoctozepto | ++ | 16:05 |
| yoctozepto | agree completely | 16:06 |
| tbarron | manila folks like me have employment associations that mean we focus on active/passive/pacemakser (tripleo) | 16:06 |
| tbarron | this is not a theoretical position, just a reality of our time budgets | 16:06 |
| tbarron | so we welcome progress on active/active without any pacemaker machinery | 16:07 |
| yoctozepto | tbarron: that's understandable | 16:07 |
| tbarron | Anyways, I can add this item to our weekly meeting agenda this week, or next, whatever if any of you wnat to attend and discuss it. | 16:08 |
| tbarron | There are some other aspects than the locking that we also need to fix. | 16:09 |
| tbarron | Example: periodic tasks, probably need to elect a leader and keep some state so that if they are interruped we | 16:10 |
| tbarron | can handle appropriately. | 16:10 |
| yoctozepto | mgoddard, eliaswimmer: you probably want to ^ | 16:11 |
| yoctozepto | "tomorrow at 1500UTC in #openstack-meeting-alt" | 16:12 |
| mgoddard | tbarron: tbh, I'm unlikely to have time to work on the manila side, but if it's helpful to discuss the issue I can attend | 16:13 |
| tbarron | mgoddard: yoctozepto eliaswimmer I think it would be helpful to have kolla-ansible folks tell the manila people stuff like | 16:14 |
| tbarron | 1) where manila support is in kolla-ansible | 16:14 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: DNM: testing mirror revert https://review.opendev.org/c/openstack/kolla/+/770093 | 16:14 |
| tbarron | 2) the back ends you care about, and why | 16:15 |
| tbarron | 3) active-active vs active-passive in kolla-ansible | 16:15 |
| *** e0ne has quit IRC | 16:15 | |
| tbarron | for #3, how does it play out for k-a if manila-share still needs to run active-passive | 16:16 |
| eliaswimmer | I will try to attend, but I am just a manila novice | 16:16 |
| mgoddard | tbarron: sure, happy to attend and go through that | 16:16 |
| tbarron | I'd imagine a conversation like that for the meeting, on the record, rather than specific action plan at this point to drive active-active manila-share | 16:17 |
| tbarron | eliaswimmer: mgoddard Excellent. | 16:17 |
| tbarron | I really don"t want manila to be overly shaped by the needs of any single deploymenht tool. Ideally we'd | 16:17 |
| tbarron | be answering to all of tripleo, k-a, osa, etc | 16:18 |
| eliaswimmer | mgoddard: maybe we find a better time to discuss a few kayobe things, right now I am quite busy with other stuff and I have to find time to get my test system installed. Then I will have refreshed everything that is bothering me :) | 16:18 |
| mgoddard | eliaswimmer: sure. Thanks for your time, feel free to add it to a future agenda or discuss elsewhere | 16:20 |
| mgoddard | Thanks for your help tbarron | 16:20 |
| eliaswimmer | tbarron: tomorrow 15:00 UTC? I will be there | 16:20 |
| tbarron | eliaswimmer: mgoddard https://wiki.openstack.org/wiki/Manila/Meetings#Next_meeting | 16:25 |
| tbarron | ^^ Feel free to edit | 16:25 |
| tbarron | but I added a slot | 16:25 |
| tbarron | 1500 UTC #openstack-meeting-alt | 16:25 |
| *** ysirndjuro has joined #openstack-kolla | 16:35 | |
| *** mchlumsky8 has joined #openstack-kolla | 16:41 | |
| *** mchlumsky has quit IRC | 16:42 | |
| *** mchlumsky8 is now known as mchlumsky | 16:42 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Support multiple environments from a single configuration https://review.opendev.org/c/openstack/kayobe/+/734867 | 16:51 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe-config master: Support specifying a Kayobe environment to use https://review.opendev.org/c/openstack/kayobe-config/+/770558 | 16:58 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Upgrade pip and friends in source images https://review.opendev.org/c/openstack/kolla/+/770647 | 17:05 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Add fluent-logger to images - source, binary-debian https://review.opendev.org/c/openstack/kolla/+/759855 | 17:07 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Upgrade pip and friends in source images https://review.opendev.org/c/openstack/kolla/+/770647 | 17:08 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Add fluent-logger to images - source, binary-debian https://review.opendev.org/c/openstack/kolla/+/759855 | 17:09 |
| *** e0ne has joined #openstack-kolla | 17:11 | |
| *** maharg101 has quit IRC | 17:31 | |
| *** bengates has quit IRC | 17:34 | |
| openstackgerrit | Merged openstack/kayobe-config stable/ussuri: Synchronise with kayobe for Ussuri https://review.opendev.org/c/openstack/kayobe-config/+/762843 | 17:57 |
| *** rpittau is now known as rpittau|afk | 18:05 | |
| *** andrewbonney has quit IRC | 18:12 | |
| *** bengates has joined #openstack-kolla | 18:16 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 18:17 |
| *** bengates has quit IRC | 18:19 | |
| *** bengates has joined #openstack-kolla | 18:20 | |
| *** bengates has quit IRC | 18:33 | |
| *** e0ne has quit IRC | 18:39 | |
| yoctozepto | kevko: nice progress; I left some comments that need attention but that is what I had in mind, thanks for handling | 18:44 |
| kevko | :) | 18:44 |
| *** iniazi_ has quit IRC | 18:49 | |
| kevko | yoctozepto: i'm checking .. | 18:52 |
| kevko | looks like i can fix it very quickly | 18:52 |
| kevko | or let's say quickly :) | 18:52 |
| *** gfidente is now known as gfidente|afk | 18:52 | |
| yoctozepto | kevko: take your time, it is no time trial :-) | 18:53 |
| *** iniazi has joined #openstack-kolla | 18:54 | |
| kevko | yoctozepto: i know, but i like to do it :) , and secondly ..we have it tested and going to deliver to customer (on ussuri) ..so i want to have our local changes as close as it can be in master | 18:54 |
| kevko | and i'm nervous if I spent time with something and it is laying in a queue :/ | 18:55 |
| kevko | lieing | 18:55 |
| kevko | yoctozepto: enable_loadbalancer: "{{ enable_haproxy | bool }}" << | 18:57 |
| kevko | yoctozepto: do you mean enable_loadbalancer: {{ True or enable_haproxy and enable_keepalived }} ? | 18:58 |
| kevko | oh, better readed ..now I understand | 18:59 |
| yoctozepto | enable_haproxy or enable_keepalived | 19:09 |
| yoctozepto | ;-) | 19:09 |
| kevko | but, is it really what we want ? | 19:21 |
| kevko | i think haproxy without keepalived doesn't make much sense | 19:22 |
| kevko | and vice versa | 19:22 |
| *** maharg101 has joined #openstack-kolla | 19:28 | |
| *** maharg101 has quit IRC | 19:32 | |
| yoctozepto | kevko: haproxy without keepalived is when folks loadbalance elsewhere | 20:19 |
| *** Underknowledge has joined #openstack-kolla | 20:45 | |
| *** cah_link has quit IRC | 20:48 | |
| *** adeberg has quit IRC | 20:53 | |
| *** e0ne has joined #openstack-kolla | 21:00 | |
| kevko | yoctozepto: makes sense | 21:00 |
| kevko | still here ? | 21:01 |
| *** e0ne has quit IRC | 21:01 | |
| yoctozepto | yes, but in bed | 21:05 |
| kevko | :D , ah ok .. it looks like test are not working if i depends-on on change where image is built ... in log i see it was built ..but not available on localhost repo with change TAG .. | 21:08 |
| kevko | goog night :) | 21:08 |
| yoctozepto | you need to add it on the kolla-ansible side to images being built for that particular scenario | 21:09 |
| yoctozepto | look in tests/ | 21:09 |
| yoctozepto | and sleep more | 21:09 |
| yoctozepto | good night! | 21:09 |
| kevko | :) | 21:10 |
| openstackgerrit | Merged openstack/kolla stable/victoria: Add a storm-base image https://review.opendev.org/c/openstack/kolla/+/770514 | 21:21 |
| *** vishalmanchanda has quit IRC | 21:41 | |
| *** TrevorV has quit IRC | 21:50 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Rename role haproxy to loadbalancer https://review.opendev.org/c/openstack/kolla-ansible/+/770618 | 22:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 22:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 22:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 22:55 |
| *** brinzhang_ has joined #openstack-kolla | 23:02 | |
| *** brinzhang has quit IRC | 23:05 | |
| *** kevko has quit IRC | 23:27 | |
| *** maharg101 has joined #openstack-kolla | 23:29 | |
| *** maharg101 has quit IRC | 23:34 | |
| *** kevko has joined #openstack-kolla | 23:35 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!