Wednesday, 2021-01-27

« Tuesday, 2021-01-26 Index Thursday, 2021-01-28 »
*** LinPeiWen has joined #openstack-kolla00:41
openstackgerritZhouHeng proposed openstack/kolla-ansible master: Replace db-sock with db-nb-sock and db-sb-sock  https://review.opendev.org/c/openstack/kolla-ansible/+/77159400:51
*** risson has joined #openstack-kolla01:29
*** k_mouza has joined #openstack-kolla01:30
*** k_mouza has quit IRC01:34
openstackgerritKevin Zhao proposed openstack/kolla stable/ussuri: [DNM] add rbd-iscsi-client as a dependencies  https://review.opendev.org/c/openstack/kolla/+/77261501:56
*** xinliang has joined #openstack-kolla02:03
*** k_mouza has joined #openstack-kolla02:10
*** k_mouza has quit IRC02:15
*** k_mouza has joined #openstack-kolla03:04
*** k_mouza has quit IRC03:09
*** k_mouza has joined #openstack-kolla03:23
*** k_mouza has quit IRC03:28
*** skramaja has joined #openstack-kolla03:51
*** iniazi_ has joined #openstack-kolla03:59
*** iniazi has quit IRC04:01
*** logan- has quit IRC04:08
*** PrinzElvis has quit IRC04:08
*** ricolin has quit IRC04:11
*** mgoddard has quit IRC04:11
*** mgoddard has joined #openstack-kolla04:14
*** PrinzElvis has joined #openstack-kolla04:14
*** logan- has joined #openstack-kolla04:33
*** logan- has quit IRC04:36
*** xinliang has quit IRC04:36
*** logan- has joined #openstack-kolla04:38
*** vishalmanchanda has joined #openstack-kolla04:41
*** ysirndjuro has quit IRC04:44
*** logan- has quit IRC04:54
*** logan- has joined #openstack-kolla04:57
*** k_mouza has joined #openstack-kolla05:21
*** k_mouza has quit IRC05:26
*** ivan_lin has quit IRC05:42
*** ivan_lin has joined #openstack-kolla05:43
*** k_mouza has joined #openstack-kolla05:57
*** k_mouza has quit IRC06:01
*** nikparasyr has joined #openstack-kolla06:07
*** cah_link has joined #openstack-kolla06:10
*** k_mouza has joined #openstack-kolla06:29
*** k_mouza has quit IRC06:33
*** murphyslawbbs has quit IRC06:35
*** xinliang has joined #openstack-kolla07:03
*** e0ne has joined #openstack-kolla07:03
yoctozeptomorning koalas07:12
*** LinPeiWen has quit IRC07:19
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Edit services roles to support database sharding  https://review.opendev.org/c/openstack/kolla-ansible/+/77021607:25
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [CI] Enable proxysql test  https://review.opendev.org/c/openstack/kolla-ansible/+/77062107:25
*** e0ne has quit IRC07:30
*** cah_link has quit IRC07:38
*** cah_link has joined #openstack-kolla08:01
*** andrewbonney has joined #openstack-kolla08:08
*** strobert has quit IRC08:16
*** jonaspaulo has joined #openstack-kolla08:17
*** jbadiapa has joined #openstack-kolla08:27
*** e0ne has joined #openstack-kolla08:27
*** rpittau|afk is now known as rpittau08:30
*** bengates has joined #openstack-kolla08:32
*** maharg101 has joined #openstack-kolla08:41
*** yoctozepto5 has joined #openstack-kolla08:47
*** yoctozepto has quit IRC08:48
*** yoctozepto5 is now known as yoctozepto08:48
*** bengates has quit IRC09:00
*** bengates has joined #openstack-kolla09:00
*** vishalmanchanda has quit IRC09:00
*** bengates has quit IRC09:02
*** bengates has joined #openstack-kolla09:03
*** gfidente|afk is now known as gfidente09:04
*** bengates_ has joined #openstack-kolla09:05
*** kevko has joined #openstack-kolla09:05
kevkomorning09:06
*** bengates has quit IRC09:07
kevkoyoctozepto: was checking jobs at night :)09:08
*** xinliang has quit IRC09:12
kevkoyoctozepto: here ?09:13
*** xinliang has joined #openstack-kolla09:16
yoctozeptokevko: here09:20
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Fix Python setup when venv is not used  https://review.opendev.org/c/openstack/kayobe/+/76451109:20
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Fix /tmp/swift-rings/backups/ files deletion  https://review.opendev.org/c/openstack/kayobe/+/77192809:21
kevkoyoctozepto: tests failed .. you don't have rendered config in proxysql for shard user ..09:31
kevkoyoctozepto: and i've leaved a comment few seconds ago ... curious if it could be done by different way09:31
openstackgerritMark Goddard proposed openstack/kolla stable/stein: CI: Use Docker proxy for pulls + Ruby fixes + get_pip  https://review.opendev.org/c/openstack/kolla/+/77249009:32
kevkoyoctozepto: ok, i know why you failed tests ... you changed shard root user from shard_x to root_shard_x ..09:40
kevkoyoctozepto: but didn't changed in os services defaults09:40
kevkoexample : aodh_database_shard_root_user: "{% if enable_proxysql | bool %}shard_{{ aodh_database_shard_id }}{% else %}{{ database_user }}{% endif %}"09:40
yoctozeptokevko: yeas, as well as the default id09:41
yoctozeptoI need to adapt both now09:41
yoctozeptopossibly refactoring the prefix09:41
yoctozeptoto have some sanity09:41
kevkoyoctozepto: really ? i see 0 in https://review.opendev.org/c/openstack/kolla-ansible/+/770216/22/ansible/group_vars/all.yml09:41
*** iniazi has joined #openstack-kolla09:43
kevkoyoctozepto: can we then add some test which is also testing two shards ? and maybe two services splitted to shards ?09:43
*** iniazi_ has quit IRC09:45
*** bengates_ has quit IRC09:45
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: CI: octavia: create and test a load balancer  https://review.opendev.org/c/openstack/kolla-ansible/+/75428509:46
*** bengates has joined #openstack-kolla09:46
yoctozeptokevko: I have updated the patch today :D09:46
yoctozeptobut missed the prefix09:46
yoctozeptoif you have some time, please patch it09:47
yoctozeptoI'm a little busy now09:47
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: CI: octavia: create and test a load balancer  https://review.opendev.org/c/openstack/kolla-ansible/+/75428509:49
kevkoyoctozepto: will try, If will have some time ..09:50
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: CI: octavia: create and test a load balancer  https://review.opendev.org/c/openstack/kolla-ansible/+/75428509:52
*** kevko has quit IRC09:55
*** e0ne has quit IRC09:56
*** bengates has quit IRC09:57
*** bengates has joined #openstack-kolla10:00
openstackgerritPierre Riteau proposed openstack/kayobe master: Adapt to changes from the Bifrost Victoria release  https://review.opendev.org/c/openstack/kayobe/+/77260710:01
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Replace db-sock with db-nb-sock and db-sb-sock  https://review.opendev.org/c/openstack/kolla-ansible/+/77159410:04
*** bengates has quit IRC10:10
*** bengates has joined #openstack-kolla10:11
*** bengates has quit IRC10:14
*** bengates has joined #openstack-kolla10:15
*** bengates_ has joined #openstack-kolla10:16
*** bengates has quit IRC10:19
*** vishalmanchanda has joined #openstack-kolla10:28
openstackgerritMichal Nasiadka proposed openstack/kolla master: Add octavia-driver-agent  https://review.opendev.org/c/openstack/kolla/+/77119110:33
*** LinPeiWen has joined #openstack-kolla10:35
openstackgerritCarsten Koester proposed openstack/kolla-ansible master: Add IPv6 configuration options to Octavia management network  https://review.opendev.org/c/openstack/kolla-ansible/+/77264710:40
*** bengates_ has quit IRC10:46
*** bengates has joined #openstack-kolla10:47
*** k_mouza has joined #openstack-kolla10:54
*** yoctozepto5 has joined #openstack-kolla11:01
*** kevko has joined #openstack-kolla11:01
*** yoctozepto has quit IRC11:02
*** yoctozepto5 is now known as yoctozepto11:02
*** kevko_ has joined #openstack-kolla11:03
*** kevko has quit IRC11:04
*** xinliang has quit IRC11:06
mgoddardhrw: I removed MERGED from Allowed to fail images on the whiteboard11:16
mgoddardhrw: we have the option but it won't make any improvement until we use it :)11:17
*** xinliang has joined #openstack-kolla11:17
mgoddardhrw: it would be good to have some way to find out when images break, too. Right now, it allows merging a patch that breaks an 'allowed' to fail image11:18
hrwmgoddard: without checking build log?11:23
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding  https://review.opendev.org/c/openstack/kolla-ansible/+/77021611:29
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: [CI] Enable proxysql test  https://review.opendev.org/c/openstack/kolla-ansible/+/77062111:36
*** ricolin has joined #openstack-kolla11:55
*** xinliang has quit IRC11:56
*** ivan_lin has quit IRC12:04
*** ivan_lin has joined #openstack-kolla12:05
*** ivan_lin has quit IRC12:06
*** ivan_lin has joined #openstack-kolla12:06
yoctozeptomgoddard, hrw: perhaps we could submit the job results somewhere?12:08
yoctozeptoand have it in the stats?12:08
mgoddardhrw: you check every build log?12:09
mgoddardI think the problem is that we can't distinguish between new failures and expected failures12:09
mgoddardso maybe we need to keep the list empty, then add to it when we have failures12:10
hrwmgoddard: no, only failed ones12:11
mgoddardhrw: the job won't fail if an image is allowed to fail12:12
hrwimho the idea was to use it only for things like 'monasca-thresh' which state for me is 'nice if builds but if not then no one (maybe except dougsz) cares'12:12
mgoddardwell if no one cares then we should remove the image12:13
hrwor in other words: some non important image fails and we are not in mood/time to fix it12:13
mgoddardthat is true, but we do need to know that it is failing. If the job passes we never know12:14
mgoddardalso we can't distinguish between new failures and expected failures12:14
openstackgerritPierre Riteau proposed openstack/kayobe master: Remove trailing whitespace  https://review.opendev.org/c/openstack/kayobe/+/77268112:16
*** bengates has quit IRC12:17
*** bengates has joined #openstack-kolla12:18
hrwthat's how CI works12:19
hrwwe can move to 'those have to pass' + 'everything' (non-voting) using profiles12:19
*** wuchunyang has joined #openstack-kolla12:30
kevko_guys, can I check ara "live" somewhere ?12:32
kevko_I don't mean zuul status page -> job -> console , but real ara html while job still running12:33
dmsimardkevko_: there is https://demo.recordsansible.org/?path=kolla-ansible but it's one-off tests12:34
hrwkevko_: would be nice to have but nope12:35
dmsimardfwiw data from demo comes from patches such as https://review.opendev.org/c/openstack/kolla-ansible/+/72090212:37
*** bengates has quit IRC12:44
*** bengates has joined #openstack-kolla12:45
openstackgerritMerged openstack/kayobe stable/train: Fix Python setup when venv is not used  https://review.opendev.org/c/openstack/kayobe/+/76451112:47
*** ricolin has quit IRC12:48
*** ricolin has joined #openstack-kolla13:11
*** bengates has quit IRC13:16
*** chateaulav has joined #openstack-kolla13:17
kevko_yoctozepto: fixed root_shard_N and it looks like it's passing13:18
*** bengates has joined #openstack-kolla13:19
*** wuchunyang has quit IRC13:24
*** wuchunyang has joined #openstack-kolla13:25
*** LinPeiWen has quit IRC13:26
*** yoctozepto2 has joined #openstack-kolla13:27
*** yoctozepto has quit IRC13:28
*** yoctozepto2 is now known as yoctozepto13:28
*** e0ne has joined #openstack-kolla13:35
*** bengates has quit IRC13:42
*** bengates has joined #openstack-kolla13:43
mgoddardhrw: added allowed to fail to todays agenda13:50
*** chateaulav has quit IRC13:54
yoctozeptomgoddard: I have removed the "hot issues" as there are none; the cinder is in the "sit down and do it" state now and nothing to discuss13:54
yoctozeptothis way we should easily fit the other agenda points13:54
mgoddardyoctozepto: thanks. I think we were veering into too much boilerplate territory13:54
yoctozeptomayhaps a bit14:01
*** spotz has joined #openstack-kolla14:03
*** Underknowledge has quit IRC14:12
*** Underknowledge has joined #openstack-kolla14:12
*** yoctozepto8 has joined #openstack-kolla14:14
*** yoctozepto has quit IRC14:15
*** yoctozepto8 is now known as yoctozepto14:15
ozzzohow can I display quota usage on CLI?14:28
openstackgerritPierre Riteau proposed openstack/kayobe master: Update seed VM image to CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/77270014:31
*** yoctozepto0 has joined #openstack-kolla14:41
*** yoctozepto has quit IRC14:41
*** yoctozepto0 is now known as yoctozepto14:41
*** bengates has quit IRC14:54
*** bengates has joined #openstack-kolla14:55
*** irclogbot_0 has quit IRC14:55
mgoddardmeeting in 2 minutes14:58
*** irclogbot_3 has joined #openstack-kolla14:58
mgoddard^ mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak14:59
mgoddard#startmeeting kolla15:00
openstackMeeting started Wed Jan 27 15:00:16 2021 UTC and is due to finish in 60 minutes.  The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: kolla)"15:00
openstackThe meeting name has been set to 'kolla'15:00
mgoddard#topic rollcall15:00
*** openstack changes topic to "rollcall (Meeting topic: kolla)"15:00
mgoddard\o15:00
wuchunyang\o15:00
osmanlicilegio/15:00
hrw[o]15:00
yoctozepto /o\15:03
mnasiadkao/15:03
mgoddard#topic agenda15:04
*** openstack changes topic to "agenda (Meeting topic: kolla)"15:04
mgoddard* Roll-call15:04
mgoddard* Announcements15:04
mgoddard* Review action items from the last meeting15:05
mgoddard* CI status15:05
mgoddard* Cleaning up disabled components and services (e.g. monasca/storm) https://review.opendev.org/c/openstack/kolla-ansible/+/76990015:05
mgoddard* Allowed to fail images - next steps https://review.opendev.org/c/openstack/kolla/+/76580715:05
mgoddard* Wallaby release planning15:05
mgoddard#topic announcements15:05
*** openstack changes topic to "announcements (Meeting topic: kolla)"15:05
mgoddardI have none. Anyone else?15:05
mgoddard#topic Review action items from the last meeting15:06
*** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)"15:06
mgoddardThere were none15:06
mgoddard#topic CI status15:06
*** openstack changes topic to "CI status (Meeting topic: kolla)"15:06
mgoddardHow are we looking?15:06
mgoddardWe've had some issues with train, let's start there15:07
yoctozeptogood15:07
yoctozeptoeverything works15:07
mgoddardgreat. Thanks to those involved in rescuing it15:08
mgoddardStein has some issues15:08
mgoddardhttps://review.opendev.org/c/openstack/kolla-ansible/+/77250115:08
mgoddardhttps://review.opendev.org/c/openstack/kolla/+/77249015:08
mgoddardThose two should address them15:08
mgoddardoptional: propose CI Slim Down in K-A (T-W)15:09
mgoddardremove l-c jobs in K-A U, V & W (as agreed; already dropped in older)15:09
mgoddardlet's either do those or remove them from the board15:10
yoctozeptodo these15:10
mgoddardI guess I'm undecided on the slim down15:11
mgoddardhas anyone actually run 'check experimental' in kolla since we removed the jobs?15:12
yoctozeptoI15:12
yoctozeptoonce15:12
yoctozeptoI'd prefer we make CI work better15:12
yoctozeptobut we can't easily15:12
mgoddardwork better how?15:12
mnasiadkaI honestly don't think anybody will use check experimental15:14
mnasiadkaSo, if we could have a list of problematic jobs, and vote on what to do with them - would probably be better15:15
mgoddardmost people don't know about it, and those who do are likely to forget15:15
mgoddardit seems like a reasonable trade-off for kolla, but not so sure about k-a15:15
mgoddardmaybe we should have only one of each scenario15:16
mgoddardand put the other in experimental15:16
yoctozeptomgoddard: as in dockerhub not failing15:16
yoctozeptoand no disk_full15:16
yoctozeptoand no timeout15:16
yoctozeptoand no multiple retries15:16
yoctozeptowe got ourselves a ton of jobs15:17
yoctozeptoI liked adding them15:17
yoctozeptobut I don't like waiting for them nowadays :D15:17
* yoctozepto practicing self-blame15:17
mnasiadkawell, I prefer to wait for them, instead of write check experimental and wait for them to fail :)15:17
mgoddard+115:18
mgoddardwe do have various things that make CI unreliable, but it does seem workable at the moment15:18
mnasiadkaI would rather keep a list of jobs that need to be looked into, if there's no interest - we can decide to remove them, or just disable them.15:19
mgoddardor combine them15:19
yoctozepto+115:19
yoctozeptolet's not overwork ourselves for the moment15:20
yoctozeptoremove the point on slim down15:20
mgoddardok15:20
yoctozeptoand we will reconsider our options when it gets worse15:20
yoctozeptokolla has it already15:20
yoctozeptoit sounds like a reasonable tradeoff15:20
mnasiadkaI know the ceph jobs are failing often, but I plan to move to use cephadm, and then investigate failures if they happen.15:20
yoctozeptoyeah, cephadm should help a bit; ceph-ansible is quite quirky15:21
mgoddardare there legit ceph failures we should look into?15:21
yoctozeptoor perhaps we should just spin ceph manually for our simple scenario15:21
yoctozeptoit's a no-brainer xD15:21
yoctozeptomgoddard: I don't think so15:22
yoctozeptoit's just feels worse than before15:22
mgoddardok15:22
mgoddardlet's move on, tired of CI :)15:22
yoctozeptoperhaps just due to multinode being worse15:22
yoctozeptoindeed!15:22
mgoddard#topic Cleaning up disabled components and services (e.g. monasca/storm) https://review.opendev.org/c/openstack/kolla-ansible/+/76990015:22
*** openstack changes topic to "Cleaning up disabled components and services (e.g. monasca/storm) https://review.opendev.org/c/openstack/kolla-ansible/+/769900 (Meeting topic: kolla)"15:22
* yoctozepto to deprecate everything15:22
mgoddardThis came up while reviewing one of dougsz's patches15:23
mgoddardhttps://review.opendev.org/c/openstack/kolla-ansible/+/76990015:23
hrwmonasca goes out?15:23
mgoddardno15:23
mgoddardbut it's going on a diet :)15:23
mgoddardsome things will be removed15:23
mgoddardand we'll add a flag to allow disabling the alerting pipeline15:24
mgoddardhttps://review.opendev.org/c/openstack/kolla-ansible/+/769902/15:24
mgoddardso...15:24
mgoddardthere are two cases here15:24
mgoddard1. a container is no longer required and should be cleaned up15:24
mgoddard2. a container is disabled based on some feature flag, and should be cleaned up15:25
yoctozeptoah, this general thing15:25
mgoddard1. I think should be done on upgrade15:25
yoctozeptowe should address both at once15:25
mgoddard2. is less clear. I don't really want a bunch of code that cleans up on every deploy15:26
yoctozeptoperhaps treat being disabled as removal?15:26
mgoddardit will be messy and slow15:26
yoctozeptoand have a stub for those removed completely due to new release15:26
yoctozeptohmm15:26
mgoddardthere is also a 3. which I forget15:27
mgoddard3. a service (enable_X) is disabled and should be cleaned up15:27
mgoddard3 is tricky because the site.yml playbook doesn't execute plays for disabled services15:27
mnasiadkawe need undeploy.yml in each role and a separate command to clean up?15:28
mgoddardthat is my preference15:28
mnasiadkathat sounds simplistic and doable in short time15:28
mgoddardright15:28
mgoddardhowever, I think dougsz didn't want to overload his patch15:29
mgoddardso we came to a compromise15:29
mgoddardhe will implement a specific command to clean up the monasca alerting pipeline, which can be adapted into a general cleanup command15:29
mgoddarde.g. kolla-ansible monasca-disable-alerting15:29
mgoddarddoes that seem reasonable?15:30
wuchunyangwhat about kolla-ansible destroy --tags service ?15:30
mgoddard(dougsz is busy right now so can't join in)15:30
mgoddardwuchunyang: I think destroy is subtley different15:30
mgoddarddestroy will clean up everything, regardless of enable flags, etc.15:31
mgoddardcleanup should only destroy things that have been disabled15:31
mnasiadkaand still questionable if it should delete database entries and so on15:32
mgoddardis this making sense?15:32
mgoddardhmm, hadn't considered DB15:32
mgoddardthat would only apply if the whole service is disabled15:32
mgoddardprobably it will evolve some flags15:33
yoctozeptoit's tricky and sounds like a good topic for the next ptg15:33
mgoddard--clean-db --clean-keystone --clean-mq15:33
yoctozeptoas the need grows :D15:33
mnasiadkayeah, but the initial approach with Monasca sounds fine, we need to start somewhere15:33
yoctozepto--yes-i-really-really-want-it-clean15:33
wuchunyangsounds good15:33
mgoddardbut a simple deletion of containers and volumes would be a good start15:34
yoctozeptoyes15:34
mnasiadkajust need to make sure we adapt reno if we change the command name :)15:34
mnasiadka(over time)15:34
mgoddardI think it would be a new command15:34
wuchunyang+ 115:34
mgoddardany other thoughts or shall we progress?15:35
mgoddard#topic Allowed to fail images - next steps https://review.opendev.org/c/openstack/kolla/+/76580715:36
*** openstack changes topic to "Allowed to fail images - next steps https://review.opendev.org/c/openstack/kolla/+/765807 (Meeting topic: kolla)"15:36
mgoddardping hrw15:36
mgoddard#link https://review.opendev.org/c/openstack/kolla/+/76580715:36
hrwpong15:36
mgoddardwe had some discussion about this in IRC earlier15:36
mgoddardthat patch adds an option to kolla to mark some images as being allowed to fail15:37
mgoddardthe next step is to make use of this in our CI15:37
mgoddardsome key requirements for me:15:37
mgoddard* a change that breaks an image must fail CI15:38
mgoddard* ideally we have some visibility if an external change breaks an image15:38
* hrw waits for end of list15:39
mgoddard</end>15:39
hrwok.15:39
hrw1. 'change that breaks an image must fail CI' == what we have by default15:39
hrwallowed-to-fail does not change anything here15:40
hrwthis feature is more for 'omg, xyz image failed again and the only core who understand it is on holidays. let use ignore it for a week with this patch'15:40
mgoddardok15:41
hrwotherwise we would switch to profile builds which can list 'those images we build and they can not fail'15:41
mgoddardI think if we keep the list empty by default it will work15:41
hrw+ non-voting job building everything to check are there images which fail15:41
hrwthat's the plan15:41
hrw(empty list)15:42
mgoddardok15:42
hrw'ideally we have some visibility if an external change breaks an image' == normal CI too15:42
hrwallowed-to-fail is kind of 'one step' before moving to UNBUILDABLE_IMAGES15:43
mgoddardthe original goal was for tiers of images, so I imagined having a static list of tier 3 images15:43
mgoddardin which case they could have started failig silently15:43
mgoddarddefault empty list works for me15:43
mgoddardso perhaps you are right in saying that the feature is complete :)15:44
mgoddardanyone disagree?15:44
mgoddardgreat15:44
hrwwe have 3 levels for images: BUILD, allowed to fail, UNBUILDABLE15:44
hrwwith middle one being for emergencies15:45
mgoddardhrw: could you add a few sentences on that to the contributor docs?15:45
yoctozeptono disagreement15:45
*** murphyslawbbs has joined #openstack-kolla15:45
hrwmgoddard: #action please. will handle15:45
mgoddard#action hrw to document allowed to fail & unbuildable images in contributor docs15:46
mgoddardgood job - nice and simple, should be useful15:46
hrwand 'allowed to fail' is basically CI stuff which can be used by anyone15:46
mgoddardPTL just too stoopid to understand it :D15:47
mgoddard#topic Wallaby release planning15:47
*** openstack changes topic to "Wallaby release planning (Meeting topic: kolla)"15:47
hrwmgoddard: after adding UNBUILDABLE I have a feeling that I understand all those lists. and that's scary15:47
hrw~3 months to release?15:48
mgoddardI don't think we've talked dates yet15:48
hrwApril is usual date ;D15:48
mgoddardI'll add a section to the whiteboard15:48
yoctozepto++15:48
mgoddard#link https://releases.openstack.org/wallaby/schedule.html15:49
hrwI think that infra stuff would be nice. I may take a look and rewrite patches adding funcionality and skip CI changes15:49
mgoddardApr 12 - Apr 1615:49
mgoddard^ is OpenStack Wallaby GA15:50
hrwso 1st April is a day when we should be ready with features, freeze, fix issues and release on 1st May15:50
mgoddardKolla feature freeze: Mar 29 - Apr 0215:51
mgoddardKolla RC1: Apr 12 - Apr 1615:51
mgoddardCentOS 8 stream is a risk15:51
*** murphyslawbbs has quit IRC15:51
mgoddardRDO is targeting stream for wallaby15:51
yoctozeptoit will freeze our blood15:52
yoctozepto:-)15:52
mgoddardjust to reiterate - there are around 2 months until feature freeze15:52
mgoddardnow is the time to get working on features15:53
yoctozeptoonly sad reactions!15:53
hrwif RDO goes stream then so are we.15:53
mgoddard(and reviewing)15:53
yoctozepto:D15:53
*** skramaja has quit IRC15:53
hrwwhich may end in centos:8 -> stream or ubi:8 as a base image15:53
mgoddard7 minutes to go. Shall we look at the release priorities?15:54
hrwgo, quickly15:55
mgoddardthis one is ever present, and never done:15:55
mgoddardHigh level documentation, eg. examples of networking config, diagrams, justification of use of containers, not k8s etc15:55
mgoddardbut if anyone has time for docs, they will be appreciated15:55
mgoddardAbility to run CI jobs locally (without Zuul, but possibly with Ansible)15:55
mgoddardyoctozepto: any progress?15:55
yoctozeptomgoddard: none15:56
mgoddardok15:56
mgoddardSwitch to CentOS 8 stream15:57
mgoddardAnyone want to pick this up?15:57
hrwI may if no one wants15:58
mgoddardok15:58
mgoddardInfra images15:58
mgoddardhrw: you mentioned adding features but skipping CI15:58
mgoddardAFAIR, CI was the blocking part15:58
mgoddardthe CentOS combined job fails15:58
mgoddardso we either need to fix that, or implement the multi-job pipeline15:59
hrwI want to rewrite patches to have functionality for review while waiting for someone with ideas of CI changes16:00
hrwit is quite old patchset so I first have to remind myself how it works16:00
mgoddardI do wonder if the combined job could be made to work with a bit of debugging16:01
mgoddardit could be a disk issue, try removing images after each build16:01
mgoddardanyway, we are over time16:02
mgoddardthanks all16:02
hrwthe good part is that CI changes can be done separately16:02
mgoddard#endmeeting16:02
*** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"16:02
openstackMeeting ended Wed Jan 27 16:02:34 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:02
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-27-15.00.html16:02
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-27-15.00.txt16:02
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-01-27-15.00.log.html16:02
hrwas we already have infra images in kolla16:02
mgoddardthey can, but they still block enabling infra images16:03
hrwso CI steps: base -> binary,source now and later: base -> infra,binary,source16:03
hrwok, I have to go16:03
mgoddardk16:03
hrwcu tomorrow16:03
mgoddard\o16:03
headphoneJamesIf anyone is still around, I have a question about how to build a test case for LetsEncrypt16:04
*** wuchunyang has quit IRC16:06
headphoneJamesTo actually exercise the LE service, we would need to have access to domain names and the DNS to use LE in an automated test.16:07
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Fix Barbican API log config  https://review.opendev.org/c/openstack/kolla-ansible/+/77271516:08
*** bengates has quit IRC16:08
*** bengates has joined #openstack-kolla16:09
yoctozeptoheadphoneJames: does it also apply to the sandbox?16:15
headphoneJamesyoctozepto: I am unfamiliar with the sandbox16:16
*** wuchunyang has joined #openstack-kolla16:19
*** bengates has quit IRC16:19
yoctozeptoheadphoneJames: the internets suggest using https://github.com/letsencrypt/pebble16:19
yoctozepto"Pebble is NOT INTENDED FOR PRODUCTION USE. Pebble is for testing only."16:19
yoctozeptoand that is exactly what we want16:19
*** bengates has joined #openstack-kolla16:21
*** livelace has joined #openstack-kolla16:21
headphoneJamesNot sure if this is what we need - will look at it more closely. I imagine it would be better to mock the LE service than the AMCE one.16:23
kevko_guys, just for curiosity ... have someone solve https://bugs.launchpad.net/keystonemiddleware/+bug/1883659 ?16:23
openstackLaunchpad bug 1883659 in oslo.cache "keystonemiddleware connections to memcached from neutron-server grow beyond configured values" [Undecided,Confirmed]16:23
*** wuchunyang has quit IRC16:24
*** rpittau is now known as rpittau|afk16:24
kevko_this was measured on openstack ussuri (kolla, kolla-asnible)16:25
kevko_while loop -> openstack server list; openstack volume list; openstack token issue ; openstack network list to API16:26
kevko_https://ibb.co/7g2yRGX16:26
kevko_X are while loop cycles ... Y are connections to memcached16:26
kevko_does anyone solve this issue ? somehow  ?16:26
*** e0ne has quit IRC16:27
headphoneJamesyoctozepto: thanks for the link16:27
*** yoctozepto2 has joined #openstack-kolla16:28
*** yoctozepto has quit IRC16:29
*** yoctozepto2 is now known as yoctozepto16:29
mgoddardyoctozepto: would be nice to push on https://review.opendev.org/c/openstack/kolla-ansible/+/74516416:33
mgoddardmaybe pulling out the check-containers.yml -> role refactor first16:37
*** egonzalez has quit IRC16:37
*** PrinzElvis has quit IRC16:37
*** alanmeadows has quit IRC16:37
*** v1k0d3n has quit IRC16:37
*** stackedsax has quit IRC16:37
*** vkmc has quit IRC16:37
*** cz3 has quit IRC16:37
*** vishalmanchanda has quit IRC16:37
*** johnsom has quit IRC16:38
*** bbezak has quit IRC16:38
*** gmann has quit IRC16:38
*** headphoneJames has quit IRC16:38
*** emccormick has quit IRC16:38
*** rpittau|afk has quit IRC16:38
*** andrein has quit IRC16:38
*** mnasiadka has quit IRC16:38
*** sri_ has quit IRC16:38
*** andrewbonney has quit IRC16:38
*** r3ap3r has quit IRC16:38
*** parallax has quit IRC16:38
*** bengates has quit IRC16:38
*** egonzalez has joined #openstack-kolla16:39
*** vkmc has joined #openstack-kolla16:39
*** johnsom has joined #openstack-kolla16:39
*** andrewbonney has joined #openstack-kolla16:39
*** bengates has joined #openstack-kolla16:40
*** gouthamr has quit IRC16:40
*** vishalmanchanda has joined #openstack-kolla16:40
*** bbezak has joined #openstack-kolla16:40
*** emccormick has joined #openstack-kolla16:40
*** rm_work has quit IRC16:40
*** rpittau|afk has joined #openstack-kolla16:40
*** alanmeadows has joined #openstack-kolla16:42
*** stackedsax has joined #openstack-kolla16:42
*** andrein has joined #openstack-kolla16:44
mgoddardyoctozepto: would you agree we only want Letsencrypt for the external API?16:45
*** headphoneJames has joined #openstack-kolla16:45
*** v1k0d3n has joined #openstack-kolla16:45
*** gmann has joined #openstack-kolla16:45
*** sri_ has joined #openstack-kolla16:45
*** parallax has joined #openstack-kolla16:50
*** mnasiadka has joined #openstack-kolla16:50
openstackgerritPierre Riteau proposed openstack/kayobe master: Update seed VM image to CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/77270016:51
*** gouthamr has joined #openstack-kolla16:52
*** gouthamr has quit IRC16:52
*** bengates has quit IRC16:52
*** wuchunyang has joined #openstack-kolla16:53
*** mnasiadka has quit IRC16:55
*** rm_work has joined #openstack-kolla16:55
*** rm_work has quit IRC16:55
*** gouthamr has joined #openstack-kolla16:55
*** parallax has quit IRC16:55
*** gouthamr has quit IRC16:56
*** PrinzElvis has joined #openstack-kolla16:56
*** rm_work has joined #openstack-kolla16:56
*** rm_work has quit IRC16:57
*** parallax has joined #openstack-kolla16:57
*** mnasiadka has joined #openstack-kolla16:57
*** rm_work has joined #openstack-kolla16:57
*** rm_work has quit IRC16:57
*** wuchunyang has quit IRC16:58
*** bengates has joined #openstack-kolla16:58
*** rm_work has joined #openstack-kolla16:58
*** rm_work has quit IRC16:58
*** cz3 has joined #openstack-kolla17:00
*** r3ap3r has joined #openstack-kolla17:00
*** Underknowledge has quit IRC17:04
*** Underknowledge has joined #openstack-kolla17:04
yoctozeptomgoddard: I agree; first step is definitely external only17:08
yoctozeptolet's not attack all fronts17:08
*** gouthamr has joined #openstack-kolla17:08
*** gouthamr has quit IRC17:08
mgoddardyoctozepto: well, would we ever want internal?17:08
mgoddardgiven that it must be publicly accessible17:09
mgoddardthe patch already tries to do internal17:09
*** rm_work has joined #openstack-kolla17:09
*** rm_work has quit IRC17:09
yoctozeptomgoddard: that's the dream of let's encrypt in an ipv6 internet17:09
yoctozeptobut realistically17:09
yoctozeptowe probably want integration with some internal mechanisms17:09
yoctozeptorather than le17:09
yoctozeptomgoddard: re pushing: makes sense17:10
yoctozeptowe also have one other that got reverted17:10
mgoddardI suppose the question is, do we not want internal LE enough to ask headphoneJames to remove it?17:11
yoctozeptomgoddard: no, that's valid if it is possible17:11
yoctozeptohopefully not enforced :P17:12
mgoddardso keep it?17:12
*** rm_work has joined #openstack-kolla17:13
yoctozeptowhy not?17:13
*** rm_work has quit IRC17:13
yoctozeptoI don't mind extra features17:13
*** bengates_ has joined #openstack-kolla17:13
mgoddardI guess it just adds a bit of complexity, and unsure if it will be used17:14
*** bengates has quit IRC17:17
*** r3ap3r has quit IRC17:17
headphoneJamesHappy to go either way :)17:17
*** mnasiadka has quit IRC17:18
*** parallax has quit IRC17:18
*** cz3 has quit IRC17:18
*** bengates_ has quit IRC17:18
yoctozeptothe question is....17:18
yoctozeptohow much complexity?!17:18
*** r3ap3r has joined #openstack-kolla17:18
*** parallax has joined #openstack-kolla17:19
mgoddardsome17:19
mgoddardheadphoneJames: did you look at the --standalone option of certbot?17:20
*** mnasiadka has joined #openstack-kolla17:20
*** stand has joined #openstack-kolla17:20
*** cz3 has joined #openstack-kolla17:21
*** andrewbonney has quit IRC17:21
*** andrewbonney has joined #openstack-kolla17:24
headphoneJamesI believe standalone removes the need for an acme server - certbot will still do a request to the LE service.17:24
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Fix Barbican API log config  https://review.opendev.org/c/openstack/kolla-ansible/+/77271517:25
yoctozeptowhat do you mean by 'acme server'?17:27
*** gouthamr has joined #openstack-kolla17:30
*** gouthamr has quit IRC17:30
*** rm_work has joined #openstack-kolla17:30
*** rm_work has quit IRC17:30
*** gfidente is now known as gfidente|afk17:33
*** livelace has quit IRC17:34
*** rm_work has joined #openstack-kolla17:34
*** rm_work has quit IRC17:34
mgoddardheadphoneJames: right. Wondering if that could be a good simplifier. Any downsides?17:35
*** livelace has joined #openstack-kolla17:37
headphoneJamesstandalone removes the requirement that deployment is running ACME server for handling certbot challenges. Running acme server is no issue.17:37
openstackgerritPierre Riteau proposed openstack/kayobe master: Test building IPA images in the seed job  https://review.opendev.org/c/openstack/kayobe/+/77275117:38
headphoneJamesthe issue is having certbot issue requests to the LE service to generate certs. I'm hoping it possible to run 'pebble' locally to generate test certs.17:39
*** rm_work has joined #openstack-kolla17:41
*** rm_work has quit IRC17:41
headphoneJamesotherwise, maybe I can use a combination of standalone and --test-cert to generate certs good enough to run a test with SSL validation disabled17:41
mgoddardheadphoneJames: I wasn't talking about testing, more about simplification - if we can remove a container by adding a CLI argument, that sounds like a good tradeoff17:45
headphoneJamesah, I see17:45
mgoddardbut perhaps there are benefits I have missed to a separate acme server17:46
*** e0ne has joined #openstack-kolla17:46
headphoneJamesthe benefits are that you cannot bind the standalone to a different port than 80, nor specify the ip address you want to listen on17:50
mgoddardok17:51
*** rm_work has joined #openstack-kolla17:52
*** rm_work has quit IRC17:52
headphoneJamesmgoddard: thanks much for initial review!17:53
mgoddardheadphoneJames: np17:54
*** k_mouza has quit IRC17:56
*** Underknowledge1 has joined #openstack-kolla17:56
*** kevko_ has quit IRC17:57
*** e0ne_ has joined #openstack-kolla17:57
*** e0ne has quit IRC17:57
*** vishalmanchanda has quit IRC18:00
*** mnasiadka has quit IRC18:00
*** Underknowledge has quit IRC18:00
*** vishalmanchanda has joined #openstack-kolla18:00
*** mnasiadka has joined #openstack-kolla18:01
*** Underknowledge1 is now known as Underknowledge18:01
*** k_mouza has joined #openstack-kolla18:03
*** emccormick has quit IRC18:04
*** emccormick has joined #openstack-kolla18:05
*** andrewbonney has quit IRC18:05
*** vishalmanchanda has quit IRC18:08
*** k_mouza has quit IRC18:08
*** e0ne_ has quit IRC18:13
*** mnasiadka has quit IRC18:13
*** e0ne has joined #openstack-kolla18:13
*** emccormick has quit IRC18:14
*** emccormick has joined #openstack-kolla18:15
*** ricolin has quit IRC18:16
*** bbezak has quit IRC18:17
*** cz3 has quit IRC18:17
*** v1k0d3n has quit IRC18:17
*** v1k0d3n has joined #openstack-kolla18:18
*** bbezak has joined #openstack-kolla18:18
*** cz3 has joined #openstack-kolla18:18
*** mnasiadka has joined #openstack-kolla18:18
*** nikparasyr has left #openstack-kolla18:19
*** bbezak has quit IRC18:24
*** mnasiadka has quit IRC18:25
*** v1k0d3n has quit IRC18:25
*** cz3 has quit IRC18:25
*** v1k0d3n has joined #openstack-kolla18:27
*** k_mouza has joined #openstack-kolla18:31
*** cz3 has joined #openstack-kolla18:32
*** bbezak has joined #openstack-kolla18:32
*** mnasiadka has joined #openstack-kolla18:33
*** k_mouza has quit IRC18:35
*** k_mouza has joined #openstack-kolla18:40
*** k_mouza has quit IRC18:45
*** mnasiadka has quit IRC18:54
*** cz3 has quit IRC18:55
*** markmcclain has quit IRC18:55
*** markmcclain has joined #openstack-kolla18:57
*** e0ne has quit IRC19:01
*** maharg101 has quit IRC19:03
*** e0ne has joined #openstack-kolla19:06
*** e0ne has quit IRC19:06
openstackgerritPiotr Parczewski proposed openstack/kolla-ansible master: [docs] Unify project's naming convention  https://review.opendev.org/c/openstack/kolla-ansible/+/77128219:09
*** gouthamr_ has joined #openstack-kolla19:18
*** rm_work has joined #openstack-kolla19:18
*** rm_work has quit IRC19:18
*** cz3 has joined #openstack-kolla19:19
*** mnasiadka has joined #openstack-kolla19:20
*** e0ne has joined #openstack-kolla19:35
*** e0ne has quit IRC19:35
*** gouthamr_ has quit IRC19:40
*** mnasiadka has quit IRC19:40
*** cz3 has quit IRC19:40
*** mnasiadka has joined #openstack-kolla19:42
*** cz3 has joined #openstack-kolla19:45
*** yoctozepto9 has joined #openstack-kolla19:50
*** yoctozepto has quit IRC19:51
*** yoctozepto9 is now known as yoctozepto19:51
*** cah_link has quit IRC20:23
*** stand has quit IRC20:42
*** e0ne has joined #openstack-kolla20:43
*** stand has joined #openstack-kolla20:46
*** e0ne has quit IRC20:47
*** e0ne has joined #openstack-kolla20:47
*** e0ne has quit IRC20:48
*** maharg101 has joined #openstack-kolla20:59
*** maharg101 has quit IRC21:04
*** livelace has quit IRC21:09
openstackgerritPierre Riteau proposed openstack/kayobe master: Fix deployment image build in Victoria  https://review.opendev.org/c/openstack/kayobe/+/77277421:12
*** rm_work has joined #openstack-kolla21:19
*** rm_work has quit IRC21:19
*** egonzalez has quit IRC21:54
*** egonzalez has joined #openstack-kolla21:54
openstackgerritPierre Riteau proposed openstack/kayobe master: Test building IPA images in the seed job  https://review.opendev.org/c/openstack/kayobe/+/77275121:54
*** rm_work has joined #openstack-kolla21:55
*** rm_work has quit IRC21:55
*** k_mouza has joined #openstack-kolla21:56
openstackgerritPierre Riteau proposed openstack/kayobe master: Update seed VM image to CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/77270021:56
openstackgerritPierre Riteau proposed openstack/kayobe stable/victoria: Fix deployment image build in Victoria  https://review.opendev.org/c/openstack/kayobe/+/77277722:00
*** k_mouza has quit IRC22:01
openstackgerritPierre Riteau proposed openstack/kayobe master: Test building IPA images in the seed job  https://review.opendev.org/c/openstack/kayobe/+/77275122:36
*** rm_work has joined #openstack-kolla22:55
*** rm_work has quit IRC22:55
*** rm_work has joined #openstack-kolla23:04
*** rm_work has quit IRC23:04
*** rm_work has joined #openstack-kolla23:06
« Tuesday, 2021-01-26 Index Thursday, 2021-01-28 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!