Friday, 2020-10-09

*** k_mouza has quit IRC00:04
*** k_mouza has joined #openstack-kolla00:22
*** k_mouza has quit IRC00:26
*** k_mouza has joined #openstack-kolla00:32
*** maharg101 has joined #openstack-kolla00:33
*** k_mouza has quit IRC00:36
*** maharg101 has quit IRC00:38
*** LinPeiWen has joined #openstack-kolla00:40
*** JamesBenson has quit IRC00:42
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend Neutron API Server  https://review.opendev.org/75636700:42
*** JamesBenson has joined #openstack-kolla00:43
*** brinzhang has joined #openstack-kolla00:44
*** JamesBenson has quit IRC00:47
*** wuchunyang has joined #openstack-kolla00:52
*** yankcrime has quit IRC00:53
*** zzzeek has quit IRC01:10
*** zzzeek has joined #openstack-kolla01:11
*** k_mouza has joined #openstack-kolla01:13
*** k_mouza has quit IRC01:17
*** JamesBenson has joined #openstack-kolla01:20
*** JamesBenson has quit IRC01:24
*** k_mouza has joined #openstack-kolla01:26
*** k_mouza has quit IRC01:30
*** LinPeiWen has quit IRC01:46
*** k_mouza has joined #openstack-kolla01:57
*** dciabrin has quit IRC01:57
*** k_mouza has quit IRC02:01
*** dciabrin has joined #openstack-kolla02:07
*** k_mouza has joined #openstack-kolla02:23
*** k_mouza has quit IRC02:27
*** JamesBenson has joined #openstack-kolla02:30
*** JamesBenson has quit IRC02:34
*** k_mouza has joined #openstack-kolla02:51
*** k_mouza has quit IRC02:55
*** LinPeiWen has joined #openstack-kolla02:59
*** JamesBenson has joined #openstack-kolla03:05
*** maharg101 has joined #openstack-kolla03:06
*** JamesBenson has quit IRC03:10
*** maharg101 has quit IRC03:11
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend Neutron API Server  https://review.opendev.org/75636703:26
*** ricolin_ has joined #openstack-kolla04:01
*** bengates has joined #openstack-kolla04:01
*** wuchunyang has quit IRC04:01
*** bengates has quit IRC04:05
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** vishalmanchanda has joined #openstack-kolla04:35
*** cah_link has joined #openstack-kolla04:45
*** cah_link has quit IRC05:00
*** zzzeek has quit IRC05:02
*** zzzeek has joined #openstack-kolla05:05
*** maharg101 has joined #openstack-kolla05:07
*** maharg101 has quit IRC05:12
*** wuchunyang has joined #openstack-kolla05:31
*** skramaja has joined #openstack-kolla05:31
*** zzzeek has quit IRC05:42
*** zzzeek has joined #openstack-kolla05:43
*** rpittau|afk is now known as rpittau05:43
*** brinzhang_ has joined #openstack-kolla05:52
*** cah_link has joined #openstack-kolla05:55
*** brinzhang has quit IRC05:55
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add log for cron script fernet-rotate.sh  https://review.opendev.org/75608306:09
*** LinPeiWen has quit IRC06:11
*** zzzeek has quit IRC06:11
*** zzzeek has joined #openstack-kolla06:12
*** LinPeiWen has joined #openstack-kolla06:15
*** also_stingrayza has joined #openstack-kolla06:16
*** stingrayza has quit IRC06:17
*** LinPeiWen has quit IRC06:23
*** jobewan has quit IRC06:46
yoctozeptomorning06:49
*** jobewan has joined #openstack-kolla06:52
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Fix haproxy bundle generation  https://review.opendev.org/75700707:01
wuchunyanghello  what  time will kolla be released?07:07
*** maharg101 has joined #openstack-kolla07:08
*** nikparasyr has joined #openstack-kolla07:09
*** maharg101 has quit IRC07:12
yoctozeptowuchunyang: hoping for the week after ptg I guess @ mgoddard07:13
wuchunyangok, thanks07:15
*** bengates has joined #openstack-kolla07:26
*** e0ne has joined #openstack-kolla07:27
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add log for cron script fernet-rotate.sh  https://review.opendev.org/75608307:31
*** maharg101 has joined #openstack-kolla07:33
*** kevko has joined #openstack-kolla07:42
mgoddardmorning07:45
mgoddardyoctozepto: let's see. Some things are out of our hands as usual :)07:45
yoctozeptomgoddard: yeah, that's where the "hope" kicks in :-)07:45
yoctozeptomgoddard: anyhow, good news is octavia is passing07:45
yoctozeptomgoddard: did you manage to keep the workaround in a single task?07:46
*** gfidente has joined #openstack-kolla07:51
wuchunyangyoctozepto  mgoddard  hello. i want  to know  why we defer this ps  https://review.opendev.org/#/c/755589/  for  'w' cycle ?07:55
patchbotpatch 755589 - kolla-ansible - octavia: support tenant management network - 11 patch sets07:55
yoctozeptowuchunyang: because it does magic not expected from kolla-ansible - we want to have as much octavia support as we can in V but we need to have a longer think cycle on this one07:56
*** e0ne has quit IRC07:56
wuchunyangbut without this ps , the octavia still not work  out of the box. could we   add this ps as a preview in 'v' cycle ?08:01
mnasiadkahost networking was never configured by kolla-ansible, so I think operators can survive to do it manually for one more cycle08:04
mnasiadkaI believe this functionality is more fit into kayobe...08:09
mgoddardyoctozepto: re single task, I had handler inversion. Basically I was about 1 hour behind you :)08:10
*** gfidente has quit IRC08:10
*** gfidente has joined #openstack-kolla08:14
hrwmorning08:17
hrwhttps://review.opendev.org/754355 anyone?08:17
patchbotpatch 754355 - kolla - convert STATUS_* consts into Enum - 3 patch sets08:17
*** k_mouza has joined #openstack-kolla08:20
wuchunyangyoctozepto mnasiadka  ok,  thanks,  This is not very friendly to testers, anyhow tenant network is the simplest way to run a octavia service.08:24
*** k_mouza_ has joined #openstack-kolla08:28
*** k_mouza has quit IRC08:31
*** LinPeiWen has joined #openstack-kolla08:36
openstackgerritMerged openstack/kolla-ansible master: octavia: generate certificates automatically  https://review.opendev.org/75428008:41
yoctozeptomgoddard: no problem08:45
yoctozeptomgoddard: maybe bcoca fixes that evaluation order and it's possible08:45
yoctozeptobut a single non-looped task per host is quite nice now08:46
yoctozeptomgoddard, mnasiadka, wuchunyang: well, we could hide this indeed behind a flag explicitly called EXPERIMENTAL_blah_blah and write in big letters it's only meant for testers and PoCers atm and should never ever be used in production as it may change with no upgradability warranty08:48
mgoddardthat would at least allow us to merge the test :)08:48
yoctozeptomgoddard: indeed, that was the hidden assumption08:49
yoctozeptoit's already much much nicer08:49
yoctozeptooctavia-certificates is semi-production (safe to use most of the time but not completely production quality - for that one should use a proper CA)08:50
yoctozeptoand we coordinate config08:50
yoctozeptomgoddard, wuchunyang: please follow up on https://review.opendev.org/745997 (I failed to save my comments from an open tab lol)08:53
patchbotpatch 745997 - kolla-ansible - add octavia openrc file - 12 patch sets08:53
wuchunyangyeah, i agree with this.  i often  need to poc  octavia,  so  it would nice to support a simply way for octavia.08:53
wuchunyang16:48 (mgoddard) that would at least allow us to merge the test :)    and CI will work too08:54
wuchunyangyoctozepto will update soon08:57
*** jan00 has joined #openstack-kolla08:57
yoctozeptowuchunyang: please submit another patch (this one is close to merge, let's not break it now)08:57
* yoctozepto back to local hacking08:58
wuchunyangok , thanks will update soon08:59
jan00hey, we just tripped over https://bugs.launchpad.net/keystone/+bug/1895723 and realised that our tokens were quite old. I believe the cronjob in the 'keystone_fernet' container is never run on ubuntu because the 'cron_path' in 'ansible/roles/keystone/templates/keystone-fernet.json.j2' should be '/var/spool/cron/crontabs/root' rather than09:02
openstackLaunchpad bug 1895723 in kolla-ansible ussuri "Keystone is restarting due to stale primary key" [High,Fix committed] - Assigned to Radosław Piliszek (yoctozepto)09:02
jan00'/var/spool/cron/crontabs/root/fernet-cron'09:02
yoctozeptomnasiadka: ^09:03
*** ricolin_ has quit IRC09:04
*** LinPeiWen has quit IRC09:05
openstackgerritMerged openstack/kolla-ansible master: add octavia openrc file  https://review.opendev.org/74599709:10
mgoddardmnasiadka, yoctozepto: could we have an ultra fast rotation in CI that triggers within a job?09:11
mgoddardideally initial tokens would become invalid before the end of the job09:11
mgoddardrotate once per second?09:11
*** kevko has quit IRC09:24
*** kevko has joined #openstack-kolla09:24
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: remove redundant line and replace octavia user  https://review.opendev.org/75703909:28
*** LinPeiWen has joined #openstack-kolla09:28
wuchunyangyoctozepto help review again, thanks.  trivial fix09:29
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: DNM[test]  https://review.opendev.org/75704109:30
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: [test]  https://review.opendev.org/75704209:32
*** yankcrime has joined #openstack-kolla09:32
mnasiadkamgoddard: we could but then fernet tokens would be invalid after 3 seconds :)09:38
mgoddardmnasiadka: that was a joke09:38
mgoddard10-15m could work though09:39
mnasiadkamaybe, if we merge the logging and backport it as part of a bug troubleshooting, at least we could understand what is happening09:39
mnasiadkabut I really hate that crond only logs to syslog09:39
mgoddardjan00's assessment sounds plausible09:41
mnasiadkaI would prefer to get it verified, which shouldn't be too complicated09:44
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Document migration of seed VM to CentOS 8  https://review.opendev.org/75705609:45
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Document migration of seed VM to CentOS 8  https://review.opendev.org/75705609:47
yoctozeptowuchunyang: thx, done09:50
yoctozeptomgoddard, mnasiadka, jan00: yeah, we've definitely had to have different paths for the two distro families09:51
*** wuchunyang has quit IRC10:07
openstackgerritMark Goddard proposed openstack/kayobe master: docs: Add skeleton for scenario docs  https://review.opendev.org/74858210:15
mnasiadkayoctozepto: we could put cron files into /etc/cron.d, it seems both debuntu and centos reads those in the same manner10:17
mnasiadkabut we would need to change the format of the file (include user name)10:17
mnasiadkaalthough ubuntu manual claims system administrator should use /etc/crontab, not /etc/cron.d :D10:18
mnasiadkaok, for sure the path on Ubuntu is at least wrong10:23
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75707610:30
mnasiadka1..2..3.. testing ^^10:30
jan00I've just did `rm -rf /var/spool/cron/crontabs/root` inside the keystone-fernet container and then `crontab -e` and it was placed at `/var/spool/cron/crontabs/root`, but `/etc/crontab` or `/etc/cron.d` should work aswell10:33
*** ewimmer__ has quit IRC10:38
mnasiadkajan00: to use /etc/crontab we would need to copy contents from the original and add our line, there's no convenient way to add a line to it on startup - I just changed the path in change 757076 and decreased fernet cron timers so we can see if it's rotating in the CI change.10:39
mnasiadkaI wonder if that path ever worked on Ubuntu...10:39
mnasiadkamgoddard, yoctozepto: what's the plan for this change https://review.opendev.org/#/c/746384/17? I'm having a slight of a problem approving it without a CI, but maybe we should push it as ,,tech preview''?10:42
patchbotpatch 746384 - kolla-ansible - Add support for GlusterFS NFS Manila backend - 17 patch sets10:42
mnasiadkaor it's too late and we push it to W?10:42
mgoddardmnasiadka: I haven't really looked at that one10:43
mgoddardhaven't heard an FFE request10:43
mnasiadkaso let's mark it as -2 priority, I can work on adding a CI job for Manila-glusterfs in W, if that feature makes sense10:44
mnasiadkamgoddard: https://review.opendev.org/#/c/756083/ - passes now10:44
patchbotpatch 756083 - kolla-ansible - Add log for cron script fernet-rotate.sh - 11 patch sets10:44
mgoddardmnasiadka: we don't have tests for any of the other manila backends do we?10:44
mgoddardceph would be nice10:45
mnasiadkamgoddard: no, we don't - I have ceph on my lengthy roadmap :)10:45
*** priteau has joined #openstack-kolla10:49
*** zzzeek has quit IRC10:52
*** e0ne has joined #openstack-kolla10:52
*** zzzeek has joined #openstack-kolla10:54
*** jan00 has quit IRC11:07
*** zzzeek has quit IRC11:17
*** jan00 has joined #openstack-kolla11:17
kevkoif you want to help with ceph CI ..I can give a hand ..we have automatic ceph deploy in our CI inside company11:17
*** zzzeek has joined #openstack-kolla11:18
mgoddardkevko: thanks. We use ceph-ansible in CI currently, only we don't test manila11:23
*** dciabrin_ has joined #openstack-kolla11:33
*** skramaja has quit IRC11:34
*** dciabrin has quit IRC11:34
*** hrw has quit IRC11:34
*** dking has quit IRC11:34
*** rphillips has quit IRC11:34
*** rockey has quit IRC11:34
*** hrww has joined #openstack-kolla11:34
*** hrww is now known as hrw11:34
*** rphillips has joined #openstack-kolla11:34
kevkomgoddard: ah, ok, same on my side :)11:35
hrwmaybe you will know... any hints how to satisfy ansible yaml parser? fails on: cmd: "make install DESTDIR=/somewhere/"11:37
*** skramaja has joined #openstack-kolla11:40
*** dking has joined #openstack-kolla11:40
*** rockey has joined #openstack-kolla11:40
*** jbadiapa has joined #openstack-kolla11:45
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add log for cron script fernet-rotate.sh  https://review.opendev.org/75608312:04
*** Fl1nt has joined #openstack-kolla12:04
Fl1ntHi everyone!12:04
Fl1ntmgoddard, I found out a bug on the haproxy role I think. It's related to the precheck task.12:05
mnasiadkahrw: what is the error from ansible yaml parser?12:05
Fl1ntif you call kolla-ansible prechecks without any limit, the set facts about whether we can run haproxy/keepalived prechecks.12:06
Fl1nton an existing deployment12:06
Fl1ntwill skip them12:06
Fl1ntwhereas if precheck task is implicitely called from an upgrade task for instance12:07
Fl1ntit won't skip them12:07
Fl1ntadditionally12:07
Fl1ntwhen we copy the HAProxy certs, we use the src: {{ kolla_fqdn_external/internal_cert }} and dst: {{ node_config }}/haproxy/{{ item }}12:09
Fl1ntwhich is then working because we take from /etc/kolla/config or the CICD/deployment job workspace vars that the user set and push it onto controllers.12:10
Fl1ntbut later on12:10
hrwmnasiadka: sorted out.12:10
Fl1ntwithin the precheck task12:10
hrwmnasiadka: forgot 'command:' above12:10
mnasiadkahrw: ah12:10
Fl1ntit will never work for users that will have {{ kolla_fqdn_external_cert }} variable with a value different than: {{ node_config_directory }}/haproxy/haproxy.pem12:11
Fl1ntbecause of the local_run from the controller itself that doesn't contain this /etc/kolla/config/ or any customised directory.12:12
Fl1ntTHIS: will always be false if you don't put your certificate variable {{ kolla_fqdn_external_cert }} under: /etc/kolla/haproxy/haproxy.pem path12:14
Fl1ntconsequently, if you've got a platform, that use node_custom_config within kolla_external_fqdn and that you deploy it, it will work.12:15
Fl1ntbut once you want to upgrade it12:15
Fl1ntit won't work anymore.12:15
Fl1ntDo we consider this as an issue?12:16
Fl1ntFrom my point of view, that is two issues, one about the fact that precheck step called standalone wont actually correctly check anything for this role as it will skip the steps.12:17
Fl1ntand the second is about the path management.12:17
mnasiadkaFl1nt: that's an excellent write up, have you thought about raising a bug and even fixing it? :)12:18
Fl1ntyep12:18
Fl1ntbut I wanted to get your insight about that first12:18
Fl1ntas I may well have missed a critical var/process somewhere ^^12:18
Fl1ntand when I'm saying 'your' insight I mean, the whole team willing to validate my investigations ^^12:20
mgoddardFl1nt: don't really have time to grok it right now12:22
*** kevko has quit IRC12:22
Fl1ntsure no problems ^^12:29
mgoddardFl1nt: I tried to read it again, still not sure I understand the problem12:29
mgoddardsimple example?12:29
Fl1ntlet say you have a platform based on Train but using CentOS7 as container base image, and you want to use your newly built CentOS8 images.12:30
Fl1ntlet say within that platform, you're using ElasticSearch (5.X deployed as you use CentOS7).12:30
Fl1ntin order for you to deploy that new platform, you'll need to use both upgrade task action in order to trigger the 5.x to 6.x migration process of the ElasticSearch role12:31
Fl1ntand12:31
Fl1ntdeploy task12:31
Fl1ntin order to switch you others services containers to CentOS 8 based images.12:31
mgoddardah12:32
mgoddardthis is why we support 6.x on CentOS 712:32
mgoddardmaybe this needs documenting12:32
mgoddardI'm not sure what this has to do with haproxy though12:33
Fl1ntWell, One need to switch to CentOS 8 at some point so, even with that in mind we still get an issue ^^12:33
Fl1ntso12:33
Fl1ntwith that in mind, this platform is also relying on TLS Haproxy (Ext/Int)12:33
Fl1ntso12:33
Fl1nthere we have two distinct bugs:12:34
Fl1ntthe first one came from the fact that when you invoke the precheck task directly from the kolla-ansible prechecks action12:35
Fl1ntthe HAProxy checks tasks are skipped12:36
Fl1ntbecause of this: https://opendev.org/openstack/kolla-ansible/src/tag/9.2.0/ansible/roles/haproxy/tasks/precheck.yml#L29 and this: https://opendev.org/openstack/kolla-ansible/src/tag/9.2.0/ansible/roles/haproxy/tasks/precheck.yml#L3212:37
Fl1ntwhich is kind of funny because this bug actually let us deploy correctly our platform and especially the TLS part of it.12:38
mgoddardbecause you are using --limit12:38
Fl1ntnope sir ^^12:38
Fl1nthence why there is a bug ^^12:39
mgoddardoh, because haproxy is running12:39
Fl1ntyes ^^12:39
mgoddardwe don't need to check for the VIP if haproxy is already running12:39
mgoddardor rather, we can't12:39
yoctozeptoyeah, we kinda can't easily/reliably12:40
Fl1ntthe issue here is that fact actually inhibit the run of the certs path checks etc too12:41
mgoddardok, I see12:42
Fl1ntas we always preform a standalone call for precheck before any deployment, that is kind of dangerous as it skip a test that can actually prevent for the platform to be reached ^^12:42
mgoddardFl1nt: https://opendev.org/openstack/kolla-ansible/src/tag/9.2.0/ansible/roles/haproxy/tasks/precheck.yml#L3412:43
mgoddardit doesn't reference haproxy_vip_prechecks12:44
Fl1ntyep, and that's what let me know there is something more12:45
mgoddardI still don't understand the problem12:46
Fl1ntthe problem is, those check tasks are all skipped when running a standalone kolla-ansible prechecks action.12:46
mgoddardif haproxy is running12:48
mgoddardthe certificate check still runs12:48
mgoddardonly the port checks are skipped12:48
Fl1ntok, I've collected some logs12:53
Fl1nthere is the standalone precheck action relevant part:12:54
Fl1nthttp://paste.openstack.org/show/ruLTIF1AQ7MbW2tfojKb/12:54
Fl1ntand the command used to launch it: `kolla-ansible -i $CONFIG_DIR/multinode --configdir $CONFIG_DIR --passwords $CONFIG_DIR/passwords.yml prechecks`12:54
mgoddardTASK [haproxy : Checking if external haproxy certificate exists] ***************12:55
mgoddardok: [emea-cp01 -> localhost]12:55
mgoddardTASK [haproxy : Fail if external haproxy certificate is absent] ****************12:55
mgoddardskipping: [emea-cp01]12:55
mgoddardfirst task ok12:55
Fl1nthold on12:55
mgoddardfail task skipped12:55
Fl1ntyeah wait a minute ^^12:55
Fl1ntnow12:55
Fl1ntif I do: `kolla-ansible -i $CONFIG_DIR/multinode --configdir $CONFIG_DIR --passwords $CONFIG_DIR/passwords.yml upgrade`12:55
Fl1ntthe upgrade action within HAProxy12:56
Fl1ntcall the config.yml12:56
Fl1ntand trigger a check step12:57
* Fl1nt goes collect the logs12:57
Fl1ntso, when using precheck as a standalone, it's OK, it find the certs13:01
Fl1ntbut once you call upgrade13:01
Fl1nthttp://paste.openstack.org/show/IjggZr2HMFg70a0zRYfc/13:01
Fl1ntit fail but it's OK13:01
Fl1ntbecause it is the intended behavior13:01
Fl1ntas13:01
Fl1ntthe used check var13:02
Fl1ntcan't be found on remote host13:02
*** rpittau is now known as rpittau|afk13:03
Fl1ntso, the first task: https://opendev.org/openstack/kolla-ansible/src/tag/9.2.0/ansible/roles/haproxy/tasks/precheck.yml#L34 is always true13:03
Fl1ntbecause it register within haproxy_cert_file the return of the check13:04
Fl1ntand the second13:04
Fl1ntis either valid when the stat.exist and kolla_enable_tls is true13:05
mgoddardwhere is the check step called from config.yml?13:05
Fl1nthum... yeah, you're right it's weird, it's not13:07
mgoddard:)13:08
Fl1nthold on checking something...13:08
Fl1nthum, find out what's going on13:10
Fl1ntthe CICD pipeline call prechecks before upgrade too as inherit from the parent pipeline that explicitly call for it.13:10
Fl1ntso, the first bug isn't a bug ^^13:11
Fl1ntI'll dig deeper ^^13:11
Fl1ntbut that doesn't explain why to identical command comes with two different behaviors :(13:13
Fl1ntre-running it ^^13:13
Fl1ntto see if it was something temporary or a constant.13:13
mgoddardFl1nt: maybe your pipeline is actually lacking the cert and the precheck is doing its job? :D13:14
Fl1ntit's checked out from the same git repository, it can't be there at deploy run and not at upgrade ^^ But I'm checking, maybe there was a network hiccups or something.13:16
Fl1ntall right, found out...13:20
Fl1ntI'll have to slap someone with a big trout ^^13:20
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Document migration of seed VM to CentOS 8  https://review.opendev.org/75705613:21
*** wuchunyang has joined #openstack-kolla13:23
*** TrevorV has joined #openstack-kolla13:28
Fl1ntmgoddard, one last thing that bug me up, how is the precheck task: "Checking if external haproxy certificate exists" able to found out a valid cert on our remote server when it check for {{ kolla_external_cert_fqdn }} which is13:29
Fl1ntequal to13:29
mgoddardFl1nt: delegate_to: localhost13:29
Fl1ntwait13:29
Fl1ntAm I missing something here? https://opendev.org/openstack/kolla-ansible/src/tag/9.2.0/ansible/roles/haproxy/tasks/precheck.yml#L3413:29
mgoddardFl1nt: local_action == delegate_to: localhost13:30
Fl1ntaaaaaaaah ok, I though local_action was actually doing something else.13:30
Fl1ntok, got it, sorry for all that confusion...13:32
mgoddardnp13:32
Fl1ntgoing back to my cloudkitty funny party ^^13:32
Fl1ntbtw hrw here is your worst nightmare: https://imgur.com/a/YSzBTeL13:37
hrwFl1nt: trust me, you do not want to work with my worst nightmare hw13:42
Fl1ntToo late I'm already ^^13:42
Fl1ntcurrently installing them using fedora.13:43
hrwFl1nt: rpi4 is just yet another sbc. category of devices where I usually do not care13:44
hrwFl1nt: edb9301 was painful. early 2.6 on zaurus was painful. nhk15 kernel trees merge was painful.13:45
Fl1ntIs that because of the BCM ?13:47
Fl1ntbecause it seems like the VideoCore VI was open sourced isn't ?13:48
hrwFl1nt: I do aarch64 servers. you know, such multicore computers which comes in 19" cases to put in racks.13:59
hrwFl1nt: with proper storage, sane memory sizes etc13:59
hrwFl1nt: hardware which lacks nvme, lacks sata, has <32GB ram is not interesting14:00
hrwFl1nt: simple enough?14:00
Fl1ntok14:04
hrwgood14:07
hrwI am aware that people use SBCs for things normal users get servers.14:07
hrwor to say it nicer: I am aware that people use SBCs for things normally users get servers.14:08
Fl1ntwasn chating about that to pissed you off.14:08
hrwI am pissed off.14:10
hrwI am not pissed off.14:10
hrw;d14:10
Fl1ntit's just that as you told it, people don't buy expensive ARM Servers to get some labs or recreation/side projects and tests about distributivity of something.14:10
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add log for cron script fernet-rotate.sh  https://review.opendev.org/75608314:11
hrwFl1nt: rpi4 is terrible choice. vendor does not give a shit about upstreaming their stuff or doing QA14:11
hrwFl1nt: you spend few hundred $€ on rpi instead of going to something saner. your choice.14:11
mnasiadkahrw: what is saner? ;)14:15
Fl1ntIt's supported on Linux, there is a distribution, with a package manager and packages that I'm interested in, I don't care about using 1 server, I need to test relationship between things to a scale that using VM isn't possible at a consumer grade level.14:15
Fl1ntAnd if it was for an enterprise grade budget, I'wd have gone with an AMD/Intel x86 as it's still more powerfull and standard over ARM.14:17
hrwFl1nt: try using aarch64 server one day. they are highly standardized14:18
hrwwe made them boring14:18
hrwFl1nt: rpi4 is not supported in fedora 3314:18
hrwit may be supported in 3414:19
hrwit is 'somekind of working' state so not listed as supported device14:19
Fl1ntsure, we've got few of them in test thanks to your last recommandation, but they're still away from x86 in terms of performance and GPU support.14:20
Fl1ntand on that chatting, the critical part was "distribution". If you want to do it on a relatively controlled budget, you're let with few options and RPi is the most balanced one. wasn't pinching you or something, was just chatting.14:21
hrwmkey14:21
* hrw -> other container builds14:21
*** wuchunyang has quit IRC14:23
*** k_mouza_ has quit IRC14:25
*** k_mouza has joined #openstack-kolla14:26
openstackgerritMark Goddard proposed openstack/kolla master: Switch to Victoria stable branches  https://review.opendev.org/75533914:34
*** e0ne_ has joined #openstack-kolla14:39
*** e0ne has quit IRC14:43
*** k_mouza has quit IRC14:52
*** bsanjeewa has joined #openstack-kolla15:01
openstackgerritMerged openstack/kayobe master: Synchronise global extra variables files with defaults  https://review.opendev.org/75658615:01
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Performance: use import_tasks for register and bootstrap  https://review.opendev.org/75712415:02
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Performance: use import_tasks for register and bootstrap  https://review.opendev.org/75712515:03
*** k_mouza has joined #openstack-kolla15:04
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Performance: use import_tasks for register and bootstrap  https://review.opendev.org/75712615:04
*** skramaja has quit IRC15:10
*** nikparasyr has left #openstack-kolla15:18
*** k_mouza has quit IRC15:28
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713315:30
mgoddardFl1nt: your ES issue reminded me I needed to document it15:30
mgoddard ^15:30
openstackgerritMark Goddard proposed openstack/kolla master: Finish off removing Congress  https://review.opendev.org/75713615:33
*** k_mouza has joined #openstack-kolla15:35
*** bengates has quit IRC15:35
*** bengates has joined #openstack-kolla15:36
*** k_mouza has quit IRC15:39
*** bengates has quit IRC15:41
*** k_mouza has joined #openstack-kolla15:41
*** maharg101 has quit IRC15:50
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713315:54
*** k_mouza has quit IRC15:55
*** k_mouza has joined #openstack-kolla15:57
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713315:57
openstackgerritPierre Riteau proposed openstack/kayobe stable/ussuri: Configure bifrost to use firewalld trusted zone  https://review.opendev.org/75714316:01
Fl1ntah ah ah glad it helped ^^16:05
Fl1ntso, I did the upgrade, how am I supposed to force k-a to use ES6 now? with elasticsearch_use_v6 to true ?16:05
*** zijlboot has quit IRC16:05
*** priteau has quit IRC16:06
*** k_mouza has quit IRC16:06
*** e0ne_ has quit IRC16:07
mgoddardFl1nt: if you are already on CentOS 8 it uses v6 always16:10
mgoddardon C7 yes, you can set that flag (and the one for kibana)16:10
Fl1ntCos8 on host or containers?16:10
mgoddardboth. host & container should match16:11
Fl1ntI've got host on C7 and containers on C8 for now16:11
mgoddardbut the flag uses the host to set the default16:11
mgoddardwe don't test/support that16:11
Fl1ntlet's test it live :p16:11
mgoddardFl1nt: https://opendev.org/openstack/kolla-ansible/src/branch/master/specs/centos8-migration.rst16:12
Fl1ntit works \o/16:13
Fl1nttempest validated ^^ and functional test validated :D16:13
Fl1ntcloudkitty installed and using ES6 index :D Perfect!16:13
mgoddardthere was a bug raised recently about it16:13
mgoddardhaproxy16:14
Fl1ntI'll have to update the hosts soon but I need to be careful with this one as I've got beta workload on it ^^16:14
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713316:18
*** kevko has joined #openstack-kolla16:34
*** maharg101 has joined #openstack-kolla16:38
*** gfidente is now known as gfidente|afk16:40
*** priteau has joined #openstack-kolla16:41
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend Neutron API Server  https://review.opendev.org/75636716:43
*** maharg101 has quit IRC16:45
openstackgerritPierre Riteau proposed openstack/kolla-ansible master: Apply bool filter to all enable_prometheus_* variables  https://review.opendev.org/75715416:51
*** gfidente|afk has quit IRC16:52
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713316:53
*** Fl1nt has quit IRC17:28
*** jbadiapa has quit IRC17:56
*** priteau has quit IRC17:58
*** priteau has joined #openstack-kolla18:03
*** cah_link has quit IRC18:05
openstackgerritMark Goddard proposed openstack/kolla master: Switch to Victoria stable branches  https://review.opendev.org/75533918:06
*** priteau has quit IRC18:08
*** vishalmanchanda has quit IRC18:15
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713318:28
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713318:31
*** k_mouza has joined #openstack-kolla18:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713318:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: Add information on migrating to CentOS 8  https://review.opendev.org/75713318:35
*** priteau has joined #openstack-kolla18:42
*** maharg101 has joined #openstack-kolla18:43
*** maharg101 has quit IRC18:47
*** priteau has quit IRC18:48
*** bsanjeewa_ has joined #openstack-kolla18:51
*** bsanjeewa has quit IRC18:54
*** priteau has joined #openstack-kolla19:14
*** k_mouza has quit IRC19:20
*** priteau has quit IRC19:27
*** cah_link has joined #openstack-kolla19:34
*** TrevorV has quit IRC19:42
*** zzzeek has quit IRC19:49
*** zzzeek has joined #openstack-kolla19:51
*** zijlboot has joined #openstack-kolla20:36
*** maharg101 has joined #openstack-kolla20:43
*** maharg101 has quit IRC20:48
*** zijlboot has quit IRC21:55
*** zijlboot has joined #openstack-kolla21:56
*** zijlboot has quit IRC22:00
*** JustAFlerkin has joined #openstack-kolla22:18
JustAFlerkinhi, having an issue with the kolla/ubuntu-source-bootstrap_gnocchi:master image. it complains about not having a rados library. 8-/ Using a ceph backend.22:19
JustAFlerkindid some googling and didn't find any viable workarounds.22:19

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!