Tuesday, 2020-10-13

*** zijlboot has joined #openstack-kolla00:24
*** zijlboot has quit IRC00:28
*** LinPeiWen has joined #openstack-kolla00:37
*** zijlboot has joined #openstack-kolla00:42
*** zijlboot has quit IRC00:47
*** zijlboot has joined #openstack-kolla01:08
*** zijlboot has quit IRC01:12
*** LinPeiWen has quit IRC01:15
*** Tengu_ has joined #openstack-kolla01:16
*** Tengu has quit IRC01:19
*** Tengu has joined #openstack-kolla01:21
*** Tengu_ has quit IRC01:22
*** zijlboot has joined #openstack-kolla01:25
*** zijlboot has quit IRC01:30
*** LinPeiWen has joined #openstack-kolla01:49
*** zijlboot has joined #openstack-kolla02:02
*** zijlboot has quit IRC02:06
*** skramaja has joined #openstack-kolla04:06
*** tonyb has quit IRC04:10
*** zijlboot has joined #openstack-kolla04:12
*** zijlboot has quit IRC04:16
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** zijlboot has joined #openstack-kolla04:48
*** zijlboot has quit IRC04:52
*** hongbin has quit IRC04:59
*** abdysn has joined #openstack-kolla05:07
*** zijlboot has joined #openstack-kolla05:30
*** zijlboot has quit IRC05:34
*** vishalmanchanda has joined #openstack-kolla05:35
*** ricolin has quit IRC06:00
*** nikparasyr has joined #openstack-kolla06:13
*** zijlboot has joined #openstack-kolla06:15
*** zijlboot has quit IRC06:20
*** cah_link has joined #openstack-kolla06:28
*** kevko has joined #openstack-kolla06:43
*** zijlboot has joined #openstack-kolla06:43
*** zijlboot has quit IRC06:50
*** zijlboot has joined #openstack-kolla07:00
*** zijlboot has quit IRC07:05
*** LinPeiWen has quit IRC07:10
*** LinPeiWen has joined #openstack-kolla07:10
*** e0ne has joined #openstack-kolla07:10
*** bengates has joined #openstack-kolla07:25
*** rpittau|afk is now known as rpittau07:27
*** gfidente has joined #openstack-kolla07:36
*** zijlboot has joined #openstack-kolla07:36
*** zijlboot has quit IRC07:42
*** wuchunyang has joined #openstack-kolla08:01
*** ricolin has joined #openstack-kolla08:06
*** born2bake has joined #openstack-kolla08:12
*** jonaspaulo has joined #openstack-kolla08:30
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: more info on migrating from CentOS 7 to 8  https://review.opendev.org/75751908:31
*** k_mouza has joined #openstack-kolla08:32
*** priteau has joined #openstack-kolla08:34
mnasiadkamgoddard: got a minute for that one - https://review.opendev.org/#/c/757542/ ?08:49
patchbotpatch 757542 - kolla - rally: Add rally-openstack - 1 patch set08:49
mgoddarddone08:50
*** bengates has quit IRC08:59
*** zijlboot has joined #openstack-kolla09:00
*** bengates has joined #openstack-kolla09:01
stingrayzaMorning folks. quick one (throwing it out here as I think you guys have a lot more mariadb/galera experience than I do)09:03
stingrayzaWe physically moved our train cluster over the weekend. The _primary_ region has come back up and seems to be working well, however, the other region's MariaDB doesn't seem to want to start.09:03
stingrayzaWhen starting the MariaDB container, it barely starts before (quietly) exiting. It doesn't even get to the point of touching the logfiles - so there's nothing in them that might explain what's happening (the last entries in the log are a clean shutdown...)09:03
stingrayzaWhen starting the container in the foreground, it dies pretty quick off the bat. ( docker start -a mariadb ). I've pasted this output here: http://paste.openstack.org/show/798976/09:03
stingrayzaI was wondering if anybody had any ideas before I bounce this off the #mariadb channel?09:03
openstackgerritMerged openstack/kolla-ansible master: Performance: optimize genconfig  https://review.opendev.org/74396109:03
stingrayza(it's a single node - no HA)09:04
*** zijlboot has quit IRC09:05
openstackgerritMark Goddard proposed openstack/kolla master: Switch to Victoria stable branches  https://review.opendev.org/75533909:06
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75707609:06
openstackgerritMark Goddard proposed openstack/kolla master: Switch to Victoria stable branches  https://review.opendev.org/75533909:11
wuchunyangstingrayza kolla-ansible mariadb_recovery ?09:12
*** brinzhang_ has quit IRC09:13
*** brinzhang has joined #openstack-kolla09:16
*** LinPeiWen has quit IRC09:17
stingrayzawuchunyang: thanks for that - just tried it, and it fails at the 'Run MariaDB wsrep recovery' - the mariadb executable dies at the same spot :(09:18
*** LinPeiWen has joined #openstack-kolla09:19
*** k_mouza has quit IRC09:21
wuchunyangis there log about recovery ?09:21
*** k_mouza has joined #openstack-kolla09:21
wuchunyangstingrayza  you can refer to https://www.penguincomputing.com/documentation/scyld-cloud-manager/admin-guide/admin/galera/intro.html09:26
*** k_mouza has quit IRC09:26
*** brinzhang has quit IRC09:27
*** k_mouza has joined #openstack-kolla09:28
*** brinzhang has joined #openstack-kolla09:29
mnasiadkamgoddard: thanks09:30
yoctozeptoNFV job broken because, suddenly, tacker/heat requires aodh09:33
yoctozeptodoes anyone here care about our NFV scenario?09:33
stingrayzawuchunyang: here's the output of the failed task... http://paste.openstack.org/show/798979/ no extra logs anywhere :(09:33
yoctozepto(looking for fix volunteers)09:33
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Performance: optimize genconfig  https://review.opendev.org/75779909:41
mgoddardyoctozepto: we could just try enabling aodh?09:41
yoctozeptomgoddard: we could; still weird09:43
stingrayzawuchunyang: Just gone through that recovery page, nothing from there working :~( (btw, my grastate.dat already has 'safe_to_bootstrap: 1' and my 'wsrep_cluster_address = gcomm://' before.09:44
*** vishalmanchanda has quit IRC09:44
wuchunyangwhich node does safe_to_bootstrap equal 1 ?09:45
stingrayzathere is only the one node....09:47
stingrayza(we don't have any HA)09:47
wuchunyangemm..   is there any error log under /var/log/kolla/mariadb/?09:54
*** brinzhang has quit IRC09:55
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: docs: more info on migrating from CentOS 7 to 8  https://review.opendev.org/75751910:06
*** jbalciunas has quit IRC10:12
hrwmgoddard: do we plan to drop vmtp, nova-mksproxy and other not maintained ones?10:13
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Performance: optimize genconfig  https://review.opendev.org/75780910:16
mgoddardhrw: we deprecated mksproxy: releasenotes/notes/deprecate-images-victoria-75748b9ff3a1e21f.yaml10:16
mgoddardhrw: vmtp had a commit 10 months ago. It's just a performance tool so possibly doesn't require much maintenance10:17
mgoddardI've never used it10:18
stingrayzawuchunyang: the last log is from the last time we shut the server down gracefully... it doesn't get to the point of adding anything into the log now before it crashes...10:18
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add log for cron script fernet-rotate.sh  https://review.opendev.org/75608310:20
hrwok10:20
*** vishalmanchanda has joined #openstack-kolla10:25
*** wuchunyang has quit IRC10:26
*** priteau has quit IRC10:30
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Performance: use a single config file for fluentd  https://review.opendev.org/75781310:39
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Performance: use a single config file for fluentd  https://review.opendev.org/75781610:44
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Performance: use a single config file for fluentd  https://review.opendev.org/75781710:47
openstackgerritMerged openstack/kolla-ansible stable/stein: Performance: use a single config file for logrotate  https://review.opendev.org/75296910:53
*** Abdallahyas has joined #openstack-kolla11:15
*** abdysn has quit IRC11:19
*** bengates has quit IRC11:19
openstackgerritMark Goddard proposed openstack/kayobe master: docs: Add initial all-in-one scenario  https://review.opendev.org/74858211:20
*** bengates has joined #openstack-kolla11:20
*** shyamb has joined #openstack-kolla11:26
*** shyamb has quit IRC11:39
*** shyamb has joined #openstack-kolla11:58
*** r3ap3r has quit IRC12:05
*** jbadiapa has joined #openstack-kolla12:06
*** k_mouza has quit IRC12:07
*** hongbin has joined #openstack-kolla12:09
*** devfaz has quit IRC12:11
*** k_mouza has joined #openstack-kolla12:13
*** k_mouza has quit IRC12:18
*** r3ap3r has joined #openstack-kolla12:18
*** Abdallahyas has quit IRC12:19
*** abdysn has joined #openstack-kolla12:20
*** k_mouza has joined #openstack-kolla12:22
*** jbalciunas has joined #openstack-kolla12:46
*** shyamb has quit IRC12:53
*** shyamb has joined #openstack-kolla12:58
*** shyamb has quit IRC12:58
*** skramaja has quit IRC13:10
r3ap3ryoctozepto: just wanted to give you an update on what I've found in Harbor. Looks like I'm going to pull each container repo individually and store it in a project. Then I can setup a "scheduled" pull once a day or something, based around DockerHub pull policy, and that will keep my containers from Docker up to date. After that, I can point Kolla-Ansible to Harbor and it should pull the containers from there.13:14
*** openstackgerrit has quit IRC13:17
kevkoguys , if i want to build several images by kolla ..should i define them as comma-separated list or delimited by whitespice ? or ?13:27
mgoddardkevko: whitespace I think13:28
kevkoi think also ..but wanted to confirm13:28
*** TrevorV has joined #openstack-kolla13:30
*** jbalciunas has quit IRC13:40
*** openstackgerrit has joined #openstack-kolla13:42
openstackgerritMark Goddard proposed openstack/kayobe master: docs: Add initial all-in-one scenario  https://review.opendev.org/74858213:42
*** hongbin has quit IRC13:52
*** jbalciunas has joined #openstack-kolla13:57
*** muhaha has joined #openstack-kolla13:59
*** jbalciunas has quit IRC14:02
*** kevko has quit IRC14:15
*** kevko has joined #openstack-kolla14:19
*** Abdallahyas has joined #openstack-kolla14:23
*** abdysn has quit IRC14:25
*** Abdallahyas has quit IRC14:27
*** wuchunyang has joined #openstack-kolla14:35
kevkofg14:37
*** hongbin has joined #openstack-kolla14:46
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: update octavia doc  https://review.opendev.org/74640914:46
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: fix a typo in global.yml  https://review.opendev.org/75788314:55
*** wuchunyang has quit IRC15:24
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Performance: use a single config file for fluentd  https://review.opendev.org/75781715:27
*** zijlboot has joined #openstack-kolla15:30
*** zijlboot has quit IRC15:34
*** brinzhang has joined #openstack-kolla15:46
*** nikparasyr has left #openstack-kolla15:49
*** cah_link has quit IRC15:53
*** muhaha has quit IRC16:05
*** bengates has quit IRC16:09
*** bengates has joined #openstack-kolla16:09
*** bengates has quit IRC16:18
*** rpittau is now known as rpittau|afk16:21
openstackgerritMerged openstack/kolla-ansible master: fix a typo in global.yml  https://review.opendev.org/75788316:29
*** rpittau|afk has quit IRC16:31
*** rpittau|afk has joined #openstack-kolla16:34
*** k_mouza has quit IRC16:38
*** priteau has joined #openstack-kolla16:39
*** k_mouza has joined #openstack-kolla16:45
*** jobewan has joined #openstack-kolla16:45
*** k_mouza has quit IRC16:50
*** kevko has quit IRC16:50
*** k_mouza has joined #openstack-kolla16:54
*** k_mouza has quit IRC16:58
*** williampiv has quit IRC17:03
*** k_mouza has joined #openstack-kolla17:07
openstackgerritRafael Weingärtner proposed openstack/kolla-ansible master: Feature to manage public endpoints via DNS names  https://review.opendev.org/75784717:09
*** k_mouza has quit IRC17:11
*** k_mouza has joined #openstack-kolla17:14
*** k_mouza has quit IRC17:19
*** gfidente is now known as gfidente|afk17:21
*** vesper11 has joined #openstack-kolla17:25
*** devfaz has joined #openstack-kolla17:35
*** k_mouza has joined #openstack-kolla17:38
*** k_mouza has quit IRC17:42
*** kevko has joined #openstack-kolla17:45
yoctozeptor3ap3r: nice, though I would never rely on the published images for production17:50
yoctozeptowe don't recommend it either ;p17:50
*** priteau has quit IRC17:53
r3ap3ryoctozepto: Oh, I just assumed that is where Kolla-Ansible was pulling them from when it built the environment. Where would I pull the "production images" from? Maybe I should just look at the playbooks to find out?17:53
*** priteau has joined #openstack-kolla17:54
yoctozeptor3ap3r: nah, you should *build* them for yourself, using kolla17:54
r3ap3ryoctozepto: oh, lol. Makes sense. Well, better start learning that too. lol17:55
*** priteau has quit IRC18:01
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Performance: use a single config file for fluentd  https://review.opendev.org/75781318:06
yoctozeptomgoddard: might be me but I can't find the production images recommendation in the docs atm ^ r3ap3r18:06
mgoddardyoctozepto: well, I wouldn't say they are any less production ready than if you build them yourself18:07
mgoddardyoctozepto: you just get more control if you build them yourself18:07
yoctozeptomgoddard: so maybe I've just mixed the general feeling here18:08
mgoddardmaybe18:08
mgoddardI expect plenty of people use them in production18:08
mgoddardat a minimum I would suggest running your own registry though, rather than pulling from dockerhub18:08
mgoddard1. to control when they get updated18:08
mgoddard2. to save internet bandwidth18:09
mgoddard(and time)18:09
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Performance: use a single config file for fluentd  https://review.opendev.org/75781718:13
*** k_mouza has joined #openstack-kolla18:15
yoctozeptomgoddard: yup, r3ap3r does that (with harbor)18:18
yoctozeptor3ap3r: so ptl approves such usage; I can't oppose18:18
yoctozepto(nor that I ever could lol)18:18
*** k_mouza has quit IRC18:19
*** k_mouza has joined #openstack-kolla18:23
r3ap3rmgoddard: yoctozepto my initial intent was to pull the images from Dockerhub as their "pull" policy is changing in November. I'll use my own local registry for building and have scheduled pulls every so often to keep them updated. I don't plan on doing anything too far out of the ordinary as to require me to build "custom" containers to my current knowledge. I may be wrong on that though?18:24
r3ap3rAll good yoctozepto it is all a learning experience.18:25
*** k_mouza has quit IRC18:28
r3ap3rCan always try both methods and see what works better for me. Beauty of flexible project right? ^^^^18:28
*** jonaspaulo has quit IRC18:30
*** hrw has quit IRC18:30
*** hrw has joined #openstack-kolla18:32
yoctozeptor3ap3r: indeed; I wouldn't have put it in better words18:38
*** k_mouza has joined #openstack-kolla18:38
r3ap3r:)18:39
*** k_mouza has quit IRC18:42
*** k_mouza has joined #openstack-kolla18:56
*** k_mouza has quit IRC19:00
*** e0ne has quit IRC19:07
*** e0ne has joined #openstack-kolla19:17
*** k_mouza has joined #openstack-kolla19:21
*** e0ne has quit IRC19:22
*** k_mouza has quit IRC19:25
*** TrevorV has quit IRC19:26
*** k_mouza has joined #openstack-kolla19:29
*** k_mouza has quit IRC19:34
*** k_mouza has joined #openstack-kolla19:38
*** kevko has quit IRC19:40
*** kevko has joined #openstack-kolla19:41
*** williampiv has joined #openstack-kolla20:00
*** born2bake has quit IRC20:01
mlozathe cron job for elasticsearch curator doesnt work20:02
*** brinzhang_ has joined #openstack-kolla20:11
*** brinzhang has quit IRC20:13
*** kevko has quit IRC20:14
*** jbadiapa has quit IRC20:20
*** gfidente|afk has quit IRC20:26
*** brinzhang_ has quit IRC20:32
openstackgerritPierre Riteau proposed openstack/kayobe master: Fix failures in Docker storage driver check  https://review.opendev.org/75795221:00
openstackgerritPierre Riteau proposed openstack/kayobe master: Fix failures in Docker storage driver check  https://review.opendev.org/75795221:13
*** zijlboot has joined #openstack-kolla21:15
*** zijlboot has quit IRC21:20
*** zijlboot has joined #openstack-kolla21:29
*** brinzhang has joined #openstack-kolla22:13
*** brinzhang_ has joined #openstack-kolla22:14
*** brinzhang has quit IRC22:18
*** vishalmanchanda has quit IRC22:34
*** k_mouza has quit IRC23:01
*** k_mouza has joined #openstack-kolla23:01
*** k_mouza has quit IRC23:06
*** k_mouza has joined #openstack-kolla23:07
*** k_mouza has quit IRC23:11
*** mchlumsky has quit IRC23:20
*** mchlumsky has joined #openstack-kolla23:21
*** k_mouza has joined #openstack-kolla23:22
*** strobert has quit IRC23:24
*** k_mouza has quit IRC23:26
*** strobert has joined #openstack-kolla23:30
*** k_mouza has joined #openstack-kolla23:53
*** k_mouza has quit IRC23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!