Monday, 2019-12-16

*** ricolin has joined #openstack-kolla00:50
r3ap3rcosmicsound I have been having the same failure however I am doing a fresh deploy. I am still new to openstack and kolla-ansible so I have been trying various nova "configurations" within the globals.yml before hitting up irc or reporting as a bug. I just like to have my ducks in a row and have Google tell me, "Dude!! Go ask for help!" before asking for help. I'm deploying on Centos 7 though, instead of Ubuntu.00:52
r3ap3rI haven't tried deploying Stein though? I might try that to see if I can get a win though. lol00:54
*** xinliang has joined #openstack-kolla01:09
*** wuchunyang has joined #openstack-kolla01:25
*** wuchunyang has quit IRC01:30
*** wuchunyang has joined #openstack-kolla02:15
r3ap3rI was able to take the same globals.yml file configuration and change the openstack_release to stein, from train, and it deployed with no issues. I hope this info helps.02:42
*** wuchunyang has quit IRC03:19
*** stingrayza has quit IRC04:08
*** openstackgerrit has quit IRC04:08
*** negronjl has quit IRC04:08
*** dmellado has quit IRC04:08
*** irclogbot_0 has quit IRC04:08
*** Reepicheep has quit IRC04:08
*** osmanlicilegi has quit IRC04:08
*** strigazi has quit IRC04:08
*** sean-k-mooney has quit IRC04:08
*** Jeffrey4l has quit IRC04:08
*** cosmicsound has quit IRC04:08
*** tbarron has quit IRC04:08
*** baha has quit IRC04:08
*** klindgren_ has quit IRC04:08
*** ianw has quit IRC04:08
*** larsks has quit IRC04:08
*** mjturek has quit IRC04:08
*** openstackstatus has quit IRC04:11
*** openstackstatus has joined #openstack-kolla04:13
*** ChanServ sets mode: +v openstackstatus04:13
*** goldyfruit has joined #openstack-kolla04:27
*** goldyfruit has quit IRC04:58
*** skramaja has joined #openstack-kolla05:08
*** rgogunskiy has joined #openstack-kolla05:12
*** rgogunskiy has quit IRC05:17
*** raukadah is now known as chkumar|rover05:22
*** gregoryo has joined #openstack-kolla05:59
*** sri_ has joined #openstack-kolla06:15
sri_Morning06:15
*** kozhukalov has joined #openstack-kolla06:24
yoctozeptomorning06:25
yoctozeptocosmicsound, r3ap3r: are you folks using kolla-ansible from the train branch to deploy train?06:29
*** oyrogerg has joined #openstack-kolla06:40
*** kozhukalov has quit IRC06:51
*** cah_link has joined #openstack-kolla06:58
*** rgogunskiy has joined #openstack-kolla07:03
*** k_mouza has joined #openstack-kolla07:06
*** gregoryo has quit IRC07:07
*** k_mouza has quit IRC07:10
*** pcaruana has joined #openstack-kolla07:16
*** sri_ has quit IRC07:51
hrwheloĊ‚07:57
mnasiadkamorning08:03
hrwhttps://review.opendev.org/698855 https://review.opendev.org/697354 https://review.opendev.org/557659 anyone? good for morning coffee time08:07
patchbotpatch 698855 - kolla - base: unify CentOS packages list - 4 patch sets08:07
patchbotpatch 697354 - kolla - add more tests for enable_repos template method - 8 patch sets08:07
patchbotpatch 557659 - kolla - Add Debian/source aarch64 CI job - 59 patch sets08:07
hrwall passed zuul08:07
*** factor has quit IRC08:08
*** factor has joined #openstack-kolla08:17
yoctozeptohmm, gerrit bot is gone huh08:19
hrwpatchbot: hop hop08:24
mnasiadkaseems it quit on a split and didn't come back ;)08:24
yoctozeptohrw: openstackgerrit08:30
hrwI have mail thread with Mellanox people. Just pointed them to report bugs upstream instead of mailing me.08:30
yoctozeptomnasiadka: yeah, reported to infra08:30
hrwyoctozepto: noticed. time for second coffee probably08:30
yoctozepto;D08:30
hrwhm. what to break today...08:31
*** rpittau|afk is now known as rpittau08:34
mnasiadkamerge your bloody change with ansible-lint fixes - I did a recheck twice and it fails on gates :D (not that the failure is change related...)08:34
*** ivve has joined #openstack-kolla08:35
hrwshit. I thought that it merged already08:36
yoctozeptobad luck08:36
hrw2019-12-12 14:18:15.160 30 ERROR oslo_db.sqlalchemy.engines pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')08:37
hrwfsck08:37
hrwrecheck sent08:38
hrwhttps://review.opendev.org/696062 anyone?08:39
patchbotpatch 696062 - kolla-ansible - CI: Use python3 for openstack clients - 8 patch sets08:39
mnasiadkahrw: may be related to yoctozepto's ubuntu mysql patch08:41
yoctozeptomnasiadka: which landed only in train, sure08:41
hrwjust looking at it with -1 at hand08:41
yoctozeptoblame yoctozepto why not :D08:41
mnasiadkayoctozepto: it didn't land yet, I'm not blaming anyone08:41
mnasiadkait's near-christmas, even I'm trying to be more polite then :D08:41
hrwyoctozepto: https://review.opendev.org/#/c/698957/3 commented08:41
patchbotpatch 698957 - kolla-ansible (stable/train) - Fix upgrades from older (<=10.1) MariaDB releases - 3 patch sets08:41
yoctozeptohrw: right08:44
yoctozeptomnasiadka: applied comment, need +2 back!08:44
hrw+208:44
yoctozeptohrw is now a biolinter for ansible08:45
hrwyoctozepto: I am shocked that you, being certified ansibler, make such childish errors.08:45
yoctozeptoxD08:46
yoctozeptoseems I don't agree with all style suggestions ansible-linter makes08:46
*** sm806 has quit IRC08:52
hrwhttps://review.opendev.org/#/c/696364/ https://review.opendev.org/#/c/689660/ https://review.opendev.org/#/c/696127/ - do we plan to merge extra CI scenarios or are they for test how much time it will take?08:52
patchbotpatch 696364 - kolla-ansible - CI: Test Swift - 23 patch sets08:52
patchbotpatch 689660 - kolla-ansible - CI: Test Zun with Cinder LVM backend (iSCSI) - 15 patch sets08:52
patchbotpatch 696127 - kolla-ansible - CI: Test Qinling - 4 patch sets08:52
*** sm806 has joined #openstack-kolla08:53
yoctozeptohrw: I guess the first two are in, the qinling and senlin are to be discussed08:56
*** shyamb has joined #openstack-kolla08:59
hrwthx09:00
*** dougsz has joined #openstack-kolla09:08
*** sm806 has quit IRC09:12
*** sm806 has joined #openstack-kolla09:13
hrwyoctozepto: "{{ ceph_storetype if scenario == 'ceph' else scenario }}" - are other ceph using jobs adapted to work with it?09:20
*** k_mouza has joined #openstack-kolla09:20
*** k_mouza has quit IRC09:21
*** k_mouza has joined #openstack-kolla09:21
hrwyoctozepto: there are 4 scenarios: ceph, cinder-lvm, zun, swift. old check was ceph or cinder-lvm. Looked like zun was using cinder-lvm here. now it will be zun.09:22
mnasiadkaand there will be 5th scenario soon ceph-ansible09:22
mnasiadkamaybe it makes sense to do this step once and for all?09:22
mnasiadkae.g. base it on zuul var?09:23
yoctozeptohrw, mnasiadka: I don't think we want to test filestore any longer09:25
yoctozeptothat would simplify the things09:25
yoctozeptoand the answer is yes, they are adapted09:25
mnasiadkayoctozepto: well, we will remove kolla-ceph in U, so it's not the correct time to do changes there09:26
hrwhttps://review.opendev.org/699129 https://review.opendev.org/698255 anyone?09:28
patchbotpatch 699129 - kolla - Docs: add new rules regarding release notes usage - 1 patch set09:28
patchbotpatch 698255 - kolla - Refactor Apache httpd setup - 4 patch sets09:28
*** cosmicsound has joined #openstack-kolla09:30
cosmicsoundr3ap3r thanks for feedback, trust me, been doing quite some reserch before i been asking here or raising bugs09:31
cosmicsoundyoctozepto whats a good read on kolla versioning09:31
cosmicsoundShould always be a step ahead from what i know09:31
yoctozeptocosmicsound: not sure what versioning you mean, branches are per openstack release09:34
yoctozeptoyou mean release notes?09:34
yoctozeptohttps://docs.openstack.org/releasenotes/kolla/train.html09:34
yoctozeptohttps://docs.openstack.org/releasenotes/kolla-ansible/train.html09:34
yoctozeptoin general you deploy kolla stein with kolla-ansible stein etc.09:35
hrwok, morning session with gerrit can be considered as done09:41
hrwhttps://review.opendev.org/#/c/695168/ https://review.opendev.org/#/c/697354/ https://review.opendev.org/#/c/698855/ anyone?09:42
patchbotpatch 695168 - kolla-ansible - Get rid of Python 2 support - 12 patch sets09:42
patchbotpatch 697354 - kolla - add more tests for enable_repos template method - 8 patch sets09:42
patchbotpatch 698855 - kolla - base: unify CentOS packages list - 4 patch sets09:42
hrwor https://review.opendev.org/#/c/698875/09:43
patchbotpatch 698875 - kolla - docker: fix 'Empty continuation line found' warnings - 2 patch sets09:43
mgoddardmorning all09:43
cosmicsoundyes thats what i meant to say09:45
cosmicsoundeach openstack release has a version that suits the kolla version09:46
cosmicsoundi upgraded from 8.0.2 to 9.0.0.0rc2 and will check again09:46
yoctozeptook09:46
*** wuchunyang has joined #openstack-kolla09:50
*** jbadiapa has joined #openstack-kolla09:52
hrwhm. debian/arm64 ci failed on upgrade job09:54
*** wuchunyang has quit IRC09:55
*** cah_link1 has joined #openstack-kolla10:04
*** strigazi has joined #openstack-kolla10:05
*** Jeffrey4l has joined #openstack-kolla10:05
*** mjturek has joined #openstack-kolla10:05
*** baha has joined #openstack-kolla10:05
*** cah_link has quit IRC10:06
*** cah_link1 is now known as cah_link10:06
*** larsks has joined #openstack-kolla10:06
*** osmanlicilegi has joined #openstack-kolla10:07
*** dmellado has joined #openstack-kolla10:07
*** ianw has joined #openstack-kolla10:07
*** Reepicheep has joined #openstack-kolla10:07
*** klindgren has joined #openstack-kolla10:07
*** stingrayza has joined #openstack-kolla10:07
*** negronjl has joined #openstack-kolla10:09
*** irclogbot_3 has joined #openstack-kolla10:09
hrwhttps://zuul.opendev.org/t/openstack/build/e9734357180d465dbf410784ae852ea2 - can someone tell me why?10:11
*** factor has quit IRC10:11
yoctozeptohrw: docker having a bad day10:14
hrwso recheck?10:14
yoctozeptoAPIError: 500 Server Error: Internal Server Error (\"ttrpc: closed: unknown\")10:14
yoctozeptofrom docker10:14
yoctozeptoso meh10:14
yoctozeptoyeah, recheck10:14
mgoddardyoctozepto loves to get a +2 in after +A :)10:15
yoctozeptomgoddard: hmm?10:15
mgoddardyoctozepto: just seeing a few emails with +2A then yoctozepto adds +210:18
mgoddardnot criticism, just observation10:18
yoctozeptomgoddard: ah10:18
yoctozeptosharing love10:19
*** xinliang has quit IRC10:19
*** cah_link1 has joined #openstack-kolla10:19
*** cah_link has quit IRC10:21
*** cah_link1 is now known as cah_link10:21
cosmicsoundit seems it fails also with all new kolla-ansible 9.0.0.0rc210:22
cosmicsoundAlways on Nova-API10:22
cosmicsoundOr Nova related stuff10:22
yoctozeptohttps://review.opendev.org/68602410:24
patchbotpatch 686024 - kolla-ansible - Custom CA certificates deployment - 27 patch sets10:24
yoctozeptolonger lecture guys10:24
yoctozeptocosmicsound: surely not on consoleauth :-)10:24
cosmicsoundnow it changed indeed10:28
yoctozeptothen a new issue10:31
yoctozeptomake sure you cleaned up after the previous b0rken deployment though10:32
yoctozeptoand ensure you updated your inventory file or alike10:32
*** shyamb has quit IRC10:34
*** gfidente has joined #openstack-kolla10:38
hrwyoctozepto: ;P10:39
hrwI have dejavu again10:39
mgoddardhrw: seems your ansible-lint change is allergic to zuul10:39
hrwthat too10:40
cosmicsoundgreat10:43
hrwhm. how to switch tripleo7 job to use py3...10:44
cosmicsoundnow it seems docker fails with docker.service: Start request repeated too quickly.10:44
mgoddardidea for more prechecks: check that all expected groups are in the inventory to avoid tricky ansible errors10:44
mgoddardalso, check that registry has all necessary images10:46
mgoddardI'm sure we could do better10:46
mgoddardany bug report containing a user error could be converted to a precheck?10:47
hrwgood idea10:47
cosmicsoundany idea what could had generated the daemon.json for docker service?11:01
cosmicsoundit seems this affects docker startup11:01
hrwcosmicsound: kolla-ansible generates it11:02
hrwfor quite a while11:02
cosmicsoundright11:02
cosmicsoundwell upon removing it, i was able to start docker11:02
cosmicsoundelse was failing11:02
hrwshow it?11:02
hrwok, once tripleo7 moves to use py3 to call kolla we can get rid of py2.11:03
cosmicsoundfor now is not there anymore11:03
cosmicsoundit seems wasnt yet generated11:03
hrwcosmicsound: then please try to reproduce11:03
cosmicsoundi will11:04
hrwthanks11:04
hrwI wrote that part of k-a11:04
cosmicsoundit had in fact this info in json format11:04
cosmicsoundmap[max-file:5 max-size:50m]11:04
cosmicsoundthats one thing im certain11:05
hrwugly indeed11:05
cosmicsoundthe error of docker was that the values were same in service11:05
cosmicsoundsame in daemon.11:05
cosmicsoundas per my understanding11:05
hrwyou had custom service?11:05
cosmicsoundno11:05
hrwas k-a generates both daemon.json and service but without using same stuff in both places11:06
cosmicsoundunless someone had changed it before without telling me11:06
hrwthere is one or two things which can only be set in service11:06
cosmicsoundwhat i did here if helps was to try to deploy train, and revert back to stein11:06
hrwzun is using one of them iirc11:06
*** cah_link has quit IRC11:07
*** cah_link has joined #openstack-kolla11:07
cosmicsoundin fact this one bug i opened leaded me to the error11:07
cosmicsoundhttps://bugs.launchpad.net/kolla-ansible/+bug/185649311:07
openstackLaunchpad bug 1856493 in kolla-ansible "Deploying Train fails on nova-consoleauth" [Undecided,Invalid]11:07
cosmicsoundwhen i just cleaned up and changed globals.yml to stein11:08
cosmicsoundsince with train we never had luck11:08
*** shyamb has joined #openstack-kolla11:10
*** wuchunyang has joined #openstack-kolla11:13
mgoddardhrw: care to replace your +2 here: https://review.opendev.org/#/c/698957/ ?11:14
patchbotpatch 698957 - kolla-ansible (stable/train) - Fix upgrades from older (<=10.1) MariaDB releases - 5 patch sets11:14
hrwdone11:15
hrwmgoddard: thanks for comments on enable_extras_repo stuff11:15
mgoddardyoctozepto, hrw, mnasiadka, osmanlicilegi: FYI today is my last full day until 2nd January. I expect I'll dip in over the break a few times11:15
mgoddardhrw: np11:15
hrwmgoddard: I will drop tripleo part. maybe separate patch later etc11:16
mnasiadkamgoddard: cool, good vacation11:16
hrwmgoddard: have fun11:17
mnasiadkayoctozepto, mgoddard: can we agree what is required to merge the fernet fix? I'm a bit tired ;-) https://review.opendev.org/#/c/698710/11:17
patchbotpatch 698710 - kolla-ansible - Initialize fernet keys before starting keystone co... - 15 patch sets11:17
mgoddardhrw: I'm just worried that enable_repos will block the tripleo centos8 port11:17
mgoddardmnasiadka: on my list for today11:17
hrwmgoddard: was thinking of adding '|| true' to dnf config-manager call11:18
mgoddard:)11:18
mgoddardthat would at least unblock them11:19
hrwprobably should write some kind of doc for this feature11:19
hrwand do some more tests11:19
hrwas real tests not write some mocks11:19
mgoddardthe problem is really that if you (tripleo or anyone else) modifies the repos then it might break11:20
mgoddarddo we need to make repos.yaml configurable?11:20
hrwprobably good option11:20
mgoddardwe should speak to cloudnull when he's awake11:20
hrwkolla-build --repos-file somewhere/repos.yaml11:20
mgoddardyep11:21
*** wuchunyang has quit IRC11:21
hrwmgoddard: speaking of yaml... source.yaml - abandon or rebase+merge?11:21
hrws/source/sources/11:21
mgoddardwhy would we abandon? maybe I missed something11:21
yoctozeptomgoddard, hrw, mnasiadka: speaking of ansible-lint 602, we are now (almost) merging https://review.opendev.org/#/c/694797/11/ansible/roles/ceph_pools.yml11:22
patchbotpatch 694797 - kolla-ansible - Some ansible-lint fixes - 11 patch sets11:22
hrwjust forgot about it for a while11:22
yoctozeptowhich changes != 0 to | length11:22
mnasiadkayoctozepto: so w-1 and change11:22
yoctozepto!= ''11:22
openstackyoctozepto: Error: "=" is not a valid command.11:22
mnasiadkawell, length is just obscurity11:22
yoctozeptoopenstack: no kidding, dear bot11:22
hrw!lsb_release -a11:22
openstackhrw: Error: "lsb_release" is not a valid command.11:22
yoctozepto!echo dupa11:22
openstackyoctozepto: Error: "echo" is not a valid command.11:22
*** rpittau is now known as rpittau|bbl11:22
yoctozeptoit can't be!11:22
mgoddardadded W-111:23
hrwthx11:23
* hrw out11:24
hrwbbl11:24
*** vmixor has joined #openstack-kolla11:26
yoctozeptoI +2 all limit backports - the impact is neglibible, better not run the risk of overflowing these11:28
*** wuchunyang has joined #openstack-kolla11:31
*** tbarron has joined #openstack-kolla11:41
*** hjensas has joined #openstack-kolla12:06
*** kplant has joined #openstack-kolla12:16
*** ivve has quit IRC12:22
*** pcaruana has quit IRC12:27
*** ivve has joined #openstack-kolla12:30
*** shyamb has quit IRC12:30
*** pcaruana has joined #openstack-kolla12:33
*** kplant has quit IRC12:39
*** kplant has joined #openstack-kolla12:39
*** kplant has quit IRC12:48
*** kplant has joined #openstack-kolla12:53
*** goldyfruit has joined #openstack-kolla13:09
*** rpittau|bbl is now known as rpittau13:09
*** rgogunskiy has quit IRC13:09
*** sm806 has quit IRC13:11
*** sm806 has joined #openstack-kolla13:12
mnasiadkamgoddard: replied to your comment on the healthchecks kolla merged change, no need to worry - the restart on failed healthcheck feature works only in Swarm13:16
mgoddardmnasiadka: oh. well that makes the whole thing a lot less useful13:17
mgoddardI thought that was the whole idea13:17
mnasiadkait was, but I was half way through when found out it works that way - we can always have custom docker container/script that restarts13:18
mnasiadkabut maybe for now it's good to leave that to the user - and not have thousands of complaints that healthchecks killed my mariadb :)13:18
mnasiadkasomebody wrote this - https://hub.docker.com/r/willfarrell/autoheal13:20
*** dougsz has quit IRC13:29
mgoddardmnasiadka: :(13:30
mgoddardwould have been good to raise that when discovered. perhaps I missed it13:31
hrwre13:31
mnasiadkaI think I haven't really raised it, was first focused on having something working13:32
hrwhttps://review.opendev.org/#/c/557659/ who will be the accepting person?13:32
patchbotpatch 557659 - kolla - Add Debian/source aarch64 CI job - 60 patch sets13:32
yoctozeptomnasiadka: so what do the healthchecks do now?13:32
mnasiadkayoctozepto: post an event with status Healthy or not, and you can easily check the output of the healthcheck command in docker inspect ;-)13:33
yoctozeptooh great13:33
yoctozeptokiller feature!13:33
mnasiadkawhat can I do, that Docker doesn't care about users :)13:33
* yoctozepto sad13:35
yoctozeptowell, no point crying over spillt milk13:35
mnasiadkawell, podman actually does the same13:35
yoctozeptohow do tripleo use them?13:35
mnasiadkayoctozepto: I doubt they have any systemd service or something similar that restarts the unhealthy containers13:37
*** goldyfruit has quit IRC13:37
mnasiadkalet's say it's rather a mean for users to quickly check if everything is all right from a very basic perspective :D13:37
yoctozeptoI see, could be, though it really limits its usefulness13:38
yoctozeptowell, anyway, no point in crying now13:38
yoctozeptolet's move on13:38
yoctozeptoceph ansible and OVN look promising13:38
mnasiadkayup, it can be used I guess for some monitoring systems or some other means13:38
mnasiadkayeah, adding relnotes to all those ceph changes13:38
mnasiadkaand trying to make OVN universal between centos and ubuntu... which is a bit of a pain due to the same but different versions :)13:39
mnasiadkahrw: you should wait until 29th March, then the change would have two years :)13:40
hrwmnasiadka: you assume that I will care about Kolla then? D:13:42
mnasiadkahrw: Just laughing - are you going somewhere? :D13:43
hrwmnasiadka: maybe. kind of bored sometimes13:44
*** dougsz has joined #openstack-kolla13:46
hrwmnasiadka: so where is your +w?13:47
*** sm806 has quit IRC13:49
*** sm806 has joined #openstack-kolla13:50
yoctozeptohrw: bored with us? no way!13:50
hrwdocker--13:52
yoctozeptoyeah, I prefer the ansible work13:54
*** openstackgerrit has joined #openstack-kolla13:57
openstackgerritRadosĊ‚aw Piliszek proposed openstack/kolla-ansible stable/train: Template custom HAProxy service configuration  https://review.opendev.org/69828413:57
openstackgerritRadosĊ‚aw Piliszek proposed openstack/kolla-ansible stable/train: [neutron] Adjust neighbour table thresholds  https://review.opendev.org/69918913:58
openstackgerritRadosĊ‚aw Piliszek proposed openstack/kolla-ansible stable/train: Support configuration of Docker client timeout  https://review.opendev.org/69825713:58
hrwyoctozepto: I prefer kolla part ;d14:05
yoctozepto;D14:05
yoctozeptostill afraid of E602, huh? ;D14:05
hrwyoctozepto: do not give a shit about it. project decided to ignore E602 so will fix patch to ignore them14:06
yoctozeptoxD14:06
mgoddardyoctozepto: you are +2 baiting me14:12
*** tonythomas has joined #openstack-kolla14:16
yoctozeptomgoddard: oh noez, now you know ;p14:18
yoctozeptoI feel bad for missing that duplication though14:19
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Some ansible-lint fixes  https://review.opendev.org/69479714:20
hrwno E602 fixes14:20
hrwAArch64 CI on gate!14:20
mgoddardyoctozepto: that is why we split changes - easy to miss things in a big one14:21
mgoddardw00p14:21
yoctozeptow00p w00p14:24
* hrw off again14:24
*** wuchunyang has quit IRC14:34
*** wuchunyang has joined #openstack-kolla14:36
*** rgogunskiy has joined #openstack-kolla14:44
openstackgerritMerged openstack/kolla-ansible stable/train: Fix upgrades from older (<=10.1) MariaDB releases  https://review.opendev.org/69895714:45
mgoddardw00p w00p w00p ^14:46
mgoddardok can we release train now? :)14:47
kplant:o14:47
mgoddardkplant: we were very close last week but some dumb mariadb upgrade bug hit us14:48
kplantgood to seee mariadb is sticking to its guns14:49
*** rgogunskiy has quit IRC14:49
mgoddardthey never fail to disappoint14:51
kplanti would say they never fail to not disappoint14:55
*** chkumar|rover is now known as ignoreirc14:57
*** ignoreirc is now known as chkumar|rover14:58
mgoddardyoctozepto, hrw, mnasiadka, osmanlicilegi: want a meeting this week or shall I cancel?15:01
mgoddard(I will not be present)15:01
mnasiadkaI guess we can talk ad-hoc if needed, unless there is something very urgent in the agenda15:02
*** KeithMnemonic has joined #openstack-kolla15:02
*** wuchunyang has quit IRC15:03
*** schwicht has quit IRC15:06
*** schwicht has joined #openstack-kolla15:07
*** mloza has quit IRC15:08
*** andreykurilin has joined #openstack-kolla15:16
*** cah_link has quit IRC15:17
andreykurilinhi folks! I have an issue while building sensu-client image (error happens while instaling one of sensu-plugins). Can anyone help me with it?15:21
*** ivve has quit IRC15:21
*** goldyfruit has joined #openstack-kolla15:23
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables  https://review.opendev.org/69830315:29
hrwandreykurilin: logs help15:33
yoctozeptohrw is right, my magic ball is off limits atm15:35
yoctozeptomgoddard: no need for meeting15:35
yoctozeptowell, the only known issue with train specifically15:35
yoctozeptois the ugly check for installation15:36
hrwguys, can we finally release train and stop worrying about it's release?15:36
hrwand move to worrying about reported bugs?15:36
hrwstuff not released does not exist == users deploy stein15:36
mgoddardyoctozepto: yeah, not blocking on the check. RC3 is in the oven15:37
mgoddard9.0.1 for the check15:37
hrwnumbers...15:38
hrwcan we (for next release) start with RELEASENUMBER.99.0 for NEXTRELEASE builds?15:38
hrwnow train will be 9.0.0 and ussuri builds are 9.1.015:39
hrwbtw - https://review.opendev.org/#/c/699024 - what do you think of my comment?15:41
patchbotpatch 699024 - tripleo-ci - ppc64le: Add altarch_excludes var for non x86 cont... - 3 patch sets15:41
yoctozeptoI agree to release15:45
*** goldyfruit has quit IRC15:45
*** rfxn has joined #openstack-kolla15:49
rfxnI'm a little confused on the kolla-ansible rocky release trees vs previous releases -- why does rocky have 7.0.1 and 7.1.2?15:50
openstackgerritMerged openstack/kolla master: Add Debian/source aarch64 CI job  https://review.opendev.org/55765916:03
hrwYAY! Closed Jira card!16:06
* hrw -> bar 16:11
*** dougsz has quit IRC16:11
*** chkumar|rover is now known as raukadah16:14
yoctozeptorfxn: 7.1.2 is the latest rocky16:17
yoctozeptowe move minor version for bigger-than-just-fix stuff I guess16:18
*** goldyfruit has joined #openstack-kolla16:20
*** dougsz has joined #openstack-kolla16:25
mjturekyoctozepto: how could we detect that the image cannot be built before generating dockerfiles?16:27
openstackgerritViktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone.  https://review.opendev.org/67457916:31
mjturekahhh I see yoctozepto a list is kept in image/build.py16:34
yoctozeptomjturek: by inspecting kolla unbuildable images dictionary16:34
mjturekyep just saw :)16:34
yoctozepto+1 for the same time16:34
yoctozeptoperfect timing16:34
mjturekdo you know Marcin's nick?16:35
mjtureklol indeed16:35
yoctozeptoMarcin is hrw here16:35
yoctozeptohe is off to bar though16:35
mjturekyoctozepto: fair enough, think it's okay for me to submit the patch then?16:35
yoctozeptogo ahead with anything you have in mind16:36
yoctozeptowe'll judge :-)16:36
mjturekawesome, thanks!16:36
cloudnullo/ saw the ping. what's up ?16:45
*** tonythomas has quit IRC16:46
yoctozeptocloudnull: could be that "tripleo" triggers you? :-)16:47
cloudnullno those pings get suppressed :D16:48
mnasiadkathat would be sad, if we could summon cloudnull just complaining over tripleo16:49
mnasiadka:)16:49
yoctozeptoI did not summon cloudnull, nor remember someone doing so16:51
yoctozeptomgoddard> we should speak to cloudnull when he's awake16:51
yoctozeptobut it was more than 5 h ago16:52
openstackgerritMerged openstack/kolla-ansible stable/train: Template custom HAProxy service configuration  https://review.opendev.org/69828416:52
mgoddardcloudnull: indeed I pinged16:53
cloudnullyoctozepto: yeah, I'm responding to that ping. is there something in the works that I should be working on / reviewing ?16:53
* mgoddard scrolls up to remember context16:53
cloudnullo/ mgoddard16:53
mgoddardaha16:54
mgoddard"do we need to make repos.yaml configurable?"16:54
mgoddardcloudnull: so we have a new 'feature' in kolla - try to disable package repos by default where possible16:54
mgoddardhttps://blueprints.launchpad.net/kolla/+spec/repos-off-by-default16:55
mgoddardhttps://review.opendev.org/#/c/695465/16:55
patchbotpatch 695465 - kolla - Enable repos only when needed (MERGED) - 18 patch sets16:55
mgoddardI think it will break centos8 tripleo in its current form however16:55
* cloudnull reading 16:55
mgoddardcloudnull: we have added this repos.yaml file: https://review.opendev.org/#/c/695465/18/kolla/template/repos.yaml16:56
patchbotpatch 695465 - kolla - Enable repos only when needed (MERGED) - 18 patch sets16:56
cloudnullOK.16:57
* cloudnull reading the bp 16:57
mgoddardcloudnull: so we now have these macros to enable repos: https://review.opendev.org/#/c/695465/18/docker/zun/zun-compute/Dockerfile.j216:58
patchbotpatch 695465 - kolla - Enable repos only when needed (MERGED) - 18 patch sets16:58
mgoddardin centos7 generates, yum-config-manager --enable ceph16:58
mgoddardin centos8, generates dnf config-manager --enable ceph16:58
mgoddardit seems that while yum doesn't care if the repo exists, dnf does16:59
mgoddardso the command silently fails on c716:59
cloudnullinteresting.16:59
mgoddardit 'works' on rhel8 because there are no entries under 'rhel' in repos.yaml17:00
mgoddardand we ignore missing entries due to differences in distro etc. they may not exist17:00
cloudnullso it looks like we'll just need to come up with an override for repos.yaml -- if im reading this all right ?17:00
mgoddardcloudnull: right. There's no override mechanism currently, but it wouldn't be too hard to add one17:01
cloudnull++17:01
mgoddardthere's been a bit of discussion in https://review.opendev.org/697354, trying to work out exactly what's going on17:02
patchbotpatch 697354 - kolla - add more tests for enable_repos template method - 8 patch sets17:02
mgoddardjust added you as a reviewer17:02
cloudnull++17:02
mgoddardmy main concern is that it will block your centos8 port17:02
* cloudnull reading that now 17:02
mgoddardFYI I will be out from tomorrow until 2nd Jan17:03
cloudnullnice17:03
cloudnullenjoy your PTO :)17:03
mgoddardthanks :)17:03
mgoddardI don't know how the tripleo c8 port is going, but get in touch if we're blocking17:04
openstackgerritMerged openstack/kolla-ansible stable/train: Support configuration of Docker client timeout  https://review.opendev.org/69825717:05
*** ricolin has quit IRC17:06
cloudnullwe have a build job which "Should" catch any failures related to these changes.17:07
cloudnullhowever, if something comes up we'll let you know. for now I wouldn't block https://review.opendev.org/#/c/697354/ on us. Seems like a good overall change and if there's something we need to do to handle the changes we'll adjust.17:08
patchbotpatch 697354 - kolla - add more tests for enable_repos template method - 8 patch sets17:08
* cloudnull really appreciates the heads up 17:09
*** goldyfruit has quit IRC17:17
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/stein: Configure region_name in cloudkitty.conf  https://review.opendev.org/69925017:18
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/stein: Use'openstack_region_name' in cloudkitty collectors and fetchers  https://review.opendev.org/69925117:18
openstackgerritPierre Riteau proposed openstack/kolla-ansible master: Update section names in cloudkitty config  https://review.opendev.org/69925317:35
*** k_mouza has quit IRC17:36
yoctozeptomgoddard: will we promote train to release?17:41
mgoddardyoctozepto: yes17:42
yoctozeptohttps://review.opendev.org/#/c/698693/217:42
patchbotpatch 698693 - releases - Release kolla and kolla-ansible 9.0.0 for Train - 2 patch sets17:42
yoctozeptoyea17:42
yoctozeptogood17:42
mgoddardjust pinged, hopefully soon17:42
yoctozeptoall right17:42
*** goldyfruit has joined #openstack-kolla17:43
kplantoooh nice17:44
yoctozeptoSean w+1'ed17:44
yoctozeptoit will be released17:45
yoctozeptohoorray :D17:45
kplantany special steps needed for s->t ?17:45
yoctozeptokplant: just the usual ones (e.g. refresh inventory) unless you run tacker17:46
kplantvery nice. good job :-)17:46
yoctozeptotacker played dirty and had to be punished17:46
kplantso i have a weird question... is it possible to move from using venvs to... not using venvs with the same deployment?17:47
kplantreason i ask.. i had ceph and openstack control plane collocated in the same OS17:47
kplanti no longer have that, no longer need the venvs17:47
yoctozeptokplant: venvs are much cleaner :-)17:48
mgoddardkplant: +117:48
yoctozeptoyou mean venv for python on ansible target nodes?17:49
kplantcorrect17:49
*** jcmdln has joined #openstack-kolla17:50
yoctozeptoI don't see why you would want to drop venv but meh - unfortunately I think it takes rebootstrapping to install the deps but you can do that manually17:51
yoctozeptoI guess it is just the kolla for python bindings17:51
kplantah17:51
kplanti will keep them then :-]17:51
yoctozepto:D17:51
kplantthey might come in handy for the 2to3 upgrade, idk17:52
yoctozeptokplant: you centos17:53
yoctozepto?17:53
kplantyes17:53
yoctozeptothen reinstallation awaits :-)17:53
kplanttrue story17:54
yoctozeptobecause you need c8 for ussuri17:54
kplant7->817:54
kplantyeah i look forward to that actually17:54
yoctozeptoand there is no upgrade17:54
kplantyeah i wouldn't want to upgrade a major release like that on a non-rolling distro17:54
yoctozeptothis is unfortunately a major pain point in here17:54
kplantthe 6->7 upgrade hack was horrendous17:54
yoctozeptodeb/ubu does it much better17:54
kplanthey.. centos stream solves the problem for good right??17:54
kplantwho knows how well rh can do rolling releases17:54
yoctozeptokind of, I hope at least17:54
kplant^17:55
kplantthat's something that gentoo has really been good at for 20+ years17:55
yoctozeptoin my life I did 2 major version upgrade of debian and ubuntu17:55
yoctozepto14.04->16.04->18.04 for ubuntu17:55
yoctozeptoand debian 5->6->717:55
yoctozeptowith no major issues17:56
kplantoh man17:56
kplantdebian sarge, is that right?17:56
kplantoh no, that was 317:56
yoctozeptono17:56
kplantlonger ago than i thought17:56
yoctozeptolenny->squeeze?->wheezy17:56
kplantsince working here for 6+ years, anything that's not EL* doesn't exist :-(17:56
kplanti'm out of touch with the good stuff17:57
yoctozeptoEL is nice, I actually feel less disturbed than with minor upgrades on ubuntu ;-)17:57
yoctozeptomajor ones are out of scope though xD17:57
kplantignoring fedora, i don't mind the major lag with releases compared to everyone else since it's for the "enterprise"17:57
kplantbut it's just... not as cool17:58
kplantnot as fun17:58
kplantbut that's fine, it's for the enterprise17:58
*** goldyfruit has quit IRC17:58
mnasiadkaone thing is not being cool, second thing crawling around the internet to find a repo hosting something with a normal version17:58
mnasiadkaor building it yourself *sigh*17:58
mnasiadkaI miss using Ubuntu17:58
openstackgerritPierre Riteau proposed openstack/kayobe-config-dev master: Synchronise with kayobe-config for Train  https://review.opendev.org/69926117:58
kplantmaybe if a company that isn't canonical took the project i would use it17:59
kplantand if it weren't ripped from debian-testing17:59
*** rgogunskiy has joined #openstack-kolla18:00
kplantso for s->t: merge inventory, merge globals.yml, pull, upgrade, fin ?18:01
yoctozeptokplant: should be18:01
kplantappreciate it18:01
yoctozeptoI will be testing that out on my semi-production18:01
kplantyeah i'm going to probably create a simple virt cluster18:02
kplantthen drop it in the lab18:02
yoctozeptojust now I have a ton of other things to do18:02
kplantsee what happens18:02
yoctozeptoyear ending :-)18:02
kplantthankfully the rest of my year is free18:02
kplantthanks to people not knowing the difference between single mode fiber and multimode fiber18:02
kplantmy whole deployment is screwed18:02
openstackgerritOpenStack Release Bot proposed openstack/kolla-cli stable/train: Update .gitreview for stable/train  https://review.opendev.org/69926218:03
openstackgerritOpenStack Release Bot proposed openstack/kolla-cli stable/train: Update TOX/UPPER_CONSTRAINTS_FILE for stable/train  https://review.opendev.org/69926318:03
openstackgerritOpenStack Release Bot proposed openstack/kolla-cli master: Update master for stable/train  https://review.opendev.org/69926418:03
*** rgogunskiy has quit IRC18:05
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support  https://review.opendev.org/69684118:06
*** dougsz has quit IRC18:10
*** k_mouza has joined #openstack-kolla18:10
*** k_mouza has quit IRC18:15
*** k_mouza has joined #openstack-kolla18:17
osmanlicilegimgoddard: +1 for no meeting this week. sorry for the delay.18:28
*** k_mouza has quit IRC18:30
openstackgerritDincer Celik proposed openstack/kolla-ansible master: WIP: Docker image pruning  https://review.opendev.org/69869418:32
openstackgerritDincer Celik proposed openstack/kolla-ansible master: WIP: Docker image pruning  https://review.opendev.org/69869418:38
kplanthmmm... my kolla build exploded on stable/train18:40
kplantshould i wait for the official release before complaining?18:41
mnasiadkago big, complain before the release18:41
kplantlol18:41
mnasiadkawhat exploded? :)18:41
kplantscrolling through the buffer to see the problem18:42
kplantmonasca totally monopolized the buffer18:43
kplanti might re-run without monasca so it's easier to read18:43
openstackgerritMerged openstack/kayobe master: Switch default IPA images to centos  https://review.opendev.org/69904618:51
*** rpittau is now known as rpittau|afk18:55
*** gfidente is now known as gfidente|afk18:57
mjturekyoctozepto was doing some work on the patch but I'm a bit confused, the dict exists to stop a build from happening here https://github.com/openstack/kolla/blob/master/kolla/image/build.py#L1027 right?19:08
mjturekshouldn't filter images control handle this?19:09
openstackgerritViktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone.  https://review.opendev.org/67457919:10
mjturekyoctozepto it seems like we're hitting a bug because sometimes it doesn't build  https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1837/logs/logs/build.log19:12
mjturekand sometimes it tries to https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1836/logs/logs/build.log19:12
mjturekaware of any bug that would make such a thing non-deterministic?19:16
*** dougsz has joined #openstack-kolla19:23
kplantmnasiadka: i think it's a layer 8 issue19:26
kplantsomeone may or may not have forgotten "docker login" first19:26
openstackgerritMerged openstack/kolla-ansible master: External Ceph: template cinder backend config when cinder_backend_ceph  https://review.opendev.org/69830119:34
*** kozhukalov has joined #openstack-kolla19:36
*** rgogunskiy has joined #openstack-kolla19:42
*** noxoid_ is now known as noxoid19:43
*** jbadiapa has quit IRC19:46
*** kozhukalov has quit IRC19:51
*** kozhukalov has joined #openstack-kolla19:51
kplantyeah total false alarm, my robot account expired for my docker registry19:52
*** rgogunskiy has quit IRC19:55
*** k_mouza has joined #openstack-kolla20:10
*** rgogunskiy has joined #openstack-kolla20:17
*** vmixor has quit IRC20:22
*** k_mouza has quit IRC20:22
*** rgogunskiy has quit IRC20:36
*** dougsz has quit IRC20:36
kplantERROR:kolla.common.utils:horizon Failed with status: building20:50
kplantERROR:kolla.common.utils:neutron-infoblox-ipam-agent Failed with status: matched20:50
kplantERROR:kolla.common.utils:neutron-server Failed with status: building20:50
kplanthmmm.. i'll investigate more tomorrow20:50
kplantERROR:kolla.common.utils:neutron-server-opendaylight Failed with status: matched20:50
kplantERROR:kolla.common.utils:neutron-server-ovn Failed with status: matched20:50
*** kplant has quit IRC20:51
*** factor has joined #openstack-kolla21:13
*** TrevorV has joined #openstack-kolla21:28
*** patchbot has quit IRC21:30
*** patchbot has joined #openstack-kolla21:31
*** TrevorV has quit IRC21:35
*** rgogunskiy has joined #openstack-kolla21:38
*** goldyfruit has joined #openstack-kolla21:44
*** rgogunskiy has quit IRC21:47
*** rgogunskiy has joined #openstack-kolla21:47
*** pcaruana has quit IRC21:55
*** kozhukalov has quit IRC22:18
*** mloza has joined #openstack-kolla22:19
r3ap3ryoctozepto and cosmicsound this has been the "quickstart" guide I have been following: https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html   not sure if "latest" means train or not? Sorry for the late response, been way for a while. I am doing a clean deploy of an all-in-one deployment before deploying to my physical equipment.22:23
r3ap3rIf it matters, I am also using the python "virtual environment" instructions.22:26
*** rgogunskiy has quit IRC22:35
cosmicsoundany idea why i receive in stein --os-compute-api-version 2.55 or later is required22:36
cosmicsoundwhen trying to make a new flavour22:36
r3ap3rcosmicsound I have only been studying up on OpenStack since August so unfortunately, I am not much help. lol My current environment is running oVirt 4.3, trying to migrate over to OpenStack.22:39
*** gfidente|afk has quit IRC22:48
*** k_mouza has joined #openstack-kolla23:36
*** k_mouza_ has joined #openstack-kolla23:41
*** k_mouza has quit IRC23:41
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Include a reference to the globally configured Certificate Authority to all services. Services use the CA to verify HTTPs connections.  https://review.opendev.org/69931223:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!