Thursday, 2019-07-11

« Wednesday, 2019-07-10 Index Friday, 2019-07-12 »
*** Sravan has joined #openstack-kolla00:51
*** Sravan has quit IRC00:55
*** hongbin has joined #openstack-kolla00:57
*** dims has joined #openstack-kolla00:59
*** zhanglong has quit IRC01:08
*** zhanglong has joined #openstack-kolla01:20
*** zhanglong has quit IRC01:21
*** lei-zh has joined #openstack-kolla01:44
*** serhatd has quit IRC01:47
*** LaurentDumont has joined #openstack-kolla01:47
*** irclogbot_0 has joined #openstack-kolla02:06
*** irclogbot_0 has quit IRC02:13
*** KeithMnemonic has quit IRC02:13
*** irclogbot_3 has joined #openstack-kolla02:16
*** altlogbot_1 has joined #openstack-kolla02:18
*** irclogbot_3 has quit IRC02:19
*** kplant has quit IRC02:30
*** BjoernT has quit IRC02:34
*** altlogbot_1 has quit IRC02:34
*** Sravan has joined #openstack-kolla02:54
*** skramaja has joined #openstack-kolla03:14
*** skramaja has quit IRC03:14
*** irclogbot_0 has joined #openstack-kolla03:20
*** whoami-rajat has joined #openstack-kolla03:20
*** whoami-rajat has quit IRC03:24
*** whoami-rajat has joined #openstack-kolla03:25
*** irclogbot_0 has quit IRC03:25
*** lei-zh1 has joined #openstack-kolla03:32
*** lei-zh has quit IRC03:34
*** hongbin has quit IRC03:44
*** altlogbot_0 has joined #openstack-kolla03:54
*** dannins has joined #openstack-kolla03:54
*** altlogbot_0 has quit IRC03:59
*** BjoernT has joined #openstack-kolla04:16
*** LaurentDumont has quit IRC04:33
*** lei-zh1 has quit IRC04:50
openstackgerritgugug proposed openstack/kolla-cli master: test  https://review.opendev.org/67022804:55
*** pcaruana has joined #openstack-kolla04:55
*** lei-zh has joined #openstack-kolla05:00
openstackgerritKylian Mbappé proposed openstack/kolla-ansible master: Testing Masakari role in gate  https://review.opendev.org/61605005:07
*** shyamb has joined #openstack-kolla05:09
*** Sravan has quit IRC05:11
*** Sravan has joined #openstack-kolla05:13
*** Sravan has quit IRC05:18
*** skramaja has joined #openstack-kolla05:34
*** cah_link has joined #openstack-kolla05:41
*** Luzi has joined #openstack-kolla05:43
*** BjoernT has quit IRC05:49
*** shyamb has quit IRC05:53
*** lei-zh has quit IRC06:01
*** wangweiDavid has joined #openstack-kolla06:04
*** lei-zh has joined #openstack-kolla06:05
openstackgerritgugug proposed openstack/kolla-cli master: Cap bandit below 1.6.0 version  https://review.opendev.org/67023406:10
openstackgerritgugug proposed openstack/kolla-cli master: Add bandit test into pep8 section  https://review.opendev.org/67023506:10
*** shyamb has joined #openstack-kolla06:10
openstackgerritgugug proposed openstack/kolla-cli master: Cap bandit below 1.6.0 version and add it into pep8 section  https://review.opendev.org/67023406:13
*** altlogbot_0 has joined #openstack-kolla06:18
*** altlogbot_0 has quit IRC06:23
yoctozeptomorning06:24
*** altlogbot_2 has joined #openstack-kolla06:24
*** altlogbot_2 has quit IRC06:29
*** dpawlik has joined #openstack-kolla06:29
*** hamdyk has joined #openstack-kolla06:30
openstackgerritgugug proposed openstack/kolla-cli master: Add cover test into tox  https://review.opendev.org/67023506:30
*** rpittau|afk is now known as rpittau06:33
openstackgerritgugug proposed openstack/kolla-cli master: Move cli_setup.py into tools  https://review.opendev.org/67022806:39
*** luksky11 has joined #openstack-kolla06:39
openstackgerritgugug proposed openstack/kolla-cli master: Move cli_setup.py into tools  https://review.opendev.org/67022806:40
*** shyamb has quit IRC06:51
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test MariaDB failures in CI  https://review.opendev.org/67017006:56
*** altlogbot_2 has joined #openstack-kolla06:56
openstackgerritMark Goddard proposed x/kayobe master: CI: Don't create an external network in init-runonce  https://review.opendev.org/67013106:58
openstackgerritwangwei proposed openstack/kolla master: Support multipath disk for bluestore in kolla  https://review.opendev.org/59996107:00
*** altlogbot_2 has quit IRC07:01
*** serhatd has joined #openstack-kolla07:01
yoctozeptomgoddard: as lucky as we are, trying to test mariadb found another bug07:03
yoctozeptohttps://bugs.launchpad.net/kolla-ansible/+bug/183615107:03
openstackLaunchpad bug 1836151 in kolla-ansible train "glance-api deployed on all nodes despite using file backend" [High,Triaged]07:03
*** ivve has joined #openstack-kolla07:04
*** shyamb has joined #openstack-kolla07:05
mnasiadkamorning07:08
mnasiadkayoctozepto: should we really support file backend in multinode? :)07:09
yoctozeptomnasiadka: well, it's simpler than ceph07:12
mnasiadkayoctozepto: yeah, but I mean multinode means HA07:12
yoctozeptomnasiadka: yup, in real life not supported07:13
mnasiadkayoctozepto: with Glance being a hard requirement for Nova, the whole install is not HA.07:13
yoctozeptobut ideal for CI now07:13
yoctozeptounless you have a better idea07:13
openstackgerritwangwei proposed openstack/kolla-ansible master: Support multipath disk for bluestore in kolla-ansible  https://review.opendev.org/59996207:13
yoctozeptoI'm open for CI improvement discussion07:13
yoctozeptoand regression is a regression ;-)07:14
mnasiadkayoctozepto: other idea is to deploy swift and use that :)07:14
yoctozeptomnasiadka: no, no, no ;D07:15
yoctozeptojoking aside, it would be nice to deploy with swift07:15
yoctozeptobut since it is not tested afaik07:15
yoctozeptoit will probably open another pandora box07:15
*** irclogbot_3 has joined #openstack-kolla07:16
*** irclogbot_3 has quit IRC07:21
*** lei-zh has quit IRC07:22
*** irclogbot_0 has joined #openstack-kolla07:24
*** irclogbot_0 has quit IRC07:27
*** dougsz has joined #openstack-kolla07:27
*** lei-zh has joined #openstack-kolla07:28
*** Wasaac has joined #openstack-kolla07:31
mgoddardmorning all07:33
*** shyamb has quit IRC07:39
*** lei-zh has quit IRC07:40
*** lei-zh has joined #openstack-kolla07:41
egonzalezI think this patch broke ODL and likely other neutron subprojects https://review.opendev.org/#/c/663436/07:42
egonzalezis backported to rocky/stein, so the patch or revert will need to carry over stable branches too07:43
*** altlogbot_0 has joined #openstack-kolla07:48
*** altlogbot_0 has quit IRC07:49
mgoddardegonzalez: yeah, I agree07:49
mgoddardegonzalez: I asked the author why they made the change07:49
egonzalezmgoddard no idea about whats the reasoning behind that, but if tripleo recalls also on the migration of all subprojects they probably have issues07:50
mgoddardegonzalez: generally they don't use KOLLA_BOOTSTRAP or KOLLA_UPGRADE. A few uses of KOLLA_BOOTSTRAP07:52
*** irclogbot_1 has joined #openstack-kolla07:52
mgoddard(check tripleo-heat-templates)07:52
mgoddardcloudnull: I don't think it affects tripleo, but just in case - see the last comment on https://review.opendev.org/#/c/663436/07:53
mgoddardyoctozepto: I'm looking at that glance issue07:53
*** irclogbot_1 has quit IRC07:55
*** jaicaa_ has quit IRC07:55
*** jaicaa has joined #openstack-kolla07:56
openstackgerritgugug proposed openstack/kolla-ansible master: Remove the cloudKitty to cloudkitty  https://review.opendev.org/67024408:04
*** irclogbot_1 has joined #openstack-kolla08:08
openstackgerritgugug proposed openstack/kolla-ansible master: Rename the cloudKitty to cloudkitty  https://review.opendev.org/67024408:09
*** irclogbot_1 has quit IRC08:12
yoctozeptomgoddard: you are right there, we are only wasteful in there08:15
yoctozeptoalso, there is another source of trouble for us08:15
yoctozeptoalas*08:15
yoctozeptohttps://etherpad.openstack.org/p/KollaWhiteBoard08:15
yoctozeptoHidden issues with random inventory source08:16
yoctozeptodue to non-stable inventory we might get a different "first" node on each playbook run08:16
yoctozeptoI think someone has already raised this point with regards to rabbitmq08:17
yoctozeptobut it seems it might affect more services08:17
*** JangwonLee has joined #openstack-kolla08:17
mgoddardyoctozepto: why is the inventory unstable?08:17
yoctozeptoi tried to list all instances hit by |first or [0]08:17
yoctozeptomgoddard: because yaml ordering is irrelevant08:17
yoctozeptounlike ini ordering08:17
mgoddardthis is the zuul inventory?08:18
yoctozeptoyah, zuul uses yaml08:18
yoctozeptoone user once said they use yaml and have issues with rabbitmq08:18
yoctozepto(issues with constant reconfiguring)08:18
mgoddardbut we generate an ini inventory for kolla-ansible, and the primary zuul node always becomes the first host08:18
yoctozeptomgoddard: nope, nope?08:19
*** JangwonLee_ has quit IRC08:20
yoctozeptoexactly how I found my issues08:21
yoctozeptohttp://logs.openstack.org/70/670170/3/check/kolla-ansible-ubuntu-source-upgrade-multi/a1a796f/primary/ara-report/08:21
yoctozepto^ here secondary2 is first08:21
yoctozeptosometimes secondary108:21
yoctozeptosometimes primary08:21
*** k_mouza has joined #openstack-kolla08:21
yoctozeptodepends on your luck08:21
yoctozeptoI see, we do generate ini08:22
yoctozeptoso it's stable across the single job08:22
yoctozeptobut not between jobs08:22
yoctozeptothat can be amended by sorting in fact08:22
mgoddardah, I see08:24
mgoddardyeah sorting would help08:24
*** dougsz has quit IRC08:27
*** Wasaac has quit IRC08:28
*** gkadam has joined #openstack-kolla08:28
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix glance with file backend  https://review.opendev.org/67024708:28
ohwhyosaMorning!08:32
ohwhyosaMonasca: fatal: [192.168.200.11]: FAILED! => {"attempts": 10, "cache_control": "no-cache", "changed": false, "connection": "close", "content": "<html><body><h1>503 Service Unavailable</h1>\nNo server is available to handle this request.\n</body></html>\n", "content_type": "text/html", "elapsed": 0, "msg": "Status code was 503 and not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "status": 503,08:32
ohwhyosa"url": "http://192.168.200.100:3001/login"}08:32
ohwhyosaOn [monasca : Wait for Monasca Grafana to load]08:32
ohwhyosaReading through the logs and the playbook08:34
ohwhyosaIt seems it is not deploying monasca-grafana, only monasca-agent (and zookeeper)08:35
ohwhyosaOnly relevant vars are "enable_monasca" and "monasca_install_type" which are yes and source, respectively08:37
mgoddardohwhyosa: monasca-grafana should get deployed on hosts in the monitoring group (see the inventory)08:37
ohwhyosamgoddard: As always, bullseye!08:38
ohwhyosaLemme try now08:38
*** shyamb has joined #openstack-kolla08:41
ohwhyosaWhen updating just horizon by pulling a newer image tag08:47
ohwhyosaShould the plugins be updated as well, or do I have to specify them?08:47
stingrayzamorning folks.08:48
stingrayzajust read through yesterdays meeting08:48
stingrayzamgoddard: congrats! is this your first?08:48
mgoddardmorning stingrayza, thanks! yes it's #108:49
mgoddardlots of learning to do08:49
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test MariaDB failures in CI  https://review.opendev.org/67017008:52
ohwhyosamgoddard This reminds me that I read it, but didn't get to tell you happy parenting!08:52
ohwhyosaIt has to be a mix between scary and happy, creating human life08:52
ohwhyosaor must be, I always mix my modals08:53
stingrayzabest of luck, you're going to need it. its an incredibly rewarding adventure, but also some of the hardest learning I ever faced...08:53
ohwhyosastingrayza: You a parent too?  Several kids?08:54
stingrayzamgoddard: just remember - everyone and their aunt is going to be giving you advice of some sort (here I am doing it!) - take what you want from it and discard the rest, otherwise you'll go insane trying to follow completely contradictory things08:54
stingrayzaohwhyosa: just the one - eight year old son :)08:55
mgoddardthere is certainly plenty of advice around08:56
ohwhyosaI don't know where you are from, but here it is somewhat common to have people coo and touch your baby, which I always found horrifying, specially old ladies for some reason08:59
ohwhyosaI'm guessing it is a weird cultural thing of us08:59
yoctozeptomgoddard: good and bad (at once) thing about mariadb there have been no mariadb issues in that test change08:59
ohwhyosa<openstackgerrit "Radosław Piliszek proposed opens"> yoctozepto: This one?08:59
yoctozeptoohwhyosa: so where are you living?09:00
mgoddardyoctozepto: how many runs?09:00
ohwhyosa<stingrayza "ohwhyosa: just the one - eight y"> So he can already lie, good, good, that's like one of the most entertaining ages09:00
yoctozeptomgoddard: well, almost all upgrades failed on glance09:00
ohwhyosa<yoctozepto "ohwhyosa: so where are you livin"> Spain09:00
mgoddardI didn't see any in my testing either, about 16 runs IIRC09:00
mgoddardyoctozepto: what happened with glance?09:00
yoctozeptomgoddard: 3x8 multinodes09:01
yoctozeptosorry09:01
yoctozepto3x4 multinodes09:01
yoctozepto3x4 singlenodes09:01
yoctozeptomgoddard: random inventory chosen different glance-api container target than primary (which is our endpoint)09:01
yoctozeptoI slapped a fix for that09:01
yoctozeptowill be refactoring it09:01
mgoddardwhy didn't we see that before?09:02
yoctozeptomgoddard: never ran multinode without ceph?09:03
mgoddardah yeah09:03
yoctozeptocinder-lvm had it patched already09:03
yoctozeptothe scenario just was not prepared09:03
mgoddardah yeah, the glance_api_hosts thing09:04
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Add custom filters for checking services  https://review.opendev.org/66592209:05
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973509:05
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025109:06
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test MariaDB failures in CI  https://review.opendev.org/67017009:07
yoctozeptoI was not aware how troublesome testing mariadb multinode without ceph would be ;p09:08
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025109:09
*** iniazi_ has quit IRC09:09
*** shyamb has quit IRC09:10
*** hjensas has joined #openstack-kolla09:10
*** shyamb has joined #openstack-kolla09:10
*** lei-zh1 has joined #openstack-kolla09:10
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025109:10
*** lei-zh has quit IRC09:11
*** dpawlik has quit IRC09:12
*** dpawlik has joined #openstack-kolla09:13
egonzalezmgoddard neutron services affected bgpvpn, l2gw, odl, neutron-dynamic-routing, fwaas, vpnaas and neutron-nsx,09:13
mgoddardyoctozepto: maybe we could make the glance logic more generic - if multinode and no ceph, set glance_api_hosts09:14
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Revert "[neutron] Do not migrate all subprojects"  https://review.opendev.org/67025509:16
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Revert "[neutron] Do not migrate all subprojects"  https://review.opendev.org/67025509:17
*** dpawlik has quit IRC09:18
*** dpawlik has joined #openstack-kolla09:18
*** k_mouza has quit IRC09:19
*** k_mouza has joined #openstack-kolla09:19
egonzalezothers as networking-sfc need to execute migrations as separate step, but those are executed with neutron main schema migrations09:20
egonzalezhrm, actually networking-sfc is also executed, we can remove the separate logic or implement the other services as sfc09:22
yoctozeptomgoddard: yeah, I did that in dnm09:23
yoctozeptothough I don't check for multinode - then there is only one node anyway so it still holds09:23
yoctozepto;D09:23
mgoddardegonzalez: the problem is if someone enables another plugin09:24
mgoddardso maybe we need to migrate all09:24
*** dougsz has joined #openstack-kolla09:24
egonzalezyes, or implement same logic for every pluging similar to sfc, but that limits vendor plugins usage09:25
egonzalezhttp://paste.openstack.org/show/754292/ log from schema migrations missing09:26
openstackgerritMerged openstack/kolla-ansible master: init-runonce: make public1 network optional  https://review.opendev.org/67012809:30
*** FlorianFa has joined #openstack-kolla09:36
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: init-runonce: make public1 network optional  https://review.opendev.org/67012909:40
*** irclogbot_0 has joined #openstack-kolla09:48
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025109:49
ohwhyosaShould monasca install the horizon plugin? what exactly does monasca datasource want where it says http settings09:50
ohwhyosa?09:50
*** irclogbot_0 has quit IRC09:51
ohwhyosaGood, figured it out, in case anyone needs the info it just wants the monasca api endpoint10:00
*** JangwonLee has quit IRC10:05
mgoddardohwhyosa: FYI dougsz is the resident monasca expert10:07
ohwhyosamgoddard: Thank you! I'll mention him, cause I'm getting a bit of trouble setting it up (Though it says the datasource is properly configured)10:17
*** shyamb has quit IRC10:17
*** hamzaachi has joined #openstack-kolla10:19
*** altlogbot_2 has joined #openstack-kolla10:26
*** altlogbot_2 has quit IRC10:29
*** janki has joined #openstack-kolla10:32
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test MariaDB failures in CI  https://review.opendev.org/67017010:33
*** altlogbot_1 has joined #openstack-kolla10:34
*** shyamb has joined #openstack-kolla10:36
*** altlogbot_1 has quit IRC10:39
*** altlogbot_0 has joined #openstack-kolla10:40
*** irclogbot_3 has joined #openstack-kolla10:40
*** hamdyk has quit IRC10:44
ohwhyosaOkay, it seems problem is that I have to create the metrics, they are not there10:44
*** hamdyk has joined #openstack-kolla10:44
*** altlogbot_0 has quit IRC10:45
*** irclogbot_3 has quit IRC10:45
yoctozeptomgoddard: https://review.opendev.org/67012910:46
yoctozeptothis is due to rocky not patched10:46
mgoddardyoctozepto: right. We need https://review.opendev.org/66969810:46
yoctozeptomnasiadka, egonzalez: ^ to slap this on so that it does not haunt us10:48
yoctozepto(queens/pike not affected at fullest because missing the other patch)10:49
yoctozeptoalso thankfully rocky does not test upgrades so queens is irrelevant10:50
mgoddard"thankfully"10:52
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973510:53
yoctozeptomgoddard: always look at the bright side of life (I know it's singing in your heads)10:54
*** altlogbot_0 has joined #openstack-kolla10:56
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test MariaDB failures in CI  https://review.opendev.org/67017010:59
*** altlogbot_0 has quit IRC11:01
stingrayzayoctozepto: thanks :/11:02
yoctozeptostingrayza: yw!11:02
*** lei-zh1 has quit IRC11:15
*** shyamb has quit IRC11:26
*** priteau has joined #openstack-kolla11:29
*** shyamb has joined #openstack-kolla11:34
*** Sravan has joined #openstack-kolla11:38
*** Sravan has quit IRC11:43
*** kplant has joined #openstack-kolla11:55
*** altlogbot_3 has joined #openstack-kolla11:56
*** altlogbot_3 has quit IRC12:01
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/rocky: Don't rotate keystone fernet keys during deploy  https://review.opendev.org/67028812:01
ohwhyosaCan I use delete with -t monasca if I want to remove just one service?12:01
openstackgerritPierre Riteau proposed openstack/kolla-ansible stable/queens: Don't rotate keystone fernet keys during deploy  https://review.opendev.org/67028912:02
*** priteau has quit IRC12:13
*** wangweiDavid has quit IRC12:16
*** janki has quit IRC12:21
*** henriqueof has joined #openstack-kolla12:23
mgoddardohwhyosa: no, destroy will remove all services12:27
*** henriqueof has quit IRC12:28
*** dougsz has quit IRC12:29
*** dougsz has joined #openstack-kolla12:30
*** irclogbot_1 has joined #openstack-kolla12:32
*** KeithMnemonic has joined #openstack-kolla12:33
*** irclogbot_1 has quit IRC12:35
*** dougsz has quit IRC12:39
*** luksky11 has quit IRC12:41
*** skramaja has quit IRC12:41
*** hamzy has quit IRC12:42
*** janki has joined #openstack-kolla12:43
*** janki has quit IRC12:45
*** tonythomas has joined #openstack-kolla12:48
*** altlogbot_1 has joined #openstack-kolla12:50
*** altlogbot_1 has quit IRC12:53
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025112:55
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973512:57
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025112:58
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025113:04
*** shyamb has quit IRC13:05
*** michaelbarkdoll has quit IRC13:05
*** dougsz has joined #openstack-kolla13:06
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025113:07
*** michaelbarkdoll has joined #openstack-kolla13:08
michaelbarkdollThe ceph-ansible dashboard feature uses docker containers when you install it on baremetal/vm.  The version of their docker throws a version mismatch error on the docker package installed.  Just wanted to make a note of it since I previously heard discussion of moving away from kolla-ansible managing ceph.  Would be nice if the ceph-ansible dashboa13:12
michaelbarkdollrd could co-exist along side the kolla-ansible's without additional modification to the playbooks.13:12
*** michaelbarkdoll has quit IRC13:15
mnasiadkaceph-ansible dashboard? Isn't it ceph-mgr dashboard in reality?13:17
mnasiadkaoh, he came, wrote this and quit13:17
mnasiadkasweet13:17
*** luksky11 has joined #openstack-kolla13:29
*** BjoernT has joined #openstack-kolla13:31
*** goldyfruit has joined #openstack-kolla13:33
openstackgerritgugug proposed openstack/kolla-cli master: test zuul  https://review.opendev.org/67025113:33
*** dougsz has quit IRC13:37
*** dougsz has joined #openstack-kolla13:37
*** irclogbot_2 has joined #openstack-kolla13:40
openstackgerritMerged openstack/kolla-ansible stable/stein: init-runonce: make public1 network optional  https://review.opendev.org/67012913:45
openstackgerritMerged openstack/kolla-ansible stable/rocky: Wait for all compute services before cell discovery  https://review.opendev.org/66969813:45
*** irclogbot_2 has quit IRC13:45
*** BjoernT_ has joined #openstack-kolla13:46
*** BjoernT has quit IRC13:47
*** hamzy has joined #openstack-kolla13:47
*** whoami-rajat has quit IRC13:48
*** whoami-rajat has joined #openstack-kolla13:52
*** oneswig has joined #openstack-kolla13:53
goldyfruito/13:57
goldyfruitStill failing with CentOS14:00
goldyfruitand Masakari tests :(14:00
goldyfruitCannot uninstall 'ipaddress'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall14:00
*** oneswig has quit IRC14:02
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: WIP: Add HAcluster Ansible role  https://review.opendev.org/67010414:13
goldyfruitShould I remove the test for centos-masakari as for Zun for example ?14:14
goldyfruitAnd about just run masakari test into the CI when a change appears on it, it that enough:  files: ^ansible\/roles\/masakari\/.* ?14:16
goldyfruitI really try to find something in Zuul documentation before asking but...14:16
*** dougsz has quit IRC14:17
*** dougsz has joined #openstack-kolla14:18
*** michaelbarkdoll has joined #openstack-kolla14:20
michaelbarkdoll@mnasiadka sorry web client disconnect for some reason.  You're probably right it is likely ceph-mgr's dashboard but the ceph-ansible playbook will install it if you configure the option.14:22
mnasiadkamichaelbarkdoll: kolla should do the same, if it’s not - raise a bug :)14:24
michaelbarkdollI'm not certain it is a bug though14:25
michaelbarkdollIt is more an issue where kolla-ansible expects a certain version of docker, but ceph-ansible expects another version from a different pacakge14:26
michaelbarkdollAnyway, the whole issue is minor to me.  I'll just avoid the dashboard feature in ceph-ansible to avoid the docker package mismatch issue.14:28
michaelbarkdollBut, I could see someone who wanted to use the dashboard wouldn't be able to by default.14:28
mgoddardgoldyfruit: let's see it passing on centos :)14:30
mgoddardgoldyfruit: As I commented in gerrit, you need to use a virtualenv when you see that error. We do that for the ironic client, so use that as an example14:31
goldyfruitmgoddard, ok!14:31
goldyfruitWill check14:31
*** hamdyk has quit IRC14:31
*** Luzi has quit IRC14:32
mgoddardyoctozepto: I remember you said you learnt something about ansible plugins during the nova discovery fix, what was it? I'm having trouble with ansible not finding a custom filter plugin: https://review.opendev.org/#/c/59973514:33
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Testing Masakari role in gate  https://review.opendev.org/61605014:41
openstackgerritMerged openstack/kolla-ansible stable/queens: Don't rotate keystone fernet keys during deploy  https://review.opendev.org/67028914:46
*** dougsz has quit IRC14:49
*** tonythomas has quit IRC14:58
*** k_mouza_ has joined #openstack-kolla15:05
openstackgerritgugug proposed openstack/kolla-cli master: Add Python 3 Train unit tests  https://review.opendev.org/67033115:06
*** k_mouza has quit IRC15:09
*** pcaruana has quit IRC15:11
*** cah_link has quit IRC15:15
openstackgerritgugug proposed openstack/kolla-cli master: Add Python 3 Train unit tests  https://review.opendev.org/67033115:19
openstackgerritgugug proposed openstack/kolla-cli master: Add Python 3 Train unit tests  https://review.opendev.org/67033115:27
*** hamzaachi has quit IRC15:31
openstackgerritMerged openstack/kolla-ansible stable/rocky: Don't rotate keystone fernet keys during deploy  https://review.opendev.org/67028815:41
*** hamzaachi has joined #openstack-kolla15:46
openstackgerritMerged x/kayobe master: CI: Don't create an external network in init-runonce  https://review.opendev.org/67013115:50
*** pcaruana has joined #openstack-kolla15:57
openstackgerritgugug proposed openstack/kolla-cli master: Add Python 3 Train unit tests  https://review.opendev.org/67033116:02
openstackgerritgugug proposed openstack/kolla-cli master: Add Python 3 Train unit tests  https://review.opendev.org/67033116:04
*** altlogbot_1 has joined #openstack-kolla16:04
*** altlogbot_1 has quit IRC16:07
*** luksky11 has quit IRC16:19
*** factor has quit IRC16:20
*** rpittau is now known as rpittau|adk16:20
*** rpittau|adk is now known as rpittau|afk16:20
*** ivve has quit IRC16:23
openstackgerritPierre Riteau proposed x/kayobe master: Add support for overriding OpenStack configuration globally  https://review.opendev.org/66572116:29
*** hamzaachi has quit IRC16:42
*** altlogbot_1 has joined #openstack-kolla16:44
*** gkadam has quit IRC16:46
*** altlogbot_1 has quit IRC16:49
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: WIP: Add HAcluster Ansible role  https://review.opendev.org/67010416:53
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Testing Masakari role in gate  https://review.opendev.org/61605017:02
*** cloudnull has quit IRC17:06
*** k_mouza_ has quit IRC17:07
*** altlogbot_2 has joined #openstack-kolla17:22
*** factor has joined #openstack-kolla17:23
*** altlogbot_2 has quit IRC17:25
*** altlogbot_3 has joined #openstack-kolla17:30
yoctozeptomgoddard: it was my firstname, python 2 did not like ł17:34
yoctozeptoaka the problem was I was testing locally with python 317:34
yoctozepto;-)17:34
*** altlogbot_3 has quit IRC17:35
*** altlogbot_3 has joined #openstack-kolla17:36
*** altlogbot_3 has quit IRC17:41
*** cloudnull has joined #openstack-kolla17:42
*** altlogbot_0 has joined #openstack-kolla17:43
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973517:44
*** altlogbot_0 has quit IRC17:45
yoctozeptomgoddard: https://review.opendev.org/665922 - commented on this one instead17:49
mgoddardyoctozepto: ah, thanks. I think I know the problem17:49
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973517:50
*** hamzaachi has joined #openstack-kolla17:55
yoctozeptomgoddard: as far as mariadb goes17:57
yoctozeptoI rebooted my local deployment with 2 galera nodes17:57
yoctozeptoand now it loops forever17:57
michaelbarkdolllol17:57
yoctozeptostein deploy17:57
yoctozeptofsck yeah17:57
mgoddardyoctozepto: yeah, if all nodes go down you need to perform a kolla-ansible mariadb_recovery17:58
kplanteven if you gracefully bring them down?17:59
yoctozepto2019-07-11 19:58:39 0 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)17:59
yoctozeptomgoddard: ah, forgot to wait for the first to finish rebooting17:59
yoctozeptoyou are right18:00
yoctozeptolet's try our procedure18:00
yoctozeptoTASK [mariadb : Shutdown MariaDB] *********************************************************************************************************************************************************************************18:01
yoctozeptofatal: [os-controller-1]: FAILED! => {18:01
yoctozeptohueh18:02
yoctozepto    "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result",18:02
yoctozepto;D18:02
yoctozeptoTASK [mariadb : Remove restart policy from MariaDB] ***************************************************************************************************************************************************************18:03
yoctozeptoTASK [mariadb : Shutdown MariaDB] *********************************************************************************************************************************************************************************18:04
yoctozepto^ this order seems wrong in this state ;p18:04
yoctozeptoI mean, it is very likely that removing restart policy will kill one of containers soon18:04
yoctozeptofixed, yay18:06
yoctozeptosans that problem, the procedure worked18:06
mgoddardnice18:08
*** Sravan has joined #openstack-kolla18:22
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check containers during kolla-ansible check  https://review.opendev.org/59973518:26
*** Sravan has quit IRC18:36
*** Sravan has joined #openstack-kolla18:40
*** Sravan has quit IRC18:41
*** luksky11 has joined #openstack-kolla18:44
*** Sravan has joined #openstack-kolla18:51
*** Sravan has quit IRC18:57
*** Sravan has joined #openstack-kolla19:02
*** Sravan has quit IRC19:05
*** Sravan has joined #openstack-kolla19:05
*** Sravan has quit IRC19:23
*** Sravan has joined #openstack-kolla19:24
*** irclogbot_0 has joined #openstack-kolla19:28
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Testing Masakari role in gate  https://review.opendev.org/61605019:29
*** michaelbarkdoll has quit IRC19:31
*** hamzaachi has quit IRC19:32
*** hamzaachi has joined #openstack-kolla19:33
*** irclogbot_0 has quit IRC19:33
*** altlogbot_3 has joined #openstack-kolla19:39
*** altlogbot_3 has quit IRC19:41
*** jistr has quit IRC19:43
*** jistr has joined #openstack-kolla19:45
*** Sravan has quit IRC19:47
*** kplant has quit IRC19:56
*** jistr has quit IRC20:03
*** jistr has joined #openstack-kolla20:05
*** Sravan has joined #openstack-kolla20:08
*** weshay|rover has joined #openstack-kolla20:09
weshay|roverhowdy.. we're trying to build kolla containers on rhel8 in prep for centos 8... not getting any errors, but also only getting 23 of the 120+ containers to build20:10
weshay|roverany clues on why kolla would skip building some containers based on the distro?20:10
weshay|roverworking w/ https://review.opendev.org/#/c/669471/20:11
*** rfolco has joined #openstack-kolla20:12
*** Sravan has quit IRC20:12
*** irclogbot_0 has joined #openstack-kolla20:12
*** irclogbot_0 has quit IRC20:16
yoctozeptoweshay|rover: http://logs.openstack.org/71/669471/2/check/kolla-build-centos-source/8bf34fe/kolla/ seems to have built more than 23 to me20:24
yoctozeptowe have skipped_images mechanism20:24
yoctozeptobut it does not differentiate based on release20:24
yoctozepto(yet at least)20:25
weshay|roveryoctozepto looking20:25
* yoctozepto interested in rhel8 but does not have enough time to check it out...20:25
weshay|roverI suspect it's something w/ rhel8 and buildah20:26
yoctozeptowe don't use buildah20:26
weshay|roveraye20:26
weshay|roverdocker summarizes any skipped.. it's hard to see w/ buildah20:26
yoctozeptoweshay|rover: it's kolla that summarizes it20:30
weshay|roverah20:30
weshay|roverk.. thanks for clarifying20:30
yoctozeptoweshay|rover: you are not building rhel8 in CI? because I cant' see a relevant job there20:30
weshay|roveryoctozepto we'll have something visible in 3rd party20:31
yoctozeptothought you overrode the centos job20:31
yoctozeptook20:31
weshay|rovershould help prep for centos820:31
*** pcaruana has quit IRC20:31
yoctozeptoyeah, we shall see to it20:31
yoctozeptogood night channel o/20:32
*** igordc has joined #openstack-kolla20:32
*** BjoernT_ has quit IRC20:39
openstackgerritMerged x/kayobe master: Improve diagnostics for seed jobs  https://review.opendev.org/66182320:46
*** whoami-rajat has quit IRC20:48
*** hamzy has quit IRC20:56
*** Sravan has joined #openstack-kolla20:57
*** altlogbot_0 has joined #openstack-kolla21:00
*** Sravan has quit IRC21:01
*** Sravan has joined #openstack-kolla21:02
*** Sravan has quit IRC21:05
*** altlogbot_0 has quit IRC21:05
*** kplant has joined #openstack-kolla21:07
*** Sravan has joined #openstack-kolla21:11
*** irclogbot_1 has joined #openstack-kolla21:22
*** irclogbot_1 has quit IRC21:26
*** irclogbot_3 has joined #openstack-kolla21:28
*** Sravan has quit IRC21:30
*** irclogbot_3 has quit IRC21:32
*** Sravan has joined #openstack-kolla21:33
*** Sravan has quit IRC21:50
*** Sravan has joined #openstack-kolla21:53
*** jonaspaulo has joined #openstack-kolla21:55
*** Sravan has quit IRC21:56
*** Sravan has joined #openstack-kolla21:57
*** Sravan has quit IRC22:00
*** hamzy has joined #openstack-kolla22:07
*** hamzaachi has quit IRC22:07
*** hamzaachi has joined #openstack-kolla22:09
*** altlogbot_2 has joined #openstack-kolla22:17
*** altlogbot_2 has quit IRC22:17
*** altlogbot_0 has joined #openstack-kolla22:19
*** irclogbot_2 has joined #openstack-kolla22:19
*** irclogbot_2 has quit IRC22:23
*** altlogbot_0 has quit IRC22:23
*** rfolco has quit IRC22:24
*** rfolco has joined #openstack-kolla22:24
*** Sravan has joined #openstack-kolla22:28
openstackgerritAlex Schultz proposed openstack/kolla master: Limit OVMF_CODE.secboot.fd to el7  https://review.opendev.org/67040522:29
*** Sravan has quit IRC22:32
openstackgerritwes hayutin proposed openstack/kolla master: DNM: Add rhel8 support for early CentOS8 testing  https://review.opendev.org/66947122:33
*** luksky11 has quit IRC22:37
*** jonaspaulo has quit IRC22:39
*** hamzaachi has quit IRC22:45
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: WIP: Add HAcluster Ansible role  https://review.opendev.org/67010422:45
openstackgerritGaëtan Trellu proposed openstack/kolla master: Add Masakari containers  https://review.opendev.org/61546922:54
openstackgerritGaëtan Trellu proposed openstack/kolla master: Add Masakari containers  https://review.opendev.org/61546922:56
*** altlogbot_1 has joined #openstack-kolla22:57
*** LaurentDumont has joined #openstack-kolla22:57
*** altlogbot_1 has quit IRC22:59
*** hamzaachi has joined #openstack-kolla23:00
*** hamzaachi has quit IRC23:00
*** irclogbot_2 has joined #openstack-kolla23:01
*** serhatd has quit IRC23:01
openstackgerritGaëtan Trellu proposed openstack/kolla master: Add Masakari containers  https://review.opendev.org/61546923:05
*** irclogbot_2 has quit IRC23:06
*** irclogbot_3 has joined #openstack-kolla23:09
*** irclogbot_3 has quit IRC23:16
*** goldyfruit has quit IRC23:16
*** LaurentDumont has quit IRC23:21
*** LaurentDumont has joined #openstack-kolla23:22
*** altlogbot_3 has joined #openstack-kolla23:29
*** altlogbot_3 has quit IRC23:30
*** goldyfruit has joined #openstack-kolla23:50
« Wednesday, 2019-07-10 Index Friday, 2019-07-12 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!