Thursday, 2019-06-06

« Wednesday, 2019-06-05 Index Friday, 2019-06-07 »
*** schwicht has quit IRC00:25
*** Sravan has joined #openstack-kolla00:48
*** Sravan has quit IRC00:53
*** spsurya has joined #openstack-kolla01:01
*** schwicht has joined #openstack-kolla01:04
*** itlinux has joined #openstack-kolla01:25
*** guozijn has joined #openstack-kolla01:27
*** guozijn has quit IRC01:28
*** zhanglong has joined #openstack-kolla01:30
*** dave-mccowan has joined #openstack-kolla01:31
*** guozijn has joined #openstack-kolla01:33
*** schwicht has quit IRC01:38
*** goldyfruit has joined #openstack-kolla01:50
*** hongbin has joined #openstack-kolla01:55
*** zhanglong has quit IRC01:56
*** zhanglong has joined #openstack-kolla01:58
*** whoami-rajat has joined #openstack-kolla02:07
*** guozijn has quit IRC02:10
*** gfidente is now known as gfidente|afk02:26
*** schwicht has joined #openstack-kolla02:29
openstackgerritMerged openstack/kolla-ansible master: runonce: do not set hw_firmware_type=uefi  https://review.opendev.org/66294202:37
*** JamesBenson has joined #openstack-kolla02:44
*** schwicht has quit IRC02:59
*** schwicht has joined #openstack-kolla02:59
*** schwicht has quit IRC03:00
*** shyamb has joined #openstack-kolla03:29
*** Sravan has joined #openstack-kolla03:32
*** dave-mccowan has quit IRC03:50
*** zhanglong has quit IRC03:56
*** Sravan has quit IRC04:09
*** hongbin has quit IRC04:11
*** shyamb has quit IRC04:29
*** Sravan has joined #openstack-kolla04:34
*** Sravan has quit IRC04:36
*** shyamb has joined #openstack-kolla04:47
*** pcaruana has joined #openstack-kolla04:50
*** radeks_ has joined #openstack-kolla05:02
*** gregoryo has joined #openstack-kolla05:05
*** shyamb has quit IRC05:25
*** shyamb has joined #openstack-kolla05:28
*** janki has joined #openstack-kolla05:30
*** luksky has joined #openstack-kolla05:34
hrwmgoddard, mnasiadka: https://review.opendev.org/#/c/661686/05:46
hrwmorning05:46
*** janki has quit IRC05:49
*** janki has joined #openstack-kolla05:49
*** janki has quit IRC05:50
*** janki has joined #openstack-kolla05:51
*** luksky has quit IRC05:53
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Debian/Ubuntu: more python3 packages for binary  https://review.opendev.org/66337505:55
*** shyamb has quit IRC05:55
*** shyamb has joined #openstack-kolla05:57
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Debian/Ubuntu: move to Python 3 for source images  https://review.opendev.org/64237506:01
hrwmgoddard: moved dind part from 642375 -> 66337506:01
*** cah_link has joined #openstack-kolla06:06
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/stein: Ceph: Update to Nautilus on CentOS and OracleLinux  https://review.opendev.org/66331206:11
*** gregoryo has quit IRC06:16
*** zhanglong has joined #openstack-kolla06:20
*** dpawlik has joined #openstack-kolla06:22
mnasiadkahrw: if we'll merge Ceph change (ignore the binary CI failures), and we'll merge this: https://review.opendev.org/#/c/651601/3 - we will be fine06:35
mnasiadkahrw: the openstack-nova-placement-api error is because we are using trunk RDO repos on stable/stein06:35
mnasiadkahrw: and openstack-nova-placement-api got removed in Train, but it's still there in Stein (although deprecated I think)06:36
hrwshit06:36
mnasiadkahrw: as you can see here: https://trunk.rdoproject.org/centos7-stein/current/06:36
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/stein: Ceph: Update to Nautilus on CentOS and OracleLinux  https://review.opendev.org/66331206:36
* hrw stops doing any changes 06:37
hrwtime to break other projects for a change06:37
mnasiadkahrw: naah, maybe we need to be more specific on the whiteboard to write what's the plan for release, like in steps :)06:37
*** shyamb has quit IRC06:46
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241606:53
hrwmnasiadka: ansible==2.8 means 2.8.0 or 2.8.x?06:56
mnasiadkahrw: 2.8.x06:56
mnasiadkahrw: at least on my Mac :D06:57
hrwmnasiadka: thx. was not sure. ==2.8 looks better than ">=2.8;<=2.9"06:57
hrw(a) 08:57 (0s) hrw@puchatek:del$ pip install ansible==2.706:58
hrwCollecting ansible==2.706:58
hrw  Downloading https://files.pythonhosted.org/packages/7c/4f/a1843687642b8e33637e312b9fb17ca7f68be0641131a92d883368dc6d1c/ansible-2.7.0.tar.gz (11.8MB)06:58
mnasiadkahmm06:59
hrw(a) 08:59 (5s) hrw@puchatek:del$ pip install "ansible>=2.7,<2.8"06:59
hrw2.7.1106:59
hrwpip 19.1.106:59
*** shyamb has joined #openstack-kolla07:00
hrwmnasiadka: ansible==2.7.* == 2.7.1107:02
mnasiadkahrw: oh ok, that's better - let me fix that07:11
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241607:12
hrwmnasiadka: check first please07:12
hrw;D07:12
mnasiadka:)07:12
hrwhttps://etherpad.openstack.org/p/kolla-train-priorities needs updates from people07:18
*** rpittau|afk is now known as rpittau07:19
*** radeks__ has joined #openstack-kolla07:22
*** radeks_ has quit IRC07:26
*** janki has quit IRC07:27
*** janki has joined #openstack-kolla07:27
*** janki has quit IRC07:28
openstackgerritMerged openstack/kolla stable/stein: Ceph: Update to Nautilus on CentOS and OracleLinux  https://review.opendev.org/66331207:47
*** shyamb has quit IRC07:47
mgoddardhrw: yeah, in-channel meeting seems to be a winner07:48
*** dougsz has joined #openstack-kolla08:07
*** happyhemant has joined #openstack-kolla08:19
*** luksky has joined #openstack-kolla08:20
*** zhanglong has quit IRC08:26
*** shyamb has joined #openstack-kolla08:32
hrwmgoddard: could you BP +1/+2 most important patches? so we could finally release stein08:38
mgoddardhrw: you mean RP?08:39
hrwyes08:39
mgoddardsure, will do08:39
hrwthx08:43
*** gfidente|afk has quit IRC08:56
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Update contributor guide  https://review.opendev.org/66044208:59
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Set kolla_source_version to stein  https://review.opendev.org/66355109:01
*** sshnaidm|afk is now known as sshnaidm09:05
*** k_mouza has joined #openstack-kolla09:05
*** priteau has joined #openstack-kolla09:12
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement internal endpoint and backend TLS - Approach #2  https://review.opendev.org/66355509:16
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Switch to RDO Stein release on CentOS & Oracle  https://review.opendev.org/65160109:21
*** jistr is now known as jistr|lnl09:28
*** sm806 has quit IRC09:28
*** sm806 has joined #openstack-kolla09:28
*** luksky has quit IRC09:28
*** janki has joined #openstack-kolla09:29
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Spelling mistake in manila.conf.j2  https://review.opendev.org/66266109:31
hrwmnasiadka: https://review.opendev.org/#/c/663375/09:33
*** shyamb has quit IRC09:34
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Test Ceph upgrade in CI  https://review.opendev.org/66356509:38
mnasiadkahrw: I was late ;)09:39
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Test Ceph upgrade in CI  https://review.opendev.org/66356509:39
hrwmnasiadka: ;D09:39
mnasiadkahrw: but it’s good spsurya is alive ;)09:40
hrw;D09:40
hrwhttps://review.opendev.org/642375 needs reviews too ;D (py3)09:40
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix docs - simply run the script instead of sourcing it  https://review.opendev.org/66356609:40
spsuryahello mgoddard mnasiadka hrw ;)09:41
hrwhi spsurya09:41
spsuryayeah alive :)09:41
mgoddardhi spsurya, nice to see you :)09:41
spsuryanice to see you all here again09:42
spsuryaguys i would be a bit less active as compared to before09:42
mgoddardspsurya: :(09:43
mgoddardspsurya: will you still have some time for kolla?09:43
spsuryaas i got some other assignments09:43
spsuryabut still i would be around keep reviewing few stuff09:43
mgoddardthat's good09:43
hrwspsurya: cool09:44
mgoddardspsurya: I posted a few things to the ML recently following the PTG. Take a look if you have time09:44
mgoddardspsurya: also please vote here: https://etherpad.openstack.org/p/kolla-train-priorities09:44
spsuryamgoddard: for sure i will take a look on this weekend and would vote for same09:45
mgoddardspsurya: great, thanks09:45
*** shyamb has joined #openstack-kolla09:48
*** sm806 has quit IRC09:49
*** sm806 has joined #openstack-kolla09:50
spsuryamgoddard: my pleasure09:53
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix docs - do not mention the old, deprecated CLI clients  https://review.opendev.org/66357409:55
*** gfidente has joined #openstack-kolla09:57
*** shyamb has quit IRC09:58
*** luksky has joined #openstack-kolla10:00
*** k_mouza has quit IRC10:22
*** ivve has joined #openstack-kolla10:27
*** shyamb has joined #openstack-kolla10:28
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement internal endpoint and backend TLS - Approach #2  https://review.opendev.org/66355510:34
openstackgerritMark Goddard proposed openstack/kolla master: Debian/Ubuntu: more python3 packages for binary  https://review.opendev.org/66337510:35
*** priteau has quit IRC10:35
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Make bootstrap more idempotent  https://review.opendev.org/66359110:37
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla master: [DNM] TestPushingPatch  https://review.opendev.org/66359210:37
*** happyhemant has quit IRC10:38
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix the deploy guide build failed  https://review.opendev.org/66359310:39
*** k_mouza has joined #openstack-kolla10:44
openstackgerritMerged openstack/kolla master: Blacklist bandit 1.6.0  https://review.opendev.org/65904510:45
hrwmgoddard: thanks for updating binary packages patch10:48
mgoddardhrw: np, just checking the source patch using the same method10:48
hrwmgoddard: will look at entries you listed10:48
mgoddardhrw: thanks10:49
hrwfun fact: I never 'pip install' kolla - always use ./tools/build.py file. and completely different with kolla-ansible. always 'pip install' ;D10:50
openstackgerritDoug Szumski proposed openstack/kolla master: Upgrade Monasca to InfluxDB 1.7  https://review.opendev.org/65836710:51
mgoddardRDO stein patch still failing after ceph merge :(10:53
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement internal endpoint and backend TLS - Approach #2  https://review.opendev.org/66355510:58
openstackgerritMark Goddard proposed openstack/kolla master: Debian/Ubuntu: move to Python 3 for source images  https://review.opendev.org/64237510:59
yoctozeptomgoddard: looks like nfs-ganesha causes all the trouble11:01
mgoddardyoctozepto: yeah, and nfs-ganesha11:01
*** k_mouza has quit IRC11:02
hrwmgoddard: reviewd comments. one more change needed11:02
openstackgerritMark Goddard proposed openstack/kolla master: Debian/Ubuntu: more python3 packages for binary  https://review.opendev.org/66337511:07
mgoddardhrw: done11:07
yoctozeptomgoddard: I mean nfs-ganesha is the problem root, see http://paste.openstack.org/show/752587/ - it ruined the whole yum transaction11:09
mgoddardyoctozepto: sorry, I meant to say 'and tempest'11:09
hrwmgoddard: now, let's wait for zuul11:09
mgoddardthat one is easily fixed11:09
yoctozeptomgoddard: understood11:10
yoctozeptook, I see 2019-06-06 09:48:54.806020 | primary | INFO:kolla.common.utils.tempest:[91mError: Not tolerating missing names on install, stopping.11:11
mgoddardit's just s/openstack-tempest-all/openstack-tempest/11:11
hrwRDO stein patch installs centos-release-stein package. which depends on centos-ceph-nautilus package. so we have two repos providing ceph11:12
mgoddardsh1t11:13
yoctozeptothey are super incompatible11:13
yoctozeptodon't try in production :-)11:13
mgoddardwhich are incompatible?11:13
yoctozeptocentos-ceph11:13
yoctozepto+ ceph11:13
yoctozeptothe official11:13
yoctozeptodisable one11:13
yoctozeptoand reap the benefits11:13
yoctozeptobut probably the RDO depends on something from there :-(11:14
mgoddardso we recently switched to upstream ceph11:14
mgoddard(from centos)11:14
yoctozeptoand that is what makes it so painful11:14
mgoddardI hadn't realised that centos-release-stein would pull in centos-ceph-nautilus11:14
yoctozeptohttp://paste.openstack.org/show/752588/11:15
yoctozeptoyup, it did11:15
yoctozeptoessentially ceph (the upstream) and nfs_ganesha depend on epel versions11:16
yoctozeptoand centos provides more modern replacements11:16
yoctozeptoepel versions of libraries*11:16
yoctozepto(missed the noun :-) )11:16
hrwand at same time centos storage sig is slooooow so we do not have nfs-ganesha-ceph11:17
*** kplant has joined #openstack-kolla11:17
*** jistr|lnl is now known as jistr11:18
mgoddardwe should have queued these patches together earlier :(11:18
hrwmgoddard: chain them11:19
yoctozeptomgoddard: maybe try disabling the installed centos repo? not sure how well they wrote their dependencies for RDO11:19
mgoddardhrw: yeah I know how, just didn't do it11:19
yoctozeptohrw: they are slow but see, they are tricky, they provide newer libs than epel does11:26
yoctozeptorabbit vs turtle  8-)11:27
hrwyoctozepto: https://bugs.centos.org/view.php?id=1613311:27
hrwyoctozepto: https://bugs.centos.org/view.php?id=1613011:27
hrwyoctozepto: those block nfs-ganesha-ceph11:27
yoctozeptoso you moved to upstream ceph11:28
yoctozeptoI approve with my whole heart11:28
yoctozeptoI just joke about this trickiness because if they did not serve the newer libs, the additional repo would probably cause no trouble11:29
yoctozeptoand it really makes epel look outdated11:29
yoctozeptoseen my paste?11:29
kplantepel is cancer imo11:29
yoctozeptokplant: +111:29
kplantinconsistent and unreliable mirrors make deploying from it super annoying11:30
yoctozeptobut ceph upstream decided to depend on it11:30
yoctozeptothe dependency management lacks coordination :-(11:30
kplantthe community release of ceph depend on it??11:31
kplantreleases*11:31
hrwepel works for all rhel7 based distros11:31
hrwor it is what people think11:31
yoctozeptohrw: you love it until it breaks your deps :D11:32
yoctozeptokplant: yes11:32
yoctozeptothe upstream / the community / the ceph one-and-only-true11:32
yoctozeptohowever you name it11:32
yoctozeptothey still depend on epel11:32
yoctozeptoand it is what caused our troubles11:33
hrwyoctozepto: I work in Red Hat for nearly 6 years. There is 'RHEL 7 Developer' softshell in my wardrobe even. Never used rhel7 for development on x86-64 hardware11:33
yoctozeptoverdict depends on the viewing angle11:33
hrwused RHEL7 on aarch64 a lot. fixed countless packages there.11:34
yoctozeptois there epel for aarch64 now?11:34
hrwyoctozepto: aarch64, ppc64, ppc64le, x86-64. only s390x lacks epel11:35
yoctozeptohrw, kplant: the paste I mentioned above: http://paste.openstack.org/show/752587/11:35
yoctozeptohrw: I see now11:35
hrwyoctozepto: aware of that paste connect11:35
hrwcontent11:36
yoctozeptoepel is 3 releases behind :D11:36
yoctozeptoof that SLOW storage SIG11:36
yoctozepto:D11:36
kplanti'll have to take a peek at my deployment, i don't _think_ i'm using epel11:36
hrwnever looked how epel is populated ;d11:36
hrwFSC#@R@#%@%@k11:37
yoctozeptohrw: thanks for the password11:37
hrwmgoddard: release without ceph-nfs? :D11:37
yoctozeptomine is: **********11:37
kplantmmm bash.org11:37
hrwyoctozepto: u! offensive you have!11:37
yoctozeptohrw: I am so peaceful because my passwords contain all my anger11:38
kplantdo you have a dent in your keyboard?11:38
hrwmy keyboard would love to get new C V D S F E L M keys11:39
*** shyamb has quit IRC11:40
*** shyamb has joined #openstack-kolla11:41
yoctozepto> <hrw> mgoddard: release without ceph-nfs? :D11:41
yoctozepto+111:41
yoctozeptowonder how many expect openstack to deploy ceph-backed nfs for them11:42
*** schwicht has joined #openstack-kolla11:42
yoctozepto;-)11:42
kplantsomeone who is afraid to break their manila? hah11:42
yoctozeptobe brave11:43
openstackgerritMerged openstack/kolla-ansible stable/stein: Spelling mistake in manila.conf.j2  https://review.opendev.org/66266111:43
yoctozeptodoes not manila support cephfs11:43
yoctozeptonowadays11:43
kplantpretty sure it does11:43
hrwopenstackgerrit is listening... someone mentioned manila ;d11:43
yoctozeptoyeah, it creeped me out too11:44
kplanti'm sure you guys covered this before i hopped on but... does master have working nautilus clients yet?11:47
*** schwicht has quit IRC11:53
yoctozeptohrw, mgoddard: probably a question with a widely known answer but why is source build using RDO in the first place anyway?11:54
hrwyoctozepto: because 'source' images are only partially source ones11:57
hrwyoctozepto: type=source is a mix of source (openstack components from pip/source) and binary (ceph, openvswitch etc) images11:58
yoctozeptohrw: ah, openvswitch, sure11:58
yoctozeptosomehow thoughts led me to think only ceph is binary11:59
yoctozeptoin all this stack11:59
yoctozeptobut yeah11:59
*** k_mouza has joined #openstack-kolla11:59
hrwyoctozepto: and kolla-toolbox is source based in both binary and source type11:59
yoctozeptohrw: thanks for the thorough explanation, feeling wiser already 8-)12:01
hrwyoctozepto: there was an idea of getting rid of source-but-binary images and then doing source+binary deployments12:02
hrwyoctozepto: but that would require manpower we lack12:02
yoctozeptohow would that work? I see source+binary now12:03
yoctozeptowhat do you mean?12:03
hrwyoctozepto: ubuntu-source-nova-compute is done from nova source not package right?12:04
hrwyoctozepto: and ubuntu-source-ceph-nfs is source-but-binary, right?12:05
yoctozeptoit is12:05
hrwyoctozepto: so drop all source-but-binary ones and do deploy where nova-compute = ubuntu-source-nova-compute and ceph-nfs = ubuntu-binary-ceph-nfs (as there is no ubuntu-source-ceph-nfs)12:06
yoctozeptoso you mean the naming change12:06
hrwbut as I said this idea was put on a shelf with other abandoned ideas12:06
yoctozeptonot functional12:06
hrwyoctozepto: not quite that.12:06
hrwyoctozepto: naming stays12:07
hrwyoctozepto: type=binary stays as it is. type=source get slashed to <50% of images or sth12:07
yoctozeptobut still it would use binary to deploy some stuff12:07
yoctozeptoonly no duplication done as pipeline knows it is the same binary12:08
yoctozeptoI see your point now (finally!)12:09
hrwyep12:09
kklimondahmmm, any idea why for heat user/project creation is done from inside of the heat-api container during bootstrap, instead of being created with ansible tasks, as is the case with other services?12:14
hrwno ida12:15
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement internal endpoint and backend TLS - Approach #2  https://review.opendev.org/66355512:16
*** Wasaac has joined #openstack-kolla12:17
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Test Ceph upgrade in CI  https://review.opendev.org/66356512:17
*** schwicht has joined #openstack-kolla12:27
mgoddardkklimonda: not sure.12:30
mgoddardkklimonda: maybe because we didn't have a module to create a domain?12:30
*** sm806 has quit IRC12:31
*** sm806 has joined #openstack-kolla12:31
*** sm806 has quit IRC12:32
*** sm806 has joined #openstack-kolla12:32
kklimondacould be, we still don't have one it seems?12:35
*** jchhatbar has joined #openstack-kolla12:36
hrwI hate those external repos...12:36
hrwwhole set of CI jobs take about 2 hours. percona repo fails in one job and whole CI run is wasted12:37
*** janki has quit IRC12:38
kklimondayeah, zuul is not the best fit for projects with multiple long-running jobs, especially if some of them are tiny bit flaky12:39
mnasiadkahrw: btw, percona repo always fails on ovh nodes, right?12:39
*** schwicht has quit IRC12:40
mgoddardkklimonda: https://docs.ansible.com/ansible/latest/modules/os_keystone_domain_module.html12:40
*** schwicht has joined #openstack-kolla12:41
hrwmnasiadka: not looked that way12:42
hrwmnasiadka: works from my ovh node ;D12:43
kklimonda@mgoddard duh, I've assumed that modules executed in kolla-toolbox are interacting with openstack directly. makes sense now12:44
mgoddardmnasiadka: oh, is that what it is?12:44
mgoddardalthough I feel like we'd hit it more if so - OVH is used a lot12:45
mnasiadkamgoddard: always when I had percona.com connection problem - it was ovh12:46
mnasiadkamgoddard: second solution is adding percona stuff to infra mirror12:46
mgoddardthe bifrost job always fails on OVH :/12:47
mgoddardsomething weird about the hostname setup12:47
mnasiadkadpawlik: can you help mgoddard if you would get some details? :)12:47
*** k_mouza has quit IRC12:49
*** jchhatbar has quit IRC12:49
*** pcaruana has quit IRC12:52
*** schwicht has quit IRC13:00
*** jrist has joined #openstack-kolla13:00
jristhi all13:00
jristcan we get a +1 W on this? https://review.opendev.org/#/c/662846/213:01
mnasiadkamy pleasure13:03
hrwjrist: is it present in stein?13:04
mnasiadkahrw: it was always excluded during build due to some build errors :D13:04
hrwmnasiadka: wondering do we need backport13:05
hrwbbl13:06
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement internal endpoint and backend TLS - Approach #2  https://review.opendev.org/66355513:06
*** shyamb has quit IRC13:06
mnasiadkamgoddard: seems centos-release-openstack-stein requires centos-release-ceph-nautilus rpm13:09
mgoddardmnasiadka: yeah - scroll up :)13:09
kklimonda@stackedsax @mgoddard ^ this is the keystone TLS patch I was talking about yesterday. I've refreshed it, merged some tidbits from the other patch, and added a simple job that is testing deployment with both external and internal TLS enabled (it's probably all going to fail but the TLS deployment went through at least)13:09
mgoddardmnasiadka: just looking at running yum-config-manager --disable centos-ceph-nautilus13:10
mgoddardnice, thanks for sharing kklimonda13:11
mgoddardmnasiadka: it worked :D13:12
mnasiadkamgoddard: awesome13:12
mgoddardtake that centos13:13
mgoddard^ a new OS brought to you by the 90s boy band13:13
mnasiadkathat's really funny that RDO forces you to use ceph from CentOS-Storage-SIG13:15
*** shyamb has joined #openstack-kolla13:16
kplantmakes sense from their pov i guess, trying to put their SIG stamp on something and making sure you're using what they tested against13:17
mnasiadkakplant: as long as they release on time and with needed components13:17
mnasiadkakplant: and the Ceph part in Storage SIG is a bit... undercared ;)13:18
kplanthey i'm not saying i like it13:18
kplantjust saying i understand the political reasoningbehind it13:18
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Switch to RDO Stein release on CentOS & Oracle  https://review.opendev.org/65160113:19
mgoddardlets see how that goes ^13:19
*** Wasaac has quit IRC13:19
*** Wasaac has joined #openstack-kolla13:21
*** Sravan has joined #openstack-kolla13:21
*** k_mouza has joined #openstack-kolla13:23
jristhrw: yes, but this is just for master13:25
jristmnasiadka: thanks for the +1w13:25
*** Sravan has quit IRC13:26
hrwmgoddard: you forgot to disable for oraclelinux ;D13:26
*** mloza has joined #openstack-kolla13:29
mgoddardhrw: it wasn't failing on oraclelinux13:31
hrwweird. isn't it?13:31
mgoddardhrw: oracle does rpm -Uvh --nodeps <stein RDO RPM URL>13:32
hrwha!13:32
hrwno question then13:32
hrw+213:33
mgoddardboom13:33
*** schwicht has joined #openstack-kolla13:37
*** whoami-rajat has quit IRC13:47
*** goldyfruit has quit IRC13:51
*** goldyfruit has joined #openstack-kolla13:51
*** k_mouza has quit IRC13:54
hrwmnasiadka, spsurya: https://review.opendev.org/#/c/663375/ before someone break something again ;D13:54
*** schwicht has quit IRC13:55
*** whoami-rajat has joined #openstack-kolla13:57
openstackgerritMerged openstack/kolla-ansible master: Make bootstrap more idempotent  https://review.opendev.org/66359114:04
mgoddardthe new ceph upgrade CI job seems to be catching some flakiness in our upgrade of clustered rabbit & mariadb14:05
mgoddardhttp://logs.openstack.org/65/663565/3/check/kolla-ansible-centos-source-upgrade-ceph/f35f67e/primary/logs/docker_logs/rabbitmq.txt.gz14:05
*** Wasaac has quit IRC14:13
*** Wasaac has joined #openstack-kolla14:15
openstackgerritPierre Riteau proposed openstack/kolla-ansible master: Stop duplicating Nova cells  https://review.opendev.org/66339814:16
*** shyamb has quit IRC14:18
*** k_mouza has joined #openstack-kolla14:20
*** Wasaac has quit IRC14:20
*** Wasaac has joined #openstack-kolla14:24
*** iclon_ has joined #openstack-kolla14:35
*** priteau has joined #openstack-kolla14:36
*** iclon__ has quit IRC14:38
*** rwadolowski_ has quit IRC14:40
*** goldyfruit_ has joined #openstack-kolla14:42
*** goldyfruit has quit IRC14:42
*** rpittau is now known as rpittau|brb14:45
*** goldyfruit_ has quit IRC14:50
*** goldyfruit has joined #openstack-kolla14:50
*** luksky has quit IRC14:53
*** luksky has joined #openstack-kolla14:55
mgoddardand we're green on rdo stein https://review.opendev.org/#/c/65160115:09
*** Wasaac has quit IRC15:20
*** Wasaac has joined #openstack-kolla15:21
*** tolisbar has joined #openstack-kolla15:23
*** rpittau|brb is now known as rpittau15:26
*** Wasaac has quit IRC15:33
*** Wasaac has joined #openstack-kolla15:38
openstackgerritMerged openstack/kolla-ansible master: Fix Blazar Nova aggregate in multi-region setup  https://review.opendev.org/66332415:46
*** VickyG has joined #openstack-kolla15:46
*** rpittau is now known as rpittau|afk15:46
*** Wasaac has quit IRC15:55
*** k_mouza has quit IRC15:58
*** Sravan has joined #openstack-kolla15:59
*** luksky has quit IRC16:00
*** Sravan has quit IRC16:04
*** whoami-rajat has quit IRC16:07
*** whoami-rajat has joined #openstack-kolla16:12
*** gfidente has quit IRC16:28
openstackgerritMerged openstack/kolla-ansible master: Add unit test for keystone fernet cron generator  https://review.opendev.org/65961916:29
openstackgerritMerged openstack/kolla stable/rocky: Fix the problem that the crush map is changed  https://review.opendev.org/65391516:31
openstackgerritMerged openstack/kolla-ansible master: Fix keystone fernet key rotation scheduling  https://review.opendev.org/65929316:33
openstackgerritMerged openstack/kolla-ansible stable/stein: Tiny fix of quickstart guide  https://review.opendev.org/66096316:33
*** mgoddard has quit IRC16:48
*** Sravan has joined #openstack-kolla16:49
*** mgoddard has joined #openstack-kolla16:50
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Supporting monitoring time synchronisation with Monasca  https://review.opendev.org/66372216:50
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Add load monitoring plugin config for Monasca  https://review.opendev.org/66372316:50
*** Sravan has quit IRC16:58
*** Sravan has joined #openstack-kolla16:59
*** dpawlik has quit IRC17:04
*** dpawlik has joined #openstack-kolla17:05
*** dougsz has quit IRC17:05
openstackgerritPierre Riteau proposed openstack/kolla-ansible master: Stop duplicating Nova cells  https://review.opendev.org/66339817:08
*** dpawlik has quit IRC17:10
openstackgerritPierre Riteau proposed openstack/kolla-ansible master: Stop duplicating Nova cells  https://review.opendev.org/66339817:10
*** dcapone2004 has joined #openstack-kolla17:23
dcapone2004is there a way in kolla to specify which network interface to use for a certain openstack service on a PER SERVER basis?  We have a dev environment we are looking to explore different configrations with and not all of our dev machines have the same number of interfaces and we are hoping to be able to VLAN some of th einterfaces on the systems that are short on physical ports17:25
kplantsure. host_vars just as you would with ansible regularly17:26
*** spsurya has quit IRC17:40
*** dpawlik has joined #openstack-kolla17:42
*** Sravan has quit IRC17:43
*** Sravan has joined #openstack-kolla17:43
*** Sravan has quit IRC17:44
*** cah_link has quit IRC17:45
*** Sravan has joined #openstack-kolla17:45
*** dpawlik has quit IRC17:46
*** priteau has quit IRC17:56
*** JangwonLee__ has joined #openstack-kolla17:57
*** lennyb has quit IRC18:00
*** JangwonLee_ has quit IRC18:00
*** mgoddard has quit IRC18:03
*** mgoddard has joined #openstack-kolla18:03
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Use become for all docker tasks  https://review.opendev.org/65121018:05
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Check for 'become' in tasks that use Docker in pep8  https://review.opendev.org/65122618:05
*** sshnaidm is now known as sshnaidm|off18:06
*** Wasaac has joined #openstack-kolla18:15
*** Wasaac has quit IRC18:19
openstackgerritMerged openstack/kolla-ansible stable/rocky: Set log message field name in Monasca Fluentd plugin  https://review.opendev.org/66102518:20
mgoddarddcapone2004: +1 for host_vars or group_vars in your inventory. Note that if you set a variable in your inventory you cannot also put it in globals.yml as this will override the inventory18:25
*** cah_link has joined #openstack-kolla18:26
dcapone2004could you possibly give an example, like if I want to specify the cluster_interface for a particular host for the ceph portion of the deployment?18:27
dcapone2004and I assume that when you say globals.yml will override, I essentially need to omit ALL interface declarations in globals.yml and define each interface for each network in my inventory file correct?18:28
kplanti don't remember off of the top of my head which takes priority18:29
kplantbut if globals.yml overrides host vars then yes18:29
kplantis your inventory file ini or yaml?18:29
dcapone2004ini....  if I understand you correctly it would be [storage]\n dev-ceph01 cluster_interface="eth0\n dev-ceph02 cluster_interface="eth1"18:31
kplantyeah you could do it that way18:32
dcapone2004didn't know how/if something could be formatted in IRC, so I used the newline code to indicate I would put it on a newline18:32
kplantyou could also use host_vars18:32
kplanta directory, each file inside would be named after a host18:32
kplantand in the file you would define vars for that host only18:32
dcapone2004ok got it18:33
dcapone2004I think for a small 9 server dev deployment, inline is probably easier as a first step18:34
*** dpawlik has joined #openstack-kolla18:37
kplantif it's only 1-2 vars it's not a big thing18:40
kplantwhen it gets to 10... it's messy18:40
kplantunless your inventory is yaml to begin with18:40
*** Wasaac has joined #openstack-kolla18:42
*** dpawlik has quit IRC18:42
blineanyone have destroy get stuck? can't seem to run to completion18:46
kplantyou run with -vvv ?18:47
blineyeah, nothin really helpful18:47
blinecan nopaste the log18:47
blinethink it's something to do with the osd as it's on the clear osd and two our of 4 (the two compute machines) are not returning18:48
*** qqmber has joined #openstack-kolla18:50
qqmberhi.. I want to add one node to my Rocky installation... the problem is this new server have its em1 interface dead.. em2,em3,em4 are working and in the deployments we're using em1 as "network_interface" in globals.yml. How can I tell the installer to use em3 ONLY in this new server? is that possible?18:53
qqmbermaybe using the configuration in the "multinode" file.. something like "newserver.local network_interface=em3"?18:55
kplantyes however i think globals.yml will override that18:56
kplantso if you'd want to pull it out of globals.yml and do it as a host var for them all18:56
kplantif that's the case18:56
*** iclon_ has quit IRC18:58
blinehttp://paste.openstack.org/show/752613/ <- stuck19:04
blineeven rebooted all the servers to ensure it wasn't some stuck block device19:05
blinestill will not complete destroy19:05
qqmberkplant: sorry, but didn't get what you meant19:06
qqmberwhat do you mean with host var for them all?19:07
kplantso i think what is defined in globals.yml will override variables you set in your inventory19:14
kplantso you'll need to pull out the interface definitions from globals.yml19:14
kplantand put them in your inventory or host_vars for all hosts19:15
dcapone2004ok, i am having a slight brain cramp on whether i can do something...if i have 1 physical interface on a machine and i want to use it as the (using kolla network names) network_interface, tunnel_interface, and neutron_external_interface ... is this possible?  network_interface create subinterfae the vlan no problem, external, same no problem, but with vlan tunneling for the tunnel_interface, I am unsure if it is possible19:15
*** owalsh has quit IRC19:18
*** zbr has quit IRC19:25
*** cloudnull has quit IRC19:25
*** cloudnull has joined #openstack-kolla19:30
*** owalsh has joined #openstack-kolla19:34
blineso it seems cleanup-host is what's hanging; running that manually doesn't look so easy19:35
blinethink i figured it out, /etc/kolla//ovsdpdk-db/ovs-dpdkctl.sh: line 14: crudini: command not found19:41
blineand somehow that script hangs on grep reading stdin19:41
*** Sravan has quit IRC19:41
blineso yeah, that script isn't great. it hangs in unconfigure_kernel_modules if the driver isn't loaded19:44
JamesBensonbline, if it is stuck on the osd and it can be erased, why not just wipe it?19:46
blinei wiped the osds everytime i destory19:46
blineit's this ovs script19:47
blineand just bad bash scripting19:47
*** luksky has joined #openstack-kolla19:49
JamesBensonWouldn't this do it? ansible -i ./multinode -m shell -a "parted /dev/vdb -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_BS 1 -1" storage19:50
blinei have a script for clearing osds19:50
JamesBensonthat's typically what I do...19:50
JamesBensonok19:51
blinedoes the same as zap in ceph19:51
JamesBensonyeah19:51
JamesBensonwell, my command would bring it back to pre-ceph, just a labled partition.19:52
qqmberkplant: thanks.. I'll check that out19:52
blinesgdisk --zap-all /dev/sd${i}; sgdisk --mbrtogpt /dev/sd${i} then the parted /dev/sda  -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_BS_ARCHIVE 1 -1 and parted /dev/sdd  -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_BS_RAID10 1 -119:52
blineanyway, it's not OSD code, it turned out to be ovs-dpdkctl.sh hanging if the driver isn't loaded19:52
blinebecause the bash script just passes $driver off to grep without seeing if it's empty19:53
blinei just copied over a fix to that script and the hanging it gone. double this is a kolla thing, probably upstream19:54
*** kplant has quit IRC19:54
*** Wasaac has quit IRC20:07
*** cah_link has quit IRC20:11
*** Sravan has joined #openstack-kolla20:12
*** cah_link has joined #openstack-kolla20:14
*** Sravan has quit IRC20:16
*** radeks__ has quit IRC20:39
dcapone2004anyone have any insight on my networking question20:45
*** kplant has joined #openstack-kolla20:53
*** dpawlik has joined #openstack-kolla20:54
*** henriqueof has joined #openstack-kolla20:57
*** dpawlik has quit IRC20:59
*** Sravan has joined #openstack-kolla21:10
*** dpawlik has joined #openstack-kolla21:10
*** dpawlik has quit IRC21:14
*** Sravan has quit IRC21:15
*** KeithMnemonic has joined #openstack-kolla21:17
*** goldyfruit has quit IRC21:17
*** goldyfruit has joined #openstack-kolla21:18
*** Sravan has joined #openstack-kolla21:23
*** goldyfruit has quit IRC21:26
*** goldyfruit has joined #openstack-kolla21:27
*** whoami-rajat has quit IRC21:27
*** goldyfruit_ has joined #openstack-kolla21:29
*** goldyfruit has quit IRC21:29
*** JamesBenson has quit IRC21:35
*** cah_link1 has joined #openstack-kolla21:39
*** cah_link has quit IRC21:41
*** cah_link1 is now known as cah_link21:41
*** qqmber has quit IRC21:47
*** goldyfruit_ has quit IRC21:52
*** Sravan has quit IRC21:52
*** Sravan has joined #openstack-kolla21:53
*** rouk has quit IRC21:54
*** goldyfruit has joined #openstack-kolla21:58
*** cloudnull has quit IRC22:00
*** Sravan has quit IRC22:04
*** Sravan has joined #openstack-kolla22:05
*** Sravan has quit IRC22:07
*** JamesBenson has joined #openstack-kolla22:07
*** Wasaac has joined #openstack-kolla22:08
*** Wasaac has quit IRC22:12
*** JamesBenson has quit IRC22:12
*** Sravan has joined #openstack-kolla22:12
*** goldyfruit has quit IRC22:19
*** schwicht has joined #openstack-kolla22:24
*** cloudnull has joined #openstack-kolla22:28
*** JamesBenson has joined #openstack-kolla22:30
*** JamesBenson has quit IRC22:35
*** goldyfruit has joined #openstack-kolla22:38
*** Sravan has quit IRC22:40
*** schwicht has quit IRC22:42
*** schwicht has joined #openstack-kolla22:44
*** schwicht has quit IRC22:44
*** luksky has quit IRC22:51
*** goldyfruit has quit IRC23:02
*** cah_link has quit IRC23:12
*** cah_link1 has joined #openstack-kolla23:13
*** cah_link1 is now known as cah_link23:15
*** schwicht has joined #openstack-kolla23:15
*** cah_link1 has joined #openstack-kolla23:20
*** cah_link has quit IRC23:21
*** cah_link1 is now known as cah_link23:21
*** dpawlik has joined #openstack-kolla23:27
*** dpawlik has quit IRC23:31
*** goldyfruit has joined #openstack-kolla23:34
*** cah_link has quit IRC23:44
*** cah_link1 has joined #openstack-kolla23:44
*** cah_link1 is now known as cah_link23:46
openstackgerritMerged openstack/kolla master: Remove tripleo-ui  https://review.opendev.org/66284623:53
*** cah_link has quit IRC23:57
« Wednesday, 2019-06-05 Index Friday, 2019-06-07 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!