Friday, 2018-10-05

*** hamzy_ has joined #openstack-ansible00:01
*** hamzy_ is now known as hamzy00:02
*** DanyC_ has quit IRC00:07
mnasercloudnull: https://www.projectatomic.io/blog/2018/02/reintroduction-podman/ a fun upcoming project for you :P00:10
cloudnullseems like OOO is going that way00:11
cloudnulljust read Emileon's blog post00:11
cloudnullalso seems like were in the summer of the container runtime :P00:11
cloudnullits like folks haven't realized linux just provides all this, nudges nspawn :)00:12
cloudnullmnaser you ever figure out what was going on with the LVM based compute deployment?00:22
mnasercloudnull: haha yup, they are, interesting path they're doing00:22
mnasercloudnull: i did not unfortunately... i think its probably a centos chown thing00:23
mnasercloudnull: upon further research tho, it seemed like a lot of missed features by going lvm00:24
cloudnullI kicked a cent box to go and give this a bash however i've been pulled away for now00:24
cloudnullyea ++ there are a bunch of features that just do not exist when running with logical volumes, however the VMs are FAST!00:24
logan-yeah the performance gains are huge. no working thin volumes was painful though :(00:39
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_aodh stable/rocky: use include_tasks instead of include  https://review.openstack.org/60810500:48
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_trove stable/rocky: use include_tasks instead of include  https://review.openstack.org/60810700:49
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_tempest stable/rocky: use include_tasks instead of include  https://review.openstack.org/60810800:50
*** devx has quit IRC00:52
cloudnulllogan- that and migration seems to be a no go too00:55
cloudnullbut the speed sure is nice :)00:55
jamesdentonhowdy01:05
cloudnullo/ jamesdenton01:13
jamesdentonehlo01:13
jamesdentonwhat's the good word?01:14
cloudnulljust clouding `MariaDB [(none)]> drop database nova;`01:15
jamesdentonyou like to live dangerously01:15
* cloudnull living up to my name 01:16
jamesdentontouché01:16
*** dave-mccowan has quit IRC01:16
cloudnullsometimes it just needs to be nuked from orbit, its the only way to be sure.01:18
prometheanfirecloudnull: any protips on https://review.openstack.org/608102 ?01:35
prometheanfirecloudnull: my only guess as to what's happening is that since one script is calling another it's a variable scope thing01:42
cloudnullyea http://logs.openstack.org/02/608102/1/check/openstack-ansible-functional-gentoo-17-0-systemd/d171d5c/job-output.txt.gz#_2018-10-05_00_55_25_363550 I'd expect it to be something you need to extend to make the script detect gentoo01:44
prometheanfirecloudnull: talking about run_tests.sh?01:45
cloudnulltests/common/run_tests_common.sh01:45
cloudnullhttps://github.com/openstack/openstack-ansible-tests/blob/master/run_tests_common.sh#L23-L3401:45
prometheanfirecloudnull: ya, I'm doing the same as all the other distros...01:46
prometheanfirehmm, sourcing passes things for me01:50
prometheanfirehmm, the var is confirmed passed, but not detected...01:54
prometheanfireVERSION is not set01:56
prometheanfirebecause we be rollin01:57
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810201:58
*** gyee has quit IRC02:01
*** DanyC has joined #openstack-ansible02:08
*** DanyC has quit IRC02:15
prometheanfirelol, france uses gentoo hardened as their 'secure' OS02:20
*** devx has joined #openstack-ansible02:22
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810202:42
*** DanyC has joined #openstack-ansible03:10
*** DanyC has quit IRC03:15
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810203:40
*** kaiokmo has quit IRC03:41
*** udesale has joined #openstack-ansible03:49
prometheanfirecloudnull: shouldn't https://github.com/openstack/openstack-ansible-tests/blob/master/run_tests_common.sh#L90 and on be in a venv?03:53
prometheanfirecloudnull: system wide pip breaks things (at least the gentoo python people hate it)03:54
cloudnullvery recently odyssey4me did work to remove all of the system wide pip03:54
cloudnullmaybe that needs some doing yet in the tests repo ?03:54
prometheanfireI guess so03:55
prometheanfireI could package bindep and then tests could just 'emerge tox bindep'03:55
cloudnulllooking at the script, you could probably just install virtualenv from the pkg manager and then use pip from there?03:58
prometheanfireyep04:00
prometheanfirethe conversion of tests to virtualenv seems simple enough04:00
prometheanfirewe'll see if it's ok though, if it's just tox and bindep it may be fine04:00
cloudnullgive it a go , then run an experimental check to see if it breaks anything else04:02
prometheanfireone change at a time, I could stack it, but I likely have more revisions to do04:02
*** DanyC has joined #openstack-ansible04:11
openstackgerritAndreas Jaeger proposed openstack/openstack-ansible-os_horizon stable/ocata: Make functional job non-voting  https://review.openstack.org/60815704:12
openstackgerritAndreas Jaeger proposed openstack/openstack-ansible-os_horizon stable/ocata: Revert "Make functional job non-voting"  https://review.openstack.org/60815804:12
*** DanyC has quit IRC04:16
*** kwu_83tw has quit IRC04:18
*** kwu83tw has quit IRC04:18
*** jonher has quit IRC04:21
*** jonher has joined #openstack-ansible04:21
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: use a venv for bindep and tox  https://review.openstack.org/60816004:22
prometheanfirecloudnull: ^ lets see what breaks then04:22
prometheanfiretox, which creates a venv, running in a venv sounds fun, turtles all the way down04:25
*** faizy98 has joined #openstack-ansible04:26
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810204:36
prometheanfirewell, let's see if we installed python with sqlite support04:37
*** kukacz has quit IRC04:52
*** flaper87 has quit IRC04:52
*** jbadiapa has quit IRC04:52
*** openstackgerrit has quit IRC04:52
*** shyamb has joined #openstack-ansible04:54
*** kukacz has joined #openstack-ansible04:57
*** flaper87 has joined #openstack-ansible04:57
*** jbadiapa has joined #openstack-ansible04:57
*** openstackgerrit has joined #openstack-ansible04:57
*** Bhujay has joined #openstack-ansible04:59
*** Bhujay has quit IRC05:00
*** Bhujay has joined #openstack-ansible05:00
*** shyamb has quit IRC05:01
AJaegercloudnull, evrardjp, odyssey4me, I proposed https://review.openstack.org/608157 to move forward with https://review.openstack.org/59475005:04
*** shyamb has joined #openstack-ansible05:07
*** DanyC has joined #openstack-ansible05:12
*** DanyC has quit IRC05:16
*** mma has joined #openstack-ansible05:20
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: use a venv for bindep and tox  https://review.openstack.org/60816005:22
*** shyamb has quit IRC05:22
*** shyamb has joined #openstack-ansible05:35
prometheanfirelooks like that needs fixing ...05:42
prometheanfirehttp://logs.openstack.org/60/608160/3/check/openstack-ansible-functional-gentoo-17-0-systemd/2a0a518/job-output.txt.gz#_2018-10-05_05_36_46_77933105:42
*** shyamb has quit IRC05:47
*** Emine has quit IRC05:56
*** shyamb has joined #openstack-ansible06:01
*** shyamb has quit IRC06:15
*** shyamb has joined #openstack-ansible06:15
*** kwu83tw has joined #openstack-ansible06:26
*** kwu_83tw has joined #openstack-ansible06:26
*** udesale has quit IRC06:39
*** markvoelker has joined #openstack-ansible06:40
*** markvoelker has quit IRC06:45
*** Bhujay has quit IRC06:46
jrosserodyssey4me: https://etherpad.openstack.org/p/bionic-timeouts06:49
*** udesale has joined #openstack-ansible06:53
*** ericzolf has joined #openstack-ansible06:55
*** pcaruana has joined #openstack-ansible06:57
*** fghaas has joined #openstack-ansible07:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59475007:06
openstackgerritAndreas Jaeger proposed openstack/openstack-ansible-os_horizon stable/ocata: Revert "Make functional job non-voting"  https://review.openstack.org/60815807:07
prometheanfireodyssey4me: since you are up.... pip is still used system wide for tests, https://review.openstack.org/608160 feel free to review / take over as needed07:10
*** shyamb has quit IRC07:16
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: Make functional job non-voting  https://review.openstack.org/60815707:18
*** shardy has joined #openstack-ansible07:28
*** shyamb has joined #openstack-ansible07:28
*** olivierb_ has joined #openstack-ansible07:36
openstackgerritPanagiotis Karalis proposed openstack/openstack-ansible-os_tacker master: Tacker uses OpenStack Barbican for secret keys  https://review.openstack.org/60578407:37
openstackgerritOlivier Bourdon proposed openstack/openstack-ansible stable/queens: Fix healthcheck-hosts to work when behind a proxy  https://review.openstack.org/60689707:43
openstackgerritOlivier Bourdon proposed openstack/openstack-ansible stable/rocky: Fix healthcheck-hosts to work when behind a proxy  https://review.openstack.org/60689807:43
*** tosky has joined #openstack-ansible07:45
*** shyamb has quit IRC08:01
*** kwu_83tw has quit IRC08:01
*** kwu83tw has quit IRC08:01
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59475008:13
*** DanyC has joined #openstack-ansible08:19
*** DanyC_ has joined #openstack-ansible08:21
*** DanyC has quit IRC08:24
*** priteau has joined #openstack-ansible08:25
odyssey4meprometheanfire: yep, I was thinking of actually ditching tox, but your approach may be good for a transitional thing because ditching tox is a significant body of work08:26
odyssey4mejrosser: ok, so it looks like it's always the containers that are struggling?08:26
jrosserodyssey4me: it does appear that way, yes. In ara you can see other package tasks were quicker in the same builds08:30
*** faizy98 has quit IRC08:30
odyssey4mejrosser: I wonder if this has something to do with resource (CPU/mem) exhaustion08:31
evrardjpgood morning08:31
odyssey4meFor the integrated build, there should be dstat graphs08:31
odyssey4meevrardjp: o/08:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: role tests: Build horizon from stable/ocata, not master  https://review.openstack.org/60803508:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Revert "Make functional job non-voting"  https://review.openstack.org/60815808:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/60230808:37
odyssey4mejrosser: ok, while you look into that issue, I'm going to revise my change in the build to make all tests use the compute kit as a base - even with the slow builds perhaps it'll buy us some breathing room08:39
*** markvoelker has joined #openstack-ansible08:41
*** electrofelix has joined #openstack-ansible08:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Extend timeout to 3 hours  https://review.openstack.org/60818408:52
odyssey4mejrosser: ^ I don't like having to do that, but we also need to get rocky released, so patches need to be able to merge08:52
odyssey4meevrardjp ^08:52
*** faizy98 has joined #openstack-ansible08:53
odyssey4meWe need to put a concerted effort into figuring out the cause of the extended job run times. Our target should be an hour.08:53
jrosserodyssey4me: yeah, not good, but as things aren’t actually failing but taking a very long time, things do need to merge08:54
*** faizy98 has left #openstack-ansible08:55
*** xdfil_ has joined #openstack-ansible08:56
*** faizy98 has joined #openstack-ansible08:56
*** faizy_ has joined #openstack-ansible08:56
evrardjpsuper sad08:57
*** faizy98 has quit IRC08:57
xdfil_ew IRC cloud in trial mode sucks08:57
*** shyamb has joined #openstack-ansible08:58
evrardjpjrosser: if you're looking at this -- keep in mind we were already swapping. So it's worth noting to know if we are swapping more than usual. After the deploy of swift we are generally seeing a bump in memory consumption08:58
odyssey4mewhen doing a rebase and there are conflicts does anyone know how to tell git to take my original patch version of the file and ignore the changes that were made in the target?08:59
odyssey4melooks like 'git checkout --ours --' may do that09:00
jrosserevrardjp: I had a “go faster” ether pad somewhere with a very speculative list of things to try09:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179109:01
jrosserI did manage to demonstrate that overlayfs significantly reduces memory consumption, so that needs trying again09:01
odyssey4mejrosser: going faster doesn't really need much in terms of config changes - for now at least... what it needs is removal of cruft, like packages we don't use or need09:02
jrosserAnd I also found a bunch of tunables for swift to reduce the thread/processes, which iirc we don’t setup properly09:02
odyssey4mewe could also use modules far more than we do to replace scripts and complex fact settings or task sets09:02
odyssey4meand yes, if there're things we can do to reduce mem consumption those would be good09:03
jrosserBut really his is all speculative, it’s totally unclear why a packaged task that should take a minute or two is taking 30-50mins in some cases09:04
evrardjpjrosser: tuning swift would be a good quick win IMO09:04
evrardjpbut odyssey4me is right, we need to clean more stuff to make the memory spikes lighter09:04
evrardjpjrosser: I guess for the package -- it depends on the package, and it needs to be known in more details -- many things can go wrong. As far as I am aware, the worst hidden thing is IPv6-IPv4 fallback in dns resolution09:05
evrardjpbut bad links can happen09:06
jrosserevrardjp: did you see my etherpad link earlier?09:06
*** chandankumar has joined #openstack-ansible09:06
jrosserThere’s something specifically affecting apt installs on bionic, if you can spot a pattern/issue in the failures I’ve listed it would be extremely helpful09:07
noonedeadpunkmorning everyone09:11
*** rgogunskiy has joined #openstack-ansible09:14
*** markvoelker has quit IRC09:15
evrardjpsorry I missed it.09:15
*** Emine has joined #openstack-ansible09:32
noonedeadpunkodyssey4me: I see your comment here https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/zuul.d/project.yaml#L23-L27 but it seems, that ubuntu distro-install passes test here https://review.openstack.org/#/c/607653/ (it was missing 1 package for installation).09:35
noonedeadpunkOr there are another caveats, in order to set ubuntu distro_install check to be non-voting?09:36
odyssey4menoonedeadpunk: hmm, that looks interesting09:41
odyssey4menoonedeadpunk: if you could do a patch on top to make it voting, that'd be grand09:42
odyssey4meevrardjp jrosser I'm reworking the AIO bootstrapping, thinking of a way to make it much simpler and easier to use for all role tests09:43
*** gkadam has joined #openstack-ansible09:43
odyssey4melooking at this, it seems to me that the scenario thing is totally unnecessary - we can just replace it with a service list to enable09:43
*** shyamb has quit IRC09:44
noonedeadpunkodyssey4me: I'll try to investigate the thing with centos then and will try to place a patch09:44
odyssey4menoonedeadpunk: fantastic, thank you09:44
*** shyamb has joined #openstack-ansible09:47
*** chandankumar has quit IRC09:48
*** Taseer has joined #openstack-ansible09:50
*** shyamb has quit IRC09:55
*** chandankumar has joined #openstack-ansible09:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: role tests: Build horizon from stable/ocata, not master  https://review.openstack.org/60803509:59
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142410:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Revert "Make functional job non-voting"  https://review.openstack.org/60815810:00
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/60230810:00
*** shyamb has joined #openstack-ansible10:03
evrardjpodyssey4me: what do you mean 'a service list to enable' ?10:11
evrardjpYou will pass a variable with what to deploy?10:11
evrardjpand create multiple jobs that will pass different variable 's values?10:11
*** markvoelker has joined #openstack-ansible10:12
odyssey4meevrardjp: yep, pretty much - 3 comma seperated lists: infra services, openstack services and extra services10:12
odyssey4methe extra services just makes it easier to add on to the defaults rather than always modifying defaults10:12
odyssey4meevrardjp: never mind, I'll show it with code once I'm done10:17
*** Emine has quit IRC10:17
*** shyamb has quit IRC10:18
*** udesale has quit IRC10:18
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Fix of oslomsg undefined variables for services notifications  https://review.openstack.org/60765310:23
*** chandankumar has quit IRC10:26
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer stable/rocky: Fix of oslomsg undefined variables for services notifications  https://review.openstack.org/60820910:34
*** markvoelker has quit IRC10:44
noonedeadpunkfolks, check please this cherry-pick to rocky ^10:47
noonedeadpunkit had conflicts, which were manually resolved10:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179110:48
noonedeadpunkoh, sorry, let it pass the test first)10:49
odyssey4meevrardjp: https://review.openstack.org/#/c/551791/15/tests/roles/bootstrap-host/defaults/main.yml is basically my thinking10:50
*** shyamb has joined #openstack-ansible10:51
*** mma has quit IRC11:06
*** Administrator__ has joined #openstack-ansible11:08
*** faizy98 has joined #openstack-ansible11:09
evrardjpodyssey4me: it's unlikely the defaults will be edited, so maybe you can rely on set_facts to parse things and make things far more readable :)11:10
odyssey4meevrardjp: we will adjust the defaults for every role test11:11
*** xdfil_ has quit IRC11:11
odyssey4methe rabbitmq trole ests, for instance, would only run rabbitmq and none of the openstack services11:11
evrardjpodyssey4me: yeah I meant for more complex variables11:11
evrardjplike bootstrap_host_data_disk2_fs11:11
*** faizy_ has quit IRC11:11
odyssey4meoh yeah, I'm trying not to touch those for now11:12
odyssey4meA lot can be done to simplify the bootstrapping - but I'm focusing just on the scenario things for now11:12
jamesdentonmornin11:13
evrardjpyeah. I also think by providing multiple ways to override we will hit the same scope creep -- reducing the way you can override things simplify11:13
evrardjp(i.e. only keep the lookup('env' ...11:13
evrardjpor do we need an ansible way to override things?11:13
evrardjp(just curious the patch is fine :) )11:14
evrardjpwhen it will pass :)11:15
odyssey4meplenty of work still to do to make it pass - I had a passing set, but decided that it was too complex11:15
odyssey4mewe use 172.29.x.x in our AIO networks - is there something special about that class B ?11:16
jamesdentonNothing special IIRC. I picked it out of thin air back before v911:16
odyssey4meoh I see it's part of 172.16.0.0 – 172.31.255.25511:16
jamesdenton:)11:16
*** rpittau_ has quit IRC11:17
*** mma has joined #openstack-ansible11:18
*** mma has quit IRC11:19
*** mma has joined #openstack-ansible11:20
*** mma has quit IRC11:24
*** faizy98 has quit IRC11:32
*** Administrator__ has quit IRC11:32
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: role tests: Build horizon from stable/ocata, not master  https://review.openstack.org/60803511:36
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer stable/rocky: Fix of oslomsg undefined variables for services notifications  https://review.openstack.org/60820911:41
nicolasbockMorning o/11:41
*** markvoelker has joined #openstack-ansible11:41
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: Revert "Make functional job non-voting"  https://review.openstack.org/60815811:56
*** udesale has joined #openstack-ansible12:12
*** markvoelker has quit IRC12:15
noonedeadpunkCherry-pick is ready for review https://review.openstack.org/#/c/608209/ :)12:29
*** ohsnap has joined #openstack-ansible12:30
AJaegerodyssey4me: great to see that you found a fix for that repo!12:32
AJaegerevrardjp, odyssey4me, cloudnull : https://review.openstack.org/#/c/597576/ just got approved and thus the first part of python3-first (moving repos in-tree) is done for you! Congrats!12:32
evrardjpafter long labour but thanks to your love AJaeger ! :p12:33
odyssey4meyep, thanks a lot AJaeger cc mnaser12:33
AJaegerevrardjp, odyssey4me, thanks!12:34
* AJaeger waves good bye to this friendly channel for now ;)12:34
*** AJaeger has left #openstack-ansible12:35
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_nova master: Update the pci config for nova.  https://review.openstack.org/60578912:36
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_nova master: Update the pci config for nova.  https://review.openstack.org/60578912:41
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_nova master: Update the pci config for nova.  https://review.openstack.org/60578912:42
*** ansmith has joined #openstack-ansible12:50
*** shyamb has quit IRC12:55
openstackgerritAlex Redinger proposed openstack/openstack-ansible-os_keystone master: Add memcache flushing handler on db migrations  https://review.openstack.org/60806612:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179112:57
evrardjpis there a problem with rocky?13:04
evrardjpor should I investigate13:05
*** dave-mccowan has joined #openstack-ansible13:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179113:16
odyssey4meevrardjp: there is the issue which jrosser has been looking into - very slow execution, particularly apt installs13:16
odyssey4meevrardjp: we're not seeing it outside of openstack-infra, so my suggestion would be to do the RC tag on what we have and release it13:17
evrardjpthere is no urgency for last rc.13:18
odyssey4menot from a deadline standpoint, but waiting two months until release just seems silly13:18
*** dave-mccowan has quit IRC13:21
noonedeadpunkevrardjp odyssey4me can you check my cherry pick to rocky? It will be -1 bug for the tag:) https://review.openstack.org/60820913:21
evrardjpI agree odyssey4me13:21
noonedeadpunkand mnaser, if you're here, can you also look on this patch?13:23
*** mma has joined #openstack-ansible13:25
odyssey4melooks like opensuse is having trouble today again? http://logs.openstack.org/84/608184/1/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/0b8937d/job-output.txt.gz#_2018-10-05_10_31_42_55647013:28
*** mma has quit IRC13:29
jamesdentoni saw that failure yesterday, too13:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179113:44
*** strattao has joined #openstack-ansible13:47
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_horizon master: Add cloudkitty dashboard  https://review.openstack.org/60301313:50
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_horizon master: Add zun dashboard into horizon  https://review.openstack.org/60315213:51
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_horizon master: Add watcher dashboard into horizon  https://review.openstack.org/60315613:51
mbuilguys, by default, are we using nfs to store glance images? I think no but I see the 'var-lib-glance-images.mount' service and that confuses me13:53
*** kaiokmo has joined #openstack-ansible13:56
odyssey4membuil: for the integrated build, we use swift by default - for role tests, we use a file backing store13:57
mbuilodyssey4me: ok, I have default_store = file in the config file. However, I was getting confused by the existence of the systemd service var-lib-glance-images.mount which tries to mount a nfs server and fails13:58
odyssey4membuil: that's odd - that service should not be there unless nfs is configured as a backing store I don't think13:59
mbuilodyssey4me: ok good to know. I'll investigate14:01
*** faizy98 has joined #openstack-ansible14:04
hwoarangwe do some configuration for nfs in xci14:13
hwoarangi just dont know how far we are going with that14:13
*** iurygregory has quit IRC14:23
*** olivierb_ has quit IRC14:27
*** skiedude has joined #openstack-ansible14:29
*** faizy98 has quit IRC14:29
*** faizy98 has joined #openstack-ansible14:30
*** weezS has joined #openstack-ansible14:36
*** udesale has quit IRC14:38
*** fghaas has left #openstack-ansible14:44
*** gillesMo has joined #openstack-ansible14:46
*** kwu83tw has joined #openstack-ansible14:47
*** kwu_83tw has joined #openstack-ansible14:47
*** hwoarang has quit IRC14:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179114:56
*** hwoarang has joined #openstack-ansible15:00
*** sabomia has joined #openstack-ansible15:05
sabomiaIs there a recommended procedure for taking an infrastructure node down for maintenance?15:08
sabomia(in a 3-node cluster)15:08
*** rgogunskiy has quit IRC15:12
*** macza has joined #openstack-ansible15:20
*** Emine has joined #openstack-ansible15:23
*** gyee has joined #openstack-ansible15:24
faizy98sabomia: what kind of cluster?15:24
sabomiaOpenStack Ansible cluster with 3 infra nodes. Trying to determine the best way to do a controlled shutdown of one node and leave everything operating properly15:25
*** spatel has joined #openstack-ansible15:30
spateljamesdenton: morning15:30
jamesdentonhi15:30
spatelI had question about availability zone, how do i tell openstack to spread out instance between two availability zone?15:31
spatelif i say create 10 instance then how openstack spread them 50%-50% between AZ?15:31
spatelis that what servergroup does?15:31
jamesdentonthat's what the scheduler is for... within a given AZ. I don't know that it will schedule between AZs; that's kinda up to you15:32
jamesdentoni believe the server group helps avoid affinity to a node15:32
spatelin AWS we tell tf to spread machine between two zone and it does good job15:33
spateli am trying to understand how does Openstack work in that context15:33
*** pcaruana has quit IRC15:39
spateljamesdenton: this is what i am planning to do to fix SR-IOV HA issue https://ibb.co/j9kgUK15:44
spatelI am going with odd/even interface15:44
jamesdentonsounds like a plan15:45
spatelif TOR-1 failed then still i have 50% server available15:45
*** Taseer has quit IRC15:45
spatelnow i need to wire up them in availability zone so application spread out equality between two zone15:46
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: scripts: sources-branch-updater: Make regexp for master branch stricter  https://review.openstack.org/60830115:51
*** weezS has quit IRC15:51
*** benkohl has joined #openstack-ansible15:52
benkohlHi! Any idea what this means and how to fix it? "ceph-volume lvm: error: unrecognized arguments: batch --filestore --yes /dev/sdb /dev/sdd /dev/sde" in "TASK [ceph-osd : use ceph-volume lvm batch to create filestore osds]"15:54
*** weezS has joined #openstack-ansible15:54
*** ericzolf has quit IRC15:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179115:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179116:03
odyssey4mespatel: it's been a long time since I looked into this, but some time ago it was possible to provide scheduler hints when creating an instance and they would be used if you had the appropriate filter loaded16:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Implement more axes for an increased test matrix  https://review.openstack.org/55179116:07
spatelodyssey4me: hmm! i would like to know if that is still around or better way to handle that16:07
spateli want to make sure my application spread out between two TOR switch so reduce failure16:08
spatels/so/to16:08
odyssey4mespatel: there were also affinity and anti-affinity groups, and may be some other options... I'd go digging into the nova docs to see16:08
spatelright now i am watching this video from last Summit https://www.openstack.org/videos/vancouver-2018/curse-your-bones-availability-zones-116:09
spatelodyssey4me: thanks for the hint16:09
*** weezS has quit IRC16:13
*** ianychoi_ is now known as ianychoi16:19
*** gkadam has quit IRC16:21
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026116:25
*** sabomia has quit IRC16:27
*** aedc has joined #openstack-ansible16:41
*** ansmith has quit IRC16:42
*** pcaruana has joined #openstack-ansible16:42
*** gillesMo has quit IRC16:44
*** ansmith has joined #openstack-ansible16:45
*** pcaruana has quit IRC16:50
*** strattao has quit IRC17:01
*** skiedude has quit IRC17:04
*** DanyC_ has quit IRC17:04
*** DanyC has joined #openstack-ansible17:05
*** dave-mccowan has joined #openstack-ansible17:08
*** DanyC has quit IRC17:10
*** hamzaachi has joined #openstack-ansible17:13
*** dave-mccowan has quit IRC17:14
*** strattao has joined #openstack-ansible17:14
mnaserdarn17:19
mnaseropensuse broken again?17:19
mnasernicolasbock: hwoarang evrardjp is it possible to have someone look into it?17:21
*** ansmith has quit IRC17:25
*** ansmith has joined #openstack-ansible17:30
*** shardy has quit IRC17:31
*** hamzaachi has quit IRC17:33
noonedeadpunkmnaser: oh, hi. Can you please take a look at my patch (actually it's cherry-pick) of it looks okay for you? https://review.openstack.org/#/c/608209/17:34
*** aedc has quit IRC17:36
*** sawblade6 has joined #openstack-ansible17:36
*** strattao has quit IRC17:38
openstackgerritMatthew Thode proposed openstack/openstack-ansible-openstack_hosts master: add gentoo support  https://review.openstack.org/60832517:39
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810217:40
*** noonedeadpunk has quit IRC17:40
*** sawblade6 has quit IRC17:41
*** strattao has joined #openstack-ansible17:42
*** weezS has joined #openstack-ansible17:42
*** mmercer has joined #openstack-ansible17:42
*** benkohl has left #openstack-ansible17:50
*** hamzaachi has joined #openstack-ansible17:56
*** fghaas has joined #openstack-ansible18:03
*** strattao has quit IRC18:08
*** electrofelix has quit IRC18:10
openstackgerritAlex Redinger proposed openstack/openstack-ansible-os_keystone master: Add memcache flushing handler on db migrations  https://review.openstack.org/60806618:17
vollmanmnaser: I have an os_manila role that I would like to submit.  What should my next steps be?18:21
ohsnapis there an openstack project similar to ELK's packetbeat for neutron?18:25
ohsnapim just thinking of all of the packetbeat instances that would be needed to run across the environment degrading perf18:26
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Tacker uses OpenStack Barbican for secret keys  https://review.openstack.org/60578418:37
cloudnullohsnap i'm not aware of one, however osa does have playbooks for packetbeat.18:42
cloudnullthere's also connbeat18:42
cloudnullwe setup packetbeat with af_packet instead of libpcap to help preserve performance across a deployment18:44
cloudnullvollman if its ready to be imported you can make a pr to project-config to import the role18:46
mnaservollman: that is awesome. Is it up somewhere ?18:56
*** ansmith has quit IRC18:58
ohsnaphey thanks cloud18:59
vollmancloudnull:  thanks.  So add it to gerrit/projects.yaml and zuul under project-config?19:00
mnaservollman: we have a small process to import it if it’s already hosted elsewhere19:02
vollmanmnaser: Gotcha.  It is under my github account.  https://github.com/mvollman/openstack-ansible-os_manila19:04
mnaservollman: looks great do you have the cycles / time to submit the patch to import it?19:05
*** faizy_ has joined #openstack-ansible19:05
vollmanmnaser:  Sure.  what do I need to do?19:05
mnaservollman: you can start here — https://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list19:06
mnaserYou can see the other projects too if you want to see what they look like19:07
mnaserSpecifically the Ansible roles19:07
vollmanGreat.  I'll start there19:07
*** faizy98 has quit IRC19:08
*** fghaas has quit IRC19:10
*** ansmith has joined #openstack-ansible19:14
*** ohsnap has quit IRC19:19
*** dave-mccowan has joined #openstack-ansible19:23
nicolasbockmnaser: I am looking into it19:27
mnasernicolasbock: merci19:27
*** mma has joined #openstack-ansible19:33
*** DanyC has joined #openstack-ansible19:33
*** sawblade6 has joined #openstack-ansible19:37
*** ansmith has quit IRC19:39
*** ansmith has joined #openstack-ansible19:40
*** gillesMo has joined #openstack-ansible19:40
*** mma has quit IRC19:41
*** sawblade6 has quit IRC19:46
*** Emine has quit IRC19:47
openstackgerritMatthew Thode proposed openstack/openstack-ansible-openstack_hosts master: add gentoo support  https://review.openstack.org/60832519:58
*** ansmith has quit IRC20:03
*** sawblade6 has joined #openstack-ansible20:14
*** sawblade6 has quit IRC20:22
*** spatel has quit IRC20:47
mnasernicolasbock: any updates?20:48
nicolasbockI am still working on it mnaser . Right now I am trying to get `python-neutron-lib` updated which should unbreak `python-neutron`.20:49
mnasernicolasbock: awesome, thank you for the progress update20:49
nicolasbockBut I have never touched `rpm-packaging` before, so things are going slowly20:49
nicolasbockno problem mnaser20:49
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Blazar with OpenStack Ansible  https://review.openstack.org/54995620:52
*** weezS has quit IRC21:03
cloudnullworth a watch - https://media.ccc.de/v/ASG2018-192-state_of_systemd_facebook#t=610 - makes note of some of the things we're doing across osa and some interesting ideas on how we could could do things even better.21:11
openstackgerritMatthew Thode proposed openstack/openstack-ansible-openstack_hosts master: add gentoo support  https://review.openstack.org/60832521:24
*** DanyC has quit IRC21:25
*** Taseer has joined #openstack-ansible21:32
*** idlemind has quit IRC21:33
*** Taseer has quit IRC21:36
*** priteau has quit IRC21:46
openstackgerritMatthew Thode proposed openstack/openstack-ansible-openstack_hosts master: add gentoo support  https://review.openstack.org/60832522:03
*** sawblade6 has joined #openstack-ansible22:19
*** hamzaachi has quit IRC22:21
prometheanfireshould I enable parallel install/compile and the like for our gate stuff, increase the speed of gentoo stuff?22:21
openstackgerritMerged openstack/openstack-ansible-os_nova stable/rocky: Revert region name option to os_region_name for Cinder  https://review.openstack.org/59657722:25
*** sawblade6 has quit IRC22:25
*** spatel has joined #openstack-ansible22:34
*** spatel has quit IRC22:39
prometheanfireamd I correct in stating that it's looking for vars/gentoo.yml in openstack-hosts?  http://logs.openstack.org/02/608102/6/check/openstack-ansible-functional-gentoo-17-0-systemd/50fcbd3/job-output.txt.gz#_2018-10-05_22_25_52_53641422:42
*** macza has quit IRC23:06
openstackgerritMatthew Thode proposed openstack/openstack-ansible-openstack_hosts master: add gentoo support  https://review.openstack.org/60832523:09
prometheanfirenvm, it's lxc-hosts now23:10
prometheanfirenetworkd isn't used lxc-hosts?23:17
*** gyee has quit IRC23:31
cloudnullprometheanfire on the host side of things we typically dont configure anything23:46
cloudnullI think in the case of lxc-hosts its still using the legacy interface scripts23:47
cloudnullfor the lxcbr0 interface23:47
cloudnullyou could use networkd for gentoo though.23:47
cloudnulljust include the networkd role and you should be able to do what's needed23:48
cloudnullin nspawn everything is networkd23:48
cloudnullor iproute223:48
*** gillesMo has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!