Friday, 2018-07-20

*** sdake has quit IRC00:01
*** sdake has joined #openstack-ansible00:06
*** sdake has quit IRC00:06
*** sdake has joined #openstack-ansible00:06
*** asdf1234asdf[m] has quit IRC00:06
*** jhesketh has quit IRC00:06
*** lbragstad has quit IRC00:06
*** chudster_ has quit IRC00:06
*** jamesdenton has quit IRC00:06
*** senk has quit IRC00:06
*** lhinds has quit IRC00:06
*** jmnk has quit IRC00:06
*** flaper87 has quit IRC00:06
*** mudpuppy has quit IRC00:06
*** jiteka- has quit IRC00:06
*** madorn has quit IRC00:06
*** rickflare has quit IRC00:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379400:09
*** linshuicheng[m] has quit IRC00:10
*** evrardjp[m] has quit IRC00:10
*** lbragstad[m] has quit IRC00:10
*** taildashef-work has quit IRC00:10
cloudnullmnaser the change looks fine however I agree w/ logan- ++ reno or leave the default var alone00:10
*** keithmnemonic[m] has quit IRC00:10
*** jothibasu[m] has quit IRC00:10
*** markvoelker has quit IRC00:10
mnasercloudnull: im going to check but i think i introduced this var this same cycle with another change i did00:11
mnaserso ill verify that because then it'd be a bit silly00:11
*** rschulman has quit IRC00:11
*** csmart has quit IRC00:11
cloudnull++00:11
cloudnullif that's the case, then carry on :)00:11
mnaserhttps://review.openstack.org/#/c/576883/6/defaults/main.yml00:11
mnasernope its not i lied00:11
cloudnullunless it was a change that was backported, then i fall back to my original thought00:12
cloudnulloh00:12
mnaservoila00:14
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_cinder master: Change deprecated option iscsi_helper to target_helper  https://review.openstack.org/58415100:14
cloudnulllgtm00:14
*** jhesketh has joined #openstack-ansible00:15
*** lbragstad has joined #openstack-ansible00:15
*** chudster_ has joined #openstack-ansible00:15
*** jamesdenton has joined #openstack-ansible00:15
*** senk has joined #openstack-ansible00:15
*** lhinds has joined #openstack-ansible00:15
*** jmnk has joined #openstack-ansible00:15
*** flaper87 has joined #openstack-ansible00:15
*** mudpuppy has joined #openstack-ansible00:15
*** jiteka- has joined #openstack-ansible00:15
*** madorn has joined #openstack-ansible00:15
*** rickflare has joined #openstack-ansible00:15
cloudnulli'll bet the cinder gate is still angry00:15
cloudnullbut the change looks good00:15
cloudnull:D00:15
mnaserill stop making it angry00:16
cloudnullno, dont stop, i think it needs to be made a little more angry :)00:21
cloudnulli think evrardjp was working on a fix for cinderbackup00:21
cloudnullto make it generally happy00:21
*** threestrands has joined #openstack-ansible00:23
*** threestrands has quit IRC00:23
*** threestrands has joined #openstack-ansible00:23
*** markvoelker has joined #openstack-ansible00:24
*** cshen has joined #openstack-ansible00:31
*** cshen has quit IRC00:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379400:36
*** poopcat1 has joined #openstack-ansible00:44
*** asdf1234asdf[m] has joined #openstack-ansible00:46
*** exodusftw has quit IRC00:46
*** poopcat has quit IRC00:47
*** exodusftw has joined #openstack-ansible00:52
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_cinder master: Change deprecated option iscsi_helper to target_helper  https://review.openstack.org/58415100:58
*** dave-mccowan has quit IRC00:59
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379401:16
*** tux_ has quit IRC01:33
*** chyka has joined #openstack-ansible01:36
*** chyka has quit IRC01:37
*** dave-mccowan has joined #openstack-ansible01:38
*** tux_ has joined #openstack-ansible01:43
bgmccollumshould the loop device for nspawn containers not be created if im using LXC? just noticed this hanging around...01:45
*** coreywright has quit IRC01:45
*** dave-mccowan has quit IRC01:52
*** Bhujay has joined #openstack-ansible01:52
*** coreywright has joined #openstack-ansible02:04
*** lbragstad[m] has joined #openstack-ansible02:11
*** RossSchulman[m] has joined #openstack-ansible02:11
*** keithmnemonic[m] has joined #openstack-ansible02:11
*** linshuicheng[m] has joined #openstack-ansible02:11
*** jothibasu[m] has joined #openstack-ansible02:11
*** csmart[m] has joined #openstack-ansible02:11
*** evrardjp[m] has joined #openstack-ansible02:11
*** albertcard2 has joined #openstack-ansible02:13
*** yanyao has joined #openstack-ansible02:14
openstackgerritbhujay kumar proposed openstack/openstack-ansible-os_cloudkitty master: Correct typo in variable name  https://review.openstack.org/58420002:16
*** poopcat1 has quit IRC02:16
logan-o/ my bad if thats the case mnaser :)02:26
*** Bhujay has quit IRC02:30
*** cshen has joined #openstack-ansible02:39
*** adrianreza has joined #openstack-ansible02:44
*** poopcat1 has joined #openstack-ansible02:44
*** cshen has quit IRC02:44
*** albertcard2 has quit IRC02:47
*** threestrands has quit IRC02:54
cloudnullbgmccollum the machines.raw loop device is created regardless.02:57
cloudnullin lxc we use that for general image storage02:57
bgmccollumOIC thanks02:58
cloudnullin nspawn and lxc w/ the machinectl backend we actually provision the container there02:58
cloudnullif you want to use that directly you can, just set lxc_backend_store (i think thats the var) to machinectl02:58
prometheanfirecloudnull: we need to switch our default now that master is updated03:02
cloudnull++03:03
*** taildashef-work[ has joined #openstack-ansible03:05
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379403:08
*** threestrands has joined #openstack-ansible03:10
*** threestrands has quit IRC03:10
*** threestrands has joined #openstack-ansible03:10
*** albertcard2 has joined #openstack-ansible03:15
*** poopcat1 has quit IRC03:18
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_cinder master: Change deprecated option iscsi_helper to target_helper  https://review.openstack.org/58415103:21
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_cinder master: Change deprecated option iscsi_helper to target_helper  https://review.openstack.org/58415103:21
*** kstev has joined #openstack-ansible03:26
cloudnullmnaser logan- you around ? mind giving my review a look ?03:31
mnaseri am around forever03:31
cloudnullhaha03:31
mnaseri dont sleep on flights and im landing 6am est so03:31
cloudnullI know you're pain03:31
cloudnullwhere you off to ?03:31
mnaserso which revieww? :>03:31
cloudnullhome ?03:31
mnaserback home :)03:31
cloudnullhttps://review.openstack.org/58379403:31
cloudnulladding testing to the elk bits03:31
logan-looking03:32
cloudnulland that testing should be selective, only running when the elk bits are modified03:32
mnaseroh thats interesting03:32
logan-see my comment in there btw regarding gate pipeline03:32
* mnaser the ':' in the job name, not a typo?03:32
cloudnullnope03:33
logan-mnaser: i was surprised that worked too lol03:33
mnaserthats a super interesting way of 'namespacing'03:33
mnaserlogan-: time to try csrf with job names?03:33
mnaserhaha03:33
cloudnulli was trying to make a way to signify which thing was running under the ops repo namespace03:33
mnaseri like it03:34
mnasercloudnull: by the way, i tried using systemd_networkd to configure networking for physical infra in order to deploy OS on top03:34
mnaserbut .. weird things started happening for some reason03:34
mnaserexample: we have lxcbr0 and br-mgmt, traffic egress lxcbr0, then out br-mgmt (masqueraded)03:35
mnaserit comes back in from br-mgmt and then instead of being sent off using lxcbr0, it actually gets sent to the vm over br-mgmt...03:35
mnaserarp and ip routes point to stuff should be going through lxcbr0.. idk03:35
cloudnullah logan- so I should add a gate pipeline then03:36
logan-yup03:36
* cloudnull will do 03:36
cloudnullmnaser that's odd ?03:37
mnaservery odd03:37
mnaserah thats a good catch03:37
mnaserlogan-: is good at reviews03:37
cloudnullI have networkd running on my hardware lab using https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-playbook-networkd-host-interfaces-yml03:38
logan-been doing alot of zuul lately heh03:38
cloudnullthe hostvars are like so https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-openstack_user_config-yml-L417-L42903:38
cloudnullits not a great way to do all the things. but its working03:38
cloudnullthat said tux_ was running into similar issues with networkd on cent703:39
cloudnullmy lab is running xenial03:39
*** kstev has quit IRC03:39
tux_cloudnull: networkd doesn't support lxc bridge with CentOS 7 because os systemd bug03:40
tux_cloudnull: only solution is to upgrade systemd to latest version which is not possible on CentOS703:41
tux_mnaser: ^^03:41
mnaseroooooh03:41
mnaserthats interesting03:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379403:41
tux_mnaser: if you using CentOS7 please use ifcfg-*03:41
mnasertux_: do you have a bug or some keryowrds for me to google03:41
mnaseryeah i ended up writing stuff to use ifcfg-03:41
tux_i spent lots of hour to fix but no luck03:42
cloudnullhowever we are using networkd in the integrated gate.03:42
mnaseri'd like to track the bug or maybe push to get the fix backported03:42
cloudnullw/ cent703:42
cloudnullso maybe there's a bug, but it is working in the main osa gate03:43
mnaseryeah after many hours i got sick of looking at it :(03:43
cloudnulland within the specific nspawn gates.03:43
tux_cloudnull: are you saying networkd working with CentOS 7 with LXC bridge ?03:43
cloudnullyes03:43
tux_cloudnull: how?????03:43
logan-i was looking at feeding osa bridges and stuff to cloud-init config drives in centos but https://bugzilla.redhat.com/show_bug.cgi?id=1536946 nixed that :(03:43
openstackbugzilla.redhat.com bug 1536946 in cloud-init "cloud-init can't handle network config data version 1 for bond" [Medium,Assigned] - Assigned to eterrell03:43
cloudnullthats how all of the main osa tests are run03:43
tux_cloudnull: tell me your kernel version and systemd version03:44
cloudnulltux_ i don't know that combo in the gate sadly.03:45
tux_cloudnull: i spend 3 days to find out and it didn't work.. (only issue is lxc bridge)  if i don't use lxcbridge everything works great with networkd03:45
mnasertux_: the answer is latest everything03:45
cloudnullhum03:45
tux_I have latest version CentOS 7.5 but there is no upgrade for systemd, CentOS 7 still using systemd 2.1903:46
tux_i tired to upgrade systemd but found there are so many dependencies which makes upgrade impossible03:47
tux_cloudnull: when you saying "integrated gate" what does that means ? is this something different technology ?03:48
cloudnulltux_ all changes that happen in the openstack-ansible repo is the integrated gate03:48
cloudnulllike https://review.openstack.org/#/c/58281403:48
tux_cloudnull: so look like its dummy network which run inside OS03:49
cloudnullwhile the cent7 gate is failing, its failing on tempest not on a networking issue03:50
cloudnullhttp://logs.openstack.org/14/582814/1/check/openstack-ansible-deploy-aio_metal-centos-7/dae3b75/job-output.txt.gz#_2018-07-16_02_43_38_99645103:50
cloudnullyes. its running dummy interfaces for everything that would be physical.03:50
cloudnullthe lxcbr0 interface is managed by the lxc-host role03:50
tux_cloudnull: it may work with internal component but it doesn't support with external communication, I had same issue everything was pinging internal but when my container trying to talk about side it failed to ping03:55
tux_it was very odd issue after banging my head multiple time i switch to ifcfg-* and i am happy now03:55
cloudnullsadly i dont have a cluster of cent7 nodes to try it.03:56
tux_may be i will try again and see if i can reproduce that error again03:56
tux_even i talked to systemd developer and they said systemd 2.19 is very buggy and stay away from it is possible03:57
cloudnulli'd be happy to try and join a screen-share / webex / whatever to try and figure that out on cent03:57
cloudnullthat very well could be03:57
tux_cloudnull: https://maciej.lasyk.info/2016/Dec/16/systemd-231-latest-in-centos-7-thx-to-facebook/03:58
-tux_- So Centos7 currently has systemd version 219 installed which was released on 2015-02-16 (see NEWS).03:58
-tux_- This is a huge problem, as we miss a lot of very important functions related to journald, networkd, machinectl, systemd-nspawn and so on.03:58
*** epalper has joined #openstack-ansible03:58
cloudnull++03:58
tux_cloudnull: lets do one thing.. i will setup CentOS 7 on my LAB and give it a try to networkd and will share result here..04:00
cloudnull++ let us know if there's anything we can do to help04:02
tux_sure i will, i will be happy if we can fix this on CentOS7 because i want to use networkd badly04:03
cloudnullthough if cent7 has these issues w/ systemd there's not a lot we can do.04:03
cloudnull++ its pretty great :)04:03
cloudnullon xenial that is04:03
tux_I am 100% sure its systemd issue but worth trying may be i had bad day when i pick that box04:03
*** albertcard2 has quit IRC04:06
*** udesale has joined #openstack-ansible04:07
*** mattinator has quit IRC04:09
tux_cloudnull: Good night!! i will catch you in morning...!04:12
cloudnulltake care04:12
*** Bhujay has joined #openstack-ansible04:14
*** yanyao has quit IRC04:22
*** epalper has quit IRC04:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379404:36
*** threestrands has quit IRC04:40
cloudnulllogan- mnaser thanks for having a look at that04:40
* cloudnull fingers crossed it gates and collects logs :) 04:40
openstackgerritziyu proposed openstack/openstack-ansible-os_sahara master: Add the project source code repository in README  https://review.openstack.org/58422004:47
openstackgerritziyu proposed openstack/openstack-ansible-rsyslog_server master: Add the project source code repository in README  https://review.openstack.org/58422104:48
openstackgerritziyu proposed openstack/openstack-ansible-rsyslog_server master: Add the project source code repository in README  https://review.openstack.org/58422104:50
openstackgerritziyu proposed openstack/openstack-ansible-os_sahara master: Add the project source code repository in README  https://review.openstack.org/58422004:51
openstackgerritziyu proposed openstack/openstack-ansible-os_neutron master: Add the project source code repository in README  https://review.openstack.org/58422204:55
openstackgerritziyu proposed openstack/openstack-ansible-os_nova master: Add the project source code repository in README  https://review.openstack.org/58422405:01
*** tux_ has quit IRC05:03
openstackgerritziyu proposed openstack/openstack-ansible-os_barbican master: Add the project source code repository in README  https://review.openstack.org/58422505:05
openstackgerritziyu proposed openstack/openstack-ansible-os_ironic master: Add the project source code repository in README  https://review.openstack.org/58422605:09
*** pcaruana has joined #openstack-ansible05:09
*** cshen has joined #openstack-ansible05:10
openstackgerritziyu proposed openstack/openstack-ansible-os_magnum master: Add the project source code repository in README  https://review.openstack.org/58422705:12
*** taseer1 has joined #openstack-ansible05:15
*** cshen has quit IRC05:15
*** taseer2 has joined #openstack-ansible05:16
*** Taseer has quit IRC05:16
openstackgerritziyu proposed openstack/openstack-ansible-os_swift master: Add the project source code repository in README  https://review.openstack.org/58422805:16
*** taseer1 has quit IRC05:19
*** yanyao has joined #openstack-ansible05:29
*** cshen has joined #openstack-ansible05:31
*** taseer3 has joined #openstack-ansible05:31
*** yanyao has quit IRC05:33
*** taseer2 has quit IRC05:34
*** cshen has quit IRC05:35
*** taseer3 is now known as Taseer05:46
jrossercloudnull: those networkd issues feel a little like rp_filter?06:03
*** epalper has joined #openstack-ansible06:04
*** taseer1 has joined #openstack-ansible06:06
*** Taseer has quit IRC06:08
*** taseer2 has joined #openstack-ansible06:09
*** taseer1 has quit IRC06:11
*** lvdombrkr has joined #openstack-ansible06:22
*** taseer2 is now known as Taseer06:25
mnaserjrosser: rp_filter is the reason why it isnt working but why does linux do this weird routing in the first place06:27
*** udesale_ has joined #openstack-ansible06:28
*** udesale has quit IRC06:30
*** taseer1 has joined #openstack-ansible06:36
*** cshen has joined #openstack-ansible06:38
*** Taseer has quit IRC06:39
*** lvdombrkr89 has joined #openstack-ansible06:49
*** lvdombrkr has quit IRC06:51
*** taseer2 has joined #openstack-ansible06:59
*** taseer1 has quit IRC07:02
jrossermnaser: it is odd, theres no ambiguity in the ip address scheme i assume?07:06
mnaserjrosser: nope, the br-mgmt range was 172.24.0.0/24 and lxcbr0 was the usual 10.something07:06
*** DanyC has joined #openstack-ansible07:07
jrosserand lxcbr nats to the br-mgmt range?07:08
hwoaranggood morning07:08
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57977007:08
evrardjpgood morning07:08
hwoarangevrardjp: could you revote on ^^. conflicts again...07:08
evrardjphwoarang: really?07:08
evrardjpSorry07:08
hwoarangand i need one more core... mnaser cloudnull perhaps^07:08
evrardjphave other cores voted before?07:09
hwoarangnope07:09
evrardjpno07:09
evrardjpok07:09
hwoarangit will get in eventually :)07:09
mnaserill have a look07:09
evrardjpI'd like at least another07:09
mnaserbut i am sad that centos is nv07:09
mnaserbut07:09
evrardjpthen if you need to rebase I will consider the work ok.07:09
odyssey4meo/07:09
mnaserim sure we'll get that figured out07:09
evrardjpmnaser: that can be improved07:09
evrardjplater07:09
evrardjpelse the patch will become huge :)07:09
hwoarangit nv despite this patch07:09
hwoarang*it is07:09
evrardjpMVP :D07:09
mnaserthe work hwoarang has done and involving centos is enough already07:10
evrardjpI am not explaining myself right07:10
*** poul has joined #openstack-ansible07:10
evrardjpignore my comment it will be easier07:10
*** poul has quit IRC07:11
*** poul has joined #openstack-ansible07:11
*** poul_ has joined #openstack-ansible07:12
hwoarangyeah for centos, it would be nice if the existing basekit job becomes green. then fixing the distro one would be easier07:13
hwoarangboth jobs are likely to face similar issues but that's just a speculation right now07:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57977007:14
openstackgerritDuc Nguyen proposed openstack/openstack-ansible-os_keystone master: Replace port 35357 with 5000  https://review.openstack.org/58425607:14
*** poul has quit IRC07:15
evrardjpI remember I had a concern a few days ago of a very far fetched thing but I can't remember it hwoarang , sorry07:15
evrardjpit will come back!07:16
mnaser+2 from me.  looks good.  doesnt break the world07:16
evrardjp #mornings07:16
evrardjpmnaser: thanks07:16
mnaserevrardjp: hwoarang ill trade reviews on https://review.openstack.org/#/c/584151/ and its parent tho :)07:17
evrardjpofc07:17
evrardjpanything else?07:17
mnaserwhich should help the basekit centos job pass07:17
mnaseri think07:17
mnaseri dunno.  im getting tired07:18
mnaserstill cant sleep07:18
evrardjpmnaser: go to bed, more work will be there tomorrow anyway... : p07:19
* mnaser is in a plane close over denver right now07:19
mnaseri cant sleep in planes07:19
evrardjpoh ok07:19
*** DanyC has quit IRC07:19
jrossermnaser: this makes an interesting read about traffic doing interesting things with bridges https://vincent.bernat.im/en/blog/2017-linux-bridge-isolation07:20
evrardjpWOW07:21
evrardjpSUCCESS on https://review.openstack.org/#/c/574006/07:21
evrardjpjust a timeout07:21
evrardjpwooot07:21
evrardjpwhat a "milestone"!07:22
evrardjpodyssey4me: can you vote on https://review.openstack.org/#/c/583955/ ?07:23
evrardjpjrosser: vincent bernat is a great writer :)07:23
jrosseryeah its an excellent series of blog posts07:25
odyssey4meweird - why has https://review.openstack.org/#/c/584037/3 not entered gate?07:26
evrardjpI started to follow vincent articles long ago when he started writing about haproxy07:26
evrardjpvery in-depth07:26
odyssey4meah, it depends on a patch which hasn't merged yet07:26
evrardjpyeah07:27
evrardjpmy bad07:27
*** tosky has joined #openstack-ansible07:27
odyssey4meanother set of eyes on https://review.openstack.org/584052 please to unblock cinder tests07:28
evrardjpodyssey4me: could you also check swift?07:28
evrardjpodyssey4me: swift multi region fails07:28
odyssey4meyeah, will get there07:28
odyssey4mejust getting the main ones I have other patches waiting on through, then will get to that one07:28
odyssey4mereview for https://review.openstack.org/583672 please - very csimple backport07:29
evrardjpyeah it's blocking httplib2 thing which was helping during my debugging of M307:29
jrosserevrardjp: https://vincent.bernat.im/en/blog/2018-multi-tier-loadbalancer07:30
jrosserwell theres my answer for massive rgw07:30
odyssey4meanother test inventory fix to get magnum working - reviews please: https://review.openstack.org/58404207:30
*** aetaric has quit IRC07:31
*** hamzy_ has joined #openstack-ansible07:31
odyssey4meand another bit of tidying up: https://review.openstack.org/58403807:31
evrardjpjrosser: OMG I am old. I remember reading https://vincent.bernat.im/en/blog/2011-lab-site-to-site-vpn07:31
*** hamzy has quit IRC07:31
*** Bhujay has quit IRC07:32
*** Bhujay has joined #openstack-ansible07:33
mnaserwow i am really potato-ing07:33
*** udesale__ has joined #openstack-ansible07:33
mnaserim asking for reviews on a change that's not mine and that i can vote for07:33
mnaseri'll look now odyssey4me07:33
odyssey4meevrardjp: mind if we merge https://review.openstack.org/#/c/583276/1 now to unblock octavia, assuming it passes gate07:34
evrardjpmnaser: what is potato-ing?07:34
mnaserbecoming a potato07:34
mnaseri guess?07:34
Adri2000hello07:34
evrardjpmnaser: yes but it's still not very explicit :p07:35
odyssey4meevrardjp: don't harrangue the fellow mid-flight with lack of sleep :p07:35
Adri2000any way to use config overrides to put multiples values for the same key? as I understand https://docs.openstack.org/nova/queens/configuration/config.html#pci.alias I'd need to put multiple "alias = ..." in my nova.conf07:36
evrardjpodyssey4me: I am trying to stimulate the person!07:36
*** udesale_ has quit IRC07:36
evrardjpodyssey4me: don't come with fancy words like harrangue07:36
odyssey4me:p07:36
evrardjp!07:36
evrardjpAdri2000: a set?07:36
evrardjpusing "?"07:36
mnaserand we're flying over denver now07:36
mnaseranyone whos flown over denver can tell you how it's a very unpleasent experience lol07:36
evrardjpAdri2000: isn't this a dict ?07:37
*** gkadam has joined #openstack-ansible07:37
odyssey4mewow, it'd be good for https://docs.openstack.org/ansible-config_template/latest/ to get some examples07:37
evrardjpAdri2000: try dict and set, see what works for the nova07:37
evrardjpodyssey4me: these are generated from the code I think07:38
evrardjpwe can change the code to add those07:38
Adri2000evrardjp: in nova.conf directly I know that multiple alias = ... lines works07:38
evrardjpwell you'd say it's always generated from the code...07:38
evrardjpsome*07:38
mnaseri think you can simply add commas07:38
mnaserfor ListOpt07:38
mnaserex: alias = foo,bar07:39
mnaseris the same as07:39
mnaseralias = foo\nalias = bar07:39
Adri2000ok let me try that :)07:39
odyssey4meI did think there were more examples, but apparently I'm wrong07:39
odyssey4meThat really should be fixed - that module is super-useful, but useless without documentation to expose how to use itproperly07:40
evrardjphwoarang: question07:40
mnaseri wonder maybe the ceph part has docs odyssey4me ?07:40
evrardjpis there a plan to support some parts of a deploy with distro and some with sources?07:40
evrardjpmnaser: odyssey4me we have docs in the reference that we can copy there07:41
hwoarangevrardjp: i have no such plans :/07:41
evrardjphwoarang: ok07:41
evrardjpwe just know what the system is07:41
hwoarangit could be possible if these parts are on separate containers. if you are mixing packages on the same host it would be too hard07:41
evrardjp"current state"07:41
evrardjpok07:41
odyssey4meevrardjp: perhaps andymccr could take it upon himself to add some docs, given he's been doing a ton of work on the module for ceph-ansible07:41
evrardjphe has done a great job :)07:42
odyssey4me++07:42
Adri2000mnaser: evrardjp: foo, bar doesn't work but { foo, bar } works perfectly!07:44
mnaserthere ya go07:44
mnaser:>07:44
evrardjphwoarang: don't you think we should skip the repo_masters group creation (or make it empty) when distro_packages are used?07:44
odyssey4meAdri2000: could you do a bug report for lack of docs for what you wanted to do, then please share what worked in the report too07:45
evrardjpAdri2000: when did I say dict? :)07:45
evrardjpodyssey4me: Adri2000 ++07:45
evrardjphwoarang: I will submit a patch07:46
hwoarangok07:48
mnaserwow, well we're hauling ass right now07:48
mnaserthanks to tailwinds doing over 1000km/h means i get home sooner woo07:48
*** hamzy_ has quit IRC07:50
*** CharlesB has joined #openstack-ansible07:54
*** pmannidi has quit IRC07:56
*** electrofelix has joined #openstack-ansible07:56
Adri2000evrardjp: :p odyssey4me: yep will do07:57
*** rmart04 has joined #openstack-ansible07:58
hwoarangdoes it worth having the distro jobs just in the check pipeline?07:58
hwoarangso we can free up some 'gate' resources?07:59
hwoarangi think i had that in the past but evrardjp you said we need in both. sorry if i forget the details :/ there is only so much info i can hold in my head07:59
odyssey4meno need to save resources07:59
hwoarangok07:59
odyssey4meand yeah, voting checks must also be in gate to ensure that we maintain consistency between patch submission and patch approval08:00
odyssey4meie it makes sure that when it passes check (code submission) it also passes at the time of merge (the code underneath could have changed beteen submission and approval)08:00
*** suggestable has joined #openstack-ansible08:01
hwoarangwhen a patch is approved you still run the check pipeline right?08:01
odyssey4menope, once w is added it goes straight into gate08:01
odyssey4meand because zuul rebases the patch on top of the current head of master, it's important that we match tests that matter in gate08:02
hwoaranghmm i thought that we ran check+gate on W+1. my bad08:03
hwoarangmakes sense then08:03
evrardjphwoarang: we needed both WHEN assuming some can be disabled. if it's an all or nothing situation that's different : )08:03
*** taseer2 is now known as Taseer08:03
evrardjpI remember saying something about ppl have to be smart and not do dumb thing like install_source = distro and change for some only08:04
evrardjpbut instead do install = source, and change some if they need to08:04
evrardjpI meant install_method=distro above.08:04
*** chyka has joined #openstack-ansible08:04
evrardjpI will patch that08:04
*** chyka has quit IRC08:09
*** shardy has joined #openstack-ansible08:10
openstackgerritMerged openstack/openstack-ansible-tests master: Connect to localhost as remote host for cinder/nova  https://review.openstack.org/58403308:15
odyssey4meevrardjp hwoarang could I get some eyes on https://review.openstack.org/584042 and https://review.openstack.org/584038 please?08:26
*** parasitid has quit IRC08:26
evrardjpsure08:28
*** KeithMnemonic has quit IRC08:37
*** KeithMnemonic has joined #openstack-ansible08:38
*** indistylo has joined #openstack-ansible08:42
*** parasitid has joined #openstack-ansible08:44
*** DanyC has joined #openstack-ansible08:55
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Preparing group of host is not a "change"  https://review.openstack.org/58387909:07
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Automatic skip of the repo build for distro installs  https://review.openstack.org/58428509:07
*** taseer1 has joined #openstack-ansible09:08
*** Taseer has quit IRC09:08
*** taseer2 has joined #openstack-ansible09:09
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_swift master: Remove pypy job  https://review.openstack.org/58428709:11
*** taseer3 has joined #openstack-ansible09:12
evrardjpI'd love seeing this merged: https://review.openstack.org/#/c/581802/09:12
*** taseer1 has quit IRC09:12
*** cshen has quit IRC09:13
evrardjpodyssey4me: that will be required for the test refactoring work ^09:13
odyssey4meseems appropriate09:14
*** cshen has joined #openstack-ansible09:15
*** taseer2 has quit IRC09:15
*** parasitid has quit IRC09:17
odyssey4mehmm, do we have an example of how to set a standard job non-voting now?09:17
odyssey4meI'd like to temporarily disable the octavia functional test, get these fixes in to make it work again, then enable it again.09:18
odyssey4meah: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/zuul.d/project.yaml#L3309:19
Bhujaywondering will these code work  when i am running ceilometer container in a separate host which is not hosting rabbit containers ?  https://github.com/openstack/openstack-ansible-os_ceilometer/blob/780d8d477cfcbe8c317dac4db68c2413b30dd0f1/templates/ceilometer.conf.j2#L4409:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Switch compute to use different inventory_hostname  https://review.openstack.org/58404809:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Fixes compute error  https://review.openstack.org/58327609:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Temporarily set functional test to non-voting  https://review.openstack.org/58429509:22
Bhujaygot this while running os_ceilometer , i had this error fatal: [infra7_ceilometer_central_container-d460b902]: FAILED! => {"failed": true, "msg": "'glance_rabbitmq_telemetry_host_group' is undefined"}09:23
evrardjpodyssey4me: just redefine the job with voting: false09:24
Bhujayand finally had to take help of this tedious workaround  http://paste.openstack.org/show/726321/. Not sure if it need a fix or i am missing something09:24
evrardjpI mean re-list it in the project09:24
evrardjpyeah exactly :)09:24
*** jbadiapa has quit IRC09:28
*** cshen has quit IRC09:28
Bhujayevrardjp, odyssey4me , if you can take a look  whenever time permits , not sure if its a bug  ^09:30
*** hamzy_ has joined #openstack-ansible09:31
*** hachi has joined #openstack-ansible09:31
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Remove localhost from neutron agents group  https://review.openstack.org/58403809:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Make certificate generation host configurable  https://review.openstack.org/58264109:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232409:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266809:35
*** parasitid has joined #openstack-ansible09:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Revert "Temporarily set functional test to non-voting"  https://review.openstack.org/58429809:37
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Switch compute/storage to use different inventory_hostname  https://review.openstack.org/58404209:41
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Switch compute to use different inventory_hostname  https://review.openstack.org/58403709:42
*** taildashef-work[ has quit IRC09:42
*** lbragstad[m] has quit IRC09:42
*** RossSchulman[m] has quit IRC09:42
*** linshuicheng[m] has quit IRC09:42
*** asdf1234asdf[m] has quit IRC09:42
*** jothibasu[m] has quit IRC09:42
*** csmart[m] has quit IRC09:42
*** keithmnemonic[m] has quit IRC09:42
*** evrardjp[m] has quit IRC09:43
*** jbadiapa has joined #openstack-ansible09:43
*** cshen has joined #openstack-ansible09:44
*** aetaric has joined #openstack-ansible09:47
*** asdf1234asdf[m] has joined #openstack-ansible09:48
*** prasen has joined #openstack-ansible09:48
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Disable Volume Backup Tests  https://review.openstack.org/58395509:55
*** taseer3 is now known as Taseer09:55
evrardjpI would be happy if we could discuss the cleanup of the ansible_local multiple when conditions, by having ppl voting on what they think is best readable here: https://etherpad.openstack.org/p/osa-readability-test09:57
evrardjpodyssey4me: hwoarang jrosser d34dh0r53 cloudnull logan- jmccrory mnaser ^09:58
*** gillesMo has joined #openstack-ansible09:59
*** hachi has quit IRC10:02
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: tasks: providers: Rename 'ovs' configuration file  https://review.openstack.org/58391910:03
hwoarangoh that needs to free up some brain capacity10:04
*** jbadiapa is now known as jbadiapa|away10:06
hwoarangevrardjp: is there a typo in D? is not " ?10:08
hwoarangnot empty?10:08
evrardjpyeah10:09
evrardjpthat's the equivalent of default(False, True) | bool for example10:09
*** cshen has quit IRC10:09
evrardjp | default(...10:09
odyssey4meevrardjp: I wonder if that might be equivalent of None? But yeah, D looks good to me as-is.10:10
odyssey4mecould perhaps do != there as well I guess10:11
evrardjpI will ofc try this10:11
evrardjpbut it was to give an idea10:11
evrardjpbecause C is very compelling10:11
odyssey4menone is different10:12
evrardjpNone is different indeed10:12
odyssey4meC is very vebose though, and easy to make a mistake with10:12
evrardjpnot sure why this came up10:12
evrardjpoh you brought it :p10:13
odyssey4methere is also https://github.com/openstack/openstack-ansible-plugins/commit/80a1262252db951e40749d37f5348aa8907039c610:13
evrardjpodyssey4me: well, funny story, that's the reason I wanted to get rid of.10:13
evrardjpso ansible has in 2.7 a filter named subelements10:13
odyssey4methat filter's not used anywhere I don't think, so we can revert that patch if we're never going to use it10:14
evrardjpso that would partially cover this, and included upstream10:14
evrardjpso for example the test_dict: a: b: c: d:10:14
evrardjpso for example the test_dict: a: b: c: d*10:14
evrardjpyou could do test_dict | subelements('c')10:15
evrardjpIIRC10:15
*** keithmnemonic[m] has joined #openstack-ansible10:15
*** csmart[m] has joined #openstack-ansible10:15
evrardjpelse10:15
*** evrardjp[m] has joined #openstack-ansible10:15
*** linshuicheng[m] has joined #openstack-ansible10:15
*** jothibasu[m] has joined #openstack-ansible10:15
evrardjpjson_query a.b.c10:15
*** RossSchulman[m] has joined #openstack-ansible10:15
*** lbragstad[m] has joined #openstack-ansible10:15
hwoarangjrosser: that was a good reading indeed (re bridge isolation)10:15
evrardjphere it's just the conditional that make it weird10:15
*** taildashef-work[ has joined #openstack-ansible10:15
evrardjpfor the example given in the patch you said odyssey4me it would easily be rewritten in json_query as: {{ (ansible_local | json_query('openstack_ansible.swift.venv_tag')) == swift_venv_tag }}10:17
evrardjpso there is 0 difference there, and no reason to have get_nested10:18
evrardjpI was just asking for clarity of the thing when conditions are more complex.10:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Revert "Add a get_nested filter"  https://review.openstack.org/58430410:20
evrardjpI truly believe jinja is missing an "empty" test, which is the same as | default(True, True)10:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Revert "Add a get_nested filter"  https://review.openstack.org/58430410:22
odyssey4meevrardjp: agreed10:22
*** hachi has joined #openstack-ansible10:23
evrardjpodyssey4me: I wanted to do it! :)10:23
evrardjpplease keep that topic name for all the cleanups :)10:24
jrosserevrardjp: is D missing a " ?10:27
evrardjp?10:27
hwoarangjrosser: it's actual two '10:27
hwoarang;p i got confused by that too10:28
hwoarang*actually10:28
evrardjplet's rewrite this as ""10:28
jrosserah right, guess "readbility test" is good name there :)10:29
evrardjphahah10:29
evrardjpwell we'll have to review those things10:29
evrardjpbetter be in sync before starting patching10:29
evrardjpI will remove my vote as I am split between B and D anyway.10:30
evrardjpoh the A is wrong10:31
evrardjpit's "bool" not defined10:31
evrardjpit doesn't matter I don't like it! :p10:32
*** rmart04 has quit IRC10:32
*** shardy has quit IRC10:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266811:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Revert "Temporarily set functional test to non-voting"  https://review.openstack.org/58429811:11
*** aruns__ has joined #openstack-ansible11:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58231511:14
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: tasks: horizon_post_install: Ensure horizon dashboard directory is accessible  https://review.openstack.org/58432711:14
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: tasks: horizon_post_install: Add missing become statements for horizon user  https://review.openstack.org/58432811:14
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: tasks: horizon_post_install: Add 'force' parameter when creating symlink  https://review.openstack.org/58432911:14
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/58433011:14
*** indistylo has quit IRC11:16
odyssey4meevrardjp: does https://review.openstack.org/#/c/584049/3 look right to you, or just I screw up a change somewhere?11:17
*** indistylo has joined #openstack-ansible11:17
evrardjpchecking11:17
*** aruns__ has quit IRC11:18
*** udesale__ has quit IRC11:19
evrardjpodyssey4me: NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 10.1.3.311:19
evrardjpfun with networking.11:19
odyssey4meyeah, do you think my change broke it or do you think that's some sort of other breakage somewhere?11:20
* odyssey4me doesn't understand all that crap11:20
evrardjpI need to see the whole picture, which I don't have with just a patch... IMO we are now using SSH everywhere11:21
evrardjpwhich is error prone11:22
evrardjpbut this can't be true :p11:22
odyssey4meyeah, but there is no other way around it - I tried pretty much every other way I could think of11:22
odyssey4meother roles are fine, even those that use nova11:23
odyssey4mealthough I expect they use different tests11:23
evrardjpthere is only one way to find out11:23
evrardjp(opening code)11:23
evrardjpall the plays are from tests repo11:24
evrardjpgood11:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58231511:24
evrardjpand the inventory is simple11:24
evrardjpoh now I understand11:24
evrardjpwe have physical_host and container_name into group_vars.11:25
odyssey4meI took 'openstack1' out of the 'neutron_linuxbridge_agent' group because I didn't think that actually belonged there, but perhaps it does?11:25
odyssey4meoh, you think that physical_hosts should now be 'compute1' ?11:26
evrardjpno I am not sure it matters, they will still do it right11:27
evrardjpoh wait11:27
evrardjpyeah it doesn't matter11:27
odyssey4memight matter for these vars? https://review.openstack.org/#/c/584049/3/tests/host_vars/compute1.yml11:28
*** aruns__ has joined #openstack-ansible11:28
evrardjpyou might want to add ansible_connection=local in the inventory11:29
evrardjpfor compute111:29
odyssey4menope, we do not want connection=local for it11:29
evrardjpwhy?11:30
odyssey4methat's why this change is happening in the first place11:30
evrardjpelse it would ssh11:30
odyssey4meif you use local connection, then it needs become - read the commit msg11:30
odyssey4mewe *want* it to ssh, because that way we're in as root11:30
evrardjpmmm yeah.11:31
evrardjpso it's on purpose11:31
evrardjpI see11:31
*** indistylo has quit IRC11:31
jamesdentonmornin'11:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Switch compute to use different inventory_hostname  https://review.openstack.org/58404911:33
evrardjpI think the best thing you could do is run it on a machine odyssey4me11:33
odyssey4metrying to put that back to see11:33
evrardjpand find out what's wrong11:33
evrardjpjamesdenton: morning!11:33
jamesdentonhi!11:33
jamesdentonsomeone said networking. my ears were burning11:33
evrardjpthe issue also appears only in tempest11:33
evrardjphahaha11:34
odyssey4mehaha11:34
evrardjpjamesdenton: as long as it's not bleeding11:34
odyssey4meyeah, I suspect that the provider network isn't working... but I don't have enough understanding of how that works to troubleshoot it even if I did build an instance11:34
jamesdentonthere are days...11:34
evrardjphttps://www.youtube.com/watch?v=eNr0WXQ3Ho411:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Move MQ vhost/user creation into role  https://review.openstack.org/58338711:35
evrardjpodyssey4me: try without removing the vars of localhost11:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58231511:36
evrardjpif it's localhost used as target for the building the networks part you're in a bad place11:36
odyssey4meevrardjp: I thought of that, then saw this: https://github.com/openstack/openstack-ansible-os_nova/blob/master/tests/os_nova-overrides.yml#L19-L2211:36
evrardjpthat's neutron though?11:36
evrardjphaha great.11:37
evrardjpmore overrides.11:37
odyssey4mewe *really* want to make sure those provider network settings are found11:37
odyssey4mehttps://github.com/openstack/openstack-ansible-os_nova/blob/master/tests/host_vars/localhost.yml#L22-L29 stays in localhost's vars because the test play that builds the bridges is targeted at localhost11:37
evrardjpodyssey4me: that was my point11:38
odyssey4meso those vars stay in my patch... so I don't understand what you're suggesting11:38
*** lvdombrkr has joined #openstack-ansible11:39
*** cshen has joined #openstack-ansible11:39
evrardjpnothing yet11:39
*** lvdombrkr89 has quit IRC11:40
*** hachi has quit IRC11:41
*** lvdombrkr89 has joined #openstack-ansible11:41
odyssey4mehwoarang & evrardjp could we go through some review quickly to unblock octavia?11:41
evrardjpyeah -- I don't see the nova issue just yet11:42
odyssey4mehttps://review.openstack.org/584295 then https://review.openstack.org/584048 then https://review.openstack.org/58327611:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Revert "Temporarily set functional test to non-voting"  https://review.openstack.org/58429811:42
odyssey4methen that one ^11:43
evrardjpodyssey4me: nothing in your chain works though11:43
odyssey4mehttps://review.openstack.org/#/c/583276/2 passed the ssl test, so I think it's done11:43
odyssey4methe functional test just timed out11:43
*** lvdombrkr has quit IRC11:44
evrardjpyeah -- I hope it's not on a network issue in tempest :p11:45
DmitriyI have another question regarding masakari role. It seems, that in 17.0.6 venv for masakari should be built on the repo server. However, build fails with the following error:11:45
evrardjpat some point if all of this doesn't work, should we start reverting this whole become: user: story?11:45
DmitriyCould not find a version that satisfies the requirement microversion-parse>=0.2.1 (from masakari) (from versions: 0.1.4)11:45
DmitriyNo matching distribution found for microversion-parse>=0.2.1 (from masakari)11:45
evrardjpI am leaving a few more days, but if tempest doesn't work, we'll never be able to reach m3.11:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338811:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Make certificate generation host configurable  https://review.openstack.org/58264111:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232411:47
evrardjpodyssey4me: we are asking you too much there, and it must be super frustrating , I am sorry.11:48
odyssey4meevrardjp: if we revert that, all the work delegating to the deploy host will have to be reverted - so no, I'd rather than run all tests as root and be done with it11:48
odyssey4megetting this all to work is pretty key to that other spec to put all OSA config into user-space (non-root)11:48
evrardjpok11:49
evrardjpI don't say it's not valuable, don't get me wrong11:49
evrardjpI just say it's maybe a bad timing11:49
odyssey4methis approach has worked for several roles already, so I think this is fine - it's just some weird niggle to figure out11:49
DmitriyAnd /opt/venv-build-script.sh fails for masakari as well. http://paste.openstack.org/show/726335/11:50
odyssey4mewuld like some review for https://review.openstack.org/583366 now that cinder's unblocked11:51
odyssey4meDmitriy: the great likelihood is that you're trying to pin to a SHA that's out of sync with the global requirements11:51
odyssey4meDmitriy: pick a SHA for the same date as all the other SHA's11:51
*** aruns__ has quit IRC11:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/57964511:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Move MQ vhost/user creation into role  https://review.openstack.org/58337911:53
*** indistylo has joined #openstack-ansible11:54
Dmitriyodyssey4me I'm trying to upgrade from 17.0.5 to 17.06. So I've sewitched to it, runned bootstrap-ansible.sh and now I'm trying to run setup-infrastructure.yml.11:54
odyssey4meDmitriy: given that masakari is not included in the integrated repo, you'll have to tell me more about what settings you've implemented to use it11:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58229611:56
*** jbadiapa|away is now known as jbadiapa11:58
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_rally stable/queens: Change rally pip package  https://review.openstack.org/58408911:58
Dmitriyodyssey4me hm, I was working on masakari role, and used it in our production. So I've placed /etc/openstack_deploy/env.d/masakari.yml with description of the service http://paste.openstack.org/show/726336/11:59
hwoarangevrardjp: you misunderstood me on https://review.openstack.org/#/c/584285/11:59
DmitriyAlso I've placed installation step in openstack_user_config.yml12:00
odyssey4meDmitriy: I mean specifically with regards to the git/version related information in your overrides/repo_packages12:00
guilhermesp^^ ignore the patch above, I was just updating a commit message, but as odyssey4me said, I proposed on master and I passed12:00
guilhermespmornings :)12:00
odyssey4meDmitriy: have you set any values anywhere for https://github.com/openstack/openstack-ansible-os_masakari/blob/master/defaults/main.yml#L29-L30 ?12:01
Dmitriyodyssey4me nope12:02
odyssey4meDmitriy: ok, so that means you're trying to build rocky masakari for a queens deployment12:03
Dmitriythey are excatly like in git12:03
odyssey4methe requirements are not compatible12:03
Dmitriyodyssey4me it seems, that I get the point. but masakari doesn't have any tag/branch except master12:03
odyssey4meso, for it to work right, you'll need to set those two vars in your /etc/openstack_deploy/user_variables.yml file, with the value for masakari_git_install_branch being a SHA that's on the same date as those that match the other openstack services for the release of OSA you're using: https://github.com/openstack/openstack-ansible/blob/17.0.6/playbooks/defaults/repo_packages/openstack_services.yml12:04
Dmitriyno, my fault12:04
*** kstev has joined #openstack-ansible12:04
odyssey4meDmitriy: I'm talking about the openstack/masakari version here, not the role version12:04
odyssey4meso, for this example we find a SHA for masakari's stable/queens which matches the date 09.06.201812:05
Dmitriyodyssey4me: Yep, I've already realised, that I'm not right. Thanks you for pointing me12:05
odyssey4meno worries, happy to help12:05
*** prasen has quit IRC12:07
evrardjphwoarang: oh good point. I still answered :p12:13
evrardjpppl shouldn't then12:14
*** kstev has quit IRC12:16
hwoarangi am not sure i understood the comment about manual deployment to be honest :/ I didn't mean to block the patch just thought to point that out12:19
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Temporarily set functional test to non-voting  https://review.openstack.org/58429512:35
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Switch compute to use different inventory_hostname  https://review.openstack.org/58404812:35
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Fixes compute error  https://review.openstack.org/58327612:35
evrardjphwoarang: if someone deploys by doing os-keystone-install.yml os-glance-install.yml ...12:35
evrardjpor in this case haproxy-install.yml repo-install.yml12:36
evrardjpso that conditional wouldn't appear12:36
evrardjphowever12:36
evrardjpI abandonned the thing, because I thought that if ppl start plays manually, there is no reason they aren't smart enough to not run the repo-install12:36
*** cshen has quit IRC12:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build stable/queens: tasks: repo_build_wheels: Download get-pip.py if it does not exist  https://review.openstack.org/58435512:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build stable/queens: tasks: repo_build_wheels: Download get-pip.py if it does not exist  https://review.openstack.org/58435512:50
*** cronix has joined #openstack-ansible12:50
odyssey4meevrardjp with https://review.openstack.org/#/c/583925/ merged, https://review.openstack.org/584355 is now necessary12:50
hwoarangevrardjp: ah ok that would make sense...12:51
admin0hi all .. is it possible to just do horizon and keystone install.. and then add 3 existing OSA installs as regions to this new one :)12:52
admin0how do I tackle/handle regions12:53
evrardjpadmin0: yes, you might want to speak to other ppl with experience but yeah12:54
evrardjpodyssey4me: HOHOHOHOHO https://review.openstack.org/#/c/574006/12:55
evrardjpgreen!12:55
evrardjpafter a month!12:55
evrardjphwoarang: could you merge this one in: https://review.openstack.org/#/c/574006/1712:56
evrardjpafter that I will stop being grumpy12:56
evrardjp(I didn't say for how long)12:56
evrardjpnext step is bumping pip to 10!12:56
evrardjpwooot12:56
evrardjpand re-bumping the shas12:56
hwoarangok12:57
evrardjpbut at least we have something to release for M3. That was far too old12:57
odyssey4mejust in time for the next bump ;)12:58
odyssey4megood work on that evrardjp - that got complicated12:58
*** armaan has joined #openstack-ansible13:00
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_keystone master: Remove the unnecessary space  https://review.openstack.org/58279113:04
mgariepygood morning everyone13:04
evrardjpodyssey4me: well I haven't fixed the things13:04
evrardjpI need to dig into cinder + swift + keystone13:04
evrardjpbut it's something I'd like to do when I have more time13:04
evrardjpfix it in devstack too13:05
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Switch storage to use different inventory_hostname  https://review.openstack.org/58405213:12
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Change deprecated option iscsi_helper to target_helper  https://review.openstack.org/58415113:12
evrardjpmgariepy: woot: Readability test for you: https://etherpad.openstack.org/p/osa-readability-test13:12
*** cshen has joined #openstack-ansible13:13
mgariepyevrardjp, isn't | not supposed to be there anymore ?13:15
mgariepy| == is ?13:15
openstackgerritjacky06 proposed openstack/openstack-ansible-os_keystone master: Remove the unnecessary space  https://review.openstack.org/58279113:15
mgariepyor i misunderstood something else.13:15
odyssey4mecores, quick review please - very simple patch: https://review.openstack.org/58367213:17
*** parasitid has quit IRC13:18
mgariepydone13:18
*** parasitid has joined #openstack-ansible13:19
*** CharlesB has quit IRC13:20
odyssey4methx mgariepy got another one here if you have a moment: https://review.openstack.org/58430413:24
*** rmart04 has joined #openstack-ansible13:24
evrardjpmgariepy: I have serious trouble with the "is bool". For me, False or True would return True to is bool :)13:25
evrardjpmgariepy: | == is for tests13:26
evrardjp| should be kept for filters.13:26
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/58433013:26
Adri2000got another override related question: trying to override enable_router in OPENSTACK_NEUTRON_NETWORK in horizon's local_settings.py: the horizon_config_overrides var can only override HORIZON_CONFIG if I understand correctly :/ any solution apart from adding a new variable to the local_settings.py template?13:26
openstackgerritMerged openstack/openstack-ansible-pip_install stable/queens: Update get-pip to version 3.3  https://review.openstack.org/58323413:27
mgariepyha ok13:27
evrardjpAdri2000: yeah currently local_settings.py is still a legacy thing13:27
evrardjpAdri2000: I'd welcome the contributor that changes it to the new format, if the new format is ready13:28
evrardjpjust saying.13:28
evrardjp:D13:28
odyssey4meevrardjp: surely 'is bool' is a type verification of the var, whereas '| bool' returns an evaluation result based on the content of the var?13:28
evrardjpodyssey4me: that's the thing13:28
evrardjpit is not a type verification13:28
Adri2000evrardjp: you mean there is a new config file format coming in horizon?13:28
evrardjp | bool is a test13:28
evrardjpso it will be written "is bool" in the future.13:28
*** armaan has quit IRC13:28
ebbex_"lxc_container_create : Generate machine-id" fails on stable/queens, "mesg: ttyname failed: Inappropriate ioctl for device\n/bin/sh: 1: /usr/bin/python: not found\n"13:28
evrardjpI just damn hate it.13:28
evrardjpI want to rename it "is truth"13:29
evrardjpis true13:29
evrardjpor whatever13:29
odyssey4mewell, '| bool' is actually evaluating the var content as far as I know13:29
evrardjpis true-ish13:29
evrardjpyeah13:29
openstackgerritMerged openstack/openstack-ansible-pip_install stable/pike: Update get-pip to version 3.3  https://review.openstack.org/58323513:29
*** hachi has joined #openstack-ansible13:29
evrardjpso it's an ansible filter that checks if the content is true-ish13:29
odyssey4meso if you have {{ 'foo' | bool }} it will return False, because 'foo' != True13:29
evrardjpso y/yes/True/true matches13:29
evrardjpthat's correct odyssey4me13:30
evrardjpodyssey4me: in the future you will have to write it "{{ 'foo' is bool }}"13:30
mgariepyFalse | bool ?13:30
mgariepywould it test if the thing is a bool ? ..13:31
evrardjpmgariepy: that will be written "{{ False is bool }}" and will return false.13:31
odyssey4mewell, meh13:31
evrardjpbecause False isn't true-ish13:31
evrardjpit's still a boolean13:31
evrardjpbut hey13:31
evrardjpI didn't write that.13:31
mgariepychanging it now wouldn't be a great idea either i guess haha13:32
evrardjpalso remember that testing on strings could return True :)13:33
evrardjpfun with ansible!13:33
evrardjpso {% if 'False' %} is True-ish13:33
evrardjpbut {% if False %} isn't.13:33
mgariepyhappy friday !13:34
evrardjpI meant is True, not True-ish in the meaning of earlier.13:34
*** jwitko has joined #openstack-ansible13:34
evrardjphahaha13:34
evrardjpbut that all makes sense to me :)13:34
* odyssey4me pours himself a drink13:34
evrardjpI just want to have our own filter that is doing the same as | bool but renames things as "trueish"13:35
evrardjpor is somethingliketrue13:35
* odyssey4me noticed evrardjp muttering to himself13:35
odyssey4meNoisy up there, eh?13:36
evrardjphahahah13:36
Adri2000evrardjp: would you +1 adding an os_horizon horizon_enable_router variable for the current local_settings.py? :)13:38
*** chyka has joined #openstack-ansible13:38
evrardjpI'd be okay for you Adri200013:39
guilhermespppl, is this ( https://bit.ly/2LpiPfY  ) "poor" in terms of testing or do you think it needs more scenarios?13:39
evrardjpbut I'd be even more okay with using yaml/ini13:39
Adri2000evrardjp: but that'd be require changes in horizon directly right?13:40
evrardjpAdri2000: alternatively you can bring the .py folder13:40
evrardjpAdri2000: I think those merged, right?13:40
Adri2000no idea13:40
evrardjpAdri2000: well I support the local_settings.d/ should be there13:40
evrardjplet me check for the rest13:41
*** goldenfri has joined #openstack-ansible13:41
*** EmilienM is now known as EvilienM13:41
openstackgerritAdrien Cunin proposed openstack/openstack-ansible-os_horizon master: New horizon_enable_router variable  https://review.openstack.org/58437513:42
Adri2000at least, here is the local patch I had to do to move forward ^ :)13:43
evrardjpAdri2000: apparently I was wrong13:43
Adri2000ah13:43
evrardjpthere is no .ini or .yaml format support yet13:43
evrardjpbut local_settings.d/ can be brought up though13:43
*** chyka has quit IRC13:44
evrardjpI think it's time to refactor horizon's role code, it starts to be messy13:44
Dmitriyodyssey4me: and how masakari has appeared in building venv? Is venv is been build for every role, that is present in /etc/ansible/roles? On what basis it is added by repo_build role? As https://github.com/openstack/openstack-ansible-repo_build/blob/8cbd722ac4de268cbf6c283f9825958071b6a6bb/tasks/repo_clone_git.yml#L34-L52 still trying to clone master branch, while I've specified  branch for masakari in user_variables.yml13:45
Dmitriyevrardjp: do you think if https://bugs.launchpad.net/openstack-ansible/+bug/1778098 needs to be fixed? I may send a patch if this approach looks ok13:49
openstackLaunchpad bug 1778098 in openstack-ansible "os_horizon role fails if horizon_custom_themes is specified" [Low,Confirmed] - Assigned to Amy Marrich (amy-marrich)13:49
evrardjpDmitriy: all bugs need fixing13:49
evrardjpI can discuss that in a minute13:50
odyssey4meDmitriy: you have to re-specify the repo too otherwise the plugin won't lookup your branch spec13:51
*** coreywright has quit IRC13:51
odyssey4meeven if the value is the same, doesn't matter13:51
Dmitriyevrardjp ok. I just want to get if we are going just to patch by creating empty dir (just to make role not to fail) or we would like to allow people to deploy their themes by playbook.13:52
guilhermespDmitriy was this bug oppened by you, isn't it?13:53
Dmitriyguilhermesp: Yep, it was. But it was opened before I've discovered gerrit and this IRC)13:55
guilhermesphahahha13:55
guilhermespI'm still trying to understand why do we need "Setting horizon permissions" task13:55
odyssey4meDmitriy: Do you have masakari_git_install_branch set in user_variables.yml? And do you have masakari_git_repo set in the same file?13:56
Dmitriyguilhermesp: actually we don't, but isn't it more beatifull, when all files of horizon are owned by horizon user?)13:56
Dmitriyodyssey4me: masakari_git_install_branch is set, but masakari_git_repo should be taken from role defaults13:58
evrardjpI re-read the bug13:58
evrardjplet me find the triage conversation13:58
odyssey4meDmitriy: if you don't set masakari_git_repo then the lookup plugin will ignore your other setting13:59
odyssey4meeven if the value is the same, that var is the key that unlocks the use of the overrides13:59
evrardjpDmitriy: the bug is a documentation issue14:01
evrardjphttp://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-26-16.00.log.html#l-24414:01
evrardjpspotz: said she would do it14:01
evrardjpYou can take over from it it's been a month14:01
evrardjpjust tell spotz14:01
*** tux_ has joined #openstack-ansible14:02
hwoaranghmm lxc_aio ubuntu has started to timeout quite frequently lately :/14:03
guilhermespDmitriy just to add into your comment. I was just thinking of add "unecessary" tasks, so I think the focus now is to refactor and make things simples14:03
Dmitriyodyssey4me: oh... ok, I will try.14:03
*** coreywright has joined #openstack-ansible14:04
*** tux__ has joined #openstack-ansible14:04
evrardjphwoarang: I've noticed it too14:05
evrardjpI think we have a race condition somewhere14:06
Dmitriyguilhermesp: I was just trying to make it more correct in some terms, but didn't take attention on simplicity. I'm pretty new to openstack, so it was a consequence)14:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server master: Remove the upstream pypi reverse proxy  https://review.openstack.org/58438514:07
*** tux_ has quit IRC14:07
guilhermespDmitriy no problem! :D keep making suggestions, this is the spirit14:09
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/queens: Remove duplicate key  https://review.openstack.org/58367214:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server master: Remove the upstream pypi reverse proxy  https://review.openstack.org/58438514:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server stable/queens: Remove the upstream pypi reverse proxy  https://review.openstack.org/58438714:11
Dmitriyevrardjp: so, the workflow of openstack installation should be the following: running setup-hosts, then to place theme into themes directory, and run setup-openstack?14:12
*** kstev has joined #openstack-ansible14:12
openstackgerritAdrien Cunin proposed openstack/openstack-ansible-os_nova master: Put passthrough_whitelist in the [pci] section  https://review.openstack.org/58439014:14
cloudnullmornings14:14
*** cshen has quit IRC14:15
evrardjpDmitriy: you can probably do it while doing your configuration14:15
evrardjpthen run all the plays14:15
evrardjpmorning cloudnull14:15
odyssey4mecloudnull logan- more of those get-pip patches to review: https://review.openstack.org/#/q/topic:bug/1779534-stable/queens+status:open / https://review.openstack.org/#/q/topic:bug/1779534-stable/pike+status:open / https://review.openstack.org/#/q/topic:bug/1779534-stable/ocata+status:open14:18
Dmitriyevrardjp: but on start I don't have a container for horizon, so there isn't a place to put a theme. So it should be done in meanwhile. But ok, in case of fixing docs, this shouldn't be a problem14:18
*** FrankZhang has quit IRC14:19
admin0\o14:20
guilhermespDmitriy I think the way it is now, you do your customizations after deploying horizon.14:20
guilhermespis there any reason to customize your themes in a fresh install?14:20
guilhermespI mean, defining your custom themes at the first time you're deploying osa?14:21
jrosserodyssey4me: would it be worth us testing https://review.openstack.org/584387 ?14:21
guilhermespyou can deploy the default first, so you're going to have your libs dir and then you can do your customizations14:21
Dmitriyguilhermesp: do you mean not to specify horizon_custom_themes on fresh install, and place it on the second run? As in case of providing it at the first run, os_horizon fails, because of collectstatic failure14:22
guilhermespyep Dmitriy14:23
Dmitriyguilhermesp: yep, this can be a workaround (which I used), but it's not really obvious and looks like some bug...14:23
odyssey4mejrosser: busy putting together the test set now14:23
odyssey4meneeds an integrated repo patch14:23
odyssey4mealmost done14:23
guilhermespDmitriy: uhum, spotz is going to deal with it :)14:24
jrosserexcellent, whats more helpful for you - http_proxy only or http_proxy with local pip mirror, we can try either14:24
evrardjpDmitriy: no the plan was to  have the files to deploy on the deploy node14:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use upstream pypi before the repo is built  https://review.openstack.org/58439314:25
evrardjpAnd you point to that folder14:25
evrardjpin your config14:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server master: Remove the upstream pypi reverse proxy  https://review.openstack.org/58438514:25
evrardjpodyssey4me: can we remove apt mirror can we can we :)14:25
odyssey4meevrardjp: the facility to disable it is already there, so I don't think we should remove it14:26
tux__In production what is recommended bluestore with LVM or raw OSD disk?14:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Use upstream pypi before the repo is built  https://review.openstack.org/58439414:29
Dmitriyevrardjp: yep, that sounds great. But I have some note on using synchronize (which I offered previously) for files delivery - as it's actually rsync, it should have direct access to the containers, which not always the case (for example, we don't have access from deploy host to containers mgmt network). But unarchive works really good, and we're creating archive with git, which doesn't make archive creation a problem.14:30
evrardjpDmitriy: We should assume access to the mgmt network as this is what's used for ssh14:33
evrardjpthat's the purpose of is_container_address14:33
evrardjpIIRC14:34
jrosserthats not strictly true is it?14:34
evrardjpI think it was :)14:34
evrardjpppl can avoid it14:34
jrosserlet me rephrase, it's not mandatory the the mgmt network is the one the deploy host ssh's to the targets over14:34
evrardjpjrosser: oh yeah indeed, but is_container_address was supposed to be the one14:35
evrardjpby default it's br-mgmt14:35
Dmitriyevrardjp: We have access to the mgmt address of management and compute nodes, but not inside of containers, and (it sounds strange) it works. I don't fully understand why, but it did.14:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update get-pip to version 3.3  https://review.openstack.org/58409514:35
evrardjpofc ppl can do whatever they want, because the IP used for the node is what matters14:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Use upstream pypi before the repo is built  https://review.openstack.org/58439414:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure that repo checks use the right values  https://review.openstack.org/56442214:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure that the repo servers also use the pypi cache  https://review.openstack.org/56850214:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Remove default pip_links value  https://review.openstack.org/56863714:35
odyssey4mejrosser: that's the full stack now - let's see how it goes14:36
odyssey4meif you could test with proxy that'd be great14:36
evrardjpDmitriy: probably because of our connection plugin, connecting to the physical node of your container14:36
Dmitriyevrardjp the only problem we've ever faced is syncronize...14:36
evrardjpofc14:36
jrosserodyssey4me: we cal also choose pip mirror or not pip mirror?14:37
evrardjpThis is easily solved by putting one of your infra nodes as deploy node though.14:37
Dmitriyevrardjp yep, probably that's the point...14:37
jrosser*can14:37
odyssey4mejrosser: now the repo build pip mirror var still takes effect, but once the repo is built it switches to using pypiserver on the repo container14:38
odyssey4mefor the moment, that's the functionality I'm targeting to keep like-for-like capability with pike for queens14:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379414:39
odyssey4mefor master if we can stabilise this I can turn back to trying to put the python builds into the roles - once that's done, we can make the repo server optional14:39
jrosserok, we'll we'll start with just http proxy and see where it gets to, keep it simple14:39
*** Bhujay has quit IRC14:42
odyssey4meevrardjp: tada - nova fixed: https://review.openstack.org/58404914:43
cloudnullyay!14:43
odyssey4mefokks, can we get another review for https://review.openstack.org/584298 to get octavia functional tests voting again14:43
odyssey4meerm, folks14:43
odyssey4mehahaha14:43
odyssey4mereviews for https://review.openstack.org/583387 on nova too - nice to see that working now :)14:44
odyssey4mexgerman_ cloudnullcould you revisit https://review.openstack.org/#/c/582641/ now that it's passing again - thanks for the help fixing octavia functional tests xgerman_ !14:45
odyssey4meand https://review.openstack.org/583388 while you're there ;)14:45
admin0jrosser, you are also using osa + ceph ? is it bluestore ?14:45
jrosseryes, both14:45
jrosserbut we deploy ceph entirely independantly of OSA14:46
jrosserwith ceph-ansible directly14:46
admin0can you help me .. i want to do bluestore ..  independent ceph-ansible is also fine to get this stalled process going14:46
jrosseri can try, stuartgr knows our ceph the best14:47
evrardjpodyssey4me: great14:47
*** armaan has joined #openstack-ansible14:47
tux__Folks i am using bluestore but why its using xfs ? http://paste.openstack.org/show/726352/14:48
tux__I thought it use raw disk14:48
evrardjptux__: we rely on cephansible -- have a look at what this mean in their documentation ...14:49
mgariepytux__, what's in your config ?14:52
mgariepytux__, what "ceph --version" returns on you osd node?14:53
tux__madorn: evrardjp: http://paste.openstack.org/show/726353/14:53
tux__ceph version 12.2.6 (488df8a1076c4f5fc5b8d18a90463262c438740f) luminous (stable)14:53
tux__mgariepy: ^^14:53
tux__evrardjp: ^^14:54
tux__Can you shared your config to see if i am doing something stupid ?14:54
*** lvdombrkr89 has quit IRC14:55
devxo/14:55
*** armaan has quit IRC14:57
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Remove group vars hack  https://review.openstack.org/58441114:57
mgariepytux__, from : http://docs.ceph.com/ceph-ansible/master/osds/scenarios.html seems like xfs is normal14:58
*** rpittau_ has quit IRC14:59
tux__Look like they are putting journal WAL/DB on XFS filesystem14:59
tux__data disk is none filesystem base right?15:00
mgariepy blkid /dev/sdb*15:00
*** mattinator has joined #openstack-ansible15:00
*** FrankZhang has joined #openstack-ansible15:00
tux__mgariepy: http://paste.openstack.org/show/726354/15:01
tux__ceph divided disk in two part  sdb1 and sdb2  (look like sdb1 is journal)15:02
*** lbragstad has quit IRC15:03
*** rmart04 has quit IRC15:03
mgariepyi use the lvm scenario for my ceph cluster.15:06
tux__Does anyone has ceph config with LVM please share :)15:06
tux__mgariepy: can you tell me how you using LVM with Ceph ?15:07
tux__Do i need to create lvm manually ? and how ?15:07
tux__We have 4 node cluster and almost 30 OSD disk15:07
mgariepytux__, http://docs.ceph.com/ceph-ansible/master/osds/scenarios.html15:07
tux__mgariepy: i am on same page and read it15:08
mgariepylast example15:08
tux__I have SSD so should i need to create 3 lv on single SSD disk ? 1. WAL 2. DB  3. data  ?15:09
tux__bluestore keep data and journal on same disk15:09
tux__thats all i want to understand how did you create LVM partition ?15:09
tux__it would be helpful if you share your config to i get some hint :)15:10
mgariepytux__, how many ssd do you have?15:10
tux__1 node i have 4 SSD (500GB) at present15:11
tux__in future i will add more when i need more space15:11
tux__i have total 5 server currently15:11
mgariepyso 7 or 8 osd per ssd ?15:11
mgariepy4 ssd and 30 hdd ?15:11
tux__Let me tell you want i have15:12
*** lbragstad has joined #openstack-ansible15:12
tux__5x server  and 20x physical SSD (500GB)15:12
tux__I want to give 1 OSD per physical SSD  i think that is idle case right?15:13
tux__This is first cluster no idea what would be good here, what do yo suggests?15:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379415:13
tux__1 OSD per physical disk.15:14
tux__in that case i will have total 20 OSD in my 5 node cluster15:14
jrosserodyssey4me: this has a parent that looks like master? https://review.openstack.org/#/c/584394/15:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58229615:17
*** indistylo has quit IRC15:18
odyssey4mejrosser: gerrit doesn't think so?15:18
jrosserhttps://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=44c98893b48693d17231842e33336e6575bd4a31 ?15:19
jrosserwhat am i doing wrong?15:19
*** dave-mccowan has joined #openstack-ansible15:20
odyssey4mejrosser: that's definitely the queens patch because I had to combine some things15:20
openstackgerritMerged openstack/openstack-ansible-repo_build stable/queens: tasks: repo_build_wheels: Download get-pip.py if it does not exist  https://review.openstack.org/58435515:21
openstackgerritMerged openstack/openstack-ansible-pip_install stable/ocata: Update get-pip to version 3.3  https://review.openstack.org/58410915:21
*** dave-mcc_ has joined #openstack-ansible15:23
*** dave-mccowan has quit IRC15:25
Dmitriyas everybody is here, can someone take a look at https://review.openstack.org/#/c/583943/ ?15:26
jrosserodyssey4me: could you confirm the order we apply these to stable/queens?15:26
odyssey4mejrosser: as it shows in gerrit, from the bottom up - alternatively just use the 'checkout' download option from gerrit15:30
logan-does anyone use /etc/openstack_deploy/host_vars or group_vars on queens? seems like ansible is not loading the 2nd inventory15:31
jamesdenton@cloudnull Thanks for looking at the patch set for OVN. It's a little sketchy, as you can tell. I didn't want to risk losing my work ;D15:31
odyssey4meso from https://review.openstack.org/#/c/568637/7 - download, click copy on checkout15:31
odyssey4megit fetch https://git.openstack.org/openstack/openstack-ansible refs/changes/37/568637/7 && git checkout FETCH_HEAD15:31
odyssey4melogan- admin0 said the same yesterday15:31
odyssey4meI don't know if it needs an inventory.ini there before it works, or what15:31
logan-yeah i am looking at admin0's env and confirming it15:31
logan-inventory.ini is present etc15:31
logan-ANSIBLE_INVENTORY env contains both inventories15:32
odyssey4mewell, then that's a pickle15:32
odyssey4meI wonder if ANSIBLE_INVENTORY can be set to use both, or whether ansible.cfg has to be used15:32
logan-for a different project i have on 2.5 we use ANSIBLE_INVENTORY="inventory1,inventory2,inventory3" etc to stack them15:34
logan-guess ill run some tests with 2.4 and see whats up15:34
jrosserwe use group_vars on queens but not host_vars and the group_vars data seems ok15:34
logan-thanks jrosser, thats helpful15:35
*** epalper has quit IRC15:35
jrosserand its 17.0.4 give or take a little bit15:35
logan-confirmed group_vars works15:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58229615:37
cloudnulljamesdenton it looks great!15:39
cloudnulli +/- just a could nits15:39
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: Remove the unnecessary space  https://review.openstack.org/58277715:39
cloudnullI've not given OVN a try yet but it seems like a good start15:39
odyssey4mexgerman_: these vars, could you help me understand their purpose? is that for octavia to jump on neutron's RPC queue or is that for octavia to have a special RPC queue which neutron listens on?15:40
xgerman_o/15:40
xgerman_which ones?15:41
odyssey4meoh, forgot to paste the link :p15:41
odyssey4mehttps://github.com/openstack/openstack-ansible-os_octavia/blob/master/defaults/main.yml#L256-L27015:41
logan-i wonder if the host_vars provided in dynamic_inventory override everything in subsequent inventories15:41
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/pike: Install openvswitch packages on 'ml2.ovs.dvr' configuration  https://review.openstack.org/58104115:42
jamesdentoncloudnull I will have some questions for you after this next set of patches re: best practices15:42
openstackgerritMerged openstack/openstack-ansible-tests stable/queens: Update get-pip to version 3.3  https://review.openstack.org/58409015:42
cloudnulljamesdenton whenever you're ready, fire away :)15:43
xgerman_odyssey4me: all this is for synchronizing between neutron lbaas and octavia/if you run octavia stand-alone you don’t need that15:43
logan-lol: "A bug was fixed with the inventory path/directory, which was defaulting to the current working directory. This caused group_vars and host_vars to be picked up from the current working directory instead of just adjacent to the playbook or inventory directory when a host list (comma separated host names) was provided as inventory."15:44
odyssey4mexgerman_: ok, so it's not neutrons primary RPC queue, it's actually a totally separate queue dedicated to this function15:44
xgerman_yes, it is.15:44
odyssey4mewell, queue is the wrong word - let's ask this another way... if this was in its own vhost, would that work? I'm not saying it will be, but it possibly could be15:45
odyssey4methe way it's set out right now it actually lives on the same rpc vhost as neutron, which one might say is a security risk given that you could have people doing load balancer things and flooding the neutron rpc queue15:46
xgerman_so it needs to be accessed by both octavia and neutron — so I was putting it into neutron’s vhost… the access permissions are a bit funky and it didn’t work for a while unless you had the same user everywhere15:46
*** electrofelix has quit IRC15:47
odyssey4memind if I make the prefix for those all octavia_neutron_* so that they're namespaced?15:47
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Update qgroup setup to be more explicit  https://review.openstack.org/58412215:47
odyssey4meand we would expect neutron to setup this vhost/user/password, correct?15:47
odyssey4meoctavia is a consumer, not the creator15:47
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Update get-pip to version 3.3  https://review.openstack.org/58409115:48
xgerman_octavia sends to neutron — so the producer15:48
xgerman_but yes, that all makes sense… but I would make octavia create it since this is really for a specific case we are trying to deprecate15:48
odyssey4meso should we, in effect, have a vhost called something like '/octavia-neutron' instead, and octavia creates it and neutron connects to it if lbaas is enabled?15:49
odyssey4methen this vhost would have its own user/password, although it'll default to the octavia one15:50
johnsomodyssey4me Octavia is a stand alone service that uses neutron/nova/glance/barbican stable APIs. So we should be careful to not label anything that is an Octavia config with "neutron", only neutron-lbaas stuff.15:50
johnsomOnly the deprecated neutron-lbaas integrates into neutron.15:51
xgerman_well, the event streamer is a weird animal15:51
odyssey4meok, I think that works though - we have other similar vars in other roles where the prefix is the role name the vars is in and then the rest of the var may have a setting for another service to access an API or whatever15:52
odyssey4meeg nova_glance_...15:52
xgerman_yeah, as I said we are trying to deprecate that so we should condition all of that on if neutron_lbaas is enabled AND configured with octavia15:53
*** chyka has joined #openstack-ansible15:53
odyssey4meso I'm just making sure I move this to something similar, because right now this is namespaced for neutron which can make stuff complicated when you're needing to scale very big and use multiple rpc clusters15:53
johnsomRight, it is super important to make that split that Octavia is not neutron nor a neutron project15:53
odyssey4meok cool, thanks for the clarity - I'll be adjusting https://review.openstack.org/583388, or perhaps put a patch on top of it, to fix that up.15:54
odyssey4meperhaps on top - given it'll be a significant set of changes15:55
odyssey4methat'll be for next week though15:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379415:56
*** udesale__ has joined #openstack-ansible16:00
*** udesale__ has quit IRC16:05
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Update get-pip to version 3.3  https://review.openstack.org/58409216:08
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Revert "Temporarily set functional test to non-voting"  https://review.openstack.org/58429816:08
odyssey4meI'm out for the w/end. Cheers folks!16:15
mgariepycya odyssey4me16:15
jrosserbye odyssey4me16:16
*** suggestable has quit IRC16:18
openstackgerritMerged openstack/openstack-ansible-os_nova master: Switch compute to use different inventory_hostname  https://review.openstack.org/58404916:19
openstackgerritMerged openstack/openstack-ansible-os_nova master: Move MQ vhost/user creation into role  https://review.openstack.org/58338716:19
*** poul_ has quit IRC16:25
*** gkadam has quit IRC16:29
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove the unnecessary space  https://review.openstack.org/58279116:31
*** gillesMo has quit IRC16:31
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/57964516:38
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Make certificate generation host configurable  https://review.openstack.org/58264116:45
*** cshen has joined #openstack-ansible16:53
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Move heartbeat from utility_all to kibana  https://review.openstack.org/58444416:54
*** DanyC has quit IRC16:56
jrossercloudnull: i'd been wondering if it was worth a dedicated set of elastic master nodes16:57
jrosserin light of how heavy the load is if the cluster is recovering, getting those off the log nodes might have some merit16:58
*** cshen has quit IRC16:58
openstackgerritJames Denton proposed openstack/openstack-ansible-plugins master: Updates provider_network plugin to support geneve  https://review.openstack.org/58444717:06
*** cshen has joined #openstack-ansible17:07
tux__Quick question can we convert ansible output in JSON or any good formate17:09
tux__its hard to read when Error output is super log and not formated17:09
cloudnulljrosser ++ breaking the elastic nodes out to dedicated gear would help a bunch17:11
cloudnulltux__ there's ara that might be of some use there.17:12
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fix quota for Octavia  https://review.openstack.org/57136817:12
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_horizon master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/58433017:13
cloudnulljrosser having masters and coordinators away from your data and ingest nodes makes for a far more stable arch17:14
cloudnullwould could use a specialized elastic_master group and override the master node election when that group is present?17:14
jrossersounds reasonable17:16
jrosserim running a hyperdiverged setup(!) so it would be easy to slide the elk master off onto a quieter node17:17
jrosseri think the only thing i need to keep an eye on is memory usage17:18
openstackgerritFrank Zhang proposed openstack/openstack-ansible master: Add aio host conf for barbican role  https://review.openstack.org/57928417:19
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_nova master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58445017:20
cloudnulljrosser with the retention policy changes, how have things been >17:22
cloudnull?17:22
jamesdentoncloudnull any suggestions on using the systemd module?17:23
cloudnulldid it finally plateau17:23
cloudnulljamesdenton just 's/service/systemd/g' :)17:23
jamesdentonoh, cool17:24
jamesdentonthats easy :D17:24
cloudnull++ :)17:24
jrossercloudnull: inhavent checked today, ill take a look later, but its certainly growing17:26
jrosserthe search is still "sticky" though17:26
cloudnullyou think that's because there's just more to search, or something else going on ?17:28
jrosseri need to see if its io bound17:28
jrosserthe disks are very busy going by the lights17:28
jrossereach node has a raidz mirror17:29
*** FrankZhang has quit IRC17:30
jrosseri wouod have thought the search should not slow down because the indexes are split per day17:30
jrosserso for something "today" the amount of data to trawl is fairly constant17:31
*** cshen has quit IRC17:32
mgariepytux__, https://getara.org/17:33
jrossercloudnull: i also thought that a modestly complex query in a cron job would put useful info into the query time stats17:33
mgariepyi think it should be added by default to osa deployment17:33
jrosserdeploying ara alongside osa is|was a little difficult17:34
openstackgerritMerged openstack/openstack-ansible-plugins master: Revert "Add a get_nested filter"  https://review.openstack.org/58430417:36
tux__mgariepy: thanks!!17:36
*** cshen has joined #openstack-ansible17:36
mgariepyjrosser, that's why it should be installed by default ;)17:42
jrosseragreed :)17:44
jrosserparticularly now all the no_log stuff is in....17:45
*** poul_ has joined #openstack-ansible17:47
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_neutron master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58302117:49
*** cshen has quit IRC17:50
*** kstev has quit IRC17:51
*** poul_ has quit IRC17:55
admin0logan-, thanks .. the ceph-install config ran successfully ..17:55
admin0so no group vars, no host vars .. direct yml file17:55
*** DanyC has joined #openstack-ansible17:56
*** mattinator has quit IRC17:57
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_cinder master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58263217:57
logan-great18:01
*** DanyC has quit IRC18:02
*** kstev has joined #openstack-ansible18:03
admin0do i need cephx: true ?18:08
admin0please ignore that question18:10
*** mattinator has joined #openstack-ansible18:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add option to allow a deployer to specific specific master  https://review.openstack.org/58446218:12
cloudnulljrosser idk if that will work for your use case?18:12
cloudnullif you have suggestions on tuning it up feel free to make changes.18:13
admin0logan-, setup-infra passed :)18:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379418:14
jrossercloudnull: i'll take a look, will be next week before i can run it i think18:14
cloudnullnp18:21
cloudnullI'm busy making it so that we've some testing on all this anyway :)18:21
cloudnullI just need to get the logs to sync and that should be good18:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Move heartbeat from utility_all to kibana  https://review.openstack.org/58444418:23
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_keystone master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58447918:26
*** kstev has quit IRC18:27
*** kstev has joined #openstack-ansible18:29
*** vnogin has joined #openstack-ansible18:35
openstackgerritMerged openstack/openstack-ansible stable/pike: Update get-pip to version 3.3  https://review.openstack.org/58409818:35
openstackgerritMerged openstack/openstack-ansible stable/ocata: Update get-pip to version 3.3  https://review.openstack.org/58410118:35
openstackgerritMerged openstack/openstack-ansible master: Skip provider_networks module if possible  https://review.openstack.org/58180218:35
*** vnogin has quit IRC18:35
*** vnogin_ has joined #openstack-ansible18:35
ebbex_how or at what point is python installed in the lxc_container_create role?18:40
*** vnogin_ has quit IRC18:41
logan-ebbex_: it is not installed into each individual container, it gets installed into the base container image https://github.com/openstack/openstack-ansible-lxc_hosts/blob/eeb21321f47244e12e572e3b83368645777806c0/vars/ubuntu-16.04.yml#L48-L5018:42
logan-so inside lxc_hosts instead of lxc_container_create18:42
*** NostawRm has quit IRC18:44
*** NostawRm has joined #openstack-ansible18:44
ebbex_logan-: Thanks, I'm looking into why python is not installed by the time this patch kicks in; https://review.openstack.org/#/c/545316/18:44
*** poul has joined #openstack-ansible18:46
*** rmart04 has joined #openstack-ansible18:47
*** rmart04 has quit IRC18:49
*** poul has quit IRC18:51
d34dh0r53mnaser: did you ping me earlier? sorry my scrollback is screwed up18:52
*** jproulx1 has quit IRC18:55
d34dh0r53anyone seen this on master? http://paste.openstack.org/show/726367/18:56
cloudnulld34dh0r53 nope18:58
d34dh0r53hmm18:58
*** poul has joined #openstack-ansible19:03
logan-would be curious to see the python traceback from -vvv d34dh0r5319:08
d34dh0r53logan-, cloudnull: cjloader says it's my ansible version, I've done a bunch of pike deploys on this mnaio so that may very well be the case19:08
logan-ahh19:09
*** joabdearaujo has quit IRC19:09
logan-that would make sense, master connection plugin is incompatible with ansible<2.519:09
d34dh0r53yep, I think that's what it is19:09
*** joabdearaujo has joined #openstack-ansible19:09
*** cshen has joined #openstack-ansible19:11
*** poul has quit IRC19:13
cjloaderlogan-: i had same error when i deployed originally19:13
*** poul has joined #openstack-ansible19:13
*** poul_ has joined #openstack-ansible19:13
*** poul has quit IRC19:14
*** poul has joined #openstack-ansible19:14
openstackgerritMerged openstack/openstack-ansible-ops master: Add functional tests to elk_metrics_6x  https://review.openstack.org/58379419:15
*** poul_ has quit IRC19:18
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_glance master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58449619:23
*** poul has quit IRC19:25
admin0n00b question .. when i login to the ceph node and do ceph command .. like ceph df etc .. it gives unable to find keyring .etc19:44
logan-yeah the admin keyring is not copied to the osd nodes by default19:44
logan-log in to the mons and it should work19:44
admin0aah ! .. got it :)19:45
tux__If i enable JBOD mode in RAID controller how does OS disk will get mirror (RAID-1) ? Do i need to use software RAID?19:52
guilhermespas ceph/osa is a hot topic.... ceph/osa users: do you share the same ceph cluster with more then one osa deployment? If so, how do you do that?19:53
logan-guilhermesp: i do not, but it would not be too difficult to do if you use different pool names for each osa environment. you probably only want to use ceph-ansible in one of the osa envs, and then in the other envs just connect to the cluster using the ceph-client settings to connect to an existing cluster19:54
guilhermespyeah logan- that's what I was thinking.... I want to create another pool using one of my rulesets (easy part). What I imagine is: the computes of the outer cloud needs to connect to ceph public network (I'm using br-storage as ceph public network )19:59
guilhermespthen I only need to configure the client on these computes and then point nova.conf to use the newest pool that I created20:00
logan-yup, that should work20:00
guilhermespI'm wondering if these outer computes needs to acess br-mgmt network of the inner cloud20:00
logan-hmm20:00
guilhermespin order to communicate with ceph_mons20:00
logan-where are your mons20:00
logan-yeah they will need to communicate with mons20:00
guilhermespso, I will need to plug two networks from inner cloud to outer cloud (br-mgmt and br-storage). I particularly don't think this is beautiful20:01
guilhermespbut seems to be the only way for my architecture20:02
guilhermespthanks logan- :)20:04
tux__logan-: I am installing fresh ceph-mon on existing OSA and its throwing this error http://paste.openstack.org/show/726373/20:07
tux__logan-: any idea? what i missed here20:07
*** poul has joined #openstack-ansible20:07
logan-looking at the output it seems like ceph-mon is not running, so you'll prob need to login and start looking at ceph-mon and why it isnt running20:09
tux__hmm20:09
logan-np guilhermesp20:09
tux__error: monitor data filesystem reached concerning levels of available storage space (available: 3% 321 MB)20:11
tux__ /dev/mapper/rootvg01-lv01  9.8G  9.5G  321M  97% /var/log20:12
*** poul has quit IRC20:12
tux__my var partition is small20:12
tux__how do i increase it ?20:12
tux__in LXC20:12
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Move heartbeat from utility_all to kibana  https://review.openstack.org/58444420:13
guilhermesphuum, logan- Actually I was seeing here that the computes (ceph.conf) of the inner cloud connects to the mon containers through br-storage (ceph-public network), so, I think br-mgmt wouldn't be required for the outer computes20:13
guilhermespi.e 10.11.18.0/24 is my ceph_public/br-storage. This is one line of the mon's session of my ceph.confg a compute that uses ceph in the inner cloud: mon addr = 10.11.18.12020:13
tux__logan-: How do i increase disk size in Ceph-mon container ? Do i need to do by hand?20:16
admin0tux__, it shares from the host system does it not ?20:19
tux__it shared from host machine20:20
tux__admin0: http://paste.openstack.org/show/726374/20:21
tux__Host var i have 403G available20:21
tux__who decide container partition size ?20:22
tux__from that output look like Host / (root) map with container /var/log :(20:24
tux__that is bad idea20:24
*** kstev has quit IRC20:26
tux__why ceph care about /var/log filesystem.. that is interesting20:27
*** kstev has joined #openstack-ansible20:28
*** poul has joined #openstack-ansible20:36
jamesdentonAnyone know how oslo.privsep gets installed on a node?20:36
tux__http://paste.openstack.org/show/726375/20:42
tux__what is wrong here, may be ceph isn't starting because of missing keyring20:43
jamesdentonn/m, venv strikes again20:44
*** kstev has quit IRC20:46
*** tux__ has quit IRC20:47
*** poul has quit IRC20:48
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_heat master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58451320:51
*** poul has joined #openstack-ansible20:52
*** poul has quit IRC20:57
openstackgerritAndy Smith proposed openstack/openstack-ansible master: [WIP] Add qdrouterd role for messaging backend deployment  https://review.openstack.org/57026121:01
*** cshen has quit IRC21:06
openstackgerritJames Denton proposed openstack/openstack-ansible master: Adds haproxy endpoints for networking-ovn support  https://review.openstack.org/58406921:07
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Adds networking-ovn support  https://review.openstack.org/58406721:08
*** cshen has joined #openstack-ansible21:08
*** jwitko has quit IRC21:08
*** RossSchulman[m] has quit IRC21:16
*** evrardjp[m] has quit IRC21:16
*** linshuicheng[m] has quit IRC21:16
*** jothibasu[m] has quit IRC21:16
*** lbragstad[m] has quit IRC21:16
*** asdf1234asdf[m] has quit IRC21:16
*** csmart[m] has quit IRC21:17
*** taildashef-work[ has quit IRC21:17
*** keithmnemonic[m] has quit IRC21:17
*** poul has joined #openstack-ansible21:18
admin0by default osa/ceph makes public-network = mgmt network  ?21:22
cloudnulladmin0 i think that's right21:23
admin0this means the instances will use the mgmt for their storage traffic ? and not the br-storage21:26
admin0is this why we have that 172.29.248.0/22 entry in some examples, as ceph replication network and then br-storage is used as publc21:29
cloudnullthat could be... logan- may have some thoughts on that.21:30
cloudnulli just dont know enough to say thats right21:30
cloudnullIMO the instance traffic should not be on br-mgmt21:30
cloudnullthough I still coming to terms w/ ceph21:30
cloudnullmy lab env is new, and small.21:31
*** poul has quit IRC21:32
*** KeithMnemonic has quit IRC21:34
admin0public network = vm <-> storage ;  cluser network = only between osds for replication, heartbeat etc ..  by default i see public network set as 236 and storage as 24421:37
cloudnullmaybe that should be changed in the example or is expected to be changed in config?21:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Move heartbeat from utility_all to kibana  https://review.openstack.org/58444421:39
jrosserseparating the ceph replication network guves you two things, visibility/accounting in your traffic stats of client vs internal ceph cluster traffic, and the opportunity to put replication on its own interfaces21:43
jrosserthe compute nodes should communicate with the ceph public network over br-storage21:44
admin0how to validate this jrosser21:44
*** poul has joined #openstack-ansible21:45
jrosserit depends what you have built21:45
jrossertraceroute from the computes to the osds21:46
jrossertcpdump the traffic to verify21:46
admin0i used the default ceph playbook in osa .. all things are working .. but i get less iops and i suspected networking .. in the config i see public network = 236.x and cluster as 244.x .. so in ceph, public = client - storage communication and cluster = osd-osd commnication which is why i asked21:47
jrosserthat feels suspect21:47
admin0and then i recall seeing 248.x in some examples so asked if that was what it is used for ..21:48
jrosseranother reason to use br-storage is you can do jumbo frames, which really shouldnt be on br-mgmt21:48
*** tux_ has joined #openstack-ansible21:48
admin0in that case, i need to override the config and put public_network on the 244.x and then create a br-replicaiton or something in the OSDs, give it the 248.x and sepcify in the config and run the playbooks again21:49
*** poul has quit IRC21:49
jrosserunless you have an actual separate set of interfaces for the private network i wonder what gain there is tbh21:50
* jrosser out for today21:50
admin0what will happen if i give the same network for both ?21:50
admin0public + cluster = 244.x21:50
admin0i want tthe vms to not use br-mgmt21:50
tux_If you give both same and if any server crash then cluster network start shuffling data which can overrun your public network21:54
tux_same amount of ingress traffic will go out from cluster network for replication thats what i think21:55
tux_if you use single NIC for both then it may be tight during recovery21:55
tux_if you have 40G that make difference and you can run on same NIC21:56
admin0i am thinking 2x 40gb for br-storage (bond) and 1x 40gb for br-replication21:56
*** poul has joined #openstack-ansible22:02
admin0do you guys prefer br-ceph or br-replication ?22:02
cloudnulltake care jrosser22:02
cloudnulli too need to step away a few, need to go put some food on the gril22:03
cloudnulltake care all22:03
admin0happy weekend22:03
cloudnullyou too admin022:03
*** asdf1234asdf[m] has joined #openstack-ansible22:04
admin0almost there to produce a fully working osa+ceph detail step by step document22:04
*** jwitko has joined #openstack-ansible22:05
cloudnullas for the nic question, in prod environments with a storage component (netapp, ceph, solidfire, whatever) we typically have at least one 10/40G bond dedicated to all storage traffic. then have two vlans one for instance traffice, one for replication.22:05
cloudnullok now i gotta run :)22:05
*** poul has quit IRC22:07
*** cshen has quit IRC22:12
*** tux_ has quit IRC22:15
*** hachi has quit IRC22:16
*** tux_ has joined #openstack-ansible22:18
*** tux_ has quit IRC22:23
admin0when using ceph, glance cinder and nova are the only 3 clients of ceph right ? or other components use it also ?22:26
*** coreywright has quit IRC22:27
*** cshen has joined #openstack-ansible22:31
*** keithmnemonic[m] has joined #openstack-ansible22:31
*** csmart[m] has joined #openstack-ansible22:31
*** jothibasu[m] has joined #openstack-ansible22:31
*** evrardjp[m] has joined #openstack-ansible22:31
*** linshuicheng[m] has joined #openstack-ansible22:31
*** RossSchulman[m] has joined #openstack-ansible22:31
*** lbragstad[m] has joined #openstack-ansible22:31
*** taildashef-work[ has joined #openstack-ansible22:31
openstackgerritMerged openstack/openstack-ansible-ops master: Move heartbeat from utility_all to kibana  https://review.openstack.org/58444422:33
*** cshen has quit IRC22:36
admin0is it possible to plug an instance to a bridge manually ?22:37
admin0a container i mean22:37
admin0when  i change my ceph public_network to .244,   ceph-mgr process fails saying  the container does not have any .244/22 ip range .. which is not present .. .. so is there an easy way exists to add an interface to the ceph-mon-container to also be in the br-storage22:39
*** coreywright has joined #openstack-ansible22:39
*** poul has joined #openstack-ansible22:46
admin0aah .. group binds :D22:47
*** tux_ has joined #openstack-ansible22:49
tux_admin0: in my network i setup br-cluster for replication :) because it match with ceph naming convention22:58
admin0tux_,  are you sure you are using br-storage for instance <-> storage traffic22:59
admin0because my tests show otherwise22:59
tux_br-storage on compute node for storage traffic23:00
admin0tux on your ceph.conf, what is the value of public_network ?23:01
admin0in the mons and in the osd nodes23:01
tux_admin0: http://paste.openstack.org/show/726378/23:03
*** poul has quit IRC23:03
tux_mon and public should be on same network23:04
tux_BRB23:06
*** tux_ has quit IRC23:06
*** cshen has joined #openstack-ansible23:08
*** cshen has quit IRC23:13
*** poul has joined #openstack-ansible23:13
*** tux_ has joined #openstack-ansible23:14
*** poul has quit IRC23:18
admin0\o/23:20
admin0a small patch  and detail document coming up23:21
*** poul has joined #openstack-ansible23:30
*** poul has quit IRC23:35
*** chyka has quit IRC23:36
tux_admin0: ??23:41
admin0nah .. not so simple ... now the network is good, but openstack still puts mon in the mgnt range and not in storage23:41
tux_delete all your facts and try23:42
admin0no . this is different23:42
tux_i had same issue and after clean up facts it fixed my issue23:42
admin0the default ceph playbooks do not do this23:42
admin0before every run, i delete the facts23:42
tux_so you are deploying outside OSA23:42
admin0no23:42
admin0with oSA23:42
admin0if outside osa, it would have been good already23:43
tux_Do you have br-storage network on ceph-mon container?23:43
tux_make sure you have br-storage network attached to Ceph-mon23:44
admin0first thing is in user_variables,you have to override the public_ and cluster_ network .. but as soon as you do that, ceph manager will fail because our mon containers do not come with br-storage IP .. so i had to use the group binds .. that fixed the ceph networking part .. but when i create a new volume, libvirt still maps to br-mgmt ips of mon23:44
tux_can you paste your user_varibles config ?23:45
admin0tux you are setting mon_host override in variables ?23:46
tux_yes23:47
admin0it should be _ there right ? mon_host23:47
admin0in the paste you gave23:47
*** poul has joined #openstack-ansible23:47
tux_http://paste.openstack.org/show/726379/23:48
tux_this is what it looks in user_var23:48
*** tosky has quit IRC23:48
admin0so you have dedicated mons ?23:48
tux_no its OSA container23:49
admin0or are those IPs from what lxc-container assigned ?23:49
admin0ok23:49
admin0got it .  so first run setup-hosts, let it create the container and assign ip.. then use thsoe IPs in the variables23:49
tux_yes23:49
tux_you are correct there23:49
admin0did you also used bind_host to add ceph-mon  so that br-storage is connected ot the container ?23:50
*** poul has quit IRC23:52
admin0i see this key possbility:   monitor_address_block: "{{ cidr_networks.storage}}""23:55
admin0that way, i think no need to specify the monitors ip23:55
admin0and it should auto take it23:55
tux_yes i did bind-host for br-storage23:57
admin0ok23:57
tux_http://paste.openstack.org/show/726380/23:58
tux_here its23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!