Thursday, 2017-11-23

*** yifei has joined #openstack-ansible00:01
*** yifei has quit IRC00:05
*** mwynne has joined #openstack-ansible00:25
*** yifei has joined #openstack-ansible00:27
*** chyka has quit IRC00:30
*** savvas_ has joined #openstack-ansible00:44
*** savvas_ has quit IRC00:45
*** savvas_ has joined #openstack-ansible00:46
*** masber has quit IRC00:47
openstackgerritLogan V proposed openstack/openstack-ansible master: [WIP] Implement iptables management  https://review.openstack.org/51209900:49
*** savvas__ has joined #openstack-ansible00:50
*** savvas__ has quit IRC00:50
*** savvas__ has joined #openstack-ansible00:51
*** savvas_ has quit IRC00:53
*** hw_wutianwei has joined #openstack-ansible01:04
*** xingchao has joined #openstack-ansible01:08
*** xingchao has quit IRC01:18
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701701:31
openstackgerritCuong Nguyen proposed openstack/openstack-ansible-os_glance master: Use glance_services to get group name  https://review.openstack.org/52098901:34
cloudnullso I dissected our recent tempest failures.01:37
cloudnullhttp://paste.openstack.org/show/627157/01:37
cloudnulllooks like we need to put the glance v1 api back01:37
cloudnull...01:37
cloudnullodyssey4me: evrardjp: hwoarang: logan-: spotz: andymccr: d34dh0r53: jmccrory: mhayden: ^01:38
cloudnullI have to run01:38
cloudnullif i get time this weekend I'll try and take a look01:38
cloudnullhowever if someone can try and figure out what is required to either make that test pass or re-instate the glance API it'd be appreciated.01:39
spotzcloudnull I'll poke and see if I can't narrow it if I have time. Gotta finish my course still by next week:(01:39
spotzcloudnull: I do wonder if it just needs to be configured to use the v2 api somewhere01:40
*** savvas_ has joined #openstack-ansible01:41
*** savvas__ has quit IRC01:42
cloudnullthis might be.01:43
cloudnullsadly I've got to go and cant look into it ATM.01:44
cloudnull:(01:44
*** pester has joined #openstack-ansible01:54
*** fxpester has quit IRC01:55
*** chyka has joined #openstack-ansible01:57
*** japestinho has joined #openstack-ansible02:00
*** xingchao has joined #openstack-ansible02:01
*** chyka has quit IRC02:02
*** xingchao has quit IRC02:02
*** savvas_ has quit IRC02:18
*** savvas_ has joined #openstack-ansible02:18
*** pmannidi has quit IRC02:19
*** pmannidi has joined #openstack-ansible02:20
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_tempest master: Disable glance v1 API by default  https://review.openstack.org/52242702:26
*** udesale has joined #openstack-ansible02:29
*** gloksinia has joined #openstack-ansible02:30
*** masber has joined #openstack-ansible02:38
*** masuberu has joined #openstack-ansible02:42
gloksiniaHello, can i ask a question here ??02:47
*** masber has quit IRC02:47
matttgloksinia: go for it!  someone will answer as soon as they're able to02:54
gloksiniamatt: thank you.03:00
*** savvas_ has quit IRC03:04
gloksiniaI want to know about deploying openstack-ansible with Openvswtich. I can't make it work at all.03:05
gloksiniaForgot it i try it on pike.03:07
gloksiniaSo my questions is after following https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html this documentation after successful deploy.03:07
gloksiniaI need to create all port and bridge by myself to make it work. i saw only br-int with ovs-vsctl show command and i cant bring it up.03:10
*** gie has joined #openstack-ansible03:40
*** gie has quit IRC03:41
*** gie has joined #openstack-ansible03:43
*** lbragstad has joined #openstack-ansible03:46
*** lbragstad has quit IRC03:52
*** poopcat has quit IRC04:01
*** Dinesh_Bhor has joined #openstack-ansible04:03
*** lbragstad has joined #openstack-ansible04:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Add basic plugin support for nspawn type containers  https://review.openstack.org/49068904:07
logan-which branch are you seeing that on cloudnull04:08
cloudnullthe tempest issue?04:09
cloudnullthat's in master.04:10
logan-k04:10
cloudnulllooks like jmccrory put up a patch for it already04:10
cloudnullhttps://review.openstack.org/#/c/52242704:10
openstackgerritLogan V proposed openstack/openstack-ansible-os_tempest master: Disable Glance v1 API usage by default  https://review.openstack.org/52243504:11
logan-oh04:11
logan-lol04:12
logan-yeah sure enough04:12
cloudnullIf that's all we need, it'd be wonderful :D04:12
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097604:15
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701704:19
*** lbragstad has quit IRC04:34
*** gkadam has joined #openstack-ansible04:36
*** germs1 has joined #openstack-ansible04:41
*** germs has quit IRC04:41
*** cjloader has joined #openstack-ansible04:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701704:46
*** hybridpollo has quit IRC05:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701705:11
*** germs1 has quit IRC05:22
*** germs has joined #openstack-ansible05:22
*** chyka has joined #openstack-ansible05:27
*** nshetty has joined #openstack-ansible05:30
*** nshetty_ has joined #openstack-ansible05:42
*** nshetty has quit IRC05:42
*** udesale has quit IRC05:44
*** chyka has quit IRC05:46
*** udesale has joined #openstack-ansible05:53
*** udesale has quit IRC05:53
*** udesale has joined #openstack-ansible05:54
*** gokhan has quit IRC05:59
*** gokhan has joined #openstack-ansible06:01
*** germs has quit IRC06:06
openstackgerritLogan V proposed openstack/openstack-ansible master: [WIP] Implement iptables management  https://review.openstack.org/51209906:07
*** wspthr has quit IRC06:07
*** threestrands has quit IRC06:10
*** wspthr has joined #openstack-ansible06:10
*** pradiprwt has joined #openstack-ansible06:10
pradiprwtHi Everyone, I am facing problem in installing galera, here is console output.. http://paste.openstack.org/show/627170/06:15
pradiprwtcan anyone please help me06:15
*** hamza has joined #openstack-ansible06:16
*** m|y|k has joined #openstack-ansible06:19
*** gokhan has quit IRC06:22
cloudnull pradiprwt normally this is a load balancer issue06:23
cloudnullis the lb up?06:23
cloudnulland can you curl http://172.29.236.9:8181 ?06:23
*** gokhan has joined #openstack-ansible06:23
pradiprwtcloudnull: yeah, you are right load balancer is not reacheble06:25
pradiprwtIs there any way to make it up ?06:25
cloudnullare you running haproxy06:26
cloudnullyou can simply rerun the haproxy playbook if something is off there.06:26
cloudnullif you're using an external LB you'll need to resolve that first.06:27
pradiprwtcloudnull: sure I will run now06:27
*** nshetty_ is now known as nshetty06:31
*** hamza has quit IRC06:33
pradiprwtcloudnull: Still facing same problem after running haproxy playbook, I got this issue while running "openstack-ansible setup-infrastructure.yml"06:33
cloudnullwhat, if anything in the haproxy playbook changed?06:34
cloudnullis haproxy running on the host?06:34
yifeiHi all, I always failed when run setup-infrastructure. The actual failure is that it failed to install nginx in repo lxc. "Public key for gperftools-libs-2.4-7.el7.x86_64.rpm is not installed". The OS of hosts is centos7.4.06:35
yifeiIf I manually installed nginx with nogpgcheck, it will also failed at some else place e.g. installing memchached06:36
pradiprwtcloudnull: yes, haproxy is running on all infra hosts06:36
*** hamza has joined #openstack-ansible06:36
pradiprwthaproxy playbook executed without any error06:37
yifeiSo if I missed some configuration related to yum repos06:37
yifeiIs there anybody can help me with this? Thanks06:37
*** gkadam has quit IRC06:59
pradiprwtcloudnull: here is log after restarting haproxy http://paste.openstack.org/show/627182/07:02
*** cjloader has quit IRC07:03
*** jvidal has joined #openstack-ansible07:11
*** michelv has joined #openstack-ansible07:13
*** jvidal has quit IRC07:26
*** nshetty is now known as nshetty|brb07:30
openstackgerritMerged openstack/openstack-ansible-os_nova stable/pike: Set the nova-lxd lib to use PIKE  https://review.openstack.org/52215507:30
*** nshetty|brb is now known as nshetty|lunch07:39
*** jvidal has joined #openstack-ansible07:40
*** pcaruana has joined #openstack-ansible07:45
*** shardy has joined #openstack-ansible08:02
*** armaan has joined #openstack-ansible08:05
*** mbuil has joined #openstack-ansible08:06
evrardjpcloudnull: still around?08:06
evrardjpjmccrory: thanks again!08:08
evrardjpodyssey4me: or andymccr are you around?08:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701708:10
cloudnullevrardjp: about to pass out.08:10
evrardjp:)08:11
cloudnullhave a good night !08:11
evrardjpyou've deserved some sleep, go to bed!08:11
openstackgerritDimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add OvS-NSH support  https://review.openstack.org/51725908:11
*** gie has quit IRC08:11
*** gloksinia has quit IRC08:11
armaanmorning folks, i was wondering if anybody here used keystone with kubernetes?08:12
*** holmsten has joined #openstack-ansible08:18
evrardjpI haven't08:21
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_ceilometer stable/newton: Initial OSA zuul v3 role jobs  https://review.openstack.org/51399908:24
evrardjparmaan: would be interested though :)08:24
armaanevrardjp: I just found this https://github.com/openstack/stackube08:25
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_ceilometer stable/newton: Initial OSA zuul v3 role jobs  https://review.openstack.org/51399908:25
evrardjpoh yeah heard about it08:26
evrardjpThey thought about including it in the list of official projects, but was temporarily not added08:26
evrardjpAlthough to me, it looked like an ops nightmare08:26
*** gkadam has joined #openstack-ansible08:28
pradiprwtevrardjp: Hi , I am getting problem in installation of haproxy, can you please help me. Galera is getting failed because if haproxy vip is not reachable08:31
evrardjppradiprwt: sure08:31
evrardjpI will ask the usual question: Is your external_lb_vip_address the same as internal_lb_vip_address?08:32
pradiprwtno08:32
evrardjpor resolves to the same IP?08:32
*** pmannidi has quit IRC08:32
pradiprwtinternal is from management network and external is from flat network08:33
pradiprwtevrardjp: /etc/openstack_deploy/openstack_user_config.yml http://paste.openstack.org/show/627190/08:35
armaanevrardjp: Yeah, i agree.08:39
armaanevrardjp: Found one more effort in this direction https://github.com/dims/k8s-keystone-auth08:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zaqar stable/ocata: [WIP] Initial Zuul v3 role jobs  https://review.openstack.org/51429908:40
pradiprwtevrardjp : now it is working08:41
evrardjpyou should ask dims then :)08:41
evrardjppradiprwt: I didn't change anything :)08:41
pradiprwtevrardjp: I did some changes in user variable file :)08:41
evrardjp... what was it?08:42
pradiprwtI was providing keepalived without vip only subnet , and  by mistake I kept some user variable values in openstack user config file... after removing it started working08:43
*** nshetty|lunch is now known as nshetty08:48
openstackgerritGökhan proposed openstack/openstack-ansible-os_aodh stable/pike: Change auth config to keystone v3 according to openstack pike aodh docs[1], we modified auth config under the "keystone_authtoken" and "service_credentials" groups. [1] https://docs.openstack.org/aodh/pike/install/ \ install-rdo.html#install-and-configure  https://review.openstack.org/52248008:50
*** flaviosr has quit IRC08:52
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Disable glance v1 API by default  https://review.openstack.org/52242708:54
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zaqar stable/ocata: [WIP] Initial Zuul v3 role jobs  https://review.openstack.org/51429908:57
*** flaviosr has joined #openstack-ansible09:01
pradiprwtevrardjp: HAproxy is working but still I am getting issue with galera, here is console output >> http://paste.openstack.org/show/627193/09:01
andymccrevrardjp: o/09:01
*** jvidal has quit IRC09:02
evrardjpandymccr: woot!09:02
evrardjpandymccr: may I get a vote on those: https://review.openstack.org/#/c/521566/ https://review.openstack.org/#/c/522314/ https://review.openstack.org/#/c/522386/ https://review.openstack.org/#/c/514289/ https://review.openstack.org/#/c/513999/ ? They clutter my inbox.09:03
andymccrevrardjp: sure will go through those this morning09:03
evrardjpjust be fairly straightforward09:04
evrardjppradiprwt: Failed to establish a new connection: [Errno 113] No route to host09:04
andymccreverytime i see that ceph_client role i hate it more :P09:04
evrardjpcan't do much for you that's a networking issue.09:04
evrardjpwell it's just to prevent the recursion depth issue :p09:05
evrardjpBut yes.09:05
andymccryeah sure but the way that was designed09:05
pradiprwtI have verified the network everything is working fine09:05
evrardjpYou're now an expert, maybe we can do better :D09:05
evrardjppradiprwt: it is not fine09:05
andymccrevrardjp: on that rally patch - thats going to be a pain to maintain. i guess there is no other way at all?09:05
evrardjp?09:05
evrardjpoh yeah09:06
evrardjpno09:06
evrardjpno other way09:06
evrardjpI don't want to have a fight with infra and kolla ansible about putting ansible in our requirements and therefore in global requirements :p09:06
evrardjpthere are many different ways to do this, and trust me, this one will be the easiest :)09:07
andymccrthat would only be dev mode though right?09:08
* hwoarang wonders what is up with teh xenial tempest failures09:08
andymccrwhy does rally need ansible as a pip install?09:08
pradiprwtevrardjp: Yeah, there is issue with network, host is able to access the url but container is not. Do you have any idea what I need to verify ?09:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Integrate Congress with OSA.  https://review.openstack.org/50397109:09
evrardjpandymccr: that's part of their dependency09:09
andymccrahh ok09:09
evrardjpandymccr: basically they have os-idontknowthename09:10
evrardjpthat thing implements an ansible wrapper09:10
evrardjpit has in its requirements, ansible09:10
evrardjpso installing rally gets the whole chain which installs ansible09:10
evrardjpso ansible gets pulled unconstrained, and magic happens.09:10
evrardjppradiprwt: the bridges on the different hosts?09:11
andymccrthats terribad. ok well thats gonna be a fun one when we move to ansible 2.4 etc. cant think of a better way though!09:12
odyssey4meandymccr it goes into the rally venv, so it doesn't affect our installation09:13
andymccrodyssey4me: sure but we're setting a version inside that role, meaning we will have to remember to update that at some point in the future09:13
andymccror tests will fail and weirdness will happen09:13
pradiprwtevrardjp :br-mgmt, br-vlan, br-vxlan  and br-storage I am using --- br-mgmt is on all hosts with IP and containers are also in same range09:14
andymccrif rally themselves wanted to propose a version of ansible required, since they require it, we could get that from their repo instead09:14
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/pike: Remove one layer of includes  https://review.openstack.org/52156609:14
*** jvidal has joined #openstack-ansible09:15
odyssey4meoh yeah - well, meh :p09:15
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249109:17
*** pbandark has joined #openstack-ansible09:19
evrardjppradiprwt: proper ip ranges? proper routes?09:19
evrardjpodyssey4me: we have weird thing happening in gates09:20
evrardjpI have things that work on my machine that don't work in gates09:20
evrardjpceilometer for example (https://review.openstack.org/#/c/513999/ ) works on my trusty, but doesn't in gates09:20
evrardjpfor a lxc_container_create issue IIRC09:20
evrardjpzaqar patchset 6 here: https://review.openstack.org/#/c/514299/6/ worked too on my machine. Which makes me wonder what's the difference.09:21
evrardjpFor zaqar I thought it maybe due to the user that runs the stuff (root vs unprivileged user)09:21
evrardjpoh no ceilometer was a service that can't restart, my bad. the lxc_container_create issue is for zaqar09:22
odyssey4mewell, different base image - different mirrors09:22
*** pbandark has quit IRC09:22
evrardjpstill, different behavior09:22
evrardjpmmm.09:23
evrardjpfor ceilometer, I tried on rax public cloud and a vagrant image09:23
evrardjpthose trusty worked.09:23
odyssey4meok, but the zaqar one is failing lint tests09:23
evrardjpI was wondering if that couldn't be a clone issue09:23
*** hamza has quit IRC09:23
evrardjpodyssey4me: the zaqar patchset 6 was not failing for that. It is now, because I try to mess up with it.09:24
*** hamza has joined #openstack-ansible09:24
evrardjpodyssey4me: have a look at the run Patch Set 7: Build failed (check pipeline). For information on how to proceed, see http://docs.openstack.org/infra/manual/developers.html#automated-testing - build-openstack-sphinx-docs http://logs.openstack.org/99/513999/7/check/build-openstack-sphinx-docs/4fd658c/html/ : SUCCESS in 1m 46s - build-openstack-releasenotes http://logs.openstack.org/99/513999/7/chec09:24
evrardjpk/build-openstack-releasenotes/0b87538/html/ : SUCCESS in 2m 38s - openstack-ansible-linters http://logs.openstack.org/99/513999/7/check/openstack-ansible-linters/685eb08/ : SUCCESS in 4m 21s - openstack-ansible-functional-ubuntu-xenial http://logs.openstack.org/99/513999/7/check/openstack-ansible-functional-ubuntu-xenial/02e6673/ : SUCCESS in 30m 31s - openstack-ansible-functional-ubuntu-trusty h09:24
evrardjpttp://logs.openstack.org/99/513999/7/check/openstack-ansible-functional-ubuntu-trusty/4b78804/ : FAILURE in 25m 30s22/11 14:1309:24
evrardjpwow.09:24
evrardjpsorry for the wrong paste.09:24
evrardjpwell I guess it works :p09:24
odyssey4meoh yes, something else which affects the older branches is the use of conflicting ip's in the inventory09:25
odyssey4meip's that conflict with some of the providers09:25
odyssey4meor are inconsistent between the tests repo and the inventory09:26
evrardjpok so I was heading the right direction on my latest patchsets then09:26
evrardjpI am glad I asked you09:26
odyssey4meheh, that's a fun one: http://logs.openstack.org/99/514299/6/check/openstack-ansible-functional-ubuntu-xenial/053d858/job-output.txt.gz#_2017-11-22_20_40_41_15202309:26
odyssey4mewhen dropping the network interfaces config, so yeah - seems like that might relate09:27
evrardjpyeah is that the same patch?09:29
evrardjpwhy do you have different numbers?09:29
odyssey4medifferent numbers?09:30
evrardjpdamn I mispasted again.09:30
evrardjpyeah whatever.09:30
evrardjpwrong morning I guess.09:30
evrardjpwell it's already 10:30 but still!09:31
evrardjpyeah that's what I meant, a weird thing going on with the dropping the network interfaces09:31
evrardjpas you can see it's directly an ansible failure09:31
evrardjpso nothing directly related to our code09:31
evrardjpit's 100% on the runtime environement09:31
evrardjpwhich makes me wonder what else do we have right now09:31
evrardjpso ceilometer failed due to a runtime thing, now zaqar...09:32
pradiprwtevrardjp :br-mgmt, br-vlan, br-vxlan  and br-storage, I am using --- br-mgmt is on all hosts with IP and containers are also in same range09:34
evrardjppradiprwt: can you, from one container, ping another container?09:34
pradiprwtlet me check09:34
pradiprwtyes I am able to ping from one container, ping another container09:36
pradiprwtbut not able to ping host IP09:37
openstackgerritMerged openstack/openstack-ansible-os_rally master: Constraint ansible installation  https://review.openstack.org/52231409:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_rally stable/pike: Constraint ansible installation  https://review.openstack.org/52250109:39
pradiprwtevrardjp : br-mgmt doesn't have gateway, this is dummy virtual network using vlan09:40
evrardjpI don't know what you're doing and what you want to achieve, but I can tell you that you have a networking issue for what you are asking ansible to do.09:40
*** nshetty is now known as nshetty|BMGR09:41
pradiprwtevrardjp : I want to install openstack with HA using ansible, I am following official documentation, but I am facing some issue ... Here is my interface file http://paste.openstack.org/show/627196/09:44
evrardjpI think vxlan is missing an IP, first09:45
evrardjpnot that it's your problem right now09:45
pradiprwtevrardjp : this is infra node interface file, do I need to keep here ?09:46
evrardjpbr-mgmt doesn't seem to have internet access like that, don't you need to do other things?09:46
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/newton: Initial OSA zuul v3 role jobs  https://review.openstack.org/51399909:47
evrardjpyou could do nat and all on your node, maybe? openstack-ansible is barely using the network connectivity on the hosts (through their bridges) and then install openstack on top of it. But I can suggest you to have a look at our limited connectivity guide if you want to follow that route09:48
pradiprwtFor internet I have provided the interface enp0s3,  and for openstack provider network there is interface enp0s909:49
evrardjpyeah that looks great09:49
evrardjpI think the only part missing is that your node would have to do nat for the mgmt network09:49
evrardjpbecause the management network isn't bridged to anything09:50
evrardjpif you would have brought br-mgmt to the same network as what's in enp0s3 (using a bridge port there) it could have been different09:51
evrardjpIt all depends on your use case09:51
pradiprwtI don't have much IPs in enp0s3 range09:51
pradiprwtThis is just POC before production :)09:52
evrardjpthen you should nat :)09:52
pradiprwtok09:52
evrardjpdoesn't it makes sense?09:53
*** hw_wutianwei has quit IRC09:53
pradiprwtI think nating is fro providing internet access to that range or interface09:53
pradiprwtIn my environment host and containers both have internet acces09:54
evrardjpdo they?09:54
odyssey4mebr-mgmt isn't used for internet access, that will be accessed through the lxcbr0 interface which will nat through the host09:54
evrardjpoh yeah that's true, that's what we do.09:55
evrardjpi always forget this one.09:55
pradiprwtyes, containers have internet because they use lxcbr0 for internet09:55
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Depth argument is prome to failure for ansible<2.3  https://review.openstack.org/52238609:56
evrardjpso pradiprwt I don't know. You have clearly an issue with networking though. "No route to host" is clear to me.09:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests stable/newton: Depth argument is prome to failure for ansible<2.3  https://review.openstack.org/52250809:56
pradiprwtI will try to trace the packet where it is getting drooped09:56
mardimhwoarang, evrardjp odyssey4me cloudnull the 'Do not merge' barrier is lifted https://review.openstack.org/#/c/517259/ :)09:58
evrardjphaha cool09:58
mardim:)09:58
evrardjpwow and it passes tests?09:58
evrardjp:)09:58
mardimYes and i created a =n extra gate09:59
mardim:)09:59
mardiman*09:59
evrardjpok so I need an extra tough review then :p10:00
mardimhaha yes :)10:01
openstackgerritMerged openstack/openstack-ansible-os_glance master: Use glance_services to get group name  https://review.openstack.org/52098910:03
* hwoarang sends mardim a chocolate cookie and a -110:04
*** electrofelix has joined #openstack-ansible10:05
hwoarangodyssey4me: mhayden: evrardjp: a centos fix please https://review.openstack.org/#/c/521882/ :)10:05
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428910:06
odyssey4mehwoarang hmm, nice catch10:06
odyssey4menot quite sure I like having it done there, but don't have a better suggestion right now10:07
odyssey4methe only thing I can think of is that it should probably be included in a bunch of the role distro packages as it's clearly a requirement for each of the services10:08
* mardim mardim will eat the chocolate and he will be furious for the -1 :P10:08
mardimhwoarang, ^10:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Do not implement reload for novnc/spice service  https://review.openstack.org/52251010:08
hwoarangodyssey4me: yeah but pip_install is a meta dependency :p10:09
odyssey4mesure, but one day it won't be10:10
*** ThomasS has joined #openstack-ansible10:10
hwoarangyeah i know :)10:10
ThomasShi10:10
ThomasSi am struggeling with a deployment of 7 nodes with ceph integration10:11
ThomasSi am using this guide10:11
ThomasShttps://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/app-config-prod-ceph.html10:11
ThomasStag 16.0.310:12
ThomasSeverything deployed fine so far10:12
ThomasSthe running of the openstack-ansible setup-openstack.yml10:13
ThomasSerror happens at TASK [os_cinder : Perform a cinder DB sync]10:13
ThomasSthe error looks strange:10:13
ThomasShttps://pastebin.com/p2Bnb0M010:13
*** nshetty|BMGR is now known as nshetty10:13
ThomasSmaybe you can give me hint10:14
odyssey4meThomasS I'm not sure why our pike docs haven't been updated with these merges, but these fixes to the docs are important to know for that example: https://github.com/openstack/openstack-ansible/commit/6249a8c9e5a334ba2e4bd9880a8351257802627f & https://github.com/openstack/openstack-ansible/commit/83e2b5415b50119eecc651fee4839ad25c5b810d10:14
evrardjpmardim: reviewed!10:14
mardimevrardjp, thanks :)10:15
*** mrch has joined #openstack-ansible10:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Use cinder_services dict to identify cinder-api service name  https://review.openstack.org/52251110:15
odyssey4meThomasS wow, that's not normal... I wonder what went wrong there10:15
evrardjpmardim: I didn't send a chocolate with my -1, but you get the idea that I wanted to send it.10:15
evrardjpoh no, my bad, I only send chocolates when +2 !10:16
evrardjp:p10:16
*** armaan has quit IRC10:16
ThomasSalso the queens docs are not up to date10:16
ThomasShttps://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/app-config-prod-ceph.html10:16
mardimevrardjp, the +2 chocolate is sweeter :)10:16
ThomasSthe fixes are not there you mentioned10:16
*** armaan has joined #openstack-ansible10:17
odyssey4meThomasS for queens only https://github.com/openstack/openstack-ansible/commit/33836d3d5ef7ec20b77ffd8082feb0f145eb294f is relevant10:17
ThomasSdo not get me wrong10:17
odyssey4meso those are up to date it seems10:17
evrardjpodyssey4me: do we have a docs publication issue again?10:18
ThomasSi was using the queens config example because pike has none10:18
ThomasSmy tag is 16.0310:18
ThomasSso installing and following the pike deployment guide with 16.0.3 and using the queens ceph example10:18
odyssey4meyes, so for pike you need the ceph_mons bit until we can merge a patch into pike which makes it work like queens10:19
openstackgerritMerged openstack/openstack-ansible-pip_install master: vars: Explicitly pull the openssl package  https://review.openstack.org/52188210:20
odyssey4meevrardjp FYI our pike docs don't seem to have been published in a while - I'm following up with infra10:20
odyssey4memaster seems up to date10:20
evrardjpOh that's great.10:21
ThomasSso i rerun10:21
ThomasShttps://pastebin.com/nHhuiC2z10:21
evrardjpI mean it's great you're dealing it with infra.10:21
ThomasSnow with -vvv10:21
ThomasSany hint what i can do?10:21
ThomasSworked really good soar10:21
evrardjpI had a lot of trouble understanding all this all fits together when I was fixing master with Andreas. But I still haven't finished my reading.10:22
odyssey4meThomasS hmm, it seems that something's trying to use the host name to figure out some config, and failing10:22
evrardjpThomasS: looks like a configuration issue, breaking something in your cinder install10:23
odyssey4meodd that we aren't seeing that same issue in our tests10:23
ThomasScan i rerun starting with setup hosts?10:23
odyssey4meno, that won't help10:23
ThomasScould it be that my hosts file is messed up? i have a static one10:24
evrardjpodyssey4me: could you put spotz and me in the conversations/reviews for the docs changes? This way we know how to deal with other branches if that happens.10:24
odyssey4meThomasS can you pastebin/gist the resulting /etc/cinder/cinder.conf from inside that container?10:24
ThomasSand seen that it was changed10:24
odyssey4meevrardjp sure10:24
ThomasSwill do10:24
evrardjpThomasS: odyssey4me probably worth knowing what are overrides too.10:24
ThomasSi also post my config10:24
evrardjpgreat10:24
ThomasShold a sec10:24
odyssey4meThomasS you have a manually set hosts file? What's in there? Because we add a bunch of stuff into /etc/hosts too.10:25
* evrardjp hears the lift music while waiting10:25
odyssey4mehaha10:25
evrardjp:)10:25
ThomasSuh damn10:25
ThomasSmaybe this messed it up10:25
ThomasScan i regenerate it`10:26
ThomasS?10:26
ThomasSmy user_varaibles10:26
ThomasShttps://pastebin.com/mKbfWzi710:26
odyssey4meThomasS ok, you definitely need to add https://github.com/openstack/openstack-ansible/commit/83e2b5415b50119eecc651fee4839ad25c5b810d to your user_variables file10:27
odyssey4mebut that's unrelated I think10:27
ThomasSmy openstack user variables10:27
ThomasShttps://pastebin.com/dPr93nJN10:27
ThomasSi will add it10:27
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove uw_nginx jobs  https://review.openstack.org/52204010:27
ThomasSgetting the cinder.conf10:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/pike: Remove uw_nginx jobs  https://review.openstack.org/52251410:28
evrardjpodyssey4me: I don't know if you've seen this: https://review.openstack.org/#/c/522427/10:29
evrardjpjust fyi10:29
evrardjpbecause you have a good memory, I plan to use that information later.10:29
evrardjp:D10:29
odyssey4meah yes, that's a good call10:30
odyssey4methanks jmccrory10:30
ThomasSmy cinder.conf10:30
ThomasShttps://pastebin.com/PbdyaU7s10:30
*** armaan has quit IRC10:31
*** armaan has joined #openstack-ansible10:31
evrardjpyeah :)10:31
ThomasShow can i regenerate the hosts files?10:31
ThomasSthey have been replaced by my ansible run :-(10:32
ThomasSi was just copying the file :-(10:32
ThomasSmy fault10:32
evrardjpwhich hosts file?10:33
odyssey4meThomasS not sure what you mean?10:33
evrardjp /etc/hosts from a container?10:33
evrardjpyeah I didn't understand that too10:33
odyssey4mebut it looks like this wasn't an explicit cinder.conf setting, but rather a default that uses the host name to figure out something like the ip address... and for some reason that broke10:33
ThomasSno on the hardware nodes10:33
ThomasSi have a job to copy one hosts file to all base os nodes10:34
odyssey4meif you're mucking with the hosts file and changing things that relate to the container names or the host names, then that might explain it10:34
ThomasSok so can i fix ist?10:34
ThomasSit10:34
odyssey4meok, so you'll need to replace that with an ansible lineinfile task rather so that it adds to the hosts file instead of replacing it10:34
ThomasSwill do this10:35
ThomasSso re-run all playbooks starting with setup-hosts?10:35
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zaqar stable/ocata: [WIP] Initial Zuul v3 role jobs  https://review.openstack.org/51429910:36
odyssey4meThomasS well, first you need to stop the hosts file copy thing and make it work *with* our hosts file changes10:36
ThomasSalready done10:37
odyssey4meso, as suggested, rather than just copying the file from one host to others - implement an ansible play that uses lineinfil to get those right10:37
ThomasSwill do this10:37
odyssey4meand then, yes, re-run setup-hosts10:37
odyssey4meis this ia new/test environment?10:37
ThomasSa new enviroment for a poc10:38
odyssey4meok, it might make sense to destroy all the containers before re-executing10:39
odyssey4meopenstack-ansible lxc-containers-destroy.yml10:39
ThomasSok10:39
odyssey4meif it's a new test environment, none of the data is important so the containers can be wiped10:39
ThomasSyes the data can go :-)10:40
ThomasSthey are gone. let's see10:44
ThomasSthanks for your help!10:44
ThomasSlet's get fingers crossed10:46
gokhanevrardjp there is problem on ceilometer gates. It can not find policy.json and api.paste.ini files.  I looked at it. Indeed there no policy.json and api-paste.ini file.10:46
gokhanhttp://logs.openstack.org/57/521857/1/check/openstack-ansible-functional-ubuntu-xenial/f181b69/job-output.txt.gz#_2017-11-23_08_30_22_69530310:47
gokhanhttps://git.openstack.org/cgit/openstack/ceilometer/plain/etc/ceilometer/10:47
odyssey4megokhan ah, it's possible that they are no longer relevant for the service10:47
odyssey4meI think they may have removed the API service entirely, so the role will have to be updated to remove all the stuff related to the API that's been removed10:48
evrardjpI think I removed that. gokhan10:51
evrardjpwhich branch??10:51
evrardjpcould you deal with that?10:51
gokhanevrardjp master branch.  odyssey4me ceilometer api and client retired and on queens branch also panko role needed10:53
*** jamesdenton has quit IRC10:53
SmearedBeardwhen I test with Vagrant and make a change and run `vagrant provision` it seems to use the older version of the file.. is that expected?10:56
SmearedBeardso I should run `vagrant destroy && vagrant up centos7` when testing a new change?10:56
hwoarangSmearedBeard: centos?10:57
SmearedBeardyou mean my OS?10:58
hwoarangthe VM10:58
hwoarangah you said centos7 didn't see it10:59
hwoarangso centos7 will only sync the working directory once during provision10:59
hwoarangyou either need to rsync it again yourself for your new changes to appear to destroy and provision again10:59
SmearedBeardhwoarang ah, hence my confusion :D OK, cool so this is expected.. is this the same for ubuntu and opensus then?11:00
hwoarangno ubuntu and opensuse mount the directory using vboxfs11:00
hwoarangso your changes are always updated in vm11:00
SmearedBeardcool, that explains a lot then11:00
openstackgerritDimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add OvS-NSH support  https://review.openstack.org/51725911:01
gokhanevrardjp , on ocata and pike ,ceilometer,aodh and gnocchi roles are mature.  I will modify some auth config deprecated variables on these branchs. Then I will struggle to upgrade ceilometer role on queens branch .11:01
*** udesale__ has joined #openstack-ansible11:03
odyssey4megokhan thanks for pushing on with it11:04
odyssey4meif panko's needed, then are you up to the challenge of developing a new role for it?11:04
*** stuartgr has joined #openstack-ansible11:05
openstackgerritGökhan proposed openstack/openstack-ansible-os_aodh stable/pike: Change auth config to keystone v3  https://review.openstack.org/52248011:05
*** udesale has quit IRC11:05
*** armaan has quit IRC11:06
*** armaan has joined #openstack-ansible11:07
gokhanodyssey4me, ok but I need time. I am junior and at learning stage :) Firstly I will try install new ceilometer, panko on devstack then start to write role11:11
odyssey4megokhan thank you - we appreciate your time and effort!11:12
andymccrgokhan: that's awesome.11:14
*** armaan has quit IRC11:14
gokhanodyssey4me,  thank you too :)11:15
*** armaan has joined #openstack-ansible11:15
openstackgerritGuoqiang Ding proposed openstack/openstack-ansible-os_neutron master: Update the doc link  https://review.openstack.org/52252011:16
gokhanodyssey4me, andymccr, evrardjp if anyone need cloudkitty service on ocata branch, I integrated it on openstack-ansible. https://github.com/b3lab/openstack-ansible/commit/eb0005f5dad94879f10f5502353d5f7c9835a3c111:17
gokhananyone use this commit :)11:17
gokhanit is working successfully11:18
*** yifei has quit IRC11:19
*** yifei has joined #openstack-ansible11:20
odyssey4mehmm, I see we forgot to create a pike branch for that repo11:23
odyssey4medo all those changes match up to what's in https://github.com/openstack/openstack-ansible-os_cloudkitty/tree/stable/ocata/extras ?11:24
odyssey4meif not, could you please push patches to those files to fix them?11:24
*** armaan has quit IRC11:24
*** armaan has joined #openstack-ansible11:25
pradiprwtevrardjp : That problem got solved by enabling promiscous mode to allow all vms, I have one more question how to disable aodh, ceilometer and gnochhi projects?11:26
odyssey4mepradiprwt as discussed yesterday, it is not enabled by default!11:41
odyssey4meif it is in your test setup, then either you've enabled it yourself or you're using a very, very old build11:42
odyssey4mepradiprwt do you have an entry for metering-alarm_host in any one of the files in /etc/openstack_deploy ?11:43
odyssey4meapologies, that should have been 'metering-alarm_hosts' (I missed the trailing s the first time)11:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Do not implement reload for novnc/spice service  https://review.openstack.org/52252611:44
odyssey4mealso, do you have entries for 'metering-compute_hosts', 'metering-infra_hosts', 'metrics_hosts'11:44
pradiprwtodyssey4me: yes it is there in openstack_user_config.yml file11:46
pradiprwtdo I need to remove it11:46
odyssey4mepradiprwt and that is why ou have those services enabled11:46
pradiprwtohhh11:47
odyssey4methose entries tell ansible that you want to enable them11:47
pradiprwtThanks now I will remove all entries from config11:47
odyssey4meok, once that's done you'll need to destroy the containers, then remove them from your inventory - that is if you already have them setup11:47
pradiprwtyeah, thanks odyssey4me11:48
odyssey4meto remove the containers, execute this: openstack-ansible lxc-containers-destroy --limit aodh_all,ceilometer_all,gnocchi_all11:49
odyssey4methen use inventory-manage.py to remove the container entries from your inventory11:49
odyssey4meonce that's done, they're gone - but the services were configured to use it... so you'll have to re-run setup-openstack.yml to reconfigure the services to no longer use it11:50
odyssey4mehwoarang evrardjp found a fairly significant bug and fixed it with https://review.openstack.org/52252611:50
*** gkadam_ has joined #openstack-ansible11:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: tasks: lxc_net: Do not source non-existing network script on CentOS  https://review.openstack.org/52253011:57
hwoarangcloudnull: mhayden^11:57
hwoarangodyssey4me: let me check11:57
*** gkadam has quit IRC11:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Do not implement reload for novnc/spice service  https://review.openstack.org/52252611:58
odyssey4menice catch there hwoarang11:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Do not implement reload for novnc/spice service  https://review.openstack.org/52251012:02
hwoarangodyssey4me: i am not sure how it managed to pass the gates...12:05
hwoarangmaybe i am using an older centos and it's fatal there whereas on newer ones it is not12:05
odyssey4meno idea12:05
mardimevrardjp, hwoarang odyssey4me I am hitting an error in the latest build in CI which I think is transient and is timeout related could you take a look?12:24
mardimhttp://logs.openstack.org/59/517259/18/check/openstack-ansible-ovs-nsh-ubuntu-xenial/774da47/job-output.txt.gz12:24
mardimAlso I was not hitting that error in the previous build12:25
hwoarangmardim: we know about it. a failure during tempest12:25
hwoarangah no not tempest12:25
hwoaranga different one12:25
hwoarangi dont know what to say. another failure with linux-headers12:26
mardimYes but the linux headers are getting installed also in server1 and server2 and localhost12:26
mardimbut I am not seeing any error there12:26
mardimthe error is only in agents1 agents212:26
mardimAlso in the previous run the error was not there12:27
mardimthat's why I think is transient12:27
hwoarangit's not easy for me to decipher apt error messages12:27
hwoarangso i dont know12:27
mardimhwoarang, ok thanks maybe the other guys have some ideas :)12:27
mardimodyssey4me, evrardjp ^12:27
mardimandymccr, ^12:28
odyssey4memardim either it's transient, or it's not - if the error happens all the time, then it's not transient - if it happens sometimes, then it's usually best to try and find the pattern12:30
*** jwitko_ has quit IRC12:30
odyssey4meso first decide whether it's transient or not - does it always fail in the same place in the same way, does it work for you in your tests, but not in the gating tests?12:30
mardimodyssey4me, do you think is realted to this https://github.com/ansible/ansible-modules-core/issues/2951 ?12:30
mardimodyssey4me, it works for me wehn I run tests locally12:30
mardimodyssey4me, It works in a real deployment12:31
mardimodyssey4me, And some time passes in Ci some time has the error12:31
odyssey4meok, then find the pattern for the failure from the logs - does it happen in one nodepool provider, more than one, or all of them?12:31
mardimwhat is a nodepool12:31
mardim?12:31
odyssey4meall openstack tests are run in various cloud providers, each test node is provided in pools (one per provider/region)12:33
odyssey4meso when the test executes, it could be in rackspace cloud iad in the first test, then in ovh in europe for the next12:33
mardimodyssey4me, Ah ok thanks I understood12:33
odyssey4mesometimes one of the regions may have a bad cache/mirror, or something being done in the test that fetches something from the internet fails because of latency or some other issue12:34
odyssey4mealso some of the VM's being tested on have nested virt, and some do not12:34
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zaqar stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51429912:34
odyssey4mein your test I can see from http://logs.openstack.org/59/517259/18/check/openstack-ansible-ovs-nsh-ubuntu-xenial/774da47/zuul-info/inventory.yaml that the test ran in citycloud-kna1 (the provider, under nodepool)12:34
odyssey4meso check where you see other fails of the same type, and see if the fails are particular to a specific provider or more than one12:35
mardimodyssey4me, How did you see that ?12:35
mardimodyssey4me, I mean how did you find out which is the provider ?12:36
odyssey4memardimlook at the file I linked and you'll see12:36
odyssey4memardim ^12:36
mardimodyssey4me, ah ok yes thanks12:36
mardimI will look into that12:36
odyssey4meyou can also use logstash.openstack.org to search job logs and find patterns12:38
odyssey4methe logs get ingested when they can, so a job that just ran will not appear there until a few hours later usually12:39
mardima ok I will check it12:40
mardimnever heard of it though12:40
hwoarangi think it's important to understand what the error is trying to tell you. then you will find it easier to look at the right place12:40
mardimhwoarang, the problem is that I cannot replicate12:41
hwoarangit doesn't matter12:41
hwoarangyour host is not the same as the ones running in nodepool12:41
hwoarangand the log has valid info in it12:41
odyssey4meit looks like this is the actual fail: dpkg: error processing archive /var/cache/apt/archives/linux-headers-4.4.0-101-generic_4.4.0-101.124_amd64.deb (--unpack):\r\n unable to install new version of '/lib/modules/4.4.0-101-generic/build': No such file or directory12:42
mardimhwoarang, odyssey4me Yes that is happening because the package is not installed12:42
mardimhwoarang, odyssey4me But I do not know why12:43
openstackgerritAaron Mehar proposed openstack/openstack-ansible-os_trove master: Adds CentOS 7 support  https://review.openstack.org/52254112:54
*** dmsimard|afk is now known as dmsimard12:55
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Create variable override tests  https://review.openstack.org/52254213:03
hwoarangmardim: why do you need the linux-headers anyway?13:06
hwoarangcan you not simply pull the dkms package?13:06
*** jvidal has quit IRC13:06
mardimhwoarang, the dkms need the headers to compile the ovs-nsh kernel modules13:10
hwoarangso it will pull them itself13:10
hwoarangwhy are you being explicit?13:10
mardimwhat do you mean it will pull them itself13:11
mardimyou mean like13:11
hwoarangi dont see any other dkms ubuntu package to pull linux-headers13:11
hwoarangthe dkms packages are already compiled. so you shouldn't need the headers. you are not building the dkms on the role13:11
mardimno but I am compiling the kernel modules for ovs-nsh13:12
hwoarangwhere13:12
mardimto be more explicit13:12
mardimwhen I install13:12
mardimthe13:12
mardimopenvswitch-nsh-dkms.deb13:12
hwoarangsomething is not right13:13
mardimthe dkms will run the ./configure command13:13
mardimand to do so needs the headers13:13
hwoarangi think your dkms package is not right13:13
mardimit is because it's working if it finds the headers13:13
mardimwe already tested that13:14
hwoarangi am just looking at https://packages.ubuntu.com/xenial/virtualbox-guest-dkms13:14
hwoarangand it does not need linux-headers13:14
mardimhwoarang, Yes maybe it assumes that the heders are already installed13:15
hwoarangthe fact that your package works doesn't mean it's packaged correctly13:15
mardimheaders13:15
hwoarangno there are no such assumptions13:15
hwoarangpackages are explicit on what dependencies they need13:15
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Create variable override tests  https://review.openstack.org/52254213:16
mardimi am not expert in packaging I just followed the procedure we did so far in other installers13:16
mardimlike fuel13:16
hwoarangi suggest you compare your dkms package with an existing one on ubuntu13:16
mardimhwoarang, ok sure13:17
*** jvidal has joined #openstack-ansible13:18
evrardjpodyssey4me: question on https://review.openstack.org/#/c/522526/213:25
*** chyka has joined #openstack-ansible13:25
evrardjphwoarang: IIRC virtualbox-guest-dkms needs linux-headers, it just doesn't ship with it.13:26
hwoarangevrardjp: it's not listed as dependency13:27
evrardjpyes13:27
hwoarangno ubuntu dkms package pulls linux-headers13:27
evrardjpok13:27
hwoarangif they need them they should pull them13:27
hwoarangsomething is fishy...13:27
mardimhwoarang, the same here13:27
evrardjpwell I suspected this to be a licensing issue13:27
mardimhwoarang, https://bbs.archlinux.org/viewtopic.php?id=21037813:27
hwoarangevrardjp: hmm why? Adding a package in the 'Dependency' list should have anything to do with licenses13:28
evrardjpmardim: exactly, on my hosts I already had issues in the past that required me to install linux-headers for installing virtualbox13:28
evrardjpbut I don't know anything about all that.13:29
hwoarang*shouldn't13:29
evrardjphwoarang: I don't know.13:29
mardimevrardjp, same here I just tried to install the packages with dkms13:29
evrardjpconsider I haven't said anything.13:29
mardimand error occured you need linux headers13:29
*** chyka has quit IRC13:29
hwoarangi have no clue what dkms requires but i would be surprised if installing a dkms package requires the headers to be present13:29
evrardjpI will trust hwoarang in those matters.13:29
hwoarangmaybe ubuntu doesn't seem modules, but recipies to build modules13:30
hwoarang*ship13:30
hwoarangwhereas centos/suse give you the .ko files directly13:30
mardimhwoarang, I think the idea with the dkms is that13:30
evrardjpoh yeah I don't think those have .ko. I think it's just the sources?13:31
mardimyou do not need to have the kernel modules precompiled for any version of the kernel13:31
evrardjpsorry I shouldn't talk when i don't know.13:31
mardimbut you can compile them on the fly if you have the linux heraders of the current kernel13:31
hwoarangok then i dont know what to say13:34
mardimme neither I just follow instructions here :)13:35
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: tasks: lxc_net: Do not source non-existing network script on CentOS  https://review.openstack.org/52253013:36
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Making sure this test vars will fail when not properly done  https://review.openstack.org/52255213:36
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_tempest stable/pike: Disable glance v1 API by default  https://review.openstack.org/52255513:46
evrardjpwow I didn't know glance image api v1 isn't supported for THAT long ago.13:46
odyssey4meuh, evrardjp why're you disabling it for pike? our defaults still have it enabled in pike13:47
openstackgerritFlavio Percoco proposed openstack/openstack-ansible-plugins master: Preserve comments in INI files  https://review.openstack.org/52255713:47
gokhanfolks, I am testing magnum installation, but I see a problem on magnum13:47
evrardjpyeah I wanted to open the discussion of things to do/not do13:47
gokhanit is installing developer version13:48
evrardjpodyssey4me: I have -1ed it already, but this way I remember I need to think about all these deprecations.13:48
gokhanlike magum-4.1.4.dev13:48
evrardjpflaper87: will review this one :)13:48
evrardjpI*13:48
flaper87evrardjp: thanks :D13:49
flaper87evrardjp: it's a bit of a hack but it seems to work beautifully13:49
flaper87(last famous words)13:49
evrardjplol13:50
evrardjplooks ok to me13:50
evrardjpwill wait for the pep8 decision13:50
odyssey4megokhan yes, we install from source at arbitrary SHA's, so it almost always ends up being a dev version13:50
gokhanodyssey4me, you say it is stable version. I looked at heat and sahara but on them I didn't see .dev installation, so I doubt of this situation on magnum13:52
odyssey4megokhan that depends on when the service last committed a change, and when they last released13:53
odyssey4meevidently magnum has commits beyond their last release13:53
odyssey4mewe do not use their released tags, we test at a sha regardless of whether it's tagged or not13:53
evrardjpodyssey4me: I am thinking more and more to use only tags tbh.13:55
gokhanodyssey4me, ok thanks.  I think we should use only tags maybe.13:56
odyssey4meevrardjp oh sure, I have some work in the pipeline to make the use of SHA's optional13:58
evrardjpmy sha bump tool takes tags instead of sha13:58
evrardjpso I don't need to do anything for it13:58
evrardjpcan take*13:58
odyssey4meoh, that can be done today that way, yes - but that will only work for non-master13:58
evrardjpoh yeah I am talking about non master13:59
evrardjpwow I didn't realize we weren't talking about the same thing13:59
*** stuartgr has left #openstack-ansible13:59
*** jvidal has quit IRC14:05
*** nshetty has quit IRC14:09
spotzy'all are very chatty I'm gonna need to increase my scroll!:)14:13
spotzAh cool jmccrory's glance patch went through finally. Fell asleep waiting for it to run:)14:16
mardimand the service was up14:17
mardimsorry ^14:18
*** jvidal has joined #openstack-ansible14:18
*** armaan_ has joined #openstack-ansible14:19
*** armaan has quit IRC14:19
evrardjpyou mean the tempest one?14:24
evrardjpyeah14:24
evrardjpthat's cool14:24
evrardjphe did a great job :)14:24
evrardjpI didn't realize but it's holiday for you guys, right?14:25
*** dave-mccowan has joined #openstack-ansible14:26
*** lbragstad has joined #openstack-ansible14:29
*** armaan_ has quit IRC14:32
spotzevrardjp: Yep and yep14:35
evrardjpenjoy then!14:36
bndzormorning14:36
spotzevrardjp: I had a feeling it was config related but was editing videos before bed. I need to work all weekend to catch up from summit so I'll be about and my scroll is now set to 3000 vs 300 so no more missing stuff!14:36
evrardjp:)14:37
evrardjpI have 10k I am still missing stuff. So I learned to stop caring and stopped reading. If someone really wants, (s)he can ping me when I am back:D14:37
spotzevrardjp: So I know you told odyssey4me to add me to something but not what!14:37
evrardjpoh14:38
evrardjpdocs thing14:38
evrardjpensuring the docs are properly published in all branches14:38
spotzI used to look at the logs but no clue where mudpuppy put the bouncer when he moved it. Luckily he used my original setup so it still works:)14:38
spotzevrardjp: Ok and we're still waiting on the new headers from Jimmy I think but we should be all good there or a quick fix. I've also got a patch ready to go for when newton goes eol to fix our releases page14:39
spotzAfter Thursday I should be a little freeer so I'll do review sweeps and try to get some stuff moving again14:40
ThomasShi14:41
ThomasSi am at the reinstall now and setup-infrastructure is failing because on infra1 the containers have no it14:42
ThomasSit looks like the iptables rules are missing on this host14:42
ThomasShow can i setup these? are they not supposed to be setup by setup-hosts playbook?14:43
ThomasSthe host files btw look now fine :-)14:43
ThomasSi did iptables-save and restore to copy the rules manually14:46
spotzThomasS: no the playbppks should work there, if you have an error can you pastebin it so someone can look when they have a chance?14:46
ThomasSsure14:47
ThomasSspotz: all containers on infra1 have no ip address assigned14:48
bndzorcheck your network config14:48
ThomasShttps://pastebin.com/J1Sp7bT314:48
*** woodard has joined #openstack-ansible14:48
ThomasSwhat exactly?14:48
bndzordepends on your network config14:48
ThomasSthe other nodes are fine like infra2 and 314:49
ThomasSall got ips14:49
bndzorthat sounds wierd14:49
bndzortry maybe rebooting the machine and see if that helps14:49
ThomasSit is maybe :-)14:49
gun1xThomasS:14:50
gun1xdid you run setup-hosts?14:50
ThomasSyes14:50
ThomasScompleted without errors14:50
gun1xThomasS: first question, are you on pike? 16.0.2?14:50
ThomasS16.0.314:50
ThomasSyes14:50
gun1xok14:50
ThomasSas full disclosure i did a destroy of all containers14:51
gun1xOSA (and any other automation solution) should run by its self, without manual intervention.14:51
ThomasSbecause i messed the hosts file14:51
gun1xif you destroyed containers, they should be automatically created with setup hosts14:51
*** dave-mccowan has quit IRC14:51
ThomasSthey are14:51
gun1xi would suggest posting the playbook on bpaste.14:51
bndzorsounds more like some network config or daemon is b0rk3d14:51
ThomasShttps://pastebin.com/J1Sp7bT314:52
spotzThomasS: I'm assuming th first time infra1 did get an IP? In shich case when you cleaned up you might have forgotten to remove something14:52
ThomasSyes14:53
ThomasSi guess so14:53
ThomasSi tried to fix the error that the repo container was gone14:53
gun1xso stuff i would check: network config on all hosts (making sure ping and TCP is allowed on all bridges) and playbook (so that there are no mistakes there). also required packages (as suggested by the docu). if all these are ok, playbooks should run wihtout error14:53
spotzThomasS: You mentioned host files, start there but then check networking14:53
ThomasSand to use the public repo again14:53
ThomasSthe playbooks run without error :-)14:54
ThomasSmaybe i do a destroy again and retry :-(14:54
bndzori did a install yesterday using 3 controllers (or infras, whatevah mhm), 3 storages(ceph) and 7 computenodes on stable/pike, worked gucci14:54
gun1xThomasS: starting from zero usually helps14:55
ThomasSok14:55
bndzor^ using ubuntu 16.04 etc14:56
*** jwitko_ has joined #openstack-ansible14:57
ThomasSmy too 16.0414:58
ThomasSi guess i broke something on the infra114:58
*** jwitko_ has quit IRC14:59
spotzThomasS: My guess is something is hanging around from the first installation15:00
*** udesale__ has quit IRC15:02
odyssey4meThomasS there's a script which puts all the iptables bits in place15:07
odyssey4melxc-system-manage15:07
odyssey4methat should fix things all up for you, but it's a bit wierd that you got into a state... I wonder how reproducable that is so that we can figure out a solution15:08
*** chyka has joined #openstack-ansible15:14
*** chyka has quit IRC15:19
openstackgerritDimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add OvS-NSH support  https://review.openstack.org/51725915:29
*** szaher has quit IRC15:34
*** szaher has joined #openstack-ansible15:35
openstackgerritDimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add OvS-NSH support  https://review.openstack.org/51725915:35
*** gkadam_ has quit IRC15:38
*** gkadam has joined #openstack-ansible15:40
*** lbragstad has quit IRC15:53
*** gkadam is now known as gkadam-dinner15:53
*** pcaruana has quit IRC16:09
*** chyka has joined #openstack-ansible16:13
*** mrch has quit IRC16:14
openstackgerritMerged openstack/openstack-ansible-os_magnum master: ansible-role-requirements: Switch ODL git repo to the github mirror  https://review.openstack.org/52179216:17
*** chyka has quit IRC16:17
mgariepyis it just me or github is super slow today ?16:22
mgariepycloning at : 20.00 KiB/s \16:22
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: add bgpvpn ml2 config support  https://review.openstack.org/52259816:25
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: add bgpvpn ml2 config support  https://review.openstack.org/52259816:26
openstackgerritAaron Mehar proposed openstack/openstack-ansible-os_trove master: Adds CentOS 7 support  https://review.openstack.org/52254116:27
hwoarangandymccr cloudnull logan-: do you know how often the ceph ansible roles sync from https://github.com/ceph/ceph-ansible ? last sync is 23 days ago so I can't properly test openSUSE in osa :/16:29
hwoarangi have seen your name on some commits (mhayden too) so i wanted to check with you first :)16:30
*** dave-mccowan has joined #openstack-ansible16:30
andymccri think logan- had an issue with that16:30
andymccrhwoarang: you mean like the ceph/ansible-ceph-osd roles16:31
hwoarangyeah16:31
andymccryeah i kinda feel like we should use the ceph-ansible repo itself rather than the individual roles16:31
hwoarangfrom what i understood these are autogenerated from the main repo16:31
andymccryeah16:31
hwoarangor something like that16:31
andymccrthey are supposed to be16:31
andymccri think logan- had an objection to using the overarching ceph-ansible repo itself16:32
hwoarangwell something is broken for a month and nobody noticed so maybe we are not supposed to use them like you said ;p16:32
hwoarangi will try to talk to upstream again16:32
andymccrthe last bump was a result of logan- pinging in the ceph-ansible irc channel i think :)16:32
odyssey4methey appear to be a bit of a second class citizen :/16:32
odyssey4meja, I suspect they don't have it automated - but instead it gets done by hand16:33
andymccrhonestly, if logan- isn't opposed to it, the ceph-ansible overall repo has worked well for me and it removes that problem16:33
andymccrit also prevents a situation where you move from versions and the roles split out differently16:33
andymccrsince it'll just get all of the roles16:33
odyssey4mebut it will mean that it's not managed from a-r-r any more right?16:33
odyssey4mewe'd have to track the version in something else16:34
openstackgerritMerged openstack/openstack-ansible-os_tempest master: ansible-role-requirements: Switch ODL git repo to the github mirror  https://review.openstack.org/52179616:34
andymccrodyssey4me:  i use a-r-r the only diff is that you have to set the role path to include /etc/ansible/roles/ceph-ansible/roles/16:34
hwoarangwell the main repo is tagged to so we can still track releases16:35
andymccryeah16:35
hwoarangok i will wait for logan- but that's still an issue because ceph master is not really master right now16:36
hwoaranglets see16:36
andymccrhwoarang: so does suse work now on ceph-ansible master?16:41
mardimGuys FYI the centos gate is failing16:42
hwoarangandymccr: in theory they can't run CI on openSUSE so I will have to run OSA to see what happens16:43
odyssey4meandymccr hmm, that works16:44
*** dave-mccowan has quit IRC16:45
andymccrhwoarang: i'll try play about with it and see if i can test it for you on that stand alone stuff i was doing16:46
hwoarangandymccr: i couldn't use that a lot of things didn't place out of the box for me. you are using 2.X iirc but i wanted master and too many things changed16:47
hwoarangbut the suse code is very similar to redhat so i don't think i am far off16:47
hwoarang*s/place/play/16:48
*** chyka has joined #openstack-ansible16:55
*** jvidal has quit IRC16:57
*** michelv has quit IRC17:01
*** stuartgr has joined #openstack-ansible17:12
*** holmsten has quit IRC17:17
*** lbragstad has joined #openstack-ansible17:19
*** gkadam-dinner is now known as gkadam17:22
*** gkadam has quit IRC17:27
*** stuartgr has left #openstack-ansible17:29
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249117:31
*** lbragstad has quit IRC17:36
*** michelv has joined #openstack-ansible17:50
*** baloo has joined #openstack-ansible17:51
*** baloo is now known as Guest3155917:51
*** michelv has quit IRC17:54
*** mbuil has quit IRC17:56
*** shardy has quit IRC18:09
*** savvas_ has joined #openstack-ansible18:25
*** savvas_ has quit IRC18:28
*** germs has joined #openstack-ansible18:39
*** germs1 has joined #openstack-ansible18:40
*** viktor_ has joined #openstack-ansible18:43
*** germs has quit IRC18:43
*** m|y|k has quit IRC18:44
*** viktor_ has quit IRC18:52
*** japestinho has quit IRC19:11
*** savvas_ has joined #openstack-ansible19:24
*** savvas_ has quit IRC19:26
*** savvas_ has joined #openstack-ansible19:26
*** electrofelix has quit IRC19:30
*** pradiprwt has quit IRC19:49
*** ThomasS_ has joined #openstack-ansible20:01
ThomasS_hi guys20:01
ThomasS_so the setup-infrastructure went ok expect two errors with the rabbitmq container20:02
ThomasS_the fiest task which fails is TASK [rabbitmq_server : Read rabbit cookie]20:02
ThomasS_the second one which brakes it is TASK [rabbitmq_server : Apply rabbitmq policies]20:03
ThomasS_the error looks like this20:03
ThomasS_https://pastebin.com/ZxV8dmEy20:04
ThomasS_the message says hostname problem but the entries are there20:04
ThomasS_in /etc/hosts20:04
ThomasS_this is only happening on infra120:09
*** savvas__ has joined #openstack-ansible20:10
*** savvas__ has quit IRC20:11
*** savvas_ has quit IRC20:13
*** savvas_ has joined #openstack-ansible20:14
*** savvas__ has joined #openstack-ansible20:15
*** savvas__ has quit IRC20:17
*** savvas_ has quit IRC20:17
*** savvas_ has joined #openstack-ansible20:17
openstackgerritMerged openstack/openstack-ansible stable/pike: Set ceph_mons in group_vars  https://review.openstack.org/52058820:22
*** savvas__ has joined #openstack-ansible20:23
*** savvas__ has quit IRC20:23
*** savvas__ has joined #openstack-ansible20:24
*** savvas_ has quit IRC20:25
*** savvas_ has joined #openstack-ansible20:26
*** savvas_ has quit IRC20:26
*** savvas__ has quit IRC20:27
*** savvas_ has joined #openstack-ansible20:27
*** savvas__ has joined #openstack-ansible20:29
*** savvas_ has quit IRC20:31
*** savvas_ has joined #openstack-ansible20:32
*** savvas__ has quit IRC20:34
*** savvas__ has joined #openstack-ansible20:35
*** savvas_ has quit IRC20:37
*** savvas_ has joined #openstack-ansible20:38
*** savvas__ has quit IRC20:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts stable/pike: tasks: lxc_net: Do not source non-existing network script on CentOS  https://review.openstack.org/52266021:01
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Allow the haproxy configuration to run with limited groups  https://review.openstack.org/52133121:03
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove the AIO scenario & add new scenarios to maintain coverage  https://review.openstack.org/51600221:03
*** savvas__ has joined #openstack-ansible21:27
*** savvas_ has quit IRC21:29
*** savvas__ has quit IRC21:34
*** savvas_ has joined #openstack-ansible21:34
ThomasS_i rebuild the rabbit mq container on infra121:41
ThomasS_problem is that the error says that it could not resolve the hostname21:42
ThomasS_i tried from host and container and the name in the error message resolves perfect21:42
ThomasS_here is the error https://pastebin.com/FjwJgCev21:43
ThomasS_i am a bit lost :-(21:43
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/pike: Change auth config to keystone v3  https://review.openstack.org/52248021:46
ThomasS_i think i got it. the infra1 node had a wrong entry in /etc/hosts21:50
ThomasS_trying to fix it nox21:50
ThomasS_now21:50
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/pike: Remove uw_nginx jobs  https://review.openstack.org/52251421:56
*** newmember has joined #openstack-ansible22:01
ThomasS_did not fix it...22:01
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/pike: Install sahara-dashboard local_settings  https://review.openstack.org/51674822:01
*** mbuil has joined #openstack-ansible22:11
openstackgerritManuel Buil proposed openstack/openstack-ansible master: Add openvswitch_nsh group to inventory  https://review.openstack.org/51726922:23
*** hamza has quit IRC22:27
*** Guest31559 has quit IRC22:44
*** mbuil has quit IRC22:47
-openstackstatus- NOTICE: Zuul has been restarted due to an unexpected issue. We're able to re-enqueue changes from check and gate pipelines, please check http://zuulv3.openstack.org/ for more information.22:54
*** ThomasS_ has quit IRC23:06
*** savvas_ has quit IRC23:07
*** savvas_ has joined #openstack-ansible23:07
*** savvas_ has joined #openstack-ansible23:41
*** savvas_ has quit IRC23:41
*** savvas_ has joined #openstack-ansible23:41
*** lbragstad has joined #openstack-ansible23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!