Tuesday, 2018-02-13

openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_rally stable/ocata: Zuul: Remove project name  https://review.openstack.org/54365800:04
*** acormier has joined #openstack-ansible00:16
*** acormier has quit IRC00:16
*** acormier has joined #openstack-ansible00:17
*** abelur has joined #openstack-ansible00:17
*** exodusftw has quit IRC00:18
*** exodusftw has joined #openstack-ansible00:23
*** esberglu has quit IRC00:24
*** hw_wutianwei has quit IRC00:26
*** hw_wutianwei has joined #openstack-ansible00:26
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-plugins master: Make connection plugin compatible with Ansible 2.5  https://review.openstack.org/54357600:29
*** pramodrj07 has quit IRC00:35
*** openstackgerrit has quit IRC01:03
*** acormier_ has joined #openstack-ansible01:16
*** jcosmao has quit IRC01:19
*** acormier has quit IRC01:20
*** acormier_ has quit IRC01:29
*** agrebennikov has quit IRC01:30
*** acormier has joined #openstack-ansible01:30
*** lbragstad has quit IRC01:34
*** openstackgerrit has joined #openstack-ansible01:45
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_heat stable/pike: Zuul: Remove project name  https://review.openstack.org/54367201:45
*** woodard_ has joined #openstack-ansible01:48
*** woodard has quit IRC01:48
openstackgerritMerged openstack/openstack-ansible stable/pike: bootstrap-host: Create swap without using a failed task  https://review.openstack.org/54341002:12
*** SerenaFeng has joined #openstack-ansible02:35
openstackgerritJames E. Blair proposed openstack/openstack-ansible-rsyslog_client stable/pike: Zuul: Remove project name  https://review.openstack.org/54376802:46
*** acormier_ has joined #openstack-ansible02:49
*** vnogin has joined #openstack-ansible02:52
*** acormier has quit IRC02:53
*** vnogin has quit IRC02:57
*** acormier_ has quit IRC02:59
*** acormier has joined #openstack-ansible02:59
*** acormier has quit IRC03:00
*** acormier has joined #openstack-ansible03:00
*** acormier has quit IRC03:05
*** acormier has joined #openstack-ansible03:07
*** acormier has quit IRC03:08
*** acormier has joined #openstack-ansible03:08
*** acormier has quit IRC03:16
*** SerenaFeng has quit IRC03:21
TESCRAThanks for your support *****cloudnull***** evrardjp odyssey4me idealmind was finally able to setup host !!!! hav a g8 time...03:34
openstackgerritJames E. Blair proposed openstack/openstack-ansible-openstack_openrc stable/ocata: Zuul: Remove project name  https://review.openstack.org/54378103:46
*** lbragstad has joined #openstack-ansible03:54
matttwhen i reboot my AIO my containers don't start w/ networking ... it looks like dnsmasq isn't firing up for whatever reason03:55
matttanyone seen this?03:55
*** dave-mccowan has quit IRC03:56
*** udesale has joined #openstack-ansible03:57
*** gkadam has joined #openstack-ansible04:04
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_gnocchi stable/ocata: Zuul: Remove project name  https://review.openstack.org/54378304:06
*** bhujay has joined #openstack-ansible04:10
*** rromans has quit IRC04:21
*** peri has joined #openstack-ansible04:26
*** SerenaFeng has joined #openstack-ansible04:33
*** SerenaFeng has quit IRC04:38
*** taseer2 is now known as Taseer04:48
*** threestrands has quit IRC04:50
TESCRAhi all05:00
TESCRAhad a question is it OK if the host section is empty for certain services in inventory.json file ?05:01
TESCRAfor instance my file has few entries like      "galera": {         "children": [],         "hosts": []     },     "galera_all": {         "children": [             "galera"         ],         "hosts": []     },     "galera_container": {         "hosts": []     },05:02
TESCRAIsn't the host list supposed to have the ip of respective containers?05:03
TESCRAalso does the fact that host[] is empty imply that either the container is missing or the service is not installed or its going to run on bare metal instad of container?05:04
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_rally stable/pike: Zuul: Remove project name  https://review.openstack.org/54379205:06
TESCRAcloudnull odyssey4me  evrardjp please let me know if my understanding is incorrect?05:07
*** SerenaFeng has joined #openstack-ansible05:08
*** Leo_m has quit IRC05:11
*** SerenaFeng has quit IRC05:13
*** Leo_m has joined #openstack-ansible05:15
*** dariko has joined #openstack-ansible05:23
openstackgerritJames E. Blair proposed openstack/openstack-ansible-repo_server stable/pike: Zuul: Remove project name  https://review.openstack.org/54379505:26
*** bhujay has quit IRC05:29
*** bhujay has joined #openstack-ansible05:29
*** acormier has joined #openstack-ansible05:32
*** acormier has quit IRC05:32
*** ANKITA has joined #openstack-ansible05:32
*** acormier has joined #openstack-ansible05:33
ANKITAHI ...Thanks cloudnull bhujay evrardjp for your guidance & support05:34
bhujayANKITA: wish you all the best05:35
ANKITAthanks05:35
*** hybridpollo has quit IRC05:39
*** peri has quit IRC05:40
*** dariko has quit IRC06:05
*** acormier has quit IRC06:07
*** Sha000 has quit IRC06:13
*** Sha000 has joined #openstack-ansible06:13
*** acormier has joined #openstack-ansible06:19
*** acormier has quit IRC06:22
*** acormier has joined #openstack-ansible06:23
jafehagood morning06:27
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_glance stable/newton: Zuul: Remove project name  https://review.openstack.org/54380606:27
*** vnogin has joined #openstack-ansible06:30
*** acormier has quit IRC06:33
*** vnogin has quit IRC06:34
*** bhujay has quit IRC06:55
*** acormier has joined #openstack-ansible06:56
*** lbragstad has quit IRC07:01
*** olivierbourdon38 has quit IRC07:07
openstackgerritJames E. Blair proposed openstack/openstack-ansible-pip_install stable/pike: Zuul: Remove project name  https://review.openstack.org/54381607:07
*** jafeha has quit IRC07:16
*** jafeha has joined #openstack-ansible07:17
*** acormier has quit IRC07:18
*** pmannidi has quit IRC07:26
evrardjpgood morning07:31
*** olivierbourdon38 has joined #openstack-ansible07:37
*** ANKITA has quit IRC07:39
*** pcaruana has joined #openstack-ansible07:41
Taseerevrardjp: good morning !07:44
Taseerdo you have any idea why this task is skipping ?07:45
Taseerhttp://logs.openstack.org/91/522491/106/check/openstack-ansible-functional-ubuntu-xenial/2c77fb7/job-output.txt.gz#_2018-02-12_22_16_09_25913707:45
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_glance stable/ocata: Zuul: Remove project name  https://review.openstack.org/54383207:47
jafehagood morning evrardjp07:50
evrardjphow are things?07:51
evrardjpTaseer: it must be a conditional in the code :p07:51
evrardjpit's probably ok07:51
evrardjpthe role should make use of the repo, and when doing standalone tests, you must be using developer mode. Check the conditions for your case.07:52
Taseerevrardjp: you mean I should use set the developer mode to true ? in defaults ?07:55
*** eumel8 has joined #openstack-ansible07:57
*** peri has joined #openstack-ansible07:57
evrardjpTaseer: no, don't change defaults. That applies to everyone. You have os_congress-overrides that is for role testing overrides08:01
evrardjpplease compare to other roles, there is nothing new there.08:02
Taseerok08:03
*** admin0 has joined #openstack-ansible08:05
*** olivierbourdon38 has quit IRC08:06
hwoaranggood morning08:08
*** sar has joined #openstack-ansible08:10
evrardjpgood morning hwoarang08:13
evrardjpodyssey4me: if you're there I'd be happy to have your help on something that followed the inclusion of https://review.openstack.org/#/c/540437/08:13
evrardjp(not sure it's linked though)08:14
evrardjpbasically I got a workaround but i am surprised this happened, so I guess a good pair debugging would work here.08:16
*** mbuil has joined #openstack-ansible08:23
hwoarangi am seeing some roles are using hostvars[inventory_hostname]['foobar_fact'] instead of simply using the 'foobar_fact'. I am curious why that may be08:24
hwoarangany ideas? :)08:24
evrardjphwoarang: yeah, the host isn't in the play08:26
evrardjpwait08:26
evrardjpthat doesn't make sense :p08:26
evrardjpcould you show the task?08:26
hwoarangevrardjp: i am looking at the galera-server default/main.yml file08:26
evrardjplink :D08:27
evrardjpI mean which task :)08:27
hwoarangone sec08:27
hwoaranghttps://github.com/openstack/openstack-ansible-galera_server/blob/master/defaults/main.yml#L14508:27
evrardjpthanks08:27
*** hamza21 has joined #openstack-ansible08:29
evrardjphwoarang: I think it comes from tech debt. Maybe changing that to {{ foobar_fact }} and adding andymccr into the reviewers, because he is the last one touching that bit of code.08:29
hwoarangok then08:29
evrardjpI'd say we were using the physical host before, which was a good assumption, but that assumption fails when doing multi OS / multi arch08:30
evrardjpso using the container data is better, but it needs to be gathered beforehand08:30
evrardjpas this is galera I think it's fair to say it would work, and wouldn't need updating08:30
evrardjpwouldn't need manual updating* if it's not behaving as expected08:31
hwoarangyeah08:31
hwoarangok thank you for checking08:31
evrardjpwelcome to tech debt land :)08:31
hwoaranglol08:31
evrardjpofc!08:31
evrardjpthat's why I am thinking of cleaning things up.08:32
*** sxc731 has joined #openstack-ansible08:34
*** hw_wutianwei_ has joined #openstack-ansible08:36
hwoarang:)08:37
eumel8good morning! what do you about translation deploy job. Is it worth to ask infra team for a bigger flavor to get the job back running? http://zuul.openstack.org/builds.html?job_name=openstack-ansible-deploy-translations-ubuntu-xenial08:38
evrardjpeumel8: well the only technical issue we have in the job is ram depletion08:43
evrardjpwell08:43
evrardjpI mean oom08:43
evrardjpso I plan to run it with a lower sized inventory08:43
evrardjpfor example, last run has: http://logs.openstack.org/periodic/git.openstack.org/openstack/openstack-ansible/master/openstack-ansible-deploy-translations-ubuntu-xenial/00458f1/job-output.txt.gz#_2018-02-12_07_51_16_88403908:44
evrardjpso two approaches:08:44
evrardjpeither we disable services, or we rethink how it runs. Both are possible, some are faster than others.08:45
evrardjpBut it is deploying on my machine with 12 GB of ram, so it's very close.08:45
*** dcdamien has quit IRC08:45
evrardjpeumel8: Let me ask odyssey4me 's -- our infra liaison, to see what he'd do.08:46
eumel8evrardjp: something there to define a new class like ubuntu-xenial-12g https://github.com/openstack-infra/project-config/blob/master/nodepool/nl01.openstack.org.yaml#L14808:46
evrardjpI think the jobs would run faster if we rethink the job and run more things on metal08:46
evrardjpI think it's technically possible, but then you'd have pool changes and things like that.08:47
ivveevrardjp: morning, did you get any idea regarding the ssl handshake & http500 from aodh? should i submit a bug to track it?08:48
evrardjpeumel8: let me file a bug, we'll discuss this in the bug triage of today08:48
evrardjpor before if we can08:48
eumel8evrardjp: alright, thx08:48
evrardjpwe'll discuss the approach, and in the next day or two, we'll see the impact of the change. If it's not enough, we should ask for a larger instance.08:49
evrardjpivve: so, on my side it's something on Ocata that I have to debug on the why08:49
evrardjpit's not a 500 though.08:49
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: Testing neutron jobs  https://review.openstack.org/52869208:50
evrardjpivve: I can implement a workaround, but basically the openstack.connection.Connection() method can take a verify=False argument, which would be necessary for invalid certs. Or alternatively, we should point cert to a filepath, or a tuple of filepaths containing certs/root08:51
evrardjpivve: but on your case it might be different08:51
evrardjpivve: you've got invalid cert for public api, right?08:52
*** admin0 has quit IRC08:52
ivveevrardjp: aye, my deployments are both on pike. both are selfsigned and aodh client is responding with a 500 and openstackclient with a ssl handshake08:52
ivveboth as in centos & ubuntu08:52
ivveso gnocchi has the ssl errors and aodh the http 500 to be precise08:53
evrardjpyeah so I guess it's the verify thing that doesn't work.08:54
evrardjpbut I am surprised of something -- let me debug that with odyssey4me08:55
*** dcdamien has joined #openstack-ansible08:55
ivvethe 500 error is troubleing though as heat spits it out when trying to create alarms08:55
*** ThomasS has quit IRC08:56
evrardjpcheck if you can pass verify false somewhere I don't know which task is failing or not08:56
evrardjpafk08:56
*** ThomasS has joined #openstack-ansible08:56
ivveevrardjp: sure08:56
*** pbandark has joined #openstack-ansible08:57
ivveevrardjp: https://hastebin.com/tedejonaje.xml this is done from the utility container09:03
ivvewith admin credentials09:04
ivveso the heat error is 503, not 500 as i stated earlier, my bad09:07
*** armaan has quit IRC09:14
evrardjpivve: connection refused is a different problem I think09:14
evrardjpthe openstack alarm list IS the same though.09:15
evrardjpis there somethink like --insecure in openstack cli?09:15
evrardjpivve: also it would be interesting to know what is your openrc/clouds.yaml composed of.09:17
*** acormier has joined #openstack-ansible09:19
*** acormier has quit IRC09:23
ivveevrardjp: not to my knowledge (regarding openstack insecure flags.. perhaps some variable can be exported but not that i know of)09:25
ivveill paste a redacted openrc09:26
ivveevrardjp: updated with openrc and clouds.yaml https://hastebin.com/riyudasizu.xml09:29
ivvethis is from the ubuntu pike cloud09:29
ivvefrom the utility container09:30
ivvebut its the same in all..09:30
ivveboth clouds are deployed without any certificate overrides, just default selfsigned.09:32
*** gkadam_ has joined #openstack-ansible09:34
evrardjpivve: as you can see, and what I can see in my case too, we have set to use the internal url, and the internal endpoint, yet, the connection get tested on the external endpoint.09:35
evrardjpwhich is concerning09:35
*** gkadam has quit IRC09:36
ArchiFleKsHi, has anyone successfully deployed Octavia lately ?09:43
evrardjpArchiFleKs: branch?09:43
evrardjpxgerman_: ^ that's for you.09:44
evrardjp:D09:44
evrardjpArchiFleKs: xgerman_ is working in octavia team. He is based in california though, so don't hesitate to spam him at the end of your day09:44
ArchiFleKsevrardjp: thanks I'll do that ;)   i'm on master right now09:46
*** armaan has joined #openstack-ansible09:47
*** armaan has quit IRC09:50
*** armaan has joined #openstack-ansible09:50
evrardjpArchiFleKs: what's your issue? In master we have OOM issues, but except that it was deploying just fine a few days ago.09:53
*** admin0 has joined #openstack-ansible09:57
*** epalper has joined #openstack-ansible10:04
evrardjpivve: you can use debug in the cli, and to all my calls it seems that the interface was respected.10:05
*** peri has quit IRC10:07
openstackgerritJames E. Blair proposed openstack/openstack-ansible stable/newton: Zuul: Remove project name  https://review.openstack.org/54388110:08
*** electrofelix has joined #openstack-ansible10:09
admin0good morning \o10:10
admin0nice to be back here again :)10:11
TESCRAhi evrardjp had a question is it OK if the host section is empty for certain services in inventory.json file ? for eg my file has few entries like      "galera": {         "children": [],         "hosts": []     },    "galera_all": {         "children": [             "galera"         ],         "hosts": []  },     "galera_container": {   "hosts": []    }, Isn't the host list supposed to have the ip of respective containers10:15
TESCRAdoes imply that either the container is missing or the service is not installed or its going to run on bare metal instad of container?10:16
*** shardy has quit IRC10:19
*** shardy has joined #openstack-ansible10:21
*** ullbeking has quit IRC10:22
*** ullbeking has joined #openstack-ansible10:23
evrardjpTESCRA: it's not normal.10:23
evrardjpwell it could be normal, but you should see something in at least one of those.10:24
evrardjpgalera is quite important.10:24
evrardjpI am not sure what you're doing, but it seems you have a lot of trouble for something that is supposed to work, which guide are you following?10:24
evrardjpour deploy guide, or our AIO guide should be quite enough to get working.10:25
openstackgerritJames E. Blair proposed openstack/ansible-hardening stable/newton: Zuul: Remove project name  https://review.openstack.org/54388610:28
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Fix use_percona_upstream variable usage  https://review.openstack.org/53525210:38
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: vars: Install qpress only when galera_xtrabackup_compression is true  https://review.openstack.org/54388810:38
odyssey4meevrardjp eumel8 I haven't done any profiling, but my initial thought of a way forward for translations is to use a non-container build- we should also verify whether our AIO tuning for lower thread counts is catching everything it should.10:39
hwoarangsorry if i missed it but has anyone investigated the upgrade job failures during some db operations?10:41
hwoaranglike http://logs.openstack.org/79/537379/2/gate/openstack-ansible-upgrade-ubuntu-xenial/78bd339/job-output.txt.gz#_2018-02-12_22_11_43_688092 or http://logs.openstack.org/92/528692/6/check/openstack-ansible-upgrade-ubuntu-xenial/3669099/job-output.txt.gz#_2018-02-13_09_26_35_09897810:41
TESCRAevrardjp i am following appendix B production guide10:41
TESCRAi think setup host probably skipped galera container creation...10:42
ArchiFleKsevrardjp: It was in issue with the network setup and specificly with `octavia_container_network_name: "{{ octavia_provider_network_name }}_address"`10:46
ArchiFleKsbut i workaround it, by setting the variable to `container_address`10:46
admin0TESCRA, share your config yml10:47
ArchiFleKsevrardjp: do you know if there are already some plan to support the dashboard deployment ?10:47
evrardjpodyssey4me: yeah I thought of non container build -- but I think we're probably gonna need it for components like trove.10:47
evrardjpArchiFleKs: what do you mean by the dashboard deployment?10:47
evrardjpWe are welcoming anyone :)10:47
evrardjpArchiFleKs: mmm I guess that's something wrongly done . Which task ?10:48
evrardjphwoarang: from which branch to which branch?10:49
evrardjphwoarang: it becomes more an more important to pass the sha freezing10:49
hwoarangevrardjp: i presume it's pike to rocky for our upgrade jobs right?10:50
hwoarangpike to master so maybe that could be it...10:50
evrardjpyeah right now it's doing something insane,10:50
evrardjpyeah10:50
ArchiFleKsevrardjp: from what I understand when using octavia api v2, we deprecate Neutron LBaaS so the new horizon LBaaS pannel would be this one : https://github.com/openstack/octavia-dashboard10:51
evrardjpthat's why I'd like to merge https://review.openstack.org/#/c/543131/ asap10:51
hwoarangright but our jobs will keep doing the pike to master thing right?10:51
evrardjpArchiFleKs: I am happy to have a patch there.10:51
* hwoarang is trying to understand the situation10:51
evrardjp:D10:51
evrardjphwoarang: so when this merges, I can ask for a rc, then forking a new branch.10:52
hwoarangi see10:52
evrardjpwe'll remove all the references to master, which should already be the case with this patch, but I might have missed some. Grepping and all that.10:53
hwoarangperhaps we should disable the upgrade jobs for now then or?10:53
evrardjpthe tests repo need updating though.10:53
evrardjpmaybe, in master.10:53
evrardjpmaybe worth asking how andymccr did last time.10:53
evrardjp:)10:53
evrardjpI am afraid we have more insidious issues since Mid Feb, which gets my focus right now.10:54
hwoarangok10:54
evrardjpalso that PR worked on my machine.10:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Use a venv with previous ansible version for upgrades  https://review.openstack.org/54323710:55
evrardjpOMG I didn't test it properly.10:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: tests: Remove duplicated container creation  https://review.openstack.org/54323810:56
evrardjpI just verified. I had a wrong git checkout master placed after.10:56
evrardjpdarn.10:56
evrardjpok spawning up a new instance10:56
evrardjpArchiFleKs: that would be great if you could add that dashboard into our horizon role.10:57
evrardjpunder the condition of octavia api v2.10:58
evrardjpI guess the fixing of octavia integration can be done by xgerman_10:58
evrardjpwith your help I guess :)10:58
andymccrhmm i'll be honest hwoarang i never had too much issue with neutron - only nova.10:59
andymccrthat could be some of the work to do the better upgrade path for services - i can try take a look a bit later today10:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Use clouds.yaml  https://review.openstack.org/54389111:02
evrardjpandymccr: I guess it's more about how we did with the branching, to not forget anything. But I guess we'll see when the freeze to latest queens passes tests.11:03
andymccrwhen you branched off queens?11:03
odyssey4meevrardjp I don't think we necessarily need another sha bump before doing the initial RC - better to branch sooner, then fix in the branch.11:04
andymccrthats tricky because there are 2 issues: 1. if you dont branch soon enough you have to keep rejecting the requirements bumps and inadvertently one gets merged and you have to revert it or you dont know about it and it breaks. 2. if you branch too soon you have to make sure you backport everything - this is probably more in line with what we did.11:04
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Bump upstream SHAs  https://review.openstack.org/54313111:05
odyssey4meThe longer we take to branch, the more likely things start to break because we're doing pike->rocky11:05
andymccryeah11:05
andymccri think i waited a while on my first cycle11:05
andymccrand it was more hassle than doing it earlier11:05
evrardjpyeah I want to do it the earliest.11:05
andymccri think i tried to do ours once requirements branched11:05
evrardjpI am not sure why it doesn't pass gates, so I will focus on that. Like I said, i thought I was properly testing, but my manual testing failed.11:06
evrardjpandymccr: yeah makes sense.11:06
andymccrits a bit of whack-a-mole tbh.11:06
andymccrthings are moving underneath you so it may have worked and then suddenly it doesnt because of some other random thing11:06
ivveevrardjp: the root issue at hand is heat is getting a 503 error when calling on gnocchi & aodh. the client was merely a way to see what the issue was.. and since i got errors there as well i just thought they were connected11:07
evrardjpivve: I can't help right now on gnocchi and aodh deploys. Sorry.11:07
odyssey4meideally we should try to re-work our tests to reduce that tech debt, but that would require quite a bit of rethinking11:08
ivveevrardjp: ait11:08
odyssey4meTaseer if you don't mind, I'm going to fire up a congress test host to figure out the final issues for your patch - and I'll update the patch... so please leave it as-is for now. Is that OK?11:11
*** pylot has quit IRC11:15
*** pylot has joined #openstack-ansible11:18
eumel8odyssey4me:  alright, it would be good to know in which direction you want with translation check. Because I beat the infra team enough to setup our translation check site  based on osa and with this configuration.11:20
*** shardy has quit IRC11:20
*** shardy has joined #openstack-ansible11:21
Taseerodyssey4me: yes, it is okay11:23
Taseerthanks for helping me out11:23
*** shardy has quit IRC11:35
*** stuartgr has joined #openstack-ansible11:47
*** olivierbourdon38 has joined #openstack-ansible11:47
evrardjpandymccr: or hwoarang could you vote on https://review.openstack.org/#/c/543891/1 ?11:48
ArchiFleKsevrardjp: I'll try, also i noticed some healthcheck fail on my haproxy.conf on master, like nova placement because of the healthcheck, how is this template generate, I notice that it is not inside but haproxy_server but it is generated with python script inside /etc/ansible/role/haproxy_endpoints right ?11:52
*** shardy has joined #openstack-ansible11:52
evrardjpArchiFleKs: I will honestly say I don't know. It used to be on haproxy_server.11:55
evrardjphttps://github.com/openstack/openstack-ansible-haproxy_server/blob/master/tasks/haproxy_service_config.yml11:56
evrardjpit's still there11:56
evrardjpI mean the service config is still there in master.11:56
*** acormier has joined #openstack-ansible11:56
evrardjphaproxy_endpoints is just for managing them IIRC11:56
*** acormier has quit IRC11:57
evrardjphttps://github.com/logan2211/ansible-haproxy-endpoints11:57
evrardjpyup11:57
*** acormier has joined #openstack-ansible11:57
evrardjpArchiFleKs: https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/haproxy_all/haproxy.yml is your service configuration btw11:58
evrardjpor maybe you're talking about a completely different thing.11:59
*** niraj_singh has joined #openstack-ansible12:00
*** acormier has quit IRC12:01
*** nsingh has quit IRC12:02
*** portdirect has quit IRC12:03
*** acormier has joined #openstack-ansible12:03
*** portdirect has joined #openstack-ansible12:03
*** acormier has quit IRC12:04
*** acormier has joined #openstack-ansible12:05
openstackgerritMerged openstack/openstack-ansible-os_glance stable/pike: tests: test-glance-upgrades.sh: Remove the exit trap  https://review.openstack.org/54147012:07
evrardjpodyssey4me: I think you misread the variable name in https://review.openstack.org/#/c/540964/212:11
odyssey4meevrardjp memcached_servers, not memcache _servers12:12
odyssey4methat's likely why I couldn't find it :)12:12
evrardjpyeah I think too :)12:13
odyssey4meah, but https://github.com/openstack/openstack-ansible-os_keystone/commit/e87e2bd737467d4d1c1225f52cb7fad5a4d2cd5d uses the right var name12:13
odyssey4meok, now the patch makes more sense to me :)12:13
evrardjpshould I be more explicit in the commit message?12:14
*** hamza21 has quit IRC12:15
odyssey4meevrardjp nope, but you should also sha bump in the patch12:15
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Use a venv with previous ansible version for upgrades  https://review.openstack.org/54323712:15
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: tests: Remove duplicated container creation  https://review.openstack.org/54323812:15
odyssey4meunless the sha is already bumped to the right SHA?12:16
evrardjpit was a depends on, but right now I can remove the depends-on, and use the a-r-r bump.12:16
* odyssey4me should have more coffee :p12:16
evrardjphahah12:16
odyssey4meleave the depends-on as it's a nice way of tracking the dep, but yeah if the a-r-r doesn't include that dep then rather add it into the patch12:17
evrardjpI will have to check if the bump wasn't done since it's been a while :)12:18
*** gkadam_ has quit IRC12:19
*** bhujay has joined #openstack-ansible12:19
*** sxc731 has quit IRC12:21
*** acormier has quit IRC12:26
*** acormier has joined #openstack-ansible12:26
hwoarangevrardjp: done12:27
evrardjpthx12:28
*** hw_wutianwei has quit IRC12:30
*** acormier has quit IRC12:31
openstackgerritMerged openstack/openstack-ansible-ops master: Use clouds.yaml  https://review.openstack.org/54389112:32
*** armaan has quit IRC12:38
*** ianychoi_ has joined #openstack-ansible12:42
*** ianychoi has quit IRC12:46
openstackgerritJames E. Blair proposed openstack/openstack-ansible-repo_server stable/newton: Zuul: Remove project name  https://review.openstack.org/54392412:49
*** sxc731 has joined #openstack-ansible12:51
evrardjpgood news the issue with the rc is easy to find!12:51
evrardjpnow, the fix...12:51
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: vars: Install qpress only when galera_xtrabackup_compression is true  https://review.openstack.org/54388812:52
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Fix use_percona_upstream variable usage  https://review.openstack.org/53525212:52
evrardjphwoarang: I love that qpress change! didn't review it yet, but the title seems logical and is great!12:54
hwoarang:)12:55
hwoarangremoving code is always good ;p12:55
*** hamza21 has joined #openstack-ansible12:59
*** sxc731 has quit IRC13:00
*** armaan has joined #openstack-ansible13:02
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/ocata: Zuul: Remove project name  https://review.openstack.org/54378113:10
openstackgerritMerged openstack/openstack-ansible-pip_install stable/pike: Zuul: Remove project name  https://review.openstack.org/54381613:10
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/pike: Zuul: Remove project name  https://review.openstack.org/54376813:14
*** pcaruana has quit IRC13:16
*** woodard_ has quit IRC13:18
*** woodard has joined #openstack-ansible13:19
*** lbragstad has joined #openstack-ansible13:20
*** olivierbourdon38 has quit IRC13:22
openstackgerritMerged openstack/openstack-ansible-os_rally stable/pike: Zuul: Remove project name  https://review.openstack.org/54379213:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Bump upstream SHAs  https://review.openstack.org/54313113:25
evrardjpcores, this should be enough for us to get a rc ^13:25
openstackgerritMerged openstack/openstack-ansible-os_glance stable/newton: Zuul: Remove project name  https://review.openstack.org/54380613:26
openstackgerritMerged openstack/openstack-ansible-repo_server stable/pike: Zuul: Remove project name  https://review.openstack.org/54379513:26
openstackgerritMerged openstack/openstack-ansible-repo_server stable/newton: Zuul: Remove project name  https://review.openstack.org/54392413:27
hwoarangchecking13:27
evrardjphwoarang: oh no, please dont!13:29
evrardjpwell that joke doesn't pass well on irc.13:29
openstackgerritMerged openstack/openstack-ansible-os_nova stable/pike: tests: test-nova-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146213:29
evrardjpyou should have seen me saying it, it was epic!13:29
*** oanson has quit IRC13:33
*** lihi has quit IRC13:33
*** Guy has joined #openstack-ansible13:34
hwoarang:p13:34
*** oanson has joined #openstack-ansible13:35
*** dave-mccowan has joined #openstack-ansible13:36
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/ocata: Zuul: Remove project name  https://review.openstack.org/54378313:39
*** lihi has joined #openstack-ansible13:39
bhujayTrying to build a repo and kvm  on SLES12 , it fails at lxc-host , most likely not getting the lxc image from index system at https://us.images.linuxcontainers.org/13:41
bhujayAny suggestion ?13:42
openstackgerritMerged openstack/openstack-ansible-os_glance stable/ocata: Zuul: Remove project name  https://review.openstack.org/54383213:43
openstackgerritMerged openstack/openstack-ansible-os_nova stable/pike: Normalise SuSE barbican package install  https://review.openstack.org/54322113:43
openstackgerritMerged openstack/ansible-hardening stable/newton: Zuul: Remove project name  https://review.openstack.org/54388613:46
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ocata: Zuul: Remove project name  https://review.openstack.org/54365313:46
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/pike: Ensure openstack_hosts sets nodepool variables  https://review.openstack.org/54351113:46
*** ianychoi_ has quit IRC13:48
*** ianychoi_ has joined #openstack-ansible13:49
*** zul has quit IRC13:56
*** zul has joined #openstack-ansible13:57
*** esberglu has joined #openstack-ansible13:58
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/ocata: Zuul: Remove project name  https://review.openstack.org/54362114:00
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/newton: Zuul: Remove project name  https://review.openstack.org/54361614:05
*** hachi has joined #openstack-ansible14:05
*** hamza21 has quit IRC14:08
mhaydenhey, i may need a hand here -- i'm trying to set SELinux contexts properly on nova/neutron/cinder log directories14:09
mhaydenon a normal deployment, that's in /openstack/log/{{ inventory_hostname }}-nova14:09
mhaydenin an AIO, it's /openstack/log/{{ inventory_hostname }}14:09
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_keystone stable/newton: Zuul: Remove project name  https://review.openstack.org/54394214:09
mhaydendo we have a variable that controls that?14:09
mhaydeni'm still hunting14:09
openstackgerritMerged openstack/openstack-ansible-galera_client stable/ocata: Zuul: Remove project name  https://review.openstack.org/54363714:11
mhaydeni guess i could do a readlink() on /var/log/nova and use that14:12
evrardjpdear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, asettle,14:16
evrardjpcolinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking14:16
evrardjpthe osa bug triage will start in 1h45'. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage14:16
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/ocata: Zuul: Remove project name  https://review.openstack.org/54363014:17
hwoarangmhayden: it seems the path is hardcoded. grep for 'log_dirs' in AIO repo14:17
openstackgerritMerged openstack/openstack-ansible-os_rally stable/ocata: Zuul: Remove project name  https://review.openstack.org/54365814:17
mhaydenhwoarang: i think i'm going to just do a readlink on it14:17
mhaydenand use whatever i find14:17
evrardjpmhayden: I think we should simplify all of this.14:17
evrardjp:D14:17
evrardjpbecause it's also different if you're on metal or not14:18
evrardjpthen it won't be a link etc.14:18
odyssey4memhayden perhaps something like https://github.com/openstack/openstack-ansible-os_tempest/commit/4b9f1010fe884bfc17f9782b15343187700d27bf ?14:18
mhaydendarn14:18
hwoarangmhayden: evrardjp does your -1 still stand on this https://review.openstack.org/#/c/538056/ ?14:19
evrardjpprobably not let me check :)14:19
mhaydenodyssey4me: yeah, i'm just trying to determine where i should apply these contexts in a programmatic way14:19
evrardjphwoarang: check experimental will help us on this.14:20
mhaydenhwoarang: so rsyslog on CentOS runs as the 'syslog' user14:20
mhaydenbut syslog is in the adm group14:21
evrardjpI guess it's all about them rotations ?14:21
evrardjp:D14:21
mhaydenhwoarang: i removed my objection -- feel free to W+114:22
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Zuul: Remove project name  https://review.openstack.org/54351314:22
hwoaranglet me check again on all 3 distros14:22
mhaydenso evrardjp / odyssey4me, we set a log_dir in the os_nova role -- that is sometimes a symlink and sometimes a plain old directory?14:23
* mhayden hasn't dug deep into the all metal scenario yet14:23
evrardjpmhayden: https://github.com/openstack/openstack-ansible-os_nova/blob/33b24727247bf37bafe0a328d20526df6322f19c/tasks/nova_pre_install.yml#L78-L8614:24
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Refactor services to magnum_services  https://review.openstack.org/54362814:24
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Implement uWSGI for Magnum API  https://review.openstack.org/54362914:24
*** shardy has quit IRC14:24
evrardjpit's not about all metal ... these kind of things exist since Juno.14:24
evrardjpwe just moved them back and forth to many different ways of doing it, but nothing has really changed14:24
*** shardy has joined #openstack-ansible14:25
mhaydenso i guess i'd have to stat the directory, check if it's a link or not, and handle that14:26
hwoarangevrardjp: i am sorry but i think i will miss the meeting again this week :(14:26
mhaydencloudnull: on CentOS 7, i'm trying the nspawn patch and i've got a problem -> https://paste.fedoraproject.org/paste/TV66aF-fSZYNkKgyZkWScQ14:26
mhaydenhaven't had much time to dig into it14:26
mhaydenbut you're welcome to look at my test instance14:26
* mhayden may be late to the bug triage -- got a team meeting that runs until 0:25 minutes after14:27
*** liangqi has quit IRC14:27
*** liangqi has joined #openstack-ansible14:27
evrardjphwoarang: mhayden no worries.14:28
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_watcher stable/ocata: Zuul: Remove project name  https://review.openstack.org/54394714:29
*** jwitko has joined #openstack-ansible14:31
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Whitelist Octavia API  https://review.openstack.org/54394814:33
*** openstackgerrit has quit IRC14:33
*** armaan has quit IRC14:35
*** eumel8 has quit IRC14:36
*** openstackgerrit has joined #openstack-ansible14:39
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: tests: Remove duplicated container creation  https://review.openstack.org/54351914:39
*** armaan has joined #openstack-ansible14:41
idlemindanyone have a link to the contributor agreement handy?14:41
*** acormier has joined #openstack-ansible14:44
openstackgerritMerged openstack/openstack-ansible stable/newton: Zuul: Remove project name  https://review.openstack.org/54388114:45
*** hachi has quit IRC14:48
*** acormier_ has joined #openstack-ansible14:49
*** acormier has quit IRC14:49
openstackgerritJames E. Blair proposed openstack/openstack-ansible-memcached_server stable/ocata: Zuul: Remove project name  https://review.openstack.org/54395614:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Add SELinux contexts for nova log directory  https://review.openstack.org/54349914:54
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Whitelist Octavia API  https://review.openstack.org/54394814:56
*** mardim has quit IRC15:00
*** Leo_m has quit IRC15:03
*** armaan has quit IRC15:06
*** kstev has joined #openstack-ansible15:11
*** xdfil has quit IRC15:13
*** sxc731 has joined #openstack-ansible15:13
*** xdfil has joined #openstack-ansible15:13
*** bhujay has quit IRC15:13
*** kstev1 has joined #openstack-ansible15:14
*** kstev has quit IRC15:16
*** hw_wutianwei_ has quit IRC15:18
*** hw_wutianwei_ has joined #openstack-ansible15:18
*** Leo_m has joined #openstack-ansible15:19
*** Leo_m has quit IRC15:22
*** sxc731 has quit IRC15:22
*** Leo_m has joined #openstack-ansible15:22
*** sxc731 has joined #openstack-ansible15:29
*** jcosmao has joined #openstack-ansible15:30
*** Leo_m has quit IRC15:33
*** sxc731 has quit IRC15:36
*** sxc731 has joined #openstack-ansible15:39
*** Leo_m has joined #openstack-ansible15:39
*** kstev1 has quit IRC15:41
*** sxc731 has quit IRC15:43
*** Guy has quit IRC15:44
mhaydenhas anyone seen this -> ImportError: /openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/netifaces.so: undefined symbol: PyUnicodeUCS2_FromString15:50
mhaydenjust dinged me in master during a glance db sync15:50
cloudnullmhayden: let me have a look, maybe something I overlooked for cent15:52
*** shardy has quit IRC15:54
*** kstev has joined #openstack-ansible15:54
cloudnullmhayden: https://github.com/cloudnull.keys15:58
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Install yum-utils in openstack_hosts  https://review.openstack.org/54398316:02
evrardjpBug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__,16:02
evrardjpasettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking16:02
evrardjpHere is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage16:02
evrardjp#startmeeting openstack_ansible_meeting16:02
openstackMeeting started Tue Feb 13 16:02:40 2018 UTC and is due to finish in 60 minutes.  The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot.16:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:02
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:02
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:02
evrardjp#topic rollcall16:02
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)"16:02
evrardjpis anyone here?16:03
evrardjpif not we'll postpone on next week.16:03
*** openstackgerrit has quit IRC16:04
bgmccollumhere not here16:04
* admin0 is here 16:04
jmccroryo/16:05
evrardjpok let's do this16:05
evrardjp#topic focus of the week16:06
*** openstack changes topic to "focus of the week (Meeting topic: openstack_ansible_meeting)"16:06
evrardjpreleasing rc and branching16:06
spotzo/16:06
evrardjpyeah so the focus for this week is to have the rc out as soon as possible, so that we can branch stable/queens, and get rolling.16:07
evrardjplet's move on to the bugs then :)16:07
evrardjp#topic bugtriage16:07
*** openstack changes topic to "bugtriage (Meeting topic: openstack_ansible_meeting)"16:07
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174908316:07
openstackLaunchpad bug 1749083 in openstack-ansible "Nova, Glance, Cinder, ... downtime during O to P upgrade" [Undecided,New]16:07
evrardjpI have fixed something that is linked to that bug, but I am not sure we don't have a moving part, so I'll leave that open for now16:08
evrardjpnext16:08
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174903716:08
openstackLaunchpad bug 1749037 in openstack-ansible "Nova API downtime during Ocata upgrade" [Undecided,New]16:08
*** openstackgerrit has joined #openstack-ansible16:08
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Install yum utilities in openstack_hosts  https://review.openstack.org/54398316:08
evrardjpjmccrory: I think your point is valid16:08
evrardjpplease note that we didn't see something wrong in the gates, but we don't test the downtime in the integrated in O16:09
evrardjpIIRC16:09
evrardjpand also quite reduced in size16:10
cloudnullo/16:10
evrardjpjmccrory: do you plan to tackle that issue?16:10
jmccroryyeah, kind of an edge case. the issue is with any external services that need to look up instance data during an upgrade will fail until a first compute is upgraded16:10
evrardjpor should we just mark it as confirmed, and high.16:10
openstackgerritJames E. Blair proposed openstack/openstack-ansible-haproxy_server stable/ocata: Zuul: Remove project name  https://review.openstack.org/54398516:10
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Add RPM warm cache plugin  https://review.openstack.org/54398616:10
*** gillesMo has joined #openstack-ansible16:11
evrardjpjmccrory: yeah but it's quite impacting :)16:11
jmccroryi'll take it, think things can just be moved around to fix it16:11
evrardjpmaybe on a conditional basis? Now that we have facts in N to know if we are in upgrades or not16:12
evrardjpok I will mark it as confirmed and high.16:12
evrardjpnext16:12
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174895116:12
openstackLaunchpad bug 1748951 in openstack-ansible "Use default sysctl_file in openstack_hosts" [Undecided,New]16:12
evrardjpwe are using sysctl module which should be idempotent, and not be the cause of problems16:14
gillesMoHello ! I can't find documentation about ceph rgw integration with openstack-ansible. Is it possible to have Openstack Object storage handled by ceph rgw configured by openstack-ansible ? And Horizon integration too ?16:14
evrardjpgillesMo: we are in the bug triage meeting, could you come a little later, please? Like 45 minutes?16:14
gillesMoAh ! Sorry, yes16:15
evrardjpI'd mark this as Invalid or maybe, at best, confirmed wishlist.16:15
evrardjp(because sysctl_file can be passed to the module)16:15
*** admin0 has quit IRC16:16
jmccrorywishlist makes sense with sysctl_file16:17
*** neillc has quit IRC16:17
evrardjpasking for the use case, and we'll probably mark it as confirmed/wishlist next week16:18
evrardjpnext16:18
*** neillc has joined #openstack-ansible16:18
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174874016:18
openstackLaunchpad bug 1748740 in openstack-ansible "Documentation missing for adding compute host with ceph" [Undecided,New]16:18
evrardjpI'd say confirmed and medium16:19
evrardjpok?16:20
evrardjp516:20
jmccroryyep16:20
evrardjpok next16:20
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174848516:21
openstackLaunchpad bug 1748485 in openstack-ansible "OpenStack-Ansible RabbitMQ server in OpenStack-Ansible: standalone module fails on CentOS7" [Undecided,New]16:21
evrardjpI think there was a patch recently with rabbitmq16:21
*** agrebennikov has joined #openstack-ansible16:22
*** kstev1 has joined #openstack-ansible16:22
*** rromans has joined #openstack-ansible16:23
mhaydeni haven't seen this problem yet16:23
mhaydenbut i am a few weeks behind on master16:23
evrardjpI think this is very close to what logan- is proposing: We are not using our roles externally enough16:24
evrardjpthis is a good example of someone that just tried to use our role, and went to a lot of pain.16:24
evrardjpwhich prevents them from contributing16:24
*** kstev has quit IRC16:24
evrardjpI meant logan- has a spec up for being more "generic" in our roles16:25
*** udesale has quit IRC16:27
evrardjpI think we should be considering this failure as confirmed and low16:27
evrardjpin the meantime, we'd just have to add some packages that are required in the package list16:28
evrardjpok moving on then16:29
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174830216:29
openstackLaunchpad bug 1748302 in openstack-ansible "Block Device Timers in Nova (Missing Variables)" [Undecided,New]16:29
evrardjpI think this is a docs bug for operations guide.16:30
evrardjpWe should list what can be done for ops.16:30
evrardjpthis var could be a good fit.16:30
idlemind^^ 1748302 isn't for docs16:30
idlemind(mine) - need the vars defined in the nova.conf template16:31
evrardjpwhy?16:32
jmccroryidlemind https://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/app-advanced-config-override.html#overriding-conf-files16:32
evrardjpI've updated the bug16:32
evrardjptalking about config_template16:32
evrardjpok if I mark this as invalid?16:33
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/ocata: Zuul: Remove project name  https://review.openstack.org/54395616:33
idlemindjmccrory ya the override will work for my needs!16:34
evrardjpok marking it as invalid.16:34
evrardjpidlemind: it's documented in the bug ;)16:34
idlemindthe nature of the bug is as a user it feels a little strange needing such an advanced feature to get 2 ubuntu instances to launch on a test lvm based cloud16:34
evrardjpidlemind: that doesn't convene well on the bug description I'd say.16:35
idlemindya that piece should be added16:36
idlemind:) i was also unaware of the ability to override at at all until a few ago16:36
evrardjpI think another bug should be filed16:36
evrardjpto say we are not using proper defaults, or, alternatively, nova is not using proper defaults.16:36
idlemindk will do that!16:37
evrardjpthanks idlemind16:37
evrardjpnext16:37
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174781316:37
openstackLaunchpad bug 1747813 in openstack-ansible "Lxc container restart has no attribute 'ansible_pkg_mgr'" [Undecided,New]16:37
evrardjpIt looks like the facts aren't gathered.16:38
jmccroryyeah16:38
odyssey4meyep16:39
evrardjpI will say incomplete, we need to know how he arived to that state.16:39
odyssey4mepossibly due to the use of --limit?16:39
odyssey4meany targeting of containers should always include lxc_hosts in the limit16:39
evrardjpMaybe, but we don't have info. So incomplete :)16:40
evrardjpnext16:40
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174775516:40
openstackLaunchpad bug 1747755 in openstack-ansible "UCA repo included multiple times" [Undecided,New]16:40
evrardjpmgariepy: on which node does this appear?16:41
evrardjpIf that's haproxy nodes, I know why, and we have fixed it :)16:41
openstackgerritKevin Lefevre proposed openstack/openstack-ansible-os_horizon master: Add support for Horizon Octavia UI  https://review.openstack.org/54399916:41
evrardjpalso I think we have a remove of repos in our process of openstack_hosts, do we?16:42
evrardjpI will ask mgariepy to complete the bug to see on which node this appears. Because if it happens on compute nodes, that is something we should be aware of.16:42
evrardjpwe have maybe a step missing.16:42
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Add SELinux contexts for neutron log directory  https://review.openstack.org/54358816:44
evrardjpshould I mark this as incomplete?16:44
mgariepyevrardjp, all my nodes16:45
evrardjpoh great you're here.16:45
evrardjpwell that's weird then16:45
evrardjps/./!/16:45
mgariepythe roles just ensure the new repo is added, but the old is not removed.16:45
evrardjpbut I thought we removed the old ones.16:45
mgariepyonly in queens16:46
evrardjpyup16:46
evrardjphttps://github.com/openstack/openstack-ansible-pip_install/blob/stable/ocata/tasks/pre_install_apt.yml#L30-L4316:46
evrardjpIt seems valid and high16:46
evrardjpmedium I'd say16:46
evrardjpnot high16:47
*** sxc731 has joined #openstack-ansible16:47
mgariepyit's not a huge issue since it still works, but still.. :)16:47
evrardjpYeah we need to add another task that removes the previous uca16:47
evrardjpyeah16:47
evrardjpcould the cause of issues16:47
*** pcaruana has joined #openstack-ansible16:47
evrardjplet's mark this as confirmed and medium or low?16:47
mgariepylow i  guess.16:47
mgariepylike I said it still works, if it wouldn't any deployer would have seen it on upgrade.16:48
evrardjpyeah16:48
evrardjpok triaged!16:48
evrardjpnext16:48
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174775416:48
openstackLaunchpad bug 1747754 in openstack-ansible "container /var/backup mounted twice on upgrade to pike" [Undecided,New]16:48
evrardjpwow16:48
mgariepyyeah that one also haha16:49
evrardjpisn't that in a remo ?16:49
evrardjpreno*16:49
*** olivierbourdon38 has joined #openstack-ansible16:49
openstackgerritMerged openstack/openstack-ansible-os_watcher stable/ocata: Zuul: Remove project name  https://review.openstack.org/54394716:49
mgariepynot sure i havent seen it16:50
evrardjpdoesn't seem so16:50
evrardjpso yes, I'd say it's something we should improve in our upgrade scripts16:50
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Add supports for Horizon Octavia Dashboard  https://review.openstack.org/54400216:50
evrardjpwhere does it come from?16:50
mgariepybut the issue is only that the option changed, so the line is added and doesn't replace the old one.16:51
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Add support for Horizon Octavia Dashboard  https://review.openstack.org/54400216:51
odyssey4meyeah, lxc allows multiple config values for the same options so we can't do full replacements16:51
odyssey4menot as a general rule16:51
mgariepylxc_container_create/tasks/lxc_container_config.yml:16:51
evrardjpthat's logan- patch!16:52
evrardjphttps://github.com/openstack/openstack-ansible-lxc_container_create/commit/c82c7a60e9df2931ab0b456deb26b615d9ccd4e616:52
evrardjpthat never happens, so I had to say it :D16:52
evrardjpI also think we talked about it in a meeting.16:53
evrardjpdiscussing what should we do...16:53
logan-what'd i break? :D16:53
evrardjpwell16:53
* logan- looks at bug16:53
evrardjpyou did what you had to16:53
*** chyka has joined #openstack-ansible16:53
evrardjpthe dual mount thing. It rings me a bell at least16:53
mgariepyjust make all the containers reboot ! haha16:54
evrardjpshould we add a reno ?16:54
evrardjpmgariepy: haha16:54
evrardjpyeah!16:54
evrardjpwhy not, disposable, right? :p16:54
mgariepygalera was filtered out at least.16:54
mgariepyhaha16:54
evrardjphaha that's the only one that matters!16:54
mgariepymostly16:55
evrardjpneutron agents? what?16:55
mgariepyneutron-agent is bad16:55
evrardjpnever heard of him.16:55
mgariepyhaha16:55
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/ocata: Zuul: Remove project name  https://review.openstack.org/54398516:55
evrardjpmgariepy: ;)16:55
evrardjpok anyway. I think it's a valid point, but I am not sure how we can fix this16:55
mgariepywasn't a big issue for me on that deploy (only 20 or so router)16:55
evrardjpa line in file, to see if we have a matching line? Or a known issue16:55
mgariepyneed to regexp the mount pount.16:55
mgariepypoint**16:55
logan-yeah we could just regexp the matching line to include both the old and new16:55
evrardjpI think it's confirmed and low for now16:56
mgariepyit would trigger container restart16:56
evrardjpnot if we do a lineinfile outside the process.16:57
evrardjplike in the upgrade process.16:57
mgariepyhttps://github.com/openstack/openstack-ansible-lxc_container_create/commit/c82c7a60e9df2931ab0b456deb26b615d9ccd4e6#diff-123a82ae3960af389bcb8b776bb79f32L19416:57
evrardjpso we'd change the configs, but lxc wouldn't notice a change16:57
mgariepywe notify of the change.16:58
logan-i get confused about which bind mounts the lxc_container_create is responsible for vs which ones the common-tasks integrated repo handles16:58
logan-https://review.openstack.org/#/c/408090/1/playbooks/common-tasks/os-lxc-container-setup.yml16:58
evrardjpwe should probably simplify all that too :D16:58
logan-my commit only brought consistency to lxc_container_create to match an earlier change to the integrated repo16:58
evrardjpI think you did good.16:58
logan-but i'm not sure which piece is actually responsible for a dupe mount16:59
evrardjpmmm16:59
mgariepyhmm maybe that's where it's done.16:59
evrardjpI think in any case, if we do a lineinfile during the upgrade process, the notify wouldn't trigger, so we'd be cleaner.17:00
evrardjpI guess the create=dir doesn't change much on upgrades.17:00
evrardjpso it would be fine17:00
evrardjpno?17:01
evrardjplet's end up for this bug, and wrap up for today17:02
evrardjpok, no consensus, so I'll just close up for today.17:03
evrardjpThanks everyone!17:03
evrardjp#endmeeting17:03
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"17:03
openstackMeeting ended Tue Feb 13 17:03:49 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:03
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-13-16.02.html17:03
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-13-16.02.txt17:03
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-13-16.02.log.html17:03
logan-yeah I agree, i want to say in ocata or newton we had an upgrade task dealing with the bind mounts17:04
evrardjpsounds ok.17:04
evrardjpWill update the bug then17:04
evrardjpmarking it as confirmed and medium17:05
evrardjp:)17:05
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/newton: Zuul: Remove project name  https://review.openstack.org/54394217:05
evrardjpOk I am done for today. I will follow the rc patch, and will submit a release whenever ready.17:05
evrardjp(https://review.openstack.org/#/c/543131/)17:06
evrardjpwe are closer to stable/queens, and I'd like to thank you all for the work done.17:06
evrardjpGreat team!17:06
evrardjpok I am off for today, sorry guys17:10
idlemindlater17:10
odyssey4meevrardjp looks like we need to modify the heat role to remove cloudwatch?17:12
*** gillesMo has quit IRC17:15
*** armaan has joined #openstack-ansible17:20
*** epalper has quit IRC17:23
*** Leo_m has quit IRC17:30
evrardjpodyssey4me: yes :(17:44
*** markvoelker has joined #openstack-ansible17:46
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Fix nova-api-placement healthcheck  https://review.openstack.org/54402317:49
*** pcaruana has quit IRC17:55
*** admin0 has joined #openstack-ansible17:59
*** pcaruana has joined #openstack-ansible18:06
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_glance master: Remove registry options from scrubber config  https://review.openstack.org/54402918:09
*** hamza21 has joined #openstack-ansible18:12
*** dariko has joined #openstack-ansible18:14
*** sxc731 has quit IRC18:17
*** idlemind has quit IRC18:28
*** sxc731 has joined #openstack-ansible18:32
*** sxc731 has quit IRC18:33
openstackgerritMatt Thompson proposed openstack/openstack-ansible stable/newton: Start nova-conductor container first  https://review.openstack.org/54403818:34
*** idlemind has joined #openstack-ansible18:35
*** mbuil has quit IRC18:43
*** RandomTech has joined #openstack-ansible18:44
*** pcaruana has quit IRC18:45
RandomTechhey mgariepy you busy?18:46
openstackgerritJames E. Blair proposed openstack/openstack-ansible-haproxy_server stable/pike: Zuul: Remove project name  https://review.openstack.org/54404318:51
mgariepyRandomTech, a little bit, what can I help you with ?18:54
RandomTechoh i just had a troubleshooting question with the bridge setup you suggested. im in no rush if your busy at the moment18:54
RandomTechfor some reason after i made the bridge i can no longer ssh through or ping the port the bridge is attached to18:57
mgariepycan you paste your network config somewherE?18:57
*** vnogin has joined #openstack-ansible18:58
RandomTechya one moment18:58
RandomTechhere ya go mgariepy: http://paste.openstack.org/show/671042/18:59
mgariepyyou try to go in via which interface ?19:00
mgariepybr-mgmt >19:00
mgariepybr-mgmt ?19:00
RandomTechim tring to get in via auto enp7s0f119:00
*** stuartgr has quit IRC19:00
RandomTechoops grabbed to much of the line19:00
RandomTechim able to get in through br-mgmt. Its how i got the config19:01
mgariepyip route show19:01
RandomTechhttp://paste.openstack.org/show/671043/19:02
*** poopcat has joined #openstack-ansible19:06
mgariepywhat ip are you coming from ?19:06
mgariepyyou might want to get in via enp7s0f1 and the server might want to send reply by another interface.19:07
mgariepywhich will break the network19:07
*** storshoo_ has quit IRC19:09
*** vnogin has quit IRC19:12
RandomTechi am coming from 130.108.87.24019:13
*** storshoo has joined #openstack-ansible19:13
mgariepyfrom the other server can you ping that address ?19:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Add SELinux contexts for nova log directory  https://review.openstack.org/54349919:13
RandomTechping the 240 adress?19:15
*** vnogin has joined #openstack-ansible19:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249119:19
*** vnogin has quit IRC19:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249119:24
odyssey4meTaseer ^ now actually builds a functioning api service - looking through the docs there's plenty more to do (get HA working, etc), but that gets it started... if it passes the gate then I think we may need to just merge it and iterate from there19:26
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Add SELinux contexts for nova log directory  https://review.openstack.org/54349919:26
odyssey4meand with that, I'm out for the night - cheerio all!19:27
*** sxc731 has joined #openstack-ansible19:29
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Add SELinux contexts for nova log directory  https://review.openstack.org/54349919:30
* mhayden cannot get that darned patch right19:30
mhaydennight, odyssey4me19:30
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Add SELinux contexts for neutron log directory  https://review.openstack.org/54358819:31
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_cinder master: Add SELinux contexts for cinder log directory  https://review.openstack.org/54358919:33
*** armaan has quit IRC19:41
*** armaan has joined #openstack-ansible19:42
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Set a fact for handling yum's fastestmirror plugin  https://review.openstack.org/54404819:49
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_monasca-agent stable/pike: Zuul: Remove project name  https://review.openstack.org/54405019:51
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Set a fact for handling yum's fastestmirror plugin  https://review.openstack.org/54404819:52
*** ansmith has joined #openstack-ansible19:53
*** john51 has quit IRC19:54
*** john51 has joined #openstack-ansible19:55
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Allow deployers to confiure yum fastestmirror  https://review.openstack.org/54405519:58
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Allow deployers to configure yum fastestmirror  https://review.openstack.org/54405519:59
*** hybridpollo has joined #openstack-ansible20:01
idlemindseeig if i can get nova_nova_conf_overrides to get my block_device_allocate stuff working and it appears to create invalid ini strings20:04
idlemindiperf.he.net20:04
idlemindsorry for the iperf link: http://paste.openstack.org/show/671050/20:04
idlemindfrom: https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-advanced-config-override.html20:05
openstackgerritJames E. Blair proposed openstack/openstack-ansible-ops stable/ocata: Zuul: Remove project name  https://review.openstack.org/54406320:12
*** hamza21 has quit IRC20:14
*** hamza21 has joined #openstack-ansible20:14
*** SerenaFeng has joined #openstack-ansible20:32
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: [WIP] Adds new OS support to multi node AIO  https://review.openstack.org/54407020:33
*** Leo_m has joined #openstack-ansible20:35
*** armaan has quit IRC20:37
*** pramodrj07 has joined #openstack-ansible20:37
*** pramodrj07 has quit IRC20:38
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_ironic stable/ocata: Zuul: Remove project name  https://review.openstack.org/54407520:52
*** armaan has joined #openstack-ansible21:06
openstackgerritJames E. Blair proposed openstack/openstack-ansible-openstack_openrc stable/pike: Zuul: Remove project name  https://review.openstack.org/54408821:12
*** Leo_m_ has joined #openstack-ansible21:14
*** Leo_m has quit IRC21:16
*** dariko has quit IRC21:19
*** dariko1 has joined #openstack-ansible21:19
*** olivierbourdon38 has quit IRC21:22
*** sxc731 has quit IRC21:25
evrardjpidlemind: use ":" instead of = :p21:27
evrardjpdict notation21:27
evrardjplike in the docs.21:27
*** RandomTech has quit IRC21:29
openstackgerritJames E. Blair proposed openstack/openstack-ansible-rabbitmq_server stable/newton: Zuul: Remove project name  https://review.openstack.org/54409421:32
*** SerenaFeng has quit IRC21:32
idlemindAhh gothca21:34
idlemindgood catch21:34
*** vnogin has joined #openstack-ansible21:38
*** ansmith has quit IRC21:41
*** hamza21 has quit IRC21:42
*** openstackstatus has quit IRC21:43
*** openstackstatus has joined #openstack-ansible21:43
*** ChanServ sets mode: +v openstackstatus21:43
*** niraj_singh has quit IRC21:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder master: Replace virtualenv-tools by a script  https://review.openstack.org/54410621:51
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_heat stable/ocata: Zuul: Remove project name  https://review.openstack.org/54410721:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Add SELinux contexts for nova log directory  https://review.openstack.org/54349921:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Add SELinux contexts for neutron log directory  https://review.openstack.org/54358821:57
*** vnogin has quit IRC21:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_cinder master: Add SELinux contexts for cinder log directory  https://review.openstack.org/54358922:00
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Add SELinux contexts for neutron log directory  https://review.openstack.org/54358822:00
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Allow deployers to configure yum fastestmirror  https://review.openstack.org/54405522:04
*** niraj_singh has joined #openstack-ansible22:10
evrardjpjmccrory: you're the most western of us, could you babysit https://review.openstack.org/#/c/543131/ ?22:10
evrardjpIt passed glance on my local machine22:10
jmccrorysure22:10
evrardjpit seems to have failed there in the gates for a .so mismatch reason -- I will have to dig into that.22:11
evrardjpit should technically work, so it's just a question of merging it as soon as possible22:11
evrardjplet me remove the update tests in glance, swift, nova, cinder, keystone, neutron for passing your change.22:12
evrardjpor we can backport when branched.22:14
jmccroryoh that one's not urgent, just some cleanup. the options aren't used at all anymore so they'd be just ignored22:15
evrardjpjmccrory: you need an urgent fix?22:15
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/pike: Zuul: Remove project name  https://review.openstack.org/54404322:15
evrardjpok22:15
evrardjpyeah let's just wait then :)22:15
evrardjpI am afraid that disabling jobs will make the door open for bad things.22:15
jmccroryyeah, i'll try to spend some time later this afternoon to see if there's some new issue with the upgrade test script22:16
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improbe tests  https://review.openstack.org/54411722:24
*** acormier_ has quit IRC22:25
*** acormier has joined #openstack-ansible22:25
evrardjpwell we'll probably need to update branches. But right now I think will go to bed :)22:27
*** acormier has quit IRC22:30
openstackgerritJames E. Blair proposed openstack/openstack-ansible-openstack_hosts stable/newton: Zuul: Remove project name  https://review.openstack.org/54412022:32
*** vnogin has joined #openstack-ansible22:34
openstackgerritKevin Lefevre proposed openstack/openstack-ansible master: Add support for Horizon Octavia Dashboard  https://review.openstack.org/54400222:36
*** vnogin has quit IRC22:39
*** armaan has quit IRC22:43
cloudnullanyone around mind giving https://review.openstack.org/#/c/477017 another review22:46
cloudnull?22:46
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improbe tests  https://review.openstack.org/54411722:54
*** dariko1 has quit IRC22:58
*** admin0 has quit IRC23:13
*** acormier has joined #openstack-ansible23:29
*** ansmith has joined #openstack-ansible23:31
*** vnogin has joined #openstack-ansible23:35
*** acormier has quit IRC23:37
*** vnogin has quit IRC23:40
*** acormier has joined #openstack-ansible23:50
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127023:53
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Replace virtualenv-tools by a script  https://review.openstack.org/53364523:53
*** acormier has quit IRC23:55
*** kstev1 has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!