Wednesday, 2018-10-17

*** mcarden has joined #openstack-ansible00:14
*** gyee has quit IRC00:17
*** mmercer has quit IRC00:25
*** spatel has joined #openstack-ansible00:31
*** spatel has quit IRC00:31
*** nsmeds has quit IRC00:36
openstackgerritMerged openstack/openstack-ansible master: Add one test case to the TestMergeDictUnit for same key dict merge  https://review.openstack.org/60974500:54
*** lbragstad-503 is now known as lbragstad00:58
*** spatel has joined #openstack-ansible01:07
*** dave-mccowan has joined #openstack-ansible01:20
*** logan- has joined #openstack-ansible01:24
*** vnogin has joined #openstack-ansible01:47
*** spatel has quit IRC01:50
*** vnogin has quit IRC01:51
openstackgerritLogan V proposed openstack/openstack-ansible-plugins master: tests: Do not use ansible_host to pass container IP  https://review.openstack.org/58232901:53
openstackgerritLogan V proposed openstack/openstack-ansible-plugins master: Allow container detection when host matches container_name  https://review.openstack.org/58233001:53
cloudnullhey mattoliverau :)01:56
mattoliveraucloudnull: o/01:56
cloudnullI'm not sure of a way to do ipv6 only clouds, however, I do know that if you have IPv6 enabled you can get IPv6 within the containers01:57
openstackgerritMerged openstack/openstack-ansible-ops master: More cleanup of the osquery role  https://review.openstack.org/61109901:57
openstackgerritMerged openstack/openstack-ansible-ops master: Add osquery pack setup  https://review.openstack.org/61119501:57
prometheanfireI've done v6 only networks, and I think nothing infra side would REQUIRE v4, but tooling probably needs to change01:57
*** cshen has joined #openstack-ansible01:58
spotzmattoliverau: Hey!!!02:00
mattoliverauspotz: o/02:00
spotzmattoliverau: Congrats02:01
mattoliveraucloudnull, prometheanfire: I'll just have a play with chaning the aio code/tooling a bit and see what happens :). If i manage it I'll be sure to push something :)02:02
cloudnull++ cool!02:02
prometheanfiremattoliverau: :D02:02
mattoliverauspotz: thanks! good thing the baby is cute, cause finding time to sleep is the hard part :P02:02
*** cshen has quit IRC02:03
spotzmattoliverau: ehehe. Will we see you in Berlin?02:03
openstackgerritMerged openstack/openstack-ansible-ops master: Fix missing logstash device error  https://review.openstack.org/61070502:03
openstackgerritLogan V proposed openstack/openstack-ansible-plugins master: Allow container detection when host matches container_name  https://review.openstack.org/58233002:06
mattoliverauspotz: nope :( I would love too but there happens to be noone (friends or family) available as some backup support for the wife that week (any other week would've been fine). And not quite ready to leave the wife alone with a new born and a monster^Wtoddler. But should be at the next.02:06
spotzmattoliverau: We'll miss you but very understandable02:06
mattoliverauso a nice quiet stay at home for the rest of the year. though maybe quiet isn't the word for it :P02:07
*** ram5391 has joined #openstack-ansible02:09
ram5391Is there a flag that is supposed to be set in the config to tell ansible to test against https keystone, and not http?02:14
ram5391I tried setting: keystone_service_publicuri_proto: http02:15
ram5391openstack_service_publicuri_proto: http02:15
ram5391But my setup-openstack.yml is failing because it can't resolve the http keystone endpoint. (https is working fine)02:16
*** kstev has joined #openstack-ansible02:20
*** kstev has quit IRC02:39
*** kstev has joined #openstack-ansible02:44
openstackgerritMerged openstack/openstack-ansible-tests stable/queens: common-tasks: nodepool: Set openSUSE OBS mirror for OpenStack CI  https://review.openstack.org/60750502:46
ram5391If anyone there could lend a hand, I just don't know if its worth combing through all the playbooks to change the value of the test string, or if its something I'm doing wrong02:47
*** kstev has quit IRC02:53
openstackgerritmelanie witt proposed openstack/openstack-ansible-os_cinder master: Fix Cinder backup to use full class path  https://review.openstack.org/60584603:00
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Update messaging notification configuration  https://review.openstack.org/60511203:05
*** dave-mccowan has quit IRC03:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122603:40
*** ram5391 has quit IRC03:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122603:48
*** cshen has joined #openstack-ansible03:58
*** cshen has quit IRC04:03
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122604:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122604:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122604:43
*** pcaruana has quit IRC04:46
*** shyamb has joined #openstack-ansible04:58
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122605:05
*** chhagarw has joined #openstack-ansible05:06
*** jbadiapa has quit IRC05:10
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122605:36
*** vnogin has joined #openstack-ansible05:47
*** vnogin has quit IRC05:51
*** DanyC has joined #openstack-ansible06:07
*** cshen has joined #openstack-ansible06:15
*** pcaruana has joined #openstack-ansible06:34
*** jbadiapa has joined #openstack-ansible06:34
evrardjpgood morning06:44
jrosserMorning evrardjp06:44
evrardjpmorning jrosser :)06:45
evrardjpmattoliverau: did you get help on the ipv6?06:45
evrardjpipv6 is so long that people tend to use dns with ipv6 behind the scenes. In that case it should be fairly straightforward. The only part is I guess the lxc containers IPs. If you want full ipv6, you can probably use a bare metal deployment, which will not really care about generation of IPs. Or better, improve our nspawn/lxc to handle ipv6 (or just accepting IPs from dhcpv6/slaac)06:47
evrardjpmaybe jrosser has an idea there?06:47
jrosserGiven that the container macs are generated I’d always thought a slaac-alike approach was viable there06:48
jrosserWhich may be osa generating static ipv6 from the generated Mac06:49
evrardjpyes so a way of disabling privacy extensions and just re-using the slaac would be fine to determine the IP of the container06:52
jrosserPerhaps my point really is that all of the tooling exists already to assign unique and unchanging ipv6 to the container interfaces, it would be a relatively small change somewhere to do that06:52
*** shyamb has quit IRC06:52
jrosserevrardjp: can we always rely on there  being a RA for the prefix?06:55
*** deployer2 has quit IRC06:58
evrardjpI was first tempted to say yes, but I can think of a few cases where no07:02
evrardjpI would not see a problem to use fe80: in itself07:02
evrardjpor private networks07:02
evrardjpfc00...07:03
evrardjpin that cases there is a slight chance that the user would not have assigned a router07:03
evrardjpbut I see many problems happening if there is no proper ipv6 router though07:06
evrardjpso it's maybe a wise assumption07:06
jrosserYou’d want it to work in any AIO really07:06
jrosserEven one without any v6 on the outside07:07
*** fghaas has joined #openstack-ansible07:07
jrosserSo I think generating static addresses in the inventory in a way which resembles slaac is probably the most universal answer.07:09
*** hamzaachi has joined #openstack-ansible07:35
*** DanyC has quit IRC07:37
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO ELK Fixes  https://review.openstack.org/61116707:40
*** goldenfri has quit IRC07:46
*** shyamb has joined #openstack-ansible07:46
*** tosky has joined #openstack-ansible07:53
*** pvradu has joined #openstack-ansible07:56
*** electrofelix has joined #openstack-ansible07:59
*** goldenfri has joined #openstack-ansible08:02
openstackgerritMerged openstack/openstack-ansible-os_ironic master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060308:04
odyssey4meo/ folks, sorry was out yesterday organising visa things for berlin08:11
openstackgerritMerged openstack/openstack-ansible-tests master: Set OpenSUSE distro jobs to non-voting  https://review.openstack.org/60843008:20
jrossero/ odyssey4me ..... this was surprising https://review.openstack.org/#/c/610165/08:21
odyssey4mejrosser: unfortunately I lost your PM from yesterday because my IRC client crashed :/08:21
jrosserno worries, i lashed some stuff together here https://review.openstack.org/#/c/611146/ which would be a starting point to talk about08:22
odyssey4mejrosser: honestly I find myself thinking that perhaps ceph for ubuntu should just come from UCA instead of trying to use the ceph repo, but meh - I just using the ceph packages across all distros is something people want08:23
jrosserwell theres a number of things08:25
jrosseri was trying to debug that rgw segafault and there didnt seem to be any -dbg packages in UCA08:26
*** DanyC has joined #openstack-ansible08:26
jrosseralso the apt-pinning is ambiguous - last week UCA had a higher version string of 13.2.1 than download.ceph.com did, but today it's the other way round as theres 13.2.2 at ceph.com08:29
*** thuydang has joined #openstack-ansible08:30
evrardjpoh great08:34
evrardjpthat's good news08:34
jrosseroh, and we apt-pin ceph_client but not the server side parts08:35
odyssey4meoh dear08:37
evrardjpodyssey4me: jrosser should we go on a limb here?08:38
evrardjpI am thinking that we should build nodes in infra with ceph on it.08:38
evrardjpso we can request said nodes and just integrate into it :p08:38
evrardjpso no need to care about that then :p08:39
evrardjptwo different lifecycles08:39
evrardjpre-usable by other deployment projects08:39
evrardjpso server side problem is solved:p08:40
odyssey4meevrardjp: I don't see how that solves the problem?08:40
evrardjpit just moves it08:40
evrardjp:p08:40
evrardjpwe don't need to care about server anymore that way?08:40
evrardjpwe just say for release x we support ceph version a/b/c08:41
evrardjpbut I said "go on a limb"08:41
evrardjpI agree that fixing the thing is probably better right now08:42
jrosseras i look at this, on the whole OSA takes a really careful approch to ensuring that the right versions of key components get installed in a repeatable manner08:42
jrosserthat just needs improving for the ceph parts, which are currently relying somewhat on luck to get a coherent set of client/server installed08:43
jrossersorting the pinning for the ceph server components to match the client is one thing08:43
evrardjpjrosser: maybe we should move to only a single role for making it easier, and have different "profiles" there?08:43
evrardjpso only one pinning would apply08:44
evrardjp(as it would be in a common 'profile' )08:44
evrardjp(wild ideas here, no sacred cows)08:44
jrosserand secondly playbooks/ceph-install.yml and the matching rgw one are quite scrappy08:44
jrosseri feel they are quite low hanging fruit for a refactor08:44
odyssey4meevrardjp: I thought the ceph_client role did exactly that?08:45
chandankumarodyssey4me: Hello08:45
odyssey4mejrosser: sounds good - I see you've started on it already08:45
odyssey4mechandankumar: o/08:45
chandankumarodyssey4me: regarding this review https://review.openstack.org/#/c/591424/ http://logs.openstack.org/24/591424/30/check/openstack-ansible-functional-distro_install-centos-7/b8236ed/job-output.txt.gz#_2018-10-16_12_37_02_74951608:45
jrosserodyssey4me: i have, but that part i'd really like input on08:46
chandankumarodyssey4me: I am not sure from where /root/etc is taken08:46
chandankumarodyssey4me: for other jobs tempest is running08:46
odyssey4mechandankumar: looking08:47
*** vnogin has joined #openstack-ansible08:47
chandankumarevrardjp: can we merge this one https://review.openstack.org/60999208:48
odyssey4mechandankumar: in vars/distro_install there is the following set: tempest_workspace: "{{ ansible_env.HOME }}"08:51
odyssey4mechandankumar: then the task 'Copy tempest config' copies the file into dest: "{{ tempest_workspace }}/etc/tempest.conf"08:51
chandankumarodyssey4me: will i remove that part?08:51
odyssey4methat's why it's trying to copy into /root/etc08:51
*** vnogin has quit IRC08:52
odyssey4meso the path you removed in 'Create tempest directories' should have a new path added to create /etc/tempest, and the destination for the conf file should be changed to /etc/tempest08:52
chandankumarodyssey4me: we donot need to create tempest workspace08:53
chandankumartmepest init <workspace> -> creates a dir and /etc and /logs folder for us08:53
odyssey4mechandankumar: yes, but we do need to create /etc/tempest do we not?08:55
chandankumarodyssey4me: we donot need08:55
evrardjpI forgot to say that 18.0.0 is finally released! Congrats everyone08:55
odyssey4meif not, then just make sure the right destination path is set for the conf file08:55
evrardjpnow I can work on 18.0.1 and all the others08:56
odyssey4meevrardjp: yeah! thanks for handling that - I guess we need a sha bump already for 18.0.108:56
chandankumarodyssey4me: http://paste.openstack.org/show/732324/08:56
chandankumarit creates tempest_lock in workspace as well as in /tmp dir08:57
chandankumarit also creates ~/.tempest/ folder where workspace reference is stored08:57
odyssey4mechandankumar: yes, that's for the workspace - but doesn't tempes.conf need to already be in /etc/tempest at the time of init for the workspace to use it as a base config?08:57
chandankumarodyssey4me: nope, during tempest run, tempest first looks for config in workspace if it not found then it looks for other places08:58
chandankumar/etc/tempest08:58
odyssey4mechandankumar: yes, but it won't exist anywhere else yet because the tasks have been re-ordered to only place the conf down afterwards08:58
chandankumarchecking08:59
odyssey4methis is why I'm suggesting that we create /etc/tempest and put the tempest.conf there before we init the workspace09:00
chandankumarodyssey4me: will I introduce a new var tempest_conf_path where default will be /etc/tempest ?09:01
odyssey4mechandankumar: I don't think it needs a var - would TripleO like it to be configurable?09:02
chandankumarodyssey4me: in Tripleo, we use the default workspace/etc path for config09:02
chandankumarlet me do that09:02
chandankumarand see how it goes, in future we can change if needed09:03
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142409:04
evrardjpodyssey4me: yes indeed -- it should have happened on friday, so I am late :p09:04
evrardjpodyssey4me: but if you have noticed, I am slowly catching up said lag.09:05
evrardjpI expect by next release no lag should appear.09:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Switch to using file-backed VM's only  https://review.openstack.org/60911009:05
evrardjpchandankumar: done09:06
chandankumarevrardjp: thanks :-)09:06
odyssey4meevrardjp: thanks - appreciate the time you're taking on this :) let us know if we can help carry the load09:07
noonedeadpunkmorning everyone.09:12
noonedeadpunkdo you know if opensuse 15 was either fixed or disabled? Unfortunatelly I didn't catch on yestarday meeting what exactly decided regarding this broken template09:13
odyssey4menoonedeadpunk: the job is now non-voting09:13
*** shyamb has quit IRC09:14
noonedeadpunkodyssey4me: so may I set it as non-voting for distro-install task as well here https://review.openstack.org/#/c/610274/ ?09:15
odyssey4mejrosser: nice work on http://grafana.openstack.org/d/4-pSHcImz/openstack-ansible?orgId=1&from=now-30d&to=now - I think it might be possible to use some wildcards to have all the jobs show up there... and the run time graphs would look better if the lines are joined I think, and perhaps we could also put them all on the same graph09:15
odyssey4mealternatively we could have each job graphed with its data, and show the moving average or something like that09:16
odyssey4meperhaps I should fire up a test grafana host to play around with some things, given that graphite.openstack.org is openly accessible09:16
*** hw_wutianwei_ has joined #openstack-ansible09:17
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: All distro-install tests are voting now.  https://review.openstack.org/61027409:21
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: All distro-install tests are voting now.  https://review.openstack.org/61027409:23
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Distro-install tests for Ubuntu and Centos are voting now.  https://review.openstack.org/61027409:24
evrardjpodyssey4me: not much load in itself. I have yet to find time basically on my last round of cleanups.09:25
evrardjpthen it can be properly documented09:25
evrardjpand moved away from the current method, and branch independant, and simpler :)09:25
odyssey4meawesome :)09:25
*** hamzaachi has quit IRC09:26
evrardjpI mean it's already branch independant and more modular to me09:26
evrardjpbut anyway I am closer.09:26
*** hamzaachi has joined #openstack-ansible09:26
*** shyamb has joined #openstack-ansible09:38
*** Emine has joined #openstack-ansible09:40
mattoliverauevrardjp, jrosser: it's too late to read through and grok all this now :P. ATM I'm just changing the aio tooling and keeping as simple as possible for now.. use static ipv6 addressing. It's just a step 1. Thanks for the comments, they will be very useful and something I will need to think about in the future.09:42
mattoliveraumaybe morning matt when he has more brain power09:43
*** shyamb has quit IRC09:48
*** shyamb has joined #openstack-ansible09:48
odyssey4menoonedeadpunk: reviewed with some feedback09:52
*** thuydang has quit IRC09:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon master: Use openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/61127709:54
noonedeadpunkodyssey4me: and is the list of zuul templates public available? Can you please point me to it, in case it is available09:57
odyssey4menoonedeadpunk: they come from https://github.com/openstack/openstack-ansible-tests/blob/master/zuul.d/project-templates.yaml09:57
noonedeadpunkgot it, thanks09:58
jrosserodyssey4me: on grafana i was thinking that having graphs like those i did per distro family would be good09:58
jrosserthen an aggregate one showing overall failure rate, because at the end of the day that is our measure of how easy/hard it is to land a patch09:59
jrosserthe per-distro family ones would let us see why things were failing easily09:59
jrosseri only discovered too late that the graphite data was open, so didnt get change to play locally and make the charts look nicer10:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use the OSA inventory and plugins where possible  https://review.openstack.org/61127910:01
odyssey4mejrosser: it's a good start, and I think a worthwhile initiative10:02
jrosseryeah, it'll provide some really good insight10:03
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Distro-install tests for Ubuntu and Centos are voting now.  https://review.openstack.org/61027410:05
noonedeadpunkodyssey4me: according to the list of templates, it's time we made bionic voting for upgrade task, or it's still not ready for prod?10:05
odyssey4menoonedeadpunk: we've removed all the upgrade tests, I'm working on using the integrated repo for all role tests and when that's in, we'll use that for upgrade tests instead10:06
odyssey4meso yeah, those comments are out of date10:06
noonedeadpunkoh, sorry then.10:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove verbose output for bootstrap  https://review.openstack.org/61128310:08
*** shyam89 has joined #openstack-ansible10:09
*** Emine has quit IRC10:10
*** shyamb has quit IRC10:13
*** Emine has joined #openstack-ansible10:13
*** rgogunskiy has joined #openstack-ansible10:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Switch to using file-backed VM's only  https://review.openstack.org/60911010:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use the OSA inventory and plugins where possible  https://review.openstack.org/61127910:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove verbose output for bootstrap  https://review.openstack.org/61128310:16
*** Emine has quit IRC10:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove duplicated vm_servers group creation  https://review.openstack.org/61128810:31
*** tosky has quit IRC10:34
*** tosky has joined #openstack-ansible10:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129210:41
*** hamzaachi has quit IRC10:43
*** hamzaachi has joined #openstack-ansible10:44
*** Emine has joined #openstack-ansible10:50
*** cshen has quit IRC11:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Switch to using file-backed VM's only  https://review.openstack.org/60911011:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use the OSA inventory and plugins where possible  https://review.openstack.org/61127911:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove verbose output for bootstrap  https://review.openstack.org/61128311:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove duplicated vm_servers group creation  https://review.openstack.org/61128811:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129211:04
*** vollman has joined #openstack-ansible11:09
*** ansmith has joined #openstack-ansible11:10
*** cshen has joined #openstack-ansible11:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Switch to using file-backed VM's only  https://review.openstack.org/60911011:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Use the OSA inventory and plugins where possible  https://review.openstack.org/61127911:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove verbose output for bootstrap  https://review.openstack.org/61128311:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Remove duplicated vm_servers group creation  https://review.openstack.org/61128811:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129211:15
*** shyam89 has quit IRC11:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129211:18
*** ansmith has quit IRC11:18
openstackgerritMerged openstack/openstack-ansible-os_heat master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060511:18
openstackgerritMerged openstack/openstack-ansible-os_trove master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060111:18
openstackgerritMerged openstack/openstack-ansible-os_nova master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61059711:21
openstackgerritMerged openstack/openstack-ansible-os_sahara master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060911:21
*** rgogunskiy has quit IRC11:26
*** pcaruana has quit IRC11:28
*** mbi has joined #openstack-ansible11:28
*** shyam89 has joined #openstack-ansible11:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129211:37
*** strobelight has joined #openstack-ansible11:39
*** kaiokmo has joined #openstack-ansible11:41
*** strobelight_ has joined #openstack-ansible11:41
*** strobelight is now known as Guest5227711:41
*** strobelight_ is now known as strobelight11:42
*** Guest52277 has quit IRC11:45
noonedeadpunkFolks, can you please review this https://review.openstack.org/#/c/610274/ ?11:50
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/rocky: use include_tasks instead of include  https://review.openstack.org/60810511:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon master: Add ability for HTTP access to horizon  https://review.openstack.org/60796911:56
*** vollman has quit IRC11:57
*** shyam89 has quit IRC12:11
*** shyam89 has joined #openstack-ansible12:11
*** shyam89 has quit IRC12:13
*** kstev has joined #openstack-ansible12:13
*** shyam89 has joined #openstack-ansible12:13
*** dave-mccowan has joined #openstack-ansible12:14
*** shyam89 has quit IRC12:18
*** pcaruana has joined #openstack-ansible12:24
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Zuul: Use  openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/60928412:36
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_nova master: Update the pci config for nova.  https://review.openstack.org/60578912:37
openstackgerritMerged openstack/openstack-ansible-os_glance master: Zuul: Use openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/60928712:38
*** hamzaachi has quit IRC12:39
nicolasbockGood morning12:40
*** strattao has joined #openstack-ansible12:41
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Zuul: Use openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/60928812:41
openstackgerritMerged openstack/openstack-ansible-os_designate master: Zuul: Use openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/60928612:42
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] Refactor ceph server playbooks  https://review.openstack.org/61114612:43
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Fix rgw playbook pre_tasks  https://review.openstack.org/61130412:43
jrosserwell there appears to be a certain amount of whoooooops about 61130412:44
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Zuul: Use  openstack-ansible-role-distro_install-jobs template  https://review.openstack.org/60928512:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: Add ability to deploy Octavia load balancer service  https://review.openstack.org/60015512:53
*** kstev has quit IRC12:53
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Distro-install tests for Ubuntu and Centos are voting now.  https://review.openstack.org/61027412:54
strattaoodyssey4me or someone, I’ve got the ec2-api up and running. When I use it to describe regions, it responds and works great. However, when I describe images, or describe instances, it tries to use the public endpoints for both glance and nova respectively and gives me connection errors, that I believe are due to certs not being installed properly. I can look into that workaround, but I’m trying to figure out why it doesn’t use the admin or12:59
strattaointernal endpoints first. Would that be something I’ve setup incorrectly with the ec2api user, a missing role or something?12:59
odyssey4mestrattao: typically you have to tell it which endpoint to use, and we tell all services in the conf file to use the 'internal' endpoint13:00
odyssey4meso it's likely just some missing config13:00
strattaothanks. I’ll keep playing around with the config settings then13:01
strattaojust to confirm, the endpoint setting you are referring to is by specifying the auth_url (like in /etc/glance/glance-api.conf)?13:02
*** chandankumar is now known as chkumar|off13:03
odyssey4mestrattao: it may be something like these: https://github.com/openstack/openstack-ansible-os_nova/blob/master/templates/nova.conf.j2#L244-L24613:04
strattaoyup, sounds good. thx odyssey4me13:04
*** ansmith has joined #openstack-ansible13:14
*** SimAloo has joined #openstack-ansible13:27
openstackgerritMerged openstack/openstack-ansible-os_cinder master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060213:34
openstackgerritMerged openstack/openstack-ansible-os_barbican master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060413:35
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026113:35
openstackgerritMerged openstack/openstack-ansible-os_aodh master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060613:36
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060813:37
hwoarangdoes anyone know what may have changed in stable/rocky and  broke suse like this http://logs.openstack.org/02/610902/1/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/00253bd/job-output.txt.gz#_2018-10-17_12_41_28_672737 ?13:38
hwoarangsounds like requests/cert.py is missing or something13:38
openstackgerritMerged openstack/openstack-ansible-os_glance master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61060713:39
openstackgerritMerged openstack/openstack-ansible-os_designate master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61061013:40
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Add ability for HTTP access to horizon  https://review.openstack.org/60796913:45
*** munimeha1 has joined #openstack-ansible13:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/rocky: Add ability for HTTP access to horizon  https://review.openstack.org/61132214:01
*** cshen has quit IRC14:04
*** rgogunskiy has joined #openstack-ansible14:07
*** chhagarw has quit IRC14:12
*** spatel has joined #openstack-ansible14:20
spateljamesdenton: morning14:20
jamesdenton hi14:20
spatelQuick question, how do you guys manage mix hardware compute node14:21
spatelex. i have 10G and 1G and more memory box all kind of hardware14:21
jamesdentonin my experience, most environments tend to leverage the same hardware/capabilities14:21
jamesdentonbut there is some flexibility14:21
mgariepyhaving different hw can cause some issues14:22
jamesdenton^^ can definitely impact migrations14:22
spatelThat is what i am struggling with14:22
jamesdentonwhat in particular?14:22
mgariepyif you don't need live migration it might be ok-ish. but that really depend on your usecase14:23
spatelWe have private cloud so its not for customer and trying to figure out how should i manage mix hardware14:23
spatelI don't need Live migration because we hare using most of time SR-IOV compute node14:23
jamesdentonwell maybe you're better off making multiple aggregates based on groupings of similar hardware14:24
spatelTrying to understand how should i layout flavor and groups to target them...14:24
spatelCurrently i have created AZ-10G & AZ-1G and AZ-Mem  Host aggregates14:25
spatelI am using availability zone for grouping in short... ;)14:25
spateli don't know what is the best practice out there which mostly people follow14:26
jamesdentonhard to say, really. i bet if you asked 20 people you'd get 20 answers14:27
spatelalso i have create small 30 compute node AZ-Live for only live migration instance (whoever need more reliability )14:27
jamesdentonif what you're doing works for you, then it's OK14:27
spatelHmm! i totally understand there is no hare written answer for this kind of question14:28
spatelI think i continue what i am doing and someday i may find holy grill to make it easy14:28
spatelI have notice block migration also not bad.. its slow but it does work14:30
*** openstackgerrit has quit IRC14:36
*** noonedeadpunk[m] has joined #openstack-ansible14:40
*** logan_ has joined #openstack-ansible14:40
*** hamzy has quit IRC14:41
*** noonedeadpunk_ has joined #openstack-ansible14:43
*** noonedeadpunk_ has left #openstack-ansible14:43
*** noonedeadpunk_ has joined #openstack-ansible14:43
*** openstackgerrit has joined #openstack-ansible14:44
openstackgerritAlex Redinger proposed openstack/openstack-ansible-os_keystone master: Add memcache flushing handler on db migrations  https://review.openstack.org/60806614:44
*** noonedeadpunk[m] has quit IRC14:45
*** kstev has joined #openstack-ansible14:47
*** munimeha1 has quit IRC14:49
*** nicolasbock has quit IRC14:49
*** logan- has quit IRC14:49
*** bgmccollum has quit IRC14:49
*** noonedeadpunk has quit IRC14:49
*** logan_ is now known as logan-14:49
*** cshen has joined #openstack-ansible14:50
*** jbadiapa has quit IRC14:52
*** jbadiapa has joined #openstack-ansible14:53
*** weezS has joined #openstack-ansible14:56
*** noonedeadpunk_ has quit IRC14:57
*** noonedeadpunk_ has joined #openstack-ansible14:57
noonedeadpunk_folks, I've got disconnected from freenode with my main nickname. As it was still appearing as online, I've tried to RELEASE it. Now freenode says, that my nickname is just unavailable. Probably someone faced with such problems and may point me to some doc or some direction14:59
*** ansmith has quit IRC15:01
*** noonedeadpunk_ is now known as noonedeadpunk15:02
openstackgerritMerged openstack/openstack-ansible-os_neutron master: releasenotes: oslo-messaging-separate-backends add project name  https://review.openstack.org/61061115:03
noonedeadpunkok, it seems, that I've resolved the problem)15:04
*** noonedeadpunk has quit IRC15:05
*** larsks has joined #openstack-ansible15:05
*** noonedeadpunk has joined #openstack-ansible15:05
*** larsks has left #openstack-ansible15:05
*** rgogunskiy has quit IRC15:07
jrosserodyssey4me: bionic/ceph passes https://review.openstack.org/#/c/611146/15:10
mgariepyafter many many recheck it seems to passes , can we merge this one please ? https://review.openstack.org/#/c/605789/15:10
noonedeadpunkFolks, and what do you think about this thing on the summit? https://www.openstack.org/summit/berlin-2018/summit-schedule/events/22736/rsvp-required-from-day-1-to-day-2-to-day-1000-practical-openstack-deployment-and-operations-with-openstack-ansible Is it worth wisiting?15:11
*** hamzy has joined #openstack-ansible15:12
*** kaiokmo has quit IRC15:12
*** pvradu has quit IRC15:12
odyssey4menoonedeadpunk: You'll meet cloudnull and I there - we're helping fghaas for the day. :)15:13
*** ansmith has joined #openstack-ansible15:15
noonedeadpunkodyssey4me: so is it designed for newbies or it will be interesting even for folks with some basics (not the strongest ones, but like mine)? As it will take full day, with tons of interesting activities...15:17
odyssey4menoonedeadpunk: I've never attended one, but Florian is very knowledgeable. However, it is a whole day so you might want to rather focus on spreading yourself around - but popping in in between things to listen in the back.15:18
noonedeadpunkodyssey4me: got you, thanks:)15:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Clean up role tests  https://review.openstack.org/61135915:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/rocky: Clean up role tests  https://review.openstack.org/61136115:25
*** blinkiz has quit IRC15:26
*** cshen has quit IRC15:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: Clean up role tests  https://review.openstack.org/61136215:28
*** mardim has quit IRC15:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Clean up role tests  https://review.openstack.org/61136415:30
*** ansmith has quit IRC15:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Remove wsrep-new-cluster from cluster.cnf  https://review.openstack.org/61099215:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Enable the xinetd service for reboot  https://review.openstack.org/60577815:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Allow configuration of startup timeout  https://review.openstack.org/60499915:34
*** fghaas has quit IRC15:34
*** cshen has joined #openstack-ansible15:37
*** hamzaachi has joined #openstack-ansible15:38
*** fghaas has joined #openstack-ansible15:39
*** macza has joined #openstack-ansible15:39
fghaasnoonedeadpunk: I get far more praise from odyssey4me there than I deserve :)15:40
fghaasbut yes, worth visiting if you'll accept that I'm clearly biased15:40
*** smoke87 has quit IRC15:41
*** cshen has quit IRC15:43
*** ansmith has joined #openstack-ansible15:43
*** vnogin has joined #openstack-ansible15:43
noonedeadpunkfghaas: I believe that it's all true:) So then I have double check the schedule for to free up the first day15:44
noonedeadpunks/first/last/15:46
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122615:48
*** vnogin has quit IRC15:48
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Switch to using file-backed VM's only  https://review.openstack.org/60911015:49
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Use the OSA inventory and plugins where possible  https://review.openstack.org/61127915:50
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Remove verbose output for bootstrap  https://review.openstack.org/61128315:52
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Remove duplicated vm_servers group creation  https://review.openstack.org/61128815:52
openstackgerritMerged openstack/openstack-ansible-ops master: MNAIO: Copy SSH keys into containers if they are present  https://review.openstack.org/61129215:52
*** hamzaachi has quit IRC15:55
*** smoke87 has joined #openstack-ansible15:55
*** shardy has joined #openstack-ansible16:01
*** hamzy has quit IRC16:01
*** hamzy has joined #openstack-ansible16:01
spatelI have flavor and i want to change vPCU number is it possible to do that ?16:03
fghaasnoonedeadpunk: right. You could just be there the morning and then sneak out to go see something else in the afternoon, but doing so wouldn't exactly be nice to a person that does want to spend the whole day and whose seat you might be taking.16:06
*** nsmeds__ has joined #openstack-ansible16:06
fghaasSo do choose wisely, and if you have something super interesting to see either half of the day, you might want to look at https://academy.citycloud.com/courses/course-v1:citycloud+cc201+201810/about instead16:07
*** cshen has joined #openstack-ansible16:07
fghaasHowever, we'll also be very happy to have you in the room, just to be crystal clear about that. :)16:08
*** priteau has joined #openstack-ansible16:08
noonedeadpunkfghaas: yeah, I know it, that's why I decided to ask whether there's a sence to take part for a person, who is familiar with OSA and already deploy with it16:08
odyssey4mecores, I'd appreciate some reviews for https://review.openstack.org/#/q/I7d1f07878dba7d21aecd59fa75e9117b50b886e6 - the broken upgrade tests are preventing other patches frommerging in pike especially16:08
noonedeadpunkAs I don't want to take someone's place but really interesnted in the event16:09
fghaasyou can also come to my Kubernetes tutorial that I'm doing with Tyler from Rackspace, there's no OSA there but at least you'll be interacting with an OSA-deployed Magnum :)16:10
fghaass/my/the/16:13
noonedeadpunkfghaas: to be honest - I was also very interested in it, but there are really interesting sessions both in the morning and in the evening16:14
fghaasclassic Summit problem16:14
noonedeadpunkyeah. And the problem starts, when there are monre than 3 cool sessions at the same time...16:17
noonedeadpunkI'd wish such tutorials being held the day before/after main event...16:20
goldenfrispatel no, the the horizon people told me that the nova people removed the ability to edit flavors because it didn't actually work16:24
*** munimeha1 has joined #openstack-ansible16:24
*** nicolasbock has joined #openstack-ansible16:24
spatelgoldenfri: thanks for confirmation! also i didn't find any single doc related that to edit directly.. I have deleted flavor and re-created16:25
*** fghaas has quit IRC16:32
*** jbadiapa has quit IRC16:33
*** strattao has quit IRC16:39
*** strattao has joined #openstack-ansible16:40
*** strattao has quit IRC16:41
*** shardy has quit IRC16:41
*** strattao has joined #openstack-ansible16:43
*** jbadiapa has joined #openstack-ansible16:47
*** strattao has quit IRC16:53
*** kaiokmo has joined #openstack-ansible16:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Ensure that the flavor/network facts are available to all targets  https://review.openstack.org/61138916:54
*** jbadiapa has quit IRC16:55
openstackgerritNicolas Bock proposed openstack/openstack-ansible-os_octavia master: Fix updating amphora images  https://review.openstack.org/61139317:01
nicolasbockI think I fixed my problem with octavia's image update playbook (https://review.openstack.org/#/c/611393/)17:02
nicolasbockxgerman_ (IRC): Could you have a look?17:02
* xgerman_ reading scrollback17:03
openstackgerritMichael Vollman proposed openstack/openstack-ansible-ops master: Add vars to configure prometheus module  https://review.openstack.org/61139417:04
*** vollman has joined #openstack-ansible17:04
odyssey4menicolasbock: yep, that looks right - great catch!17:05
odyssey4menicolasbock: oh, you might have to use openstack_image[0].id17:06
odyssey4mebecause the facts module returns a list, I think17:06
*** hamzy has quit IRC17:07
*** hamzy has joined #openstack-ansible17:08
xgerman_nicolasbock: we use the same name for all images — so the id is in reality the name?17:08
odyssey4mexgerman_: the ID must be used, because we want to delete the previous image of the same name17:09
odyssey4meif we delete by name, we'd be deleting both the old and new one17:09
odyssey4meby deleting the old after uploading the new, octavia can still deploy while that process is happening17:09
xgerman_my question is more: https://docs.ansible.com/ansible/2.6/modules/os_image_module.html says name is the image name and not id17:10
xgerman_but you give name the is from before… so wonder if we need to issue both?17:10
*** hamzy has quit IRC17:12
odyssey4megood question - I thnk the shade library will use name or ID - let's take a peek17:12
*** hamzy has joined #openstack-ansible17:12
odyssey4mexgerman_ nicolasbock for ansible 2.5 (rocky/stein), 'name' needs to be provided for the image delete function, but it will accept an id for the name: https://github.com/ansible/ansible/blob/stable-2.5/lib/ansible/modules/cloud/openstack/os_image.py#L19517:15
*** fghaas has joined #openstack-ansible17:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests master: Convert test network setup to use the networkd role  https://review.openstack.org/59259617:20
nicolasbockYes, the documentation is a bit confusing17:22
xgerman_who is submitting that fix?17:22
nicolasbockI verified that it works with the `name` key and the `id` as value17:22
odyssey4menicolasbock: did it work without using openstack_image[0].id instead of openstack_image.id ?17:24
odyssey4memy env is hanging due to too many processes :/17:24
cloudnullprometheanfire -> https://review.openstack.org/59259617:24
nicolasbockxgerman_ (IRC): I have to look at the module source to answer that. I'll do that.17:24
nicolasbockAnd what fix?17:24
xgerman_fix to the od_image docs17:25
xgerman_:-)17:25
odyssey4meI'll be happy to do that if no-one else wants to.17:26
odyssey4meI might be wrong, but it looked to me like 'id' is not actually even used.17:26
*** tosky__ has joined #openstack-ansible17:26
maczahey i know this is out of the openstack ansible scope but hoping i could get some help, in case someones run into this.  im running ocata using nova with ceph, a compute hypervisor crashed and now all the instances wont connect to their drives after bringing the hypervisor back up17:27
*** tosky has quit IRC17:27
nicolasbockxgerman_ (IRC): I am on it :)17:27
xgerman_:-17:27
xgerman_017:27
*** kstev has quit IRC17:28
nicolasbockxgerman_ (IRC): The thing with using both `name` and `id` was that the module errors out saying that there are multiple images with that name (I had two amphora images at the time)17:28
*** tosky__ is now known as tosky17:28
xgerman_ok, makes sense… tose modules really need to be documented17:28
odyssey4menicolasbock: hmm, perhaps that delete action should loop through the list17:28
nicolasbockAh, good point17:29
nicolasbockodyssey4me: I think you are right about the modules and its use of `id` and `name`. It's a little confused I think. It sometimes uses the `name` and sometimes the `id`. I am still trying to decipher how exactly though...17:30
nicolasbockSorry no, it's not using the `id` at all :(17:31
odyssey4meit seems to be to return id in the facts, but it never uses the module parameter17:31
nicolasbockBut it's using the `name` in `cloud.name_or_id` which seems to explain why it works with `name = id`17:31
odyssey4meI'm not entirely sure why you'd ever want to use id when you could put id into the name parameter.17:31
logan-macza: check the auth caps for the cephx key that nova is using, ensure that it has the "osd blacklist" capability under mon17:32
nicolasbockxgerman_ (IRC): one fix: https://github.com/ansible/ansible/pull/4721817:32
nicolasbockodyssey4me: good point17:32
odyssey4methe commit doesn't say why either :/ https://github.com/ansible/ansible/commit/de5fb8d98c40ad806420187bbf87fd3f642d784617:34
logan-macza: or better, use the rbd profile so you don't have to end up in this situation next time the required rbd auth caps change :) make your caps look something like: http://paste.openstack.org/show/732352/17:34
odyssey4menicolasbock: I guess when uploading an image, an ID can be set. I didn't know that glance allowed that, but meh. That's fine.17:35
nicolasbockYes, me neither17:36
*** DanyC has quit IRC17:36
nicolasbockSeems kind of wrong to set and ID :)17:36
nicolasbockBut the documentation should really explain that the `name` can also be an `id`.17:37
maczalogan- thanks a bunch 'll try that17:37
spotznicolasbock: I think that might be a holdover from when the project clients mainly used UUID vs Names, but ID is now sometimes used interchangeably in the help and docs17:38
nicolasbockYes, good point spotz (IRC)17:39
odyssey4menicolasbock: yeah, it should say something like 'The ID of the image when uploading an image' for the 'id' parameter. And for the 'name' parameter it should say something like 'The name of the image when uploading - or the name/ID of the image if deleting'17:39
nicolasbockThanks odyssey4me I'll use that in my PR :)17:39
odyssey4menicolasbock: you're welcome :)17:40
maczahey logan- shoudl i just reboot nodes after that change?17:42
nicolasbockhttps://github.com/ansible/ansible/pull/4722217:42
*** strattao has joined #openstack-ansible17:45
*** macza has quit IRC17:52
*** macza has joined #openstack-ansible17:52
prometheanfirecloudnull: nice, watching it17:55
*** kstev has joined #openstack-ansible17:56
*** kstev has quit IRC18:00
logan-macza: I don't think you should need to, probably just reboot the instances18:03
*** jbadiapa has joined #openstack-ansible18:06
*** electrofelix has quit IRC18:14
odyssey4melogan-: could you review this if you have a moment? https://review.openstack.org/61099218:16
logan-yep.. is this only needed on pike?18:18
odyssey4melogan-: yep, it seems so - we're not hitting the same issues any later18:18
odyssey4melogan-: I think it's because we basically rewrote the role in queens18:19
logan-ah ok18:20
*** hamzaachi has joined #openstack-ansible18:20
*** jbadiapa has quit IRC18:21
*** fghaas has quit IRC18:23
*** bgmccollum has joined #openstack-ansible18:23
nicolasbockI am getting lots of errors like "ERROR nova.console.websocketproxy error: [Errno 32] Broken pipe" in an AIO based on master. Is that a known issue in Nova?18:25
mgariepyanyone have a minute to review this one ? odyssey4me cloudnull ? :D https://review.openstack.org/#/c/605789/18:35
noonedeadpunkfolks, what to do, if run-upgrade.sh failed at one step? Is it safe to launch it one more time, or it's better to proceed with manual upgrade since failure step?18:40
odyssey4menoonedeadpunk: you can run it again, it tracks where it was18:41
odyssey4meif it doesn't work, then that's a bug which we should fix18:41
noonedeadpunkoh, that's great18:41
odyssey4memgariepy: any chance you could review https://review.openstack.org/#/q/I7d1f07878dba7d21aecd59fa75e9117b50b886e6 ?18:41
*** vnogin has joined #openstack-ansible18:42
mgariepysure give me a sec18:42
noonedeadpunkIt failed on nova console setup with http://paste.openstack.org/show/732358/18:42
noonedeadpunkbut this commit exists, so it' strange why it failed. Probably I should clean facts like evrardjp suggested several days before18:43
mnaseri'm sorry for not being able to keep up with everything18:47
mnaseri'll do my best to do a catch up sprint later this week18:48
odyssey4memnaser: it's not all on you, sir - we're all in this together :)18:48
cloudnull++18:48
mnaseri've wanted to check off some of the things we talked about at the ptg18:50
mnaserthank you odyssey4me and cloudnull18:50
mnaserhttps://review.openstack.org/#/c/610311/ is an increased coverage if everyone is ok with it18:50
prometheanfirehttps://i.imgur.com/UqbcYt2.jpg18:51
odyssey4meit'd be nice to get eyes on this backport too https://review.openstack.org/61036318:51
mnaserodyssey4me: got it18:52
*** ram5391 has joined #openstack-ansible18:56
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add osquery testing  https://review.openstack.org/61122618:58
ram5391Is there a flag that is supposed to be set in the config to tell ansible to test against https keystone, and not http?18:58
ram5391I tried setting: keystone_service_publicuri_proto: https and openstack_service_publicuri_proto: https, but my deployment is failing because it can't get to the http endpoint (https) is working fine18:59
odyssey4meram5391:  that was recently fixed in master, and the backport is pending review19:04
odyssey4mehttps://review.openstack.org/61132219:04
odyssey4meram5391: oh, I misread - by default keystone's public endpoint is https and internal endpoint is http19:05
odyssey4mewhat exactly are you trying to do?19:05
ram5391odyssey4me I'm just trying to execute setup-hosts.yml. it fails on the "waiting for services to be up" because it's checking http://x.x.x.x:5000 and nothing is answering19:10
ram5391I haven't mucked with the haproxy or default os-keystone files19:10
ram5391weirdly then my public endpoint https is working fine, and my private is not. They're both on the same network, and I used the same IP for both19:11
noonedeadpunkodyssey4me: my problem was mostly related with network lag in DC, as git pull and git checkout after it worked.19:14
odyssey4meram5391: then something must have failed earlier in the play, or something is misconfigured19:19
odyssey4meram5391: also, setup-hosts doesn't do anything that would do a port check for port 5000 - that would be the keystone play which is well beyond setup-hosts19:20
*** fghaas has joined #openstack-ansible19:21
*** hamzy has quit IRC19:21
*** hamzy has joined #openstack-ansible19:21
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Clean up role tests  https://review.openstack.org/61136419:22
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Allow configuration of startup timeout  https://review.openstack.org/60499919:23
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Enable the xinetd service for reboot  https://review.openstack.org/60577819:23
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Remove wsrep-new-cluster from cluster.cnf  https://review.openstack.org/61099219:23
openstackgerritMerged openstack/openstack-ansible-galera_server stable/queens: Clean up role tests  https://review.openstack.org/61136219:23
ram5391odyssey4me sorry, you're correct. I misstyped, its the setup-openstack.yml playbook that fales19:23
ram5391fails* hosts and infrastructure execute 100% succesfully19:24
odyssey4meram5391: I would suggest inspecting why the keystone service failed to start rather than trying to add more overrides19:24
ram5391and I'm following the hosts -> infrastructure -> openstack order19:24
ram5391odyssey4me thats just it, it doesn't fail to start. I can get to https://x.x.x.x:5000 totally fine.19:25
odyssey4meram5391: good, but if keystone is failing to respond then everything else will fail - identify why it failed and resolve that19:25
odyssey4meok, in that case you need to look more carefully at the failed task result, perhaps with debug output19:26
odyssey4meIIRC the task does a localhost port check19:26
ram5391can't I configure both public and private endpoints to interact with keystone on https? The weird thing is that haproxy and keystone are on the same machine. I looked at haproxy to see if maybe it wasn't listening to http requests, but I'm not familiar enough with haproxy to make sense of it. It _looks_ like the config might be setup to not allow localhost to talk to http?19:28
odyssey4meram5391: you should be able to, but it's not recommended because the certs used are self-signed - you'd need real certs, and even then it's not a well tested path19:29
ram5391this is the full log output: http://paste.openstack.org/show/732377/19:29
ram5391the machine I'm running the playbooks on, is the same machine that haproxy, keystone and all the other core services are on19:30
odyssey4meram5391: also, they're not on the same machine - haproxy is acting as a front-end and forwarding to a container which is a wholly separate 'machine'19:30
*** hamzy has quit IRC19:30
odyssey4meit may be on the same host, but they are not the same machine19:30
ram5391odyssey4me touche, but the containers are all picking up IP's on the same /16 that the host is configured with19:31
odyssey4meram what release/branch is this?19:31
ram5391checking now19:31
odyssey4mealso, what is the failed task's name - the log you posted doesn't show the name of the task19:32
ram5391odyssey4me I'm pulling master at: 3e458a8ef2d8b3ba3a94aee8de6427ca203b6c3119:35
ram5391and its failing at this task: TASK [os_keystone : Wait for services to be up]19:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update galera_server SHA to include cluster fixes  https://review.openstack.org/61141919:36
*** strattao has quit IRC19:37
odyssey4meram5391: ok, are you intending to pull master - because that's always going to be in a varying state19:37
ram5391I tried pulling stable/rocky, but was having issues with that too. Since you said that got fixed in master, I'll try pulling again and see if its still an issue19:38
*** strattao has joined #openstack-ansible19:38
*** macza has quit IRC19:43
*** macza has joined #openstack-ansible19:44
odyssey4meram5391: switching back and forth is also not a good idea19:46
odyssey4merocky is released and stable19:46
*** fghaas has quit IRC19:46
odyssey4mesome more fixes are trickling in, but it's in a generally good working state19:46
odyssey4meram5391: are you trying, perhaps, to use the same ip for the internal and external LB addresses?19:47
ram5391odyssey4me understandable, I am in fact19:47
maczathanks logan- you're a lifesaver19:47
odyssey4meram5391: just don't do that - it does not work because http and https cannot listen on the same port19:47
odyssey4meram5391: keep them separate19:48
*** fghaas has joined #openstack-ansible19:48
odyssey4meram5391: once https://review.openstack.org/#/c/611322/ is merged (whenever that happens) and is available in a release, you might be able to have them both on the same IP - but I wouldn't bet on it... just use different IP's19:48
*** strattao has quit IRC19:48
ram5391ah, that makes sense. But I can have another vif on the same nic and still be okay right? as long as its another IP?19:49
odyssey4meram5391: yep, they can just be secondary IP's - if you could have keepalived bind them for you if you like19:49
*** vnogin has quit IRC19:50
ram5391odyssey4me ah okay awesome, that makes sense then. I'll add another vif to my headnode interface, add the new IP and try again. Thank you! Will report back19:51
*** vnogin has joined #openstack-ansible19:51
*** spatel has quit IRC19:53
*** jbadiapa has joined #openstack-ansible20:02
odyssey4meram5391: good luck!20:04
*** fghaas has quit IRC20:06
*** hamzy has joined #openstack-ansible20:17
*** DanyC has joined #openstack-ansible20:33
*** fghaas has joined #openstack-ansible20:46
openstackgerritAntony Messerli proposed openstack/openstack-ansible stable/pike: Stop MariaDB nodes to reset quorum during upgrade  https://review.openstack.org/61143820:52
*** fghaas has quit IRC20:53
*** vnogin has quit IRC20:57
*** ansmith has quit IRC21:02
*** kaiokmo has quit IRC21:24
*** olivierb has quit IRC21:30
*** cshen has quit IRC21:42
*** priteau has quit IRC21:50
*** SimAloo has quit IRC21:53
*** hamzaachi has quit IRC21:58
logan-macza: no prob glad it worked!22:18
*** munimeha1 has quit IRC22:20
*** DanyC has quit IRC22:54
openstackgerritMerged openstack/openstack-ansible-galera_server stable/rocky: Clean up role tests  https://review.openstack.org/61136122:56
*** weezS has quit IRC23:01
*** nsmeds__ has quit IRC23:08
*** rgogunskiy has joined #openstack-ansible23:09
*** rgogunskiy has quit IRC23:13
openstackgerritMerged openstack/openstack-ansible-galera_server master: Clean up role tests  https://review.openstack.org/61135923:13
*** ram5391 has quit IRC23:15
*** macza has quit IRC23:17
*** tosky has quit IRC23:17
*** lbragstad is now known as lbragstad_50323:26
*** cshen has joined #openstack-ansible23:38
*** cshen has quit IRC23:42
*** DanyC has joined #openstack-ansible23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!