Thursday, 2015-03-12

*** jmccrory has joined #openstack-ansible00:17
*** jmccrory has quit IRC00:17
*** jmccrory has joined #openstack-ansible00:20
*** jmccrory has quit IRC00:20
*** ccrouch is now known as ccrouch-biab00:21
*** ccrouch-biab is now known as ccrouch00:36
bgmccollumandymccr: dropping replication_network fixes my problem (since i dont have a dedicated replication_network). but if replication_network is defined and is the same value as storage_network, the *-server-replication.conf files don't get dropped. This seems to have been fixed in master. Thanks again...00:38
*** vmtrooper has joined #openstack-ansible00:41
*** vmtrooper has quit IRC00:46
*** jmccrory has joined #openstack-ansible00:47
*** ccrouch is now known as ccrouch-bbl00:50
*** jmccrory has quit IRC00:52
*** jmccrory has joined #openstack-ansible00:53
*** sigmavirus24 is now known as sigmavirus24_awa01:19
*** markvoelker has quit IRC01:27
*** markvoelker has joined #openstack-ansible01:27
*** markvoelker has quit IRC01:32
*** sdake_ has quit IRC01:42
*** ccrouch-bbl is now known as ccrouch01:52
*** vmtrooper has joined #openstack-ansible02:30
*** vmtrooper has quit IRC02:35
*** jmccrory has quit IRC02:38
*** sdake_ has joined #openstack-ansible02:48
*** jmccrory has joined #openstack-ansible02:53
*** jmccrory has quit IRC02:53
*** jmccrory has joined #openstack-ansible02:53
*** sdake_ has quit IRC03:38
*** jmccrory has quit IRC03:47
*** docaedo has joined #openstack-ansible04:08
*** sdake_ has joined #openstack-ansible04:08
*** vmtrooper has joined #openstack-ansible04:19
*** vmtrooper has quit IRC04:24
*** devlaps has quit IRC04:25
*** sdake__ has joined #openstack-ansible04:55
*** sdake_ has quit IRC04:58
*** sdake__ has quit IRC05:08
*** alextricity has quit IRC05:09
*** galstrom_zzz has quit IRC05:09
*** alextric_ has joined #openstack-ansible05:09
*** raginbajin has quit IRC05:09
*** galstrom_zzz has joined #openstack-ansible05:10
*** raginbajin has joined #openstack-ansible05:13
*** britthouser has joined #openstack-ansible05:16
*** britthouser has quit IRC05:19
*** britthouser has joined #openstack-ansible05:24
*** markvoelker has joined #openstack-ansible05:25
*** markvoelker has quit IRC05:30
*** britthouser has quit IRC05:34
*** britthouser has joined #openstack-ansible05:40
*** britthouser has quit IRC05:46
*** britthouser has joined #openstack-ansible05:50
*** sdake_ has joined #openstack-ansible06:02
*** sdake__ has joined #openstack-ansible06:04
*** sdake_ has quit IRC06:08
*** vmtrooper has joined #openstack-ansible06:08
*** sdake_ has joined #openstack-ansible06:10
*** vmtrooper has quit IRC06:13
*** sdake__ has quit IRC06:13
*** sdake__ has joined #openstack-ansible06:14
*** sdake_ has quit IRC06:18
*** markvoelker has joined #openstack-ansible06:26
*** markvoelker has quit IRC06:32
*** sdake_ has joined #openstack-ansible06:37
*** sdake__ has quit IRC06:41
*** sdake__ has joined #openstack-ansible06:58
*** sdake_ has quit IRC07:02
*** sdake__ has quit IRC07:08
*** stevemar has quit IRC07:22
*** markvoelker has joined #openstack-ansible07:28
*** markvoelker has quit IRC07:33
*** sdake_ has joined #openstack-ansible07:42
*** sdake_ has quit IRC07:49
*** sdake has joined #openstack-ansible07:56
*** vmtrooper has joined #openstack-ansible07:57
*** vmtrooper has quit IRC08:02
*** markvoelker has joined #openstack-ansible08:29
*** markvoelker has quit IRC08:34
openstackgerritHugh Saunders proposed stackforge/os-ansible-deployment: Revert "Trim ansible's output to console.log"  https://review.openstack.org/16298408:38
*** sdake__ has joined #openstack-ansible08:54
*** sdake has quit IRC08:57
openstackgerritgit-harry proposed stackforge/os-ansible-deployment: Test commit - do not review  https://review.openstack.org/16167009:21
*** nosleep77 has quit IRC09:30
*** markvoelker has joined #openstack-ansible09:30
*** markvoelker has quit IRC09:35
*** vmtrooper has joined #openstack-ansible09:45
*** vmtrooper has quit IRC09:51
openstackgerritMerged stackforge/os-ansible-deployment: Set backend_alg for swift_proxy to source  https://review.openstack.org/16296709:59
openstackgerritMerged stackforge/os-ansible-deployment: Fix the br-vlan mode in the example interfaces  https://review.openstack.org/16304810:00
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Revert "Trim ansible's output to console.log"  https://review.openstack.org/16298410:15
openstackgerritAndy McCrae proposed stackforge/os-ansible-deployment: Set container_networks to a dict rather than None  https://review.openstack.org/16308310:31
*** markvoelker has joined #openstack-ansible10:31
*** markvoelker has quit IRC10:36
openstackgerritMerged stackforge/os-ansible-deployment: Create external address setting for maas checks  https://review.openstack.org/16273410:48
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Update contributing guidelines with backport guidance  https://review.openstack.org/16376411:08
openstackgerritMerged stackforge/os-ansible-deployment: Fix the br-vlan mode in the example interfaces  https://review.openstack.org/16304411:10
openstackgerritMerged stackforge/os-ansible-deployment: Remove unused external_vip_address reference  https://review.openstack.org/16323811:12
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Create ansible log file and directory  https://review.openstack.org/16377011:22
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Create ansible log file and directory  https://review.openstack.org/16377211:22
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16377511:29
*** markvoelker has joined #openstack-ansible11:33
*** vmtrooper has joined #openstack-ansible11:34
*** markvoelker has quit IRC11:37
*** vmtrooper has quit IRC11:39
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Ensure get-pip.py is retrieved properly  https://review.openstack.org/16218311:41
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Revert "Trim ansible's output to console.log"  https://review.openstack.org/16298411:43
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Enable network basic ops tests  https://review.openstack.org/16354411:44
*** galstrom_zzz is now known as galstrom11:54
openstackgerritgit-harry proposed stackforge/os-ansible-deployment: WIP: Testing hash_behaviour  https://review.openstack.org/16298912:02
*** markvoelker has joined #openstack-ansible12:15
*** sdake has joined #openstack-ansible12:23
*** sdake__ has quit IRC12:23
openstackgerritAndy McCrae proposed stackforge/os-ansible-deployment: Set container_networks to a dict rather than None  https://review.openstack.org/16308312:35
odyssey4mehughsaunders odd, the ansible logging actually works - check the console output here: https://review.openstack.org/16377512:36
odyssey4menote that in the review I changed the method of doing the processing - perhaps that's made the difference12:36
*** galstrom is now known as galstrom_zzz12:37
hughsaundersodyssey4me: I thought it was odd that run-playbooks was sourced rather than executed previously12:38
hughsaundersmaybe we should hold off on the revert and see if your patch fixes logging for other runs also..12:38
odyssey4mehughsaunders the library is the only one that actually needs sourcing - all the other scripts can be run via bash12:44
*** sdake has quit IRC12:48
*** sdake has joined #openstack-ansible12:49
openstackgerritgit-harry proposed stackforge/os-ansible-deployment: Test commit - do not review  https://review.openstack.org/16167012:50
matttodyssey4me hughsaunders : we're going to have to bump tempest sha :P  https://bugs.launchpad.net/openstack-ansible/+bug/143105213:06
openstackLaunchpad bug 1431052 in openstack-ansible "Swift failures with upgrade to tempest 7c73dd5" [Undecided,New]13:06
hughsaundersmattt:  ok13:06
odyssey4memattt fair enough - we'll have to bump both juno and master then, but test with master first obviously13:17
odyssey4meis there a minimum change sha that we can bump to - or should we bump to whatever the current sha is?13:17
odyssey4meie shall we be conservative, or hold on to our pants?13:18
andymccrsurely holding onto your pants would be a conservative move regardless :D13:18
*** stevemar has joined #openstack-ansible13:18
odyssey4mehaha13:19
matttodyssey4me: i worked out where it broke and was fixed, so to be conservative we can either go to the sha before it broke or the one after it was fixed13:19
matttprobably better to bump forward13:19
odyssey4meafter fixed, I think13:20
odyssey4mebefore broke would take us to older than the current sha, right?13:20
matttodyssey4me: yep, i'll change to go to after13:22
andymccrhughsaunders: did we change the subset of tempest tests for commit_multinode?13:23
*** vmtrooper has joined #openstack-ansible13:23
matttandymccr: b8c2d7c13:24
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Change testr to run in serial  https://review.openstack.org/16380713:26
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Change testr to run in serial  https://review.openstack.org/16380813:27
hughsaundersandymccr: no13:27
andymccrhughsaunders: yeh it was the forbidden stuff that mattt ran into just for keystone and not swift13:27
andymccrbut the sha worked perfectly13:28
andymccrso looks good13:28
andymccrcommit_multinode worked end ot end13:28
*** vmtrooper has quit IRC13:29
matttandymccr: ok going to put a change through for that now13:29
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16380913:32
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16381013:32
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16380913:35
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16381013:36
openstackgerritMatt Thompson proposed stackforge/os-ansible-deployment: Bump tempest sha  https://review.openstack.org/16381513:38
*** sigmavirus24_awa is now known as sigmavirus2413:51
openstackgerritMerged stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16377514:11
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16380914:15
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Change testr to run in serial  https://review.openstack.org/16380714:15
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Simplify and improve bootstrap/gate/run scripts  https://review.openstack.org/16383714:15
*** KLevenstein has joined #openstack-ansible14:20
*** Mudpuppy has joined #openstack-ansible14:22
*** Mudpuppy has quit IRC14:22
*** Mudpuppy has joined #openstack-ansible14:24
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Simplify and improve bootstrap/gate/run scripts  https://review.openstack.org/16384614:32
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Create ansible log file and directory  https://review.openstack.org/16377014:42
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Create ansible log file and directory  https://review.openstack.org/16377214:45
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Adjust method for trimming ansible output debug information  https://review.openstack.org/16381014:50
openstackgerritMatt Thompson proposed stackforge/os-ansible-deployment: Bump tempest sha  https://review.openstack.org/16381514:55
*** BjoernT has joined #openstack-ansible15:00
*** alextric_ is now known as alextricity15:10
*** vmtrooper has joined #openstack-ansible15:12
*** erikmwilson has quit IRC15:13
*** erikmwilson has joined #openstack-ansible15:13
*** erikmwilson_ has joined #openstack-ansible15:13
*** vmtrooper has quit IRC15:17
*** jwagner_away is now known as jwagner15:20
openstackgerritMerged stackforge/os-ansible-deployment: Enable network basic ops tests  https://review.openstack.org/16354415:29
*** daneyon_ has joined #openstack-ansible15:39
*** daneyon has quit IRC15:42
sdakemorning15:45
sigmavirus24morning sdake15:46
-sigmavirus24- Meeting in 14 minutes in #openstack-meeting-415:47
*** nermik has joined #openstack-ansible15:57
cloudnullping odyssey4me16:05
odyssey4mecloudnull yebo?16:05
cloudnullmeetings times16:05
cloudnullgit-harry meeting time16:10
openstackgerritMerged stackforge/os-ansible-deployment: Set container_networks to a dict rather than None  https://review.openstack.org/16308316:12
*** jmccrory has joined #openstack-ansible16:30
*** daneyon has joined #openstack-ansible16:42
*** daneyon_ has quit IRC16:44
*** vmtrooper has joined #openstack-ansible17:01
ApsuBjoernT: So, a few things. The project does have a load balancing component provided that we use a lot for our testing and dev, https://github.com/stackforge/os-ansible-deployment/blob/master/playbooks/haproxy-install.yml17:01
cloudnullalso if we use haproxy 1.5 we can do ssl within it17:02
ApsuBjoernT: However, that isn't something we support or document for the product that we, rackspace, sell and maintain.17:02
BjoernTapsu: then we need a keepalive component too17:02
cloudnullBjoernT we as in OSAD but not for rax17:02
ApsuBjoernT: I think that's a worthwhile discussion to have.17:02
cloudnullsdake you around ?17:03
Apsuhaproxy-install is minimal effort.17:03
cloudnulli know that you guys we're looking into updating the haproxy bits17:03
ApsuThere are many reasons why we don't want to ship or support it for the product we sell.17:03
BjoernTyes, some customers are using this already in their DC17:03
ApsuBut for our dev needs it was plenty sufficient.17:03
cloudnullis that something that we can look into for the process of testing ssl offloading ?17:03
sdakecloudnull wound me17:03
ApsuBjoernT:  Yes, and we've told them they should not be, and trying hard to not allow/support them if they choose to.17:03
BjoernTYes we know. We fight this every day. From the SSL perspective it would help us to remove all the hard coded stuff and replace it with variables so we can change it easily17:04
sdakecloudnull sorry you possibly didn't get the joke - I often say shoot and wound me when people ping me - what can I do for you17:05
BjoernTThe offloading stuff is a different story, similar to FULL ssl support down to all services17:05
cloudnullhaha. no worries sdake17:05
cloudnullwas just curious if you've had a opportunity to look at our s/w lb roles/plays ?17:05
cloudnulland if you17:05
cloudnullhave done any of the haproxy 1.5 ssl things17:05
sdakeI have spent 10-15 hours analyzing the source base17:05
sdakekeep in mind I have zero ansible experience17:06
cloudnullin master? or in the other branches?17:06
sdakebut it looks pretty solid to me17:06
*** vmtrooper has quit IRC17:06
sdakeI know zero about ssl haproxy17:06
cloudnullkk. was just curious  .17:06
ApsuBjoernT: Separating out these concerns goes like this: A) SSL offloading (haproxy, F5, Apache, Nginx, etc), B) Load Balancing, C) High Availability, D) Endpoint flexibility, E) Project vs Product needs17:07
daneyonI stood up a multi-node cluster using v10. Roughly how many other folks outside of RAX have used osad to deploy a multi node cluster?17:07
sdakealso until after VC ODS my plate is so full I am going to gain weight if I finish :)17:07
palendaedaneyon: That's a great question :p17:07
sdakedaneyon that might be worht a post to the ml to share your experiences17:07
palendaeI know approd0 had, but they're not on right now17:07
Apsusdake: The short version is easy. < 1.5, ssl was a separate binary essentially, that had some performance and behavior issues in some cases. >= 1.5, it's native and seems to be awesome.17:07
ApsuBjoernT: As far as I'm concerned, D all by itself is reasonable and an easy win. I'm happy to help make it go.17:08
odyssey4medaneyon no idea, but I did see someone state that they're doing R&D to do so17:08
ApsuBjoernT: A-C and E are separate concerns and need separate consideration and discussion :)17:08
odyssey4meto be fair, the removal of all the rax bits was only implemented very recently17:08
palendaeodyssey4me: And not even in an actual release yet17:09
palendaeJust master17:09
BjoernT  apsu: Yes that's OK, that's why I asked to slice it up and just start with the removal of the http:// hard coded variables17:09
BjoernTthat helps me the rest is not so much an issue for us since we use SSL on F517:09
daneyonsdake: I am planning on doing a write-up and will post for feedback.17:09
BjoernTBut also telling you that full ssl requirements are coming with big customers who just have HIPAA or PCI requirements17:10
ApsuBjoernT: Sure. For us, that means prioritizing our own dev work and planning around our product needs. Which will of course benefit the project by way of us implementing them.17:11
ApsuBut those types of things may or may not be project priorities, and our public meetings will reflect that. :)17:11
BjoernTPersonally I would like to start tackling SSL stuff before messing with Kilo. But that's my opinion. Without full SSL implementation we can't sell the product to specific customers17:11
ApsuLikewise our public bug triages.17:11
odyssey4meBjoernT that is an issue for the organisation doing the selling. If that organisation wants to prioritise it, then it needs to allocate the resourcing to make it happen.17:13
Apsu^17:13
BjoernTRight I know17:13
odyssey4meI would recommend that you highlight this priority through the appropriate internal paths - otherwise you'll have to wait for someone in the project to take an interest and get it done.17:14
sdakeI dont know enough about ssl to provide any educated opnions17:14
sdakedaneyon any chance you can find out ?17:14
Apsusdake: It's terrible, insufficient, but necessary. And openstack projects are inconsistent with it.17:15
ApsuThat's the elevator pitch. Delightful, really17:15
odyssey4meA simple workaround for anyone at this stage is simply to adjust the endpoints in keystone after the deployment to reflect what's needed. So I don't really see the real problem here.17:15
sdakeapsu our priority for Lamar is likely to be around native packaging support for debuntian and RPM, as well as out-of-band CI/CD/container building17:16
BjoernTodyssey4me: Yeah I got this feeling too, we will talk internally about priorities with the product people. No need to spin here17:16
odyssey4meAFAIK the endpoints are not overridden if they're set. If they are, then we should deal with that as a bug or at least make it a configurable behaviour.17:16
Apsuodyssey4me: The issue is the protocol.17:16
sdakelamar17:16
ApsuThat's purely what Bjoern wants. Make the protocol a variable.17:16
sdakewhere did that come from17:16
sdakeold product name 10 years ago :)17:16
Apsusdake: No idea. I was curious if we were getting a new name for L somehow17:17
Apsulol17:17
sdakeI meant liberty ;-)17:17
ApsuFreedom. 'murica.17:17
daneyonsdake: i'm not completely following. Find out if SSL is a priority?17:17
Apsuodyssey4me: Also, there's no API-ability to update a keystone endpoint URL. You have to add a new one, delete the old one, or mangle the database.17:18
Apsuodyssey4me: It's not that it's impossible, just crufty17:19
sdakethere was a technical question in there17:19
sdakeunfortunately I dont know anything about it to even know what quesiton to ask :)17:19
odyssey4meApsu agreed, but this is hardly a difficult thing to do - unless something's changed recently...17:19
sdakeperhaps someone oculd post a ml q to bring in the broader openstack community expertise17:19
Apsuodyssey4me: No, add/remove isn't difficult to do. But we fix all of this with simply making the protocol variable.17:20
ApsuIt's really not even worthy of discussion. Make variable, set default to http, commit, go.17:20
sdakeapsu wfm :)17:21
ApsuThen deployers can put in https if they've solved all the other SSL parts elsewhere.17:21
odyssey4meApsu sure - code wins... would love to see the patch :)17:21
sdakeat this point i'm just a spectator - but plan to get more engaged in code writing during Liberty17:22
daneyonApsu: Although adding https as a var, I thought OpenStack services performed and scaled poorly when using https instead of http and the recommended approach was SSL offload?17:25
*** britthouser has quit IRC17:26
Apsudaneyon: Setting the endpoint to https doesn't mean the service has to be the SSL endpoint.17:26
daneyonApsu: ^ adding https as a var should be simple....17:26
*** britthouser has joined #openstack-ansible17:26
*** devlaps has joined #openstack-ansible17:26
ApsuIf you use an SSL offloader with service VIPs through some variety of proxy or load-balancer, then the services can listen on http and perform as normal, while the clients will use SSL because the endpoint protocol says https17:26
ApsuThat's how we (RPC) deploy, with F5s as LB/SSL offload17:27
daneyonApsu: I see, you re: to setting the ks endpoints as https.17:27
ApsuYep17:27
BjoernTdaneyon: Do you have more information around that. SSL should not be an issue nowadays17:27
ApsuSuper easy win, solves BjoernT's need, provides a starting point for further SSL work17:27
BjoernTapsu: yess17:27
daneyonBjoernT: I may be 1 or 2 releases behind in my knowledge... it's been a while since I've look into it.17:28
openstackgerritJesse Pretorius proposed stackforge/os-ansible-deployment: Revise gate script library to report correctly  https://review.openstack.org/16391417:28
ApsuLunching!17:29
daneyonApsu: Right about the the service not needing to be the SSL endpoint, it could be offloaded which is what I thought the openstack best practice. I need to do some homework to see if openstack services provide better native ssl support.17:31
odyssey4medaneyon don't waste your time17:33
odyssey4methere's a general view that the native SSL/TLS support is generally best for development testing only17:33
odyssey4meand it's very well founded17:33
daneyonodyssey4me: that's what i recall. So, SSL offload is still the preferred method. If that's what the discussion is about, then +1 from me.17:35
odyssey4mewell, the discussion is more around getting a patch in to allow endpoints to be defined with the HTTPS protocol from the get-go17:35
*** nermik has quit IRC17:36
odyssey4meI think we all agree that SSL offloading is required, but right now within the ansible code we don't make room to define the endpoints using SSL. It has to be done after the initial deployment manually.17:36
odyssey4meWhile this is not hard to do, it's not exactly optimal.17:36
*** nosleep77 has joined #openstack-ansible17:43
*** KLevenstein has quit IRC17:56
cloudnulljust to inject some shinanigans here in master all endpoints have a proto extension that is a default set within all service roles and can be overridden via user_variables.yml17:56
*** KLevenstein has joined #openstack-ansible17:56
cloudnullso if you had ssl offloading on a predefined lb it could be done at deployment with no additional steps.17:57
odyssey4mehaha cloudnull in that case, perhaps the discussion goes around to a backport :p17:57
odyssey4mecould you perhaps make a note in the bug about that being available in master and point to the variable to override? it may give incentive to someone to handle a backport17:58
cloudnullif we backport in juno the variable structure would be radically different.17:58
odyssey4meyeah, but it does change the conversation a bit :)17:59
odyssey4meI gotta run - trainerating.17:59
*** Mudpuppy_ has joined #openstack-ansible18:02
cloudnullsee you later odyssey4me18:02
cloudnullodyssey4me before you bounce do you have a lp bug id # ?18:03
*** galstrom_zzz is now known as galstrom18:04
bgmccollumodyssey4me, Apsu: mental dump - https://etherpad.openstack.org/p/Ansible_Tunable_OpenStack_Configuration_Options18:05
*** Mudpuppy has quit IRC18:06
*** Mudpuppy_ has quit IRC18:06
*** Mudpuppy has joined #openstack-ansible18:07
*** nermik has joined #openstack-ansible18:26
*** vmtrooper has joined #openstack-ansible18:50
*** vmtrooper has quit IRC18:55
*** jmccrory has quit IRC19:20
*** jmccrory has joined #openstack-ansible19:24
*** sigmavirus24 is now known as sigmavirus24_awa19:27
*** sigmavirus24_awa is now known as sigmavirus2419:28
palendaecloudnull: If we transition to writing specs, I've kinda changed my mind - I'd rather do it in tree in specs/ than have to wait for a new repo19:29
palendaeSo I'm +1 for specs and getting them in there, but not sure if there's consensus19:29
cloudnulli dont want specs in the main repo. that would require a full gate job in order to add a spec.19:31
*** nermik has quit IRC19:35
b3rnard0The first hackathon shipment order is away!19:35
b3rnard0whoops wrong channel lol19:36
palendaecloudnull: That's fair19:39
palendae+1 for specs in any case19:40
*** galstrom is now known as galstrom_zzz19:40
cloudnullno doubt.19:40
*** openstackgerrit has quit IRC19:40
*** openstackgerrit has joined #openstack-ansible19:40
BjoernTcloudnull: Just pinged you with one problem19:54
cloudnulli have no ping19:55
BjoernTyou do, you just don't know it19:55
cloudnullhahaha19:55
BjoernThold on, might have found it19:56
cloudnullso still no ping ?20:00
cloudnull:D20:00
BjoernTlol, found it. Don't need your ping anymore20:01
BjoernTlol20:01
cloudnullboom!20:01
cloudnullyour welcome20:01
* cloudnull a helper20:01
cloudnullhahahaha20:01
lbragstadpalendae: cloudnull fwiw ttx had a interesting post relating to the ability to add repos faster/easier http://ttx.re/stepping-out-of-the-way.html20:02
cloudnullah nice. will read that too. thanks lbragstad20:03
palendaelbragstad: Thanks!20:05
palendaethat's definitely relevant as we figure out how to grow this project's community base20:05
*** Mudpuppy has quit IRC20:05
*** Mudpuppy has joined #openstack-ansible20:06
BjoernTdoes anyone know this swift-recon error by chance: status error in()\n  File "./swift-recon.py", line 352, in main\n    stats = swift_replication(args.ring)\n  File "./swift-recon.py", line 156, in swift_replication\n    replication_statistics[rep_dict.pop('replication_type')] = rep_dict\nKeyError: 'replication_type'\n20:14
odyssey4meBjoernT that sounds like it may relate to an issue that's been patched where if you define a replication network as being the same as (not sure, andymccr knows best) then stuff breaks.20:15
odyssey4meThere's a patch in for it, which I think has hit master - not sure if it's been backported.20:15
BjoernTok20:15
BjoernThttps://github.com/rcbops/rpc-maas/issues/17220:16
docaedoHi - I was playing around with the AIO deployment and wanted to add the "Solutions" tab to the environment - is that part of the aoi build script or is it a different playbook to run afterwards?20:17
docaedo(aio script I mean)20:18
odyssey4medocaedo the 'solutions' tab is part of rcbops/rpc-extras20:18
BjoernTis the solution stuff already good to go?20:19
odyssey4mework there is still in progress for master, but I'm not sure of the status for juno/10.x20:19
palendaeI think miguelgrinberg would be the one to ask on that20:20
odyssey4mehttp://docs.rackspace.com/rpc/api/v10/bk-rpc-installation/content/ch-solutions.html20:20
odyssey4menote that it's specifically an RPC thing, not an os-ansible-deployment thing20:20
docaedoodyssey4me: thanks - understood it's part of the rackspace "product".  os-ansible-deployment is nice, enjoying poking around in it20:21
cloudnulldocaedo: have a look at https://github.com/rcbops/rpc-extras20:21
cloudnullthats where those bits live20:21
odyssey4medocaedo :) I'm sure that rpc-extras would be happy to accept issue reports for anything that's not working against master... if that's your current experimental base :)20:22
cloudnull^ + 120:22
docaedogot it, thanks - figured I should ask first as I know there's been a bunch of great work you guys have done to make the playbooks generic20:22
ApsuBlame.. er, I mean thank cloudnull for that.20:22
docaedoand yes, I'm working off master right now, so thought I would check first in case there were known issues20:22
cloudnullApsu your welcome ?20:23
Apsu:D20:23
odyssey4me:) docaedo very happy to have input, and even more happy to see bug reports and patches coming in :D20:23
cloudnulldocaedo all issues are just unknown features :)20:23
ApsuBugs are surprise features.20:24
docaedohaha20:26
*** Mudpuppy has quit IRC20:29
odyssey4mehmm, some warnings which may bite us in the near future: http://logs.openstack.org/14/163914/1/check/os-ansible-deployment-dsvm-check-commit/84c8d9a/console.html#_2015-03-12_18_21_21_97620:34
BjoernTHey guys, the swift playbooks should configure object-server-replicator.conf right ?20:35
*** Mudpuppy has joined #openstack-ansible20:35
odyssey4meBjoernT as I understand it, that should only be configured in the situation where the replicator network is different to the (proxy?) network20:36
odyssey4melet me find that bug/commit to clarify20:36
BjoernThmm, shouldn't be the object replicator process running in any case ?20:36
odyssey4meBjoernT are you working with master, juno or 10.x?20:37
*** Mudpuppy_ has joined #openstack-ansible20:37
BjoernTjuno, 10.1.220:37
BjoernTthe swift replication maas checks are failing due to https://github.com/rcbops/rpc-maas/pull/173 and the last comment made me nervous that replication wasn't working20:38
BjoernTBTW, how can I cherry pick these when I have to specify a parent-number20:39
*** vmtrooper has joined #openstack-ansible20:39
odyssey4meBjoernT cherry pick for github or gerrit?20:40
palendaeGuessing github if he's working rpc-maas20:40
BjoernTguthub https://github.com/rcbops/rpc-maas/pull/17320:40
*** Mudpuppy has quit IRC20:40
sigmavirus24odyssey4me: do you knwo where that's coming from?20:41
odyssey4meyou should be able to cherry-pick 9c9483710b1bdc0f76fb049762de85ae3ccf36fe (the commit from that PR)20:41
sigmavirus24oh i bet that's setuptools20:41
odyssey4mesigmavirus24 not sure - haven't worked with swift at all20:41
odyssey4meI know about these relating to the swift replicator network, but they should be in 10.1.2:20:42
sigmavirus24odyssey4me: sorry, I meant the deprecation warnings: http://logs.openstack.org/14/163914/1/check/os-ansible-deployment-dsvm-check-commit/84c8d9a/console.html#_2015-03-12_18_21_21_97620:42
odyssey4mehttps://bugs.launchpad.net/openstack-ansible/+bug/141470520:42
openstackLaunchpad bug 1414705 in openstack-ansible trunk "swift: replicator init script deployed unnecessarily" [Medium,Fix committed] - Assigned to Andy McCrae (andrew-mccrae)20:42
BjoernTI did a patch now but the checks fail with status error Cannot parse '[replication_time] - No hosts returned valid data.' for statistics.20:42
BjoernTso replication is not running20:42
odyssey4mehttps://bugs.launchpad.net/openstack-ansible/+bug/141146520:42
openstackLaunchpad bug 1411465 in openstack-ansible trunk "If replication_network is the same as storage_network swift will fail" [Medium,Fix committed] - Assigned to Andy McCrae (andrew-mccrae)20:42
odyssey4mehttps://bugs.launchpad.net/openstack-ansible/+bug/142759920:42
openstackLaunchpad bug 1427599 in openstack-ansible "swift replication network should not be required" [High,Fix committed] - Assigned to Andy McCrae (andrew-mccrae)20:42
odyssey4methe last one is master only20:42
odyssey4meBjoernT as I understand it, the replication service itself should not run unless the replication network is different20:43
*** erikmwilson has quit IRC20:43
odyssey4me(isolated)20:43
odyssey4mefrom storage_network20:43
BjoernTHmm, I though the service has to run always no matter what network. In the end you either specify a replication IP inside the ring or not20:44
odyssey4meas I recall from a message andymccr sent some time last night, the trick was to not specify both replication_network and storage_network if the two are the same - but I may stand corrected by people who know better :)20:44
*** vmtrooper has quit IRC20:44
odyssey4meBjoernT not sure - just trying to provide options for consideration :)20:45
BjoernTso should I apply  the commit  8cf39b11ff0dab230b6ad2698b7512679d05e2e1 or remove replication network20:45
BjoernT?20:45
odyssey4meBjoernT that commit only applies to master20:46
BjoernTdamn20:46
odyssey4me10.1.2 should already have it, so I guess the solution is to remove replication_network as per https://bugs.launchpad.net/openstack-ansible/+bug/141146520:46
openstackLaunchpad bug 1411465 in openstack-ansible trunk "If replication_network is the same as storage_network swift will fail" [Medium,Fix committed] - Assigned to Andy McCrae (andrew-mccrae)20:46
odyssey4mealthough, from the commit message it would appear that it's supposed to ignore the replication_network if it's the same as the storage_network20:47
odyssey4memaybe there is a bug there after all - try removing the replication_network and seeing20:48
daneyonI see the following error from Kibana OpenStack API Response (MS) after deploying a v10 cluster: × Oops! FacetPhaseExecutionException[Facet [7]: (value) field [httptime] not found] Anyone see this before?20:49
odyssey4mesigmavirus24 it likely is setuptools - git-harry has been poking through a problem today around our versions of pip and setuptools for juno/icehouse20:49
BjoernTok, i try removing the setting20:49
odyssey4medaneyon yes - that would seem that logstash is not working20:49
odyssey4medaneyon logstash processes the logs from all the nodes and creates indexes in elasticsearch - one of the fields it creates for some openstack services is 'httptime' (response time)20:50
miguelgrinbergdocaedo, BjoernT: feel free to hit me with questions about the solutions stuff. It should be fully working for both juno and master.20:50
BjoernTok20:50
miguelgrinbergbut master uses the new ansible-galaxy style, we haven't done the docs for that yet20:51
odyssey4meif there is no such value, then either logstash hasn't yet gotten to process an openstack log yet, or elasticsearch has crashed (which happens on an AIO, especially after it's been up for a few days - especially if it's out of disk space)20:51
daneyonodyssey4me: I am running logstash on my deploy node. The logstash container is running, the service is running inside the container. i do not see any logs in the logstash log20:51
sigmavirus24odyssey4me: actually it's pip20:52
* sigmavirus24 just talked to the pip maintainer20:52
odyssey4medaneyon if you set kibana to look for logs over as long a period as possible, does it show any log entries being processed?20:52
daneyonodyssey4me: let me try20:52
cloudnullwhen you guys get a chance this is the review to add specs / docs https://review.openstack.org/#/c/163960/20:53
odyssey4mesigmavirus24 ok - so that log's from juno, and in juno we use the get-pip script from the rax mirror20:53
sigmavirus24odyssey4me: yeah it's for a good reaso20:53
sigmavirus24we'll have time for that to go away. It's probably a year+ deprecation warning fwiw20:54
sigmavirus24(requests and pip have very similar methodologies)20:54
odyssey4mecloudnull awesome, +1 for sure - just to get it attention, of course :)20:54
daneyonodyssey4me: i set the duration to 30 days and still the same oops message20:54
odyssey4medaneyon sure, but is it showing events in the histogram for events?20:54
daneyonodyssey4me: yes20:55
odyssey4mesigmavirus24 cloudnull ok, but a question has been raised recently in our team - why do we use the get-pip script from the rax mirror instead of the same approach as master (from the source), and could we now uncap setuptools for juno/icehouse?20:56
daneyonodyssey4me: i see info for raw events, severity, top 5 event sources and infra events20:56
odyssey4medaneyon ok, are there events consistantly coming through, or are they old?20:56
sigmavirus24odyssey4me: I frankly don't know20:57
odyssey4medaneyon is your kibana available publically - feel free to prv msg me the URL and creds, if you're happy to do that20:57
cloudnullodyssey4me, we cant uncap setuptools in juno / icehouse until we move to 2014.2.2 and 2014.1.4 respectively .20:57
odyssey4me(it's been a while since I looked at logging :))20:57
daneyonodyssey4me: consistently coming through20:57
cloudnullthere is a requirements logic bomb20:57
cloudnullin the earlier juno icehouse releases from upstream sources.20:58
odyssey4mecloudnull it seems that we're hitting that requirements logic bomb on anything other than the deployment node - well, from git-harry's testing20:58
*** Mudpuppy_ is now known as Mudpuppy20:58
cloudnullif git-harry installed pip before hand and didnt allow our deployment process to do it he got pip620:58
cloudnullwhich will never work .20:59
odyssey4methe aio is passing because it is the deployment node too - so pip and setuptools is at the right level20:59
cloudnullthats the same issue bgmccollum ran into20:59
odyssey4mecloudnull he's working on the external CI jenkins, which I believe he uncovered is deploying pip in a different process - so that is likely the issue20:59
daneyonAs part of my eval write-up/demo, I would like to show the logging but the error doesn't look so good. So, do I have to run trunk for the logging error to go away?20:59
odyssey4medaneyon nope, the logging does work - there's likely something simple/silly that went wrong21:00
daneyonodyssey4me: OK21:00
cloudnullodyssey4me yea if we update to 2014.2.2 and 2014.1.4 (when released) those issues should go away. upstream openstack fixed their logic issues in requirements.21:01
odyssey4medaneyon in the absence of access to your system, let me fire up an AIO21:01
BjoernTodyssey4me: did we file a documentation bug for 10.1.2 ?21:01
daneyonodyssey4me: I can fire-up a webex, share my screen and even have you take control21:01
odyssey4mecloudnull quite honestly I think the juno branch should update to the latest tag21:01
cloudnullme too21:02
odyssey4medaneyon happy to help if you're happy to do so :)21:02
daneyonodyssey4me: give me 2 min21:02
cloudnullsame with icehouse, while were still make fixes in it.21:02
odyssey4mecloudnull icehouse should perhaps not, but we are due to tag 9.0.7 which has some essential fixes (pinning especially), so perhaps the update to the latest openstack tag would be good too21:02
cloudnullbut as they're rax technical debt thats a bit of a harder negotiation.21:02
odyssey4meBjoernT doc bug for what? the replication network? no idea - if you don't see it, then you know the drill :)21:03
cloudnulli'd drop 9.0.7 with the couple fixes. and then drop 9.1.0 with the updated stable tags.21:03
BjoernTyes21:03
odyssey4mehaha, how am I typing so quickly.... I'm supposed to be relaxing for the evening :p21:04
cloudnullbecause icehouse as is , is a bunch of disjointed shas because early icehouse was kinda broken from upstream .21:04
cloudnullbut the tags "should"-tm be better :)21:04
daneyonodyssey4me: go to http://cisco.webex.com  meeting# 209 879 429 meeting pswd: osad12321:04
odyssey4medaneyon for future - it's probably best to have done that privately21:04
odyssey4methis is a logged channel, after all21:05
daneyonodyssey4me: my bad21:05
odyssey4mein fact, I'd suggest cancelling that right now and setting up a seperate session/password and sending it to me privately21:05
daneyonodyssey4me: OK21:05
odyssey4mebefore you end up with a troll :p21:05
stevellepaging sigmavirus24?21:05
* odyssey4me looks at sigmavirus24 ;)21:06
odyssey4mehahaha21:06
* sigmavirus24 shakes head21:06
sigmavirus24o-sad21:06
*** erikmwilson has joined #openstack-ansible21:20
*** erikmwilson has quit IRC21:23
*** erikmwilson_ is now known as erikmwilson21:23
*** KLevenstein has quit IRC21:24
*** KLevenstein has joined #openstack-ansible21:24
BjoernTcloudnull: what was the syntax to specify multiple networks in the rpc_user_config for one network type. I thought it was comma separated if not a range21:26
openstackgerritSteve Lewis proposed stackforge/os-ansible-deployment: Fixes config name for Cinder default availability zone  https://review.openstack.org/16398321:29
*** jwagner is now known as jwagner_away21:30
cloudnullBjoernT huh?21:31
cloudnulldo you want to specify multiple used_ips ?21:31
cloudnullor more provider networks ?21:31
BjoernTmultiple provider vlans21:32
BjoernTfor one network type21:32
BjoernTlooks like we have to repeat each -network stanza21:32
BjoernTI refer to         type: "vlan"21:33
BjoernT        range: "752"21:33
* cloudnull looking 21:33
BjoernTcomma separated did not work21:34
cloudnullyup multiple stanzas21:35
cloudnullits doing a merge down .21:35
cloudnulland will append the additional ranges21:35
BjoernTok21:35
openstackgerritSteve Lewis proposed stackforge/os-ansible-deployment: Fix config name for Cinder default availability zone  https://review.openstack.org/16398321:38
docaedoapologies for my ansible ignorance - finally circled back to try adding "solutions" tab to the all in one deployment and ansible is looking for an inventory file, but since this is all in one I don't think it's needed21:52
docaedo(which means maybe I'm just missing an environment var somewhere?)21:53
docaedo# ansible-playbook playbooks/horizon_extensions.yml21:53
docaedoERROR: Unable to find an inventory file, specify one with -i ?21:53
*** BjoernT has left #openstack-ansible21:54
bgmccollumdocaedo, make sure you are in /opt/rpc-extras/rpc_deployment21:57
docaedoI started with the "run-aio-build.sh" script (https://github.com/stackforge/os-ansible-deployment/blob/master/development-stack.rst), which checked out the repo into /opt/stackforge/os-ansible-deploy21:58
docaedoThen the docs for the solutions tab (http://docs.rackspace.com/rpc/api/v10/bk-rpc-installation/content/sec-install-solutions.html) tell me to pull the rpc-extras repo down into /opt/rpc-extras (http://docs.rackspace.com/rpc/api/v10/bk-rpc-installation/content/sec-install-solutions.html)21:59
*** sigmavirus24 is now known as sigmavirus24_awa22:02
bgmccollumdocaedo: then from `/opt/rpc-extras/rpc_deployment`, run `ansible-playbook playbooks/horizon_extensions.yml`22:02
docaedoah I suspect I checked out master instead of juno branch (and rpc_deployment wasn't there)22:03
cloudnullthis is the review that adds docs / specs repos . please review it as you get a chance https://review.openstack.org/#/c/163960/22:07
Apsudocaedo: Make sure you're in the playbooks directory before you run ansible-playbook22:10
Apsudocaedo: For master on both os-a-d and rpc-extras22:10
ApsuThe other branches expect you to be in rpc_deployment (hence the docs refs)22:10
ApsuMaster isn't a release yet, and those changes aren't in the public product docs :)22:10
docaedoUnderstood, thanks for your help!  Soon as I get my VPN connection back I'll try again22:12
ApsuSure thing!22:13
odyssey4medocaedo if you're on master, try using 'openstack-ansible' from the playbooks directory :)22:16
odyssey4me'openstack-ansible' is a convenience script deployed by the 'bootstrap-ansible' script which takes care of the /etc/ bits for you - all you have to do is make sure that you run it from the place where the dynamic inventory/playbooks/roles sit22:17
Apsu(which is $gitCloneDir/playbooks/)22:18
*** logan2 has quit IRC22:26
*** vmtrooper has joined #openstack-ansible22:28
*** KLevenstein has quit IRC22:30
bgmccollumodyssey4me: thoughts on how to handle templating the memcached_servers?22:31
bgmccollummaybe via a lookup22:32
*** KLevenstein has joined #openstack-ansible22:32
*** KLevenstein has quit IRC22:33
*** vmtrooper has quit IRC22:33
odyssey4mebgmccollum I haven't looked that far into the details - it might require setting facts in plays or using other means to do the lookups ahead of time, but I don't see that as too hard to resolve22:40
bgmccollumodyssey4me: like this maybe, memcached_servers: "{{ lookup('template', 'memcached_servers.j2') }}"22:41
odyssey4meI am, however, intrigued at the idea of using an ansible module instead of doing a dict merge via jina22:41
odyssey4me*jinja22:41
bgmccollumwith the jinja bits in the template to format it correctly22:42
odyssey4mebgmccollum yup, that's an option - although it may not be necessary... it'll be hard to know until we get an example worked up22:46
odyssey4meyou're welcome to take a crack at it if you want to :)22:46
*** sdake has quit IRC23:00
*** Mudpuppy has quit IRC23:20
*** jmccrory has quit IRC23:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!