Friday, 2013-08-30

*** dina_belova has joined #openstack-infra00:04
*** dolphm has quit IRC00:05
*** sgviking has quit IRC00:05
*** sgviking has joined #openstack-infra00:06
clarkbwoot I have git review tests working against gerrit 2.400:06
clarkbI think they will work against 2.6 as well00:06
clarkbnow running with --until-failure to see if it is any more reliable00:07
*** pcrews has quit IRC00:08
*** dina_belova has quit IRC00:09
*** jfriedly has quit IRC00:11
*** w_ has quit IRC00:14
*** olaph has joined #openstack-infra00:14
clarkbjeblair: I think we are seeing an odd thing happen wiht the test load. There is a long weekend coming up so the test load is falling rather than climbing despite being only a few days from feature freeze00:14
*** UtahDave has quit IRC00:14
*** michchap has joined #openstack-infra00:18
*** jhesketh_ has quit IRC00:18
*** sarob_ has quit IRC00:18
*** sarob has joined #openstack-infra00:19
*** michchap has quit IRC00:19
*** michchap has joined #openstack-infra00:20
openstackgerritClark Boylan proposed a change to openstack-infra/git-review: Use OpenStack's Gerrit war when testing git-review  https://review.openstack.org/4437800:23
*** sarob has quit IRC00:23
clarkblet's see if that helps00:24
clarkbnope http://logs.openstack.org/78/44378/1/check/gate-git-review-python27/1460032/console.html I really do not know why that is happening00:26
clarkb(I think there is additional value in running the tests against our war so not completely wasted effort)00:26
openstackgerritLi Yingjun proposed a change to openstack/requirements: Bump python-cinderclient requirement to >=1.0.5  https://review.openstack.org/4437900:29
*** zul has joined #openstack-infra00:36
*** jhesketh_ has joined #openstack-infra00:36
echoheadpleia2: thanks for the pointer.  not sure how the default_data.json is populated - if nothing else, i guess one could send a patch to update it.00:38
jeblairclarkb: yeah, it seems like everyone has already left.  probably because the bay bridge is closed.  :)00:41
jeblairand on that note, i'm going afk for the evening00:42
clarkbjeblair: good night00:42
*** jhesketh__ has joined #openstack-infra00:42
clarkbI am about to do the same. It time for a break from the git-review and gerrit bashing00:42
*** HenryG has joined #openstack-infra00:43
*** gyee has quit IRC00:45
*** w_ has joined #openstack-infra00:47
*** olaph has quit IRC00:50
*** dkliban has quit IRC00:51
*** olaph has joined #openstack-infra00:52
*** [wchrisj_ has quit IRC00:54
*** w_ has quit IRC00:55
*** svarnau has quit IRC01:02
*** dkranz has joined #openstack-infra01:03
*** dina_belova has joined #openstack-infra01:05
*** zul has quit IRC01:06
*** w_ has joined #openstack-infra01:06
*** pcrews has joined #openstack-infra01:06
*** olaph has quit IRC01:09
*** dina_belova has quit IRC01:10
*** olaph has joined #openstack-infra01:10
*** w_ has quit IRC01:11
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates with with rebased branches.  https://review.openstack.org/4438301:15
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438301:17
openstackgerritlifeless proposed a change to openstack-infra/config: Install Nova and Cinder clients on puppetmaster.  https://review.openstack.org/4438401:20
*** dims has quit IRC01:21
*** portante|afk is now known as portante01:22
*** woodspa has quit IRC01:23
*** dims has joined #openstack-infra01:24
*** sandywalsh has quit IRC01:27
*** w_ has joined #openstack-infra01:28
*** olaph has quit IRC01:31
*** [wchrisj_ has joined #openstack-infra01:32
*** Ryan_Lane has quit IRC01:45
*** olaph has joined #openstack-infra01:45
lifelesshmm01:45
lifelesserr: /Stage[main]/Testcabal_project::Puppetmaster/Package[python-cinderclient]: Provider pip is not functional on this host01:45
*** sandywalsh has joined #openstack-infra01:45
lifeless^ pointers for that? [ clarkb, pleia2 et al]01:46
uvirtbotlifeless: Error: "clarkb," is not a valid command.01:46
*** w_ has quit IRC01:47
*** dkliban has joined #openstack-infra01:47
*** jhesketh_ has quit IRC01:49
*** jhesketh__ has quit IRC01:49
clarkblifeless: is pip installed?01:50
*** w_ has joined #openstack-infra01:50
clarkbdoes pip --version work?01:50
lifeless# pip --version01:52
lifelesspip 1.4.1 from /usr/local/lib/python2.7/dist-packages (python 2.7)01:52
lifelessclarkb: ^01:52
*** olaph has quit IRC01:52
clarkbis pip installed in a weird place so puppet can't find it?01:53
clarkbI think the pip is not function means puppet can't find it or running it doesn't work01:53
clarkbthe pip --version indicates it does work01:53
lifeless# which pip01:55
lifeless/usr/local/bin/pip01:55
lifelessI didn't install pip AFAIK01:55
lifelessii  python-pip             1.0-1build1            alternative Python package installer01:55
lifelessthere is something odd - dpkg -L pip suggests /usr/bin/pip is there.01:57
clarkblifeless: that is because pip removes it when pip upgrades...01:58
clarkbits a bit wrong01:58
lifelessanyhow01:58
lifelesspip is there01:58
clarkbI would have to go look in the pip puppet privder to see where that errors comes from01:59
lifelessewww01:59
clarkbhttps://github.com/puppetlabs/puppet/blob/2.7.x/lib/puppet/provider/package/pip.rb02:00
clarkbthat error message is not in that file02:00
clarkbwhat version of puppet?02:00
*** jhesketh_ has joined #openstack-infra02:01
lifelesshttps://groups.google.com/forum/#!msg/puppet-dev/R8VNyORGW3M/YkuEPKT55LsJ02:02
lifelessgnar 'useful error message' [which no longer shows what went wrong]02:02
*** jhesketh__ has joined #openstack-infra02:02
lifelessclarkb: # puppet --version02:02
lifeless2.7.2302:02
*** w_ has quit IRC02:02
*** w_ has joined #openstack-infra02:04
clarkbI'm confused that doesn't show up in the github source02:04
*** changbl has joined #openstack-infra02:05
*** dina_belova has joined #openstack-infra02:06
clarkboh derp02:06
clarkbI was searching the actual message. If I read the diff I see I am derping02:06
clarkblifeless: is /usr/local/bin in puppet/root's path?02:07
lifelessI'm root atm, and it's in my path02:08
lifelesslet me log directly in02:08
lifelesspleia2: replied to your review02:08
lifelessoh, I can't. Uhm..02:09
lifeless(login as root that is, PermitRootLogin no)02:10
*** dina_belova has quit IRC02:10
*** yaguang has joined #openstack-infra02:11
lifelessclarkb: and AFAICT in puppets too02:11
lifelessI'll symlink /usr/bin/pip though and try again02:11
lifelessclarkb: pip removing the system packaged pip is so evil though02:12
clarkblifeless: it is02:12
lifelessclarkb: and pointless, since dpkg updates will reinstate it02:12
lifelessdstufft: ^02:12
lifelessclarkb: once the puppetmaster is setup, do you need the full puppet apply --modulepath='/opt/config/production/modules:/etc/puppet/modules' -e 'include testcabal_project::puppetmaster' thing?02:13
*** dkliban has quit IRC02:13
lifelessclarkb: or is there a shorter command that can be used ?02:13
clarkbonce puppet master is running you can run puppet in agent mode instead of apply mode (apply is purely local hence the need for pointing out modules and stuff)02:14
clarkblifeless: puppet agent --test will run it in agent master mode once02:14
clarkband give you nice debug output02:14
lifelessclarkb: on the master right ?02:15
clarkblifeless: wherever you want to apply the puppet configs02:15
lifelessit's hung, I think...02:15
lifelessroot@ci-puppetmaster:/opt/config/production# puppet agent --test02:15
lifelessinfo: Creating a new SSL key for undef02:15
lifelessinfo: Creating a new SSL certificate request for undef02:15
lifelessinfo: Certificate Request fingerprint (md5): 8B:C3:97:C3:9B:F4:A2:B8:2A:49:56:D3:6E:FB:56:BE02:15
lifelessExiting; no certificate found and waitforcert is disabled02:15
clarkboh  Ithink you need to edit your /etc/puppet/puppet.conf02:16
clarkbto tell it what the certname is and which master to talk to02:16
lifelessclarkb: this is the master02:16
clarkbthe puppet apply you run the first time should do that02:16
clarkblifeless: right, but the master is also a client02:16
lifelessthe apply I run the first time to setup the master doesn't do that?02:16
*** olaph has joined #openstack-infra02:16
clarkbI think it should02:16
clarkbthough we may be doing it in a very openstack specific part of the code02:17
lifelesshmm, server=ci-puppetmaster.openstack.org02:17
lifelesscertname=undef02:17
lifelesshuh, I appear to have an unfixed file here02:17
* lifeless digs02:17
clarkbhttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/base.pp#n9402:18
*** w_ has quit IRC02:18
lifelessyes, failed to update one of the references02:18
lifelessin modules/testcabal_project/manifests/base.pp02:19
lifelessthe symlink worked02:22
clarkb:/02:22
lifelessindeed02:22
clarkbI wonder if puppte which is special and not using PATH?02:23
lifelesscertname=undef02:23
*** vipul has quit IRC02:23
lifelessstill; but the right server now02:23
lifelessand wheee boom02:23
openstackgerritA change was merged to openstack/requirements: bump keystoneclient to 0.3.2  https://review.openstack.org/4391902:24
lifelessclarkb: n# puppet agent --test | pastebinit02:24
lifelesshttp://paste.ubuntu.com/6042559/02:24
*** vipul has joined #openstack-infra02:24
clarkblifeless: looks like you may need to chmod the puppet reports dir02:26
clarkbline 133 in the paste02:26
lifelesshttps://bugs.launchpad.net/openstack-ci/+bug/121869602:27
uvirtbotLaunchpad bug 1218696 in openstack-ci "new puppetmaster ends up with broken pip provider" [Undecided,New]02:27
*** anteaya has quit IRC02:27
lifelesshttps://bugs.launchpad.net/openstack-ci/+bug/121869702:28
uvirtbotLaunchpad bug 1218697 in openstack-ci "bad mode on reports directory" [Undecided,New]02:28
lifelessclarkb:  how does one express 'set a mode' in puppet ?02:28
lifelessclarkb: or should reports be puppet:puppet rather than root:root ?02:29
clarkblifeless: with the file resource http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/jenkins.pp#n15802:29
lifelessclarkb: also I love the error 'change from X to Y; failed to set mode X..' WTF02:30
clarkbyeah that message isn't so great02:30
openstackgerritA change was merged to openstack/requirements: Bump python-cinderclient requirement to >=1.0.5  https://review.openstack.org/4437902:30
lifelesslooks like this is not master specific, right?02:31
lifelessso I should do this in base? or server?02:31
*** [wchrisj_ has quit IRC02:31
clarkblifeless: reports is master specific02:31
clarkblifeless: I think passenger/puppet is trying to make sure it can write/read into the reports dir02:32
lifelessclarkb: it's cutting -a off02:32
clarkboh, so being defensive02:32
clarkbin any case that is master specific (possibly also dashboard specific because you can send reports there too)02:33
lifelessclarkb: ls -ld /var/lib/puppet/reports/02:33
lifelessdrwxr-xr-x 4 root root 4096 Aug 30 01:39 /var/lib/puppet/reports/02:33
lifelessclarkb: is it 'dir' or 'directory' to assert a dir exists?02:33
clarkbdirectory02:33
lifelesslike http://paste.ubuntu.com/6042568/ ?02:34
clarkblifeless: s/directory/file/ s/present/directory/02:34
lifelesshttp://paste.ubuntu.com/6042570/ ?02:35
clarkbyup02:35
*** dkliban has joined #openstack-infra02:36
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439102:37
lifelesswe probably want some of this stack to land :>02:37
lifelessclarkb: warning: Could not retrieve fact fqdn02:40
clarkblifeless: oh man this is the best thing ever02:40
lifelessclarkb: that will explain the undef on certname02:40
lifelessclarkb: what is?02:40
clarkblifeless: so facter is actually pretty dumb when it comes to figuring out an fqdn02:40
clarkbif your domain is '.' eg your hostname is the TLD then facter undefs fqdn02:41
clarkbbecause a hostname is apparently not an fqdn when anchored under '.'02:41
lifeless# puppet agent --test  | pastebinit02:41
lifelesshttp://paste.ubuntu.com/6042589/02:41
clarkblifeless: I think you may need to generate a server cert with the faux fqdn02:42
clarkblifeless: or use the name iwthout a domain in your server specification02:42
lifelessI've just reloaded hostname - I'd edited the hostname file but not kicked the upstart job02:42
clarkbthat should do it02:42
clarkbso annoying02:42
lifelessI'll re-run the apply02:43
clarkbfacter's code explicitly does something like if not domain: fqdn = None02:43
clarkbwhich is wrong...02:43
lifelessok, I now have a valid certname in puppet.conf02:43
clarkbbut it has been argued a couple times before and it never went anywhere so I just work around it now if I have to02:43
lifelessand more notes to roll into docs/bugfixes.02:44
*** melwitt has quit IRC02:44
lifelesspuppet agent --test02:44
lifelessinfo: Creating a new SSL key for ci-puppetmaster.testing-cabal.org02:44
lifelessinfo: Creating a new SSL certificate request for ci-puppetmaster.testing-cabal.org02:44
lifelessinfo: Certificate Request fingerprint (md5): D5:B0:14:60:AF:86:1E:37:0E:53:B8:1E:A2:54:56:AF02:44
lifelessExiting; no certificate found and waitforcert is disabled02:44
lifelessthis is for the puppetmaster on the puppetmaster02:44
lifelessafter re-running the whole '02:44
lifelesspuppet apply --modulepath='/opt/config/production/modules:/etc/puppet/modules' -e 'include testcabal_project::puppetmaster'02:44
lifelesscommand02:44
*** jfriedly has joined #openstack-infra02:45
clarkblifeless: so now I think you need to sign the cert02:46
openstackgerritA change was merged to openstack-infra/config: Fix semantic error in example config.  https://review.openstack.org/4400002:46
clarkbpuppetca --list && puppetca --sign $HOSTNAME02:46
openstackgerritA change was merged to openstack-infra/config: Correct launch README.  https://review.openstack.org/4415402:46
lifelessso how does launch.py do this automatically?02:46
openstackgerritA change was merged to openstack-infra/config: Make root-only information clear in sysadmin.rst.  https://review.openstack.org/4416202:46
lifelessI see the steps in puppet.rst02:46
*** w_ has joined #openstack-infra02:47
clarkblifeless: launch.py pregenerates and signs the cert, copies it to where it needs to be on the puppet master, and copies it to where it needs ot be on the client02:47
clarkbsorry not launch.py02:47
lifelessok02:47
clarkbthis is a manual step in the readme02:47
clarkbthen you pass the name of the cert to launch.py so that it can copy it to the client02:47
lifelessI am wondering if we can do the puppetmaster cert for the puppetmaster automatically?02:47
clarkblifeless: possibly since you could run all of the commands to do that on the master itself with puppet02:48
clarkblifeless: in https://review.openstack.org/#/c/44163/3 did you save your reply to my -1?02:48
clarkblifeless: you mention it to pleia2 but I don't see it02:48
lifelessoh gerrit I hate thee02:49
lifelessclarkb: done02:49
clarkbthansk02:49
lifelesson patch set 102:49
*** olaph has quit IRC02:50
clarkblifeless: changing that is tricky, because we'd have to detect whether or not git-http is being used02:50
clarkbpossibly by checking headers?02:50
clarkbbecause we only want non git-http to go to /cgit/*02:50
*** adalbas has quit IRC02:51
lifelessclarkb: I believe the urls are entirely distinct02:52
lifelessclarkb: there is the magic url for the smart thing, and then the .git/ contents02:52
lifelessclarkb: all other paths are cgit02:52
clarkbif you point your browser at the url you give in that doc it won't do you much good02:53
lifelessclarkb: if you point git at it , it won't do much good.02:53
lifelessclarkb: the prose surrounding it says 'a clone of'02:53
*** DennyZhang has joined #openstack-infra02:54
clarkblifeless: yeah I am fine with the content after your comment02:54
lifelessclarkb: I could format it differently, just put it at ``...`` instead?02:54
*** w_ has quit IRC02:54
clarkblifeless: just explaining that fixing it is a little tricky02:54
lifelessclarkb: ack02:54
lifelessclarkb: ugh - err: /File[/var/lib/puppet/lib]: Failed to generate additional resources using 'eval_generate: Server hostname 'ci-puppetmaster.testing-cabal.org' did not match server certificate; expected ci-puppetmaster02:55
lifelessis back02:55
clarkbdid something change your hostname back?02:55
lifeless# hostname -f02:55
lifelessci-puppetmaster.testing-cabal.org02:55
lifelessno02:55
clarkbI wonder if the server cert was generated with the old name02:56
clarkb(there are two certs at play here for mutual auth and identification, the server cert and the client cert)02:56
clarkbI think02:56
lifelessthe server cert is probably wrong02:56
clarkbthat is what I am thinking. I believe there is a puppetca command to regenerate /me looks02:57
clarkbhttp://projects.puppetlabs.com/projects/1/wiki/certificates_and_security#Regenerate-Certificates-for-Puppet-Master02:57
lifelesswhat does 'stop puppet master' mean ?02:58
lifelessclarkb: any reason base doesn't set puppet to start on boot ?02:58
clarkblifeless: in this case stop apache so that the passenger processes stop02:59
clarkblifeless: yes, our slaves do not run puppet as a daemon and use cron instead. Also, we often want a little more control of what puppet does when first building a new host02:59
lifelessclarkb: the puppet.rst doc says to change e/d/p to start on boot02:59
lifelessclarkb: is the doc stale?03:00
clarkblifeless: no, its fine we just don't want to do it automagically03:00
lifelessclarkb: so, it *should* be set on on the puppetmaster?03:00
clarkbyes03:01
clarkbthe puppetmaster runs a client that talk to the master03:01
lifelessclarkb: does launch.py make it start on boot ?03:01
clarkbit does not03:01
clarkbREADME notes this near EOF03:02
lifelesswhat does 'Restart the puppet master.' mean here?03:03
clarkblifeless: in the regenerate certificates for puppet master page?03:03
clarkblifeless: start apache again03:04
lifelessyes, thanks03:04
clarkbthe master is a set of processes that run as apache workers03:04
lifelessshould puppetqd be running?03:04
clarkblifeless: no I don't think so03:04
clarkbthere should be some passenger/puppet processes03:05
clarkbbut they aren't daemons on their own03:05
lifelessok, so service puppet start, rather than rebooting, after setting up the pupet master ?03:05
lifelessstill getting info: Retrieving plugin03:05
lifelesserr: /File[/var/lib/puppet/lib]: Failed to generate additional resources using 'eval_generate: Server hostname 'ci-puppetmaster.testing-cabal.org' did not match server certificate; expected ci-puppetmaster03:05
clarkbservice puppet start runs the client03:06
lifelessright, and you said /e/d/puppet should say yes to start on boot03:06
clarkbyup03:06
lifelessbut unless one reboots thepuppetmaster03:06
*** dina_belova has joined #openstack-infra03:06
lifelesspuppet won't be started03:06
*** w_ has joined #openstack-infra03:06
clarkbright so service puppet start is what you want03:06
clarkbI am just failing to context switch with you03:07
clarkbso did the new cert get generated with the old hostname?03:08
lifelessno, I didn't wipe the client state03:09
lifelessand on the puppet master thats in the same damn directory03:09
lifelessso I'm hitting it harder at the moment03:09
lifelessnuts - SSLCertificateFile: file '/var/lib/puppet/ssl/certs/ci-puppetmaster.pem' does not exist or is empty03:09
clarkbhttp://docs.puppetlabs.com/guides/troubleshooting.html03:09
clarkbthere is another thing on the problem03:09
clarkbbut it looks like the same content03:09
*** dina_belova has quit IRC03:10
clarkbopenssl x509 -text -in /var/lib/puppet/ssl/certs/<hostname_of_puppet_master> to look at hte server cert03:10
lifelessthats  bad filename03:11
lifelessis the original hostname03:11
lifelessbad apache2 puppetmaster site definition03:11
clarkboh03:11
lifelessok, muuuuch more progress.03:12
lifelesserr: Could not retrieve catalog from remote server: Error 400 on SERVER: malformed format string - %S at /opt/config/production/manifests/site.pp:134 on node ci-puppetmaster.testing-cabal.org03:13
lifelessfrom agent --test03:13
clarkbcool it is actually compiling your manifests now03:14
clarkbsite.pp has an error on line 13403:14
lifelessnuts, hate all the merge commits; can gerrit be told to merge via rebase, since it has an artifical flat history...03:15
clarkbnewer gerrit can rebase if necessary. gerrit that we have can only do cherry picks which we stopped doing because it makes a few things weird03:15
clarkbit actually updates your commit messages instead of using git notes03:15
lifelesswhats the error on line 134?03:15
lifeless    sysadmins => hiera('sysadmins'),03:15
lifeless ?03:15
*** olaph has joined #openstack-infra03:16
lifelessoh, my return from hiera is a list03:16
lifelessshouldn't it be?03:17
clarkblifeless: google indicates maybe your yaml is malformed?03:17
lifelessclarkb: it is exactly what I pasted you :(03:17
lifelessclarkb: what does the sysadmins key for openstack-ci hiera look like ?03:17
clarkblifeless: I am not on a machine with keys to look but I am pretty sure it uses the other list syntax (that shouldn't matter)03:18
*** w_ has quit IRC03:18
lifelesschanged it to the block format03:19
lifelesshappy now03:19
lifelessso yay03:19
clarkbwait really?03:19
lifelessso now in theory, I have a fully functional puppet master. Yay.03:19
clarkb it didn't like [] but - foo\n- bar is fine?03:19
lifelessthat or perhaps the trailing ,03:19
lifelessyaml confuses me :)03:20
clarkbalso yay to functioning master03:20
lifelessnow, write up more bootstrap docs03:20
lifelessthen get the dashboard up03:20
lifelessI'm going to use a 2G instance - I'm on a rackspace free account, I don't want to abuse it -03:20
clarkbdashboard size depends a lot on number of lcients too03:21
clarkb2G is probably fine especially if once pleia2 gets those optimizations working03:21
*** ArxCruz has joined #openstack-infra03:21
*** w_ has joined #openstack-infra03:23
*** olaph has quit IRC03:26
*** olaph has joined #openstack-infra03:27
jhesketh__jeblair: ping03:28
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439303:29
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439103:29
openstackgerritlifeless proposed a change to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435703:29
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427003:29
openstackgerritlifeless proposed a change to openstack-infra/config: Install Nova and Cinder clients on puppetmaster.  https://review.openstack.org/4438403:29
openstackgerritlifeless proposed a change to openstack-infra/config: Add a pointer to launch/README for root operators.  https://review.openstack.org/4416303:29
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420903:29
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438303:29
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426203:29
openstackgerritlifeless proposed a change to openstack-infra/config: Start documenting running your own CI infra.  https://review.openstack.org/4417703:29
lifelessboom03:29
lifelesssorry :)03:29
*** w_ has quit IRC03:29
*** w_ has joined #openstack-infra03:30
*** olaph has quit IRC03:32
*** dims has quit IRC03:32
clarkbjhesketh__: I think jeblair called it a night a few hours ago03:34
jhesketh__thought I might be a little late but worth a try :-)03:34
lifelessclarkb: openstack creds - you upload those to servers by hand ?03:35
clarkblifeless: yes, and we put them in the files that are sourced according to launch/README03:37
lifelesswould making /root/ci-launch via puppet be reasonable?03:37
clarkblifeless: for launch.py and friends?03:38
*** olaph has joined #openstack-infra03:38
clarkblifeless: or for credentials that can be sourced?03:38
lifelessthe latter03:38
lifelessjust make it, right owner and mode03:38
clarkbI suppose. You will need to put the info in hiera or some other place mostly protected03:39
lifelessclarkb: what info?03:39
clarkbthe credentials03:39
lifelessclarkb: I'm not proposing to change how the creds are uploaded03:39
clarkboh03:39
lifelessclarkb: just to make teh directory they end up in03:39
lifelessclarkb: so it's not by hand03:39
clarkbI see. ya that would be fine03:39
clarkband help enforce that the permissions are correct03:40
lifelessexactly03:40
*** w_ has quit IRC03:40
lifelesscan one put comments inside a definition03:40
clarkblifeless: yes03:41
clarkbcomments can start anywhere and go to end of line iirc03:41
clarkbyou can also do C style block comments /* */03:42
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439403:42
*** vogxn has joined #openstack-infra03:42
clarkbI am going to AFK now03:43
lifelessau revoir03:43
clarkbtomorrow I plan on reviewing this stuff so hopefully we can push a bunch in before you start work again on Monday03:43
clarkb(assuming you don't also hack on it over the wekeend :) )03:43
lifelesspresentation is on Friday I think; so yeah, am going to be fairly focused.03:44
lifelessI need a consistent stack up to gerrit/zuul/jenkins/nodepool/slaves.03:44
*** jfriedly has quit IRC03:45
*** w_ has joined #openstack-infra03:46
*** olaph has quit IRC03:48
*** dkliban has quit IRC03:48
*** olaph has joined #openstack-infra03:49
*** w_ has quit IRC03:50
*** nicedice__ has joined #openstack-infra03:51
*** nicedice_ has quit IRC03:53
*** dkliban has joined #openstack-infra04:01
*** w_ has joined #openstack-infra04:01
*** ArxCruz has quit IRC04:02
*** olaph has quit IRC04:04
*** dina_belova has joined #openstack-infra04:07
*** w_ has quit IRC04:08
*** dina_belova has quit IRC04:11
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439504:19
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438404:19
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439304:19
*** odyi has quit IRC04:19
lifelessnuts, rebase mess up04:20
*** nicedice_ has joined #openstack-infra04:21
*** odyi has joined #openstack-infra04:21
*** nicedice__ has quit IRC04:24
*** [wchrisj_ has joined #openstack-infra04:24
*** sgviking has quit IRC04:30
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439104:31
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438404:31
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439404:31
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439504:31
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439304:31
*** DennyZhang has quit IRC04:37
*** sgviking has joined #openstack-infra04:43
[wchrisj_Could someone with quantum/neutron experiencetell me if this is an issue with the CLI or the docs: https://bugs.launchpad.net/python-neutronclient/+bug/1198750 Has this bug been misclassified?04:43
uvirtbotLaunchpad bug 1198750 in python-neutronclient "help for security-group-list calls out shell, should be csv" [Undecided,New]04:43
*** [wchrisj_ has quit IRC04:46
*** [wchrisj_ has joined #openstack-infra04:46
*** boris-42 has joined #openstack-infra04:46
clarkb[wchrisj_: that is an issue with the neutronclient args help04:49
clarkbwhich is not in the docs04:49
[wchrisj_Thanks - newb here04:49
[wchrisj_Would that be "python-neutronclient"?04:50
clarkbhttp://git.openstack.org/cgit/openstack/python-neutronclient/tree/04:51
[wchrisj_I've been looking at the github repo04:51
[wchrisj_same thing?04:52
*** amotoki has joined #openstack-infra04:52
clarkbthey are mirrors of each other04:52
[wchrisj_aha - thanks!04:53
*** jhesketh__ has quit IRC04:54
clarkb[wchrisj_: https://cliff.readthedocs.org/en/latest/show_commands.html you may find that interesting. (that doc implies to me this may not be a bug)04:54
*** jhesketh__ has joined #openstack-infra04:54
[wchrisj_This looks like a bug:04:57
[wchrisj_usage: quantum security-group-rule-create [-h] [-f {shell,table}04:57
*** nati_ueno has joined #openstack-infra04:57
[wchrisj_in this context, "shell" s/b "csv"04:57
[wchrisj_appears04:57
clarkb[wchrisj_: I can't parse 'in this context, "shell" s/b "csv" appears'04:58
clarkb[wchrisj_: but "shell" comes form cliff and is documented in the page I linked04:59
[wchrisj_sorry… the first part of the bug description seems to reflect that there is a bug04:59
*** reed has quit IRC04:59
[wchrisj_I agree with you wrt the second paragraph of the bug desc05:00
clarkbthere is an assertion that a bug exists, but I think that assertion is incorrect. This is expected behavior from cliff (I could be wrong though)05:00
[wchrisj_ok05:00
*** vogxn has quit IRC05:00
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support for emailing results via SMTP  https://review.openstack.org/4264505:05
*** SergeyLukjanov has joined #openstack-infra05:06
*** dina_belova has joined #openstack-infra05:07
*** [wchrisj_ has quit IRC05:09
*** vogxn has joined #openstack-infra05:10
*** dina_belova has quit IRC05:12
*** vogxn has quit IRC05:13
*** nicedice_ has quit IRC05:14
*** vogxn has joined #openstack-infra05:21
*** dkliban has quit IRC05:25
*** fifieldt has joined #openstack-infra05:34
*** SergeyLukjanov has quit IRC05:35
*** vogxn has quit IRC05:43
*** dina_belova has joined #openstack-infra05:57
*** DennyZhang has joined #openstack-infra05:59
*** DennyZhang has quit IRC06:00
*** DennyZhang has joined #openstack-infra06:00
*** dina_belova has quit IRC06:01
*** dina_belova has joined #openstack-infra06:02
*** olaph has joined #openstack-infra06:06
*** fifieldt has quit IRC06:06
*** dina_belova has quit IRC06:06
amotokihi, when I ran "tox -e pep8" in neutronclient after devstack run, i got pyflakes version conflict. http://paste.openstack.org/show/45451/06:07
amotokiIt seems that if test-requirements has the line "pyflakes>=0.7.2,<0.7.4" the version conflict occurs.06:08
amotokiafter I removed pep8,pyflakes,flake8 from test-requirements, the issue solved. Is it a correct solution?06:09
amotokiIt is same as test-requirements in nova, neutron, python-novaclient.06:10
*** w_ has joined #openstack-infra06:14
*** nati_ueno has quit IRC06:15
*** olaph has quit IRC06:17
*** nati_ueno has joined #openstack-infra06:18
*** olaph has joined #openstack-infra06:23
*** w_ has quit IRC06:25
*** vogxn has joined #openstack-infra06:25
clarkbonly hacking should be listed06:29
clarkbit has dependencies on the others and will install the correct versions06:29
*** SergeyLukjanov has joined #openstack-infra06:31
*** SergeyLukjanov has quit IRC06:33
*** DennyZhang has quit IRC06:35
*** morganfainberg is now known as morganfainberg|a06:41
amotokithanks. I will fix test-requirements in neutronclient.06:41
*** Bada has joined #openstack-infra06:45
*** Bada has quit IRC06:45
*** boris-42 has quit IRC06:49
*** w_ has joined #openstack-infra06:50
*** odyssey4me has joined #openstack-infra06:51
*** olaph has quit IRC06:52
*** nati_ueno has quit IRC06:53
*** dina_belova has joined #openstack-infra06:58
*** odyssey4me has quit IRC06:58
*** odyssey4me has joined #openstack-infra06:59
*** thomasbiege has joined #openstack-infra07:04
*** dina_belova has quit IRC07:08
*** dina_belova has joined #openstack-infra07:09
*** thomasbiege2 has joined #openstack-infra07:13
*** dina_belova has quit IRC07:13
*** thomasbiege has quit IRC07:15
*** thomasbiege2 has quit IRC07:18
*** w_ has quit IRC07:24
*** fifieldt has joined #openstack-infra07:25
*** Bada has joined #openstack-infra07:35
*** w_ has joined #openstack-infra07:36
*** vogxn has quit IRC07:37
*** odyssey4me has quit IRC07:41
*** w_ has quit IRC07:50
*** olaph has joined #openstack-infra08:03
*** fbo_away is now known as fbo08:04
*** jhesketh__ has quit IRC08:07
*** w_ has joined #openstack-infra08:13
*** jhesketh__ has joined #openstack-infra08:13
*** hashar has joined #openstack-infra08:14
*** derekh has joined #openstack-infra08:15
*** olaph has quit IRC08:16
*** ruhe has joined #openstack-infra08:17
*** dina_belova has joined #openstack-infra08:20
dukhlov_Hi all08:21
dukhlov_Can anybody help me with my problem that we discussed yesterday?08:22
dukhlov_means "fatal: ICLA contributor agreement requires current contact information."08:22
dukhlov_?08:22
*** dina_belova has quit IRC08:24
jd__dukhlov_: probably but you'll have to wait for the sun to rise above the US west coast08:25
*** olaph has joined #openstack-infra08:25
*** w_ has quit IRC08:27
dukhlov_:). Ok, I will wait08:27
*** vogxn has joined #openstack-infra08:28
*** DennyZhang has joined #openstack-infra08:33
*** olaph has quit IRC08:35
hashardoes anyone know who's in charge of building debian packages beside pabelanger ? :]08:39
*** jhesketh__ has quit IRC08:40
*** olaph has joined #openstack-infra08:47
*** DennyZhang has quit IRC08:48
*** DennyZhang has joined #openstack-infra08:48
Mithrandirhmm, did anybody get around to implementing the job cleanup stuff in jjb?08:53
Mithrandiror should I do it?08:53
*** thomasbiege has joined #openstack-infra09:07
*** w_ has joined #openstack-infra09:11
*** olaph has quit IRC09:14
*** dina_belova has joined #openstack-infra09:20
*** dina_belova has quit IRC09:25
*** olaph has joined #openstack-infra09:27
*** w_ has quit IRC09:28
*** olaph has quit IRC09:35
*** ruhe has quit IRC09:38
*** boris-42 has joined #openstack-infra09:45
*** thomasbiege2 has joined #openstack-infra09:48
*** olaph has joined #openstack-infra09:48
*** thomasbiege has quit IRC09:49
*** w_ has joined #openstack-infra09:51
*** olaph has quit IRC09:54
*** hashar has quit IRC09:55
*** olaph has joined #openstack-infra09:59
*** w_ has quit IRC10:00
*** pcm_ has joined #openstack-infra10:03
*** pcm_ has joined #openstack-infra10:04
*** thomasbiege2 has quit IRC10:08
*** alexpilotti has joined #openstack-infra10:12
*** ruhe has joined #openstack-infra10:15
*** asalkeld has left #openstack-infra10:19
*** dina_belova has joined #openstack-infra10:21
*** boris-42 has quit IRC10:24
*** yaguang has quit IRC10:25
*** dina_belova has quit IRC10:26
*** DennyZha` has joined #openstack-infra10:30
openstackgerritThierry Carrez proposed a change to openstack-infra/odsreg: Order topic names in the 'suggest session' dialog  https://review.openstack.org/4443410:39
openstackgerritDaniel Izquierdo proposed a change to openstack-infra/config: Addition of the openstack-activity-board-dash project to the StackForge environment  https://review.openstack.org/4405710:42
openstackgerritThierry Carrez proposed a change to openstack-infra/odsreg: Empty comment box after posting one  https://review.openstack.org/4443510:50
*** w_ has joined #openstack-infra10:50
*** olaph has quit IRC10:53
*** w_ has quit IRC11:00
*** olaph has joined #openstack-infra11:00
*** vogxn has quit IRC11:04
*** dukhlov_ has quit IRC11:04
*** w_ has joined #openstack-infra11:05
*** DennyZha` has quit IRC11:08
*** DennyZhang has quit IRC11:08
*** olaph has quit IRC11:09
*** dukhlov has joined #openstack-infra11:12
*** michchap has quit IRC11:12
*** ruhe has quit IRC11:19
*** dina_belova has joined #openstack-infra11:21
openstackgerritA change was merged to openstack-infra/odsreg: Order topic names in the 'suggest session' dialog  https://review.openstack.org/4443411:25
*** dina_belova has quit IRC11:26
openstackgerritA change was merged to openstack-infra/odsreg: Empty comment box after posting one  https://review.openstack.org/4443511:27
*** vogxn has joined #openstack-infra11:27
*** olaph has joined #openstack-infra11:27
*** ruhe has joined #openstack-infra11:29
*** w_ has quit IRC11:29
*** w_ has joined #openstack-infra11:30
*** DennyZhang has joined #openstack-infra11:31
*** jamiem has joined #openstack-infra11:32
*** jamiem has quit IRC11:33
*** olaph has quit IRC11:33
*** jamiem has joined #openstack-infra11:34
*** vogxn has quit IRC11:35
*** boris-42 has joined #openstack-infra11:37
*** jamiem has quit IRC11:37
*** boris-42 has quit IRC11:40
*** hashar has joined #openstack-infra11:41
*** olaph has joined #openstack-infra11:43
*** dims has joined #openstack-infra11:44
*** w_ has quit IRC11:46
*** rcleere has joined #openstack-infra11:46
*** w_ has joined #openstack-infra11:48
*** hashar has quit IRC11:48
*** olaph has quit IRC11:49
*** hashar has joined #openstack-infra11:51
*** olaph has joined #openstack-infra11:51
*** w_ has quit IRC11:53
*** weshay has joined #openstack-infra11:55
*** w_ has joined #openstack-infra11:55
*** olaph has quit IRC11:58
*** thomasbiege has joined #openstack-infra12:00
*** thomasm has joined #openstack-infra12:01
thomasmhey all!12:03
*** olaph has joined #openstack-infra12:06
*** w_ has quit IRC12:08
*** pblaho has joined #openstack-infra12:11
*** w_ has joined #openstack-infra12:12
*** DennyZhang has quit IRC12:12
*** DennyZhang has joined #openstack-infra12:13
*** Grizzlebee has joined #openstack-infra12:13
*** ArxCruz has joined #openstack-infra12:14
*** olaph has quit IRC12:14
*** rfolco has joined #openstack-infra12:19
*** dina_belova has joined #openstack-infra12:22
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439112:22
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427012:22
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438412:22
*** openstackstatus has quit IRC12:22
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438312:22
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426212:22
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439412:22
*** cppcabrera has joined #openstack-infra12:22
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439512:22
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439312:22
*** cppcabrera has left #openstack-infra12:23
*** dkliban has joined #openstack-infra12:24
*** olaph has joined #openstack-infra12:26
*** dina_belova has quit IRC12:27
*** w_ has quit IRC12:27
*** DennyZhang has quit IRC12:27
ttxjeblair: trying to push initial commit for openstack/governance (with basic structure and .gitreview) but it does not seem to be in gerrit yet12:28
ttxcould be a side-effect of not having "upstream" set for it in review.projects.yaml12:29
*** ruhe has quit IRC12:32
jd__question on doc: I am under the impression that we push something to a stable branch, the documentation job is ran and the stable documentation is pushed at http://docs.openstack.org/developer/ceilometer/, and the same things goes to the same place for master12:35
jd__in the end, would it be anyway possible to have 2 locations for stable and master doc to be both online at the same time?12:36
*** ruhe has joined #openstack-infra12:40
openstackgerritlifeless proposed a change to openstack-infra/config: Fix launch-node for non-official environments.  https://review.openstack.org/4444912:41
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439112:41
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427012:41
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438412:41
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438312:41
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426212:41
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439412:41
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439512:41
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439312:41
*** thomasbiege has quit IRC12:41
*** alexpilotti has quit IRC12:43
*** boris-42 has joined #openstack-infra12:43
lifelessjd__: most projects have different release vs master docs published, AFAICT.12:43
lifelessjd__: annegentle_ is possibly the best person to ask about that.12:44
* jd__ knocks knocks annegentle_ 12:44
*** dims has quit IRC12:44
*** ruhe has quit IRC12:44
*** ruhe has joined #openstack-infra12:45
*** dims has joined #openstack-infra12:47
*** rcleere has quit IRC12:47
*** woodspa has joined #openstack-infra12:48
*** anteaya has joined #openstack-infra12:49
anteayahashar: zul builds packages but I think his are ubuntu, I don't know if he also does debian packages, zigo builds debian packages12:55
hasharanteaya: yup zigo does the openstack packages12:56
hasharand pabelanger does the infra ones12:56
Mithrandirhmm, does something like https://gist.github.com/tfheen/5d667003aba41164eab0 make sense?12:56
Mithrandir(yes, it needs adding the delete options too)12:56
*** pabelanger has quit IRC12:56
Mithrandirand it needs to validate that it added the job itself.12:56
anteayahi dukhlov_ in order to help you anymore, I think I need to see a stacktrace please, including the command you are trying to run12:56
hasharanteaya I though one more people was doing the infra packages as well.  I wiil catch up with pabelanger.  I could use a package for the python 'gear' module :-] thx!12:56
anteayahashar: may you get your package12:57
anteayaMithrandir: I know so little about Jenkins Job Builder, my opinion wouldn't count for much, but I did look at the diff12:57
anteayahopefully someone with more JJB experience than I will be around soon to weigh in12:58
Mithrandiranteaya: basically, I want to be able to say "purge obsolete jobs"12:58
anteayaa valuable function12:58
hasharMithrandir: there is a delete-all command12:58
hasharMithrandir: though that would delete any job12:59
Mithrandirhashar: yes, so it's not what I want.12:59
annegentle_jd__: aroo12:59
hasharMithrandir: ah you only want to delete jobs which are not configured in JJB. Clever!12:59
MithrandirI want to delete obsolete jobs, not all jobs.  We still have some hand-maintained jobs.12:59
hasharmy recommendation would be to push your change in Gerrit12:59
Mithrandirhashar: no, I want to delete those which are no longer configured by jjb.12:59
Mithrandirwhich is subtly different.12:59
hasharand if it is not really ready, mark it as a work in progress with the [WIP] button in Gerrit12:59
Mithrandirhashar: sure, and I will eventually.12:59
hasharthat will attract reviewers :-]  We are a bunch looking at the changes submitted13:00
MithrandirI was hoping to lure jeblair or mordred to comment, really. :-P13:00
annegentle_jd__: for docs.o.o/dev/project name we don't publish point releases13:00
hashari like that feature myself13:00
Mithrandirhashar: I already have a bunch of patches in, I know the flow.13:00
Mithrandirthanks for the pointers though13:00
hashar\O/13:00
annegentle_jd__: I think that the jobs push from master13:00
lifelesswoo, got a server up and self registered. yay.13:00
annegentle_jd__: master only13:00
annegentle_jd__: we do backport from openstack-manuals to prior releases13:01
anteayaMithrandir: mordred won't be lured to look at anything 'til next week13:01
anteayahe is at burning man13:01
annegentle_jd__: you can backport docs to past releases from ceiliometer/doc/source/ so that someone could build locally, but they're not published to the web13:01
jd__annegentle_: reading the infra code, I'm under the impression there's no distinction (that's why I aksed here in the first place)13:01
annegentle_jd__: yep that's accurate13:01
jd__annegentle_: could you publish stable releases documentation too then?13:02
lifelessclarkb: / jeblair: is the puppet dashboard meant to be anonymous-access?13:02
annegentle_jd__: swift was the only project who wanted to, and it became too much trouble/maintenance for the value13:02
anteayajeblair has been working on overdrive for the past two weeks and will show up in a few hours, I try to answer the phone in the first couple hours of my day to relieve some of the pressure on him13:02
jd__annegentle_: people deplying Grizzly reads the Havana-dev documentation online right now, that doesn't seem like a good thing13:02
annegentle_jd__: but it's dev doc, deployers should read deployer doc13:02
annegentle_jd__: to me that's the distinction13:02
jd__annegentle_: we don't have a deployer doc :(13:03
*** ruhe has quit IRC13:03
lifelessjd__: working up to it :)13:03
*** amotoki has quit IRC13:03
jd__annegentle_: our deployer doc is in our dev doc :(13:03
annegentle_jd__: it would belong in openstack-manuals13:03
anteayalifeless: \o/13:03
annegentle_jd__: I know13:03
annegentle_jd__: and it's okay, but do take some steps13:03
jd__annegentle_: I get it :)13:03
lifelessanteaya: https://github.com/testing-cabal/ci-config/tree/testcabal13:03
jd__annegentle_: well, (how) can we help?13:03
*** olaph has quit IRC13:03
lifelessanteaya: in addition to the somewhat large stack I have floating on top of openstack-infra/config in gerrit ;)13:04
anteayawahoo, look at that13:04
anteayaha ha ha13:04
jd__annegentle_: having the deployer documentation outside our repository seems also quite problematic since our API documentation is automatically generated from the source code for example13:04
*** olaph has joined #openstack-infra13:05
annegentle_jd__: your API docs are very deployer oriented, I realize, where most other projects their API docs are for end-users13:05
annegentle_jd__: we can figure this out13:05
jd__annegentle_: well our API is user oriented too since we got alarming13:06
annegentle_jd__: we already scrape a bunch of config info from the other projects, how about automating to put into the Config Ref13:06
annegentle_jd__: here's the lay of the land13:06
*** dims has quit IRC13:06
anteayalifeless: this is awesome13:06
jd__annegentle_: yeah generating configuration information is another problem indeed :(13:06
anteayain other news, the gate is empty13:07
annegentle_jd__: http://paste.openstack.org/show/45468/13:07
annegentle_jd__: hopefully we can get your docs into this sort of pattern13:07
annegentle_jd__: sorry, typo in the paste13:07
*** vogxn has joined #openstack-infra13:08
annegentle_jd__: but hopefully it gives you the idea13:08
jd__annegentle_: yes, I get it13:08
jd__annegentle_: what's the motivation to have documentation outside the projects?13:09
lifelessincoming13:09
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439113:09
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438413:09
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438313:09
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439413:09
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439513:09
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439313:09
annegentle_jd__: the tools selected did not enable translations at the time. That's not the whole story but https://wiki.openstack.org/wiki/WebContentRequirements gives more indepth requirements that Sphinx didn't meet.13:10
annegentle_jd__: doesn't mean we can't revisit, and obviously we are all the time, but when you have to take 12 projects into account you make choices13:11
jd__annegentle_: sure, I'm just trying to get the context :)13:11
annegentle_jd__: when people come to docs.openstack.org, they want OpenStack docs. We need to get Ceilometer fitting into the install guide, configuration guide, end user guide, admin user guide, and so on13:11
jd__I'm already embarassed we are not better at documentation13:11
annegentle_jd__: I love this morning's post so I know you're on the right track13:12
jd__annegentle_: my thinking is, it would be better to force people to update documentation with their patches if all the documentation was in our repository13:12
annegentle_jd__: I do prefer docs checked in with code and it's mortifying as I go through DocImpact bugs now how little I have to go on.13:12
*** w_ has joined #openstack-infra13:12
annegentle_jd__: yes, do force update docs, use DocImpact, use commit messages for docs that can be integrated elsewhere, all of it13:12
jd__yeah I don't think DocImpact is a good solution for you13:12
*** ruhe has joined #openstack-infra13:13
jd__I'd prefer to have the people writing/modifying the feature to update the doc at the same time13:13
jd__annegentle_: maybe we could experiment something on Ceilometer about this, like having API doc and deployer doc etc in the project rather than outside?13:13
annegentle_jd__: you're not core so go ahead :)13:14
annegentle_jd__: I really would encourage an entry on api.openstack.org/api_ref.html at a minimum13:14
*** ruhe has quit IRC13:14
*** mriedem has joined #openstack-infra13:15
*** olaph has quit IRC13:15
jd__annegentle_: ok13:15
jd__I'll go through this and try to build some tasks we can tackle to advance on that matters13:16
annegentle_jd__: and we have almost no DocImpact from ceilometer that I can see. We automated doc bug generation from that so ideally we'd have more of those from the repo and automation13:16
*** DennyZhang has joined #openstack-infra13:16
annegentle_jd__: sounds good. I can help prioritize as I'm sure it's a bit overwhelming now.13:16
jd__annegentle_: hm anyway, what would you do with Ceilometer's DocImpact?13:16
jd__(with the current doc status)13:16
annegentle_jd__: in any commit that affects docs, put DocImpact and enough info to write docs from or docs themselves.13:16
*** ruhe has joined #openstack-infra13:16
*** w_ has quit IRC13:17
annegentle_jd__: go through your merged commits and log doc bugs manually13:17
jd__annegentle_: but who and where this doc will be written? :)13:17
jd__s/who/by who/13:17
annegentle_jd__: your devs, your deployers13:17
annegentle_jd__: and I can help recruit13:17
jd__annegentle_: ok that's the problem, nobody's doing it :D13:17
annegentle_jd__: well, yes. :)13:17
jd__but I get the picture13:17
annegentle_jd__: you have several deployers to ask though13:17
jd__such as?13:18
annegentle_jd__: Ryan_Lane, right13:18
annegentle_jd__: sandywalsh, I think13:18
jd__ack :)13:18
annegentle_jd__: perhaps "several" is an exaggeration :)13:19
annegentle_jd__: seems like more than a few though13:19
jd__yes, for sure13:19
*** olaph has joined #openstack-infra13:20
*** sandywalsh_ has joined #openstack-infra13:20
*** mriedem has quit IRC13:21
*** dina_belova has joined #openstack-infra13:22
sandywalsh_jd__, ah, just read the email ... makes sense now. We'll need some help from annegentle_ to understand what the "state of the art" is for openstack docs these days.13:23
sandywalsh_annegentle_, is there a "how to write docs for openstack" doc?13:24
sandywalsh_:)13:24
*** sandywalsh has quit IRC13:24
*** dims has joined #openstack-infra13:24
*** mriedem has joined #openstack-infra13:24
*** w_ has joined #openstack-infra13:24
annegentle_sandywalsh_: of course! http://wiki.openstack.org/Documentation/Howto13:26
annegentle_er13:26
annegentle_http://wiki.openstack.org/Documentation/HowTo13:26
*** dina_belova has quit IRC13:27
*** olaph has quit IRC13:27
annegentle_how do I find a list of core members of any project team?13:30
annegentle_this one didn't work https://launchpad.net/~neutron-core/+members#active13:30
sandywalsh_annegentle_, thanks ... I'll get freshened up on that and try to allocate some time. The RC-phase might be good for that.13:30
pblahoannegentle_: I think you can try https://review.openstack.org/#/admin/groups/13:31
annegentle_pblaho: ah that's it, thanks13:31
sandywalsh_https://launchpad.net/~ceilometer-drivers/+members#active13:31
sandywalsh_pblaho, that's a handy link ... saved. thanks13:32
*** DennyZhang has quit IRC13:33
pblahoannegentle_: sandywalsh_ : no problem13:33
*** tstevenson has joined #openstack-infra13:38
tstevensonmorning13:39
*** DennyZhang has joined #openstack-infra13:42
*** w_ has quit IRC13:43
anteayamorning tstevenson13:44
annegentle_can I talk to someone (I think it was clarkb or fungi) about what it means to shallow clone a git repo to reuse the content?13:44
annegentle_such as, does that happen at build time?13:46
*** w_ has joined #openstack-infra13:47
*** boris-42 has quit IRC13:48
annegentle_and, is it part of a script?13:48
*** russellb is now known as rustlebee13:49
anteayaah yes, Friday13:49
*** anteaya is now known as ColinMochrie13:50
ColinMochriebnemec: oh Ryan13:50
*** w_ has quit IRC13:50
*** prad_ has joined #openstack-infra13:51
*** burt has joined #openstack-infra13:53
*** jog0 is now known as flashgordon13:53
*** datsun180b has joined #openstack-infra13:53
*** pblaho has quit IRC13:54
*** pblaho has joined #openstack-infra13:55
*** ruhe has quit IRC13:56
*** alexpilotti has joined #openstack-infra13:57
*** fifieldt has quit IRC14:02
ColinMochrieif anyone is struggling to figure out how to use rvm (Ruby Version Manager) - potentially useful for puppet installations, here is an 8 minute introductory screencast that explains the basics: http://screencasts.org/episodes/how-to-use-rvm the narrator has a very friendly voice14:02
*** ruhe has joined #openstack-infra14:03
*** ruhe has quit IRC14:11
*** jamiem has joined #openstack-infra14:12
*** ruhe has joined #openstack-infra14:14
*** thedodd has joined #openstack-infra14:16
*** vogxn has quit IRC14:18
*** thedodd is now known as jim14:19
*** gaelL has quit IRC14:19
*** jim is now known as Guest4455114:19
*** Guest44551 has quit IRC14:20
*** thedodd has joined #openstack-infra14:21
ColinMochriepleia2: as I read the docs on puppet-dashboard, I'll share some thoughts14:22
*** dina_belova has joined #openstack-infra14:23
ColinMochriefirst up, major development seems to have stopped about 2 years ago, puppet-dashboard depends on ruby 1.8.7 which is an old version of ruby and isn't really being supported anymore14:23
ColinMochrieruby 1.9.x is the ruby of choice currently and ruby 2 has been released14:23
mgagneColinMochrie: puppet-dashboard is now maintained by Aaron Stone14:24
ColinMochrieso the latest round of ruby/rails security issues, I have forgotten exactly but it was database related means that ruby 1.8.7 will be vulnerable14:24
ColinMochriemgagne: good to know14:24
ColinMochrieis he available for a conversation and where would I find him?14:24
ColinMochrieI'll change to my real nick if he is up for a chat14:25
*** ColinMochrie is now known as anteaya14:25
mgagneColinMochrie: puppetlabs only put efforts in the enterprise dashboard which I think is called Puppet Console14:25
anteayaright14:25
anteayawhich leaves us out, since we don't use enterprise14:25
mgagneanteaya: there is some alternative outside puppetlabs but don't know how they compare to dashboard14:26
anteayamgagne: I'm willing to look14:26
anteayahave you googleable terms or urls?14:26
anteayaI have to find something that plays nice with what we have14:27
mgagneanteaya: foreman is the one I know about, it comes with a provisioning tool too I think14:27
anteayaokay I will look at foreman, is it ruby?14:27
*** dina_belova has quit IRC14:28
*** ruhe has quit IRC14:29
*** SergeyLukjanov has joined #openstack-infra14:29
mgagneanteaya: looks to use ruby14:29
anteayamgagne: http://theforeman.org/ ?14:29
mgagneanteaya: yes14:29
anteayanot sure that is what we want14:29
anteayawe are looking for a gui to inferface with what puppet is already doing14:30
mgagneanteaya: as I said, it is a provisioning tool which happens to use puppet. There is a dashboard people are talking. I don't know how easy it would be to strip/disable the provisioning part and only use the dashboard14:30
anteayaah okay, I think I get it now14:30
mgagneanteaya: or if it plays well with an existing installation14:31
anteayawe are just looking for a dashboard to interface with current provisioning14:31
*** gaelL has joined #openstack-infra14:31
anteayaperhaps figuring out how I talk with Aaron Stone is a better direction14:32
anteayado you know him?14:32
mgagneanteaya: =)14:32
anteaya:D14:32
mgagneanteaya: not personally, I just happened to read a tweet about him taking over puppet dashboard14:32
anteayaah okay thanks14:33
anteayaa little bird told you14:33
anteaya:D14:33
mgagneanteaya: should be him: https://github.com/sodabrew14:34
anteayawell foreman will use ruby 1.9 as well as 1.8 so there's that14:34
*** comstud is now known as bearhands14:34
mgagneanteaya: https://github.com/sodabrew/puppet-dashboard14:35
anteayayeah14:35
anteayathis is a step up, you can use 1.9.314:35
anteayamight be worth spinning this up on a test node to see if we can get it working14:35
mgagneanteaya: background info about him willing to take over dev: https://groups.google.com/forum/#!msg/puppet-users/j44EbTJY7HI/EQSJgh-g1fgJ14:36
anteayaoh thank you14:36
* anteaya reads14:36
anteaya"I started porting to Rails 3 last week" written about a year ago - yay!14:37
anteayathis is much better14:37
*** ruhe has joined #openstack-infra14:38
anteayathough the whole use of puppet dashboard looks like a project with a short shelf life14:40
*** boris-42 has joined #openstack-infra14:40
*** rnirmal has joined #openstack-infra14:42
anteayathanks mgagne14:42
mgagneanteaya: np14:43
mgagneanteaya: I'll keep an eye on what you will choose, I'm interested in your conclusions =)14:43
*** sandywalsh_ has quit IRC14:44
*** UtahDave has joined #openstack-infra14:45
*** markmcclain has joined #openstack-infra14:47
ttxanteaya: reviewing your election setup guidelines. Why are you advising to check the "Present choices on voting page in exactly the given order" box ?14:52
anteayamgagne: thanks I welcome your opinions during the conversation14:58
anteayattx: thanks for reviewing14:59
anteayato enforce an alphabetical order if that was what was input14:59
anteayaplease remove if you disagree14:59
dukhlovanteaya: Hello14:59
anteayadukhlov: hello14:59
anteayahave you a paste?15:00
ttxanteaya: yeah, I disagree... numerous studies prove that the order influences the voters, so randomizing the order helps in having a fair election15:00
ttxanteaya: willfix15:00
anteayattx great thank you15:00
*** dina_belova has joined #openstack-infra15:00
*** sandywalsh_ has joined #openstack-infra15:00
anteayaI didn't know we had been going with randomized order previously15:01
dukhlovanteaya: regarding my yersterday problem (fatal: ICLA contributor agreement requires current contact information.)... I found out the cause15:02
anteayagood15:02
anteayawhat was it?15:02
dukhlovanteaya: I registered with launchpad as 'dukhlov' vith mail 'dukhlov@mirantis.com' then I went to review.openstack.org and review profile was created automatically with username dukhlov15:04
dukhlovanteaya:then I had a problem with launchpad and resigned launchpad accaunt. After thar when I came to review.openstack, it seems that new review profile was created15:06
anteayaah15:06
ttxanteaya: made a few modifications to https://wiki.openstack.org/wiki/Election_Officiating_Guidelines . Please review :)15:06
* anteaya reviews15:06
ttxoh. forgot something15:07
dukhlovanteaya: and it have empty username and when I entrered 'dukhlov' it was rejected and I entered 'dyx'15:07
dukhlovanteaya:so, my current solutiom is the next: I set up gitreview.username=dyx in my git configuration and all works fine15:08
anteayaah ha, that would do it dukhlov15:08
ttxanteaya: posted new version with a warning about locale. That bit me in the past15:09
anteayaokay, well know we know you have two accounts, I will ask clarkb or fungi once he gets back to look at the db and clean it up so we don't have a ghost entry for you, that has happened before15:09
anteayadukhlov: glad you have it working and thanks for telling me what happened15:09
*** Bada has quit IRC15:10
anteayadukhlov: please remind me next week to see if the db clean up for your account(s) have taken place15:10
ttxOh, and something else15:10
* anteaya stands by15:10
anteayaha ha ha15:10
anteayabet the french invitations to vote were well received :D15:11
ttxanteaya: they were.15:12
anteayaha ha ha15:12
ttxadded a bit on picking election officials15:12
anteayaokay /me reviews again15:14
anteayathis is great, thanks ttx15:15
anteayaI missed a few things officiating this election and will do a better job next time15:15
anteayathis election is only 2 days long and I was asked not to do a detailed results report, I will fix those next time15:16
ttxanteaya: the detailed results report lets us run the anonymized ballots through alternative, experimental algorithms and check if they would have given better results15:17
anteayattx okay, good to know15:18
anteayaI will do so henceforth15:18
*** [wchrisj_ has joined #openstack-infra15:19
ttxanteaya: (we are considering moving the the "proportional representation" option but it's a bit of a mystery what it would do, so we want to run a few elections results through it to test15:19
ttxs/the the/to the/15:19
anteayaah okay15:19
ttxno big deal if that election missed it15:19
anteayayes, the enforce proportional representation checkbox had me wondering too, glad you are evaluating that setting15:19
anteayattx okay thanks15:20
*** boris-42 has quit IRC15:20
clarkbgood morning15:29
jeblairclarkb: good morning15:30
jeblairclarkb: are you caught up on code review?  i mean, obviously not stuff since yesterday, but there are a few things i reviewed a few days ago that you haven't reviewed15:30
ttxclarkb, jeblair: hola15:30
jeblairclarkb: wondering if you're still working on catching up or missed them.  eg: https://review.openstack.org/#/c/40498/15:31
jeblairttx: hola!15:31
anteayamorning clarkb and jeblair15:31
*** Protux has joined #openstack-infra15:31
* ttx reposts questions lost in backlog15:31
ttx<ttx> jeblair: trying to push initial commit for openstack/governance (with basic structure and .gitreview) but it does not seem to be in gerrit yet15:31
ttx<ttx> could be a side-effect of not having "upstream" set for it in review.projects.yaml15:31
jeblairttx: ah, it's probably just manage_projects breaks about half the time it runs :(15:32
jeblairrunning it manually15:32
ttxjeblair: let me know when it's up, I've got an initial commit for it15:32
*** neelashah has joined #openstack-infra15:33
clarkbjeblair: probably a little bit of both. I know I am behind but have tried to skim the list and review important bits15:34
*** vogxn has joined #openstack-infra15:34
clarkbjeblair: I plan on trying to catch up today15:34
jeblairFailed to add groups file for project: stackforge/clouddocs-maven-plugin15:35
clarkbjeblair: arg that is a known issue15:35
clarkbjeblair: let me push a fix now before I can forget again15:35
*** DennyZhang has quit IRC15:35
*** bpokorny has joined #openstack-infra15:35
neelashahDoes anyone know if there are issues currently with gate-nova-python27?15:35
anteayaneelashah: what are you seeing?15:36
anteayacan I get the url to a log?15:36
neelashahanteaya: http://logs.openstack.org/79/30479/14/check/gate-nova-python27/c8aebbe/console.html15:36
* anteaya looks15:37
neelashahits failing 27 at the gate15:37
dstufftmordred: possibly relevant to your interests http://www.python.org/dev/peps/pep-0453/15:37
anteayaERROR: InvocationError: '/home/jenkins/workspace/gate-nova-python27/.tox/py27/bin/python setup.py testr --slowest --testr-args='15:38
anteayadstufft: he is away until next week and told me he won't be reading backscroll, I suggest you try him then15:38
dstufftokies15:39
anteayaUnknownMethodCallError: Method called is not a member of the object: __deepcopy__15:39
anteayaneelashah: I'm just pulling out stuff that might be helpful for clarkb or jeblair15:40
neelashahthanks anteaya15:40
clarkbneelashah: anteaya: That looks like a valid failure of the test15:42
*** boris-42 has joined #openstack-infra15:43
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add Gerrit ACLs for clouddocs maven plugin project  https://review.openstack.org/4447115:43
clarkbjeblair: ^ that should fix the manage_projects error you saw15:43
anteayathanks clarkb, glad it isn't an infra issue15:43
clarkbjeblair: manage_projects should configure other projects even with that error though15:43
clarkbnow time for code review15:43
neelashahok clarkb, thanks - something must have changed in underlying code since it last passed jenkins15:43
*** mrodden has quit IRC15:43
neelashahthanks anteaya15:44
clarkbneelashah: very possible15:44
clarkbwe merge a lot of code15:44
jeblairclarkb: https://jenkins.openstack.org/job/nova-upstream-translation-update/4020/console15:44
*** thomasbiege has joined #openstack-infra15:45
anteayathanks for the log neelashah, hope you track down the error15:45
clarkbjeblair: looks like openstackjenkins was removed from the nova maintainer list? /me looks on transifex15:45
*** fbo is now known as fbo_away15:46
clarkbjeblair: yup https://www.transifex.com/projects/p/nova/edit/maintainers/15:46
clarkbjeblair: do we want to check with fifieldt before adding jenkins again?15:46
*** sgviking has quit IRC15:47
jeblairclarkb: why?  i mean, it's great talking to him, but it just seems like a straightforward oversight...15:48
*** sgviking has joined #openstack-infra15:49
clarkbjeblair: maybe it was intentional? though at this point Transifex has changed so much stuff behind the scenes and this is probably related to something transifex did and not fifieldt15:49
*** boris-42 has quit IRC15:50
jeblairclarkb: weird; openstackjenkins is a maintainer of the openstack hub project15:51
clarkbjeblair: there is a Nova_old, I wonder if this is related to the en_US -> en transition15:51
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377915:51
*** markmcclain has quit IRC15:51
clarkbjeblair: it is possible fifieldt did not add jenkins to the maintainers list so that we could make sure the jenkins scripts output files with the correct source local for the .pot15:52
dukhlovanteaya: ok, thank you15:52
*** boris-42 has joined #openstack-infra15:52
flashgordonclarkb: ping15:53
clarkbflashgordon: pong15:53
jeblairclarkb: ok; we can wait, though i think his weekend has started15:53
*** fbo_away is now known as fbo15:53
clarkbjeblair: the whole en vs en_US thing is a bit of a mess15:53
flashgordonclarkb: so once I get the large-ops job sorted out fully and running what is the next step15:53
jeblairclarkb: true, i don't want to make it worse.15:53
*** dkehn has quit IRC15:54
flashgordonwould it be possible to get it to gate, and if not can we get it to run periodically and email or something when it fails?15:54
clarkbjeblair: tl;dr is horizon cannot do en_US, transifex only shares translation memory if the source locale is the same across projects so all projects with en_US (I think this is the default on our ubuntu machines) need to transition to en15:54
flashgordonclarkb: also is it possible to graph the test duration over time.15:54
jeblairi wonder if pootle has that restriction15:55
*** dkehn has joined #openstack-infra15:55
jeblairclarkb: so, puppet is running on gerrit, but when i run it by hand, it is doing stuff15:55
clarkbflashgordon: next step is probably into silent pipeline or non voting (to gather data), then when happy with results there we can gate it15:55
*** [wchrisj_ has quit IRC15:56
clarkbflashgordon: test duration isn't logged in an easily consumable place.15:56
*** hashar has quit IRC15:57
jeblairgraphite15:57
clarkbis duration in graphite now?15:57
jeblairclarkb: i think it has been for a while15:57
jeblairlemme check15:57
flashgordonclarkb: what is the silent pipeline?15:57
clarkbflashgordon: it is equivalent to the check pipeline but it does not report to gerrit15:58
clarkbflashgordon: so you can run a lot of tests on real patchsets without noise on reviews15:58
clarkbgood for gathering data15:58
flashgordonclarkb: where can you see the results from it?15:58
*** ruhe has quit IRC15:58
clarkbflashgordon: on logs.openstack.org/GITSHA[:2]/GITSHA/silent/$NAME_OF_TEST15:59
clarkbflashgordon: or in elasticsearch or in jenkins15:59
*** ruhe has joined #openstack-infra15:59
*** markmcclain has joined #openstack-infra16:00
clarkbjeblair: https://review.openstack.org/#/c/40498/ reviewed, it needs a rebase16:00
flashgordonclarkb: cool anything in silent pipeline today?16:00
flashgordonI don't see anything in stats/zuul16:00
clarkbflashgordon: no I don't think anything is using it today16:01
jeblairflashgordon: but it's all configured, all you need to do is shift the job to 'silent:' instead of 'experimental:' in layout.yaml16:01
*** reed has joined #openstack-infra16:01
jeblairhttp://graphite.openstack.org/render/?width=586&height=308&_salt=1377878483.97&lineMode=connected&drawNullAsZero=true&from=-72hours&target=stats.timers.zuul.pipeline.experimental.job.gate-tempest-devstack-vm-large-ops.FAILURE.mean&target=stats.timers.zuul.pipeline.experimental.job.gate-tempest-devstack-vm-large-ops.SUCCESS.mean&target=stats.timers.zuul.pipeline.check.job.gate-cinder-pep8.SUCCESS.mean16:02
jeblairhrm16:02
jeblairi don't see data for large-ops, but you can see that cinder job does have data16:02
flashgordonjeblair: neat, it would be really slick if there was a way to just list all the runs16:02
flashgordonfor silent pipeline16:03
jeblairflashgordon: yes, as-is you have to hunt for it.  you can get results by searching logstash...16:04
flashgordonwhen ther was one jenkins master that was easy in jenkins but don't know how to check now that we have 316:04
jeblairflashgordon: you can get stats from graphite16:04
jeblairflashgordon: you can look at individual changes through gerrit -- follow a check run and then go up a directory on logs.o.o and you'll find the silent runs16:04
jeblairflashgordon: you can still go to jenkins01 and 02 individually and look at the run history there16:05
jeblairflashgordon: (obviously, that may be harder to scale in the future)16:05
ttxjeblair: I get a "no common ancestry" when I try to git review an openstack/governance change16:05
anteayapleia2 I haven't read all the backscroll from last night, but the upshot that I get is you want to spin up a new puppet dashboard on a test node and if stable transition over to it16:06
ttxjeblair: should I try to clone the repo again ?16:06
jeblairttx: yay it ran16:06
pleia2anteaya: thanks for looking into dashboard, was just catching up16:06
ttxOh16:06
anteayapleia2: to that end, mgagne pointed me to: https://github.com/sodabrew/puppet-dashboard which accepts the use of ruby 1.9.3 (a more secure ruby than 1.8.7) and looks like it uses rails 316:06
ttxyou pushed .gitreview, that explains it16:06
flashgordonjeblair: ahh http://graphite.openstack.org/graphlot/?width=586&height=308&_salt=1377878787.545&target=stats.zuul.pipeline.experimental.job.gate-tempest-devstack-vm-large-ops.FAILURE&target=stats.zuul.pipeline.experimental.job.gate-tempest-devstack-vm-large-ops.SUCCESS16:07
ttxjeblair: willfix16:07
anteayapleia2: at first blush, I vote for a trial of the sodabrew dashboard on a node and see what happens16:07
*** bpokorny has quit IRC16:08
jeblairttx: yeah, you may have created your own local repo; you'll want to re-clone, and probably just "patch <" whatever you have in your local one16:08
anteayamight alleviate a host of problems of compatibility we are locked into with our current puppet-dashboard, like db upgrades and such16:08
pleia2anteaya: so ruby 1.8.7 is in Ubuntu 12.04 main, which means canonical has committed to keeping it up security-wise for 5 years from release16:08
openstackgerritA change was merged to openstack-infra/config: Build Basic Install Guide for openSUSE  https://review.openstack.org/4298816:08
jeblairclarkb: so why did puppet agent --test do something; was it --disabled ? know how i can tell?16:08
anteayapleia2: the problem is that the ruby community hasn't16:09
pleia2anteaya: our servers run precise, no newer version of ruby there16:09
*** bpokorny has joined #openstack-infra16:09
anteayapleia2: the ruby community has moved on to 1.9.316:09
pleia2anteaya: yeah, even when upstream doesn't take care of it, canonical takes on that burden (in theory)16:09
clarkbjeblair: if it was --disabled puppet agent --test would be disabled as well. Maybe the agent got itself stuck (deadlock, busy loop, etc)?16:09
anteayapleia2: well you know canonical better than I, so I defer to your judgement in that area16:10
jeblairclarkb: ok, i'll just restart it16:10
*** ruhe has quit IRC16:10
anteayapleia2: then we are into rails 3/1.8.7 issues vs rails 3/1.9.3 issues16:10
pleia2anteaya: well, it would be interesting to know exactly what the problems are with it and check to see if the appropriate bugs have been filed and/or fixed16:10
jeblairclarkb: (i did not see signs of it getting hung in the usual ways)16:10
*** ArxCruz has quit IRC16:10
anteayaassuming the sodabrew repo is indeed using rails 3, I haven't confirmed that yet16:10
openstackgerritA change was merged to openstack-infra/config: Add slow heat job to devstack experimental for debug  https://review.openstack.org/4397116:10
clarkbanteaya: pleia2: we will definitely need to start thinking about newer puppet in part because newer ruby is in use in a bunch of places16:10
anteayapleia2: ahh16:11
*** dina_belova has quit IRC16:11
pleia2clarkb: are we using newer ruby on precise, or elsewhere?16:11
anteayayeah, the better work is spent on moving to newer ruby16:11
clarkbpuppetlabs doesn't publish python2.7 for hosts without ruby 1.816:11
anteayanewer ruby is 1.9.316:11
clarkbpleia2: when we tried to use fedora slaves they all use newer ruby16:11
*** dina_belova has joined #openstack-infra16:11
anteayaand considering ruby 216:11
pleia2clarkb: ah, ok16:11
clarkbso we couldn't install puppet 2.7 from puppetlabs16:11
* pleia2 nods16:12
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377916:12
*** nicedice_ has joined #openstack-infra16:12
anteayapleia2: one of the strengths/weaknesses of the ruby community is its speed, speed of development16:12
anteayapleia2: but they are not known for long term backwards support16:13
clarkbjeblair: https://review.openstack.org/#/c/43991/ I haven't approved that because of the en/en_US thing. I will look into forcing babel to use en16:13
anteayawhich is one of the major frustrations with ruby16:13
pleia2anteaya: yeah, makes it tricky to use packages shipped with an os16:13
anteayapleia2: yeah, I never do myself16:13
anteayapleia2: the ruby community basically has an expectation that you upgrade your ruby constantly if not more often16:14
ttxjeblair, anteaya: feel free to early comment on structure/file formats @ https://review.openstack.org/#/c/44489 - before I push that to the rest of the TC16:14
pleia2anteaya: seems like a lot of work :)16:14
anteayapleia2: and those that don't aren't granted much sympathy16:14
anteayapleia2: it is, but keeps you on the bleeding edge, one of the attractions for working with ruby16:14
* anteaya reviews16:15
pleia2anteaya: tbh most software is like this, backporting is hard, makes it easier for them not to support old things, if we made a special case for everyone we'd never get any work done16:15
ttxjeblair, anteaya: also we are missing the groups16:15
pleia2not saying we shouldn't make a special case, just that it has to be considered carefully16:15
anteayapleia2: very true16:16
*** dina_belova has quit IRC16:16
ttxjeblair, anteaya; I mean, the tc-committee-chair group16:16
anteayaI'm just sharing why in my opinion spinning up something that uses 1.8.7 when we have an option that uses 1.9.3 will pigeonhole us soon16:16
*** fbo is now known as fbo_away16:16
pleia2anteaya: I'm thinking we should get some notes together on what it would take to run this newer dashboard in development (I can toss something up on a test server today) and then chat about it with everyone at a meeting or something, I'd like to have fungi's input too16:17
anteayattx yes, I had wondered how the tc-committee group and the tc-committee group get added16:17
anteayapleia2: +16:17
anteayapleia2: I can help16:17
ttxanteaya: tech-committee is there. Only missing tech-committee-chair with me in16:17
BobBallhmmmmm - what's the recursive rebase message about? Zuul said: Your change requires a recursive merge to resolve and asked me to rebase.  I've done a rebase to gerrit/master but it "just worked" so I don't have much confidence that resubmitting it will work any better?16:17
anteayaif I have shell access to the test server, I can spin it up, or help you16:17
ttxanteaya: would be great if tech-committee-chair could edit tech-committee members too16:18
anteayattx ah okay, sorry two directions at the same time :D16:18
anteayaI'm sure you know the dance well16:18
clarkbjeblair: I am beginning to wonder if this is purely a transifex issue. .pot files don't seem to have a specific source locale16:18
jeblairclarkb: governance repo has no acl in gerrit :(16:18
* reed about to rant .... 16:18
reedthis dude, I send him a private message and he replies including a mailing list!16:19
*** markmcclain has quit IRC16:19
jeblairi will run manage-projects again16:19
ttxreed: yay16:19
reeda private message ... to a mlist!16:19
anteayaBobBall: this is zuul's way of saying that your patch might have merged with a lot of work, but it kicked it out and asked you to rebase to increase the chances of other patches merging16:19
* ttx disappears, it's way past beer o'clock time16:19
reedttx, back in France?16:19
clarkbBobBall: Gerrit uses jgit which is different than Cgit which makes merges slightly odd. Zuul is now trying to approximate what Gerrit does with jgit. tl;dr local merges may not be a good indication of what Gerrit will do16:19
ttxreed: yep16:19
reedttx, have a good beer16:19
BobBallheh... nice :D ok16:20
clarkbif anyone knows how to set the source locale for a .pot such that transifex will learn about it correctly please let me know, but I can't find anything.16:20
BobBallwell I'll do what it says... I can follow instructions even if I don't understand why ;)16:20
clarkbI really think this may be a transifex thing. Maybe the tx command can set it?16:20
anteayajeblair: have I erred on my original governance repo creation patch?16:20
anteayaor is this the manage_repos bug you mentioned earlier?16:21
*** pblaho has quit IRC16:21
anteayaBobBall: it helps to chant an incantation and spin a rubber chicken in the air16:22
clarkbhttp://support.transifex.com/customer/portal/articles/996211-pushing-new-translations doesn't indicate a way to set the source locale16:22
* BobBall gets the rubber chicken out again16:22
BobBallFourth time I've needed to use that today!16:22
anteayaha ha ha16:22
anteayahelps to keep the chicken handy16:22
*** dina_belova has joined #openstack-infra16:23
*** markmcclain has joined #openstack-infra16:24
pleia2anteaya: it's going to take me some time to get around to -dashboard today, in the meantime can you update https://bugs.launchpad.net/openstack-ci/+bug/1218631 with version info, location, etc of new dashboard we should be trying?16:26
uvirtbotLaunchpad bug 1218631 in openstack-ci "Build new puppet-dashboard server" [Undecided,New]16:26
openstackgerritA change was merged to openstack-infra/config: Fix new sqlalchemy-migrate jobs  https://review.openstack.org/4402116:27
anteayapleia2: can do, I think I will try to read a bit more first but I will update with what I have soon16:27
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377916:27
* anteaya heads for lunch16:27
pleia2anteaya: perfect, thank you!16:27
anteaya:D16:27
jeblairclarkb: if manage-projects fails to do anything with the acl file, what do we do?16:28
*** BobBall is now known as BobBallAway16:28
clarkbjeblair: was there a traceback when run manually?16:28
jeblair(after mordred gets back, i don't intend to approve any new projects until this is fixed)16:28
jeblairclarkb: nope, just silently exited16:28
jeblairexcept for that one error from earlier16:28
clarkbjeblair: usually fails to do things with ACL files are a result of a syntax error in the file16:29
jeblairbut no traceback16:29
clarkbI thought that generated a traceback when the git push failed, but I could be mistaken16:29
openstackgerritA change was merged to openstack-infra/config: Generate heat docs on check and gate  https://review.openstack.org/4323416:29
*** hemnafk is now known as hemna16:30
jeblairof course manage-projects --help16:30
jeblairjust runs manage-projects again16:30
jeblairgithub.GithubException.GithubException: 403 {u'message': u'API rate limit exceeded for openstack-project-creator. See http://developer.github.com/v3/#rate-limiting for details.'}16:30
jeblairthat's exciting16:30
clarkbnice16:31
clarkbthere are print messages for the ACL push failure (so not tracebacks but you should get a message)16:31
*** gyee has joined #openstack-infra16:32
jeblairclarkb: i can not think of a way to debug this16:33
*** thomasbiege has quit IRC16:33
jeblairthis seems like a black box.  no logging, no debug mode, no verbose mode, no noop mode, nothing.16:33
clarkbit has "logging"16:34
jeblairit logs to /dev/null16:34
jeblairso it has webscale logging.  great.16:34
clarkbjeblair: creating a pruned projects.yaml so that you are only interacting with the problem project and running in pdb may be the immediate answer16:35
clarkbthat will help keep the github rate limiter happy and simplify debugging16:36
*** nati_ueno has joined #openstack-infra16:37
*** nati_ueno has quit IRC16:38
*** nati_ueno has joined #openstack-infra16:38
*** ArxCruz has joined #openstack-infra16:44
*** dina_belova has quit IRC16:47
openstackgerritJames E. Blair proposed a change to openstack-infra/jeepyb: Add options to manage-projects  https://review.openstack.org/4449616:48
*** jfriedly has joined #openstack-infra16:48
*** dina_belova has joined #openstack-infra16:48
jeblairclarkb: apparently what was needed was for it to run several times with debugging output.  <sigh>16:48
jeblairclarkb: because as soon as i did that ^ the acls showed up in gerrit.16:48
openstackgerritA change was merged to openstack-infra/config: Translation update jobs now supports any org  https://review.openstack.org/4421216:49
openstackgerritA change was merged to openstack-infra/config: Update Japanese Ops Guide build job.  https://review.openstack.org/4373416:49
jeblairalso, wow the neutron people really want to sudo.16:49
clarkbjeblair: :/ but ++ to your change. reviewing it now16:49
clarkbjeblair: yes ovcsctl all over the plce16:49
ArxCruzALL: I'm trying to configure zuul in my ifrastructure to listen review.openstack.org streams. I configure it to use my account on review.openstack.org and my key. However, I'm wondering, how can I autehticate since zuul is running as a daemon…16:51
jeblairArxCruz: in production you'd use a service account with a key with no passphrase16:52
*** dina_belova has quit IRC16:52
jeblairArxCruz: for testing, you can use ssh-agent which will avoid you needing to enter the passphrase16:52
*** dina_belova has joined #openstack-infra16:53
*** ruhe has joined #openstack-infra16:54
clarkbjeblair: jeepy manage-project change reviweed16:55
jeblairclarkb: any idea what that error is?16:55
clarkbjeblair: that was causing it to fail when you ran it?16:56
jeblairclarkb: no, that is causing it to not install gerritlib.16:56
clarkboh is that why the tests failed? I didn't even look there yet. Looking now16:57
jeblairclarkb: and so you know, i don't plan on fixing manage_projects.  i have too much on my plate and creating stackforge projects is not a priority for me.16:57
jeblairmordred can fix it when he gets back16:57
clarkbjeblair: thats fine16:57
clarkbjeblair: it almost looks like it is complaining that the real name of the gerritlib is gerritlib16:58
clarkbdstufft: http://logs.openstack.org/96/44496/1/check/gate-jeepyb-pep8/9c379e0/console.html16:58
dstufftclarkb: http://status.python.org/incidents/4h01t5v8r34316:59
*** pcrews has quit IRC16:59
*** wenlock_ has joined #openstack-infra16:59
openstackgerritJames E. Blair proposed a change to openstack-infra/jeepyb: Add options to manage-projects  https://review.openstack.org/4449616:59
clarkbdstufft: that would cause "Real name of requirement gerritlib is gerritlib" ? also, ignore me if you are busy :)17:00
annegentle_what's a way to trigger the Japanese Ops Guide build?17:00
ArxCruzjeblair: How can I use ssh-agent ? editing the /etc/init.d/zuul script ?17:00
openstackgerritJames E. Blair proposed a change to openstack-infra/jeepyb: Add options to manage-projects  https://review.openstack.org/4449617:01
clarkbannegentle_: it is in the post queue so you will need to merge a change to that project17:01
annegentle_clarkb: even a change to the english guide builds the jp one?17:01
clarkbannegentle_: I would give JJB and Zuul anohter 20 minutes to apply their changes17:01
clarkbannegentle_: yes, it is the same project17:01
jeblairArxCruz: you can google how to use ssh-agent; nothing special is needed for zuul, but if you're running it from an init script, you should get a service account.17:01
clarkbArxCruz: no, ssh-agent will run independent of zuul.17:01
annegentle_clarkb: ok, yeah, that's logical :) der, thanks17:01
ArxCruzkrtaylor: ^17:02
dstufftclarkb: it might yea, if /simple/gerritlib/ was unavailable and it fell back to looking at /simple/ and discovered "gerritlib"17:02
*** sarob has joined #openstack-infra17:05
flashgordondo you think the failures from the regular tests are related to my changes: https://review.openstack.org/#/c/43779/17:07
*** zeus has joined #openstack-infra17:07
clarkbmtreinish: ^ http://logs.openstack.org/79/43779/11/check/gate-tempest-devstack-vm-full/f66dfdb/console.html17:08
*** mgagne has quit IRC17:08
*** mgagne has joined #openstack-infra17:09
*** mgagne has quit IRC17:09
*** mgagne has joined #openstack-infra17:09
*** nicedice_ has quit IRC17:09
flashgordonit seems to always happen17:10
*** Ryan_Lane has joined #openstack-infra17:10
clarkbflashgordon: you shouldn't have changed anything in normal tempest though. The localrc changes only happen for your test17:11
clarkbflashgordon: I would see if mtreinish recognizes the failures17:11
flashgordonclarkb: thats what I thought but maybe I goofed17:12
flashgordonI did make one change actaully17:12
clarkboh you changed fixed network size17:12
clarkbbut didn't change the fixed range17:12
clarkbflashgordon: that may be the problem17:12
flashgordonfixed_range isn't used17:12
clarkbit isn't?17:12
flashgordonif i remember correctly17:12
clarkbI thought it was necessary to prevent VM ip collisions with HPCloud IOPs17:13
flashgordonactually I can drop the fixed_range change17:13
clarkbs/IOPs/IPs/17:13
flashgordonerr network_size17:13
clarkbflashgordon: if you bump the network size you need to bump the fixed range too I think17:13
*** derekh has quit IRC17:13
clarkbbecause a /24 has less than 1024 usable addresses in it17:13
flashgordonclarkb: yeah fixed_range isn't in nova.conf17:14
*** adalbas has joined #openstack-infra17:14
flashgordonbut I don't need to change it anymroe17:14
flashgordonsince will be spinning up <256 VMs now17:14
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377917:15
flashgordonclarkb: looks like the magic number of VMs I can spin up is 20017:15
flashgordonand 250 fails17:15
*** david-lyle is now known as david-lyle_afk17:16
*** david-lyle_afk is now known as david-lyle_away17:16
mgagneflashgordon: pardon my ignorance, is large_ops test using neutron?17:16
flashgordonmgagne: it is not17:16
mgagneflashgordon: ok thanks17:17
flashgordonmgagne: no reason it cannot though17:17
*** beagles is now known as seagulls17:17
flashgordonmgagne: this is the localrc used http://logs.openstack.org/79/43779/8/experimental/gate-tempest-devstack-vm-large-ops/1aed0c3/logs/localrc.txt.gz17:17
clarkbflashgordon: it would be interesting to see if neutron would pass :)17:17
mgagneflashgordon: I ask the question because we are facing serious scalability issues with quantum (grizzly) and are still trying to figure out the reason17:18
flashgordonclarkb mgagne: I picked n-net because that is the default setup17:18
flashgordonmgagne: let me try a neutron version17:18
clarkbflashgordon: my curiousity comes from some of the problems neutron has with normal tempest (different sort of test though)17:20
mtreinishclarkb, flashgordon: I don't recognize any of those failures17:21
*** shardy is now known as shardy_afk17:21
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377917:23
clarkbpleia2: https://review.openstack.org/#/c/44209/ though the parents of that commit also have -1's so no rush17:23
flashgordonmtreinish:  Ithink it is related to the network size change17:23
flashgordonwhich I dropped17:23
flashgordonclarkb: ^ neutron version of test17:23
pleia2clarkb: my comment from the 3rd patch set is still valid, hiera is misspelled17:24
flashgordonmgagne: ^17:24
mgagneflashgordon: waiting for results =)17:24
flashgordonmgagne: so just a warning the logs aren't complete for this test due to https://bugs.launchpad.net/devstack/+bug/121857517:25
uvirtbotLaunchpad bug 1218575 in devstack "When using NUMBER_FAKE_NOVA_COMPUTE only one copy of n-cpu is logged" [Undecided,New]17:25
flashgordonso if it fails n-cpu logs are missing17:25
flashgordonfor 9/10 n-cpus17:25
flashgordonmgagne: test takes ~10-15 min17:26
clarkbpleia2: new patchset must have been part of a rebase and not an actual edit17:26
clarkbpleia2: thank you for looking17:26
wenlock_puppet install question on very bare bones ubuntu system, has anyone seen this error before?17:27
wenlock_ puppet : Depends: puppet-common (= 2.7.23-1puppetlabs1) but it is not going to be installed17:27
wenlock_E: Unable to correct problems, you have held broken packages.17:27
mgagneflashgordon: I talked to my coworkers and we think we figure out part of our problem. (to be validated) We create a bunch of instances in the same tenant. Those instances share a common security groups which contains a rule: all traffic from members of the security groups. We believe it has the potential to create some kind of exponential workload on quantum, each instance triggering the update on the previously created instances.17:27
mgagnewenlock_: you need to pin puppet-common too17:28
clarkbwenlock_: the isntall_puppet.sh script should do this for you17:28
flashgordonmgagne: hmm interesting, we can test this here by updating the large_ops test to do that17:29
flashgordonmgagne: https://github.com/openstack/tempest/blob/master/tempest/scenario/test_large_ops.py17:29
clarkbmgagne: flashgordon I think that issue exists in not quantum/neutron as well17:29
flashgordonmgagne: want to update tempest to do that case17:30
mgagneflashgordon: I have yet to have tempest installed in our infra =)17:30
flashgordonin the file above ^, because its a superset of what we do now17:30
mgagneflashgordon: our backlog starts to drop requests =)17:30
flashgordonflashgordon: that sounds right, RPC timeouts ?17:31
mgagneflashgordon: talking to yourself?17:31
flashgordonmgagne: I guess so17:31
flashgordonTGIF17:31
*** vogxn has quit IRC17:31
mgagneflashgordon: backlog: TODO list, tempest is low in the list =(17:31
flashgordonmgagne: ohh that backlog17:31
*** morganfainberg|a is now known as morganfainberg17:32
clarkbdarn backlogs17:32
mgagneclarkb: tell me about it =)17:32
mgagneclarkb: but our customers need that heated cup-holder first! Please stop working on airbags now.17:33
flashgordonmgagne: this is the rule you use: http://paste.openstack.org/show/45487/17:35
flashgordonif so this is an easy change, just add a rule to default security group before launching VMs17:36
*** SlickNik has quit IRC17:37
*** dina_belova has quit IRC17:37
*** SlickNik has joined #openstack-infra17:37
*** dina_belova has joined #openstack-infra17:38
flashgordonclarkb mgagne: neutron just failed where n-net worked http://logs.openstack.org/79/43779/13/experimental/gate-tempest-devstack-vm-large-ops/89f96f8/17:39
clarkbflashgordon: make fake libvirt isn't good enough for it?17:39
flashgordonclarkb: huh?17:40
flashgordonmarkmcclain: ^17:40
mgagneflashgordon: OverQuota: Quota exceeded for resources: ['port'] =)17:40
flashgordonmgagne: doh17:41
flashgordongood catch17:41
*** senk has quit IRC17:41
*** dina_belova has quit IRC17:42
*** sandywalsh_ has quit IRC17:43
*** markmcclain has quit IRC17:43
*** markmcclain has joined #openstack-infra17:46
openstackgerritJames E. Blair proposed a change to openstack-infra/devstack-gate: Remove node management from devstack-gate  https://review.openstack.org/4450317:46
*** seagulls is now known as beagles17:49
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377917:50
*** beagles is now known as seagulls17:50
*** [wchrisj_ has joined #openstack-infra17:50
openstackgerritA change was merged to openstack-infra/config: Add Gerrit ACLs for clouddocs maven plugin project  https://review.openstack.org/4447117:50
*** ruhe has quit IRC17:51
*** neelashah has left #openstack-infra17:55
*** sandywalsh_ has joined #openstack-infra17:56
*** dina_belova has joined #openstack-infra17:58
openstackgerritElizabeth Krumbach Joseph proposed a change to openstack-infra/config: Update references to GerritJenkinsGit wiki  https://review.openstack.org/4450717:59
*** xBsd has joined #openstack-infra18:01
*** pcrews has joined #openstack-infra18:03
*** wenlock_ has quit IRC18:06
*** dukhlov has quit IRC18:08
clarkbjeblair: https://review.openstack.org/#/c/42643/ LGTM. I did not approve it as it requires a corresponding zuul layout change18:18
clarkbjeblair: should we try pushing that through today?18:18
Alex_Gaynorclarkb: Can I ask you to take a look at https://review.openstack.org/#/c/44369/ and https://review.openstack.org/#/c/44246/ when you have a chance?18:20
clarkbAlex_Gaynor: sure18:20
Alex_Gaynorthanks18:20
clarkbAlex_Gaynor: all of those tests run under pypy and pass?18:21
Alex_Gaynorclarkb: swiftclient ones definitely do, I didn't double check jd__ for hacking and pbr though18:21
*** Protux has quit IRC18:21
*** Protux has joined #openstack-infra18:22
clarkbAlex_Gaynor: jd__: it would be great to double check the others because once the hacking and pbr change merges pypy will gate18:22
Alex_Gaynorclarkb: I'll doubel check for him (assuming he's not around to verify now)18:22
clarkbya I think he is near/in UTC so this would be really late on Friday18:23
clarkbAlex_Gaynor: great let me know. I am slightly worried about pbr18:23
openstackgerritA change was merged to openstack-infra/config: Added PyPy to gate and check for python-swiftclient  https://review.openstack.org/4436918:24
*** sarob has quit IRC18:24
Alex_Gaynorclarkb: hmm, is there something more to running the pbr tests than `tox`?18:24
*** sarob has joined #openstack-infra18:24
clarkbAlex_Gaynor: I don't think pbr has pypy in its default envs list. `tox -epypy` should work though18:25
Alex_Gaynorclarkb: yeah, I just meant, running `tox` doesn't work for me in the pbr repo: http://bpaste.net/show/127822/18:25
clarkbthat should work. Jenkins runs the tests that way18:26
clarkbthough you do have nested virtualenvs looks like18:27
Alex_Gaynoryeah, I'm running tox inside another venv18:27
Alex_Gaynorwhich usually works ok18:27
clarkbAlex_Gaynor: I think pbr in the outer venv might be having trouble installing pbr18:27
clarkbAlex_Gaynor: try with a clean outer venv?18:27
*** markmcclain has quit IRC18:30
Alex_Gaynorclarkb: so hacking definitely works18:31
jeblairclarkb: well, i don't really want to touch zuul again for a while; we could let those sit; make a feature branch; or pin prod to a sha18:31
clarkbjeblair: wfm18:32
clarkbI just figured if it was going to go in it would have to be today18:33
jeblairclarkb: yep18:33
openstackgerritAlex Gaynor proposed a change to openstack-dev/hacking: Use the name for this attribute that exists on Python3.  https://review.openstack.org/4451218:33
openstackgerritAlex Gaynor proposed a change to openstack-dev/hacking: Added PyPy env to tox  https://review.openstack.org/4451318:34
clarkbjeblair: https://review.openstack.org/#/c/42645/7 the comments say I left an inline comment on patchset 7 but it doesn't show up for me18:34
clarkbjeblair: can you see my inline comment?18:34
clarkbI am 98% sure I know what the comment was, but it is weird that I can't refer back to it18:34
jeblairclarkb: i don't see the flag next to the file18:34
jeblairclarkb: which file?18:34
clarkbjeblair: neither do I. It would've been on the smtp.py file18:35
clarkbI think18:35
clarkbaround how error handling is done18:35
jeblairclarkb: nope, don't see it.  ;/18:35
clarkbweird18:35
Alex_Gaynorclarkb: I can't seem to get pbr tests running at all :/18:35
clarkbAlex_Gaynor: even with a clean virtualenv? oh I wonder, how new is your setuptools in that virtualenv?18:36
clarkbsetuptools >=1.0 seems to have broken us18:36
jeblairreed: can you poke mrmartin and have him look at clark's comment on https://review.openstack.org/#/c/42608/  ?18:36
Alex_Gaynorclarkb: it's 0.9.8, I guess my system venv is old18:36
reedjeblair, done18:36
clarkbAlex_Gaynor: what version of python failed in that paste?18:38
Alex_Gaynorclarkb: 2.6, also happens if I manually run testr under 2.7 though18:39
clarkbcould it be an OS X thing?18:39
Alex_Gaynorpossibly!18:39
*** gaelL has quit IRC18:40
clarkbit is trying to do subprocess stuff which is at least slightly OS specific18:40
Alex_Gaynoryeah, I'm investigating18:40
Alex_Gaynorclarkb: so yeah. something is hella messed up: http://bpaste.net/show/AL79IlsuJCHtJiUdItfF/18:41
clarkbit is splitting on every byte with a null byte?18:43
clarkbthat is awesome18:43
Alex_GaynorI think it's looking at the underly byte representation of the unicode, instead of ... anything remotely sane18:43
Alex_Gaynorso it's utf-16, so of course there are some \x00 bytes18:43
Alex_Gaynoramazing18:44
clarkboh yes18:44
clarkbshlex doesn't work with unicode on py2618:44
Alex_Gaynorthis is 2.718:44
clarkbbut you said it does the same on py27?18:44
clarkbhmm18:44
Alex_Gaynoryup18:44
clarkbjeblair: what do you think about WIP'ing jhesketh's changes? I am semi afraid mordred might do drive by approvals next week :)18:45
*** gaelL has joined #openstack-infra18:46
jeblairclarkb: heh, probably a good idea18:47
*** david-lyle_away is now known as david-lyle18:48
flashgordonclarkb: so I think I have the large_ops test working18:51
flashgordoncan you review https://review.openstack.org/#/c/44343 so I can update the d-g patch accordingly18:51
clarkbsure18:51
clarkblet me finish reviewing jhesketh_'s second zuul change then I will look at the large ops chane18:51
flashgordonclarkb: thanks18:51
clarkbflashgordon: done. that was easy18:53
clarkbAlex_Gaynor: your hacking change seems to have not liked __code__18:54
*** thomasbiege1 has joined #openstack-infra18:54
openstackgerritA change was merged to openstack-infra/config: Add word tempest to large_ops variable  https://review.openstack.org/4434318:55
flashgordonclarkb: thanks18:56
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377918:56
clarkbjeblair: did you want to look at the mysql backups on review-dev and see if they look good to you? Is merging the change for review.o.o and wiki something you are comfortable doing next week or should I focus on that now?18:56
*** UtahDave has quit IRC18:57
jeblairclarkb: either way; i'll look at review-dev now18:59
*** mriedem has quit IRC18:59
*** mriedem1 has joined #openstack-infra18:59
jeblairclarkb: i think it needs work :(19:00
jeblair-rw-r--r-- 1 root root       0 Aug 30 06:30 review-dev.sql.gz19:00
jeblair-rw-r--r-- 1 root root 1234398 Aug 30 00:00 review-dev.sql.gz.119:00
*** datsun180b has quit IRC19:00
clarkboh that19:01
Alex_Gaynorclarkb: will investigate after lunch19:01
clarkbthe dump and the rotate run at different times and logrotate insists that the file actually exist19:01
*** wenlock has joined #openstack-infra19:02
clarkbjeblair: so at 0000 review-dev.sql.gz is created with many bytes by mysqldump. then at 0630 review-dev.sql.gz is moved to review-dev.sql.gz.1 and a zero byte review-dev.sql.gz is craeted19:02
*** wenlock has quit IRC19:02
*** wenlock has joined #openstack-infra19:03
jeblairoh, ok19:03
Mithrandirhmm, I submitted a draft branch for review (for jjb), doesn't that show up on irc?19:06
annegentle_clarkb: hm. I triggered the build for operations-guide, but looks like it hasn't run since Aug. 5th. https://jenkins.openstack.org/view/Openstack-manuals/job/openstack-operations-guide/19:07
jeblairclarkb: backups lgtm19:07
annegentle_clarkb: and the JP version has never attempted to be built19:07
*** UtahDave has joined #openstack-infra19:07
jeblairMithrandir: i don't believe it does; no one can view the change unless you've explicitly added them.  we pretty much hate drafts around here, and use work-in-progress instead19:08
jeblairMithrandir: (they never work like anyone expects them to)19:08
Mithrandiroh, ok.19:08
Mithrandirhow do I submit a WIP branch?19:08
jeblairMithrandir: you have to mark it wip after submitting it19:08
Mithrandirok, submitting one now.  I'm on 3G so this takes a while.19:09
*** dina_belova has quit IRC19:09
*** dina_belova has joined #openstack-infra19:10
clarkbannegentle_: we have three jenkins masters now. jenkins.o.o doesn't run many tests19:10
clarkbannegentle_: you will want to look on jenkins01 and jenkins0219:10
clarkbjeblair: good to approve https://review.openstack.org/#/c/44129/1 then?19:11
*** dina_belova has quit IRC19:12
*** dina_belova has joined #openstack-infra19:13
*** SergeyLukjanov has quit IRC19:13
annegentle_clarkb: oh!19:14
*** SergeyLukjanov has joined #openstack-infra19:15
*** ruhe has joined #openstack-infra19:15
annegentle_clarkb: ok, still have the problem of the slicing script going to the openstack-manuals repo error while opening "./doc/src/docbkx/openstack-ops/locale/ja.po" for reading: No such file or directory19:15
annegentle_clarkb: I'll cirlce back with Daisy on the openstack-docs mailing list19:15
Mithrandirgah:  ! [remote rejected] HEAD -> refs/publish/master/purge-old-jobs (no new changes)19:17
*** boris-42 has quit IRC19:17
* Mithrandir stabs gerrit with a rusty spoon19:17
*** ruhe has quit IRC19:18
Alex_Gaynorclarkb: hmm, so they pass locally for me19:20
Mithrandirhmm, I don't think it shows up here even when I published it19:22
Mithrandirso, https://review.openstack.org/#/c/44525/ ; reviews welcome, but I don't really think it's in a mergeable state19:23
openstackgerritAlex Gaynor proposed a change to openstack-dev/hacking: Use the name for this attribute that exists on Python3  https://review.openstack.org/4451219:23
*** dina_belova has quit IRC19:27
*** dina_belova has joined #openstack-infra19:27
Alex_Gaynorclarkb: https://review.openstack.org/#/c/44512 looks good now, I claim it was a phantom in the machine :/ (I hate not knowing why it was broken before)19:28
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377919:28
*** dina_belova has quit IRC19:28
*** dina_bel_ has joined #openstack-infra19:28
*** SergeyLukjanov has quit IRC19:30
*** nicedice_ has joined #openstack-infra19:33
*** sarob has quit IRC19:34
*** thomasm has quit IRC19:35
*** SergeyLukjanov has joined #openstack-infra19:38
clarkbannegentle_: I am on the list now so will try to follow along :)19:39
clarkbMithrandir: gerrit is very specific about not pushing redundant patchsets... that means sometimes you push a trivial change. It is also picky about not merging anything but the latest patchset19:40
*** bpokorny has quit IRC19:43
*** dkehn_ has joined #openstack-infra19:43
*** openstack has joined #openstack-infra19:43
*** bpokorny has joined #openstack-infra19:44
*** dkehn has quit IRC19:45
lifelessclarkb: oh hai :)19:45
lifelessclarkb: is there meant to be anything on puppet-dashboard:80/ ?19:46
lifelessclarkb: and is the :3000 service meant to be secured in some fashion ?19:46
lifelessclarkb: http://puppet-dashboard.testing-cabal.org:3000/ lists lots of pending tasks; I presume there is some undocumented setup ?19:47
clarkblifeless: I bet the log process workers are not running.19:47
*** gyee has quit IRC19:48
*** dkehn_ is now known as dkehn19:48
clarkblifeless: the way dashboard works is it has a web frontend that displays what you see and stores reports from clients. Then the worker processes grab the stored logs do stuff with them and updte the mysql DB19:48
clarkblifeless: look in /etc/init.d/ for puppet things that aren't puppet agent and start that19:49
clarkbif you have it running on the same host as the master I thnk you need to secure it as it can operate in write mode. When run on its own host I believe it is semi secure as it is read only . Do note that puppet logs go there though which may be problematic if you need to keep thing secret19:50
lifelessclarkb: so does openstack need to keep it's one secure?19:50
clarkbwe don't keep ours secure19:50
lifelessclarkb: other than it being broken-ass right now ?19:50
lifeless:)19:50
clarkblifeless can you address jeblair and pleia2's comments near the bottom of your stack? once that is done I think we can merge another batch of changes19:52
*** svarnau has joined #openstack-infra19:52
Mithrandirclarkb: arguably, it was different, since it was no longer a draft.19:54
jeblairMithrandir: if you just wanted to wip your draft, you could publish it, then mark it wip19:55
Mithrandirjeblair: I ended up doing that, or rather, marking the draft as published and then wip-ing it.19:55
clarkbjeblair: logrotate take a couple days to do its thing with the mysqldumps. I am leaning towards erring on the side of caution and approving the backup change next week. Avoids anything that may happen over the long weekend19:59
clarkbif however you feel that is too paranoid let me know and I will approve (the change has been running on 3 hosts now)20:00
*** markmcclain has joined #openstack-infra20:00
jeblairclarkb: i like your plan20:04
*** thomasbiege1 has quit IRC20:07
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439120:12
openstackgerritlifeless proposed a change to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435720:12
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427020:12
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438420:12
openstackgerritlifeless proposed a change to openstack-infra/config: Add a pointer to launch/README for root operators.  https://review.openstack.org/4416320:12
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420920:12
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438320:12
openstackgerritlifeless proposed a change to openstack-infra/config: Fix launch-node for non-official environments.  https://review.openstack.org/4444920:12
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426220:12
openstackgerritlifeless proposed a change to openstack-infra/config: Start documenting running your own CI infra.  https://review.openstack.org/4417720:12
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439420:12
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439520:12
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439320:12
lifelessjeblair: clarkb: whats the next service to bring up after the dashboard? Gerrit or zuul?20:12
lifelessclarkb: I'll file a bug about the dashboard20:12
clarkblifeless: gerrit20:12
clarkbgerrit -> jenkins -> zuul I think20:13
*** sarob has joined #openstack-infra20:13
*** mriedem has joined #openstack-infra20:14
*** mriedem1 has quit IRC20:16
*** xBsd has quit IRC20:17
*** pcm__ has joined #openstack-infra20:20
*** gyee has joined #openstack-infra20:22
*** adalbas has quit IRC20:22
*** thomasbiege1 has joined #openstack-infra20:23
*** pcm_ has quit IRC20:24
*** adalbas has joined #openstack-infra20:26
lifelessclarkb: so whats meant to be on port 80 on the dashboard?20:28
clarkblifeless: right now nothing20:28
clarkblifeless: there is history behind that and it has to do with mordred wresting dashboard and dashboard winning the port argument20:28
openstackgerritA change was merged to openstack-infra/config: Fix stackforge description for Neutron module  https://review.openstack.org/4436120:28
lifelessso why is the port open ?20:28
clarkblifeless: he couldn't get dashboard to reliably serve out of port 80 for some reason20:28
lifelesshttps://bugs.launchpad.net/openstack-ci/+bug/1219076 filed20:29
uvirtbotLaunchpad bug 1219076 in openstack-ci "puppet-dashboard does not run background services" [Undecided,New]20:29
lifelessI haven't seen 'start an init.d service' in puppet yet to cargo cult the fix20:29
*** dina_bel_ has quit IRC20:30
*** dina_belova has joined #openstack-infra20:30
*** thomasbiege1 has quit IRC20:31
openstackgerritA change was merged to openstack-dev/hacking: Add pypy on tox envlist  https://review.openstack.org/4424820:31
lifelessjeblair: clarkb: I can rebase that full stack if you want to get it in w/o merge commits20:32
lifelessjeblair: I believe I've answered the questions you and pleia2 posed20:32
*** sarob_ has joined #openstack-infra20:33
*** sarob has quit IRC20:33
*** Shrews has quit IRC20:34
*** SergeyLukjanov has quit IRC20:34
jeblairlifeless: no need, and thanks.20:34
clarkblifeless: merge commits don't bother me. Was the heira typo fixed?20:34
clarkbshould be hiera20:34
*** dina_belova has quit IRC20:35
jeblairlifeless: re https://review.openstack.org/#/c/44262/9/doc/source/running-your-own.rst20:35
jeblairlifeless: jenkins01 is not a slave, it's a jenkins master (#2 out of 3)20:36
jeblairlifeless: jenkins.o.o, jenkins01.o.o, jenkins02.o.o are all jenkins masters20:36
jeblairlifeless: the slaves take the form precise#.slave.openstack.org20:36
*** dims has quit IRC20:37
*** rnirmal has quit IRC20:38
jeblairlifeless: in our case, jenkins01 and jenkins02 do the bulk of the work; jenkins.o.o has more privileged (eg, can publish things) slaves attached to it (to avoid complications from potential jenkins privilege escalations from the test runners)20:38
openstackgerritA change was merged to openstack-infra/config: Add a pointer to launch/README for root operators.  https://review.openstack.org/4416320:38
jeblairlifeless: from a scaling pov, one jenkins master can scale to at least hundreds of slaves.20:38
jeblairlifeless: i think the thing pleia2 and i are picking up on is the word 'minimally'; perhaps there should be a minimal set, and then recommendations for how to scale out the next steps20:40
jeblairlifeless: and i don't think dashboard should be in minimal; i mean, heck, we're not even using it right now.20:40
jeblairlifeless: and same for the additional jenkins masters -- probably a good idea if you're going to scale, but not minimally needed.20:40
*** whoops has joined #openstack-infra20:42
lifelessclarkb: fixed now.20:43
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439120:43
openstackgerritlifeless proposed a change to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435720:43
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427020:43
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438420:43
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420920:43
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438320:43
openstackgerritlifeless proposed a change to openstack-infra/config: Fix launch-node for non-official environments.  https://review.openstack.org/4444920:43
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426220:43
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439420:43
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439520:43
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439320:43
lifelessjeblair: so it's more complex to make the dashboard optional20:43
lifelessjeblair: right now the base config looks for a dashboard to report to.20:44
lifelessjeblair: I don't see the point in supporting arbitrary variation20:44
jeblairlifeless: ok, fair enough.  i think we should make the dashboard optional, but if it is not in practice now, that's fine.20:44
jeblairlifeless: that leaves the multiple jenkinses20:45
lifelessjeblair: so the security separation is more important than scaling20:45
lifelessjeblair: isn't it?20:46
lifelessjeblair: ack on the word minimal; I'm expecting multiple futher iterations to this doc as we progress through the exercise20:46
jeblairlifeless: i think the separation is important; though it's afaik a very theoretical vector, and also depends on what you want to use the system for.  if you only want to automate testing, but not, say, releases, then it's of less concern.20:49
jeblairthat sentence was constructed poorly; it should have been two.  but i think you get the idea.20:50
*** thomasm has joined #openstack-infra20:56
lifelessjeblair: so, I think keeping the two jenkins makes sense then: we can document why there are two; and that 01 is the first of a scalable set available if needed.20:56
lifelessjeblair: but collapsing to just one removes that protection - and one of the main things *I* want is release automation that isn't bound to my laptop or jml's laptop.20:56
*** pcm__ has quit IRC20:57
lifelessjeblair: I probably haven't spelt this out... I want a) to follow openstack-ci as closely as possible: every delta in design or deployment is ongoing maintenance. I want near-zero of that.20:57
*** pcm_ has joined #openstack-infra20:57
lifelessjeblair: b) we want a broad spectrum of python test gates, and a small number of more complex things that will drive cloud instances etc.20:58
lifelessjeblair: c) release management20:58
lifelessjeblair: d) but we probably don't need wiki etherpad lists etc, at least for now.20:58
jeblairlifeless: wfm (with additional docs about why)21:00
lifelessjeblair: having this all AAS but not as noddy as e.g. travis, would be ideal.21:00
lifelessjeblair: would you like me to write 'why' docs now, or in a later iteration ?21:00
openstackgerritA change was merged to openstack-infra/devstack-gate: Missing space at the end of the conditional expression  https://review.openstack.org/4422321:01
openstackgerritA change was merged to openstack-infra/devstack-gate: Missing default value  https://review.openstack.org/4422621:01
jeblairlifeless: if it's more convenient, we can go with later21:01
lifelessjeblair: I'd kind of like to flush the queue; the rebase is getting ridonkulous :)21:01
*** dims has joined #openstack-infra21:02
openstackgerritA change was merged to openstack-infra/config: Add puppet modules we maintain to gerrit bot  https://review.openstack.org/4437021:02
jeblairlifeless: k, +2d21:02
*** rfolco has quit IRC21:02
*** xBsd has joined #openstack-infra21:02
lifelessjeblair: what doc file would 'why' docs about the openstack-ci layout go in? top level README.md ?21:02
clarkbjeblair: https://review.openstack.org/#/c/44348/1/modules/openstack_project/templates/review.projects.yaml.erb line 192. Any concern with duplicatign a project without a clear why? (it appears that the existing repo does a couple things and they will prune it but I don't see confirmation of that)21:03
jeblairclarkb: i did not notice that, thanks.  i'll change to a -1.21:04
jeblairclarkb: are you going to leave a comment, or shall i?21:04
lifelessjeblair: one thing that struck me as I work through this is that there is a mix of 'what to run', 'how to run it' and 'what projects are hosted' all in the same repo.21:05
notmynameFYI python-swiftclient 1.6.0 tag pushed up just now21:05
lifelessjeblair: 'what and how' make sense to clone, but for many infra-downstreams 'hosted projects' will be totally different.21:05
clarkbjeblair: I can do it21:05
lifelessjeblair: it would be nice to hive that off to a different tree I think21:05
clarkblifeless: https://review.openstack.org/#/c/44209/6/install_puppet.sh what is with the comment there?21:06
clarkblifeless: YES!21:06
jeblairlifeless: can you elaborate more about 'hosted projects'?21:06
openstackgerritA change was merged to openstack-infra/config: Start documenting running your own CI infra.  https://review.openstack.org/4417721:06
lifelessclarkb: that comment notes that there is copied code.21:06
lifelessclarkb: there is both a manual and a puppet enforced setting.21:07
lifelessclarkb: if one changes, so should the other.21:07
lifelessclarkb: though this is apparently not obvious :)21:07
clarkbI think we need to refactor to use roles and profiles https://github.com/hunner/roles_and_profiles. Then we can use r10k to split the hows into distinct modules21:07
clarkbthen only how will live in openstack-infra/config21:07
clarkblifeless: 'NB:' is what confused me21:08
lifelessjeblair: to add a new project to gerrit for instance, one patches the same git tree that describes how to add a new jenkins master.21:08
lifelessclarkb: note bene21:08
lifelessjeblair: these two things are not the same, nor even tightly coupled.21:08
clarkbdoing the refactoring that I describe is a significant amount of work but definitely doable21:08
lifelessclarkb: so I'm more ok with how and what in the same tree, vs list-of-hosted-projects21:09
clarkblifeless: the nice thing about what I describe is it will be easier to swap in puppet modules from puppetforge21:10
lifelessclarkb: 90% of openstack_project/ seems to be applicable to me so far, I'm unlikely to refactor it as I go, but I'll start a low-priority thread to consolidate all the stuff i"m copying21:10
*** sarob_ has quit IRC21:10
clarkblifeless: for example there is a good logstash module there which didn't exist when I started working with logstash so I wrote my own21:10
lifelessclarkb: what is r10k ?21:10
clarkblifeless: it is a tool for managing puppet modules either from puppet forge or from source21:11
clarkblifeless: it uses puppetfiles which come from puppet-librarian but I am told that r10k actually works :)21:12
clarkbmgagne: have you used r10k yet? finch says it will solve all my problems21:12
mgagneclarkb: I just read about you talking about r10k. no, haven't used it.21:12
jeblairlifeless: this shows signs of being a much longer conversation than i am able to have atm, but openstack-infra/config is "The configuration of the infrastructure of the OpenStack project"; i think that includes the hosts we run and the configuration of those hosts, including what projects are hosted on them.21:12
clarkblifeless: using it allows you to avoid dealing with git submodules or git subtree and instead treat dependencies like packages21:12
*** fifieldt has joined #openstack-infra21:12
*** jamiem has quit IRC21:13
jeblairlifeless: i believe if we continue in the direction we want to, including what clarkb is talking about, then many operational details of, eg, how to run a gerrit server, should be pulled out of that repo.21:13
clarkb++21:13
lifelessjeblair: So I don't much care which direction the split occurs in :)21:13
mgagneclarkb: IMO, it looks like an organization philosophy21:14
lifelessjeblair: however, I think the split I'm suggesting is useful irrespective of downstreams, though of course both repos should be openstack-infra repos.21:14
lifelessjeblair: but - the main reason I mentioned it is that you wanted feedback on the design and layout and approach.21:15
mgagneclarkb: rename openstack_project to role, split reusable piece of manifests to profile and you now have a similar setup21:15
clarkbmgagne: yup21:15
clarkbhunner brought roles and profiles up after complaining that our gerrit module is too monolithic21:15
lifelessjeblair: and this plus the fact that I'm copy-pasting unmodified many pp files, some with a minor search-replace.21:15
lifelessjeblair: is the feedback I have so far ;)21:15
clarkbbut after reading his exampes I realized openstack_project was half an attempt at doing roles and profiles21:16
clarkbmgagne: but there is a bit more to pull some of the monolithicness out and into profiles21:16
mgagneclarkb: could be that some stuff are openstack specific and/or does not allow more granular configuration of gerrit21:16
*** UtahDave has quit IRC21:17
clarkbmgagne: there is some of that too21:17
clarkbbut I guess when you write pretty puppet all day for clients you want more of the same :)21:17
mgagneclarkb: we could say it's much like a 600 lines method, doing to much21:17
clarkbyup21:17
clarkbI absolutely agree with his suggsetions. With a bit of refactoring our puppet becomes quite flexible21:18
*** UtahDave has joined #openstack-infra21:18
mgagneclarkb: this should be split in an other manifest within the module itself: https://github.com/openstack-infra/config/blob/master/modules/gerrit/manifests/init.pp#L512-54321:18
mgagneclarkb: easy example21:18
clarkbjeblair: lifeless' change at hte bottom of the stack needs one more review21:20
mgagneclarkb: have to go21:21
clarkbjeblair: I am moving up the stack and approving things that look good. once the one at the bottom is approved we should see a bunch of things go into the gate21:21
clarkbmgagne: have a good weekend21:21
mgagneclarkb: thanks, you too21:21
clarkbmgagne: I don't think there is a major rush on the refactoring but it would be good to think of this stuff as we make changes21:21
mgagneclarkb: cool, don't mind giving my input ;)21:21
*** weshay has quit IRC21:22
*** svarnau has quit IRC21:22
*** openstackgerrit has quit IRC21:25
*** openstackgerrit has joined #openstack-infra21:25
clarkblifeless: https://review.openstack.org/#/c/44262/11/doc/source/running-your-own.rst what is meant by Migrate: on line 113?21:26
clarkblifeless: migrate from openstack-infra's configs?21:26
*** woodspa has quit IRC21:26
lifelessclarkb: yes, copy and paste21:29
clarkblifeless: and for https://review.openstack.org/#/c/44383/8/modules/openstack_project/manifests/puppetmaster.pp are you running that on your master and it works fine?21:30
clarkb@{u} is going to send me to cron manpages I think21:30
clarkbor is that a git thing?21:31
*** melwitt has joined #openstack-infra21:31
openstackgerritA change was merged to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420921:31
openstackgerritA change was merged to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435721:31
openstackgerritA change was merged to openstack-infra/config: Fix launch-node for non-official environments.  https://review.openstack.org/4444921:32
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Add a nodepool command  https://review.openstack.org/4455321:32
openstackgerritRussell Bryant proposed a change to openstack-infra/config: Report cinder patches to #openstack-cinder  https://review.openstack.org/4455421:33
openstackgerritA change was merged to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426221:33
lifelessclarkb: I am21:33
lifelessclarkb: it does21:33
lifelessclarkb: it means 'upstream branch'21:34
*** mriedem has quit IRC21:35
clarkbequivalent to origin/master in this case?21:35
*** whoops has quit IRC21:36
clarkbI found it in gitrevisions(7)21:37
*** [wchrisj_ has quit IRC21:38
lifelessclarkb: for you yes21:38
lifelessclarkb: for https://github.com/testing-cabal/ci-config, equivalent to origin/testcabal21:39
lifelessclarkb: it's the branch that 'git pull' would pull from, but I couldn't find a pull recipe that == reset --hard.21:39
*** thomasm has quit IRC21:40
clarkblifeless: should the git fetch be a git remote update instead to get all remotes?21:40
*** dina_belova has joined #openstack-infra21:41
clarkbI guess in this case it probably doesn't matter. everything is talking to origin21:41
lifelessclarkb: it will fetch the current pull tracking branch remote, IIRC.21:42
lifelessclarkb: but yeah, it should work for you as-is, and works for me.21:42
lifelessclarkb: other folk can submit patches.21:42
*** sarob has joined #openstack-infra21:43
notmynamesuppose the swift team wanted to create a 3rd deliverable as a separate code repo (in addition to the server and the client). what is the feasibility, risks, etc?21:44
*** dina_belova has quit IRC21:45
*** thedodd has quit IRC21:46
clarkbnotmyname: that seems to becoming more common with other projects, it is definitely feasible21:46
clarkblifeless: I got picky in https://review.openstack.org/#/c/44384/ sorry21:46
*** sarob_ has joined #openstack-infra21:46
notmynameclarkb: k. nothing formal yet. just a discussion this afternoon that I wanted to explore21:47
*** pcm_ has quit IRC21:47
clarkblifeless: and will have a comment for its child that can be addressed together21:47
clarkbnotmyname: heat is doing this for addtional stuff and so is trove21:47
notmynameclarkb: ah. we're thinking about it for the swift-bench tool21:47
clarkbnotmyname: I think one of the risks is packagers see it as another dependency but often that is the right choice21:47
notmynameclarkb: the good news in this case is that it wouldn't be a dependency on either the server or the client (it would depend on the client though)21:48
*** prad_ has quit IRC21:48
lifelessclarkb: is it possible to list multiple packages, or do they have to be separate stanzas?21:48
*** sarob_ has quit IRC21:49
*** sarob has quit IRC21:49
clarkblifeless: you can list multiple as long as they share all of the same parameters. So python-novaclient and python-cinderclient can be combined. I will paste and example of that the looks like21:49
jeblairclarkb: did cookiecutter land?21:49
*** sarob has joined #openstack-infra21:49
clarkbjeblair: no https://review.openstack.org/#/c/42530/21:50
jeblairnotmyname: swift-bench currently exists within swift repo?21:50
notmynamejeblair: yup21:50
clarkblifeless: http://paste.openstack.org/show/45500/21:50
*** bpokorny has quit IRC21:50
jeblairnotmyname: we have 'git filter-branch'-ed projects out of existing repos before; we can help with that if/when the time comes, if you like.21:51
lifelessclarkb: do you want VWS between the stanzas, though the comment applies to both ?21:51
mgagneclarkb: I'm still here. => yes21:51
*** morganfainberg is now known as morganfainberg|a21:51
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377921:51
notmynamejeblair: nah, if we were to split it, I'd want to keep the history intact21:51
flashgordonclarkb: I think large_ops test is ready21:51
mgagneclarkb: check jenkins::slave21:52
jeblairnotmyname: that's what git filter-branch does.  :)21:52
mgagneclarkb: doing it already21:52
clarkbmgagne: ?21:52
*** morganfainberg|a is now known as morganfainberg21:52
lifelessnotmyname: it gives you the history of just the files you keep21:52
mgagneclarkb: forget it, you were replying to lifeless =)21:52
notmynamejeblair: as in, I don't want to prune it from the history. I'd want to have an initial commit of "initial migration from the swift repo" as the first commit of the new thing21:52
notmynamejeblair: lifeless: but I'm sure I could be convinced otherwise21:52
lifelessnotmyname: tis mainly asthetics21:53
clarkblifeless: VWS == whitespace?21:53
lifelessbah, aesthetics.21:53
lifelessclarkb: vertical whitespace21:53
lifelessclarkb: aka a blank line21:53
clarkblifeless: no you can group them together since they are all related and belong to the comment21:53
notmynamejeblair: lifeless: ya, I understand. perhaps it would be cool. it's not what I normally think of when I hear `git filter-branch` :-)21:53
jeblairnotmyname: your choice -- i like the filter-branch approach because you have the history of the relevant files without the extra size of the rest of the repo; git blame, etc still work.21:54
notmynamejeblair: ya, that makes sense21:54
clarkbnotmyname: and you can remove it from the swift repo in the way you describe21:54
openstackgerritlifeless proposed a change to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439121:54
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427021:54
openstackgerritlifeless proposed a change to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438421:54
openstackgerritlifeless proposed a change to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438321:54
openstackgerritlifeless proposed a change to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439421:54
openstackgerritlifeless proposed a change to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439521:54
openstackgerritlifeless proposed a change to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439321:54
clarkbnotmyname: wtih a single commit that deletes files and explains why21:54
lifelessyay, no longer a full page.21:54
*** sarob has quit IRC21:54
notmynameclarkb: jeblair: who do we talk to if/when we decide to do it?21:54
lifelessclarkb: so how do you tell puppet to run the dashboard services?21:55
clarkblifeless: there should be an init script for them so you can create a service resource for the service and ensure => running21:56
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Add a nodepool command  https://review.openstack.org/4455321:56
clarkblifeless: if you grep for 'service {' in the repo you shoudl find examples21:56
clarkblifeless: did that recent stack reorder dependencies?21:56
jeblairnotmyname: let clarkb, fungi, mordred or i know, and we can help with setting it up21:56
lifelessclarkb: no21:57
jeblairnotmyname: also i'm sure ttx will be interested21:57
lifelessclarkb: I just rebase -i'd to edit the patch, then review -y to upload.21:57
notmynamejeblair: ttx is interested in /everything/21:57
clarkbdid you rebase -i against master/21:57
jeblairnotmyname: i thought that was a safe bet.  :)21:57
clarkbI am trying to figure out why it repusehd a couple things I had approved but were through the gate yet. Not a big deal21:57
lifelessclarkb: other changes would have landed in the interim, so the review scripts fetch + rebase combo would change the hash on all the not-in-master patches.21:57
lifelessclarkb: 'review' aka 'all your rebase done for you'21:58
clarkbgit review only does that if there are merge conflicts, which may be the case21:59
lifelessoh, has it gotten smarter?21:59
openstackgerritA change was merged to openstack-infra/devstack-gate: Remove node management from devstack-gate  https://review.openstack.org/4450321:59
clarkbyeah anything >= 1.19 or so21:59
*** tstevenson has quit IRC21:59
lifelessPress ENTER or type command to continue21:59
lifelessgit-review version 1.2121:59
openstackgerritA change was merged to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427022:00
lifelessdoes it log it's actions?22:00
openstackgerritA change was merged to openstack-infra/config: Make config updates work with rebased branches.  https://review.openstack.org/4438322:00
clarkblifeless: no, but you can pass it the -v flag and it will be very verbose22:00
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Update nodepool init script to nodepoold  https://review.openstack.org/4455722:00
lifelessclarkb: logging would be good22:01
lifelessclarkb: then one can answer 'why did X happen'22:01
*** xBsd has quit IRC22:03
clarkbjeblair: I think if you give the existing stack one more pass we may be able to merge them all22:03
*** burt has quit IRC22:04
*** sarob has joined #openstack-infra22:07
*** sarob has quit IRC22:08
*** jamiem has joined #openstack-infra22:08
*** sarob has joined #openstack-infra22:08
*** sarob_ has joined #openstack-infra22:09
jeblairlifeless: did you note my comment about bug refs in commit msgs?22:10
openstackgerritA change was merged to openstack-infra/config: Install launch/ dependencies on puppetmaster.  https://review.openstack.org/4438422:11
openstackgerritA change was merged to openstack-infra/config: Ensure reports directory is setup correctly.  https://review.openstack.org/4439122:12
openstackgerritA change was merged to openstack-infra/config: Document setting the correct hostname.  https://review.openstack.org/4439322:12
*** sarob has quit IRC22:13
*** morganfainberg is now known as morganfainberg|a22:13
openstackgerritA change was merged to openstack-infra/config: Create ci-launch directory on the puppetmaster.  https://review.openstack.org/4439422:13
openstackgerritA change was merged to openstack-infra/config: Make third-party imports clearer in launch/.  https://review.openstack.org/4439522:14
*** woodspa has joined #openstack-infra22:16
*** woodspa has left #openstack-infra22:18
*** zeus has quit IRC22:19
*** woodspa has joined #openstack-infra22:19
*** mgagne has quit IRC22:23
lifelessjeblair: I didn't sorry; which patch is it on?22:25
jeblairlifeless: not important; i wanted to point out that there's a canonical way of referring to bugs now: https://wiki.openstack.org/wiki/GitCommitMessages#Including_external_references22:27
jeblairlifeless: (if you want automation to act on it)22:27
jeblairlifeless: lots of backwards compat forms are still supported though.22:27
jeblairlifeless: but it might be good to start adjusting habits22:28
*** pcrews has quit IRC22:28
*** jamiem has quit IRC22:29
lifelessjeblair: nuts, I thought I was following the canonical form :)22:30
lifelessjeblair: thanks22:30
*** jhesketh_ has quit IRC22:30
*** sarob_ has quit IRC22:34
*** morganfainberg|a is now known as morganfainberg22:43
jeblairwe have 1129 jobs defined in jenkins22:45
jeblairit was like 450 the last time i looked.22:45
clarkbjeblair: Alex_Gaynor and jd__ have been busy with the py3k and pypy jobs :)22:45
* Alex_Gaynor added like 5... jobs...22:46
jeblairAlex_Gaynor: to maybe 100 projects :)22:47
jeblairalso, there... are... four... jobs.22:47
Alex_GaynorAh, right, so I'm responsible for *maybe* 100 jobs :) Someone else is responsible for the other 60022:48
jeblairi think it's pretty cool.  :)22:51
Alex_Gaynor:)22:57
*** woodspa has quit IRC23:04
clarkbjeblair: are you going to this OpenStack Core talk thing?23:05
clarkbor did that already happen?23:05
clarkbnevermind it happened23:06
notmynameclarkb: and it was exciting!23:06
clarkbdoes anyone else think "Core" is the wrong term because it is too overloaded?23:07
jeblairnotmyname: were all our problems solved?23:07
clarkbopenstack-core-positions == people that review code to me23:07
notmynamejeblair: well, first off, there was pizza23:07
jeblairnotmyname: then it was a success!23:07
notmynamejeblair: so according to maslow, we're done23:07
*** reed has quit IRC23:09
notmynameclarkb: jeblair: it was less silly than the AWS API stuff. overall, I support the general idea, but I think there are still too many undefined or overloaded words in the current conversation23:09
notmynameclarkb: but the problem is that the openstack bylaws say "core"23:09
clarkbnotmyname: yeah I think the ship has sailed, I was just confused for a minute23:10
jeblairthe bylaws can be changed.  it's only _nearly_ impossible to do so.23:10
clarkbItem 6.B bothers me23:12
clarkbwhy is open sourcing the alternate implementation matter if it isn't compliant? you remove the mark and move one23:13
clarkbs/one/on/ anyways, I clearly missed the discssion23:13
*** Protux has quit IRC23:17
jeblairclarkb: what are you reading?23:18
clarkbjeblair: http://robhirschfeld.com/2013/08/27/taking-openstack-core-discussions-to-community/23:20
*** pcrews has joined #openstack-infra23:21
clarkbjeblair: I followed that to http://robhirschfeld.com/2013/08/13/openstack-core-positions/23:22
pleia2the pizza wasn't bad23:22
pleia2reed was there too23:22
clarkbit is also slightly weird that they would do the Core talk as a non design session considering it is directly related to the TC23:23
notmynameclarkb: they are planning on having the final decision made (or thingy approved) on the board meeting right before the summit. on sunday in hong kong23:24
notmynameie before design sessions23:24
clarkboh its before23:24
notmynameclarkb: my concern with the wording is that it seems geared towards the provisioning API framework projects (like cinder and neutron) and not towards stuff like swift, horizon, marconi, or ceilometer23:25
koolhead17clarkb: we need to sit drink beer on 7th when am in Seattle & talk about Core :D23:27
notmynamealso the language around basing "must pass" tests (ie those that define compliance) based on common deployments--IOW the results of a survey23:27
koolhead17pleia2: hi there.23:27
pleia2koolhead17: hey23:27
koolhead17pleia2: howdy?23:28
koolhead17notmyname: hellos23:28
anteayahow long are you in seattle, koolhead17?23:28
koolhead17anteaya: only for one day :(23:28
koolhead177th23:28
anteaya:(23:28
anteayagoing to be in seattle on the 14th23:28
anteayaI'll miss seeing you23:28
koolhead17sigh..23:28
clarkbnotmyname: the stuff about vendor specific implementations bothers23:28
clarkb*bothers me23:28
anteayakoolhead17: you will be at the summit, yeah?23:29
koolhead17anteaya: hopefully yes. :D23:29
clarkbnotmyname: the bits about must open source a thing if you don't pass tests seems unenforceable, and not necessary23:29
anteayakoolhead17: keep me posted, I hope to see you there23:29
notmynameclarkb: indeed23:29
koolhead17anteaya: for sure23:29
anteaya:D23:29
clarkbnotmyname: I would also question being an openstack core thing if you have a completely private implementation that simply passes the must pass tests. That isn't OpenStack that is a proprietary clone23:29
koolhead17anteaya: i will be at doc bootcamp. hoping to meet annegentle_ fifieldt and many others :D23:30
clarkbkoolhead17: yes beer23:30
koolhead17clarkb: for sure sir.23:30
pleia2clarkb: yeah, that came up, it can't just be an API test23:30
koolhead17DM me your number so can SMS you once am there as i might not have IRC access via cellphone23:31
anteayakoolhead17: that sounds great, the infra boot camp was awesome, so I hope the doc bootcamp is equally awesome23:31
clarkbpleia2: but any amount of testing doesn't change that it is a clone that we have zero control of23:31
koolhead17anteaya: yups am sure of it23:31
pleia2could have a really lousy proprietary clone, and that gives people a lousy experience, not good for openstack23:31
notmynameclarkb: indeed. but I think that's covered by section 4 (although that has its own fuzzy definition issues)23:31
pleia2clarkb: presumably the control comes from not allowing them to call it openstack (trademark) if it's not23:32
clarkbpleia2: but vendors may substitute. that is what 6 is all about :)23:32
clarkbpleia2: and passing the must pass tests is the only hurdle to getting the mark23:33
pleia2clarkb: but it's still bound by 423:33
pleia2pretty much the entire discussion the other night was on 4 and 6 btw :)23:33
clarkbeven if you are bound by 4 you can be closed and the foundation/project have no control over the actual projects23:34
pleia2yeah23:34
clarkb(assuming the frameworks in 4 don't require being free as in libre)23:34
pleia2notmyname made good points about 4 being vague enough that it's hard to tell exactly what it is/requires23:35
notmynameactually, I had issues with 6 too (I think). the whole lack of definition around "plugin" or "alternate implementation" is too vague right now23:36
*** zul has joined #openstack-infra23:36
pleia2yeah23:36
notmynameeg other vendors are starting to announce "Swift API compatibility" now. which is cool. but also emphasizes the need for definition. (eg ceph, emc vipr, cleversafe, etc)23:37
*** lbragstad has joined #openstack-infra23:40
*** Shrews has joined #openstack-infra23:41
*** yjiang5 is now known as bmqq12323:42
*** gyee has quit IRC23:43
koolhead17zul: hola dir23:45
koolhead17clarkb: Nova is not Nova if you are not using RabbitMQ as per CORE definiton23:46
koolhead17:D23:46
* koolhead17 is kidding23:46
koolhead17pleia2: will you be occupied over weekend? We can go grab beer somewhere23:46
pleia2koolhead17: yeah, I have a friend coming into town tomorrow, sorry :\23:47
koolhead17pleia2: np. :)23:47
pleia2was good to see you last night though!23:47
clarkbkoolhead17: thats fine with me :) (replace rabbitmq with qpid, 0mq, etc and it is still fine with me)23:47
clarkbkoolhead17: because there is still a thing that is controlled by the body giving you the mark, that is open and accessible to all23:47
clarkbif there is a decision to standardize on some components that does not break ^23:48
koolhead17i heard someone bragging over twitter CORE certificate will be given/provided23:48
koolhead17:D23:48
koolhead17i wonder what that certification means23:48
koolhead17haha23:49
koolhead17and current CORE can become un-CORE23:49
koolhead17as well23:50
bmqq123not sure if gerrit can provide a method to differnt two patchset, like patchset 24/25 difference.23:55
clarkbbmqq123: it can, in the cahnge there is a dropdown that says "base" change that to patchset 2423:55
clarkbbmqq123: you can also use git review -m to do the diffs locally. The benefit of using git review -m is it will rebase both sides to a common base so you only see differences between the patchsets and not their bases23:56
bmqq123clarkb: that base will include everything changed (i.e. master changes between 24/25) and it's very difficlut to distinguish the pure-patch changes.23:56
clarkbbmqq123: that is what git review -m aims to solve23:56
bmqq123clarkb: aha, that's sound really perfect, will have a try.23:56
openstackgerritA change was merged to openstack/requirements: Add jsonpatch  https://review.openstack.org/4425323:59
*** markmcclain has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!