Sunday, 2014-03-23

*** saschpe has quit IRC00:00
*** mspreitz has quit IRC00:05
*** saschpe has joined #openstack-infra00:07
*** harlowja_at_home has joined #openstack-infra00:08
*** harlowja_at_home has quit IRC00:13
*** harlowja_at_home has joined #openstack-infra00:13
*** mfer has joined #openstack-infra00:13
*** thedodd has joined #openstack-infra00:13
*** yamahata has quit IRC00:25
*** yamahata has joined #openstack-infra00:26
*** nati_ueno has quit IRC00:27
*** nati_ueno has joined #openstack-infra00:28
*** nati_ueno has quit IRC00:28
*** nati_ueno has joined #openstack-infra00:29
*** dcramer_ has quit IRC00:32
*** nati_ueno has quit IRC00:33
*** nati_uen_ has joined #openstack-infra00:36
*** harlowja_at_home has quit IRC00:39
*** CaptTofu has joined #openstack-infra00:40
*** CaptTofu has quit IRC00:43
*** CaptTofu has joined #openstack-infra00:43
*** zhiwei has joined #openstack-infra00:52
*** e0ne has joined #openstack-infra00:53
*** peddamat has quit IRC00:55
*** e0ne has quit IRC00:56
*** e0ne has joined #openstack-infra01:22
*** e0ne has quit IRC01:27
*** rhsu has joined #openstack-infra01:43
*** vkozhukalov has joined #openstack-infra01:46
*** zhiwei has quit IRC01:50
*** e0ne has joined #openstack-infra01:53
*** e0ne has quit IRC01:57
*** mfer has quit IRC02:00
*** mfer has joined #openstack-infra02:05
*** flaper87 is now known as flaper87|afk02:12
clarkbnibalizer: mordred http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/templates/puppet.conf.erb#n20 so that line needs to say store,puppetdb?02:13
*** mfer has quit IRC02:17
*** dcramer_ has joined #openstack-infra02:19
*** CaptTofu has quit IRC02:21
*** CaptTofu has joined #openstack-infra02:22
*** dkehn_ has quit IRC02:23
*** CaptTofu has quit IRC02:26
*** saschpe has quit IRC02:29
*** saschpe has joined #openstack-infra02:30
*** vkozhukalov has quit IRC02:39
*** thedodd has quit IRC02:39
*** CaptTofu has joined #openstack-infra02:41
*** CaptTofu has quit IRC02:45
*** e0ne has joined #openstack-infra02:53
*** e0ne has quit IRC02:58
*** nati_uen_ has quit IRC03:06
*** nati_ueno has joined #openstack-infra03:13
*** thuc has joined #openstack-infra03:18
*** packet has quit IRC03:21
*** thuc has quit IRC03:23
*** blamar has quit IRC03:23
AaronGrclarkb: correct, assuming you want both on disk and in puppetdb.03:32
*** blamar has joined #openstack-infra03:33
*** blamar has quit IRC03:34
*** bhuvan has joined #openstack-infra03:35
*** Ryan_Lane has joined #openstack-infra03:39
*** mriedem has quit IRC03:39
*** Ryan_Lane has quit IRC03:43
*** e0ne has joined #openstack-infra03:53
*** bhuvan has quit IRC03:53
*** e0ne has quit IRC03:56
*** CaptTofu has joined #openstack-infra03:59
*** CaptTofu has quit IRC04:43
*** CaptTofu has joined #openstack-infra04:44
*** nati_uen_ has joined #openstack-infra04:46
*** nati_ueno has quit IRC04:48
*** CaptTofu has quit IRC04:49
*** bhuvan has joined #openstack-infra04:49
*** e0ne has joined #openstack-infra04:53
*** bhuvan has quit IRC04:54
*** e0ne has quit IRC04:58
*** rhsu has quit IRC05:13
*** alff has joined #openstack-infra05:22
*** blkperl has joined #openstack-infra05:32
*** nati_uen_ has quit IRC05:33
*** nati_ueno has joined #openstack-infra05:33
blkperlhi, i'm working with nibalizer on puppetdb, can someone cat /etc/puppet/puppet.conf into a gist and post it here05:34
blkperlmordred: ^ clarkb: ^ fungi: ^05:35
*** harlowja_at_home has joined #openstack-infra05:38
*** nati_ueno has quit IRC05:38
*** harlowja_at_home has quit IRC05:43
openstackgerritWilliam Van Hevelingen proposed a change to openstack-infra/config: Remove Oneiric conditional logic  https://review.openstack.org/8233505:44
clarkbblkperl can you see my link in sb?05:47
clarkbthat is the file05:47
*** Ryan_Lane has joined #openstack-infra05:50
*** e0ne has joined #openstack-infra05:53
*** Ryan_Lane has quit IRC05:55
*** alff has quit IRC05:57
*** e0ne has quit IRC05:57
blkperlclarkb: sb?05:58
*** thedodd has joined #openstack-infra06:02
*** pcrews has joined #openstack-infra06:03
clarkbscrollback06:06
*** _nadya_ has joined #openstack-infra06:09
blkperlclarkb: yeah i don't have sb :)06:12
*** sabari has joined #openstack-infra06:14
*** thedodd has quit IRC06:20
*** _nadya_ has quit IRC06:24
*** _nadya_ has joined #openstack-infra06:36
openstackgerritSergey Lukjanov proposed a change to openstack/requirements: Bump min hacking version to 0.8.1  https://review.openstack.org/8233906:37
*** _nadya_ has quit IRC06:38
*** thedodd has joined #openstack-infra06:39
*** pcrews has quit IRC06:39
*** hogepodge has quit IRC06:39
*** CaptTofu has joined #openstack-infra06:44
*** thedodd has quit IRC06:47
*** azneita has joined #openstack-infra06:48
*** CaptTofu has quit IRC06:49
*** e0ne has joined #openstack-infra06:53
*** alff has joined #openstack-infra06:54
*** e0ne has quit IRC06:58
openstackgerritA change was merged to openstack-infra/zuul: Tidy up app.js - limit lines to 80chars  https://review.openstack.org/8171606:58
*** rhsu has joined #openstack-infra06:58
*** zhiyan_ is now known as zhiyan07:18
*** azneita has quit IRC07:20
*** sabari has quit IRC07:23
*** branen_ has quit IRC07:24
*** branen_ has joined #openstack-infra07:24
*** alff has quit IRC07:25
*** _nadya_ has joined #openstack-infra07:30
*** harlowja_at_home has joined #openstack-infra07:41
*** branen__ has joined #openstack-infra07:44
*** KurtMartin has joined #openstack-infra07:44
*** harlowja_at_home has quit IRC07:45
*** kmartin has quit IRC07:47
*** branen_ has quit IRC07:47
*** rhsu has quit IRC07:53
*** rhsu has joined #openstack-infra07:53
*** e0ne has joined #openstack-infra07:53
*** e0ne has quit IRC07:55
*** _nadya_ has quit IRC08:00
*** yolanda has joined #openstack-infra08:11
*** rhsu1 has joined #openstack-infra08:27
*** rhsu has quit IRC08:31
*** che-arne has quit IRC08:42
*** che-arne has joined #openstack-infra08:45
*** CaptTofu has joined #openstack-infra08:45
*** CaptTofu has quit IRC08:50
*** e0ne has joined #openstack-infra08:53
*** e0ne has quit IRC08:56
*** flaper87|afk is now known as flaper8709:10
*** e0ne has joined #openstack-infra09:53
*** e0ne has quit IRC09:54
*** morganfainberg is now known as morganfainberg_Z09:58
*** david_lyle_ has joined #openstack-infra10:04
*** david-lyle has quit IRC10:07
*** rhsu1 has quit IRC10:08
*** e0ne has joined #openstack-infra10:11
*** e0ne has quit IRC10:16
*** rlandy has joined #openstack-infra10:41
*** CaptTofu has joined #openstack-infra10:46
*** CaptTofu has quit IRC10:51
*** gema_ has joined #openstack-infra10:51
*** SergeyLukjanov2 has joined #openstack-infra10:53
*** ianw has quit IRC10:53
*** sc68cal_ has joined #openstack-infra10:53
*** mancdaz_ has joined #openstack-infra10:54
*** gema has quit IRC10:54
*** SergeyLukjanov has quit IRC10:54
*** soren has quit IRC10:54
*** sc68cal has quit IRC10:54
*** soren has joined #openstack-infra10:54
*** SergeyLukjanov2 is now known as SergeyLukjanov10:54
*** harlowja_away has quit IRC10:54
*** mancdaz has quit IRC10:54
*** soren has quit IRC10:54
*** soren has joined #openstack-infra10:54
*** mancdaz_ is now known as mancdaz10:54
*** SumitNaiksatam has quit IRC10:54
*** SumitNaiksatam has joined #openstack-infra11:00
*** rlandy has quit IRC11:06
*** CaptTofu has joined #openstack-infra11:09
*** CaptTofu has quit IRC11:14
*** rlandy has joined #openstack-infra11:20
*** njd002 has joined #openstack-infra11:21
*** HenryG_ has joined #openstack-infra11:21
*** e0ne has joined #openstack-infra11:21
*** Daviey_ has joined #openstack-infra11:24
*** e0ne has quit IRC11:24
*** soren_ has joined #openstack-infra11:24
*** EntropyWorks_ has joined #openstack-infra11:25
*** mtreinish_ has joined #openstack-infra11:25
*** CaptTofu has joined #openstack-infra11:26
*** saschpe- has joined #openstack-infra11:28
*** kiall_ has joined #openstack-infra11:29
*** soren has quit IRC11:29
*** saschpe has quit IRC11:29
*** yamahata has quit IRC11:29
*** bknudson has quit IRC11:29
*** ruhe has quit IRC11:29
*** DinaBelova has quit IRC11:29
*** NikitaKonovalov has quit IRC11:29
*** lifeless has quit IRC11:29
*** jeremyb has quit IRC11:29
*** Steap has quit IRC11:29
*** ogelbukh has quit IRC11:29
*** fifieldt has quit IRC11:29
*** salv-orlando has quit IRC11:29
*** HenryG has quit IRC11:29
*** jdurgin has quit IRC11:29
*** mburned has quit IRC11:29
*** njd001 has quit IRC11:29
*** zul has quit IRC11:29
*** kiall has quit IRC11:29
*** hdd has quit IRC11:29
*** pabelanger has quit IRC11:29
*** zhiyan has quit IRC11:29
*** Daviey has quit IRC11:29
*** mtreinish has quit IRC11:29
*** chmouel has quit IRC11:29
*** EntropyWorks has quit IRC11:29
*** superdan has quit IRC11:29
*** antonym has quit IRC11:29
*** mrda_weekend has quit IRC11:29
*** loquacities has quit IRC11:29
*** asadoughi has quit IRC11:29
*** shortstop has quit IRC11:29
*** Daviey_ is now known as Daviey11:29
*** EntropyWorks_ is now known as EntropyWorks11:29
*** mtreinish_ is now known as mtreinish11:29
*** dansmith has joined #openstack-infra11:30
*** NikitaKonovalov has joined #openstack-infra11:31
*** Steap has joined #openstack-infra11:31
*** rlandy has quit IRC11:32
*** sirushti has joined #openstack-infra11:32
*** lifeless has joined #openstack-infra11:32
*** jeremyb has joined #openstack-infra11:32
*** loquacities has joined #openstack-infra11:35
*** fifieldt has joined #openstack-infra11:36
*** chmouel has joined #openstack-infra11:36
*** SumitNaiksatam has quit IRC11:36
*** azneita has joined #openstack-infra11:36
*** hdd has joined #openstack-infra11:38
*** DinaBelova has joined #openstack-infra11:38
*** pabelanger has joined #openstack-infra11:38
*** zul has joined #openstack-infra11:39
*** nprivalova has quit IRC11:39
*** obondarev has quit IRC11:39
*** skraynev_afk has quit IRC11:39
*** plomakin_ has quit IRC11:39
*** skraynev_afk has joined #openstack-infra11:39
*** plomakin has joined #openstack-infra11:39
*** obondarev has joined #openstack-infra11:40
*** nprivalova has joined #openstack-infra11:42
*** SumitNaiksatam has joined #openstack-infra11:42
*** tianst20 has quit IRC11:43
*** tianst20 has joined #openstack-infra11:44
*** ruhe has joined #openstack-infra11:45
*** yamahata has joined #openstack-infra11:45
*** bknudson has joined #openstack-infra11:45
*** ogelbukh has joined #openstack-infra11:45
*** salv-orlando has joined #openstack-infra11:45
*** jdurgin has joined #openstack-infra11:45
*** zhiyan has joined #openstack-infra11:45
*** mburned has joined #openstack-infra11:46
*** ilyashakhat has quit IRC11:52
*** obondarev has quit IRC11:52
*** nprivalova has quit IRC11:52
*** skraynev_afk has quit IRC11:52
*** tnurlygayanov has quit IRC11:53
*** rlandy has joined #openstack-infra11:53
*** skraynev has joined #openstack-infra12:03
*** nprivalova has joined #openstack-infra12:03
*** ilyashakhat has joined #openstack-infra12:03
*** tnurlygayanov has joined #openstack-infra12:04
*** obondarev has joined #openstack-infra12:04
*** afazekas has joined #openstack-infra12:07
*** jamielennox|away has quit IRC12:21
*** jrex has joined #openstack-infra12:23
*** jamielenz has joined #openstack-infra12:28
*** jamielenz has quit IRC12:32
*** yolanda has quit IRC12:34
*** jamielennox|away has joined #openstack-infra12:36
*** nprivalova has quit IRC12:38
*** plomakin has quit IRC12:38
*** ilyashakhat has quit IRC12:39
*** skraynev has quit IRC12:39
*** obondarev has quit IRC12:40
*** tnurlygayanov has quit IRC12:40
*** jepoy has quit IRC12:42
*** jepoy has joined #openstack-infra12:42
*** zhiyan is now known as zhiyan_12:46
*** jepoy has quit IRC12:46
*** azneita has quit IRC12:51
*** jepoy has joined #openstack-infra12:53
*** skraynev has joined #openstack-infra12:57
*** tnurlygayanov has joined #openstack-infra12:57
*** ilyashakhat has joined #openstack-infra12:57
*** dcramer_ has quit IRC13:01
*** nprivalova has joined #openstack-infra13:02
*** plomakin has joined #openstack-infra13:02
anteayablkperl: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/templates/puppet.conf.erb#n2013:03
*** rlandy_ has joined #openstack-infra13:04
*** obondarev has joined #openstack-infra13:04
*** rlandy has quit IRC13:07
*** jrex_ has joined #openstack-infra13:12
*** azneita has joined #openstack-infra13:12
*** jrex has quit IRC13:12
*** azneita has quit IRC13:17
*** yamahata__ has joined #openstack-infra13:20
*** zhiyan_ has quit IRC13:22
*** yamahata has quit IRC13:22
*** salv-orlando has quit IRC13:22
*** azneita has joined #openstack-infra13:22
*** salv-orlando has joined #openstack-infra13:22
*** mrda_weekend has joined #openstack-infra13:23
*** zhiyan_ has joined #openstack-infra13:24
*** CaptTofu has quit IRC13:24
*** antonym has joined #openstack-infra13:24
*** CaptTofu has joined #openstack-infra13:25
*** CaptTofu has quit IRC13:29
*** asadoughi has joined #openstack-infra13:30
*** obondarev1 has joined #openstack-infra13:34
*** yolanda has joined #openstack-infra13:37
*** obondarev has quit IRC13:38
*** obondarev1 has quit IRC13:38
mordredblkperl, AaronGr, clarkb: actually, the puppet.conf on the master is this: http://paste.openstack.org/show/74092/13:41
*** weshay has joined #openstack-infra13:42
*** dcramer_ has joined #openstack-infra13:44
*** obondarev has joined #openstack-infra13:49
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Store puppetmaster reports in puppetdb  https://review.openstack.org/8234913:50
*** roeyc has joined #openstack-infra13:56
openstackgerritA change was merged to openstack-infra/config: Store puppetmaster reports in puppetdb  https://review.openstack.org/8234914:00
*** lcostantino has joined #openstack-infra14:07
*** azneita has quit IRC14:15
*** lcostantino has quit IRC14:22
*** yolanda has quit IRC14:28
*** persia is now known as Guest1336914:31
*** wchrisj has joined #openstack-infra14:31
*** pcrews has joined #openstack-infra14:31
*** persia__ has joined #openstack-infra14:31
*** persia__ is now known as persia14:31
*** persia has joined #openstack-infra14:32
*** jepoy has quit IRC14:35
*** jepoy has joined #openstack-infra14:35
*** jepoy has quit IRC14:40
*** thuc_ has joined #openstack-infra14:43
*** dcramer_ has quit IRC14:43
*** pcrews has quit IRC14:45
*** thuc_ has quit IRC14:46
*** david_lyle_ has quit IRC14:48
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add parameters for mavencentral auth  https://review.openstack.org/8235414:49
*** thuc has joined #openstack-infra14:49
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Rename accessbot config file to match manifest  https://review.openstack.org/8235514:52
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove pip version specifier  https://review.openstack.org/8235614:53
*** jasondotstar has joined #openstack-infra14:59
*** dcramer_ has joined #openstack-infra15:03
openstackgerritA change was merged to openstack-infra/config: Add parameters for mavencentral auth  https://review.openstack.org/8235415:10
openstackgerritA change was merged to openstack-infra/config: Rename accessbot config file to match manifest  https://review.openstack.org/8235515:11
*** yolanda has joined #openstack-infra15:11
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove files from puppet urls  https://review.openstack.org/8235915:15
mordredfungi: morning15:15
mordredfungi: you may have noticed that I'm working through errors that we can now see via puppetdb.openstack.org ...15:16
*** yolanda has quit IRC15:20
fungimordred: yep, saw. very awesome15:20
* fungi is mostly afk, what with cramming wedding and an unexpected move into the next few months--weekends and evenings are no longer my own for a while15:21
*** packet has joined #openstack-infra15:22
*** dcramer_ has quit IRC15:23
*** packet has quit IRC15:24
*** CaptTofu has joined #openstack-infra15:25
mordredfungi: nod. well, enjoy that :)15:26
fungiyup. so much fun i can hardly contain myself15:27
mordredwow15:27
mordredbest error I've ever seen15:27
mordrederr: /Stage[main]/Openstack_project::Cacti/File[/etc/apache2/conf-available/cacti.conf]/ensure: change from absent to file failed: Could not set 'file on ensure: cannot generate tempfile `/etc/apache2/conf-available/cacti.conf20140323-28690-1f63lt8-9' at /opt/config/production/modules/openstack_project/manifests/cacti.pp:2915:28
*** HenryG_ has quit IRC15:28
openstackgerritA change was merged to openstack-infra/config: Remove files from puppet urls  https://review.openstack.org/8235915:28
*** HenryG has joined #openstack-infra15:30
*** CaptTofu has quit IRC15:30
*** pcrews has joined #openstack-infra15:33
*** _nadya_ has joined #openstack-infra15:34
jeblairmordred, nibalizer: puppetboard!15:34
*** mwagner_lap has joined #openstack-infra15:35
jeblairmordred: that error makes sense -- there is no "/etc/apache2/conf-available" directory (nor should there be, i think.  i believe the 'available' thing is only for sites and mods)15:36
jeblairmattoliverau: http://puppetdb.openstack.org/report/latest/cacti.openstack.org15:37
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove extra g722 sounds  https://review.openstack.org/8236015:41
mordredjeblair: devstack-launch, centos6-dev1 and precise-dev1 are all unsued now, yeah?15:42
*** packet has joined #openstack-infra15:43
mordredjeblair: also, I'm super stoked that we have puppetboard now15:43
mordrednibalizer: ^^15:43
*** pcrews has quit IRC15:44
clarkbmordred why did the puppet.conf erb not match reality? also yay puppetboard15:44
mordredclarkb: I honestly have no idea. best I can tell someone manually edited puppetmaster's puppet.conf? that seems like a weird choice for any of us to make though15:45
mordredclarkb: also, puppet agent was not running on puppetmaster15:45
clarkbthat'll do it15:46
mordredclarkb: http://puppetdb.openstack.org/report/storyboard.openstack.org/ecc673898d13812a8c087071e7c886c643c8adbd15:47
*** packet has quit IRC15:47
mordredthe virtualenv package has a flapping failure - it doesn't fail on ever run15:47
mordredbut also, I've verified that both pip and virtualenv are installed there15:47
mordredso wtf15:47
dstufftsoftware is bad15:47
dstufftthat's the reason15:47
mordreddstufft: ++15:47
mordreddstufft: you have an alert on pip don't you?15:48
*** packet has joined #openstack-infra15:48
dstufftha15:48
*** packet has quit IRC15:48
dstufftno I don't actually :)15:48
mordredhehe15:48
dstufftI just sense it15:48
mordrednicely done15:48
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove pip version specifier  https://review.openstack.org/8235615:48
mordredclarkb: I think now that we have puppetboard - the first large-scale patch we should land is the pip one15:48
clarkbya15:49
jeblairmordred: istr that occasionally pip gets confused about what versions of things are installed and reports wrong ones15:50
mordredyah15:50
mordredhttp://puppetdb.openstack.org/node/summit.openstack.org15:50
mordredif you llook at all of those reports15:50
mordredtheyr'e all upgrading virtualenv from 1.10 to 1.10.115:51
pleia2puppetboard \o/15:51
openstackgerritDoug Hellmann proposed a change to openstack/requirements: Do not sync requirements to pbr  https://review.openstack.org/8236115:51
mordredclarkb: ooh! the puppetboard virtualenv module has given us an accurate virtualenv_version fact15:55
blkperlmordred: awesome, you got reporting on puppetboard working :D15:57
*** jasondotstar has quit IRC15:58
blkperlmordred: so nibalizer and I need the puppetmaster logs to find puppet3 deprecation warnings, but were not sure if its actually free of sensitive data, so someone would have to look it over first16:00
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use virtualenv_version fact to unconfuse puppet  https://review.openstack.org/8236216:03
mordredblkperl: ok - where are they/which logs?16:03
*** todd_dsm has joined #openstack-infra16:04
blkperlmordred: grep puppet-master /var/log/syslog16:04
clarkbblkperl: deprecation warnings happen master side so dont end up in agent reports?16:05
blkperlclarkb: right16:05
*** rustler is now known as NobodyCam16:06
blkperlalso https://review.openstack.org/#/c/80469/ and https://review.openstack.org/#/c/80470/ should be safe to merge16:06
mordredblkperl: scanning the results of that it looks clean16:07
blkperlmordred: oh, i know why16:07
jeblairi'm preparing to restart zuul16:08
nibalizerhi16:08
blkperlmordred: http://puppetdb.openstack.org/fact/puppetversion I think they all need to be 2.7.2* to have deprecation warnings16:08
blkperla lot of those versions probably don't have the deprecation warnings16:08
mordredblkperl: no - I mean I looks clean from having secrets in it16:10
blkperlmordred: oh :)16:10
nibalizercould we do the classic share /var/log/puppet over http thing?16:10
mordredblkperl: we should probably set a thing to keep us current on puppet version16:11
nibalizeraccess to the logs is exactly what we need16:11
*** wchrisj has quit IRC16:11
*** _nadya_ has quit IRC16:11
blkperlnibalizer: I think we will still need a noop run against a puppet3 master, im not sure if puppet 2.7 throws out all the deprecation warnings we need16:12
nibalizeryea16:12
nibalizeri agree16:12
mordrednibalizer: for now - http://paste.openstack.org/show/74097/16:12
mordredenjoy16:12
nibalizer<316:13
blkperlawesome <316:13
nibalizermordred: jeblair fungi so we'd like to fire up a puppet 3 master and have the rooters do dry runs against it on the nodes16:13
nibalizerwe'll get the commits in place, can someone requisition a virtual machine and maybe puppet.o.o for us?16:13
clarkbjeblair: picking up the noop change?16:14
nibalizerblkperl: i think we should paramaterize install_puppet.sh16:14
jeblairclarkb: yes16:14
nibalizerwell we'll have to paramaterize everything else too16:14
nibalizer(modules/openstack_project/manifests/puppetmaster)16:14
jeblairnibalizer: yeah, no problem; we'll probably spin up the machine after the commits have landed16:14
nibalizeroh wait are we in a soft freeze ?16:14
nibalizerwaiting on the massive pip change?16:14
*** CaptTofu has joined #openstack-infra16:15
jeblairmordred: ^  are we ready to freeze for that?16:15
blkperlof course its all apache errors :)16:15
mordredjeblair: perhaps we should put the hieradata into a private git location that both puppetmasters could pull from -so that we could migrate a node at a time to the puppet3 without too much crazymaking?16:16
*** e0ne has joined #openstack-infra16:16
mordredjeblair: I think we shoudl rebase the change16:16
mordredfirst16:16
mordredjeblair: I can do that real quick16:16
*** e0ne has quit IRC16:16
nibalizeris the private hiera data not under git right now?16:17
*** e0ne has joined #openstack-infra16:17
mordredit's under git - but it's just a local repo16:17
nibalizeroh i see16:17
nibalizer+1 to putting it in a private git location16:17
jeblairmordred: yeah, i think we could just have one master pull from the other16:17
nibalizeralthough i wonder, do we really have a private git server set up?16:18
mordredjeblair: good idea16:18
mordrednibalizer: nope - but what jeblair just said ^^16:18
nibalizeryea that works16:19
jeblairzuul is restarted16:20
jeblair Zuul version: 2.0.0.11416:20
*** todd_dsm has quit IRC16:20
jeblairprobably about time for a release :)16:20
*** todd_dsm has joined #openstack-infra16:21
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Fix deprecation warnings in gerrit module  https://review.openstack.org/8236416:21
jeblairclarkb: i restarted the mergers too, so init scripts and re-registration should be fixed there16:21
openstackgerritWilliam Van Hevelingen proposed a change to openstack-infra/config: Resource references should be capitalized  https://review.openstack.org/8236516:22
blkperlnibalizer: maybe we should coordinate :)16:22
nibalizerblkperl: did we just do the same thing16:22
blkperlyes16:22
nibalizerhahhahahaha16:23
nibalizero/16:23
jeblairnibalizer, blkperl: fixing it twice makes it twice as fixed16:23
* blkperl kills mine16:23
*** thuc_ has joined #openstack-infra16:24
nibalizerokay well im actually going back to bed, but everything is awesome!16:24
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make pip install from upstream better  https://review.openstack.org/5142516:25
mordredjeblair: ^^16:25
mordredjeblair: amazingly, I did not have to resolve any rebase conflicts16:25
*** todd_dsm has quit IRC16:25
*** todd_dsm has joined #openstack-infra16:26
*** thuc has quit IRC16:27
anteayaI just have to say that you two have the best names nibalizer and blkperl16:28
anteayaI keep waiting to see one of you add "III" to yours16:28
clarkbjeblair awesome16:28
*** thuc_ has quit IRC16:29
mordredclarkb: you wanna look the pip patch over too?16:30
clarkbmordred maybe later, doing weekend morning things now. including watching kansas lose to stanford16:31
mordredclarkb: the tourney is a bit cray cray this year16:32
blkperlanteaya: thanks :)16:33
anteaya:D16:34
anteayaso we are in soft freeze on puppet changes until 51425 merges, yes?16:34
*** jasondotstar has joined #openstack-infra16:35
mordredanteaya: I'm down with that if jeblair, clarkb, fungi and SergeyLukjanov are16:35
*** thedodd has joined #openstack-infra16:36
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use virtualenv_version fact to unconfuse puppet  https://review.openstack.org/8236216:37
anteayamordred: k great16:38
anteayamordred: did a quick pass of 51425 for glaring format things, found some16:39
mordredanteaya: oh yeah? cool16:40
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make pip install from upstream better  https://review.openstack.org/5142516:43
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use virtualenv_version fact to unconfuse puppet  https://review.openstack.org/8236216:43
mordredanteaya: fixed ^^16:43
*** sdake has quit IRC16:51
*** todd_dsm has quit IRC16:51
openstackgerritWilliam Van Hevelingen proposed a change to openstack-infra/config: Fix modules deprecation warning in lodgeit module  https://review.openstack.org/8236616:55
*** thuc has joined #openstack-infra16:56
anteayamordred: thanks16:59
*** roeyc has quit IRC17:01
*** thuc_ has joined #openstack-infra17:02
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Fix centos image name in region-b  https://review.openstack.org/8236917:02
*** rhsu has joined #openstack-infra17:03
*** thuc has quit IRC17:04
mordredjeblair: any thoughts on killing {devstack-launch,precise-dev1,centos6-dev1}.slave.openstack.org ?17:04
jeblairmordred: i think launch can go; i don't think nodepool is working on jenkins-dev yet, so that makes those slaves possibly the only ones attached to dev; we may want to hold onto those17:05
mordredjeblair: ahhhh... I wasn't grokking that they were attached to dev in my headbrain17:05
mordredjeblair: should I fix puppet on them then?17:05
jeblairmordred: maybe?  not if it's too much trouble, since i imagine we actually want them gone once nodepool works there17:06
jeblairmordred: but if it's easy, sure why not?17:06
mordredjeblair: k. I'll see what i can do17:07
mordredI mainly wanted to get puppetboard fairly green so taht we can start responding to not-green as an issue17:07
openstackgerritWilliam Van Hevelingen proposed a change to openstack-infra/config: Fix @var deprecation warnings in drupal templates  https://review.openstack.org/8237317:15
zaromordred: so i got a little more info on cross project commits.17:17
zaromordred: looks like their initial idea is to add functionality to git to make it similar to the 'repo' scm17:18
zaromordred: to support that feature.17:18
zaromordred: i don't know repo so i'm not sure what that would entail.17:19
mordredzaro: hrm. so, repo is a tool they use that we looked at but decided to not use17:19
mordredzaro: they use it instead of git-review to submit things to gerrit, for instance17:19
mordredbut it's designed so that you can essentially grab all of the related repos for a project at once17:19
zaromordred: android uses it and their plan is to have android project that use repo for cross project commits to switch to using git.17:20
mordredand make a feature branch across them17:20
mordrednod17:20
*** jrex_ has quit IRC17:20
mordredit'll be interesting to track work on that and possibly provide feedback or collaboration17:20
mordredmainly because we need to be able to do what we do with zuul - which is probably not a use case that gets considered much :)17:21
zarozuul is definately not on their radar.17:21
mordredyeah - coordinated cross-project gating is a thing not many people do17:22
*** e0ne has quit IRC17:23
zarofrom my understanding repo defines all project depencies with some manifest and they plan to use the same idea and somehow that invovles git submodules.17:23
mordredyeek17:23
clarkbrepo is a for loop around git review for strict dependencies17:23
*** e0ne has joined #openstack-infra17:23
zaroif repo is analogus to git-review i'm not sure how that involves sumbmodules17:23
clarkbfor example to build android you need a bunch of stuff, repo will make sure you have all of it17:24
mordredyah - and allow you to easily create and submit changes across multiple modules17:24
mordredbut it doesn't really come with any enforcement of those things on the gerrit server side17:24
mordredwhich is fine if you're manually landing patches and if it's ok to produce a possible intermediate broken state17:25
mordrederr: Failed to apply catalog: Invalid parameter psql_path at /etc/puppet/modules/postgresql/manifests/server/role.pp:6117:26
*** shakamunyi has joined #openstack-infra17:26
mordredI'd like to disagree with it17:26
mordredI believe that yes, in fact, it is a valid parameter17:26
boris-42mordred jeblair sorry for interruption guys, but is there any command to stop gate job ?17:30
mordredboris-42: no- but you can leave a -2 vote to block it from landing17:30
clarkbmordred: http://puppetdb.openstack.org/report/review.openstack.org/f64c8c5e7ba634f0b3f1296c25f2c0c633978b71 why are those jars being removed?17:30
clarkbboris-42: you can also push a new patchset to kill it if you don't have -2 power17:31
boris-42mordred so actually the case is another.. sometimes job sticks in one of the gates (cause of race condition)17:31
boris-42mordred and you would like to kill it and recheck =)17:31
boris-42mordred something like "git recheck --force"17:32
clarkbboris-42: push a new patchset17:32
clarkbis the only way to immediately stop gating something17:32
mordredclarkb: I do not know - that's a good question17:32
boris-42clarkb I think that it will be nice to extend "git recheck" functionality..17:33
clarkbboris-42: why?17:33
clarkbboris-42: sorry I don't think a new subcommand is really necessary to expose implementation specific queuing behavior17:33
clarkbmordred: all of the reports say that so I don't think it is actually removing them17:34
boris-42clarkb hm there are some cases where it is useful, e.g. patch is not your =)17:35
boris-42clarkb and author of patch is not online..17:35
clarkbboris-42: right, just push a new patchset17:35
clarkbgit push (or git review) is your command17:35
mordredclarkb: I can confirm that the jar files are still there17:36
*** shakamunyi has quit IRC17:36
mordredclarkb: I have NO IDEA why the psql_path error above is happening on centos6-dev.slave.openstack.org17:36
boris-42clarkb yep I know that works, but cleaner solution is "recheck" command17:36
zarohad an interesing question come up at the conference.17:36
clarkbboris-42: I disagree :)17:36
boris-42clarkb =)17:36
clarkbboris-42: the nice thing about the push is everyone can see the history of it17:36
boris-42clarkb okay I am just newbie=)17:36
clarkbthere is no side channel that will need a second set of reporting so that when people go wtf they can figure out what happened17:36
clarkbkicking something out of the gate is intentionally a bit hard and currently has a paper trail17:37
zarocan you have zuul merge dependent commits before executing tests?17:37
boris-42clarkb ok =) i was speaking just from user side17:37
zaroi mean 'all dependent'17:37
clarkbboris-42: right17:37
mordredzaro: well...17:37
boris-42clarkb e.g. now we are sometimes waiting 1hrs and then doing recheck =)17:37
clarkbboris-42: I don't want any user to be able to snipe my change without a paper trail :)17:37
mordredzaro: yes and no17:37
boris-42clarkb reasonable=)17:37
clarkbboris-42: today any user can but they must leave a paper trail17:37
mordredzaro: it will definitely merge all of the dependent changesets before running tests on the final changesets17:38
mordredzaro: but currently we require that each of the changesets in the sequence pass tests itself- so we will ALSO test the combinations of the changesets leading up to the final state17:38
mordredzaro: we consider doing that a feature, because of folks doing continuous deployment17:39
*** shakamunyi has joined #openstack-infra17:39
clarkbboris-42: I think there is a balance between abuse of the system (whcih we have seen, it isn't an imaginary problem) and ease of use17:40
zaromordred: ahh, ok i didn't think it was possible atm.17:40
*** yolanda has joined #openstack-infra17:40
clarkbboris-42: so somethings are harder than they could be but are often intentionally that way to discourage abuse17:40
boris-42clarkb sure agree17:40
boris-42clarkb one question do you have wiki page?)17:40
zaromordred: the other use case someone came up with is that they didn't have as much testing resources and wanted to bunch up the changes before testing.17:41
anteayaboris-42: wikipage for what?17:41
boris-42clarkb e.g. in Rally we have some kind of introduction on wiki page: https://wiki.openstack.org/wiki/Rally17:41
boris-42anteaya ^17:41
anteayafor how to snipe a patch?17:41
boris-42anteaya for everything17:41
clarkbboris-42: we do https://wiki.openstack.org/wiki/InfraTeam also http://ci.openstack.org17:41
mordredzaro: yah. we explicitly dont' want to do that ourselves17:41
mordredzaro: although I totally grok the desire some folks might have17:41
boris-42clarkb i would like to contribute a bit in Wiki as well17:41
mordredzaro: for us - zuul is designed to test _more_ things, not less - with the assumption that we have scalable clouds to deal with resources17:42
mordredzaro: I do not think zuul would be the right choice for anyone who is resource constrained17:42
boris-42clarkb so reviews + wiki to make it easily to involve new developers and reviewers17:42
boris-42in infra team17:42
zaromordred: it's in situations where they have variable resources.  sometimes a lot and sometimes a little.17:43
anteayaboris-42: here are the docs for ci.openstack.org: http://git.openstack.org/cgit/openstack-infra/config/tree/doc/source17:43
anteayaoffer what ever patches you see fit17:43
boris-42anteaya ivestigeting docs17:44
anteayak17:45
boris-42anteaya thanks17:45
anteayanp17:45
anteayaI look forward to your patches17:46
boris-42anteaya so my idea is next17:46
boris-42anteaya we have for example this page http://ci.openstack.org/zuul.html17:47
anteayaboris-42: you read the -infra meeting logs, correct?17:47
anteayahttp://eavesdrop.openstack.org/meetings/infra/2014/17:47
boris-42anteaya not but will start=)17:47
anteayagreat17:47
boris-42anteaya I just started yestarday=)17:47
anteayait is a good way to see what we are thinking17:47
anteayaand what is most important at the moment17:47
anteayaokay welcome17:47
boris-42anteaya yep I will take part in meetings17:47
boris-42anteaya so about this page http://ci.openstack.org/zuul.html17:48
boris-42anteaya there is not enough information about this project17:48
anteayaboris-42: this is a good etherpad to spend some time with: https://etherpad.openstack.org/p/infrastructure-priorities17:49
boris-42anteaya so new developer is not able to understand for 5 minutes how it works17:49
anteayazuul can't be understood in 5 minutes17:49
boris-42anteaya everything can be=)17:49
anteayawhat information do you want to page to include?17:49
boris-42anteaya a lot of diagrams17:49
anteayaboris-42: I want to eat what you do for breakfast17:49
anteayadiagram away17:49
anteayaI have yet to see a good diagram be refused17:50
boris-42anteaya like in Rally we have refused17:50
boris-42https://wiki.openstack.org/wiki/File:Rally-Actions.png17:50
anteayaI believe your wiki page has diagrams17:50
anteayayou don't need to sell me on rally17:50
anteayaso if you want diagrams on the zuul page17:51
anteayamake them and offer them as a patch17:51
boris-42anteaya I would like to make them=)17:51
anteayagreat17:51
anteayaI look forward to seeing your diagrams17:51
boris-42anteaya so I am just speaking about what I would like to concentrate=)17:51
*** _nadya_ has joined #openstack-infra17:51
anteayahave you looked at https://etherpad.openstack.org/p/infrastructure-priorities yet?17:51
boris-42anteaya looking17:51
*** shakamunyi has quit IRC17:51
anteayathose are the infrastructure priorites that jeblair has identified17:52
clarkbboris-42 doc updates (particularly for clarity) are always welcome. it is not always easy to see where the deficiencies are if you already understand it17:52
anteayastatus alert system and translation tools need someone to work on them17:53
boris-42clarkb yep so you get new member "me"17:53
boris-42clarkb and I don't understand how it works17:53
jeblairboris-42: http://ci.openstack.org/zuul.html isn't designed to teach you everything about zuul -- it's designed to teach you about how zuul is configured and operated by openstack infra17:53
boris-42clarkb and will have that "first" impression17:53
*** thuc_ has quit IRC17:53
jeblairboris-42: but more importantly, it's designed to point you to where you can find more information17:54
anteayaboris-42: the best place to start to understand infra is to read the meeting logs and the channel logs17:54
jeblairboris-42: like zuul's reference manual: http://ci.openstack.org/zuul/17:54
boris-42anteaya imho code is better=)17:54
*** thuc has joined #openstack-infra17:54
anteayaboris-42: then you won't understand infra17:54
jeblairboris-42: which _is_ designed to explain how zuul works17:54
anteayasince infra is people who write code17:54
anteayathe code is the tools that do the work17:54
anteayathe people are the ones that decide how to make the tools do what they do17:55
anteayaand why17:55
dstufftjeblair: can I say it's really confusing to have http://ci.openstack.org/zuul.html  and http://ci.openstack.org/zuul/ be two entirely different things17:55
anteayaif you just want to understand a given tool, like zuul then the code is a great place to work from17:55
boris-42dstufft +1 =)17:55
boris-42anteaya I would like to make developer2developer instruction17:56
boris-42anteaya about how everything is organized and how infra team works17:56
anteayaboris-42: okay that is different than contributing to infra17:56
boris-42anteaya disagree17:56
boris-42=)17:56
*** yolanda has quit IRC17:56
anteayawhy do you need infra knowledge for developer2developer instruction?17:56
boris-42anteaya probably this will be cleaner: developer_of_infra 2 future_developer_of_infra17:57
anteayamost developers need to know how to interpret status.openstack.org/zuul17:57
anteayanot how zuul works17:57
anteayagreat17:57
jeblairboris-42: http://ci.openstack.org/project.html17:58
boris-42anteaya future developers of Infra should get High level understanding about how everything in Infra works17:58
anteayachannel logs and meeting logs are a great place to start17:58
anteayaeveryting in infra is a moving target17:58
anteayawhich changes daily17:58
boris-42anteaya yep, but global scope and projects are not17:58
anteayadeveloping in infra is more about daily communication habits than code17:58
anteayagreat17:58
boris-42anteaya but agree that such page should be updated every day/week17:58
anteayait is17:59
anteayathey are called channel logs17:59
anteayaand infra devs consume them daily17:59
*** thuc has quit IRC17:59
boris-42jeblair so the issue of that page, I read it, and I don't know even what project I should look for..17:59
anteayahttp://eavesdrop.openstack.org/irclogs/%23openstack-infra/17:59
boris-42anteaya btw about that logs, sorry for putting Rally as a sample, but this page is much better https://wiki.openstack.org/wiki/Rally/Updates for tracking project updates18:00
*** harlowja_at_home has joined #openstack-infra18:01
boris-42anteaya so probably that will be nice to have a person that will write such updates weekly, so you don't need to read a lot to get understanding about what is happening in infra =)18:01
anteayaboris-42: if you are volunteering to be that person, that is great18:02
anteayaI'm sure the information you provide will be consumed18:02
boris-42anteaya I will, but I need some time to understanding infra=)18:02
boris-42understand*18:02
anteayaboris-42: yes I understand18:02
boris-42jeblair so probably I should just try to start writing some wiki pages, about how I understand Infra as a newbie18:03
*** reed has joined #openstack-infra18:03
*** reed has quit IRC18:04
boris-42jeblair then this should be reviewed by cores to ensure that I didn't mix everything=)18:04
boris-42anteaya ^ thoughts ?18:04
anteayaboris-42: you might consider starting out with some blog posts18:04
anteayathen move them to wiki pages once you have a sense of things18:04
anteayathat is what I did18:04
*** shakamunyi has joined #openstack-infra18:06
boris-42anteaya I may write it at the end, but it simpler to me to work with wiki…18:06
mordredI will say that I agree with boris-42 that there is a deficiency here, so I welcome efforts in this direction18:06
mordredwe've got some excellent detailed docs18:06
mordredbut what's missing is a top level big-picture thing for folks with no pre-existing context18:07
boris-42mordred yep to "join in"18:07
boris-42mordred and I will try to make such one18:07
mordredboris-42: wootr18:08
boris-42mordred So I don't wan't to write docs in wiki page=) just diagrams and text to get involved and understand where you should look and what you should look =)18:08
mordredboris-42: yah18:08
jeblairplease don't put important docs in the wiki.  they won't be reviewed or updated by cores18:08
jeblairand i'd really rather we not end up with a bunch of docs about how to contribute to infra in the wiki that quickly go out of date18:08
jeblairso if you find some introductory material is missing from http://ci.openstack.org/index.html please add it18:09
mordredyeah - I think almost all of this, if not all, can go there ^^18:09
jeblairbut also know that documentation is _intentionally_ not detailed18:09
boris-42jeblair actually I don't think that at the "high level" scope  there is a lot of changes18:09
jeblairbecause it points to other sources of more detailed documentation18:09
jeblair(which, in turn, if they are missing details, should be updated)18:09
boris-42jeblair okay I will work on this page http://ci.openstack.org/index.html18:09
mordredjeblair: I don't thin kit's detailed info that's missing, I think it's top level narrative - what is this system in the first place18:10
boris-42mordred yep goal is to hide all details)18:11
mordred(essentially, a doc version of our intro presentations that we do)18:11
boris-42mordred btw what intro presentation?)18:13
*** harlowja_at_home has quit IRC18:13
*** CaptTofu has quit IRC18:15
*** CaptTofu has joined #openstack-infra18:16
*** _nadya_ has quit IRC18:17
mordredboris-42: http://docs.openstack.org/infra/publications/18:17
mordredhttp://docs.openstack.org/infra/publications/overview/ is a good one18:17
boris-42mordred thanks! =)18:17
mordredclarkb: ooh - I hadn't seen the logstash diagram: http://docs.openstack.org/infra/publications/overview/#%2834%2918:18
*** e0ne has quit IRC18:18
*** e0ne has joined #openstack-infra18:19
*** harlowja_at_home has joined #openstack-infra18:19
*** CaptTofu has quit IRC18:20
boris-42mordred nice presentation =)18:22
*** weshay has quit IRC18:31
*** harlowja_at_home has quit IRC18:32
*** mestery has quit IRC18:35
*** rlandy_ has quit IRC18:41
*** shakamunyi has quit IRC18:43
clarkbmordred that was part of my lca talk and jeblair put it in the overview too18:43
*** rdwrer is now known as marktraceur18:45
*** pcrews has joined #openstack-infra18:52
*** sdake has joined #openstack-infra18:55
mordredclarkb: "man puppet-kick"18:58
mordredclarkb: we've been making this too hard18:58
*** pcrews has quit IRC19:08
*** elasticio has joined #openstack-infra19:17
jeblairmordred: not keen on allowing incoming connections to agents on hosts19:23
jeblairmordred: (but perhaps would be okay with a good iptables config that allows only from puppetmaster)19:26
*** dcramer_ has joined #openstack-infra19:33
* fungi barely skimmed... okay with puppetry soft freeze for ramming big refactors through19:35
fungiand agree with jeblair that puppet-kick would need some tighter access controls, iptables works19:35
fungialso, boris-42, welcome and thanks!19:36
*** CaptTofu has joined #openstack-infra19:36
* fungi gets back to crating up the various albatrosses he wears around his neck19:37
boris-42fungi hi there=)19:39
clarkbgraphite looks broken again19:39
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Drive puppet from the master  https://review.openstack.org/8097619:39
clarkbViewDoesNotExist: Could not import graphite.render.views. Error was: No module named timezone19:39
clarkbgonna guess another django incompatibility19:39
mordredclarkb: awesome19:39
* clarkb would debug but going back to weekend now19:40
clarkbspring is sort of here time to walkt o the lake and find beer19:40
mordredfungi, jeblair: that patch is a sketch of iptables and puppet auth controls19:40
mordredclarkb: I'm cheering for the shockers right now19:40
*** CaptTofu has quit IRC19:41
clarkbmordred: is that wichita state?19:41
clarkbmordred: our broadcast has been interrupted with news conferences about the landslide all day19:41
mordredclarkb: GROSS19:41
mordredclarkb: has the landslide changed? like, is there anything you need to know about it really?19:42
mordredclarkb: (and yes, wichita state)19:42
mordredclarkb: they're leading kentucky right now19:42
clarkbmordred: the governor is trying to get the feds to declare a state of emergency19:42
clarkb18 people missing19:42
mordredclarkb: I suppose that's important19:43
jeblairmordred, nibalizer: why does puppetboard only show the last 10 reports for a host?19:49
*** rhsu has quit IRC19:51
*** rhsu has joined #openstack-infra19:51
jeblairmordred: did you start puppet on graphite?19:52
*** ociuhandu has joined #openstack-infra19:52
*** rhsu has quit IRC19:52
jeblairmordred: you need to check out graphite-web version 7f8c33da809e2938df55c1ff57ab5329d8d7b87819:54
jeblairmordred: graphite 0.9.x branch is broken with this issue https://github.com/graphite-project/graphite-web/issues/65019:54
mordredjeblair: yes. k. let me go do that - should we fix in puppet? or disable puppet on the host explicitly?19:55
jeblairmordred: probably just pin graphite-web to that sha in puppet for now19:56
mordredk. will do right now19:56
jeblairgotta run19:56
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Pin graphite-web  https://review.openstack.org/8238019:59
*** CaptTofu has joined #openstack-infra20:00
*** thuc_ has joined #openstack-infra20:01
openstackgerritA change was merged to openstack-infra/config: Pin graphite-web  https://review.openstack.org/8238020:04
*** thuc_ has quit IRC20:04
*** thuc_ has joined #openstack-infra20:04
boris-42mordred ^ oh how fast=)20:04
*** CaptTofu has quit IRC20:05
nibalizerjeblair: its hardcoded20:06
*** thedodd has quit IRC20:12
*** alff has joined #openstack-infra20:14
*** harlowja_at_home has joined #openstack-infra20:14
mordredjeblair: ^^ fixed20:16
lifelessmordred: back in the land of compatible tz's?20:17
mordredlifeless: yup! and also of better internets20:17
mordrednibalizer: I was just looking at http://docs.puppetlabs.com/puppetdb/latest/maintain_and_tune.html#monitor-the-performance-dashboard20:20
mordrednibalizer: is that something we should expose in some manner?20:20
nibalizermaybe20:21
*** bearhands is now known as comstud20:21
*** mgagne has joined #openstack-infra20:21
nibalizermy concern is that 8080 is the unathenticated trust-everybody endpoint, i wonder if the metrics are exposed on the secure endpoint20:21
nibalizeralso as we were talking in the meeting a couple weeks ago, we don't have anyone on call to respond to pages20:22
nibalizerso we could dump it in graphite just to keep it20:22
nibalizeractually those metrics are definitely exposed via the secure endpoint20:23
*** harlowja_at_home has quit IRC20:24
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Create propose_translation_update for horizon  https://review.openstack.org/8217620:27
*** mriedem has joined #openstack-infra20:31
*** CaptTofu has joined #openstack-infra20:33
*** caleb_ has joined #openstack-infra20:34
*** thuc has joined #openstack-infra20:38
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: propose_translation_update: Handle .tx/config in git  https://review.openstack.org/8238420:39
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Create propose_translation_update for horizon  https://review.openstack.org/8217620:40
*** harlowja_at_home has joined #openstack-infra20:42
*** thuc_ has quit IRC20:42
*** thuc has quit IRC20:42
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Use rolled-up nodepool stats  https://review.openstack.org/8238820:59
*** mrda_weekend is now known as mrda21:03
*** e0ne has quit IRC21:03
*** alff has quit IRC21:10
*** thuc has joined #openstack-infra21:14
mattoliveraujeblair: Yay! Puppetboard!!21:19
mordredmattoliverau: it's exciting isn't it?21:33
mattoliverauYeah, it really is :) But looks like it will be a source a many more bugs... now that the world can see puppet errors :P21:34
*** harlowja_at_home has quit IRC21:38
*** changbl has quit IRC21:38
*** thuc_ has joined #openstack-infra21:48
mordredyah21:51
mordredmattoliverau: otoh - maybe we can fix them21:52
*** thuc has quit IRC21:52
*** thuc_ has quit IRC21:53
*** jhesketh has joined #openstack-infra21:55
*** jhesketh_ has joined #openstack-infra21:56
jheskethMorning21:56
mattoliveraulol, defintely, maybe now that the puppet runs are more visible we can fix the problems and the old puppet hanging bugs could be thing of the past :)21:58
anteayamorning jhesketh21:58
mattoliveraumorning jhesketh21:58
*** caleb_ has quit IRC22:00
openstackgerritKhai Do proposed a change to openstack-infra/config: fix installation of nodepool on jenkins-dev  https://review.openstack.org/6132122:00
*** marktraceur has quit IRC22:03
*** Ryan_Lane has joined #openstack-infra22:06
*** bhuvan has joined #openstack-infra22:07
*** elasticio has quit IRC22:08
*** marktraceur has joined #openstack-infra22:14
*** ianw has joined #openstack-infra22:19
*** marktraceur has quit IRC22:20
fungimattoliverau: it's worth pointing out... the bugs were already there22:21
fungihowever, only a handful of us with access to the syslog on each of those systems was finding and fixing them previously22:21
funginow you can instead! ;)22:21
mordredyay!22:24
mattoliveraufungi: that's true, I can indeed :)22:28
openstackgerritA change was merged to openstack-infra/config: Fixup logstash vhost template to use @global vars  https://review.openstack.org/8046922:30
*** rhsu has joined #openstack-infra22:31
*** CaptTofu has quit IRC22:31
mordrednibalizer: have you tested https://review.openstack.org/#/c/71739/ with puppet apply?22:31
openstackgerritA change was merged to openstack-infra/config: Fixup lodgeit templates to use @global vars  https://review.openstack.org/8047022:31
*** Alexandra has joined #openstack-infra22:36
mordrednibalizer: from reading the docs, it appears it might be tricky to deal with22:40
mordrednibalizer, AaronGr: in general, it's extremely important that "git clone git://git.openstack.org/openstack-infra/config ; cd config ; puppet apply $some_amount_of_command_line_args" works ... or something of similar complexity22:41
nibalizerso long as we bring a hiera.yaml and specify it we should be ok with puppet apply22:42
mordrednibalizer, AaronGr: a "git grep 'puppet apply'" in the config repo will show the places where we use the form22:42
mordredk-  I _think_ we might need to specify it via --confdir (in 2.7 it's expected to be in $confdir/hiera.yaml) - but I'm pretty sure I agree with you22:43
lifelessrustlebee: can I get a copy of the crontab you used for reviewstats?22:43
lifelessrustlebee: I've setup a VM to host a temporary copy of it on22:44
mordrednibalizer: we might have more problems with the path specification, since we won't be doing puppet apply rooted on /etc/puppet22:45
mordrednibalizer: can we reference confdir in hiera.yaml ?22:45
*** CaptTofu has joined #openstack-infra22:52
*** CaptTofu has quit IRC22:57
mordrednibalizer: http://paste.openstack.org/show/7410622:59
mordrednibalizer: perhaps like that22:59
*** mgagne has quit IRC23:01
*** jamielennox|away is now known as jamielennox23:08
*** rhsu has quit IRC23:09
mordrednibalizer: or more completely: http://paste.openstack.org/show/7410723:10
*** jepoy has joined #openstack-infra23:10
lifelesswow23:16
lifeless2014-03-23 22:10:25.272 | Cloning into 'devstack-gate'...23:16
lifeless2014-03-23 22:10:25.433 | Build step 'Execute shell' marked build as failure23:16
lifeless2014-03-23 22:10:26.551 | [SCP] Connecting to static.openstack.org23:16
lifeless2014-03-23 22:10:30.705 | [SCP] No file(s) found: logs/**23:16
lifelessever seen failures like that ?23:16
lifeless2014-03-23 22:10:31.000 | [SCP] ‘logs/**’ doesn’t match anything, but ‘**’ does. Perhaps that’s what you mean?23:16
lifelesshttp://logs.openstack.org/40/75540/11/check-tripleo/check-tripleo-overcloud-precise/b7a841c/console.html23:17
*** CaptTofu has joined #openstack-infra23:18
mordredlifeless: I have not - although23:19
mordred2014-03-23 22:10:25.249 | git.openstack.org: Temporary failure in name resolution23:19
mordredseems to be your real problem23:19
lifelessah gnnnnar23:19
*** Alexandra has quit IRC23:20
lifelessI'm thinking we want a local git mirror in this cloud too23:21
*** flaper87 is now known as flaper87|afk23:21
*** CaptTofu has quit IRC23:22
mordredthat - and/or also getting dns fixed23:22
*** 92AAANHV8 has joined #openstack-infra23:23
*** Alexandra has joined #openstack-infra23:23
*** bhuvan has quit IRC23:25
lifelessmordred: dns isn't broken23:25
lifelessmordred: networking is23:25
lifelessmordred: (dns for that vm is 8.8.8.8)23:26
*** _Alexandra_ has joined #openstack-infra23:27
*** Alexandra has quit IRC23:27
*** Alexandra has joined #openstack-infra23:28
*** Alexandra has quit IRC23:28
*** _Alexandra_ has quit IRC23:28
*** Alexandra has joined #openstack-infra23:28
*** _Alexandra_ has joined #openstack-infra23:28
*** _Alexandra_ has left #openstack-infra23:30
*** _Alexandra_ has quit IRC23:30
*** CaptTofu has joined #openstack-infra23:36
openstackgerritPaul Belanger proposed a change to openstack-infra/nodepool: Set paramiko version > 1.9.0  https://review.openstack.org/8240423:38
*** harlowja_at_home has joined #openstack-infra23:39
*** changbl has joined #openstack-infra23:39
*** CaptTofu has quit IRC23:41
jeblairlifeless: why do you say networking is broken?23:41
lifelessjeblair: because we regularly see small networking issues in this rack23:45
jeblairlifeless: i think in this case, dns really is broken23:46
lifelessjeblair: PXE, TFTP, DNS, wget performance, a raft of things.23:46
clarkblifeless: isn't it that infiniband stuff?23:46
jeblairlifeless: i see a lot of similar failures, and we just merged some changes on friday to image builds related to dns23:46
lifelessclarkb: a lot of it certainly was/is, and we've only fixed the network node.23:46
jeblairlifeless: picking a ready tripleo node at random, i see that resolv.conf says: nameserver 192.168.1.123:46
lifelesswhaaa23:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Shorten update spinner fadeout on status page  https://review.openstack.org/8201923:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support to status page to collapse changesets  https://review.openstack.org/8201823:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add expand by default option to status page  https://review.openstack.org/8229023:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add a total progress bar to each change  https://review.openstack.org/8201723:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Format change headers like infra's status page  https://review.openstack.org/8201623:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add a filter box to status.html  https://review.openstack.org/8227923:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Build status page more jquery like  https://review.openstack.org/8171723:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Update zuul's status page to bootstrap 3.1.1  https://review.openstack.org/8201323:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add demo support for openstack's live zuul feed  https://review.openstack.org/8201423:47
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add in progress bars for jobs  https://review.openstack.org/8201523:47
jeblairlifeless: that's surprising, our change from friday should have set it to 127.0.0.1, which is a caching-forwarding resolver that, in this case should be forwarding to 8.8.8.823:47
jeblairlifeless: the second part of that is correct (unbound is running and configured correctly to forward to 8.8.8.8; i don't know why resolv.conf has the rfc1918 addr though)23:48
lifelessjeblair: thats plain wrong, bad network configuration fo rthe test network.23:48
lifelessat a guess23:48
lifelesspoking now23:48
jeblairlifeless: it got it from the eth1 dhcp lease23:49
lifelessjeblair: thats what I expected23:49
lifelessfail | enable_dhcp      | True                                             |23:50
lifelessgnar neutron subnet-update is so useless!23:51
jeblairlifeless: i _thought_ i tested the tripleo node; any chance something about this changed in the past week or so?23:51
lifelessno23:51
jeblairlifeless: in that case, i'm sorry i didn't catch this in testing23:52
lifelessok, enable_dhcp set to False for that23:53
lifelessoh no, thats not what I wanted.23:53
lifelessI want to disable dns_nameserver23:55
*** marktraceur has joined #openstack-infra23:56
lifeless1.1 is owned by the dhcp agent23:56
lifelessactually, I'm not sure that I *can* disable this23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!