Wednesday, 2015-07-01

*** dboik has quit IRC00:00
*** asettle has joined #openstack-infra00:01
*** claudiub_ has quit IRC00:02
*** laughterwym has joined #openstack-infra00:03
*** wenlock has quit IRC00:06
*** thorst has joined #openstack-infra00:07
*** thorst has quit IRC00:11
clarkbhttps://github.com/ether/etherpad-lite/issues/2522 updated with what we see on etherpad-dev00:11
*** larainema has joined #openstack-infra00:14
*** DericHorn-HP has joined #openstack-infra00:15
*** mwagner_lap has joined #openstack-infra00:15
*** mtanino has quit IRC00:15
*** DericHorn-HP has quit IRC00:16
*** otter768 has quit IRC00:20
*** sputnik1_ has quit IRC00:21
*** chlong has joined #openstack-infra00:21
*** Qiming has quit IRC00:23
*** cindyo has quit IRC00:23
*** julim has quit IRC00:24
*** cebruns has quit IRC00:27
*** schang has quit IRC00:27
*** peterstac has quit IRC00:27
*** sirushti has quit IRC00:28
*** cebruns has joined #openstack-infra00:28
*** timfreund has quit IRC00:29
*** sdake has quit IRC00:29
*** dougshelley66 has quit IRC00:30
*** timfreund has joined #openstack-infra00:30
*** jasondotstar has joined #openstack-infra00:30
*** dims has joined #openstack-infra00:32
*** sirushti has joined #openstack-infra00:33
*** peterstac has joined #openstack-infra00:34
*** otter768 has joined #openstack-infra00:34
*** dougshelley66 has joined #openstack-infra00:35
*** dims_ has joined #openstack-infra00:35
*** olaph has joined #openstack-infra00:37
*** schang has joined #openstack-infra00:37
*** puranamr has quit IRC00:38
*** dprince has joined #openstack-infra00:39
*** dims has quit IRC00:39
*** ddieterly has joined #openstack-infra00:39
*** puranamr has joined #openstack-infra00:39
*** geoffarnold has quit IRC00:40
*** asettle has quit IRC00:40
*** ddieterl_ has joined #openstack-infra00:43
*** ddieterly has quit IRC00:44
*** Swami has quit IRC00:44
krotscheckOk, so I've been having significant problems with builds failing for random intermittent reasons. Given the same exact patch, I've had it pass, fail in grenade, unstable in tempest, fail in devstack, fail in docs, all at different times and in different rechecks. The build itself takes up to 2 hours, so it's more than a little frustrating when I have +2A on a thing I've been pushing for weeks. What's going on?00:45
*** teran has joined #openstack-infra00:49
*** teran has quit IRC00:54
pabelangerzaro, yes, the team is aware of it.00:54
*** crc32 has quit IRC00:55
pabelangerzaro, not sure if they sent out a message or not. However, I can find out00:55
*** dannywilson has quit IRC00:55
*** sigmavirus24 is now known as sigmavirus24_awa00:58
*** annegentle has joined #openstack-infra01:01
*** boris-42 has quit IRC01:02
*** Rockyg has joined #openstack-infra01:03
openstackgerritMerged openstack-infra/irc-meetings: Add agenda page URL to Refstack team meeting.  https://review.openstack.org/19736501:07
*** kiran-r has joined #openstack-infra01:10
*** dprince has quit IRC01:10
*** r-daneel has quit IRC01:11
*** armax has quit IRC01:12
*** esmute__ has quit IRC01:13
*** bswartz has quit IRC01:14
*** heyongli has quit IRC01:14
*** heyongli has joined #openstack-infra01:15
*** armax has joined #openstack-infra01:18
*** changbl has joined #openstack-infra01:18
*** Qiming_ has joined #openstack-infra01:19
*** armax has quit IRC01:22
*** dannywilson has joined #openstack-infra01:23
*** yamamoto has joined #openstack-infra01:24
*** patrickeast has quit IRC01:24
*** Rockyg has quit IRC01:28
*** sputnik13 has joined #openstack-infra01:30
*** sputnik13 has quit IRC01:31
*** sputnik13 has joined #openstack-infra01:32
*** asselin_ has joined #openstack-infra01:33
*** sputnik13 has quit IRC01:33
*** otter768 has quit IRC01:36
*** yamamoto has quit IRC01:37
*** hdd has joined #openstack-infra01:40
*** annegentle has quit IRC01:42
*** enikanorov2 has quit IRC01:46
*** esmute__ has joined #openstack-infra01:47
*** Qiming_ is now known as Qiming01:49
*** teran has joined #openstack-infra01:50
*** puranamr has quit IRC01:51
*** teran has quit IRC01:56
*** sdake has joined #openstack-infra01:57
ianwi think i figured out why centos6 era git is so slow over https -> https://bugzilla.redhat.com/show_bug.cgi?id=123739501:58
openstackbugzilla.redhat.com bug 1237395 in git "extremley slow https clone performance" [Unspecified,New] - Assigned to pstodulk01:59
*** sdake_ has joined #openstack-infra01:59
ianwso hopefully the way forward on that is to fix the package (from today's meeting)01:59
*** homeless has quit IRC02:00
*** enikanorov2 has joined #openstack-infra02:01
*** camunoz has quit IRC02:02
*** sdake has quit IRC02:02
*** camunoz has joined #openstack-infra02:02
*** yamahata has quit IRC02:05
*** jasondotstar has quit IRC02:07
*** annegentle has joined #openstack-infra02:08
*** esmute__ has quit IRC02:08
*** ajo has quit IRC02:08
*** pabelanger has quit IRC02:09
*** Longgeek_ has joined #openstack-infra02:10
*** pabelanger has joined #openstack-infra02:10
*** sdake_ has quit IRC02:10
*** sdake has joined #openstack-infra02:10
*** ajo has joined #openstack-infra02:11
*** Longgeek has quit IRC02:12
*** coolsvap|away has quit IRC02:13
*** yamamoto has joined #openstack-infra02:13
*** esmute__ has joined #openstack-infra02:13
*** kiran-r has quit IRC02:14
*** coolsvap|away has joined #openstack-infra02:15
*** ivar-laz_ has joined #openstack-infra02:15
*** ivar-laz_ has quit IRC02:15
*** mriedem has quit IRC02:16
*** ivar-lazzaro has quit IRC02:17
*** xyang1 has quit IRC02:23
*** pabelanger has quit IRC02:27
*** pabelanger has joined #openstack-infra02:28
*** tqtran has quit IRC02:28
*** unicell has quit IRC02:29
openstackgerritlifeless proposed openstack-infra/project-config: Be clear about when a failure occurs.  https://review.openstack.org/19739902:30
openstackgerritlifeless proposed openstack-infra/project-config: Really fix requirement checking.  https://review.openstack.org/19740002:30
openstackgerritlifeless proposed openstack-infra/project-config: Really fix requirement checking.  https://review.openstack.org/19740002:31
lifelessmordred: fungi: jhesketh: AJaeger: - https://review.openstack.org/#/c/197400/ <- really fix things.02:32
lifelessthis time with lots of manual testing02:32
*** baoli has joined #openstack-infra02:34
jheskethlifeless: little nit02:35
lifelessjhesketh: btw flaper87 is putting in a talk proposal for us02:36
jheskethoh cool :-)02:36
lifelessjhesketh: replied in the review02:37
*** Kennan has quit IRC02:38
*** Kennan has joined #openstack-infra02:38
*** Longgeek_ has quit IRC02:39
jheskethlifeless: ah thanks, lgtm02:40
jheskethlifeless: although why was the head reqs not strict previously? will this break anything02:40
lifelessjhesketh: I think I inverted it in a prior patch02:40
lifelessjhesketh: the idea is that whats in master / stable/kilo etc should not be allowed to cause a failure02:41
*** Longgeek has joined #openstack-infra02:41
jheskethyep, I agree this new one looks right02:41
jheskethjust curious02:41
*** marun has joined #openstack-infra02:43
*** weshay has quit IRC02:43
*** baoli has quit IRC02:47
*** binbincong has quit IRC02:47
*** binbincong has joined #openstack-infra02:49
*** baoli has joined #openstack-infra02:49
*** unicell has joined #openstack-infra02:52
*** teran has joined #openstack-infra02:52
*** gyee has quit IRC02:52
*** annegentle has quit IRC02:53
*** teran has quit IRC02:57
*** fallenpegasus has quit IRC03:03
*** annegentle has joined #openstack-infra03:04
*** Longgeek has quit IRC03:14
openstackgerritMerged openstack-infra/irc-meetings: Update the TripleO meeting schedule  https://review.openstack.org/19720203:16
*** unicell has quit IRC03:22
*** unicell has joined #openstack-infra03:23
openstackgerritEmilien Macchi proposed openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations  https://review.openstack.org/19740703:24
*** baoli has quit IRC03:26
lifelessholy cow03:31
*** annegentle has quit IRC03:31
lifelessits green03:31
lifelessSHIP IT03:31
lifeless(constraints)03:33
*** esmute__ has quit IRC03:33
*** yamada-h has joined #openstack-infra03:36
*** otter768 has joined #openstack-infra03:37
*** annegentle has joined #openstack-infra03:38
*** harlowja_at_home has joined #openstack-infra03:40
*** jyuso1 has joined #openstack-infra03:41
*** otter768 has quit IRC03:42
*** Longgeek has joined #openstack-infra03:45
*** BharatK has joined #openstack-infra03:46
*** ildikov has quit IRC03:47
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: refactorize puppet-syntax job  https://review.openstack.org/19721603:47
*** annegentle has quit IRC03:48
*** Longgeek has quit IRC03:49
*** jogo has joined #openstack-infra03:50
*** teran has joined #openstack-infra03:52
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: add puppet-unit-latest job  https://review.openstack.org/19721803:54
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: do not run beaker/upgrade jobs on old branches  https://review.openstack.org/19721903:54
*** soren has joined #openstack-infra03:55
*** teran has quit IRC03:57
*** heyongli has quit IRC03:57
*** ddieterl_ has quit IRC03:58
*** heyongli has joined #openstack-infra03:58
*** dims_ has quit IRC04:03
*** acruz has quit IRC04:05
*** asettle has joined #openstack-infra04:06
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman  https://review.openstack.org/19517504:06
openstackgerritgreghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests  https://review.openstack.org/19492804:06
*** heyongli has quit IRC04:07
*** heyongli has joined #openstack-infra04:08
*** yfried has quit IRC04:08
*** Alexandra_ has joined #openstack-infra04:08
*** armax has joined #openstack-infra04:10
*** asettle has quit IRC04:10
*** coolsvap|away is now known as coolsvap04:14
*** Alexandra_ has quit IRC04:14
openstackgerritDon Dugger proposed openstack-infra/irc-meetings: New meeting time  https://review.openstack.org/19741204:15
*** harlowja_at_home has quit IRC04:15
*** koolhead17 has joined #openstack-infra04:17
*** achanda has joined #openstack-infra04:19
*** dannywilson has quit IRC04:21
*** dannywilson has joined #openstack-infra04:21
*** morganfainberg is now known as caerbannograbbit04:24
*** caerbannograbbit is now known as CaerbannogRabbit04:24
*** MarkAtwood has joined #openstack-infra04:26
*** Qiming has quit IRC04:26
openstackgerritMerged openstack-infra/irc-meetings: New meeting time  https://review.openstack.org/19741204:28
*** puranamr has joined #openstack-infra04:28
openstackgerritEmilien Macchi proposed openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations  https://review.openstack.org/19740704:31
*** deepakcs has joined #openstack-infra04:33
*** Longgeek has joined #openstack-infra04:34
*** achanda has quit IRC04:38
*** kiran-r has joined #openstack-infra04:41
*** fawadkhaliq has joined #openstack-infra04:43
openstackgerritAnand Shanmugam proposed openstack/requirements: Adding cloudpulse and cloudpulseclient to projects  https://review.openstack.org/19600404:43
openstackgerritMerged openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations  https://review.openstack.org/19740704:44
*** hdd has quit IRC04:46
*** yfried has joined #openstack-infra04:49
*** annegentle has joined #openstack-infra04:49
*** yfried_ has joined #openstack-infra04:52
*** teran has joined #openstack-infra04:53
*** yfried has quit IRC04:53
*** annegentle has quit IRC04:55
*** kiran-r has quit IRC04:56
*** kiran-r has joined #openstack-infra04:56
*** esmute__ has joined #openstack-infra04:57
*** teran has quit IRC04:58
*** ddieterly has joined #openstack-infra04:59
*** skraynev has joined #openstack-infra05:02
*** ilyashakhat has joined #openstack-infra05:02
*** ddieterly has quit IRC05:03
*** chlong has quit IRC05:03
*** dims has joined #openstack-infra05:07
*** esmute__ has quit IRC05:09
*** fallenpegasus has joined #openstack-infra05:09
*** dims has quit IRC05:12
*** chlong has joined #openstack-infra05:21
*** esmute__ has joined #openstack-infra05:22
*** marun has quit IRC05:23
*** heyongli has quit IRC05:30
openstackgerritJens Rosenboom proposed openstack-infra/nodepool: Be more careful when config options are not set  https://review.openstack.org/19052605:31
*** abregman has joined #openstack-infra05:33
*** yfried_ is now known as yfried|afk05:33
*** heyongli has joined #openstack-infra05:37
*** yfried|afk is now known as yfried_05:37
*** otter768 has joined #openstack-infra05:38
*** mmedvede has quit IRC05:40
*** kaisers1 has quit IRC05:43
*** otter768 has quit IRC05:43
*** jtomasek has joined #openstack-infra05:45
*** dannywilson has quit IRC05:53
*** puranamr has quit IRC05:53
*** teran has joined #openstack-infra05:54
*** jgrimm is now known as zz_jgrimm05:55
lifelessok so constraints are ready05:57
lifelessoh gnarg. a failure I missed.05:58
lifelessin 1 hr we'll know05:58
*** teran has quit IRC05:59
*** e0ne has joined #openstack-infra05:59
*** ddieterly has joined #openstack-infra06:00
*** davideag_ has quit IRC06:00
*** chlong has quit IRC06:01
*** chlong has joined #openstack-infra06:01
*** BharatK has quit IRC06:02
*** ddieterly has quit IRC06:04
*** fawadkhaliq has quit IRC06:04
*** e0ne has quit IRC06:11
*** john-davidge has joined #openstack-infra06:12
*** puranamr has joined #openstack-infra06:13
*** gokrokve has joined #openstack-infra06:16
*** mrunge has joined #openstack-infra06:16
*** spredzy|afk is now known as spredzy06:16
*** BharatK has joined #openstack-infra06:17
*** gokrokve has quit IRC06:18
*** puranamr has quit IRC06:18
*** chlong has quit IRC06:19
*** marun has joined #openstack-infra06:20
*** MarkAtwood has quit IRC06:20
*** scheuran has joined #openstack-infra06:20
openstackgerritSteve Martinelli proposed openstack-infra/project-config: Create automated job for sample configuration files  https://review.openstack.org/17762006:21
*** fawadkhaliq has joined #openstack-infra06:25
*** marun has quit IRC06:25
*** fawadkhaliq has quit IRC06:31
*** chlong has joined #openstack-infra06:34
*** _nadya_ has joined #openstack-infra06:34
*** nikil89_ has joined #openstack-infra06:35
*** nikil89_ is now known as naggappan06:35
*** skraynev has quit IRC06:35
*** mrunge has quit IRC06:35
*** yamahata has joined #openstack-infra06:39
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix Normalize projects.yaml proposal  https://review.openstack.org/19744306:40
blaeddlifeless, tests take an hour to run? eww.06:42
*** asettle has joined #openstack-infra06:43
*** mrunge has joined #openstack-infra06:45
*** Murad has joined #openstack-infra06:45
Muraddoes anybody have any idea how in install devstack with infiniband interface?06:46
*** ildikov has joined #openstack-infra06:49
*** Ala has joined #openstack-infra06:50
*** k4n0 has joined #openstack-infra06:51
*** annegentle has joined #openstack-infra06:51
*** yfried_ is now known as yfried|afk06:52
*** teran has joined #openstack-infra06:55
*** skraynev has joined #openstack-infra06:56
*** annegentle has quit IRC06:56
*** esmute__ has quit IRC06:58
*** teran has quit IRC06:59
*** yfried|afk is now known as yfried_06:59
*** ddieterly has joined #openstack-infra07:00
*** otter768 has joined #openstack-infra07:00
*** hichihara has quit IRC07:01
*** frobware_ has joined #openstack-infra07:01
*** isviridov_away is now known as isviridov07:01
clarkbMurad I am not aware of any direct support. IPoIB is likely your best bet with devstack07:01
clarkbfor not devstacj I believe there is a neutron plugin for mellanox07:02
*** doude has joined #openstack-infra07:03
*** leanderthal has quit IRC07:03
*** asettle has quit IRC07:04
*** ddieterly has quit IRC07:05
*** otter768 has quit IRC07:06
AJaegerclarkb, fungi, pleia2: The change we did for the proposal jobs works fine and is needed as well here: https://review.openstack.org/197443 - please review to unbreak that job07:06
*** yamamoto has quit IRC07:08
clarkbAJaeger does that work if the branch already exists?07:09
AJaegerthe -B ensures that07:09
clarkbor does checkout -B fail on the second run? these are not single use nodes so this may break07:09
AJaeger"           If -B is given, <new_branch> is created if it doesn’t exist; otherwise, it is reset"07:10
clarkboh -B is dont dail if exists on top of -b?07:10
clarkbcool thanks07:10
openstackgerritMerged openstack-infra/project-config: Really fix requirement checking.  https://review.openstack.org/19740007:10
*** fallenpegasus has quit IRC07:12
openstackgerritPeng Wu proposed openstack-infra/project-config: This draft patch is created for more-gettext-support jenkins jobs.  https://review.openstack.org/19744807:12
*** mpavone has joined #openstack-infra07:12
*** sshnaidm has joined #openstack-infra07:13
*** yamamoto has joined #openstack-infra07:15
*** HeOS has quit IRC07:15
*** leanderthal has joined #openstack-infra07:16
*** armax has quit IRC07:18
*** devvesa has joined #openstack-infra07:21
*** chlong has quit IRC07:24
*** ParsectiX has joined #openstack-infra07:24
*** dizquierdo has joined #openstack-infra07:27
*** Jeffrey4l has joined #openstack-infra07:28
*** ihrachyshka has joined #openstack-infra07:28
*** puranamr has joined #openstack-infra07:28
*** dtantsur|afk is now known as dtantsur07:28
*** JayF has quit IRC07:29
*** JayF has joined #openstack-infra07:29
*** mjturek1 has joined #openstack-infra07:30
*** Jeffrey4l has quit IRC07:31
*** rbradfor_ has quit IRC07:31
*** zz_jgrimm has quit IRC07:31
*** rbradfor_ has joined #openstack-infra07:31
*** mpaolino has joined #openstack-infra07:32
*** Jeffrey4l has joined #openstack-infra07:33
*** zz_jgrimm has joined #openstack-infra07:33
*** puranamr has quit IRC07:33
*** hashar has joined #openstack-infra07:33
Jeffrey4lis there any block rules exist in review.openstack.org?07:34
Jeffrey4lI can not connect the gerrit server07:34
mrungeJeffrey4l, are you located in China?07:35
Jeffrey4lyup07:35
mrungecongrats. Great wall of china blocks it07:35
*** unicell has quit IRC07:35
mrungeJeffrey4l, this question was asked several times in the past. Recommendation was, to use a tunnel07:35
Jeffrey4lholly shit07:36
Jeffrey4lmrunge, thanks you.07:36
mrungeJeffrey4l, good luck07:36
mrungethis block doesn't make any sense07:36
mrungeI hope it gets fixed07:36
*** sshnaidm has quit IRC07:38
Jeffrey4lmrunge, yup. But u know, there is no way to request the fix.07:38
*** sshnaidm has joined #openstack-infra07:38
mrungeJeffrey4l, yes. That's like government agencies work, everywhere07:39
*** dizquierdo has quit IRC07:42
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Fix script file name for Inspector dsvm job  https://review.openstack.org/19745307:43
*** jlanoux has joined #openstack-infra07:43
lifelessblaedd: devstack etc07:43
lifelessblaedd: unit tests are much faster07:44
clarkbJeffrey4l https should work07:44
lifelessblaedd: but the integration tests for the system install a full cloud07:44
lifelessblaedd: and then exercise it07:44
lifelessblaedd: (on multiple nodes) - and they're full VM's not containers07:44
*** Guest21021 has quit IRC07:44
clarkbJeffrey4l http://lists.openstack.org/pipermail/openstack-dev/2014-September/045385.html07:45
*** jistr has joined #openstack-infra07:45
Jeffrey4lclarkb, thanks a lot. u save lots of time for me. I will try that.07:46
*** jtomasek has quit IRC07:48
*** jcoufal has joined #openstack-infra07:49
*** hashar has quit IRC07:50
*** shardy has joined #openstack-infra07:50
*** hashar has joined #openstack-infra07:50
*** arxcruz has joined #openstack-infra07:52
lifelessAHAHAHAHAAH07:52
lifelesskilled by my own cleverness: virtualenv was held back by upper-constraints.txt07:52
*** kiran-r has quit IRC07:52
*** yfried_ is now known as yfried07:53
lifelessfungi: / mordred: ^ you may appreciate the irony07:55
*** teran has joined #openstack-infra07:55
lifelessThe changeset to test constraints working failed because constraints worked07:56
*** mpaolino has quit IRC07:56
*** hashar has quit IRC07:56
*** e0ne has joined #openstack-infra07:56
AJaegerlifeless: ;)07:58
*** afazekas is now known as __afazekas07:59
*** shardy has quit IRC08:00
*** shardy has joined #openstack-infra08:00
*** ddieterly has joined #openstack-infra08:01
*** Hal has joined #openstack-infra08:01
*** teran has quit IRC08:01
*** Hal is now known as Guest2951708:02
openstackgerritlifeless proposed openstack/requirements: Update upper-constraints.txt  https://review.openstack.org/19746108:02
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Fix script file name for Inspector dsvm job  https://review.openstack.org/19745308:02
lifelessso https://review.openstack.org/197461 should fix it08:02
*** hashar has joined #openstack-infra08:03
*** mrunge has quit IRC08:04
*** koolhead17 has quit IRC08:05
*** ddieterly has quit IRC08:06
clarkbso does everythibg break until we bumo that whenwver virtualenv releases?08:07
clarkb*bump08:07
* blaedd runs the tripleo devtest inside a vm on his home machine, and waits for things to explode08:07
clarkbbecause that represents a flaw in the system if so08:09
*** marun has joined #openstack-infra08:09
*** mrunge has joined #openstack-infra08:09
lifelessclarkb: huh? no, its the pip vendoring08:10
*** teran has joined #openstack-infra08:10
*** fhubik has joined #openstack-infra08:11
lifelessclarkb: new virtualenv is needed *in constraints mode* because it has the new pip vendored in it08:11
clarkbgotcha so going forwar is not an issue08:12
lifelessright08:12
openstackgerritlifeless proposed openstack-infra/devstack-gate: Switch to using constraints files.  https://review.openstack.org/19488608:13
*** isviridov is now known as isviridov_away08:13
*** BobBall_AWOL is now known as BobBall08:14
*** marun has quit IRC08:14
lifelessAJaeger: care to  +2+A on https://review.openstack.org/197461 :)08:14
lifelessAJaeger: it only changes upper-constraints.txt which isn't in use yet, so tis a no-brainer08:15
AJaegerlifeless: I don't have +2 permissions there...08:15
lifelessAJaeger: oh, I thought you were infra +2 capable08:15
*** __afazekas is now known as afazekas08:20
*** bmwiedemann has joined #openstack-infra08:24
*** yamahata has quit IRC08:26
AJaegerlifeless: only project-config08:27
lifelessAJaeger: ah, sadness.08:27
lifelessjhesketh: still around ?08:27
jheskethlifeless: roger08:28
AJaegerno: Focus and thus sanity ;)08:28
lifelessjhesketh: https://review.openstack.org/197461 please :)08:28
*** dguerri` is now known as dguerri08:29
*** HeOS has joined #openstack-infra08:29
*** yamamoto has quit IRC08:31
GheRiverolifeless: should we wait for tests to pass? ^^08:32
jheskethlifeless: lgtm08:32
jheskethGheRivero: yes08:32
GheRivero:)08:33
openstackgerritVictor Stinner proposed openstack-infra/jenkins-job-builder: Fix Builder.update_job() on Python 3  https://review.openstack.org/17223808:35
openstackgerritVictor Stinner proposed openstack-infra/jenkins-job-builder: Replace open() with codecs.open()  https://review.openstack.org/18348808:35
*** e0ne is now known as e0ne_08:36
AJaegerGheRivero, jhesketh: Jenkins will not allow a merge without tests to pass, so you could approve IMHO unless there are non-voting changes taht you like to review...08:37
*** yamamoto has joined #openstack-infra08:37
* AJaeger normally also waits for the results to double check ;)08:37
jheskethAJaeger: yeah it's just a double check08:38
*** e0ne_ is now known as e0ne08:38
jheskethmostly because without reviewing every tiny increment/release of all the updated packages it's hard to know what that change will actually do08:39
*** dizquierdo has joined #openstack-infra08:39
*** dizquierdo has quit IRC08:39
*** dizquierdo has joined #openstack-infra08:39
*** pelix has joined #openstack-infra08:39
*** dguitarbite has quit IRC08:40
*** notnownikki has joined #openstack-infra08:40
*** dguerri is now known as dguerri`08:41
*** e0ne has quit IRC08:41
lifelessGheRivero: no :)08:43
lifelessGheRivero: upper-constraints isn't used by anything landed, so it can't possibly affect tests08:43
lifelessjhesketh: GheRivero: ^ - so +A :)08:43
*** laughterwym has quit IRC08:47
*** jasondotstar has joined #openstack-infra08:48
*** ParsectiX has quit IRC08:49
*** afazekas is now known as __afazekas08:50
*** ParsectiX has joined #openstack-infra08:50
*** mase_x200 has joined #openstack-infra08:50
GheRiverolifeless: done08:51
*** pblaho has joined #openstack-infra08:51
*** dtantsur is now known as dtantsur|brb08:58
openstackgerritMerged openstack-infra/zuul: Status: Fix JSHint violations and commit settings  https://review.openstack.org/16995709:00
*** mpavlase has joined #openstack-infra09:00
*** mase_x200 has quit IRC09:01
*** hashar has quit IRC09:01
*** naggappan has quit IRC09:01
*** ddieterly has joined #openstack-infra09:02
*** otter768 has joined #openstack-infra09:02
*** dizquierdo has quit IRC09:05
*** ddieterly has quit IRC09:06
*** Guest29517 has quit IRC09:06
*** hashar has joined #openstack-infra09:06
*** Hal has joined #openstack-infra09:06
*** Hal is now known as Guest6045209:07
*** otter768 has quit IRC09:07
lifelessGheRivero: \o/ thanks09:08
*** dims has joined #openstack-infra09:08
*** teran has quit IRC09:11
*** abregman is now known as abregman|lunch09:12
*** dims has quit IRC09:14
*** katyafervent is now known as katyafervent_awa09:19
hashargood morning09:19
*** katyafervent_awa is now known as katyafervent09:20
*** afazekas has joined #openstack-infra09:24
*** KanagarajM has joined #openstack-infra09:24
*** dizquierdo has joined #openstack-infra09:24
KanagarajMAJaeger: Hi, could you review  https://review.openstack.org/#/c/195531/ (for heat project)09:24
ekarlsohttp://pastebin.com/BvGA8t6H < anyone know what's wrong here ?09:26
AJaegerKanagarajM: +209:27
KanagarajMAJaeger: thanks09:27
*** samuelBartel has joined #openstack-infra09:27
AJaegerlifeless: could you look at ekarlso's pastebein ^, please? Looks requirements related09:27
KanagarajMSergeyLukjanov: Hi, could you review  https://review.openstack.org/#/c/195531/ (for heat project)09:29
*** ihrachyshka has quit IRC09:30
*** yamada-h has quit IRC09:31
*** fhubik is now known as fhubik_afk09:32
*** Guest60452 has quit IRC09:33
SergeyLukjanovKanagarajM, approved09:34
*** e0ne has joined #openstack-infra09:35
*** fhubik_afk is now known as fhubik09:35
KanagarajMSergeyLukjanov: thanks09:36
*** laughterwym has joined #openstack-infra09:37
kashyapFor some reason, some of the repos in `gertty` doesn't sync and Error out after some amount of trying.09:38
*** Sherif has joined #openstack-infra09:39
*** ociuhandu has quit IRC09:39
lifelessAJaeger: http://lists.openstack.org/pipermail/openstack-dev/2015-June/068031.html09:39
openstackgerritMerged openstack-infra/project-config: Enables job for heat convergence functional test  https://review.openstack.org/19553109:40
kashyapAny clues about this? Also, strangely ~/.gertty.log ends up being a data file. (/me is using the newest upstream release.)09:40
*** Sherif has quit IRC09:40
lifelessekarlso: ^09:40
* kashyap enables debug logging and checks09:41
AJaegerlifeless: thanks. Seems really to address ekarlso's problem09:42
*** bradjones has quit IRC09:44
ekarlsolifeless: thnx!09:44
*** Hal has joined #openstack-infra09:44
*** Hal is now known as Guest7540709:45
*** sdake has quit IRC09:46
*** bradjones has joined #openstack-infra09:46
*** bradjones has quit IRC09:46
*** bradjones has joined #openstack-infra09:46
*** mikeit has joined #openstack-infra09:47
openstackgerritMerged openstack/requirements: Update upper-constraints.txt  https://review.openstack.org/19746109:52
*** soren has quit IRC09:54
*** marun has joined #openstack-infra09:58
*** dims has joined #openstack-infra09:59
*** ihrachyshka has joined #openstack-infra09:59
*** BharatK has quit IRC10:01
*** yamada-h has joined #openstack-infra10:01
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Make Sahara python3 job voting  https://review.openstack.org/19749810:02
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/19650410:02
*** marun has quit IRC10:02
*** ddieterly has joined #openstack-infra10:02
*** andrey-mp has joined #openstack-infra10:04
*** Guest75407 has quit IRC10:05
*** andrey-mp has quit IRC10:05
*** andrey-mp has joined #openstack-infra10:05
andrey-mpHi! Who can help me to understand how to merge this - https://review.openstack.org/#/c/172335/ ?10:06
*** yamada-h has quit IRC10:06
openstackgerritGorka Eguileor proposed openstack-infra/elastic-recheck: Add fingerprint for Glance upload disconnect  https://review.openstack.org/19750010:07
openstackgerritDirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder  https://review.openstack.org/19750110:07
*** ddieterly has quit IRC10:07
*** dtantsur|brb is now known as dtantsur10:08
*** soren has joined #openstack-infra10:09
openstackgerritAntoine Musso proposed openstack-infra/gearman-plugin: Fix deadlock from a WORK_FAIL event  https://review.openstack.org/19242910:17
*** abregman|lunch is now known as abregman10:20
*** john-davidge has quit IRC10:21
*** hafe has joined #openstack-infra10:22
hafewhen I try to submit the ICLA I get server error - "Cannot store contact information", any ideas?10:23
fricklerhafe: the usual response would be to look at https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/10:26
hafefrickler: thanks10:27
*** john-davidge has joined #openstack-infra10:27
*** yamamoto has quit IRC10:28
andrey-mpok, Who can set review on this - https://review.openstack.org/#/c/172335/ ?10:28
*** samuelBartel has quit IRC10:29
*** pc_m has joined #openstack-infra10:31
openstackgerritBob Ball proposed openstack-infra/irc-meetings: Update XenAPI team meeting  https://review.openstack.org/19750710:32
*** BharatK has joined #openstack-infra10:32
openstackgerritFlorian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag.  https://review.openstack.org/19750810:34
*** john-davidge has quit IRC10:34
*** fhubik is now known as fhubik_afk10:34
*** binbincong has quit IRC10:34
openstackgerritFlorian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag.  https://review.openstack.org/19495410:38
*** e0ne is now known as e0ne_10:39
*** e0ne_ is now known as e0ne10:39
*** yfried is now known as yfried|afk10:40
*** DericHorn-HP has joined #openstack-infra10:42
*** claudiub has joined #openstack-infra10:46
*** yfried|afk is now known as yfried10:46
*** sergmelikyan has joined #openstack-infra10:49
*** nfedotov has joined #openstack-infra10:50
*** hashar has quit IRC10:50
*** KanagarajM has left #openstack-infra10:53
*** hafe has left #openstack-infra10:55
openstackgerritBob Ball proposed openstack-infra/irc-meetings: Update XenAPI team meeting  https://review.openstack.org/19750710:55
*** BharatK has quit IRC10:57
*** Hal has joined #openstack-infra10:58
*** Hal is now known as Guest2271610:59
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Update XenAPI team meeting  https://review.openstack.org/19750711:00
*** dprince has joined #openstack-infra11:01
*** ociuhandu has joined #openstack-infra11:03
*** ddieterly has joined #openstack-infra11:03
openstackgerritSergey Skripnick proposed openstack-infra/project-config: Switch rally-heat job to neutron from nova-network  https://review.openstack.org/19751511:05
*** ddieterly has quit IRC11:08
*** weshay has joined #openstack-infra11:08
*** BharatK has joined #openstack-infra11:10
openstackgerritMerged openstack-infra/irc-meetings: Update XenAPI team meeting  https://review.openstack.org/19750711:11
*** mikeit has quit IRC11:14
*** teran has joined #openstack-infra11:15
*** sergmelikyan has quit IRC11:17
*** fhubik_afk is now known as fhubik11:17
*** fhubik is now known as fhubik_afk11:18
*** teran_ has joined #openstack-infra11:18
*** teran has quit IRC11:20
BobBalltonyb: How long does it take for the main page @eavesdrop.openstack.org to be updated with the new meeting time?11:20
*** yamamoto has joined #openstack-infra11:20
*** e0ne is now known as e0ne_11:24
*** e0ne_ is now known as e0ne11:24
*** DericHorn-HP has quit IRC11:25
*** sergmelikyan has joined #openstack-infra11:25
*** sergmelikyan has quit IRC11:29
*** sergmelikyan has joined #openstack-infra11:29
openstackgerritSergey Lukjanov proposed openstack-infra/project-config: Start using in-tree Sahara Devstack plugin  https://review.openstack.org/19752411:29
openstackgerritAndrey Kurilin proposed openstack-infra/project-config: Switch rally-heat job to neutron from nova-network  https://review.openstack.org/19751511:30
AJaegerBobBall: this is done via a postjob, see http://status.openstack.org/zuul/ whether yours is run already. Currently it's not. post jobs are run with low priority...11:30
KiallHey infra folks - could I get a quick review on a small DSVM job change? https://review.openstack.org/#/c/196961/ Thanks :)11:30
BobBallFair enough!11:31
*** sergmelikyan has quit IRC11:31
* BobBall will occasionally check then :)11:31
*** ldnunes has joined #openstack-infra11:31
*** sergmelikyan has joined #openstack-infra11:32
*** pradk has joined #openstack-infra11:34
SergeyLukjanovKiall, +2d11:34
KiallSergeyLukjanov: thanks :)11:35
*** jasondotstar has quit IRC11:35
*** prad has quit IRC11:36
*** jasondotstar has joined #openstack-infra11:36
*** sergmelikyan has quit IRC11:36
*** yamamoto has quit IRC11:38
*** yamamoto has joined #openstack-infra11:39
*** pradk has quit IRC11:40
*** hashar has joined #openstack-infra11:41
*** jasondotstar has quit IRC11:41
*** fhubik_afk is now known as fhubik11:41
openstackgerritKiall Mac Innes proposed openstack/requirements: Add openstack/designate-dashboard to projects  https://review.openstack.org/19753011:42
*** jcoufal has quit IRC11:42
AJaegerKiall, no need to add the whole team to the review...11:44
AJaegerKiall: +2A11:45
KiallAJaeger: awesome, and.. I actually only thought the team was like 4 of you :) I added the group and got a surpise! Sorry11:45
AJaegerKiall: https://review.openstack.org/#/admin/groups/459,members - 3 plus all infra cores ;)11:46
*** marun has joined #openstack-infra11:46
KiallHeh - I didn't know the infra-core group was included ;) Sorry11:46
*** yamamoto has quit IRC11:47
andrey-mpAJaeger, where I can find channel for openstack/requirements ? )11:47
andrey-mpI'm triyng to find someone who can review my change https://review.openstack.org/#/c/172335/ :(11:48
openstackgerritMerged openstack-infra/project-config: Add openstack/designate-dashboard to designate DSVM gates  https://review.openstack.org/19696111:48
*** Jeffrey4l has quit IRC11:49
*** jcoufal has joined #openstack-infra11:49
AJaegerandrey-mp: channel here is fine and to check the list of people that are core, open https://review.openstack.org/#/c/172335/, click on the text "openstack/requirements", click on "Access" and then on "requirements-core"11:49
*** jcoufal is now known as Guest5216811:50
AJaegerandrey-mp: GheRivero was around this morning (European time), others migth be in the US.11:50
*** Guest52168 has quit IRC11:50
andrey-mpI added all people from both lists several weeks ago :(11:50
*** jcoufal_ has joined #openstack-infra11:50
AJaegerandrey-mp: Seems you added too many ;) Better ask them directly - and if you ask here, tell us what it is.11:51
andrey-mpAJaeger, thanks. will do.11:51
*** marun has quit IRC11:52
*** sergmelikyan has joined #openstack-infra11:52
*** sergmelikyan has quit IRC11:52
AJaegerandrey-mp: So, instead of asking for a review of X, ask for "review of change X that adds Y to requirements repo to allow us to...". That way the right people will look at it. In this channel, we have dozens of repos and thus many ignore unqualified requests11:52
*** sergmelikyan has joined #openstack-infra11:52
andrey-mpok, thanks for information :)11:53
openstackgerritMerged openstack-infra/grafyaml: Initial unit tests for CLI  https://review.openstack.org/18977011:53
openstackgerritMerged openstack-infra/grafyaml: Fix --version CLI output  https://review.openstack.org/18978811:53
openstackgerritMerged openstack-infra/puppet-jenkins: Always install latest git-review  https://review.openstack.org/19720311:57
*** _nadya_ has quit IRC11:58
*** Longgeek has quit IRC11:59
andrey-mpGheRivero, are you here? could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project.11:59
*** sergmelikyan has quit IRC11:59
openstackgerritMerged openstack-infra/project-config: Run diskimage-builder-install macro for akanda image build  https://review.openstack.org/19694612:01
openstackgerritMerged openstack-infra/project-config: Fix script file name for Inspector dsvm job  https://review.openstack.org/19745312:02
*** _diana_ has joined #openstack-infra12:02
*** dizquierdo has quit IRC12:03
*** Jeffrey4l has joined #openstack-infra12:03
*** sergmelikyan has joined #openstack-infra12:04
*** ddieterly has joined #openstack-infra12:04
*** hashar is now known as hasharConfcall12:04
andrey-mpSergeyLukjanov, could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project.12:07
openstackgerritMerged openstack-infra/system-config: Alpha-sort the cacti host list  https://review.openstack.org/19198912:07
*** yamamoto has joined #openstack-infra12:08
*** yamamoto has quit IRC12:08
openstackgerritMerged openstack-infra/system-config: Add apps.openstack.org to cacti  https://review.openstack.org/19199012:09
*** thorst has joined #openstack-infra12:09
*** ociuhandu has quit IRC12:09
*** samuelBartel has joined #openstack-infra12:10
flaper87AJaeger: ping, I forgot what the process to request a new branch is. We need a stable/juno branch for glanceclient to be created out of this tag: https://github.com/openstack/python-glanceclient/commits/0.14.212:11
*** fhubik is now known as fhubik_afk12:11
flaper87AJaeger: mind refreshing my mind with what the process is ?12:11
flaper87:D12:11
flaper87fungi: ^ in case you're around already12:11
flaper87:)12:11
*** sergmelikyan has quit IRC12:13
*** markvoelker has quit IRC12:14
*** markvoelker has joined #openstack-infra12:14
*** eharney has joined #openstack-infra12:14
openstackgerritMerged openstack-infra/system-config: Set proper permissions on login.def  https://review.openstack.org/19077712:15
*** sergmelikyan has joined #openstack-infra12:15
*** sergmelikyan has quit IRC12:15
*** sergmelikyan has joined #openstack-infra12:15
*** sergmelikyan has quit IRC12:16
*** mpavone has quit IRC12:16
*** sergmelikyan has joined #openstack-infra12:16
*** sergmelikyan has quit IRC12:16
*** raginbajin has quit IRC12:18
*** _diana_ has quit IRC12:18
*** kiran-r has joined #openstack-infra12:18
fricklerflaper87: I don't know how to create the branch, but I'm curious: you intend to cut a 0.14.3 including a backport of https://review.openstack.org/#/c/156975/?12:19
*** _diana_ has joined #openstack-infra12:19
*** raginbajin has joined #openstack-infra12:19
flaper87frickler: that was not the plan but I guess we could consider it :)12:20
*** radez_g0n3 is now known as radez12:21
*** ociuhandu has joined #openstack-infra12:21
openstackgerritMerged openstack/requirements: Cap Routes at below 2.0 as 2.1 breaks Nova  https://review.openstack.org/19686712:21
*** john-davidge has joined #openstack-infra12:23
*** jcoufal_ has quit IRC12:23
*** sergmelikyan has joined #openstack-infra12:24
*** sshnaidm has quit IRC12:24
*** sergmelikyan has quit IRC12:24
*** heyongli has quit IRC12:24
*** sshnaidm has joined #openstack-infra12:25
*** Longgeek has joined #openstack-infra12:25
*** john-davidge_ has joined #openstack-infra12:25
*** deepakcs has quit IRC12:26
*** doug-fish has joined #openstack-infra12:26
openstackgerritMerged openstack-infra/project-config: Fix Normalize projects.yaml proposal  https://review.openstack.org/19744312:26
*** heyongli has joined #openstack-infra12:27
*** shardy has quit IRC12:27
*** sergmelikyan has joined #openstack-infra12:27
*** john-davidge has quit IRC12:28
*** john-davidge_ is now known as john-davidge12:28
*** zigo has quit IRC12:28
*** sergmelikyan has quit IRC12:28
*** zigo has joined #openstack-infra12:29
*** sergmelikyan has joined #openstack-infra12:29
*** BharatK has quit IRC12:29
*** rfolco has joined #openstack-infra12:30
*** dizquierdo has joined #openstack-infra12:30
*** aysyd has joined #openstack-infra12:30
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/19650412:30
*** mpavone has joined #openstack-infra12:31
*** shardy has joined #openstack-infra12:31
*** Longgeek has quit IRC12:31
*** kiran-r has quit IRC12:32
*** sergmelikyan has quit IRC12:32
fungiflaper87: ask the library release managers to handle it, i believe https://review.openstack.org/#/admin/groups/967,members12:32
flaper87fungi: alright, I can do that. Thank you :)12:33
fungiflaper87: though they may end up involving the release management team to do the actual branch creation after they confirm that's a feasible choice https://review.openstack.org/#/admin/groups/11,members12:33
andrey-mpfungi, could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project.12:34
*** sergmelikyan has joined #openstack-infra12:35
fungiandrey-mp: the infrastructure team generally doesn't vet changes to the global requirements list unless it's to fix infrastructure problems or multi-project gating breakage12:35
*** BharatK has joined #openstack-infra12:35
*** sergmelikyan has quit IRC12:35
*** sergmelikyan has joined #openstack-infra12:35
*** sergmelikyan has quit IRC12:35
*** sergmelikyan has joined #openstack-infra12:35
fungiandrey-mp: also i'm not sure what the current criteria are for adding requirements needed only by non-openstack repos12:35
andrey-mpok, thanks. I will as to requirements-core group12:36
andrey-mpask12:36
*** _diana_ has quit IRC12:36
*** fallenpegasus has joined #openstack-infra12:36
*** annegentle has joined #openstack-infra12:37
*** sergmelikyan has quit IRC12:37
*** yamamoto has joined #openstack-infra12:41
*** e0ne is now known as e0ne_12:41
*** e0ne_ is now known as e0ne12:42
*** binbincong has joined #openstack-infra12:42
*** yamamoto has quit IRC12:42
*** _diana_ has joined #openstack-infra12:43
*** baoli has joined #openstack-infra12:44
*** bknudson has joined #openstack-infra12:45
*** pelix has quit IRC12:48
openstackgerritMerged openstack/requirements: Bump python-ironicclient minimal version to 0.6.0  https://review.openstack.org/19661812:48
*** baoli_ has joined #openstack-infra12:48
*** annegentle has quit IRC12:48
*** sergmelikyan has joined #openstack-infra12:48
GheRiveroandrey-mp: pong.12:48
*** annegentle has joined #openstack-infra12:49
andrey-mpGheRivero, ping )12:49
*** Longgeek has joined #openstack-infra12:49
*** yamamoto has joined #openstack-infra12:49
fungioh wow, yesterday's block storage interruptions in rackspace were leapsecond-related! https://status.rackspace.com/index/viewincidents?group=11&start=143563680012:50
*** jasondotstar has joined #openstack-infra12:51
openstackgerritMerged openstack/requirements: Add oslo.cache and oslo.reports to global requirements  https://review.openstack.org/19505812:51
*** baoli has quit IRC12:51
andrey-mpGheRivero, I'm hope to merge this review https://review.openstack.org/#/c/172335/ before code freeze as I got in Kilo...12:52
andrey-mpWe need it for stackforge/ec2-api project12:52
*** e0ne is now known as e0ne_12:53
*** rlandy has joined #openstack-infra12:54
openstackgerritSzymon Wróblewski proposed openstack/requirements: tooz 0.16.0 or better required  https://review.openstack.org/19702112:55
*** e0ne_ is now known as e0ne12:57
*** annegentle has quit IRC12:57
*** jsavak has joined #openstack-infra12:57
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/19650412:58
*** annegentle has joined #openstack-infra12:58
fungiAJaeger: i hope i've answered what i think was a question from you on 19690712:59
GheRiveroandrey-mp: We are still in time before code freeze :)12:59
fungiAJaeger: i can't tell if you're still asking (since you didn't vote on the change) or managed to answer it for yourself12:59
*** flip214 has quit IRC13:00
fungiAJaeger: er, sorry, i mean 19690613:00
*** shardy has quit IRC13:01
fungiGheRivero: out of curiosity, have we started as policy adding global requirements for non-openstack repos? i haven't been following along on those discussions since the big tent shift13:01
*** shardy has joined #openstack-infra13:01
andrey-mp@GheRivero, thank you very much :)13:02
*** olaph has quit IRC13:03
fungijust wondering whether this is setting a precedent for every repo in stackforge to start asking to have their requirements added13:04
*** yamada-h has joined #openstack-infra13:04
*** otter768 has joined #openstack-infra13:04
*** olaph has joined #openstack-infra13:05
*** radez is now known as radez_g0n313:06
*** yfried has quit IRC13:06
*** ihrachyshka_ has joined #openstack-infra13:07
*** ddieterly has quit IRC13:07
*** ihrachyshka has quit IRC13:08
*** yamada-h has quit IRC13:08
*** otter768 has quit IRC13:09
*** heyongli has quit IRC13:09
*** homeless has joined #openstack-infra13:09
*** woodster_ has joined #openstack-infra13:11
GheRiverofungi: Me neither (my bad for approving it withput checking) , but I guess, under the big tent, stackforge should be just a temporary step13:11
*** amitgandhinz has joined #openstack-infra13:11
*** spzala has joined #openstack-infra13:11
fungiGheRivero: yeah, no idea if we should be encouraging projects to apply for formal recognition by the tc before we start including their requirements in the global requirements list enforcing version constraints on official repos13:12
fungibut i'm happy to leave that decision to the requirements reviewers and the tc13:12
*** heyongli has joined #openstack-infra13:13
fungias a counterexample, i think we've not been letting arbitrary repos publish their documentation on docs.openstack.org until they apply and get their project-team recognized by the tc13:14
andrey-mpfungi - GheRivero is right, we hope that stackforge is temporary step and our project will be moved to openstack in one of next releases.13:14
*** trey has joined #openstack-infra13:14
*** Longgeek has quit IRC13:14
*** Longgeek has joined #openstack-infra13:15
fungiandrey-mp: why wait? just propose the addition to the governance repo and ask the tc to add you13:15
andrey-mpwe agreed at last summit that our project should be checked by operators and then we will move further13:16
*** hdd has joined #openstack-infra13:16
fungithere's no requirement for project teams or their software to reach any particular "maturity" before applying, and we don't want people to see stackforge as a "stepping stone" (there's a resolution currently being worked through the tc to make it more obvious we don't want people to think they need to "incubate" things in stackforge before applying to be a part of the openstack community)13:16
*** mmedvede has joined #openstack-infra13:17
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add functional test job to python-ironic-inspector-client  https://review.openstack.org/19757713:18
*** hasharConfcall is now known as hashar13:18
*** bhunter71 has joined #openstack-infra13:18
*** heyongli has quit IRC13:18
*** ociuhandu has quit IRC13:19
*** ociuhandu has joined #openstack-infra13:20
*** mattt has left #openstack-infra13:20
*** jsavak has quit IRC13:20
SpamapSheh.. update on infra-cloud baremetaling.. current wedge is that ironicclient is way too old in Ubuntu cloud archive.13:20
*** heyongli has joined #openstack-infra13:21
*** jsavak has joined #openstack-infra13:22
*** nihilifer has joined #openstack-infra13:24
*** isviridov_away is now known as isviridov13:24
*** coolsvap is now known as coolsvap|away13:26
*** ociuhandu has quit IRC13:27
*** mriedem has joined #openstack-infra13:27
GheRiveroSpamapS: ubuntu? old? I would expect that about Debian13:28
*** jcoufal has joined #openstack-infra13:30
*** ociuhandu has joined #openstack-infra13:30
*** fallenpegasus has quit IRC13:31
jeblairfungi: know anything about an ask-staging server? i think it lacks rdns records but is sending me email13:31
andrey-mpfungi, thanks for information.13:32
AJaegerfungi: Regarding 196906: Thanks! I was confused first but then saw the follow up cahnge and your comments...13:32
fungijeblair: yes, sorry, i'm testing https://review.openstack.org/17288013:33
*** jcoufal has quit IRC13:33
jeblairfungi: no problem13:33
*** marun has joined #openstack-infra13:35
*** jcoufal has joined #openstack-infra13:35
*** alivigni has joined #openstack-infra13:36
fungiihrachyshka_: i finally got around to taking a look at https://review.openstack.org/195923 and left you some comments. i also updated bug 1469067 with some clarification13:36
openstackbug 1469067 in devstack "Devstack always uses soft requirements updates" [Undecided,In progress] https://launchpad.net/bugs/1469067 - Assigned to Ihar Hrachyshka (ihar-hrachyshka)13:36
*** jsavak has quit IRC13:36
*** Jeffrey4l has quit IRC13:36
*** jsavak has joined #openstack-infra13:36
*** heyongli has quit IRC13:37
fungiihrachyshka_: your fix isn't wrong, but it's adding complexity when you could solve it completely by removing code instead13:38
openstackgerritMerged openstack-infra/project-config: Add a zuul-git-prep builder macro  https://review.openstack.org/19690613:39
openstackgerritMerged openstack-infra/project-config: Add a zuul-git-prep builder macro  https://review.openstack.org/19690613:39
ihrachyshka_fungi, ack, thanks, yeah, I get your comment, will update next week13:40
*** mpavone has quit IRC13:40
*** _nadya_ has joined #openstack-infra13:40
*** baoli_ has quit IRC13:40
fungiihrachyshka_: i'm happy to update it for you now as long as you don't mind13:40
*** marun has quit IRC13:40
*** ParsectiX has quit IRC13:40
*** heyongli has joined #openstack-infra13:40
AJaegerflaper87: you can reach them on #openstack-rel-mgr or so...13:41
*** mrmartin has joined #openstack-infra13:41
*** _nadya_ has quit IRC13:42
ihrachyshka_fungi, ok, please do. I'm busy at neutron code sprint this week13:42
*** ZZelle has quit IRC13:42
flaper87AJaeger: yeah, it's done13:42
*** julim has joined #openstack-infra13:42
*** ZZelle has joined #openstack-infra13:42
fungiihrachyshka_: done13:42
*** trey has quit IRC13:43
*** baoli has joined #openstack-infra13:44
*** mpavone has joined #openstack-infra13:45
*** dbite has quit IRC13:46
*** pradk has joined #openstack-infra13:46
*** tvanderwiel has joined #openstack-infra13:48
*** Jeffrey4l has joined #openstack-infra13:49
*** radez_g0n3 is now known as radez13:50
*** ociuhandu has quit IRC13:51
*** sergmelikyan has quit IRC13:53
*** ociuhandu has joined #openstack-infra13:53
*** dboik has joined #openstack-infra13:54
*** dboik has quit IRC13:55
*** dboik has joined #openstack-infra13:55
*** gokrokve has joined #openstack-infra13:56
*** jcoufal has quit IRC13:56
*** jsavak has quit IRC13:56
*** kir_ has quit IRC13:57
*** jcoufal has joined #openstack-infra13:57
*** devvesa has quit IRC13:57
*** fhubik_afk is now known as fhubik13:57
openstackgerritMerged openstack-infra/project-config: Switch constraints proposal to use zuul-git-prep  https://review.openstack.org/19690713:57
*** kiran-r has joined #openstack-infra13:58
*** jcoufal has quit IRC13:58
*** devvesa has joined #openstack-infra13:58
*** dims has quit IRC13:59
openstackgerritMerged openstack/requirements: Add botocore to requirements  https://review.openstack.org/17233513:59
openstackgerritMerged openstack/requirements: Bump oslo.db to 1.12  https://review.openstack.org/19552513:59
*** jcoufal has joined #openstack-infra14:00
*** _diana_ has quit IRC14:00
*** dims has joined #openstack-infra14:00
*** jsavak has joined #openstack-infra14:01
*** andrey-mp has quit IRC14:01
*** sshnaidm has quit IRC14:01
*** mtanino has joined #openstack-infra14:02
*** sshnaidm has joined #openstack-infra14:02
*** jsavak has quit IRC14:02
*** zz_dimtruck is now known as dimtruck14:02
mordredSpamapS: hrm14:02
*** amitgandhinz has quit IRC14:05
*** dalgaaf has joined #openstack-infra14:06
*** amitgandhinz has joined #openstack-infra14:06
*** kiran-r has quit IRC14:07
*** e0ne is now known as e0ne_14:08
*** EricGonczer_ has joined #openstack-infra14:09
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/19650414:09
*** yfried has joined #openstack-infra14:09
*** jcoufal has quit IRC14:11
*** sigmavirus24_awa is now known as sigmavirus2414:12
*** sshnaidm has quit IRC14:12
mordredSpamapS: python-ironicclient in UCA is too old to work with ironic in UCA?14:13
mordredSpamapS: that's strange14:13
*** sshnaidm has joined #openstack-infra14:13
*** jcoufal has joined #openstack-infra14:13
*** _nadya_ has joined #openstack-infra14:13
*** amitgandhinz has quit IRC14:13
*** amitgandhinz has joined #openstack-infra14:14
*** tjones1 has joined #openstack-infra14:14
*** kiran-r has joined #openstack-infra14:14
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova infinite recursion bug 1470302  https://review.openstack.org/19760214:15
openstackbug 1470302 in OpenStack Compute (nova) "gate-nova-python27 fails with "RuntimeError: maximum recursion depth exceeded"" [High,Confirmed] https://launchpad.net/bugs/147030214:15
*** wenlock has joined #openstack-infra14:15
*** sergmelikyan has joined #openstack-infra14:16
*** sergmelikyan has quit IRC14:17
mriedemis it just me, or is latest tox/pip much faster at recreates than it used to be?14:18
mriedempip > 7, tox > 214:18
*** ddieterly has joined #openstack-infra14:21
*** Jeffrey4l has quit IRC14:22
*** dguerri` is now known as dguerri14:22
*** heyongli has quit IRC14:22
*** ddieterly has quit IRC14:22
*** smarcet has joined #openstack-infra14:24
*** shardy has quit IRC14:24
*** jcoufal has quit IRC14:24
*** shardy has joined #openstack-infra14:24
*** heyongli has joined #openstack-infra14:24
*** sergmelikyan has joined #openstack-infra14:25
*** jcoufal has joined #openstack-infra14:25
*** sshnaidm has quit IRC14:29
*** sshnaidm has joined #openstack-infra14:29
asselin_fbo, ping14:29
*** tonytan4ever has joined #openstack-infra14:30
*** weshay has quit IRC14:31
*** zz_jgrimm is now known as jgrimm14:32
fboasselin_, pong14:33
*** dizquierdo has quit IRC14:33
asselin_fbo, hi, did you see my comments on the common-zuul patches? Id like to knoe your thoughts14:34
asselin_know*14:34
*** pblaho has quit IRC14:34
*** pblaho has joined #openstack-infra14:34
*** heyongli has quit IRC14:35
*** weshay has joined #openstack-infra14:36
*** rossella_s has quit IRC14:36
*** SlickN1k has joined #openstack-infra14:36
*** rossella_s has joined #openstack-infra14:37
*** ociuhandu_ has joined #openstack-infra14:37
*** yamahata has joined #openstack-infra14:37
*** heyongli has joined #openstack-infra14:37
*** nagyz_ has joined #openstack-infra14:37
*** enikanorov2_ has joined #openstack-infra14:37
*** mescanef_ has joined #openstack-infra14:38
*** vahidh has quit IRC14:38
*** madong_ has joined #openstack-infra14:39
*** mgkwill_ has joined #openstack-infra14:39
*** matt____ has joined #openstack-infra14:39
*** kiran-r has quit IRC14:40
*** Longgeek has quit IRC14:40
*** megm_ has joined #openstack-infra14:40
openstackgerritMerged openstack-infra/elastic-recheck: Add query for nova infinite recursion bug 1470302  https://review.openstack.org/19760214:41
*** kgiusti has joined #openstack-infra14:41
openstackbug 1470302 in OpenStack Compute (nova) "gate-nova-python27 fails with "RuntimeError: maximum recursion depth exceeded"" [High,In progress] https://launchpad.net/bugs/1470302 - Assigned to Dan Smith (danms)14:41
*** notnown29 has joined #openstack-infra14:41
openstackgerritMerged openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/19724914:41
*** devanand1 has joined #openstack-infra14:41
*** notnown29 has quit IRC14:41
*** gordc_af1 has joined #openstack-infra14:41
*** Nakato_ has joined #openstack-infra14:41
*** doude_ has joined #openstack-infra14:41
*** jkt_ has joined #openstack-infra14:42
*** reazem_ has joined #openstack-infra14:42
*** nikhil_k1away has joined #openstack-infra14:42
*** mpavone has quit IRC14:42
*** sergmelikyan has quit IRC14:42
clarkbbecause its a fun bug, gerrit 2.10 will corrupt repos if you push to a repo whileGerrit is doing a GC on it14:42
*** thingee_ has joined #openstack-infra14:43
*** edwarnicke_ has joined #openstack-infra14:44
*** sergmelikyan has joined #openstack-infra14:45
*** rackertom_ has joined #openstack-infra14:45
jeblairi like gerrit 2.10 more and more14:45
*** radez` has joined #openstack-infra14:45
*** adreznec has joined #openstack-infra14:45
*** mtreinish_ has joined #openstack-infra14:45
*** AJaeger_ has joined #openstack-infra14:45
*** AJaeger_ has quit IRC14:45
*** AJaeger_ has joined #openstack-infra14:45
*** fbo- has joined #openstack-infra14:45
*** mmmpork_ has joined #openstack-infra14:45
*** EmilienM_ has joined #openstack-infra14:45
*** NikitaKonovalov2 has joined #openstack-infra14:45
*** dguerri_ has joined #openstack-infra14:45
*** mrodden_ has joined #openstack-infra14:45
*** dgonzalez_ has joined #openstack-infra14:45
*** f1ller has joined #openstack-infra14:45
*** katyafervent_ has joined #openstack-infra14:46
*** melwitt_ has joined #openstack-infra14:46
*** tjones1 has quit IRC14:46
*** ociuhandu has quit IRC14:46
*** alivigni has quit IRC14:46
*** aysyd has quit IRC14:46
*** notnownikki has quit IRC14:46
*** bmwiedemann has quit IRC14:46
*** doude has quit IRC14:46
*** camunoz has quit IRC14:46
*** enikanorov2 has quit IRC14:46
*** larainema has quit IRC14:46
*** SlickNik_ has quit IRC14:46
*** asadoughi has quit IRC14:46
*** marcusvrn has quit IRC14:46
*** fbo has quit IRC14:46
*** mtreinish has quit IRC14:46
*** AJaeger has quit IRC14:46
*** megm has quit IRC14:46
*** gordc_afk has quit IRC14:46
*** mancdaz has quit IRC14:46
*** melwitt has quit IRC14:46
*** EmilienM has quit IRC14:46
*** antonym has quit IRC14:46
*** radez has quit IRC14:46
*** adreznec_ has quit IRC14:46
*** edwarnicke has quit IRC14:46
*** nagyz has quit IRC14:46
*** ctlaugh_ has quit IRC14:46
*** dguerri has quit IRC14:46
*** reazem has quit IRC14:46
*** NikitaKonovalov has quit IRC14:46
*** tchaypo has quit IRC14:46
*** mgkwill has quit IRC14:46
*** kun_huang has quit IRC14:46
*** thingee has quit IRC14:46
*** rackertom has quit IRC14:46
*** devananda has quit IRC14:46
*** flaper87 has quit IRC14:46
*** lxsli has quit IRC14:46
*** mrodden has quit IRC14:46
*** Nakato has quit IRC14:46
*** katyafervent has quit IRC14:46
*** asilenkov has quit IRC14:46
*** jkt has quit IRC14:46
*** mescanef has quit IRC14:46
*** mmmpork has quit IRC14:46
*** fungi has quit IRC14:46
*** dgonzalez has quit IRC14:46
*** mattoliverau has quit IRC14:46
*** filler has quit IRC14:46
*** nikhil_k-away has quit IRC14:46
*** timburke has quit IRC14:46
*** dteselkin has quit IRC14:46
*** EmilienM_ is now known as EmilienM14:46
*** dguerri_ is now known as dguerri14:46
*** mmmpork_ is now known as mmmpork14:46
*** dguerri has quit IRC14:46
*** dguerri has joined #openstack-infra14:46
*** dizquierdo has joined #openstack-infra14:46
*** ociuhandu_ is now known as ociuhandu14:46
*** mtreinish_ is now known as mtreinish14:46
*** mrodden_ is now known as mrodden14:46
*** dgonzalez_ is now known as dgonzalez14:46
*** mpavlase has quit IRC14:46
*** annegentle has quit IRC14:47
*** NikitaKonovalov2 is now known as NikitaKonovalov14:47
openstackgerritMarton Kiss proposed openstack-infra/system-config: Upgrade openstackid to 1.0.7  https://review.openstack.org/19761414:47
*** asilenkov has joined #openstack-infra14:47
*** madong_ is now known as larainema14:47
*** ayoung has joined #openstack-infra14:47
*** sergmelikyan has quit IRC14:47
*** dteselkin has joined #openstack-infra14:48
*** mgkwill_ is now known as mgkwill14:48
*** Ala has quit IRC14:48
*** thingee_ is now known as thingee14:48
*** DericHorn-HP has joined #openstack-infra14:48
*** timburke has joined #openstack-infra14:48
*** nelsnels_ has quit IRC14:49
*** fhubik is now known as fhubik_afk14:49
clarkbjeblair: and it isn't temporary in memory jgit trouble, appears to affect the repo on disk and require a restore from backup14:49
*** flaper87 has joined #openstack-infra14:49
*** flaper87 has quit IRC14:49
*** flaper87 has joined #openstack-infra14:49
*** nelsnelson has joined #openstack-infra14:49
*** shardy has quit IRC14:49
*** heyongli has quit IRC14:49
*** _diana_ has joined #openstack-infra14:50
jeblairclarkb: that's really weird because apparently jgit's locking is sufficient for running an _external_ gc14:50
*** kiran-r has joined #openstack-infra14:51
*** rackertom_ is now known as rackertom14:51
fbo-asselin_, yep I just tested a stuff and I guess you provide $gerrit_ssh_host_identity as a string and not an array. isn't it ?14:51
clarkbjeblair: aiui the issue is what jgit does with the new refs that are being pushed14:52
*** rackertom has quit IRC14:52
clarkbthey visit never never land and captain hook holds them hostage14:52
asselin_fbo-, yes perhaps14:52
*** aysyd has joined #openstack-infra14:52
*** heyongli has joined #openstack-infra14:52
asselin_fbo-, I guess I ran into issues passing in an array?14:52
*** camunoz has joined #openstack-infra14:52
jeblairclarkb: captain githook?14:53
mordredclarkb: that'll teach you for installing the "captain" git hook14:53
fbo-got the same error with this snippet http://paste.openstack.org/show/uQ2To8KjlAPXiLA0V6ex/ if I set gerrit_ssh_host_identity as string.14:53
fbo-asselin_,14:53
mordreddamn. jeblair beat me to it14:53
*** lxsli has joined #openstack-infra14:53
fbo-if it an array it works for me14:53
* jeblair high-fives mordred14:53
*** alivigni has joined #openstack-infra14:53
asselin_fbo-, so I was thinking to move that logic out to site.pp14:53
*** asadoughi has joined #openstack-infra14:53
*** ctlaugh_ has joined #openstack-infra14:53
*** marcusvrn has joined #openstack-infra14:54
*** teran_ has quit IRC14:54
*** fungi has joined #openstack-infra14:54
asselin_fbo-, and use a string in openstackci14:54
*** antonym has joined #openstack-infra14:54
*** sergmelikyan has joined #openstack-infra14:54
*** geoffarnold has joined #openstack-infra14:55
fungiwow. that irc server went down _hard_14:55
fungimriedem: pip 6 added an optional wheel cache, and pip 7 turned it on by default14:55
fungimriedem: that speeds up anything which was doing compilation of c extensions in particular, though brings a new liability: if the libraries/headers against which those wheels were built change later, pip won't know those cached wheels need to be rebuilt14:55
asselin_fbo-, and the string in openstackci is whatever should be put into the ssh known hosts sections w/o any manipulation14:56
openstackgerritCody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler  https://review.openstack.org/19517214:56
mriedemfungi: ok, i figured wheels was being used now14:56
*** shardy has joined #openstack-infra14:56
*** edwarnicke_ is now known as edwarnicke14:56
clarkbfungi: we can probably remove the explicit wheel caching from our scripts then?14:57
clarkbthinking of the requirements check job and devstack14:57
*** yfried has quit IRC14:57
fungiclarkb: probably, yes14:57
*** heyongli has quit IRC14:57
*** sergmelikyan has quit IRC14:57
*** geoffarnold has quit IRC14:57
fungiclarkb: for any that are self-testing, easy enough to see if ripping out that machinery slows anything down14:57
clarkbyup14:58
*** sergmelikyan has joined #openstack-infra14:58
*** geoffarnold has joined #openstack-infra14:58
clarkbfungi: did you see that the 4 byte utf8 chars broke that etherpad but did not break the service? I have updated the upstream bug with js tracebacks14:58
fungipleia2: you probably will be interested in reviewing https://review.openstack.org/19761414:58
clarkbfungi: I think we should go ahead with the DB move friday but not with the utf8 set conversion unless we can test something that works on -dev14:58
fungiclarkb: yep, saw your updates14:58
clarkbkk14:58
*** heyongli has joined #openstack-infra14:59
fungiclarkb: and i agree moving forward as planned is still better than not14:59
*** kun_huang has joined #openstack-infra14:59
fungiclarkb: i don't know that skipping the conversion is necessarily warranted. breaking a specific pad is still preferable to taking down the entire service until someone edits the database15:00
*** rackertom has joined #openstack-infra15:00
*** sshnaidm has quit IRC15:00
*** fhubik_afk is now known as fhubik15:01
clarkbfungi: thats true my only concern there was the conversion would be lossy but thinking about that a bit more I don't think it can be15:01
clarkbwe are going from a smaller representation space to a larger one that is a superset so should not be lossy at all15:01
*** devanand1 is now known as devananda15:01
*** xyang1 has joined #openstack-infra15:02
*** sshnaidm has joined #openstack-infra15:02
*** MarkAtwood has joined #openstack-infra15:02
*** cindyo has joined #openstack-infra15:03
*** derekh has joined #openstack-infra15:03
fbo-asselin_, so as you want, we just need to rework again that patch. I'm not against it but other reviewers was ok with it15:04
*** otter768 has joined #openstack-infra15:05
*** sergmelikyan has quit IRC15:05
*** tchaypo has joined #openstack-infra15:06
*** dimtruck is now known as zz_dimtruck15:07
*** Longgeek has joined #openstack-infra15:07
*** e0ne_ is now known as e0ne15:07
*** sshnaidm has quit IRC15:07
*** mancdaz has joined #openstack-infra15:07
*** Longgeek has quit IRC15:07
*** sshnaidm has joined #openstack-infra15:07
*** mmedvede has quit IRC15:08
*** Longgeek has joined #openstack-infra15:08
*** jlanoux_ has joined #openstack-infra15:08
*** bmwiedemann has joined #openstack-infra15:09
*** jlanoux has quit IRC15:09
fricklernibalizer: would you also +A https://review.openstack.org/#/c/189141/? (yours is the second +2) otherwise whom else should I bug about this?15:09
*** arxcruz has quit IRC15:09
*** otter768 has quit IRC15:10
*** Longgeek has quit IRC15:12
*** Longgeek has joined #openstack-infra15:14
*** enikanorov2_ has quit IRC15:15
eantyshevasselin_, jeblair: hello I think I know approximately why zuul hangups occasionally, and have the proposals, described here https://storyboard.openstack.org/#!/story/200030915:17
eantyshevasselin_, jeblair: hello I think I know approximately why zuul hangups occasionally, and have the proposals, described here https://storyboard.openstack.org/#!/story/200030915:17
ttxmordred: damn you and your PHP, I won't see those last 7 hours of my life again15:18
ttxcontext: http://lists.openstack.org/pipermail/openstack-infra/2015-July/002885.html15:19
*** e0ne is now known as e0ne_15:19
*** e0ne_ is now known as e0ne15:20
*** jkt_ is now known as jkt15:20
asselin_fbo-, yea I was also ok...I pinged nibalizer yesterday to get his opinion.15:21
*** notnownikki has joined #openstack-infra15:21
*** armax has joined #openstack-infra15:22
*** wenlock_ has joined #openstack-infra15:23
*** unicell has joined #openstack-infra15:23
asselin_eantyshev, what to you mean by pickle?15:24
*** Sukhdev has joined #openstack-infra15:24
*** enikanorov2 has joined #openstack-infra15:25
*** afazekas has quit IRC15:26
*** scheuran has quit IRC15:26
fbo-if you both asselin_ and nibalizer are ok to move the inline_template elsewhere I can rework the patch then15:26
*** jsavak has joined #openstack-infra15:26
fbo-but I need I guess some guidance to target what you expect within one patchset15:27
asselin_fbo-, so the changes are small to rework it.15:27
*** dtantsur is now known as dtantsur|afk15:28
asselin_fbo-, in the openstack-ci, let the host key be the full identity string to pass into the config, so no inline template.15:28
*** olaph has quit IRC15:28
fbo-asselin_, ok15:28
openstackgerritLianhao Lu proposed openstack-dev/pbr: Use io.open() to open metadata files  https://review.openstack.org/19762615:29
eantyshevasselin_: that was first false impression, last comment more reasonable:)15:29
asselin_fbo-, then in the system-config patch you concat the identity and key and pass that in as one string15:29
*** sergmelikyan has joined #openstack-infra15:29
*** CaerbannogRabbit is now known as morganfainberg15:30
asselin_fbo-, b/c at the infra level the ips are static in the puppet file and the host key is in heira, so this is where they should be joined together.15:30
*** sergmelikyan has quit IRC15:31
*** sergmelikyan has joined #openstack-infra15:31
*** olaph has joined #openstack-infra15:31
*** austin81 has joined #openstack-infra15:31
eantyshevasselin_: and I cannot tell why reconfiguration failed, since that information is lost every time, which is a part of the problem15:31
fbo-asselin_, ok so zuul_merger, zuul_dev, and zuul_prod still take an array as argument ? and I use the inline_template here ?15:31
*** austin81 has left #openstack-infra15:31
asselin_fbo-, let me look again15:31
*** austin81 has joined #openstack-infra15:32
asselin_eantyshev, oh I see...so that error only occurs after running a zuul reload with updated layout.yaml?15:32
*** marun has joined #openstack-infra15:32
eantyshevasselin_: yes15:32
*** coolsvap|away is now known as coolsvap15:33
fbo-hum before it was hardcoded and not passed as argument in zuul_*.pp15:33
eantyshevasselin_: sorry, have to go right now15:33
*** sergmelikyan has quit IRC15:33
fbo-I can remove that gerrit_ssh_host_identity argument and make it a variable inside the class ?15:34
*** k4n0 has quit IRC15:34
*** mmedvede has joined #openstack-infra15:34
asselin_fbo-, variable inside which class?15:34
*** dangers_away is now known as dangers15:35
*** signed8bit has joined #openstack-infra15:35
fbo-asselin_, yes15:35
fbo-?15:35
asselin_fbo-, honestly I thought it should be moved to here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n55415:36
fbo-sorry zuul_*.pp in system-config15:36
asselin_right at the source15:36
asselin_so this line would have the full identity & key: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n55815:37
*** jaypipes has quit IRC15:37
*** pblaho has quit IRC15:39
fbo-asselin_, ok so after line 558 I add the identities and pass them via  gerrit_ssh_host_identity argument. Ok got it i'll do that15:39
*** unicell has quit IRC15:39
*** jasondotstar has quit IRC15:39
*** pblaho has joined #openstack-infra15:39
asselin_fbo-, first, do you agree this is better?15:40
*** ashleighfarnham has joined #openstack-infra15:42
*** sshnaidm has quit IRC15:42
SergeyLukjanovjeblair, hi, I've seen that you helped trove with moving devstack from devstack itself to their repo, could you help me with some tips to do the same for sahara?15:43
SergeyLukjanovjeblair, I've done a few patches already - https://review.openstack.org/#/q/topic:bp/sahara-devstack-intree,n,z15:43
*** sergmelikyan has joined #openstack-infra15:43
jeblairSergeyLukjanov: yep!  let me look15:43
SergeyLukjanovjeblair, great! thx15:44
*** sergmelikyan has quit IRC15:44
fbo-asselin_, to be honest that sounds like a bit the same :) to me. At least the diff is not obvious to me but no matter the most important is it fit all usages and everybody are ok with the change. So I'm ok to implement that request :)15:44
*** coolsvap is now known as coolsvap|away15:44
asselin_jeblair, if you have a moment, your feedback on the above discussion would be valuable ^^15:45
asselin_jeblair, re common zuul patches: https://review.openstack.org/#/c/176010/815:46
asselin_fbo-, jeblair need to step away for a few minutes15:47
*** kiran-r has quit IRC15:48
*** laughterwym has quit IRC15:48
fbo-nibalizer, I'm not sure to understand your comment here https://review.openstack.org/#/c/175970/17/metadata.json because puppet-project_config will be really handy to use for future users of openstackci to target there own "project_config" repo15:49
fbo-asselin_, ok15:49
*** pblaho has quit IRC15:50
jeblairfbo-: asselin_'s idea seems like a good one.  i think that eventually that information will end up in a public hiera file when nibalizer finishes his work15:50
*** pblaho has joined #openstack-infra15:50
*** sergmelikyan has joined #openstack-infra15:50
*** jasondotstar has joined #openstack-infra15:50
*** ashleighfarnham has quit IRC15:51
jeblairfbo-: i agree, perhaps nibalizer misread that as referring to our actual project-config repo and not puppet-project_config?15:52
*** dannywilson has joined #openstack-infra15:52
*** ivar-lazzaro has joined #openstack-infra15:53
*** ivar-lazzaro has quit IRC15:53
fbo-jeblair, yes I think the same.15:53
*** sergmelikyan has quit IRC15:54
*** ivar-lazzaro has joined #openstack-infra15:54
zarohashar: hi15:55
*** patrickeast has joined #openstack-infra15:55
zaromorning15:56
*** fallenpegasus has joined #openstack-infra15:56
*** pblaho has quit IRC15:56
zarohashar: replied to your comment in https://issues.jenkins-ci.org/browse/JENKINS-2586715:57
*** erlon has joined #openstack-infra15:57
zarohashar: i'm curious whether the changes you picked up made it work for that matrix job?15:58
hasharzaro: hey :)15:58
*** pblaho has joined #openstack-infra15:58
hasharzaro: well I have no idea because I can't reproduce the issue15:58
*** deepakcs has joined #openstack-infra15:58
zarohashar: occurs randomly?15:59
hasharkind of yeah :)16:00
zarobut only with matrix job?16:00
hasharzaro: it must have a root cause but I haven't managed to track it down16:00
hasharjust that at some point a computer object returns NULL instead of the actual node16:00
hasharand that seems to keep some lock in position16:00
*** armax has quit IRC16:00
hasharthen the executors refuse to accept new jobs because  they are locked16:01
hasharinterestingly, the matrix job has a parent process, that still is allocated on an executor :-D16:01
hasharand yeah apparently only on matrix job16:01
hasharI had the issue previously with nodes having multiple executors, but that seems to have been fixed when upgrading the gearman-plugin.  That was ages ago16:01
hasharzaro: oh note the matrix job is triggered by the Jenkins scheduler. Not by Zuul16:02
zarois the jenkins scheduler one of the jenkins plugins?16:03
zarotrigger plugin?16:03
hasharI will have to look at the jobs configuration and write you a summary :-D16:04
zaroso i guess that means jenkins itself can't run builds on the nodes.16:04
hasharthere is probably a race condition between the Jenkins scheduler / Gearman build queue / trigger plugin / throttle plugin or owhatever16:04
*** zz_dimtruck is now known as dimtruck16:04
zaroregardless of gearman.16:04
zaroso once you get into that state your saying that if you click on the 'run build' icon on the jenkins UI a build doesn't get scheduled?16:05
hasharyeah16:05
hasharbut it shows up in Jenkins build queue16:05
hasharwith a status of "waiting for next executors on xxx label"16:05
*** devvesa has quit IRC16:06
*** olaph has quit IRC16:06
zaroahh, ok so that's fixed by https://review.openstack.org/#/c/192429/16:06
*** _diana_ has quit IRC16:06
hasharpotentially :-}16:06
*** Longgeek has quit IRC16:06
zaroor at least i believe so16:06
hasharI have deployed it this morning (europe)  so we will see what happens!16:07
zarobecause that's the exact same thing i ran into.16:07
*** _diana_ has joined #openstack-infra16:07
hasharthe problem is that I can't reproduce the issue.  Have to wait for it to occurs :-/16:07
*** _diana_ has quit IRC16:07
*** asselin_ has quit IRC16:07
*** jsavak has quit IRC16:07
*** dkazhdan has joined #openstack-infra16:07
zaroit's when a gearman responds with WORK_FAIL.16:07
*** Longgeek has joined #openstack-infra16:08
*** jistr has quit IRC16:08
hasharah I found an hold thread dump at https://phabricator.wikimedia.org/T72597#74805916:08
*** jcoufal has quit IRC16:08
hasharthe slave being deadlocked is deployment-bastion.eqiad_exec16:08
hasharall the executors are locked by hudson.plugins.gearman.NodeAvailabilityMonitor.lock16:09
hasharwithin src/main/java/hudson/plugins/gearman/NodeAvailabilityMonitor.java lock() function. It takes a worker as parameter and has a wait(5000).16:09
hasharbut the worker yields a 'null' which causes the code to not release the lock16:09
hashar(sorry that looks confusing)16:09
zaroYep, NodeAvailabilityMonitor was the culprit.  if you look at the commit message there's an explanation.16:10
*** sergmelikyan has joined #openstack-infra16:11
hasharI am not sure why it would be given a null worker though :D16:11
*** fallenpegasus has quit IRC16:11
zaronot sure if it's real clear, but the fix is to the NodeAvailabilityMonitor could not get the node because it's locked due to WORK_FAIL event.16:11
*** sergmelikyan has quit IRC16:12
*** unicell has joined #openstack-infra16:12
hasharyeah I got that. But that might not be related to the bug I faced :/16:12
hasharwe will see :-}16:12
*** Longgeek has quit IRC16:12
hasharat least for today, I haven't noticed any issue16:12
*** jsavak has joined #openstack-infra16:13
zaroagreed.16:13
*** sergmelikyan has joined #openstack-infra16:13
*** dkazhdan has quit IRC16:14
*** puranamr has joined #openstack-infra16:14
*** jsavak has quit IRC16:14
asselinfbo-, ok i'm back....seems you have your answer. thank you16:14
*** DericHorn-HP has quit IRC16:15
*** romcheg has joined #openstack-infra16:15
romchegHi folks!16:15
hasharzaro: heading back home. Thanks a ton for the patch and for moving to Jira (so we get mail notifications : D )16:16
*** hashar has quit IRC16:16
romchegI'm here with the same question I had yesterday. I pushed a tag to stackforge/python-fuelclient but it looks the new version didn't go to PyPi16:16
*** DericHorn-HP has joined #openstack-infra16:17
romchegI can see the tarball here http://tarballs.openstack.org/python-fuelclient/16:17
*** sergmelikyan has quit IRC16:18
*** whoops has joined #openstack-infra16:18
*** kiran-r has joined #openstack-infra16:19
*** _kiran_ has joined #openstack-infra16:19
*** harlowja_at_home has joined #openstack-infra16:20
fungiromcheg: let's have a look at the log...16:20
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Make Sahara python3 job voting  https://review.openstack.org/19749816:20
romchegfungi: sorry if it's obvious, I couldn't look at the log because unlike logs for patch sets I don't know where to look for one16:21
fungiromcheg: yep, digging it up now. it's based on the hash of the tag16:21
*** jlanoux_ has quit IRC16:21
*** larainema has quit IRC16:22
*** _nadya_ has quit IRC16:23
*** larainema has joined #openstack-infra16:23
fungiromcheg: it's possible you pushed a tag yesterday while everything was completely broken16:23
*** cindyo has quit IRC16:24
fungii didn't get the logserver brought back into order until 14:00 utc16:24
*** sdake has joined #openstack-infra16:24
romchegfungi: I pushed the tag 20 minutes ago :)16:24
*** gyee has joined #openstack-infra16:24
jeblairhttp://logs.openstack.org/2f/2f5a9c37d0c528647de7ef20ebb6cb14ac2f8a25/release/python-fuelclient-pypi-both-upload/console.html16:24
fungiromcheg: oh, i thought you said yesterday16:24
jeblairfungi: i would have expected it to be there ^16:24
romchegfungi: I indeed pushed a 6.1.1 tag yesterday, but it is broken, so we decided to make another 6.1.216:24
*** esmute__ has joined #openstack-infra16:25
romchegsorry for the confusion :)16:25
fungijeblair: yeah, i went digging in the zuul log since we're missing logfiles from that time period and also because i think the pypi uploads log to swift now16:25
jeblairhttps://jenkins.openstack.org/job/python-fuelclient-pypi-both-upload/3/console16:26
jeblairthat's the failure from the new tag today16:26
*** fallenpegasus has joined #openstack-infra16:26
*** sergmelikyan has joined #openstack-infra16:28
*** sergmelikyan has quit IRC16:28
*** _diana_ has joined #openstack-infra16:29
romchegSo it fails if the wheel is Py2 or Py3 only?16:29
*** Guest89865 is now known as spiffxp16:29
fungilooks that way16:29
fungii think when dhellmann wrote that he was expecting not to publish non-universal wheels?16:29
romchegThat's strange…16:30
fungino, that looks like a bug actually. i think it's supposed to be identifying whether it's a universal wheel16:30
*** john-davidge has quit IRC16:30
fungiaha, it assumes that if there's a wheel section then there will be a universal option16:31
*** sarob_ has joined #openstack-infra16:31
fungifuelclient's setup.cfg has a wheel section with no universal option, and the extract script doesn't safeguard against that possibility16:32
fungipatch on the way16:32
romchegfungi: thanks! Could you please push this patch trough the tag queue when the patch is merged?16:33
*** tqtran has joined #openstack-infra16:33
*** sarob_ has quit IRC16:33
romcheg*the tag16:33
pleia2fungi, mrmartin - all ok for me to +A 197614 to get the new openstackid out there?16:33
fungiromcheg: i can retrigger the job, once it merges, yes16:33
fungipleia2: i believe so, yes16:33
mrmartinhi pleia216:34
mrmartinapprove that: https://review.openstack.org/#/c/197614/16:34
mrmartin:)16:34
openstackgerritFabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests  https://review.openstack.org/17597016:34
*** _diana_ has quit IRC16:34
openstackgerritFabien Boucher proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev  https://review.openstack.org/17601016:34
*** cindyo has joined #openstack-infra16:34
*** BharatK has quit IRC16:34
pleia2mrmartin: great, on the way!16:34
mrmartinpleia2: http://tarballs.openstack.org/openstackid/ 1.0.7 is there, and I did an auth test with groups + a vagrant master branch in my dev env, and everything was looking nice16:35
* pleia2 nods16:35
pleia2perfect, thanks16:35
mrmartinso let's go, I guess we need to wait a while until the puppet script is picking up the changes on openstackid.org16:35
*** geoffarnold has quit IRC16:35
pleia2yeah16:35
*** Swami has joined #openstack-infra16:36
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Fix universal extraction in non-universal wheel  https://review.openstack.org/19765416:37
fungiromcheg: jeblair: dhellmann: ^16:37
*** harlowja_at_home has quit IRC16:37
*** samuelBartel has quit IRC16:37
*** yamada-h has joined #openstack-infra16:37
*** ociuhandu has quit IRC16:38
nibalizerjeblair: fungi ah yes, puppet-project_config always trips me up16:38
funginibalizer: that's the glue that holds our glue factory together16:39
*** derekh has quit IRC16:39
dhellmannfungi: does has_option() fail cleanly if the section isn't there? I think I've seen that throw an error on the missing section instead of just returning false16:39
fungidhellmann: it does. i even tested it to be certain16:40
dhellmannfungi: cool, maybe I'm remembering an old version or something16:40
fungidhellmann: maybe that was on some !=2.7 version16:40
fungiyeah16:41
dhellmannyeah, could have been ages ago #deepscars16:41
fungiwe're running that script exclusively on python 2.7 so should be safe16:41
dhellmann+116:41
fungiheh. python 1.x!!!16:41
romchegfungi: perhaps there should be a note left for times when it's on Py3?16:42
*** yamada-h has quit IRC16:42
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate: Set ATTACH_ENCRYPTED_VOLUME_AVAILABLE=False if testing with Ceph  https://review.openstack.org/19383516:43
fungiromcheg: it works the same on 3.4. just tested16:43
fbo-asselin, I've done the refactoring. let me know if this what you expected. Also I haven't tested it yet.16:43
*** geoffarnold has joined #openstack-infra16:44
romchegI mean, if someone's wheel is py3 only16:44
fungiromcheg: oh, that's likely going to need a rethinking of the script16:44
fungiromcheg: or deeper parsing to detect when it's a py3-only wheel16:45
asselinfbo-, ok will take a look & test it today16:45
romchegfungi: Perhaps it makes sense to unlock in now16:45
romchegfungi: and file a bug for py3 only wheels16:45
*** Longgeek has joined #openstack-infra16:45
fbo-asselin, thanks16:46
*** deepakcs has quit IRC16:46
greghaynesfungi: mordred did either of you try out performing the nodepool image upload to rax via command?16:46
openstackgerritMerged openstack-infra/system-config: Upgrade openstackid to 1.0.7  https://review.openstack.org/19761416:46
fungigreghaynes: i have not. just observing the nodepool scheduler do it16:46
*** marun has left #openstack-infra16:47
greghayneshrm, the way the command works it should be equivilentish of restarting nodepool in terms of getting new deps, so might be a good way to test that theory16:47
greghaynesthe theory that were just running nodepool with a stale dep16:47
*** BharatK has joined #openstack-infra16:48
*** samuelBartel has joined #openstack-infra16:48
krotscheckAnyone around who can help me set up ACL's on https://review.openstack.org/#/admin/projects/openstack/ironic-webclient16:48
krotscheck?16:48
*** flip214 has joined #openstack-infra16:49
flip214Hi. Is there some "secret" repository for devstack that works? I'm looking through my logs right now and find quite a lot of things that don't work - and are not even noticed to be wrong...16:50
romchegfungi: for non-universal wheels it's possible to read wheel/python-tag option. With that no deeper re-thinking would be required :)16:50
*** koolhead17 has joined #openstack-infra16:50
flip214things like this:16:50
flip214+ return grep '/nova$' /opt/stack/requirements/projects.txt16:50
flip214/home/stack/devstack/inc/python: line 198: return: grep: numeric argument required16:50
fungiflip214: no idea, but you probably want to talk to the devstack developers. they hang out in #openstack-qa16:50
fungiflip214: that's bug 1469067 and there's a fix being reviewed for it now16:51
openstackbug 1469067 in devstack "Devstack always uses soft requirements updates" [Undecided,In progress] https://launchpad.net/bugs/1469067 - Assigned to Ihar Hrachyshka (ihar-hrachyshka)16:51
*** armax has joined #openstack-infra16:52
fungiflip214: it's generally more helpful to pitch in with bugs you find than to imply that the developers of the software intentionally withhold bug fixes from you16:53
greghaynescrinkle: I think https://review.openstack.org/#/c/196252/ is probably what you were hitting during your nodepool testing16:53
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: argparse in requirements.txt should be 2.6 dependent  https://review.openstack.org/19766016:53
*** nfedotov has quit IRC16:53
flip214fungi: I'd just like to have the same (working!) devstack that is used in the openstack CI systems ;)16:54
fungiflip214: yep. it's not working for us either! ;)16:54
crinklegreghaynes: yep probably16:54
flip214ah, okay.16:54
*** sergmelikyan has joined #openstack-infra16:54
flip214I didn't want to imply intentionality... I just hoped for some repo that has all that *fixed* already!16:54
fungiflip214: you can grab that fix from https://review.openstack.org/195923 if you want it before the devstack devs have finished reviewing it16:55
*** melwitt_ is now known as melwitt16:55
*** bswartz has joined #openstack-infra16:56
*** sergmelikyan has quit IRC16:56
*** hdd has quit IRC16:56
krotscheckAnyone around who can help me set up ACL's on https://review.openstack.org/#/admin/projects/openstack/ironic-webclient ?16:57
fungikrotscheck: yep, i was just pulling that up16:57
krotscheckfungi: Thanks!16:57
fungikrotscheck: yeah, looks like it didn't apply. chances are we've got a typo in the change that added it. do you have a link to that handy?16:58
fungiif not i'll dig it out of the git log16:58
krotscheckfungi: https://review.openstack.org/#/c/194424/16:58
*** baoli has quit IRC16:58
fungikrotscheck: aha! fix on the way16:59
krotscheckfungi: And by typo, you mean "ACL's didn't appear to have been added"16:59
mrmartinpleia2: http://puppetboard.openstack.org/node/openstackid.org is that info valid for the openstackid.org puppet runs?16:59
*** ashleighfarnham has joined #openstack-infra16:59
fungikrotscheck: yep17:00
flip214fungi: thank you very much ...17:00
fungikrotscheck: is there an existing acl you want reused by ironic-webclient or is it going to have some unique needs (separate review team, different release model, et cetera)>17:00
*** davideagnello has joined #openstack-infra17:01
krotscheckfungi: For the time being we'll just use the ironic ACL's, and I'll come back when the team decides what to do.17:01
*** sergmelikyan has joined #openstack-infra17:01
*** Longgeek has quit IRC17:02
*** ashleighfarnham has quit IRC17:02
*** patrickeast_ has joined #openstack-infra17:02
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Reuse ironic ACLs for ironic-webclient  https://review.openstack.org/19766217:03
*** patrickeast has quit IRC17:03
fungikrotscheck: that's ^ what you'll want17:03
*** baoli has joined #openstack-infra17:03
*** sigmavirus24 is now known as sigmavirus24_awa17:04
*** sergmelikyan has quit IRC17:04
pleia2mrmartin: yes, looks like it hasn't run yet with the change17:04
pleia2mrmartin: likely will wait for the next run, things aren't perfectly timed to always get updated immediately after merge17:04
mrmartinpleia2: Wednesday, July 1 2015 1:59 PM shows me this run. what is the time zone for this entry?17:05
mrmartinthis run / last run17:05
mrmartinCatalog compiled at: Unknown17:05
fungimrmartin: unfortunately it's the timezone of the author of the puppetboard software i think :/ they assumed nobody runs software outside their 1/24th of the planet17:06
*** otter768 has joined #openstack-infra17:06
*** patrickeast has joined #openstack-infra17:06
SpamapSmordred: its not that strange to think that Canonical would not take care to make Ironic work well. Also, because ironicclient is not in requirements.txt, it's not entirely clear that the virt driver would require later versions (which is actually what is broken)17:06
mrmartinoh ok, and where this guy was living ?17:06
pleia2shows 4:59AM for me17:06
fungimrmartin: i believe that last run was 16:59... so probably incorporating changes that merged before 16:30 or maybe 16:4517:06
pleia2but I was reading that as PM, so 7 minutes ago17:06
greghaynesSpamapS: You discovered some packaging badness in ubuntu?17:07
*** kiran-r has quit IRC17:07
pleia2fungi: that was my read as well17:07
*** patrickeast_ has quit IRC17:07
fungipleia2: amusing. for me it says the last run was 11:59 am17:07
pleia2our merge happened at 16:46, so kind of on the cusp of being picked up17:07
fungiand my clock is set to utc17:07
*** yamahata has quit IRC17:07
pleia2clocks are hard17:07
mrmartinpleia2: ok, /me is excited17:07
SpamapSgreghaynes: just oldness17:08
*** ashleighfarnham has joined #openstack-infra17:08
SpamapSgreghaynes: we just need to get a not-18months-old version of ironicclient into Ubuntu17:08
greghaynesah :/17:08
SpamapSalso when I tried pip installing.. zomg that pissed off puppet17:08
greghayneshahaha17:08
fungimrmartin: anyway, judging from the current cadence of puppet updates there, i'd assume you shouldn't expect anything exciting for about another 40 minutes17:09
*** dboik has quit IRC17:09
mrmartinpuppet apply by hand to speed up things ?17:09
greghaynesSpamapS: so, there are some hacks infra does to disable package installs while they build images... maybe the similar hack can be done for just a single pacakge17:09
fungimrmartin: i can if it's urgent17:09
pleia2mrmartin: it's not an emergency, I'd rather not17:09
mrmartinpleia2: it's not urgent17:10
SpamapSgreghaynes: no the issue is that my pip installed current ironicclient installed a version of pbr that breaks the package installed neutronclient.17:10
fungiwe'd like to streamline our puppet updates to be a lot faster. i think they'll be nice and speedy once we switch to masterless17:10
fungiright now they're mostly serialized17:10
greghayneswooow17:10
SpamapS2015-07-01 13:17:49 +0000 Puppet (err): Could not prefetch keystone_service provider 'openstack': Execution of '/usr/bin/openstack service list --quiet --format csv --long' returned 1: ERROR: openstackclient.shell Exception raised: (pbr 1.2.0 (/usr/local/lib/python2.7/dist-packages), Requirement.parse('pbr!=0.7,<1.0,>=0.6'), set(['python-neutronclient', 'cliff', 'python-glanceclient', 'python-cinderclient', 'python-novaclient']))17:10
*** otter768 has quit IRC17:11
SpamapSgreghaynes: so basically I suspect there's a rather large dependency chain of fail in UCA that needs to be fixed.17:11
fungiokay, time to work on surgically extracting stable/icehouse from all our jobs17:11
*** dguerri is now known as dguerri`17:11
*** yamamoto has quit IRC17:12
*** geoffarnold has quit IRC17:13
*** geoffarnold has joined #openstack-infra17:14
*** wshao has joined #openstack-infra17:16
*** SumitNaiksatam has joined #openstack-infra17:16
*** sabeen1 has joined #openstack-infra17:17
*** cindyo has quit IRC17:17
*** sdake_ has joined #openstack-infra17:18
*** e0ne is now known as e0ne_17:19
*** koolhead_ has joined #openstack-infra17:19
*** patrickeast has quit IRC17:19
*** koolhead17 has quit IRC17:19
*** e0ne_ is now known as e0ne17:20
*** sabeen2 has joined #openstack-infra17:21
*** yamamoto has joined #openstack-infra17:21
*** dboik has joined #openstack-infra17:21
*** sdake has quit IRC17:21
*** patrickeast has joined #openstack-infra17:21
*** ihrachyshka_ has quit IRC17:22
*** jaypipes has joined #openstack-infra17:22
*** dboik_ has joined #openstack-infra17:23
*** SumitNaiksatam has quit IRC17:23
*** achanda has joined #openstack-infra17:23
*** SumitNaiksatam has joined #openstack-infra17:23
*** sabeen1 has quit IRC17:24
*** dannywilson has quit IRC17:24
*** Sukhdev has quit IRC17:24
sdake_mordred happen to be around fine sir re temporary relicense of shade to asl17:25
*** ajmiller_ has joined #openstack-infra17:25
*** Sukhdev has joined #openstack-infra17:25
*** jsavak has joined #openstack-infra17:25
*** dboik has quit IRC17:26
*** gokrokve_ has joined #openstack-infra17:26
*** trey has joined #openstack-infra17:26
*** wshao has quit IRC17:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: stackforge/{anchor,bandit} -> openstack/{anchor,bandit}  https://review.openstack.org/19767317:27
*** gokrokve has quit IRC17:27
*** wshao has joined #openstack-infra17:27
*** yfried has joined #openstack-infra17:27
SpamapSso.. this is a really sticky problem I'm running into...17:28
SpamapSpackaged versions of client libraries are basically all "really old" in ubuntu cloud archive17:28
*** hdd has joined #openstack-infra17:28
greghaynesSpamapS: Why do you need the client libs? they are working fine as deps for the services as is right?17:29
*** e0ne is now known as e0ne_17:29
*** abregman has quit IRC17:29
greghaynesasking because why not venv17:29
SpamapSgreghaynes: well it's a dependency graph problem17:29
SpamapSgreghaynes: so the puppet modules are built around packages17:30
SpamapSgreghaynes: so venv would be a massive departure.17:30
greghaynesSpamapS: I think it depends on where they are being used, which is what im trying to figure out17:31
krotscheckfungi: Thanks!17:31
greghaynesSpamapS: are the services themselves failing because old client libs?17:31
SpamapSgreghaynes: and for instance, ironicclient needs pbr >=0.11 ... Ubuntu cloud archive has 0.1017:31
SpamapSlooks like I could maybe compromise with ironicclient 0.5.117:32
*** e0ne_ is now known as e0ne17:32
SpamapShrm... 0.7.0 only _says_ it wants >=0.1117:33
SpamapSseems to work fine with 0.1017:33
greghaynesoh, this is puppet trying to set up the openstack using the client libs17:33
SpamapSgreghaynes: yes17:33
greghayneshrm17:33
greghaynesyea, that is a bad spot :p17:33
SpamapSgreghaynes: just in general, it's the model of having everything in system python17:33
*** BharatK has quit IRC17:33
SpamapSwhich I am pretty sure is a model that is _heavily_ flawed.17:34
SpamapSand is a great way to get stuck on an old release of OpenStack17:34
greghaynesYea, I was trying to figure out if theres a way you could maybe make this one use case use a venv, but that would probably be a lot of puppet change17:34
SpamapSwell it might be worthwhile puppet change17:35
SpamapSI've always believed very strongly that "how you get your software" and "how you configure your software" should be thought of separately.17:35
*** e0ne has quit IRC17:35
*** doude_ has quit IRC17:36
greghaynesalso crinkle ^ I think this is your exact area of expertise - client libs + puppet17:36
*** trey has quit IRC17:37
crinkleha17:37
*** armax has quit IRC17:37
greghaynes:)17:37
SpamapSI'm actually about 5 minutes from uploading python-ironicclient 0.7.0 to Ubuntu "wily"17:38
SpamapSwhich would I think make it fairly simple for UCA to sync that.17:38
*** fhubik has quit IRC17:38
crinkleso the puppet modules should be working with what's in uca17:38
greghaynesSpamapS: Yea, for ironic that shouldnt be a big issue - theres not going to be any other services that use python-ironicclient17:38
SpamapScrinkle: nova ironic driver does not17:39
SpamapScrinkle: which is likely a corner case not covered in any integration test17:39
*** trey has joined #openstack-infra17:39
SpamapSone I'd like to cover once I get this sorted17:39
*** ildikov has quit IRC17:39
*** sdake_ is now known as sdake17:39
SpamapSsince we'll be relying on that.17:39
SpamapSW: Failed to fetch http://security.ubuntu.com/ubuntu/dists/trusty-security/universe/binary-amd64/Packages  Hash Sum mismatch17:41
SpamapSoh joy17:41
SpamapSapt.. seriously.. get your act together17:41
greghaynes\O/17:41
*** jsavak has quit IRC17:42
Clintsilly ubuntu17:42
*** marcusvrn1 has joined #openstack-infra17:43
*** armax has joined #openstack-infra17:43
openstackgerritMerged openstack-infra/project-config: Fix universal extraction in non-universal wheel  https://review.openstack.org/19765417:44
SpamapSClint: I know right? pdiffs are like 10 years old now17:44
*** sdake has quit IRC17:44
SpamapSClint: note that it's really "silly launchpad" for that one. :-/17:44
*** mestery_ has joined #openstack-infra17:46
*** sdake has joined #openstack-infra17:46
*** notnownikki has quit IRC17:46
*** marcusvrn has quit IRC17:46
*** yamamoto has quit IRC17:48
*** sdake has quit IRC17:48
*** liam_ has joined #openstack-infra17:49
*** mrunge has quit IRC17:49
*** mestery has quit IRC17:49
*** liam_ is now known as Guest1205017:49
*** sdake has joined #openstack-infra17:49
*** rwsu has quit IRC17:50
mordredSpamapS: *headdesk*17:50
*** frobware_ has quit IRC17:52
openstackgerritMerged openstack-infra/project-config: Make Sahara python3 job voting  https://review.openstack.org/19749817:52
*** SumitNaiksatam has quit IRC17:52
*** Guest12050 has quit IRC17:53
*** shardy has quit IRC17:53
SpamapSand now the fun begins17:53
SpamapSwily has old'n'busted oslo.i18n still... so old it doesn't have de-namespaced modules17:54
*** shardy has joined #openstack-infra17:54
*** rwsu has joined #openstack-infra17:54
mordredSpamapS: wow17:54
SpamapSwait no..17:55
SpamapSthis was trusty17:55
SpamapSn/m17:55
*** DericHorn-HP has quit IRC17:55
SpamapSwily's good on that one17:55
*** wshao has quit IRC17:55
* SpamapS doing too many things in parallel17:55
SpamapSneed to enable UCA in my trusty test chroot17:55
clarkbyou kbow if this constraints stuff works wellall we need next is to sign our python packages then you can/should just pip + venv everythibg17:56
clarkb(granted we cant sign our deps)17:56
*** isviridov is now known as isviridov_away17:56
*** thorst has quit IRC17:57
SpamapSclarkb: I'm lacking context. Constraints stuff?17:57
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging  https://review.openstack.org/19119317:57
*** dizquierdo has quit IRC17:57
clarkbSpamapS the work lifeless is doing to make pip installs deterministic17:58
greghaynesrequirements constraints17:58
dhellmannjeblair: I updated ^^ after discussing it with ttx this week when we realized your "keep all the history" approach would help us solve another problem we have17:58
greghaynesclarkb: thers still the system dep problem too17:58
greghaynesbut were solving that in theory17:58
clarkbgreghaynes ya so need bindep too17:58
*** jogo has quit IRC17:58
SpamapSclarkb: what would happen if we didn't have that and just used signed git tags with pip+venv?17:59
*** mayurig has joined #openstack-infra17:59
fungiwow. i started writing the icehouse testing removal change less than an hour ago, based on project-config branch tip, and it's already in merge conflict before i've even pushed it into gerrit17:59
pleia2fungi: hm, I think something might actually be wrong with puppet17:59
pleia2about 6 hours since anything has changed17:59
*** puranamr has quit IRC17:59
*** ivar-lazzaro has quit IRC17:59
dhellmannAJaeger_, is the change to add openstack/releases ok now? https://review.openstack.org/#/c/196704/18:00
nibalizerpleia2: what are you seeing?18:01
pleia2nibalizer: just looking at puppetboard.openstack.org18:01
fungipleia2: on the puppetmaster i see a bash /opt/system-config/production/run_all.sh process running since 12:15 utc18:01
fungipleia2: so i agree18:01
clarkbSpamapS: you would have no control over your deps18:01
clarkbSpamapS: so when you deploy a new compute node for example it could be runnign very different software than the existing compute nodes18:01
fungipleia2: and no updates to /var/log/puppet_run_all.log since 12:09 utc18:02
pleia2fungi: nods18:02
SpamapSclarkb: I would, if I did pip install on each compute node. But instead I'd probably just copy the venv that passed testing. No?18:02
clarkbSpamapS: virtualenvs are not portable, while that may work in a very specific use case generally it wont18:03
openstackgerritMerged openstack/requirements: Updated from global requirements  https://review.openstack.org/19650418:03
*** DericHorn-HP has joined #openstack-infra18:03
fungipleia2: if you look at ps afuxww you'll see there's git fetch-pack hung for the past 6 hours18:03
SpamapSclarkb: it works very reliably if you have the same path, and put it on hosts that are the same arch+os+libs .. which is not a hard thing to achieve. But I agree, we're two "what ifs" in and I'm already feeling icky. ;)18:03
pleia2fungi: oof18:04
*** mestery_ is now known as mestery18:04
*** Kennan has quit IRC18:04
SpamapSclarkb: though this is really why things like snappy and docker are gaining popularity.18:04
fungipleia2: strace shows it's idling in the middle of a read18:04
fungipleia2: presumably on the network socket for that18:04
SpamapSbecause those _are_ portable and they don't have all the insanity of system level packaging.18:04
clarkbSpamapS: sure, but they have the problem where something like 60% of images on dockers image hub are found to have major security vulnerabilities18:04
*** Kennan has joined #openstack-infra18:05
clarkbit would be really neat if we could have aworking packaging system for python18:05
mordredclarkb: sure. but if you build your own, it's easy, and you can track the security yourself18:05
fungipleia2: i'm willing to chalk this up to git^Wnetworks^Wcloud sucks, kill that pid and move on with our lives18:05
clarkbSpamapS: also they are not necessarily portable because systemd and friends18:05
mordredfungi: ++18:05
SpamapSclarkb: I don't understand how systemd affects the portability?18:05
clarkbfungi: pleia2 ianw did appear to debug the git issue on centos18:05
pleia2fungi: wfm18:06
fungiclarkb: yep, i saw18:06
clarkbSpamapS: systemd is picky about its kernel18:06
SpamapSit is?18:06
fungiclarkb: though what's fun is this is ubuntu trusty on the client end18:06
*** thorst has joined #openstack-infra18:06
mordredclarkb: but you don't need to run systemd inside of a docker container18:06
clarkbSpamapS: yes they explicitly have min kernel versions that are arbitrary based on whatever new feature they decide they need18:06
mordredif you are doing that, you are doing it wrong18:06
*** sigmavirus24_awa is now known as sigmavirus2418:06
mordredalso - distro pacakges are ALSO not portable across different hosts18:07
clarkbmordred: I take some issue with that, not running init in docker has resulted in many broken docker containers18:07
clarkbmordred: because you have nothing reaping zombies18:07
clarkbif you do it correctly its fine but it turns out that is hard to do when running $randomservice18:07
SpamapSI think your kernel argument is true, but I'm not sure it is actually relevant to what we're discussing.18:08
SpamapSand for the record, I also believe you need something reaping zombies in a container.18:08
mordredyou need suse packages for suse, and debian packages for debian18:09
mordredalso18:09
mordredhttps://github.com/ewindisch/container-shpid118:09
clarkbmordred: it doesn't have to be systemd but it does need to be something18:09
mordredthat ^^18:09
clarkbmordred: and most docker images have nothing18:09
clarkbmordred: including the official ones18:09
mordredyah18:09
mordredbecause most of them are single-process application containers18:09
mordrednot containers-that-behave-like-vms18:09
clarkbmordred: until that single process forks18:09
clarkbmordred: which they do because unix18:09
mordredclarkb: right. you have to use them for purposes18:10
mordredthey AREN'T a magic bullet18:10
mordredbut they ARE easier to deal with than distro packaging for most humans18:10
SpamapSmordred: thats not handling zombies.18:10
mordredso whether they are perfect or not - they are going to be used more and more18:10
clarkbmordred: yes use them, I think I am more arguing that the docker conventions are terrible and need to be rethought18:11
clarkbbecause hand waving around single process isn't practical18:11
SpamapSbut I think it _could_ handle them with a SIGCHLD handler. Also one could just run sysvinit as the pid1 for the container .. ;)18:11
jeblairare we actually discussing using containers in infra?  if so, great, otherwise, maybe this is a good conversation for #openstack-rainbow-unicorn-pals18:11
mordredSpamapS: haha. nice18:12
*** HeOS has quit IRC18:12
*** ZZelle_ has joined #openstack-infra18:12
SpamapSanyway, my point is not to disect docker. It is to suggest that I'm really not looking forward to jumping down the package rabbit hole just to fix nova+ironic in UCA.18:12
clarkbjeblair: we probably do need to have the discussion about how to better test with containers and docker but thats orthogonal to this discussion18:12
mordredSpamapS: yah18:12
persiaclarkb: Theoretically https://github.com/opencontainers/specs contains the results of such rethinking of conventions.18:12
*** ajmiller_ has quit IRC18:12
EmilienMgreetings Infra! asking for review on 3 patches for Puppet CI > https://goo.gl/3Cn1HA18:12
SpamapSjeblair: there is a legitimate problem right now, and we are actually discussing solutions. I know right? ;)18:12
clarkbjeblair: because a lot of jobs are using docker and they essenentially break all the caching we do for jobs18:12
clarkbthey also break dns and use different package mirrors and don't use our pypi mirrors etc18:13
clarkbmordred: ^ this is another issue with "its just single process isolation" if it was this wouldn't be a problem18:13
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Remove managed stable/icehouse branch testing  https://review.openstack.org/19768718:13
fungithat ^ has already merge-conflicted with master once just in the hour it took me to write it, so i feel like we should fast-track reviewing it otherwise it will likely take forever to land18:14
*** MarkAtwood has quit IRC18:14
mordredfungi: reviewing18:14
jeblairclarkb: okay, do we want to talk about that now?  because seriously this just seems like people saying random things about containers in general.18:14
clarkbjeblair: I don't need to have that discussion now. Its probably best to have the groups using containers come to us with their needs and go from there (kolla, solum, ansible openstack deployment, etc)18:14
jeblairif there are legitimate problems that we want to solve, i'm happy to engage in a conversation, but i'd love it if we could avoid conflating that with general opining on systemd and containers18:15
jeblairclarkb: agreed18:15
*** mrmartin has quit IRC18:15
clarkbjeblair: but they do have jobs fail at a fairly reasonable rate due to things that would be mostly non issues if not run in containers18:15
mordredfungi: +218:15
*** jogo has joined #openstack-infra18:15
fungii need to write a filter which replaces "container" with "tractor" in irc conversations and see if it makes about as much sense18:15
sdakeclarkb my kolla beeper went off18:15
sdakeanythingI can help answer?18:15
clarkbsdake: just mentioning that the container based testing circumvents much of our node setup to make tests as reliable as possible18:16
jeblairclarkb: yeah, folks who want to use containers have some engineering work to do to have them well supported in our system i think.18:16
clarkbsdake: and that at some point we will want to address that18:16
ClintEmilienM: i think you may have erred with your url-shortening18:16
EmilienMoh dear18:16
SpamapSjeblair: the problem we have now is that UCA is badly broken for nova + ironic. Luckily, I'm an Ubuntu developer and I can at least try to help it get fixed in UCA (though UCA is Canonical, so....). But we need to think more about how much packaging infrastructure we want to deal with, and thus came the topic "could we just use pip+venv or docker or something"18:16
*** fallenpegasus has quit IRC18:16
jeblairclarkb: and to keep us from being a dos vector18:16
EmilienMClint: the URL works for me, it's originally https://review.openstack.org/#/q/status:open+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22+project:openstack-infra/project-config,n,z18:17
jeblairSpamapS: aiui part of this overall effort includes a packaging component18:17
jeblairSpamapS: but also, aren't we expecting to get kilo packages soon?18:17
SpamapSjeblair: yes, it's been somewhat hand-wavy and decoupled up until now.18:17
SpamapSjeblair: we have kilo packages18:18
SpamapSexcept python-ironicclient18:18
*** kiran-r has joined #openstack-infra18:18
SpamapSwhich is Icehouse versioned18:18
SpamapSand too old for kilo's Ironic driver18:18
jeblairthat seems weird18:18
SpamapSnobody seems to have tried to run Kilo Nova+Ironic from UCA yet.18:18
SpamapSexcept me :-P18:18
clarkbSpamapS: you are a trailblazer18:19
*** Sukhdev has quit IRC18:19
SpamapSclarkb: I prefer s/trailblazer/firework/18:19
* SpamapS lets his colors burst18:19
clarkbSpamapS: careful fireworks are going to be banned in this part of the country18:20
AJaeger_dhellmann: https://review.openstack.org/#/c/196704/ needs a +1 from ttx18:20
AJaeger_also, I noticed one "sorting nit". Let me fix that for you and then +2.18:21
dhellmannAJaeger_: ok, thanks18:21
clarkbfungi: how did you find that precise stuff for ironic testing, good catch on removing that18:21
*** puranamr has joined #openstack-infra18:21
*** puranamr has quit IRC18:21
*** nihilifer has quit IRC18:22
AJaeger_dhellmann: I'll +2 once ttx has given his explicit approval18:22
mordredclarkb: because he's a magical bunny18:22
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging  https://review.openstack.org/19119318:22
fungiclarkb: git grep18:23
jeblairSpamapS: my understanding is that we have chosen to use puppet modules and packages, which carries the risk that we are dependent on distro packages, but we can potentially mitigate that risk by implementing our own packaging system.  we may find problems along the way, but will try to get those corrected.18:23
*** e0ne has joined #openstack-infra18:23
*** e0ne is now known as e0ne_18:23
jeblairSpamapS: does that match your understanding?  do you think we should consider changing any aspects of that?18:23
fungiclarkb: tried to clean up as much as i can without intentionally breaking/removing jobs for non release:managed repos for now18:23
*** e0ne_ is now known as e0ne18:23
*** e0ne has quit IRC18:23
fungiclarkb: when we tear out precise workers, we'll probably be able to remove a lot more18:23
clarkbfungi: I also notice we have no python kilo bitrot jobs18:24
fungiclarkb: ttx proposed a change to add them18:24
*** puranamr has joined #openstack-infra18:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add openstack/releases repository  https://review.openstack.org/19670418:24
clarkbfungi: perfect18:24
*** e0ne has joined #openstack-infra18:24
fungiclarkb: i'm planning to review/stack it on this, but first i'm going through and abandoning icehouse changes which are still open18:24
*** puranamr has quit IRC18:24
jeblairSpamapS: also, should we start thinking of the packaging effort as a harder dependency?18:25
SpamapSjeblair: That matches my understanding. I think it makes me want to fill in details about what we'll do with packages, but does not bring me to any new conclusions.18:25
AJaeger_fungi, clarkb : ttx' change is https://review.openstack.org/196709 - please review. I'm not convinced that the python 2.6 changes are right18:25
fungiAJaeger_: yep i plan to give it a good going-over shortly18:25
jeblairSpamapS: ++18:25
SpamapSjeblair: I think it's going to become a harder dependency, for the simple reason that we cannot "work upstream" on UCA AFAIK.18:25
clarkbfungi: yup no rush, just pointing out my observations, should be approving your change shortly as long as it all looks good18:25
SpamapSjeblair: we just have to ask nicely for packages to be updated in UCA18:26
SpamapSand they may not even decide to support nova+ironic in UCA, and thus would leave us out in the cold.18:26
clarkbspeaking of, the state of the python3 trusty package bug was updated again to reset it back to not fix released18:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: warn on projects not in governance  https://review.openstack.org/19678518:26
clarkbso maybe someone is workign on that again?18:26
fungiclarkb: that's my hope18:26
fungiclarkb: it's getting more and more embarrassing18:27
jeblairSpamapS, crinkle: do the puppet modules have a hard dependency on UCA packages?  if we start substituting our own, is that likely to succeed or cause undue problems?18:27
*** ivar-lazzaro has joined #openstack-infra18:27
clarkbfungi: I have comments on the zuul layout that will be posted as soon as I can write them18:27
crinklejeblair: they have an implicit dependency on UCA packages18:27
*** jsavak has joined #openstack-infra18:27
crinklejeblair: they make assumptions about the packaging such as the package name, default locations of configuration files18:27
jeblairSpamapS, crinkle: (also, it seems weird that there is a puppet module for ironic while it is so out of step with the rest)18:28
SpamapSjeblair: no, the puppet modules just ask for packages by name.18:28
crinklethe ironic module seems to get a little less love than the others18:28
jeblairso probably minimal problems as long as we start with the uca sources18:28
SpamapSAgreed, the ironic module doesn't get tagged for instance.18:28
crinkleit hasn't been released yet, i expect it will for kilo ( EmilienM ?)18:29
SpamapSjeblair: right, I think we simply make our package repo a downstream of UCA18:29
jeblairis ubuntu the only operating system supported by the puppet modules?18:29
*** packet has joined #openstack-infra18:29
EmilienMcrinkle: yes, it's mature enough now18:29
SpamapSkeep it in sync for the most part, and diverge when we need to.18:29
crinkleno there is fedora, centos, and debian support18:29
*** ildikov has joined #openstack-infra18:29
crinkleand potential for solaris support18:29
jeblairsome of those are more likely for us than others ;)18:29
clarkbfungi: posted18:30
fungiclarkb: thanks18:30
clarkbfungi: with those addressed I think it is ready to be merged18:30
openstackgerritJulia Kreger proposed openstack-infra/glean: Make glean python 2.6 compatible for Centos6  https://review.openstack.org/19769018:30
jeblairSpamapS, crinkle: are the debian packgase in better shape?18:30
crinklejeblair: i have no knowledge of that18:31
EmilienMjeblair: they should be18:31
SpamapSjeblair: ehhh.. yes and no18:31
*** nihilifer has joined #openstack-infra18:31
EmilienMjeblair: before our acquisition, we were deploying them every day and they are working very well (cc zigo )18:31
EmilienMjeblair: upstream puppet modules support them without any issue18:32
clarkbTheJulia: re 197690 both those methods raise an exception if the command fails which means the subsequent poll will never run right?18:32
*** dannywilson has joined #openstack-infra18:33
clarkbgreghaynes: mordred ^18:33
jeblaira potential idea is to run infra-cloud on a different os; we've certainly considered running more infra servers on debian, and we already run some centos servers.  i think that's a significant enough departure from our established plan not to be undertaken lightly.  but it can be an idea we keep in mind.18:33
SpamapSjeblair: their shape is probaby about the same. The OS itself is quite a different beast from Ubuntu though. :)18:33
SpamapSWe actually have.. a ridiculous number of DD's available.18:33
clarkbTheJulia: er rather it won't poll if it fails in that case18:34
fungiwell, debian and ubuntu aren't terribly divergent... however the debian and ubuntu openstack packages are fairly divergent still18:34
TheJuliaclarkb: from what I read, yes18:34
crinkleiirc we talked ourselves into Ubuntu for some reason18:34
*** e0ne is now known as e0ne_18:34
ClintSpamapS: and none of them looking at zuul-packaging18:34
EmilienMjeblair: centos7 is running fine and we make CI on this (and trusty)18:34
clarkbTheJulia: I think I have convinced myself its fine if maybe lacking more verbose logging for that fail case18:34
*** ilyashakhat has quit IRC18:34
fungiSpamapS: but yes, there are a lot of dds here and also non-dds who run pretty much pure-debian outside of openstack infra ;)18:34
*** ilyashakhat has joined #openstack-infra18:35
fungiso it's not a huge stretch18:35
fungi(accidental pun there)18:35
TheJuliaclarkb: :)  Yeah.... I looked at it and felt the urge to add more, but I figured simple would be best.  At least it now executes on centos6.  Now to just get interfaces to come online with simple-init!18:35
*** kushal has quit IRC18:35
SpamapSfungi: well played18:35
SpamapSMy feeling is meh on Debian vs. Ubuntu.18:35
*** mrmartin has joined #openstack-infra18:36
SpamapSI like the Ubuntu security team's track record a lot. I like the LTS release cadence a lot more than the Debian release cadence.18:36
clarkbTheJulia: yup +2 from me18:36
*** signed8bit has quit IRC18:36
*** rossella_s has quit IRC18:36
*** e0ne_ is now known as e0ne18:37
SpamapSRegarding the packages.. its likely even with Debian packages that we'd have operationally-important issues that would have to be solved quickly with a patch that might not be suitable for Debian.18:37
*** rossella_s has joined #openstack-infra18:37
SpamapSSo going to that OS does not really free us from a need to have our own repo.18:37
jeblairSpamapS: agreed18:37
*** kiran-r has quit IRC18:38
jeblairSpamapS: i'll just go ahead and say i'm a little worried that we're running into a sabdfl-created ironic/maas conflict here, which prompted my thinking along this line.18:38
SpamapSSo, I think we should focus on the meta-problem of creating and maintaining a downstream package overlay repo.18:38
*** sdake has quit IRC18:38
*** dprince has quit IRC18:38
*** sdake has joined #openstack-infra18:38
jeblairSpamapS: yep.  clearly we have demonstrated need.18:39
*** kiran-r has joined #openstack-infra18:39
*** dprince has joined #openstack-infra18:39
clarkbAJaeger_: good catch on python26, we dropped 26 for servers in kilo so we can probably just remove that18:39
SpamapSjeblair: yeah, that conflict is not lost on me at all. I think it is absolutely why ironicclient has gone completely un-touched for 18 months in Ubuntu.18:39
clarkbAJaeger_: I think you can flip your review to a -1 if you like18:39
AJaeger_;)18:40
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Remove managed stable/icehouse branch testing  https://review.openstack.org/19768718:40
AJaeger_Ah, now I see what confused me - there are python 3.4 projects in the python 2.6 deprecation list. Will resort...18:40
*** sdake_ has joined #openstack-infra18:41
*** Rockyg has joined #openstack-infra18:41
fungiAJaeger_: yeah, we need to clean that up but i left it for later18:41
*** doude has joined #openstack-infra18:41
*** homeless has quit IRC18:41
AJaeger_fungi, I'll put my patch on top of yours and rebase if needed...18:41
clarkbAJaeger_: or maybe even push a new patchset? ttx is likely afk at this point18:41
* crinkle -> lunch18:42
*** fallenpegasus has joined #openstack-infra18:42
SpamapSClint: have you taken a look at all at this problem of making a downstream apt repo?18:42
SpamapSStevenK: ^ ?18:42
ClintSpamapS: only as a handwavy idea18:43
mrmartinpleia2: are you here?18:44
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Move python 3.4 jobs out of python 2.6 list  https://review.openstack.org/19769518:44
*** sdake has quit IRC18:44
*** Sukhdev has joined #openstack-infra18:44
*** kiran-r has quit IRC18:44
AJaeger_clarkb: not at the moment...18:45
mordreduhoh. the clints are involved18:45
SpamapSClint: seems like the best way to do it would be to use something really simple that would build packages using sbuild on merge to git, and then manage the whole thing in gerrit.18:45
ClintSpamapS: packages based on what though?18:46
*** signed8bit has joined #openstack-infra18:46
mrmartinfungi: something not quite ok with this openstackid upgrade. can you help me and paste the output of this two commands: cat /opt/deploy/conf.d/openstackid.conf and /opt/deploy/deploy.sh status openstackid ?18:46
fungimrmartin: yep, trying now18:47
SpamapSClint: whatever we need to have in our apt repo.18:47
ClintSpamapS: but like, are you maintaining divergent packaging repos for everything or are you specifying some sort of base + diff?18:47
SpamapSClint: I think you start with an import of the package into git as your base.18:48
jeblairClint, SpamapS: as you come to conclusions, can you help refine https://review.openstack.org/179713 ?18:48
SpamapSClint: if the package is already in git, great. :)18:48
*** SumitNaiksatam has joined #openstack-infra18:48
mordredyah. that's one of my main questions - git repos are pretty heavy-weight in gerrit land18:48
fungimrmartin: http://paste.openstack.org/show/332895/18:48
SpamapSOh I hadn't looked at that one.18:48
mrmartinfungi: thnx18:48
mordredand it seems like we could quickly wind up with 200 infra-packaging repos18:48
SpamapSmordred: I don't expect we'd want to have more than a handful of these.18:49
Clintwhat's the scope then?18:49
SpamapSmordred: if we end up at 200 ... we're our own distro at that point. Time to make t-shirts.18:49
SpamapSThe idea is to fix it in our apt repo only as a buffer to the fix actually landing in our upstream.18:50
Clintand are we never going to want to spin custom packages for software that is not openstack-upstream18:50
*** gokrokve_ has quit IRC18:50
SpamapSBut I agree, adding and removing git repos every time we diverge could end up with 200 total, even if only 10 of them are active.18:50
SpamapSClint: yes, because NEW is slow. ;)18:50
clarkbanteaya: happy canada day (is that the appropriate thing to say for this holiday?) I hope you do the Canadian equivalent of exploding things and cooking food with fire18:51
fungimrmartin: we discovered that our puppet apply task was hung and not updating any servers for ~6 hours, so that first run which updated openstackid.org about 25 minutes ago may not have used the latest configuration yet18:51
*** bradjones has quit IRC18:51
Clintjeblair: i think there will be more questions than conclusions18:51
clarkbClint: possible libvirt, ovs, kernel, rabbitmq, etc. the system deps of openstack18:51
jeblairClint: questons are good to have there too :)18:51
mrmartinfungi: I realized that one part, I just like to figure out why the status of deploy.sh is pending18:51
Clintso do we want full-weight git repos for each of those/18:51
*** julim has quit IRC18:51
Clint(i suspect we don't)18:52
mordredI think we don't18:52
mordredI think we ultimately want to support both things - both having a packaging repo and not having a packaging repo18:52
*** hodos has joined #openstack-infra18:52
*** bradjones has joined #openstack-infra18:52
*** bradjones has quit IRC18:52
*** bradjones has joined #openstack-infra18:52
fungii wonder if you want a git repo of patches which can be layered on the deb src v3 quilt stacks18:52
SpamapSare branches heavyweight?18:52
mordredbecause there are some things where a referecen in a file that says "please clone $packaging_repo, run dch $some_version_args, run debuild and put the results in a local repo" is fine for simple things for us18:53
mordredand I think we are NOT a distro18:53
fungior possibly just overlay patches to the debian subtrees of unpacked source packages18:53
mordredso having a long-lived repo for things like "we temporarily need a new copy of a thing in our local repo" really doesn't need us to own the git for it18:53
mordredfungi: yah18:53
mordredor *something hand wavy*18:53
SpamapSHrm18:54
Clintfungi: i'd want something that could patch the debian/ packaging too18:54
fungia repo fully of ugly hack triples of "script+patch+metadata" per source package18:54
mordredhttp://lists.openstack.org/pipermail/openstack-infra/2015-April/002723.html18:54
fungis/fully/full/18:54
mordredis what I rambled on the subject back in april18:55
SpamapSThats just the thing... git repos are, by definition, a series of patches on top of a base.18:55
mordredyes. but a git repo in gerrit is a heavy prospect18:55
SpamapSThe fact that gerrit makes them hard to use is rather frustrating at this point.18:55
*** shardy has quit IRC18:55
*** shardy has joined #openstack-infra18:55
jeblairSpamapS: well... let's pretend it was easy to delete git repos from gerrit.  should we?  i am not so sure.18:56
jeblairi don't like deleting work history18:56
fungiSpamapS: well, i don't think it's so much gerrit. we're talking about forks of a bunch of ...probably... git repos but really debian source packages. we don't necessarily need the entire archive history if we're just maintaining an overlay18:56
SpamapSI don't want to delete them. I think its fine to mark them as inactive and let them sit until the next time we want to diverge that package.18:56
SpamapSfungi: definitely agree there.18:56
jeblairSpamapS: that's an option18:56
*** sergmelikyan has joined #openstack-infra18:57
mrmartinfungi: can you check me whether the /srv/openstackid/w/public/index.php file exists, w is symlink to slot0 or slot1 and /srv/openstackid/slot0 directory exists18:57
mordredwell, honestly18:57
mordredSpamapS has a good point18:57
mordredwhich is that there is really nothing that _prevents_ us from making some more repos18:57
mordredwe have like 1000 puppet repos18:57
jeblairright, i've not generally objected to creating repos, just deleting them.  i assumed that was what was at issue here.18:57
SpamapSCan we hide them?18:58
mordredyah - if we just keep them around after we've used them once, that work _did_ happen and we _did_ publish the artifact from it18:58
fungimrmartin: the public/index.php exists (and is nonempty). the w symlink points at slot018:58
mordredSpamapS: shouldn't really need to - it's not a problem taht they exist I think18:58
SpamapSas in, they are there, and available, but gerrit doesn't show them because we've re-synced?18:58
mordredSpamapS: the more I think about it18:58
Clintand then huge rebase if you want to use it again?18:58
fungimrmartin: and the slot0 directory does exits too, yes18:58
jeblairClint: well, 'merge commit' perhaps/18:58
SpamapSClint: might not even really need to rebase. Just import dsc again.18:58
mordredClint: I think we could have upstream branches and infra branches like we do with gerrit18:58
mordredor do that18:58
mrmartinfungi: strange, I not get why it tells for the status that it is pending: https://github.com/openstack-infra/puppet-openstackid/blob/master/files/functions#L88 based on this18:58
*** hashar has joined #openstack-infra18:59
*** hashar is now known as hasharCall18:59
mordredSpamapS: instead of inactiving them - we can always land a commit that deletes all the content and replaces it with a "unused right now" readme18:59
jeblairthe main thing i think it's important to avoid is the appearance that we are either maintaining or willing to accept patches to a defunct pagaging repo.  we can fix that as SpamapS suggests18:59
mordredSpamapS: and then import-dsc if we need a point-in-time package again in the future18:59
jeblairand mordred suggests.18:59
mordredI could be on board with that19:00
SpamapSmordred: yeah, totally19:00
fungialso it now feels somewhat like we're reinventing git-buildpackage19:00
SpamapSfungi: wouldn't we be using git-buildpackage ?19:00
SpamapSI sort of assumed ... ;)19:00
*** koolhead_ has quit IRC19:00
mordredyah. I think we'd use git-buildpackage for sure19:01
fungiSpamapS: well, okay, reinventing one of the existing common gbp workflows, yeah19:01
mordredif we go with having a repo for each pacakge in gerrit19:01
fungior perhaps converging on it19:01
mordredI think converging on it19:01
SpamapSfungi: to be clear, I'm trying hard to align us with that workflow. :)19:01
fungiwfm19:02
pc_manteaya: hi19:02
SpamapSso assuming we did that, the idea would be that on approval of a patch, a nodepool worker goes out and runs a package build, and uploads it to our repo?19:03
persiaI've maintained overlay repos in the past, and one of the biggest issues we had was response-time to changes in the repos we overlaid.  While the git-based workflow described above looks good: if you don't control the mirror for your base (and fail to sync stuff that is modified), you end up with annoying race conditions.19:03
*** unicell has quit IRC19:03
mordredpersia: good point - I think how we mirror the base is important19:03
SpamapSpersia: ah so overlay works today, but tomorrow base updates and all hell breaks loose?19:03
persiaSpamapS: Right.  There are a few solutions that do analysis in various ways: usually using append notation in version numbers to blacklist things, but I don't know of any that are independent of an archive management suite.19:04
Clintsounds like when gentoo first started19:04
persiaAnd it would be annoying to try to host DAK or Soyuz in -infra.19:04
SpamapSClint: except without the nitro?19:04
* Clint coughs.19:04
Clinti don't think we need anything more complex than reprepro to manage the .debs19:05
fungia big up-side to doing this as a fork of existing distro-managed git repos is at least we have easy ways to see what changed, hopefully why, and manage the necessary merge conflicts/rebases19:05
SpamapSpersia: I've never looked at how independent of launchpad Soyuz is... or.. is it at all?19:05
* Rockyg thinks branches are the right solution19:06
mordredClint: ++19:06
SpamapSI had always basically been look at very funny when suggesting trying to do any part of Ubuntu's infrastructure without doing all of Ubuntu's infrastructure.19:06
mordredI cannot imagine that we need not-reprepro19:06
fungiClint: yeah, or just a script that calls apt-ftparchive and then creates detached signatures19:06
fungiClint: basically a solved problem19:06
SpamapSwait you're missing persia's point19:06
persiaSpamapS: It was once independent.  I think it isn't now.  StevenK or lifeless will have a more recent opinion than I.19:06
Rockygclone the upstream repo.  Keep it updated.  Branch any time you want to make changes.  Re-merge or maintain branch if you need to when your done19:06
SpamapSYes reprepro will create a bunch of packages which will be available to our servers with apt.19:07
*** otter768 has joined #openstack-infra19:07
mordredSpamapS: I think there are two reprepro options to deal with persia's point19:07
mordredwe can use reprepro to maintain an overlay repo that only has our packages that we have built referencing UCA19:07
persiamordred: There are some, but reprepro has some issues, some of which are solved.19:07
*** jsavak has quit IRC19:07
SpamapSBut it also will be somewhat unpredictable when interwoven with whatever the upstream distro does on any given day.19:07
mordredthis has the problem that UCA can then move on and purge old packages making packages in our overlay repo uninstallable19:07
persiaMore importantly, apt can recognise when a repo should be used, and not to override that from an update from another repo: some of the work done to support backports.19:07
mordredwe can also additionally use reprepro to maintain a local mirror of UCA that we update when we choose19:08
*** puranamr has joined #openstack-infra19:08
mordredand that we consume UCA through - and that we build the overlay repo using19:08
mordredthis has the problem if needing to manage syncs with upstream19:08
SpamapSRockyg: thats assuming there is an upstream repo to clone. ;) Sometimes it's just downloading the .dsc+bits and importing them.19:08
*** crc32 has joined #openstack-infra19:08
*** dimtruck is now known as zz_dimtruck19:08
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: prototype script to generate tag history for a project  https://review.openstack.org/19771119:08
mordredbut does not leave us with an unusable repo state19:08
persiaHaving a local mirror is the first step towards a working solution.19:09
RockygSpamapS: Ah.  Thanks.  So, only works for things with repos.  Would 2 solutions be bad?19:09
SpamapSRockyg: not at all.19:09
Rockygpersia ++19:09
SpamapSRockyg: basically the ones with git repos for their packaging will just be easier to keep merged.19:09
persiaRockyg: For debian-style packaging, there are at least 4 different ways to organise a git repo, which complicates that part of the discussion.19:10
RockygSpamapS: branching *is* the way to go for those19:10
*** crc32 has quit IRC19:10
*** erlon has quit IRC19:10
*** nihilifer has quit IRC19:10
*** crc32 has joined #openstack-infra19:10
SpamapSAnd yeah, what persia said. Local reprepro that has "all the things" and then we inject our own overrides into it. We would need to put some kind of merge guard on the sync process which prevents overwriting our own packages.19:10
*** gokrokve has joined #openstack-infra19:10
fungioh, there's an option... we test updates to both our mirror and overlay and don't update them when the proposed new state fails. of course that means having jobs that would run against a staging mirror, and trigger an afs vos release or whatever when the jobs succeed19:10
*** fallenpegasus has quit IRC19:10
Rockygpersia: grrr.  darn open source!  same NIH problem as everywhere else19:10
SpamapSfungi: I so want that. I SO WANT THAT.19:11
*** DericHorn-HP has quit IRC19:11
jeblairfungi, SpamapS: yeah, i think we'll have it :)19:11
persiafungi: That would be lovely, indeed.19:11
mordred++19:11
*** otter768 has quit IRC19:11
SpamapSA package mirror that gates updates on stuff actually working?19:11
mordredfungi: s/or whatever//19:11
Clintthat's some rainbow-unicorn-pals19:12
fungiSpamapS: well, to the extent that the tests can validate that, yes19:12
*** romcheg1 has joined #openstack-infra19:12
SpamapSIt's possible we could get that for free with autopkgtest, but I feel like we've introduced too many new concepts already. :)19:12
mordredyah. I Think we can get a something19:12
mordredand then make it better19:12
mordredeven if the first something isn't the best something19:12
clarkbtumbleweed figured it out19:12
persiaI don't seem to share a channel with paultag today, but I know he wrote some stuff to do some of this for Tanglu, which might be suitable as a starting point, rather than starting from reprepro19:12
SpamapSSo, MVP for this is just a reprepro built from UCA19:12
jeblairwe can also make it worse but i wouldn't recommend that19:12
fungiSpamapS: we've wanted that for a while with our package mirrors just so we can avoid the issue of distro official mirrors or mirrors in service providers being in a broken state (so badly that sometimes apt-get update just breaks for hours straight)19:12
clarkbso it is doable19:12
*** ajmiller_ has joined #openstack-infra19:13
romcheg1fungi: Sorry for poking, but your patch seems to be landed. Could you please re-trigger the job to release python-fuelclient-6.1.2?19:13
Clintpersia: paultag is distracted by things atm19:13
fungiromcheg1: we had some delays with puppet getting changes out to our servers. i need to check the pypi upload worker and make sure that change propagated to it19:13
fungiromcheg1: but yes, i will19:13
persiaOh well.  I'll see if I can find a real pointer then.19:13
*** boris-42 has joined #openstack-infra19:13
romcheg1fungi: Thanks a lot!19:14
SpamapSClint: I'm going to give you a new task from the storyboard to drive this. K?19:14
ClintSpamapS: i suppose i should ask how to get storyboard switched between ubuntu one whatsits then19:14
romcheg1fungi: Could you please let me know, when it's re-triggered?19:14
fungiromcheg1: i will19:14
SpamapSClint: StevenK has investigating options and reporting to the team, but I think this is more "put together an MVP repo and document in the package building spec"19:15
*** reed_ has joined #openstack-infra19:15
ClintSpamapS: where mvp repo == plain mirror19:15
jeblairSpamapS, Clint: can we get the spec updated and merged first?19:15
*** ajmiller has quit IRC19:16
persiahttps://github.com/opencollab/debile19:17
SpamapSClint: https://storyboard.openstack.org/#!/story/2000175 <-- you have a task there now19:17
Clintpersia: ahhh, i forgot about that19:17
persiaShould save some time instead of starting with reprepro.  Not precisely what is needed.19:17
persiaBut the ability to run custom tooling on mirror should be helpful.19:18
SpamapSjeblair: Sorry, I'm a trial-and-error person so specs tend to trail POC's for me. I think we should focus on the spec 100%, and if Clint can reason about it properly before the POC, then seems like it would be his call when to start noodling with tools.19:18
persiaAnd I suspect the code running in production for Tanglu (which I can't find at the moment) probably has some of the mirror-catching stuff.19:18
SpamapSjeblair: and likewise, StevenK probably would like to read this backscroll and at least be involved in the spec reboot we just hashed out. :)19:19
mrmartinfungi, pleia2 puppet run seems to be ok now on openstackid.org http://puppetboard.openstack.org/report/openstackid.org/f39e037ca14c10fccbfb6159b1b28f5dd7061d7819:19
*** sergmelikyan has quit IRC19:20
jeblairSpamapS: i hear you; i'm just trying to balance that with not wanting to freeze StevenK out, and making sure we can all collaborate cross-timezone, etc.  so yeah, i think "poc to see if what i'm about to write is remotely feasible" is more cool than "implement the thing and write the spec for it later"; i guess i wasn't clear where on the spectrum your suggestion was :)19:20
jeblairSpamapS: there are also openstack projects where apparently people write specs and then get them approved after the code lands....19:21
fungipleia2: mrmartin: mystery solved too... looks like deploy.sh needs extra privs to check status http://paste.openstack.org/show/333002/19:21
SpamapSjeblair: I may have been suggesting Clint push his cart with a horse. ;)19:21
Clintand then lifeless can huff it19:21
*** sdake has joined #openstack-infra19:21
jeblairSpamapS: so i guess i'm sensitive to that, and want to make sure that folks know our intended use of specs is "get approval for idea (spec merged) then implement"19:22
SpamapSI also keep forgetting that when I say "Clint: something something something" thats not just my inner monologue.19:22
jeblairor really s/approval/agreement/19:22
*** sdake has quit IRC19:23
mrmartinfungi: yeah, nah, thanks :)19:23
SpamapSjeblair: also I just raised priority of the investigate package building task to High, as not having it is going to start complicating other things.19:23
jeblairSpamapS: ++19:23
*** sdake has joined #openstack-infra19:23
*** aysyd has quit IRC19:23
*** DericHorn-HP has joined #openstack-infra19:24
*** ivar-lazzaro has quit IRC19:25
*** sdake_ has quit IRC19:25
*** aysyd has joined #openstack-infra19:25
*** kiran-r has joined #openstack-infra19:26
*** mayurig has quit IRC19:27
*** dansmith has quit IRC19:30
*** dansmith has joined #openstack-infra19:30
*** arosen has joined #openstack-infra19:31
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add periodic Kilo jobs  https://review.openstack.org/19670919:31
AJaeger_clarkb, fungi: removed python 2.6 ^19:31
*** nihilifer has joined #openstack-infra19:33
*** armax has quit IRC19:34
*** dguerri` is now known as dguerri19:34
*** Rockyg has quit IRC19:35
*** gokrokve has quit IRC19:36
*** ociuhandu has joined #openstack-infra19:36
fungiAJaeger_: lgtm, though will probably merge-conflict with 19768719:37
*** jasondotstar has quit IRC19:37
lifelesspersia: Clint: ?!19:37
*** aysyd has quit IRC19:37
*** HeOS has joined #openstack-infra19:38
*** e0ne has quit IRC19:38
persialifeless: Discussing ways to handle mirroring UCA, and then having some custom -infra packages layered above that, ideally sanely.19:38
persiaIt was thought you would likely have an opinion about ways of doing this.19:38
Clintlifeless: the horse, not the cart19:38
lifelessI'll think about it and swing back19:38
lifelessright now its morning bootstrap19:38
persiaMy understanding is that the consensus was to write stuff up, and make sure you had a chance to review before doing anything.19:38
*** aysyd has joined #openstack-infra19:39
persiaAlso, Good morning :)19:39
*** jsavak has joined #openstack-infra19:39
*** yamada-h has joined #openstack-infra19:39
AJaeger_fungi: yeah, expect so... Shall I rebase it after 197687?19:42
*** kiran-r has quit IRC19:42
*** nadirvardar has joined #openstack-infra19:42
fungiromcheg1: https://pypi.python.org/pypi/python-fuelclient is updated now19:42
*** armax has joined #openstack-infra19:42
fungiAJaeger_: wouldn't be a bad idea, just to get that out of the way now19:42
lifelessfungi: are there images with  https://review.openstack.org/#/c/197400/ on yet? I was pinged in -nova about what looks like the older colde19:42
lifeless*code*19:43
fungilifeless: looking now19:43
*** sergmelikyan has joined #openstack-infra19:43
* AJaeger_ is rebasing...19:43
lifelesshttp://logs.openstack.org/69/175569/20/check/gate-nova-requirements/3119838/console.html#_2015-06-30_23_23_23_62119:43
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add periodic Kilo jobs  https://review.openstack.org/19670919:43
romcheg1fungi: thanks!19:43
AJaeger_fungi, didn't cause any conflicts, still can't hurt to have it this way19:43
fungilifeless: everywhere except hpcloud-b5 and rax-ord got updated bare-trusty images today. i'll get those two spinning right now19:44
*** dguerri is now known as dguerri`19:44
lifelessfungi: thanks19:44
*** yamada-h has quit IRC19:44
AJaeger_fungi, your +2 for 196709 is still there ;)19:44
fungijenkins06 is unhappy. grr. seeing if i can get it into shutdown and then clean it up and restart it19:45
fungiwe're apparently over-quota in rax-ord. i'll see if i can figure out what's leaked there19:45
lifelessfungi: I thought jenkinses were separate?19:46
fungithey are19:46
lifelessfungi: or - were those two separate utterances ;)19:46
fungilifeless: me noticing multiple problems that need attention19:47
*** jsavak has quit IRC19:47
lifelessFIRE19:47
*** zz_dimtruck is now known as dimtruck19:47
fungiwow. no need to put jenkins06 into shutdown after all! [Wed Jul  1 12:00:55 2015] Out of memory: Kill process 23001 (java) score 905 or sacrifice child19:47
jeblairit's helpful like that19:47
*** jsavak has joined #openstack-infra19:47
fungiit's like it knew _just_ what i needed19:47
jeblairfungi: it looks like some ord nodes are in the nova 'deleted' state for quite some time19:51
mtreinishfungi: heh, someone reading that oomkiller message without context (or the rest of the log) would probably think the computer is telling you to sacrifice your child if you didn't want it to kill java :)19:52
fungijeblair: interesting. i wonder why they're not deleting, and why they're counting against our quota19:52
*** Rockyg has joined #openstack-infra19:52
jeblairfungi: indeed19:53
fungimtreinish: it's a kernel hostage crisis19:53
*** samuelBartel has quit IRC19:53
*** unicell has joined #openstack-infra19:53
*** olaph has joined #openstack-infra19:54
TheJuliamordred: or any other infra folks that might know, have you guys managed to use the simple-init element with centos7 successfully?19:55
*** yamahata has joined #openstack-infra19:55
fungiianw: ^ ? i think you did some work with dibified devstack centos 7 workers?19:55
*** michchap has joined #openstack-infra19:56
*** sergmelikyan has quit IRC19:56
fungijenkins02 looks like it's gotten pretty leaky too, so i'm quiescing it for cleanup19:57
clarkbTheJulia: I don't think we are using simple init with centos7 yet19:57
clarkbunsure if it has been attempted19:57
*** mrunge has joined #openstack-infra19:57
*** hasharCall has quit IRC19:57
*** michchap_ has quit IRC19:57
*** Swami has quit IRC19:57
fungiugh, jenkins03 needs help as well. i'll do that one too19:58
TheJuliaclarkb: that would kind of explain it not working unless I reset the service and start it manually. :(19:58
*** hashar has joined #openstack-infra19:59
clarkbTheJulia: centos7 is a systemd distro, prehaps related to that?20:00
*** shardy_ has joined #openstack-infra20:01
openstackgerritDirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder  https://review.openstack.org/19750120:01
openstackgerritDirk Mueller proposed openstack/diskimage-builder: opensuse: Update README  https://review.openstack.org/19771920:01
greghaynesTheJulia: We havent really tested it much at all20:02
TheJuliaclarkb: definitly related, although I'm not convinced that systemd is actually calling simple-init again.20:02
greghaynesTheJulia: Yea, I wouldnt be surprised20:02
fungiclarkb: if you want an easy review, https://review.openstack.org/197662 fixes that we somehow approved a project creation with no acl at all20:02
*** michchap_ has joined #openstack-infra20:03
*** achanda has quit IRC20:03
clarkbfungi: I just approved the icehouse removal change stack too20:03
openstackgerritMerged openstack-infra/project-config: Remove managed stable/icehouse branch testing  https://review.openstack.org/19768720:03
fungiclarkb: i saw, i'll keep an eye on jobs once that merges20:03
openstackgerritDirk Mueller proposed openstack/diskimage-builder: opensuse: Update README  https://review.openstack.org/19771920:03
openstackgerritDirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder  https://review.openstack.org/19750120:03
fungiclarkb: i've already abandoned all open icehouse backports for those projects, so as soon as it's applied i can go on a branch-deleting bender20:04
*** abregman has joined #openstack-infra20:04
*** DericHorn-HP has quit IRC20:04
*** michchap has quit IRC20:04
fungiand then send an eol announcement to the usual lists and prepare for the deluge of hatemail which inevitably follows20:04
clarkbembrace the dark side20:05
TheJuliawe have cookies!20:05
jeblairfungi: or send the mail as "OpenStack Proposal Bot"20:05
Clintha20:05
fungijeblair: hah, the poor bot gets enough hatemail as it is20:05
fungijeblair: using my old alien node detection methods, i see a lot of aliens in rax. 27 in dfw20:06
fungijeblair: the list of uuids is in nodepool:~fungi/rax-dfw.aliens20:06
fungii'm seeing what i can identify about any of them20:07
*** achanda has joined #openstack-infra20:07
*** shashank_hegde has joined #openstack-infra20:07
fungijeblair: it looks like nodepoold knows at least some of these are aliens and is itself logging its attempts to delete them20:07
*** DericHorn-HP has joined #openstack-infra20:08
*** achanda has quit IRC20:09
fungijeblair: ahh, yep, deleted status in nova20:09
fungijeblair: when you said there were a bunch in ord, did you perchance mean dfw?20:09
fungisome are also in error status according to nova20:10
*** dimtruck is now known as zz_dimtruck20:10
*** jsavak has quit IRC20:12
openstackgerritMerged openstack-infra/project-config: Move python 3.4 jobs out of python 2.6 list  https://review.openstack.org/19769520:12
*** zz_dimtruck is now known as dimtruck20:12
ClintSpamapS: is it expected that UCA has a lot of broken checksums?20:12
openstackgerritMerged openstack-infra/project-config: Reuse ironic ACLs for ironic-webclient  https://review.openstack.org/19766220:12
fungijeblair: out of the 27 in that list, nova says 2 are active, 12 are deleted and 13 are error20:13
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772220:13
mriedemis it just me or is launchpad not putting links in bug reports when a review is posted for the bug?20:13
mriedemit's changing status to in progress though20:13
*** olaph has quit IRC20:13
krotscheckI have QA-core approval on a project addition, can infra cores take a look? https://review.openstack.org/#/c/194938/20:13
jeblairfungi: i thought i was checking ord20:14
*** yamamoto has joined #openstack-infra20:14
fungimriedem: on a change where the bug was mentioned in the commit message of the initial patchset, or only added in a later patchset? if it really was in the initial patchset, maybe the ~hudson-openstack account lost bug supervisor membership over the project in question and can no longer reassign?20:15
fungijeblair: yeah, i simply checked them all, and dfw turned out to be pretty massively crufty20:15
mriedemfungi: initial ps120:15
*** _nadya_ has joined #openstack-infra20:15
*** jsavak has joined #openstack-infra20:15
mriedemfungi: i bet thta's the case, i got an email about nova bug team membership last week20:16
jeblairfungi: probably a good idea to check on those 2 and see if they change state20:16
openstackgerritMerged openstack-infra/project-config: Add periodic Kilo jobs  https://review.openstack.org/19670920:16
*** olaph has joined #openstack-infra20:16
jeblairfungi: but at least, that suggests that as far as nodepool leaks go, we're at somewhere between 0-2, which is a definite improvement.20:16
mriedemfungi: and i don't see hudson here https://launchpad.net/~nova-bugs/+members#active20:17
jeblairfungi: i think perhaps we were never quite sure whether a nova 'deleted' instance counted against quota, and maybe nodepool assumes that it does not.  maybe we need to reverse that assumption.20:17
*** _nadya_ has quit IRC20:17
clarkbnot to be *that* person but does 194938 need to enforce CLA since its openstack/ ?20:17
fungijeblair: ooh, yeah 27 in a deleted state in ord. ugly20:17
clarkbkrotscheck: ^20:18
*** e0ne has joined #openstack-infra20:18
*** mrmartin has quit IRC20:18
krotscheckclarkb: Does hacking?20:18
fungimriedem: it's the "OpenStack Infra" user on page 2, so that's not the issue20:19
krotscheckclarkb: ¯\_(ツ)_/¯20:19
clarkbkrotscheck: yes hacking does20:19
mriedemfungi: oh, ok, nvm then20:19
clarkboh wait no20:19
clarkbhrm I dunno then20:19
*** yamamoto has quit IRC20:20
krotscheckclarkb: Well, teh openstack/* thing came because apparently there's open tent things and efforst to move hacking under openstack.20:20
krotscheckI do _not_understand the depths of what's going on there.20:20
fungimriedem: another possibility is that launchpad changed its bug api and now we're failing to reassign... or that we've introduced some bug into the hook script that does that20:21
krotscheckOr, for taht matter, what the CLA means.20:21
asselinnibalizer, jeblair cmmon-zuul patches have been updated per our disucssion. We should merge them when things calm down:  https://review.openstack.org/#/c/176010/  https://review.openstack.org/#/c/175970/20:21
fungimriedem: do you have a recent example (for a change started in the past couple weeks maybe)?20:21
krotscheckclarkb: But fwiw, given that the rules are openstack specific, I don't have a problem with CLA or Not CLA.20:21
mriedemfungi: https://review.openstack.org/#/c/197721/20:21
krotscheckI just don't know how to express it in gerrit.20:22
*** ajmiller_ is now known as ajmiller20:22
clarkbkrotscheck: https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/aodh.config#n1220:22
*** cburgess_ has quit IRC20:23
krotscheckclarkb: Ah, ok, that makes sense.20:23
krotscheckIs that a thing we want?20:23
*** cburgess has joined #openstack-infra20:23
krotscheckOr rather: I, as the person working on it, don't really care. Other people will care more than me. Can we identify those other peoples who care and ask them whether they actually care?20:23
clarkbthe trouble is the people that actually care are legal counsels for $company and they don't seem to directly interact with us20:25
clarkbfwiw I +2'd if someone think it needs to go in they can -120:25
clarkbfungi: CNN really wants me to know that you should avoid your shark infested waters20:25
*** olaph has quit IRC20:28
*** mayurig has joined #openstack-infra20:28
openstackgerritJeremy Stanley proposed openstack-infra/jeepyb: Default to no series in update_bug.py  https://review.openstack.org/19772520:28
fungimriedem: recently introduced bug ^ in jeepyb wins this round!20:28
*** marcusvrn1 has quit IRC20:28
*** packet has quit IRC20:28
fungiclarkb: yes, sharks like to nibble on the tourists. especially the ones not smart enough to avoid swimming next to the piers where people are fishing and getting said sharks all excited20:29
*** olaph has joined #openstack-infra20:29
*** jgrimm is now known as zz_jgrimm20:29
*** esp has left #openstack-infra20:29
fungiwe've had a few choppered out of here and up over state lines to the hospital in the past couple weeks20:30
krotscheckfungi: At least you getting tornadoes is unlikey20:30
mriedemfungi: sweet, thanks20:30
fungikrotscheck: instead we get waterspouts which can be nearly as bad20:30
fungikrotscheck: they're still tornadoes, they just call them something else because they form over the water20:30
krotscheckfungi: Eeeehhh.... sharkwaterspout doesn't have the same ring. Can we just call them sharknado's and be done with it?20:31
fungikrotscheck: sold!20:31
krotscheckfungi: next openstack project you incubate has to be called sharknado20:32
*** mayurig has quit IRC20:33
clarkbwill that pass legal review >_> probably depends on whether or not you use apache storm20:33
* krotscheck perks up.20:34
krotscheckDid you say storm?20:34
krotscheck:D20:34
krotscheckOk, I've got one +2 on https://review.openstack.org/#/c/194938/ , looking for one more! Going once, going twice....20:35
krotscheckYou, too, can help me continue to procastinate from writing documentation!20:35
openstackgerritAaron Rosen proposed openstack-infra/project-config: Make check-tempest-dsvm-networking-ovn voting  https://review.openstack.org/19772820:35
*** earlephilhower has quit IRC20:35
*** earlephilhower has joined #openstack-infra20:36
crinklejeblair: nibalizer: when you have a moment could you take a look at https://review.openstack.org/#/c/197377/ and https://review.openstack.org/#/c/190839/ to confirm whether it's in line with what we talked about?20:36
*** alivigni has quit IRC20:36
*** openstackgerrit has quit IRC20:37
*** jasondotstar has joined #openstack-infra20:37
*** openstackgerrit has joined #openstack-infra20:37
*** jasondotstar has quit IRC20:37
*** puranamr has quit IRC20:38
*** olaph has quit IRC20:38
nibalizerasselin: crinkle pushing it on the stack20:39
jeblaircrinkle: hrm, why is r10k needed?  (i read the part that it's recommended, but i'm wondering why, as it seems like the sort of network traffic that we would want to avoid)20:39
crinklejeblair: it is not more network traffic than writing a shell script to clone each repo20:40
jeblaircrinkle: zuul-cloner will use the local cache20:40
jeblairso we're sort of defeating its optimizations20:41
*** spzala has quit IRC20:41
crinklejeblair: good point, i can rework it to avoid the duplication20:43
crinklenibalizer: i don't understand20:43
jeblaircrinkle: would simply this approach work? "if zuul-cloner exists: zuul-cloner; else: r10k!20:43
jeblairer that was supposed to be a ", but ! is nice too i guess20:44
nibalizercrinkle: my to do task20:44
crinklejeblair: that doesn't account for the modules that can't be zuul-cloned20:44
*** Sukhdev has quit IRC20:44
*** unicell1 has joined #openstack-infra20:45
*** ayoung has quit IRC20:45
openstackgerritAdam Harwell proposed openstack-infra/project-config: Octavia: enable a voting py34 gate on master  https://review.openstack.org/19773220:45
*** unicell has quit IRC20:45
*** DericHorn-HP has quit IRC20:45
*** Sukhdev has joined #openstack-infra20:45
jeblaircrinkle: got it; maybe split the list and apply that to the ones that can, and just r10k the rest20:45
crinklejeblair: that's what i'm thinking20:45
jeblaircrinkle: we should also, probably at a later time, look into caching those dependencies on build images and then making use of that for the same reason.  but we should let the dust settle on the nodepool dib work first.20:45
crinklejeblair: sounds good20:46
*** puranamr has joined #openstack-infra20:46
jeblair(very far aside: perhaps as part of the zuul+github work, zuul-cloner might grow the ability to clone/update an external git repo from a local cache)20:47
*** ihrachyshka has joined #openstack-infra20:47
mordredlifeless: if you're around, notmyname has a question about pbr, hacking and swift (he just ran in to an instance of the general class of problems you've been fixing)20:48
mordredlifeless: notmyname | mordred: so is it worth proposing a fix to global requirements to update teh min version of pbr (or hacking)?20:48
lifelesshi20:49
notmynamehi20:49
mordredlifeless: notmyname | mordred: or will that get fixed later?20:49
mordredoh look. you're both here20:49
lifelessso its awkward20:49
*** mriedem has quit IRC20:49
lifeless0.11 is the only overlap between master and stable/kilo20:49
notmyname0.11 on what?20:49
lifelesspbr20:49
lifelesskilo is <1.020:49
lifelessmaster is >=0.1120:49
lifelessif we move master to say >=1.2 (for instance) then there's no overlap and we've had bad experiences in the past there.20:50
notmynamehacking 0.10.0 and 0.10.1 (which are both allowed), caps pbr at <1.020:50
lifelessyes, as do many other kilo branches of things20:50
*** cindyo has joined #openstack-infra20:50
lifelessnotmyname: ah, in g-r master?20:51
notmynameyes20:51
lifelessnotmyname: yes, we should raise the hacking minimums I think20:51
lifelessnotmyname: raising pbr's minimum is tricky because of its use as a setup_requires20:51
lifelessnotmyname: literally none of the problems we've had would have been avoided by a higher pbr minimum in g-r20:51
notmynamehmm20:52
*** fallenpegasus has joined #openstack-infra20:52
lifelessnotmyname: because the pbr references in requirements.txt are evaluated *after* the downgraded pbr has tried and failed.20:52
notmynameright. that's the problem we got20:52
lifelessnotmyname: its a great big honking defect in the otherwise great declarative stuff pip does20:52
lifelessnotmyname: and I have a proof of concept to fix it20:52
lifelessnotmyname: but its queued up behind the constraints work20:52
openstackgerritCody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler  https://review.openstack.org/19517220:52
notmynamewe've had a stack of patches blocked by the gate for about a week or so because our requirements has an older hacking version. we have just now figured it out that updating the hacking version will unblock things20:54
openstackgerritCody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler  https://review.openstack.org/19517220:54
lifelessnotmyname: oh! I wish someone had chatted with me, I would have helped diagnose.20:55
notmynamebut it's mildly irritating to have to update a dependency when your use of it hasn't changed but suddenly it breaks because external packages that you don't use are updated20:55
lifelessnotmyname: I did send mails to the list about it20:55
lifelessnotmyname: I agree20:55
lifelessnotmyname: the problem is again that we can't version dep setup_requires [yet]20:55
notmynameyeah, I saw something about the ;python== stuff, whcih is where we were breaking20:56
lifelessnotmyname: once we can, each package can declare the right build dep for it, and pip will take care of doing the build in an isolated env20:56
notmynamebut since global requirements is what's used instead of the local requirements in the project, we didn't realize how we were affected by it20:57
notmynameie we have a dependency on something that global requriements added the ;python== stuff to, and that's what broke20:57
fungisome of this pain also comes back to the need for a sane and stateful dep solver in pip. right now to guarantee co-installability of things we're stuck declaring identical versions of requirements across all of them. it's not that we _want_ that situation20:57
notmynameI've got to go run the swift team meeting now20:57
notmynamemordred: thanks for the info20:58
*** mayurig has joined #openstack-infra20:58
notmynamelifeless: thanks for fixing this, long term :-)20:58
notmynameI'm looking forward to it20:58
* mordred hands lifeless a fluffy bunny20:58
*** matt____ is now known as mattoliverau20:58
fungii'm especially looking forward to upcoming pip release including lifeless's solver20:58
fungithat opens us up to a lot more flexibility around divergent versions of requirements20:59
*** GheRivero has quit IRC20:59
clarkbfungi: we will still need to use the constraints file for testing though20:59
clarkband constraints can't be circumvented by setup_requires so have to be careful until those allow a version spec21:00
fungiclarkb: yep, but projects will be a lot more free to declare differing ranges of support for things21:00
*** marcusvrn has joined #openstack-infra21:00
*** jasondotstar has joined #openstack-infra21:01
jeblairfungi: can i add a rdns entry for ask-staging?21:01
*** shardy_ has quit IRC21:01
clarkbfungi: right as long as its resolvable for constraints and doesn't prevent us from depending on bugfixes or security fixes that we need21:01
fungijeblair: oh, i'll do it now. i didn't realize it was still spamming21:01
jeblairlooks like Subject: Cron <root@ask-staging> /bin/bash /srv/askbot-site/cron/clean_session.sh21:02
jeblairspams regularly21:02
fungijeblair: yep, "There are 2944 expired sessions ..."21:02
*** mrunge has quit IRC21:03
*** ajmiller_ has joined #openstack-infra21:03
*** GheRivero has joined #openstack-infra21:04
fungijeblair: ptr records added now21:04
*** puranamr has quit IRC21:04
*** otherwiseguy has quit IRC21:04
*** dizquierdo has joined #openstack-infra21:05
*** thorst has quit IRC21:05
*** spzala has joined #openstack-infra21:05
*** maishsk has joined #openstack-infra21:06
krotscheckHypothetically speaking, if I were to be able to generate a .lcov report for code coverage somehow, is there a place where that might be uploadable so that it integrates into our gate somehow?21:06
*** ajmiller has quit IRC21:06
clarkbkrotscheck: the way we do coverage with python projects is to have the job render an html report then we host that with the job logs21:07
clarkbkrotscheck: nodepool runs it in check if you want an example21:07
*** maishsk has quit IRC21:07
*** sdake_ has joined #openstack-infra21:07
*** otter768 has joined #openstack-infra21:08
*** e0ne has quit IRC21:08
krotscheckclarkb: So sortof like the js draft job, except you get the coverage report.21:08
krotscheckExcellent.21:08
clarkbkrotscheck: yup21:08
*** sdake has quit IRC21:09
krotscheckclarkb: It turns out the javascript coverage tool is crazy simple. It spaws a process that wraps the test runner, intercepts all filesystem commands issued by the same, and only instruments those files that the test runner asks for.21:09
fungilifeless: the last of the bare-trusty images from earlier are caught up now, so rechecks should get the latest version of that script now21:10
*** mpavlase has joined #openstack-infra21:11
*** aysyd has quit IRC21:11
*** otter768 has quit IRC21:12
*** teran has joined #openstack-infra21:13
*** Swami has joined #openstack-infra21:13
lifelessdims: ^21:13
fungiokay, jenkins02 and 03 have been cleaned up and started again21:13
lifelessfungi: thanks21:13
clarkbfungi: was it looking like the thread leak again?21:13
fungiclarkb: yep21:13
fungiclarkb: i had to do 05 and 06 earlier in the week too21:14
clarkbI don't think my jenkins bug has gotten anymore traction once I provided the concrete thread dump ingo21:14
clarkbwhich is sad because why ask me if its just going to be ignored :/21:14
*** ldnunes has quit IRC21:15
fungiclarkb: probably because there are 100 people who know how to tell when there's not enough detail in the bug, and 2 who actually stand a chance of interpreting the additional detail once it's added21:15
fungi"please attach a thread dump" is the bug triage equivalent of submitting changes to correct typos in code comments21:16
*** tvanderwiel has quit IRC21:18
*** austin81 has left #openstack-infra21:21
*** marcusvrn has quit IRC21:23
*** heyongli has quit IRC21:23
*** heyongli has joined #openstack-infra21:24
*** kgiusti has quit IRC21:29
*** heyongli has quit IRC21:29
*** jasondotstar has quit IRC21:30
*** heyongli has joined #openstack-infra21:31
*** ivar-lazzaro has joined #openstack-infra21:33
fungii'm going to pop out for food and some evening errands. bbiaw21:35
*** radez` is now known as radez_g0n321:35
*** doude has quit IRC21:38
*** doude has joined #openstack-infra21:38
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772221:38
*** dprince has quit IRC21:39
*** puranamr has joined #openstack-infra21:41
*** maishsk has joined #openstack-infra21:42
Sukhdevfungi: If I may bug you for a quick question21:42
*** doude has quit IRC21:42
Sukhdevfungi: see this - https://review.openstack.org/#/c/195247/21:42
*** doude has joined #openstack-infra21:43
Sukhdevfungi: it is in merge conflict - wondering if there is a painless way to resolve the merge conflict - short of pushing new patch and loosing all the votes?21:43
greghaynesSukhdev: Generally people should be able to recognize that it was just a merge conflict resolution and assume the votes are still there21:44
Sukhdevpops sorry did not see fungi is gone out :-)21:44
*** spzala has quit IRC21:44
greghaynesmost projects have some convention around that21:45
*** smarcet has quit IRC21:45
greghaynesbut yea, its a process fix not a technical one21:45
*** pc_m has quit IRC21:45
Sukhdevgreghaynes: so have to pull, merge, and push a new one, right? no other painless way around?21:46
greghaynesYep21:46
greghaynespull, rebase, push21:46
*** romcheg1 has quit IRC21:46
Sukhdevgreghaynes: right - thanks21:47
*** doude has quit IRC21:47
*** mmedvede has quit IRC21:48
*** doude has joined #openstack-infra21:48
*** ayoung has joined #openstack-infra21:51
*** bknudson has quit IRC21:51
*** amitgandhinz has quit IRC21:52
*** _diana_ has joined #openstack-infra21:53
*** _diana_ has quit IRC21:54
*** _diana_ has joined #openstack-infra21:54
*** dannywilson has quit IRC21:55
*** puranamr has quit IRC21:55
*** dannywilson has joined #openstack-infra21:56
openstackgerritKhai Do proposed stackforge/python-jenkins: fix passing of byte object to url request method  https://review.openstack.org/19775221:58
*** shashank_hegde has quit IRC22:01
*** annegentle has joined #openstack-infra22:02
*** nihilifer_ has joined #openstack-infra22:04
*** nihilifer has quit IRC22:04
*** nihilifer_ is now known as nihilifer22:04
*** dizquierdo has quit IRC22:05
*** hashar has quit IRC22:05
*** ZZelle_ has quit IRC22:08
openstackgerritTomoki Sekiyama proposed openstack-infra/project-config: Check requirements changes for each of python2 and python3  https://review.openstack.org/19775322:10
*** chlong has joined #openstack-infra22:10
*** thingee has quit IRC22:11
*** thingee has joined #openstack-infra22:11
*** thingee has quit IRC22:11
*** thingee has joined #openstack-infra22:11
*** pradk has quit IRC22:14
*** mayurig has quit IRC22:15
*** mmedvede has joined #openstack-infra22:16
*** weshay has quit IRC22:16
*** mayurig has joined #openstack-infra22:16
*** sdake_ is now known as sdake22:17
*** doude has quit IRC22:17
*** dims_ has joined #openstack-infra22:17
*** signed8bit has quit IRC22:19
openstackgerritMerged openstack/requirements: Add openstack/designate-dashboard to projects  https://review.openstack.org/19753022:19
*** dizquierdo has joined #openstack-infra22:19
*** tsekiyama has joined #openstack-infra22:20
*** tsbot_ has joined #openstack-infra22:20
*** tsbot_ has left #openstack-infra22:20
*** dims has quit IRC22:21
*** tsbot_ has joined #openstack-infra22:21
*** dima____ has joined #openstack-infra22:22
*** nadirvardar has quit IRC22:23
*** jsavak has quit IRC22:25
*** jsavak has joined #openstack-infra22:26
*** sdake is now known as sdake_22:29
*** chlong has quit IRC22:30
*** cindyo has quit IRC22:30
*** chlong has joined #openstack-infra22:30
tonybBobBall: Umm I'm not sure when the publisher runs.22:30
openstackgerritgreghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests  https://review.openstack.org/19492822:32
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Enable CORS for app-catalog  https://review.openstack.org/19487522:32
*** puranamr has joined #openstack-infra22:34
*** _diana_ has quit IRC22:34
*** cindyo has joined #openstack-infra22:36
*** ddieterly has joined #openstack-infra22:38
*** whoops has quit IRC22:38
*** olaph has joined #openstack-infra22:38
openstackgerritgreghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests  https://review.openstack.org/19492822:39
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman  https://review.openstack.org/19517522:41
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772222:41
tsekiyamaRequirements.txt update by OpenStack Proposal Bot (and also by humans) is failing in the CI for some projects (e.g. Nova, Glance) now. I hope https://review.openstack.org/#/c/197753/ will fix the issue. Could some one review this please?22:42
*** dizquierdo has quit IRC22:43
*** ddieterly has quit IRC22:44
*** ddieterl_ has joined #openstack-infra22:44
*** rlandy has quit IRC22:44
*** Sukhdev has quit IRC22:45
*** Sukhdev has joined #openstack-infra22:45
*** fallenpegasus has quit IRC22:45
*** nihilifer has quit IRC22:46
*** weshay has joined #openstack-infra22:47
*** jsavak has quit IRC22:48
*** shashank_hegde has joined #openstack-infra22:48
openstackgerritlifeless proposed openstack-infra/devstack-gate: Switch to using constraints files.  https://review.openstack.org/19488622:49
*** jsavak has joined #openstack-infra22:50
*** nihilifer has joined #openstack-infra22:52
*** sdake_ has quit IRC22:54
*** mpavlase has quit IRC22:55
*** nihilifer has quit IRC22:56
*** hodos has quit IRC22:57
*** jsavak has quit IRC22:58
*** olaph has quit IRC22:59
jheskethMorning22:59
*** olaph has joined #openstack-infra23:01
*** dannywilson has quit IRC23:02
*** tonytan4ever has quit IRC23:02
*** dannywilson has joined #openstack-infra23:03
*** dimtruck is now known as zz_dimtruck23:03
*** nelsnelson has quit IRC23:07
lifelesssob23:07
lifelessglance has -e git+https://github.com/openstack/glance_store.git#egg=glance_store23:07
lifelessin requirements.txt :/23:07
lifelesshmm, the py3 version23:07
*** otter768 has joined #openstack-infra23:08
mgagneis there some literature available about nodepool subnode support I can read and how I can use it?23:09
*** jasondotstar has joined #openstack-infra23:09
*** annegentle has quit IRC23:10
lifelessI think tere are docs in the infra docs area about nodepool stuff23:10
greghaynesmgagne: theres some info on http://docs.openstack.org/infra/nodepool/scripts.html in reguards to what info is there for each node23:10
clarkbmgagne: http://docs.openstack.org/infra/nodepool/configuration.html tells you how to configure it and http://docs.openstack.org/infra/nodepool/scripts.html#ready-script describes the info left on the nodes23:10
greghayneshehe, yea, that23:10
mgagneI think I missed the scripts part23:10
mgagnewill read23:10
mgagneif I understand correctly, ready-script will be run on the primary node which can in turn prepare the su nodes?23:11
clarkbmgagne: a23:11
clarkb*ya23:11
mgagneand /etc/nodepool/id_rsa is the key to use to connect to those sub nodes right?23:12
*** sabeen2 has quit IRC23:13
*** DericHorn-HP has joined #openstack-infra23:13
*** otter768 has quit IRC23:13
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Call sudo pip /w -H diskimage-builder-install macro  https://review.openstack.org/19776723:16
*** hichihara has joined #openstack-infra23:17
SukhdevHello Infra folks, this needs your blessing/review - https://review.openstack.org/#/c/195341/23:17
pleia2Sukhdev: moves require scheduled downtime for gerrit, can you add this to this section of the wiki? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames23:18
*** ihrachyshka has quit IRC23:19
*** Nakato_ is now known as Nakato23:19
*** EricGonczer_ has quit IRC23:19
greghaynesadam_g: the sudo -H pip - does that fail because of the cached wheels?23:19
greghayneser, does that fail without -H because that23:20
adam_ggreghaynes, http://logs.openstack.org/73/736a7c9bfcb83367c722ca21ef55d0aa6093dd12/post/akanda-appliance-buildimage/884ae24/console.html23:20
clarkbya what happens is the dir gets owned by root in your homedir and you can't write new wheels to it23:20
clarkbso you -H so that they go in roots homedir separate from your users cache23:20
greghaynesyea, makes sense23:20
*** abregman has quit IRC23:22
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Enable CORS for app-catalog  https://review.openstack.org/19487523:23
Sukhdevpleia2: Thanks - I just added it to the wiki. This will need some +1/+2, right?23:24
pleia2Sukhdev: yes, people will look at it but we don't approve until a rename window comes up23:25
pleia2that's when we'll go through all of them a couple days before and make sure they're ready23:25
Sukhdevpleia2: got it - thanks23:25
*** yamamoto has joined #openstack-infra23:27
*** otter768 has joined #openstack-infra23:30
*** fbo- has quit IRC23:31
*** enikanorov2 has quit IRC23:33
*** annegentle has joined #openstack-infra23:34
*** wenlock_ has quit IRC23:38
*** wenlock has quit IRC23:38
*** yamamoto has quit IRC23:39
*** puranamr has quit IRC23:39
*** puranamr has joined #openstack-infra23:40
*** mayurig has quit IRC23:40
*** gyee has quit IRC23:40
*** baoli has quit IRC23:41
mordredmorning greghaynes23:41
greghaynesmorning? are you in SEA or something?23:41
mordredgreghaynes: nah - just bad at time :)23:41
mordredgreghaynes: jeblair and I looked further at the swift thing earlier today and were till not able to reproduce it23:42
greghaynesmordred: yea - did you try doing an upload via nodepool command?23:42
mordredyah23:42
greghaynesdid it work?23:42
mordredyah23:42
mordredI mean23:42
mordredthere was a cloud failure23:42
mordredbut the api calls all worked23:42
greghaynesso that supports the theory that nodepool is just running with an old python dep that has since been upgraded in the venv23:43
greghaynesand we just havent restarted nodepool23:43
*** mayurig has joined #openstack-infra23:43
mordredgreghaynes: that's the best theory I've got23:43
greghaynessweet, well we should restart it and hopefully forget about this23:43
mordredgreghaynes: also - I saw a mentino of NOC things - did you do things with the noc people? (or the crabpeople?)23:44
greghaynesmordred: Yea, they are doing another inventory of our hardware, just getting them somewhat sanely formatted data (for their definition of sane which seems to be able to put into a spreadsheet)23:44
greghayneshavent heard back from them since I sent that off a couple days ago23:45
mordredgreghaynes: cool! it'll be neat to have that bit done23:45
*** sabeen has joined #openstack-infra23:46
greghaynesalso as a PSA - im going to be traveling a bit next week but in theory I should be around, then the following two weeks I have vacation23:46
*** cindyo has quit IRC23:48
Clinthiding from oscon23:48
greghaynesyep!23:49
greghaynesactually, I am going to europython which seems to be at the same time23:49
greghaynesjust to be different23:49
mordredyay!23:49
*** cebruns has quit IRC23:49
clarkbI bet oscon has better beer but worse spanish23:50
*** DericHorn-HP has quit IRC23:50
Clintalso IETF9323:51
*** cebruns has joined #openstack-infra23:51
*** DericHorn-HP has joined #openstack-infra23:52
*** jasondotstar has quit IRC23:52
*** DericHorn-HP has quit IRC23:53
*** mayurig has quit IRC23:53
*** trey has quit IRC23:53
mordredfwiw, I'll also be on vacation OSCON week23:54
greghayneswill you be on vacation at OSCON?23:55
mordredfollowed by 3 weeks of conference/travel followed by a week of vacation - but I'm here and working the next two weeks23:55
mordredgreghaynes: nope!23:55
mordredgreghaynes: I will be on vacation in panama23:55
greghaynesoh, nice23:55
greghayneshah23:55
greghayneswow23:55
mordredwhere they will have probably much better spanish23:55
mordredalthough I'm not sure why the quality of the spanish is important :)23:55
greghaynesYes, just a different kind23:56
greghaynesI think clarkb meant because europython is in Bilbao23:56
clarkbmordred it speaks to the cultural experience23:56
clarkbeg its not MURICA23:56
mordredah23:56
mordredwll yes then23:56
mordredI will vacation in panama23:56
mordredthen I will conference for a while23:56
mordredthen I will vacation in bali23:57
clarkbI hope you have excellent MURICA plans for freedom day23:57
mordred\o/23:57
mordredclarkb: I'm going to freedom all the MURICAs23:57
mordredclarkb: which will mostly involve drinking on my roof23:57
*** puranamr_ has joined #openstack-infra23:57
mordredclarkb: are the twins excited about explosions yet?23:57
clarkbmordred I doubt it, though watchingbthem startle can be funny23:58
mordredclarkb: I'm guessing they are excited by few things that are !(sleep|food)23:58
clarkbthere is a decebt chance we will have a firework ban though, will be interesting to see how that is enforced23:59
mordredgood luck with that23:59
greghaynesI think it is full on burn ban ATM23:59
Clintno more firepits23:59
greghaynesyea, seriously, in portland on the 4th it gets a bit crazy23:59
*** laughterwym has joined #openstack-infra23:59
fungimordred: greghaynes: for the "not restarted in a while" datapoint, nodepoold was last restarted on june 19, ~12 days ago23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!