Tuesday, 2015-11-10

pabelangerYa, and right now I am seeing it takes almost 10mins to rehash the data00:00
*** Sukhdev has joined #openstack-infra00:00
*** markvoelker_ has quit IRC00:01
*** Sukhdev has quit IRC00:02
pabelangerwe could up that to every 6 hours honest00:03
pabelangeror even 1200:03
greghaynesheh00:03
greghaynesI wonder if we could turn it off00:03
greghaynesand then do that OOB00:03
*** shashank_hegde has quit IRC00:04
pabelangerwe only process new data ever 8 hours right now00:04
jeblairthis is, apparently, just stackalytics loading it into memory?  that makes me wonder what memcached is for...00:04
jeblair(it seems like the obvious thing would be to have the processor update memcache, and have the web procs just read from that)00:05
jeblairbut i'm not speaking from knowledge :)00:05
*** tsg has quit IRC00:06
greghayneshaha, yeeeep00:06
pabelangerstackalytics-processor (scraps git, review.o.o, launchpad) and stores the data into memcached.  Then, uswgi loads data from memcached into memory every 1 hour to serve up to apache00:07
pabelangerthat's how I understand how it works00:07
greghaynes:/00:07
jeblairinteresting.  :)00:07
pabelangerand we are talking about all data.  So, commits from Austin are being loaded every hour.  Even though the default landing page is Mitaka00:08
greghaynesI wonder if we could make eager loading work so the first request doesnt have the terribly slow problem, then disable the once per hour updating and just rely on the data to be reloaded when uwsgi workers are respawned00:09
greghaynesI guess the issue then is your workers arent necessarially in sync... although that is an issue anyhow00:09
* greghaynes is suddenly very confused about how this works at all00:09
*** wenlock1 has quit IRC00:10
*** Swami has quit IRC00:11
*** Sukhdev has joined #openstack-infra00:11
clarkbI am going to run the jenkins restarter playbook now that fungi has confirmed the groovy fix seems to work00:12
clarkbwill keep an eye on it but should correct 02 and 04's leaks00:12
*** gildub has joined #openstack-infra00:13
*** xyang1 has quit IRC00:15
*** achanda has joined #openstack-infra00:16
openstackgerritRohit Jaiswal proposed openstack/requirements: Bump Tooz version to 0.13.3  https://review.openstack.org/24336000:17
*** tiswanso has quit IRC00:18
*** hashar_ has quit IRC00:19
pabelangerFamily time, will continue this tomorrow00:20
pabelangerthanks all00:20
*** harlowja has joined #openstack-infra00:20
*** craigbr has quit IRC00:24
bardiain my private Devstack VMs come up with a floating public IP auto assigned. Nodepool however fails to retrieve that ip when testing connection to the instance and raises SSH connection exception. I was wondering if anyone has encountered this issue before00:25
clarkbbardia: have you tried manually ssh'ing to those VMs00:25
bardiayes and it works00:25
clarkbcould be security groups or ssh keys or networking trouble00:25
clarkbbardia: using the same key as nodepool?00:25
bardiayes00:25
*** achanda has quit IRC00:25
clarkbbardia: does nodepool say it is sshing to a specific IP?00:26
bardiaI check the nodepool logs and its trying to check ssh connection to the private IP of the instance00:26
clarkbis that IP correct?00:26
bardiayes to the private ip00:26
bardiathat's the problem00:26
clarkbbardia: is nodepool attaching a floating IP?00:26
*** tiswanso has joined #openstack-infra00:26
*** smarcet has quit IRC00:26
clarkb(we know nodepool works against devstack with floating IPs because we test it)00:26
bardianodepool isn't. devstack is auto assigning on spawn00:26
clarkboh that we don't test00:27
clarkbI would try not auto assigning and let nodepool assign them00:27
clarkbI didn't realize auto assigning floating IPs was a thing00:27
bardiahow do i configure nodepool to assign floating ip00:27
clarkbit should just do it if it notices there is only a private ip00:27
clarkbyou can check the devstack config and nodepool config on any of the dsvm nodepool jobs00:27
clarkblet me find a link00:27
*** mtanino has quit IRC00:28
clarkbhttp://logs.openstack.org/53/229653/6/check/gate-dsvm-nodepool/76863c8/logs/localrc.txt.gz devstack localrc and http://logs.openstack.org/53/229653/6/check/gate-dsvm-nodepool/76863c8/logs/etc/nodepool/nodepool.yaml.txt.gz nodepool config00:29
clarkblooks like it just works00:29
clarkbwe don't set a network name or anything00:29
bardiais this the local.conf for devstack?00:30
*** Sukhdev has quit IRC00:30
clarkbit is the localrc00:30
clarkbwe don't use local.conf (though at this point we could/should change)00:30
*** dgonzalez has quit IRC00:30
*** Sukhdev has joined #openstack-infra00:30
bardiabut its the localrc for devstack right?00:30
clarkbyes00:30
*** achanda has joined #openstack-infra00:30
bardiaah ok that makes sence00:30
bardiasense00:30
*** dgonzalez has joined #openstack-infra00:30
bardiamy devstack conf is no enabling nodepool00:31
bardiathanks a bunch00:31
sputnik13hi, getting a failure in some ansible job in our gates...  http://logs.openstack.org/95/242695/1/check/gate-cue-integration-dsvm-rabbitmq/a63fd35/console.html#_2015-11-08_20_40_36_14600:31
clarkbyou don't need to enable it if you configure it yourself00:31
clarkbthat is mostly just for testing00:31
*** dgonzalez has quit IRC00:31
clarkbI probably wouldn't want to run a service that way00:31
clarkbsputnik13: its likely not ansible failing00:31
sputnik13clarkb the error is "No hosts matched"00:31
clarkbsputnik13: ya thats a noop pulling logs of non existant subnodes00:31
*** dgonzalez has joined #openstack-infra00:32
* greghaynes does some more nodepool patches poking00:32
clarkbsputnik13: thats not an issue00:32
openstackgerritMerged openstack/diskimage-builder: dib-lint: ignore blank lines in element ordering  https://review.openstack.org/23129200:32
clarkbsputnik13: http://logs.openstack.org/95/242695/1/check/gate-cue-integration-dsvm-rabbitmq/a63fd35/console.html#_2015-11-08_20_40_29_002 is the issue00:32
greghayneshttps://review.openstack.org/#/c/233852/3 just needs a W+1 - lost it due to rebase but already has 2x +200:32
greghaynesand the parent should be a pretty no-brainer +2 +A :)00:32
*** dgonzalez has quit IRC00:32
clarkbsputnik13: specifically http://logs.openstack.org/95/242695/1/check/gate-cue-integration-dsvm-rabbitmq/a63fd35/logs/devstacklog.txt.gz#_2015-11-08_20_40_28_80700:32
*** bexelbie has quit IRC00:32
clarkbgreghaynes: there is no parent00:33
greghayneser, child00:33
*** dolpher has joined #openstack-infra00:33
*** dims_ has quit IRC00:33
sputnik13clarkb ack, thx00:33
*** jamielennox is now known as jamielennox|away00:33
jeblairpabelanger: i straced a pegged uwsgi process and it is simply reading lots of data from memcached00:34
*** dgonzalez has joined #openstack-infra00:34
jeblairpabelanger: i think that supports your theory00:34
greghayneswheeee00:34
sputnik13but we never changed this I wonder why it's failing now00:34
clarkbsputnik13: liekly a change in devstack to enable zookeeper by default or something like that00:34
clarkbsputnik13: so now when its double started it fails00:34
*** angdraug has quit IRC00:34
*** dims has joined #openstack-infra00:36
clarkbgreghaynes: why does the child grow and if t: check in wait for threads?00:36
clarkbgreghaynes: checking against thread that has already exited?00:36
sputnik13clarkb yeah that's exactly it, zookeeper got added to support DLM...  I was at the DLM talk at the summit, should have seen this coming >_<00:37
greghaynesclarkb: there is a reason, lemme page it in00:38
*** sabeen1 has quit IRC00:40
greghaynesclarkb: it is because of image_update00:40
*** annegentle has quit IRC00:41
greghaynesclarkb: now, where I started hitting that... I cant actually remember00:41
clarkbbut it is guarding against dead threads?00:41
greghaynesclarkb: I think its guarding against a branch which returns None00:41
greghaynesthat if threads probably should have been one patch up00:42
clarkbok00:42
clarkbif you hurry you can fix that or I can just merge because YOLO00:42
greghayneswell, the parent seems to have failed to merge00:43
greghaynesso no need to merge00:43
clarkboh ok00:43
greghaynesugh, and its a race00:44
*** tiswanso has quit IRC00:44
greghaynescue lots of debugging time00:44
*** sputnik13 has quit IRC00:45
openstackgerritMerged openstack-infra/irc-meetings: Add documentation install team meeting  https://review.openstack.org/24300600:45
*** weshay has quit IRC00:50
openstackgerritMerged openstack-infra/irc-meetings: Add a weekly HA meeting  https://review.openstack.org/24319300:51
*** dims_ has joined #openstack-infra00:51
*** dims has quit IRC00:51
*** dangers is now known as dangers_away00:53
openstackgerritMerged openstack-infra/irc-meetings: Update meeting time and day for Kuryr  https://review.openstack.org/24322800:54
*** otter768 has joined #openstack-infra00:56
*** FallenPegasus has joined #openstack-infra00:57
*** SumitNaiksatam has quit IRC00:57
*** thorst has joined #openstack-infra00:58
*** ddieterly has joined #openstack-infra00:59
*** eliqiao1 has quit IRC01:00
*** jyuso1 has joined #openstack-infra01:00
*** thorst_ has joined #openstack-infra01:00
*** thorst has quit IRC01:02
*** kmartin has quit IRC01:03
*** ybathia has quit IRC01:06
*** asselin__ has joined #openstack-infra01:06
lifelesshow do I recover my openstack id username?01:07
lifelessI did a password reset01:07
*** rossella_ has quit IRC01:07
*** w_ has joined #openstack-infra01:07
lifelessbut now it claims my email address is an invalid username01:07
lifelessand I'm like WTF01:07
*** rossella_ has joined #openstack-infra01:07
*** asselin_ has quit IRC01:08
*** olaph has quit IRC01:08
*** hemna is now known as hemnafk01:08
lifelessstill getting 'We're sorry, your username or password does not match an existing record. '01:09
lifelessclarkb: ^01:10
* lifeless picks random west coaster to ask01:10
*** Sukhdev has quit IRC01:10
clarkbI have no idea and apache logs aren't helpful01:10
clarkbyou got the password reset sent to that email address no problem?01:11
lifelessyes01:12
lifelessand I did it and it seemed to think it worked01:13
clarkbso reset in theory went through but now account isnt valid?01:13
*** kmartin has joined #openstack-infra01:13
*** shashank_hegde has joined #openstack-infra01:13
lifelesshttps://www.openstack.org/join/register says 'your email address will be your primary username'01:13
lifelessclarkb: I have no idea TBH01:13
lifelessclarkb: have I mentioned how much I resent having to manage passwords here?01:14
lifeless:/01:14
clarkbhere being?01:14
jeblairlifeless: (aside from php, i see no reason we can't extend openstackid to also be a consumer)01:15
jeblairalso time01:15
lifelessjeblair: oh, I would -love- that01:15
lifelessjeblair: I had been given to understand there was some reason openstack.org wanted to own passwords01:15
*** Ryan_Lane has left #openstack-infra01:15
lifelessjeblair: but if its just a matter of yagni's, thats a whole different matter! \o/01:15
clarkbit wants to manage the user accounts01:16
clarkbwhich include a password?01:16
clarkbanyways I can't login either01:16
clarkbso I doubt its just you01:16
lifelessclarkb: ah, ok. Thanks!01:16
clarkboh there it goes01:16
clarkbI swear I typed that password in just fine previously01:16
lifelessclarkb: so yeah, managing passwords well and securely is really hard; I don't like any sites having passwords for me other than the small number with dedicated teams focused purely on that01:17
*** unicell1 has joined #openstack-infra01:17
lifelessclarkb: which I can count on one hand; those with open implementations require even less counting (but its non-zero)01:17
clarkbaiui they kept it that way because silverstripe was already doing it, so now you auth against the same backend just using openid01:18
clarkbor something01:18
jeblairlifeless, clarkb: i know unification of identity across systems is desired; i don't think actually storing the password is necessary for that; i think it would be fine for openstackid to be a consumer as well as a provider and don't know of any reason not to support that.01:18
clarkbso its a legacy thing01:18
clarkbjeblair: ya likely just started with accounts as they were for compat01:18
*** otter768 has quit IRC01:18
openstackgerritMerged openstack-infra/irc-meetings: Change DefCore from 15:00 to 16:30 UTC  https://review.openstack.org/24169501:19
*** unicell has quit IRC01:19
*** otter768 has joined #openstack-infra01:19
openstackgerritMerged openstack-infra/irc-meetings: Adding Tap as a Service meeting details  https://review.openstack.org/24335501:19
clarkbhttps://jenkins01.openstack.org/cli/ is a 404 post restart01:20
jeblairwoot01:20
clarkbso groovy fix is working (02 is in shutdown mode now01:20
*** amitgandhinz has joined #openstack-infra01:20
clarkblifeless: it would be neat if we could move to something like firefox's persona where I hold the private keys01:20
lifelessclarkb: if openstackid becomes a consumer, you can01:21
clarkbanyways if you give me the email addr associated iwth the account I can pass it along01:22
lifelessrobertc at robert collins dot net01:22
Clintmordred: well, you could say that the governance structures are what's causing the dysfunction01:23
Clintmordred: though in this particular case i probably wouldn't say that01:23
*** markvoelker has joined #openstack-infra01:23
clarkblifeless: passed along though I think the timezones invovled are such that we may not get a quick response01:24
*** thorst_ has quit IRC01:24
lifelessclarkb: thanks01:25
*** shuquan has joined #openstack-infra01:26
*** pvaneck has quit IRC01:26
*** btully has joined #openstack-infra01:27
*** zhenguo has joined #openstack-infra01:28
*** markvoelker has quit IRC01:28
*** achanda has quit IRC01:29
openstackgerritNikola Dipanov proposed openstack-infra/irc-meetings: Changes to the PCI passthrough meeting  https://review.openstack.org/24338201:32
*** mestery has quit IRC01:32
*** amitgandhinz has quit IRC01:33
*** amitgandhinz has joined #openstack-infra01:33
*** xylan_kong has joined #openstack-infra01:34
*** tjcocozz has quit IRC01:34
*** ddieterly has quit IRC01:36
*** ddieterly has joined #openstack-infra01:37
*** tjcocozz has joined #openstack-infra01:38
*** ddieterly has quit IRC01:39
openstackgerritLingxian Kong proposed openstack-infra/project-config: Add mistral-specs  https://review.openstack.org/24274701:41
*** amitgandhinz has quit IRC01:41
*** ddieterly has joined #openstack-infra01:43
*** devl_ has quit IRC01:46
*** yamamoto has joined #openstack-infra01:53
*** amuller has quit IRC01:56
*** shuquan has quit IRC01:59
*** devl_ has joined #openstack-infra02:01
*** dims_ has quit IRC02:01
*** zhurong has joined #openstack-infra02:05
*** dims has joined #openstack-infra02:05
clarkbmordred: I am sad that east texas is not included in the name criteria for the N release02:07
clarkbmordred: we could've had Newton02:07
*** rguillebert has quit IRC02:08
*** phschwartz has quit IRC02:09
*** phschwartz has joined #openstack-infra02:09
*** thorst has joined #openstack-infra02:09
*** dolpher has left #openstack-infra02:11
*** salv-orlando has joined #openstack-infra02:12
jeblairi'm glad i don't have to chose between newton and null.  :)02:12
*** btully has quit IRC02:13
*** thorst has quit IRC02:13
SpamapSI'm just sad it isn't "M" ... Marfa would be a great name ;)02:13
*** bpokorny_ has joined #openstack-infra02:14
*** yamamoto has quit IRC02:14
*** yamamoto has joined #openstack-infra02:17
*** bpokorny has quit IRC02:17
*** bpokorny_ has quit IRC02:18
*** rfolco has joined #openstack-infra02:21
*** kengo_sakai has joined #openstack-infra02:21
*** yamamoto has quit IRC02:21
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add Evoque dashboard project  https://review.openstack.org/24338802:21
*** sridhar_ram has quit IRC02:23
*** smarcet has joined #openstack-infra02:23
*** FallenPegasus has quit IRC02:26
*** smarcet has quit IRC02:27
*** weshay_xchat has joined #openstack-infra02:31
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add check-requirements job for senlin-evoque  https://review.openstack.org/24339102:33
*** wenlock has joined #openstack-infra02:33
*** jamielennox|away is now known as jamielennox02:34
*** wenlock has quit IRC02:37
*** Sukhdev has joined #openstack-infra02:38
*** Sukhdev has quit IRC02:38
*** zhurong has quit IRC02:40
*** wenlock has joined #openstack-infra02:42
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add Evoque dashboard project  https://review.openstack.org/24338802:42
*** hodos has quit IRC02:46
*** wenlock has quit IRC02:46
*** baoli has quit IRC02:50
*** spzala has quit IRC02:51
*** bapalm has quit IRC02:54
*** tjcocozz has quit IRC02:56
*** rfolco has quit IRC02:56
*** tqtran-afk has quit IRC02:56
*** ddieterly has quit IRC02:58
*** wenlock has joined #openstack-infra03:00
*** bapalm has joined #openstack-infra03:02
*** tjcocozz has joined #openstack-infra03:03
*** bardia has quit IRC03:04
*** _denisra has joined #openstack-infra03:04
*** ddieterly has joined #openstack-infra03:05
*** someara2 has quit IRC03:06
*** yamamoto has joined #openstack-infra03:07
*** baoli has joined #openstack-infra03:07
*** someara2 has joined #openstack-infra03:07
*** cloudtrainme has joined #openstack-infra03:10
*** dims has quit IRC03:13
openstackgerritSpencer Krum proposed openstack-infra/ansible-puppet: Conditionally manage puppet config files  https://review.openstack.org/24339903:15
*** someara2 has quit IRC03:17
*** yuanying has quit IRC03:17
*** cloudtrainme has quit IRC03:21
*** tiswanso has joined #openstack-infra03:23
*** ctlaugh_ has joined #openstack-infra03:23
*** markvoelker has joined #openstack-infra03:24
*** ctlaugh_ has quit IRC03:25
*** sdake has quit IRC03:25
*** ctlaugh_ has joined #openstack-infra03:25
*** sdake has joined #openstack-infra03:26
*** thedodd has quit IRC03:27
*** thedodd has joined #openstack-infra03:27
*** markvoelker has quit IRC03:28
*** thedodd has quit IRC03:31
*** ctlaugh_ has quit IRC03:31
*** shuquan has joined #openstack-infra03:32
*** ctlaugh_ has joined #openstack-infra03:40
*** sdake has quit IRC03:48
*** ctlaugh_ has quit IRC03:50
*** shuquan has quit IRC03:50
*** unicell1 has quit IRC03:51
*** ctlaugh_ has joined #openstack-infra03:55
*** ctlaugh has quit IRC03:56
*** ctlaugh_ has quit IRC03:56
*** ctlaugh has joined #openstack-infra03:56
*** ctlaugh has quit IRC03:56
*** ctlaugh has joined #openstack-infra03:57
*** links has joined #openstack-infra03:59
*** salv-orlando has quit IRC03:59
*** sdake has joined #openstack-infra04:01
*** shashank_hegde has quit IRC04:04
*** mriedem_away has quit IRC04:05
*** david-lyle has joined #openstack-infra04:07
*** ddieterly has quit IRC04:08
*** yuanying has joined #openstack-infra04:14
*** rlandy has quit IRC04:16
*** binbincong has quit IRC04:20
mtreinishjhesketh: show be an easy +A: https://review.openstack.org/24335104:20
*** binbincong has joined #openstack-infra04:20
*** Ramanjaneya has joined #openstack-infra04:20
jheskethmtreinish: are there cases where they don't start with periodic-? ie, could they start with just tempest|grenade?04:24
jhesketh(also I totally suck for not having done that patch last week :-s)04:24
mtreinishjhesketh: I actually did last week, just wrong :)04:25
mtreinish(err however long ago the last day of summit was)04:25
mtreinishjhesketh: dunno, I think they all start periodic- but I wasn't sure04:25
*** fedexo has joined #openstack-infra04:25
mtreinishso I figure making a wild card didn't hurt04:26
jheskethmtreinish: right, but it'll miss things that don't have a prefix... let me go check04:27
*** sdake has quit IRC04:27
openstackgerritMerged openstack/requirements: Add requestsexceptions to global requirements  https://review.openstack.org/24132404:27
*** devkulkarni has joined #openstack-infra04:28
mtreinishjhesketh: I'm pretty sure the only jobs I cared about have a prefix04:28
mtreinishbut anyway I'm gonna call it a night, I'll pick it up in the morning04:28
jheskethmtreinish: there are a few that don't... lets merge your fix and I'll push up another fix04:28
*** sdake has joined #openstack-infra04:29
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Fix regex for periodic job collection (part2)  https://review.openstack.org/24340804:35
*** baoli has quit IRC04:35
openstackgerritMerged openstack-infra/system-config: Fix regex for periodic job subunit collection  https://review.openstack.org/24335104:36
openstackgerritMerged openstack-infra/irc-meetings: Changes to the PCI passthrough meeting  https://review.openstack.org/24338204:37
*** tiswanso has quit IRC04:38
*** Sukhdev has joined #openstack-infra04:39
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/23789404:46
*** Sukhdev has quit IRC04:48
*** amotoki has joined #openstack-infra04:50
*** weshay_xchat has quit IRC04:56
*** wenlock1 has joined #openstack-infra04:58
timrcWhat. A. Day. *crash*04:59
*** salv-orlando has joined #openstack-infra05:01
*** jamielennox is now known as jamielennox|away05:01
*** bpokorny has joined #openstack-infra05:02
*** gnuoy has quit IRC05:05
*** jamespage has quit IRC05:05
*** salv-orlando has quit IRC05:05
*** gnuoy has joined #openstack-infra05:06
*** jamespage has joined #openstack-infra05:06
*** ddieterly has joined #openstack-infra05:08
*** otter768 has quit IRC05:09
*** ddieterly has quit IRC05:13
*** yamamoto_ has joined #openstack-infra05:13
*** tlian2 has quit IRC05:13
openstackgerritMerged openstack/diskimage-builder: Clarify what fedora-minimal/install.d/99-ramdisk is doing  https://review.openstack.org/23958205:14
openstackgerritMerged openstack/diskimage-builder: Fix fedora-minimal kernel-install on older platforms  https://review.openstack.org/23958305:14
*** yamamoto has quit IRC05:15
*** fedexo has quit IRC05:17
*** btully has joined #openstack-infra05:19
*** devkulkarni has quit IRC05:22
*** kozhukalov_ has joined #openstack-infra05:24
*** markvoelker has joined #openstack-infra05:25
*** kushal has joined #openstack-infra05:25
*** unicell has joined #openstack-infra05:28
*** markvoelker has quit IRC05:29
*** bpokorny has quit IRC05:32
*** shashank_hegde has joined #openstack-infra05:35
*** shashank_hegde has quit IRC05:42
*** someara2 has joined #openstack-infra05:43
*** kozhukalov_ has quit IRC05:43
*** laughterwym has joined #openstack-infra05:45
*** someara2 has quit IRC05:46
*** armax has quit IRC05:50
*** gyee has quit IRC05:52
*** yfried has quit IRC05:54
*** achanda has joined #openstack-infra06:03
*** ig0r__ has quit IRC06:05
*** shashank_hegde has joined #openstack-infra06:05
*** hdd has joined #openstack-infra06:08
*** ddieterly has joined #openstack-infra06:10
*** ig0r__ has joined #openstack-infra06:10
*** shashank_hegde has quit IRC06:10
*** wenlock1 has quit IRC06:11
*** devl has joined #openstack-infra06:14
*** ddieterly has quit IRC06:14
*** devl_ has quit IRC06:15
*** claudiub has joined #openstack-infra06:20
*** nadya has joined #openstack-infra06:24
*** bdemers has quit IRC06:25
*** flepied has joined #openstack-infra06:28
*** bdemers has joined #openstack-infra06:28
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24342506:29
*** abregman has joined #openstack-infra06:29
*** mahatic_ has joined #openstack-infra06:29
*** mahatic has joined #openstack-infra06:29
*** mahatic_ has quit IRC06:29
*** aopincar_ has joined #openstack-infra06:33
*** unicell1 has joined #openstack-infra06:34
*** mrmartin has joined #openstack-infra06:35
*** unicell has quit IRC06:35
*** taron has quit IRC06:37
*** baoli has joined #openstack-infra06:38
*** yfried has joined #openstack-infra06:39
*** shashank_hegde has joined #openstack-infra06:39
*** ilyashakhat_mobi has joined #openstack-infra06:40
*** yfried_ has joined #openstack-infra06:42
*** baoli has quit IRC06:43
*** August1914 has quit IRC06:43
*** yfried has quit IRC06:43
*** taron has joined #openstack-infra06:44
*** ilyashakhat_mobi has quit IRC06:46
*** jswarren has quit IRC06:48
*** bardia has joined #openstack-infra06:49
*** hamzy_ has quit IRC06:49
*** taron has quit IRC06:50
*** _ody has quit IRC06:50
bardiaanyone know the login cred for the DPC image that nodepool builds?06:51
*** taron has joined #openstack-infra06:51
*** jswarren has joined #openstack-infra06:52
*** hamzy_ has joined #openstack-infra06:52
*** shashank_hegde has quit IRC06:57
*** mgrosz has joined #openstack-infra06:57
mgroszHello, can someone tell me how do I configure gerrit to have two reviewers giving +2 for a change?06:58
pleia2mgrosz: I don't know if you can make that requirement with gerrit, for us it's a social construct, not a technical one07:03
*** unicell has joined #openstack-infra07:05
*** unicell1 has quit IRC07:05
*** kozhukalov_ has joined #openstack-infra07:06
mgroszpleia2: what do you mean by "for us it's a social construct"?07:06
*** garyk1 has joined #openstack-infra07:07
pleia2mgrosz: we have all agreed to require two reviewers to give +2s before a change is approved, it's not enforced by gerrit07:07
mgroszDo you count on the contirubuters that they won't +1 on workflow before they see double +2?07:07
pleia2technically a core reviewer could even approve their own change if they want07:07
pleia2but then people would probably be mad at them07:07
mgroszThis is what I am trying to avoid...07:08
pleia2it works fine for us07:08
pleia2there's trust among core reviewers not to break the rules07:08
*** woodster_ has quit IRC07:09
*** otter768 has joined #openstack-infra07:10
*** ddieterly has joined #openstack-infra07:10
*** nadya has quit IRC07:12
*** ddieterly has quit IRC07:15
*** jed56 has joined #openstack-infra07:15
*** alexpilotti has joined #openstack-infra07:15
*** ParsectiX has joined #openstack-infra07:17
*** Ramanjaneya has quit IRC07:17
openstackgerritIan Wienand proposed openstack/diskimage-builder: Remove unused RELEASE_RPMS variable  https://review.openstack.org/23497107:17
*** otter768 has quit IRC07:19
*** kushal has quit IRC07:20
*** btully has quit IRC07:23
openstackgerritMerged openstack-infra/puppet-jenkins: Don't configure memory swap bytes on cgroups for Trusty  https://review.openstack.org/21822707:24
mgroszHello, I am waiting for 3 days now for someone to +2 my change : https://review.openstack.org/#/c/242817/. Please?07:25
*** markvoelker has joined #openstack-infra07:26
*** achanda has quit IRC07:27
*** pahuang_ has quit IRC07:29
*** zhurong has joined #openstack-infra07:29
*** dmellado has joined #openstack-infra07:30
*** markvoelker has quit IRC07:31
*** kushal has joined #openstack-infra07:33
*** scheuran has joined #openstack-infra07:34
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add check-requirements job for evoque  https://review.openstack.org/24339107:35
*** nadya has joined #openstack-infra07:35
*** alexpilotti has quit IRC07:35
openstackgerritMerged openstack-infra/project-config: Initialize vitrage-dashboard new project  https://review.openstack.org/24281707:37
openstackgerritSpencer Krum proposed openstack-infra/ansible-puppet: Conditionally manage puppet config files  https://review.openstack.org/24339907:37
*** gildub has quit IRC07:38
openstackgerritMerged openstack-infra/puppet-lodgeit: Add mysql class to manage db, and configure db name  https://review.openstack.org/23542807:41
*** ilyashakhat_mobi has joined #openstack-infra07:42
*** openstackgerrit has quit IRC07:46
*** openstackgerrit has joined #openstack-infra07:47
ttxanteaya: interesting, will read07:48
*** chenli has joined #openstack-infra07:52
chenlihello, anyone know how to change the identity email address ?07:53
*** ilyashakhat_mobi has quit IRC07:55
anteayattx: cool07:56
*** nmagnezi has joined #openstack-infra07:57
anteayachenli: in your gerrit contact settings: https://review.openstack.org/#/settings/contact there is a text field and a button to register a new email07:57
chenlianteaya, I already did that07:58
ttxjeblair: read your summary, thx for posting. They seem to have attracted a decently-diverse community: do you know how the project governance is set up ? Couldn't find any document describing it07:58
chenliandreaf, but, at https://review.openstack.org/#/settings/web-identities07:58
chenliandreaf, the  identity : https://login.launchpad.net/+id/xxx is still after the first email address07:59
chenliandreaf, and the first email address can not be deleted07:59
*** samuelBartel has joined #openstack-infra08:00
anteayachenli: go to contact information08:00
anteayalook at the preferred email drop down list08:00
*** aopincar_ has quit IRC08:01
*** zigo has quit IRC08:01
chenliandreaf, how to delete ?08:01
anteayaare you in contact information?08:01
anteayaand looking at the preferred email drop down list?08:02
chenliandreaf, yes.08:02
anteayaand what email is set as your preferred email?08:02
chenliandreaf, the new one08:02
anteayagreat08:02
anteayaand how many other emails are on the list?08:03
chenliandreaf, 308:03
anteayagreat08:03
anteayanow go to web identities08:03
openstackgerrityolanda.robla proposed openstack-infra/puppet-jenkins: Properly setup of jenkins keys  https://review.openstack.org/21519708:03
anteayado you see a small box beside the emails listed?08:03
*** zigo has joined #openstack-infra08:03
chenliandreaf, yes, but the first email do not have that box08:04
chenliandreaf, other 3 has the box, including the new one08:04
anteayais the first email set as your preferred email?08:04
chenliandreaf, no08:05
chenliandreaf, that's the old one08:05
chenliandreaf, and only this one has content in "identity" column08:05
anteayawhen you set your new email as the preferred email in contact information did you click the save changes button at the bottom of the contact information page?08:05
chenliandreaf, yes, I believe so, and when you check my bugs, the email is already the new one. https://review.openstack.org/#/q/owner:shchenli%2540cn.ibm.com+status:open,n,z08:07
anteayaokay08:07
chenliandreaf, this page is correct too. https://review.openstack.org/#/settings/08:07
anteayawell I don't know why you can't delete an email that is not your preferred email then08:07
chenliandreaf, ok, thanks for the help anyway.08:08
anteayaunless it is the email you used to set up the account initally, so that our single sign on client launchpad uses it08:08
*** abregman is now known as abregman|brb08:08
*** peterlisak has joined #openstack-infra08:08
chenliandreaf, I guess  it is the initial one...08:09
chenliandreaf, so, there is no way to edit the initial email address ?08:10
*** ddieterly has joined #openstack-infra08:11
andreafchenli: I guess you are talking to anteaya not me, right :)08:11
*** jlanoux has joined #openstack-infra08:11
chenlianteaya,  I guess  it is the initial one... so, there is no way to edit the initial email address ?08:12
chenliandreaf, sorry08:12
andreafchenli: np, just wanted to make sure :)08:13
anteayachenli: I said I don't know08:13
chenliandreaf, ok.08:13
chenlianteaya, ok, thanks!08:13
anteayachenli: I said I am guessing that if you used that email address to set up your account that could be the reason08:13
anteayachenli: welcome08:13
*** ifarkas has joined #openstack-infra08:13
chenlianteaya, :)08:13
openstackgerritMerged openstack-infra/infra-ansible: Attach volumes defined on servers stanzas  https://review.openstack.org/24154108:14
*** bexelbie has joined #openstack-infra08:15
openstackgerritMerged openstack-infra/project-config: Skip long-running jobs for release note changes  https://review.openstack.org/24324608:15
*** ddieterly has quit IRC08:15
openstackgerritMerged openstack-infra/project-config: Add check-requirements job for evoque  https://review.openstack.org/24339108:18
openstackgerritMerged openstack-infra/project-config: add stable/liberty branch to gerritbot for project openstack-chef  https://review.openstack.org/24324508:19
*** arxcruz has joined #openstack-infra08:22
openstackgerritMerged openstack-infra/project-config: Add create ACL for Octavia  https://review.openstack.org/24326408:23
*** mpavone has joined #openstack-infra08:23
*** mpavone has quit IRC08:23
*** bardia has quit IRC08:25
*** Ala has joined #openstack-infra08:25
zigoI'd be nice to get some help and an answer to my message here: http://lists.openstack.org/pipermail/openstack-dev/2015-November/078650.html08:26
zigoI'm currently a bit stuck ...08:26
*** Piet has quit IRC08:26
*** ilyashakhat_mobi has joined #openstack-infra08:26
*** jed56 has quit IRC08:28
openstackgerritMerged openstack-infra/project-config: Make #openstack-ha receive HA guide change alerts  https://review.openstack.org/24317308:28
openstackgerritMerged openstack-infra/project-config: Correct ACLs for Neutron sub-projects  https://review.openstack.org/24219608:29
*** hashar has joined #openstack-infra08:30
*** yfried__ has joined #openstack-infra08:31
*** openstackgerrit has quit IRC08:31
*** openstackgerrit has joined #openstack-infra08:31
*** devl has quit IRC08:31
*** dtantsur|afk is now known as dtantsur08:33
*** yfried_ has quit IRC08:33
*** reed_ has joined #openstack-infra08:33
*** Ramanjaneya has joined #openstack-infra08:34
*** jed56 has joined #openstack-infra08:36
*** fhubik has joined #openstack-infra08:37
*** devl_ has joined #openstack-infra08:39
*** ZZelle has quit IRC08:39
*** abregman|brb is now known as abregman08:39
*** ZZelle has joined #openstack-infra08:39
*** sorantis has joined #openstack-infra08:40
*** jordanP has joined #openstack-infra08:41
shardyMorning all, looking for reviews on https://review.openstack.org/#/c/240938/08:41
*** devl_ has quit IRC08:41
shardyAdds stable/liberty jobs for TripleO08:41
*** sorantis has quit IRC08:41
shardyany help getting that landed would be hugely appreciated, thanks! :)08:42
*** devl_ has joined #openstack-infra08:43
*** sshnaidm has joined #openstack-infra08:46
*** laughterwym has quit IRC08:46
*** matrohon has joined #openstack-infra08:48
*** yfried has joined #openstack-infra08:53
openstackgerritIan Wienand proposed openstack/diskimage-builder: Fixup RPM db path when building Fedora on Ubuntu  https://review.openstack.org/23877308:54
*** yfried__ has quit IRC08:56
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add IPA-based job for ironic-inspector  https://review.openstack.org/24346408:56
*** zeih has joined #openstack-infra08:56
*** achanda has joined #openstack-infra08:57
*** zeih_ has joined #openstack-infra09:00
*** zeih has quit IRC09:00
*** zeih has joined #openstack-infra09:01
*** achanda has quit IRC09:02
*** dingyichen has quit IRC09:03
*** ilyashakhat_mobi has quit IRC09:03
*** fhubik is now known as fhubik_brb09:04
*** zeih_ has quit IRC09:05
*** placko has joined #openstack-infra09:06
*** rossella_ has quit IRC09:07
*** zhurong has quit IRC09:08
*** rossella_ has joined #openstack-infra09:08
*** yfried has quit IRC09:10
*** ddieterly has joined #openstack-infra09:12
*** yfried has joined #openstack-infra09:12
*** mgrosz has quit IRC09:12
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add in extra connections tests  https://review.openstack.org/16930009:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Move Item formatting into Reporters  https://review.openstack.org/22329809:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Document the new connections in zuul  https://review.openstack.org/16927009:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333309:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Tidy up loggers  https://review.openstack.org/22433609:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept  https://review.openstack.org/12152809:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Remove ActionReporters  https://review.openstack.org/24347409:14
*** mgrosz has joined #openstack-infra09:15
*** ddieterly has quit IRC09:16
*** yfried_ has joined #openstack-infra09:16
*** yfried has quit IRC09:17
*** otter768 has joined #openstack-infra09:20
*** derekh has joined #openstack-infra09:21
*** chenli has quit IRC09:23
*** watanabe_isao has joined #openstack-infra09:25
*** fhubik_brb is now known as fhubik09:25
*** otter768 has quit IRC09:25
*** markvoelker has joined #openstack-infra09:27
watanabe_isaoHello, all. Does anyone know anything about this issue, please?09:27
watanabe_isao^^^https://bugs.launchpad.net/zuul/+bug/127002909:27
openstackLaunchpad bug 1270029 in Zuul "zuul doesn't connect to gearman server" [Undecided,New]09:27
*** skolekonov has joined #openstack-infra09:30
*** jlanoux has quit IRC09:30
*** markvoelker has quit IRC09:31
*** jlanoux has joined #openstack-infra09:31
openstackgerritSergey Lukjanov proposed openstack-infra/project-config: No more need for Icehouse tag acls for Sahara  https://review.openstack.org/24348509:33
*** jed56 has quit IRC09:35
*** ihrachys has joined #openstack-infra09:35
openstackgerritSergey Lukjanov proposed openstack-infra/project-config: Use separated ACL groups for sahara-dashboard  https://review.openstack.org/24348709:36
openstackgerritMerged openstack/diskimage-builder: Remove unused RELEASE_RPMS variable  https://review.openstack.org/23497109:38
*** sdake has quit IRC09:42
*** sdake has joined #openstack-infra09:42
*** devl_ has quit IRC09:43
hrubijhesketh: hi, any idea why the zuul tests bahave non-deterministically and fail on some runs?09:43
*** fhubik is now known as fhubik_brb09:43
*** jistr has joined #openstack-infra09:45
openstackgerrityolanda.robla proposed openstack-infra/zuul: Fix newrev comparison for NullChange  https://review.openstack.org/24349309:45
*** kozhukalov_ has quit IRC09:48
*** aopincar_ has joined #openstack-infra09:50
*** laughterwym has joined #openstack-infra09:51
*** mgrosz has quit IRC09:51
*** jed56 has joined #openstack-infra09:51
*** rguillebert has joined #openstack-infra09:52
openstackgerrityolanda.robla proposed openstack-infra/zuul: Log errors on zuul validating schema  https://review.openstack.org/24349909:52
*** ilyashakhat_mobi has joined #openstack-infra09:59
*** kozhukalov_ has joined #openstack-infra09:59
*** zhenguo has quit IRC10:00
*** achanda has joined #openstack-infra10:00
*** jed56 has quit IRC10:02
*** jed56 has joined #openstack-infra10:03
*** fhubik_brb is now known as fhubik10:03
openstackgerritMerged openstack-infra/project-config: No more need for Icehouse tag acls for Sahara  https://review.openstack.org/24348510:04
*** achanda has quit IRC10:05
StevenKianw: I just +A'd that change, I was waiting for tests.10:10
*** smarcet has joined #openstack-infra10:10
*** ddieterly has joined #openstack-infra10:13
*** sridhar_ram has joined #openstack-infra10:14
*** ddieterly has quit IRC10:17
*** devl_ has joined #openstack-infra10:18
*** yfried_ is now known as yfried|afk10:19
*** sdake has quit IRC10:20
*** abregman is now known as abregman|brb10:23
*** abregman|brb is now known as abregman|lunch10:23
*** jamielennox|away is now known as jamielennox10:24
*** sorantis has joined #openstack-infra10:25
*** nikhil_k has joined #openstack-infra10:29
*** nikhil has quit IRC10:30
*** ociuhandu has joined #openstack-infra10:33
*** jlanoux has quit IRC10:34
*** cdent has joined #openstack-infra10:35
*** ihrachys has quit IRC10:38
*** ihrachys has joined #openstack-infra10:39
*** yfried|afk is now known as yfried_10:39
*** pblaho has quit IRC10:39
*** ig0r__ has quit IRC10:40
*** gildub has joined #openstack-infra10:41
*** electrofelix has joined #openstack-infra10:43
*** yamamoto_ has quit IRC10:44
*** sorantis has quit IRC10:49
*** fhubik has quit IRC10:51
*** fhubik has joined #openstack-infra10:51
*** ldnunes has joined #openstack-infra10:52
*** jlanoux has joined #openstack-infra10:53
*** nadya has quit IRC10:55
*** jlanoux_ has joined #openstack-infra10:55
*** eliqiao has quit IRC10:56
*** baoli has joined #openstack-infra10:56
*** ilyashakhat_mobi has quit IRC10:56
*** jlanoux has quit IRC10:57
*** eliqiao has joined #openstack-infra10:58
*** baoli has quit IRC11:01
*** aopincar_ has quit IRC11:01
*** peterlisak13 has joined #openstack-infra11:02
openstackgerritMerged openstack/diskimage-builder: Fixup RPM db path when building Fedora on Ubuntu  https://review.openstack.org/23877311:03
*** aysyd has joined #openstack-infra11:03
*** marcusvrn_ has joined #openstack-infra11:04
*** peterlisak has quit IRC11:04
*** dims has joined #openstack-infra11:05
*** jlanoux has joined #openstack-infra11:06
*** sorantis has joined #openstack-infra11:07
*** sorantis has quit IRC11:08
openstackgerritFlavio Percoco proposed openstack-infra/irc-meetings: Update chair for Glance meetings  https://review.openstack.org/24353511:08
*** jlanoux_ has quit IRC11:08
*** ujuc has joined #openstack-infra11:09
*** sorantis has joined #openstack-infra11:09
*** rfolco has joined #openstack-infra11:10
*** Liuqing has joined #openstack-infra11:13
*** abregman|lunch is now known as abregman11:13
*** ddieterly has joined #openstack-infra11:13
*** wenlock has quit IRC11:14
*** pbourke has quit IRC11:16
*** pbourke has joined #openstack-infra11:17
Liuqinghello, could someone help review the patch : https://review.openstack.org/#/c/243388/11:17
*** aopincar_ has joined #openstack-infra11:18
*** ddieterly has quit IRC11:18
*** ihrachys has quit IRC11:18
*** ihrachys has joined #openstack-infra11:19
*** sdake has joined #openstack-infra11:19
*** dims has quit IRC11:21
*** sdake has quit IRC11:21
*** pc_m has joined #openstack-infra11:21
*** otter768 has joined #openstack-infra11:21
*** dims has joined #openstack-infra11:22
*** ihrachys has quit IRC11:23
*** gildub has quit IRC11:25
*** otter768 has quit IRC11:26
*** markvoelker has joined #openstack-infra11:27
*** markvoelker has quit IRC11:32
openstackgerritPaul Murray proposed openstack-infra/irc-meetings: Add a weekly Nova Live Migration subteam meeting  https://review.openstack.org/24354311:32
*** sridhar_ram has quit IRC11:32
*** watanabe_isao has quit IRC11:33
*** yamamoto has joined #openstack-infra11:35
*** yamamoto has quit IRC11:39
*** yamamoto has joined #openstack-infra11:39
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: DO NOT REVIEW: verify CI with python3  https://review.openstack.org/24354511:39
*** jlanoux has quit IRC11:39
*** sorantis has quit IRC11:40
*** yamamoto_ has joined #openstack-infra11:40
*** jlanoux has joined #openstack-infra11:41
*** nadya has joined #openstack-infra11:41
*** PaulMurray has joined #openstack-infra11:42
*** jaypipes has joined #openstack-infra11:42
*** yamamoto has quit IRC11:43
*** ihrachys has joined #openstack-infra11:49
*** fhubik is now known as fhubik_brb11:52
*** julim has joined #openstack-infra11:53
*** achanda has joined #openstack-infra11:54
*** PaulMurray is now known as ptm_away11:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Add in extra connections tests  https://review.openstack.org/16930012:00
*** ilyashakhat_mobi has joined #openstack-infra12:02
*** yamamoto_ has quit IRC12:06
*** sorantis has joined #openstack-infra12:08
openstackgerritTimofey Durakov proposed openstack-infra/project-config: Initial job for live-migrations  https://review.openstack.org/24301312:09
openstackgerritTomas Bezdek proposed openstack-infra/jenkins-job-builder: Add support for Rebuild Plugin  https://review.openstack.org/23536712:10
*** HeOS has quit IRC12:11
*** ajo is now known as ajo\lunch12:14
*** ddieterly has joined #openstack-infra12:14
*** yfried_ is now known as yfried|afk12:14
*** ddieterly has quit IRC12:18
*** yfried|afk is now known as yfried_12:20
ihrachysclarkb: hi. can you validate our approach at https://review.openstack.org/#/c/243333/ ?12:20
*** pc_m is now known as pc_m_AWAY12:21
*** gordc has joined #openstack-infra12:22
*** achanda has quit IRC12:23
*** freyes has quit IRC12:26
*** freyes has joined #openstack-infra12:26
*** yamamoto has joined #openstack-infra12:27
openstackgerritTomas Bezdek proposed openstack-infra/jenkins-job-builder: Add support for Rebuild Plugin  https://review.openstack.org/23536712:28
mordredinfra-root, Shrews: ok. for real this time - I'm going to cut shade 1.1.012:29
yolandawoot!12:30
mordreddone12:30
*** Ramanjaneya has quit IRC12:31
*** julim has quit IRC12:31
*** sdake has joined #openstack-infra12:32
*** sdake has quit IRC12:33
*** cloudtrainme has joined #openstack-infra12:34
*** sdake has joined #openstack-infra12:34
*** mrmartin has quit IRC12:35
*** roaet_ has quit IRC12:35
*** sdake has quit IRC12:35
*** Mmike has quit IRC12:36
*** wenlock has joined #openstack-infra12:36
*** kisoku has quit IRC12:36
*** oomichi_ has quit IRC12:37
*** kisoku has joined #openstack-infra12:37
hasharSpamapS: python-shade can use a bump to 1.1.0 :-}12:39
*** roaet_ has joined #openstack-infra12:39
mordredSpamapS: enjoy packaging munch and requestsexceptions for that ^^ :)12:39
mordredoh, and os-client-config 1.10.212:39
* mordred hands SpamapS a shiny to distract him from the pain12:40
*** wenlock has quit IRC12:40
*** ilyashakhat_mobi has quit IRC12:42
*** mahatic_ has joined #openstack-infra12:42
*** thorst has joined #openstack-infra12:43
*** Mmike has joined #openstack-infra12:44
*** fbo has quit IRC12:44
*** sambetts is now known as sambetts-hungry12:45
*** mahatic has quit IRC12:46
*** sorantis_ has joined #openstack-infra12:47
*** fhubik_brb is now known as fhubik12:47
*** fbo has joined #openstack-infra12:47
*** weshay_xchat has joined #openstack-infra12:47
*** Kennan has quit IRC12:48
*** sorantis has quit IRC12:48
*** sorantis_ is now known as sorantis12:48
*** gongysh has joined #openstack-infra12:49
openstackgerritTomas Bezdek proposed openstack-infra/jenkins-job-builder: Add support for Rebuild Plugin  https://review.openstack.org/23536712:51
*** Kennan has joined #openstack-infra12:51
Shrewsmordred: you gave up on the 2 +A'd shade reviews that have yet to merge?12:52
*** dims has quit IRC12:53
*** baoli has joined #openstack-infra12:53
samueldmqwhat could be a great site I could get impressive data about openstack from?12:55
*** bdemers has quit IRC12:56
samueldmqfrom stackalytics, in member directory, I see more than 7k companies that have contributed12:56
*** dims has joined #openstack-infra12:56
samueldmqand over 20k individual contributors12:56
*** ajo\lunch is now known as ajo12:57
*** gongysh_ has joined #openstack-infra12:57
*** sabeen1 has joined #openstack-infra12:57
mordredShrews: gah. I thought the cache value one was merged12:58
*** markvoelker has joined #openstack-infra12:58
mordredShrews: I've rechecked that one just now btw12:59
*** gongysh has quit IRC12:59
*** dprince has joined #openstack-infra13:00
mordredShrews: in other news - I've got a script written (and running right now) which is creating a server on each cloud without auto_ip, saving the server dict, adding an auto ip, saving the server dict, and then deleting and doing it again except with reuse_ips set to true the second time13:01
mordredShrews: and it's doing that on all of my accounts13:01
mordredShrews: so I should have some good server dicts for us13:02
*** markvoelker has quit IRC13:03
Shrewsmordred: does it do validation between the two dicts?13:03
*** maishsk has joined #openstack-infra13:03
mordredright now it's just collecting them13:03
*** sorantis has quit IRC13:03
*** pblaho has joined #openstack-infra13:03
*** kengo_sakai has quit IRC13:05
*** rossella_ has quit IRC13:07
*** rossella_ has joined #openstack-infra13:08
*** cloudtrainme has quit IRC13:08
*** devkulkarni has joined #openstack-infra13:10
*** sorantis has joined #openstack-infra13:10
*** peterlisak has joined #openstack-infra13:11
*** ujuc has quit IRC13:11
*** stevemar_ has joined #openstack-infra13:11
*** peterlisak13 has quit IRC13:14
*** ddieterly has joined #openstack-infra13:15
*** fhubik is now known as fhubik_brb13:17
*** gongysh_ has quit IRC13:17
*** fhubik_brb is now known as fhubik13:17
*** ddieterly has quit IRC13:19
*** stevemar_ has quit IRC13:20
*** markvoelker has joined #openstack-infra13:20
*** markvoelker has quit IRC13:20
*** stevemar_ has joined #openstack-infra13:21
*** tsg has joined #openstack-infra13:21
mordredShrews: oh neat! I have leanred a new way in which clouds fail13:22
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: DO NOT REVIEW: verify CI with python3  https://review.openstack.org/24354513:22
mordredI think I'm going to file a bug against the cloud in question on this one13:22
*** otter768 has joined #openstack-infra13:22
mordredShrews: entercloudsuite has a shared public neutron network - but you are not allowed to boot VMs on it13:22
mordredflaper87: didn't you say you know the entercloudsuite folks?13:23
*** gongysh has joined #openstack-infra13:23
*** achanda has joined #openstack-infra13:23
*** salv-orlando has joined #openstack-infra13:23
*** amuller has joined #openstack-infra13:23
flaper87mordred: I do13:24
flaper87Anything I can do to help?13:24
* flaper87 reads the backlog13:24
*** baoli has quit IRC13:25
*** daemontool has quit IRC13:25
openstackgerritMerged openstack-infra/shade: Let os-client-config handle session creation  https://review.openstack.org/24073413:25
*** markvoelker has joined #openstack-infra13:25
*** baoli has joined #openstack-infra13:26
*** ayoung has quit IRC13:26
mordredflaper87: their neutron network is listed as "shared:True" - which normally means you should be able to boot a vm on it13:26
mordreddirectly13:26
mordredexcept13:26
mordredyou get this if you do:13:26
mordredError in creating instance: It is not allowed to create an interface on external network 1d09bbe1-7f46-4856-b0b6-4f983f196342 (HTTP 403) (Request-ID: req-eff7c9ca-6266-4b05-8d4d-b9cce6f50ff5)13:26
*** yamamoto has quit IRC13:27
Shrewsmordred: wow13:27
*** zhurong has joined #openstack-infra13:27
mordredflaper87: so they should set that network to be shared=False13:27
*** otter768 has quit IRC13:27
mordredbecause that is what it is13:27
flaper87mordred: oh, mmh. I hadn't noticed that13:28
*** changbl has quit IRC13:28
flaper87mordred: I can communicate that to them13:29
flaper87I guess they're restricting it using policies13:29
*** Liuqing_ has joined #openstack-infra13:29
tsglifeless: can't seem to get in https://review.openstack.org/#/c/238771/ still - can't tell if this http://logs.openstack.org/71/238771/4/gate/gate-tempest-dsvm-neutron-full/42720c5/console.html is a known issue at gate.13:29
*** gongysh has quit IRC13:29
*** achanda has quit IRC13:30
mordredmgagne: while I'm poking people about clouds ...13:31
tsglifeless: I see it captured under http://status.openstack.org/elastic-recheck/data/uncategorized.html a times yesterday but not looked at yet - seemed as through the gate-tempest-dsvm-neutron-full have been failing a couple of unit tests randomly in test setup (_setup_network_and_servers) with " AssertionError: 0 == 0 : No IPv4 addresses found in: []"13:31
*** sambetts-hungry is now known as sambetts13:31
*** Liuqing has quit IRC13:31
*** nelsnelson has joined #openstack-infra13:32
*** flepied has quit IRC13:33
*** kaisers has quit IRC13:33
mordredmgagne: there are two networks in internap, both are listed as "shared:False" and "router:external:False" but it is possible to boot a VM directly on each of them13:34
*** kgiusti has joined #openstack-infra13:34
mordredmgagne: and one of them is externally routable13:34
*** glauco___ has joined #openstack-infra13:37
*** zhurong has quit IRC13:37
mordredflaper87: so, basically, they need to set their network metadata correctly13:38
*** zhurong has joined #openstack-infra13:38
mordredflaper87: if, as a user, I am not allowed to boot a vm on that network, it should not be listed as shared:False - if it is, it shows up as an available network for me to boot an instance on - and it's a fair assumption on my part that I should e able to13:38
*** Mmike has quit IRC13:39
* flaper87 fully agrees with that13:39
flaper87I'll let them know13:40
mordredflaper87: thanks!13:40
*** glauco has quit IRC13:40
flaper87I'm not sure if they have a "report issues" section13:40
*** yfried_ is now known as yfried|afk13:40
mordredflaper87: yah. that's why I pinged you :)13:40
flaper87but I'll send them an email13:40
flaper87mordred: :D13:40
*** kaisers has joined #openstack-infra13:40
*** Mmike has joined #openstack-infra13:41
mordredflaper87: you can let them know this came from me verifying that shade/ansible works on all of the existing clouds - and this means that ansible users will get errors trying to use their cloud13:41
*** yfried|afk is now known as yfried_13:41
*** burgerk has joined #openstack-infra13:42
*** dkranz has joined #openstack-infra13:42
flaper87mordred: that's a good insight, I'll mention that in the email13:42
*** aopincar_ has quit IRC13:43
*** trown|outttypeww is now known as trown13:44
*** gongysh has joined #openstack-infra13:46
flaper87mordred: sent13:46
*** barnaby has joined #openstack-infra13:47
mordredflaper87: thanks!13:48
mordredflaper87: I have a local workaround for now - I'm going to set use-external-network: False in their vendor profile in os-client-config13:49
*** spzala has joined #openstack-infra13:49
*** akshai has joined #openstack-infra13:51
*** barnaby has quit IRC13:52
*** tlian has joined #openstack-infra13:53
phschwartzmorning infra13:53
*** ilyashakhat_mobi has joined #openstack-infra13:55
*** w_ is now known as olaph13:56
*** yamamoto has joined #openstack-infra13:56
*** woodster_ has joined #openstack-infra13:56
*** ddieterly has joined #openstack-infra13:58
*** fhubik is now known as fhubik_brb13:58
*** xyang1 has joined #openstack-infra14:01
*** jyuso1 has quit IRC14:02
*** flepied has joined #openstack-infra14:02
*** devkulkarni has quit IRC14:03
*** stevemar_ has quit IRC14:04
*** rlandy has joined #openstack-infra14:06
*** ilyashakhat_mobi has quit IRC14:06
openstackgerritEvgeny Antyshev proposed openstack-infra/devstack-gate: Allow to save custom product logs  https://review.openstack.org/24081314:07
*** barnaby has joined #openstack-infra14:07
*** sorantis has quit IRC14:08
*** links has quit IRC14:08
*** eliqiao has quit IRC14:10
*** amitgandhinz has joined #openstack-infra14:11
openstackgerritThomas Morin proposed openstack-infra/project-config: net-bgpvpn: Make requirements check non-voting  https://review.openstack.org/24361014:11
*** eliqiao has joined #openstack-infra14:11
*** ddieterly has quit IRC14:12
*** kushal has quit IRC14:12
*** stevemar_ has joined #openstack-infra14:13
openstackgerrityolanda.robla proposed openstack-infra/zuul: Fix newrev comparison for NullChange  https://review.openstack.org/24349314:15
*** alivigni has joined #openstack-infra14:17
*** tiswanso has joined #openstack-infra14:17
*** daemontool has joined #openstack-infra14:18
*** rhallisey has joined #openstack-infra14:18
*** peristeri has joined #openstack-infra14:18
*** hamzy_ is now known as hamzy14:24
*** Liuqing_ has quit IRC14:24
openstackgerrityolanda.robla proposed openstack-infra/puppet-zuul: Update httpd settings on zuul  https://review.openstack.org/24362314:25
*** Liuqing has joined #openstack-infra14:25
*** tsufiev_ has quit IRC14:26
pabelangerjeblair: well, that is good news we know the reason now.14:26
*** yamamoto has quit IRC14:27
*** freyes has quit IRC14:30
*** tsufiev has joined #openstack-infra14:30
*** bdemers has joined #openstack-infra14:31
*** signed8bit has joined #openstack-infra14:32
*** zhurong_ has joined #openstack-infra14:32
*** zhurong has quit IRC14:32
*** tsg has quit IRC14:33
*** sdake has joined #openstack-infra14:34
*** sdake has quit IRC14:35
*** ayoung has joined #openstack-infra14:35
*** gongysh has quit IRC14:38
Zaraduplicate stories have been cropping up about the storyboard bug we think SotK fixed here: https://review.openstack.org/#/c/236945/ (stories: https://storyboard.openstack.org/#!/story/2000381 https://storyboard.openstack.org/#!/story/2000395 )14:39
Zarasince email notifications are in review atm, but not merged, this is hopefully the best way to draw attention to them...14:39
Zara*the patch, even14:39
*** fhubik_brb is now known as fhubik14:40
*** regXboi has joined #openstack-infra14:40
Zaraif this is causing you problems, please spare a moment to review; I'm not merging it with *only* my +2 because that's a bad path to go down.14:40
*** yfried_ is now known as yfried|afk14:40
*** wenlock has joined #openstack-infra14:41
SergeyLukjanovjeblair, fungi, clarkb, hey folks, could you please help me to find the place to do the redirect like glance.o.o -> docs.o.o/developer/glance for sahara?14:42
SergeyLukjanovit seems like glance.o.o is A dns record to 173.203.107.20714:42
SergeyLukjanovbut I couldn't find where this server managed14:42
*** zeih has quit IRC14:43
mordredSergeyLukjanov: we actually stopped doing the project domains like that a while ago14:44
mordredSergeyLukjanov: and are only keeping the existing ones around because of links to them people may have had out in the wild14:44
mordred(when we removed them altogether, we got some complains)14:44
SergeyLukjanovmordred, oh, than it's strange that we have them for many projects and don't have them for the new ones14:44
*** ptm_away is now known as PaulMurray14:44
*** wenlock has quit IRC14:45
mordredit should just be the first 4 projects or so nova, glance, keystone14:45
*** sigmavirus24_awa is now known as sigmavirus2414:45
*** yfried|afk is now known as yfried_14:45
mordredhorizon, cinder14:45
mordredneutron doesn't have one14:45
SergeyLukjanovquantum has ;)14:45
mordredyah. like I said - backwards compat :)14:46
SergeyLukjanovmordred, okay, thx for the explanation, I've just been asked a few times during summit why we don't have such redirect for sahara :)14:46
mordredyou'll find that burrow has one too14:46
*** salv-orlando has quit IRC14:46
mordredbut burrow hasn't existed in QUITE some time14:46
SergeyLukjanov:)14:46
*** xgerman has quit IRC14:47
*** pradk has joined #openstack-infra14:47
*** xgerman has joined #openstack-infra14:48
*** zhurong_ has quit IRC14:49
*** eharney has joined #openstack-infra14:50
*** fhubik is now known as fhubik_brb14:50
*** zhurong has joined #openstack-infra14:50
*** mriedem has joined #openstack-infra14:51
*** cloudtrainme has joined #openstack-infra14:51
*** ddieterly has joined #openstack-infra14:52
*** freyes has joined #openstack-infra14:53
*** ddieterl_ has joined #openstack-infra14:53
*** stevemar_ has quit IRC14:53
mordredShrews: AND - auro will let you boot on a shared public network14:54
mordredbut it won't14:54
*** stevemar_ has joined #openstack-infra14:54
mordredyou'll get scheduler failures if you try14:54
*** jamesmcarthur has joined #openstack-infra14:55
*** craigbr has joined #openstack-infra14:56
*** ZZelle has quit IRC14:56
openstackgerritMerged openstack-infra/storyboard: Add an offset parameter to search endpoints  https://review.openstack.org/23694514:57
*** ddieterly has quit IRC14:57
*** angdraug has joined #openstack-infra14:57
*** nmagnezi has quit IRC14:57
*** daemontool has quit IRC14:58
*** Mmike has quit IRC14:59
*** Mmike has joined #openstack-infra14:59
*** zeih has joined #openstack-infra14:59
*** ujuc has joined #openstack-infra15:00
*** amotoki_ has joined #openstack-infra15:00
*** akshai has quit IRC15:00
*** links has joined #openstack-infra15:01
*** akshai has joined #openstack-infra15:02
*** ParsectiX has quit IRC15:03
*** zeih has quit IRC15:04
*** links has quit IRC15:05
mriedemdid something change since 11/9 wrt the test nodes that nova unit test / functional test jobs would be running on? we're seeing a spike in build timeouts since 11/915:06
mriedemon master and stable/liberty15:07
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=(message:%5C%22Build%20timed%20out%20(after%2050%20minutes).%20Marking%20the%20build%20as%20failed.%5C%22%20OR%20message:%5C%22Build%20timed%20out%20(after%2040%20minutes).%20Marking%20the%20build%20as%20failed.%5C%22)%20AND%20project:%5C%22openstack/nova%5C%22%20AND%20tags:%5C%22console%5C%22%20AND%20NOT%20build_queue:%5C%22periodic-stable%5C%2215:07
*** kushal has joined #openstack-infra15:07
*** yfried_ is now known as yfried|afk15:08
*** flip214 has quit IRC15:08
*** sabeen1 has quit IRC15:08
*** yfried|afk is now known as yfried_15:09
*** garyk1 has quit IRC15:11
*** nmagnezi has joined #openstack-infra15:12
*** fhubik_brb is now known as fhubik15:12
*** pradk has quit IRC15:13
*** pradk_ has joined #openstack-infra15:13
*** pradk_ is now known as pradk15:14
mriedemnvm15:15
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ansible-role-nodepool project  https://review.openstack.org/24365015:15
*** armax has joined #openstack-infra15:16
*** mestery has joined #openstack-infra15:16
*** FallenPegasus has joined #openstack-infra15:16
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ansible-role-nodepool project  https://review.openstack.org/24365015:17
*** zhurong has quit IRC15:17
*** yfried_ has quit IRC15:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Pull server list cache setting via API  https://review.openstack.org/24331115:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Four minor fixes that make debugging better  https://review.openstack.org/24365315:19
*** harlowja_at_home has joined #openstack-infra15:20
*** btully has joined #openstack-infra15:20
*** abregman has quit IRC15:21
*** craigbr has quit IRC15:22
*** asselin__ has quit IRC15:22
*** fhubik is now known as fhubik_brb15:22
*** otter768 has joined #openstack-infra15:23
mordredShrews: auro, entercloudsuite and internap are a bit weird in terms of auto_ip15:24
mordredShrews: the other clous are working fine15:24
mordredShrews: but I think we need a better story for clouds where a specific network needs to be provided by the user15:24
mordredShrews: the nics parameter obviously sucks15:25
fungiSergeyLukjanov: mordred: yeah, only swift complained, so i was going to puppet up a redirect for that one to host on static.o.o so we can take the old wiki server back offline and maybe finally get rid of it once and for all15:25
mordredbut also there are other places, like the add-ip sequence, where if the user said "this is the network you should boot on" those things should be honored15:25
*** flip214 has joined #openstack-infra15:26
mordredShrews: which is to say, three of the clouds have messed up networking - but it _IS_ possible for me as a human to understand it. at this point, once I've understood it as a human, there is no _good_ way for me to communicate my understanding to occ/shade15:26
mordredShrews: my stance that a user shoud not _have_ to communicate things to occ/shade about how networking works in the cloud notwithstanding15:27
*** tsg has joined #openstack-infra15:27
*** achanda has joined #openstack-infra15:27
*** yamamoto has joined #openstack-infra15:28
*** otter768 has quit IRC15:28
*** mestery has quit IRC15:28
*** sdake has joined #openstack-infra15:29
*** craigbr has joined #openstack-infra15:29
openstackgerritMatt Riedemann proposed openstack/requirements: Block oslo.messaging 2.8.0  https://review.openstack.org/24365715:29
mriedemsdague: ^15:29
*** tiswanso has quit IRC15:29
*** tiswanso has joined #openstack-infra15:30
*** sdake has quit IRC15:30
*** asselin_ has joined #openstack-infra15:30
*** craigbr has quit IRC15:31
mordredhttps://gist.github.com/emonty/82738dc9fac9a57bae9d15:31
*** akshai has quit IRC15:31
Shrewsmordred: are you proposing a new occ setting?15:31
*** burgerk has quit IRC15:31
mordredthat's my test script, the yaml form of all of the server dicts, and the shade debug trace showing api calls made and times for them15:31
mordredShrews: maybe15:31
mordredShrews: I'm not sure I'm to proposing a specific solution yet15:32
mordredShrews: but there is definitely not a great way to deal with this particular thing for auro/intenap/entercloudsuite right now15:32
*** achanda has quit IRC15:32
*** yamamoto has quit IRC15:33
*** akshai has joined #openstack-infra15:33
*** zz_gondoi is now known as gondoi15:33
openstackgerrityolanda.robla proposed openstack-infra/puppet-gerrit: Only point to chain file if is valid  https://review.openstack.org/24366215:33
mordredShrews: what I tried was this: https://gist.github.com/emonty/82738dc9fac9a57bae9d#file-server_dict_test-py-L36-L4115:33
mordredShrews: and that actually did not work15:34
*** clarkb has quit IRC15:34
mordredalso, this: https://gist.github.com/emonty/82738dc9fac9a57bae9d#file-server_dict_test-py-L36-L41 is just sad15:34
mordred(and yes, each of the additional ifs there were to work around a specific issue that was unavoidable from having tried to "just find me an ubuntu image"15:35
*** fawadkhaliq has joined #openstack-infra15:36
*** sfinucan has joined #openstack-infra15:37
Shrewsyes, that is a sad making15:37
*** thedodd has joined #openstack-infra15:38
*** bradjones is now known as bradjones|away15:38
openstackgerritMonty Taylor proposed openstack-infra/shade: Four minor fixes that make debugging better  https://review.openstack.org/24365315:38
*** changbl has joined #openstack-infra15:40
*** zns has joined #openstack-infra15:41
*** changbl has quit IRC15:43
*** changbl has joined #openstack-infra15:43
*** asselin_ has quit IRC15:45
*** salv-orlando has joined #openstack-infra15:46
fungiyolanda: on 243662 it might make more sense to port my 238668 change (since it's a port of the flexible https support i already implemented for static.openstack.org)15:47
*** sdake has joined #openstack-infra15:48
*** jffische has joined #openstack-infra15:48
*** angdraug has quit IRC15:48
*** fedexo has joined #openstack-infra15:48
fungiyolanda: at some point i'd like our certificate handling to be consistent across all our modules rather than the mess of random implementations we have now15:48
mordredfungi: +100015:49
yolandafungi ok, i'll revisit that15:49
yolandai agree, things like certificate handling, apache configuration... shall be something that the apache module needs to do15:49
mgagnemordred: yes. what's the question?15:50
mordredmgagne: well ... it's a weirdness about the attributes on the networks there15:50
mordredmgagne: I have two networks in my project15:51
mordredmgagne: neither are router:external:True15:51
mgagnemordred: what were the expectations?15:51
*** sdake_ has joined #openstack-infra15:51
mgagnemordred: I'm not sure what router:external:True does tbh15:51
mordredmgagne: although one of them _is_ the one that I should use if I want an externally routable ip15:51
mordredmgagne: it's a property set on a neutron network to communicate that it is a network that  has externally routable IPs in it15:51
mgagnemordred: interesting, I haven't paid attention to it before15:52
*** tonytan4ever has joined #openstack-infra15:52
mordredmgagne: it looks like each project in internap gets two networks created in it - one called {project}-lan-{id} and one called {project}-wan-{id}15:52
mgagnemordred: does adding this attribute change anything to the network? will you be able to boot VMs on it?15:52
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for oslo.messaging 2.8.0 bug 1514876  https://review.openstack.org/24367415:52
openstackbug 1514796 in oslo.messaging "duplicate for #1514876 MessageHandlingServer locking deadlocks" [Critical,Fix committed] https://launchpad.net/bugs/1514796 - Assigned to Julien Danjou (jdanjou)15:52
mgagnemordred: yes, that's the case15:52
mordredmgagne: it doesn't - it's informational15:52
mordredmgagne: I can already boot vms on both networks15:52
mgagnemordred: each project has a non-shared set of networks15:52
fungiyolanda: yes, if we could make that a class in the apache module that would be even better. though if we want to be able to switch to the puppetlabs apache module we might not have that option15:53
*** sdake has quit IRC15:53
*** burgerk has joined #openstack-infra15:53
mordredmgagne: but it's not possible to know programitcaly which network is public and which is private15:53
mgagnemordred: I'll check this info with our team and see what can be done15:53
mordredsince router:external is set to false on both15:53
yolandafungi, mordred, at this point... i need to raise again.. why not try to move to apache module from community?15:53
mgagnemordred: true, except regex fu against WAN string15:53
fungiyolanda: does it already have this feature?15:53
mordredmgagne: right. but I'd have to know to do that for internap15:53
*** peterlisak has quit IRC15:53
yolandafungi, it has ability to manage apache conf files15:53
mordredmgagne: it's not a regex I can count on for other providers15:53
yolandai need to check for certificates15:53
mgagnemordred: yep, I'll look into the router:external attribute15:54
mordredyolanda: I believe each time we look at it we have found it to be deficient for our needs15:54
mordredmgagne: awesome! thanks!15:54
*** asselin_ has joined #openstack-infra15:54
mgagnemordred: are you able to update this attribute?15:54
mordredmgagne: nope. it's an admin feature15:54
*** freyes has quit IRC15:54
fungiyolanda: that's what i meant. autodetection based on content to allow referring to certificates managed in our outside of puppet and also automatic fallbacks to snakeoil certs15:54
mordredmgagne: actually -one sec15:54
mordredlet me try and make sure I'm not lying15:54
*** dramalho has joined #openstack-infra15:54
fungiyolanda: asking if it has similar logic to what i implement in 238668, not whether the same logic can be implemented on top of it15:55
mordredmgagne: nope. I cannot edit those networks15:55
*** devkulkarni has joined #openstack-infra15:55
mordredmgagne: incidentally, there is a thing about this that has showed a UI deficiency on shade's part ... so thanks for that too15:55
mgagne:P15:56
yolandafungi, i need to check15:56
mgagnemordred: ok, will update them now so you can work on your stuff15:56
mordredmgagne: also - THANK YOU for providing a directly routable network15:56
mgagnemordred: I don't know what else I should be providing tbh15:56
*** salv-orlando has quit IRC15:57
mordredmgagne: there are other clouds that only give me private networks and then make me get floating ips to get an address on the public net15:57
*** freyes has joined #openstack-infra15:57
mgagnemordred: that's madness15:57
mordredmgagne: yes. it's completely insane15:57
mgagnemordred: I believe in a hybrid approach15:57
*** mtanino has joined #openstack-infra15:57
mordredmgagne: yes. you and the other good clouds do15:57
mgagnemordred: were you can boot in ext-net if you wish or use all that FIP/NAT madness if you wish15:57
mordred++15:57
mordredthat's exactly right15:58
fungi_madness_15:58
mordredthe only people who disagree with us are the ones who are obsessed with telling us all that we're thinking about how we use computers wrong15:58
mordred:)15:58
fungigreat word for choosing to inflict address translation on yourself needlessly15:58
mordredfungi: ++15:58
yolandafungi yes, puppetlabs-apache has default fallback to ssl certs15:59
fungito the people who disagree with me, i say they're thinking about ip addresses and the internet wrong15:59
*** woodster_ has quit IRC15:59
mgagnealthough sometimes it's an unfair statement or a too hasty judgement, I don't know how else to describe it15:59
*** _ody has joined #openstack-infra16:00
*** kushal has quit IRC16:00
*** maishsk has quit IRC16:00
fungiyolanda: neat. a proof-of-concept implementation would be useful to see how we'd leverage the latest puppetlabs apache module in one of our more complicated web application modules16:01
yolandapabelanger, you had something like that, right?16:01
*** cloudtrainme has quit IRC16:01
openstackgerrityolanda.robla proposed openstack-infra/zuul: Fix newrev comparison for NullChange  https://review.openstack.org/24349316:02
*** eliqiao has quit IRC16:02
*** daemontool has joined #openstack-infra16:03
yolandafungi anyway, https://review.openstack.org/243662 should act as a temporary fix until we create a better solution ... because right now, file creation is skipped on manifest, but we point to a non existing file in apache16:03
pabelangeryolanda: reading backscroll16:03
*** eliqiao has joined #openstack-infra16:03
*** fhubik_brb is now known as fhubik16:03
*** sorantis has joined #openstack-infra16:03
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Redirect dashboard to about page when not logged in  https://review.openstack.org/24368216:03
pabelangeryolanda: ya, let me dig up the review16:04
mriedemis this a problem due to the image/node this is running on? http://logs.openstack.org/68/210468/4/check/gate-tempest-dsvm-multinode-full/3461bb8/logs/subnode-2/devstacklog.txt.gz#_2015-11-09_17_20_09_31916:04
*** arxcruz has quit IRC16:05
openstackgerritDerek Higgins proposed openstack-infra/project-config: Switch TripleO jobs to F22 jenkins nodes  https://review.openstack.org/24368416:07
openstackgerritDerek Higgins proposed openstack-infra/system-config: Move to F22 tripleo nodes  https://review.openstack.org/24368516:07
openstackgerritDerek Higgins proposed openstack-infra/system-config: Remove F21 nodes from the tripleo cloud  https://review.openstack.org/24368616:07
*** cloudtrainme has joined #openstack-infra16:07
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196416:07
*** clarkb has joined #openstack-infra16:07
*** hemnafk is now known as hemna16:09
pabelangeryolanda: https://review.openstack.org/#/c/205596/16:09
pabelangerthat was using the custom_fragment field16:10
*** zns has quit IRC16:10
pabelangerthat allowed puppet-apache do handle some default values and us to override the rest16:10
pabelangerother wise, we need to patch vhost (or add our own into the module) to just accept a raw vhost file16:11
*** craigbr has joined #openstack-infra16:11
pabelangerpersonally, having puppetlabs-apache manage some of vhost will keep it more consistent across our nodes16:11
rhalliseyhello.  I was wondering if anyone could review a patch to enable a gating job for tripleo-containers.  Just need a second review! Thanks! https://review.openstack.org/#/c/238212/16:12
*** bexelbie has quit IRC16:13
*** rk4n has joined #openstack-infra16:13
rk4nHey everyone,16:13
rk4nI'me getting same error https://bugs.launchpad.net/openstack-org/+bug/1317957/comments/7616:13
openstackLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Fix released] - Assigned to Jimmy McArthur (jimmy-l)16:13
yolandafungi , what do you think of pabelanger's approach?16:13
*** fhubik has quit IRC16:13
*** skolekonov is now known as _skolekonov16:14
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Copy config files tree  https://review.openstack.org/24368916:14
openstackgerritMerged openstack-infra/elastic-recheck: Add query for oslo.messaging 2.8.0 bug 1514876  https://review.openstack.org/24367416:14
openstackbug 1514796 in oslo.messaging "duplicate for #1514876 MessageHandlingServer locking deadlocks" [Critical,Fix committed] https://launchpad.net/bugs/1514796 - Assigned to Julien Danjou (jdanjou)16:15
fungiyolanda: pabelanger: that's the potential approach we'd discussed in the past. i'm not personally opposed to it, and if we've completed the transition from the old apache module version to our httpd module then we should be able to do an implementation like that with newer puppetlabs apache piecemeal if others agree16:15
clarkbI am opposed :)16:15
clarkbI don't like that custom fragment doesn't give you a complete configuration16:15
fungiwhich is why i said "if others agree"16:15
clarkbits not portable16:15
clarkbit makes it very hard to understand the config when reading the puppet manifests16:15
clarkbyou basically have to puppet apply somewhere and see what you get out16:16
funginotably, an erb template isn't entirely portable either (though it's at least easier to edit into a single working config)16:16
clarkbfungi: its portable to any erb template generator16:16
clarkbrather than being a weird conglomeration of template tooling and puppet classes16:16
pabelangerSo, lets take that discussion to puppetlabs-apache and fix it upstream.  I don't want to force people to use something they don't like, however I don't want to be forced to use a fork either :)16:17
clarkbpabelanger: I already have :/16:18
pabelangermaybe we need raw_vhost.pp or something16:18
clarkbthats why I am frustrated. granted I did this years ago16:18
*** esker has joined #openstack-infra16:18
clarkband "make all the things puppet" was the war cry16:18
clarkbdo not know if that is different now16:18
fungiyeah, it's possible they've become more receptive to that feature in the time since16:18
*** amotoki_ has quit IRC16:19
clarkbI mean it would be great if modules didn't remove features for the fun of it16:19
clarkbwhich is the other frustration, this worked fine16:19
clarkbcontinues to work fine16:20
*** nmagnezi has quit IRC16:21
*** sabeen1 has joined #openstack-infra16:21
pabelangerI was working on something recently from puppetlabs that allowed you to override a template, let me find that16:21
pabelangerthey do it in another module16:21
mgagnepabelanger: problem is there is no longer a "single" template, it's multiple templates combined with concat16:22
openstackgerritWilliam Stevenson proposed openstack/diskimage-builder: Add lldp info element for ironic-inspector  https://review.openstack.org/24369516:22
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24342516:22
mgagnepabelanger: you could insert yourself in between concat fragments but I agree it's not the same as overriding the whole template16:22
*** pc_m_AWAY is now known as pc_m16:22
*** sabeen2 has joined #openstack-infra16:23
clarkbpabelanger: I left a comment on that change with my specific concerns16:24
clarkbso its recorded there at least16:24
*** sabeen1 has quit IRC16:26
openstackgerritSebastien Badia proposed openstack-infra/project-config: layout: Fix regexp for puppet-openstack integration jobs  https://review.openstack.org/24369816:26
*** hashar has quit IRC16:26
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Replace Dashboard button with About button when logged out  https://review.openstack.org/24370016:27
*** erikwilson has joined #openstack-infra16:27
sbadiahi infra o/16:27
*** dzamboni has joined #openstack-infra16:27
*** maishsk has joined #openstack-infra16:27
sbadiaif you have time, it's possible to merge https://review.openstack.org/243698 (some puppet-openstack jobs are blocked because of this)16:27
sbadiathanks in advance!16:27
*** laughterwym has quit IRC16:27
*** laughterwym has joined #openstack-infra16:28
*** jamielennox has quit IRC16:28
*** scheuran has quit IRC16:29
pabelangerSo currently there are only _file_header, and _file_footer concat template always on.  The rest of them can be toggled.  So we could patch upstream to allow those to also be toggled which should give us an empty template to use custom_fragment as our blob of data.16:30
pabelangerthis is header: https://github.com/puppetlabs/puppetlabs-apache/blob/master/templates/vhost/_file_header.erb16:30
yolandado we have some contact point for the puppetlabs apache module?16:30
pabelangerwhich just sets vhost port, servername, serveradmin16:31
pabelangerfooter just closes virtual host16:31
*** maishsk_ has joined #openstack-infra16:32
*** maishsk has quit IRC16:32
*** maishsk_ is now known as maishsk16:32
pabelangeractually, _file_header could be stripped even more to reduce the code it includes16:32
clarkbjenkins04 is really unhappy :(16:32
pabelangerand just default to header and footer templates16:32
pabelangerwith a custom_frag in between16:32
fungii expect someone could just propose that patch as a pull request on their github project and see what they say (if it's trivial and we don't mind the potentially wasted effort, that is)16:32
*** bpokorny has joined #openstack-infra16:32
clarkbpabelanger: why not just continue to support having a passed in template?16:32
clarkbpabelanger: its the most flexible method16:32
*** mestery has joined #openstack-infra16:32
pabelangerright, we need to see what upstream says16:33
pabelangerbut they already rejected that before?16:33
*** sdake_ has quit IRC16:33
clarkbpabelanger: over beers at a conference16:33
*** bardia has joined #openstack-infra16:33
pabelangerokay16:33
clarkbpabelanger: I was told that the puppet community had largely decided on modeling all the thingsin puppet16:33
clarkbeven files that are files and should be treated as files16:33
clarkband so there was resistance to go back and readd the removed feature16:34
*** Liuqing has quit IRC16:34
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Remove the "Not updated" text in project and project_group lists  https://review.openstack.org/24370516:35
*** jamesmcarthur has quit IRC16:35
pabelangerRight, and that is my concern honestly. Other people who are consuming puppetlabs-apache and migrated their configurations to the new, defacto method.  We have decided to resist it16:35
pabelangerI can't today, but I'll find some time this week to jump into puppet irc and see what they can do to help16:36
clarkbthe jenkins restarter failed against 04 with httplib.IncompleteRead: IncompleteRead(0 bytes read) so I think this is a case where if we don't run it often enough things degrade to the point of sadness. I will try to manually cleanup 04 then restart playbook against 05 06 and 0716:36
clarkbpabelanger: lets be clear we initially didn't resist it so much as module made changes that meant it was impossible for us to use the newer versions of the module16:36
clarkbpabelanger: that isn't resistance thats getting ignored by an upstream16:37
*** August1914 has joined #openstack-infra16:37
clarkbthen upstream said "well we added these new features so now you can get by" and thats when the resistance started16:37
*** sdake has joined #openstack-infra16:38
*** jamesmcarthur has joined #openstack-infra16:38
*** jlanoux has quit IRC16:39
*** jlanoux has joined #openstack-infra16:40
*** flepied has quit IRC16:40
openstackgerritsebastian marcet proposed openstack-infra/openstackid: OIDC - OpenId Connect Implementation  https://review.openstack.org/19845816:40
*** ujuc has quit IRC16:41
clarkbhrm looks like elastic-recheck may be broken too :(16:41
*** jamielennox has joined #openstack-infra16:41
clarkbbut it stopped not when when updated elasticsearch but when e-r got the pyelasticsearch patch16:41
clarkbasselin: ^ are you running it internally with that newer pyelasticsearch?16:42
clarkbI am going to have to go find logs16:42
*** harlowja_at_home has quit IRC16:42
*** salv-orlando has joined #openstack-infra16:42
*** ujuc has joined #openstack-infra16:43
*** jlanoux_ has joined #openstack-infra16:43
*** samuelBartel has quit IRC16:43
*** cdent has quit IRC16:44
*** HeOS has joined #openstack-infra16:44
*** jlanoux has quit IRC16:45
*** thedodd has quit IRC16:45
*** gchamoul has joined #openstack-infra16:45
*** reed_ has quit IRC16:46
*** ujuc has quit IRC16:48
*** placko has quit IRC16:49
jeblairhas anyone here been working with fuel folks on their gate jobs?16:50
*** __TheDodd__ has joined #openstack-infra16:50
fungii have not, afaik16:50
clarkbnot me16:50
PaulMurraytonyb, if you have a moment I have an IRC meeting change please: https://review.openstack.org/#/c/243543/16:51
jeblairtheir bit tent application is up again, and i'm trying to evaluate their progress...16:51
*** laughterwym has quit IRC16:51
jeblairi'm seeing that they have added a number of jobs, and i believe they plan to add more, but there is still substantial internal testing which could be done in infra16:51
clarkbfor jenkins04 I think the easiest thing will be to stop the server (its been in shutdown mode and not running jobs) manually clear out the slave list in config.xml and start it up :(16:52
*** gyee has joined #openstack-infra16:52
clarkbthen hopefully running the restarter playbook weekly willactually alleviate this issue16:52
clarkb(seems to have since this is the first hard fallover in a while)16:52
*** August1914 has quit IRC16:53
*** sdake has quit IRC16:54
*** baoli has quit IRC16:55
*** sergmelikyan has joined #openstack-infra16:55
*** mestery has quit IRC16:59
fungipabelanger: nice announcement on the grafana.o.o service!16:59
*** fawadkhaliq has quit IRC17:00
openstackgerritThomas Morin proposed openstack-infra/project-config: Add networking-bgpvpn jobs for bagpipe driver  https://review.openstack.org/24372517:00
*** sridhar_ram has joined #openstack-infra17:01
mgagne+1 for grafana, looks cool and didn't know about Grafyaml17:01
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Fix default port in elastic search URL  https://review.openstack.org/24372617:01
*** fedexo has quit IRC17:01
SpamapSmordred: ACK, I fell down the Debian and Ubuntu rabbit hole last night.. ended up fixing reportbug on trusty (because it was broken due to changes in Debian's BTS) so I could open the ITP for munch..  :-P17:01
mgagnethis warrants a success17:02
jeblairfungi: when does py26 die?17:03
*** trown is now known as trown|brb17:03
fungipabelanger: it would be awesome if the web interface could be tweaked so dashboards include links to the git repo for any particular yaml template17:03
fungijeblair: apevec has proposed 2014.2.4 release for november 19, so after that17:03
*** sshnaidm has quit IRC17:03
*** sorantis has quit IRC17:04
fungijeblair: i'll be out of town all next week, but can work on eol'ing stable/juno as early as the 23rd unless there's something else major to deal with (for example, gerrit upgrade fallout)17:04
*** amitgandhinz has quit IRC17:04
*** Kennan has quit IRC17:04
*** daemontool has quit IRC17:04
fungithough i'm also happy for someone else to do the eol work in my stead17:04
clarkbI was planning on doing that cleanup when I returned from post thanksgiving stuff17:04
*** ayoung has quit IRC17:04
clarkbthough thats a little late I am not sure how much stuff I will have going on before the holiday17:05
*** Kennan has joined #openstack-infra17:05
clarkbjenkins04 is starting up again17:05
*** unicell1 has joined #openstack-infra17:05
*** unicell has quit IRC17:06
clarkbonce it starts accepting jobs I will start up the playbook against 05 06 and 0717:07
asselin_clarkb, yes we are using the new pyelasticsearch. in a meeting...will get more details later if it can wait...17:07
clarkbasselin_: I think mriedem tracked it down17:07
mriedemyar https://review.openstack.org/#/c/243726/17:08
*** salv-orlando has quit IRC17:08
mriedemsame as https://review.openstack.org/#/c/238251/17:08
*** dtantsur is now known as dtantsur|afk17:09
*** burgerk has quit IRC17:10
rk4nHey, anyone can help with this ?17:10
rk4nhttps://bugs.launchpad.net/openstack-org/+bug/1317957/comments/7617:10
openstackLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Fix released] - Assigned to Jimmy McArthur (jimmy-l)17:10
clarkblets see if we can get jimmy in here17:11
clarkboh17:11
clarkbthough I read the bug comment and  Ithink this is run of the mill gerrit cla stuff17:11
clarkbrk4n: one sec I will have a link for you that should explain the problem17:11
clarkbrk4n: does https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ sort it out for you?17:12
rk4nclarkb, tnx17:12
*** baoli has joined #openstack-infra17:13
rk4nclarkb, It works, thanks again !17:14
*** Piet has joined #openstack-infra17:15
*** jlanoux_ has quit IRC17:15
*** wenlock has joined #openstack-infra17:16
*** trown|brb is now known as trown17:16
clarkbok jenkins04 just started its first job, going to start the restarts against the remaining masters now17:16
*** shashank_hegde has joined #openstack-infra17:18
*** sorantis has joined #openstack-infra17:19
*** wenlock has quit IRC17:20
*** ayoung has joined #openstack-infra17:20
*** sorantis has quit IRC17:21
lifelesstsg: sounds like a bug in neutron ?17:21
tsglifeless: yeah - the puzzling thing is neutron unit tests succeed at check stage but fail at the gate17:22
*** amitgandhinz has joined #openstack-infra17:22
openstackgerritMerged openstack-infra/puppet-openstackci: Pass zuul_revision through to zuul_scheduler class  https://review.openstack.org/23821617:22
lifelesstsg: have you asked hete about what might cause that?17:22
lifelesstsg: e.g. different clouds running the tests17:23
*** katyafervent has joined #openstack-infra17:23
katyaferventHi guys!17:23
clarkblifeless: tsg or test ordering being different17:23
dprinceany project-config cores willing to review this one: https://review.openstack.org/#/c/240938/17:23
fungitsg: i'm willing to bet it's a timeframe issue17:23
katyaferventDo you know who has access to openstack git repositories?17:23
clarkb(sorry I don't have a ton of context)17:23
dprinceThat is a stable upgrades job for tripleo ^^^17:23
tsglifeless, fungi, clarkb: so it seemed - I have been issuing rechecks all day long :)17:24
lifelessclarkb: there's a g-r patch to change the == to >= for pyeclib, doesn't change any versions actually in use17:24
lifelessclarkb: which is passing check cnosistently but failing gate consistently17:24
thervetsg, I think I'm seeing it as well17:24
thervetsg, https://review.openstack.org/#/c/164880/ looks very suspicious17:24
tsgin 5th one right now - again, check passed, and gate failed (note to notmyname)17:24
*** otter768 has joined #openstack-infra17:24
katyaferventI need to add ReadTheDocs service, so documentation will be updated automatically17:24
fungitsg: therve: is this the same neutron 35% failure rate sdague mentioned on the dev ml today?17:24
* therve looks17:24
clarkbkatyafervent: you can do that on the read the docs side without any involvement from us17:24
lifelessit is failing neutron, but I haven't seen that mail yet. [0630 yo]17:25
tsgtherve, fungi: http://logs.openstack.org/71/238771/4/gate/gate-tempest-dsvm-neutron-full/42720c5/17:25
*** gyee has quit IRC17:25
clarkbkatyafervent: we do also have a jenkins job that can trigger a read the docs update when code merges, look for rtfd in openstack-infra/project-config17:25
thervefungi, Might be, I don't think he linked a specific traceback17:25
fungitsg: therve: lifeless: http://lists.openstack.org/pipermail/openstack-dev/2015-November/079105.html17:25
clarkbdprince: any chance they take less than 3 hours to run?17:25
clarkbdprince: I have been noticing the really long tripleo job runtimes lately when trying to safely restart jenkins masters17:25
dprinceclarkb: oh my, I hope so17:26
*** matrohon has quit IRC17:26
katyaferventclarkb, yeah. we (murano team) used to have this job. but now doc job is updating docs on openstack docs since we start to use it17:26
dprinceclarkb: we had "some slowness" creep into our CI jobs recently17:26
clarkbdprince: its not a huge deal, but something to keep an eye on as you add more jobs17:26
katyaferventbut still we have links to RTD so it would be good to have it updated too (one per day)17:26
*** kzaitsev_mb has joined #openstack-infra17:26
dprinceclarkb: yeah, we aren't happy with our wall time for sure17:26
tsgfungi: not sure if it is that one, I have been watching http://status.openstack.org/elastic-recheck/data/uncategorized.html#gate-tempest-dsvm-neutron-full17:26
thervetsg, There is that "Exception: Port tap5e94508a-ca is not ready, resync needed" error in neutron log17:26
fungikatyafervent: if murano became an official openstack project and started publishing documentation to docs.openstack.org, the documentation on rtfd.org should be deprecated/removed17:27
*** dims has quit IRC17:27
fungiyou don't want your documentation duplicated in multiple places, confusing people as to which one is official17:27
katyaferventI looked hard at RTD settings, but couldn't find where automatic build cab be set up. I just find that http://read-the-docs.readthedocs.org/en/latest/webhooks.html17:27
*** dims has joined #openstack-infra17:28
tsgtherve: the one I am seeing is "AssertionError: 0 == 0 : No IPv4 addresses found in: []" most of the time17:28
thervetsg, Right, that's the top level one I got two17:28
katyaferventfungi, now it's kind of hard to find murano documentation on openstack docs, there is no links from the main page17:28
therveInterestingly that message got changed in tempest yesterday :)17:28
tsgtherve: :)17:28
*** gyee has joined #openstack-infra17:28
tsgtherve, fungi: so suggest keep trying rechecks? or file a bug?17:28
fungikatyafervent: you should discuss that with the docs team. infra doesn't really have any jurisdiction there17:29
katyaferventfungi, ok, so you are suggesting to deprecate rtd at all. Thank you!17:29
fungitsg: i recommend helping figure out why neutron broke. rechecking with that high of a failure rate is pretty wasteful17:29
openstackgerritMerged openstack-infra/elastic-recheck: Fix default port in elastic search URL  https://review.openstack.org/24372617:29
jeblairthe fuel repos are merged with the noop shared change queue because of https://review.openstack.org/23990017:29
*** otter768 has quit IRC17:29
jeblairi'm tempted to revert that and suggest that they create actual jobs for those branches17:30
fungiplease do17:30
davidlenwellhello all .. quick question about the attic.. I was trying to merge in some folders in one of our old repos into the new astara repo.. but went to find the repo in the attic and found it was empty.. https://github.com/openstack-attic/akanda  is something not complete yet?17:30
clarkbdprince: one question about https://review.openstack.org/#/c/240938/8/jenkins/jobs/tripleo.yaml changes that are made against stable/foo will hvae their zuul branch set to master because of the else block17:30
*** achanda has joined #openstack-infra17:30
clarkbdprince: I think its that way to handle periodic jobs, so its partially correct but will break changes directly against that brnach17:31
fungiyolanda: just a reminder, noop-jobs should never be mixed with any other templates or jobs which add things in the check or gate pipelines17:31
tsgfungi: agreed. will see what I can do (with my little neutron knowledge) :)17:31
*** unicell1 has quit IRC17:32
thervetsg, FWIW http://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22Found%20multiple%20IPv4%20addresses%5C%22 is how it was failing before17:32
yolandafungi, yep, they cause a union of noop + another jobs. Did i miss it?17:32
dprinceclarkb: I think that is what we are trying to test here17:32
dprinceshardy: ^^^17:32
clarkbdprince: typically we have completely split periodic and gate job templates so that we can hardcode branches in periodic and let zuul set the branch otherwise17:32
tsgtherve: LOL17:32
asselin_mriedem, so much for being proactive....17:33
*** barnaby has quit IRC17:33
tsgtherve: s/multiple IPv4 addresses/No IPv4 addresses !17:33
thervehttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22No%20IPv4%20addresses%20found%20in:%20%5B%5D%5C%22 is the new error, pretty bad last night17:33
openstackgerritJames E. Blair proposed openstack-infra/project-config: Revert "Add missing 'noop' checks to fuel-* projects"  https://review.openstack.org/24374117:33
therveA bit better during the day17:33
jeblairfungi: https://review.openstack.org/24374117:33
clarkbfungi: you may have more info on davidlenwell'squestion as you pushed the gitreviews iirc17:33
*** peterlisak has joined #openstack-infra17:34
mriedemtsg: therve: sdague was already asking in the -neutron channel this morning if the neutron team was looking into those failures17:34
davidlenwellthanks clarkb17:34
mriedemtsg: therve: first step is getting a bug reported17:34
*** mestery has joined #openstack-infra17:34
therveYeah he noticed the same exception17:35
*** esker has quit IRC17:35
*** achanda has quit IRC17:36
SpamapShttps://www.vividcortex.com/blog/2015/11/05/nobody-loves-graphite-anymore/ <-- interesting given our new grafana overlord17:36
fungiyolanda: yeah, you approved https://review.openstack.org/239900 so just wanted to make sure you're aware of the risk from those sorts of additions17:36
fungiyolanda: https://review.openstack.org/243741 is a revert of it17:37
tsgmriedem: thanks for pointing out - I saw them talking about https://bugs.launchpad.net/neutron/+bug/149718517:37
openstackLaunchpad bug 1497185 in neutron "some of api tests assume address-scope extension" [Wishlist,Incomplete]17:37
yolandafungi, yes.. missed that17:37
SpamapSmordred: I suspect requestsexceptions may cause... unrest.. in Debian17:38
*** shashank_hegde has quit IRC17:38
fungidavidlenwell: odd. i'll look17:38
SpamapSGiven the somewhat passive aggressive tone of the first sentence of the description.. "some distributions modify requests...""17:38
SpamapS(it's not actually passive aggressive, but.. it could be taken that way ;)17:39
shardydprince, clarkb: so the intention is for changes against stable/liberty branches to trigger the job with branch_override: stable/liberty17:39
davidlenwellthanks fungi17:39
clarkbshardy: that won't happen there, they will run against master because of that else block17:39
fungiSpamapS: i worried about the same, though i can't figure out how to rephrase it such that it retains accuracy without risking setting off people who are out looking for new excuses to be victims in public17:39
shardyso, IIUC we should go down the first part of the else, and end up with ZUUL_BRANCH=stable/liberty and STABLE_BRANCH=liberty17:39
SpamapSfungi: we are of the same mind on this.17:40
SpamapSfungi: Just going to rip that bandaid off.17:40
clarkbshardy: in the gate/check jobs branch won't be overridden17:40
shardyclarkb: https://review.openstack.org/#/c/240938/8/jenkins/jobs/projects.yaml17:40
clarkboh I see what you did17:40
clarkbno thats not right17:40
shardyso that line 2016 won't work?17:40
clarkbshardy: dprince you need to let zuul select branch stuff in gate/check17:40
clarkbshardy: dprince and only override in the periodic jobs17:40
shardyderekh: ^^17:40
fungiSpamapS: it seems debian-devel is returning to the temper tantrums of old. i should have expected the past year or so of relative quiet sanity wouldn't last17:40
*** jamesmcarthur_ has joined #openstack-infra17:41
*** __TheDodd__ has quit IRC17:41
clarkblet me dig up a good example job17:41
aspiersanyone know where the topic categories listed at http://lists.openstack.org/cgi-bin/mailman/options/openstack-dev are defined? I can't find them in any git repo17:41
shardyclarkb: Ok, thanks, yeah an example would be great17:41
SpamapSfungi: I think the haters were just hoarse from yelling about systemd.17:41
*** claudiub has quit IRC17:41
fungimaybe the great systemd-ing just took enough out of people that they needed a break to regain their strength for new arguments17:41
SpamapSfungi: clearly they've regained their voice. ;)17:41
fungihah!17:41
*** thedodd has joined #openstack-infra17:41
SpamapSgmta17:41
*** Ala has quit IRC17:42
clarkbshardy: dprince derekh https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n62 something as simple as that should be sufficient. Then you use the default branch override (which does nothing) for all gate/check jobs17:42
*** weshay_xchat is now known as join17:42
*** join is now known as weshay17:42
clarkbshardy: dprince derekh then you make periodic specific jobs that set branch-override to the specific branch17:42
*** jamesmcarthur has quit IRC17:42
fungiaspiers: they're set by hand, by the list admin17:42
*** jamesmcarthur_ is now known as jamesmcarthur17:42
fungiaspiers: in this case, by ttx17:43
clarkbshardy: dprince derekh the lack of an else is important there to allow zuul to control things in the "default" case17:43
aspiersfungi: ah, thanks! in that case, can I request "HA" be added as a topic?17:43
*** shashank_hegde has joined #openstack-infra17:43
aspiersttx: ^^^17:43
fungiaspiers: our mailman list configurations aren't really driven by configuration management because they're embedded inside python pickle files (maybe with mm3 this gets better)17:43
*** ujuc has joined #openstack-infra17:43
aspiersI see17:43
derekhclarkb: I'm not sure I understand, zuul in controling things, we're only setting ZUUL_BRANCH is it was unset17:44
derekh*zuul is contro...17:44
clarkbderekh: ya so that is less of an issue the more I look at it but the problem is more that you make a specific liberty job then try to run it only against liberty https://review.openstack.org/#/c/240938/8/zuul/layout.yaml17:45
clarkbderekh: typically you would just have a single gate/check job that ran against all branches, then you would hae a liberty periodic job17:45
clarkbmy confusion is mostly around lines 211017:45
clarkband 210717:45
dprinceclarkb: we are somewhat basing our jobs on the CI job name. So it is a bit weird but it allows us to not post so many openstack-infra patches (these things go into tripleo-ci)17:45
pabelangerfungi: thanks. Figured I'd add something about the launch.17:46
clarkbfrom that it appears that you are wanting override zuul on those branches which you shouldnt do17:46
pabelangerfungi: adding a link to the git repo would be pretty easy. Let me see what we can do17:46
clarkbjob at https://review.openstack.org/#/c/240938/8/jenkins/jobs/projects.yaml line 1987 shouldn't exist17:46
clarkbyou can still siwtch the job type, you just don't need to hardcode branch information17:47
shardyclarkb: so if we don't specify a branch specific job, does that mean we have to run all the jobs we run on master also on stable/liberty?17:48
fungipabelanger: awesome. it's just the first thing which came to mind when looking at the one dashboard we had there: where can i find the file which defines this dashboard?17:48
shardymaybe that is OK, but it's not what we were aiming for here17:48
clarkbshardy: yes, but you are already doing that17:48
*** jistr has quit IRC17:48
clarkbshardy: its what you are already doing...17:48
pabelangerfungi: Agreed17:48
clarkbits just a lot more complicated in jjb than it has to be17:48
fungipabelanger: i mean, i know how to find it personally, but i expect a lot of our other power users in the community to benefit from a quick link to the definition file17:48
*** ujuc has quit IRC17:49
*** barnaby has joined #openstack-infra17:49
shardyderekh: so, can we just run all the jobs on the stable branch, and figure out STABLE_BRANCH from ZUUL_BRANCH in toci_instack?17:49
*** nadya has quit IRC17:49
shardyderekh, dprince: running all the jobs on stable doesn't seem like such a bad idea17:49
derekhclarkb: ok, I think I get what you are saying, I'll try and update later tonight17:49
derekhshardy: ack17:49
clarkbderekh: ok let me know if you hvae more questions (I think the end result will make it even easier for you to avoid extra jjb patches)17:50
dprinceshardy: if we can pull it off, no17:50
derekhclarkb: thanks, will do17:50
shardyclarkb: thanks for the assistance! :)17:50
dprinceclarkb: yep, thanks for looking t this one17:50
derekhshardy: I gotta run in about 2 minutes, but will push an update later tonight unless you want to do it in the mean time17:50
thervetsg, I'll open a bug17:51
openstackgerritMerged openstack-infra/project-config: Revert "Add missing 'noop' checks to fuel-* projects"  https://review.openstack.org/24374117:51
shardyderekh: I'll give it a try and you can check it out for sanity later ;)17:51
*** AJaeger has joined #openstack-infra17:51
AJaegerkatyafervent, let's discuss on #openstack-doc, ok?17:52
derekhshardy: ack, will do17:52
katyaferventAJaeger, sure17:52
*** BobBall is now known as BobBall_AWOL17:54
openstackgerritAdam Gandelman proposed openstack-infra/irc-meetings: Rename irc meeting: akanda->astara  https://review.openstack.org/24323517:54
*** derekh has quit IRC17:55
*** abregman has joined #openstack-infra17:55
openstackgerritMatt Riedemann proposed openstack/requirements: Block oslo.messaging 2.8.0  https://review.openstack.org/24365717:56
mriedemsdague: dims: ^ had to rebase17:56
mriedemupper-constraints was updated after i made ps117:56
dimsmriedem +2A17:57
mriedemthanks17:57
AJaegerfungi, jeblair: Just reading backscroll about the noop and have a question.17:58
*** austin81 has joined #openstack-infra17:58
AJaegerWhat happens if you have a single non-voting job? Add a noop to the gate only in that case is correct, isn't it?17:59
fungiAJaeger: nope, you need to not have only non-voting jobs17:59
sdagueI'm also putting my +2 on that17:59
dimsthanks sdague17:59
*** tonytan4ever has quit IRC18:00
*** jamesmcarthur has quit IRC18:00
*** sergmelikyan has quit IRC18:00
fungiAJaeger: it's pretty easy to have a very simple job that does nothing at all, or better, checks that your docs build successfully or that your coding style meets some basic convention18:01
*** abregman is now known as abregman|mtg18:02
AJaegerfungi: then I gave wrong advice in the past ;( Let me clean that one up. To be sure:18:02
AJaegerhttp://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n6044 is wrong, isn't it?18:02
AJaegerI mean the "gate: noop"18:02
krotscheckfungi: Quick touch base- what's the status on those wheel patches?18:02
pabelangerEmilienM: Did you ever fix your regex issue? Was it an order problem in zuul?18:02
flaper87mordred: got a response, the issue is being taken care of!18:02
*** maishsk has quit IRC18:03
* krotscheck forgot the patch #'s :(18:03
*** krtaylor has quit IRC18:03
*** alivigni has quit IRC18:03
fungiAJaeger: it's not great, though at least there are no other gate jobs (only check)18:03
krotscheckAh, nevermind!18:03
krotscheckFound 'em.18:03
fungiAJaeger: i assume, without looking, that those check jobs are both non-voting which is why neither is in the gate pipeline?18:04
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Add Docker job to tripleo CI  https://review.openstack.org/23821218:04
krotscheckgreghaynes: I remember there being two wheel patches. I found 165240, which is the other one?18:04
fungiAJaeger: oh, actually at least one of them must be voting because noop is only applied to the gate pipeline18:04
greghayneskrotscheck: https://review.openstack.org/#/c/164927/18:05
*** jordanP has quit IRC18:05
*** amitgandhinz has quit IRC18:05
fungiAJaeger: so in that case it's not mixing noop and other jobs in a pipeline, so it's not going to cause non-noop jobs to get dragged into the noop queue for the gate, but it's still very confusing and leaves me wondering why they don't have gate jobs if they have working check jobs18:05
*** shashank_hegde has quit IRC18:06
krotscheckgreghaynes: Danke18:07
*** craigbr has quit IRC18:07
*** dramalho has quit IRC18:07
*** craigbr has joined #openstack-infra18:08
*** bardia has quit IRC18:08
*** unicell has joined #openstack-infra18:09
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Set STABLE_BRANCH based on ZUUL_BRANCH  https://review.openstack.org/24375518:09
*** rebase has joined #openstack-infra18:09
AJaegerfungi: all jobs for network-checker are non-voting18:10
*** cloudtrainme has quit IRC18:10
fungidavidlenwell: i found the problem. it looks like our maintenance plan was built from a list that had openstack/akanda getting renamed to openstack-attic/akanada (note the extra "a")18:10
AJaegerfungi, so problem is mixing noop and others in one pipeline - ok, I see that. But should I review differently for things like network-checker in the future?18:10
fungiAJaeger: odd. and changes still get a +1 even with no voting jobs?18:10
*** sputnik13 has joined #openstack-infra18:10
*** sputnik13 has quit IRC18:11
AJaegerfungi: let me check...18:11
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add new context manager for shade exceptions, cont. again  https://review.openstack.org/24322118:11
*** sputnik13 has joined #openstack-infra18:11
fungiAJaeger: mostly i would recommend to projects that they behave like other projects (run at least some jobs that vote in check and gate, or run no jobs at all)18:11
asselin_fungi, AJaeger I did notice that before. if all jobs are non-voting, then it's a +118:11
AJaegerfungi: yes, seems to work: https://review.openstack.org/#/c/239639/18:11
*** yfried_ has joined #openstack-infra18:12
fungiAJaeger: and also they need jobs that vote on all their branches, not just master (adding noop to get around some branches having no jobs is the main issue causing projects to try to merge other jobs into the noop queue)18:12
AJaegerfungi: isn't this part of the bootstrapping? No jobs, then add them as experimental, then non-voting to check?18:12
openstackgerritSteven Hardy proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093818:13
rhalliseyclarkb, Hi.  I was wondering if I could get some feedback regarding https://review.openstack.org/#/c/238475/18:13
AJaegerfungi: yeah, I see that noop issue with fuel now and will not let it in again.18:13
fungiAJaeger: i always expected them to add jobs which initially did nothing successfully and then they tweak the tests being run in their project to actually test things18:13
*** dramalho has joined #openstack-infra18:14
shardyclarkb: ^^ I hope I interpreted your comments correctly, now we only set branch-override for the stable periodic job18:14
*** tsg has quit IRC18:14
fungiAJaeger: that helps test the test framework itself as they implement their tests18:14
shardyand I assume ZUUL_BRANCH will be set to that override, so we just look at ZUUL_BRANCH to determine what branch we're consuming18:14
AJaegerfungi: so, you suggest for pep8 to start with "true" or just disabling tests until some pass?18:15
*** krtaylor has joined #openstack-infra18:15
fungiAJaeger: yeah, that way they can test their tests without having to do lots of additional patches to project-config18:16
clarkbshardy: the override doesn't affect the other env var18:16
shardyclarkb: OK, so I still need the test for branch override explitly18:16
AJaegerfungi, thanks will recommend next time when I stumble over this.18:16
shardybut not the else18:16
clarkbyou should do just like the example I linked18:16
clarkbif not default set OVERRIDE_ZUUL_BRANCH done18:17
fungiclarkb: davidlenwell: so anyway, i'm thinking we're stuck needing another gerrit outage to correct openstack-attic/akanada -> openstack-attic/akanda18:17
*** PaulMurray is now known as ptm_away18:17
clarkbrhallisey: just be careful with iscsi18:17
*** tsg has joined #openstack-infra18:17
clarkbfungi: ok, though thats less urgent if davidlenwell can just fetch from that (wrong) location?18:17
AJaegerfungi, should we cleanup the existing cases - or wait for the projects to do it? There're a few more with "noop" only in the gate...18:17
*** trown is now known as trown|flu_shot18:18
clarkbrhallisey: also I think you will conflict iwth shardy's change18:18
AJaegerbtw. I see opencafe with voting check job, let me clean that one up...18:18
*** tsg has quit IRC18:18
fungiclarkb: davidlenwell: i don't think the wrongly-named openstack-attic/akanada is being served by anything at the moment, since it was a typo in the maintenance plan cut-n-paste commands/queries but not in the project-config change18:19
*** tsg has joined #openstack-infra18:19
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use same job for check and gate for opencafe  https://review.openstack.org/24375818:19
clarkbfungi: gerrit isn't serving it?18:20
fungiclarkb: davidlenwell: basically we still have the data in the database and on the filesystem but no corresponding project configuration in gerrit/cgit and no replication for it18:20
fungiit's possible it can be cloned directly from gerrit. i didn't check that18:20
clarkbgit clone https://review.openstack.org/openstack-attic/akanada seems to work18:21
fungiyep, just confirmed18:21
fungidavidlenwell: ^ temporary workaround18:21
openstackgerritSteven Hardy proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093818:21
rhalliseyclarkb, ok, I can rebase off of shardy.  My change is pretty tiny.18:21
AJaegerfungi, after the change above we have now gate only noop in fuel-menu, network-checker, shotgun.18:21
fungizaro: i have a feeling the misnamed openstack-attic/akanada repo will need correcting before the gerrit upgrade next week18:21
openstackgerritShamail Tahir proposed openstack-infra/irc-meetings: Adding User Committee Meeting to IRC Schedule.  https://review.openstack.org/24375918:21
shardyclarkb: Ok, thanks - I added back in the OVERRIDE_ZUUL_BRANCH as in the example you posted18:22
fungii need to get started prepping for our meeting18:22
*** abitha has joined #openstack-infra18:22
*** ayoung_ has joined #openstack-infra18:23
*** tsg has quit IRC18:23
*** tsg has joined #openstack-infra18:23
*** kozhukalov_ has quit IRC18:23
*** achanda has joined #openstack-infra18:25
*** ayoung has quit IRC18:25
*** ayoung_ is now known as ayoung18:26
*** sfinucan_ has joined #openstack-infra18:26
*** sfinucan has quit IRC18:26
openstackgerritSteven Hardy proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093818:27
*** bnemec has quit IRC18:29
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Change publishers scp to use list for sources  https://review.openstack.org/24376718:31
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Remove deprecated getChildren() usage  https://review.openstack.org/24376818:33
*** rk4n has quit IRC18:34
*** craigbr has quit IRC18:35
*** craigbr_ has joined #openstack-infra18:35
*** cloudtrainme has joined #openstack-infra18:35
*** ilyashakhat_mobi has joined #openstack-infra18:35
*** angdraug has joined #openstack-infra18:36
clarkbshardy: thats close, just a few small comments but otherwise thats more like what I expected18:36
*** hdd has quit IRC18:36
shardyclarkb: Ok, thanks for the feedback!18:37
*** signed8bit is now known as signed8bit_ZZZzz18:37
*** bardia has joined #openstack-infra18:38
*** kozhukalov_ has joined #openstack-infra18:39
openstackgerritSteven Hardy proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093818:40
*** sdake has joined #openstack-infra18:40
bardiathe authorized_key in the image that nodepool builds does not match the NODEPOOL_SSH_KEY/jenkins_key.pub thats entered in the yaml file. Anyone encountered this issue before?18:40
bardiabecause of this nodepool can't ssh into the instance that comes up in devstack18:41
*** achanda has quit IRC18:41
clarkbbardia: its up to you to get that set properly in your image builds18:42
bardiaclarkb: thats the thing I have set it up properly18:42
bardiaI followed the puppet-openstackci README that's under review18:42
bardiaeverything looks fine18:42
bardiais there anyway to manually overwrite that file in the image?18:44
*** ujuc has joined #openstack-infra18:44
*** yamahata has joined #openstack-infra18:46
asselin_bardia, hi, did you manually build the image or with nodepool as a service?18:46
bardiamanually built it18:46
bardianodepool image-build18:46
asselin_bardia, did you source /etc/defaults/nodepool first?18:46
*** craigbr_ has quit IRC18:46
bardiayes18:46
asselin_bardia, ok, please check the contents of that file18:46
bardiaI made sure NODEPOOL_SSH_KEY is in env18:46
*** craigbr has joined #openstack-infra18:47
bardiaNODEPOOL_SSH_KEY in env matches the jenkins_key.pub18:47
clarkbwhat readme?18:47
bardiahttps://review.openstack.org/#/c/227584/9/contrib/README.md,unified18:47
*** barnaby has quit IRC18:48
clarkbthe one I see is one paragraph and doesnt say anything about images18:48
*** signed8bit_ZZZzz is now known as signed8bit18:48
clarkbthanks18:48
asselin_bardia, if you follow the instructions here https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool18:49
asselin_you can mount the image you built and inspect the authorized_keys file18:49
asselin_https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/README.rst#n4318:49
*** gouthamr has joined #openstack-infra18:49
bardiaasselin_: does nodepool image-build take NODEPOOL_SSH_KEY value and sticks it into image under /home/jenkins/.ssh/authorized_keys every time you build the image?18:49
asselin_bardia, otherwise, double-check the private key is correct18:49
asselin_bardia, yes18:50
clarkbexport NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'` is how it says to set it18:50
*** nadya has joined #openstack-infra18:50
*** ujuc has quit IRC18:50
asselin_bardia, double check the private key here: /home/nodepool/.ssh18:51
*** doug-fis_ has joined #openstack-infra18:52
bardiaasselin_: that should match the jenkins_key private key right?18:52
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add description to zuul-status dashboard  https://review.openstack.org/24377518:52
pabelangerfungi: that should get us started ^18:52
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode  https://review.openstack.org/22114318:52
asselin_bardia, yes18:52
*** alivigni has joined #openstack-infra18:53
asselin_bardia, jenkins_ssh_private_key in your hiera common.yaml18:53
bardiaasselin_: /home/nodepool/.ssh/id_rsa matches the jenkins_key private key I have in single_node_ci_hiera.yaml file18:53
asselin_(or that...I recently changed the name)18:53
*** mriedem has quit IRC18:53
bardiayes i'm aware18:53
*** kozhukalov_ has quit IRC18:54
bardiaasselin_: the problem is that the content of the /home/jenkins/.ssh/authorized_keys does not match the jenkins_key.pub18:54
asselin_bardia, try to manual build a vm with that image and manually log in with the key18:54
*** mestery has quit IRC18:54
asselin_bardia, yes that will break it18:55
bardiaasselin_: that's what I have been trying to do pub the key gets denied18:55
*** nadya has quit IRC18:55
pabelangertimrc: think we'll need to add some sort of global element that we can use for global settings on dashboards. Like time and adding rows18:55
asselin_bardia, so you're using the latest project-config elements? any modifications?18:55
*** doug-fish has quit IRC18:55
bardiacan you point me to where in image-build grabs the NODEPOOL_SSH_KEY value and writes it to /home/jenkins/.ssh/authorized_keys18:56
* asselin_ looks it up18:56
*** armax has quit IRC18:56
pabelangertimrc: for example: https://review.openstack.org/#/c/243775/118:56
*** Sukhdev has joined #openstack-infra18:56
*** ybathia has joined #openstack-infra18:56
*** ybathia has quit IRC18:56
pabelangertimrc: don't want to manually add that to every dashboard18:56
bardiaasselin_: I setup my env last week. Has there been changes to the nodeopool?18:56
jeblairnibalizer: dude.  polygerrit.  :)18:57
asselin_bardia, I just setup a test system last week also and it works18:57
*** shashank_hegde has joined #openstack-infra18:57
*** maishsk has joined #openstack-infra18:58
*** pvaneck has joined #openstack-infra18:58
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add description to zuul-status dashboard  https://review.openstack.org/24377518:58
*** baoli has quit IRC18:58
*** mriedem has joined #openstack-infra18:58
asselin_bardia, this is new: http://hound.openstack.org/?q=NODEPOOL_SSH_KEY&i=nope&files=&repos=18:58
asselin_bardia, which points to here: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/prepare_node.sh#n12718:59
*** amuller is now known as amuller_afk18:59
*** shashank_hegde has quit IRC18:59
*** thedodd has quit IRC18:59
asselin_bardia, actually this is what you're using: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n2718:59
*** trown|flu_shot is now known as trown18:59
fungimeeting time! head for #openstack-meeting ye scallywags18:59
*** tsg has quit IRC19:00
jheskethMorning19:00
pabelangerwow, sneaks up on ya19:00
clarkbsilly DST switch19:00
timrcpabelanger: Sounds like we may consider contributing upstream some sort of meta object we can use with the API.19:00
*** gondoi is now known as zz_gondoi19:02
bardiaasselin_: yeah I have that code in my project-config/nodepool/elements19:02
bardiaasselin_: has your changes been committed to master?19:03
*** achanda has joined #openstack-infra19:03
asselin_bardia, which ones of my changes?19:03
*** baoli has joined #openstack-infra19:03
*** julim has joined #openstack-infra19:03
bardiahttps://review.openstack.org/#/c/227584/19:03
*** onovy has joined #openstack-infra19:04
*** abregman|mtg has quit IRC19:04
*** barnaby has joined #openstack-infra19:04
*** tiswanso has quit IRC19:05
onovyhi, creating new openstack related project, so not openstack official. Should IRC channel be #openstack-swauth or #swauth or it doesn't matter?19:05
asselin_bardia, not yet merged. Still needs some reviews.19:05
*** tiswanso has joined #openstack-infra19:05
asselin_bardia, if you are successful, then I think we can merge it :)19:05
*** tsg has joined #openstack-infra19:05
bardiaasselin_: I'm close to being done. just need to figure out this ssh issue19:06
asselin_bardia, please try it again with a few minor adjustments19:07
*** kushal has joined #openstack-infra19:07
asselin_bardia, first export DIB_OFFLINE=true to make it go faster19:07
timrcpabelanger: I just want to avoid getting too hacky ya know?19:07
bardiaasselin_: ok thanks19:07
timrcpabelanger: Seems like grafana is lacking something that'd be generally useful.19:08
asselin_bardia, then doublecheck set | grep NODEPOOL and double check the correct key is there19:08
pabelangertimrc: Ya, I think we could make an effort to push this upstream. but I do think we need some sort of global section for yaml file that we copy / paste all over the place19:09
*** achanda has quit IRC19:09
asselin_bardia, then capture the log output19:09
asselin_whenyou  build the image19:09
*** nadya has joined #openstack-infra19:09
bardiaasselin_: ok thanks I will give it a try in a bit19:09
* SpamapS unleashes the requestsexceptions flamewar on debian-devel19:10
*** shashank_hegde has joined #openstack-infra19:10
asselin_bardia, so that you can capture the part of the script that sets the ssh key19:10
timrcpabelanger: Maybe our parser can look for an "include" keyword :) Uh oh we're starting to create our own DSL.19:10
pabelangertimrc: Ya, not sure we want to do that.  I was looking at anchors, but they don't work across multiple files. So, considering a global: element that we deal with at run time19:11
pabelangernot sure I want to try includes again19:12
*** ociuhandu has quit IRC19:12
*** achanda has joined #openstack-infra19:12
*** achanda has quit IRC19:13
*** electrofelix has quit IRC19:13
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Remove duplicate version code  https://review.openstack.org/24378519:13
*** markvan has quit IRC19:14
*** kushal has quit IRC19:15
pabelangerjeblair: so I haven't been able to reproduce uwsgi pinning on stackaltyics.o.o today. Not sure if my timing is off or what19:15
pabelangerI've connect about 3 different times now, and the page loads correctly everytime19:15
jeblairpabelanger: any evidence in cacti?19:15
pabelangerjeblair: good call, checking19:15
*** skraynev has quit IRC19:16
*** kushal has joined #openstack-infra19:16
timrcpabelanger: It can be added automatically when the dashboard is added to grafana... so when grafyaml loads a dashboard it prefixes a template which includes that info.19:17
*** amitgandhinz has joined #openstack-infra19:18
*** sputnik13 has quit IRC19:18
pabelangerjeblair: will give in 20mins or so. Looks like last spike was at 18:20 UTC19:19
pabelangercoming up on an hour19:19
*** sputnik13 has joined #openstack-infra19:19
pabelangertimrc: Ya, that is what I am thinking too. Either prefix or postfix new global field into existing dashboard, then upload19:20
ilyashakhat_mobipabelanger: hi!19:21
pabelangerilyashakhat_mobi: ohai19:21
*** dprince has quit IRC19:21
*** abregman has joined #openstack-infra19:21
ilyashakhat_mobihow's stackalytics.o.o doing?19:21
pabelangerilyashakhat_mobi: good, it is live now. Just doing tuning19:22
greghaynescrinkle: yolanda rcarrillocruz SpamapS Hey - so I think the situation in US West has changed for infra-cloud and crinkle has managed to revive our hardware for now! I'd kind of like to do a quick conf call deal to make sure were all up to date on the state of things / what we want to focus on for getting terrible-cloud set up19:22
pabelangerilyashakhat_mobi: we noticed yesterday that uwsgi spikes to 100% every hour or so.  Think it has to do with vault update process.  Do you see that on stackalytics.com?19:23
pabelangerilyashakhat_mobi: when pinned to 100% it was taking 10mins to load data19:23
rcarrillocruzgreghaynes: sounds good to me19:23
yolandagreghaynes, that's good news19:23
crinklegreghaynes: okay19:24
rcarrillocruzactually, crinkle greghaynes SpamapS i wanted to ask you. In the change from crinkle to setup the puppet for the infra_cloud I see inventory_dhcp set to true:19:24
rcarrillocruzhttps://review.openstack.org/#/c/231757/7/templates/bifrost/bifrost_global_vars.hpuseast.erb19:24
calebbim having an issue creating a container with shade "shade.exc.OpenStackCloudException: Container fetch failed:  (/) (Inner Exception: No tenant specified)" (from the get_container() method) on hpcloud19:25
greghaynesrcarrillocruz: crinkle yolanda SpamapS does 17:30 UTC tomorrow work for you all?19:25
rcarrillocruzthat implies dnsmasq will put static ip address. Is that intended? I mean, that will require we put files with matching values for each host with each IP19:25
yolandaworks for me19:25
ilyashakhat_mobipabelanger: dashboard polls update from memcached every hour, this includes reading of changed records and rebuilding of indexes; if there are many records updated (like during initial load) the operation can be quite long19:25
*** otter768 has joined #openstack-infra19:25
rcarrillocruzgreghaynes: that works ok19:25
*** amitgandhinz has quit IRC19:25
rcarrillocruznm, i can probably ask about that in tomorrow's call for clarification19:25
*** ihrachys has quit IRC19:25
*** yamahata has quit IRC19:25
*** amitgandhinz has joined #openstack-infra19:26
pabelangerilyashakhat_mobi: Ah, okay. So maybe we were seeing the lag because we just brought the system online19:26
crinklegreghaynes: that works for me19:26
pabelangerilyashakhat_mobi: and each time it reloads now, the data is a small subset19:26
*** yamahata has joined #openstack-infra19:26
ilyashakhat_mobipabelanger: i haven't seen any significant slowness in prod during normal operation19:26
adam_gany infraz around to +W a trivial? https://review.openstack.org/#/c/243349/19:26
greghaynesrcarrillocruz: Yea, so there is some funkyness in how we are doing the dhcp/networking because of the whole vlan tagged interface19:26
pabelangerilyashakhat_mobi: Ya, things are running better today.  Which make sense, because not much new data has been parsed19:27
greghaynesrcarrillocruz: Basically we are statically configuring /e/n/i in all the bm hosts so they dhcp19:27
greghaynesrcarrillocruz: which means we need static leasing info on the bm controller19:27
SpamapSgreghaynes: 1730 UTC tomorrow should be fine19:27
rcarrillocruzerm yeah, having issues to get clients to send dhcp requests because of that19:27
*** skraynev has joined #openstack-infra19:27
AJaegeradam_g: I'm reviewing...19:27
rcarrillocruzgreghaynes: ok, then i think we should have some ansible automation to create from the inventory the dnsmasq leases file19:27
rcarrillocruzto avoid putting all that manually19:27
adam_gAJaeger, ty!19:27
*** abregman has quit IRC19:27
*** maishsk_ has joined #openstack-infra19:27
pabelangerilyashakhat_mobi: so under apache, here is our current memory usage: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2908&rra_id=all19:27
rcarrillocruzunless yo u have already set for that?19:27
greghaynesrcarrillocruz: Yes, there were some patches for bifrost, I dont know where they ended up19:28
rcarrillocruzsome script, ansible, whichever19:28
pabelangerilyashakhat_mobi: Does that look inline with nginx?19:28
rcarrillocruzah ok19:28
rcarrillocruzi can follow up with TheJulia19:28
rcarrillocruzthey better be on bifrost , nod19:28
ilyashakhat_mobipabelanger: yes, pretty similar19:29
greghaynesrcarrillocruz: SpamapS crinkle yolanda ok, 17:30 UTC tomorrow in conf room 7000 on https://wiki.openstack.org/wiki/Infrastructure/Conferencing19:29
rcarrillocruzoh19:29
*** maishsk has quit IRC19:29
*** maishsk_ is now known as maishsk19:29
ilyashakhat_mobipabelanger: the drop on the first chart was when the processor finished, right?19:29
yolanda++19:29
* rcarrillocruz is excited , never used infra pbx 19:29
rcarrillocruz++19:29
yolandayep, first time as well19:29
pabelangerilyashakhat_mobi: ya19:29
rcarrillocruzi think we could also talk about how to centralize all communications, tasks done, etc19:30
*** otter768 has quit IRC19:30
rcarrillocruzwe should consolidate it 'somewhere', not sure what tool to be honest19:30
rcarrillocruzthere will be stuff internal to HP, and some other that should be public to infra19:30
yolandayep, we need something to reflect all documentation, all tasks, etc19:30
*** emildi has joined #openstack-infra19:30
rcarrillocruzfungi: we'd appreciate your input ^19:30
pabelangerilyashakhat_mobi: we had some initial talks about moving memcached and processor to another system. But I think we are fine for the moment with this setup19:30
rcarrillocruzdon't want to keep all the stuff we've been doing in the shadow19:31
*** tonytan4ever has joined #openstack-infra19:31
greghaynesrcarrillocruz: there are tickets we have been updating. The problem is our last state was basically "we cant do anything"19:31
rcarrillocruzyeah19:31
rcarrillocruzit's going to be tricky19:31
greghaynesbut that changed19:31
fungircarrillocruz: a good start is participating in the infra meeting. in fact, it's going on now ;)19:31
greghaynesso yea, we should regroup and get that stuff up to date19:31
rcarrillocruzcos it's hosted in HP, what we put on public so everything is on hte same page, etc19:32
*** armax has joined #openstack-infra19:32
pabelangerany infra-root mind approving https://review.openstack.org/#/c/242890/ and https://review.openstack.org/#/c/242892/19:32
rcarrillocruzfungi: aye, arrived home 10min ago (bit late :/)19:32
*** mestery has joined #openstack-infra19:32
rcarrillocruzwill propose for the agenda next meeting19:32
fungicool19:32
bardiaasselin_: do you know the password for the jenkins user on the image that nodepool builds19:32
*** devl_ has quit IRC19:32
pabelangerilyashakhat_mobi: so I think based on your answers, we're pretty good for the moment. Going to let this setup run for a while and continue tweaking the server19:32
clarkbbardia: it should be passwordless19:32
asselin_bardia, no password, only ssh key authentication19:33
clarkbright that, not that logins are allowed iwthout a pssword19:33
*** dtardivel has quit IRC19:33
bardiaso I can't login to the instance through console?19:33
*** ybathia has joined #openstack-infra19:33
*** Shrews has quit IRC19:33
ilyashakhat_mobipabelanger: I don't see any difference in UI speed between s.o.o and s.com19:33
*** jamesmcarthur has joined #openstack-infra19:33
asselin_bardia, correct19:33
bardiaok thanks19:34
*** tsg has quit IRC19:34
rcarrillocruzanyway, tty tomorrow folks, out to walk the dogs and then Mario's bath19:34
pabelangerilyashakhat_mobi: thats good news19:34
asselin_bardia, if you like, in horizon, you can launch a node and setup your you ssh key pair for the 'ubuntu' user19:34
asselin_bardia, using the uploaded image19:34
*** Shrews has joined #openstack-infra19:34
bardiaasselin_: thanks I will try that19:35
*** zz_gondoi is now known as gondoi19:35
ilyashakhat_mobipabelanger: if we ran out of 15G it would be possible to move memcached to another host(s), but it will slow the update and reading of activity log19:35
ilyashakhat_mobipabelanger: but it's something to talk next year :)19:36
*** taron has quit IRC19:36
*** mestery has quit IRC19:36
pabelangerilyashakhat_mobi: Ya, I suspect we'll need to figure out something moving forward. Next step for us is a 30GB instance, which would require some paper work to get :)19:36
*** taron has joined #openstack-infra19:38
pabelangerilyashakhat_mobi: I also think some next steps are maybe moving the default_data.json out of stackalytics into project-config.  But no rush to do that right now19:39
ilyashakhat_mobipabelanger: in this case we'll be no more the project with the largest number of contributors :019:40
ilyashakhat_mobipabelanger: do you have plans to have driverlog instance?19:41
pabelangerilyashakhat_mobi: not yet, I haven't looked into it. But something we should likely do too?19:41
ilyashakhat_mobipabelanger: yes, it's a place where all drivers are listed (very similar to stackalytics)19:42
*** amotoki has quit IRC19:42
ilyashakhat_mobipabelanger: and its data is used at marketplace19:42
pabelangerilyashakhat_mobi: Ya, if that is something -infra should run, I could see what is needed to migrate that over.19:42
pabelangerwill read up on it later today19:42
openstackgerritOndÅ™ej Nový proposed openstack-infra/project-config: WIP: New project "swauth"  https://review.openstack.org/24379519:42
openstackgerritMerged openstack-infra/project-config: Revert pinning of astara to stable/liberty  https://review.openstack.org/24334919:43
ilyashakhat_mobipabelanger: ok19:43
ttxaspiers: no time now, could you send me an email ?19:44
pabelangerilyashakhat_mobi: Right now, I expect stackalytics.o.o to run a few more weeks before we decide to pun anything around19:44
pabelangerilyashakhat_mobi: and sure there will be more questions for you too :)19:45
pabelangerthanks again for all your help19:45
ilyashakhat_mobipabelanger: you're welcome19:46
*** thedodd has joined #openstack-infra19:46
*** cloudtrainme has quit IRC19:46
ilyashakhat_mobipabelanger: btw, how often do you plan to redeploy the code?19:47
pabelangerilyashakhat_mobi: puppet runs every 30mins, so any updates should be live then19:47
ilyashakhat_mobipabelanger: but does it restart uwsgi process?19:48
aspiersttx: sure, thanks!19:48
ilyashakhat_mobipabelanger: (cause it's time-consuming)19:48
pabelangerilyashakhat_mobi: Oh, no we don't restart uwsgi yet19:48
pabelangerso, guess we should figure that out19:48
pabelangerilyashakhat_mobi: we are actually thinking of using max-worker-lifetime to deal with process reloads19:49
pabelangerbut haven't tried it yet19:49
pabelangerilyashakhat_mobi: what do you do?19:49
openstackgerritShamail Tahir proposed openstack-infra/irc-meetings: Updating meeting channel and time for Product WG.  https://review.openstack.org/24379919:49
*** abregman has joined #openstack-infra19:50
*** ayoung has quit IRC19:50
ilyashakhat_mobipabelanger: i redeploy and restart manually, during low hours - and do it quite rarely19:50
openstackgerritPhilip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work  https://review.openstack.org/23981019:50
*** emildi has quit IRC19:51
*** emildi has joined #openstack-infra19:51
phschwartzasselin_: ^^ done19:51
pabelangerilyashakhat_mobi: Ya, so we'll need to work out some sysadmin stuff it sounds like.  I suspect that's what we'll be working on before cutting over19:51
*** baoli has quit IRC19:51
* asselin_ looks19:51
*** daemontool has joined #openstack-infra19:51
*** mestery has joined #openstack-infra19:51
*** tsg has joined #openstack-infra19:52
*** yfried_ has quit IRC19:52
*** rebase has quit IRC19:52
*** yfried_ has joined #openstack-infra19:52
*** yfried_ is now known as yfried|afk19:52
*** gondoi is now known as zz_gondoi19:54
*** kushal has quit IRC19:54
*** zz_gondoi is now known as gondoi19:55
*** emildi has quit IRC19:56
*** emildi has joined #openstack-infra19:56
*** baoli has joined #openstack-infra19:56
*** ctlaugh has quit IRC19:57
*** nelsnelson has quit IRC19:59
*** hdd has joined #openstack-infra20:00
samueldmqhi, any project-config core around for a quick review ? https://review.openstack.org/#/c/24145220:00
*** nelsnelson has joined #openstack-infra20:00
*** sdake has quit IRC20:00
samueldmqit is about promoting a gate from experimental to non-voting20:01
samueldmqit already has approval from people of specific projects and a +220:02
samueldmqjust needs another +2 and workflow :)20:02
*** baoli has quit IRC20:02
*** baoli has joined #openstack-infra20:03
*** baoli has quit IRC20:04
*** sabeen2 has quit IRC20:05
*** baoli has joined #openstack-infra20:05
*** gondoi is now known as zz_gondoi20:06
openstackgerritPaul Van Eck proposed openstack-infra/puppet-refstack: Refresh apache on api changes  https://review.openstack.org/24380920:06
AJaegersamueldmq: shall this job run on stable/mitaka in the future?20:06
*** mestery_ has joined #openstack-infra20:07
*** baoli has quit IRC20:08
openstackgerritMerged openstack/os-testr: Fix syntax of the README file  https://review.openstack.org/23006520:08
*** maiteb has joined #openstack-infra20:08
cbaderI am seeing issues with devstack failure on ebtables not loading anyone seen this or how to correct it?20:08
*** nadya has quit IRC20:08
yolandagreghaynes, trying to check for that bifrost change for fixed ip address, no idea where it is20:09
samueldmqAJaeger: I think it makes sense, to ensure this behavior is consistent from this cycle20:10
*** bdemers has quit IRC20:10
greghaynesyolanda: it was a SpamapS change, maybe he abandoned it?20:10
samueldmqAJaeger: I am not sure what the policy is20:10
*** mestery has quit IRC20:10
yolandaah, i was looking for your owner or crinkle, going to try SpamapS20:11
greghaynesyolanda: https://review.openstack.org/#/c/217374/20:11
samueldmqjamielennox: you around ? ^20:11
greghaynesyolanda: even better, merge20:11
jamielennoxsamueldmq: vaguely20:11
yolandacool20:11
AJaegersamueldmq: in that case use a different regex for the branch20:11
AJaegerlet me ask in the review...20:11
yolandagreghaynes , so we can try tomorrow with that, thanks20:11
*** yamahata has quit IRC20:11
samueldmqjamielennox: about the v3 gate, do we want to have it in stable/mitaka ?20:12
samueldmqjamielennox: or just keeping it running in the master branch is enough ?20:12
jamielennoxmitaka? you mean liberty?20:12
*** zz_ja is now known as zz_zz_ja20:12
jamielennoxi'm happy for it to just be master20:12
jamielennoxatm we just want it running20:12
samueldmqjamielennox: mitaka, so the job would be appropriate when we release mitaka in the future20:13
samueldmqjamielennox: but I agree in master is enough for now, just would like to confirm with you20:13
samueldmqAJaeger: cc ^20:13
samueldmqAJaeger: we're happy to keep it just in master for now, plans are to ake keystone auth api v3 default in devstack this cycle, once we get that, we can think about whether to putit in stble/mitaka or not20:14
*** ldnunes has quit IRC20:14
AJaegersamueldmq: ok. Sorry, have to leave now, hope somebody else reviews.20:15
samueldmqAJaeger: sure, no problme20:15
*** bhunter71 has joined #openstack-infra20:16
*** mestery_ has quit IRC20:16
*** AJaeger has quit IRC20:16
*** unicell has quit IRC20:17
*** unicell has joined #openstack-infra20:17
*** jffische has quit IRC20:18
bhunter71a question, probably one I've asked before.    What's the secret to keeping a bandersnatch happy?   Every couple of months, I end up with a situation with a "todo" file with some broken serial# in it that immediately causes run-bandersnatch to fail.   I've tried some curl against pypi.python.org, but it didn't help - so I just delete the todo file.20:18
openstackgerritMerged openstack-infra/project-config: Create monasca-api tempest job  https://review.openstack.org/24060020:18
*** gyee has quit IRC20:18
*** r-daneel has joined #openstack-infra20:18
*** cbader has left #openstack-infra20:19
*** unicell has quit IRC20:21
*** unicell has joined #openstack-infra20:21
pabelangerfungi: when you have a moment, wouldn't mind you weighing in: https://review.openstack.org/#/c/243650/20:22
*** ctlaugh has joined #openstack-infra20:22
*** cbader has joined #openstack-infra20:23
*** amitgandhinz has quit IRC20:24
*** amitgandhinz has joined #openstack-infra20:24
*** kzaitsev_mb has quit IRC20:24
maitebhey guys, I need some help... we are having some issues running tests for puppet-jenkins in trusty that I can't reproduce in my dev environment. As the error says that it can't connect to https://localhost, I'm wondering if there is something related to a lack of certificate at the host, I don't know. There is anyone that can help me with that? (logs here: http://logs.openstack.org/28/220228/9/chec20:25
maitebk/gate-puppet-jenkins-puppet-beaker-rspec-dsvm-trusty-nv/64bb7f6/console.html)20:25
maitebcorrect link: http://logs.openstack.org/28/220228/9/check/gate-puppet-jenkins-puppet-beaker-rspec-dsvm-trusty-nv/64bb7f6/console.html20:25
*** dramalho has quit IRC20:25
*** lifeless has quit IRC20:26
pabelangermaiteb: that looks to be an issue with apt mirros20:26
pabelangermirrors*20:26
maiteboh sorry, just saw that the error was changed when I was writting this message20:27
maitebwe got so many errors with https://localhost these days... but I'll need help with that too :/20:28
pabelangermaiteb: have a log file for that error?20:28
*** tiswanso has quit IRC20:28
pabelangermy beaker foo is weak, but can help look20:28
clarkbmaiteb: its possible the vhost is configured to listen against the fqdn which loclahost won't match20:29
*** dprince has joined #openstack-infra20:29
clarkbmaiteb: you may need to hit the fqdn instead if you are having trouble20:29
*** sabeen has joined #openstack-infra20:29
maitebpabelanger: http://logs.openstack.org/28/220228/9/check/gate-puppet-jenkins-puppet-beaker-rspec-dsvm-trusty-nv/4c08fd4/console.html20:30
*** abregman is now known as abregman|afk20:30
*** ilyashakhat_mobi has quit IRC20:30
*** cloudtrainme has joined #openstack-infra20:31
*** tiswanso has joined #openstack-infra20:32
*** ujuc has joined #openstack-infra20:32
*** bdemers has joined #openstack-infra20:33
*** dramalho has joined #openstack-infra20:36
pabelangermaiteb: http://logs.openstack.org/28/220228/9/check/gate-puppet-jenkins-puppet-beaker-rspec-dsvm-trusty-nv/4c08fd4/console.html#_2015-11-09_13_29_03_89220:36
pabelangermaybe you need to use 127.0.0.120:36
maitebwow good catch... thanks pabelanger20:37
jeblairangdraug: could you either start a ml thread or maybe add a topic to the infra team meeting about fuel CI needs?20:37
*** ctlaugh has quit IRC20:37
*** dramalho has quit IRC20:37
maitebI'll change that when I get home20:37
jeblairangdraug: that way we can find out what the delta is between what we have in openstack and what you need20:37
*** ctlaugh has joined #openstack-infra20:37
*** ujuc has quit IRC20:37
pabelangermaiteb: our add jenkins.example.org to 127.0.0.1 hosts file.... something like that20:38
pabelangereither way, try IP first20:38
*** dramalho has joined #openstack-infra20:38
pabelangerthen add fqdn to dns20:38
*** sputnik13 has quit IRC20:38
*** ddieterl_ is now known as ddieterly20:39
*** ctlaugh has quit IRC20:40
*** bdemers has quit IRC20:40
*** ctlaugh has joined #openstack-infra20:40
*** maiteb has quit IRC20:42
*** baoli has joined #openstack-infra20:42
*** sputnik13 has joined #openstack-infra20:42
*** mahatic_ has quit IRC20:44
*** amuller_afk has quit IRC20:45
*** dramalho has quit IRC20:46
*** tsg has quit IRC20:46
*** bdemers has joined #openstack-infra20:47
*** bnemec has joined #openstack-infra20:47
*** cloudtrainme has quit IRC20:48
*** Sukhdev has quit IRC20:49
*** craigbr has quit IRC20:49
*** sputnik13 has quit IRC20:51
*** craigbr has joined #openstack-infra20:51
*** devl_ has joined #openstack-infra20:51
*** hdd has quit IRC20:52
*** sputnik13 has joined #openstack-infra20:52
*** wenlock has joined #openstack-infra20:52
*** kozhukalov_ has joined #openstack-infra20:53
*** bdemers has quit IRC20:53
calebbmordred: Shrews im having an issue creating a container with shade "shade.exc.OpenStackCloudException: Container fetch failed:  (/) (Inner Exception: No tenant specified)" (from the get_container() method) on hpcloud... any ideas what i could be doing wrong?20:54
* calebb not sure if shade problem or not20:54
clarkbcalebb: you need to specifyy a tenant clearly20:54
*** hdd has joined #openstack-infra20:55
*** bhunter71 has quit IRC20:55
*** wenlock has quit IRC20:56
calebbhmmmm, would that be in the call for creating a container or for creating a connection to the cloud? I dont see a way to specify that in the create_container() method20:56
clarkbcalebb: it would be part of your auth details20:57
openstackgerritThomas Morin proposed openstack-infra/project-config: Add networking-bgpvpn jobs for bagpipe driver  https://review.openstack.org/24372520:57
calebband there is a project_name in clouds.yml... is that not the same?20:57
clarkbI think they are semi the same but seems like we run into problems with them all the time20:57
clarkbcalebb: try a uuid instead?20:57
*** sridhar_ram1 has joined #openstack-infra20:59
*** ayoung has joined #openstack-infra20:59
*** sridhar_ram has quit IRC20:59
clarkbpabelanger: maiteb looks like it is trying to list the plugins at the time21:00
clarkbcould be related to that if jenkins version is too old or something ?21:00
clarkbor needing auth that isn't configured?21:01
clarkbjuding by the curl output the ssl negotiation and redirect worked fine21:01
clarkb(you might try using https directly instead)21:01
*** kozhukalov_ has quit IRC21:01
Shrewscalebb: hrm, could totally be a shade problem. I just tried list_containers() and there's a great big ol' bug in that one. The container code path is not well tested and needs some functional tests.21:01
*** kzaitsev_mb has joined #openstack-infra21:02
Shrewsmordred: ^^^^21:02
*** ifarkas has quit IRC21:03
*** dzamboni has quit IRC21:03
*** sergmelikyan has joined #openstack-infra21:03
calebbwrote the list_containers() method and im pretty sure there are some functional tests in test_objects.py21:03
calebbunless those tests are broken21:03
*** ociuhandu has joined #openstack-infra21:03
calebbs/wrote/i wrote/21:04
*** ayoung has quit IRC21:04
Shrewscalebb: they must be broken, or do not exist. the code in list_containers() should reference 'self.manager' not 'manager'21:04
openstackgerritMerged openstack-infra/shade: Pull server list cache setting via API  https://review.openstack.org/24331121:05
calebbhuh21:05
*** bdemers has joined #openstack-infra21:05
Shrewsthat's throwing a NameError21:05
*** devkulkarni has quit IRC21:05
*** tiswanso has quit IRC21:05
*** arxcruz has joined #openstack-infra21:06
Shrewshow that functional test is not catching that is perplexing21:07
calebbyeah21:07
*** rossella_ has quit IRC21:07
Shrewscalebb: OH21:07
Shrewsi bet swift isn't enabled in the gate tests21:07
*** tonytan4ever has quit IRC21:07
Shrewsso those tests are skipped21:07
Shrewsbleh21:07
calebb>.<21:07
*** tiswanso has joined #openstack-infra21:07
*** emildi has quit IRC21:08
*** alivigni has quit IRC21:08
*** rossella_ has joined #openstack-infra21:08
*** emildi has joined #openstack-infra21:08
*** ctlaugh has quit IRC21:09
*** bdemers has quit IRC21:09
openstackgerritPhilip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work  https://review.openstack.org/23981021:09
Shrewscalebb: SO, the thing to do is tests those func tests against devstack and make sure they all pass, then enable swift in the gate. Order matters there.21:09
clarkbyou can likely use a depends-on to get it working21:10
*** lifeless has joined #openstack-infra21:10
*** emildi has quit IRC21:10
Shrewsor that21:10
*** ZZelle has joined #openstack-infra21:10
*** emildi__ has joined #openstack-infra21:10
*** emildi__ has quit IRC21:10
clarkbdepends on how the jobs are configured21:10
*** salv-orlando has joined #openstack-infra21:10
*** yamamoto has joined #openstack-infra21:11
phschwartzasselin_: check again pls21:12
*** rfolco has quit IRC21:12
*** annegentle has joined #openstack-infra21:12
Shrewsclarkb: oh, speaking of shade jobs, we have a new one up for review: https://review.openstack.org/24318921:13
*** annegentle is now known as Guest3268321:13
*** bdemers has joined #openstack-infra21:14
*** erikmwilson_ has joined #openstack-infra21:15
angdraugjeblair: see bookwar's comments on #openstack-dev21:15
clarkbShrews: calebb I am looking at the current jjb jobs and swift should be enabled21:15
clarkbswift is part of the default service list in devstack, have an example job log I can look at to confirm?21:16
Shrewsclarkb: https://review.openstack.org/#/c/243311/21:16
jeblairangdraug: oh great, thanks!21:17
clarkbShrews: calebb http://logs.openstack.org/11/243311/4/check/gate-shade-dsvm-functional-neutron/4dd9617/logs/screen-s-container.txt.gz siwft is running there21:17
Shrewsclarkb: weird, b/c there is no way that one test can pass21:17
*** kozhukalov_ has joined #openstack-infra21:17
clarkbmaybe the test selection is broken? /me digs more21:18
*** craigbr has quit IRC21:18
*** yamamoto has quit IRC21:18
*** erikwilson has quit IRC21:18
Shrewsabout to test against my local devstack21:18
*** tonytan4ever has joined #openstack-infra21:19
*** zeih has joined #openstack-infra21:19
*** erikmwilson_ has quit IRC21:19
pabelangernibalizer: do you mind approving? https://review.openstack.org/#/c/242890/21:19
pabelangernibalizer: and the following patch21:20
*** flepied has joined #openstack-infra21:20
*** bdemers has quit IRC21:21
*** ybathia has quit IRC21:21
*** devkulkarni has joined #openstack-infra21:22
*** Guest32683 has quit IRC21:22
calebbthat is weird O.o21:24
*** maishsk_ has joined #openstack-infra21:24
*** maishsk has quit IRC21:24
*** maishsk_ is now known as maishsk21:24
jeblairShrews: 243189 references shade/shade/tests/ansible/hooks/post_test_hook.sh which does not exist21:24
clarkbShrews: we could really use subunit logs in the job logs21:25
*** zeih has quit IRC21:25
clarkbhard to tell what the test suite chose to do without them21:25
Shrewsjeblair: right. we will add that to shade. https://review.openstack.org/24319621:25
*** jamielennox is now known as jamielennox|away21:25
*** otter768 has joined #openstack-infra21:26
greghaynesclarkb: So that nodepool race test fail is definitely unrelated to the builders patch stack and is in master. It is also extremely rare. :/21:26
Shrewsclarkb: yeah. just confirmed the test is run and passes. but i also confirmed it's not hitting the assert that is supposed to fail21:26
*** kozhukalov_ has quit IRC21:26
*** rebase has joined #openstack-infra21:26
jeblairShrews: are there any alternatives to cloning ansible from github?21:27
Shrewsjeblair: wait for 2.0 to be release?21:27
jeblairoh i thought that happened21:27
*** woodster_ has joined #openstack-infra21:27
*** sergmelikyan has quit IRC21:28
*** kgiusti has quit IRC21:28
openstackgerritClark Boylan proposed openstack-infra/elastic-recheck: Revert "Update pyelasticsearch to >=1.4"  https://review.openstack.org/24383021:28
*** rockyg has joined #openstack-infra21:28
Shrewsclarkb: calebb: wow, i just put self.asserTrue(False) as the first line in test_create_object() and the test still passes21:29
sc68calShrews: lol wut21:29
calebbO.o21:29
* Shrews scratches his head21:29
calebbthat's...... interesting/scary21:30
*** otter768 has quit IRC21:30
greghaynesShrews: False = True. Problem solved.21:30
jeblairgreghaynes: sounds like mock21:30
Shrewsok, put it in setup() and it fails. which means the skipTest is being executed21:31
*** dprince has quit IRC21:31
greghaynesjeblair: WCPGW21:31
*** yamahata has joined #openstack-infra21:33
*** ujuc has joined #openstack-infra21:34
*** sfinucan_ has quit IRC21:35
*** sfinucan__ has joined #openstack-infra21:35
openstackgerritMerged openstack-infra/irc-meetings: Adding User Committee Meeting to IRC Schedule.  https://review.openstack.org/24375921:36
*** cloudtrainme has joined #openstack-infra21:37
*** baoli has quit IRC21:38
*** rhallisey has quit IRC21:38
*** ujuc has quit IRC21:39
*** shashank_hegde has quit IRC21:39
*** hdd has quit IRC21:41
*** changbl has quit IRC21:41
asselin_phschwartz, thanks for the fixes. much better now.21:42
openstackgerritMerged openstack-infra/irc-meetings: Updating meeting channel and time for Product WG.  https://review.openstack.org/24379921:42
*** esker has joined #openstack-infra21:42
*** sputnik13 has quit IRC21:42
openstackgerritMerged openstack-infra/irc-meetings: Rename irc meeting: akanda->astara  https://review.openstack.org/24323521:43
openstackgerritTomas Bezdek proposed openstack-infra/jenkins-job-builder: Add support for Rebuild Plugin  https://review.openstack.org/23536721:43
openstackgerritMerged openstack-infra/irc-meetings: Add a weekly Nova Live Migration subteam meeting  https://review.openstack.org/24354321:43
openstackgerritMerged openstack-infra/elastic-recheck: Revert "Update pyelasticsearch to >=1.4"  https://review.openstack.org/24383021:43
*** ctlaugh has joined #openstack-infra21:43
*** ayoung has joined #openstack-infra21:43
*** sputnik13 has joined #openstack-infra21:43
phschwartzasselin_: :)21:43
*** hashar has joined #openstack-infra21:44
phschwartzmordred: jeblair: SpamapS: nibalizer: yolanda: mind reviewing https://review.openstack.org/239810 once more21:44
Shrewsjeblair: any reason you didn't vote on that shade job? am i missing something?21:46
openstackgerritTomas Bezdek proposed openstack-infra/jenkins-job-builder: add support for NodeJS Plugin  https://review.openstack.org/23541121:46
*** flepied1 has joined #openstack-infra21:46
*** zeih has joined #openstack-infra21:46
*** kzaitsev_mb has quit IRC21:47
*** kzaitsev_mb has joined #openstack-infra21:48
*** trown is now known as trown|outttypeww21:49
*** tiswanso has quit IRC21:49
*** flepied has quit IRC21:50
*** flepied1 has quit IRC21:50
*** devl_ has quit IRC21:50
*** zeih has quit IRC21:51
*** esker has quit IRC21:51
*** sridhar_ram1 has quit IRC21:52
*** esker has joined #openstack-infra21:52
openstackgerritCaleb Boylan proposed openstack-infra/shade: Testing object tests, please ignore  https://review.openstack.org/24383621:52
asselin_nibalizer, clarkb want to schedule a day/time for nodepool.yaml migration?21:53
Shrewscalebb: that doesn't work either  :(21:53
* calebb sighs21:54
*** aysyd has quit IRC21:54
*** eil397 has joined #openstack-infra21:54
Shrewscalebb: i *think* the problem is that it's not showing up in the catalog21:55
*** FallenPegasus has quit IRC21:55
*** smarcet has quit IRC21:55
*** esker has quit IRC21:56
openstackgerritAdam Gandelman proposed openstack/requirements: Raise minimum oslo.messaging requirement  https://review.openstack.org/24383921:56
*** yamahata has quit IRC21:56
adam_gdims, to go along with https://review.openstack.org/#/c/24277521:56
*** ZZelle has quit IRC21:57
openstackgerritMichael Jeanson proposed openstack-infra/jenkins-job-builder: Add matrixOptions to throttle properties module  https://review.openstack.org/24169921:57
Shrewscalebb: testing a theory...21:58
*** thedodd has quit IRC22:01
*** salv-orlando has quit IRC22:01
*** thedodd has joined #openstack-infra22:02
*** sdake has joined #openstack-infra22:03
*** thedodd has quit IRC22:03
*** ctlaugh has quit IRC22:03
*** pradk has quit IRC22:03
*** arxcruz has quit IRC22:04
*** abregman|afk has quit IRC22:05
*** bhunter71 has joined #openstack-infra22:05
*** maishsk has quit IRC22:05
*** maishsk has joined #openstack-infra22:06
*** yamamoto has joined #openstack-infra22:07
adam_gpleia2, so our channels registered and both irc patches look green now,  https://review.openstack.org/#/c/242642/ https://review.openstack.org/#/c/242643/22:08
*** dkranz has quit IRC22:10
*** salv-orlando has joined #openstack-infra22:10
openstackgerritMerged openstack-infra/nodepool: Explicitly block in nodepool upload commands  https://review.openstack.org/23385222:12
*** smarcet has joined #openstack-infra22:12
*** salv-orlando has quit IRC22:13
SpamapSjeblair: your mention of gertty reminded me..22:13
SpamapSjeblair: I tend to shut my machine down and start it back the next day...22:13
SpamapSjeblair: and I have 100 - 200 out of sync things... that takes 20+ minutes to catch up.. and while syncing .. it is super confusing22:14
openstackgerritCaleb Boylan proposed openstack-infra/shade: Make functional object tests actually run  https://review.openstack.org/24384622:14
SpamapSjeblair: I was wondering if there were any efforts to a) speed up syncing, or b) flag unsynced things in the UI?22:14
*** devkulkarni has quit IRC22:14
*** ctlaugh has joined #openstack-infra22:14
calebb^ that should make the tests actually run, will probably still fail though22:15
*** FallenPe_ has joined #openstack-infra22:16
*** FallenPe_ is now known as MarkAtwood22:18
*** thorst has quit IRC22:18
*** unicell1 has joined #openstack-infra22:18
*** unicell has quit IRC22:19
*** gouthamr has quit IRC22:20
*** ayoung has quit IRC22:21
clarkbjenkins masters are all restarted and unleaky right now22:24
*** jamielennox|away is now known as jamielennox22:24
Shrewscalebb: it would actually be *helpful* to see it fail. that way we'd know the test is running22:24
calebbyeah22:24
calebbShrews: https://jenkins02.openstack.org/job/gate-shade-dsvm-functional-nova/145/console looks like it is actually failing before the container list stuff22:25
Shrewsbut, i did confirm it locally22:25
calebbseems to be failing on the object stuff22:25
Shrewsyeah, i saw that one too locally22:25
calebbthat's the first patch i submitted, not the one with the fixed list_container method, but that should fail the same way22:25
*** sdake has quit IRC22:28
*** boris-42 has joined #openstack-infra22:30
jeblairShrews: i haven't looked at the hard stuff on that change yet :)22:31
*** baoli has joined #openstack-infra22:32
*** nikhil_k has quit IRC22:33
*** regXboi has quit IRC22:33
*** nikhil has joined #openstack-infra22:33
jeblairSpamapS: syncing is as fast as i know how to make it without doing multiple simultaneous server requests which i worry about since we run a gerrit server.  :)  i'm totally open to more ideas on that point (most of the current speedups were not my idea :)22:33
clarkbgreghaynes: can you check https://review.openstack.org/#/c/235079/4/modules/openstack_project/files/gerrit/hideci.js its js'y and I am worried htat it assumes a very particular return value from children that isn't enforced by jqery22:33
clarkbgreghaynes: basically children() retuns all the children but that code is looking for a specific name and date22:33
clarkbso if there is >1 child we lose22:34
*** tsufiev has quit IRC22:34
jeblairSpamapS: having said that, i'm working on some fundamental work that will let us set project priorities, so later we can at least sync "important things" first22:34
greghaynesclarkb: lemme see....22:34
*** flwang has joined #openstack-infra22:35
greghaynesclarkb: aye, that is nasty22:35
jeblairSpamapS: i believe we could probably do something to mark un-synced changes, however note that gertty will avoid sending your review and flag the change as "held" in some circumstances (eg, you +1 a review with a -1 you did not see).22:35
openstackgerritMerged openstack-infra/project-config: Update zuul-dev.o.o pipelines  https://review.openstack.org/24182722:35
clarkbgreghaynes: I think find() might be better22:36
jeblairSpamapS: and if you 'ctrl-r' to refresh, that action always goes to the top of the queue, so if you are unsure of status with sync tasks outstanding, you can always hit that....22:36
clarkbgreghaynes: get the specific element(s) we need but I hvaen't actually looked at the html gerrit spits back22:36
greghaynesclarkb: Yea, I am trying to break in to that bit of code in the browser debugger to see what its doing22:36
clarkbzaro: ^ if you are around trying to review the toggle ci patch22:36
jeblairSpamapS: which suggests the following optimization: if you view a change that gertty has in its sync queue, immediately high-priority sync it.  :)22:36
*** rebase has quit IRC22:37
*** tsufiev has joined #openstack-infra22:37
*** austin81 has left #openstack-infra22:37
*** peristeri has quit IRC22:37
jeblairSpamapS: (i mean, gertty should do that automatically)22:37
jeblairSpamapS: you come up with good ideas!22:37
clarkbzaro and https://review.openstack.org/#/c/236220/2 needs a rebase, I can rebase if it helps22:37
*** rebase has joined #openstack-infra22:37
*** gongysh has joined #openstack-infra22:37
flwanghi anybody know who is the right guy about the debian packaging question? cheers22:38
Clintflwang: what question?22:38
*** tongli has quit IRC22:39
openstackgerritMerged openstack-infra/subunit2sql: Add option to specify global test attr prefix in subunit2sql  https://review.openstack.org/22147922:41
*** sputnik13 has quit IRC22:41
*** sputnik13 has joined #openstack-infra22:41
clarkbhttps://review-dev.openstack.org/#/c/5383/ git review works22:42
openstackgerritMerged openstack-infra/subunit2sql: Enable python 3 testing support  https://review.openstack.org/23087422:42
clarkbgreghaynes: seems like the old code was pretty hacky as well22:43
clarkbgreghaynes: probably doesn't hurt a ton to make the change as is22:43
clarkbbut I have no idea how crazy GWT recompiles can change stuff22:43
clarkbiirc GWT compiles are not stable22:43
jeblairit's true, they are randomized22:44
jeblairclarkb: but not things like dom structure, which is what that's doing22:45
jeblairwhether there might be >1 child is still a question, but it's an app question, not a gwt, i think.22:46
clarkbok22:46
SpamapSjeblair: Hah, yeah, right "I" am proud of that idea "I" came up with ;)22:46
*** barnaby has quit IRC22:46
jeblairSpamapS: you should be, "I" im!22:46
SpamapSjeblair: so yeah, I think just automatically ctrl-r'ing would be a wonderful optimization.22:47
greghaynesclarkb: so it does something even more wierd22:47
greghaynesclarkb: notice the children().children()22:47
SpamapSjeblair: the confusing part comes when somebody pings on IRC "Hey my thing passes tests, can you look again and +A if it's good?" and I look and it has 3 failed tests and a -1 vote..22:47
greghaynesclarkb: that grabs the last child (I have no idea why that is, but it does)22:47
clarkbgreghaynes: it doesn't go down another level?22:47
greghaynesand then calls children on that22:48
clarkboh22:48
greghaynesyea, but children() returns a list22:48
jeblairSpamapS: gertty tries to give you just enough time to type "no it doesn't what are you talking about?<enter>" before syncing those changes.22:48
SpamapSjeblair: ctrl-r is definitely the thing to do there (I do use that) but it creates a moment of confusion nonetheless.22:48
clarkbrigh os the second call implicitly does it on list[-1] ?22:48
greghaynesI think so22:48
greghaynesthats what js console does22:48
clarkbweird22:48
clarkband the old code did [0]22:48
*** smarcet has quit IRC22:48
SpamapSjeblair: I sometimes suspect it observes my IRC conversations and waits helpfully until I hit enter to sync. ;)22:48
clarkbI am guessing old code only had one element to deal with so 0 and -1 are equivalent indexes22:48
clarkbbut new 2.11 code must have more than one element22:49
clarkbso thats how this ends up being compatible with both22:49
greghaynesI am going to look a bit deeper and see if I can identify a better way22:49
greghaynesthis seems pretty scary fragile22:50
SpamapSjeblair: also regarding pounding on the server... it seems like one way to make that better is to have gerrit provide you with the whole item along side the event stream _if_ thats what you asked for.22:50
jeblairgreghaynes, clarkb: i talked to dave borowitz and he seemed willing to lift his objection to adding support for native understanding of ci reports which would obsolete this script...22:51
*** dingyichen has joined #openstack-infra22:51
jeblairthey _might_ make progress on that in the hackathon22:51
greghaynesoooo22:51
*** akshai has quit IRC22:51
flwangClint: i don't know, TBH. jasondotstar is working on the zaqar puppet work and he said he is running into some issues about debian packaging22:51
flwangIIRC, somebody is focusing on the debian packaging for openstack, but i can't remember his name :(22:52
nibalizerzigo?22:52
zigonibalizer: Yes?22:52
zigoflwang: That is myself.22:53
zigoflwang: I've been asking for feedback on the packaging of Zaqar, but so far, had no reply to that.22:53
*** craigbr has joined #openstack-infra22:53
zigoIt's a very new package, so problems are to be expected.22:53
*** BobBall_AWOL has quit IRC22:53
*** amitgandhinz has quit IRC22:53
zigoI have no idea how to actually run Zaqar, so I can't really tell what issue there are.22:54
*** MarkAtwood has quit IRC22:54
flwangzigo: oh22:54
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add Blue Box to nodepool  https://review.openstack.org/23448322:54
clarkbjeblair: \o/22:55
*** BobBall_AWOL has joined #openstack-infra22:55
flwangzigo: anything i can help for how to running zaqar?22:55
*** rbrndt has joined #openstack-infra22:55
asselin_clarkb, jeblair it would be really nice to migrate nodepool.yaml before ^^22:55
SpamapSzigo: from an operational standpoint, it shouldn't be too different than say, Heat.22:55
jeblairasselin_: link?22:56
*** akshai has joined #openstack-infra22:56
clarkbasselin_: I think its already diverged unless you have recently updated it22:56
asselin_clarkb, I did, one sec22:56
asselin_clarkb, jeblair diverged portion: https://review.openstack.org/#/c/242194/22:56
zigoflwang: Try the package, then report back to me if you see issues...22:56
clarkbasselin_: is that it? I thought that there were non tripleo f22 updates too22:57
asselin_clarkb, jeblair migration patch: https://review.openstack.org/#/c/233315/22:57
*** thorst has joined #openstack-infra22:57
asselin_clarkb, that should be it, otherwise the migration patch would have a merge conflict22:57
zigoflwang: I normally fix things in record breaking times! :)22:57
rbrndtHi, I have a question about creating a gate job. I got this http://paste.openstack.org/show/478492/ from the job, and I was wondering how the job loads the change it is testing?22:58
flwangzigo: where to get the package? :)22:58
jeblairasselin_: that adds passwords to status.openstack.org?22:58
flwangzigo: it works for me either :)22:58
* jasondotstar listens in.22:58
greghaynesclarkb: jeblair I think that patch is about as good as were going to get :/22:58
flwangjasondotstar: hey22:58
zigoflwang: Are you ok with running Sid?22:58
greghaynesclarkb: only nit I have is why did the semicolon go away ;)22:58
asselin_jeblair, ??22:58
clarkbgreghaynes: thank you for looking22:58
clarkbasselin_: check the diff22:58
zigoflwang: Or do you prefer a (currently non-official) backport to Debian Stable?22:58
jasondotstarflwang: sounds like we're following up on the deb pkg stuff for zaqar ?22:58
asselin_clarkb, ok will check again22:59
flwangjasondotstar: yes22:59
jasondotstarack.22:59
*** bpokorny_ has joined #openstack-infra22:59
flwangzigo: i will test it on my local, or pre prod, so either way is ok i think22:59
asselin_clarkb, diff is clean23:00
jeblairasselin_: i left an inline comment23:00
zigoflwang: My Jenkins keeps a Jessie version of all of what I maintain in Sid. The repository list is described on this page: http://liberty-jessie.pkgs.mirantis.com/23:01
asselin_jeblair, ack...pasted in wrong spot23:01
*** thorst has quit IRC23:01
zigoflwang: It's strait rebuilds from Sid, without any change. Within a few days, if I can fix the last issue and the remaining packages migrate to Debian Testing, I'll upload all of Liberty to the jessie-backports (official backports, that is...).23:01
jasondotstarkeep me posted. want to ensure i point the repos to the right spot for deploying the latest pkgs w/ puppet.23:02
zigoflwang: So, currently, either that non-official backport repo, or just plain Debian unstable (using your nearby preffered mirror).23:02
openstackgerritJames E. Blair proposed openstack-infra/project-config: Add Blue Box to nodepool  https://review.openstack.org/24386123:02
openstackgerritMerged openstack-infra/project-config: Resync nodepool.yaml with system-config version.  https://review.openstack.org/24219423:02
jeblairasselin_: ^ two changes for the price of one :)23:02
openstackgerritRamy Asselin proposed openstack-infra/system-config: Migrate to puppet-openstackci openstackci::nodepool  https://review.openstack.org/23331523:03
*** bpokorny has quit IRC23:03
flwangzigo: ok, got it. thanks a lot23:03
flwangjasondotstar: does that address your questions?23:03
jasondotstarsounds like it, yes.23:03
jasondotstarflwang++23:03
jasondotstarzigo++23:03
rbrndtLooking for some help with setting up a gate job23:03
flwangjasondotstar: awesome awesome23:04
*** hashar has quit IRC23:04
clarkbzaro I +2'd the ci js change but noted that the dependency you put in place isn't required if it owrks with both gerrit verssions23:04
rbrndtAnyone got a moment?23:04
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add python3 jobs to subunit2sql  https://review.openstack.org/23120523:04
clarkbrbrndt: usually best to just ask23:04
jasondotstarzigo: I'll get w/ you if I've questions but it sounds like I can point to the Debian Testing repos23:04
jasondotstarzigo: well, when they've been migrated.23:04
*** cloudtrainme has quit IRC23:04
rbrndtclarkb: I did, it disappeared quickly23:04
mtreinishanteaya, clarkb, nibalizer: ^^^ if you get a sec that project config change should be quick23:05
clarkbrbrndt: paste.openstack.org/show/478492/ ?23:05
*** ybathia has joined #openstack-infra23:05
clarkbrbrndt: can you link to the actual job logs?23:05
rbrndthttp://logs.openstack.org/07/241407/5/experimental/gate-monasca-api-tempest-dsvm/d4901bf/logs/23:06
clarkbrbrndt: the error is that you have attempted to clone when you shouldn't (you should installed have devstack-gate set up your repos for you)23:06
zigojasondotstar: The issue I have is with python-repoze.who.23:06
zigoIt blocks keystone ...23:06
zigoLong chain of dependency here.23:06
jasondotstarack.23:06
clarkbrbrndt: you can have devstack-gate do that by adding your project to the PROJECTS list env var in the job23:06
jeblairasselin_, clarkb: nodepool migration lgtm.23:06
*** tsg has joined #openstack-infra23:06
*** Sukhdev has joined #openstack-infra23:06
rbrndtclarkb: we found that doing that causes our project to install twice23:06
clarkbjeblair: I doubt I will be able to babysit but can review if people want to babysit it23:07
clarkbotherwise gonna try to finish up my stack of gerrit reviews23:07
jasondotstarzigo: *maybe* I can assist... haven't done much deb pkg work. that should change.23:07
jeblairclarkb, asselin_: i have 2 hours; should be enough for a deploy+rollback23:07
zigojasondotstar: Keystone depends on pysaml2. Pysaml2 depends on python-repoze.who >2, which I uploaded to Sid. python-repoze.what depends on python-repoze.who < 1.99, with no hope to get upstream to fix that. So I'm a bit stuck here, helpless, and I don't know how to fix the situation... :(23:07
clarkbjeblair: cool I will review then23:07
clarkbrbrndt: devstack-gate does not install anything23:07
clarkbrbrndt: it only clones and checks out the correct ref for you23:07
asselin_jeblair, clarkb i'm here too23:07
jasondotstarzigo: oh. i c.23:07
zigojasondotstar: It's Python work that has to be done here: fixing python-repoze.what so that it works with the latest repoze.who.23:08
clarkbasselin_: jeblair we need the project-config change in first ya?23:08
rbrndtclarkb: we were running a "gate" job locally which was running a complete install of devstack. The gate jobs don't do that?23:08
zigoI think I should ask for help in the openstack-dev@l.o.o list.23:08
clarkboh that just merged23:08
jasondotstar+123:08
asselin_clarkb, yes, and the latest just merged23:08
clarkbrbrndt: they do, but the specifically set ERROR_ON_CLONE to ensure that devstack-gate alone is checking out cod23:09
clarkbto avoid volkswagening23:09
asselin_clarkb, (I believe I added depends-on as well)23:09
*** signed8bit is now known as signed8bit_ZZZzz23:09
*** xyang1 has quit IRC23:09
rbrndtclarkb: alright, so we have multiple repos, do we need to add them all?23:09
clarkbrbrndt: any that devstack tries to clone will need to be added23:10
clarkbjeblair: no concern about adding the NODEPOOL_SSH_KEY env var? I thought I explicitly asked that we remove that in a previous patch23:11
clarkbasselin_: ^23:11
*** sputnik13 has quit IRC23:11
rbrndtclarkb: alright, thanks. We will investigate further23:11
*** camunoz has joined #openstack-infra23:11
asselin_clarkb, in the previous patch, it was b/c I had removed an extra paramter that was in fact needed23:11
asselin_clarkb, but I see now...infra has the default built-in, so that's not needed. I can remove it.23:12
clarkbasselin_: I asked that you use the parameter to set the key rather than set the env var23:12
jeblairclarkb: missed that, thx23:12
clarkbasselin_:  https://review.openstack.org/#/c/233315/7/manifests/site.pp23:12
openstackgerritRamy Asselin proposed openstack-infra/system-config: Migrate to puppet-openstackci openstackci::nodepool  https://review.openstack.org/23331523:14
asselin_clarkb, yes, I thought you mean add line 660 which I was missing: https://review.openstack.org/#/c/233315/7..8/manifests/site.pp23:14
clarkbit was both add that and remove the env var23:14
*** dims has quit IRC23:15
asselin_clarkb, 3rd party ci needs both.23:15
clarkbasselin_: why is that?23:15
clarkbasselin_: if you set that file nodepool should useit just fine23:16
*** sputnik13 has joined #openstack-infra23:16
*** esker has joined #openstack-infra23:16
asselin_clarkb, b/c otherwise 3rd party ci nodes will have infra's public key authorized instead of their own23:16
asselin_clarkb, set which file?23:16
*** armax has quit IRC23:16
clarkbthe ssh private and public key in ~$nodepooluser/.ssh23:17
openstackgerritHongbin Lu proposed openstack/requirements: Add certifi to global requirements  https://review.openstack.org/22110723:17
asselin_clarkb, hmmm I need to check that23:17
clarkblatest patchset lgtm23:17
clarkbasselin_: I don't know that hte image elements or snapshot scripts will do that though23:17
clarkbasselin_: but nodepool itself will (those are two different problems imo)23:18
asselin_clarkb, last I checked, if you don't set end env, then you won't be able to log into your nodes. I will get you the line number23:18
clarkbthey are related in that they have to match up but a nodepool install should take an arbitrary key and the image builds should take an arbitrary key23:18
clarkbas nothing says they have to be used in conjunction23:18
asselin_clarkb, http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n2723:19
clarkbya we should clean that interface up23:19
*** jdg has joined #openstack-infra23:20
clarkbdib has a devuser element that might have a better interface (or it may not )23:20
asselin_clarkb, also, not sure where nodepool would get the public key otherwise. current only the private key is in /home/nodepool/.ssh23:20
*** esker has quit IRC23:20
clarkbasselin_: oh wait is that a public key?23:21
*** pc_m has quit IRC23:21
clarkbasselin_: then the puppet chang was wrong because it was setting the private key not hte public key23:21
*** ujuc has joined #openstack-infra23:21
asselin_clarkb, nodepool_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),23:22
clarkbasselin_: ya but the removed code23:22
clarkbasselin_: the current patchset is correct, I a msaying the old patchset was wrong regradless23:22
clarkband would've resulting in broken ssh23:22
*** hichihara has joined #openstack-infra23:22
asselin_clarkb, you're right..sorry :(23:23
clarkbanyways, current patchset lgtm. We should consider a better interface to setting the public key in image builds for the future23:23
clarkbas using an env var like that is great for testing but a little hacky for production23:23
*** signed8bit_ZZZzz is now known as signed8bit23:23
jeblairyup23:24
asselin_agree...it should be explicit23:24
asselin_I'll work on that next23:25
*** stevemar_ has quit IRC23:25
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Example of how to use targets plugins  https://review.openstack.org/24386523:26
*** stevemar_ has joined #openstack-infra23:26
*** ujuc has quit IRC23:26
*** otter768 has joined #openstack-infra23:27
openstackgerritMerged openstack-infra/system-config: Migrate to puppet-openstackci openstackci::nodepool  https://review.openstack.org/23331523:28
*** sigmavirus24 is now known as sigmavirus24_awa23:29
*** jdg has quit IRC23:29
mgagnewhich software are people using to make their images in presentations? (ex.: http://docs.openstack.org/infra/publications/)23:29
clarkbmgagne: I have used pencil23:29
clarkblet me find a link because there is >1 pencil23:30
*** stevemar_ has quit IRC23:30
clarkbmgagne: http://pencil.evolus.vn/23:30
clarkbbut I am graphically challenged23:30
mgagneinteresting23:30
mgagnewill take a look23:30
clarkbits in ubuntu's repos too iirc23:31
mgagneI'm running Mac OS X, fortunately, there is a package for it23:31
*** otter768 has quit IRC23:32
*** aeng has joined #openstack-infra23:32
jeblairi use tetradraw23:34
jeblairits lower rez tho23:34
*** bpokorny_ has quit IRC23:34
*** bpokorny has joined #openstack-infra23:35
*** unicell1 has quit IRC23:39
*** unicell has joined #openstack-infra23:39
*** signed8bit is now known as signed8bit_ZZZzz23:39
*** craigbr has quit IRC23:41
*** ddieterly has quit IRC23:41
asselin_clarkb, jeblair seems this ran a few minutes after the patch merged with noop: http://puppetboard.openstack.org/report/nodepool.openstack.org/a50a3aef286a76a1b5df1de9ad1e986099720b4223:43
asselin_noop is what is expected23:44
*** salv-orlando has joined #openstack-infra23:45
*** kzaitsev_mb has quit IRC23:47
jeblairasselin_: ack, it may be in the next run though23:48
* asselin_ waits23:48
jeblairwhich is in progress23:48
jeblairhttp://puppetboard.openstack.org/report/nodepool.openstack.org/ef83263ad4e2eab92fa0eb4ae367de11337e0afb23:49
jeblairalso no changes23:49
asselin_so...success?23:50
jeblairi think so!23:50
asselin_\O/23:50
*** signed8bit_ZZZzz is now known as signed8bit23:51
*** signed8bit has quit IRC23:51
asselin_welcome infra to having nodepool.yaml in project config like all the other 3rd party cis :p23:51
*** akshai has quit IRC23:51
jeblairyay!23:52
*** tonytan4ever has quit IRC23:52
*** Sukhdev has quit IRC23:53
*** rockyg has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!