Wednesday, 2016-01-27

*** nelsnels_ has joined #openstack-infra00:01
*** oomichi has quit IRC00:01
jheskethpleia2: are you still looking for help with the upstream infrastructure for beginners talk?00:01
jeblairit takes about 22 minutes to upload one of those00:02
*** jpr has quit IRC00:02
* samueldmq is getting 502 proxy error in review.o.o00:02
*** sbalukoff has joined #openstack-infra00:02
*** ashleighfarnham has quit IRC00:02
*** nelsnelson has quit IRC00:03
*** peristeri has quit IRC00:04
*** daemontool_ has quit IRC00:04
*** dims has quit IRC00:04
*** rlandy has quit IRC00:05
*** gordc has quit IRC00:06
*** daemontool_ has joined #openstack-infra00:06
*** rbrndt has quit IRC00:07
*** baoli has quit IRC00:07
*** achanda has joined #openstack-infra00:11
*** sflanigan has joined #openstack-infra00:11
*** sflanigan has joined #openstack-infra00:11
*** hichihara has joined #openstack-infra00:12
*** flepied has joined #openstack-infra00:13
*** Sukhdev has joined #openstack-infra00:13
*** daemontool_ has quit IRC00:13
*** dimtruck is now known as zz_dimtruck00:15
nibalizerinfra-root ok so the puppetdb puppet module is kinda um complicated00:16
nibalizerbut we are now set to -Xmx384m (manually) and puppet dosen't seem to be putting it back00:16
*** tongli has quit IRC00:20
*** fbo has quit IRC00:20
*** smarcet has joined #openstack-infra00:20
*** fbo_ has joined #openstack-infra00:20
*** EricGonczer_ has joined #openstack-infra00:22
*** rlandy has joined #openstack-infra00:23
*** flepied has quit IRC00:23
*** derekh has quit IRC00:26
*** Sukhdev has quit IRC00:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a update in trunk repository version  https://review.openstack.org/22978900:30
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Make builder multi-threaded  https://review.openstack.org/27284900:33
*** jcoufal has quit IRC00:34
openstackgerritSpencer Krum proposed openstack-infra/system-config: Puppetdb keeps ooming, give it more ram  https://review.openstack.org/27285000:34
jeblairgreghaynes: ^ i haven't tested that, i just was thinking about it while waiting for these images to upload00:34
openstackgerritMathieu Gagné proposed openstack-infra/jeepyb: Don't create new groups for system ones  https://review.openstack.org/24812600:34
jeblairand huh, the bandwidth being used for uploading to bhs1 is half that of gra100:38
*** yamamoto_ has quit IRC00:39
openstackgerritShane Wang proposed openstack-infra/system-config: Request to add a mailing list for the working group of bug smash-a-thon  https://review.openstack.org/27285100:40
*** flepied has joined #openstack-infra00:40
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Clarify debug statements in image-upload  https://review.openstack.org/27275400:43
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Make builder multi-threaded  https://review.openstack.org/27284900:43
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Add more debug logging to image upload  https://review.openstack.org/27277500:43
*** haiwei has quit IRC00:48
*** hdd has joined #openstack-infra00:48
*** markvoelker has quit IRC00:51
greghaynesjeblair: hrm, is subprocess going to release the GIL there?00:52
greghaynesjeblair: if not we are going to end up with a cpu bound thread along with all our upload threads00:52
greghaynesjeblair: it might be nicer to just multiprocess pool workers, I dont think threads really buy us anything over multiple processes and they will definitely be less performant00:54
greghayneser, multiprocessing00:54
*** Swami has quit IRC00:55
*** markvoelker has joined #openstack-infra00:56
*** flwang has joined #openstack-infra00:56
flwangAJaeger: ping re the translation of zaqar ui00:56
*** cody-somerville_ has quit IRC00:57
*** smarcet has quit IRC01:01
openstackgerritIan Wienand proposed openstack-infra/system-config: Don't exclude python-setuptools  https://review.openstack.org/27285701:01
*** eil397 has quit IRC01:01
ianwmordred: ^ sorry, another essay length commit message01:01
*** rhallisey has quit IRC01:02
*** diana_clarke has quit IRC01:02
*** gildub has quit IRC01:04
*** EricGonczer_ has quit IRC01:06
*** bpokorny_ has joined #openstack-infra01:07
*** bpokorny_ has quit IRC01:07
*** bpokorny has quit IRC01:07
*** bpokorny has joined #openstack-infra01:07
jeblairgreghaynes: multiprocessing?01:08
jeblairgreghaynes: where is that used?01:08
jeblairgreghaynes: but an easy answer to your question is that until recently, all of this happened in the same process, so it should not be a problem01:08
*** sridhar_ram1 has joined #openstack-infra01:09
*** sridhar_ram has quit IRC01:09
*** bryan_att has quit IRC01:09
*** cody-somerville has joined #openstack-infra01:11
*** baoli has joined #openstack-infra01:11
*** baoli has quit IRC01:11
*** Daisy has joined #openstack-infra01:13
*** sdake has joined #openstack-infra01:13
*** bpokorny has quit IRC01:14
*** sdake_ has joined #openstack-infra01:15
*** diana_clarke has joined #openstack-infra01:17
*** sdake has quit IRC01:17
*** lianz has joined #openstack-infra01:18
gmanndhellmann: ping01:18
*** tphummel has quit IRC01:20
ianwgreghaynes: do you have experience overriding "system-config" in dib command-lines ... the "-" is giving me issues01:20
ianwe.g. DIB_REPOLOCATION_system-config=https://review.openstack.org/openstack-infra/system-config DIB_REPOREF_system-config=refs/changes/57/272857/101:21
ianwoh, hang on, it's doing the conversion to _01:22
*** yamamoto_ has joined #openstack-infra01:23
*** piet has joined #openstack-infra01:23
*** hdd has quit IRC01:28
*** Jeffrey4l has joined #openstack-infra01:28
*** hdd has joined #openstack-infra01:28
*** ccrouch has quit IRC01:29
pleia2jhesketh: I think we're probably good on the infra beginners talk (3 of us) but it's fine to add another lightning talk to the other proposal (first in the etherpad) if you have an idea for something or want to do the bindep one01:31
*** tphummel has joined #openstack-infra01:31
*** Sukhdev has joined #openstack-infra01:32
jeblairianw: | 7519236 | ovh-bhs1               | None | devstack-centos7-dib   | jenkins02 | devstack-centos7-dib-ovh-bhs1-7519236       | devstack-centos7-dib-ovh-bhs1-7519236       | 76fa0797-0709-4bb2-9efe-a8974121d42c | 158.69.95.208   | ready    | 00:01:30:36 |01:34
*** Liuqing has joined #openstack-infra01:34
bkeropleia2: who else is doing the beginners talk?01:35
jeblairianw: i have logged into that node01:35
*** tphummel has quit IRC01:36
*** sdake has joined #openstack-infra01:36
*** david-lyle has quit IRC01:36
pleia2bkero: pabelanger and docaedo01:36
bkeroCool, ok :)01:37
*** Sukhdev has quit IRC01:37
*** gildub has joined #openstack-infra01:37
*** Sukhdev has joined #openstack-infra01:37
jeblairianw: so should we switch that to the devstack-centos7 label so it gets used?01:37
*** sdake_ has quit IRC01:37
jeblairmordred: ^ fyi01:37
*** sridhar_ram1 has quit IRC01:38
*** Sukhdev has quit IRC01:40
*** Sukhdev has joined #openstack-infra01:40
*** piet has quit IRC01:41
*** piet has joined #openstack-infra01:41
*** angdraug has quit IRC01:43
openstackgerritJames E. Blair proposed openstack-infra/project-config: Supply the devstack-centos7 label from ovh  https://review.openstack.org/27286601:43
*** pvaneck has quit IRC01:43
*** Sukhdev has quit IRC01:43
*** Sukhdev has joined #openstack-infra01:44
*** EricGonczer_ has joined #openstack-infra01:44
*** FallenPe_ has joined #openstack-infra01:44
prometheanfireglean doesn't support nova with vfat config drive (needed for migration)01:46
*** Sukhdev has quit IRC01:47
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Make builder multi-threaded  https://review.openstack.org/27284901:47
*** tiswanso has joined #openstack-infra01:47
*** Sukhdev has joined #openstack-infra01:47
*** tiswanso has quit IRC01:47
*** FallenPegasus has quit IRC01:47
*** tiswanso has joined #openstack-infra01:48
*** Yanyanhu has joined #openstack-infra01:49
*** Sukhdev has quit IRC01:50
*** achanda has quit IRC01:50
*** Sukhdev has joined #openstack-infra01:50
prometheanfireI'm adding that new (and testing01:51
*** Sukhdev has quit IRC01:53
*** Qiming has quit IRC01:53
*** Sukhdev has joined #openstack-infra01:53
*** flepied has quit IRC01:53
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: Retire icehouse and juno for networking-midonet  https://review.openstack.org/27200501:54
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Add experimental rally job  https://review.openstack.org/26885901:54
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Remove KEEP_LOCALRC setting  https://review.openstack.org/27286701:54
*** mtanino has quit IRC01:54
*** mtanino_ is now known as mtanino01:54
*** ybathia has quit IRC01:55
*** fawadkhaliq has joined #openstack-infra01:58
*** Sukhdev_ has joined #openstack-infra01:58
ianwjeblair: hmm, i guess yes?  it's probably easier to fix any problems than to do something like setup a whole separate job path to test it with, although i could if you like01:59
*** fawadkhaliq has quit IRC01:59
*** Sukhdev has quit IRC01:59
*** smarcet has joined #openstack-infra02:01
*** Sukhdev_ has quit IRC02:02
*** Sukhdev has joined #openstack-infra02:02
*** rakhmerov has quit IRC02:03
*** Sukhdev has quit IRC02:05
*** Sukhdev has joined #openstack-infra02:05
*** rakhmerov has joined #openstack-infra02:07
*** _amrith_ is now known as amrith02:08
*** Sukhdev has quit IRC02:08
*** Sukhdev has joined #openstack-infra02:08
*** flepied has joined #openstack-infra02:10
*** Sukhdev has quit IRC02:10
*** Sukhdev has joined #openstack-infra02:11
*** smarcet has quit IRC02:11
*** shashank_hegde has quit IRC02:11
*** Sukhdev has quit IRC02:13
*** Sukhdev has joined #openstack-infra02:14
*** Sukhdev has quit IRC02:14
*** apoorvad has quit IRC02:14
*** apoorvad has joined #openstack-infra02:16
cody-somervillehere is a first go at the hpcloud sunset impact announcement: https://etherpad.openstack.org/p/openstack-infra-ann-hpcloud-sunset02:16
*** hdd has quit IRC02:16
*** sdake has quit IRC02:16
*** zhurong has joined #openstack-infra02:18
*** jpr has joined #openstack-infra02:18
*** changzhi has joined #openstack-infra02:18
*** tphummel has joined #openstack-infra02:21
*** Qiming has joined #openstack-infra02:22
*** dims has joined #openstack-infra02:24
*** flepied has quit IRC02:25
*** tphummel has quit IRC02:29
*** rossella_s has quit IRC02:31
*** daemontool has joined #openstack-infra02:31
*** rossella_s has joined #openstack-infra02:31
*** Daisy has quit IRC02:33
*** diazjf has joined #openstack-infra02:33
*** FallenPe_ has quit IRC02:37
*** flepied has joined #openstack-infra02:38
*** Jeffrey4l has quit IRC02:38
*** aeng has quit IRC02:41
*** MarkAtwood has quit IRC02:42
*** lianz has quit IRC02:44
*** yamahata has quit IRC02:44
*** Jeffrey4l has joined #openstack-infra02:48
*** e0ne has joined #openstack-infra02:48
*** flwang has quit IRC02:50
*** EricGonczer_ has quit IRC02:51
*** aeng has joined #openstack-infra02:54
*** achanda has joined #openstack-infra02:56
*** apoorvad has quit IRC02:56
*** Jeffrey4l_ has joined #openstack-infra02:57
*** esker has quit IRC02:57
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add the periodic-neutron queue  https://review.openstack.org/27288002:59
*** aeng has quit IRC02:59
*** pradk has quit IRC02:59
*** Jeffrey4l has quit IRC03:00
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Run ovs-native jobs on the periodic-neutron queue  https://review.openstack.org/27059503:02
*** akshai has joined #openstack-infra03:02
*** sdake has joined #openstack-infra03:04
*** piet has quit IRC03:04
*** flwang has joined #openstack-infra03:04
*** akshai has quit IRC03:07
*** diazjf has quit IRC03:08
*** sdake has quit IRC03:12
*** pradk has joined #openstack-infra03:12
*** aeng has joined #openstack-infra03:12
*** diana_clarke has quit IRC03:17
*** gokrokve has joined #openstack-infra03:18
*** yuanying has quit IRC03:21
*** tlian2 has joined #openstack-infra03:22
*** gokrokve has quit IRC03:22
*** yuanying has joined #openstack-infra03:23
*** tlian has quit IRC03:24
*** [1]Thelo has joined #openstack-infra03:24
*** Thelo has quit IRC03:26
*** [1]Thelo is now known as Thelo03:26
*** yuanying has quit IRC03:28
openstackgerritMatthew Thode proposed openstack-infra/glean: Update glean to fix gentoo support  https://review.openstack.org/27288403:29
*** sflanigan has quit IRC03:29
*** BobBall_AWOL has joined #openstack-infra03:29
prometheanfiremordred: greghaynes ^ should fix some stuff, we now ignore the 'lo' interface again (regression on my part) https://review.openstack.org/27288403:29
*** BobBall_AWOL has quit IRC03:30
*** dims has quit IRC03:30
*** acruz has quit IRC03:33
*** yuanying has joined #openstack-infra03:33
*** unicell has quit IRC03:36
*** baoli has joined #openstack-infra03:37
*** FallenPegasus has joined #openstack-infra03:38
*** keedya has joined #openstack-infra03:38
*** kushal has quit IRC03:39
*** yuanying has quit IRC03:40
*** yuanying has joined #openstack-infra03:40
*** hdd has joined #openstack-infra03:41
*** kushal has joined #openstack-infra03:41
*** baoli has quit IRC03:42
*** doug-fish has joined #openstack-infra03:49
*** tlian2 has quit IRC03:50
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059703:54
*** Qiming has quit IRC03:54
*** rockyg has quit IRC03:56
*** yuanying has quit IRC03:56
*** yuanying has joined #openstack-infra03:57
prometheanfireand that's the rest :D03:57
*** yuanying_ has joined #openstack-infra03:58
*** sflanigan has joined #openstack-infra03:59
*** sflanigan has joined #openstack-infra03:59
*** baoli has joined #openstack-infra04:01
*** yuanying has quit IRC04:01
*** flwang1 has quit IRC04:04
*** signed8__ has quit IRC04:04
*** markvoelker has quit IRC04:04
*** gokrokve has joined #openstack-infra04:05
*** salv-orl_ has quit IRC04:09
*** gokrokve has quit IRC04:10
*** SamYaple has quit IRC04:11
*** rlandy has quit IRC04:12
*** Qiming has joined #openstack-infra04:14
*** wei-wang has joined #openstack-infra04:15
*** baoli has quit IRC04:17
*** SamYaple has joined #openstack-infra04:18
*** hdd has quit IRC04:23
*** david-lyle has joined #openstack-infra04:25
*** david-lyle has quit IRC04:25
*** david-lyle has joined #openstack-infra04:25
*** Sukhdev has joined #openstack-infra04:27
*** david-lyle has quit IRC04:30
*** gokrokve has joined #openstack-infra04:30
*** coolsvap|away is now known as coolsvap04:31
clarkbianw for 272857, pip needs working setuptools, will that rm break the following pip install -U?04:33
openstackgerritGhanshyam Mann proposed openstack-infra/project-config: Enbale neutron for layer 4 services gate jobs  https://review.openstack.org/27289504:34
*** gokrokve has quit IRC04:36
*** rguillebert has quit IRC04:37
*** david-lyle has joined #openstack-infra04:37
*** flepied has quit IRC04:40
gmannclarkb: Thanks, so fast :)04:41
*** flepied has joined #openstack-infra04:41
*** Daisy has joined #openstack-infra04:45
*** fawadkhaliq has joined #openstack-infra04:46
clarkbgmann: though I am curious why it is called the layer 4 test?04:49
*** Daisy has quit IRC04:49
*** piet has joined #openstack-infra04:49
openstackgerritSteve Kowalik proposed openstack-infra/jeepyb: Add three Zanata scripts  https://review.openstack.org/24145104:50
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Run the ofagent ci job on the periodic-neutron queue  https://review.openstack.org/26732304:52
asselin_clarkb, for gearman...who/when is the "number in queue" updated?04:53
*** Thelo has quit IRC04:53
asselin_i'm seeing them as 0, but there are plenty of jobs in the zuul queue with that name04:54
asselin_i'd like to know where to start debugging. zuul or jenkins?04:54
*** flepied has quit IRC04:55
gmannclarkb: all those services are consumption service only  - https://dague.net/2014/08/26/openstack-as-layers/04:56
*** vivekd has joined #openstack-infra04:56
clarkbasselin_: when zuul says run this job, typically after the results of the merge job are known04:57
clarkbgmann: ok, wasnt sure wjat layer description was being used, thanks04:57
asselin_oh...so many an issue with zuul merger. will take a look04:57
asselin_maybe*04:57
*** FallenPegasus has quit IRC04:59
greghaynesjeblair: multiprocessing is just like the threading module but uses multiple processes05:05
*** FallenPegasus has joined #openstack-infra05:05
*** yamahata has joined #openstack-infra05:05
*** markvoelker has joined #openstack-infra05:05
greghaynesso in this case it would be free lack of gil as long as were willing to read new images off an IPC queue05:05
*** shashank_hegde has joined #openstack-infra05:05
*** diana_clarke has joined #openstack-infra05:05
*** salv-orlando has joined #openstack-infra05:05
openstackgerritMerged openstack-infra/devstack-gate: neutron: set network_device_mtu to br-ex MTU value  https://review.openstack.org/26784705:06
greghaynesjeblair: anyhow, that can be an enhancement05:08
clarkbgreghaynes: I dont have context but couldnt each thread/process be its own gearman connection?05:08
greghaynesclarkb: context is https://review.openstack.org/#/c/272849/05:08
greghaynesclarkb: and ya, really the thing I am wondering is if we thread then will the cpu consumption while dib is run kill the uploading performance05:08
*** piet has quit IRC05:08
greghaynesbecause we added all this complexity of using rpc so we can in theory avoid that05:09
clarkbit might but I dont think you need any special IPC just use existing job dispatch05:10
*** markvoelker has quit IRC05:10
greghaynesclarkb: you mean multiple builder processes?05:11
clarkbya via mulyiprocess05:11
*** vivekd has quit IRC05:12
clarkbor fork05:12
greghaynesclarkb: Ya, so there are some benefits to having a coordinated set of processes - they can share an images-dir and then all upload the same images05:12
*** vivekd has joined #openstack-infra05:12
clarkbyup05:12
*** sdake has joined #openstack-infra05:13
greghaynesclarkb: but yes, just forking and using ipc to poke other builders that a new image is available so register upload jobs is what I am thinking05:13
clarkband you can either lock around writes (builds) with IPC or just promote a single process to write05:13
clarkbgreghaynes: you can possibly just inotify tjat05:13
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059705:13
*** salv-orlando has quit IRC05:13
greghaynesI dont think we need to lock - there will only be one builder who ever gets a unique build job05:13
greghaynesclarkb: oh, yes!05:13
greghaynesclarkb: that is exactly what we should do05:14
SpamapSwe're building in parallel?05:14
SpamapSfun05:14
SpamapScan we do this as an aaS? ;)05:14
SpamapSdib-aaS05:14
greghaynesSpamapS: if you run N builders they can each do a single build ATM but there is a patch to do more05:14
greghaynesSpamapS: so, funny story, I have really been thinking about that05:14
greghaynesSpamapS: in terms of there being a use case to keep a list of images in glance up to date05:14
*** krtaylor has quit IRC05:15
greghaynesSpamapS: which is basically what nodepool does :p05:16
clarkbbut we'll make it run "in" cloud and it wont get deployed everywhere so it wont get used05:16
SpamapSno05:16
SpamapSnobody said aaOPENSTACKService05:16
SpamapSjust, aaS05:16
clarkbheh I was being sarcastic05:17
greghaynesIt is pretty serviceafied ATM, just not rest-ey05:17
*** unicell has joined #openstack-infra05:17
SpamapSclarkb: you forgot to use the sarcasm font05:17
clarkbwe have a bad habut of taking good idea, making it hard to use then no one uses it05:17
clarkbgreghaynes: yes05:17
SpamapScompose-D,O,H turns it on05:17
clarkbgreghaynes: and ylu can just gearman to the workers now05:18
greghaynesnice05:18
greghaynesclarkb: yep05:18
*** shashank_hegde has quit IRC05:21
*** hdd has joined #openstack-infra05:22
*** shashank_hegde has joined #openstack-infra05:23
*** krtaylor has joined #openstack-infra05:27
*** shashank_hegde has quit IRC05:29
*** sdake has quit IRC05:29
*** flepied has joined #openstack-infra05:30
*** gokrokve has joined #openstack-infra05:30
openstackgerritMerged openstack-infra/shade: include keystonev2 role assignments  https://review.openstack.org/27099305:30
*** fawadkhaliq has quit IRC05:31
*** shashank_hegde has joined #openstack-infra05:33
*** e0ne has quit IRC05:33
*** vivekd has quit IRC05:35
*** FallenPegasus has quit IRC05:36
*** wei-wang has quit IRC05:37
*** FallenPegasus has joined #openstack-infra05:40
*** diana_clarke has quit IRC05:41
*** fawadkhaliq has joined #openstack-infra05:47
*** fawadkhaliq has quit IRC05:47
*** FallenPegasus has quit IRC05:48
*** gokrokve has quit IRC05:49
*** Daisy has joined #openstack-infra05:50
*** fawadkhaliq has joined #openstack-infra05:50
*** diana_clarke has joined #openstack-infra05:51
*** sdake has joined #openstack-infra05:51
*** Daisy has quit IRC05:52
*** piet has joined #openstack-infra05:52
*** Daisy has joined #openstack-infra05:52
*** flepied has quit IRC05:56
*** diana_clarke has quit IRC05:56
*** Daisy has quit IRC05:57
*** FallenPegasus has joined #openstack-infra05:57
*** shashank_hegde has quit IRC05:57
*** Yanyan has joined #openstack-infra05:58
*** Yanyanhu has quit IRC05:59
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059706:03
*** salv-orlando has joined #openstack-infra06:05
*** vgridnev has joined #openstack-infra06:07
*** flepied has joined #openstack-infra06:09
*** salv-orlando has quit IRC06:10
*** vivekd has joined #openstack-infra06:12
*** hdd has quit IRC06:15
*** aopincar has joined #openstack-infra06:16
*** FallenPegasus has quit IRC06:18
*** flwang has quit IRC06:22
*** piet has quit IRC06:22
*** flwang has joined #openstack-infra06:23
ianwclarkb: yeah, it does not seem to06:26
*** jaosorior has joined #openstack-infra06:27
*** wei-wang has joined #openstack-infra06:27
*** shashank_hegde has joined #openstack-infra06:30
openstackgerritSergey Kraynev proposed openstack/requirements: Bump up heatclient version to 0.9.0  https://review.openstack.org/27240506:31
*** rossella_s has quit IRC06:31
*** rossella_s has joined #openstack-infra06:31
openstackgerritIan Wienand proposed openstack-infra/system-config: Don't exclude python-setuptools  https://review.openstack.org/27285706:32
ianwclarkb: ^ so it's a good point though.  i looked at the code and i think the concerns are addressed in the comment now...06:32
ianwempirically, it does work06:33
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27291406:33
*** sflanigan has quit IRC06:33
*** sdake has quit IRC06:40
*** Daisy has joined #openstack-infra06:41
*** shashank_hegde has quit IRC06:44
*** abregman has joined #openstack-infra06:44
*** Qiming has quit IRC06:45
*** Qiming has joined #openstack-infra06:46
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27292206:47
*** FallenPegasus has joined #openstack-infra06:47
*** sdake has joined #openstack-infra06:49
*** sdake has quit IRC06:50
*** shashank_hegde has joined #openstack-infra06:50
*** Qiming has quit IRC06:54
*** salv-orlando has joined #openstack-infra06:57
*** salv-orlando has quit IRC06:57
*** salv-orlando has joined #openstack-infra06:58
*** vgridnev has quit IRC07:00
*** hichihara has quit IRC07:00
*** hichihara has joined #openstack-infra07:00
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059707:02
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a update in trunk repository version  https://review.openstack.org/22978907:04
*** exploreshaifali has joined #openstack-infra07:06
*** scheuran has joined #openstack-infra07:06
*** markvoelker has joined #openstack-infra07:06
*** markvoelker has quit IRC07:11
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a update in trunk repository version  https://review.openstack.org/22978907:17
*** Qiming has joined #openstack-infra07:19
*** scheuran_ has joined #openstack-infra07:19
*** wei-wang has quit IRC07:20
*** scheuran has quit IRC07:21
*** Jeffrey4l_ has quit IRC07:21
*** cody-somerville has quit IRC07:21
*** cody-somerville has joined #openstack-infra07:21
*** k4n0 has joined #openstack-infra07:21
*** nmagnezi_ has joined #openstack-infra07:21
*** Jeffrey4l_ has joined #openstack-infra07:21
*** k4n0 has quit IRC07:22
*** reedip has joined #openstack-infra07:23
*** esikachev has joined #openstack-infra07:23
openstackgerritReedip proposed openstack-infra/project-config: Add support for py34 job for Kuryr  https://review.openstack.org/27292907:23
openstackgerritMerged openstack-infra/project-config: Add doc publishing for networking-bagpipe  https://review.openstack.org/25953607:23
reedipAbove patch has been added to support a non-voting py34 job in gate for Openstack/kuryr07:24
*** gokrokve has joined #openstack-infra07:24
reedipyolonda: ping07:25
*** gnuoy_ has joined #openstack-infra07:27
*** gnuoy_ has quit IRC07:27
*** rcernin has joined #openstack-infra07:27
*** FallenPegasus has quit IRC07:28
*** thorst_ has joined #openstack-infra07:28
*** gokrokve has quit IRC07:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add the periodic-neutron queue  https://review.openstack.org/27288007:29
*** chlong_zzz is now known as chlong07:31
*** thorst_ has quit IRC07:32
*** Qiming has quit IRC07:32
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27292207:33
*** reedip has left #openstack-infra07:34
*** jcoufal has joined #openstack-infra07:37
AJaegerflwang: I'm here now, how can I help?07:37
*** vgridnev has joined #openstack-infra07:38
openstackgerritReedip proposed openstack-infra/project-config: Add support for py34 job for Kuryr  https://review.openstack.org/27292907:41
openstackgerritMerged openstack-infra/project-config: Enbale neutron for layer 4 services gate jobs  https://review.openstack.org/27289507:43
*** fbo_ is now known as fbo07:45
esikachevhi! peoples from requirements-cores here?07:52
*** flepied1 has joined #openstack-infra07:53
*** Qiming has joined #openstack-infra07:56
*** flepied has quit IRC07:56
*** Daisy has quit IRC07:56
*** shashank_hegde has quit IRC07:57
*** Daisy has joined #openstack-infra07:59
*** Sukhdev has quit IRC08:00
*** amaretskiy has joined #openstack-infra08:02
*** zeih has joined #openstack-infra08:02
*** Qiming has quit IRC08:05
*** hichihara has quit IRC08:07
*** exploreshaifali has quit IRC08:07
*** Yanyan has quit IRC08:07
*** Yanyanhu has joined #openstack-infra08:07
*** Qiming has joined #openstack-infra08:07
*** shashank_hegde has joined #openstack-infra08:11
*** salv-orlando has quit IRC08:11
*** matrohon has joined #openstack-infra08:13
*** chaitu has joined #openstack-infra08:15
*** ifarkas has joined #openstack-infra08:18
chaitunodepool machine ssh into the instance i am getting the following error in nodepool.log file http://paste.openstack.org/show/485112/08:19
chaitucan someone please help me out with it08:19
*** ganso has joined #openstack-infra08:20
*** arxcruz has joined #openstack-infra08:23
*** Qiming has quit IRC08:27
*** shashank_hegde has quit IRC08:27
*** Qiming has joined #openstack-infra08:28
*** shardy has joined #openstack-infra08:29
*** Yanyanhu has left #openstack-infra08:30
yolandamorning08:30
esikachevyolanda: can you merge https://review.openstack.org/#/c/270676/ ?08:31
*** dizquierdo has joined #openstack-infra08:34
*** dtardivel has joined #openstack-infra08:35
*** gildub has quit IRC08:35
dougwigif you're not seeing proxy errors in general from gerrit right now, i am, and i am on terrible terrible wi-fi. so, maybe slow clients are causing issues?08:36
*** vgridnev has quit IRC08:36
*** mikelk has joined #openstack-infra08:37
*** hashar has joined #openstack-infra08:38
*** yaume has joined #openstack-infra08:38
yolandahi, in terms of requirements i prefer that specific requirements core take action on it08:40
yolandaAJaeger, i'm fixing the double logs nesting issue08:41
AJaegerthanks, yolanda08:42
*** jlanoux has joined #openstack-infra08:42
*** vgridnev has joined #openstack-infra08:44
*** armax has quit IRC08:45
openstackgerritReedip proposed openstack-infra/project-config: Add support for py34 job for Kuryr  https://review.openstack.org/27292908:45
*** vgridnev has quit IRC08:46
*** nikil89_ has joined #openstack-infra08:48
*** nikil89_ is now known as naggappan08:48
*** jaypipes has joined #openstack-infra08:49
*** flepied1 has quit IRC08:49
openstackgerritReedip proposed openstack-infra/project-config: Add support for py34 job for Kuryr  https://review.openstack.org/27292908:50
*** ihrachys has joined #openstack-infra08:53
yolandaAJaeger, it should be fixed now08:54
*** amaretskiy has quit IRC08:55
*** amaretskiy1 has joined #openstack-infra08:55
*** derekh has joined #openstack-infra08:56
*** mriedem has joined #openstack-infra08:57
*** lucas-dinner is now known as lucasagomes08:58
*** nmagnezi_ has quit IRC08:58
*** armax has joined #openstack-infra09:04
*** salv-orlando has joined #openstack-infra09:04
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add translation jobs to murano-dashboard  https://review.openstack.org/26207309:05
AJaegerthanks, yolanda09:05
dmelladodougwig: just got a proxy error myself too09:06
dmelladoand the gerrit is *extremely* slow09:07
dmelladomy patch did go through in the end, but it took way longer that usual09:07
*** markvoelker has joined #openstack-infra09:07
*** Daisy has quit IRC09:07
*** thorst_ has joined #openstack-infra09:08
*** nmagnezi_ has joined #openstack-infra09:11
openstackgerritAles Komarek proposed openstack-infra/project-config: Add openstack-salt project and jobs  https://review.openstack.org/27246909:12
*** markvoelker has quit IRC09:12
lucasagomeshi all, do we have any gerrit admin online? I'm having an issue with a new project, few days ago I started a project called ironic-staging-drivers, it's approved now and I've submitted the first patch for it but I don't have -2..+2 powers to approve anything09:12
yolandahi lucasagomes, i can help09:13
yolandawhich project do you need to be added?09:13
lucasagomesso I asked here in #infra to be added to the gerrit ironic-staging-drivers-{core, release} groups, but somehow it didn't allow me to +2 any patches09:13
yolandamm, i added you yesterday09:13
lucasagomesyolanda, yeah, it's odd09:13
lucasagomesI looked at the ACL file, it seems fine09:13
yolandaplease logout and login, and empty browser cache09:13
lucasagomesyolanda, thakns for adding btw09:13
lucasagomesyolanda, oh... I logged in and out but haven't cleaned the cache09:14
lucasagomeslemme try09:14
*** achanda has quit IRC09:14
openstackgerritAthlan-Guyot sofer proposed openstack-infra/project-config: puppet: initiate testing for puppet-openstack-cookicutter  https://review.openstack.org/27215609:14
*** gnuoy_ has joined #openstack-infra09:15
lucasagomesyolanda, damn! that's it09:15
*** MCoLo has joined #openstack-infra09:15
lucasagomessorry for bothering...09:15
yolandathat caught me sometimes :)09:15
lucasagomesyeah09:16
*** woodster_ has quit IRC09:16
* lucasagomes approved the first skeleton patch, thanks yolanda :-)09:17
yolandaanytime09:17
AJaegerlucasagomes: now you can enlarge the core team as well  ;)09:18
*** flepied has joined #openstack-infra09:18
AJaegeryolanda: gerrit is problematic, lots of 502s ;(09:18
lucasagomesAJaeger, ++ dtantsur|afk already accept to help me out09:18
yolandaAJaeger, will take a look09:18
AJaegerthanks09:19
*** armax_ has joined #openstack-infra09:19
*** gnuoy_ has quit IRC09:19
*** jaosorior has quit IRC09:19
*** jaosorior has joined #openstack-infra09:20
*** jordanP has joined #openstack-infra09:20
AJaegeryolanda: could I bother you with another review later, please? https://review.openstack.org/#/c/271014/ would be great to see in eventually...09:21
*** armax has quit IRC09:21
*** armax_ is now known as armax09:21
yolandaAJaeger yep, sorry, i've been a bit overloaded these days09:22
*** _skolekonov is now known as skolekonov09:24
yolandaok, i'm seeing jetty errors, so i'll need to restart gerrit09:24
yolandai haven't sorted the status problem so i cannot send notification :(09:24
*** jaosorior has quit IRC09:25
*** BobBall has joined #openstack-infra09:25
bauzasyolanda: yeah a gerrit restart would be appreciated :)09:25
*** jaosorior has joined #openstack-infra09:25
bauzasthanks :)09:25
yolandadoing that now09:25
*** bexelbie has joined #openstack-infra09:26
yolandaok gerrit was restarted, let's see if that improves09:27
*** bexelbie has quit IRC09:27
*** bexelbie has joined #openstack-infra09:27
*** tzn has joined #openstack-infra09:27
bauzasjaypipes: just a miss from the respin in https://review.openstack.org/#/c/256297/509:30
bauzasjaypipes: could you just iterate a new file now ?09:30
*** Jeffrey4l_ is now known as Jeffrey4l09:30
*** jlanoux has quit IRC09:31
bauzasoh snap, bad chan09:31
*** jlanoux has joined #openstack-infra09:32
*** Liuqing has quit IRC09:33
*** jordan_ has joined #openstack-infra09:34
*** jordanP has quit IRC09:34
*** jordan_ has quit IRC09:34
*** jordanP has joined #openstack-infra09:35
*** yolanda has quit IRC09:39
*** amotoki has joined #openstack-infra09:41
*** yolanda has joined #openstack-infra09:41
*** binbincong_ has quit IRC09:43
*** jistr has joined #openstack-infra09:43
*** binbincong_ has joined #openstack-infra09:44
openstackgerritAles Komarek proposed openstack-infra/project-config: Add openstack-salt project and jobs  https://review.openstack.org/27246909:44
*** dizquierdo has quit IRC09:44
esikachevyolanda: please, look at https://review.openstack.org/#/c/270676/09:45
yolandahi esikachev, that is requirements so from infra we normally let requirements cores to deal with that09:45
openstackgerritAles Komarek proposed openstack-infra/project-config: Add openstack-salt project and jobs  https://review.openstack.org/27246909:46
*** vgridnev has joined #openstack-infra09:46
yolandahttps://review.openstack.org/#/admin/groups/131,members09:46
yolandaesikachev ^09:46
esikachevok, thanks09:46
*** baoli has joined #openstack-infra09:51
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs  https://review.openstack.org/27296709:54
*** alex_xu has quit IRC09:56
*** vgridnev has quit IRC09:57
*** baoli has quit IRC09:57
*** alex_xu has joined #openstack-infra09:58
*** vgridnev has joined #openstack-infra09:58
*** vgridnev has quit IRC09:58
*** vgridnev has joined #openstack-infra10:00
*** ihrachys has quit IRC10:02
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add optional run_metadata filter to get_test_runs_by_test_test_id  https://review.openstack.org/26995010:03
*** ihrachys has joined #openstack-infra10:03
*** tzn has quit IRC10:05
*** eliqiao has quit IRC10:06
*** rguillebert has joined #openstack-infra10:06
*** salv-orl_ has joined #openstack-infra10:06
*** eliqiao has joined #openstack-infra10:06
*** piet has joined #openstack-infra10:06
anteayayolanda: thank you for the gerrit restart10:08
yolandahi anteaya, no problem. I hope things are better10:08
*** markvoelker has joined #openstack-infra10:08
*** salv-orlando has quit IRC10:08
anteayawe will know if we have issues with everything else other than gerrit :)10:09
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs  https://review.openstack.org/27296710:10
*** esikachev has quit IRC10:11
*** dabukalam has joined #openstack-infra10:12
*** markvoelker has quit IRC10:13
openstackgerritMerged openstack-infra/project-config: skip most tests on a locale import  https://review.openstack.org/27101410:13
*** esikachev has joined #openstack-infra10:13
*** zhurong has quit IRC10:14
*** tzn has joined #openstack-infra10:14
*** ihrachys has quit IRC10:17
*** nmagnezi_ has quit IRC10:18
*** sshnaidm has quit IRC10:21
openstackgerritMerged openstack-infra/project-config: Add translation jobs to murano-dashboard  https://review.openstack.org/26207310:21
*** piet has quit IRC10:25
*** sputnik13 has quit IRC10:27
AJaegeryolanda: regarding https://review.openstack.org/272880 and the failure part: We discussed with mtreinish in one of the other reviews to not have one - and isntead use the web ui for looking at failures.10:28
yolandaah ok10:28
yolandacan you clarify the comment and then i approve?10:28
mtreinishyolanda: yeah when you the queue starts running it'll pop up on: http://status.openstack.org/openstack-health/#/?groupKey=build_queue10:29
mtreinishit's my evil plan to force people to start looking at things and provide feedback or hopefully code10:29
yolandaheh :)10:30
*** _nadya_ has quit IRC10:30
AJaegerdone10:30
*** _nadya_ has joined #openstack-infra10:30
*** armax has quit IRC10:30
AJaegermtreinish: ;)10:30
*** sputnik13 has joined #openstack-infra10:30
*** nmagnezi_ has joined #openstack-infra10:31
openstackgerritMerged openstack-infra/project-config: networking-midonet: Remove KEEP_LOCALRC setting  https://review.openstack.org/27286710:32
*** salv-orl_ has quit IRC10:35
openstackgerritAles Komarek proposed openstack-infra/project-config: Add openstack-salt project and jobs  https://review.openstack.org/27246910:35
*** dtantsur|afk is now known as dtantsur10:37
*** electrofelix has joined #openstack-infra10:38
*** ihrachys has joined #openstack-infra10:39
*** ldnunes has joined #openstack-infra10:41
*** sputnik13 has quit IRC10:44
openstackgerritMerged openstack-infra/project-config: Add the periodic-neutron queue  https://review.openstack.org/27288010:44
*** sputnik13 has joined #openstack-infra10:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Run the ofagent ci job on the periodic-neutron queue  https://review.openstack.org/26732310:48
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Run ovs-native jobs on the periodic-neutron queue  https://review.openstack.org/27059510:50
openstackgerritAngus Lees proposed openstack-infra/project-config: Create new tempest-dsvm-full-head job-template  https://review.openstack.org/27014310:51
openstackgerritMerged openstack-infra/project-config: Add networking-generic-switch project  https://review.openstack.org/26766410:53
openstackgerritMerged openstack-infra/project-config: Dismiss glance-drivers team  https://review.openstack.org/27257310:55
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add DB API method to get failure rate for jobs by run_metadata  https://review.openstack.org/26550710:57
*** tzn has quit IRC11:02
*** gokrokve has joined #openstack-infra11:02
*** sdake has joined #openstack-infra11:05
*** gokrokve has quit IRC11:06
openstackgerritMerged openstack-infra/project-config: Run ovs-native jobs on the periodic-neutron queue  https://review.openstack.org/27059511:07
*** baoli has joined #openstack-infra11:07
*** rfolco has joined #openstack-infra11:09
*** changzhi has quit IRC11:10
openstackgerritMerged openstack-infra/project-config: Add tempest-dsvm-ironic-pxe_libvirt job  https://review.openstack.org/26959211:12
openstackgerritMerged openstack-infra/project-config: gnocchi: add openstack-server-release-jobs  https://review.openstack.org/27268011:12
openstackgerritMerged openstack-infra/project-config: Run the ofagent ci job on the periodic-neutron queue  https://review.openstack.org/26732311:12
*** baoli has quit IRC11:12
*** dizquierdo has joined #openstack-infra11:15
*** sshnaidm has joined #openstack-infra11:15
*** sfinucan has joined #openstack-infra11:16
*** mikelk has quit IRC11:16
*** mikelk has joined #openstack-infra11:18
*** mikelk has quit IRC11:18
*** mikelk has joined #openstack-infra11:19
*** Daisy has joined #openstack-infra11:19
*** trown|outttypeww is now known as trown11:19
*** sdake has quit IRC11:20
anteayayolanda: so when you approve changes that make existing gerrit groups redundant are you cleaning up the unused groups? if no, can you?11:21
anteayahttps://review.openstack.org/#/c/272573/1 as an example11:21
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add DB API method to get failure rate for jobs by run_metadata  https://review.openstack.org/26550711:21
yolandaanteaya no, haven't cleaned, is not something that happens usually11:21
*** e0ne has joined #openstack-infra11:22
yolandaanteaya, i'd also prefer to check with some other infra-root, because i'm not sure about the cleanest way to remove a gerrit group11:22
anteayawhat is not something that happens usually?11:23
*** jd__ has quit IRC11:23
yolandaremoving groups11:23
anteayayou can't remove them, you hide them11:23
anteayawe hide unused groups everytime we do a rename11:23
yolandaanteaya, can you teach me how to do it?11:23
anteayait is a clean up as you go kind of thing11:23
yolandacan be done from gerrit ui?11:24
anteayaif you go into the gerrit ui and search for glance-drivers-core11:24
anteayayes11:24
anteayais there an option to hide the group?11:24
*** Daisy has quit IRC11:24
anteayaafter the acl that just merged has updated11:24
yolandai don't see any option to hide group there11:25
*** Daisy has joined #openstack-infra11:25
anteayahmmmmm11:25
*** mikelk has quit IRC11:25
anteayaokay I don't know where to look as I am not a gerrit admin11:25
anteayabut somehow groups that are made redundant get cleaned up, and I believe the action is hiding them11:26
yolandaok, seeing now, i lost my session and was not logged11:26
anteayaah11:26
*** exploreshaifali has joined #openstack-infra11:26
anteayaokay so when that acl you approved has populated in gerrit11:26
yolandadone now11:26
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Resolve Board and Worklist contents on the server-side  https://review.openstack.org/27140811:26
anteayawonderful, thank you11:26
yolandai didn't know about that action, thanks11:26
anteayathank you11:27
yolandait may be worth documenting it, if that hasn't been done11:27
anteayagood point11:27
anteayaI don't know if it has11:27
*** jd__ has joined #openstack-infra11:28
yolandai don't see that task on our gerrit documentation, it will be useful to have it11:29
anteayaI agree11:30
anteayathanks for looking11:30
yolandano problem, new thing learnt11:31
anteaya:)11:31
*** andreykurilin__ has joined #openstack-infra11:38
*** Daisy has quit IRC11:39
*** trown is now known as trown|outttypeww11:41
*** fawadkhaliq has quit IRC11:42
AJaegeranteaya: what brings us the pleasure to have you here during European morning?11:42
purpHello, kind #infra folks. Is http://refstack.net/ a concern of yours, or should I ask someone else why it seems to be down?11:42
*** fawadkhaliq has joined #openstack-infra11:42
anteayaAJaeger: nova mid-cycle11:42
AJaegeranteaya: where is it?11:42
anteayabristol11:42
anteayapurp: looking11:43
purpanteaya: Thanks.11:43
AJaegeranteaya: I see - enjoy the British weather ;)11:43
anteayapurp: I don't see refstack.net listed in infra's cacti: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=7&select_first=true11:43
anteayaAJaeger: thanks, so far so good :)11:44
*** pcaruana has joined #openstack-infra11:44
purpAwesome. So we set something up and don't seem to have minders for it. I'll push on the DefCore/RefStack folks to see what's what.11:44
purpThanks!11:44
anteayacurrently that dns is registered to davidlenwell11:44
anteayaI think that if it was under infra it would be registered to the foundation11:45
anteayapurp: so I'm going with contact davidlenwell at this point11:45
anteayapurp: it is possible I am wrong11:45
purpanteaya: It's a good starting point. Thanks!11:45
anteayawelcome11:45
*** dalgaaf has joined #openstack-infra11:46
*** zz_ja has quit IRC11:46
anteayas/domain/dns11:47
*** jkraj has joined #openstack-infra11:48
AJaegeranteaya: do you have time for some smaller reviews? Or should I better not bother you this week?11:50
*** rfolco has quit IRC11:50
anteayaAJaeger: we just went on breack11:50
anteayabreak11:51
*** rfolco has joined #openstack-infra11:51
anteayagive me the list11:51
*** baoli has joined #openstack-infra11:51
anteayabut yes my priority this week is the live discussion11:51
AJaegerhttps://review.openstack.org/#/c/272478/ and https://review.openstack.org/#/c/271911/ , please11:51
anteayathanks for understanding11:51
anteayathank you11:51
AJaegerthanks11:52
*** dprince has joined #openstack-infra11:52
AJaegerand one more if possible https://review.openstack.org/#/c/269763/11:53
*** zz_ja has joined #openstack-infra11:53
*** baoli has quit IRC11:57
anteayastand by on 26976311:57
AJaegeranteaya: Shall I do a followup and remove everything from gantt?11:57
anteayaI would +2 that patch if you do11:57
AJaegerI'll do11:57
anteayathanks11:57
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Use constraints based job to the gate of ofagent  https://review.openstack.org/26198211:58
AJaegerREgarding 269763: jeblair said yesterday it's safe to merge here11:58
anteayaunderstood, out of courtesy going to lean across the table and give sdague a heads up after this conversation is concluded11:58
anteayashould be about 10 minutes11:58
AJaegeranteaya: good idea - thanks11:58
anteayathanks11:59
AJaegerhe might want to +2 https://review.openstack.org/#/c/271379 as well - unless you do;)11:59
AJaegermtreinish, sdague : Could you both review https://review.openstack.org/#/c/268295/ to "Allow stable-maint-core members to manage devstack stable branches" , please?12:00
AJaegerthat was my fast lane for today ;)12:01
*** sdake has joined #openstack-infra12:01
anteayaI can't understand the commit message in https://review.openstack.org/#/c/27137912:03
anteayaI don't have a "this patch does this" bit that I'm looking for12:03
openstackgerritMerged openstack-infra/project-config: Remove some jobs from gantt  https://review.openstack.org/27191112:03
anteayaI get something was tried, something broke, so a bit of a story12:04
anteayaI don't get a declarative statement about the intent of the patch12:04
AJaegeranteaya: then -1 and ask for a better one ;). Yes, it is confusing12:04
anteayaokey dokey12:04
* AJaeger reviewed the broken patch so had that background in his mind12:04
openstackgerritMerged openstack-infra/tripleo-ci: Switch the overcloud pingtest to use the new heat client  https://review.openstack.org/27247912:06
anteayaAJaeger: ah12:06
anteayaI carry no context in my head ever12:07
*** vgridnev has quit IRC12:07
*** ajmiller has quit IRC12:07
*** zhurong has joined #openstack-infra12:07
*** ajmiller has joined #openstack-infra12:07
anteayawell maybe a bit12:07
*** sputnik13 has quit IRC12:08
openstackgerritMerged openstack-infra/project-config: Revert "Don't use internap for 2-node labels"  https://review.openstack.org/26976312:08
*** markvoelker has joined #openstack-infra12:09
anteayalunch now I'll try to coral sdague and mtreinish to look at 26829512:09
*** jlanoux has quit IRC12:10
*** vgridnev has joined #openstack-infra12:10
AJaegeranteaya: enjoy lunch!12:10
AJaegerthanks, anteaya !12:10
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove jobs from gantt and python-ganttclient  https://review.openstack.org/27301012:11
AJaegeranteaya: for you ^12:11
*** markvoelker has quit IRC12:14
*** vgridnev has quit IRC12:15
*** exploreshaifali has quit IRC12:16
*** erlon has joined #openstack-infra12:18
*** daemontool has quit IRC12:19
*** vgridnev has joined #openstack-infra12:21
*** dims has joined #openstack-infra12:23
*** gordc has joined #openstack-infra12:29
*** eantyshev has joined #openstack-infra12:29
*** tdurakov has joined #openstack-infra12:32
tdurakovclarkb, hi, are you around?12:32
*** fhubik has joined #openstack-infra12:35
*** fhubik is now known as fhubik_brb12:35
openstackgerritgordon chung proposed openstack-infra/project-config: fix ceilometerclient gate  https://review.openstack.org/27137912:35
*** tdurakov has quit IRC12:35
*** salv-orlando has joined #openstack-infra12:35
*** chem has quit IRC12:36
*** tdurakov has joined #openstack-infra12:36
*** pcaruana has quit IRC12:37
*** rhallisey has joined #openstack-infra12:37
chaituHi all, my nodepool is unable to ssh the instance created in devstack can some one help me with this12:37
*** gnuoy_ has joined #openstack-infra12:38
*** weshay_xchat has joined #openstack-infra12:38
*** chaitu has quit IRC12:39
*** daemontool has joined #openstack-infra12:40
*** tzn has joined #openstack-infra12:40
*** salv-orlando has quit IRC12:40
*** fhubik_brb is now known as fhubik12:40
*** tdurakov has quit IRC12:41
*** baoli has joined #openstack-infra12:42
*** e0ne has quit IRC12:42
*** Daisy has joined #openstack-infra12:43
*** thiagop has joined #openstack-infra12:45
openstackgerritAles Komarek proposed openstack-infra/project-config: Add openstack-salt project and jobs  https://review.openstack.org/27246912:47
*** amrith is now known as _amrith_12:47
*** yamamoto_ has quit IRC12:49
*** claudiub has joined #openstack-infra12:52
*** jlanoux has joined #openstack-infra12:52
*** e0ne has joined #openstack-infra12:52
*** placko has joined #openstack-infra12:55
*** trown|outttypeww is now known as trown12:59
*** tdurakov has joined #openstack-infra13:01
*** BobBall_ has joined #openstack-infra13:02
*** EricGonczer_ has joined #openstack-infra13:03
anteayatdurakov: clarkb will return next week13:04
tdurakovanteaya, hi, maybe you could help me then?13:04
*** _amrith_ is now known as amrith13:05
tdurakovanteaya, there is a bug: https://bugs.launchpad.net/nova/+bug/1535232 so I would like to debug it on ci nodes during job execution, how to get access to nodes?13:06
openstackLaunchpad bug 1535232 in OpenStack Compute (nova) "live-migration ci failure on nfs shared storage" [Medium,Confirmed]13:06
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove jobs from gantt and python-ganttclient  https://review.openstack.org/27301013:06
*** BobBall has quit IRC13:06
*** EricGonc_ has joined #openstack-infra13:06
*** david-lyle has quit IRC13:08
*** mpavone has joined #openstack-infra13:09
*** markvoelker has joined #openstack-infra13:09
*** EricGonczer_ has quit IRC13:10
*** mpavone has left #openstack-infra13:10
anteayaAJaeger: this diff is really confusing13:10
AJaegeranteaya: is https://review.openstack.org/#/c/271379 better? I know it's not perfect...13:10
anteayahttps://review.openstack.org/#/c/273010/2/jenkins/jobs/projects.yaml13:10
AJaegerindeed...13:10
AJaegerWhat I did manually: Remove ganttclient, notice that the job is used and add it to galnceclient.13:11
anteayatrying to parse your patch first13:11
AJaegerBetter compare:13:11
AJaegerhttps://review.openstack.org/#/c/273010/1/jenkins/jobs/projects.yaml13:11
*** coolsvap is now known as coolsvap|away13:11
AJaegerand https://review.openstack.org/#/c/273010/1..2/jenkins/jobs/projects.yaml13:11
*** tiswanso has quit IRC13:11
openstackgerritMerged openstack-infra/irc-meetings: Move nova-notification meeting  https://review.openstack.org/27200413:12
anteayaI'm at a loss as to why a job running on ganttclient, which has glanceclient in the name, is apended to glanceclient for this patch to work13:13
*** EricGonc_ has quit IRC13:13
*** gnuoy_ has quit IRC13:14
*** markvoelker has quit IRC13:14
AJaegeranteaya: check zuul/layout.yaml, let me give you a link13:15
AJaegerhttp://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n844213:15
ansiwenAJaeger, sdague: now the pbr people recommended, to bring the compile_catalog patch up to babel. ;-)13:15
AJaegerIt was always wrong there...13:15
*** chlong has quit IRC13:15
AJaegeransiwen: I've seen it . Why not give it a try and if babel sends you back to pbr you can argue with them. Could you try it, please?13:16
anteayaAJaeger: wow13:16
anteayayeah that job is defined on the wrong repo13:16
* AJaeger was surprised as well...13:17
anteayaI think this is two separate patches, the glance job fixed to be located on the glance repo (wow)13:17
AJaegerSo, your suggestion is worth that cleanup already.13:17
AJaegeranteaya: Ok, will do...13:17
anteayaand the child patch to remove the gantt jobs13:17
anteayaAJaeger: thanks13:17
* anteaya says wow again13:17
* anteaya goes back to nova mid-cycling13:18
*** mikelk has joined #openstack-infra13:20
ansiwenAJaeger: do you really think it makes sense there, especially the autodetection? AFAIK there is no rule, that the .pot files lie in the locales directory13:20
ansiwenAJaeger: but: I found out you can call setup.py compile_catalog with a --domain= option13:21
*** mikelk has quit IRC13:21
*** e0ne has quit IRC13:21
ansiwenAJaeger: so packaging can call setup.py for each of the text domains at least13:21
*** keedya has quit IRC13:21
openstackgerritgordon chung proposed openstack-infra/project-config: rename ceilometer-specs to telemetry-specs  https://review.openstack.org/24889713:23
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove jobs from gantt and python-ganttclient  https://review.openstack.org/27301013:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Move glanceclient-dsvm-function to glanceclient  https://review.openstack.org/27303213:26
*** amrith is now known as _amrith_13:26
AJaegeranteaya: here're the changes ^13:26
anteayaokay will look next break13:26
AJaegeransiwen: documenting that call with --domain= would be plan B.13:26
AJaegeranteaya: thanks, nothing urgend13:27
anteayathanks13:27
AJaegeransiwen: report it - without a cahnge as issue and see what the babel folks think13:27
*** _nadya_ has quit IRC13:27
AJaegerdhellmann, lifeless, and myself can comment there as needed - and then we can decide on best course of action13:27
*** chlong has joined #openstack-infra13:28
*** _nadya_ has joined #openstack-infra13:30
*** changzhi has joined #openstack-infra13:32
*** notnownikki has joined #openstack-infra13:33
*** hdd has joined #openstack-infra13:36
*** Daisy has quit IRC13:36
*** Daisy has joined #openstack-infra13:37
*** ociuhandu has joined #openstack-infra13:39
*** vgridnev has quit IRC13:39
*** changzhi has quit IRC13:39
*** vgridnev has joined #openstack-infra13:40
*** sdake_ has joined #openstack-infra13:40
*** Daisy has quit IRC13:42
*** sdake has quit IRC13:42
*** sirushti has joined #openstack-infra13:42
*** mikelk has joined #openstack-infra13:43
*** krtaylor has quit IRC13:44
*** sirushti has quit IRC13:45
*** dkranz has joined #openstack-infra13:45
*** hdd has quit IRC13:45
*** markvoelker has joined #openstack-infra13:45
*** sirushti has joined #openstack-infra13:48
*** julim has joined #openstack-infra13:48
*** signed8b_ has joined #openstack-infra13:49
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow worklist "users" to add, move, and delete items  https://review.openstack.org/27305213:50
*** andreykurilin__ has quit IRC13:52
*** lucasagomes is now known as lucas-hungry13:54
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added afs to wheel mirror slaves  https://review.openstack.org/27305413:54
*** BobBall_ is now known as BobBall13:54
*** keedya has joined #openstack-infra13:54
krotscheckmordred: ^^13:55
*** fawadkhaliq has quit IRC13:55
*** fawadk has joined #openstack-infra13:55
*** keedya has left #openstack-infra13:56
*** tdurakov has quit IRC13:56
*** yaume_ has joined #openstack-infra13:59
*** zul has joined #openstack-infra13:59
*** jkraj has quit IRC13:59
*** tlian has joined #openstack-infra14:00
*** daemontool has quit IRC14:00
*** yaume has quit IRC14:02
*** julim_ has joined #openstack-infra14:02
*** tiswanso has joined #openstack-infra14:03
*** keedya_ has joined #openstack-infra14:05
*** sdake_ is now known as sdake14:05
*** julim has quit IRC14:05
*** vivekd has quit IRC14:07
*** kgiusti has joined #openstack-infra14:09
*** yamamoto has joined #openstack-infra14:10
*** yamamoto_ has joined #openstack-infra14:11
*** jsavak has joined #openstack-infra14:12
*** fawadk has quit IRC14:12
*** tdurakov has joined #openstack-infra14:12
*** salv-orlando has joined #openstack-infra14:13
*** rajinir has joined #openstack-infra14:14
mriedemzuul keeps kicking this out w/o running jobs https://review.openstack.org/#/c/273033/14:14
mriedemi'm thinking the depends-on to devstack with multiple branches is causing problems14:14
mriedembut don't know why14:14
*** rlandy has joined #openstack-infra14:14
*** sabeen has joined #openstack-infra14:14
*** yamamoto has quit IRC14:15
*** fawadkhaliq has joined #openstack-infra14:15
*** fawadkhaliq has quit IRC14:16
*** david-lyle has joined #openstack-infra14:17
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27291414:17
clarkbmriedem: it says it ran jobs14:18
*** ajmiller_ has joined #openstack-infra14:18
*** piet has joined #openstack-infra14:18
mriedemclarkb: it did earlier, when there was only the devstack change on master,14:18
clarkb~half an hour ago14:18
mriedembut i need the same change on devstack stable/liberty b/c it's live migration grenade that i'm trying to test14:18
mriedemwhen i recheck the jobs show up as queued in zuul but then they are gone14:19
*** piet has quit IRC14:19
clarkbI dont see your recheck comments, is that the correct change link?14:19
*** piet has joined #openstack-infra14:19
mriedemblarg14:19
mriedemhttps://review.openstack.org/#/c/272950/14:19
mriedemsorry14:19
*** sabeen3 has joined #openstack-infra14:20
clarkbmriedem: first thing I would check is that there are no loops though a loop should resuly in -114:20
*** dims has quit IRC14:21
*** sabeen has quit IRC14:21
krotscheckinfra-core: Is there anyone around that can add keedya_ as the first core on openstack/shovel? He has the project, he just doesn't have ACL's ;)14:22
*** amitgandhinz has joined #openstack-infra14:22
clarkbkrotscheck: is that the gerrit usernamr?14:23
krotscheckclarkb: I... don't think so? andre.keedy@emc.com14:23
krotscheckkeedya_: Once you're core, you can add other cores that can approve your work.14:23
krotscheckkeedya_: In general, it's frowned upon to approve your own code :)14:24
anteayaclarkb: can you answer jeblair's question in -incident?14:24
mriedemclarkb: ah, the nova dependency now has a merge conflict, that would do it14:24
anteayaclarkb: and how is the beach in mexico?14:24
clarkbkrotscheck:  done14:25
krotscheckkeedya_: ^^14:25
krotscheckclarkb: Much obliged :)14:25
clarkbanteaya: it looks like jeblair figured it out, the defaults file specifies the list of daemon args14:26
anteayaclarkb: awesome, thanks for looking14:27
clarkbanteaya: beach is very windy14:27
anteayaclarkb: good for para-sailing?14:27
anteayawindy in bristol too, just not as warm14:27
clarkbanteaya: there were parasailers buy I dont know if it is favorable weather14:27
*** peristeri has joined #openstack-infra14:27
anteayaah makes sense14:27
keedya_krotcheck: my username is keedya email andre.keedy@emc.com14:28
anteayaclarkb: backlog of folks with with duplicate gerrit accounts in backscroll but right now I don't think there are any fires14:28
clarkbanteaya: I dont have db access right now, this is just phone over breakfast tea14:29
anteayayup, just sharing status best I know it to be14:29
anteayaenjoy tea14:29
*** Swami has joined #openstack-infra14:29
clarkbdepending on how the day goes I may try working on splitting the nodepool daemon log config files assuming that isnt already in progress14:30
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196414:30
anteayaI don't know, mostly nova mid-cycling14:30
clarkbas that was the remaining item for puppeting those services14:30
anteayaI can't say I'm up on all the backscroll14:30
clarkbkk14:30
*** rossella_s has quit IRC14:31
*** rossella_s has joined #openstack-infra14:31
*** daemontool has joined #openstack-infra14:31
*** ajmiller_ has quit IRC14:34
*** ccrouch has joined #openstack-infra14:34
*** jsavak has quit IRC14:35
*** dims has joined #openstack-infra14:36
keedya_clarkb: thanks!! :)14:36
*** jsavak has joined #openstack-infra14:36
*** alivigni has joined #openstack-infra14:38
*** hdd has joined #openstack-infra14:40
*** yamamoto_ has quit IRC14:41
krotscheckurgh.14:43
krotscheckVagrant no likee centos14:43
*** keedya_ has left #openstack-infra14:43
*** david-lyle has quit IRC14:44
*** _amrith_ is now known as amrith14:45
*** samuelBartel has joined #openstack-infra14:46
ansiwenAJaeger: let's see, what they say... https://github.com/python-babel/babel/pull/33514:47
*** yamamoto has joined #openstack-infra14:48
*** david-lyle has joined #openstack-infra14:48
*** smarcet has joined #openstack-infra14:48
*** keedya__ has joined #openstack-infra14:50
*** zz_dimtruck is now known as dimtruck14:50
*** regXboi has joined #openstack-infra14:50
krotscheckAnyone have suggestions on which vagrant virtualbox image I can use to simulate a centos node?14:50
krotscheckcentos/7 doesn't have the guest additions, and I really don't care to build that box manually14:51
*** keedya__ has quit IRC14:51
*** nmagnezi_ is now known as nmagnezi14:52
*** e0ne has joined #openstack-infra14:53
*** david-lyle has quit IRC14:53
*** thorst_ has quit IRC14:54
*** piet has quit IRC14:55
*** sigmavirus24_awa is now known as sigmavirus2414:55
openstackgerritvenkatamahesh proposed openstack/requirements: tuskar is no longer maintained  https://review.openstack.org/27308814:56
*** pradk_ has joined #openstack-infra14:56
*** piet has joined #openstack-infra14:56
*** edmondsw has joined #openstack-infra14:57
*** yamamoto has quit IRC14:57
*** gokrokve has joined #openstack-infra14:58
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Fix being able to drop lanes into lanes  https://review.openstack.org/27308914:59
*** e0ne has quit IRC14:59
*** thorst_ has joined #openstack-infra14:59
*** thorst_ has quit IRC15:01
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059715:01
*** lucas-hungry is now known as lucasagomes15:02
*** jpr has quit IRC15:02
AJaegeransiwen: thanks. lifeless, see please see  https://github.com/python-babel/babel/pull/33515:03
*** zul has quit IRC15:03
*** e0ne has joined #openstack-infra15:05
*** rbrndt has joined #openstack-infra15:05
*** andymaier has joined #openstack-infra15:06
openstackgerritAlexander Maretskiy proposed openstack-infra/project-config: Increase timeout for job gate-rally-dsvm-cli  https://review.openstack.org/27013415:06
*** MarkAtwood has joined #openstack-infra15:08
*** yamamoto has joined #openstack-infra15:08
openstackgerritvenkatamahesh proposed openstack-infra/project-config: tuskar is no longer maintained  https://review.openstack.org/27309515:10
*** Keedya_ has joined #openstack-infra15:10
*** diazjf has joined #openstack-infra15:11
*** Daisy has joined #openstack-infra15:11
*** sputnik13 has joined #openstack-infra15:12
*** piet has quit IRC15:13
*** Keedya_ has quit IRC15:14
*** thorst_ has joined #openstack-infra15:14
*** aysyd has joined #openstack-infra15:15
*** gokrokve has quit IRC15:16
*** aysyd has quit IRC15:17
*** hdd has quit IRC15:18
*** Qiming has quit IRC15:18
*** aysyd has joined #openstack-infra15:18
*** yamamoto has quit IRC15:19
*** keedya_ has joined #openstack-infra15:19
*** hdd has joined #openstack-infra15:24
*** piet has joined #openstack-infra15:24
keedya_Hi all I want to publish openstack/shovel changes on IRC. which channel will make sense here?15:25
sdagueanyone know why https://review.openstack.org/#/c/262931/ is in submitted / merge pending still after 40 minutes?15:25
AJaegerkeedya_: the channel where your team is hanging out and where your topic applies15:25
*** tonytan4ever has joined #openstack-infra15:25
keedya_my team is only a group on one(myself).15:26
*** zhurong has quit IRC15:26
keedya_I am looking for more code reviewrs committers in openstack community15:26
AJaegerkeedya_: since you're not hanging out on any channel, then it does not make sense to send notifications to any channel...15:27
anteayasdague: I've never seen that before, but gerrit has posted a helpful comment on that patch15:28
AJaegerkeedya_: find first reviewers, grow a team - and then figure out where it is.15:28
jaosoriorHey, does anyone know if the fedora-23 node types are working already?15:28
AJaegerChannel notifictaion help the reviewers - if you post them just somewhere, you annoy others15:28
AJaegerjaosorior: there's work going on, see email from ianw on openstack-infra mailing list from today with details15:28
jaosoriorAJaeger: will do. Thanks15:29
keedya_ AJaeger: make sense!! thanks!!15:29
sdagueanteaya: ok, wow, didn't realize we could get into that state15:29
anteayasdague: me either15:29
anteayaTIL15:30
anteayathanks for that15:30
AJaegerkeedya_: so, I suggest you abandon your change for now - and create a new one later15:30
*** yamahata has quit IRC15:30
sdaguehowever that explains how to fix it, just hit the rebase button and reapprove15:30
*** yamahata has joined #openstack-infra15:30
keedya_AJaeger: will do!!15:31
anteayawoooot15:31
*** MarkAtwood has quit IRC15:31
*** mtanino_ has joined #openstack-infra15:32
*** jdg has joined #openstack-infra15:33
*** cschwede has quit IRC15:34
*** jgriffith is now known as Guest9423415:36
*** krtaylor has joined #openstack-infra15:36
*** jdg is now known as jgriffith15:36
*** tdurakov has quit IRC15:37
*** dprince has quit IRC15:37
*** aopincar has quit IRC15:37
*** MarkAtwood has joined #openstack-infra15:38
*** vgridnev has quit IRC15:38
*** yamamoto has joined #openstack-infra15:39
*** dimtruck is now known as zz_dimtruck15:39
*** fawadkhaliq has joined #openstack-infra15:40
*** fawadkhaliq has quit IRC15:40
*** fawadkhaliq has joined #openstack-infra15:40
*** zz_dimtruck is now known as dimtruck15:40
*** keedya_ has quit IRC15:41
*** esikachev has quit IRC15:42
*** gokrokve has joined #openstack-infra15:42
*** cschwede has joined #openstack-infra15:42
*** Sukhdev has joined #openstack-infra15:43
*** vgridnev has joined #openstack-infra15:43
*** cznewt has joined #openstack-infra15:43
*** sputnik13 has quit IRC15:44
*** keedya has joined #openstack-infra15:45
*** tdurakov has joined #openstack-infra15:46
*** _nadya_ has quit IRC15:47
*** keedya has quit IRC15:47
*** keedya has joined #openstack-infra15:48
d0ugalpython-tuskarclient has been removed from https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/check-osc-plugins.sh#L3615:49
d0ugalbut the install is still being attempted: http://logs.openstack.org/36/265336/6/check/check-osc-plugins/789d58c/console.html15:49
*** tonytan_brb has joined #openstack-infra15:50
krotschecknibalizer, crinkle: I've got a bit of a problem I need some advice on. openstack_project::slave_common, the redhat manifest declares some kernel header packages in an array, however those are also declared in the puppet-openafs::client.pp module. Adding AFS to one of our slaves is hitting an error, and while each() exists... well, is parser=future something we can do? Otherwise, any ideas on how to address this?15:50
d0ugalIs there something we need to do for that update to get through?15:50
AJaegerd0ugal: let me check...15:50
*** sputnik13 has joined #openstack-infra15:51
*** tdurakov has quit IRC15:51
*** matrohon has quit IRC15:51
*** jpr has joined #openstack-infra15:52
AJaegerd0ugal: might be that we need new images generated with the script updated on them ;(15:53
*** tonytan4ever has quit IRC15:53
*** tdurakov has joined #openstack-infra15:53
d0ugalAJaeger: ah15:53
d0ugalThat sounds like a big task :(15:53
AJaegerd0ugal: this is on rax-ord - let's ask others whether the  bare-trusty images are current15:54
AJaegerinfra-root, can you help, please? ^15:54
AJaegerd0ugal: those images are build automatically but sometimes fail15:54
d0ugalright15:54
*** burgerk has joined #openstack-infra15:55
*** sputnik13 has quit IRC15:57
*** vgridnev has quit IRC15:59
*** naggappan has quit IRC15:59
*** nmagnezi has quit IRC15:59
krotscheckDo we have a policy for where we include puppet package conditionals? I have a package that's declared in puppet-openafs, and one that's declared in slave_common.pp16:01
krotscheckclarkb: ^^ Comments?16:01
*** mgould has joined #openstack-infra16:02
jeblairgreghaynes: i know what multiprocessing is.  i just didn't understand your question.  i thought you were telling me we were using it somewhere.16:02
anteayaAJaeger d0ugal image logs are here: http://nodepool.openstack.org/16:02
anteayamorning jeblair16:02
jeblairgreghaynes: the gil is not a concern with the patch i made16:02
krotscheckjeblair: Are you still working on that incident?16:02
jeblairgreghaynes: all of the dib work happens in another process, while not holding the gil, so there is nothing to be gained there16:04
AJaegeranteaya, d0ugal: Change merged on Monday, images build fine today - question is whether they uploaded. d0ugal try rechecking and if not come back here.16:04
jeblairgreghaynes: but i don't want to run more than one dib process at a time anyway -- it fairly well utilizes the whole machine already16:04
* AJaeger signs off for today and wishes everybody a great day16:04
*** tdurakov has quit IRC16:04
jeblairgreghaynes: i'm more interested in running more than one upload process at a time, because they are not as efficient (they spend most of their time waiting on the network)16:05
*** yaume_ has quit IRC16:05
*** tdurakov has joined #openstack-infra16:05
*** salv-orl_ has joined #openstack-infra16:06
jeblairkrotscheck: no16:06
krotscheckjeblair: puppet-openafs declares kernel header packages, which are also declared in slave_common.pp. I can wrap conditionals around those, but don't know if I should do that in the puppet module or in system config. Suggestion?16:07
jeblairkrotscheck: do it in both?16:07
krotscheckjeblair: You gotit16:07
jeblairthat really should have just been a universal pattern :(16:08
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: Added conditional statements for installed packages  https://review.openstack.org/27312716:08
krotscheckjeblair: It's harder to do when you can't loop over arrays16:08
krotscheckjeblair: Which apparently requires parser=future in puppet.conf16:08
krotscheckWhich I'm not certain is a thing I'm allowed to patch16:08
jeblairkrotscheck: it sounds like a rabbit hole at least16:09
krotscheckjeblair: Yep16:09
*** salv-orlando has quit IRC16:09
*** rcernin has quit IRC16:09
*** tonytan_brb has quit IRC16:13
*** esikachev has joined #openstack-infra16:13
*** tonytan4ever has joined #openstack-infra16:14
*** david-lyle has joined #openstack-infra16:14
jeblairkrotscheck: after 2 days of work, i believe i have finally gotten our images to update.  i rechecked the d-g change to test.16:16
krotscheckjeblair: oh, awesome16:16
krotscheckjeblair: baby steps :)16:17
*** diazjf has quit IRC16:17
*** mika has quit IRC16:17
prometheanfireis gate-tripleo-ci-f22-nonha still failing for everyone or just me?16:17
*** mika has joined #openstack-infra16:17
prometheanfirethough that's more tripleo16:18
*** fhubik is now known as fhubik_brb16:18
*** binbincong_ has quit IRC16:18
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: don't require launchpad milestone for stable branch  https://review.openstack.org/27313316:18
*** zeih has quit IRC16:18
*** binbincong_ has joined #openstack-infra16:18
keedyakrotcheck: can I have heckj@mac.com and james.king@emc.com added to shovel project16:19
*** jsavak has quit IRC16:19
krotscheckkeedya: You should do that yourself ;)16:20
krotscheckkeedya: Do you know how?16:20
keedyakrotscheck: I can figure it out :)16:20
krotscheckkeedya: Your access right groups are listed here -> https://review.openstack.org/#/admin/projects/openstack/shovel,access16:20
krotscheckAdd them to shovel-release and shovel-core16:21
*** woodster_ has joined #openstack-infra16:21
*** jgriffith has quit IRC16:21
anteayakrotscheck: only one person should be in -release16:21
*** cznewt has quit IRC16:21
*** tdasilva has quit IRC16:21
anteayakrotscheck: core is where mulitple reviewers go16:21
krotscheckkeedya: ^^16:21
keedyaok Got it :)16:22
*** jgriffith has joined #openstack-infra16:22
cody-somervillejust a reminder, here is draft for hpcloud sunset impact e-mail: https://etherpad.openstack.org/p/openstack-infra-ann-hpcloud-sunset16:22
*** dgonzalez has quit IRC16:23
openstackgerritMerged openstack-infra/puppet-openstackid: Fix on nodejs default version  https://review.openstack.org/27172216:23
*** jsavak has joined #openstack-infra16:23
*** dgonzalez has joined #openstack-infra16:24
openstackgerritMerged openstack-infra/project-config: Supply the devstack-centos7 label from ovh  https://review.openstack.org/27286616:24
*** JasonF has joined #openstack-infra16:24
*** NobodyCa1 has joined #openstack-infra16:24
*** NobodyCam has quit IRC16:25
*** JayF has quit IRC16:25
*** jesusaurus has quit IRC16:25
d0ugalAJaeger: We have rechecked it a few times already. https://review.openstack.org/#/c/265336/16:25
d0ugalSorry, got distracted for a moment.16:25
*** tdasilva has joined #openstack-infra16:26
openstackgerritAthlan-Guyot sofer proposed openstack-infra/project-config: puppet: initiate testing for puppet-openstack-cookicutter  https://review.openstack.org/27215616:26
*** NobodyCa1 is now known as NobodyCam16:27
*** dizquierdo_ has joined #openstack-infra16:27
openstackgerritMerged openstack-infra/irc-meetings: Revert to bi-weekly schedule for the neutron team meeting  https://review.openstack.org/27249416:27
*** MarkAtwood has quit IRC16:28
clarkbcody-somerville: seems fine to me, only thing is we will turn it off on fiday on our end16:28
*** jesusaurus has joined #openstack-infra16:28
*** diazjf has joined #openstack-infra16:28
cody-somervilleclarkb: Good catch. I'll update it to mention that.16:28
*** tphummel has joined #openstack-infra16:28
*** jsavak has quit IRC16:29
*** jsavak has joined #openstack-infra16:29
cody-somervilleclarkb: Do we have any estimates on the impact to the queue length/wait times?16:30
*** dimtruck is now known as zz_dimtruck16:31
*** tjones has joined #openstack-infra16:31
*** dizquierdo has quit IRC16:31
jeblaircody-somerville, clarkb: ++16:31
clarkbcody-somerville: you could use graphite to determine what our jobs per hpur rate is without hpcloud thrn compare that to total jobs per day/week wtc16:32
jeblaircody-somerville, clarkb: (btw, we kind of turned most of hpcloud off already; it's only running centos jobs now... but we don't really have to go in to detail there)16:32
*** simondodsley has joined #openstack-infra16:32
clarkboh neat16:33
anteayawe also have increased our capacity with three new hosts however since that was a gradual increase I'm not sure folks with recognize we actually have increaesed capacity in the last 2 months16:33
*** MarkAtwood has joined #openstack-infra16:33
jeblairright, after hpcloud turns off (yesterday? :) we're at something like 75% of what we had 6mo ago16:34
anteayaexactly16:34
jeblairwe'd be at <50 without the new folks16:34
anteayaspeaking of which both bluebox and ovh are showing error state16:35
anteayaif someone has a chance to take a peek16:35
*** austin81 has joined #openstack-infra16:35
krotscheckjeblair: It appears that openafs does not have releases for v716:35
krotscheckcentos716:35
krotscheckhttp://dl.openafs.org/dl/openafs/1.6.11/16:35
jeblairanteaya: some errors from bluebox would not surprise me since we're running 2 mirror nodes there and did not adjust the quota to compensate16:35
anteayajeblair: ah ha16:36
anteayathanks16:36
*** arxcruz has quit IRC16:36
*** sdake_ has joined #openstack-infra16:36
anteayamight that also be the case with ovh?16:36
*** esikachev has quit IRC16:37
anteayasorry I've lost track of all the details with the mirroring16:37
anteayayay mirrors16:37
krotscheckNothing in the regular repo's either.16:37
krotscheckHrm16:37
*** david-lyle has quit IRC16:38
*** tdurakov has quit IRC16:38
jeblairkrotscheck: this seems to be the latest 1.6 release but also does not have rhel7 http://dl.openafs.org/dl/openafs/1.6.15/16:38
*** ashleighfarnham has joined #openstack-infra16:39
jeblairkrotscheck: this release has many more platforms including rhel7 http://dl.openafs.org/dl/openafs/1.6.7/16:39
krotscheckjeblair: Alrightey, lemme adjust16:39
krotscheckThanks, I only scanned upwards16:39
*** ashleighfarnham has quit IRC16:40
*** ashleighfarnham has joined #openstack-infra16:40
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add stdout to indicate expiring runs operations  https://review.openstack.org/27314116:40
*** sdake has quit IRC16:40
mtreinishfungi: ^^^ do you think that's enough? I'm thinking we might need more details16:40
*** sdake_ is now known as sdake16:40
*** david-lyle has joined #openstack-infra16:40
jeblairkrotscheck, mordred: https://lists.openafs.org/pipermail/openafs-info/2014-October/041078.html  this message and previous replies in that thread have interesting information16:41
*** tdurakov has joined #openstack-infra16:41
*** bpokorny has joined #openstack-infra16:41
krotscheckjeblair: I found and discarded that because unverified source?16:42
jeblairkrotscheck: yeah, i'm not at the point of suggesting we use that16:42
openstackgerritReedip proposed openstack-infra/project-config: Add support for py34 job for Kuryr  https://review.openstack.org/27292916:42
*** bnemec has quit IRC16:42
*** zeih has joined #openstack-infra16:43
*** jogo has quit IRC16:43
*** BobBall has quit IRC16:43
*** jogo has joined #openstack-infra16:44
*** jogo has joined #openstack-infra16:44
*** Keedya_ has joined #openstack-infra16:45
*** skolekonov is now known as _skolekonov16:45
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds  https://review.openstack.org/19366016:45
*** Keedya_ has quit IRC16:46
*** HeOS has quit IRC16:47
*** zz_dimtruck is now known as dimtruck16:48
jeblairkrotscheck, mordred: also https://lists.centos.org/pipermail/centos-devel/2015-August/013730.html16:48
jeblairkrotscheck, mordred: and https://copr.fedorainfracloud.org/coprs/jsbillings/openafs/ and https://copr.fedorainfracloud.org/coprs/jsbillings/openafs-kmod/16:48
*** fhubik_brb is now known as fhubik16:48
Davieyfungi: Happen to be around?16:49
*** diana_clarke has joined #openstack-infra16:49
krotscheckjeblair: Worht using?16:49
*** bnemec has joined #openstack-infra16:49
*** bpokorny has quit IRC16:50
*** bpokorny has joined #openstack-infra16:50
crinklekrotscheck: did you figure out your puppet issue?16:52
*** sputnik13 has joined #openstack-infra16:52
krotscheckcrinkle: I did, thanks16:52
*** sputnik13 has quit IRC16:53
mikalAJaeger: you around?16:53
austin81clarkb, jeblair: If timothyb89 and I decide to go the nodepool route with stackviz, would we place our build/pre-processing script here? https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/16:53
austin81or is there somewhere else it belongs?16:54
*** abregman has quit IRC16:54
jeblairkrotscheck, mordred: there's also the decidedly-not-for-production http://cbs.centos.org/repos/storage7-testing/16:55
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196416:56
*** scheuran_ has quit IRC16:56
*** zeih has quit IRC16:56
*** tdurakov has quit IRC16:56
krotscheckjeblair: Ok, so do we (A) lock the version of centos to 1.6.7 (easiest), add the jsbillings repo as a lsbmajdistrelease switch, or build from source?16:57
*** gokrokve has quit IRC16:57
*** mikelk has quit IRC16:57
krotscheckjeblair: Or we can add a version switch that installs 1.6.11 on everything but centos7, and 1.6.7 on that one16:57
sdaguekrotscheck: what is need to make https://review.openstack.org/#/c/238756/ mergable?16:57
krotschecksdague: This job needs to pass https://review.openstack.org/#/c/272215/16:58
krotschecksdague: A bunch of our jenkins nodes were still out of date, jeblair feels he's been able to get them updated, we're rechecking now16:58
jeblairaustin81: yes, but more importantely (because this is the long-term direction), add it to the elements tree16:58
*** trown is now known as trown|lunch16:58
jeblairit seems to have gotten worse16:59
*** rockyg has joined #openstack-infra16:59
*** BobBall has joined #openstack-infra16:59
*** jistr has quit IRC16:59
*** ashleighfarnham has quit IRC17:00
jeblairoh!  now it looks like a mirror problem, that's more tractable :)17:00
krotscheckjeblair: Neat!17:00
jeblairyep17:00
jeblairbandersnatch is stuck again17:00
jeblairHTTPError: 404 Client Error: Not Found for url: https://pypi.python.org/packages/2.7/c/cloudmesh_client/cloudmesh_client-1.1.1-py2.py3-none-any.whl17:00
krotscheckThat seems to happen pretty often.17:01
*** dprince has joined #openstack-infra17:01
*** fhubik is now known as fhubik_brb17:01
*** matrohon has joined #openstack-infra17:02
austin81jeblair: I thought stackviz was automatically pulled like the other OS projects? Could you clarify what you mean by add it to the elements tree?17:02
*** samuelBartel has quit IRC17:02
jeblairaustin81: then i clearly don't understand your question17:02
mikalAJaeger: thanks for the review17:02
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: OpenAFS Version Selection for Debian  https://review.openstack.org/27315517:02
*** shashank_hegde has joined #openstack-infra17:02
*** fhubik_brb is now known as fhubik17:03
*** jlanoux has quit IRC17:03
*** gokrokve has joined #openstack-infra17:03
tznAJaeger: any chance to review this https://review.openstack.org/#/c/267453/17:03
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: OpenAFS Version Selection for Centos  https://review.openstack.org/27315517:04
* krotscheck is silly and typod the OS17:04
krotscheckdurrrr17:04
tznAJaeger: looks like stalled for some time17:04
*** amaretskiy1 has quit IRC17:04
*** tdurakov has joined #openstack-infra17:05
*** yamahata has quit IRC17:07
*** yamamoto has quit IRC17:07
austin81jeblair: I'm referring to how the static site will be built (basically just cd /opt/stackviz and npm install). We want to do that in the scripts dir, assuming stackviz is already on the image?17:07
openstackgerritIhar Hrachyshka proposed openstack-infra/devstack-gate: Set MTU for br-ex in multinode neutron grenade mode  https://review.openstack.org/27315717:07
*** jaypipes has quit IRC17:07
*** tdurakov has quit IRC17:08
*** thorst_ has quit IRC17:08
*** sfinucan has quit IRC17:08
jeblairaustin81: do you have a link to a plan or previous discussion or something so i can refresh my memory?17:09
*** thorst_ has joined #openstack-infra17:09
austin81jeblair: http://eavesdrop.openstack.org/irclogs/%23openstack-meeting/%23openstack-meeting.2016-01-05.log.html17:09
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: OpenAFS Version Selection for Centos  https://review.openstack.org/27315517:09
austin81jeblair: and the planning etherpad https://etherpad.openstack.org/p/BKgWlKIjgQ17:09
*** mriedem has quit IRC17:10
*** HeOS has joined #openstack-infra17:11
*** claudiub has quit IRC17:12
*** andymaier has quit IRC17:12
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: OpenAFS Version Selection for Centos  https://review.openstack.org/27315517:12
openstackgerritMichael Krotscheck proposed openstack-infra/puppet-openafs: OpenAFS Version Selection for Centos  https://review.openstack.org/27315517:13
jeblairaustin81: for step 1, are you doing daily build in nodepool or tarball release?17:13
*** aarefiev has quit IRC17:13
*** thorst_ has quit IRC17:13
*** ashleighfarnham has joined #openstack-infra17:13
*** dtantsur is now known as dtantsur|afk17:13
*** sshnaidm has quit IRC17:14
austin81jeblair: We're going to give nodepool a shot first17:14
jeblairaustin81: then you want to perform the clone/npm/gulp/tar steps inside both the nodepool/scripts dir, and also nodepool/elements17:14
krotscheckOk, that one seems to be working.... /me has tentative hope.17:15
jeblairaustin81: scripts and elements do the same thing for different types of images17:15
*** ihrachys has quit IRC17:15
jeblairaustin81: scripts runs on snapshot images (they get run on a vm which gets snapshotted at the end of the process)17:15
jeblairaustin81: elements is for diskimage builder17:15
jeblairaustin81: we are transitioning from snapshot-style images to dib-style images17:15
jeblairaustin81: which is why i say it's more important to add it to elements17:16
austin81jeblair: ahh okay that helps clear it up17:16
austin81jeblair: new dir in elements?17:16
*** matrohon has quit IRC17:16
*** salv-orl_ has quit IRC17:16
*** aarefiev has joined #openstack-infra17:17
jeblairaustin81: yeah, i'm not expert on how that should be organized, best to ask greghaynes, fungi, ianw, or clarkb17:17
greghayneshrm?17:17
jeblairaustin81: but i feel that the answer "yes, make a new element" is the safest; we can always combine it with something if needed17:17
*** thorst_ has joined #openstack-infra17:17
austin81jeblair: Awesome. I'm also getting ahead of myself, need to write the script first17:17
greghaynesYep, elements are easily composable17:18
jeblairgreghaynes: basically, the problem is "need to build some stuff to have it on the dib images"17:18
austin81jeblair: thanks for the help!17:18
*** fhubik has quit IRC17:19
*** flwang1 has joined #openstack-infra17:19
jeblairnp17:19
greghaynesYa, that should work fine - you can run pretty much anything as part of an element17:19
*** shashank_hegde has quit IRC17:19
*** jaosorior has quit IRC17:20
krotscheckUrm... ok, so, setting up a puppet slave on a centos7 image seems to error a lot. Is this a known thing?17:20
*** jaosorior has joined #openstack-infra17:20
*** jaosorior has quit IRC17:21
jeblairkrotscheck: i think we only use centos7 for short-lived slaves; i don't believe that's currently erroring17:21
jeblairkrotscheck: but a long-lived slave has more puppet17:22
krotscheckjeblair: Yeah, noticing that.17:22
*** thorst_ has quit IRC17:22
* krotscheck KNEW there was another yak here somewhere17:22
greghaynesjeblair: re builders and gil - thats exactly what I was wondering - would the dib subprocess release the gil so uploads wouldnt get hit with the cpu load, so sounds like it is fine17:23
jeblairdstufft: i have 2 mirrors that ran at the same time; one succeeded, the other failed; here are the logs -- do you have any idea what happened? http://paste.openstack.org/show/485175/17:24
jeblairgreghaynes: ah yes, absolutely!17:24
*** apoorvad has joined #openstack-infra17:25
dstufftjeblair: dunno, bot those are downloading different versions17:26
*** hashar has quit IRC17:26
*** shardy has quit IRC17:26
SpamapSjeblair: I had a pin stuck in my brain that you were supposed to discuss something with mordred and me yesterday. But it's out of backscroll on my weechat so I forget the actual context. Any idea?17:26
jeblairdstufft: any idea why it would do that?17:28
dstufftjeblair: could be you hit different Fastly cache nodes with different stuff cached17:28
SpamapSjeblair: I think it was cloudinit related17:28
jeblairdstufft: when i visit https://pypi.python.org/simple/cloudmesh-client/ 1.1.1 shows up there but does indeed 40417:29
jeblairSpamapS: ah i know what it is!17:29
jeblairSpamapS, mordred: we should talk with mgagne about ubuntu cloud images in internap17:29
SpamapSjeblair: ah right, I just found the log lines17:30
*** esikachev has joined #openstack-infra17:30
SpamapSsomething about growroot not happening17:30
zaromorning17:30
SpamapSmgagne: are you around, and available to chat about that?17:30
SpamapSmgould: "that" == growroot and cloudinit and ubuntu17:30
SpamapSdohhh17:30
SpamapSmgagne: "that" == growroot and cloudinit and ubuntu17:31
SpamapSmgould: disregard17:31
mgouldSpamapS, np17:31
*** yamahata has joined #openstack-infra17:31
jeblairdstufft: i think i understand17:33
*** flwang1 has quit IRC17:33
jeblairdstufft: the mirror it worked on had 1.1.1 already (from like 2 weeks ago); 1.1.1 has since gone missing from the /packages dir, but is still listed in the simple index.  so both of my bandersnatches were told to sync the package, one of them decided it only had to download the 2 later versions, the other had to download all 3, but one is missing.17:34
cody-somervillejeblair: clarkb: Ok. Made small edits to better reflect the Friday decommission date. Should I get any more reviews before sending out?17:34
dstufftjeblair: yea, so the question then is why did 1.1.1 go missing.17:35
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Use improved worklists/boards API  https://review.openstack.org/27316517:35
*** tdurakov has joined #openstack-infra17:35
*** flwang1 has joined #openstack-infra17:35
*** jecarey has joined #openstack-infra17:36
jeblairkrotscheck, mordred: another option here would be to switch strategies and go with the upload-to-tarballs / download-to-mirror server idea.  that will mean we don't need afs on our wheel build hosts.17:36
*** thorst_ has joined #openstack-infra17:37
krotscheckjeblair: We'd have to be pretty clever with the diff detection of files.17:38
*** BobBall is now known as BobBall_AWOL17:38
*** thorst__ has joined #openstack-infra17:38
jeblairkrotscheck: to avoid uploading the entire wheel mirror to tarballs every time?17:39
krotscheckjeblair: Yep, and downloading it to AFS every time.17:39
jeblairyeah, that's not beautiful17:39
mordredrsync?17:40
mordredthat may still suck17:40
*** dizquierdo_ has quit IRC17:40
* mordred goes back into his whole17:40
openstackgerritDavid Caro proposed openstack-infra/jenkins-job-builder: Added github-pull-request-merge publisher  https://review.openstack.org/27316717:41
luvhi, can I catch Khai Do on this channel ?17:41
*** thorst_ has quit IRC17:41
*** krtaylor has quit IRC17:41
jeblairluv: he is zaro17:41
luvjeblair: cool, thanks17:41
*** armax has joined #openstack-infra17:42
jeblairkrotscheck: yeah, this looks a lot nicer in afs; shall we stick with that for now then?17:42
*** unicell1 has joined #openstack-infra17:42
krotscheckjeblair: I think so.17:42
krotscheckjeblair: i'm currently arguing with jenkins_params.pp and varying package names.17:42
luvzaro: hi :) would you mind having a look at https://review.openstack.org/#/c/238535/ (kerberos support for python-jenkins) you reviewd a while back and I have finally got to incorporate the changes. thanks17:43
*** thorst__ has quit IRC17:43
krotscheckjeblair: Do we use fedora, centos, or...17:43
*** bhunter71 has joined #openstack-infra17:43
*** jed56 has quit IRC17:43
nibalizerkrotscheck: so you are hitting duplicate definion errors?17:43
jeblairkrotscheck: we have both fedora and centos images17:43
krotschecknibalizer: Fixed that, moved on.17:43
zaroluv: glad you found me, will take a look soon.17:43
krotscheckjeblair: Oh. Great.17:43
nibalizercool17:43
*** smarcet has quit IRC17:43
nibalizerare you guys having all slaves mount afs as a client?17:43
jeblairkrotscheck: ianw is very helpful with such things17:44
krotschecknibalizer: No, only the wheel slaves.17:44
nibalizerok17:44
*** unicell has quit IRC17:44
krotschecknibalizer: I have to go make our thick slave manifests behave well on Things-Other-Than-Precise-And-Trusty first.17:45
*** tzn has quit IRC17:45
*** tiswanso has quit IRC17:46
*** cznewt has joined #openstack-infra17:46
*** _nadya_ has joined #openstack-infra17:47
jeblairdstufft: i think this 'some packages missing from pypi's /packages' is what i saw quite a bit of when i was brining this mirror up to sync, and i think it would also prevent any bandersnatch mirror from syncing from the empty state as well.17:47
dstufftjeblair: yea I'm looking into it17:48
dstufftit's possible S3 is losing data, which means we'll have to restore that from our own mirror and then figure out what we're going to do about S317:48
prometheanfiremordred: https://review.openstack.org/#/c/272884/ it also fixes a regression in not filtering the 'lo' interface17:48
prometheanfireit's been fully tested as well17:48
jeblairdstufft: yuck.17:49
dstufftemailled the person on that to clarify if he tried to delete those files (and PyPI didn't remove it from the DB) or if twe lose those files in S317:51
dstufft-> lunch17:51
*** dmsimard has quit IRC17:51
*** _nadya_ has quit IRC17:51
*** fawadkhaliq has quit IRC17:51
jeblairkrotscheck: i'm going to work on syncing just the /packages dir from our existing mirrors into afs; that should mitigate this problem as much as possible -- in that at least the afs mirror will be no more susceptible to this problem than our current mirrors17:51
*** derekh has quit IRC17:52
freerunnerHi folks! Could you please review it? https://review.openstack.org/#/c/270770/17:52
greghaynesjpr: Hey, you around? I have a vague idea of what is going on17:52
*** sdake has quit IRC17:53
*** krtaylor has joined #openstack-infra17:53
*** flwang1 has quit IRC17:53
openstackgerritgreghaynes proposed openstack/diskimage-builder: DO NOT MERGE: unmount debugging  https://review.openstack.org/27317117:53
greghaynesjpr: ^ if you could run with that it would be very helpful17:53
*** salv-orlando has joined #openstack-infra17:53
*** jcoufal has quit IRC17:54
greghaynesjpr: I am pretty confident that our unmount is failing17:54
greghaynesjpr: now, why it fails for you in particular and not for me, I have no idea17:55
*** dims has quit IRC17:58
cznewtHello, who can please help with creating team for https://review.openstack.org/#/c/272469/17:58
*** Sukhdev has quit IRC17:59
*** achanda has joined #openstack-infra17:59
austin81jeblair: I'm guessing node/npm are not installed in nodepool images?17:59
*** rcernin has joined #openstack-infra18:00
*** smarcet has joined #openstack-infra18:00
jprgreghaynes: will check the run.  yeah. not sure why it would fail under the nodepool account and not the default ubuntu account.   I'll note that the nodepool user id is " uid=1002(nodepool) gid=1002(nodepool) groups=1002(nodepool)"  .   it doesn't have sudo privs (thus is based on the stock config of puppet) but the the ubuntu user of course does.  but if that's an issue not sure how nodepool would get this far, ie. being able to create bind mounts an18:01
greghaynesjpr: if it doesn't have sudo privs then how is it running dib?18:01
*** ajmiller has quit IRC18:02
*** dmsimard has joined #openstack-infra18:02
*** armax has quit IRC18:02
*** ajmiller has joined #openstack-infra18:02
jprgreghaynes: yeah, beats me.  that thought just triggered when you mentioned mounts not unmounting18:02
*** Jeffrey4l has quit IRC18:02
jprgreghaynes: nodepool@ci2:~$ id18:02
jpruid=1002(nodepool) gid=1002(nodepool) groups=1002(nodepool)18:02
jprgreghaynes: nodepool@ci2:~$ ps -ef | grep node18:03
jprnodepool  1290     1  0 09:59 ?        00:01:01 /usr/bin/python /usr/local/bin/nodepoold -c /etc/nodepool/nodepool.yaml -l /etc/nodepool/logging.conf18:03
greghaynesjpr: huh, well it must have some kind of sudo perms because I see it running sudo in the log18:03
*** lucasagomes is now known as lucas-dinner18:04
*** BobH_ has quit IRC18:04
*** tdurakov has quit IRC18:04
jprgreghaynes: yes.  i did to so just assumed that's good.  it's not part of the sudo group but checked the sudo file: root@ci2:~# cat /etc/sudoers.d/nodepool-sudo18:05
jprnodepool ALL=(ALL) NOPASSWD:ALL18:05
*** unicell1 has quit IRC18:05
jprgreghaynes: at least the world is not totally upsidedown18:06
greghaynesjpr: hah, ok18:06
*** Swami has quit IRC18:06
cznewt[A18:07
krotscheckjeblair: I'm guessing the various index.html files won't have too much of a problem?18:07
krotscheckjeblair: That sounds good.18:08
cznewtjasondotstar: do you know anyone from the infra team, who could18:12
cznewthelp adding the teams18:12
*** jsavak has quit IRC18:13
*** jsavak has joined #openstack-infra18:13
cznewt3323218:14
cznewtOROR[A18:14
*** esikachev has quit IRC18:15
*** dimtruck is now known as zz_dimtruck18:15
*** ashleighfarnham has quit IRC18:15
*** sshnaidm has joined #openstack-infra18:16
*** flepied has quit IRC18:16
*** doug-fish has quit IRC18:16
openstackgerritValeriy Ponomaryov proposed openstack-infra/project-config: Make 'gate-manila-buildimage-generic' job voting  https://review.openstack.org/27318318:17
*** ybathia has joined #openstack-infra18:18
*** jcoufal has joined #openstack-infra18:18
*** jordanP has quit IRC18:18
*** flepied has joined #openstack-infra18:18
*** sabeen3 has quit IRC18:18
*** jsavak has quit IRC18:19
*** flepied1 has joined #openstack-infra18:19
*** sputnik13 has joined #openstack-infra18:20
*** ihrachys has joined #openstack-infra18:20
*** tzn has joined #openstack-infra18:21
*** sridhar_ram has joined #openstack-infra18:21
openstackgerritVictor Ryzhenkin proposed openstack-infra/project-config: Add non-voting murano-api gate job with tempest-plugin  https://review.openstack.org/27077018:21
*** doug-fish has joined #openstack-infra18:22
*** flepied has quit IRC18:22
*** achanda has quit IRC18:24
*** zz_dimtruck is now known as dimtruck18:25
*** Swami has joined #openstack-infra18:25
openstackgerritIhar Hrachyshka proposed openstack-infra/devstack-gate: Set MTU for br-ex in multinode neutron grenade mode  https://review.openstack.org/27315718:27
*** doug-fish has quit IRC18:27
openstackgerritDoug Hellmann proposed openstack-infra/project-config: add a job to send automated announcements of releases  https://review.openstack.org/27276718:28
*** ihrachys has quit IRC18:28
*** ashleighfarnham has joined #openstack-infra18:29
dhellmannjeblair : ^^ that's the job we discussed earlier this week18:30
*** ifarkas has quit IRC18:30
jprgreghaynes: posted debug log to ticket18:31
krotscheckjeblair: I'm going to try to get wheels for trusty and precise up first, then move on to centos. Reducing scope for simplicity's sake.18:31
greghaynesjpr: ty18:32
jasondotstardhellmann, jeblair: can you guys help us with something?  cznewt and I are attempting to finishing setting up the openstack-salt project18:32
*** electrofelix has quit IRC18:32
dhellmannjasondotstar : possibly, what's up?18:32
jasondotstarthe change to create the project(s) is here: https://review.openstack.org/#/c/272469/18:32
jeblairkrotscheck: ++ (aiui, we can even stage production like that and start getting a performance benefit on most of our jobs)18:32
jeblairkrotscheck: wait, do we even need precise?18:32
jasondotstardhellmann: we're looking to have the group creation completed, and we need cznewt added to the -release and/or -core groups upon creation.18:33
*** achanda has joined #openstack-infra18:33
jeblairkrotscheck: i think mordred found yesterday that we don't run any devstack jobs on precise now18:33
*** jsavak has joined #openstack-infra18:33
krotscheckjeblair: Oh good!18:33
* krotscheck goes off and nukes precise.18:33
jeblair++18:33
krotscheckIt's on its way out anyway18:34
jeblairkrotscheck: i think infra are the main users at this point :)18:34
krotscheckSo, does this mean we can get rid of apply-precise?18:34
dhellmannjasondotstar : the gerrit group will be created when the project is imported, iiuc, but then someone with gerrit admin rights needs to add the first member to the group. after that, the group can self-admin18:35
jasondotstari c18:35
*** kushal has quit IRC18:35
dhellmannjasondotstar : I believe the project creator guide talks about filing a ticket to ask for that first member to be added, with the understanding that you may not be in the same tz as the infra folks who can do that18:35
jasondotstarlooks like we're wating on the merge18:35
*** doug-fish has joined #openstack-infra18:35
jeblairkrotscheck: no, we still have lots of precise servers18:35
*** kushal has joined #openstack-infra18:35
krotscheckjeblair: For future reference, I need to make this work on centos7 and fedora... 19? 20? >3.14159?18:35
*** unicell has joined #openstack-infra18:36
jeblairkrotscheck: 23?  <--ianw18:36
jasondotstardhellmann: where should we open the tkt?18:36
jeblairjasondotstar: best just to ask here when it's created18:37
greghaynesjpr: awesome, so yep the umount is definitely not happening for you18:37
dhellmannjasondotstar : yeah, I was remembering old instructions. No mention of a bug in http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members now18:38
jasondotstarack.18:38
jprgreghaynes: ugh. yup. and I see why18:39
jeblairkrotscheck, mordred, dstufft: i diffed the packages directory of 4 of our old pypi mirrors against the new mirror and got 4 different answers: 100, 988, 1004, 945 files missing.18:39
jeblairkrotscheck, mordred, dstufft: i diffed the packages directory of 4 of our old pypi mirrors against the new mirror and got 4 different answers: 1001, 988, 1004, 945 files missing.18:40
jeblair(sorry typo)18:40
krotscheckjeblair: ....u....ur... um...18:40
jprit's my move of /opt to /mnt/opt via a symlink rather than a mount18:40
*** doug-fish has quit IRC18:40
krotscheckSadnersnatch?18:40
jprgreghaynes: the pattern match fails because of the prefix difference. let me remount that and see if it fixes the problem.18:41
krotscheckjeblair: Is that because they're missing on pypi, or missing on the afs volume?18:41
greghaynesjpr: OH18:41
*** ybathia has quit IRC18:41
krotscheckOr both?18:41
greghaynesjpr: good eye18:41
*** pvaneck has joined #openstack-infra18:41
*** ybathia has joined #openstack-infra18:41
*** jgriffith has quit IRC18:42
openstackgerritJerry Zhao proposed openstack/requirements: bump os-testr uppper constraints to use generate-subunit  https://review.openstack.org/27319218:42
jeblairkrotscheck: at least some of those are missing on pypi; i wouldn't be able to know for sure without running a full sync.18:42
mgagneSpamapS sup18:42
krotscheckjeblair: I... have an odd question. Is there a difference between the publicly available packages on the new mirrors? (i.e. there's a problem with AFS for some reason?)18:43
jeblairkrotscheck, mordred, dstufft: at any rate, i will copy those into the new mirror and hopefully it will be more resilient to this problem than the old ones.18:43
krotscheckjeblair: Gothca18:43
*** jgriffith has joined #openstack-infra18:43
*** mgould has quit IRC18:43
SpamapSmgagne: we were trying to loop back around to the growroot problems you were seeing.18:44
jeblairkrotscheck: the differences i mentioned are because there is a difference between each of the old mirrors and the single new one;  so the comparisons were old-rax-dfw -> new; old-rax-iad -> new; etc...18:44
greghaynesjpr: any idea where that /mnt prefix is coming from?18:44
mgagneSpamapS what are you seeing18:44
krotscheckjeblair: ack18:44
*** daemontool_ has joined #openstack-infra18:45
jprgreghaynes: yes. my stock cloud x1.large has an 80G ephemeral drive that is mounted to /mnt by default.  the system image stays 10G.18:45
greghaynesjpr: hrm, but I see in the log we do mount --bind /dev /opt/dib_tmp/image.3uTEKgO2/mnt/dev18:46
greghaynesjpr: not sure why that is being changed to udev /mnt/opt/dib_tmp/image.3uTEKgO2/mnt/dev in /proc/mounts18:47
*** daemontool has quit IRC18:47
jprgreghaynes: but I believe the pattern check is on /opt/dib_tmp/image.3uTEKgO2/mnt (in grep) and the awk would give /mnt/opt/dib_tmp/image.3uTEKgO2/mnt/dev18:47
*** tiswanso has joined #openstack-infra18:48
jprgreghaynes: it's very likely that /opt is a symlink to /mnt/opt.  mount doesn't deal in symlinks.  it mounts to nodes in the tree and the node is /mnt/opt/...18:49
greghaynesjpr: yes, I am just trying to figure out why /proc/mounts is showing /mnt/opt/dib_tmp/image.3uTEKgO2/mnt/dev instead of /opt/dib_tmp/image.3uTEKgO2/mnt/dev, do you have a symlink or something?18:49
*** trown|lunch is now known as trown18:49
greghaynesjpr: yep, so I bet that is exactly it18:49
jprgreghaynes: yes.  i'm rebuilding and it just passed the problematic point. the mv -t didn't take my /dev with it18:50
greghaynesjpr: ok, so I can think up a fix, we just need to readlink when figuring out the unmount prefix18:50
greghaynesjpr: ty for the help18:51
greghaynesSpamapS: ^ if you didnt follow, tl;dr is that if your build dir has a symlink on it we will fail to unmount any of the dirs18:52
openstackgerritMerged openstack-infra/devstack-gate: Remove checks for sideways-neutron job  https://review.openstack.org/26779918:52
*** gfreeman has joined #openstack-infra18:52
jprgreghaynes:  ok. so that would then resolve the link to the actual mount?  and btw, the stock ubuntu account wasn't failing because it's cache/tmp for dib was pointing to the absolute path under /mnt18:52
greghaynesjpr: Yep18:52
SpamapSgreghaynes: oh is that the bug?18:53
greghaynesSpamapS: yep18:53
SpamapSmgagne: I'm not seeing anything. A couple of days ago you said you were seeing problems and jeblair mentioned it to me. :)18:53
greghaynes/proc/mounts will not match where we think we mounted /dev and friends to18:53
*** zeih has joined #openstack-infra18:53
*** sdake has joined #openstack-infra18:54
gtmanfredSpamapS: Shrews i replied to yalls comments on https://review.openstack.org/#/c/268404/14 can you just verify that that will fix your issues, and I can get started fixing them :) thanks18:54
jeblairSpamapS, mgagne: internap is using the ubuntu server images as their base images because there was a (cloud-init?) problem with the cloud images18:55
mgagneSpamapS only issue there really is: We use the Ubuntu Server iso to create our cloud images with Oz. The ISO has HWE enabled and latest kernel installed. jeblair doesn't like it because AFS can't instal with latest lts kernel and asked why we have HWE enabled when vanilla cloud images don't have it.18:55
mgagnejeblair ^18:55
mgagnemy initial hypothesis was proven wrong as I thought it was growroot that was installing the latest kernel, it's false. it's the base iso.18:55
*** doug-fish has joined #openstack-infra18:55
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Run python-jobs against astara  https://review.openstack.org/27319418:56
jeblairmgagne: what was the problem that you had with the cloud images that prevented your using them?18:57
mgagnejeblair super old cloud-init AFAIK18:57
mgagne+ we have to patch cloud-init to add feature it doesn't have18:57
SpamapStrusty has 0.7.something18:57
mgagneor bugs18:57
mgagnethat something is important18:58
SpamapSwhich _should_ work ok with openstack18:58
mgagnewith cdrom config drive?18:58
SpamapSconfigdrive you mean?18:58
SpamapSyeah18:58
SpamapSoh sorry I read that wrong18:58
SpamapSyeah18:58
SpamapSit may not work WELL with configdrive :)18:58
mgagneeither way, we use Oz to build images. it's our standard tool today, might change later18:58
mgagneSpamapS we aim for Well,18:58
SpamapSyeah cool. But you can't just also enable the newer lts kernel in your oz build?18:59
SpamapSto match the cloud images18:59
mgagneSpamapS AFAIK, still not fixed: https://bugs.launchpad.net/cloud-init/+bug/127509818:59
openstackLaunchpad bug 1225922 in cloud-init "duplicate for #1275098 Support static network configuration even on already configured devices" [High,Confirmed]18:59
*** ashleighfarnham has quit IRC18:59
*** dprince has quit IRC18:59
*** austin81 has left #openstack-infra18:59
SpamapSmgagne: also if you're patching cloud-init.. I mean, you could try building your images with diskimage-builder and adding in your newer cloud-init. just sayin. ;)19:00
greghayneshehe19:00
mgagneSpamapS we can do a lot of things with time, we don't have it19:00
mgagneSpamapS that's why we are sticking with a proven solution until we have more time to convert stuff to DIB19:00
*** doug-fish has quit IRC19:00
*** dprince has joined #openstack-infra19:00
*** doug-fish has joined #openstack-infra19:01
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Make rally-dsvm-rally-cinder cinder voting  https://review.openstack.org/27319519:01
SpamapSmgagne: cool. I'm happy to help if you do find the time. Anyway, I think I'll page this thought out unless jeblair has more to add?19:02
*** doug-fis_ has joined #openstack-infra19:02
*** trown is now known as trown|brb19:02
jeblairSpamapS: so in summary, cloud-init has a bug that's not fixed in the ubuntu cloud images, so there really is no way for internap to use them?19:02
mgagnejeblair we are also moving to a patched version of cloud-init to support network_info.json19:03
mgagnejeblair required for our baremetal offer19:03
*** doug-fi__ has joined #openstack-infra19:03
mgagnejeblair but our history of opening and patching upstream has been very poor with cloud-init and we stopped investing time in that direction. we might revisit19:04
mgagnemost of our bugs are still open years later, even with patches.19:04
SpamapSjeblair: I don't think that's accurate. Cloud-init in the ubuntu cloud images is missing a feature which internap needs, and in order to ship that feature, they use the server ISO to build an image instead of the cloud image.19:04
SpamapSmgagne: have you tried glean? ;-)19:05
mgagnebut that's not the reason for lts kernel. We use Oz, it uses .iso, we use latest ubuntu server iso which has HWE. that's it.19:05
nibalizerso just to be clear, I release an -infra project by pushing a signed-tag and thats the only action I have to take right?19:05
mgagneSpamapS we are not a private cloud19:05
*** dizquierdo has joined #openstack-infra19:05
mgagneSpamapS our users expect cloud-init with its feature, bad or not.19:05
SpamapSmgagne: Understood. But you can have cloud-init read the cloud-config data, and let glean do the network_info.json. :)19:06
*** doug-fish has quit IRC19:06
openstackgerritMerged openstack-infra/devstack-gate: Update README.rst on how users can reproduce gate issues  https://review.openstack.org/26354819:06
mgagneSpamapS feature is already coded and in prod for some of our images =)19:06
gfreemanhi all.  i've been tasked to add an iscsi CI job to our company's setup for the following driver:  https://review.openstack.org/#/c/269796/  is there a web link that says "here's how to configure zuul to only run your new job for <change_request_x>," since only this change request will have our new iscsi driver?19:06
mgagneSpamapS and good luck reading that file without that patch: https://review.openstack.org/#/c/241824/19:06
jeblairSpamapS, mgagne: yeah, the HWE is a major difference between the server and cloud images -- it means that we have to do extra work to normalize our servers across providers.  honestly i thought the 'standard' ubuntu cloud image was really nice for this sort of thing19:07
jeblairSpamapS, mgagne: which is why i suggested having this conversation might be fruitful19:07
*** doug-fis_ has quit IRC19:07
SpamapSmgagne: DOH!19:07
mgagnejeblair I will be really happy to have that conversation in a couple of weeks. moving to DIB has been in our backlog for months/years.19:08
SpamapSmakes me sad that there's no unit test added tho19:08
mgagneSpamapS yea, sorry, seriously lacked time at that time, I can revisit now19:08
SpamapSjeblair: doesn't this go away if we also just build our own images and upload?19:08
mgagneSpamapS what I find frustrating is that original author didn't have unit test and now it's my problem =)19:08
*** ashleighfarnham has joined #openstack-infra19:08
jeblairmgagne: yeah, it seems like just moving to dib is the future, for both you and us.  :)  i was just hoping thet there was a simpler solution.19:09
jeblairSpamapS: yes.  ^19:09
SpamapSmgagne: I totally, 100%, mean, the original author is the one that makes me sad. :)19:09
mgagneSpamapS I think they are not geared yet for that19:09
asselingfreeman, https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers#How_do_I_run_my_CI_to_test_all_cinder_patches_with_my_driver_not_yet_merged.3F19:09
jeblairmgagne: and yes; mordred has some back-burner work to do that.19:09
mgagneSpamapS when bugfixer are expected to have higher standard than original author :-/19:09
gfreemanasselin:  tyvm19:09
mgagneSpamapS our main challenge will also be our baremetal offering which *might* requires HWE.19:10
*** tongli has joined #openstack-infra19:10
mgagneSpamapS we don't have 2 sets of images for sack of simplicity for our customers/users.19:10
mgagneSpamapS rax has 2/3 sets of images per OS, that's madness.19:11
jeblairSpamapS, mgagne: i'm just also trying to be a helpful customer here, reporting that, hey, my experience on internap is different in a significant way from other providers (in a way that makes my work non-portable)19:11
mgagnejeblair sure totally understand the point. I'm just not sure how to address it in a very short term manner.19:12
jeblairmgagne: yep, me neither.19:12
mgagnejeblair we already have baremetal using this Ubuntu image19:12
jeblair2016-01-27 19:10:39,450 INFO: New mirror serial: 192600919:13
jeblairkrotscheck: ^ mirror is up to date now19:13
*** trown|brb is now known as trown19:13
krotscheckjeblair: Recheck?19:13
jeblairkrotscheck: just kicked it off19:13
krotscheckjeblair: hooookay19:13
* krotscheck waits with bated breath19:13
*** boris-42 has quit IRC19:13
*** e0ne has quit IRC19:13
*** ZZelle_ has joined #openstack-infra19:14
mgagneSpamapS are you a reviewer/contributor for cloud-init?19:14
SpamapSmgagne: I am not.19:14
SpamapSharlowja: ^^19:14
SpamapSmgagne: harlowja is. :)19:14
harlowjawho what19:14
harlowjalol19:15
mgagneSpamapS I had higher hopes for you :P19:15
openstackgerritDimitry Ushakov proposed openstack-infra/devstack-gate: Update README and move ~/workspace-cache after project setup  https://review.openstack.org/25814819:15
harlowjamgagne whats up19:15
harlowjai may know something about cloud-int19:15
harlowjalol19:15
SpamapSmgagne: I _am_ a reviewer and contributor for glean. So... ;)19:15
harlowjaglean19:15
harlowjahmmm19:15
harlowjaewwe19:15
harlowjalol19:15
*** piet has quit IRC19:15
SpamapSit really is ew19:15
SpamapSso small19:15
harlowjalol19:15
SpamapSand ineffective19:15
mgagneharlowja we didn't call you for that lol19:15
harlowja:-P19:15
harlowjaew19:15
SpamapScloud-init features, SO BIG19:15
harlowjalol19:15
harlowjaits not the size that matters19:16
harlowjafrom what i hear19:16
harlowjalol19:16
harlowjaannnnddddd soo whats up :-P19:16
mgagnealright, harlowja is the guy I'll poke later about cloud-init19:16
harlowjalol19:16
harlowjak19:16
mgagnenothing for now, we have a couple of patches/bugs which still have to land upstream.19:17
harlowjaah19:17
SpamapSharlowja: basically, mgagne would like to land patches in cloud-init.19:17
harlowjasoooo this is an interesting question19:17
SpamapSmgagne: is one of the things you want to land vlan integration with network_info.json?19:17
harlowjaand one that i need someone from infra to help with19:17
mgagneand feature we need which aren't in cloud-init yet. but not much time yet to re-up them19:17
harlowjaso https://github.com/stackforge/cloud-init/tree/0.7.x is behind the bzr branch19:18
harlowjaand i've gotten verbal confirmation from scott that bzr is no longer open19:18
SpamapSharlowja: force push ftw? ;-)19:18
harlowjaright19:18
harlowjai need infra to do a force push19:18
mgagneif we can make it super clear where I'm supposed to contribute, that would be great =)19:18
SpamapSharlowja: just ask, they'll hook you up. I think. ;)19:18
harlowjahttps://github.com/harlowja/cloud-init/tree/0.7.x-final-final-final-really19:18
harlowjathat one is the really really final one, i hope :-/19:18
harlowjaas long as scott no longer merges anything into bzr19:18
SpamapSbad scott19:19
SpamapSno donut19:19
harlowjalol19:19
mgagnehttps://bugs.launchpad.net/cloud-init/+bug/1275098  https://bugs.launchpad.net/cloud-init/+bug/1236883 + network_data.json support19:19
openstackLaunchpad bug 1225922 in cloud-init "duplicate for #1275098 Support static network configuration even on already configured devices" [High,Confirmed]19:19
openstackLaunchpad bug 1236883 in cloud-init "data source config drive doesn't use the Admin Pass given by OpenStack" [Low,Triaged]19:19
harlowjahttps://gist.github.com/harlowja/e62c4d69bcd5d2a0d4bd (everytime he merges, i have to rerun that and ask for happy force push)19:19
SpamapSharlowja: you could also just do it via gerrit as long as you didn't mind some wonky history19:19
harlowjaSpamapS i can force push into gerrit :-/19:20
harlowjai thought u had to be a jedi to do that19:20
mgagnewhy isn't he contributing to gerrit repo?19:20
*** rkukura has quit IRC19:20
SpamapSharlowja: no you can't19:20
harlowjabzr is the bomb, lol :-/19:20
SpamapSharlowja: but you can make your master gerrit + patches to get to where we are now. ;)19:20
harlowjamgagne i think i finally got him to agree to not do that19:20
SpamapSmgagne: because Canonical just found out git won last week.19:21
SpamapSTakes time19:21
nibalizerkk i am releasing gerritlib19:21
harlowjamgagne the other question here is 0.7.x is sorta in stable-mode, whereas head of https://github.com/openstack/cloud-init/ is for what is called cloud-init 2.0 (which is slowly being worked on)19:21
*** smarcet has quit IRC19:21
harlowjanibalizer holy crap, gerritlib, can u merge my reviews first :-P19:21
mgagneas long as you have your sh*t together, I'll be happy. it's always madness with ubuntu, there are 54 repos and you never know which one to use19:22
harlowjanibalizer https://review.openstack.org/#/q/project:openstack-infra/gerritlib+owner:%22Joshua+Harlow+%253Charlowja%2540yahoo-inc.com%253E%22 :)19:22
harlowjamgagne i sometimes have my shit together19:22
harlowjadepends on the day, lol19:22
mgagneharlowja I'm not a fan of: yea, we have a stable-no-feature branch and a not-so-ready-next-version.19:22
harlowjamgagne agreed19:22
mgagnebecause this means I'm stuck in between19:23
*** Sukhdev has joined #openstack-infra19:23
harlowjaright, i think we can work through said issue19:23
mgagneand will just patch stable alone on my side19:23
harlowjano worries, harlowja is here!19:23
harlowjalol19:23
harlowja(gets my cape out)19:23
harlowjato save u19:23
nibalizerharlowja: unfortunately your open patches lack any +2 love, so they'll have to be included in the next release19:23
jesusaurnibalizer: do you happen to know how long it has been since the last gerritlib release?19:24
harlowjabut but https://review.openstack.org/#/c/171393/ is a really good one19:24
*** ihrachys has joined #openstack-infra19:24
harlowja'Previously without this it is nearly impossible to stop this thread in a clean and nice manner (which is how all threads should die).'19:24
harlowja:-/19:24
mgagnehopefully the effect of the redbull you drank won't stop too soon19:24
clarkb jeblair mgagne how is inyernap different?19:24
harlowjaand its been sitting there for 'Jul 10, 2015' :(19:24
mgagneclarkb HWE kernel (lts-utopic atm)19:24
jesusaurwhoa, looks like 201419:24
harlowjaand i want to use it in https://github.com/openstack/nerd-reviewer#nerdreviewer---automates-dull-daily-routine-code-reviews :-P19:24
nibalizerjesusaur:  Wed Apr 16 10:10:57 201419:25
*** e0ne has joined #openstack-infra19:25
*** keedya has quit IRC19:25
* harlowja started to give up on gerritlib reviews/changes, lol19:25
*** keedya has joined #openstack-infra19:26
harlowjacause in nerdreviewer i'm just making a mini-gerritlib that can actually have its thread stopped19:26
harlowjahttps://github.com/openstack/nerd-reviewer/blob/master/nerdreviewer/watcher.py#L2419:27
harlowja(i'd rather not have to make that code)19:27
*** weshay_xchat has quit IRC19:27
*** notnownikki has quit IRC19:28
*** bpokorny_ has joined #openstack-infra19:29
*** bpokorny_ has quit IRC19:29
*** weshay_xchat has joined #openstack-infra19:29
*** bpokorny_ has joined #openstack-infra19:29
mgagnegreat unit test: https://github.com/openstack/nova/blob/master/nova/tests/unit/test_metadata.py#L331-L33619:31
mgagne"it returns non None values, who cares about what it is" :-/19:31
mgagneor how many19:31
*** ashleighfarnham has quit IRC19:31
harlowjawhats a unit test19:32
harlowjalol19:32
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Make builder multi-threaded  https://review.openstack.org/27284919:32
*** bpokorny has quit IRC19:32
*** tonytan_brb has joined #openstack-infra19:32
*** ociuhandu has quit IRC19:32
nibalizerseems to have suceeded https://pypi.python.org/pypi/gerritlib/0.5.019:32
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Builder: Also unregister image-delete  https://review.openstack.org/27320319:32
jeblairgreghaynes:   https://review.openstack.org/272849 passes tests now19:33
jeblairgreghaynes: and the one after that is, i think, something we missed earlier19:33
*** eumel8 has joined #openstack-infra19:33
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added conditional install statements for kernel header packages  https://review.openstack.org/27320519:33
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added AFS keytab to wheel slave  https://review.openstack.org/27320619:33
jeblairgreghaynes: (the multi-thread change is intended to be minimal so i did not update it with the unregister fix)19:33
greghaynesjeblair: ah, yep19:34
jeblairkrotscheck: can we jut have a single key for all wheel mirrors?19:34
krotscheckjeblair: Cando.19:35
krotschecksec19:35
*** tonytan4ever has quit IRC19:35
eumel8hi, I try to setup my contact information on review.openstack.org but I got everytime Error 500. Are there something special?19:35
*** unicell1 has joined #openstack-infra19:36
mgagneoh, I had a good question for you guys: Suppose I have a project which *needs* code to be compiled (and takes some time) to be tested and could download stuff from the interweb. How would you make it fit into the CI system? Would you compile the binary and share it between jobs? make each jobs compile it? if check is passing, recompile binary? etc.19:36
*** piet has joined #openstack-infra19:36
jeblairSpamapS: are you interested in reviewing this (seemingly) simple gear patch?  https://review.openstack.org/27271719:36
*** unicell has quit IRC19:37
SpamapSjeblair: ACK, done19:38
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added AFS keytab to wheel slave  https://review.openstack.org/27320619:38
*** sabeen1 has joined #openstack-infra19:38
*** jsavak has quit IRC19:38
jeblairgreghaynes: fwiw, the extraction into jobs.py makes the nodepool disconnect change a teensy bit harder to review19:38
* krotscheck has to figure out why the first patch failed.19:39
*** jsavak has joined #openstack-infra19:39
greghaynesjeblair: Yea, it was getting pretty hard for me to track the state machine though19:39
pabelangerany zuul-cores mind reviewing 266998. pretty simple log level change19:40
*** ashleighfarnham has joined #openstack-infra19:40
*** sabeen3 has joined #openstack-infra19:40
jeblairgreghaynes: i just mean that all the code is new so i have to mentally diff WatchableJob19:41
greghaynesjeblair: ah, I could split it out19:41
jeblairgreghaynes: it's okay, i'm getting through it :)19:41
greghaynesI started writing the disconnect change and had an "oh my this is silly" moment19:42
jeblairyeah, sometimes these grow more than you expect; in an ideal world it would be at least 2 patches, but it's not worth the re-work19:43
*** sabeen1 has quit IRC19:43
greghaynesmgagne: Something similar to how IPA does images might work - a job which does the compilation and posts the binary to taballs.o.o if it passes, then other jobs can download from there19:43
mgagnegreghaynes hmm19:44
mgagnegreghaynes so you would have a pre-check job which build the binary and after check jobs use the binary?19:44
*** ihrachys has quit IRC19:44
*** ihrachys has joined #openstack-infra19:45
*** tonytan_brb has quit IRC19:46
*** tonytan4ever has joined #openstack-infra19:46
jeblairgreghaynes: oh, wow, erm, you really changed the whole thing there didn't you.19:47
jeblairgreghaynes: i was sort of expecting to just add the disconnect handler.19:48
openstackgerritIhar Hrachyshka proposed openstack-infra/devstack-gate: Set MTU for br-ex in multinode neutron grenade mode  https://review.openstack.org/27315719:48
*** placko has quit IRC19:48
TheJuliaOne note regarding a post job, the disconnect between a tested image and a post-built job can result in an artifact being built but not tested being relied upon for other jobs, which actually happened with IPA and a few of the jobs that relied upon it.19:48
greghaynesjeblair: Ya, it was pretty silly - there is no reason to be doing the callback registering/etc19:49
openstackgerritDoug Hellmann proposed openstack-infra/project-config: add a job to send automated announcements of releases  https://review.openstack.org/27276719:49
greghaynesjeblair: it just adds noise and more indirection which was driving me nuts figuring out what all cases we need to handle19:49
jeblairgreghaynes: okay, i will reset my mental state over lunch and read it again :)19:50
openstackgerritMatthew Thode proposed openstack-infra/glean: Update glean to fix gentoo support  https://review.openstack.org/27288419:50
*** dims has joined #openstack-infra19:53
openstackgerritMerged openstack/requirements: bump troveclient to 2.0.0  https://review.openstack.org/27097319:54
*** _nadya_ has joined #openstack-infra19:55
*** dizquierdo has quit IRC19:57
*** eumel8 has quit IRC19:57
*** Sukhdev has quit IRC19:57
*** ihrachys has quit IRC19:59
*** MarkAtwood has quit IRC20:01
*** daemontool has joined #openstack-infra20:06
*** tonytan_brb has joined #openstack-infra20:07
*** jcoufal has quit IRC20:07
*** rkukura has joined #openstack-infra20:08
*** tonytan4ever has quit IRC20:09
*** daemontool_ has quit IRC20:09
*** jpr has quit IRC20:10
openstackgerritMerged openstack-infra/project-config: Add reno jobs for puppet-keystone  https://review.openstack.org/27226120:10
zaroluv: did you forget the kerberose documentation for python-jenkins?20:12
krotscheckjeblair: Fewer failures, digging into them now.20:12
luvzaro: I would like to write the docs ... I am actually asking about that in my one my comments. I am just not sure where it should/what's the best way to document this.20:13
krotscheckjeblair: Read timeouts against the mirrors.20:13
zaroprobably best to give a overview description then maybe provide an example?20:13
krotscheckjeblair: Probably a cold cache. Recheck?20:13
*** ldnunes has quit IRC20:14
jeblairkrotscheck: yeah, i was just looking into it -- bluebox had a config error which i have corrected20:14
jeblair(/etc/hosts was wrong; this is another inter-cloud difference)20:14
krotscheckjeblair: Because we love those.20:15
krotscheckjeblair: Keeps our lives interesting20:15
luvso shall I create a new file kerberos.rst in doc/source ?20:15
openstackgerritJerry Zhao proposed openstack/requirements: bump os-testr uppper constraints to use generate-subunit  https://review.openstack.org/27319220:15
jeblairkrotscheck: i'm a bit more puzzeled by the ovh ones... some of the read timeouts show up as completed requests in the apache logs20:15
*** Sukhdev has joined #openstack-infra20:16
*** tonytan_brb has quit IRC20:16
krotscheckjeblair: Odd. Network slowness?20:16
krotscheckNo, that couldn't be it.20:17
jeblairi'm looking to see if we're seeing any problems with the current mirrors20:17
*** tonytan4ever has joined #openstack-infra20:17
EmilienMI'm sure someone already asked the question but why zuul does not merge a patch that have merged dependencies automatically ? (ex: the patch is +2 +A, but deps are not reviewed yet. When reviewied, we need to retrigger zuul manually with +A again) - sorry for stupid question20:17
*** julim_ has quit IRC20:17
*** jsavak has quit IRC20:18
clarkb EmilienM because there is no event that zuul can see when you do that20:18
clarkbit is event based and currently relies on the change updated event to trigger gate actions20:18
jeblairEmilienM: that is true for projects that don't share a change queue (it will automatically happen for projects that do)20:18
EmilienMclarkb: is that an event we should create on Gerrit if we would this feature?20:18
zaroluv: maybe just add an example is enough.20:19
luvok20:19
mgagneEmilienM I think jeblair is hinting at a shared change queue20:19
jeblairit would be possible to support this in zuul across change queues by having zuul generate a synthetic event20:19
zaroluv: also i think the kerberose dependency needs to be in requirements.txt instead of test-requirements.txt20:20
mgagneEmilienM puppet modules look to not have a shared change queue (if you are referring to cross-modules deps)20:20
EmilienMmgagne: yeah I'm refering to puppet modules20:20
jeblairoh, they ought to have one, i would expect20:20
mgagneEmilienM http://status.openstack.org/zuul/ see "Change queue" above changes20:21
jeblairEmilienM: do you have an integration job?20:21
EmilienMjeblair: yes20:21
jeblairEmilienM: what's it called?20:21
EmilienMjeblair: https://github.com/openstack/puppet-openstack-integration#description20:22
EmilienMthat is a full description of what is does20:22
EmilienMjeblair: gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty for example20:22
*** flepied1 has quit IRC20:22
jeblairEmilienM: i don't see that running right now20:22
*** ashleighfarnham has quit IRC20:22
jeblairEmilienM: oh you don't gate on them!20:23
EmilienMno, that's why probably20:23
EmilienMthey are not 100% stable, but at some point we might want them voting20:24
jeblairEmilienM: once you gate on those, any projects that run those jobs will have their change queues combined automatically20:24
luvzaro: this is on purpose actually, the dependency is optional (if "import kerberos" throws ImportError the urllib handler is simply not added) - I think not everyone would be happy with "kerberos" as dependency because it's not pure python and depends on kerberos header files - having that as a harddep would just cause needless build failures for anyone who does not want to use kerberos - a lot of build fails for users who are not interested in kerberos.20:24
*** bpokorny_ has quit IRC20:24
jeblairEmilienM: when that happens, depend-on will work as you expect20:24
EmilienMjeblair: I see, it makes more sense now... Thank you20:24
*** ihrachys has joined #openstack-infra20:24
*** bpokorny has joined #openstack-infra20:24
EmilienMjeblair: I'll run the discussion about enabling voting in our group20:24
openstackgerritIhar Hrachyshka proposed openstack-infra/devstack-gate: Set MTU for br-ex in multinode neutron grenade mode  https://review.openstack.org/27315720:25
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added afs to wheel mirror slaves  https://review.openstack.org/27305420:25
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added AFS keytab to wheel slave  https://review.openstack.org/27320620:25
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added conditional install statements for kernel header packages  https://review.openstack.org/27320520:25
krotscheckOk, ^^ should pass.20:25
jeblairEmilienM: (the primary thing to understand is that without sharing a change queue, it's not possible to enqueue the changes in order together, which is why depends-on doesn't automatically work in the gate across shared change queues -- and if we did, it would have to only activate after the dependent change merged, so would be much slower)20:26
* krotscheck didn't do them in the right order.20:26
* krotscheck shifts to daycare mode.20:26
jeblairkrotscheck: thanks!20:26
*** baoli has quit IRC20:26
*** jsavak has joined #openstack-infra20:27
EmilienMjeblair: makes sense, thanks again20:27
*** salv-orlando has quit IRC20:27
*** ihrachys has quit IRC20:27
*** doug-fi__ is now known as doug-fish20:27
krotscheckjeblair: likewise!20:30
flwangAJaeger: ping re the zaqar ui translation, you posted message in zaqar channel about this20:32
flwangAJaeger: any more details?20:32
*** ashleighfarnham has joined #openstack-infra20:33
*** jsavak has quit IRC20:34
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added wheel hosting for AFS mirror slave  https://review.openstack.org/27097920:35
*** jpr has joined #openstack-infra20:35
*** weshay_xchat has quit IRC20:36
phschwartzIs there a way to pass a variable from zuul to a jenkins job?20:38
clarkbphschwartz: yes using a zull function you can set arbitrary emv vars20:39
clarkbthere is examples of this in our functions file20:39
*** matrohon has joined #openstack-infra20:41
*** diazjf has quit IRC20:41
*** _nadya_ has quit IRC20:42
*** jsavak has joined #openstack-infra20:44
*** Sukhdev has quit IRC20:44
*** EricGonczer_ has joined #openstack-infra20:45
*** pfallenop has quit IRC20:47
*** jsavak has quit IRC20:47
*** jsavak has joined #openstack-infra20:47
*** rfolco has quit IRC20:50
*** weshay_xchat has joined #openstack-infra20:50
krotscheckjeblair: All the wheel-mirror patches are passing again :) https://review.openstack.org/#/q/status:open+project:openstack-infra/system-config+branch:master+topic:wheel_mirror20:52
krotscheckAt least the system-config ones.20:52
* krotscheck will do the project config ones in the morning.20:52
openstackgerritDoug Fish proposed openstack-infra/project-config: Add JavaScript gate jobs to LBaaS dashboard  https://review.openstack.org/27277120:57
*** gokrokve has quit IRC20:57
*** gokrokve_ has joined #openstack-infra20:57
*** dtardivel has quit IRC20:57
*** gokrokve_ has quit IRC20:59
*** gokrokve has joined #openstack-infra20:59
*** gokrokve has quit IRC21:00
*** julim has joined #openstack-infra21:03
*** rocky_g has joined #openstack-infra21:04
*** gokrokve has joined #openstack-infra21:05
openstackgerritMerged openstack-infra/project-config: Add non-voting murano-api gate job with tempest-plugin  https://review.openstack.org/27077021:05
*** sridhar_ram has quit IRC21:06
*** amrith is now known as _amrith_21:09
*** aysyd has quit IRC21:09
*** jsavak has quit IRC21:14
*** gokrokve has quit IRC21:14
*** thorst_ has joined #openstack-infra21:14
*** jsavak has joined #openstack-infra21:14
*** diazjf has joined #openstack-infra21:15
*** ashleighfarnham has quit IRC21:15
*** salv-orlando has joined #openstack-infra21:16
*** ashleighfarnham has joined #openstack-infra21:16
*** rcernin has quit IRC21:16
openstackgerritDoug Fish proposed openstack-infra/project-config: Add JavaScript gate jobs to LBaaS dashboard  https://review.openstack.org/27277121:17
*** trown is now known as trown|outttypeww21:18
*** flwang1 has joined #openstack-infra21:18
*** thorst_ has quit IRC21:18
*** ybathia has quit IRC21:20
*** keedya has quit IRC21:23
prometheanfiremordred: ping21:25
*** jecarey has quit IRC21:26
openstackgerritJoshua Harlow proposed openstack/requirements: Bump upper constraint of futurist to 0.10.0  https://review.openstack.org/27324621:28
*** zeih has quit IRC21:30
*** weshay_xchat has quit IRC21:32
dstufftjeblair: I'm not sure how to read that output, is that ~1000 files missing?21:34
jeblairdstufft: yes, though i do not know how many are due to the problem we were discussing.21:36
dstufftjeblair: oh, some of them will be from the mirrors being behind?21:36
*** matrohon has quit IRC21:36
jeblairdstufft: yes, some of them will certainly be that; it was about a day behind.21:37
dstufftjeblair: I'm not sure what you're doing here, will you be able to see what that the diff is once you've gotten synced up, or are you copying all files over from an existing mirror?21:38
*** flepied has joined #openstack-infra21:38
*** weshay_xchat has joined #openstack-infra21:39
*** weshay_xchat is now known as weshay21:39
*** piet has quit IRC21:40
jeblairdstufft: i copied them from 4 existing mirrors, so the new mirror now has the union of all of the files on those mirrors, so it should be less susceptible to this problem from here out.  the interesting thing to me is that all 4 mirrors had a slightly different set of files beyond what the new mirror had.21:40
*** bpokorny_ has joined #openstack-infra21:41
*** pfallenop has joined #openstack-infra21:41
*** bpokorny_ has quit IRC21:41
*** bpokorny_ has joined #openstack-infra21:42
*** pfallenop has quit IRC21:44
*** pfallenop has joined #openstack-infra21:44
*** bpokorny has quit IRC21:44
*** baoli has joined #openstack-infra21:44
*** EricGonczer_ has quit IRC21:45
*** zeih has joined #openstack-infra21:45
*** zeih has quit IRC21:45
*** baoli_ has joined #openstack-infra21:46
*** dims has quit IRC21:46
*** fitoduarte has joined #openstack-infra21:48
*** e0ne has quit IRC21:49
*** baoli has quit IRC21:49
*** diazjf has quit IRC21:51
*** piet has joined #openstack-infra21:51
*** bpokorny_ has quit IRC21:52
*** ddecapit has joined #openstack-infra21:52
*** jcoufal has joined #openstack-infra21:52
*** bpokorny has joined #openstack-infra21:52
*** ddecapit is now known as DuaneDeC721:52
*** lifeless has quit IRC21:53
*** FallenPegasus has joined #openstack-infra21:53
jheskethMorning21:54
*** mtanino has quit IRC21:54
*** ybathia has joined #openstack-infra21:54
*** mtanino__ has quit IRC21:54
*** lifeless has joined #openstack-infra21:55
*** Sukhdev has joined #openstack-infra21:55
*** kgiusti has left #openstack-infra21:55
*** mtanino_ has quit IRC21:55
*** mtanino__ has joined #openstack-infra21:56
*** mtanino has joined #openstack-infra21:56
*** thiagop has quit IRC22:04
*** salv-orl_ has joined #openstack-infra22:06
*** marcusvrn_ has quit IRC22:07
openstackgerritLukas Vacek proposed openstack/python-jenkins: Add optional kerberos support  https://review.openstack.org/23853522:08
*** salv-orlando has quit IRC22:09
*** pfallenop has quit IRC22:10
*** pfallenop has joined #openstack-infra22:10
*** bpokorny has quit IRC22:11
dstufftjeblair: So I just diff'd S3 with the database, and found 32 files that are missing from S3. The list of them makes me feel like this is a problem where someone tried to delete a file/version/entire-project from PyPI and we deleted from S3 and then the transaction failed to commit22:11
*** dprince has quit IRC22:11
dstuffthttps://bpaste.net/show/3b993220a0b622:11
dstufftunless S3 has gotten a lot worse at data integrity in a way that also happens to match package names22:12
jeblairdstufft: i recognize some of those from the other day when i was unable to sync the mirror22:12
mgagnedon't let grafana with autorefresh opened... it's gonna eat all your ram :D22:13
jeblairand yeah, i agree22:14
jeblairmgagne: heh, when i stop firefox, it takes about 2 minutes to completely exit.22:15
mgagne18GB used compressed =)22:15
openstackgerritDaniel Wallace proposed openstack-infra/shade: granting and revoking privs to users and groups  https://review.openstack.org/26840422:16
*** dkranz has quit IRC22:16
*** regXboi has quit IRC22:18
*** daemontool has quit IRC22:19
*** _amrith_ is now known as amrith22:20
craigeo/22:21
*** EricGonczer_ has joined #openstack-infra22:21
*** sridhar_ram has joined #openstack-infra22:22
openstackgerritgreghaynes proposed openstack/diskimage-builder: Resolve sylinks when unmounting  https://review.openstack.org/27326022:22
*** diazjf has joined #openstack-infra22:25
greghaynesjpr: ^ should fix your issue22:26
greghayneslots of debugging for so few characters22:26
*** rbrndt has quit IRC22:27
*** piet has quit IRC22:28
*** ashleighfarnham has quit IRC22:29
*** bpokorny has joined #openstack-infra22:30
*** daemontool has joined #openstack-infra22:30
*** peristeri has quit IRC22:31
*** rossella_s has quit IRC22:31
*** rbrndt has joined #openstack-infra22:31
*** rossella_s has joined #openstack-infra22:31
*** DuaneDeC7 has quit IRC22:32
*** baoli_ has quit IRC22:33
openstackgerritPaul Belanger proposed openstack-infra/system-config: Run puppet-apply tests with fedora 23  https://review.openstack.org/23168122:33
*** bpokorny_ has joined #openstack-infra22:34
*** bpokorny_ has quit IRC22:35
*** bpokorny has quit IRC22:35
*** bpokorny has joined #openstack-infra22:36
*** aeng has quit IRC22:36
*** bexelbie has quit IRC22:36
*** daemontool_ has joined #openstack-infra22:37
*** aeng has joined #openstack-infra22:37
*** daemontool has quit IRC22:39
*** dizquierdo has joined #openstack-infra22:40
*** thorst_ has joined #openstack-infra22:41
*** dizquierdo has quit IRC22:41
*** keedya has joined #openstack-infra22:41
*** dimtruck is now known as zz_dimtruck22:43
openstackgerritPaul Belanger proposed openstack-infra/project-config: Drop dsvm from fedora 23  https://review.openstack.org/27326722:43
pabelangerianw: jeblair ^ mind the review22:43
pabelangerthat will fix experimental jobs on fedora-2322:43
jprgreghaynes: thank.  will check it out i a bit22:43
*** ashleighfarnham has joined #openstack-infra22:44
*** sdake has quit IRC22:45
jeblairkrotscheck, mordred: it looks like transatlantic udp from rax->ovh is not super fast, so when the cache is cold, performance there is much worse than elsewhere.  the timeout's we're seeing there are us hitting pip's default 15 second timeout (but just barely, it looks like most pip-sized chunks are transferred in about 18 seconds).  i'm seeing good results by increasing the timeout to 60s.22:45
*** bexelbie has joined #openstack-infra22:45
jeblairkrotscheck, mordred: i think that's going to be okay for us since once it gets into the cache, it's fast.22:45
*** jsavak has quit IRC22:47
zaroluv: your documentation cleared up my question22:47
luvcool :)22:47
*** jsavak has joined #openstack-infra22:48
*** unicell1 is now known as unicell22:48
*** unicell has joined #openstack-infra22:48
*** dims has joined #openstack-infra22:51
openstackgerritgreghaynes proposed openstack/diskimage-builder: Resolve sylinks when unmounting  https://review.openstack.org/27326022:54
jeblairkrotscheck, mordred: i'm reading cern's afs tuning suggestions :)22:54
*** amitgandhinz has quit IRC22:54
*** dims has quit IRC22:54
*** jsavak has quit IRC22:55
*** jcoufal has quit IRC22:55
*** jsavak has joined #openstack-infra22:56
*** alivigni has quit IRC22:56
*** Sukhdev has quit IRC22:57
*** daemontool has joined #openstack-infra22:58
*** jpr has quit IRC22:59
*** tiswanso has quit IRC23:00
*** ashleighfarnham has quit IRC23:00
*** tiswanso has joined #openstack-infra23:00
asselinpabelanger, quick question about SOURCE_MODULES["https://github.com/puppetlabs/puppetlabs-apache"]="b9f630a60811694916ecf8758103d4bca2ac6038". Is that the version that supports tempate?23:01
asselintemplate*23:01
*** tonytan4ever has quit IRC23:01
*** daemontool_ has quit IRC23:01
*** diazjf has quit IRC23:01
*** e0ne has joined #openstack-infra23:02
*** yuanying_ has quit IRC23:02
*** tdurakov has joined #openstack-infra23:03
elmikohi, could i get a few eyes on https://review.openstack.org/#/c/271321/23:03
elmikotrying to update our meeting times to be accurate23:03
*** doug-fish has quit IRC23:03
*** harlowja has quit IRC23:03
*** e0ne_ has joined #openstack-infra23:04
*** harlowja has joined #openstack-infra23:04
*** tiswanso has quit IRC23:05
*** e0ne has quit IRC23:06
*** sabeen3 has quit IRC23:06
*** davidlenwell has quit IRC23:06
*** davidlenwell has joined #openstack-infra23:08
*** simondodsley has quit IRC23:08
*** doug-fish has joined #openstack-infra23:10
*** weshay has quit IRC23:11
*** jesusaur has quit IRC23:11
*** rocky_g has quit IRC23:11
*** yuanying has joined #openstack-infra23:12
*** ashleighfarnham has joined #openstack-infra23:13
*** sigmavirus24 is now known as sigmavirus24_awa23:16
*** rkukura has quit IRC23:16
*** edmondsw has quit IRC23:17
*** armax has joined #openstack-infra23:17
*** jesusaur has joined #openstack-infra23:18
*** doug-fish has quit IRC23:18
*** chlong has quit IRC23:18
*** tphummel has quit IRC23:19
*** burgerk has quit IRC23:20
*** rkukura has joined #openstack-infra23:20
*** doug-fish has joined #openstack-infra23:21
openstackgerritIan Wienand proposed openstack-infra/project-config: Drop dsvm from fedora 23  https://review.openstack.org/27326723:22
*** vivekd has joined #openstack-infra23:23
*** e0ne_ has quit IRC23:24
*** doug-fish has quit IRC23:24
*** doug-fish has joined #openstack-infra23:25
*** doug-fish has quit IRC23:25
*** doug-fish has joined #openstack-infra23:25
*** doug-fish has quit IRC23:27
*** doug-fish has joined #openstack-infra23:27
*** camunoz has joined #openstack-infra23:28
*** sridhar_ram has quit IRC23:30
*** sridhar_ram1 has joined #openstack-infra23:30
*** dims_ has joined #openstack-infra23:30
*** chlong has joined #openstack-infra23:31
*** bpokorny_ has joined #openstack-infra23:31
*** sabeen has joined #openstack-infra23:31
*** bpokorny_ has quit IRC23:32
*** bpokorny_ has joined #openstack-infra23:32
*** doug-fish has quit IRC23:32
*** bpokorny has quit IRC23:35
*** bpokorny_ has quit IRC23:38
openstackgerritMerged openstack/python-jenkins: Add optional kerberos support  https://review.openstack.org/23853523:38
*** zz_dimtruck is now known as dimtruck23:38
*** bpokorny has joined #openstack-infra23:40
*** bpokorny has quit IRC23:42
*** ybathia has quit IRC23:43
ianwgreghaynes: failures look real :(23:45
ianwrm: cannot remove '/tmp/image.K4icrsSw/mnt/var/cache/apt/archives': Device or resource busy23:45
*** ybathia has joined #openstack-infra23:45
*** dimtruck is now known as zz_dimtruck23:45
*** Sukhdev has joined #openstack-infra23:46
*** cody-somerville has quit IRC23:46
*** cody-somerville has joined #openstack-infra23:46
*** sabeen has quit IRC23:47
*** cody-somerville has quit IRC23:48
*** jsavak has quit IRC23:48
*** cody-somerville has joined #openstack-infra23:48
*** cody-somerville has quit IRC23:48
*** cody-somerville has joined #openstack-infra23:48
*** bpokorny has joined #openstack-infra23:49
*** Sukhdev has quit IRC23:49
*** dingyichen has joined #openstack-infra23:49
*** Sukhdev has joined #openstack-infra23:51
*** gfreeman has quit IRC23:51
*** Sukhdev has quit IRC23:52
*** Sukhdev has joined #openstack-infra23:52
greghaynesianw: ya, so the umount failed for some reason earlier on23:54
*** Sukhdev has quit IRC23:54
greghaynesianw: I am on phone so can't debug right now, but if you can tgatd be awesome23:54
*** Sukhdev has joined #openstack-infra23:54
*** ashleighfarnham has quit IRC23:54
pabelangerasselin: yes. That adds ::apache::vhost::custom23:55
asselinpabelanger, oh? anyone using that yet?23:56
*** Sukhdev has quit IRC23:56
*** Qiming has joined #openstack-infra23:56
*** Sukhdev has joined #openstack-infra23:56
*** ybathia has quit IRC23:56
pabelangerasselin: https://review.openstack.org/#/c/205596/23:56
*** Sukhdev has quit IRC23:57
*** Sukhdev has joined #openstack-infra23:58
*** rbrndt has quit IRC23:58
*** pradk_ has quit IRC23:59
*** Sukhdev has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!