Monday, 2017-03-27

*** amotoki has quit IRC00:01
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Show the PROJECTS list after processing  https://review.openstack.org/45004800:03
pabelangerianw: do you mind looking at 449941 and 449942. Would like to increase nodepool dsvm coverage for debian00:07
*** dharinic has joined #openstack-infra00:07
ianwpabelanger: ok, will do ... what's the runtime effects?00:08
pabelangerianw: will be less then current. only 1 image currently00:08
pabelangerdirk: happen to know why DIB is giving this error? http://logs.openstack.org/45/450045/2/check/gate-dsvm-nodepool-src-nv/e75202c/logs/screen-nodepool-builder.txt.gz#_2017-03-26_23_01_35_32400:13
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Show the PROJECTS list after processing  https://review.openstack.org/45004800:14
*** baoli has joined #openstack-infra00:16
*** timello has joined #openstack-infra00:17
*** s-shiono has joined #openstack-infra00:18
*** mtanino has joined #openstack-infra00:19
*** sflanigan has joined #openstack-infra00:21
*** sflanigan has joined #openstack-infra00:21
*** tphummel has joined #openstack-infra00:26
*** jesusaur has quit IRC00:26
*** mtanino has quit IRC00:26
*** rbuzatu has joined #openstack-infra00:28
*** baoli has quit IRC00:29
*** jesusaur has joined #openstack-infra00:30
*** jesusaur has quit IRC00:31
*** jkilpatr has quit IRC00:31
*** jkilpatr has joined #openstack-infra00:31
*** rkukura has joined #openstack-infra00:39
*** oomichi has quit IRC00:39
*** kzaitsev_mb has quit IRC00:40
*** oomichi has joined #openstack-infra00:42
*** liusheng has quit IRC00:42
*** tphummel has quit IRC00:44
*** erikmwil_ has joined #openstack-infra00:52
*** erikmwilson has quit IRC00:52
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Show the PROJECTS list after processing  https://review.openstack.org/45004800:53
*** asselin has joined #openstack-infra00:54
*** liusheng has joined #openstack-infra00:55
*** asselin_ has quit IRC00:56
*** timello has quit IRC00:59
*** jamielennox is now known as jamielennox|away01:01
*** rbuzatu has quit IRC01:01
*** markvoelker has joined #openstack-infra01:01
*** dharinic has quit IRC01:02
*** dharinic has joined #openstack-infra01:03
*** amotoki has joined #openstack-infra01:04
*** yuanying_ has joined #openstack-infra01:04
*** tphummel has joined #openstack-infra01:06
*** yuanying has quit IRC01:07
*** Julien-zte has joined #openstack-infra01:11
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Show the PROJECTS list after processing  https://review.openstack.org/45004801:11
*** tphummel has quit IRC01:13
*** masayukig_ has joined #openstack-infra01:13
*** masayukig has quit IRC01:14
*** EricGonczer_ has quit IRC01:15
*** masayukig_ is now known as masayukig01:15
*** jesusaur has joined #openstack-infra01:15
*** gcb has joined #openstack-infra01:15
*** ihrachys has quit IRC01:16
*** tonytan4ever has joined #openstack-infra01:17
*** EricGonczer_ has joined #openstack-infra01:19
*** jamielennox|away is now known as jamielennox01:19
*** liujiong has joined #openstack-infra01:19
*** masayukig has quit IRC01:23
*** masayukig has joined #openstack-infra01:24
*** amotoki has quit IRC01:27
*** hongbin has joined #openstack-infra01:29
*** yanyanhu has joined #openstack-infra01:30
*** jesusaur has quit IRC01:34
*** kzaitsev_mb has joined #openstack-infra01:37
*** tuanluong has joined #openstack-infra01:37
*** jesusaur has joined #openstack-infra01:40
*** timello has joined #openstack-infra01:41
*** sbezverk has quit IRC01:53
*** rbuzatu has joined #openstack-infra01:58
*** oomichi has quit IRC02:08
*** dave-mccowan has quit IRC02:09
*** oomichi has joined #openstack-infra02:12
*** tphummel has joined #openstack-infra02:16
*** gouthamr has quit IRC02:16
*** EricGonczer_ has quit IRC02:18
*** kzaitsev_mb has quit IRC02:21
*** dharinic has quit IRC02:23
*** yamamoto has joined #openstack-infra02:25
*** dharinic has joined #openstack-infra02:26
*** saibarspeis has joined #openstack-infra02:29
*** yuanying has joined #openstack-infra02:30
*** rbuzatu has quit IRC02:32
*** yuanying_ has quit IRC02:33
*** amotoki has joined #openstack-infra02:42
*** yamamoto has quit IRC02:43
*** yamamoto has joined #openstack-infra02:43
*** smarcet has joined #openstack-infra02:49
*** amotoki has quit IRC02:53
*** smarcet has quit IRC02:55
*** amotoki has joined #openstack-infra03:06
*** dimtruck is now known as zz_dimtruck03:07
*** zz_dimtruck is now known as dimtruck03:07
*** links has joined #openstack-infra03:09
*** yamamoto has quit IRC03:16
*** dimtruck is now known as zz_dimtruck03:16
*** hongbin has quit IRC03:16
*** kzaitsev_mb has joined #openstack-infra03:17
*** saibarspeis has quit IRC03:17
*** yamamoto has joined #openstack-infra03:18
*** dharinic- has quit IRC03:19
*** dharinic has quit IRC03:21
*** dharinic has joined #openstack-infra03:22
*** saibarspeis has joined #openstack-infra03:22
*** saibarspeis has quit IRC03:28
*** rbuzatu has joined #openstack-infra03:29
*** saibarsp_ has joined #openstack-infra03:29
*** amotoki has quit IRC03:31
*** gcb has quit IRC03:33
*** tphummel has quit IRC03:34
*** yamamoto has quit IRC03:35
*** tphummel has joined #openstack-infra03:36
*** nicolasbock has quit IRC03:45
*** gongysh has joined #openstack-infra03:45
*** sbezverk has joined #openstack-infra03:50
*** kzaitsev_mb has quit IRC03:51
*** amotoki has joined #openstack-infra03:52
*** gcb has joined #openstack-infra03:58
*** rbuzatu has quit IRC04:02
*** gongysh has quit IRC04:03
*** saibarsp_ has quit IRC04:03
*** psachin has joined #openstack-infra04:04
*** zz_dimtruck is now known as dimtruck04:07
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Stop after early failures  https://review.openstack.org/45004804:10
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Fix DEVSTACK_PROJECT_FROM_GIT for pbr  https://review.openstack.org/45007304:10
*** jamielennox is now known as jamielennox|away04:14
*** sree has joined #openstack-infra04:14
*** dimtruck is now known as zz_dimtruck04:17
*** claudiub|2 has joined #openstack-infra04:18
*** jamielennox|away is now known as jamielennox04:22
*** yamamoto has joined #openstack-infra04:22
*** toidiu has joined #openstack-infra04:28
*** ramishra has joined #openstack-infra04:34
*** dharinic_ has joined #openstack-infra04:55
*** dharinic_ has quit IRC04:57
*** rbuzatu has joined #openstack-infra04:59
*** aviau has quit IRC05:03
*** aviau has joined #openstack-infra05:03
*** dharinic_ has joined #openstack-infra05:03
*** dharinic_ has quit IRC05:04
*** tphummel has quit IRC05:05
*** dharinic_ has joined #openstack-infra05:06
*** tphummel has joined #openstack-infra05:06
*** tphummel has quit IRC05:06
*** dharinic_ has quit IRC05:06
*** tphummel has joined #openstack-infra05:06
*** zz_dimtruck is now known as dimtruck05:06
*** tphummel has quit IRC05:06
*** tphummel has joined #openstack-infra05:07
*** tphummel has quit IRC05:07
*** tphummel has joined #openstack-infra05:07
*** toidiu has quit IRC05:08
*** tphummel has quit IRC05:08
*** tphummel has joined #openstack-infra05:08
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit master: Update bouncy castle libraries for Gerrit 2.13  https://review.openstack.org/44983505:09
*** tphummel has quit IRC05:09
*** claudiub has joined #openstack-infra05:10
*** pgadiya has joined #openstack-infra05:10
*** prateek has joined #openstack-infra05:12
*** anilvenkata has joined #openstack-infra05:12
*** claudiub|2 has quit IRC05:13
*** dharinic has quit IRC05:16
*** dimtruck is now known as zz_dimtruck05:16
*** gongysh has joined #openstack-infra05:19
*** dharinic- has joined #openstack-infra05:19
*** dhajare has joined #openstack-infra05:22
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit master: Fix bug to tidy up bouncy castle libs  https://review.openstack.org/45008205:24
*** rcernin has joined #openstack-infra05:26
*** rbuzatu has quit IRC05:33
*** bhavik1 has joined #openstack-infra05:33
dirkpabelanger: my guess is because it's trying to access http:// rather than https://. I will debug this today05:35
*** bhavik1 has quit IRC05:36
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Remove PBR from global PROJECTS list  https://review.openstack.org/45008305:38
ianwclarkb / sdague: ^^^ 450073 is required to unbreak pbr gate.  others ontop are nice to haves05:39
*** tonytan4ever has quit IRC05:41
*** pgadiya has quit IRC05:41
*** rwsu has quit IRC05:47
*** kornicameister has joined #openstack-infra05:52
*** oomichi has quit IRC05:58
*** noorul has joined #openstack-infra06:01
*** oomichi has joined #openstack-infra06:01
*** florianf has joined #openstack-infra06:05
*** zz_dimtruck is now known as dimtruck06:07
*** tjones has quit IRC06:10
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Remove PBR from global PROJECTS list  https://review.openstack.org/45008306:11
openstackgerritIan Wienand proposed openstack-infra/devstack-gate master: Stop after early failures  https://review.openstack.org/45004806:11
*** jaosorior has joined #openstack-infra06:13
*** dimtruck is now known as zz_dimtruck06:17
openstackgerritNam Nguyen Hoai proposed openstack-infra/project-config master: Add Barbican grenade gate  https://review.openstack.org/44768906:19
openstackgerritMerged openstack-infra/project-config master: Clean up {pipeline}-dsvm-nodepool{images}-src{suffix} job  https://review.openstack.org/44994106:19
*** nadya has joined #openstack-infra06:20
openstackgerritMerged openstack-infra/project-config master: Add debian DIBs to nodepool-dsvm jobs  https://review.openstack.org/44994206:23
*** oomichi has quit IRC06:28
*** rbuzatu has joined #openstack-infra06:29
*** andreas_s has joined #openstack-infra06:29
*** eroux has quit IRC06:30
*** oomichi has joined #openstack-infra06:32
AJaegerianw: FYI, seeing your changes, I removed the LIB_FROM_GIT_* vars from trove, see https://review.openstack.org/450088 and https://review.openstack.org/45008906:33
*** psachin has quit IRC06:33
*** slaweq__ has joined #openstack-infra06:34
*** dingyichen has quit IRC06:37
*** dingyichen has joined #openstack-infra06:38
*** oomichi has quit IRC06:39
AJaegerianw: my change is wrong - LIB_FROM_GIT is set to True if it does not exist ;(06:42
*** eranrom has joined #openstack-infra06:42
ianwAJaeger: oh, i probably read it wrong, did I?06:42
*** oomichi has joined #openstack-infra06:43
*** isaacb has joined #openstack-infra06:43
ianwhttp://git.openstack.org/cgit/openstack/trove/tree/integration/scripts/trovestack.rc#n29 <- that's default false?06:43
AJaegerianw: it is indeed...06:44
AJaegerI looked at the change introducing it and didn't double check. Thanks!06:45
ianwthis dell ironic ci is geting rather annoying06:45
*** hashar has joined #openstack-infra06:46
AJaegeryeah ;(06:46
*** Julien-zte has quit IRC06:46
*** Julien-zte has joined #openstack-infra06:48
*** bhavik1 has joined #openstack-infra06:49
*** tuanluong has quit IRC06:50
*** bhavik1 has quit IRC06:53
*** nadya has quit IRC06:55
*** ralonsoh has joined #openstack-infra06:55
*** Hal has joined #openstack-infra06:58
*** jaosorior has quit IRC06:58
*** oomichi has quit IRC06:58
*** zz_dimtruck is now known as dimtruck07:01
*** rbuzatu has quit IRC07:02
*** martinkopec has joined #openstack-infra07:02
*** rbuzatu has joined #openstack-infra07:02
*** oomichi has joined #openstack-infra07:03
*** vikrant has joined #openstack-infra07:04
*** alexchadin has joined #openstack-infra07:07
*** oomichi has quit IRC07:08
*** dimtruck is now known as zz_dimtruck07:11
openstackgerritNam Nguyen Hoai proposed openstack-infra/project-config master: Add Barbican grenade gate  https://review.openstack.org/44768907:11
*** oomichi has joined #openstack-infra07:13
*** acabot has quit IRC07:17
*** jaosorior has joined #openstack-infra07:18
*** Julien-zte has quit IRC07:19
*** Julien-zte has joined #openstack-infra07:19
*** pcaruana has joined #openstack-infra07:20
*** chem has joined #openstack-infra07:23
*** flepied has quit IRC07:24
*** kjackal_ has joined #openstack-infra07:29
*** tuanluong has joined #openstack-infra07:31
*** noorul has left #openstack-infra07:32
strigazi@cores - Andreas who +2: can you have a look at "https://review.openstack.org/#/c/449225"07:38
*** oomichi has quit IRC07:38
*** tonytan4ever has joined #openstack-infra07:41
*** Hal has quit IRC07:43
*** oomichi has joined #openstack-infra07:43
*** tesseract has joined #openstack-infra07:44
*** rcarrillocruz has joined #openstack-infra07:45
*** aarefiev_afk is now known as aarefiev07:47
*** Hal has joined #openstack-infra07:47
*** ssbarnea has joined #openstack-infra07:49
*** martinkopec has quit IRC07:51
*** acabot has joined #openstack-infra07:52
*** amoralej|off is now known as amoralej07:55
*** flepied has joined #openstack-infra07:56
*** zzzeek has quit IRC08:00
*** martinkopec has joined #openstack-infra08:00
openstackgerritMerged openstack-infra/project-config master: Add releasenote jobs to kuryr-libnetwork  https://review.openstack.org/45004008:01
*** zzzeek has joined #openstack-infra08:01
*** zz_dimtruck is now known as dimtruck08:02
*** rossella_s has joined #openstack-infra08:02
*** makowals has quit IRC08:03
*** aviau has quit IRC08:03
*** aviau has joined #openstack-infra08:03
*** nadya has joined #openstack-infra08:04
*** makowals has joined #openstack-infra08:04
openstackgerritMerged openstack-infra/project-config master: New Project - LOCI  https://review.openstack.org/44922408:04
*** matrohon has joined #openstack-infra08:04
openstackgerritBruno Cornec proposed openstack-infra/project-config master: python3 voting tests for python-redfish  https://review.openstack.org/44879608:05
openstackgerritMerged openstack-infra/project-config master: [magnum] Disable tempest service  https://review.openstack.org/44922508:05
*** jpich has joined #openstack-infra08:07
openstackgerritMerged openstack-infra/project-config master: Set up openstack-manuals for Ocata  https://review.openstack.org/44938508:07
openstackgerritMerged openstack-infra/project-config master: puppet-vitrage: run integration scenario001 job  https://review.openstack.org/44967308:09
openstackgerritMerged openstack-infra/project-config master: Adding Python3 Functional Test Gate for Barbican  https://review.openstack.org/44934308:09
openstackgerritMerged openstack-infra/project-config master: Changing octavia service type to load-balancer  https://review.openstack.org/44936308:10
*** dimtruck is now known as zz_dimtruck08:11
*** psachin has joined #openstack-infra08:12
openstackgerritMerged openstack-infra/project-config master: Update nova-lxd gate to use local_conf  https://review.openstack.org/44970108:12
openstackgerritMerged openstack-infra/project-config master: [Rally] Make gate-rally-tox-self-* voting  https://review.openstack.org/44928208:12
openstackgerritMerged openstack-infra/project-config master: Add refstack py35 functional test gate job  https://review.openstack.org/44829208:12
*** timello has quit IRC08:18
AJaegerinfra-root, why is Dell Ironic CI reporting on https://review.openstack.org/449385 - a project config change. It reports "Merge Failed".08:18
* AJaeger sent an email out now08:22
*** john-davidge has joined #openstack-infra08:24
*** Julien-z_ has joined #openstack-infra08:25
*** Julien-zte has quit IRC08:26
*** rakhmerov has quit IRC08:26
*** igormarnat has quit IRC08:26
*** kornicameister has quit IRC08:26
*** rakhmerov has joined #openstack-infra08:26
openstackgerritJordan Pittier proposed openstack-infra/devstack-gate master: Remove the EBTABLES_RACE_FIX added for Trusty  https://review.openstack.org/45012008:28
*** igormarnat has joined #openstack-infra08:28
*** dingyichen has quit IRC08:30
*** martinkopec has quit IRC08:31
*** sree_ has joined #openstack-infra08:31
*** sree_ is now known as Guest1692608:32
*** dizquierdo has joined #openstack-infra08:32
*** martinkopec has joined #openstack-infra08:32
*** lucas-afk is now known as lucasagomes08:32
*** openstackgerrit has quit IRC08:33
*** markus_z has joined #openstack-infra08:35
*** sree has quit IRC08:35
*** derekh has joined #openstack-infra08:37
*** tonytan4ever has quit IRC08:42
*** jascott1_ has quit IRC08:42
*** rossella_s has quit IRC08:42
*** rossella_s has joined #openstack-infra08:43
odyssey4meAJaeger it's doing feedback on our repositories too08:44
*** ccamacho has joined #openstack-infra08:44
odyssey4meit's likely a misconfiguration - previously when this happened it was ejected from the right to do so with an email sent to the owner to indicate that they have a misconfiguraiton and should fix it before it will be allowed to post back to jobs again08:45
*** openstackgerrit has joined #openstack-infra08:46
openstackgerritAlfredo Moralejo proposed openstack-dev/pbr master: Initialize sphinx config using application instead of config  https://review.openstack.org/44845508:46
*** kjackal_ has quit IRC08:52
*** namnh has joined #openstack-infra08:55
*** kjackal_ has joined #openstack-infra09:00
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/45012709:00
*** zz_dimtruck is now known as dimtruck09:02
*** apetrich has quit IRC09:06
*** Julien-z_ has quit IRC09:06
openstackgerritNam Nguyen Hoai proposed openstack-infra/project-config master: Add Barbican grenade gate  https://review.openstack.org/44768909:06
*** arxcruz has quit IRC09:11
*** Julien-zte has joined #openstack-infra09:12
*** dimtruck is now known as zz_dimtruck09:12
*** Julien-zte has quit IRC09:13
*** Julien-zte has joined #openstack-infra09:13
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing conditional instead of nested stack for rabbitmq  https://review.openstack.org/45013709:15
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing conditional instead of nested stack for rabbitmq  https://review.openstack.org/45013709:16
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/45012709:16
*** hrubi has joined #openstack-infra09:20
*** arxcruz has joined #openstack-infra09:22
*** yamahata has quit IRC09:26
*** dizquierdo has quit IRC09:26
*** kjackal_ has quit IRC09:27
*** s-shiono has quit IRC09:41
openstackgerritNam Nguyen Hoai proposed openstack-infra/project-config master: Add Barbican grenade gate  https://review.openstack.org/44768909:43
*** tosky has joined #openstack-infra09:45
*** sambetts_ is now known as sambetts09:51
*** ociuhandu has quit IRC09:56
*** rcarrillocruz has quit IRC09:57
*** timello has joined #openstack-infra09:57
*** nadya has quit IRC10:02
*** zz_dimtruck is now known as dimtruck10:03
*** liujiong has quit IRC10:09
*** electrofelix has joined #openstack-infra10:11
*** dimtruck is now known as zz_dimtruck10:13
*** bauwser is now known as bauzas10:17
*** jordanP has joined #openstack-infra10:22
*** neiljerram has joined #openstack-infra10:23
*** Guest16926 has quit IRC10:26
*** amotoki has quit IRC10:30
*** electrofelix has quit IRC10:35
*** gongysh has quit IRC10:35
*** panda|pto is now known as panda10:35
*** sree has joined #openstack-infra10:37
*** sdague has joined #openstack-infra10:38
*** sdague_ has joined #openstack-infra10:38
*** ociuhandu has joined #openstack-infra10:38
AJaegeramrith: what do you think of retiring trove-integration repo completely? Or do you still need it?10:39
*** sdague has quit IRC10:39
*** sdague_ is now known as sdague10:40
*** nadya has joined #openstack-infra10:40
*** sree has quit IRC10:41
*** nicolasbock has joined #openstack-infra10:42
*** tonytan4ever has joined #openstack-infra10:42
*** e0ne has joined #openstack-infra10:50
*** nmathew has joined #openstack-infra10:50
openstackgerritMerged openstack-infra/project-config master: python3 voting tests for python-redfish  https://review.openstack.org/44879610:55
*** florianf has quit IRC10:57
*** mat128 has joined #openstack-infra10:58
*** electrofelix has joined #openstack-infra11:00
*** lucasagomes is now known as lucas-hungry11:00
*** ccamacho is now known as ccamacho|lunch11:02
*** yanyanhu has quit IRC11:04
electrofelixrajinir: hi, just saw a comment from the 'Dell Ironic CI' user appear on https://review.openstack.org/#/c/408215/6 which is a project called git-upstream, wondering if maybe something got changed by mistake or did you really mean for it to comment on it?11:04
AJaegerelectrofelix: it's broken, I already sent an email but got no so far reply ;( http://lists.openstack.org/pipermail/openstack-infra/2017-March/005261.html .11:06
AJaegerrajinir: are you in charge of that server? Then disable it directly - and then fix it ^11:06
*** apetrich has joined #openstack-infra11:07
electrofelixAJaeger: cheers11:07
*** wolverineav has joined #openstack-infra11:07
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing conditional instead of nested stack for apache  https://review.openstack.org/45016911:10
*** nmathew has quit IRC11:12
*** noorul has joined #openstack-infra11:13
openstackgerritNam Nguyen Hoai proposed openstack-infra/project-config master: Add Barbican grenade gate  https://review.openstack.org/44768911:14
*** adarazs is now known as adarazs_lunch11:14
*** Julien-zte has quit IRC11:16
*** florianf has joined #openstack-infra11:16
*** nicolasbock has quit IRC11:16
*** dave-mccowan has joined #openstack-infra11:18
*** nicolasbock has joined #openstack-infra11:19
*** jiaohaolin1 has left #openstack-infra11:23
*** gcb has quit IRC11:25
*** rbuzatu_ has joined #openstack-infra11:27
*** florianf has quit IRC11:31
*** rbuzatu has quit IRC11:31
*** florianf has joined #openstack-infra11:31
*** zhurong has joined #openstack-infra11:31
*** jascott1_ has joined #openstack-infra11:35
amrithAJaeger, it is needed for older releases11:35
*** sree has joined #openstack-infra11:36
AJaegeramrith: which ones?11:36
AJaegeramrith: Background for my question: I noticed some unused variables and cleaned up - see https://review.openstack.org/450088 and https://review.openstack.org/45008911:37
amrithpike was first release that didn't use it. so ocata and whatever n was ...11:38
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Silence command warnings  https://review.openstack.org/44874811:39
AJaegeramrith: Current release is ocata and trove merged the integration changes in ocata cycle - so, ocata and onward don't use, newton and older need it - correct?11:39
*** jascott1_ has quit IRC11:39
*** zz_dimtruck is now known as dimtruck11:40
amrithif it merged in ocata, then yes. newton and before11:40
*** sree has quit IRC11:40
*** dizquierdo has joined #openstack-infra11:40
AJaegeramrith: ok, then.11:40
AJaegeramrith: ah, found your comments in project-config - ok, then we cannot retire yet ;)11:41
amrithso AJaeger when you retire it, or rather the trigger to retire it will be when the -legacy- gate jobs can all be retired11:42
amriththey are used only from those legacy jobs11:42
AJaegeramrith: understood now, thanks11:42
amrithand any humans who still mistakenly use it11:42
amriththx AJaeger11:42
*** tonytan4ever has quit IRC11:42
*** nicolasbock has quit IRC11:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Replace ssh-keyscan with host keys from node  https://review.openstack.org/44678511:43
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add entry for ref-replication-scheduled event  https://review.openstack.org/44625111:43
*** thorst has joined #openstack-infra11:45
*** nicolasbock has joined #openstack-infra11:45
*** amotoki has joined #openstack-infra11:46
odyssey4meAJaeger Can we block the Dell Ironic CI? It's quite a nuisance and causing quite a lot of confusion.11:46
AJaegerodyssey4me: http://lists.openstack.org/pipermail/openstack-infra/2017-March/005261.html - and I agree. Once an infra-root is up, let's ask...11:46
* jhesketh waves11:47
jheskethI'll take a look11:47
AJaegerthanks, jhesketh11:49
*** ldnunes has joined #openstack-infra11:51
*** namnh has quit IRC11:53
*** rfolco has joined #openstack-infra11:53
*** jaypipes has joined #openstack-infra11:55
*** tuanluong has quit IRC11:56
*** sree has joined #openstack-infra11:56
*** EricGonczer_ has joined #openstack-infra11:57
jheskethAJaeger, odyssey4me: account disabled12:00
*** isaacb_ has joined #openstack-infra12:01
*** lucas-hungry is now known as lucasagomes12:03
*** ggnel_t has quit IRC12:03
*** isaacb has quit IRC12:04
*** noorul has left #openstack-infra12:05
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add a test for multiple provider pools  https://review.openstack.org/45018312:07
*** trown|outtypewww is now known as trown12:10
*** dprince has joined #openstack-infra12:10
*** erlon has joined #openstack-infra12:11
*** dave-mccowan has quit IRC12:12
*** aysyd has joined #openstack-infra12:12
*** zhurong has quit IRC12:12
*** apetrich has quit IRC12:15
*** amoralej is now known as amoralej|lunch12:16
*** ccamacho|lunch is now known as ccamacho12:16
*** ggnel_t has joined #openstack-infra12:19
*** askb has quit IRC12:20
*** gouthamr has joined #openstack-infra12:21
*** alexchadin has quit IRC12:22
AJaegerthanks, jhesketh !12:26
*** xyang1 has joined #openstack-infra12:28
*** isaacb_ has quit IRC12:33
*** markus_z has quit IRC12:34
*** isaacb_ has joined #openstack-infra12:35
openstackgerritVasyl Saienko proposed openstack-infra/project-config master: Increase concurrency for ironic jobs to 4  https://review.openstack.org/44752512:36
*** links has quit IRC12:40
*** Goneri has joined #openstack-infra12:41
*** rossella_s has quit IRC12:42
*** rlandy has joined #openstack-infra12:43
*** rossella_s has joined #openstack-infra12:43
*** EricGonczer_ has quit IRC12:44
*** rtmins has joined #openstack-infra12:44
*** efoley has joined #openstack-infra12:44
*** tonytan4ever has joined #openstack-infra12:45
*** rtmins has quit IRC12:45
*** Julien-zte has joined #openstack-infra12:46
*** markvoelker has quit IRC12:47
*** adarazs_lunch is now known as adarazs12:47
*** markus_z has joined #openstack-infra12:47
*** tonytan4ever has quit IRC12:48
*** sree has quit IRC12:48
fungithanks jhesketh12:48
*** john-davidge has quit IRC12:49
*** john-dav_ has joined #openstack-infra12:49
*** ggnel_t has quit IRC12:50
jpichAJaeger: Hi! Where should bugs about the translation jobs be filed? I found a minor bug with the js translation infra (easy to work around), it'd probably be nice to track it somewhere until I have a bit of breathing room to fix it proper (or let someone beat me to it!)12:50
*** chlong has joined #openstack-infra12:51
openstackgerritAndy McCrae proposed openstack-infra/project-config master: Promote Upgrade jobs to voting for OpenStack-Ansible  https://review.openstack.org/45019812:51
*** ggnel_t has joined #openstack-infra12:53
*** vsaienk0 has joined #openstack-infra12:54
vsaienk0dtantsur: AJaeger, yolanda please add to your review queue increase concurrency for ironic-standalone and multinode jobs https://review.openstack.org/#/c/413499/12:54
AJaegerjpich: storyboard.openstack.org is for all things infra12:56
*** rbuzatu_ has quit IRC12:56
fungiyeah, probably file a story against the openstack-infra/project-config project12:56
*** rbuzatu has joined #openstack-infra12:57
jpichAJaeger, fungi: Ok, I found the project-config project over there - thanks!12:58
*** sree has joined #openstack-infra12:58
*** apetrich has joined #openstack-infra12:58
AJaegervsaienk0: that'S an ironic change that'12:59
fungiAJaeger: and not just infra any more (monasca and defcore/interop/refstack are using it too)12:59
AJaegervsaienk0: that's an ironic change that I'm not touching - and depends on devstack-gate which I won't touch either.12:59
AJaegerfungi: yes, indeed. But I didn't say it's only for infra ;)13:00
AJaegerfungi: have you seen https://review.openstack.org/#/c/447932/ ? Moves python-monascaclient over to storyboard13:00
*** amoralej|lunch is now known as amoralej13:00
*** mriedem has joined #openstack-infra13:02
*** sree has quit IRC13:03
vsaienk0AJaeger: dtantsur, yolanda I'm sorry provided wrong link earlier correct patch is https://review.openstack.org/#/c/447525/13:03
*** baoli has joined #openstack-infra13:03
*** apetrich has quit IRC13:03
*** jcoufal has joined #openstack-infra13:05
openstackgerritAnton Studenov proposed openstack-infra/project-config master: [Rally] increase CLI job timeout  https://review.openstack.org/45020913:11
lennybregarding diskimage-builder. there are some minimal elements ( centos-minimal) that require yum, yum-utils. what is the lightest and the easiest way to install them?13:12
*** ihrachys has joined #openstack-infra13:12
mnaseris there a bug with the dell ironic ci?13:15
andreykurilinAJaeger: hi! Do you have a minute to discuss https://review.openstack.org/#/c/449683/ ?13:15
mnaserim seeing it throw up a "This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset." here and there on things that are not tested by it (ex kolla)13:15
*** apetrich has joined #openstack-infra13:15
*** alexchadin has joined #openstack-infra13:16
mnaserex: https://review.openstack.org/#/c/450203/113:16
fungimnaser: jhesketh just disabled the account13:17
fungijhesketh: did you do a close-connection on any open connections for it?13:18
jheskethfungi: ah no, I didn't think of that13:18
jheskethfungi: I've retired for the evening. Would you mind killing it please. No worries if not, I can get the lappy out13:19
fungijhesketh: did you mention that account's id number in channel? trying to find it again13:19
jheskethNo sorry. You'll have to query.13:20
jheskethI can find my term if you prefer though13:20
fungino worries, i should soon be at a computer where i can do that easily13:20
fungiand did anybody send an announcement about that disablement to the 3rd-party-ci-announce ml?13:21
jheskethfungi: ah no. I really did a half job sorry!13:23
*** gcb has joined #openstack-infra13:25
*** gongysh has joined #openstack-infra13:26
openstackgerritAndy McCrae proposed openstack-infra/project-config master: Promote Upgrade jobs to voting for OpenStack-Ansible  https://review.openstack.org/45019813:29
asettlettx: ping13:31
openstackgerritEmma Foley proposed openstack-infra/project-config master: Add collectd-ceilometer-plugin jobs  https://review.openstack.org/44861213:31
*** tonytan4ever has joined #openstack-infra13:31
fungiDell Ironic CI is account id 1933913:34
*** anilvenkata has left #openstack-infra13:34
fungishow-connections -n has four entries matching that account id number, all from 143.166.116.413:35
*** jascott1_ has joined #openstack-infra13:36
fungii've used close-connection on each of them just now, and there are no longer any appearing in the show-connections -n output for account 1933913:36
AJaegerandreykurilin: I really cannot help with that, sorry. Please ask others in this channel or #openstack-qa for help.13:36
*** gouthamr_ has joined #openstack-infra13:36
*** gouthamr has quit IRC13:36
*** dimtruck is now known as zz_dimtruck13:38
*** zz_dimtruck is now known as dimtruck13:38
*** jascott1_ has quit IRC13:40
dmsimardah, yes, Dell Ironic CI. I was about to say that this CI was rogue but you,re already on it.13:42
ttxasettle: pong13:45
AJaegerfungi: Matt has +1ed the IRC access removal, I've removed the WIP - https://review.openstack.org/#/c/44751113:45
asettlettx: thanks for getting back to me. All done!  Just a really minor issue :)13:45
ttxasettle: great!13:47
ttxMy favorite problems: those that are solved already.13:47
*** dimtruck is now known as zz_dimtruck13:47
*** igormarnat has quit IRC13:48
asettleHahaha, so happy to help?13:49
asettle:p13:49
*** skinkitten has joined #openstack-infra13:51
pabelangerinfra-root: mudpuppy: Morning, I've been tracking some networking issues we appears to be having in osic-cloud1 for the past few days. Specifically, we look to be dropping packets / getting TCP connection resets when accessing external networks. For example: http://paste.openstack.org/show/604306/13:51
openstackgerritChangBo Guo(gcb) proposed openstack-infra/project-config master: Make tempest-neutron-dsvm-src-oslo.messaging-zmq-ubuntu-xenial non-voting  https://review.openstack.org/45023513:52
pabelangerRight now, I can see a large amount of failures on centos-7 nodes starting from mar. 24 the13:52
pabelangerhttps://goo.gl/Bqoymy13:52
*** sree has joined #openstack-infra13:52
pabelangerif you remove voting from the query, you'll see more data^13:53
pabelangerand provider is limited to osic13:53
*** igormarnat has joined #openstack-infra13:54
*** gcb has quit IRC13:54
*** gcb has joined #openstack-infra13:54
*** nadya has quit IRC13:55
*** mtanino has joined #openstack-infra13:57
*** esberglu has joined #openstack-infra13:57
*** markus_z has quit IRC13:57
fungipabelanger: any theories as to why it's hitting centos 7 harder? (or is it?)13:59
*** esberglu_ has joined #openstack-infra14:00
*** markvoelker has joined #openstack-infra14:00
*** hongbin has joined #openstack-infra14:00
*** nmathew has joined #openstack-infra14:00
pabelangerfungi: first different I can see, centos-7 is not using unbound for dns.   glean is getting DNS setting from config-drive and setting them to google, so working to address that, but don't think it is the issue14:01
*** nmathew has quit IRC14:01
pabelangerfungi: but, I think tripleo jobs just go out to the internets more then devstack things honestly.  Which might just be using the network more14:02
mudpuppypabelanger: Ty for the heads up. Investigating today on it14:02
*** esberglu has quit IRC14:02
*** sree has quit IRC14:02
pabelangerI'm still trying to see if ubuntu is affected at all, but haven't see any failures14:02
fungiwell, unbound would still be going to those same nameserver addresses presumably14:02
pabelangershould confirm with openstack-qa14:02
*** sree has joined #openstack-infra14:03
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing conditional instead of nested stack for MySQL  https://review.openstack.org/45024614:03
pabelangerfungi: no, because cloud-drive doesn't use google ipv6 namesevers, defaults to ipv4. Meaning centos-7 doesn't benefit from ipv6?14:03
fungii thought our unbound config also just used google's ipv4 nameserver addresses14:04
*** zz_dimtruck is now known as dimtruck14:04
pabelangerno, we added ipv6 a while back for forwarding.conf14:04
fungiaha, i missed that (or forgot it)14:04
fungineat14:04
pabelangerand, because unbound on ubuntu will also rewrite /etc/resolv.conf on start up, it fixes gleans rewrite14:05
openstackgerritMerged openstack-infra/project-config master: Remove Sam-I-am from accessbot  https://review.openstack.org/44751114:05
pabelangerfungi: so, for a short term fix, can we ask osic-cloud to stop passing dns to config-drive? I am not sure if that is valid or not14:05
pabelangerotherwise, I think it is time glean grew a configuration file14:06
fungii'd rather not get providers to work around bugs in software we're running14:06
pabelangerack14:06
*** sree has quit IRC14:07
pabelangermudpuppy: danke14:07
fungiand yes, dhcp clients have configuration you can use to tell them what settings to look for, what settings to ignore, what settings to override. i think glean ultimately needs to be able to do similar things14:07
andreykurilinAJaeger: np. thanks!14:08
*** knangia has joined #openstack-infra14:08
*** chlong has quit IRC14:09
*** markus_z has joined #openstack-infra14:10
*** burgerk has joined #openstack-infra14:11
*** ramishra has quit IRC14:11
*** zhurong has joined #openstack-infra14:12
AJaegerfungi, jhesketh went through open Infra-manual changes, could you put that queue on your review list as well, please? There're now a few that could merge...14:12
*** gyee has joined #openstack-infra14:13
*** gyee has quit IRC14:13
AJaegersdague: does export KEEP_LOCALRC=1 work with the new local conf? see https://review.openstack.org/#/c/448612/3/jenkins/jobs/collectd-ceilometer-plugin.yaml14:13
*** dhajare has quit IRC14:14
*** dave-mccowan has joined #openstack-infra14:16
openstackgerritMonty Taylor proposed openstack/os-client-config master: Stop special-casing idenity catalog lookups  https://review.openstack.org/45025914:17
sdagueAJaeger: I'm not sure that it does, I don't remember14:17
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add normalization for heat stacks  https://review.openstack.org/45026014:18
openstackgerritMonty Taylor proposed openstack-infra/shade master: Replace heatclient testing with requests_mock  https://review.openstack.org/45026114:18
*** ym200 has joined #openstack-infra14:20
*** timello has quit IRC14:21
*** EricGonczer_ has joined #openstack-infra14:22
*** ricardoas has left #openstack-infra14:23
*** ccamacho is now known as ccamacho|brb14:25
*** dhajare has joined #openstack-infra14:26
*** vikrant has quit IRC14:27
*** rbrndt has joined #openstack-infra14:28
*** marst has quit IRC14:30
*** gordc has joined #openstack-infra14:32
*** hongbin_ has joined #openstack-infra14:32
*** EricGonc_ has joined #openstack-infra14:32
*** arosales has left #openstack-infra14:33
*** EricGonczer_ has quit IRC14:33
*** hongbin has quit IRC14:34
*** jordanP has quit IRC14:36
*** jordanP has joined #openstack-infra14:36
openstackgerritChangBo Guo(gcb) proposed openstack-infra/project-config master: Make tempest-neutron-dsvm-src-oslo.messaging-zmq-ubuntu-xenial non-voting  https://review.openstack.org/45023514:36
*** superdan is now known as dansmith14:38
SamYapleI have a new project merged: https://review.openstack.org/#/c/449224/  Would someone in the infra-core group add me to these two groups? https://review.openstack.org/#/admin/groups/1735,members https://review.openstack.org/#/admin/groups/1736,members14:39
*** zhurong has quit IRC14:41
jrollthis reminds me I have one, as well: https://review.openstack.org/#/c/446703/ https://review.openstack.org/#/admin/groups/1733,members https://review.openstack.org/#/admin/groups/1734,members14:41
jrollthanks SamYaple :P14:41
pabelangerSamYaple: done14:42
SamYaplepabelanger: thanks!14:42
pabelangerjroll: done14:43
jrollthanks pabelanger :)14:43
*** marst has joined #openstack-infra14:44
*** szaher has quit IRC14:45
*** trown is now known as trown|brb14:45
*** szaher has joined #openstack-infra14:46
*** trown|brb is now known as trown14:49
*** toidiu has joined #openstack-infra14:50
*** furlongm has quit IRC14:50
*** toidiu has quit IRC14:50
*** dhajare has quit IRC14:51
*** toidiu has joined #openstack-infra14:51
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Enable multinode topology for slow Patrole tests.  https://review.openstack.org/45027814:51
mtreinishmasayukig: I don't see the failed test lists in the rss either. I'd check puppetboard to see if the server update worked, but that doesn't work anymore...14:52
openstackgerritChangBo Guo(gcb) proposed openstack-dev/cookiecutter master: Remove testsenarios from test-requirements.txt  https://review.openstack.org/45027914:54
*** yamahata has joined #openstack-infra14:56
*** Goneri has quit IRC14:57
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: README.rst: add documentation for the quickstart transition scripts  https://review.openstack.org/45028114:57
clarkbianw: sorry for the d-g breaking pbr gating. I have approved the fix14:58
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: Add debian-jessie DIB for dsvm testing  https://review.openstack.org/44993815:01
SamYaplepabelanger: im definetely in the right group, i can approve changes to openstack/loci, however i cannot appove changes to openstack/loci-* which should be all in the same group15:02
*** flepied has quit IRC15:02
pabelangerSamYaple: try logout / login?15:02
SamYaplepabelanger: already tried15:02
pabelangerlet me check acl15:02
SamYapleyea im digging in the acl right now15:03
pabelangerSamYaple: which review?15:03
*** prateek has quit IRC15:03
*** dhajare has joined #openstack-infra15:03
pabelangerSamYaple: drop +1 on 45025415:04
pabelangerthen review again15:04
pabelangersee +2?15:04
SamYaplepabelanger: ok ill try15:04
*** marst has quit IRC15:04
*** ijw has joined #openstack-infra15:05
SamYaplepabelanger: yep, adding a comment fixes it15:05
SamYaplepabelanger: thanks!15:05
pabelangernp15:05
*** ijw_ has joined #openstack-infra15:06
*** john-dav_ is now known as john-davidge15:06
*** tonytan_brb has joined #openstack-infra15:06
*** tonytan4ever has quit IRC15:07
*** rcernin has quit IRC15:07
*** annegentle has joined #openstack-infra15:08
*** skinkitten has quit IRC15:09
*** ijw has quit IRC15:09
openstackgerritPaul Belanger proposed openstack-infra/glean master: Do not merge  https://review.openstack.org/45028415:10
*** xarses has joined #openstack-infra15:11
*** andreww has joined #openstack-infra15:12
*** Goneri has joined #openstack-infra15:13
*** zinggggg has joined #openstack-infra15:14
*** xarses has quit IRC15:15
*** dhajare has quit IRC15:17
openstackgerritChangBo Guo(gcb) proposed openstack-infra/project-config master: Make tempest-neutron-dsvm-src-oslo.messaging-zmq-ubuntu-xenial non-voting  https://review.openstack.org/45023515:17
*** flepied has joined #openstack-infra15:19
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Addd Update Event Feedback endpoint  https://review.openstack.org/45028615:19
mtreinishinfra-root: if someone gets a sec can they check if puppet updated the api server on health.o.o to include: https://review.openstack.org/#/c/444722/15:21
mtreinishbecause it doesn't look like that change has been applied from any of the response15:21
mtreinishs15:21
pabelangerlooking15:21
*** skinkitten has joined #openstack-infra15:21
openstackgerritMerged openstack-infra/openstackid-resources master: Addd Update Event Feedback endpoint  https://review.openstack.org/45028615:22
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove SSH support from nodepool  https://review.openstack.org/44668315:22
pabelangermtreinish: this could be fixed: http://paste.openstack.org/show/604328/15:23
mtreinishheh, yeah it's definitely not bzr15:23
pabelangerthe permission change keeps running every 15, just spamming logs15:24
*** beslemon has joined #openstack-infra15:24
pabelangeraside from that, I do see any other changes in the last few days15:24
*** chlong has joined #openstack-infra15:25
mtreinishpabelanger: do or don't? (context implies 'don't')15:26
mtreinishpabelanger: hmm, well the simple way to check is what's the current HEAD of the repo on health.o.o15:26
mtreinishL2 in that paste makes me think it's not updating the repo anymore15:27
pabelangermtreinish: found it: http://paste.openstack.org/show/604330/15:27
pabelangermtreinish: don't sorry, need some coffee15:27
pabelangerso, if you can fix the permission thing, it will help read logs :)15:27
mtreinishheh, ok it's updating a git repo while 'using bzr' :p15:28
mtreinishwell, at least git is at master15:28
mtreinishis there anything about running pip install again or restarting apache with the new version?15:29
mtreinishor is just cloning and moving on...15:29
pabelangermtreinish: the bzr thing is just noise atm this point, you can ignore that15:29
pabelangermtreinish: no, just what I liked15:29
pabelangerlinked*15:29
pabelangermtreinish: elastic-recheck installs properly too15:30
pabelangerI can see that15:30
mtreinishpabelanger: if it updated the openstack-health repo it should have triggered running this: http://git.openstack.org/cgit/openstack-infra/puppet-openstack_health/tree/manifests/api.pp#n11215:31
mtreinishunless that git clone was just elastic-recheck and not openstack-health15:31
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove keypair from provider section  https://review.openstack.org/44767315:31
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove legacy openstack settings from nodepool.yaml  https://review.openstack.org/44764715:31
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update nodepool config syntax  https://review.openstack.org/44881415:31
pabelangermtreinish: doesn't http://paste.openstack.org/show/604330/ show that?15:32
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update nodepool config syntax  https://review.openstack.org/44881415:32
mtreinishpabelanger: oh, yeah you're right I missed it in there15:33
mtreinishI guess maybe we just need to restart apache to force it to pick up the new version?15:33
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Add a test for multiple provider pools  https://review.openstack.org/45018315:33
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove api-timeout and provider.image-type  https://review.openstack.org/44934215:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970515:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935415:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update docs for configuration syntax change  https://review.openstack.org/44933915:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973715:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978115:34
pabelangermtreinish: not sure15:35
asselinanyone around to review some puppet-openstackci changes? https://review.openstack.org/#/c/439796/ https://review.openstack.org/#/c/263021/15:36
*** ym200 has quit IRC15:36
asselinthese 2 shouldn't affect anything in upstream production15:37
asselinbut will help out 3rd party ci folks15:37
openstackgerritLenny Verkhovsky proposed openstack-infra/puppet-openstackci master: added Single Use Slave plugin  https://review.openstack.org/45029615:37
*** mriedem has quit IRC15:38
*** vhosakot has joined #openstack-infra15:39
*** vhosakot has joined #openstack-infra15:40
pabelangerasselin: +315:40
asselinthanks pabelanger15:41
*** ym200 has joined #openstack-infra15:41
*** andreas_s has quit IRC15:41
*** beslemon has quit IRC15:41
*** ym200 has quit IRC15:41
*** martinkopec has quit IRC15:42
*** ym200 has joined #openstack-infra15:42
*** isaacb_ has quit IRC15:43
*** e0ne has quit IRC15:44
openstackgerritLenny Verkhovsky proposed openstack-infra/puppet-openstackci master: added Single Use Slave plugin  https://review.openstack.org/45029615:45
andymccrmorning infra - is there an easy/correct process for requesting gerrit group changes - or is irc the best/easiest way?15:46
openstackgerritMerged openstack-infra/puppet-openstackci master: change default jjb revision to 1.6.2  https://review.openstack.org/43979615:46
sdakesay quick quesiton for people that may know how to integrate pastebinit with paste.openstack.org15:46
sdakedoes anyone know the magic incantation to get these two things to work together?15:46
sdakepastebinit has a paste service avialalbe for paste.openstackorg but i can't get it to work15:47
clarkbandymccr: either send email to the openstack ifnra list or ask here15:47
andymccrclarkb: sweet :) thanks15:47
clarkbandymccr: I'm around if you want to get it done now15:47
fricklersdake: "pastebinit -b paste.openstack.org" should work15:48
andymccrclarkb: excellent, there are a few groups already setup but with no members: openstack-ansible-os_(searchlight|molteniron|octavia|monasca-agent|monasca-ui)-core - can i be added so that i'll be able to add individual members to those groups please?15:49
clarkbandymccr: yes, do you have the change(s) that added those groups?15:49
*** GheRivero has joined #openstack-infra15:50
andymccrclarkb: i can hunt them down - some are a bit old now.15:51
*** benj_ has quit IRC15:51
clarkbandymccr: ah ok. Wanted ti to make sure we didn't miss any. I've done the 5 you listed though15:52
andymccrclarkb: ahh sweet thanks :) yeah i had a look through all the other openstack-ansible-x groups and those were the only ones i could see that i didnt have access to15:52
*** Julien-zte has quit IRC15:53
andymccrthanks clarkb - all worked15:54
*** Julien-zte has joined #openstack-infra15:54
openstackgerritLenny Verkhovsky proposed openstack-infra/puppet-openstackci master: added Single Use Slave plugin  https://review.openstack.org/45029615:54
*** Julien-zte has quit IRC15:54
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Force deploy commands to timeout  https://review.openstack.org/45030215:54
fungisdake: or `pastebinit -b http://paste.openstack.org` is what i do (no idea whether the http:// is needed). i just have a shell alias for that15:54
*** Julien-zte has joined #openstack-infra15:55
openstackgerritLenny Verkhovsky proposed openstack-infra/puppet-openstackci master: added Single Use Slave plugin  https://review.openstack.org/45029615:55
*** Julien-zte has quit IRC15:55
sdakefrickler fungi so just : cat file | pastebinit -b http://paste.openstack.org?15:55
fungisdake: that's what i do, yes15:55
sdakelet me give it a go - before that only rturned "paste.openstack.org"15:56
*** Julien-zte has joined #openstack-infra15:56
sdakewith no other information15:56
*** Julien-zte has quit IRC15:56
*** hashar is now known as hasharAway15:57
sdakethis is what I get now: http://paste.openstack.org/show/604341/15:57
sdakeusing 1.3.115:57
sdakehave to do some magic incantation with sprung.io to get any kind of autopasting15:57
sdakeas fpaste is broken now15:57
*** amotoki has quit IRC15:57
fungiseems like either/both of those could stand to have some manner of rcfile support15:58
*** alexchadin has quit IRC15:58
*** dizquierdo has quit IRC15:58
*** andreww is now known as xarses15:58
fungiaha, pastebinit can have a ~/.pastebinit.xml so sayeth its manpage15:58
sdakei installed from packaging - it is possible the rpm is bad - is there a pip archive of it - pip insstall pastebinit doesn't do anything useful :(15:59
fungiworth noting, i've never been able to get the pastebinit format options to work correctly with lodgeit, but since we're now effectively the lodgeit upstream i bet we could fix that15:59
fungisdake: i'm using the debian's pastebinit 1.5-1 package, no idea if it's on pypi16:00
*** markus_z has quit IRC16:01
sdakefungi sounds good - i'll see what i can find - you said openstack is the pastebinit upstream (or lodgeit upstram, not sure what this?) - know where the reference github repo is?16:02
fungisdake: homepage (according to the package) is http://launchpad.net/pastebinit/ and i don't see anything on pypi for it16:02
fungisdake: openstack infra forked lodgeit because that's what we use to provide the paste.openstack.org service16:03
*** tonytan_brb has quit IRC16:03
*** skinkitten has quit IRC16:03
fungisdake: and then the other forks of it died out, leaving us the de facto upstream16:03
sdakei see16:03
*** tonytan4ever has joined #openstack-infra16:03
sdakewell i need the client not the server ;)16:03
fungisdake: pastebinit's upstream dev seems to be in lp and i don't recognize any of their names16:04
sdakeall I see are deb packages on that launchpad and really old rpm packages on the various sites16:04
sdakefungi would you know where their repo is?16:04
*** beslemon has joined #openstack-infra16:04
fungiyeah, i mentioned us as upstream for the server side because the "format" support from pastebinit not working is probably something we can fix server-side (likely lodgeit does formats differently from how pastebin did)16:05
*** aarefiev is now known as aarefiev_afk16:05
sdakefungi right - however if your cleint works the client has probably fixed it - just need to find the source to said client ;)16:05
fungisdake: their revision control seems to be bzr on lp: https://code.launchpad.net/~pastebinit-developers/pastebinit/trunk16:06
*** nadya has joined #openstack-infra16:06
sdakefungi thanks :)16:06
* sdake groans at bzr16:06
fungisdake: the format support is completely orthogonal to your problem. i mentioned it out of personal interest16:06
sdakefungi roger16:06
fungiplease ignore everything i said about format support and lodgeit, it was an aside16:06
sdakefungi pulling from bzr nwo - thanks :)16:07
fungithe pastebinit devs also have a blog at https://stgraber.org/category/pastebinit/https://stgraber.org/category/pastebinit/ last updated in 2012 (with a release note about soren submitting support for paste.openstack.org)16:08
fungier, https://stgraber.org/category/pastebinit/16:08
* fungi has replacement buttons on order which should solve these extra clicks16:08
*** MapspaM is now known as SpamapS16:08
*** jpich has quit IRC16:09
*** electrofelix has quit IRC16:09
*** hashar has joined #openstack-infra16:10
*** mattmceuen has joined #openstack-infra16:10
openstackgerritMerged openstack-infra/devstack-gate master: Fix DEVSTACK_PROJECT_FROM_GIT for pbr  https://review.openstack.org/45007316:11
openstackgerritMonty Taylor proposed openstack-infra/shade master: Remove python-heatclient and replace with REST  https://review.openstack.org/45031716:11
openstackgerritDave McCowan proposed openstack-infra/project-config master: Disable Swift When Running Barbican with Python 3.5  https://review.openstack.org/45031816:12
*** cinerama has joined #openstack-infra16:12
fungiheading out to grab some lunch, bbiab16:13
clarkbzaro: when you have a moment I'd like to come up to speed a bit more on the gerrit builds and all that. I reviewed a bunch of stuff late last week to help get that going but is that all we needed? can we trigger some builds?16:13
*** beslemon_ has joined #openstack-infra16:13
openstackgerritMerged openstack-infra/devstack-gate master: Stop after early failures  https://review.openstack.org/45004816:14
*** beslemon has quit IRC16:15
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder  https://review.openstack.org/44440316:15
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Refactor nodepool apps into base app  https://review.openstack.org/44839516:21
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test consistent repo with debug  https://review.openstack.org/44751416:22
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Add check for valid zk attribute before disconnect  https://review.openstack.org/44911016:22
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Do not require secure file for nodepoold  https://review.openstack.org/44911816:23
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Docs: Remove "jenkins" reference  https://review.openstack.org/44912916:23
*** jamesdenton has joined #openstack-infra16:23
*** matrohon has quit IRC16:23
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Docs: Clarify secure file usage  https://review.openstack.org/44913016:23
openstackgerritSpyros Trigazis proposed openstack-infra/project-config master: [magnum] Install dib in virtualenv  https://review.openstack.org/45032916:24
*** toidiu has quit IRC16:25
*** MasterOfBugs has joined #openstack-infra16:28
*** nadya has quit IRC16:30
*** rbrndt has quit IRC16:30
*** psachin has quit IRC16:32
openstackgerritMerged openstack-infra/project-config master: Disable Swift When Running Barbican with Python 3.5  https://review.openstack.org/45031816:33
*** jordanP has quit IRC16:33
*** rbrndt has joined #openstack-infra16:33
openstackgerritMerged openstack-infra/devstack-gate master: Remove PBR from global PROJECTS list  https://review.openstack.org/45008316:34
clarkbpabelanger: mudpuppy it looks like networking connectivity from osic to git.openstack.org might be related to our current top elastic-recheck bug too16:34
clarkbpabelanger: mudpuppy is there anything else I/we can eb doing to help debug that?16:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove api-timeout and provider.image-type  https://review.openstack.org/44934216:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970516:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935416:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update docs for configuration syntax change  https://review.openstack.org/44933916:34
*** jordanP has joined #openstack-infra16:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update nodepool config syntax  https://review.openstack.org/44881416:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973716:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978116:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Add a test for multiple provider pools  https://review.openstack.org/45018316:34
*** Swami has joined #openstack-infra16:35
*** annegentle has quit IRC16:35
*** toidiu has joined #openstack-infra16:36
*** rcernin has joined #openstack-infra16:37
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Add a test for multiple provider pools  https://review.openstack.org/45018316:37
*** adrian_otto has joined #openstack-infra16:38
openstackgerritGage Hugo proposed openstack-dev/pbr master: Add Changelog build handling for invalid chars  https://review.openstack.org/43989716:38
*** Goneri has quit IRC16:38
pabelangerclarkb: ya, seems related16:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove api-timeout and provider.image-type  https://review.openstack.org/44934216:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970516:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935416:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update docs for configuration syntax change  https://review.openstack.org/44933916:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973716:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978116:39
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add list_availability_zone_names method  https://review.openstack.org/45033216:39
mordredjeblair: ^^ there's the list_azs method addition16:39
*** Hal has quit IRC16:40
mordredjeblair: I just made it returna list of az names since that's the actual thing we want/need - and to default to only returning ones that are active16:41
mordredsdague: ^^ that's why I was asking you that question just now16:41
*** jaosorior has quit IRC16:41
mudpuppyclarkb: I found a tenant that was abusing networking resources. His instance is now shutdown16:41
*** rossella_s has quit IRC16:42
clarkbmudpuppy: cool I was just poking at it from our mirror host and not seeing any issues16:42
clarkbmudpuppy: so you think tis resolved now then?16:42
jeblairmordred: thanks!16:43
mudpuppyclarkb: I hope so,16:43
jeblairmordred, Shrews: were one of you planning on doing the nodepool complement to that change?16:43
clarkbmudpuppy: http://status.openstack.org/elastic-recheck/index.html#1282876 is the elastic-recheck tracker for this we should see it fall off over time16:43
*** rossella_s has joined #openstack-infra16:43
mudpuppyty16:43
clarkbI've just noticed it would be nice to be the graph key in the top left not top right. I wonder if I can change that16:44
clarkbmnaser: pabelanger http://status.openstack.org/elastic-recheck/index.html#1531187 is the bug with configuring the internal private nic on rax with glean I think16:45
clarkbmnaser: pabelanger is there a change up yet to modify the systemd and have it retry on failure?16:45
mordredjeblair: I will happily do a nodepool complement - but not sure how Shrews might want it plumbed in to his scheduling things - I'll bother him about that in just a bit16:47
*** Apoorva has joined #openstack-infra16:47
pabelangerclarkb: I haven't, but can now16:47
pabelangerI am currently fighting systemd and debian-jessie16:47
clarkbpabelanger: with glean?16:48
clarkb:P16:48
pabelangerclarkb: yup16:48
clarkbnice16:48
pabelangerhttp://paste.openstack.org/show/604351/16:48
mordredclarkb: feel like doing a 3-second review on https://review.openstack.org/#/c/450332/ ?16:48
pabelangerit seems debian-jessie has a different start order for systemd things16:48
*** rwsu has joined #openstack-infra16:48
mordredpabelanger: YAY!16:48
*** eharney has joined #openstack-infra16:48
mordredpabelanger: just what we always wanted16:48
pabelangerand use depending on network-pre.target is a problem16:48
asselinclarkb, Zaro what version of gerrit are you planning to upgrade to?16:49
*** derekh has quit IRC16:49
mordredpabelanger: it's so nice that systemd's dependency graph saves us from needing to having to think about init script numbering16:49
clarkbasselin: 2.13.7 currently16:49
mordredand instead need to think about abstract names in a graph that can vary from distro to distro and release to release16:49
clarkbpabelanger: have you asked systemd to graph that?16:49
clarkbpabelanger: might make it easier to resolve if you see the full cycle16:49
asselinclarkb, ok latest released gerrit...any known issues so far?16:50
mordredDEFINITELY an improvement on doing something so mundane and pedestrian and obvious like using a runparts directory with a list of maybe 10 scripts to initilize the system in order16:50
pabelangerclarkb: ya, that is next step16:50
clarkbasselin: no we haven't deployed it yet16:50
mordredasselin: so no known issues - plenty of unknown issues :)16:51
clarkbmordred: the best part is you can still do that, but only within the bubble of your other run parts firends16:51
asselinlol thanks :)16:51
clarkbasselin: working on getting it built along with plugins then will likely deploy to review-dev, test, and schedule production upgrade16:51
*** flepied has quit IRC16:52
openstackgerritAndrey Kurilin proposed openstack-infra/project-config master: [rally] Add support for custom branching  https://review.openstack.org/45033716:53
*** hashar has quit IRC16:54
*** gyee has joined #openstack-infra16:54
clarkbmordred: all that said the easiest way to fix all these problems? DHCP16:55
mordredclarkb: yup16:56
mordredclarkb: but heaven forbid we use a protcol with a 20 year old RFC16:57
openstackgerritVasyl Saienko proposed openstack-infra/project-config master: Add install-guide job to networking-baremetal  https://review.openstack.org/45034116:57
mordredclarkb: clearly we need to invent a new method for Dynamically Configuring Hosts - then we can have fun trying to interact with it from the replacement for the 40 year old init system16:58
*** amotoki has joined #openstack-infra16:58
openstackgerritAndrey Kurilin proposed openstack-infra/project-config master: [rally] Add support for custom branching  https://review.openstack.org/45033716:58
*** tesseract has quit IRC16:59
openstackgerritAndrey Kurilin proposed openstack-infra/project-config master: [rally] Add support for custom branching  https://review.openstack.org/45033717:00
*** annegentle has joined #openstack-infra17:00
vsaienk0AJaeger: yolanda dtantsur: please add to your review queue 1 line patch that enables install-guide job on networking-baremetal project https://review.openstack.org/#/c/450341/17:01
AJaegervsaienk0: if it's one line patch, I bet it's wrong. Did it pass testing locally?17:02
*** armax has joined #openstack-infra17:02
*** amotoki has quit IRC17:03
*** ricardoas has joined #openstack-infra17:03
openstackgerritAndrey Kurilin proposed openstack-infra/project-config master: [rally] Add support for custom branching  https://review.openstack.org/45033717:03
*** saibarspeis has joined #openstack-infra17:04
*** YorikSar has quit IRC17:05
*** trown is now known as trown|compassing17:05
pabelangerclarkb: mnaser: looks like that won't work. We'll need to add a lock check to ExecStartPre17:05
mnaserpabelanger im confused at why the lock code of glean doesn't work in the first place17:06
pabelangerbecause, this isn't glean failing, but systemd magic I believe17:06
pabelangerit is a race condition between chkconfig17:06
*** rcernin has quit IRC17:08
zaroclarkb: hey, here’s the latest changes https://review.openstack.org/#/q/status:open++topic:gerrit-upgrade17:11
openstackgerritMonty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fetch list of AZs from nova if it's not configured  https://review.openstack.org/45034517:12
*** pcaruana has quit IRC17:12
zaroclarkb: looks like changes are in to build 2.13.7 just need to make some type of change in openstack-infra/gerrit (openstack/2.13.7 branch) to kick off a build.17:12
clarkbzaro: did the change to update the .gitreview already merge? that might be a good one to trigger the buidls if not17:13
clarkbzaro: or do we need any backports? guessing not really since this release is brand new17:13
mnaserpabelanger but i believe that chkconfig is called by glean17:14
mnaserwhen it does systemctl enable network17:14
mnaserthat forwards it to chkconfig17:14
zaroclarkb: i’m not aware of any required backports.17:14
*** efoley has quit IRC17:14
*** ociuhandu has quit IRC17:14
zaroclarkb: .gitreview one already merged so i think we need a new change17:15
zaroclarkb: actually, it looks like build are already there, http://tarballs.openstack.org/ci/gerrit/17:16
clarkbperfect17:17
zaroclarkb: javamelody is there as well however, no its-storyboard yet.  wondering if it failed?17:17
zaroohh actually its-storyboard is available as well :)17:17
zaroi don’t have time to try upgrade review-dev.o.o today though.17:18
*** harlowja has quit IRC17:18
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935417:18
clarkbzaro: thats fine, I will work on reviewing the topic you linked17:19
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970517:19
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973717:19
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978117:19
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder  https://review.openstack.org/44440317:20
*** chlong has quit IRC17:22
*** saibarspeis has quit IRC17:22
pabelangermnaser: Hmm, why are we doing that?17:22
pabelangerI never noticed that before17:23
mnaserpabelanger i'm not sure, but it seems unnecessary because ifup will start the interface afterwards regardless17:23
*** markvoelker has quit IRC17:23
*** harlowja has joined #openstack-infra17:24
mnaseri mean all its doing is enabling it so in the event the VM is restarted, network will come up afterwards17:24
mnaserbut i feel that's a bit unnecessary in a temp. VM world17:24
clarkboh wait17:24
mnaseri can only assume that in a real world scenario replacing cloud-init, this makes sure that network goes up successfully on reboots17:24
clarkbis this a problem because we are writing multiple network configs at the same time and then chkconfiging in the middle and we might not have a complete config written when chkconfig runs so it fails?17:25
clarkbcan we fix that by writing to a tmp file and then doing an atomic rename to avoid the chkconfig problem?17:25
mnaserclarkb one thing that has me baffled all of this time is17:26
mnaserhttps://github.com/openstack-infra/glean/blob/master/glean/cmd.py#L1177-L118317:27
mnaserit should be happening one at a time, they should be waiting for each other17:27
*** amoralej is now known as amoralej|off17:27
clarkbhuh17:27
mnaserand this was added 2 years ago as well17:27
mnaserhttps://github.com/openstack-infra/glean/commit/b94841bbd9e91d9e21b09cfaf3d008ba587fd11617:28
clarkbmaybe /tmp isn't shared among processes in boot? I dunno17:28
mnaserthats what i thought17:28
mnaserlooks like when the patch was submitted, it wasnt /tmp17:28
mnasercould this have introduced it? https://github.com/openstack-infra/glean/commit/7f8c13fbb7ad9bad06bf79a2395d2baa52edb03f17:28
pabelanger/var/lib/glean seems like a better choice17:29
mnaserthat would probably be cleaner if the folder is expected to exist17:29
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Create zuul.executor.hostname ansible variable  https://review.openstack.org/44882017:29
pabelangerI did look into systemd privatetmp, docs say it should be disabled befault17:30
mnaseryeah i came to that same conclusion17:30
pabelangerbut we could set the param to be safe17:30
mnaserso i put that aside17:30
*** lazyPower is now known as lp|Kubecon17:30
*** arxcruz has quit IRC17:31
*** gouthamr_ is now known as gouthamr17:32
clarkbits relatively simple to do atomic renames maybe we do that regardless since its cleaner?17:33
pabelangerokay, I need to stop looking at systemd for a few minutes17:33
bkeroQuestion: Why do multinode nodepool jobs log the files from subnodes in directories indexed starting with 'subnode-2'?17:33
clarkbbkero: because the primary node is -1 (but its implicit in the logs)17:33
bkeroclarkb: Is that really a subnode then?17:33
clarkbbkero: I'm not sure I understand the question17:33
clarkbsubnodes are subnodes beacuse nodepool said so17:34
clarkb(and they don't talk to jenkins/zuul)17:34
bkeroIf a multinode job is comprised of a primary node plus N subnodes, then in this nomenclature, why is the primary node a subnode?17:34
clarkbthe primary node is not a subnode17:34
*** rossella_s has quit IRC17:34
bkeroWhy is it named subnode-1 then? :)17:34
clarkbbkero: its not17:34
clarkbit gets the first index, it is not named subnode-117:34
bkeroSo the index isn't associated with the name?17:35
bkeroThat's confusing17:35
clarkbthe index is there to have consistent naming for logs so that you can always look in the same place for predictable urls17:35
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove legacy openstack settings from nodepool.yaml  https://review.openstack.org/44764717:35
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove keypair from provider section  https://review.openstack.org/44767317:35
clarkbthe index lines up with the IPs assigned in the overlay networking17:35
*** Goneri has joined #openstack-infra17:36
clarkbprimary is .1, subnodes are assigned 2-254 in order in the /24 address space17:36
bkeroActually the primary is .2 IIRC17:36
clarkbits just an index on the number of hosts we have17:36
clarkbno primary is .117:36
*** eharney has quit IRC17:36
clarkbif someone changed that then that is a bug and should be fixed17:36
bkeroAt least that's what the ovs_vxlan_networking devstack-gate script would have me believe17:36
*** rbrndt has quit IRC17:37
*** chlong has joined #openstack-infra17:38
clarkbhttps://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n150 passes 1 as the offset to https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n102417:38
*** armax_ has joined #openstack-infra17:39
clarkbso primary starts at .1, then we increment for each subnode and they get .2 .3 and so forth17:39
*** armax has quit IRC17:39
*** armax_ is now known as armax17:39
*** sshnaidm is now known as sshnaidm|afk17:40
*** flepied has joined #openstack-infra17:41
*** e0ne has joined #openstack-infra17:41
bkeroSo the index in 'subnode-$INDEX' is actually the IP of the subnode in the vxlan bridge? Or is it the order that it appears in /etc/nodepool/sub_nodes_private?17:42
bkeroIt couldn't really be the second one because the primary node isn't in that file.17:42
*** mtanino has quit IRC17:44
*** shardy has quit IRC17:44
*** lucasagomes is now known as lucas-afk17:45
*** tosky has quit IRC17:45
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/infra-specs master: Zuulv3 Executor Security Enhancement  https://review.openstack.org/44449517:45
clarkbyes, its the IP address. But really that index is arbitrary but we've applied to consistently to ip addresses and logging17:45
*** ccamacho|brb is now known as ccamacho17:46
*** Yogi1_ has joined #openstack-infra17:46
*** dave-mccowan has quit IRC17:46
*** vhosakot_ has joined #openstack-infra17:46
bkeroI'm definitely finding logs of 192.168.24.2 being the primary node17:46
bkeroand can't find any record of 192.168.24.1 ever being correctly used17:47
*** baoli has quit IRC17:49
*** vhosakot has quit IRC17:49
*** eharney has joined #openstack-infra17:50
*** ociuhandu has joined #openstack-infra17:50
clarkbbkero: that is not a devstack-gate overlay network17:50
clarkbbkero: so I can't help you17:50
bkero'eh?17:51
clarkbdevstack-gate overlay network is 172.24.4.0/23 split into two /24s17:51
clarkbthe first half for the test nodes and the second half for the nested VMs17:51
clarkbwhatever 192.168.24.0/24 is is not d-g17:51
bkeroThat seems like some arguments that you passed to ovs_vxlan_bridge, but that's certainly not default behavior17:51
*** panda is now known as panda|bbl17:51
bkero(since there are no defaults passed to that afaict)17:51
clarkbbkero: right its how we use devstack-gate17:52
clarkbdevstack-gate assignes the same indexing to the networks it creates and the log subdirs17:52
bkerohttp://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo.sh#n131717:52
clarkbI do not know where 192.168.24 comes from but its not devstack-gate17:52
clarkbright so that sets offset to 217:52
bkeroThat's calling ovs_vxlan_bridge to create the bridge between subnodes17:52
clarkbso you won't get the same index17:52
clarkbyou could fix it17:53
bkeroBy changing the offset to a 1, right17:53
clarkbyes17:53
bkeroor 0?17:53
clarkb117:54
*** viks has joined #openstack-infra17:54
bkeroSo the beginning offset by 1 is 1?17:54
bkeroI guess if it's 0-indexed. I thought that was usually reserved in that ipv4 space though.17:54
clarkbthe index is not 0 indexed (thats why)17:55
clarkbits 1 indexed. primary node is 1, then subnodes 2-25417:55
*** ociuhandu has quit IRC17:55
bkeroSo if it's 1-indexed, why does setting an offset of 1 result in the primary node being 1 instead of 2? O_o17:56
* fungi normally prefers index by zero, but in network addressing the 0 address for a network is generally unusable for local routing, sometimes also used as a broadcast address (thanks ibm for that little bit of insanity)17:56
clarkbbkero: because the first address is set to the passed in offset17:56
clarkbbkero: then incremented for each subnode17:57
*** adrian_otto has quit IRC17:57
bkeroBut then that's not really an offset, is it?17:57
bkeroIt's just a starting address17:57
clarkbbkero: its an offset into the /24 to start applying addresses17:59
clarkbbecause as you found it does support setting it to eg 2 or 128 or 9 or whatever17:59
*** amotoki has joined #openstack-infra17:59
*** baoli has joined #openstack-infra17:59
bkeroThat says to me that it's 0-indexed starting with x.x.x.0, so an offset of 1 would result in the primary being x.x.x.118:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Stop deployment before jobs end  https://review.openstack.org/45038118:00
clarkbbkero: I think you are reading far too much into the terms used here18:00
clarkbits an arbitrary index that we choose to line up IP addresses and log dirs with18:00
clarkbit starts at 118:00
bkeroclarkb: tripleo-ci is having a problem with log collection, with some logs going into subnode-1/ and some going into subnode-2/ so I'm trying to understand how these IPs and names are determined.18:00
bkero(on 2-node jobs)18:01
openstackgerritLin Yang proposed openstack-infra/project-config master: Enable check-requirements job for valenceclient  https://review.openstack.org/45038218:01
clarkbbkero: it also looks like tripleo ci does whatever it wants and doesn't actually d-g...18:01
bkeroin this case the subnode-1 and subnode-2 dirs are from the same host, but different log collectors are naming them differently18:01
*** dave-mccowan has joined #openstack-infra18:01
*** HeOS has quit IRC18:01
*** jordanP has quit IRC18:02
clarkbI get that it doesn't work but there isn't much I can do about that because tripleo has 4 years on continued to refuse to use common tooling to run its testing18:02
bkeroI wasn't actually aware that devstack-gate already provided a vxlan bridge between nodes of a multinode job. Maybe it would be easiest to simply use that.18:02
bkeroI don't know the reasons why it hasn't used that.18:02
clarkbbkero: it also writes out the ansible inventory, which is likelywhere it is breaking for you18:02
clarkbbecause ansible isgetting inventory for multiple node with same IP address18:03
clarkbso when log collection runs it hits that node twice18:03
bkerotripleo-quickstart is making its own inventory18:03
bkeroSo that's not an issue18:03
clarkbright thats what is broken I'm guessing18:03
clarkbbeacuse when log collection runs it hits that inventory file?18:03
bkeroAh I see18:03
*** amotoki has quit IRC18:03
clarkb(thats a guess)18:04
bkeroI can go trawl around to find out18:04
*** sshnaidm|afk is now known as sshnaidm18:04
bkeroI'll see if I can simplify by using devstack-gate's vxlan networking sometime.18:05
bkeroclarkb: thank you for answering my questions18:05
*** e0ne has quit IRC18:07
*** ralonsoh has quit IRC18:11
*** mtanino has joined #openstack-infra18:12
*** marst has joined #openstack-infra18:12
*** beslemon_ has quit IRC18:12
*** armax has quit IRC18:13
clarkbbkero: the tricky thing we were trying to workaround here was not change the log format for any single node jobs and have the primary (eg single node) be the same everywhere18:14
clarkbwhich is why the primary is implicit in the log dir18:14
clarkbbecuase it was that way for many years and I didn't want to chagne it on everyoen18:14
bkeroRight, that makes sense. subnodes as a first-level subdir are clear and should allow backwards compatibility18:14
*** gongysh has quit IRC18:15
*** arxcruz has joined #openstack-infra18:16
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/infra-specs master: Zuulv3 Executor Security Enhancement  https://review.openstack.org/44449518:16
*** tosky has joined #openstack-infra18:18
*** MasterOfBugs has quit IRC18:18
openstackgerritMerged openstack-infra/shade master: Add list_availability_zone_names method  https://review.openstack.org/45033218:20
*** rbrndt has joined #openstack-infra18:21
*** pvaneck has joined #openstack-infra18:21
*** armax has joined #openstack-infra18:22
*** baoli_ has joined #openstack-infra18:24
*** baoli has quit IRC18:25
*** e0ne has joined #openstack-infra18:27
*** hasharAway is now known as hashar18:27
*** e0ne has quit IRC18:28
*** dhajare has joined #openstack-infra18:30
*** dhajare has quit IRC18:30
*** d0ugal has quit IRC18:31
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Update nodepool config syntax  https://review.openstack.org/44881418:33
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Add a test for multiple provider pools  https://review.openstack.org/45018318:33
*** Goneri has quit IRC18:34
*** ociuhandu has joined #openstack-infra18:35
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove api-timeout and provider.image-type  https://review.openstack.org/44934218:35
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970518:35
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935418:36
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Update docs for configuration syntax change  https://review.openstack.org/44933918:36
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973718:36
openstackgerritJames E. Blair proposed openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978118:36
*** yamahata has quit IRC18:36
*** eventingmonkey has quit IRC18:36
*** alexchadin has joined #openstack-infra18:38
*** jerryz has joined #openstack-infra18:38
clarkbI've been asked to update our https://github.com/openstack 's profile pic to use the new 2d logo18:39
*** arxcruz has quit IRC18:39
clarkbany oppotisiton to me just uploading a new image to the profile?18:39
*** ociuhandu has quit IRC18:40
mat128clarkb: go ahead18:41
*** armax has quit IRC18:41
mat128I don't think it changes too often that we have to script / source control something for it18:41
*** eventingmonkey has joined #openstack-infra18:42
jerryzhi, everyone, https://review.openstack.org/#/c/450048/ is making our ci fail because CI wont pass the ping check and http check against mirrors18:43
jerryzhttps://github.com/openstack-infra/devstack-gate/blob/master/playbooks/roles/network_sanity_check/tasks/main.yaml#L2518:43
*** ym200 has quit IRC18:44
jerryzthis change the behavior of the previous bash checks, which check only when the variables of cloud is set by nodepool18:44
openstackgerritPaul Belanger proposed openstack-infra/project-config master: New zuulv3 syntax for nodepoolv3.yaml  https://review.openstack.org/45041618:44
*** cody-somerville has joined #openstack-infra18:45
*** cody-somerville has quit IRC18:45
*** cody-somerville has joined #openstack-infra18:45
clarkbmat128: ya its not something that we have botthered to automate. Just wanted to make sure people are aware I its a thing and that I will do it unless there is reason not to :)18:45
*** bswartz has quit IRC18:47
*** d0ugal has joined #openstack-infra18:47
pabelangerjerryz: mind posting a log?18:47
*** bswartz has joined #openstack-infra18:48
jerryzhttp://paste.openstack.org/show/604362/ pabelanger18:48
jerryzpabelanger: the setup host step has been failing since the migration from bash to ansible playbook due to lack of None check18:49
pabelangerworking on a patch18:49
jerryzand the fail on early failure change today just failed the ci altogether18:50
*** eroux has joined #openstack-infra18:51
jerryzpabelanger: thanks18:51
*** toidiu has quit IRC18:51
*** e0ne has joined #openstack-infra18:51
*** trown|compassing is now known as trown18:53
clarkbjerryz: and this is third party ci?18:53
jerryzclarkb: yes. because we don't have mirrors for our own cloud.18:54
openstackgerritPaul Belanger proposed openstack-infra/devstack-gate master: Only ping check NODEPOOL_MIRROR_HOST if found  https://review.openstack.org/45041818:54
pabelangerjerryz: clarkb: ^is how we did it before18:54
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add OSC functional tips job to osc-lib  https://review.openstack.org/45041918:55
*** eroux has quit IRC18:55
*** dizquierdo has joined #openstack-infra18:55
openstackgerritMonty Taylor proposed openstack-infra/shade master: Remove python-heatclient and replace with REST  https://review.openstack.org/45031718:56
openstackgerritMonty Taylor proposed openstack-infra/shade master: Replace heatclient testing with requests_mock  https://review.openstack.org/45026118:56
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add normalization for heat stacks  https://review.openstack.org/45026018:56
*** e0ne has quit IRC18:56
*** toidiu has joined #openstack-infra18:57
*** ym200 has joined #openstack-infra18:58
openstackgerritBen Swartzlander proposed openstack-infra/devstack-gate master: Don't fail ping check for pypi mirror on nonstandard port  https://review.openstack.org/45042018:58
jerryzpabelanger: but the /etc/nodepool/provider file does exist, just that the mirror url formed by the variables doesn't make sense in our cloud.18:58
*** amotoki has joined #openstack-infra19:00
*** beekneemech is now known as bnemec19:00
pabelangerk19:01
*** yamahata has joined #openstack-infra19:01
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add OSC functional tips job to osc-lib and os-client-config  https://review.openstack.org/45041919:02
pabelangerjerryz: what does your /etc/nodepool/provider look like19:02
jerryzpabelanger: it is in the paste file19:02
pabelangerokay, I see why it didn't fail before19:03
clarkbjerryz: do you use nodepool?19:04
clarkbjust wondering if the proposed fix would fix it19:04
jerryzclarkb: yes19:04
clarkbpabelanger: jerryz ya so I don't think the proposed fix would fix it19:05
*** amotoki has quit IRC19:05
jerryzclarkb: is the /etc/nodepool/provider file generated from an element?19:05
pabelangerclarkb: right, fixing now19:05
clarkbbecause the nodepool info will be there19:05
pabelangerNODEPOOL_REGION is empty19:05
clarkbjerryz: its written by nodepool after the instance is booted so you will have it19:05
pabelangerwhich we check before19:05
pabelangernow, we don't19:05
clarkbpabelanger: but even then if you don't have a mirror then it will fail19:05
fungiproject-config-core reviewers: random-ish question from a conference call i'm on... would any of you be interested in doing an example change review on camera in a corner somewhere at the boston summit?19:05
clarkbpabelanger: jerryz we may just want to make that an advisory thing and return true regardless of status?19:06
*** ym200 has quit IRC19:06
clarkbwill AJaeger be there? AJaeger is the project-config master reviweer19:06
pabelangerI'd be okay with that19:06
jeblairfungi: what's the goal?  illustrate how to make a change to project-config, or how to review a change or...?19:07
fungigeneral, openstack-wide, trying to mystify the processes seasoned reviewers follow in hopes of encouraging newcomers to participate more in the process19:07
jeblairfungi: demistify? :)19:08
pabelangermaybe? do I need a haircut :)19:08
jeblairer, demystify...19:08
jeblairor dehumidify19:08
clarkbpabelanger: I need one :P19:08
fungitrying to come up with options to grow general leadership within the community (a takeaway from one of the concerns raised at the joint bod/tc/us meeting a couple weeks ago)19:08
fungijeblair: demistify, yes. my fingeers fail me19:08
clarkb#status log clarkb updated https://github.com/openstack profile pic with new image of new openstack logo19:09
fungiclarkb: wow, that's dedication there19:09
*** rlandy is now known as rlandy|brb19:09
clarkbI didn't want anyone to freak out over the new image without a paper trail :)19:09
clarkb(I was asked to do it by foundation as they are trying to get things moved over, we should probably ask for an image to use on review.o.o too)19:10
fungiclarkb: i have a zipfile of logo sizes.formats from when i fixed the wiki graphics if anyone needs those to root out old logos19:10
clarkbfungi: ooh that might be handy for doing gerrit19:10
fungiclarkb: if you want to pick that up, awesome. i had an item on my to do list to find and update random places we're still using the previous logo graphics19:11
*** jkilpatr has quit IRC19:11
fungibut as you can imagine, its priority has been relatively low19:11
clarkbya I want to focus on doing gerrit upgrade reviews this afternoon19:12
pabelangerif you want to add my name to list, I don't mind helping19:12
*** adrian_otto has joined #openstack-infra19:12
clarkbpabelanger: https://review.openstack.org/#/q/status:open+topic:gerrit-upgrade is gerrit upgrade reviews19:12
clarkbif thats the list you want to be added to :P19:12
fungipabelanger: awesome. i expect i will indirectly be receiving a request from myself in the near future to recruit some core reviewers to do videos of reviewing changes19:13
pabelanger:)19:13
clarkbpabelanger: however I think if you and mnaser could finish tracking down that glean issue with rax's two itnerfaces that would be more awesomer right now since its relatively high on the e-r fail list19:13
*** sambetts is now known as sambetts|afk19:13
*** isaacb has joined #openstack-infra19:14
*** panda|bbl is now known as panda19:14
jeblairfungi: add me to the list a couple slots down from the top if needed.  :)19:14
clarkbpabelanger: I'm happy to help on the glean thing too and may poke at trying to make those file writes more atomic19:14
fungijeblair: can do!19:14
pabelangerclarkb: okay, let me focus on glean19:15
*** erlon has quit IRC19:15
fungijeblair: i was pushing to get some nova reviewers targeted, but there was a concern raised that we also want some less daunting examples (i don't know that what we review is any less daunting, but i'm willing to pretend)19:15
*** florianf has quit IRC19:15
*** isaacb has quit IRC19:17
*** isaacb has joined #openstack-infra19:17
*** isaacb has quit IRC19:18
*** florianf has joined #openstack-infra19:18
pabelangerclarkb: mnaser: https://review.openstack.org/#/c/257230/ seems like it might be better just to setup a dependency with systemd, and stop having glean to it directly19:19
jeblairfungi: yeah, i don't know where to go with that.  :)19:19
jeblairfungi: also, put me on camera if you want a monologue on "style" reviews.  :)19:19
clarkbfungi: mordred for /etc/network/interfaces do the filenames matter there? eg can I rwite to /etc/networking/interfaces/foo.glean_tmp and mv it to /etc/network/interfances/foo when done to get an atomic rename?19:19
clarkbor will the .glean_tmp file be picked up an interpreted as its being written/19:20
fungijeblair: oh, that would be awesome19:20
jerryzclarkb: i am ok with that too, since pip mirror check already check the health of the mirror server if a pip mirror is configured19:20
fungi"whitespace and you: a diatribe on triviality"19:20
*** ym200 has joined #openstack-infra19:21
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Update docs for configuration syntax change  https://review.openstack.org/44933919:21
mordredclarkb: I do not know19:21
mordredclarkb: like, I don't think the names matter19:21
mordredclarkb: but I do not know if something is watching that dir19:21
clarkbmordred: ya I think for debuntu /etc/network/interfaces it doesn't actually matter19:22
fungiclarkb: tmpfiles aren't an option i guess?19:22
clarkbso finding a place to write on the same fs is trickier there19:22
fungioh, atomic19:22
*** jkilpatr has joined #openstack-infra19:22
clarkbfungi: well tmpfiles may not be on the same fs so rename isn't always going to be atomic19:22
fungiyeah, that19:22
fungirealized after i suggested it19:22
fungidebian's file-per-interface equivalent is /etc/network/interfaces.d/*19:23
fungifor the record19:23
*** samueldmq has quit IRC19:23
*** samueldmq has joined #openstack-infra19:24
clarkboh right looks like glean writes them to interfaces.d/eth0.cfg etc19:24
clarkbbut I don't think the filename or extension actually matters19:24
pabelangerclarkb: http://logs.openstack.org/09/446609/2/check/gate-kolla-dsvm-build-centos-source-centos-7/c29fa62/logs/syslog.txt.gz#_Mar_19_16_02_2019:24
pabelangerthat is the actually error19:24
*** arxcruz has joined #openstack-infra19:24
pabelangerERROR:glean:Error enabling network.service19:25
pabelangerfailed to make symlink /etc/rc3.d/S10network: File exists19:25
pabelangerI think the right fix, is to have glean stop calling systemctl network.server start19:25
pabelangerand setup a proper dependency in systemd.service file19:25
clarkboh ya thats slightly different than what I thought was happening19:25
clarkbpabelanger: what is calling chkconfig? quick grep doenst' show it in glean or simple init19:26
*** kzaitsev_mb has joined #openstack-infra19:26
pabelangerclarkb: I think it is centos magic19:26
clarkboh wiat I see it19:27
*** rbuzatu has quit IRC19:27
*** mnencia has quit IRC19:27
clarkbnetwork.service is not a real service so it gets redirected in systemd19:27
clarkbsystemd magic19:27
pabelangeryes19:27
clarkbI may have to boot a centos machine19:27
*** rbuzatu has joined #openstack-infra19:27
pabelangerya, doing that now19:27
*** mwhahaha has quit IRC19:27
*** rbuzatu_ has joined #openstack-infra19:28
openstackgerritMonty Taylor proposed openstack-infra/shade master: Remove python-heatclient and replace with REST  https://review.openstack.org/45031719:29
openstackgerritMonty Taylor proposed openstack-infra/shade master: Replace heatclient testing with requests_mock  https://review.openstack.org/45026119:29
*** jordanP has joined #openstack-infra19:29
*** mwhahaha has joined #openstack-infra19:29
*** mnencia has joined #openstack-infra19:29
*** rbuzatu__ has joined #openstack-infra19:29
*** rbuzat___ has joined #openstack-infra19:31
clarkbpabelanger: /etc/init.d/network is the thing actually running. Its not a unit (hence the not a native service message)19:31
clarkbthats interesting19:31
*** rbuzatu has quit IRC19:31
clarkband its trying to make a symlink for /etc/rc3.d/S10network to that service19:32
pabelangerclarkb: maybe we update simple-init element to make sure it is started19:32
*** baoli_ has quit IRC19:32
clarkbthis is a fun smashing together of sysv and systemd19:32
pabelangerglean should then had the proper dependency for systemd19:32
*** rbuzatu_ has quit IRC19:32
*** beslemon has joined #openstack-infra19:32
pabelangerthat's basically what we did for SSHd19:32
pabelangerremoved glean from touching19:33
clarkbpabelanger: I think the problem here is that its enabling the service more than once19:33
pabelangeryup19:33
clarkbpabelanger: so the second enable tries to make the symlink but its already there19:33
pabelangerOr they run at the same time, confusing each other19:33
clarkbpabelanger: you are saying have simple-init enable the service at build time?19:33
clarkbso the symlink is there and we don't have to do it at boot?19:33
pabelangerreading https://review.openstack.org/#/c/257230/ it seems to imply networking might now be on disk19:34
pabelangerthat is why glean started it19:34
*** rbuzatu__ has quit IRC19:34
*** rbuzat___ has quit IRC19:35
clarkbpabelanger: that says depending on how you build things you might not get a network service enabled so its enabling it at boot19:35
*** kzaitsev_mb has quit IRC19:35
clarkbbut I think we could enable it at image build time19:36
clarkband then avoid the race entirely19:36
clarkbmaybe we can get ianw to weigh in as he wrote the change that did the boot time enabkle19:36
clarkbpabelanger: the thing I want to etst is whether or not enabling the network.service on a steady stated post boot centos7 host is an error19:36
pabelangerYes, we should enable for sure. Then update glean to only enable if missing19:37
clarkbor if its only an erorr during a race19:37
clarkbbecause this could get tricky if its always a race to get the code updated where it doesn't break a bunch of people suddenly ;)19:37
clarkbI just ran it on a random host and it worked fine19:38
clarkbso I think its ok in steady state and must be a race19:38
pabelangerjust tried: sudo systemctl start network.service works as expected19:38
pabelangerit was already started too19:38
clarkbyup same here19:39
clarkbthats good it simplifies unwinding this19:39
clarkbI think we just enable it in simple-init and stop having glean do it at boot19:39
*** baoli has joined #openstack-infra19:39
clarkbbut lets get ianw to tell us if thats a good idea too19:40
pabelangerWe could make glean nicer, and 'systemctl status network.service' first19:40
pabelangerto see if it is running or not19:40
pabelangersure, I'll get a DIB patch in place19:40
clarkbI tested this on a test node for kolla I think19:41
clarkbConfiguration file /etc/systemd/system/kubelet.service is marked executable. Please remove executable permission bits. Proceeding anyway.19:41
*** aimeeu__ has joined #openstack-infra19:41
clarkbConfiguration file /etc/systemd/system/kubelet.service.d/10-kubeadm.conf is marked executable. Please remove executable permission bits. Proceeding anyway.19:41
*** aimeeu has quit IRC19:41
*** khappone has quit IRC19:41
*** aimeeu__ is now known as aimeeu19:41
clarkbya gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv19:41
clarkbmnaser: ^ you may be interested in fixing those systemd issues too19:41
*** khappone has joined #openstack-infra19:42
*** ym200 has quit IRC19:43
*** rlandy|brb is now known as rlandy19:43
mnaserclarkb pabelanger i think the systemd forwading to chkconfig is only happening when you're doing systemctl enable network and not start19:44
*** annegentle has quit IRC19:44
clarkbmnaser: oh right its symlinking to enable it19:45
clarkbmnaser: pabelanger http://paste.openstack.org/show/604367/ seems to be ok19:45
mnaserhttps://github.com/openstack-infra/glean/blob/master/glean/cmd.py#L485-L49419:45
mnaseri think this is where it poops out19:45
mnaserwhich is called by this - https://github.com/openstack-infra/glean/blob/master/glean/cmd.py#L79319:46
clarkbmnaser: yup19:46
*** annegentle has joined #openstack-infra19:46
mnaserclarkb what if you run it more than once19:46
clarkbmnaser: pabelanger so I think what we want to do is remove that fromt glean and have simple-init enable it once in dib build19:46
clarkbmnaser: same thing19:46
clarkbmnaser: that actually did it on boot because its in rax on centos 7 machine19:46
mnaserso i guess the issue is happening when they both get called really quickly at the same time19:46
*** rhallisey has quit IRC19:46
clarkbthen I ran it a couple times in foreground19:46
clarkbit appears to be fine once boot has reached steady state19:47
*** sripriya has quit IRC19:47
mnaserdoes systemd enable automatically start a service19:47
mnasermaybe that was the original intention19:47
clarkbI don't think it does19:47
*** sripriya has joined #openstack-infra19:48
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: Have simple-init try to enable network.service  https://review.openstack.org/45043619:48
pabelangerclarkb: mnaser: ianw: ^ what I was thinking19:49
*** v1k0d3n has quit IRC19:49
mnasermaybe this is a naive assumption but isnt networking enabled by default19:49
clarkbpabelanger: ya just s/start/enable/ in commit message19:49
clarkbmnaser: according to the change that added this to glean it isn't19:50
mnasergpotcha19:50
clarkbmnaser: which is amazing on its own but not sure we can do much to change that19:50
mnaserpabelanger a concern comes out of this is that19:50
*** rfolco has quit IRC19:50
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: Have simple-init try to start network.service  https://review.openstack.org/45043619:50
mnaserdoes dib wipe all network config on build19:50
*** v1k0d3n has joined #openstack-infra19:51
mnaserbecause then the server might boot, grab a dhcp ip, glean runs, and then we got a weird messy state19:51
*** tonytan4ever has quit IRC19:51
mnaserwith glean enabling it you know you're working on the basis of a clean slate19:51
clarkbmnaser: simple-init wipes it out19:51
*** florianf has quit IRC19:51
clarkbso the auto dhcp defaults are removed and we let glean figure that bit out at run time19:51
mnaserok cool!19:52
clarkbmnaser: that was anotehr thing that broke the multinic setups in rax because we only did that for one network interface initially19:52
clarkband then glean saw the second as already configured and ignored it19:52
pabelangeractually, do we want systemctl start, or systemctl enable?19:53
clarkbpabelanger: enable19:53
mnaser^19:53
pabelangerk19:53
*** tonytan4ever has joined #openstack-infra19:53
pabelangerlet me fix patch19:53
clarkbpabelanger: if you are able to quickly test that dib build locally then check that /etc/rc3.d/S10network is a symlink to /etc/init.d/network then I think that is what we want19:54
clarkb(I can test it too just have to boot my dib build VM)19:54
*** rfolco has joined #openstack-infra19:54
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: Have simple-init try to enable network.service  https://review.openstack.org/45043619:54
pabelangerclarkb: do you mind testing? need to step away for 20min19:54
mnaser"the joy of building images"19:54
pabelangeror I can do it when I get back19:54
clarkbpabelanger: ya I can give it a go19:55
pabelangercool19:55
pabelangerglean dsvm job should also test this19:55
clarkbbut its a change to dib19:55
clarkbdo we have nodepool src jobs for centos 7 against dib too?19:56
*** dharinic- has quit IRC19:56
*** florianf has joined #openstack-infra19:58
clarkbok my local build is running19:58
clarkbmnaser: its unfortunate that we can't just dhcp everywhere because then this is entirely a non issue20:00
mnaserclarkb multinic at rackspace is for what exactly?20:01
*** baoli has quit IRC20:02
*** HeOS has joined #openstack-infra20:02
clarkbmnaser: they give you a public interface with internet address and private interface with free bw for internal talking20:02
clarkbmnaser: getting it to work there is more for completeness and consistency with other clouds that do the private network space with floating IPs thing20:02
*** baoli has joined #openstack-infra20:02
mnasergotcha20:02
*** annegentle has quit IRC20:02
*** alexchadin has quit IRC20:03
clarkbmnaser: we use the "private" interfaces on all the clouds for running our overlay networks in tests because we have had problems running that stuff via the NAT of some public IPs20:03
clarkbits likely we can further debug the reasons why public IPs didn't work for that but currently its easier to just make private IPs do it20:03
mnaseri can imagine that's introduced some more fun problems with overlay in overlay, heh20:04
clarkbmnaser: I think part of it is vxlan is udp and fireawlls do silly things to make udp stateful20:05
mnasercan we get therapy pets @ the summit for all those who have to deal with fixing overlay network issues20:05
mnaser:P20:06
clarkbmnaser: I can bring therapy whiskey20:06
mnaser:D20:07
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix typo in cloud number  https://review.openstack.org/45044220:09
*** markvoelker has joined #openstack-infra20:09
*** tjones has joined #openstack-infra20:10
*** dane-fichter has joined #openstack-infra20:11
pabelangerclarkb: ya, we have tests in diskimage-builder now that build centos-7 and try to boot it20:11
pabelangerso far, it has been working well20:11
clarkbcool, I have an image built currently working to mount the qcow2 and inspect fs20:11
*** rbuzatu has joined #openstack-infra20:12
*** xarses has quit IRC20:12
clarkbhttp://paste.openstack.org/show/604373/ lgtm20:12
clarkband yes I called my build box woocloud20:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Correct availability-zones documentation.  https://review.openstack.org/44914720:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Remove refs to removed nodepool commands  https://review.openstack.org/44915220:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Remove cron references  https://review.openstack.org/44914020:13
*** jamielennox is now known as jamielennox|away20:13
clarkbwe may not even need to change glean with that in place20:14
clarkband let glean do its best if it is installed without the network service being enabled20:14
*** rbuzatu has quit IRC20:16
*** baoli has quit IRC20:17
pabelangerYa, I am happy to try this first20:17
*** xarses has joined #openstack-infra20:18
pabelangerI'll poke myself in the eyes more with systemd and debian-jessie tomorrow20:18
*** andreww has joined #openstack-infra20:19
*** andreww has quit IRC20:20
*** andreww has joined #openstack-infra20:20
*** markvoelker has quit IRC20:22
*** xarses has quit IRC20:23
*** baoli has joined #openstack-infra20:23
*** jamielennox|away is now known as jamielennox20:24
*** matrohon has joined #openstack-infra20:24
jheskethMorning20:24
*** Yogi1_ has quit IRC20:26
mudpuppyclarkb, pabelanger: Just checking in and seeing if your all good. We have kicked a few people who were abusing networking resources today.20:26
clarkbmudpuppy: we might have to look at the aggregate data in a day or two just to be sure20:27
mudpuppyok20:27
clarkbmudpuppy: also I'm afraid the next time this comes up we will be the people abusing resources :P20:27
jeblairi was going to say.... :)20:27
mudpuppymost likely, AUP violators20:27
clarkbmudpuppy: out of curiousity how are we on bw? I'm guessing that our mirrors help that quite a bit20:27
openstackgerritMonty Taylor proposed openstack-infra/shade master: Remove python-heatclient and replace with REST  https://review.openstack.org/45031720:28
clarkbah so not really bw necessarily20:28
openstackgerritMonty Taylor proposed openstack-infra/shade master: Replace heatclient testing with requests_mock  https://review.openstack.org/45026120:28
mudpuppyclarkb: So far so good. Your not the issue :) It was a few instances that were doing some bad tcp things20:28
pabelangermudpuppy: clarkb: a quick look at logstash for my queue, I improvement20:28
clarkbpabelanger: I'm going to attempt booting this image I built in a few but locally it will be dhcp without config drive20:29
clarkbso test isn't too legit20:29
*** Goneri has joined #openstack-infra20:29
*** gouthamr has quit IRC20:29
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove api-timeout and provider.image-type  https://review.openstack.org/44934220:30
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove deprecated networks syntax  https://review.openstack.org/44935420:30
pabelangerclarkb: ack20:33
pabelangerI can see nodepool dsvm job booted centos-720:33
clarkbpabelanger: I think thats dhcp too but with config drive20:33
clarkbso slightly more legit20:33
*** john-davidge has quit IRC20:34
openstackgerritMerged openstack-infra/shade master: Add normalization for heat stacks  https://review.openstack.org/45026020:34
ianwpabelanger: seems like it will work ... then again we've hit quite a few different things that seemed like they would work in this path :)20:36
clarkbit actually doesn't appear to have dhcp'd for me20:37
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Refactor out Changeish  https://review.openstack.org/44891320:37
clarkbwondering if we need a config drive to make glean do the right thing on red hat20:37
clarkboh wait there it is20:38
clarkbit called itself localhost huh20:38
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove NullChange  https://review.openstack.org/44993520:38
pabelangermy only concern is we have the dependency on network.service setup properly, to run after glean20:38
pabelangerif before, I think we might have issues?20:38
clarkbpabelanger: all this is doing is enabling the unit not starting it20:38
clarkbI get the same chkconfig message but then no error so I think this is fine20:39
*** ihrachys has quit IRC20:39
clarkbpabelanger: then ordering is dependent on what we set up as deps in the glean units20:39
pabelangerright20:39
pabelangerjust need to make sure we have that right20:39
clarkbat least on my little test host it loosk fine, but its not doing rax style nic config20:39
*** annegentle has joined #openstack-infra20:39
pabelangerhttp://logs.openstack.org/36/450436/3/check/gate-dsvm-nodepool-redhat-src-nv/d7e9383/ was successful20:41
pabelangerthat booted centos-720:41
pabelangerand fedora20:41
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add OSC functional tips job to osc-lib and os-client-config  https://review.openstack.org/45041920:41
*** rbuzatu has joined #openstack-infra20:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Stop logging git repo rsync output  https://review.openstack.org/44875020:43
*** baoli has quit IRC20:43
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Correct availability-zones documentation.  https://review.openstack.org/44914720:44
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Remove refs to removed nodepool commands  https://review.openstack.org/44915220:44
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Docs: Remove cron references  https://review.openstack.org/44914020:44
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Exercise statsd in tests and fix  https://review.openstack.org/44973720:45
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove ipv6-preferred and rely on interface_ip  https://review.openstack.org/44970520:45
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove mention of non-clouds.yaml from docs  https://review.openstack.org/44978120:45
clarkbheh someone just updated the jenkins bug for thread leaks on slaves20:46
*** hashar has quit IRC20:46
clarkbianw: pabelanger so I think we can add the dib change and leave glean as is so that glean has a built in fallback (but shouldn't race if simple-init does it at build time too)20:46
mordredclarkb: wow really? any new useful information?20:47
*** rockyg has joined #openstack-infra20:47
pabelangerclarkb: ianw: ++20:47
openstackgerritMerged openstack-infra/project-config master: New zuulv3 syntax for nodepoolv3.yaml  https://review.openstack.org/45041620:48
*** csomerville has joined #openstack-infra20:48
clarkbmordred: no20:48
clarkbmordred: components: remoting20:48
*** jcoufal has quit IRC20:48
clarkboh wait there is more ya they said "From what I see in the File Leak detector, it requires a fix on the Remoting side. The fix needs to be similar to JENKINS-37332 . BTW, it seems to be a standalone issue" too20:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove url_pattern config parameter  https://review.openstack.org/44716520:50
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Simplify the log url  https://review.openstack.org/43802820:50
ianwpabelanger: so i'm a little unclear from scrollback ... this is for kolla & multiple interfaces?20:50
clarkbianw: its for any test using the private network interface in rackspace20:51
*** cody-somerville has quit IRC20:51
*** baoli has joined #openstack-infra20:51
clarkbianw: since rackspace has two interfaces public and private what happens is glean configures the first (public) one and while it configures the second one that breaks due to /etc/rc3.d/S10network already existing20:51
clarkbianw: and then the test runs without a private interface configured20:51
pabelangerya, any multi nic centos system will have the race20:52
ianwah, right20:52
clarkbianw: on testing systemctl enable network.service you can run that enable command as much as you want in a steady state so must be a race of some sort during boot20:52
*** askb has joined #openstack-infra20:52
clarkbso by "preseeding" the symlink at build time we should avoid teh race entirely20:52
pabelangerglean could also be updated to only do systemctl enable for 1st interface20:52
ianwyeah, i'd agree it's just linking in the unit files20:52
pabelangerand skip any others20:53
*** eharney has quit IRC20:53
openstackgerritEric Harney proposed openstack-infra/project-config master: Enable Barbican for Cinder LIO job  https://review.openstack.org/44979920:54
clarkbpabelanger: I think thats more complicated20:54
clarkbhow do you know what is first in systemd?20:54
clarkbyou'd have to serialize a lot of the boot20:54
mordredclarkb: if only there was some sort of boot system with serialized operations20:55
clarkbmordred: well thats actually the problem here, centos isn't really systemd20:55
*** claudiub has quit IRC20:55
clarkbmordred: would be non issue if centos used systemd for network boot20:56
fungiif only they knew people at red hat who write that systemd stuff, they could ask how to use it20:56
pabelangerzing20:56
ianwi think it can be20:57
clarkbmordred: btw https://review.openstack.org/#/c/450297/ is stack to fix the config drive thing we found last week20:57
ianwit's glean that's not really systemd20:57
ianwif we want to rewrite it ...20:57
clarkbianw: the network service in centos is a bash script20:57
ianwfor network-manager, say20:57
clarkbor maybe bourne20:57
clarkbrather than being a systemd unit20:58
*** dprince has quit IRC20:58
pabelangerclarkb: yes, I think this is the reason why debian-jessie is failing20:58
pabelangerbecause debian is generating systemd things from legacy init.d20:58
*** burgerk_ has joined #openstack-infra20:58
clarkbmordred: looks like we will get ipv6_dhcp and ipv6_slaac as net types20:59
mordredclarkb: wow nice20:59
clarkbmordred: we should watch that then update glean once it merges to handle ipv6_slaac too20:59
*** rhallisey has joined #openstack-infra20:59
mordredwell - we could go ahead and update glean to handle it  - since that update would need to ignore it if it's not there21:00
mordredalthough we likely should not do that until the general approach is ok with people21:00
clarkbthats true, I am just slightyl worried it might not merge like that given the WIP prefix on it21:00
clarkbya that21:00
mordred++21:01
*** trown is now known as trown|outtypewww21:01
*** gouthamr has joined #openstack-infra21:01
ianwclarkb: yeah, i think if you ask the solution will be "use NetworkManager" because the networking scripts have all sorts of ordering/timing issues in the systemd world21:01
*** burgerk has quit IRC21:01
clarkb:/21:02
ianwwhich i'm not sure is much of a solution, i think it's trading one problem for another that might even be a bigger problem21:02
fungistrikes me as misleading naming since stateless dhcp6 relies on slaac (and yes, i followed the ml thread, but still, confusing)21:02
clarkbianw: yes that21:02
clarkbfungi: you should leave review comments ;)21:02
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: testing consistent repo with nova commit  https://review.openstack.org/45045521:02
*** baoli has quit IRC21:02
clarkbfungi: I think from oeprating system perspective you maybe care less?21:02
*** dimtruck is now known as zz_dimtruck21:03
fungis/ipv6_dhcp/dhcp6_stateful/ and i'd be less cranky21:03
*** burgerk_ has quit IRC21:03
clarkbtonyb_: are you awake yet? have you managed to dig into the libvirt crashes at all yet?21:03
clarkbfungi: I think ipv6_dhcp is already the thing though21:03
clarkbfungi: granted right now it doens't mean much bceause its what you get for vanilla slaac too21:04
fungiright, that's where it's confusing that ipv6_dhcp is seem as an opposite to ipv6_slaac21:04
fungier, seen21:04
clarkbianw: also does network manager understand metadata service/config drive?21:06
clarkbianw: seems like it would be really weird to get that working properly if not already there since its way more dynamic with networkmanager because laptops21:06
viksHi, I need some help on cinder CI, which is failing since yesterday. Logs at : http://52.35.51.88/40/450440/1/check/dsvm-veritas-hyperscale-cinder-driver/af95c6c/21:06
viksDo we need to do any changes in the CI environment?21:06
viksor is it getting fixed in some check-in that will affect and correct these failures...21:07
clarkbviks: the issue is at http://52.35.51.88/40/450440/1/check/dsvm-veritas-hyperscale-cinder-driver/af95c6c/logs/devstack-gate-setup-host.txt21:07
clarkbviks: its a side effect of us stopping jobs early if setup fails (we didn't in the past)21:07
clarkbviks: pabelanger and jerryz were looking at it earlier. I think we might make that ping check advisory and return success from it regardless of success or not21:08
pabelangerclarkb: viks: looks like ping_check again for nodepool_mirror21:08
clarkbpabelanger: ya21:08
*** eharney has joined #openstack-infra21:08
gouthamrpabelanger clarkb: we suffer from a similar issue with ping check... we've a pip cache, hence: https://review.openstack.org/#/c/450420/21:08
viksok21:09
clarkbgouthamr: that won't fix the problem for jerryz at least because there is no mirror, but that is another fix we should get in21:09
clarkbpabelanger: is there a change to make that not fail the job if mirror doesn't exist?21:10
openstackgerritPaul Belanger proposed openstack-infra/devstack-gate master: Ignore errors for nodepool mirror checks  https://review.openstack.org/45045621:10
pabelangerclarkb: ^21:10
gouthamrclarkb: +1 ... that's the first failure, i suppose our CI will fail nodepool mirror check right after even if https://review.openstack.org/#/c/450420/ is merged21:11
*** florianf has quit IRC21:11
jerryzclarkb: do you think skipping the mirror check is an option since pip conf check already checked ping and http of that mirror host21:11
pabelangerclarkb: we'll need to change that logic for zuulv3 too21:11
*** ccamacho has left #openstack-infra21:12
pabelangerso I am okay with ignore_errors for now21:12
clarkbjerryz: right tahts why its ok to let it soft fail, basically just log the issue then let the job fail when it tries to install21:12
gouthamr+121:12
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Re-enable test_stuck_job_cleanup  https://review.openstack.org/44678321:13
ianwclarkb: yeah, no idea ... i think the bigger issue also might be dealing with neutron and all it's magic with networkmanager turned on.  afaik they don't want it.21:13
tonyb_clarkb: Sorry no I haven't21:13
*** rbuzatu_ has joined #openstack-infra21:13
gouthamrpabelanger clarkb: would appreciate your review of https://review.openstack.org/#/c/450420/21:13
clarkbgouthamr: if you can rebase your fix onto pabelanger's that would be good as pabelanger's will solve the problem for jerryz and viks, then we can refine it for your specific case21:13
ianwfirewalld was also another problem causing point21:13
clarkbgouthamr: actually they may not conflict21:13
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Remove url_pattern config parameter  https://review.openstack.org/44716521:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Implement getSafeAttributes for other objects  https://review.openstack.org/45045921:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Make sql reporter score null when not set  https://review.openstack.org/45046021:14
*** aysyd has quit IRC21:14
clarkbianw: oh thats a good point, I hadn't even considered what would happen if you neutron with networkmanager running next to you21:14
clarkbcompeting dnsmasqs at the very least21:14
gouthamrclarkb: yep. thanks for the review.21:14
*** rbuzatu__ has joined #openstack-infra21:14
clarkbya they don't appear to conflict so no rebase needed21:14
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Make sql reporter score null when not set  https://review.openstack.org/45046021:15
*** dane-fichter has quit IRC21:16
*** rbuzatu has quit IRC21:16
*** rbuzat___ has joined #openstack-infra21:16
*** rbuzatu has joined #openstack-infra21:17
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Consume interface_ip from nodepool node  https://review.openstack.org/44970621:17
*** jamesdenton has quit IRC21:17
*** panda is now known as panda|zZ21:17
*** rbuzatu_ has quit IRC21:17
*** ldnunes has quit IRC21:17
clarkbok I have +2'd both cahnges. can another infra-root review https://review.openstack.org/#/c/450420/ and https://review.openstack.org/450456 to help fix third party CIs21:18
pabelanger+3 45042021:18
*** rbuzatu_ has joined #openstack-infra21:18
*** rbuzatu__ has quit IRC21:18
mordredpabelanger beat me to it21:18
gouthamrthanks guys!21:19
clarkbmordred: can you look at the other one, pabelanger is author so best not to have him approve if you canreview it21:19
*** ssbarnea has quit IRC21:19
*** rbuzatu__ has joined #openstack-infra21:19
*** ssbarnea has joined #openstack-infra21:20
*** ssbarnea has quit IRC21:20
*** rbuza____ has joined #openstack-infra21:21
*** mat128 has quit IRC21:21
*** rbuzat___ has quit IRC21:21
jheskethfungi: re Colleen's question to rename the spec: https://review.openstack.org/#/c/449933/, I believe that's the best option yeah? (Just dont' want to give wrong advice)21:21
*** rbuzatu has quit IRC21:21
*** ssbarnea has joined #openstack-infra21:21
jeblairclarkb: are you saying that we used to not fail in that case?21:22
clarkbjeblair: yes21:22
jheskethclarkb: +3'd 45045621:22
*** jordanP has quit IRC21:22
*** rbuzatu has joined #openstack-infra21:22
jheskethalthough jeblair, did you have an objection?21:22
clarkbjeblair: we ignored host setup failures until today when ianw's change to stop ignoring thoes failure and short circuit merged21:22
clarkbwhich was fine for us because we have mirrors but its not working for third party CI without mirrors21:22
*** matrohon has quit IRC21:23
*** rbuzatu_ has quit IRC21:23
*** rbuzatu_ has joined #openstack-infra21:23
*** rbuzatu__ has quit IRC21:24
fungijhesketh: cmurphy: i can see both sides of it. puppet_4_prelim_testing has no primary assignee though mentions mordred wrote some stuff. and the proposed puppet-4 does go a good deal further in scope21:24
fungithey have a lot in common though, so probably fine to combine them21:24
*** rbuzatu__ has joined #openstack-infra21:25
jheskethfungi: sure, the prelim one needs updating or even superseding, but I don't think we need both right?21:25
mordredit's also fair to assume whatever I broke is bong21:25
mordredgah21:25
jheskethfungi: so renaming would therefore be reasonable21:25
mordredit's also fair to assume whatever I wrote is bong21:25
fungijhesketh: yeah, rename or abandon the old spec in favor of the new one21:25
*** rbuza____ has quit IRC21:25
jheskethcool, thanks21:25
fungieither wfm21:25
fungii'll leave a review comment21:25
jheskethfungi: heh, I just did21:26
*** rbuzat___ has joined #openstack-infra21:26
*** rbuzatu has quit IRC21:27
fungiawesome21:27
*** rbuzatu has joined #openstack-infra21:27
*** dave-mccowan has quit IRC21:27
*** rbuzatu_ has quit IRC21:28
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Make sql reporter score null when not set  https://review.openstack.org/45046021:28
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement getSafeAttributes for other objects  https://review.openstack.org/45045921:28
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove url_pattern config parameter  https://review.openstack.org/44716521:28
*** rbuzatu_ has joined #openstack-infra21:29
*** rbuzatu__ has quit IRC21:29
mnaseri need to increase my buffer :<21:30
*** rbuzat___ has quit IRC21:30
*** rbuzatu has quit IRC21:31
*** rbuzatu_ has quit IRC21:33
fungiand/or have your client log to a file21:33
fungibut also, we have online logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/21:34
clarkbI once contributed to an oom on a shared irc client parking box that was up for like 3 years because we had set our buffers to be huge21:34
*** john-davidge has joined #openstack-infra21:34
clarkbso be careful :)21:34
mnaseri think eavesdrop is good enough21:35
fungimy client also locally logs all the channels i lurk in to disk. makes it easy for me to grep for things we talked about 5 years ago21:35
*** john-davidge has quit IRC21:39
*** csomerville has quit IRC21:39
mordredmnaser: ooh - you seem to be running designate v2 now21:39
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Make sql reporter score null when not set  https://review.openstack.org/45046021:41
clarkbzaro: ok rereviewed the gerrit deps changes21:42
clarkbzaro: I don't think we need the new one to flip the >, inline comment has details21:42
*** sshnaidm is now known as sshnaidm|off21:43
*** aeng has joined #openstack-infra21:45
*** ijw_ is now known as ijw21:46
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Catch and log url pattern formatting errors  https://review.openstack.org/45046821:47
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add OSC functional tips job to osc-lib and os-client-config  https://review.openstack.org/45041921:47
*** vhosakot has joined #openstack-infra21:48
*** vhosakot_ has quit IRC21:50
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes  https://review.openstack.org/44714221:50
*** rocky_g has joined #openstack-infra21:50
*** rockyg has quit IRC21:50
*** armax has joined #openstack-infra21:51
*** tonytan4ever has quit IRC21:51
*** esberglu_ has quit IRC21:51
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes  https://review.openstack.org/44714221:52
*** wolverineav has quit IRC21:52
clarkbzaro: and now whole topic is reviewed21:52
clarkbzaro: let me know if you have questions, and thanks21:52
openstackgerritMerged openstack-infra/shade master: Replace heatclient testing with requests_mock  https://review.openstack.org/45026121:52
*** Swami has quit IRC21:54
*** zz_dimtruck is now known as dimtruck21:56
pabelangerclarkb: fungi: do you mind: https://review.openstack.org/#/c/414640/22:00
pabelangerwork for gem mirror22:00
jeblairzuul meeting time in #openstack-meeting-alt22:00
*** vhosakot has quit IRC22:00
fungiooh, meetins22:00
*** amotoki has joined #openstack-infra22:02
*** thorst has quit IRC22:02
*** thorst has joined #openstack-infra22:03
openstackgerritKevin Fox proposed openstack-infra/project-config master: Kolla v4 support in Kolla-Kubernetes  https://review.openstack.org/45047122:03
*** chlong has quit IRC22:03
*** armax has quit IRC22:04
*** david-lyle has quit IRC22:04
*** esberglu has joined #openstack-infra22:05
*** david-lyle has joined #openstack-infra22:05
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Force deploy commands to timeout  https://review.openstack.org/45030222:06
*** thorst has quit IRC22:07
*** jkilpatr has quit IRC22:07
*** esberglu has quit IRC22:09
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Use shorter timeout for update step  https://review.openstack.org/44877822:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Force deploy commands to timeout  https://review.openstack.org/45030222:11
openstackgerritKevin Fox proposed openstack-infra/project-config master: Kolla v4 support and upgrades in Kolla-Kubernetes  https://review.openstack.org/45047122:11
clarkbpabelanger: I thought gems didn't work on afs?22:11
openstackgerritSam Yaple proposed openstack-infra/project-config master: [WIP] Add non-voting initial gate for LOCI  https://review.openstack.org/45047322:11
pabelangerclarkb: not yet! https://github.com/pabelanger/rubygems-mirror/commit/d004fe6e285e5d1126ba89927bb4a2554170acc622:11
pabelangerclarkb: going to bring it up at meeting tomorrow and see if we can fork, for now22:12
clarkbpabelanger: so do we want to merge this and have it attempt to write things to afs?22:12
*** amotoki has quit IRC22:12
SamYapleim looking for a bit of project-config help with a patchset. i dont quite follow project-config here. https://review.openstack.org/45047322:12
openstackgerritMerged openstack-infra/shade master: Remove python-heatclient and replace with REST  https://review.openstack.org/45031722:12
pabelangerclarkb: it won't write anything currently, because I'm holding the lock22:12
SamYaplebasically i want the tests to live in openstack/loci and be used in openstack/loci-* which ive seen other projects do22:12
openstackgerritKevin Fox proposed openstack-infra/project-config master: Kolla v4 support and upgrades in Kolla-Kubernetes  https://review.openstack.org/45047122:12
clarkbpabelanger: gotcha22:12
*** xyang1 has quit IRC22:13
clarkbSamYaple: the jobs themselves have to be in project-config.22:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack-infra/project-config master: jenkins: scripts: install-distro-packages: Handle remote bindep files  https://review.openstack.org/45047422:13
clarkbSamYaple: are you talking about the scripts/gate-setup.sh bits?22:15
SamYapleclarkb: right. so my limited understanding here is that would be in the openstack/loci-* repos22:16
SamYaplebut i would like to avoid duplicating that code22:16
clarkbSamYaple: yes as written you'd need that script in every repo22:16
SamYapleagreed, can i redo it to avoid that?22:16
clarkbthere are probably two different major options here. First is if this is an integration job just define it once and reuse it for all projects. Then always cloen and checkout the location of setup-gate.sh22:17
*** ssbarnea has quit IRC22:17
pabelangeryou'll need to setup a CLONEMAP for zuul-clone, then make sure openstack/loci22:17
*** toidiu has quit IRC22:17
clarkbthe second is continue to use a different job for each project but in addition to that always clone and checkout the location of setup-gate.sh22:17
clarkbya using clonemap is a good way to do the cloning in either case22:17
SamYaplepabelanger: yea im looking for something akin to how OSA does it i believe22:17
SamYapleok. i will attempt to figure that out22:18
pabelangerSamYaple: openstack-puppet-integration is another good one22:18
*** sdague has quit IRC22:18
SamYaplepabelanger: ok22:18
clarkbpabelanger: ok left some commeents but am +2. curious what the answers are to my uqestions on the gem change22:19
*** EricGonc_ has quit IRC22:20
*** rfolco has quit IRC22:20
*** jascott1_ has joined #openstack-infra22:20
pabelangerclarkb: left reply, but open to suggestions22:21
*** jascott1_ has quit IRC22:21
clarkbpabelanger: and responded22:23
mnasermordred yeah.  kinda.   it's a rough upgrade and we're thinking of redeploying it and moving everyone over22:23
mnaserit was initially deployed back when hp first started it out so, it has a lot of weird things going on22:24
mordredmnaser: I'm just thrilled because I'm working on replacing all of the client libs in shade with pure rest calls - and that's harder when I don't have a public cloud to test stuff out on for sanity22:24
mnaseroh yeah that must make life nice and easy22:24
mnaserour entire control plane is on newton now22:24
*** Adri2000 has quit IRC22:29
*** rbuzatu has joined #openstack-infra22:30
*** jascott1_ has joined #openstack-infra22:31
*** jkilpatr has joined #openstack-infra22:35
*** Goneri has quit IRC22:37
*** eharney has quit IRC22:39
*** beslemon has quit IRC22:39
*** Julien-zte has joined #openstack-infra22:41
clarkbmordred: you mean the apis that devstack present are not representative? >_>22:44
*** rbuzatu has quit IRC22:46
*** armax has joined #openstack-infra22:46
*** rbuzatu has joined #openstack-infra22:46
mordredclarkb: no - those are _great_ and very useful for the functional tests22:49
mordredclarkb: but I like to poke around at things with the repl22:49
mordredclarkb: and when mnaser runs a cloud for me, I don't have to spin one up22:49
mordredmnaser: yay newton!22:49
*** thorst has joined #openstack-infra22:50
mnaser:)22:51
*** rbrndt has quit IRC22:52
*** markvoelker has joined #openstack-infra22:52
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DNM - test rever zaqar / oooclient  https://review.openstack.org/45048322:53
*** thorst has quit IRC22:53
*** Sihan has joined #openstack-infra22:53
SihanHi Guys, does zuul support trigger pipeline in jenkins? Currently it is working fine to trigger project job.22:55
clarkbSihan: zuul doesn't support any of that directly instead it triggers via the gearman plugin. So whatever the gearman plugin can trigger should work22:57
*** Adri2000 has joined #openstack-infra22:57
*** Adri2000 has quit IRC22:57
*** Adri2000 has joined #openstack-infra22:57
clarkbmordred: speaking of forum and user of apis hat, did you want to do the api improvements session with me if accepted?22:59
*** rfolco has joined #openstack-infra22:59
mordredclarkb: would love to23:00
clarkbI figured :)23:00
clarkbwould be good23:00
*** rfolco has quit IRC23:00
mordredinfra-root: I would like to release shade 1.18.0 to pick up the new az list method for zuul, the removal of magnumclient and heatclient and a few bugfixes - any concerns?23:00
fungimordred: sounds like goodness to me23:01
pabelangermordred: just that I need to do another RPM release :)23:01
*** rocky_g has quit IRC23:01
mordredpabelanger: the hits keep on coming :)23:01
*** Sihan has quit IRC23:03
clarkbmordred: the integration job is happy now that we got that glean change released?23:03
clarkbif so ++ but if not we should figure that out in case shade has regressed23:04
*** gordc has quit IRC23:04
*** marst has quit IRC23:04
clarkb#status log after ES cluster recovered after restarting master the logstash workers had to be restarted as well23:05
mordredclarkb: yup. integration jobs are all green23:07
*** rfolco has joined #openstack-infra23:08
*** rfolco has quit IRC23:09
*** tosky has quit IRC23:09
clarkbianw: pabelanger before pabelanger calls it a day, thinking about https://review.openstack.org/#/c/450436/3 and andreas' comment is centos the distro name for rhel builds too?23:09
clarkband if so who else can we get to review that and maybe get a dib release sooner than later?23:09
openstackgerritSam Yaple proposed openstack-infra/project-config master: [WIP] Add non-voting initial gate for LOCI  https://review.openstack.org/45047323:10
ianwclarkb: actually, that's a good point, we should =~ match there23:11
openstackgerritMerged openstack-dev/pbr master: Remove testr entry point  https://review.openstack.org/42237923:12
SamYapleis there any reason for a new job to be using a trusty node? im not sure how these nodes are scheduled and if using only xenail will make it take longer to schedule23:13
clarkbSamYaple: the only reason is if that job is running against old code not expected to work on new distro release23:13
mordredSamYaple: no new jobs should use trusty23:13
mordredyah23:13
clarkbeg testing mitaka23:14
*** andreww has quit IRC23:14
mordredinfra-root: ok. tag for 1.18.0 pushed23:15
*** annegentle has quit IRC23:16
*** annegentle has joined #openstack-infra23:16
jeblairmordred: thanks23:17
*** marst has joined #openstack-infra23:18
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Have simple-init try to enable network.service  https://review.openstack.org/45043623:19
ianwpabelanger: ^ i took the liberty of updating23:19
*** signed8bit has joined #openstack-infra23:21
*** annegentle has quit IRC23:21
SamYaplemordred: you mean xenial? right?23:23
clarkbSamYaple: if there was a comma there then yes xenial. Without teh comma after no I think trusty is right >_>23:24
SamYapleclarkb: i was just looking at the jobs that have selectors for both nodes23:24
*** thorst has joined #openstack-infra23:24
SamYaplehaha. grammer23:24
*** jaypipes has quit IRC23:24
SamYapleit stricks again23:24
SamYaplei follow23:24
SamYaplestrikes*23:24
*** benj_ has joined #openstack-infra23:25
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Have simple-init try to enable network.service  https://review.openstack.org/45043623:26
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Have simple-init enable network.service  https://review.openstack.org/45043623:29
*** Julien-zte has quit IRC23:29
*** mattmceuen has quit IRC23:30
*** s-shiono has joined #openstack-infra23:32
*** s-shiono_ has joined #openstack-infra23:37
*** s-shiono has quit IRC23:38
*** dizquierdo has quit IRC23:39
*** thorst has quit IRC23:39
openstackgerritMerged openstack-infra/jenkins-job-builder master: add two new options to Log Parser Plugin  https://review.openstack.org/44550923:41
*** signed8bit is now known as signed8bit_Zzz23:42
*** annegentle has joined #openstack-infra23:42
openstackgerritMerged openstack-infra/jenkins-job-builder master: Add note regarding a bug with !include-raw-escape  https://review.openstack.org/44677323:43
SamYapleok clarkb, if the job can run on either centos-7 or ubuntu-xenial, i can put them both in this list, correct?23:45
SamYapleor is the preference still ubuntu-xenial23:45
openstackgerritSam Yaple proposed openstack-infra/project-config master: Add non-voting initial gate for LOCI  https://review.openstack.org/45047323:48
*** signed8bit_Zzz is now known as signed8bit23:49
*** annegentle has quit IRC23:49
*** EricGonczer_ has joined #openstack-infra23:53
clarkbSamYaple: you can do both23:55
SamYapleclarkb: ok23:55
openstackgerritKevin Fox proposed openstack-infra/project-config master: Kolla v4 support and upgrades in Kolla-Kubernetes  https://review.openstack.org/45047123:57
clarkbSamYaple: the preference there is within a distro release (so that we don't needlessly try to keep new code running on old distros)23:57
clarkbSamYaple: it would represetn a significant amount of effort both on infras side keeping things going and on development side accomodating old bugs/lack of features and so on23:58
SamYapleclarkb: so centos-8 comes out, switch. and ubuntu-18.04 comes out... switch. yes?23:58
clarkbSamYaple: yup23:58
SamYaplecool. that should be really easy23:58
SamYaplei can dig it23:58
*** dimtruck is now known as zz_dimtruck23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!