Monday, 2017-01-23

*** thorst_ has joined #openstack-infra00:03
*** yujunz has joined #openstack-infra00:04
*** jamielennox|away is now known as jamielennox00:05
*** thorst_ has quit IRC00:08
*** gildub has joined #openstack-infra00:12
*** sdake has quit IRC00:12
*** tphummel has quit IRC00:14
*** voldz1tic3n has joined #openstack-infra00:15
*** yujunz has quit IRC00:21
*** jamesdenton has joined #openstack-infra00:23
*** rbuzatu has joined #openstack-infra00:24
*** gouthamr has quit IRC00:24
*** camunoz has quit IRC00:28
*** rbuzatu has quit IRC00:28
*** ssbarnea has quit IRC00:31
*** gouthamr has joined #openstack-infra00:32
*** sdake has joined #openstack-infra00:34
*** ihrachys has quit IRC00:38
*** kzaitsev_mb has joined #openstack-infra00:42
*** yanyanhu has joined #openstack-infra00:42
*** mtanino has quit IRC00:43
*** camunoz has joined #openstack-infra00:45
*** stakeda has joined #openstack-infra00:49
*** thorst_ has joined #openstack-infra00:50
*** claudiub has quit IRC00:53
*** thorst_ has quit IRC00:53
*** wolverineav has joined #openstack-infra00:58
*** csomerville has joined #openstack-infra00:58
*** jamesdenton has quit IRC01:00
*** wolverineav has quit IRC01:03
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update platform support to describe stable testing  https://review.openstack.org/41820401:04
*** camunoz has quit IRC01:05
*** gildub has quit IRC01:05
*** jamesdenton has joined #openstack-infra01:06
*** ijw has joined #openstack-infra01:09
*** hurgleburgler has joined #openstack-infra01:17
*** liujiong has joined #openstack-infra01:19
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Add launchpadlib and simplejson as requirements  https://review.openstack.org/42387601:20
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Add imported tasks to master branch of relevant project  https://review.openstack.org/42387701:20
*** hurgleburgler has quit IRC01:23
*** rbuzatu has joined #openstack-infra01:25
*** rbuzatu has quit IRC01:29
*** wolverineav has joined #openstack-infra01:31
*** liujiong has quit IRC01:32
*** liujiong has joined #openstack-infra01:33
*** wolverineav has quit IRC01:35
*** jamesdenton has quit IRC01:45
*** cody-somerville has joined #openstack-infra01:54
*** thorst_ has joined #openstack-infra01:55
*** csomerville has quit IRC01:56
*** thorst_ has quit IRC01:56
*** ijw_ has joined #openstack-infra01:56
*** ijw has quit IRC01:59
*** rbuzatu has joined #openstack-infra02:03
*** baoli has quit IRC02:05
*** yujunz has joined #openstack-infra02:07
*** rbuzatu has quit IRC02:07
*** yujunz has quit IRC02:08
*** yujunz has joined #openstack-infra02:09
*** yujunz is now known as yujunz[away]02:10
*** yujunz[away] is now known as yujunz02:10
*** yujunz is now known as yujunz[away]02:10
*** yujunz[away] is now known as yujunz02:10
*** yujunz is now known as yujunz[away]02:11
*** yujunz[away] is now known as yujunz02:11
*** yujunz is now known as yujunz[away]02:11
*** yujunz[away] is now known as yujunz02:11
*** yujunz is now known as yujunz[away]02:11
*** yujunz[away] has quit IRC02:12
*** kzaitsev_mb has quit IRC02:12
*** camunoz has joined #openstack-infra02:13
*** yujunz has joined #openstack-infra02:13
*** yujunz has joined #openstack-infra02:16
*** wolverineav has joined #openstack-infra02:20
*** yujunz has quit IRC02:20
*** gluytium has quit IRC02:20
*** wolverineav has quit IRC02:27
*** erikmwil_ has quit IRC02:29
*** gluytium has joined #openstack-infra02:29
*** soliosg has quit IRC02:32
*** wolverineav has joined #openstack-infra02:37
*** dave-mccowan has joined #openstack-infra02:38
*** john-davidge has joined #openstack-infra02:39
*** john-davidge has quit IRC02:44
*** wolverineav has quit IRC02:45
*** jamesdenton has joined #openstack-infra02:45
*** thorst_ has joined #openstack-infra02:48
*** thorst_ has quit IRC02:48
*** wolverineav has joined #openstack-infra02:50
*** kjorgensen has quit IRC02:55
*** wolverineav has quit IRC02:57
*** amotoki has quit IRC02:59
*** Apoorva has joined #openstack-infra03:00
*** Apoorva has quit IRC03:03
*** gongysh has joined #openstack-infra03:05
*** kzaitsev_mb has joined #openstack-infra03:08
*** amotoki has joined #openstack-infra03:10
*** wolverineav has joined #openstack-infra03:11
*** wolverineav has quit IRC03:15
*** amotoki has quit IRC03:15
*** david-lyle has joined #openstack-infra03:15
*** amotoki has joined #openstack-infra03:20
*** david-lyle has quit IRC03:21
*** sflanigan is now known as sflanigan_afk03:22
openstackgerritIan Wienand proposed openstack/diskimage-builder: ironic-agent: use /sbin for modprobe  https://review.openstack.org/42389303:22
*** Julien-zte has joined #openstack-infra03:25
*** baoli has joined #openstack-infra03:26
*** wolverineav has joined #openstack-infra03:28
*** baoli has quit IRC03:30
*** anilvenkata has joined #openstack-infra03:30
*** ihrachys has joined #openstack-infra03:31
*** amotoki_ has joined #openstack-infra03:33
*** ihrachys has quit IRC03:33
*** wolverineav has quit IRC03:35
*** amotoki has quit IRC03:35
openstackgerritIan Wienand proposed openstack/diskimage-builder: ironic-agent: use /sbin for modprobe  https://review.openstack.org/42389303:35
*** zz_dimtruck is now known as dimtruck03:39
*** Julien-zte has quit IRC03:40
*** Julien-zte has joined #openstack-infra03:40
*** Julien-zte has quit IRC03:40
*** erikmwil_ has joined #openstack-infra03:41
*** amotoki_ has quit IRC03:42
*** Julien-zte has joined #openstack-infra03:43
*** csmart has quit IRC03:43
*** gluytium has quit IRC03:43
*** Julien-zte has quit IRC03:44
*** Julien-zte has joined #openstack-infra03:44
*** voldz1tic3n has quit IRC03:45
*** wolverineav has joined #openstack-infra03:45
*** Julien-zte has quit IRC03:45
*** sflanigan_afk is now known as sflanigan03:45
*** jamesdenton has quit IRC03:45
*** Julien-zte has joined #openstack-infra03:45
*** Julien-zte is now known as Julien03:47
*** Julien is now known as Guest1059803:48
*** Guest10598 is now known as Julien-zte03:48
*** rbuzatu has joined #openstack-infra03:52
*** wolverineav has quit IRC03:53
*** baoli has joined #openstack-infra03:53
*** dave-mccowan has quit IRC03:53
*** soliosg has joined #openstack-infra03:54
*** wolverineav has joined #openstack-infra03:56
*** rbuzatu has quit IRC03:56
*** ramishra has joined #openstack-infra03:57
*** baoli has quit IRC04:00
*** gluytium has joined #openstack-infra04:00
*** kzaitsev_mb has quit IRC04:00
*** gildub has joined #openstack-infra04:02
*** wolverineav has quit IRC04:03
*** Sukhdev has joined #openstack-infra04:03
*** dave-mccowan has joined #openstack-infra04:04
*** gluytium has quit IRC04:05
*** sree has joined #openstack-infra04:09
*** sree has quit IRC04:09
*** sree has joined #openstack-infra04:09
*** yujunz has joined #openstack-infra04:11
*** wolverineav has joined #openstack-infra04:12
*** rbuzatu has joined #openstack-infra04:13
*** nicolasbock has quit IRC04:14
*** amotoki has joined #openstack-infra04:16
*** csmart has joined #openstack-infra04:17
*** wolverineav has quit IRC04:17
*** rbuzatu has quit IRC04:17
*** gildub has quit IRC04:19
*** anilvenkata has quit IRC04:20
*** lindycoder has joined #openstack-infra04:21
*** yujunz has quit IRC04:22
*** psachin has joined #openstack-infra04:24
*** EricGonczer_ has joined #openstack-infra04:25
*** EricGonczer_ has quit IRC04:28
*** gildub has joined #openstack-infra04:28
*** EricGonczer_ has joined #openstack-infra04:29
*** yujunz has joined #openstack-infra04:30
*** EricGonczer_ has quit IRC04:32
*** gluytium has joined #openstack-infra04:34
*** dave-mccowan has quit IRC04:35
*** yujunz has quit IRC04:36
*** gongysh has quit IRC04:36
*** s-shiono has joined #openstack-infra04:37
*** gluytium has quit IRC04:39
*** s-shiono_ has joined #openstack-infra04:42
*** s-shiono has quit IRC04:44
*** bhavik1 has joined #openstack-infra04:44
*** kzaitsev_mb has joined #openstack-infra04:48
*** thorst_ has joined #openstack-infra04:49
*** rbuzatu has joined #openstack-infra04:49
*** thorst_ has quit IRC04:54
*** rbuzatu has quit IRC04:54
*** umeshksingla has joined #openstack-infra05:00
*** lindycoder has quit IRC05:00
*** pgadiya has joined #openstack-infra05:02
openstackgerritIan Wienand proposed openstack-infra/system-config: Add bindep virtualenv to wheel-build slaves  https://review.openstack.org/42390405:03
ianwpabelanger AJaeger : ^ i think as described there, that's the way to get the wheel slaves installing required packages?05:04
*** sflanigan is now known as sflanigan_afk05:06
*** gouthamr has quit IRC05:07
*** bhavik1 has quit IRC05:11
*** kzaitsev_mb has quit IRC05:15
*** esikachev has quit IRC05:16
*** gongysh has joined #openstack-infra05:16
*** rbuzatu has joined #openstack-infra05:25
*** wolverineav has joined #openstack-infra05:25
*** umeshksingla has quit IRC05:26
*** sflanigan_afk is now known as sflanigan05:27
*** hongbin has quit IRC05:28
*** rbuzatu has quit IRC05:29
*** wolverineav has quit IRC05:29
*** wolverineav has joined #openstack-infra05:30
*** gongysh has quit IRC05:32
*** ijw_ has quit IRC05:32
*** nmathew has joined #openstack-infra05:34
*** wolverineav has quit IRC05:35
*** sdake has quit IRC05:37
*** wolverineav has joined #openstack-infra05:54
*** nadya has joined #openstack-infra05:56
*** wolverineav has quit IRC05:58
*** rbuzatu has joined #openstack-infra06:01
*** rbuzatu has quit IRC06:06
*** nadya has quit IRC06:07
*** tnovacik has joined #openstack-infra06:08
*** florianf has joined #openstack-infra06:08
*** tnovacik has quit IRC06:09
*** gildub has quit IRC06:14
*** isaacb has joined #openstack-infra06:15
*** tnovacik has joined #openstack-infra06:20
*** wolverineav has joined #openstack-infra06:30
*** sdake has joined #openstack-infra06:34
*** wolverineav has quit IRC06:35
*** claudiub has joined #openstack-infra06:38
*** rbuzatu has joined #openstack-infra06:38
*** wolverineav has joined #openstack-infra06:39
*** claudiub|2 has joined #openstack-infra06:40
*** rbuzatu has quit IRC06:42
*** claudiub has quit IRC06:42
*** wolverineav has quit IRC06:44
*** rbuzatu has joined #openstack-infra06:45
*** wolverineav has joined #openstack-infra06:47
*** thorst_ has joined #openstack-infra06:50
*** wolverineav has quit IRC06:52
openstackgerritJulia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new role  https://review.openstack.org/39489506:54
*** thorst_ has quit IRC06:55
*** drifterza has joined #openstack-infra06:57
*** markus_z has joined #openstack-infra06:59
*** yuval has joined #openstack-infra06:59
*** aojea has quit IRC07:07
*** abregman has joined #openstack-infra07:09
*** kzaitsev_mb has joined #openstack-infra07:11
*** isaacb has quit IRC07:13
*** tnovacik has quit IRC07:15
*** Sukhdev has quit IRC07:15
*** aojea has joined #openstack-infra07:20
*** isaacb has joined #openstack-infra07:23
*** rbuzatu has quit IRC07:26
*** tesseract has joined #openstack-infra07:31
*** wolverineav has joined #openstack-infra07:33
*** umeshksingla has joined #openstack-infra07:33
ianwAJaeger: yeah, doh.  what do you think about a coverage-jobs-nv, or even adding nv to coverage-jobs group?  it doesn't seem like coverage jobs really need to be run for voting07:43
*** bkorren has joined #openstack-infra07:44
*** isaacb has quit IRC07:44
*** yonglihe has joined #openstack-infra07:45
*** e0ne has joined #openstack-infra07:46
*** isaacb has joined #openstack-infra07:48
*** yujunz has joined #openstack-infra07:51
*** rbuzatu has joined #openstack-infra07:52
*** Hal has joined #openstack-infra08:03
*** yujunz has quit IRC08:04
*** Hal has quit IRC08:04
*** Hal has joined #openstack-infra08:05
*** sdake has quit IRC08:05
*** Hal is now known as Guest7200908:05
*** sdake has joined #openstack-infra08:05
*** isaacb has quit IRC08:08
*** e0ne has quit IRC08:09
*** Guest72009 has quit IRC08:09
*** yamamoto has quit IRC08:10
*** sdake has quit IRC08:12
*** isviridov_away has quit IRC08:15
*** jtomasek has quit IRC08:15
*** vaidy has quit IRC08:16
*** jtomasek has joined #openstack-infra08:17
*** pcaruana has joined #openstack-infra08:17
*** isaacb has joined #openstack-infra08:19
*** matrohon has joined #openstack-infra08:22
*** ccamacho has joined #openstack-infra08:22
*** abregman has quit IRC08:24
*** ssbarnea has joined #openstack-infra08:28
*** Hal has joined #openstack-infra08:28
*** maishsk has joined #openstack-infra08:28
*** Hal is now known as Guest3662908:28
*** abregman has joined #openstack-infra08:29
*** esikachev has joined #openstack-infra08:32
*** hashar has joined #openstack-infra08:33
*** rbuzatu has quit IRC08:34
*** rbuzatu has joined #openstack-infra08:34
*** vaidy has joined #openstack-infra08:35
*** isviridov_away has joined #openstack-infra08:36
*** umeshksingla has quit IRC08:37
*** dtardivel has joined #openstack-infra08:38
*** rbuzatu has quit IRC08:39
*** rbuzatu has joined #openstack-infra08:39
*** kzaitsev_mb has quit IRC08:40
*** dingyichen has quit IRC08:42
*** dizquierdo has joined #openstack-infra08:46
*** yamamoto has joined #openstack-infra08:46
*** electrofelix has joined #openstack-infra08:46
*** rossella_ has joined #openstack-infra08:50
*** thorst_ has joined #openstack-infra08:51
*** jpich has joined #openstack-infra08:52
*** pkoniszewski_ is now known as pkoniszewski08:52
openstackgerritCao Xuan Hoang proposed openstack-infra/jenkins-job-builder: Remove support for py33  https://review.openstack.org/42399308:52
*** jlibosva has joined #openstack-infra08:53
*** dizquierdo has quit IRC08:54
*** ralonsoh has joined #openstack-infra08:54
*** isaacb has quit IRC08:55
*** thorst_ has quit IRC08:56
*** nadya has joined #openstack-infra08:57
*** isaacb has joined #openstack-infra08:58
*** zzzeek has quit IRC09:00
*** askb has quit IRC09:01
*** zzzeek has joined #openstack-infra09:01
*** panda|Zz is now known as panda09:01
*** yolanda has quit IRC09:02
*** pgadiya has quit IRC09:02
mordredkfox1111: I agree with fungi on the can-it-be-automated part ... and also yeah we really need to docker caching and a local registry stood up09:02
*** panda is now known as Guest4144709:02
*** shardy has joined #openstack-infra09:02
openstackgerritLenny Verkhovsky proposed openstack-infra/nodepool: Create mandatory /etc/nodepool for later use  https://review.openstack.org/42400009:02
*** Guest41447 is now known as panda09:02
*** pgadiya has joined #openstack-infra09:05
*** yolanda has joined #openstack-infra09:07
*** e0ne has joined #openstack-infra09:08
*** nmathew has quit IRC09:08
*** isaacb has quit IRC09:09
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE test multinode  https://review.openstack.org/42387009:12
AJaegerianw: there are those projects that run coverage in post job, and others in check/gate. And indeed for most in check, it's non-voting. So, consolidating this is a good idea.09:13
*** yolanda has quit IRC09:15
*** stakeda has quit IRC09:16
*** zeih has joined #openstack-infra09:17
*** abregman has quit IRC09:18
*** abregman has joined #openstack-infra09:19
*** yamamoto has quit IRC09:21
*** maishsk has quit IRC09:24
*** yolanda has joined #openstack-infra09:24
openstackgerritMonty Taylor proposed openstack-infra/shade: Update coding document to mention direct REST calls  https://review.openstack.org/42401409:26
openstackgerritMonty Taylor proposed openstack-infra/shade: Copy in needed template processing utils from heatclient  https://review.openstack.org/42401609:27
*** yarkot has quit IRC09:29
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401709:29
*** zeih has quit IRC09:30
*** Julien-zte has quit IRC09:32
*** isaacb has joined #openstack-infra09:33
yolandagood morning09:33
mordredmorning yolanda !09:34
yolandahi, are you on my timezone? or having a bad night?09:34
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Neutron: Fix DVR multinode job in Grafana  https://review.openstack.org/42402309:35
*** maishsk has joined #openstack-infra09:36
mordredyolanda: I'm in your timezone - and slept quite well :)09:36
yolandawhat takes you to Europe? :)09:36
mordredyolanda: going to devconf.cz - yay for conferences09:37
mordredit'll be my first time in brno09:37
yolandaoh, seems a bunch of people are attending09:37
yolandai was asked last week for that09:37
mordredyah - should be a party09:37
yolandaBrno shall be really really cold these days...09:37
mordredyes. VERY. I'm in munich right now and it's quite cold09:37
*** yanyanhu has quit IRC09:37
*** nmathew has joined #openstack-infra09:38
yolandai've stayed in Brno a pair of times, long time before09:38
*** lennyb has joined #openstack-infra09:39
*** yamamoto has joined #openstack-infra09:40
*** maishsk has quit IRC09:43
*** amotoki has quit IRC09:44
*** maishsk has joined #openstack-infra09:45
*** sshnaidm is now known as sshnaidm|afk09:45
*** sshnaidm|afk has quit IRC09:45
ianwAJaeger: btw i ran that wheel build job by hand, took about 214 minutes.  i haven't copied the updated stuff to AFS.  still thinking about it all :)09:46
*** s-shiono_ has quit IRC09:46
*** dizquierdo has joined #openstack-infra09:47
ianwnot only do i think it can use bindep, but i think we can parallel it probably upto about 4x09:47
*** derekh has joined #openstack-infra09:47
*** john-davidge has joined #openstack-infra09:50
*** erikmwil_ has quit IRC09:50
AJaegerwow, 2 1/2 hours. ianw, your bindep idea looks sane but haven't checked all the details...09:50
*** pblaho has joined #openstack-infra09:51
*** erikmwil_ has joined #openstack-infra09:52
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403409:56
bkeromordred: I'd wager Brno might be even colder09:56
*** chem has joined #openstack-infra09:57
bkeroI've always wanted to go to Devconf.cz, although January interferes with Hackerbeach09:57
openstackgerritMerged openstack-infra/project-config: Add Keystone Admin charm interface  https://review.openstack.org/42071009:58
openstackgerrityolanda.robla proposed openstack-infra/project-config: Swift experimental multinode grenade job  https://review.openstack.org/41198209:58
yolandahi ianw, i finally saw the green light in diskimage-builder refactor of block device09:59
yolandatripleo integration was broken but with Andreas patchset, it started to work09:59
*** umeshksingla has joined #openstack-infra10:00
*** liujiong has quit IRC10:01
*** umeshksingla has quit IRC10:01
*** chem has quit IRC10:01
*** chem has joined #openstack-infra10:02
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403410:02
*** lindycoder has joined #openstack-infra10:03
*** lindycoder has quit IRC10:03
*** nadya has quit IRC10:04
*** sambetts|afk is now known as sambetts10:06
*** priteau has joined #openstack-infra10:07
openstackgerritMerged openstack-infra/project-config: Add a devstack-gate job to zunclient's tests  https://review.openstack.org/42271410:07
openstackgerritMerged openstack-infra/project-config: Remove fedora-24 from openstack-infra  https://review.openstack.org/42370610:07
openstackgerritMerged openstack-infra/project-config: enable python-jobs for meteos  https://review.openstack.org/42374010:08
*** maishsk has quit IRC10:09
*** tosky has joined #openstack-infra10:10
*** apuimedo is now known as apuimedo|flu10:13
openstackgerritMerged openstack-infra/project-config: ironic: grenade.*multitenant job use agent_ssh  https://review.openstack.org/42291710:14
openstackgerritMerged openstack-infra/project-config: ironic: agent_* jobs require a partition type of wholedisk  https://review.openstack.org/42292710:15
openstackgerritMerged openstack-infra/project-config: Add experimental jobs to quickstart and its extras  https://review.openstack.org/42322310:15
*** isaacb has quit IRC10:19
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403410:21
*** adarazs has left #openstack-infra10:24
*** chem has quit IRC10:24
*** chem has joined #openstack-infra10:24
*** ggnel_t has joined #openstack-infra10:25
*** ociuhandu has quit IRC10:26
*** maishsk has joined #openstack-infra10:27
openstackgerritAlistair Coles proposed openstack-infra/project-config: Update swift functional job list  https://review.openstack.org/42350810:28
*** sshnaidm has joined #openstack-infra10:31
*** claudiub|2 is now known as claudiub10:32
*** ldnunes has joined #openstack-infra10:35
*** martinkopec has joined #openstack-infra10:36
*** nadya has joined #openstack-infra10:38
*** wolverineav has quit IRC10:39
*** kzaitsev_mb has joined #openstack-infra10:40
*** umeshksingla has joined #openstack-infra10:41
*** nadya has quit IRC10:43
*** rbuzatu has quit IRC10:43
*** rbuzatu has joined #openstack-infra10:43
*** chem has quit IRC10:44
*** chem has joined #openstack-infra10:44
*** nadya has joined #openstack-infra10:48
*** rbuzatu has quit IRC10:50
*** thorst_ has joined #openstack-infra10:52
*** wolverineav has joined #openstack-infra10:54
*** isaacb has joined #openstack-infra10:54
openstackgerritOleksandr Karpenko proposed openstack-infra/gearman-plugin: Job name must be unique: use getFullName() instead of getName()  https://review.openstack.org/42405510:55
*** thorst_ has quit IRC10:57
*** mptacekx has joined #openstack-infra10:57
*** wolverineav has quit IRC10:58
*** dtantsur|afk is now known as dtantsur11:05
*** thiagolib has joined #openstack-infra11:07
dimsyolanda : any reason to remove the +w on https://review.openstack.org/#/c/423533/ ? :)11:13
dimsyolanda : good morning/afternoon11:13
AJaegerdims: the dependency was not merged when she did that11:13
yolandayep, that was my reason :)11:13
dimsah.11:13
AJaegeror wait - it's merged now, isn't it?11:14
dimsAJaeger : it merged on "Change has been successfully merged into the git repository by JenkinsJan 21 3:59 PM"11:14
yolandaah, i saw a -111:14
yolandaso i didn't pay attention to the +w11:14
dimsyolanda : y we are letting that merge and filing follow up11:14
dimsreviews11:14
yolandaok +w now11:14
dimsthanks yolanda !11:14
dimsthanks AJaeger11:15
*** pkoniszewski has quit IRC11:16
*** andreas_s has joined #openstack-infra11:17
mptacekxHi, we're running 3rd party CI and it seems that our computes after running 4 weeks are getting slower, higher "inactive memory used", becoming swapping, some builds crashed on timeouts (eventually on OOM issue). We would like to handle it better than doing regular reboots, has anyone the same observation ? Thanks11:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE test multinode  https://review.openstack.org/42387011:18
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403411:19
openstackgerritMerged openstack-infra/project-config: Switch tempest/nova/py35 from experimental to non-voting/check  https://review.openstack.org/42353311:20
*** nmathew has quit IRC11:24
*** esikachev has quit IRC11:25
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403411:25
*** wolverineav has joined #openstack-infra11:25
*** florianf has quit IRC11:27
*** rbuzatu has joined #openstack-infra11:27
*** ccamacho1 has joined #openstack-infra11:29
*** wolverin_ has joined #openstack-infra11:29
*** ccamacho has quit IRC11:29
*** florianf has joined #openstack-infra11:30
*** krtaylor has quit IRC11:31
*** wolverineav has quit IRC11:32
*** krtaylor has joined #openstack-infra11:33
*** yamamoto has quit IRC11:34
*** esikachev has joined #openstack-infra11:35
*** rfolco has joined #openstack-infra11:36
*** sshnaidm is now known as sshnaidm|afk11:39
*** sdake has joined #openstack-infra11:40
*** esikachev has quit IRC11:40
*** jkilpatr has quit IRC11:41
wznoinskhi infra11:43
*** nicolasbock has joined #openstack-infra11:43
*** esikachev has joined #openstack-infra11:43
wznoinskany from infra thought of doing each step of devstack-gate timed maybe?, similar to how devstack times different 'components', i.e.: pip_install, apt-get, run_process11:48
*** esikachev has quit IRC11:48
*** erlon has joined #openstack-infra11:49
*** esikachev has joined #openstack-infra11:50
*** sree has quit IRC11:56
*** nmathew has joined #openstack-infra11:59
*** sree has joined #openstack-infra11:59
*** tinwood has quit IRC12:00
*** tinwood has joined #openstack-infra12:01
*** thorst_ has joined #openstack-infra12:03
*** anilvenkata has joined #openstack-infra12:03
*** sree has quit IRC12:04
*** thorst_ has quit IRC12:04
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: WIP - Checking SNMP upgrade  https://review.openstack.org/42407712:04
*** dave-mccowan has joined #openstack-infra12:05
*** askb has joined #openstack-infra12:07
*** pgadiya has quit IRC12:09
*** sshnaidm|afk is now known as sshnaidm12:12
*** sdake_ has joined #openstack-infra12:12
*** jkilpatr has joined #openstack-infra12:13
*** amotoki has joined #openstack-infra12:15
*** sdake has quit IRC12:16
*** shu-mutou is now known as shu-mutou-AWAY12:17
*** shardy is now known as shardy_lunch12:22
*** sdague has joined #openstack-infra12:22
*** abalobashina has joined #openstack-infra12:22
*** ociuhandu has joined #openstack-infra12:22
lennybmptacekx, we are running CI on physical servers for a long time without seeing such behavior. There is a third party CI weekly meeting today and you are welcome to join and ask there https://wiki.openstack.org/wiki/Meetings/ThirdParty12:23
lennybianw, pls review https://review.openstack.org/#/c/424000/  . I've added a fix to work with nodepool without running nodepool-base element12:25
*** sdake_ is now known as sdake12:25
*** dave-mccowan has quit IRC12:25
openstackgerritMonty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips  https://review.openstack.org/42408712:32
*** amotoki has quit IRC12:33
*** yamamoto has joined #openstack-infra12:34
*** gordc has joined #openstack-infra12:36
*** baoli has joined #openstack-infra12:38
openstackgerritMonty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips  https://review.openstack.org/42408712:38
*** baoli has quit IRC12:39
abalobashinaHi there! Could you please help me. I have the following problem with Jenkins job: http://logs.openstack.org/81/422481/2/check/gate-fuel-web-python27-db-ubuntu-xenial/5b0710e/console.html  But some time ago (when I rechecked this patch) the appropriate tests were passed, but Job timed out http://logs.openstack.org/81/422481/2/check/gate-fuel-web-python27-db-ubuntu-xenial/4c589b0/console.html  Also, this issue does not a12:43
*** ansiwen_ is now known as ansiwen12:43
*** EricGonczer_ has joined #openstack-infra12:44
*** dave-mccowan has joined #openstack-infra12:45
AJaegerabalobashina: your last sentence is incomplete12:46
AJaegerabalobashina: there might be different versions of packages involved between your previous run and this one12:47
*** patriciadomin_ is now known as patriciadomin12:49
*** ominakov has joined #openstack-infra12:50
*** pkoniszewski has joined #openstack-infra12:50
*** psachin has quit IRC12:50
mptacekxlennyb: thanks for your input. Are you using hugepages in your setup ? I will try to join today and rephrase it there12:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode subnodes to inventory  https://review.openstack.org/42387012:51
*** EricGonc_ has joined #openstack-infra12:52
*** EricGonczer_ has quit IRC12:53
*** ominakov has quit IRC12:53
lennybmptacekx, no. we are not using huge pages. can you refresh/release/remount hugepages after job was finished? we are removing all pip packages and python processes during clean phase after job was finished12:53
abalobashinaAJaeger: but locally tests successfully passed12:55
*** jlibosva has quit IRC12:56
*** yujunz has joined #openstack-infra12:58
mptacekxlennyb: we don't have hugepages setup on hypervisor level, but we're running VM's on those compute nodes, which are using hugepages. Those VM's are removed when zuul/jenkins/nodepool is done with them. Alas something is gradually slowing the system. I can see some higher increase of "inactively used RAM memory", which can also consume half of the RAM capacity of whole server even when no VM's are running. Naturally it's not neccessarily a12:58
mptacekxreason of the problem, you might also see that.12:58
*** dprince has joined #openstack-infra13:00
*** rhallisey has joined #openstack-infra13:01
*** _sigmavirus24 is now known as sigmavirus13:02
*** sigmavirus has joined #openstack-infra13:02
njohnstondevstack-gate cores: Please take a look at https://review.openstack.org/383827 - neutron team is trying to get something in for O-3 but this is blocking.  Thanks!13:02
sdagueclarkb / mordred - the d-g local.conf change seems pretty solid now - https://review.openstack.org/#/c/326585/ - I ran ironic against it to test how plugin based jobs worked, and it seemed solid13:02
abalobashinaAJaeger: and this failure appeared in other different patches, for example http://logs.openstack.org/14/420914/12/check/gate-fuel-web-python27-db-ubuntu-xenial/f175149/console.html  and this problem doesn't related with this patch's code13:03
*** markus_z has quit IRC13:03
*** hrybacki|sick is now known as hrybacki13:04
*** rlandy has joined #openstack-infra13:05
*** yujunz has quit IRC13:07
lennybmptacekx, I see. since we are starting to work with nodepool I will inform you if anything similar will be observed13:09
mptacekxlennyb, thanks a lot13:10
*** drifterza has quit IRC13:10
*** john-dav_ has joined #openstack-infra13:10
*** john-davidge has quit IRC13:10
*** xyang1 has joined #openstack-infra13:11
*** trown|outtypewww is now known as trown13:12
openstackgerritMerged openstack-infra/tripleo-ci: multinode: remove 417109 workaround  https://review.openstack.org/42291313:13
*** raildo has joined #openstack-infra13:13
*** yamamoto has quit IRC13:14
*** markus_z has joined #openstack-infra13:17
AJaegerabalobashina: I cannot help you further on this - but if it happens on different patches, it's often the case of different packages. So, you have to debug what's different. We haven't done any changes in OpenStack CI that should change anything here.13:20
*** nadya has quit IRC13:24
rbuzatu:q13:24
*** EricGonc_ has quit IRC13:25
*** shardy_lunch is now known as shardy13:28
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option  https://review.openstack.org/41659313:28
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Add py35/tempest job to devstack and tempest check queues  https://review.openstack.org/42410713:28
openstackgerritSean McGinnis proposed openstack-infra/project-config: Revert "Remove sheepdog jobs from cinder queue"  https://review.openstack.org/42410813:29
*** esikachev has quit IRC13:30
*** sshnaidm_ has joined #openstack-infra13:31
*** sshnaidm has quit IRC13:31
*** sflanigan has quit IRC13:32
*** mdrabe has joined #openstack-infra13:34
*** mrtenio has quit IRC13:37
*** jordanP has joined #openstack-infra13:38
*** umeshksingla has quit IRC13:38
*** mrtenio has joined #openstack-infra13:38
*** umeshksingla has joined #openstack-infra13:38
*** mrtenio has quit IRC13:39
*** kgiusti has joined #openstack-infra13:41
*** askb has quit IRC13:43
*** nicolasbock has quit IRC13:46
*** noama has joined #openstack-infra13:46
*** kgiusti has quit IRC13:46
*** kgiusti has joined #openstack-infra13:47
*** rossella_ has quit IRC13:47
*** rossella_ has joined #openstack-infra13:47
*** jheroux has joined #openstack-infra13:50
*** nicolasbock has joined #openstack-infra13:51
*** noama has quit IRC13:51
*** csomerville has joined #openstack-infra13:52
*** cody-somerville has quit IRC13:52
openstackgerritDmitrii Shcherbakov proposed openstack-infra/project-config: snaps: add snap-ceilometer definitions  https://review.openstack.org/42412013:52
*** noama has joined #openstack-infra13:52
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Revert "enable Placement API on multinode jobs"  https://review.openstack.org/42412113:52
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Add SNMP support to major CI upgrade  https://review.openstack.org/42407713:53
*** sflanigan has joined #openstack-infra13:53
*** sflanigan has joined #openstack-infra13:53
*** yujunz has joined #openstack-infra13:54
*** tlian has joined #openstack-infra13:54
dmsimardo/13:55
dmsimardI did a recheck on a job which ended up being successful but ended with a failure due to a Zuul error: [Zuul] standard output/error still open after child exited13:55
dmsimardThe re-check ended with the same status. It's the three same jobs on which this occurred twice, other jobs have been successful.13:56
dmsimardAny idea or should I just throw a second recheck at it ? That was friday/saturday.13:56
*** gouthamr has joined #openstack-infra13:56
*** ihrachys has joined #openstack-infra13:58
*** nicolasbock has quit IRC13:58
openstackgerritDmitrii Shcherbakov proposed openstack-infra/project-config: snaps: add snap-ceilometer definitions  https://review.openstack.org/42412014:00
*** acruz has joined #openstack-infra14:00
*** arxcruz has quit IRC14:00
*** jcoufal has joined #openstack-infra14:02
*** tosky has quit IRC14:03
*** umeshksingla has joined #openstack-infra14:04
openstackgerritKaitlin Farr proposed openstack-infra/project-config: Add job template for Barbican tempest plugin  https://review.openstack.org/42080914:04
*** Goneri has joined #openstack-infra14:05
*** nicolasbock has joined #openstack-infra14:06
*** sshnaidm_ has quit IRC14:06
*** thorst_ has joined #openstack-infra14:08
*** esberglu has joined #openstack-infra14:09
*** sshnaidm has joined #openstack-infra14:09
*** umeshksingla has quit IRC14:11
*** amotoki has joined #openstack-infra14:11
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Migrate -platform- devstack jobs to -neutron-full-  https://review.openstack.org/41132814:12
*** nadya has joined #openstack-infra14:13
*** jamesdenton has joined #openstack-infra14:13
*** matt-borland has joined #openstack-infra14:18
*** thiagolib has quit IRC14:18
*** baoli has joined #openstack-infra14:19
*** hongbin has joined #openstack-infra14:20
*** isaacb has quit IRC14:21
*** dizquierdo has quit IRC14:22
*** fguillot has joined #openstack-infra14:24
*** amotoki has quit IRC14:25
openstackgerritDmitrii Shcherbakov proposed openstack-infra/project-config: snaps: add snap-ceilometer definitions  https://review.openstack.org/42412014:27
*** jcoufal has quit IRC14:29
*** jcoufal has joined #openstack-infra14:31
pabelangerdmsimard: which job?14:33
dmsimardpabelanger: https://review.openstack.org/#/c/423554/ see centos job results14:35
dmsimardI just submitted a patchset of something that could perhaps explain the issue -- maybe permission error when uploading logs14:35
openstackgerritYolande Amate proposed openstack-infra/jenkins-job-builder: Make add_nonblank_xml_subelement more reusable  https://review.openstack.org/40880114:36
dmsimardIf it comes back successful with the permission log fix, I'd love to see an improvement so Zuul is a bit more explicit about what the error really is ..14:36
dmsimardbut time will tell :)14:36
*** dizquierdo has joined #openstack-infra14:37
*** jcoufal_ has joined #openstack-infra14:38
*** hongbin has quit IRC14:39
*** hongbin has joined #openstack-infra14:40
*** nmathew has quit IRC14:40
*** jcoufal has quit IRC14:41
*** jcoufal has joined #openstack-infra14:42
*** umeshksingla has joined #openstack-infra14:42
*** slaweq_ has joined #openstack-infra14:43
*** isaacb has joined #openstack-infra14:43
openstackgerritMerged openstack-infra/tripleo-ci: Use already patched repos cloned by zuul for build  https://review.openstack.org/41949114:44
*** esikachev has joined #openstack-infra14:44
*** jcoufal_ has quit IRC14:45
*** eharney has joined #openstack-infra14:45
*** bkorren has quit IRC14:48
*** yujunz has quit IRC14:50
*** eharney has quit IRC14:52
pabelangerdmsimard: looks like the job was still collecting logs, after the failure14:53
*** srobert has joined #openstack-infra14:53
dmsimardpabelanger: collecting != uploading14:53
pabelangeryes14:53
pabelangeruploading happens after that error14:53
*** srobert has quit IRC14:53
pabelangererr14:54
pabelangerfailure message14:54
*** dimtruck is now known as zz_dimtruck14:54
*** zz_dimtruck is now known as dimtruck14:54
*** martinkopec has quit IRC14:54
dmsimardpabelanger: looks like not permission related.. failed again http://logs.openstack.org/54/423554/2/check/gate-puppet-openstack-integration-3-scenario002-tempest-centos-7/1638091/console.html14:54
pabelangersomething is keeping the console open14:56
*** jaosorior has joined #openstack-infra14:56
*** anilvenkata has quit IRC14:56
pabelangerI'm guessing you need to fix the job: http://logs.openstack.org/54/423554/2/check/gate-puppet-openstack-integration-3-scenario002-tempest-centos-7/1638091/console.html#_2017-01-23_14_52_07_81370514:57
pabelangersince that is doing exit 114:57
*** hongbin has quit IRC15:00
*** hongbin_ has joined #openstack-infra15:00
*** umeshksingla has quit IRC15:01
*** panda is now known as panda-notpydata15:01
*** tosky has joined #openstack-infra15:02
*** jordanP has quit IRC15:03
*** dimtruck is now known as zz_dimtruck15:03
*** jordanP has joined #openstack-infra15:03
openstackgerritYolande Amate proposed openstack-infra/jenkins-job-builder: Make add_nonblank_xml_subelement more reusable  https://review.openstack.org/40880115:05
*** eharney has joined #openstack-infra15:06
*** hongbin_ has quit IRC15:08
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Add experimental job to test nova custom resource classes  https://review.openstack.org/40764515:11
*** rbrndt has joined #openstack-infra15:13
*** tphummel has joined #openstack-infra15:13
*** srobert has joined #openstack-infra15:15
*** acruz has quit IRC15:17
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952915:18
*** mtanino has joined #openstack-infra15:19
*** knikolla has joined #openstack-infra15:20
*** knikolla has quit IRC15:20
*** knikolla has joined #openstack-infra15:20
*** martinkopec has joined #openstack-infra15:21
*** arxcruz has joined #openstack-infra15:22
*** sflanigan has quit IRC15:22
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419015:23
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE test oooq with users  https://review.openstack.org/42419115:23
*** zz_dimtruck is now known as dimtruck15:24
*** john-dav_ is now known as john-davidge15:27
*** baoli has quit IRC15:30
*** EricGonczer_ has joined #openstack-infra15:30
*** voldz1tic3n has joined #openstack-infra15:31
*** ccamacho1 has quit IRC15:32
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add ceph support to major upgrade job  https://review.openstack.org/42338315:32
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Workaround bigswitch breakage in upgrade CI  https://review.openstack.org/42419915:32
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Handle RETRY_LIMIT failure type in cistatus script  https://review.openstack.org/42420015:33
*** beekneemech is now known as bnemec15:33
*** yolanda has quit IRC15:36
*** yolanda has joined #openstack-infra15:36
*** yolanda has quit IRC15:37
*** cloader89 is now known as cjloader15:38
openstackgerritMerged openstack-infra/project-config: Drop template from diskimage names  https://review.openstack.org/42012815:40
*** knangia has joined #openstack-infra15:41
*** baoli has joined #openstack-infra15:41
*** shardy has quit IRC15:41
*** shardy has joined #openstack-infra15:42
*** sdague has quit IRC15:43
*** florianf has quit IRC15:45
*** icey has joined #openstack-infra15:45
*** icey has quit IRC15:45
*** icey has joined #openstack-infra15:45
*** florianf has joined #openstack-infra15:46
*** ccamacho has joined #openstack-infra15:46
openstackgerritLenny Verkhovsky proposed openstack-infra/nodepool: Create mandatory /etc/nodepool for later use  https://review.openstack.org/42400015:46
*** panda-notpydata is now known as panda|mtg15:46
*** mptacekx has quit IRC15:47
*** john-davidge has quit IRC15:49
*** tphummel has quit IRC15:49
*** arxcruz has quit IRC15:50
*** umeshksingla has joined #openstack-infra15:51
*** mriedem has joined #openstack-infra15:52
*** yamahata has joined #openstack-infra15:54
*** maishsk has quit IRC15:54
*** maishsk has joined #openstack-infra15:54
*** maishsk has quit IRC15:54
*** isaacb has quit IRC15:55
*** tnovacik has joined #openstack-infra15:56
*** hongbin has joined #openstack-infra15:56
*** jcoufal_ has joined #openstack-infra15:56
*** sshnaidm is now known as sshnaidm|afk15:56
*** sshnaidm|afk has quit IRC15:57
*** yuval has quit IRC15:57
*** sdake_ has joined #openstack-infra15:58
*** xarses has joined #openstack-infra15:58
*** jcoufal has quit IRC15:59
*** burgerk has joined #openstack-infra15:59
*** xarses_ has joined #openstack-infra15:59
*** tnovacik has quit IRC16:00
*** sdake has quit IRC16:00
*** panda|mtg is now known as panda16:01
*** rbrndt has quit IRC16:01
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809816:01
*** erikmwil_ has quit IRC16:02
*** erikmwil_ has joined #openstack-infra16:03
*** xarses has quit IRC16:03
*** adrian_otto has joined #openstack-infra16:04
*** rbrndt has joined #openstack-infra16:05
*** amotoki has joined #openstack-infra16:06
*** Jeffrey4l_ has quit IRC16:06
*** rbrndt has quit IRC16:06
*** Jeffrey4l_ has joined #openstack-infra16:06
*** rhallisey has quit IRC16:07
*** chem has quit IRC16:07
*** yland has joined #openstack-infra16:09
*** jimbaker has quit IRC16:09
*** gouthamr has quit IRC16:12
*** gouthamr has joined #openstack-infra16:12
*** markus_z has quit IRC16:13
*** pcaruana has quit IRC16:13
*** chem has joined #openstack-infra16:14
*** esberglu has left #openstack-infra16:14
*** rbrndt has joined #openstack-infra16:14
openstackgerritYolande Amate proposed openstack-infra/jenkins-job-builder: Make add_nonblank_xml_subelement more reusable  https://review.openstack.org/40880116:17
*** cody-somerville has joined #openstack-infra16:18
*** cody-somerville has joined #openstack-infra16:18
*** csomerville has quit IRC16:20
njohnstonsdague and infra cores: Please take a look at https://review.openstack.org/383827 in devstack-gate - neutron team is trying to get something in for O-3 but this is blocking.  Thanks!16:24
*** jascott1_ has joined #openstack-infra16:26
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419016:26
EmilienM:tripleo16:26
EmilienMoops16:27
*** markus_z has joined #openstack-infra16:27
*** umeshksingla has quit IRC16:28
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351916:30
*** jascott1_ has quit IRC16:30
*** maishsk has joined #openstack-infra16:31
openstackgerritMerged openstack-infra/system-config: Move gerrit's MySQL backups to gerrit homedir  https://review.openstack.org/42264916:32
*** rbrndt has quit IRC16:32
*** david-lyle has joined #openstack-infra16:32
*** panda is now known as panda|bbl16:33
*** dizquierdo has quit IRC16:34
*** maishsk has quit IRC16:34
*** maishsk has joined #openstack-infra16:36
*** Guest36629 has quit IRC16:36
*** Hal has joined #openstack-infra16:36
*** Hal is now known as Guest7063216:37
*** nadya has quit IRC16:37
*** tphummel has joined #openstack-infra16:38
*** xarses_ is now known as xarses16:41
*** inc0 has joined #openstack-infra16:42
*** arxcruz has joined #openstack-infra16:43
dmsimardpabelanger: oh man, thanks .. I totally didn't notice the exit 1 there16:43
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Mark nodepool image workers specs as complete  https://review.openstack.org/42422916:43
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Abandon nodepool launch worker spec  https://review.openstack.org/42423016:43
jeblairfungi: ^16:43
*** florianf has quit IRC16:48
*** adrian_otto has quit IRC16:48
*** rbuzatu has quit IRC16:50
openstackgerritMerged openstack-infra/nodepool: Begin implementing node request handling.  https://review.openstack.org/42148516:50
openstackgerritMerged openstack-infra/zuul: Correct comments in requirement test cases  https://review.openstack.org/42289916:51
*** hashar is now known as hasharAway16:51
openstackgerritMerged openstack-infra/nodepool: Fix for launched node counting  https://review.openstack.org/42280716:52
fungijeblair: thanks!16:52
openstackgerritMerged openstack-infra/nodepool: Query ZooKeeper to determine image availability  https://review.openstack.org/42285716:52
*** erikmwil_ has quit IRC16:55
*** erikmwil_ has joined #openstack-infra16:55
openstackgerritMerged openstack-infra/nodepool: Add a serialize() method to ZK model definitions  https://review.openstack.org/42340416:56
*** adrian_otto has joined #openstack-infra16:57
*** david-lyle_ has joined #openstack-infra16:57
openstackgerritMerged openstack-infra/nodepool: Add API methods for locking/unlocking Nodes.  https://review.openstack.org/42349616:57
openstackgerritMerged openstack-infra/nodepool: Allow nodepool-builder to only build diskimages  https://review.openstack.org/41216016:58
*** maishsk has quit IRC16:59
*** maishsk has joined #openstack-infra17:00
*** baoli has quit IRC17:01
*** andreas_s has quit IRC17:01
*** inc0 has quit IRC17:01
*** yland has quit IRC17:01
*** martinkopec has quit IRC17:02
*** david-lyle_ has quit IRC17:03
*** rhallisey has joined #openstack-infra17:04
*** kzaitsev_mb has quit IRC17:05
*** nadya has joined #openstack-infra17:05
*** chem has quit IRC17:06
*** nadya has quit IRC17:06
*** rajinir has joined #openstack-infra17:06
*** sdake_ is now known as sdake17:08
*** abregman has quit IRC17:08
*** sshnaidm has joined #openstack-infra17:09
*** chem has joined #openstack-infra17:09
jeblairfungi: i added 410442 to the agenda17:09
*** ccamacho has left #openstack-infra17:09
pabelangermordred: fungi: mysql_backups on review.o.o have been properly moved to /home/gerrit2 folder17:10
*** e0ne has quit IRC17:13
*** maishsk has quit IRC17:14
*** markus_z has quit IRC17:14
*** matrohon has quit IRC17:15
*** tesseract has quit IRC17:15
*** nadya has joined #openstack-infra17:17
openstackgerritMerged openstack-infra/system-config: Exclude aarch64 for epel mirrors  https://review.openstack.org/41552417:18
*** inc0 has joined #openstack-infra17:18
*** baoli has joined #openstack-infra17:18
*** nicolasbock has quit IRC17:19
*** jascott1_ has joined #openstack-infra17:20
fungijeblair: awesome17:20
*** jascott1_ has quit IRC17:20
*** EricGonczer_ has quit IRC17:25
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate: Run discover_hosts to register subnodes in a multinode setup  https://review.openstack.org/42425217:25
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Mark nodepool image workers specs as complete  https://review.openstack.org/42422917:25
fungi(correcting a minor typo in the commit message)17:26
jeblaira strangely persistent one too...17:26
jeblairi like to think it's a clever pun and has nothing to do with the proximity of the r and l keys on dvorak.17:27
*** nicolasbock has joined #openstack-infra17:27
fungijeblair: while you're around, are you aware of any slow memory leak in gertty, maybe related to periodic review sync?17:27
jeblairfungi: no, but i haven't been looking, and i just restarted gertty so i can't check my own :(17:28
fungii find that after a week or so of running it eats around 2gb virtual memory and will eventually get sniped by the oom killer if left unchecked17:28
*** mat128 is now known as mat128|afk17:28
fungithough usually i notice once it gets sluggish from swapping17:28
*** nadya has quit IRC17:29
*** esikachev has quit IRC17:29
jeblairfungi: i'm at 389M after restarting, i'll check it over the course of the week17:29
*** esikachev has joined #openstack-infra17:32
*** derekh has quit IRC17:33
fungijeblair: thanks, i've noticed that if i leave it idling, and check every few minutes i see it creep up steadily in very small increments17:33
fungiwhich i wouldn't find surprising if it were just from caching data, but it never seems to level off17:34
*** esikachev has quit IRC17:36
*** Swami has joined #openstack-infra17:37
*** esikachev has joined #openstack-infra17:38
*** jpich has quit IRC17:38
*** tosky has quit IRC17:39
*** nicolasbock has quit IRC17:40
*** Apoorva has joined #openstack-infra17:40
*** isaacb has joined #openstack-infra17:43
*** isaacb has quit IRC17:45
*** rbuzatu has joined #openstack-infra17:45
*** marst has joined #openstack-infra17:45
*** thiagolib has joined #openstack-infra17:45
*** rossella_ has quit IRC17:46
openstackgerritDan Smith proposed openstack-infra/devstack-gate: Run discover_hosts to register subnodes in a multinode setup  https://review.openstack.org/42425217:46
*** rossella_ has joined #openstack-infra17:47
*** esikachev has quit IRC17:48
*** rbuzatu has quit IRC17:49
*** trown is now known as trown|lunch17:50
*** hashar has joined #openstack-infra17:52
*** erikmwil_ has quit IRC17:52
openstackgerritMerged openstack-infra/infra-specs: Mark nodepool image workers specs as complete  https://review.openstack.org/42422917:52
*** erikmwil_ has joined #openstack-infra17:53
fungineed to run some lunchtime errands, but will return soon17:54
openstackgerritSagi Shnaidman proposed openstack-infra/project-config: Create periodic multinode scenario jobs in tripleo  https://review.openstack.org/42426517:54
*** john-davidge has joined #openstack-infra17:55
*** nicolasbock has joined #openstack-infra17:55
openstackgerritMerged openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option  https://review.openstack.org/41659317:55
*** dtantsur is now known as dtantsur|afk17:56
*** hasharAway has quit IRC17:56
openstackgerritSagi Shnaidman proposed openstack-infra/project-config: Create periodic multinode scenario jobs in tripleo  https://review.openstack.org/42426517:56
*** david-lyle_ has joined #openstack-infra17:56
*** david-lyle_ has quit IRC17:56
*** tnovacik has joined #openstack-infra17:56
AJaegersshnaidm: why do you add half of intra to https://review.openstack.org/#/c/418293/ ?17:57
*** Jeffrey4l__ has joined #openstack-infra17:57
*** vhosakot has joined #openstack-infra17:57
*** david-lyle_ has joined #openstack-infra17:57
*** EricGonczer_ has joined #openstack-infra17:57
sshnaidmAJaeger, sorry, I thought it's same cores, but I can't remove reviewers17:57
*** hurgleburgler has joined #openstack-infra17:58
*** eharney has quit IRC17:58
AJaegersshnaidm: it's not. Do you know how to check for reviewers?17:58
*** Jeffrey4l_ has quit IRC17:59
AJaegerclick on the little wheel in the review besides the project17:59
sshnaidmAJaeger, yeah17:59
AJaegerand from there via access to the group...17:59
*** xarses_ has joined #openstack-infra17:59
*** xarses_ has quit IRC18:00
*** xarses_ has joined #openstack-infra18:00
*** ralonsoh has quit IRC18:01
*** inc0 has quit IRC18:01
sshnaidmAJaeger, I hope yolanda and rcarrillocruz will not be offended and will just ignore this review18:02
*** xarses has quit IRC18:02
*** rbrndt has joined #openstack-infra18:03
*** dinob has joined #openstack-infra18:04
*** david-lyle has quit IRC18:05
*** david-lyle_ is now known as david-lyle18:05
*** hashar has quit IRC18:07
*** nadya has joined #openstack-infra18:07
AJaeger;)18:08
*** karthikp has quit IRC18:09
*** armax has joined #openstack-infra18:10
*** karthikp has joined #openstack-infra18:10
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419018:11
*** xarses has joined #openstack-infra18:11
*** xarses_ has quit IRC18:12
AJaegeroomichi: could you review https://review.openstack.org/#/c/424107 , please? This adds a new job to tempest and devstack for py3518:13
*** jordanP has quit IRC18:13
openstackgerritMonty Taylor proposed openstack-infra/shade: Upload images to swift as application/octet-stream  https://review.openstack.org/42427418:14
*** eharney has joined #openstack-infra18:14
*** john-davidge has quit IRC18:15
*** amotoki has quit IRC18:18
*** esikachev has joined #openstack-infra18:19
*** xarses_ has joined #openstack-infra18:19
*** xarses_ has quit IRC18:19
*** xarses_ has joined #openstack-infra18:20
*** sambetts is now known as sambetts|afk18:21
*** xarses has quit IRC18:22
*** tphummel has quit IRC18:22
*** Guest75281 has joined #openstack-infra18:22
*** esikachev has quit IRC18:23
*** Guest75281 has quit IRC18:24
*** Guest75281 has joined #openstack-infra18:24
*** tphummel has joined #openstack-infra18:25
*** rossella_ has quit IRC18:27
*** tphummel has quit IRC18:28
*** john-davidge has joined #openstack-infra18:28
*** john-davidge has quit IRC18:30
*** tphummel has joined #openstack-infra18:31
*** esikachev has joined #openstack-infra18:35
*** dharinic is now known as dharinic|lunch18:35
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode scenario job for repo promotion  https://review.openstack.org/42428218:36
*** jcoufal has joined #openstack-infra18:39
*** erikmwil_ has quit IRC18:42
*** jcoufal__ has joined #openstack-infra18:42
*** jcoufal_ has quit IRC18:42
*** erikmwil_ has joined #openstack-infra18:43
*** rbrndt has quit IRC18:44
*** jcoufal_ has joined #openstack-infra18:45
*** jcoufal has quit IRC18:45
*** e0ne has joined #openstack-infra18:46
*** rbuzatu has joined #openstack-infra18:46
openstackgerritMonty Taylor proposed openstack-infra/shade: Upload images to swift as application/octet-stream  https://review.openstack.org/42427418:46
openstackgerritMonty Taylor proposed openstack-infra/shade: Add ability to stream object directly to file  https://review.openstack.org/42366118:46
*** mrtenio has joined #openstack-infra18:46
*** esikachev has quit IRC18:47
*** beagles is now known as beagles-brb18:47
*** jcoufal__ has quit IRC18:48
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI  https://review.openstack.org/42428718:48
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temprevert broken bigswitch backport  https://review.openstack.org/42428818:49
*** erikmwil_ has quit IRC18:50
openstackgerritMerged openstack-infra/tripleo-ci: Revert "enable Placement API on multinode jobs"  https://review.openstack.org/42412118:50
*** rbuzatu has quit IRC18:50
*** erikmwil_ has joined #openstack-infra18:50
openstackgerritMerged openstack-infra/project-config: Make python3 rally job voting in Neutron  https://review.openstack.org/42287218:50
*** yamahata has quit IRC18:51
*** mriedem has quit IRC18:55
*** shardy is now known as shardy_afk18:55
*** Guest75281 is now known as jimbaker`18:57
*** sree has joined #openstack-infra18:57
*** jcoufal has joined #openstack-infra18:58
*** jimbaker` is now known as jimbaker18:59
*** jcoufal_ has quit IRC19:01
openstackgerritKhai Do proposed openstack/python-jenkins: for HTTPS with SSL context, removed not used import and added context to a tests  https://review.openstack.org/25815619:01
openstackgerritKhai Do proposed openstack/python-jenkins: Adding HTTPS capability to urlib.request/urlopen through ssl context  https://review.openstack.org/25812719:01
*** rbuzatu has joined #openstack-infra19:02
*** kukacz has quit IRC19:03
*** sree has quit IRC19:03
*** rbrndt has joined #openstack-infra19:06
*** jcoufal_ has joined #openstack-infra19:07
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419019:08
*** shamail has joined #openstack-infra19:08
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809819:09
*** trown|lunch is now known as trown19:09
*** jcoufal has quit IRC19:10
*** jcoufal__ has joined #openstack-infra19:10
*** sdake has quit IRC19:10
*** bkorren has joined #openstack-infra19:12
*** maishsk has joined #openstack-infra19:12
*** jcoufal_ has quit IRC19:12
*** electrofelix has quit IRC19:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Assign node set to node requests  https://review.openstack.org/42350219:13
*** shamail has quit IRC19:14
*** amotoki has joined #openstack-infra19:18
dansmithreposting here: <dansmith>anyone else seeing this packaging failure on grenade runs? http://logs.openstack.org/75/396775/42/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/288846c/logs/grenade.sh.txt.gz#_2017-01-23_18_37_57_57319:18
*** gouthamr has quit IRC19:20
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351919:21
pabelangeryes19:21
*** Sukhdev_ has joined #openstack-infra19:21
pabelangerfor some reason packaging 16.7 is getting pulled from mirror19:21
*** EricGonczer_ has quit IRC19:22
*** sdague has joined #openstack-infra19:22
*** knikolla has quit IRC19:23
*** beagles-brb is now known as beaglkes19:23
*** knikolla has joined #openstack-infra19:23
*** knikolla has quit IRC19:23
*** beaglkes is now known as beagles19:24
*** knikolla has joined #openstack-infra19:24
*** knikolla has quit IRC19:24
*** knikolla has joined #openstack-infra19:24
*** knikolla has quit IRC19:24
*** inc0 has joined #openstack-infra19:25
*** knikolla has joined #openstack-infra19:25
*** knikolla has quit IRC19:25
*** EricGonczer_ has joined #openstack-infra19:25
pabelangerk, found it in upper-constraints19:25
*** knikolla has joined #openstack-infra19:25
*** knikolla has quit IRC19:25
*** matrohon has joined #openstack-infra19:26
*** sshnaidm is now known as sshnaidm|afk19:27
openstackgerritMerged openstack-infra/tripleo-ci: Handle RETRY_LIMIT failure type in cistatus script  https://review.openstack.org/42420019:28
*** yamahata has joined #openstack-infra19:30
*** hashar has joined #openstack-infra19:30
*** rbuzatu has quit IRC19:30
*** strigazi is now known as strigazi_AFK19:30
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Assign node set to node requests  https://review.openstack.org/42350219:31
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add nodepoold test for request decline and fail  https://review.openstack.org/42429819:31
fungidansmith: pabelanger: got it figured out?19:31
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: fix tools for listing unreleased changes  https://review.openstack.org/42147419:31
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: skip reno when release-notes is only getting a list of changes  https://review.openstack.org/42147519:31
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: do not use title to show when a repo is being cloned  https://review.openstack.org/42429919:31
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: do not create the venv virtualenv when it already exists  https://review.openstack.org/42430019:31
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: script to report on unreleased changes of deliverables with no releases  https://review.openstack.org/42430119:31
dansmithfungi: I've figured out that pabelanger has it figured out19:31
pabelangerfungi: still digging, nothing yet19:32
*** dizquierdo has joined #openstack-infra19:33
*** rbuzatu has joined #openstack-infra19:33
fungii'll skim the log in that case. extra set of eyes can't hurt19:33
*** rbuzatu has quit IRC19:34
*** rbuzatu has joined #openstack-infra19:34
*** jkilpatr has quit IRC19:34
oomichiAJaeger: thanks for picking https://review.openstack.org/#/c/424107 up, +1.  We discussed it before on irc meeting, I think most qa members love it :)19:35
openstackgerritMerged openstack/python-jenkins: Allow to wait for jenkins to enter normal operation  https://review.openstack.org/15526319:38
*** tphummel has joined #openstack-infra19:39
pabelangerfungi: not sure why yet, we pip install packaging 16.7 from /opt/stack/old/requirements/upper-constraints.txt then complain about version conflict for >=16.819:40
fungi"Found existing installation: packaging 16.819:40
*** sdake has joined #openstack-infra19:40
fungi"19:40
AJaegeroomichi: thanks for confirming. Then I'll happily +219:41
funginot sure how that's getting installed as all the previous references are for 16.719:41
pabelangerfungi: yes, seen that too. We do uninstall properly19:42
fungioh19:42
fungihttp://git.openstack.org/cgit/openstack/requirements/tree/upper-constraints.txt#n25719:43
fungithat's forcing 16.819:43
pabelangerhttps://review.openstack.org/#/c/388555/ was the change, 3 month ago19:44
pabelangerwonder if something is recently installing 16.8, but only exposed the issue because of the reinstall attempt19:45
*** nadya has quit IRC19:45
fungiaha, i think we're mixing constraints files between stable/newton and master :/19:45
fungihttps://git.openstack.org/cgit/openstack/requirements/tree/upper-constraints.txt?h=stable/newton#n23519:46
pabelangerya19:46
fungithat's what'll be in /opt/stack/old/requirements/upper-constraints.txt19:46
pabelangermight be right19:46
*** ociuhandu has quit IRC19:47
*** jkilpatr has joined #openstack-infra19:47
*** dharinic|lunch is now known as dharinic19:49
*** jaosorior has quit IRC19:50
*** erikmwil_ has quit IRC19:50
*** sdake has quit IRC19:51
fungiit's still not entirely clear to me what is requiring "packaging>=16.8" though19:51
*** sdake has joined #openstack-infra19:51
pabelangerfungi: I see a recent change related to devstack-tools19:51
*** erikmwil_ has joined #openstack-infra19:51
pabelangernot sure what that is19:51
fungithe constraints file in use seems to be the one from stable/newton19:51
pabelangerhttps://pypi.python.org/pypi/devstack-tools was released today19:52
fungiyeah, they recently started using devstack-tools to abstract out some common routines, but that doesn't look like ot drags in a dep on packaging19:53
pabelangerya, I don't see anything related to packaging19:53
sdaguedevstack-tools only requires pbr19:54
*** tphummel has quit IRC19:56
fungii think one of the transitive deps of openstack.requirements stable/newton must have recently started declaring an install_requires on packaging>=16.819:58
*** tphummel has joined #openstack-infra19:59
pabelangerlooking at http://logs.openstack.org/85/378585/8/check/gate-grenade-dsvm-neutron-ubuntu-xenial/362ac9a/logs/grenade.sh.txt.gz I don't see the downgrading of packaging 16.820:00
*** sdake_ has joined #openstack-infra20:00
pabelangercurrently trying to see what is installing it now20:00
*** sdague has quit IRC20:00
*** sdake has quit IRC20:03
*** jcoufal__ is now known as jcoufal20:04
*** ssbarnea has quit IRC20:04
jrolldoes someone mind a +A to add an experimental job to run ironic with nova's new-style scheduling things? thanks :) https://review.openstack.org/#/c/407645/20:04
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Semi-automatic doc generation of element dependency  https://review.openstack.org/42287420:05
*** panda|bbl is now known as panda20:05
openstackgerritMerged openstack-infra/tripleo-ci: Extract /etc from subnode logs for easy browser viewing  https://review.openstack.org/41770820:06
*** ssbarnea has joined #openstack-infra20:08
*** sdake_ has quit IRC20:09
*** hurgleburgler has quit IRC20:10
*** dprince has quit IRC20:10
pabelangerfungi: https://github.com/pypa/setuptools/blob/master/setup.py#L16620:10
pabelangerwe have a new release of setuptools today20:10
pabelangerI think that is the issue20:10
*** sdake has joined #openstack-infra20:10
fungipahuang: yep, i just managed to recreate it locally as well20:11
fungier, pabelanger ^20:11
fungi(sorry pahuang!)20:11
fungithis makes for a nice deadlock20:11
fungibasically, if we're going to work with latest setuptools, all our supported branches need to get updated to use setuptools' minimum install_requires i think20:12
fungimordred: dhellmann: ^ ?20:12
pabelangerthink so too20:12
dhellmannsigh20:13
pabelangermaybe pin setuptools to releast the pressure in the gate first?20:13
fungiwhich _is_ the case with master upper-constraints.txt20:13
pabelangerthen see how we do a proper fix20:13
fungibut we'll need to do the same on stable branches20:13
fungipabelanger: pin setuptools how?20:13
pabelangerfungi: I see an entry in global-requirements.txt, is that used to define compat?20:14
fungipabelanger: yeah, note it doesn't appear in upper-constraints.txt at all20:14
pabelangeractually, let me check nodepool20:15
dhellmannfungi , pabelanger : I see packaging===16.8 in upper-constraints.txt20:16
dhellmannat least on master20:16
*** ldnunes has quit IRC20:16
fungidhellmann: yep, master isn't the issue20:16
fungithis is the "old" side of a grenade job20:16
dhellmannah20:16
*** MasterOfBugs has joined #openstack-infra20:16
dhellmannthen, yeah, it seems updating the constraint is the right way to go20:17
pabelangerconfirmed: setuptools 34.0.0: http://logs.openstack.org/85/378585/8/gate/gate-grenade-dsvm-neutron-ubuntu-xenial/e9e853b/logs/old/devstacklog.txt.gz#_2017-01-23_19_04_52_80120:17
fungidevstack explicitly upgrades to latest setuptools in tools/install_pip.sh per http://logs.openstack.org/75/396775/42/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/288846c/logs/grenade.sh.txt.gz#_2017-01-23_18_37_41_43420:17
pabelangerfungi: yup, seen that too20:17
pabelangerdhellmann: fungi: k, just confirming, we'd have to update upper-constraints.txt on all branches to packaging===16.820:19
dhellmannI wonder if it would make more sense to not constrain packaging, since it's a setuptools dependency20:19
dhellmannthat'll need more thought, though, so let's do the obvious fix for now20:20
pabelangerk, let me get a patch up20:20
fungiperhaps. we also constrain six and appdirs but those constraints fall within setuptools' minimum install_requires20:20
fungipabelanger: you'll likely need to get the mitaka patch proposed, then make the newton patch depends-on it20:21
pabelangerfungi: k20:22
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Assign node set to node requests  https://review.openstack.org/42350220:25
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add nodepoold test for request decline and fail  https://review.openstack.org/42429820:25
pabelangerdhellmann: fungi: https://review.openstack.org/#/c/424320/20:26
pabelangersix looks to be safe20:26
fungiyeah, six and appdirs are already constrainted to appropriate versions in all supported branches, so packaging is the only one we need to tweak20:27
*** rfolco has quit IRC20:27
pabelangerhttps://review.openstack.org/#/c/424323/20:28
pabelangerI believe that is correct20:28
fungipabelanger: as i said a moment ago, i think you'll need to do mitaka first and then make the newton change depends-on it20:29
fungiotherwise grenade jobs for the newton fix are going to fail because of the same problem in mitaka20:29
pabelangerfungi: should be that way now20:29
fungid'oh, i see you have more than one20:30
fungididn't realize you meant 424323 and a dependency20:30
pabelangerI should have linked them together, sorry about that20:30
funginp. lgtm20:30
*** pradk- has joined #openstack-infra20:31
*** pradk has quit IRC20:31
fungiif these pass jobs, then once we approve i can kick them to the front of the gate20:31
*** kzaitsev_mb has joined #openstack-infra20:32
pabelangerack20:33
*** admcleod_ has joined #openstack-infra20:34
*** kzaitsev_mb has quit IRC20:36
*** admcleod has quit IRC20:36
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode scenario job for repo promotion  https://review.openstack.org/42428220:39
*** prometheanfire has joined #openstack-infra20:41
prometheanfirepabelanger: :P20:41
*** Cibo has quit IRC20:41
prometheanfirepabelanger: I'll close mine in favor of yours20:43
prometheanfirepabelanger: where was the fast +2 given?20:43
pabelangerprometheanfire: ah, ya. Didn't see your patch. but we did discuss the fix in the backscroll20:43
prometheanfireah, tried getting attention on it in -stable, but it's a bit of a ghost town now20:44
*** dtardivel has quit IRC20:44
*** EricGonc_ has joined #openstack-infra20:44
*** Cibo has joined #openstack-infra20:45
*** EricGonczer_ has quit IRC20:46
*** mhickey has joined #openstack-infra20:48
fungii +2'd it due to it being a ci blocker20:48
fungisudden dependency-related breakages due to new releases of outside requirements tends to get discussed in here20:49
fungier, tend to20:49
*** jcoufal_ has joined #openstack-infra20:50
*** Cibo has quit IRC20:50
prometheanfireyarp20:51
*** maishsk has quit IRC20:51
*** Cibo has joined #openstack-infra20:53
*** jcoufal has quit IRC20:53
*** jcoufal has joined #openstack-infra20:53
*** jcoufal_ has quit IRC20:56
fungibut yes, we should at least trickle that discussion down into the stable branch channel too20:57
*** shamail has joined #openstack-infra20:58
*** pradk- is now known as pradk20:58
*** hichihara has joined #openstack-infra20:58
*** wolverin_ has quit IRC20:58
*** ociuhandu has joined #openstack-infra21:02
*** wolverineav has joined #openstack-infra21:03
*** adriant has joined #openstack-infra21:06
*** maishsk has joined #openstack-infra21:06
*** raildo has quit IRC21:07
*** umeshksingla has joined #openstack-infra21:07
*** wolverineav has quit IRC21:07
*** EricGonc_ has quit IRC21:08
*** yuvalb has quit IRC21:09
*** wolverineav has joined #openstack-infra21:09
*** oanson has quit IRC21:10
*** lihi has quit IRC21:10
*** dimak has quit IRC21:10
prometheanfirek, /parting :D21:10
*** prometheanfire has left #openstack-infra21:10
*** dimtruck is now known as zz_dimtruck21:11
dansmithpabelanger: fungi: is 424323 the one I should watch to wait for a recheck?21:13
*** wolverineav has quit IRC21:14
fungidansmith: yes, i believe so21:16
bhunter71what's the minimum number of 'zuul nodes' one needs nowadays?   I'm behind on zuul-launchers, zuul-mergers, zl-statics21:16
fungidansmith: it and its dependency will need to merge21:16
dansmithfungi: yeah, okay thanks21:16
jeblairbhunter71: with jenkins?21:17
bhunter71without jenkins21:17
jeblairbhunter71: then you'll need one zuul-server, at least one zuul-merger (same as always), plus at least one zuul-launcher21:18
pabelangerfungi: dansmith: ya, 424323 will need a recheck, looks like we failed to connection to mirror in infracloud for some reason21:18
jeblairbhunter71: in v2.5 zuul-launcher is analagous to a jenkins master21:19
bhunter71jeblair, do you recall which component of the above is the gearman listener?21:19
fungipabelanger: as log as the grenade jobs pass, i'm okay directly enqueuing into the gate rather than waiting for additional rounds in check21:19
bhunter71sorry, the zmq port listener, 888821:19
pabelangerfungi: WFM21:19
jeblairbhunter71: we have a bunch of zuul-launchers which nodepool assigns nodes to, and one zuul-launcher which only has static nodes assigned to it21:20
jeblairbhunter71: (that's zlstatic01.openstack.org).  you don't have to set it up that way.21:20
jeblairbhunter71: (we do for security purposes)21:20
jeblairbhunter71: zuul-launcher has the zmq listener21:20
bhunter71well, me running without any 'launcher' service at all might have explained some things there ;/21:20
*** mrtenio is now known as mrtenio-afk21:20
*** yamamoto has joined #openstack-infra21:20
jeblairbhunter71: yeah, we don't recommend people use this, since it's really only intended to be a bridge for openstack between zuul v2 and v321:21
jeblairbhunter71: i forget -- have we tried to scare you off from running v2.5 yet? :)21:21
jeblairbhunter71: (the temporary nature of the v2.5 zuul launcher is why we didn't document it or update the puppet-openstackci module to use it by default)21:22
fungihence the near-nonexistent documentation for it21:22
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419021:22
jeblairv3 will have actual documentation :)21:22
*** ijw has joined #openstack-infra21:23
fungiand will be a good bit different from 2.5 to booty21:23
fungier, to boot21:23
*** mhickey has quit IRC21:23
pabelangeryar!21:23
* fungi wondered if he could claim it's another talk-like-a-pirate day to explain away that typo21:23
*** mrtenio-afk has quit IRC21:24
*** umeshksingla has quit IRC21:25
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Abandon nodepool launch worker spec  https://review.openstack.org/42423021:25
fungineeded a rebase since i edited the commit message of its parent earlier21:26
jeblairah... wondered what i screwed up on that one :)21:26
*** shardy_afk has quit IRC21:27
*** dimak has joined #openstack-infra21:29
*** yuvalb has joined #openstack-infra21:29
armaxhi folks21:29
Shrewsoh neat. i'm handling two specs at once21:29
armaxwe’re seeing a failure in the gate21:30
*** hashar has quit IRC21:30
*** oanson has joined #openstack-infra21:30
*** lihi has joined #openstack-infra21:30
armaxthis is the trace21:30
armaxhttp://logs.openstack.org/93/404293/41/check/gate-grenade-dsvm-neutron-ubuntu-xenial/0b6f384/logs/grenade.sh.txt.gz#_2017-01-23_19_02_20_38921:30
armaxI wonder if you had any suggestion on what might have gone wrong?21:30
fungiarmax: we think https://review.openstack.org/424323 will solve it21:30
armaxfungi: excellent, thanks for the pointer21:31
fungiarmax: fallout from a new setuptools release today demanding newer version of one of its dependencies than we pin in stable constraints lists21:31
*** camunoz has quit IRC21:31
armaxfungi: ack21:31
armaxthanks21:31
*** tphummel has quit IRC21:32
*** zz_dimtruck is now known as dimtruck21:32
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: script to report on unreleased changes of deliverables with no releases  https://review.openstack.org/42430121:32
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: add a summary report for inactive projects  https://review.openstack.org/42433621:32
*** jkilpatr has quit IRC21:34
*** Jeffrey4l_ has joined #openstack-infra21:34
*** Goneri has quit IRC21:35
*** thorst_ has quit IRC21:35
*** bexelbie has quit IRC21:35
*** Jeffrey4l__ has quit IRC21:35
openstackgerritMerged openstack-infra/infra-specs: Abandon nodepool launch worker spec  https://review.openstack.org/42423021:35
*** sdake has quit IRC21:35
*** kgiusti has left #openstack-infra21:35
*** thorst_ has joined #openstack-infra21:35
*** sdake has joined #openstack-infra21:36
*** srobert_ has joined #openstack-infra21:36
*** bexelbie has joined #openstack-infra21:37
*** tonytan4ever has quit IRC21:37
openstackgerritMerged openstack-infra/zuul: Reorganize connections into drivers  https://review.openstack.org/40884921:38
openstackgerritMerged openstack-infra/zuul: Re-enable zuultrigger test  https://review.openstack.org/40884821:39
openstackgerritMerged openstack-infra/zuul: Separate driver interfaces and make abstract  https://review.openstack.org/41855421:39
openstackgerritMerged openstack-infra/zuul: Add Drivers to documentation  https://review.openstack.org/42280421:39
*** srobert has quit IRC21:39
*** pvaneck has joined #openstack-infra21:40
*** thorst_ has quit IRC21:40
*** srobert_ has quit IRC21:41
*** maishsk has quit IRC21:41
*** yamamoto has quit IRC21:43
*** bkorren has quit IRC21:43
*** EricGonczer_ has joined #openstack-infra21:44
*** camunoz has joined #openstack-infra21:44
*** adrian_otto has quit IRC21:45
*** matrohon has quit IRC21:45
*** adrian_otto has joined #openstack-infra21:46
pabelangerfungi: did you want to enqueue 424323 to gate and promote 424323 424320?21:46
pabelangersingle job failure on 42432321:46
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Clean up testenv if Jenkins instance goes away  https://review.openstack.org/42434321:46
fungipabelanger: yeah, i was just commenting on the review first for posterity21:47
*** markvoelker has quit IRC21:47
*** jkilpatr has joined #openstack-infra21:47
pabelanger++21:48
*** gordc has quit IRC21:48
fungiboth promoted now21:48
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Clean up testenv if Jenkins instance goes away  https://review.openstack.org/42434321:49
*** wolverineav has joined #openstack-infra21:50
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Clean up testenv if Jenkins instance goes away  https://review.openstack.org/42434321:52
*** fguillot has quit IRC21:54
*** wolverineav has quit IRC21:54
*** priteau has quit IRC21:55
*** oanson has quit IRC21:56
jheskethMorning21:57
*** oanson has joined #openstack-infra21:57
*** thorst_ has joined #openstack-infra21:58
ianwhello21:59
*** shamail has quit IRC22:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:01
*** hichihara has quit IRC22:01
*** thorst_ has quit IRC22:03
*** harlowja has quit IRC22:03
*** eharney has quit IRC22:03
*** baoli has quit IRC22:04
*** e0ne has quit IRC22:04
*** kukacz has joined #openstack-infra22:05
*** wolverineav has joined #openstack-infra22:05
*** e0ne has joined #openstack-infra22:06
*** e0ne has quit IRC22:06
*** e0ne has joined #openstack-infra22:06
*** e0ne has quit IRC22:07
*** e0ne has joined #openstack-infra22:07
*** dprince has joined #openstack-infra22:07
*** e0ne has quit IRC22:08
*** e0ne has joined #openstack-infra22:08
*** e0ne has quit IRC22:08
*** e0ne has joined #openstack-infra22:09
*** e0ne has quit IRC22:09
*** wolverineav has quit IRC22:10
*** burgerk has quit IRC22:10
*** jheroux has quit IRC22:12
*** wolverineav has joined #openstack-infra22:12
*** thorst_ has joined #openstack-infra22:13
*** dprince has quit IRC22:15
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435422:17
*** rbuzatu has quit IRC22:21
*** thorst_ has quit IRC22:22
*** trown is now known as trown|outtypewww22:22
*** yamamoto has joined #openstack-infra22:23
*** oanson has quit IRC22:24
*** EricGonczer_ has quit IRC22:25
*** oanson has joined #openstack-infra22:25
*** ihrachys has quit IRC22:27
*** vhosakot has quit IRC22:28
*** dizquierdo has quit IRC22:29
*** vhosakot has joined #openstack-infra22:30
*** vhosakot has quit IRC22:30
*** askb has joined #openstack-infra22:32
*** tnovacik has quit IRC22:37
bhunter71my nodepool is in this state where a node is 'ready', yet it is running, in fact passes jenkins jobs.  I thought this typically had something to do with ZMQ module in jenkins-  I have all the TCP connections open that I would expect.22:38
*** rbuzatu has joined #openstack-infra22:42
jeblairbhunter71: yeah, nodepool still needs to get those events over zmq, so if you're using zuul-launcher, it needs to be configured to connect to each zuul-launcher over zmq.22:43
*** matt-borland has quit IRC22:44
bhunter71oh, you've sufficiently talked me out of zuul-launching, I think22:44
*** camunoz has quit IRC22:45
jeblairbhunter71: oh ok. then, yeah, you need the zmq plugin for jenkins running (i think it has to be enabled globally?)  and nodepool configured to talk to that port on each master22:46
bhunter71my zuul version is Zuul version: 2.5.2.dev44, btw, and I'm now trying to use jenkins-master still22:46
*** rbuzatu has quit IRC22:46
bhunter71my zuul might not be complete, it's only the 'zuul' as defined in newest/currect system-config22:47
*** thiagolib has quit IRC22:48
*** mtanino has quit IRC22:49
*** marst has quit IRC22:51
*** tphummel has joined #openstack-infra22:54
*** Swami_ has joined #openstack-infra22:56
*** camunoz has joined #openstack-infra22:58
*** jamesdenton has quit IRC23:00
*** Swami has quit IRC23:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Put Zuul vars in an ansible vars file  https://review.openstack.org/42436723:00
*** adrian_otto has quit IRC23:00
*** voldz1tic3n has quit IRC23:00
*** Swami_ has quit IRC23:01
*** rbuzatu has joined #openstack-infra23:03
*** mdrabe has quit IRC23:05
*** rbuzatu has quit IRC23:07
*** panda is now known as panda|zZ23:10
*** sdake_ has joined #openstack-infra23:19
openstackgerritMerged openstack/diskimage-builder: ironic-agent: use /sbin for modprobe  https://review.openstack.org/42389323:19
*** sdake has quit IRC23:22
jeblairinfra-root: apparently an existing held node with a null comment breaks the auto-hold feature23:22
jeblairso to whomever anonymously held tripleo-centos-7-tripleo-test-cloud-rh1-6825451 i'm about to delete it23:23
jeblair(let's make the hold reason required in future nodepool versions)23:23
*** rbuzatu has joined #openstack-infra23:24
*** xyang1 has quit IRC23:25
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419023:25
*** ihrachys has joined #openstack-infra23:25
*** sdake_ is now known as sdake23:26
*** rbuzatu has quit IRC23:29
*** jkilpatr has quit IRC23:29
*** ihrachys has quit IRC23:30
*** ssbarnea has quit IRC23:33
ianwwasn't me :)23:33
ianwwow gnu parallel is just about an operating system to itself23:33
*** harlowja has joined #openstack-infra23:34
*** harlowja has quit IRC23:35
*** dave-mccowan has quit IRC23:38
*** mtanino has joined #openstack-infra23:40
*** mriedem has joined #openstack-infra23:40
*** Swami has joined #openstack-infra23:41
*** ianychoi has quit IRC23:43
*** EricGonczer_ has joined #openstack-infra23:44
*** dimtruck is now known as zz_dimtruck23:44
*** sdake has quit IRC23:45
*** harlowja has joined #openstack-infra23:48
*** stakeda has joined #openstack-infra23:49
*** gildub has joined #openstack-infra23:55
*** dingyichen has joined #openstack-infra23:55
*** tphummel has quit IRC23:56
*** Julien-zte has joined #openstack-infra23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!