Monday, 2017-05-01

*** esikachev has joined #openstack-infra00:00
*** askb has joined #openstack-infra00:01
*** esberglu has joined #openstack-infra00:03
*** tphummel has quit IRC00:03
*** esikachev has quit IRC00:04
*** esberglu has quit IRC00:07
rm_workhmmm00:13
rm_workhttp://logs.openstack.org/54/459654/9/check/gate-octavia-v1-dsvm-py3x-scenario-ubuntu-xenial/7f937da/logs/devstacklog.txt.gz#_2017-04-30_23_48_45_95600:13
rm_workdrwxr-xr-x 2 stack root 4096 Apr 30 23:48 /var/cache/octavia00:13
rm_workstack 7627 0.0 0.0 13340 1100 '?' S 23:48 0:00 grep apache2 root 27414 0.0 0.0 89992 5976 '?' Ss 23:39 0:00 /usr/sbin/apache2 -k start www-data 27417 0.0 0.1 448592 15116 '?' Sl 23:39 0:00 /usr/sbin/apache2 -k start www-data 27418 0.0 0.1 514144 13852 '?' Sl 23:39 0:00 /usr/sbin/apache2 -k start00:13
rm_workso apache2 IS running as stack! I was wrong00:13
rm_workbut00:13
rm_workthe dir is owned by stack too00:13
rm_workand still00:13
rm_workhttp://logs.openstack.org/54/459654/9/check/gate-octavia-v1-dsvm-py3x-scenario-ubuntu-xenial/7f937da/logs/apache/octavia_error.txt.gz#_2017-05-01_00_05_27_36200800:13
rm_work...00:13
*** neiljerram has quit IRC00:23
rm_workapache running in a chroot?00:25
rm_workthis is exactly the same thing glance does...00:29
*** rkukura has joined #openstack-infra00:31
*** EricGonczer_ has quit IRC00:31
*** ijw has joined #openstack-infra00:32
*** baoli has joined #openstack-infra00:33
rm_workhttp://logs.openstack.org/54/459654/9/check/gate-octavia-v1-dsvm-py3x-scenario-ubuntu-xenial/7f937da/logs/apache/octavia_error.txt.gz#_2017-05-01_00_05_27_36200800:36
*** ijw has quit IRC00:38
johnsomHmmm00:38
*** amotoki has joined #openstack-infra00:38
*** baoli has quit IRC00:38
*** amotoki has quit IRC00:42
*** esikachev has joined #openstack-infra00:59
*** Goneri has joined #openstack-infra01:02
*** esikachev has quit IRC01:03
*** EricGonczer_ has joined #openstack-infra01:03
*** baoli has joined #openstack-infra01:06
*** EricGonczer_ has quit IRC01:08
*** Goneri has quit IRC01:08
*** thorst has joined #openstack-infra01:14
*** rkukura has quit IRC01:14
*** salv-orlando has joined #openstack-infra01:16
*** thorst has quit IRC01:19
*** salv-orlando has quit IRC01:22
*** baoli has quit IRC01:24
*** baoli has joined #openstack-infra01:24
*** nicolasbock has joined #openstack-infra01:26
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Store cache expiry times per status object  https://review.openstack.org/46133001:28
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use routes for URL handling in webapp  https://review.openstack.org/46133101:28
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use tenant_name to look up project key  https://review.openstack.org/46133201:28
*** ijw has joined #openstack-infra01:30
*** baoli has quit IRC01:31
*** mat128 has joined #openstack-infra01:32
*** thorst has joined #openstack-infra01:33
*** qba73 has joined #openstack-infra01:34
*** slagle has joined #openstack-infra01:34
*** yamahata_ has joined #openstack-infra01:35
*** qba73 has quit IRC01:39
*** thorst has quit IRC01:41
*** tphummel has joined #openstack-infra01:43
openstackgerritRosario Di Somma proposed openstack-infra/shade master: Use REST API for volume delete and detach calls  https://review.openstack.org/46133301:44
*** esikachev has joined #openstack-infra01:57
*** esikachev has quit IRC02:01
*** esikachev has joined #openstack-infra02:03
*** mat128 has quit IRC02:07
*** esikachev has quit IRC02:07
*** mat128 has joined #openstack-infra02:13
*** mat128 has quit IRC02:17
*** salv-orlando has joined #openstack-infra02:18
*** jascott1 has joined #openstack-infra02:22
*** salv-orlando has quit IRC02:22
*** yamamoto has joined #openstack-infra02:24
*** jascott1 has quit IRC02:26
*** thorst has joined #openstack-infra02:38
*** amotoki has joined #openstack-infra02:39
*** tphummel has quit IRC02:41
*** amotoki has quit IRC02:43
*** thorst has quit IRC02:56
*** ijw has quit IRC03:01
*** ijw has joined #openstack-infra03:02
*** esikachev has joined #openstack-infra03:03
*** armax has joined #openstack-infra03:06
*** ijw has quit IRC03:06
*** esikachev has quit IRC03:08
*** psachin has joined #openstack-infra03:09
*** asselin_ has quit IRC03:12
*** asselin_ has joined #openstack-infra03:12
*** psachin has quit IRC03:13
*** mat128 has joined #openstack-infra03:16
*** dave-mccowan has quit IRC03:22
*** jascott1 has joined #openstack-infra03:24
*** yamamoto has quit IRC03:27
*** jascott1 has quit IRC03:28
*** vikrant has joined #openstack-infra03:29
*** masber has quit IRC03:29
*** nicolasbock has quit IRC03:31
*** qba73 has joined #openstack-infra03:35
*** psachin has joined #openstack-infra03:39
*** yamahata_ has quit IRC03:40
*** qba73 has quit IRC03:40
*** armax has quit IRC03:41
*** tphummel has joined #openstack-infra03:49
*** dhajare has joined #openstack-infra03:49
*** dimtruck is now known as zz_dimtruck03:50
*** thorst has joined #openstack-infra03:53
*** thorst has quit IRC03:58
*** armax has joined #openstack-infra04:00
*** ijw has joined #openstack-infra04:02
*** esikachev has joined #openstack-infra04:04
*** ijw has quit IRC04:07
*** esikachev has quit IRC04:08
*** armax has quit IRC04:09
*** yamamoto has joined #openstack-infra04:09
*** links has joined #openstack-infra04:12
*** armax has joined #openstack-infra04:14
*** esberglu has joined #openstack-infra04:14
*** dhajare has quit IRC04:16
*** dhajare has joined #openstack-infra04:19
*** sshnaidm is now known as sshnaidm|pto04:19
*** esberglu has quit IRC04:19
openstackgerritAnne Gentle proposed openstack-infra/reviewstats master: Adds doc and api-ref stat measures  https://review.openstack.org/46128004:21
*** tonytan4ever has joined #openstack-infra04:25
*** lamt has quit IRC04:26
*** sbezverk has quit IRC04:31
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use routes for URL handling in webapp  https://review.openstack.org/46133104:32
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use tenant_name to look up project key  https://review.openstack.org/46133204:32
*** ijw has joined #openstack-infra04:38
*** afred312 has quit IRC04:40
*** afred312 has joined #openstack-infra04:41
*** ijw has quit IRC04:42
*** armax has quit IRC04:46
*** dhajare has quit IRC04:51
*** thorst has joined #openstack-infra04:54
*** thorst has quit IRC04:58
*** armax has joined #openstack-infra05:00
*** armax has quit IRC05:04
*** esikachev has joined #openstack-infra05:05
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Store cache expiry times per status object  https://review.openstack.org/46133005:08
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use routes for URL handling in webapp  https://review.openstack.org/46133105:08
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Use tenant_name to look up project key  https://review.openstack.org/46133205:08
*** esberglu has joined #openstack-infra05:08
*** esikachev has quit IRC05:09
*** esberglu has quit IRC05:12
*** isaacb has joined #openstack-infra05:16
*** salv-orlando has joined #openstack-infra05:20
*** salv-orlando has quit IRC05:25
*** chkumar|off is now known as chandankumar05:27
*** jascott1 has joined #openstack-infra05:27
openstackgerritMerged openstack-infra/project-config master: TripleO: experimental container upgrade job on more repos  https://review.openstack.org/46100705:32
*** jascott1 has quit IRC05:33
*** qba73 has joined #openstack-infra05:36
openstackgerritMerged openstack-infra/project-config master: neutron: add ovs firewall tempest job to check queue  https://review.openstack.org/46040905:37
openstackgerritMerged openstack-infra/project-config master: Make gate-ironic-inspector-tox-func3 voting  https://review.openstack.org/46091405:39
*** ijw has joined #openstack-infra05:39
*** lamt has joined #openstack-infra05:40
*** qba73 has quit IRC05:41
*** tphummel has quit IRC05:45
*** ijw has quit IRC05:46
*** thorst has joined #openstack-infra05:54
*** esikachev has joined #openstack-infra05:58
*** thorst has quit IRC05:59
*** ramishra has joined #openstack-infra06:01
*** esikachev has quit IRC06:08
*** adriant has quit IRC06:08
*** jascott1 has joined #openstack-infra06:11
*** ramishra has quit IRC06:14
*** waves_ has joined #openstack-infra06:17
*** esikachev has joined #openstack-infra06:20
*** salv-orlando has joined #openstack-infra06:22
*** salv-orlando has quit IRC06:26
*** waves_ has quit IRC06:30
openstackgerritMerged openstack-infra/project-config master: Clean up driverfixes branch jobs  https://review.openstack.org/46110206:34
openstackgerritEvgeniy Shatokhin proposed openstack-infra/jenkins-job-builder master:  added parsing of groovy-script option in Extended choice parameter  https://review.openstack.org/46134306:36
*** salv-orlando has joined #openstack-infra06:37
*** amotoki has joined #openstack-infra06:40
openstackgerritMerged openstack-infra/project-config master: Remove useless quotes for nodes  https://review.openstack.org/45906506:42
openstackgerritMerged openstack-infra/project-config master: [Zun] Add release jobs for Zun server  https://review.openstack.org/46118806:42
openstackgerritMerged openstack-infra/project-config master: Publish openstack-doc-tools documents  https://review.openstack.org/46124806:42
openstackgerritMerged openstack-infra/project-config master: Make the TripleO job non-voting on Mistral for now  https://review.openstack.org/46103906:42
openstackgerritMerged openstack-infra/project-config master: Enable monasca-transform dvsm functional tests  https://review.openstack.org/46082206:42
openstackgerritMerged openstack-infra/project-config master: Add docs job for openstack-helm  https://review.openstack.org/46092506:42
*** ijw has joined #openstack-infra06:43
openstackgerritMerged openstack-infra/project-config master: [Fuxi] Add devstack-plugin-container to PROJECTS  https://review.openstack.org/46121906:43
openstackgerritMerged openstack-infra/project-config master: [Kuryr] Use gate hook in dsvm jobs  https://review.openstack.org/46122606:43
openstackgerritMerged openstack-infra/project-config master: [Zun] Add zun-ui server release job  https://review.openstack.org/46081506:43
openstackgerritMerged openstack-infra/project-config master: Don't run tempest tests in heat grenade job  https://review.openstack.org/46081006:43
openstackgerritMerged openstack-infra/project-config master: Added api-ref jobs for freezer-api  https://review.openstack.org/46017906:44
openstackgerritMerged openstack-infra/project-config master: Load plugin configuration for the ceph job  https://review.openstack.org/45944506:44
openstackgerritMerged openstack-infra/project-config master: netwokring-odl: typo in grafana/networking-odl  https://review.openstack.org/45982706:44
*** amotoki has quit IRC06:45
*** ijw has quit IRC06:48
openstackgerritMerged openstack-infra/project-config master: Fix names of uploaded qcow2 files for manila-image-elements  https://review.openstack.org/43984006:50
openstackgerritMerged openstack-infra/project-config master: Add experimental python3 dsvm job for networking-ovn  https://review.openstack.org/45924006:50
openstackgerritMerged openstack-infra/project-config master: Register IRC channel scientific-wg  https://review.openstack.org/45988106:50
openstackgerritMerged openstack-infra/project-config master: Move undercloud-containers job to check-tripleo-undercloud-jobs pipeline  https://review.openstack.org/44694006:51
openstackgerritMerged openstack-infra/project-config master: jenkins/jobs/networking-vpp.yaml: Fixing job config  https://review.openstack.org/45748406:51
openstackgerritMerged openstack-infra/project-config master: add the release notes jobs to python-mistralclient  https://review.openstack.org/45934306:51
openstackgerritMerged openstack-infra/project-config master: Add experimental gate job for murano dashboard  https://review.openstack.org/45819706:51
openstackgerritMerged openstack-infra/project-config master: Add zmq fullstack job for Dragonflow project  https://review.openstack.org/45869906:51
openstackgerritMerged openstack-infra/project-config master: Add release notes job for Patrole  https://review.openstack.org/45911806:51
*** knangia has joined #openstack-infra06:52
*** thorst has joined #openstack-infra06:55
*** andreas-f has quit IRC06:59
*** thorst has quit IRC07:00
*** qba73 has joined #openstack-infra07:01
*** qba73 has quit IRC07:06
*** tesseract has joined #openstack-infra07:06
*** andreas-f has joined #openstack-infra07:07
*** salv-orlando has quit IRC07:08
*** rcernin has joined #openstack-infra07:12
*** dhajare has joined #openstack-infra07:14
*** aviau has quit IRC07:19
*** aviau has joined #openstack-infra07:19
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134607:26
*** dhajare has quit IRC07:29
*** jascott1 has quit IRC07:31
*** rcernin has quit IRC07:32
openstackgerritChaoyi Huang proposed openstack-infra/irc-meetings master: Update Tricircle weekly meeting schedule  https://review.openstack.org/46134707:32
*** tonytan_brb has joined #openstack-infra07:39
*** tonytan4ever has quit IRC07:41
*** Qiming has joined #openstack-infra07:41
*** ijw has joined #openstack-infra07:44
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134607:45
*** masber has joined #openstack-infra07:46
*** esberglu has joined #openstack-infra07:51
openstackgerritMerged openstack/diskimage-builder master: Refactor block_device: passing command line parameters  https://review.openstack.org/45904307:51
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134607:54
*** esberglu has quit IRC07:55
*** thorst has joined #openstack-infra07:56
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134607:57
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** ttx has quit IRC08:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove most python 34 jobs  https://review.openstack.org/45634008:00
*** ttx has joined #openstack-infra08:01
AJaegerEmilienM: nearly all tripleo periodic jobs are failing, examples http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-updates/f0df7bf/ and http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/4317d7d/08:02
openstackgerritMerged openstack/diskimage-builder master: Turn off strict_id mode for Ec2 datasource  https://review.openstack.org/45701508:04
openstackgerritMerged openstack/diskimage-builder master: Make Gentoo package updates work more often  https://review.openstack.org/45908208:05
*** ijw has quit IRC08:05
*** d0ugal has quit IRC08:07
*** d0ugal has joined #openstack-infra08:08
*** salv-orlando has joined #openstack-infra08:08
openstackgerritMerged openstack/diskimage-builder master: Clean out apt index caches at end of image build  https://review.openstack.org/45506208:09
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134608:11
*** salv-orlando has quit IRC08:13
*** thorst has quit IRC08:15
*** gildub has quit IRC08:19
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134608:22
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove useless '' for nodes  https://review.openstack.org/46135208:25
*** qba73 has joined #openstack-infra08:35
*** qba73 has quit IRC08:37
AJaegeryolanda: could you put the above nit-picking - nothing urgent - change on your review queue, please? ^08:38
*** wolverineav has joined #openstack-infra08:44
*** verdurin has joined #openstack-infra08:44
*** tonytan_brb has quit IRC08:54
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135308:54
*** esikachev has quit IRC08:54
*** ijw has joined #openstack-infra09:01
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134609:02
*** e0ne has joined #openstack-infra09:05
*** ijw has quit IRC09:07
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135309:07
*** salv-orlando has joined #openstack-infra09:09
*** thorst has joined #openstack-infra09:12
*** salv-orlando has quit IRC09:14
*** thorst has quit IRC09:16
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135309:25
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134609:26
*** john-davidge has joined #openstack-infra09:36
*** esberglu has joined #openstack-infra09:38
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135309:39
*** esberglu has quit IRC09:43
*** john-davidge has quit IRC09:43
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135309:45
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135309:56
*** ijw has joined #openstack-infra10:03
*** wolverineav has quit IRC10:04
*** nicolasbock has joined #openstack-infra10:04
*** wolverineav has joined #openstack-infra10:04
*** gildub has joined #openstack-infra10:07
*** wolverineav has quit IRC10:09
*** sdague has joined #openstack-infra10:09
*** esikachev has joined #openstack-infra10:10
*** salv-orlando has joined #openstack-infra10:10
*** ijw has quit IRC10:12
*** salv-orlando has quit IRC10:15
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block-device base functions.  https://review.openstack.org/46135610:18
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in ports commands  https://review.openstack.org/46135710:19
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Improve documentation for image creation  https://review.openstack.org/46135910:21
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134610:23
*** dizquierdo has joined #openstack-infra10:38
*** jkilpatr has joined #openstack-infra10:41
openstackgerritMerged openstack-infra/irc-meetings master: Update Tricircle weekly meeting schedule  https://review.openstack.org/46134710:42
*** tonytan4ever has joined #openstack-infra10:54
*** rossella_s has joined #openstack-infra10:58
*** chlong has joined #openstack-infra11:07
*** ijw has joined #openstack-infra11:09
*** thorst has joined #openstack-infra11:14
*** ijw has quit IRC11:14
*** isaacb has quit IRC11:17
*** thorst has quit IRC11:18
*** dave-mccowan has joined #openstack-infra11:23
*** esberglu has joined #openstack-infra11:27
*** askb has quit IRC11:27
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in quotas commands  https://review.openstack.org/46136211:27
*** askb has joined #openstack-infra11:28
EmilienMAJaeger: yes we have a regression in osc-lib, so we need to fix tripleoclient11:28
EmilienMAJaeger: periodic jobs are our "promotion" job where it test openstack from master11:29
EmilienMand friday a patch from osc-lib broke us11:29
EmilienMAJaeger: https://bugs.launchpad.net/tripleo/+bug/168703211:29
openstackLaunchpad bug 1687032 in tripleo "Exception raised: 'ClientManager' object has no attribute 'auth'" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)11:29
EmilienMwe are working on it11:29
*** esberglu has quit IRC11:31
*** thorst has joined #openstack-infra11:49
*** askb has quit IRC11:51
*** ykarel has joined #openstack-infra11:54
*** dizquierdo has quit IRC11:54
*** sdague has quit IRC11:55
*** john-davidge has joined #openstack-infra11:55
*** tonytan4ever has quit IRC11:55
*** rossella_s has quit IRC11:59
*** john-davidge has quit IRC12:00
*** gordc has joined #openstack-infra12:01
*** rlandy has joined #openstack-infra12:03
*** dprince has joined #openstack-infra12:07
*** lamt has quit IRC12:07
*** ijw has joined #openstack-infra12:11
*** sdague has joined #openstack-infra12:12
*** ijw has quit IRC12:17
*** wolverineav has joined #openstack-infra12:22
*** amotoki has joined #openstack-infra12:27
*** kgiusti has joined #openstack-infra12:28
*** ykarel has quit IRC12:33
*** vikrant has quit IRC12:35
*** e0ne has quit IRC12:36
*** mdrabe has joined #openstack-infra12:37
*** rhallisey has joined #openstack-infra12:39
*** knangia has quit IRC12:41
*** edmondsw_ has joined #openstack-infra12:45
*** edmondsw_ has quit IRC12:45
*** jaypipes has joined #openstack-infra12:54
*** dklyle has joined #openstack-infra12:57
*** david-lyle has quit IRC12:57
*** lamt has joined #openstack-infra12:58
*** gcb has joined #openstack-infra13:00
sdaguemordred: you up and awake?13:01
sdagueor anyone else willing to get this d-g change in - https://review.openstack.org/#/c/460947/ ?13:01
*** jcoufal has joined #openstack-infra13:03
*** eharney has joined #openstack-infra13:03
*** gcb has quit IRC13:03
*** gcb has joined #openstack-infra13:04
fungilooking13:04
*** jamesmca_ has joined #openstack-infra13:07
*** funzo has joined #openstack-infra13:07
*** funzo_ has joined #openstack-infra13:10
*** funzo has quit IRC13:10
*** salv-orlando has joined #openstack-infra13:12
*** ijw has joined #openstack-infra13:13
*** baoli has joined #openstack-infra13:13
*** trown|outtypewww is now known as trown13:13
*** baoli has quit IRC13:13
*** ykarel has joined #openstack-infra13:14
*** baoli has joined #openstack-infra13:14
*** srobert has joined #openstack-infra13:15
*** jkilpatr has quit IRC13:16
sdaguefungi: thanks13:17
*** salv-orlando has quit IRC13:17
*** ijw has quit IRC13:18
*** ykarel has quit IRC13:18
openstackgerritEvgeniy Shatokhin proposed openstack-infra/jenkins-job-builder master: added parsing of groovy-script option in Extended choice parameter  https://review.openstack.org/46137313:19
*** john-davidge has joined #openstack-infra13:21
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in quotas commands  https://review.openstack.org/46136213:22
*** baoli has quit IRC13:25
*** gildub has quit IRC13:26
*** tonytan4ever has joined #openstack-infra13:27
*** jkilpatr has joined #openstack-infra13:28
*** links has quit IRC13:29
openstackgerritOpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements  https://review.openstack.org/46137513:30
openstackgerritEvgeniy Shatokhin proposed openstack-infra/jenkins-job-builder master: added parsing of groovy-script option in Extended choice parameter  https://review.openstack.org/46137313:31
*** mriedem has joined #openstack-infra13:32
*** ijw has joined #openstack-infra13:33
pabelangermorning13:34
leifmadseno/13:34
*** jamesmca_ has quit IRC13:35
*** esberglu has joined #openstack-infra13:36
*** lbragstad_ is now known as lbragstad13:37
*** EricGonczer_ has joined #openstack-infra13:38
*** vhosakot has joined #openstack-infra13:39
*** erikmwil_ has joined #openstack-infra13:41
*** neiljerram has joined #openstack-infra13:41
*** _ari_|gone is now known as _ari_13:41
*** esikachev has quit IRC13:43
*** erikmwilson has quit IRC13:43
*** john-davidge has quit IRC13:43
pabelangercmurphy: AJaeger: fungi: if no objections, going to +3 https://review.openstack.org/#/c/460728/ this morning and start a build maybe centos-7 first.  cmurphy has done a great job on build / reproduce.sh logs in the review13:44
fungipabelanger: fire away13:45
* fungi just reviewed and +3'd13:45
*** ykarel has joined #openstack-infra13:45
*** neiljerram has quit IRC13:46
*** jamesmca_ has joined #openstack-infra13:46
pabelanger++13:46
fungithanks cmurphy!13:46
*** baoli has joined #openstack-infra13:46
pabelanger^513:47
*** neiljerram has joined #openstack-infra13:48
*** jamesmc__ has joined #openstack-infra13:48
openstackgerritMerged openstack-infra/shade master: Use REST API for volume delete and detach calls  https://review.openstack.org/46133313:48
openstackgerritEvgeniy Shatokhin proposed openstack-infra/jenkins-job-builder master: added parsing of groovy-script option in Extended choice parameter  https://review.openstack.org/46137313:48
*** esikachev has joined #openstack-infra13:52
*** jamesmca_ has quit IRC13:52
*** gcb has quit IRC13:52
*** gcb has joined #openstack-infra13:53
*** gcb_ has joined #openstack-infra13:54
openstackgerritMerged openstack-infra/project-config master: Stop installing and running puppet in node builds  https://review.openstack.org/46072813:55
*** gcb_ has quit IRC13:56
*** mat128 has quit IRC13:56
openstackgerritOpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements  https://review.openstack.org/46137513:56
*** gcb has quit IRC13:58
*** esikachev has quit IRC13:58
pabelangerUpdate email sent to ML about removal of puppet element.13:59
*** ijw has quit IRC13:59
AJaegerGreat, thanks cmurphy and pabelanger !14:00
*** mat128 has joined #openstack-infra14:00
*** beekneemech is now known as bnemec14:00
*** gcb has joined #openstack-infra14:00
*** neiljerram has quit IRC14:00
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block-device base functions.  https://review.openstack.org/46135614:01
*** xyang1 has joined #openstack-infra14:01
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Improve documentation for image creation  https://review.openstack.org/46135914:01
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in security groups commands  https://review.openstack.org/46140614:02
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in quotas commands  https://review.openstack.org/46136214:02
*** ijw has joined #openstack-infra14:03
AJaegerEmilienM: understood, glad to hear it's on your radar14:04
*** esikachev has joined #openstack-infra14:06
AJaegerpabelanger, fungi, we can merge https://review.openstack.org/#/c/458106 as well, can't we? We shouldn't need the extra checkout of system-config anymore since only puppet used it AFAIU14:07
AJaegercmurphy: ^14:08
pabelangershould be okay now14:09
*** mat128 has quit IRC14:09
AJaegerfungi, pabelanger: You both +2ed at the same time - I'll +A then ...14:10
*** tphummel has joined #openstack-infra14:11
*** zz_dimtruck is now known as dimtruck14:13
*** salv-orlando has joined #openstack-infra14:14
*** mat128 has joined #openstack-infra14:14
*** rbrndt has joined #openstack-infra14:16
*** shrircha has joined #openstack-infra14:16
*** jamesmc__ has quit IRC14:16
*** jamesmca_ has joined #openstack-infra14:16
*** salv-orlando has quit IRC14:17
*** mdrabe has quit IRC14:17
*** mdrabe has joined #openstack-infra14:18
openstackgerritMerged openstack-infra/project-config master: cleanup: remove unused clone of system-config  https://review.openstack.org/45810614:19
*** shrircha has quit IRC14:20
EmilienMAJaeger: thanks for checking14:21
cmurphywoohoo!14:24
* cmurphy hi5 pabelanger14:24
*** xarses has joined #openstack-infra14:24
*** xarses_ has quit IRC14:26
pabelangerokay, centos-7 and fedora-25 DIBs building14:27
*** gcb has quit IRC14:29
*** gcb has joined #openstack-infra14:29
*** ijw has quit IRC14:30
*** gcb has quit IRC14:31
*** gcb has joined #openstack-infra14:31
*** eharney has quit IRC14:32
openstackgerritMerged openstack-infra/project-config master: manila: mark python-manilaclient to clone from git  https://review.openstack.org/45968814:33
*** prometheanfire has joined #openstack-infra14:39
prometheanfirehi, coworker is giving a presentation and we need to open a firewall so she can do so, is the IP-space for the confrence known?14:40
prometheanfireand if so, may I have it?14:40
*** sree has joined #openstack-infra14:41
pabelangerI believe that will be a question for the summit support staff. I'm unsure if anybody here would know. fungi ^14:42
*** john-davidge has joined #openstack-infra14:42
fungiprometheanfire: no clue. we don't handle that, it's taken care of by a logistics contractor firm managed by the conference organizers working at the foundation. i can pass the question along14:42
fungiprometheanfire: might be easier to directly ask summit@openstack.org though14:43
fungigenerally, the logistics company gets hookups from whatever service providers are tied into the venue though14:44
prometheanfirek, will email, thanks14:44
prometheanfireya14:44
prometheanfireI realize that, just didn't know if infra knew yet14:44
fungibut often there is a choice of multiple providers with presence, so it may not be the same from one to the next even within the same venue14:44
*** peterlisak has quit IRC14:45
openstackgerritMerged openstack/diskimage-builder master: Refactor block_device: isolate the getval call  https://review.openstack.org/46134614:45
fungiprometheanfire: we generally find out on the day of, and someone gives freenode a heads up that they may see lots of clients connecting from a given nat range, but that's about it14:46
*** peterlisak has joined #openstack-infra14:46
prometheanfirek14:46
openstackgerritMatthew Treinish proposed openstack-infra/system-config master: Add firehose docs for ansible events  https://review.openstack.org/46118414:47
mtreinishfungi: so I did some preliminary load testing on firehose over the weekend (just looping client creations) I think we're hitting a ulimit at 1000 clients14:48
*** e0ne has joined #openstack-infra14:49
mtreinishwhen I created > 1000 from my desktop it stopped showing more clients on grafana14:49
fungimtreinish: looked at the cacti graphs? is it maybe topping out at a specific connection count or something?14:49
jeblairmordred, fungi, SpamapS, pabelanger: i got some emails about launchpad ppa building vhd-util14:49
mtreinishfungi: heh, you can see the spike: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=4926&rra_id=2&view_type=&graph_start=1493045387&graph_end=149365018714:50
pabelangerjeblair: Ya, mordred was able to get a build going this weekend. However, failed because warnings are errors14:50
fungijeblair: me too. i think it goes to all active members of the owner team for the ppa or something14:50
*** tphummel has quit IRC14:51
*** john-davidge has quit IRC14:51
pabelangerYour request to join OpenStack CI Core is awaiting approval.14:51
pabelanger:)14:51
fungipabelanger: not any lomger14:53
fungilonger14:53
pabelangerdanke14:53
*** hongbin has joined #openstack-infra14:53
*** aviau has quit IRC14:53
*** markvoelker has joined #openstack-infra14:54
*** esikachev has quit IRC14:56
*** sree_ has joined #openstack-infra14:56
*** rkukura has joined #openstack-infra14:57
*** sree_ is now known as Guest1211514:57
*** salv-orlando has joined #openstack-infra14:57
*** john-davidge has joined #openstack-infra14:58
*** sree has quit IRC14:58
*** xarses_ has joined #openstack-infra14:58
*** tonytan4ever has quit IRC14:59
*** tonytan4ever has joined #openstack-infra14:59
*** andreww has joined #openstack-infra14:59
*** xarses_ has quit IRC15:03
AJaegerEmilienM: do you need this change? https://review.openstack.org/#/c/459762/ - It waits for Tripleo PTL +1/-1 ;)15:04
EmilienMAJaeger: nice catch. I won't +1 this one yet. I haven't seen much discussion15:06
EmilienMI'll comment.15:06
AJaegerok15:06
EmilienMAJaeger: I use a Gerrit query to find out this kind of patches but I'm lagging in reviews, a lot to catch up. Thanks for checking with me15:07
pabelangeruploads started for fedora-25 and centos-7 DIBs15:08
*** prometheanfire has left #openstack-infra15:09
AJaegerEmilienM: yeah, it can be a lot ;(15:10
*** EricGonczer_ has quit IRC15:10
*** Guest12115 has quit IRC15:10
*** sree has joined #openstack-infra15:11
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Remove fedora and debian from puppet-apply jobs  https://review.openstack.org/46142615:11
*** xarses_ has joined #openstack-infra15:12
*** Goneri has joined #openstack-infra15:12
*** links has joined #openstack-infra15:14
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove empty single_use_slave class  https://review.openstack.org/46123015:15
*** e0ne has quit IRC15:15
*** andreww has quit IRC15:15
*** e0ne has joined #openstack-infra15:15
*** andreww has joined #openstack-infra15:15
*** sree has quit IRC15:15
*** hongbin has quit IRC15:15
*** e0ne has quit IRC15:16
*** e0ne has joined #openstack-infra15:16
*** xarses_ has quit IRC15:16
*** xarses_ has joined #openstack-infra15:16
*** e0ne has quit IRC15:16
*** e0ne has joined #openstack-infra15:17
*** links has quit IRC15:17
*** e0ne has quit IRC15:17
*** e0ne has joined #openstack-infra15:18
*** e0ne has quit IRC15:18
*** e0ne has joined #openstack-infra15:18
*** e0ne has quit IRC15:19
*** andreww has quit IRC15:19
*** xarses_ has quit IRC15:20
*** EricGonczer_ has joined #openstack-infra15:21
*** tonytan_brb has joined #openstack-infra15:21
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135315:21
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Improve documentation for image creation  https://review.openstack.org/46135915:22
*** tonytan4ever has quit IRC15:23
jeblairi'm responding to fifieldt's question15:27
jeblair(about ask.o.o)15:27
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Remove fedora and debian from puppet-apply jobs  https://review.openstack.org/46142615:27
*** andreww has joined #openstack-infra15:31
*** andreww has quit IRC15:31
*** andreww has joined #openstack-infra15:31
*** jascott1 has joined #openstack-infra15:32
mtreinishpabelanger: have you seen this centos7 apply job failure? http://logs.openstack.org/84/461184/3/check/gate-infra-puppet-apply-3-centos-7/4a3c364/15:33
mtreinishpabelanger: its hitting my docs patch: https://review.openstack.org/#/c/461184/15:33
pabelangermtreinish: yes, we need to land: https://review.openstack.org/#/c/461222/15:34
*** tphummel has joined #openstack-infra15:34
*** Goneri has quit IRC15:35
pabelangercmurphy: centos-7 and fedora-25 DIBs coming on line now15:35
cmurphypabelanger: woot15:35
pabelangercmurphy: NICE! http://logs.openstack.org/96/461096/2/check/gate-puppet-openstack-integration-puppet-syntax-4-centos-7/f16a4a8/console.html#_2017-05-01_15_36_48_66692115:39
pabelangerNo Match for argument: puppet15:39
pabelangerjob passed too15:39
pabelangerEmilienM: ^15:40
EmilienMwoot15:40
EmilienMwait this job doesn't run puppet15:40
EmilienMlet me kick off CI jobs15:41
pabelangerEmilienM: right, but it tried to uninstall it :)15:41
pabelangerwhich, it no longer has too15:41
EmilienMpabelanger: on ubuntu, all looks fine. centos is running now, gimme a sec15:42
pabelangerEmilienM: we haven't done ubuntu image yet15:42
pabelangerjust centos / fedora15:42
EmilienMk15:42
pabelangerI've just started build for ubuntu-trusty and ubuntu-xenail DIBs now15:43
cmurphyneat15:43
cmurphygood thing the job doesn't fail when that macro fails15:43
EmilienMpabelanger: centos works \o/15:44
*** ihrachys has joined #openstack-infra15:44
EmilienMI need to check beaker jobs also, just to make sure15:44
*** ykarel has quit IRC15:46
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add net-info macro to puppet jobs  https://review.openstack.org/46143315:46
pabelangerEmilienM: AJaeger ^ adds some extra debug for puppet jobs, so we can see which image is running15:47
*** beslemon has joined #openstack-infra15:47
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Remove fedora and debian from puppet-apply jobs  https://review.openstack.org/46142615:47
pabelangerEmilienM: cool, next up is to check tripleo jobs are fine too15:47
*** waynr has joined #openstack-infra15:48
EmilienMpabelanger: really cool15:48
EmilienMpabelanger: yes +1 for ooo15:48
pabelangerneat15:49
*** salv-orl_ has joined #openstack-infra15:52
*** Apoorva has joined #openstack-infra15:52
*** esikachev has joined #openstack-infra15:52
AJaegerfungi, could you +3 https://review.openstack.org/#/c/461222/ , please?15:52
*** Apoorva has quit IRC15:52
*** mrunge has quit IRC15:52
*** Apoorva has joined #openstack-infra15:53
AJaegerclarkb: could you put these DEVSTACK_PROJECT_FROM_GIT cleanups on your review queue, please? https://review.openstack.org/#/q/status:open++topic:PROJECTS15:53
clarkbAJaeger: sure15:54
*** mrunge has joined #openstack-infra15:54
clarkbI'm probably going to spend most of my time today on presentation prep for summit. Gonna give presentty a try15:54
*** john-davidge has quit IRC15:54
*** salv-orlando has quit IRC15:55
*** rkukura has quit IRC15:55
*** trown is now known as trown|lunch15:55
*** amotoki has quit IRC15:55
*** persia has joined #openstack-infra15:55
*** jascott1 has quit IRC15:56
*** jascott1 has joined #openstack-infra15:56
*** sbezverk has joined #openstack-infra15:57
pabelangerEmilienM: this is the only error I am seeing: http://logs.openstack.org/43/460643/2/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/aba3d23/logs/undercloud/home/jenkins/install_packages.sh.log.txt.gz15:59
pabelangerEmilienM: but, looks unrelated?15:59
*** dklyle has quit IRC16:00
EmilienMpabelanger: beaker works for us16:00
*** dklyle has joined #openstack-infra16:00
EmilienMpabelanger: unrelated16:00
*** gyee has joined #openstack-infra16:00
*** Sukhdev has joined #openstack-infra16:00
pabelangergreat16:00
EmilienMbut you found a new issue16:01
*** neiljerram has joined #openstack-infra16:01
*** esikachev has quit IRC16:02
*** salv-orl_ has quit IRC16:05
openstackgerritMerged openstack-infra/project-config master: Add net-info macro to puppet jobs  https://review.openstack.org/46143316:05
*** dtantsur|afk is now known as dtantsur16:07
*** Swami has joined #openstack-infra16:08
*** Goneri has joined #openstack-infra16:08
pabelangerOops http://logs.openstack.org/22/461222/1/gate/gate-infra-puppet-apply-3-centos-7/617e4cf/console.html16:11
pabelangercmurphy: ^16:11
pabelangerguess we need to add puppet to system-config now16:12
fungihah16:12
pabelangerworking on patch16:12
fungior in the job definitions at least16:12
openstackgerritMerged openstack/diskimage-builder master: Improve documentation for image creation  https://review.openstack.org/46135916:12
cmurphyoh wow woops16:12
*** neiljerram has quit IRC16:13
*** neiljerram has joined #openstack-infra16:13
*** esikachev has joined #openstack-infra16:14
*** Sukhdev has quit IRC16:14
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Install puppet for prep-apply.sh  https://review.openstack.org/46143716:15
*** rossella_s has joined #openstack-infra16:17
*** esikachev has quit IRC16:20
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add empty SSH key for krotscheck  https://review.openstack.org/46122216:24
*** dklyle is now known as david-lyle16:24
pabelangercmurphy: by dropping puppet, we've shaved about 15mins of build times too16:26
*** ijw has joined #openstack-infra16:26
pabelangerhttp://nb02.openstack.org/dib.ubuntu-xenial.log16:26
cmurphypabelanger: that's nice for building locally but the repo caching takes so much longer16:27
clarkbAJaeger: see comment on https://review.openstack.org/#/c/461250/216:27
pabelangerdropping stackviz should get us another 10mins I think16:27
clarkbpabelanger: did we remove that time or just replace it?16:28
fungicmurphy: repo caching _may_ go away with zuul v3 at least16:28
pabelangerclarkb: haven't removed it yet, still need to land https://review.openstack.org/#/c/457074/16:28
cmurphyfungi: ooh neat16:28
fungicmurphy: since zuul v3 pushes refs to the worker nodes, it can just push an entire repo state for each repo needed by the job (which is expected in the job declaration now)16:29
*** tesseract has quit IRC16:29
clarkbfungi: there was talk of figuring out if rsync would work properly for partial updates16:30
clarkb(we didn't think it would)16:30
*** rderose has joined #openstack-infra16:30
*** openstack has joined #openstack-infra16:59
*** openstack has joined #openstack-infra17:09
*** openstack has joined #openstack-infra17:12
*** openstack has joined #openstack-infra17:15
*** openstack has joined #openstack-infra17:22
*** gildub has joined #openstack-infra17:23
*** rkukura has joined #openstack-infra17:23
*** Nisha_Agarwal has joined #openstack-infra17:23
*** baoli has quit IRC17:24
*** psachin has quit IRC17:25
dtantsurthanks pabelanger!17:25
clarkbAJaeger: yes I think your change makes it claer those are XOR'd17:26
clarkbwhich is nice17:26
fungipabelanger: did that old ip address no longer appear in the chat.f.n round-robin?17:26
fungior was it a new problem this time?17:26
sdagueclarkb: so... even if we aren't changing file locations, what do we need updated on the default parser front from this - https://review.openstack.org/#/c/460725/ ?17:27
*** beslemon has quit IRC17:27
cmurphypabelanger: oops: + xargs puppet parser validate --modulepath=/home/jenkins/workspace/gate-system-config-puppet-syntax/modules17:27
cmurphyxargs: puppet: No such file or directory17:27
pabelangerfungi: not sure, I need to confirm that17:27
pabelangercmurphy: where are you seeing that?17:28
cmurphypabelanger: http://logs.openstack.org/30/461230/3/check/gate-system-config-puppet-syntax/66f507f/console.html17:28
pabelangerah17:28
pabelangercmurphy: we should be able to add it to bindep.txt I think17:29
pabelangeractually17:29
pabelangerHmm17:29
clarkbsdague: I think you want to update the regex to handle either a syslog timestamp or iso8601 then make hostname and program optional17:30
pabelangermaybe for system-config we should also run install_puppet.sh17:30
*** ijw has quit IRC17:30
clarkbsdague: the rest of the regex is common between journald and screen/oslo looks like17:30
cmurphypabelanger: i think there's a rake task the puppet-openstack jobs use for syntax, trying to find it17:32
pabelangercmurphy: do we care which version of puppet we are validating?17:33
openstackgerritMerged openstack-infra/project-config master: Remove fedora and debian from puppet-apply jobs  https://review.openstack.org/46142617:33
*** dprince has quit IRC17:33
pabelangercmurphy: if so, I think we need to move to gate-{name}-puppet-syntax-{puppet_version}-{legacy}{node} job17:33
*** jmorgan1 has quit IRC17:33
*** Nisha_Agarwal has left #openstack-infra17:34
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: ironic: Cleanup PROJECTS and DEVSTACK_PROJECT_FROM_GIT  https://review.openstack.org/46146017:34
cmurphypabelanger: yeah we probably want to still be validating puppet 317:34
*** rkukura has quit IRC17:35
pabelangercmurphy: so, if we still want to call install_puppet.sh, I am okay with that. We can just update the puppet-syntax job. I think we are the only project using it17:35
pabelangeror maybe migrate to puppet-syntax jobs that puppet openstack is using, and depend on a gem install17:35
cmurphypabelanger: i think we should use the puppet-syntax job the puppet-openstack modules are using17:36
cmurphyno need to do this two different ways17:36
*** salv-orlando has joined #openstack-infra17:36
mtreinishpabelanger: heh, I rechecked and hit: http://logs.openstack.org/84/461184/3/check/gate-system-config-puppet-syntax/f40c797/console.html#_2017-05-01_17_28_23_61170917:36
mtreinishbut you and cmurphy are already looking at that17:36
pabelangercmurphy: sure, I think that will also make testing puppet4 easier too, right?17:36
cmurphypabelanger: yep probably17:36
pabelangercmurphy: kk, thats do that then. Do you mind updating the job?17:37
cmurphypabelanger: i'll give it a try17:37
pabelangermtreinish: yes, that is what cmurphy and I are just talking about now17:37
AJaegerclarkb: https://review.openstack.org/461460 is one more cleanup - it covers ironic17:37
*** sree has joined #openstack-infra17:38
*** Goneri has joined #openstack-infra17:38
sdagueclarkb: ok17:40
*** salv-orlando has quit IRC17:40
*** tongli has quit IRC17:41
*** rbrndt has quit IRC17:41
*** sree has quit IRC17:42
*** baoli has joined #openstack-infra17:43
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146217:43
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146217:44
*** hongbin has joined #openstack-infra17:45
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add refactor of tree-like vs graph  https://review.openstack.org/46135317:45
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor block-device base functions.  https://review.openstack.org/46135617:45
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146217:46
openstackgerritSean Dague proposed openstack-infra/system-config master: Support journald files  https://review.openstack.org/46072517:47
sdagueclarkb: maybe that's right?17:47
*** jamesmca_ has quit IRC17:50
*** dprince has joined #openstack-infra17:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/gear master: Provide TextJob and TextWorker for convenience  https://review.openstack.org/46117217:53
pabelangercmurphy: looks good, only had 1 comment about centos-7 vs xenial17:54
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921517:54
*** dtantsur is now known as dtantsur|afk17:58
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146217:59
*** idoine has quit IRC17:59
cmurphypabelanger: AJaeger: updated ^17:59
*** marst has joined #openstack-infra17:59
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: WIP: working on python3 compat  https://review.openstack.org/46146818:01
AJaegercmurphy: I fear it will fail testsuite since there's no xenial syntax job defined in jjb.18:01
AJaegercmurphy: otherwise looks fine.18:01
*** jamesmca_ has joined #openstack-infra18:04
*** jamesmca_ has quit IRC18:04
cmurphyAJaeger: hmm is this where i would update that? http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/puppet-module-jobs.yaml#n37818:04
*** jamesmca_ has joined #openstack-infra18:04
pabelangerya, I think so18:05
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146218:06
*** tdasilva has joined #openstack-infra18:07
*** apetrich has joined #openstack-infra18:07
AJaegercmurphy: LGTM, should ;) pass18:08
*** pradk has quit IRC18:09
*** mat128_ has quit IRC18:09
cmurphyAJaeger: yay18:09
*** pradk has joined #openstack-infra18:10
*** pradk has quit IRC18:10
pabelanger=318:10
pabelanger+318:10
fungi#status log Upgraded wiki.openstack.org from MediaWiki 1.28.0 to 1.28.2 for CVE-2017-037218:11
fungipabelanger: looks like we lost openstackstatus to the same issue18:12
fungii'll restart it18:12
pabelangerfungi: thanks18:12
fungiwhen we run into that problem with one, it always impacts both18:13
pabelangerya, I'll remember that for next time18:13
fungisame server, same hosts file18:13
*** openstackstatus has joined #openstack-infra18:13
*** ChanServ sets mode: +v openstackstatus18:13
cmurphytox -ezuul passes for me18:14
fungi#status log Upgraded wiki.openstack.org from MediaWiki 1.28.0 to 1.28.2 for CVE-2017-037218:14
*** andreww is now known as xarses_18:15
openstackstatusfungi: finished logging18:15
*** pradk has joined #openstack-infra18:17
*** rbrndt has joined #openstack-infra18:19
*** kiltzman has quit IRC18:24
*** kiltzman has joined #openstack-infra18:25
*** felipemonteiro has joined #openstack-infra18:26
openstackgerritMerged openstack-infra/project-config master: Use gem-based puppet syntax jobs for infra  https://review.openstack.org/46146218:26
*** srobert has quit IRC18:29
*** ccamacho has quit IRC18:29
*** jamesmca_ has quit IRC18:30
*** Goneri has quit IRC18:30
*** srobert has joined #openstack-infra18:31
*** jamesmca_ has joined #openstack-infra18:31
clarkbsdague: ya that looks right18:32
clarkbsdague: wondering if the )?: will need to have the : escaped? but context says no because its not the start of a capture group18:33
clarkbpabelanger: cmurphy is fixfor fail on https://review.openstack.org/#/c/460725/2 on its way in yet?18:33
cmurphyclarkb: just merged, see three lines up18:34
clarkboh thanks18:34
clarkbI was looking for the system config change I reivewed earlier18:34
cmurphyya we broke it in a lot of different ways :)18:35
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove stackviz from centos-7  https://review.openstack.org/46147818:36
*** salv-orlando has joined #openstack-infra18:37
*** ijw has joined #openstack-infra18:37
pabelangerclarkb: cmurphy: Ya, just watching ansible wheel now18:39
pabelangershould be starting up in 6mins18:39
*** rderose has quit IRC18:41
*** salv-orlando has quit IRC18:41
*** tonytan4ever has joined #openstack-infra18:42
*** rcarrillocruz has joined #openstack-infra18:44
*** ccamacho has joined #openstack-infra18:48
openstackgerritMerged openstack-infra/project-config master: add rtfd hook for downpour repository  https://review.openstack.org/46144518:48
*** mdrabe_ has quit IRC18:50
*** mdrabe_ has joined #openstack-infra18:51
*** matrohon has joined #openstack-infra18:52
*** matrohon has quit IRC18:55
*** jamesdenton has joined #openstack-infra18:57
*** ijw has quit IRC19:01
openstackgerritEric Harney proposed openstack-infra/project-config master: Cinder: move rally-dsvm-py35 to experimental  https://review.openstack.org/46148219:05
*** jamesmca_ has quit IRC19:08
*** mat128 has joined #openstack-infra19:10
*** rkukura has joined #openstack-infra19:11
*** gouthamr has joined #openstack-infra19:13
*** dougwig has joined #openstack-infra19:15
openstackgerritMerged openstack-infra/devstack-gate master: Use compat names for journal files  https://review.openstack.org/46094719:17
*** david-lyle is now known as dklyle19:17
*** dklyle is now known as david-lyle19:17
*** tonytan_brb has joined #openstack-infra19:18
*** gouthamr has quit IRC19:18
*** tonytan4ever has quit IRC19:20
*** andreas-f has joined #openstack-infra19:21
openstackgerritMerged openstack-infra/devstack-gate master: Handle shade and glean in DEVSTACK_PROJECT_FROM_GIT  https://review.openstack.org/46128319:21
*** jamesdenton has quit IRC19:22
openstackgerritMerged openstack-infra/release-tools master: remove launchpadlib from requirements list  https://review.openstack.org/46064919:26
openstackgerritMerged openstack-infra/release-tools master: make default python for venv python 3  https://review.openstack.org/46065019:26
openstackgerritMerged openstack-infra/release-tools master: port release-notes command to python 3  https://review.openstack.org/46065119:26
*** tie has joined #openstack-infra19:27
*** jamesmca_ has joined #openstack-infra19:28
*** hashar has joined #openstack-infra19:32
*** jamesmca_ has quit IRC19:32
*** yottatsa has joined #openstack-infra19:32
*** yottatsa has quit IRC19:33
*** Hal has joined #openstack-infra19:35
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add Gemfile  https://review.openstack.org/46148919:36
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add Gemfile  https://review.openstack.org/46148919:46
*** esikachev has quit IRC19:46
*** e0ne has joined #openstack-infra19:46
clarkbpabelanger: is ^ fix for the rakefile stuff?19:48
clarkbLoadError: cannot load such file -- puppetlabs_spec_helper/rake_tasks that19:48
pabelangerclarkb: Y19:48
pabelangerya19:48
*** ijw has joined #openstack-infra19:49
*** ijw has quit IRC19:49
pabelangerfingers crossed, should be the last step19:49
*** ijw has joined #openstack-infra19:49
*** ijw has quit IRC19:50
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Move test_test_config to a cmd-focused test suite  https://review.openstack.org/46149319:51
pabelangerwill have to work on the reverse proxy cache for gems this week19:51
*** esikachev has joined #openstack-infra19:51
pabelangerYay, passed19:52
fungipabelanger: also missing ruby executable in our puppet lint jobs?19:53
fungior is that now solved?19:53
*** gcb has quit IRC19:53
clarkbI think that fix got in19:53
fungithanks, rechecking the change i was looking at which failed on it in that case19:54
fungilast check result was a couple hours old19:54
pabelangeryup, that is fixed now too19:54
fungiperfect, much appreciated19:54
pabelangerhttps://review.openstack.org/#/c/461489 should be everything now19:54
*** gcb has joined #openstack-infra19:55
*** esikachev has quit IRC19:58
*** Apoorva has quit IRC19:58
*** annegentle has joined #openstack-infra19:59
clarkbsdague: I've double checked your grok filter using http://grokconstructor.appspot.com/do/match and the only line that fails is http://logs.openstack.org/62/460062/11/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/6f24498/logs/screen-c-api.txt.gz#_Apr_28_13_43_10_500983 which I think we can live with initially20:01
clarkbsdague: it fails because it doesn't have a log level20:01
*** Apoorva has joined #openstack-infra20:03
openstackgerritMerged openstack-infra/system-config master: Add Gemfile  https://review.openstack.org/46148920:04
*** ihrachys has quit IRC20:05
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove empty single_use_slave class  https://review.openstack.org/46123020:06
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove empty template class  https://review.openstack.org/46070320:06
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move puppet repos to openstack_project::server  https://review.openstack.org/46070220:06
sdagueclarkb: yeh, that should be fine20:06
sdaguethat line isn't going to be there anyway, right?20:07
sdaguedon't we filter at INFO on the server side20:07
sdaguehttp://logs.openstack.org/62/460062/11/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/6f24498/logs/screen-c-api.txt.gz?level=INFO20:07
clarkbwe do, good point20:08
sdaguethe devstack change did just land though, which means we need to get the system-config change in20:08
sdagueotherwise we're not going to index logs any more on master20:08
clarkbyup, rechecked it again now that the ci fix is in20:09
sdagueok, cool20:09
clarkbpabelanger: can you review ^ when it comes back?20:09
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Remove all centos-release-* repos  https://review.openstack.org/46149720:09
clarkbI did test it using that utility so am really confident in it fwiw20:09
clarkbhttps://review.openstack.org/#/c/460725/2 is the change20:09
*** jamesdenton has joined #openstack-infra20:10
*** srobert has quit IRC20:10
clarkbsdague: btw I did the grab journal file and play with it locally thing, thats a really nice way for interacting with gate logs. my one grump would be that journald seems to split it into multiple files. I wonder if we can't concatenate them?20:10
fungioh, yep i missed that 460947 needed that20:11
sdagueclarkb: there is a fixed max size, it's a binary packed construct20:11
clarkbah20:11
sdaguebut, you can target a directory20:11
*** tie has quit IRC20:11
clarkboh thats the missing piece20:11
clarkbI was pointing at specific files20:11
*** funzo_ has quit IRC20:11
sdague       -D DIR, --directory=DIR20:11
sdague           Takes a directory path as argument. If specified, journalctl will operate on the specified journal directory DIR instead of the default20:11
sdague           runtime and system journal paths.20:11
clarkbperfect20:12
sdagueyeh, I wanted to get those out there first just to make sure my export trick worked to create the correct native thing that you could query20:13
*** gcb has quit IRC20:13
*** gcb has joined #openstack-infra20:14
cmurphypabelanger: final system-config cleanups in topic:unpuppet-zuul-workers are green now20:18
pabelangercmurphy: \o/20:19
openstackgerritMerged openstack-infra/system-config master: Support journald files  https://review.openstack.org/46072520:19
*** jamesmca_ has joined #openstack-infra20:22
*** dimtruck is now known as zz_dimtruck20:25
*** rhallisey has quit IRC20:26
openstackgerritJeremy Stanley proposed openstack-infra/infra-manual master: Register on PyPI with a minimal PKG-INFO file  https://review.openstack.org/46149820:29
*** esikachev has joined #openstack-infra20:30
*** tiswanso has joined #openstack-infra20:30
*** rossella_s has quit IRC20:32
*** jamesmca_ has quit IRC20:33
*** ihrachys has joined #openstack-infra20:33
*** jamesmca_ has joined #openstack-infra20:34
*** jmorgan1 has joined #openstack-infra20:34
*** jamesmca_ has quit IRC20:36
*** kgiusti has quit IRC20:37
*** mdrabe_ is now known as mdrabe20:37
*** jamesmca_ has joined #openstack-infra20:38
*** jamesdenton has quit IRC20:38
*** jamesdenton has joined #openstack-infra20:40
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_merge_conflict  https://review.openstack.org/46150220:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Remove all centos-release-* repos  https://review.openstack.org/46149720:44
*** dprince has quit IRC20:44
*** zz_dimtruck is now known as dimtruck20:45
*** e0ne has quit IRC20:45
*** mat128 has quit IRC20:46
*** mat128 has joined #openstack-infra20:48
*** ijw has joined #openstack-infra20:50
*** andreas-f has quit IRC20:51
*** jamesmca_ has quit IRC20:52
*** jamesmca_ has joined #openstack-infra20:52
*** annegentle has quit IRC20:52
openstackgerritMerged openstack-infra/system-config master: Add firehose docs for ansible events  https://review.openstack.org/46118420:53
*** ijw has quit IRC20:55
*** hichihara has joined #openstack-infra20:55
*** thorst has quit IRC20:56
*** jamesmca_ has quit IRC20:56
*** trown is now known as trown|outtypewww20:57
*** ccamacho has quit IRC20:58
*** jamesmca_ has joined #openstack-infra20:59
*** rockyg has joined #openstack-infra21:01
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_failed_root  https://review.openstack.org/46150821:02
*** ijw has joined #openstack-infra21:04
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DNM - deploy overcloud with debug  https://review.openstack.org/45703721:05
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DNM - deploy overcloud with debug  https://review.openstack.org/45703721:06
*** jamesmca_ has quit IRC21:06
*** markvoelker has quit IRC21:06
*** sdague has quit IRC21:06
*** eharney has quit IRC21:07
*** jamesmca_ has joined #openstack-infra21:07
*** ijw has quit IRC21:07
*** Sukhdev_ has joined #openstack-infra21:08
*** jamesmca_ has quit IRC21:08
*** annegentle has joined #openstack-infra21:09
openstackgerritJames E. Blair proposed openstack-infra/infra-specs master: Add nodepool drivers spec  https://review.openstack.org/46150921:11
*** funzo has joined #openstack-infra21:12
*** rossella_s has joined #openstack-infra21:13
*** thorst has joined #openstack-infra21:15
*** tonytan_brb has quit IRC21:17
*** funzo has quit IRC21:17
*** mat128 has quit IRC21:17
*** hashar has quit IRC21:18
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_failed_job  https://review.openstack.org/46151221:18
*** rocky_g has joined #openstack-infra21:18
*** Qiming has quit IRC21:19
*** rockyg has quit IRC21:19
*** thorst has quit IRC21:20
*** krtaylor has quit IRC21:21
*** Qiming has joined #openstack-infra21:21
mtreinishfungi: so when do you want to start the firehose load test for real? (instead of me just randomly running a for loop on the weekend :) )21:21
*** jascott1 has quit IRC21:22
*** rhallisey has joined #openstack-infra21:22
*** jascott1 has joined #openstack-infra21:22
fungitrying to get trash day chores caught up before the zuul meeting in 40 minutes, but i might be able to look at it after 23:00 utc21:23
mtreinishfungi: ok, no rush. 2300 UTC works for me21:24
mtreinishjust trying to gauge when I should be around to help with it21:24
*** ijw has joined #openstack-infra21:25
*** ijw has quit IRC21:25
*** ijw has joined #openstack-infra21:25
fungiwas going to try to find some time to test 461214 and make sure it dtrt with no_log too21:25
fungisince it would be good to have that landed before we start making noise about the callback there21:26
fungi(maybe your upstream ansible pr needs the same treatment too?)21:26
mtreinishfungi: heh, that's a fair point21:26
mtreinishit does, I have a local rev with that change applied. I haven't pushed it yet because I'm making some config changes per dmsimard's comments21:27
mtreinishwhich I haven't finished yet21:27
*** asselin has joined #openstack-infra21:27
*** asselin_ has quit IRC21:27
*** EricGonczer_ has quit IRC21:27
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_failed_job  https://review.openstack.org/46151221:27
*** askb has joined #openstack-infra21:27
*** jamesmca_ has joined #openstack-infra21:28
*** ijw has quit IRC21:31
*** tiswanso has quit IRC21:32
*** krtaylor has joined #openstack-infra21:34
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove cache-bindep element  https://review.openstack.org/46151721:34
*** ijw has joined #openstack-infra21:34
*** ijw has quit IRC21:35
*** ijw has joined #openstack-infra21:35
*** rkukura has quit IRC21:36
*** baoli has quit IRC21:37
*** hichihara has quit IRC21:37
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Set sane default locale for tools/build-image.sh  https://review.openstack.org/46151821:37
*** adriant has joined #openstack-infra21:37
*** flaper87 has quit IRC21:38
*** jamesdenton has quit IRC21:39
*** salv-orlando has joined #openstack-infra21:39
*** neiljerram has quit IRC21:39
*** jcoufal has quit IRC21:40
*** rkukura has joined #openstack-infra21:41
*** esikachev has quit IRC21:41
*** neiljerram has joined #openstack-infra21:41
*** krtaylor has quit IRC21:42
*** salv-orlando has quit IRC21:44
*** rkukura_ has joined #openstack-infra21:46
*** rkukura has quit IRC21:47
*** rkukura_ is now known as rkukura21:47
openstackgerritPaul Belanger proposed openstack-infra/project-config master: [WIP] Make cache-devstack optional for image builds  https://review.openstack.org/46152121:48
*** jamesmca_ has quit IRC21:50
*** aeng has joined #openstack-infra21:50
*** jamesmca_ has joined #openstack-infra21:51
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_shared_queue  https://review.openstack.org/46152221:51
*** jamesmca_ has quit IRC21:51
*** tiswanso has joined #openstack-infra21:55
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_live_reconfiguration_shared_queue  https://review.openstack.org/46152221:55
*** esikachev has joined #openstack-infra21:56
openstackgerritTim Burke proposed openstack-infra/project-config master: swift: Skip long-running dsvm jobs for unrelated changes  https://review.openstack.org/45543921:56
*** markvoelker has joined #openstack-infra21:57
fungimtreinish: is http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=4926&rra_id=2&view_type=&graph_start=1493433214&graph_end=1493447658&graph_height=120&graph_width=500&title_font_size=10 the spike from where you were load-testing? (that was 200 tcp connections sustained for 30 minutes late friday night/wee hours of saturday morning)21:57
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Clone zuul from git.openstack.org for zuul-env  https://review.openstack.org/46152521:58
mtreinishfungi: yeah I think it was21:59
*** Swami has quit IRC21:59
mtreinishalthough I don't remember leaving it open for 30 mins21:59
fungilike 1-1:30am local time?21:59
*** tiswanso has quit IRC22:00
fungithe eth0 traffic graph suggests it spiked to 1.08mbps outbound22:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:00
*** esikachev has quit IRC22:00
jeblairpabelanger: i don't understand why 461525 is necessary -- if we plan on removing the element, what does it matter where it clones from?22:01
*** jascott1_ has joined #openstack-infra22:02
*** rossella_s has quit IRC22:03
pabelangerjeblair: right, we want to remove it for zuulv3, but if I build our images, without cache-devstack element, they fail to build currently. Figure getting it from git.openstack.org or pypi would help.  I'd also like to create an experimental job too for tools/build-image.sh, to help increase test coverage on our images22:04
*** jascott1 has quit IRC22:05
jeblairpabelanger: the test job would have access to the cached repo, right?22:07
*** rderose has joined #openstack-infra22:11
*** thorst has joined #openstack-infra22:11
*** funzo has joined #openstack-infra22:14
*** xyang1 has quit IRC22:15
pabelangeryes22:15
*** mat128 has joined #openstack-infra22:15
*** thorst has quit IRC22:16
*** esikachev has joined #openstack-infra22:16
*** ijw has quit IRC22:17
*** ijw has joined #openstack-infra22:17
*** jkilpatr has quit IRC22:18
*** funzo has quit IRC22:19
*** esikachev has quit IRC22:21
*** ijw has quit IRC22:22
*** ijw has joined #openstack-infra22:23
*** mat128 has quit IRC22:28
*** jascott1 has joined #openstack-infra22:28
*** marst has quit IRC22:29
*** mat128 has joined #openstack-infra22:30
*** jascott1_ has quit IRC22:32
*** mat128 has quit IRC22:33
*** vhosakot has quit IRC22:33
*** mat128 has joined #openstack-infra22:35
*** jkilpatr has joined #openstack-infra22:36
*** marst has joined #openstack-infra22:39
*** lamt has quit IRC22:39
*** salv-orlando has joined #openstack-infra22:40
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: don't run tripleo-container-undercloud before Pike  https://review.openstack.org/46152822:42
*** Goneri has joined #openstack-infra22:42
EmilienMpabelanger: if you can look at it please, a project-config patch broke tripleo-ci stable jobs, it should fix it ^22:43
*** salv-orlando has quit IRC22:45
*** esikachev has joined #openstack-infra22:46
*** thorst has joined #openstack-infra22:46
*** rbrndt has quit IRC22:48
*** mat128 has quit IRC22:49
*** esikachev has quit IRC22:50
*** gordc has quit IRC22:53
*** gildub has quit IRC22:58
*** erikmwil_ has quit IRC22:59
*** thorst has quit IRC22:59
*** thorst has joined #openstack-infra22:59
*** erikmwilson has joined #openstack-infra23:00
*** dimtruck is now known as zz_dimtruck23:01
clarkbfungi: pabelanger basically I think the hard thing to guard against which is actually valuable is making sure we don't break tripleo/osa/whoever23:01
fungiclarkb: the point with self-validating images is that we can reduce the chances of breaking image updates and having to wait for someone to notice they've stopped working, rather than giving direct feedback to change authors that their proposed element alteration will break something we guarantee23:01
clarkbhaving other validation is good but if its limited to build time I don't think we need much more machinery than we already have, just add the checks to the elements23:01
fungiright, that23:02
fungiif our elements add selftests (and even better if dib adds a separate phase for that use case) then we get testing for free on any we run in the integration job23:02
*** aeng has quit IRC23:03
jeblairif we can start to characterize the ways we have broken tripleo/osa/etc, we can build up regression tests at least.  the other half of that is continuing to get the images small enough there's not much for us to break.23:03
pabelangerclarkb: for me, even if it was a directory output of the DIB image we just created, would be a step in the right directly.  Most of the time, I am hoping a file is created in the right location unless I manually build it (as tarball) and uncompress and audit23:04
clarkbpabelanger: yes, the iteration time is painful too. I almost always try to build and boot and check images for changes I make23:05
pabelangerthe other thing we could have done (if ready-script in nodepool was still a thing) add the nodepool-dsvm job to project-config and assert things with the ready-script in the gate23:05
clarkband if you have to do that for multiple ubuntus and fedora and centos is slow going23:05
pabelangerwe can still do that, but need to write some logic into devstack hook23:06
jeblairpabelanger: ready script, like pre-playbook, is too late in the process to be useful.23:07
pabelangerjeblair: this is in the context of using out nodepool-dsvm job today, to audit images we build in the gate23:08
jeblairpabelanger: a failing pre-playbook just re-runs the job until the fail counter maxes out.  the ready-script causes nodes to be re-launched, with the same image over and over.23:08
*** aeng has joined #openstack-infra23:08
pabelangeragree23:08
fungimtreinish: any idea as to how i could most easily do the publisher load generation? i'm going to use a dev instance in the same provider/region as firehose01 so we can beat on it pretty soundly23:09
jeblairpabelanger: you mean upload the image to devstack and run something with a ready script?23:09
clarkbto summarize what I am trying t oget at, for in element tests you can have that today with no additional changes to anything but hte elements themselves23:09
pabelangerjeblair: yes, that's what I was trying to convey23:09
clarkbI think being smarter about how we build images in testing is also good but we shouldn't block on that or treat it as required23:09
clarkband we will get most of the benefit (but lack upfront in code review results)23:10
pabelangerif we add an experimental job for nodepool-dsvm to project-config, we could do the same with a ansible-playbook, after image is online23:10
mtreinishfungi: well bash or python? it's about the same level of involvement on either23:10
jeblairpabelanger: 'check out a node from nodepool and run something on it' would be a very easy script to write (assuming you don't want to just run a zuul).  so if 'upload the image to devstack and run something real on it' is feasible, we can do it.  i just doubt that we're going to be able to do very much there other than very basic checks (because nested virt is so slow)23:10
jeblairpabelanger: good point, we don't even really need to check the node out, we can just dirty it without telling nodepool.  :)23:11
pabelangerjeblair: agree, basic checks is all I would hope for23:11
openstackgerritMerged openstack/os-client-config master: Fix interactions with keystoneauth from newton  https://review.openstack.org/46111423:11
fungiyeah, this is why a validation phase in the lements (as it's running in a chroot context not nested virt) would allow us to analyze a lot more as long as we don't need to test kernel features, init system, leave daemons running, and so on23:11
*** felipemonteiro has quit IRC23:11
fungis/lements/elements/23:12
mtreinishfungi: something like http://paste.openstack.org/show/608552/ should work23:12
pabelangerYa, since we have coverage in glean / diskimage-builder / nodepool now, I am confident out issues are not related to SSH for project-config23:13
fungimtreinish: the mass parallelization is at least easier in the shell (for me anyway)23:13
jeblairfungi: laments?23:13
*** jamesdenton has joined #openstack-infra23:13
fungijeblair: lamentations of the pool23:13
mtreinishfungi: to run that for loop you'll have to make sure the mosquitto-clients package is installed (on ubuntu)23:14
ianwpabelanger: sorry, had to step out.  as it is, with the custom repo list, you can build an image quite quickly by just cutting basically everything out23:15
ianw^ re zuulv3 meeting23:15
*** xarses_ has quit IRC23:15
mtreinishfungi: oh, I forgot the port in that paste. you'll need to add '-p 8883'23:15
ianwi think i put instructions in build_image.sh23:15
clarkbjeblair: yes nested virt slowness would severely hamper attacking it that way23:15
mtreinishsince you want to use the tls port so we're not sending the password in plaintext23:16
*** mat128 has joined #openstack-infra23:16
fungiaha, -P is password23:19
*** ijw has quit IRC23:19
*** hrubi has quit IRC23:21
*** hrubi has joined #openstack-infra23:21
fungimtreinish: Error: Unknown option '--cafile'.23:21
fungimtreinish: do i need a newer client package?23:21
*** ijw has joined #openstack-infra23:22
fungitrusty seems to still be on 0.15, if i use a xenial server i'll have 1.4.823:22
*** ijw has quit IRC23:23
mtreinishfungi: hmm, yeah you'll need newer than 0.1523:23
fungik, finding23:23
*** ijw has joined #openstack-infra23:23
mtreinishI forgot the trusty packages were so old23:23
*** jamesdenton has quit IRC23:23
fungimaybe i'll just temporarily boot something23:23
mtreinishthey never updated it from precise23:23
*** rhallisey has quit IRC23:27
fungiokay, 4gb xenial instance booting now. i'll use it as the test publisher load generator23:28
*** rocky_g has quit IRC23:28
mtreinishok23:29
*** neiljerram has quit IRC23:31
*** rderose has quit IRC23:32
fungiokay, test payload sent from the new instance with no problem i think23:37
fungisetting up a single loop now23:37
fungiinitially doing one per second just so i don't lose control of it yet23:37
mtreinishfungi: ok I see the messages on my end23:38
fungikeen, dropping the sleep 1 now23:38
fungithey should be coming a little faster? ;)23:38
mtreinishfungi: heh, yep23:38
*** mat128 has quit IRC23:38
fungihttp://grafana.openstack.org/dashboard/db/mosquitto-status agrees23:39
fungishould i leave it running like this with just the one added publisher for the moment, or increase the number of publishers, or increase the payload size?23:40
pabelangerianw: right, that is what I do today. However, I think we can improve on it and make the element completely optional.  We potentially need to do this shortly, when we move to zuulv3. It is possible we'll get to a point of not caching repos in our diskimages23:40
mtreinishhmm, that's a good question. I guess it depends on what scale limit we're looking to find23:40
mtreinishI hadn't really thought this through :)23:40
*** mat128 has joined #openstack-infra23:41
pabelangerianw: right now only zuul-env and tempest-env depend on it. puppet was a big one, but that was just removed23:41
*** salv-orlando has joined #openstack-infra23:41
fungimtreinish: i'll change this to run one loop in the background, and then can add more of them and see where that puts us23:41
ianwpabelanger: ok, cool, yeah as i mentioned, I'm struggling to think if I ever used that second clone for anythign other than testing install_puppet.sh23:41
*** Julien-zte has quit IRC23:41
pabelangerianw: so, if we come up with the right want to clone zuul and tempest outside of devstack-cache, we can maybe remove devstack-cache from some gate testing we are talking about23:42
ianwi don't think so, hence i'd be cool with just removing it, which i think should happen in that change too23:42
pabelangerk, I'll dive into source-repos tomorrow and see if that will work23:42
ianwwe've talked before about adding a zuul-cloner element thing23:42
fungimtreinish: i can background a few mosquitto_sub processes too, listening for load-test23:43
fungisay... 10?23:43
mtreinishsure23:43
pabelangerianw: ya, I'm not sure if we need that any more. everything is now contained in project-config.23:43
fungiand then we can scale up both sides23:43
mtreinishdo you want me to start more than one on my desktop too?23:43
fungiokay, 10 clients subscribed to that topic now23:44
fungimtreinish: if you want, for some more real-world/higher-latency clients23:45
fungiError: The connection was lost.23:45
fungii think one of my clients just dropped, maybe23:45
*** salv-orlando has quit IRC23:45
fungihrm, nope, they're still running23:46
mtreinishI just launched 20 on my desktop23:46
*** wolverineav has quit IRC23:46
*** esikachev has joined #openstack-infra23:46
fungiload average on the test instance i booted is still low23:46
mtreinishso it's worth pointing out we're not running this with any qos setting23:47
mtreinishso there is no delivery guarantees23:47
fungimaybe we leave this running for a few minutes to see the graphs stabilize, then crank up some more23:47
mtreinishok23:47
fungii need to go spread some nematodes now that the sun's going down, since we've got rain forecast for later tonight23:48
fungibrb23:48
mtreinishheh, ok. enjoy23:48
openstackgerritMerged openstack-infra/jenkins-job-builder master: Builders: Add ansible-playbook builder  https://review.openstack.org/32224323:49
*** mat128 has quit IRC23:49
*** esikachev has quit IRC23:51
pabelangerheh, that is neat^23:51
*** rfolco has joined #openstack-infra23:54
*** jamielennox is now known as jamielennox|away23:56
*** jamielennox|away is now known as jamielennox23:58
*** esikachev has joined #openstack-infra23:58
*** gcb has quit IRC23:59
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add gate-project-config-buildimages job  https://review.openstack.org/46153523:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!