| *** gomarivera has joined #openstack-infra | 00:05 | |
| *** markvoelker has joined #openstack-infra | 00:14 | |
| *** dimtruck is now known as zz_dimtruck | 00:20 | |
| *** sekelso has joined #openstack-infra | 00:22 | |
| *** rkukura has joined #openstack-infra | 00:30 | |
| *** Julien-zte has quit IRC | 00:33 | |
| *** gildub has quit IRC | 00:33 | |
| *** EricGonczer_ has joined #openstack-infra | 00:33 | |
| *** vikrant has joined #openstack-infra | 00:34 | |
| *** jascott1 has quit IRC | 00:39 | |
| *** xingchao has joined #openstack-infra | 00:39 | |
| *** dhinesh has quit IRC | 00:40 | |
| *** thorst_afk has joined #openstack-infra | 00:42 | |
| *** rkukura has quit IRC | 00:42 | |
| *** sekelso has quit IRC | 00:45 | |
| *** thorst_afk has quit IRC | 00:46 | |
| *** markvoelker_ has joined #openstack-infra | 00:49 | |
| *** markvoelker has quit IRC | 00:49 | |
| *** gouthamr has quit IRC | 00:53 | |
| *** markvoelker_ has quit IRC | 00:54 | |
| *** markvoelker has joined #openstack-infra | 00:55 | |
| *** Apoorva_ has joined #openstack-infra | 01:01 | |
| *** Apoorva has quit IRC | 01:05 | |
| *** Apoorva_ has quit IRC | 01:05 | |
| *** gomarivera has quit IRC | 01:16 | |
| *** hongbin has joined #openstack-infra | 01:16 | |
| *** jkilpatr has quit IRC | 01:17 | |
| *** markvoelker has quit IRC | 01:21 | |
| *** markvoelker has joined #openstack-infra | 01:24 | |
| *** masayukig has quit IRC | 01:28 | |
| *** jkilpatr has joined #openstack-infra | 01:28 | |
| *** masayukig has joined #openstack-infra | 01:29 | |
| *** Julien-zte has joined #openstack-infra | 01:32 | |
| *** dave-mccowan has quit IRC | 01:34 | |
| *** Julien-z_ has joined #openstack-infra | 01:41 | |
| *** Julien-zte has quit IRC | 01:42 | |
| *** jkilpatr has quit IRC | 01:49 | |
| *** armax has quit IRC | 01:57 | |
| *** gongysh has quit IRC | 01:57 | |
| *** tinwood has quit IRC | 02:05 | |
| *** tinwood has joined #openstack-infra | 02:06 | |
| *** hieulq_ has joined #openstack-infra | 02:06 | |
| *** esberglu has quit IRC | 02:13 | |
| *** esberglu has joined #openstack-infra | 02:13 | |
| *** esberglu has quit IRC | 02:17 | |
| *** gyee has quit IRC | 02:18 | |
| *** yamamoto has joined #openstack-infra | 02:20 | |
| *** rossella_s has quit IRC | 02:21 | |
| *** rossella_s has joined #openstack-infra | 02:21 | |
| *** gomarivera has joined #openstack-infra | 02:25 | |
| *** Julien-z_ has quit IRC | 02:26 | |
| *** hieulq_ has quit IRC | 02:27 | |
| *** salv-orlando has joined #openstack-infra | 02:28 | |
| *** salv-orlando has quit IRC | 02:32 | |
| *** yamamoto has quit IRC | 02:33 | |
| *** jascott1 has joined #openstack-infra | 02:39 | |
| *** jascott1 has quit IRC | 02:44 | |
| fungi | mtreinish: yeah, still fiddling with pymqttbench when not visiting friends and doing touristy things with christine. that spike was probably me | 02:45 |
|---|---|---|
| fungi | mtreinish: trying to figure out what parameters i'm setting are causing it to run so long/indefinitely | 02:48 |
| fungi | mtreinish: found! i think there may be a bug with --topic | 02:49 |
| fungi | if i leave it out things work the way i expect | 02:49 |
| *** zz_dimtruck is now known as dimtruck | 02:53 | |
| *** funzo has quit IRC | 03:02 | |
| *** gouthamr has joined #openstack-infra | 03:03 | |
| *** markvoelker has quit IRC | 03:04 | |
| *** baoli has joined #openstack-infra | 03:05 | |
| *** EricGonczer_ has quit IRC | 03:08 | |
| *** rfolco has quit IRC | 03:08 | |
| *** cody-somerville has quit IRC | 03:08 | |
| *** cody-somerville has joined #openstack-infra | 03:09 | |
| *** cody-somerville has joined #openstack-infra | 03:09 | |
| *** jamesmca_ has joined #openstack-infra | 03:11 | |
| *** rfolco has joined #openstack-infra | 03:15 | |
| *** rfolco has quit IRC | 03:15 | |
| *** jamesmca_ has quit IRC | 03:16 | |
| *** felipemonteiro has joined #openstack-infra | 03:21 | |
| *** morgan has quit IRC | 03:21 | |
| *** yamamoto has joined #openstack-infra | 03:34 | |
| *** yamamoto has quit IRC | 03:41 | |
| *** kjackal_ has joined #openstack-infra | 03:42 | |
| *** funzo has joined #openstack-infra | 04:03 | |
| *** funzo has quit IRC | 04:07 | |
| *** markvoelker has joined #openstack-infra | 04:08 | |
| *** felipemonteiro has quit IRC | 04:08 | |
| *** yolanda has joined #openstack-infra | 04:13 | |
| *** salv-orlando has joined #openstack-infra | 04:24 | |
| *** salv-orlando has quit IRC | 04:29 | |
| *** dimtruck is now known as zz_dimtruck | 04:33 | |
| *** Julien-zte has joined #openstack-infra | 04:38 | |
| *** psachin has joined #openstack-infra | 04:42 | |
| *** gildub has joined #openstack-infra | 04:58 | |
| *** hongbin has quit IRC | 05:09 | |
| *** baoli has quit IRC | 05:12 | |
| *** jamesmca_ has joined #openstack-infra | 05:12 | |
| *** gildub has quit IRC | 05:13 | |
| *** kjackal_ has quit IRC | 05:16 | |
| *** jamesmca_ has quit IRC | 05:16 | |
| *** jcoufal_ has joined #openstack-infra | 05:18 | |
| *** jcoufal has quit IRC | 05:19 | |
| *** thorst_afk has joined #openstack-infra | 05:36 | |
| *** thorst_afk has quit IRC | 05:38 | |
| *** jcoufal has joined #openstack-infra | 05:43 | |
| *** ociuhandu has quit IRC | 05:46 | |
| *** jcoufal_ has quit IRC | 05:46 | |
| *** jcoufal has quit IRC | 05:46 | |
| *** jamesmca_ has joined #openstack-infra | 05:49 | |
| *** jcoufal_ has joined #openstack-infra | 05:50 | |
| *** esberglu has joined #openstack-infra | 05:51 | |
| *** esberglu has quit IRC | 05:51 | |
| *** gouthamr has quit IRC | 05:52 | |
| *** esberglu has joined #openstack-infra | 05:52 | |
| *** esberglu has quit IRC | 05:56 | |
| *** funzo has joined #openstack-infra | 06:04 | |
| *** signed8bit has joined #openstack-infra | 06:06 | |
| *** funzo has quit IRC | 06:09 | |
| *** signed8bit has quit IRC | 06:09 | |
| *** kjackal_ has joined #openstack-infra | 06:13 | |
| *** jamesmca_ has quit IRC | 06:14 | |
| *** jcoufal has joined #openstack-infra | 06:19 | |
| *** jcoufal_ has quit IRC | 06:20 | |
| *** jcoufal has quit IRC | 06:23 | |
| *** salv-orlando has joined #openstack-infra | 06:25 | |
| *** salv-orlando has quit IRC | 06:29 | |
| *** Julien-zte has quit IRC | 06:35 | |
| *** Julien-zte has joined #openstack-infra | 06:36 | |
| *** pcaruana has joined #openstack-infra | 06:50 | |
| *** jamielennox is now known as jamielennox|away | 06:55 | |
| *** Julien-zte has quit IRC | 07:02 | |
| *** kjackal_ has quit IRC | 07:02 | |
| *** Julien-zte has joined #openstack-infra | 07:02 | |
| *** salv-orlando has joined #openstack-infra | 07:07 | |
| *** Julien-zte has quit IRC | 07:40 | |
| *** Julien-zte has joined #openstack-infra | 07:41 | |
| *** gildub has joined #openstack-infra | 07:45 | |
| *** gomarivera has quit IRC | 07:49 | |
| *** salv-orlando has quit IRC | 07:56 | |
| *** neiljerram has quit IRC | 07:57 | |
| *** funzo has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** funzo has quit IRC | 08:04 | |
| *** dgonzalez has quit IRC | 08:07 | |
| *** gildub has quit IRC | 08:14 | |
| *** dgonzalez has joined #openstack-infra | 08:15 | |
| *** Hal has joined #openstack-infra | 08:23 | |
| *** salv-orlando has joined #openstack-infra | 08:23 | |
| *** askb has quit IRC | 08:50 | |
| *** jamesmca_ has joined #openstack-infra | 08:53 | |
| *** Julien-zte has quit IRC | 08:56 | |
| *** salv-orl_ has joined #openstack-infra | 08:56 | |
| *** Julien-zte has joined #openstack-infra | 08:57 | |
| *** salv-orlando has quit IRC | 08:59 | |
| *** jamesmca_ has quit IRC | 09:17 | |
| *** pbourke has quit IRC | 09:17 | |
| *** pbourke has joined #openstack-infra | 09:19 | |
| *** vikrant has quit IRC | 09:22 | |
| *** Julien-zte has quit IRC | 09:23 | |
| *** Julien-zte has joined #openstack-infra | 09:25 | |
| *** esberglu has joined #openstack-infra | 09:30 | |
| *** esberglu has quit IRC | 09:30 | |
| *** salv-orl_ has quit IRC | 09:31 | |
| *** bhavik1 has joined #openstack-infra | 09:37 | |
| *** andreas-f has joined #openstack-infra | 09:37 | |
| *** gomarivera has joined #openstack-infra | 09:46 | |
| *** gomarivera has quit IRC | 09:51 | |
| *** ykarel_ has joined #openstack-infra | 10:01 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Run containers job on each patch of tripleo-ci https://review.openstack.org/462574 | 10:08 |
| *** ykarel_ has quit IRC | 10:08 | |
| *** ykarel_ has joined #openstack-infra | 10:09 | |
| *** jamesmca_ has joined #openstack-infra | 10:14 | |
| *** Julien-zte has quit IRC | 10:16 | |
| *** Julien-zte has joined #openstack-infra | 10:17 | |
| *** rossella_s has quit IRC | 10:21 | |
| *** rossella_s has joined #openstack-infra | 10:21 | |
| *** esberglu has joined #openstack-infra | 10:23 | |
| *** ykarel_ has quit IRC | 10:24 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Remove redundant OVB jobs from tripleo-ci repo https://review.openstack.org/463084 | 10:24 |
| *** esberglu has quit IRC | 10:28 | |
| *** jamesmca_ has quit IRC | 10:36 | |
| *** wolverineav has joined #openstack-infra | 10:44 | |
| *** funzo has joined #openstack-infra | 11:01 | |
| *** hashar has joined #openstack-infra | 11:04 | |
| *** funzo has quit IRC | 11:06 | |
| *** sshnaidm|off has quit IRC | 11:06 | |
| *** sshnaidm has joined #openstack-infra | 11:10 | |
| *** flepied has quit IRC | 11:12 | |
| *** sshnaidm is now known as sshnaidm|off | 11:14 | |
| *** jcoufal has joined #openstack-infra | 11:20 | |
| *** yamamoto has joined #openstack-infra | 11:20 | |
| *** jcoufal has quit IRC | 11:25 | |
| *** askb has joined #openstack-infra | 11:25 | |
| *** Hal has quit IRC | 11:26 | |
| *** wolverineav has quit IRC | 11:26 | |
| *** askb has quit IRC | 11:27 | |
| *** bhavik1 has quit IRC | 11:29 | |
| *** EricGonczer_ has joined #openstack-infra | 11:29 | |
| *** gildub has joined #openstack-infra | 11:30 | |
| *** wolverineav has joined #openstack-infra | 11:32 | |
| *** wolverineav has quit IRC | 11:36 | |
| *** jascott1 has joined #openstack-infra | 11:40 | |
| *** jascott1 has quit IRC | 11:45 | |
| *** yamamoto has quit IRC | 11:45 | |
| *** gomarivera has joined #openstack-infra | 11:48 | |
| *** gomarivera has quit IRC | 11:52 | |
| *** Julien-zte has quit IRC | 11:57 | |
| *** yamamoto has joined #openstack-infra | 11:58 | |
| *** Julien-zte has joined #openstack-infra | 11:58 | |
| *** yamamoto has quit IRC | 12:02 | |
| *** Julien-zte has quit IRC | 12:17 | |
| *** EricGonczer_ has quit IRC | 12:17 | |
| *** Julien-zte has joined #openstack-infra | 12:18 | |
| *** yolanda has quit IRC | 12:19 | |
| *** gildub has quit IRC | 12:21 | |
| *** neiljerram has joined #openstack-infra | 12:27 | |
| *** zz_dimtruck is now known as dimtruck | 12:30 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Introduce exec_sudo command https://review.openstack.org/462893 | 12:33 |
| openstackgerrit | Merged openstack/diskimage-builder master: Add a test to validate we can build debian vms https://review.openstack.org/462945 | 12:35 |
| openstackgerrit | Merged openstack/diskimage-builder master: Refactor documentation on image creation https://review.openstack.org/462954 | 12:35 |
| *** psachin has quit IRC | 12:36 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add sort_mount_point method https://review.openstack.org/462959 | 12:38 |
| *** yamamoto has joined #openstack-infra | 13:02 | |
| *** xarses has quit IRC | 13:05 | |
| *** yamamoto has quit IRC | 13:06 | |
| *** gomarivera has joined #openstack-infra | 13:10 | |
| *** gomarivera has quit IRC | 13:14 | |
| *** yamamoto has joined #openstack-infra | 13:19 | |
| *** jcoufal has joined #openstack-infra | 13:19 | |
| *** asselin_ has quit IRC | 13:20 | |
| *** jcoufal has quit IRC | 13:23 | |
| *** dave-mccowan has joined #openstack-infra | 13:28 | |
| *** chlong has quit IRC | 13:34 | |
| *** Goneri has joined #openstack-infra | 13:38 | |
| *** jamesmca_ has joined #openstack-infra | 13:38 | |
| *** jamesmca_ has quit IRC | 13:38 | |
| *** Hal has joined #openstack-infra | 13:39 | |
| *** jamesmca_ has joined #openstack-infra | 13:39 | |
| *** xingchao has quit IRC | 13:40 | |
| *** xingchao has joined #openstack-infra | 13:41 | |
| *** jamesmca_ has quit IRC | 13:42 | |
| *** jamesmca_ has joined #openstack-infra | 13:42 | |
| *** jamesmca_ has quit IRC | 13:43 | |
| *** jamesmca_ has joined #openstack-infra | 13:44 | |
| *** jamesmca_ has quit IRC | 13:45 | |
| *** jamesmca_ has joined #openstack-infra | 13:45 | |
| *** xingchao has quit IRC | 13:46 | |
| *** jamesmca_ has quit IRC | 13:47 | |
| *** jamesmca_ has joined #openstack-infra | 13:48 | |
| *** jamesmca_ has quit IRC | 13:48 | |
| *** jamesmca_ has joined #openstack-infra | 13:49 | |
| *** jamesmca_ has quit IRC | 13:50 | |
| *** jamesmca_ has joined #openstack-infra | 13:50 | |
| *** jamesmca_ has quit IRC | 13:52 | |
| *** Goneri has quit IRC | 13:52 | |
| *** jamesmca_ has joined #openstack-infra | 13:52 | |
| *** jamesmca_ has quit IRC | 13:53 | |
| *** jamesmca_ has joined #openstack-infra | 13:54 | |
| *** Julien-zte has quit IRC | 13:54 | |
| *** Julien-zte has joined #openstack-infra | 13:55 | |
| *** jamesmca_ has quit IRC | 13:56 | |
| *** jamesmca_ has joined #openstack-infra | 13:57 | |
| *** jamesmca_ has quit IRC | 13:58 | |
| *** yamamoto has quit IRC | 13:58 | |
| *** jamesmca_ has joined #openstack-infra | 13:58 | |
| *** jamesmca_ has quit IRC | 13:59 | |
| *** jamesmca_ has joined #openstack-infra | 14:00 | |
| *** jamesmca_ has quit IRC | 14:01 | |
| *** dhajare has joined #openstack-infra | 14:01 | |
| *** jamesmca_ has joined #openstack-infra | 14:01 | |
| *** Julien-zte has quit IRC | 14:01 | |
| *** esberglu has joined #openstack-infra | 14:01 | |
| *** jamesmca_ has quit IRC | 14:02 | |
| *** Julien-zte has joined #openstack-infra | 14:02 | |
| *** mat128 has joined #openstack-infra | 14:02 | |
| *** jamesmca_ has joined #openstack-infra | 14:03 | |
| *** coffee_cat is now known as ildikov | 14:03 | |
| *** jamesmca_ has quit IRC | 14:04 | |
| *** jamesmca_ has joined #openstack-infra | 14:05 | |
| *** jamesmca_ has quit IRC | 14:05 | |
| *** jamesmca_ has joined #openstack-infra | 14:06 | |
| *** esberglu has quit IRC | 14:06 | |
| *** thorst_afk has joined #openstack-infra | 14:06 | |
| *** jamesmca_ has quit IRC | 14:07 | |
| *** jamesmca_ has joined #openstack-infra | 14:09 | |
| *** jamesmca_ has quit IRC | 14:10 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Get rid of job name filter for ARA OSA job https://review.openstack.org/463093 | 14:10 |
| *** thorst_afk has quit IRC | 14:10 | |
| *** xingchao has joined #openstack-infra | 14:11 | |
| *** thorst_afk has joined #openstack-infra | 14:11 | |
| *** kiltzman has quit IRC | 14:11 | |
| *** kiltzman has joined #openstack-infra | 14:14 | |
| *** thorst_afk has quit IRC | 14:15 | |
| *** xingchao has quit IRC | 14:15 | |
| *** baoli has joined #openstack-infra | 14:32 | |
| *** mat128 has quit IRC | 14:37 | |
| *** mat128 has joined #openstack-infra | 14:38 | |
| *** xingchao has joined #openstack-infra | 14:40 | |
| *** rcarrillocruz has quit IRC | 14:40 | |
| *** rcarrillocruz has joined #openstack-infra | 14:41 | |
| *** xingchao has quit IRC | 14:41 | |
| *** thorst_afk has joined #openstack-infra | 14:42 | |
| *** jcoufal has joined #openstack-infra | 14:44 | |
| *** armax has joined #openstack-infra | 14:45 | |
| *** jcoufal has quit IRC | 14:50 | |
| *** Hal has quit IRC | 14:53 | |
| *** thorst_afk has quit IRC | 14:56 | |
| *** funzo has joined #openstack-infra | 14:59 | |
| *** yamamoto has joined #openstack-infra | 14:59 | |
| *** baoli has quit IRC | 15:02 | |
| *** funzo has quit IRC | 15:03 | |
| *** apetrich_ has quit IRC | 15:04 | |
| *** ssbarnea has joined #openstack-infra | 15:05 | |
| *** apetrich_ has joined #openstack-infra | 15:05 | |
| *** yamamoto has quit IRC | 15:09 | |
| *** EricGonczer_ has joined #openstack-infra | 15:09 | |
| openstackgerrit | Merged openstack-infra/shade master: Remove neutronclient mocks from floating ips tests https://review.openstack.org/463070 | 15:13 |
| *** mat128 has quit IRC | 15:14 | |
| *** dizquierdo has joined #openstack-infra | 15:16 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Remove has_service mock from Neutron FIP tests https://review.openstack.org/463099 | 15:18 |
| *** baoli has joined #openstack-infra | 15:18 | |
| *** EricGonczer_ has quit IRC | 15:21 | |
| *** dizquierdo has quit IRC | 15:24 | |
| *** armax has quit IRC | 15:27 | |
| *** asdfghzxcvbn has joined #openstack-infra | 15:28 | |
| *** gomarivera has joined #openstack-infra | 15:32 | |
| *** gouthamr has joined #openstack-infra | 15:33 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab https://review.openstack.org/444586 | 15:34 |
| *** sbezverk_ has joined #openstack-infra | 15:34 | |
| *** baoli has quit IRC | 15:34 | |
| *** gomarivera has quit IRC | 15:37 | |
| *** sbezverk_ has quit IRC | 15:37 | |
| openstackgerrit | Merged openstack-infra/shade master: Remove cinderclient mocks from snapshot tests https://review.openstack.org/463071 | 15:41 |
| *** xingchao has joined #openstack-infra | 15:42 | |
| *** baoli has joined #openstack-infra | 15:46 | |
| *** xingchao has quit IRC | 15:46 | |
| *** rcarrill1 has joined #openstack-infra | 15:47 | |
| *** sbezverk_ has joined #openstack-infra | 15:48 | |
| *** rkukura has joined #openstack-infra | 15:49 | |
| *** rcarrillocruz has quit IRC | 15:49 | |
| *** sbezverk_ has quit IRC | 15:51 | |
| *** thorst_afk has joined #openstack-infra | 15:52 | |
| *** EricGonczer_ has joined #openstack-infra | 15:56 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements https://review.openstack.org/461375 | 15:59 |
| *** jcoufal has joined #openstack-infra | 16:03 | |
| *** markvoelker has quit IRC | 16:03 | |
| *** EricGonczer_ has quit IRC | 16:04 | |
| *** EricGonczer_ has joined #openstack-infra | 16:04 | |
| *** EricGonczer_ has quit IRC | 16:05 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Add assert_calls check testing volume calls with timeout enabled https://review.openstack.org/463104 | 16:05 |
| *** jamesmca_ has joined #openstack-infra | 16:06 | |
| *** jamesmca_ has quit IRC | 16:06 | |
| *** jamesmca_ has joined #openstack-infra | 16:07 | |
| *** xingchao has joined #openstack-infra | 16:07 | |
| *** jamesmca_ has quit IRC | 16:08 | |
| *** jamesmca_ has joined #openstack-infra | 16:08 | |
| *** jamesmca_ has quit IRC | 16:09 | |
| *** jamesmca_ has joined #openstack-infra | 16:10 | |
| *** jamesmca_ has quit IRC | 16:11 | |
| *** thorst_afk has quit IRC | 16:12 | |
| *** jamesmca_ has joined #openstack-infra | 16:12 | |
| *** jamesmca_ has quit IRC | 16:13 | |
| *** tjones has joined #openstack-infra | 16:13 | |
| *** rwsu has quit IRC | 16:13 | |
| *** jamesmca_ has joined #openstack-infra | 16:13 | |
| *** jamesmca_ has quit IRC | 16:14 | |
| *** jamesmca_ has joined #openstack-infra | 16:15 | |
| *** flepied has joined #openstack-infra | 16:15 | |
| *** felipemonteiro has joined #openstack-infra | 16:15 | |
| *** jamesmca_ has quit IRC | 16:16 | |
| *** jamesmca_ has joined #openstack-infra | 16:17 | |
| *** jamesmca_ has quit IRC | 16:18 | |
| *** jamesmca_ has joined #openstack-infra | 16:19 | |
| *** jamesmca_ has quit IRC | 16:20 | |
| *** jamesmca_ has joined #openstack-infra | 16:20 | |
| *** jamesmca_ has quit IRC | 16:22 | |
| *** jamesmca_ has joined #openstack-infra | 16:23 | |
| *** jamesmca_ has quit IRC | 16:23 | |
| *** rkukura has quit IRC | 16:23 | |
| *** jamesmca_ has joined #openstack-infra | 16:24 | |
| *** jamesmca_ has quit IRC | 16:25 | |
| *** jamesmca_ has joined #openstack-infra | 16:25 | |
| *** jamesmca_ has quit IRC | 16:26 | |
| *** jamesmca_ has joined #openstack-infra | 16:27 | |
| *** jamesmca_ has quit IRC | 16:28 | |
| mtreinish | fungi: oh, that could be, I wasn't ever using topic in my local testing, and was just relying on the default I set in code | 16:28 |
| *** jamesmca_ has joined #openstack-infra | 16:29 | |
| *** jamesmca_ has quit IRC | 16:30 | |
| *** jamesmca_ has joined #openstack-infra | 16:31 | |
| *** jamesmca_ has quit IRC | 16:32 | |
| *** jamesmca_ has joined #openstack-infra | 16:32 | |
| *** jamesmca_ has quit IRC | 16:33 | |
| fungi | mtreinish: yep, that's working fine for me | 16:33 |
| *** lennyb has quit IRC | 16:34 | |
| *** jamesmca_ has joined #openstack-infra | 16:34 | |
| fungi | testing with 512-byte payloads since that seems probably representative of our typical average (though i really don't know, just a guess) | 16:35 |
| *** jamesmca_ has quit IRC | 16:36 | |
| *** jamesmca_ has joined #openstack-infra | 16:36 | |
| *** jamesmca_ has quit IRC | 16:37 | |
| *** jamesmca_ has joined #openstack-infra | 16:37 | |
| *** jamesmca_ has quit IRC | 16:38 | |
| *** ykarel has joined #openstack-infra | 16:39 | |
| *** jamesmca_ has joined #openstack-infra | 16:39 | |
| *** jamesmca_ has quit IRC | 16:40 | |
| *** jamesmca_ has joined #openstack-infra | 16:40 | |
| *** jamesmca_ has quit IRC | 16:41 | |
| *** jamesmca_ has joined #openstack-infra | 16:42 | |
| *** jamesmca_ has quit IRC | 16:42 | |
| *** jamesmca_ has joined #openstack-infra | 16:43 | |
| *** jamesmca_ has quit IRC | 16:45 | |
| *** jamesmca_ has joined #openstack-infra | 16:45 | |
| *** jamesmca_ has quit IRC | 16:46 | |
| openstackgerrit | Merged openstack-infra/shade master: Remove has_service mock from Neutron FIP tests https://review.openstack.org/463099 | 16:46 |
| *** esberglu has joined #openstack-infra | 16:47 | |
| *** jamesmca_ has joined #openstack-infra | 16:47 | |
| *** jamesmca_ has quit IRC | 16:47 | |
| *** jamesmca_ has joined #openstack-infra | 16:48 | |
| *** jamesmca_ has quit IRC | 16:49 | |
| *** ssbarnea has quit IRC | 16:49 | |
| *** jamesmca_ has joined #openstack-infra | 16:49 | |
| *** felipemonteiro has quit IRC | 16:49 | |
| *** jamesmca_ has quit IRC | 16:50 | |
| *** jamesmca_ has joined #openstack-infra | 16:51 | |
| *** jamesmca_ has quit IRC | 16:51 | |
| *** esberglu has quit IRC | 16:51 | |
| *** jamesmca_ has joined #openstack-infra | 16:52 | |
| *** jamesmca_ has quit IRC | 16:53 | |
| *** jamesmca_ has joined #openstack-infra | 16:53 | |
| fungi | mtreinish: i've noticed i can't push it up to 32pub x 32sub without getting lots of pub timeout exceptions, but 16pub x 512sub is working without error (1024sub gets me ssl handshake errors) | 16:53 |
| *** jamesmca_ has quit IRC | 16:54 | |
| *** jkilpatr has joined #openstack-infra | 16:54 | |
| *** jamesmca_ has joined #openstack-infra | 16:55 | |
| *** jamesmca_ has quit IRC | 16:55 | |
| *** jamesmca_ has joined #openstack-infra | 16:56 | |
| fungi | should we try to find ways to push those higher, or go with 1..16pub x 1..512sub as our ranges? | 16:57 |
| *** jamesmca_ has quit IRC | 16:57 | |
| *** jamesmca_ has joined #openstack-infra | 16:58 | |
| *** jamesmca_ has quit IRC | 17:00 | |
| openstackgerrit | Yuval Brik proposed openstack-infra/project-config master: karbor: mark python-karborclient to clone from git https://review.openstack.org/462031 | 17:00 |
| *** jamesmca_ has joined #openstack-infra | 17:00 | |
| *** jamesmca_ has quit IRC | 17:01 | |
| *** jamesmca_ has joined #openstack-infra | 17:02 | |
| mtreinish | fungi: I really should have decoupled the ssl for the pub and sub | 17:02 |
| mtreinish | I was just lazy | 17:02 |
| mtreinish | because I don't expect many people to ssl on the sub side | 17:02 |
| *** jamesmca_ has quit IRC | 17:03 | |
| mtreinish | fungi: I wonder is there anything logged on the broker side for the failures? | 17:03 |
| *** Goneri has joined #openstack-infra | 17:04 | |
| *** markvoelker has joined #openstack-infra | 17:04 | |
| mtreinish | because I feel like there's tuning we could do to make it go past 512subs | 17:04 |
| mtreinish | but I'm ok with saying those are our ranges for now | 17:04 |
| *** jamesmca_ has joined #openstack-infra | 17:04 | |
| *** jamesmca_ has quit IRC | 17:05 | |
| fungi | mtreinish: checking, though also looking to see whether i'm hitting a local max sockets per process or something | 17:05 |
| *** jamesmca_ has joined #openstack-infra | 17:06 | |
| *** jamesmca_ has quit IRC | 17:07 | |
| *** jamesmca_ has joined #openstack-infra | 17:08 | |
| *** jamesmca_ has quit IRC | 17:08 | |
| *** jamesmca_ has joined #openstack-infra | 17:09 | |
| *** thorst_afk has joined #openstack-infra | 17:09 | |
| *** markvoelker has quit IRC | 17:10 | |
| *** jamesmca_ has quit IRC | 17:10 | |
| *** xarses has joined #openstack-infra | 17:11 | |
| *** jamesmca_ has joined #openstack-infra | 17:11 | |
| *** jamesmca_ has quit IRC | 17:12 | |
| *** jamesmca_ has joined #openstack-infra | 17:13 | |
| *** jamesmca_ has quit IRC | 17:13 | |
| *** jamesmca_ has joined #openstack-infra | 17:14 | |
| *** jamesmca_ has quit IRC | 17:15 | |
| *** jamesmca_ has joined #openstack-infra | 17:15 | |
| *** jamesmca_ has quit IRC | 17:16 | |
| *** ykarel has quit IRC | 17:20 | |
| *** asdfghzxcvbn has quit IRC | 17:21 | |
| fungi | mtreinish: could be a max clients issue with openssl. getting more of this in the log each time i try to push to 1024sub (even at only 1pub): | 17:24 |
| fungi | When: Sat May 6, 2017 3:30pm – 4:30pm Central Time | 17:24 |
| fungi | er, wrong paste buffer | 17:24 |
| fungi | 1494091483: OpenSSL Error: error:140F3042:SSL routines:ssl_undefined_const_function:called a function you should not call | 17:25 |
| *** asdfghzxcvbn has joined #openstack-infra | 17:25 | |
| *** asdfghzxcvbn has quit IRC | 17:25 | |
| *** asdfghzxcvbn has joined #openstack-infra | 17:25 | |
| *** asdfghzxcvbn has quit IRC | 17:25 | |
| *** salv-orlando has joined #openstack-infra | 17:25 | |
| *** asdfghzxcvbn has joined #openstack-infra | 17:25 | |
| *** asdfghzxcvbn has quit IRC | 17:25 | |
| fungi | https://dev.eclipse.org/mhonarc/lists/mosquitto-dev/msg00878.html | 17:26 |
| *** thorst_afk has quit IRC | 17:27 | |
| *** Julien-zte has quit IRC | 17:29 | |
| fungi | so maybe that error from mosquitto is a result of connection failures, not indicating the cause of them | 17:30 |
| *** Julien-zte has joined #openstack-infra | 17:33 | |
| *** gomarivera has joined #openstack-infra | 17:34 | |
| fungi | looks like the connection limits in this testing aren't ssl-related since i get them even over non-ssl too (straight up connection reset in that case) | 17:35 |
| mtreinish | fungi: I think it's the unlimit thing I was hitting in our local test back in april | 17:37 |
| mtreinish | s/april/august | 17:38 |
| mtreinish | I don't remember how I figured out that was what was going on, but iirc we hit the max fd open count or something at 1024 for the mosquitto process | 17:38 |
| *** gomarivera has quit IRC | 17:38 | |
| mtreinish | sry, i'm gonna kinda be in and out all day. I've got some errands and packing todo before I head to boston tomorrow morning | 17:39 |
| fungi | mtreinish: no worries, i'm still running it down... just keeping you apprised | 17:41 |
| fungi | looks like i can manage to get 1pub and 997sub at the moment, but when it hits 998sub it starts hitting socket errors, so i agree it's probably client-side but ulimit -n claims i should be able to open 4096 file descriptors | 17:47 |
| *** xingchao has quit IRC | 17:50 | |
| *** xingchao has joined #openstack-infra | 17:51 | |
| *** xingchao has quit IRC | 17:55 | |
| *** ssbarnea has joined #openstack-infra | 17:57 | |
| *** lamt has joined #openstack-infra | 18:00 | |
| *** shardy_ has quit IRC | 18:03 | |
| fungi | maybe it's the server side after all. soft nofile is 1024 for the daemon's pid | 18:06 |
| *** markvoelker has joined #openstack-infra | 18:06 | |
| mtreinish | fungi: heh, my memory works :) | 18:08 |
| *** hashar has quit IRC | 18:09 | |
| *** markvoelker has quit IRC | 18:12 | |
| fungi | yep, just looking into how to set it in a systemd unit config | 18:13 |
| *** Goneri has quit IRC | 18:13 | |
| mtreinish | fungi: https://www.freedesktop.org/software/systemd/man/systemd.exec.html#LimitCPU= ? | 18:14 |
| mtreinish | fungi: I guess it's actually: https://www.freedesktop.org/software/systemd/man/systemd-system.conf.html#DefaultLimitCPU= | 18:15 |
| *** jcoufal has quit IRC | 18:15 | |
| *** markvoelker has joined #openstack-infra | 18:16 | |
| *** lamt has quit IRC | 18:19 | |
| *** lamt has joined #openstack-infra | 18:19 | |
| *** lamt has quit IRC | 18:24 | |
| *** thorst_afk has joined #openstack-infra | 18:25 | |
| *** lamt has joined #openstack-infra | 18:26 | |
| fungi | mtreinish: okay, after some confusion, determined that we're using a sysvinit script for mosquitto (the ubuntu package ships with an initscript and an upstart config, no native systemd unit file) | 18:28 |
| *** thorst_afk has quit IRC | 18:29 | |
| fungi | mtreinish: bingo. stuck ulimit -n 4096 in the initscript and now i can push to 1024sub no problem | 18:30 |
| *** Goneri has joined #openstack-infra | 18:33 | |
| fungi | trying 1pub x 2048sub too and no errors (so far) but it's not concluding | 18:37 |
| fungi | yeah, taking way beyond twice the time testing 1024 subscribers took, so there's probably something else at play | 18:39 |
| fungi | hah, load average on my test instance climbed up to around 1500 | 18:41 |
| *** lamt has quit IRC | 18:42 | |
| *** dhajare has quit IRC | 18:43 | |
| *** lamt has joined #openstack-infra | 18:45 | |
| *** funzo has joined #openstack-infra | 18:47 | |
| *** xingchao has joined #openstack-infra | 18:52 | |
| *** funzo has quit IRC | 18:52 | |
| fungi | mtreinish: so looks like i can get 66 samples for pub and sub each in the 2^(0..10) range as long as pub*sub<=1024 | 18:55 |
| fungi | we'll end up with a triangular sheet basically | 18:55 |
| *** Goneri has quit IRC | 18:57 | |
| *** xingchao has quit IRC | 18:58 | |
| *** lamt has quit IRC | 19:00 | |
| *** lamt has joined #openstack-infra | 19:03 | |
| *** lamt has quit IRC | 19:05 | |
| *** slagle has quit IRC | 19:13 | |
| *** slagle has joined #openstack-infra | 19:15 | |
| *** pcaruana has quit IRC | 19:16 | |
| *** gouthamr has quit IRC | 19:16 | |
| *** esberglu has joined #openstack-infra | 19:23 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements https://review.openstack.org/461375 | 19:23 |
| *** esberglu has quit IRC | 19:30 | |
| *** gomarivera has joined #openstack-infra | 19:35 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DNM - deploy tripleo with all debug https://review.openstack.org/457037 | 19:38 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DNM - deploy tripleo with all debug https://review.openstack.org/457037 | 19:38 |
| *** gomarivera has quit IRC | 19:40 | |
| *** yamahata has joined #openstack-infra | 19:51 | |
| *** xingchao has joined #openstack-infra | 19:56 | |
| *** mrunge_ is now known as mrunge | 19:59 | |
| mtreinish | fungi: very cool, when you've got data feel free to push it up to the boston-summit branch on our talk repo | 20:01 |
| mtreinish | if I find the time tonight I can play with graphing it | 20:01 |
| fungi | mtreinish: yep. i've just about polished a patch with a --brief option to generate one-line output and include fields for the pub and sub client numbers | 20:01 |
| mtreinish | fungi: heh, yeah that's probably a better way to do it compared to my print('='*80) output stuff :) | 20:03 |
| mtreinish | fungi: feel free to push that up to pymqttbench repo when you get it working, I'll give you commit access on it now | 20:05 |
| fungi | mtreinish: yup, i've got the nested loop going generating one full dataset now, but need to disappear in about 10 minutes for a tour of the venue | 20:07 |
| fungi | looks like it's doing what i want. yay! | 20:07 |
| fungi | i'll push up the --brief commit when i get back if i have any time before i have to head to the board/tc/uc/staff dinner | 20:08 |
| mtreinish | fungi: sure, no rush. As long as you have it working locally that's what really counts | 20:09 |
| fungi | okay, one potential issue is that when it intermittently hits sub timeouts, that seems to result in the benchmark hanging indefinitely | 20:12 |
| fungi | i should be able to work around is as long as that doesn't happen so frequently that i can't make it through a complete set of samples | 20:12 |
| fungi | okay, heading out, back later | 20:13 |
| mtreinish | fungi: it should come back after after the sub-timeout param (which defaults to 60sec iirc) | 20:14 |
| *** xingchao has quit IRC | 20:14 | |
| mtreinish | fungi: ok, enjoy the tour | 20:14 |
| *** esberglu has joined #openstack-infra | 20:17 | |
| *** mhickey has joined #openstack-infra | 20:19 | |
| *** esberglu has quit IRC | 20:21 | |
| *** dizquierdo has joined #openstack-infra | 20:22 | |
| *** jamesmca_ has joined #openstack-infra | 20:23 | |
| *** thorst_afk has joined #openstack-infra | 20:26 | |
| *** thorst_afk has quit IRC | 20:30 | |
| *** andreas-f has quit IRC | 20:36 | |
| *** Julien-zte has quit IRC | 20:46 | |
| *** andreas-f has joined #openstack-infra | 20:49 | |
| *** Julien-zte has joined #openstack-infra | 20:50 | |
| openstackgerrit | Merged openstack-infra/shade master: Updated from global requirements https://review.openstack.org/461375 | 20:52 |
| *** jascott1 has joined #openstack-infra | 20:53 | |
| *** salv-orl_ has joined #openstack-infra | 20:57 | |
| *** gomarivera has joined #openstack-infra | 20:57 | |
| *** salv-orlando has quit IRC | 20:59 | |
| *** gomarivera has quit IRC | 21:02 | |
| *** jamesdenton has joined #openstack-infra | 21:05 | |
| *** gouthamr has joined #openstack-infra | 21:09 | |
| *** mhickey has quit IRC | 21:09 | |
| *** ccamacho has left #openstack-infra | 21:12 | |
| *** xingchao has joined #openstack-infra | 21:13 | |
| *** gomarivera has joined #openstack-infra | 21:16 | |
| *** markvoelker has quit IRC | 21:16 | |
| *** jkilpatr has quit IRC | 21:18 | |
| *** thorst_afk has joined #openstack-infra | 21:28 | |
| *** jamesdenton has quit IRC | 21:30 | |
| *** jkilpatr has joined #openstack-infra | 21:32 | |
| *** dizquierdo has quit IRC | 21:34 | |
| *** dizquierdo has joined #openstack-infra | 21:36 | |
| *** gouthamr has quit IRC | 21:43 | |
| *** thorst_afk has quit IRC | 21:46 | |
| fungi | mtreinish: it seemed not to come back after hitting the timeout, because it was still sitting at it when i got back just now | 21:49 |
| fungi | also with the frequency i'm hitting it at higher load values, i should look at increasing that timeout | 21:49 |
| fungi | running now with --sub-timeout=120 to see if that helps | 21:53 |
| *** mriedem has joined #openstack-infra | 21:54 | |
| fungi | grr, still hitting that sub timeout frequently when pub*sub==1024 | 21:57 |
| *** jamesmca_ has quit IRC | 21:58 | |
| *** jamesmca_ has joined #openstack-infra | 21:59 | |
| fungi | i upped the --pub-timeout similarly now and things are looking okay so far | 22:01 |
| *** thorst_afk has joined #openstack-infra | 22:05 | |
| *** yamahata has quit IRC | 22:06 | |
| fungi | hrm, nope, still tripping it | 22:07 |
| *** thorst_afk has quit IRC | 22:08 | |
| mtreinish | fungi: hmm, I migh have missed a place to set the timeout | 22:08 |
| mtreinish | but I thought I set it on all the joins and other blocking calls | 22:09 |
| * mtreinish double checks | 22:09 | |
| *** jamesmca_ has quit IRC | 22:09 | |
| mtreinish | fungi: I bet it's the get() from the Queue | 22:09 |
| *** russellb has quit IRC | 22:10 | |
| *** leifmadsen has quit IRC | 22:10 | |
| mtreinish | if a sub (or a pub I guess) fails and doesn't populate the resource it'll sit there in the get() waiting for one that will never show up | 22:10 |
| mtreinish | fungi: one sec I'll push a patch (that'll be untested) that should fix it | 22:10 |
| fungi | wfm, it'll be tested rsn ;) | 22:11 |
| mtreinish | fungi: ok, it's up now: https://github.com/mtreinish/pymqttbench/commit/03aadcdb64557e8c607cb180b7f93603b3993710 | 22:16 |
| mtreinish | fungi: oh, actually just read the doc for the queue class that'll likely blow up instead of just logging the failed clients | 22:17 |
| mtreinish | it looks like get() raises an exception if the timeout is reached | 22:18 |
| fungi | yeah, i'm getting a traceback and exception on stdout or stderr | 22:19 |
| fungi | but the script neither terminates nor continues once that happens | 22:19 |
| mtreinish | I'm gonna switch the list comprehension to a real loop and add a try on it | 22:19 |
| fungi | k | 22:19 |
| mtreinish | hmm that's weird it should exit | 22:19 |
| mtreinish | on an unhandled exception | 22:19 |
| mtreinish | unless the threads are stuck and keeping things alive? | 22:20 |
| openstackgerrit | Yolande Amate proposed openstack-infra/jenkins-job-builder master: Update EnvInject to make use of convert_mapping_to_xml https://review.openstack.org/408801 | 22:20 |
| fungi | yeah, i'm thinking there's something going on with the threading when that happens | 22:20 |
| *** jkilpatr has quit IRC | 22:21 | |
| *** jkilpatr has joined #openstack-infra | 22:22 | |
| mtreinish | fungi: actually re-reading the code I'm confused how it got in that state. There is an upfront check on queue size before it does the list comprehension | 22:24 |
| mtreinish | which is run after it loops over all the threads and does a join() | 22:24 |
| mtreinish | so all the threads should have exited or an exception was raised | 22:25 |
| mtreinish | fungi: ok I pushed another (untested) patch to correct the previous one | 22:26 |
| *** gouthamr has joined #openstack-infra | 22:27 | |
| mtreinish | but I'm still at a loss for how it gets into that state | 22:27 |
| *** dizquierdo has quit IRC | 22:27 | |
| *** esberglu has joined #openstack-infra | 22:30 | |
| *** esberglu has quit IRC | 22:35 | |
| *** leifmadsen has joined #openstack-infra | 22:37 | |
| *** russellb has joined #openstack-infra | 22:37 | |
| *** xingchao has quit IRC | 22:37 | |
| *** askb has joined #openstack-infra | 22:37 | |
| *** dave-mccowan has quit IRC | 22:39 | |
| *** jamesmca_ has joined #openstack-infra | 22:39 | |
| fungi | mtreinish: testing now (took a few to rebase my reporting commit on that) | 22:43 |
| *** jamesmca_ has quit IRC | 22:44 | |
| fungi | about to step out to dinner but when i get back i'll see if i managed to get a full dataset now | 22:44 |
| fungi | no error so far this time though, so there's hope! | 22:44 |
| *** Goneri has joined #openstack-infra | 22:46 | |
| *** gouthamr has quit IRC | 22:47 | |
| *** yland has joined #openstack-infra | 22:47 | |
| *** gouthamr has joined #openstack-infra | 22:51 | |
| *** Goneri has quit IRC | 23:06 | |
| *** thorst_afk has joined #openstack-infra | 23:08 | |
| *** xingchao has joined #openstack-infra | 23:08 | |
| *** jamielennox|away is now known as jamielennox | 23:09 | |
| *** thorst_afk has quit IRC | 23:13 | |
| *** sbezverk_ has joined #openstack-infra | 23:15 | |
| *** sbezverk_ has quit IRC | 23:15 | |
| *** markvoelker has joined #openstack-infra | 23:18 | |
| *** yland has quit IRC | 23:22 | |
| *** markvoelker has quit IRC | 23:22 | |
| *** jkilpatr has quit IRC | 23:26 | |
| *** dimtruck is now known as zz_dimtruck | 23:33 | |
| *** armax has joined #openstack-infra | 23:38 | |
| *** zz_dimtruck is now known as dimtruck | 23:41 | |
| *** xingchao has quit IRC | 23:46 | |
| *** dimtruck is now known as zz_dimtruck | 23:51 | |
| *** esberglu has joined #openstack-infra | 23:56 | |
| *** armax has quit IRC | 23:56 | |
| *** slagle has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!