| *** sabari is now known as zz_sabari | 00:05 | |
| *** hdd has joined #openstack-infra | 00:06 | |
| *** ddieterly has quit IRC | 00:12 | |
| *** ddieterly has joined #openstack-infra | 00:12 | |
| *** avozza is now known as zz_avozza | 00:15 | |
| *** banix has joined #openstack-infra | 00:30 | |
| *** jaypipes has joined #openstack-infra | 00:30 | |
| *** mase_home has joined #openstack-infra | 00:35 | |
| *** david-lyle has joined #openstack-infra | 00:35 | |
| *** Masahiro has joined #openstack-infra | 00:35 | |
| *** ryanpetrello has joined #openstack-infra | 00:39 | |
| *** Masahiro has quit IRC | 00:40 | |
| *** mase_home has quit IRC | 00:40 | |
| *** mase_home has joined #openstack-infra | 00:43 | |
| *** markmcclain has joined #openstack-infra | 00:46 | |
| *** markmcclain1 has joined #openstack-infra | 00:47 | |
| *** markmcclain has quit IRC | 00:47 | |
| *** mase_x200 has joined #openstack-infra | 00:49 | |
| *** ryanpetrello has quit IRC | 00:58 | |
| *** sputnik13 has joined #openstack-infra | 00:59 | |
| *** hdd has quit IRC | 01:01 | |
| *** mohitsharma has joined #openstack-infra | 01:03 | |
| *** mohitsha_ has joined #openstack-infra | 01:05 | |
| *** banix has quit IRC | 01:06 | |
| *** sputnik13 has quit IRC | 01:07 | |
| *** mohitsharma has quit IRC | 01:08 | |
| *** wuhg has joined #openstack-infra | 01:10 | |
| *** markmcclain has joined #openstack-infra | 01:10 | |
| *** markmcclain1 has quit IRC | 01:10 | |
| *** markmcclain has quit IRC | 01:10 | |
| *** mohitsha_ has quit IRC | 01:13 | |
| *** mohitsharma has joined #openstack-infra | 01:14 | |
| *** zz_sabari is now known as sabari | 01:16 | |
| *** ryanpetrello has joined #openstack-infra | 01:17 | |
| *** david-lyle has quit IRC | 01:18 | |
| *** jyuso has quit IRC | 01:21 | |
| *** david-lyle has joined #openstack-infra | 01:25 | |
| *** markmcclain has joined #openstack-infra | 01:26 | |
| *** salv-orlando has quit IRC | 01:26 | |
| *** markmcclain has quit IRC | 01:26 | |
| *** markmcclain has joined #openstack-infra | 01:26 | |
| *** david-lyle has quit IRC | 01:27 | |
| *** mase_x200 has quit IRC | 01:28 | |
| *** david-lyle has joined #openstack-infra | 01:28 | |
| *** sputnik13 has joined #openstack-infra | 01:29 | |
| *** sputnik13 has quit IRC | 01:32 | |
| *** Sukhdev has joined #openstack-infra | 01:32 | |
| *** banix has joined #openstack-infra | 01:38 | |
| *** hdd has joined #openstack-infra | 01:38 | |
| *** otter768 has quit IRC | 01:39 | |
| *** sabari is now known as zz_sabari | 01:40 | |
| *** zz_sabari is now known as sabari | 01:41 | |
| *** Sukhdev has quit IRC | 01:42 | |
| *** zz_dimtruck is now known as dimtruck | 01:42 | |
| *** teran_ has joined #openstack-infra | 01:43 | |
| *** markmcclain1 has joined #openstack-infra | 01:44 | |
| *** markmcclain has quit IRC | 01:44 | |
| *** nelsnelson has quit IRC | 01:44 | |
| *** markmcclain has joined #openstack-infra | 01:45 | |
| *** markmcclain1 has quit IRC | 01:45 | |
| *** teran__ has joined #openstack-infra | 01:45 | |
| *** sabari is now known as zz_sabari | 01:46 | |
| *** teran has quit IRC | 01:46 | |
| *** mohitsharma has quit IRC | 01:46 | |
| *** teran_ has quit IRC | 01:48 | |
| *** ryanpetrello has quit IRC | 01:48 | |
| *** Masahiro has joined #openstack-infra | 01:51 | |
| *** otter768 has joined #openstack-infra | 01:51 | |
| *** adalbas has quit IRC | 01:53 | |
| *** Masahiro has quit IRC | 01:56 | |
| *** jerryz has joined #openstack-infra | 01:58 | |
| *** markmcclain has quit IRC | 01:59 | |
| *** david-lyle has quit IRC | 01:59 | |
| *** salv-orlando has joined #openstack-infra | 02:00 | |
| *** mohitsharma has joined #openstack-infra | 02:01 | |
| *** nelsnelson has joined #openstack-infra | 02:03 | |
| *** salv-orlando has quit IRC | 02:12 | |
| *** mmedvede has joined #openstack-infra | 02:17 | |
| *** salv-orlando has joined #openstack-infra | 02:18 | |
| *** Longgeek has joined #openstack-infra | 02:21 | |
| *** salv-orlando has quit IRC | 02:28 | |
| *** baoli has quit IRC | 02:36 | |
| *** salv-orlando has joined #openstack-infra | 02:37 | |
| *** kaisers has joined #openstack-infra | 02:38 | |
| *** kaisers1 has quit IRC | 02:38 | |
| *** salv-orlando has quit IRC | 02:41 | |
| *** r-daneel has joined #openstack-infra | 02:42 | |
| *** Sukhdev has joined #openstack-infra | 02:42 | |
| *** hdd has quit IRC | 02:45 | |
| *** pcrews has joined #openstack-infra | 02:48 | |
| *** dhritishikhar has joined #openstack-infra | 02:50 | |
| *** salv-orlando has joined #openstack-infra | 03:10 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 03:12 | |
| *** salv-orlando has quit IRC | 03:13 | |
| *** dhritishikhar has quit IRC | 03:14 | |
| *** nelsnelson has quit IRC | 03:15 | |
| *** jyuso has joined #openstack-infra | 03:16 | |
| *** r-daneel has quit IRC | 03:22 | |
| *** r-daneel has joined #openstack-infra | 03:23 | |
| wuhg | config.pysize is +1, -1 (doesn't change ) , if i remove it from the patch , will the Code-Review bit refreshed? | 03:23 |
|---|---|---|
| *** julim has quit IRC | 03:24 | |
| clarkb | whenever you push non trivial patchsets the votes are reset | 03:25 |
| *** julim has joined #openstack-infra | 03:25 | |
| clarkb | non trivial means the diff has changed | 03:25 |
| *** julim has quit IRC | 03:25 | |
| *** nelsnelson has joined #openstack-infra | 03:29 | |
| *** nelsnelson has quit IRC | 03:38 | |
| *** markmcclain has joined #openstack-infra | 03:39 | |
| *** Masahiro has joined #openstack-infra | 03:40 | |
| *** nelsnelson has joined #openstack-infra | 03:42 | |
| *** jyuso has quit IRC | 03:43 | |
| *** ddieterly has quit IRC | 03:44 | |
| *** david-lyle has joined #openstack-infra | 03:44 | |
| *** Masahiro has quit IRC | 03:45 | |
| *** shashankhegde has joined #openstack-infra | 03:47 | |
| mtreinish | corvus, fungi, clarkb: is someone comfortable +Aing this?: Dependencies | 03:54 |
| mtreinish | 03:55 | |
| mtreinish | well that didn't work at all as I expected... | 03:55 |
| mtreinish | let me try that again | 03:55 |
| mtreinish | https://review.openstack.org/#/c/136234/ | 03:55 |
| *** markmcclain has quit IRC | 03:56 | |
| *** banix has quit IRC | 03:58 | |
| *** mohitsharma has quit IRC | 04:01 | |
| *** Sukhdev has quit IRC | 04:06 | |
| *** nelsnelson has quit IRC | 04:07 | |
| *** Longgeek has quit IRC | 04:14 | |
| *** Longgeek has joined #openstack-infra | 04:21 | |
| *** hdd has joined #openstack-infra | 04:25 | |
| *** coolsvap|afk is now known as coolsvap | 04:31 | |
| *** shashankhegde has quit IRC | 04:33 | |
| *** nelsnelson has joined #openstack-infra | 04:33 | |
| *** david-lyle has quit IRC | 04:50 | |
| *** david-lyle has joined #openstack-infra | 04:50 | |
| *** bhunter71 has quit IRC | 04:58 | |
| *** sputnik13 has joined #openstack-infra | 04:59 | |
| *** salv-orlando has joined #openstack-infra | 05:00 | |
| *** mohitsharma has joined #openstack-infra | 05:01 | |
| *** david-lyle has quit IRC | 05:06 | |
| *** sputnik1_ has joined #openstack-infra | 05:06 | |
| *** mohitsharma has quit IRC | 05:07 | |
| *** ddieterly has joined #openstack-infra | 05:08 | |
| *** sputnik13 has quit IRC | 05:08 | |
| *** mohitsharma has joined #openstack-infra | 05:08 | |
| *** Sukhdev has joined #openstack-infra | 05:10 | |
| *** salv-orlando has quit IRC | 05:11 | |
| *** pcrews has quit IRC | 05:11 | |
| *** ddieterly has quit IRC | 05:12 | |
| *** sarob has joined #openstack-infra | 05:15 | |
| *** yfried has quit IRC | 05:16 | |
| *** HeOS has joined #openstack-infra | 05:16 | |
| *** otter768 has quit IRC | 05:17 | |
| *** zz_sabari is now known as sabari | 05:18 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 05:21 | |
| heyongli | Intel HW CI: the log server address change to a new IP address: 198.175.100.33. doing this due to network device and topological change, then we can get a more stable service from IT. to access old log(just some sample) you need change to use this new ip. New Log server Sample\: http://198.175.100.33/143614/6/ | 05:24 |
| *** Longgeek has quit IRC | 05:24 | |
| *** sputnik1_ has quit IRC | 05:24 | |
| *** hdd has quit IRC | 05:26 | |
| *** harlowja_at_home has joined #openstack-infra | 05:27 | |
| *** sabari is now known as zz_sabari | 05:28 | |
| *** Masahiro has joined #openstack-infra | 05:29 | |
| *** sputnik13 has joined #openstack-infra | 05:29 | |
| *** Longgeek has joined #openstack-infra | 05:32 | |
| *** Masahiro has quit IRC | 05:33 | |
| *** sputnik1_ has joined #openstack-infra | 05:34 | |
| *** sputnik13 has quit IRC | 05:35 | |
| *** harlowja_at_home has quit IRC | 05:41 | |
| *** harlowja_at_home has joined #openstack-infra | 05:41 | |
| *** mrmartin has joined #openstack-infra | 05:42 | |
| *** HeOS has quit IRC | 05:43 | |
| *** sputnik13 has joined #openstack-infra | 05:44 | |
| *** sputnik13 has quit IRC | 05:45 | |
| *** sputnik1_ has quit IRC | 05:45 | |
| *** sputnik13 has joined #openstack-infra | 05:48 | |
| *** sputnik13 has quit IRC | 05:50 | |
| *** sputnik1_ has joined #openstack-infra | 05:50 | |
| *** salv-orlando has joined #openstack-infra | 05:53 | |
| *** sputnik13 has joined #openstack-infra | 05:54 | |
| *** hdd has joined #openstack-infra | 05:56 | |
| *** sputnik1_ has quit IRC | 05:56 | |
| *** sputnik13 has quit IRC | 05:56 | |
| *** salv-orlando has quit IRC | 05:57 | |
| *** sputnik13 has joined #openstack-infra | 05:58 | |
| *** sarob has quit IRC | 06:02 | |
| *** mohitsharma has quit IRC | 06:03 | |
| *** mohitsharma has joined #openstack-infra | 06:03 | |
| *** salv-orlando has joined #openstack-infra | 06:06 | |
| *** ddieterly has joined #openstack-infra | 06:08 | |
| *** zz_sabari is now known as sabari | 06:08 | |
| *** salv-orlando has quit IRC | 06:11 | |
| *** ddieterly has quit IRC | 06:13 | |
| *** shashankhegde has joined #openstack-infra | 06:17 | |
| *** mrmartin has quit IRC | 06:21 | |
| *** vigneshvar has joined #openstack-infra | 06:22 | |
| *** r-daneel has quit IRC | 06:25 | |
| *** harlowja_at_home has quit IRC | 06:26 | |
| *** Masahiro has joined #openstack-infra | 06:30 | |
| *** dimtruck is now known as zz_dimtruck | 06:31 | |
| *** Masahiro has quit IRC | 06:34 | |
| *** sputnik13 has quit IRC | 06:43 | |
| *** yfried has joined #openstack-infra | 06:44 | |
| *** fandi has joined #openstack-infra | 06:44 | |
| *** sputnik13 has joined #openstack-infra | 06:45 | |
| *** fandi has quit IRC | 06:46 | |
| *** fandi has joined #openstack-infra | 06:47 | |
| *** Sukhdev has quit IRC | 06:48 | |
| *** yfried has quit IRC | 06:48 | |
| *** yfried_ has joined #openstack-infra | 06:48 | |
| *** nikesh_vedams_ has joined #openstack-infra | 06:50 | |
| *** hdd has quit IRC | 06:52 | |
| *** jerryz has quit IRC | 06:52 | |
| *** jerryz has joined #openstack-infra | 06:53 | |
| nikesh_vedams_ | i deployed a kilo devstack on ubuntu 14.04 server. i launched a instance from dashboard,successfully launched but i am unable to open console from dashboard for instance | 06:55 |
| nikesh_vedams_ | Also instacne is unable to get ip | 06:55 |
| nikesh_vedams_ | any idea | 06:56 |
| *** Longgeek has quit IRC | 06:59 | |
| *** zz_avozza is now known as avozza | 07:00 | |
| *** fandi has quit IRC | 07:01 | |
| *** paul-- has quit IRC | 07:08 | |
| *** ddieterly has joined #openstack-infra | 07:08 | |
| *** Longgeek has joined #openstack-infra | 07:08 | |
| *** paul-- has joined #openstack-infra | 07:09 | |
| *** avozza is now known as zz_avozza | 07:10 | |
| *** ddieterly has quit IRC | 07:12 | |
| *** otter768 has joined #openstack-infra | 07:17 | |
| *** coolsvap is now known as coolsvap|afk | 07:20 | |
| *** otter768 has quit IRC | 07:22 | |
| *** shashankhegde has quit IRC | 07:22 | |
| *** ildikov has joined #openstack-infra | 07:23 | |
| *** fandi has joined #openstack-infra | 07:24 | |
| *** _nadya_ has joined #openstack-infra | 07:25 | |
| *** coolsvap has joined #openstack-infra | 07:29 | |
| *** _nadya_ has quit IRC | 07:29 | |
| *** zz_dimtruck is now known as dimtruck | 07:31 | |
| *** mrunge has joined #openstack-infra | 07:33 | |
| *** salv-orlando has joined #openstack-infra | 07:37 | |
| *** coolsvap has quit IRC | 07:38 | |
| *** dimtruck is now known as zz_dimtruck | 07:41 | |
| *** HeOS has joined #openstack-infra | 07:44 | |
| *** ddieterly has joined #openstack-infra | 07:45 | |
| *** mohitsharma has quit IRC | 07:46 | |
| *** nijaba has quit IRC | 07:48 | |
| *** nijaba has joined #openstack-infra | 07:48 | |
| *** ddieterly has quit IRC | 07:49 | |
| *** salv-orlando has quit IRC | 07:49 | |
| *** salv-orlando has joined #openstack-infra | 07:50 | |
| *** salv-orlando has quit IRC | 07:54 | |
| *** jamielennox is now known as jamielennox|away | 07:56 | |
| *** paul-- has quit IRC | 08:00 | |
| *** paul-- has joined #openstack-infra | 08:01 | |
| *** zz_avozza is now known as avozza | 08:01 | |
| *** mika has quit IRC | 08:03 | |
| *** ihrachyshka has joined #openstack-infra | 08:06 | |
| *** e0ne has joined #openstack-infra | 08:07 | |
| *** markus_z has joined #openstack-infra | 08:09 | |
| *** e0ne has quit IRC | 08:10 | |
| *** chlong has quit IRC | 08:10 | |
| *** mika has joined #openstack-infra | 08:11 | |
| *** Ala has joined #openstack-infra | 08:13 | |
| *** arxcruz has joined #openstack-infra | 08:14 | |
| *** avozza is now known as zz_avozza | 08:15 | |
| *** skraynev has joined #openstack-infra | 08:16 | |
| *** tkelsey has joined #openstack-infra | 08:17 | |
| *** Masahiro has joined #openstack-infra | 08:18 | |
| *** jlibosva has joined #openstack-infra | 08:20 | |
| *** Masahiro has quit IRC | 08:23 | |
| *** fandi has quit IRC | 08:23 | |
| *** skraynev_ has joined #openstack-infra | 08:28 | |
| *** yolanda has joined #openstack-infra | 08:28 | |
| *** skraynev_ has quit IRC | 08:28 | |
| *** pblaho has joined #openstack-infra | 08:31 | |
| *** zz_dimtruck is now known as dimtruck | 08:33 | |
| *** links has joined #openstack-infra | 08:35 | |
| *** mrmartin has joined #openstack-infra | 08:37 | |
| *** mpaolino has joined #openstack-infra | 08:38 | |
| *** jkraj has joined #openstack-infra | 08:39 | |
| *** afazekas has joined #openstack-infra | 08:39 | |
| *** coolsvap|afk is now known as coolsvap | 08:42 | |
| *** dimtruck is now known as zz_dimtruck | 08:42 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/storyboard: Implement Streaming API websocket handler https://review.openstack.org/143304 | 08:44 |
| *** jcoufal has joined #openstack-infra | 08:48 | |
| *** ihrachyshka has quit IRC | 08:49 | |
| *** hashar has joined #openstack-infra | 08:49 | |
| *** tkelsey has quit IRC | 08:52 | |
| *** unicell has joined #openstack-infra | 08:53 | |
| *** dizquierdo has joined #openstack-infra | 08:59 | |
| *** andreykurilin has joined #openstack-infra | 08:59 | |
| *** sabari is now known as zz_sabari | 09:00 | |
| *** jlibosva has quit IRC | 09:00 | |
| *** jlibosva has joined #openstack-infra | 09:01 | |
| *** mohitsharma has joined #openstack-infra | 09:02 | |
| *** sarob has joined #openstack-infra | 09:02 | |
| *** jpich has joined #openstack-infra | 09:02 | |
| *** mohitsharma has quit IRC | 09:04 | |
| *** mohitsharma has joined #openstack-infra | 09:04 | |
| *** achanda has joined #openstack-infra | 09:06 | |
| *** sarob has quit IRC | 09:07 | |
| *** derekh has joined #openstack-infra | 09:07 | |
| *** mohitsharma has quit IRC | 09:09 | |
| *** MaxV has joined #openstack-infra | 09:09 | |
| *** mohitsharma has joined #openstack-infra | 09:13 | |
| *** mrunge has quit IRC | 09:14 | |
| *** zz_avozza is now known as avozza | 09:18 | |
| *** otter768 has joined #openstack-infra | 09:18 | |
| *** otter768 has quit IRC | 09:23 | |
| *** vponomaryov has joined #openstack-infra | 09:24 | |
| *** jlibosva has quit IRC | 09:26 | |
| *** mrunge has joined #openstack-infra | 09:27 | |
| *** jlibosva has joined #openstack-infra | 09:28 | |
| *** andreykurilin has quit IRC | 09:28 | |
| *** andreykurilin has joined #openstack-infra | 09:29 | |
| *** achanda has quit IRC | 09:30 | |
| *** zz_dimtruck is now known as dimtruck | 09:31 | |
| *** romcheg has joined #openstack-infra | 09:32 | |
| *** Hal_ has joined #openstack-infra | 09:33 | |
| *** ZZelle|away has quit IRC | 09:35 | |
| *** ZZelle|away has joined #openstack-infra | 09:35 | |
| *** mohitsharma has quit IRC | 09:38 | |
| *** ihrachyshka has joined #openstack-infra | 09:38 | |
| *** mohitsharma has joined #openstack-infra | 09:39 | |
| *** ZZelle|away is now known as ZZelle | 09:40 | |
| *** ZZelle is now known as Guest49447 | 09:40 | |
| *** pelix has joined #openstack-infra | 09:40 | |
| *** Guest49447 is now known as ZZelle_ | 09:41 | |
| *** dimtruck is now known as zz_dimtruck | 09:41 | |
| *** jcoufal_ has joined #openstack-infra | 09:41 | |
| *** jedimike has joined #openstack-infra | 09:42 | |
| *** salv-orlando has joined #openstack-infra | 09:42 | |
| nikesh_vedams_ | i am getting some issue in devtstack?can any one help please? | 09:43 |
| *** jcoufal has quit IRC | 09:44 | |
| *** mohitsharma has quit IRC | 09:47 | |
| *** andreykurilin has quit IRC | 09:50 | |
| *** dalgaaf has joined #openstack-infra | 09:54 | |
| *** jistr has joined #openstack-infra | 09:58 | |
| openstackgerrit | Roman Prykhodchenko proposed openstack-infra/project-config: Add Fuel Client to Stackforge https://review.openstack.org/145843 | 10:01 |
| *** mpaolino has quit IRC | 10:01 | |
| *** achanda has joined #openstack-infra | 10:02 | |
| openstackgerrit | Roman Prykhodchenko proposed openstack-infra/project-config: Add Fuel Client to Stackforge https://review.openstack.org/145843 | 10:07 |
| *** Masahiro has joined #openstack-infra | 10:07 | |
| *** yfried_ is now known as yfried|afk | 10:11 | |
| *** Masahiro has quit IRC | 10:11 | |
| *** dizquierdo has quit IRC | 10:12 | |
| *** mpaolino has joined #openstack-infra | 10:14 | |
| *** achanda has quit IRC | 10:15 | |
| *** yfried|afk is now known as yfried_ | 10:15 | |
| romcheg | Hi guys! | 10:17 |
| romcheg | I can see my patch to project-config fails with a test unable to install all deps | 10:18 |
| romcheg | This one https://jenkins05.openstack.org/job/gate-project-config-layout/345/ | 10:19 |
| *** mpaolino has quit IRC | 10:19 | |
| *** mase_x200 has joined #openstack-infra | 10:19 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add maxlength validation for fields https://review.openstack.org/146055 | 10:25 |
| *** adalbas has joined #openstack-infra | 10:25 | |
| *** e0ne has joined #openstack-infra | 10:27 | |
| *** adalbas has quit IRC | 10:28 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add grunt-lintspaces module to check cr-at-end in js files https://review.openstack.org/145483 | 10:28 |
| *** ssam2 has joined #openstack-infra | 10:29 | |
| *** mpaolino has joined #openstack-infra | 10:32 | |
| *** zz_dimtruck is now known as dimtruck | 10:32 | |
| *** marcusvrn has joined #openstack-infra | 10:32 | |
| *** jerryz has quit IRC | 10:34 | |
| romcheg | I cloned zuul's repo from https://git.openstack.org/openstack-infra/zuul and indeed it fails | 10:34 |
| *** ldnunes has joined #openstack-infra | 10:41 | |
| *** dimtruck is now known as zz_dimtruck | 10:42 | |
| *** nithyag_ has quit IRC | 10:44 | |
| *** jerryz has joined #openstack-infra | 10:49 | |
| jhesketh | romcheg: I have a fix up for that: https://review.openstack.org/#/c/146350/ | 10:55 |
| *** mpaolino has quit IRC | 10:55 | |
| *** mfink has quit IRC | 10:55 | |
| romcheg | jhesketh: I've already filed a bug for that https://storyboard.openstack.org/#!/story/2000107 so maybe you want to attach your patch to it | 10:56 |
| jhesketh | romcheg: oh cheers :-) | 10:56 |
| jhesketh | there's an upstream bug too | 10:56 |
| *** andreykurilin has joined #openstack-infra | 10:56 | |
| romcheg | jhesketh: I got lost in infra's bug-trackers :D | 10:57 |
| jhesketh | heh | 10:57 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Pin python-daemon<2.0 https://review.openstack.org/146350 | 10:57 |
| *** berendt has joined #openstack-infra | 10:59 | |
| *** pcaruana has joined #openstack-infra | 10:59 | |
| *** jp_at_hp has joined #openstack-infra | 11:05 | |
| *** rfolco has joined #openstack-infra | 11:07 | |
| *** Masahiro has joined #openstack-infra | 11:08 | |
| *** unicell has quit IRC | 11:08 | |
| *** mpaolino has joined #openstack-infra | 11:08 | |
| *** andreykurilin has quit IRC | 11:10 | |
| *** aysyd has joined #openstack-infra | 11:10 | |
| *** gilllliard is now known as gilliard | 11:11 | |
| *** rfolco has quit IRC | 11:11 | |
| *** _nadya_ has joined #openstack-infra | 11:12 | |
| *** rfolco has joined #openstack-infra | 11:12 | |
| *** Masahiro has quit IRC | 11:13 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 11:13 | |
| *** mpaolino has quit IRC | 11:13 | |
| *** mpaolino has joined #openstack-infra | 11:14 | |
| *** rfolco has quit IRC | 11:17 | |
| *** Hal_ has quit IRC | 11:18 | |
| *** koolhead17 has joined #openstack-infra | 11:18 | |
| *** otter768 has joined #openstack-infra | 11:19 | |
| *** avozza is now known as zz_avozza | 11:20 | |
| *** teran has joined #openstack-infra | 11:21 | |
| *** teran__ has quit IRC | 11:24 | |
| *** otter768 has quit IRC | 11:24 | |
| *** andreaf has joined #openstack-infra | 11:24 | |
| *** adalbas has joined #openstack-infra | 11:28 | |
| *** rfolco has joined #openstack-infra | 11:29 | |
| *** david-lyle has joined #openstack-infra | 11:32 | |
| *** adalbas has quit IRC | 11:32 | |
| *** teran has quit IRC | 11:32 | |
| *** zz_dimtruck is now known as dimtruck | 11:33 | |
| *** rfolco has quit IRC | 11:33 | |
| *** zz_avozza is now known as avozza | 11:37 | |
| *** rfolco has joined #openstack-infra | 11:38 | |
| *** chlong has joined #openstack-infra | 11:41 | |
| *** dimtruck is now known as zz_dimtruck | 11:42 | |
| *** rfolco has quit IRC | 11:43 | |
| *** adalbas has joined #openstack-infra | 11:44 | |
| *** rfolco has joined #openstack-infra | 11:45 | |
| *** dizquierdo has joined #openstack-infra | 11:47 | |
| *** chlong has quit IRC | 11:47 | |
| *** chlong has joined #openstack-infra | 11:47 | |
| *** rfolco has quit IRC | 11:49 | |
| *** rfolco has joined #openstack-infra | 11:52 | |
| *** cdent has joined #openstack-infra | 11:53 | |
| openstackgerrit | Merged openstack-infra/zuul: Pin python-daemon<2.0 https://review.openstack.org/146350 | 11:54 |
| *** andreaf has quit IRC | 11:56 | |
| *** e0ne is now known as e0ne_ | 11:56 | |
| *** avozza is now known as zz_avozza | 11:59 | |
| *** _nadya_ has quit IRC | 12:01 | |
| *** teran has joined #openstack-infra | 12:03 | |
| romcheg | I tried running tox -e zuul in project-config. Still seems to fail with the same error http://paste.openstack.org/show/156446/ | 12:03 |
| romcheg | after 146350 was merged | 12:03 |
| romcheg | SergeyLukjanov: could you please take a look at ^ | 12:03 |
| *** e0ne_ is now known as e0ne | 12:04 | |
| *** rfolco has quit IRC | 12:07 | |
| *** dmsimard_away is now known as dmsimard | 12:08 | |
| *** teran has quit IRC | 12:08 | |
| *** teran has joined #openstack-infra | 12:09 | |
| *** EmilienM|afk is now known as EmilienM | 12:10 | |
| *** redixin has joined #openstack-infra | 12:12 | |
| *** andreaf has joined #openstack-infra | 12:12 | |
| *** dkranz has quit IRC | 12:15 | |
| *** zz_avozza is now known as avozza | 12:18 | |
| *** hashar has quit IRC | 12:21 | |
| *** teran_ has joined #openstack-infra | 12:24 | |
| *** yfried_ is now known as yfried|afk | 12:24 | |
| *** imeerovi has joined #openstack-infra | 12:25 | |
| romcheg | Fixed. In addition to recreating tox environments I had to remove .test dir | 12:26 |
| *** teran has quit IRC | 12:27 | |
| *** esmute has quit IRC | 12:29 | |
| *** baoli has joined #openstack-infra | 12:29 | |
| *** baoli has quit IRC | 12:30 | |
| *** jkraj has quit IRC | 12:31 | |
| *** esmute has joined #openstack-infra | 12:32 | |
| *** zz_dimtruck is now known as dimtruck | 12:34 | |
| *** Hal_ has joined #openstack-infra | 12:34 | |
| *** dims has joined #openstack-infra | 12:35 | |
| *** koolhead17 has quit IRC | 12:38 | |
| *** yfried|afk is now known as yfried_ | 12:38 | |
| *** doug-fish has joined #openstack-infra | 12:39 | |
| *** alexpilotti has joined #openstack-infra | 12:39 | |
| *** Longgeek has quit IRC | 12:39 | |
| *** weshay has joined #openstack-infra | 12:43 | |
| *** dimtruck is now known as zz_dimtruck | 12:43 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Teams endpoint https://review.openstack.org/146451 | 12:44 |
| *** alexpilotti has quit IRC | 12:44 | |
| *** esmute has quit IRC | 12:45 | |
| romcheg | jhesketh: May I please ask you to take a look at https://review.openstack.org/#/c/145843 ? Tests pass for me now but I'm not familiar with Infra enough to be 100% sure I did everything corectly | 12:46 |
| *** mwagner_lap has quit IRC | 12:47 | |
| *** esmute has joined #openstack-infra | 12:48 | |
| *** miqui has quit IRC | 12:49 | |
| openstackgerrit | Aleksey proposed openstack-infra/storyboard: Text fields validation with json schema https://review.openstack.org/143988 | 12:49 |
| openstackgerrit | Aleksey proposed openstack-infra/storyboard: Git repo links in project table https://review.openstack.org/143455 | 12:52 |
| *** alexpilotti has joined #openstack-infra | 12:55 | |
| *** chlong has quit IRC | 12:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Delete bashate job from sahara-image-elements https://review.openstack.org/146318 | 12:56 |
| *** Masahiro has joined #openstack-infra | 12:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Add experimental Fedora 21 devstack job https://review.openstack.org/140889 | 12:58 |
| *** Masahiro has quit IRC | 13:01 | |
| *** Longgeek has joined #openstack-infra | 13:02 | |
| *** dprince has joined #openstack-infra | 13:02 | |
| *** radez_g0n3 is now known as radez | 13:03 | |
| *** jlibosva has quit IRC | 13:03 | |
| *** jlibosva has joined #openstack-infra | 13:05 | |
| *** dkranz has joined #openstack-infra | 13:08 | |
| nikesh_vedams_ | hi | 13:09 |
| nikesh_vedams_ | we want to create a CI for our cinder driver "https://review.openstack.org/#/c/145778/" | 13:10 |
| nikesh_vedams_ | please give some input on this | 13:10 |
| nikesh_vedams_ | we are beginners in CI | 13:10 |
| *** e0ne is now known as e0ne_ | 13:11 | |
| *** dkehn has quit IRC | 13:11 | |
| *** dkehn has joined #openstack-infra | 13:13 | |
| *** dims has quit IRC | 13:14 | |
| *** bswartz has quit IRC | 13:14 | |
| *** ryanpetrello has joined #openstack-infra | 13:17 | |
| *** dims__ has joined #openstack-infra | 13:18 | |
| *** otter768 has joined #openstack-infra | 13:20 | |
| *** hashar has joined #openstack-infra | 13:21 | |
| *** sandywalsh has joined #openstack-infra | 13:22 | |
| *** kgiusti has joined #openstack-infra | 13:25 | |
| *** otter768 has quit IRC | 13:25 | |
| *** jkraj has joined #openstack-infra | 13:25 | |
| *** mwagner_lap has joined #openstack-infra | 13:27 | |
| *** mfink has joined #openstack-infra | 13:27 | |
| *** jlibosva has quit IRC | 13:31 | |
| *** mbacchi has joined #openstack-infra | 13:32 | |
| *** zz_dimtruck is now known as dimtruck | 13:34 | |
| openstackgerrit | Roman Prykhodchenko proposed openstack-infra/project-config: Add Fuel Client to Stackforge https://review.openstack.org/145843 | 13:37 |
| *** berendt has quit IRC | 13:41 | |
| *** doude has quit IRC | 13:41 | |
| *** avozza is now known as zz_avozza | 13:41 | |
| *** doude_ has joined #openstack-infra | 13:41 | |
| *** dimtruck is now known as zz_dimtruck | 13:44 | |
| *** bcourt has joined #openstack-infra | 13:45 | |
| *** davidhadas_ has joined #openstack-infra | 13:45 | |
| *** e0ne_ is now known as e0ne | 13:45 | |
| *** bknudson has quit IRC | 13:51 | |
| *** arielb has joined #openstack-infra | 13:51 | |
| *** arielb has joined #openstack-infra | 13:51 | |
| *** katherine__ has joined #openstack-infra | 13:53 | |
| *** davidhadas___ has joined #openstack-infra | 13:54 | |
| *** vigneshvar has quit IRC | 13:55 | |
| mkoderer | nikesh_vedams_: http://ci.openstack.org/third_party.html | 13:55 |
| openstackgerrit | Joakim Löfgren proposed openstack-infra/jenkins-job-builder: Add DRY publisher https://review.openstack.org/126317 | 13:56 |
| mkoderer | nikesh_vedams_: do you have any specific question? | 13:56 |
| *** davidhadas_ has quit IRC | 13:57 | |
| *** bswartz has joined #openstack-infra | 13:57 | |
| nikesh_vedams_ | mkoderer: hmm, just talked to jaypipes and he suggested "https://github.com/rasselin/os-ext-testing" | 13:58 |
| nikesh_vedams_ | mkoderer: but its not updated for ubuntu 14.04 | 13:58 |
| nikesh_vedams_ | mkoderer:so need to talk rasselin but seems he is not online | 13:59 |
| *** amitgandhinz has joined #openstack-infra | 14:00 | |
| mkoderer | nikesh_vedams_: ok so jaypipes blog post is also very good http://www.joinfu.com/2014/02/setting-up-an-external-openstack-testing-system/ | 14:01 |
| nikesh_vedams_ | yes i m going through that | 14:01 |
| jaypipes | mkoderer: well, it's outdated unfortunately. | 14:01 |
| mkoderer | jaypipes: but it's a valid starting point.. I guess :) | 14:01 |
| jaypipes | mkoderer: it has a big warning note at the top about it not working since the config -> system-config/project-config split happened. | 14:01 |
| jaypipes | mkoderer: :) perhaps. It's been unfortunately very confusing for people :( | 14:02 |
| *** unicell has joined #openstack-infra | 14:02 | |
| *** e0ne is now known as e0ne_ | 14:03 | |
| mkoderer | jaypipes: :) ok .. maybe it's due to the complexity in general | 14:03 |
| jaypipes | mkoderer: well, sure, but that's really no excuse for my work being a confusion to others :( I really need to find time to clean it all up | 14:05 |
| *** sputnik13 has quit IRC | 14:08 | |
| *** dustins has joined #openstack-infra | 14:10 | |
| *** mase_x200 has quit IRC | 14:11 | |
| *** e0ne_ is now known as e0ne | 14:11 | |
| *** garyh has joined #openstack-infra | 14:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Add nodepool script to preseed testrepository from subunit2sql https://review.openstack.org/136234 | 14:14 |
| *** julim has joined #openstack-infra | 14:15 | |
| fungi | mtreinish: since that ^ merged so close to the wire, i rushed nodepool to update from puppet so it should get incorporated into the image builds which had just started | 14:16 |
| *** amitgandhinz has quit IRC | 14:17 | |
| *** _nadya_ has joined #openstack-infra | 14:18 | |
| *** jlibosva has joined #openstack-infra | 14:19 | |
| fungi | (image updates start at 14:14 utc) | 14:20 |
| mrmartin | hi fungi | 14:24 |
| fungi | hi mrmartin | 14:24 |
| mrmartin | something was a bit broken today morning: http://logs.openstack.org/92/146392/1/check/gate-groups-unittests/48e62b2/console.html | 14:24 |
| mrmartin | https://review.openstack.org/#/c/146392/ | 14:24 |
| mrmartin | this patch got his +1 from jenkins just for 3rd try | 14:25 |
| *** yfried_ is now known as yfried|afk | 14:25 | |
| *** yfried|afk is now known as yfried_ | 14:25 | |
| fungi | mrmartin: looks like authentication failures contacting static.openstack.org (where the logs site is served) | 14:28 |
| mrmartin | seems to be ok now anyway | 14:28 |
| fungi | the run previous to that seems to have gotten a corrupt tarball from github | 14:29 |
| *** sabeen1 has joined #openstack-infra | 14:29 | |
| mrmartin | ok, so maybe some networking related magnetic storm | 14:29 |
| fungi | yeah, i'm looking to see if i can correlate it to anything | 14:29 |
| mrmartin | anyway, if you have some boring hours, or simply cannot sleep :) I have this askbot patch, sitting in the queue for a while: https://review.openstack.org/#/c/140043/ | 14:30 |
| mrmartin | and if this gets some approval, it requires a new instance also | 14:30 |
| fungi | oh, right, i meant to check back in on that one after you'd had time to polish it a little. i'll add it to my priority pile | 14:31 |
| mrmartin | I have access for the current server, so I can help in the initial transition of database, etc. | 14:31 |
| *** davidhadas___ has quit IRC | 14:31 | |
| *** sarob has joined #openstack-infra | 14:31 | |
| fungi | if you can get me access to it as well, that way i can get to the database dumps (since i'll have access to the new server to import them) | 14:32 |
| *** eharney has joined #openstack-infra | 14:32 | |
| mrmartin | ok, I'll manage that | 14:33 |
| *** jerryz has quit IRC | 14:35 | |
| *** dkliban_afk is now known as dkliban | 14:35 | |
| *** zz_dimtruck is now known as dimtruck | 14:35 | |
| *** mriedem has joined #openstack-infra | 14:36 | |
| *** Longgeek has quit IRC | 14:37 | |
| *** e0ne is now known as e0ne_ | 14:39 | |
| *** zz_gondoi is now known as gondoi | 14:39 | |
| *** lttrl has joined #openstack-infra | 14:40 | |
| *** baoli has joined #openstack-infra | 14:41 | |
| *** e0ne_ is now known as e0ne | 14:42 | |
| *** Longgeek has joined #openstack-infra | 14:42 | |
| *** hdd has joined #openstack-infra | 14:42 | |
| *** salv-orl_ has joined #openstack-infra | 14:42 | |
| *** baoli_ has joined #openstack-infra | 14:42 | |
| *** nelsnelson has quit IRC | 14:43 | |
| *** mestery_ has joined #openstack-infra | 14:43 | |
| *** salv-orlando has quit IRC | 14:43 | |
| *** baoli has quit IRC | 14:43 | |
| *** mestery has quit IRC | 14:43 | |
| *** dimtruck is now known as zz_dimtruck | 14:45 | |
| *** bknudson has joined #openstack-infra | 14:45 | |
| *** armax has joined #openstack-infra | 14:45 | |
| *** Masahiro has joined #openstack-infra | 14:45 | |
| *** baoli_ has quit IRC | 14:47 | |
| *** baoli has joined #openstack-infra | 14:48 | |
| *** nelsnelson has joined #openstack-infra | 14:48 | |
| *** baoli has quit IRC | 14:49 | |
| *** baoli has joined #openstack-infra | 14:49 | |
| *** Masahiro has quit IRC | 14:50 | |
| *** amitgandhinz has joined #openstack-infra | 14:51 | |
| *** mattfarina has joined #openstack-infra | 14:51 | |
| *** jkraj has quit IRC | 14:51 | |
| *** mattfarina has quit IRC | 14:54 | |
| *** rlandy has joined #openstack-infra | 14:55 | |
| *** mattfarina has joined #openstack-infra | 14:56 | |
| *** baoli has quit IRC | 14:57 | |
| *** mestery_ is now known as mestery | 14:58 | |
| *** ddieterly has joined #openstack-infra | 14:59 | |
| *** fifieldt__ has joined #openstack-infra | 15:00 | |
| *** asselin_ has joined #openstack-infra | 15:01 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:02 | |
| *** fifieldt_ has quit IRC | 15:02 | |
| katherine__ | good morning, infra folks. katherine here again | 15:03 |
| *** annegentle has joined #openstack-infra | 15:03 | |
| katherine__ | i'm still trying to figure out how to pull the git refs files using http when my gerrit is configured to use ssh | 15:03 |
| *** dustins_ has joined #openstack-infra | 15:03 | |
| *** julim_ has joined #openstack-infra | 15:04 | |
| katherine__ | i've added a special user with ssh keys and an http password and added it to an acl but still get auth errors | 15:04 |
| katherine__ | i do not know where to go from here | 15:04 |
| *** dustins has quit IRC | 15:04 | |
| jkt | hi there, I tried to help katherine__ with that, and indeed it seems wrong that zuul/trigger/gerrit.py is hardcoded to always talk git-over-http and interpret pretty low-level wire traffic from there | 15:04 |
| jkt | IMHO, it would make more sense to do something like `git ls-remote` | 15:04 |
| jkt | because the assumption that git is always reachable over http is a bit opitmistic one, IMHO | 15:05 |
| *** julim has quit IRC | 15:05 | |
| *** dhritishikhar has joined #openstack-infra | 15:06 | |
| *** mtanino has joined #openstack-infra | 15:07 | |
| katherine__ | short of modifying the zuul gerrit trigger to be ssh-friendly for us, i'm at a loss | 15:07 |
| fungi | jkt: putting an ssh url into the zuul configuration doesn't work then? | 15:07 |
| katherine__ | no | 15:08 |
| katherine__ | the gerrit trigger code is using python's urllib2 and a url read | 15:08 |
| katherine__ | the urllib2 library can not read from ssh | 15:08 |
| fungi | it's definitely not something we use, so untested and unsurprising (to me) that it doesn't work | 15:08 |
| jkt | fungi: the code is like this, url = "%s/p/%s/info/refs?service=git-upload-pack" % ( self.baseurl, project) | 15:09 |
| *** HeOS has quit IRC | 15:09 | |
| jkt | fungi: it looks a bit scary, imho | 15:09 |
| *** sarob has quit IRC | 15:09 | |
| fungi | jkt: got it, so it's not shelling out to git at all, nor using gitpython? | 15:09 |
| *** dkranz has quit IRC | 15:09 | |
| jkt | fungi: yes | 15:09 |
| jkt | based on git history, it was added to fix a race where zuul would try to use a ref before it arrived to the git repo | 15:09 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: hipchat posting doesn't work on newer jenkins https://review.openstack.org/146487 | 15:10 |
| jkt | fungi: https://review.openstack.org/#/c/10673/ | 15:10 |
| *** wuhg has quit IRC | 15:14 | |
| *** dkranz has joined #openstack-infra | 15:14 | |
| *** dkranz has quit IRC | 15:14 | |
| *** dkranz has joined #openstack-infra | 15:14 | |
| *** superdan is now known as dansmith | 15:15 | |
| *** koolhead17 has joined #openstack-infra | 15:15 | |
| fungi | jkt: yeah, i remember that race condition now... does indeed look like that workaround could be expanded to be more general and less protocol-specific | 15:15 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 15:16 |
| *** spzala has joined #openstack-infra | 15:16 | |
| *** beekneemech is now known as bnemec | 15:16 | |
| katherine__ | fungi:jkt: that is what i've been considering doing. i asked the infra folks last week if they would consider doing that | 15:16 |
| katherine__ | i could work on the implementation while getting it to work in our env | 15:17 |
| fungi | katherine__: i'm pretty sure we wouldn't reject a patch to fix that, if you have the time to work on it and get it through review | 15:18 |
| katherine__ | i'll double check with my team but i think they're pretty committed to getting zuul working in our env so would not be opposed to putting that work in | 15:18 |
| *** otter768 has joined #openstack-infra | 15:21 | |
| *** berendt has joined #openstack-infra | 15:21 | |
| clarkb | setting baseurl to https://user:pass@foo.gerrit.com didnt work? | 15:22 |
| jkt | clarkb: that still relies on an assumption that there's a properly configured git-daemon taking care of HTTP access to repos | 15:23 |
| clarkb | there is | 15:23 |
| clarkb | gerrit | 15:23 |
| *** tkelsey has joined #openstack-infra | 15:24 | |
| *** enikanorov has joined #openstack-infra | 15:24 | |
| fungi | oh, right, the alternative suggestion was to use authenticated http | 15:25 |
| fungi | rather than ssh | 15:25 |
| *** dustins_ has quit IRC | 15:26 | |
| *** otter768 has quit IRC | 15:26 | |
| katherine__ | clarkb: no, that did not work. | 15:26 |
| katherine__ | i did verify i was able to clone with that user via ssh | 15:27 |
| fungi | jkt: was authenticated http breaking on the same place (the commit ready race workaround in the trigger)? | 15:27 |
| *** imeerovi has quit IRC | 15:28 | |
| jkt | clarkb: ok, you're right | 15:28 |
| jkt | fungi: I have no idea, stuff works well for me, I was just curious on why it hardcoded http(s) access in there | 15:29 |
| fungi | i still think making it protocol-agnostic in that spot would probably be fine, but am still curious why authenticated http(s) isn't working | 15:30 |
| *** teran has joined #openstack-infra | 15:30 | |
| *** e0ne is now known as e0ne_ | 15:30 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/storyboard: Added tags controllers https://review.openstack.org/114217 | 15:31 |
| *** kaisers has quit IRC | 15:31 | |
| jkt | katherine__: your server at https://review.hpcloud.net/p/openstack/neutron/info/refs?service=git-upload-pack times out for me | 15:31 |
| katherine__ | when i list the acl group i added the user to, i do see it in the list. however, on the ui in that group, i do not see my user and cannot add it via ui | 15:31 |
| katherine__ | jkt: ok. i'm able to access it from here. it's acutally hp cloud's gozer gerrit | 15:32 |
| *** imcsk8 has quit IRC | 15:33 | |
| *** imcsk8 has joined #openstack-infra | 15:33 | |
| *** teran_ has quit IRC | 15:34 | |
| fungi | jkt: probably behind a firewall in hpcloud | 15:34 |
| romcheg | Hi fungi, jkt! | 15:34 |
| clarkb | why dont you use gozers zuul? | 15:34 |
| clarkb | seems like extra work to run >1... | 15:35 |
| romcheg | I'm adding a new project to Stackforge but it's only compatible with 2.6 now. I still can see the py26 job but afaik py26 was deprecated. | 15:35 |
| katherine__ | clarkb: we already have a zuul instance. but our zuul works fine, it's only our gerrit instance that isn't cooperating | 15:35 |
| *** sputnik13 has joined #openstack-infra | 15:35 | |
| romcheg | Is that job going to be present at least 'til Kilo release? | 15:35 |
| jesusaurus | katherine__: you shouldnt need to run another zuul, there is already one running in gozer for hpcloud.net | 15:36 |
| katherine__ | jesusaurus: we would prefer to have our own instance as we are a completely different project. but zuul isn't the issue here | 15:37 |
| *** sarob has joined #openstack-infra | 15:38 | |
| fungi | katherine__: though more to the point, if gozer's zuul can interact with review.hpcloud.net then surely yours could be configured similarly? | 15:38 |
| *** e0ne_ has quit IRC | 15:41 | |
| *** zz_dimtruck is now known as dimtruck | 15:41 | |
| *** sarob has quit IRC | 15:41 | |
| katherine__ | our zuul is configured the same as hp cloud's | 15:42 |
| katherine__ | fungi: it's our gerrit that is different | 15:43 |
| jkt | I actually like the fact that zuul downloads right from Gerrit without respecting the download plugin settings | 15:43 |
| clarkb | what is a download plugin? | 15:43 |
| *** _nadya_ has quit IRC | 15:43 | |
| fungi | katherine__: oh, got it | 15:43 |
| jkt | that would send the CI to public mirrors which are in different countries | 15:43 |
| katherine__ | fungi: zuul is not involved in this problem. it's when we try to use the git-http-backend on our gerrit instance that causes the problem | 15:43 |
| katherine__ | fungi: cool | 15:44 |
| *** zz_jgrimm is now known as jgrimm | 15:44 | |
| jkt | clarkb: it's configurable what gets shown on the web under the "download" link, what protocols to offer (git/ssh/http/...) etc | 15:44 |
| jkt | clarkb: there's also a gerrit-wide config option what URLs to return to clients when they call that REST endpoint "where can I get this from" | 15:45 |
| clarkb | so zuul exists and supports gerrit from before the rest api or plugins | 15:45 |
| clarkb | so zuul has to had to and continues to work without features like that | 15:45 |
| jkt | and for me, it's a very good thing | 15:46 |
| nikesh_vedams_ | mkoderer: there? | 15:46 |
| clarkb | I am confused about http not working since that is how you do code reviews in a browser | 15:46 |
| clarkb | so it should work enough to do http auth and serve pages | 15:47 |
| jkt | clarkb: I just asked katherine__ to come here and ask here because that code looked really like a zuul problem, no matter that there's probably some misconfigured user account or something | 15:47 |
| clarkb | yes I think we agree zuul could be better there but we also suggested a workaround whih doesnt work | 15:48 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: add support for python and tox matrix project axis https://review.openstack.org/134025 | 15:48 |
| katherine__ | clarkb: a bit of info - i am able to clone using "git clone https://zuul:password@cvp-test-gerrit.vse.adapps.hp.com/project" but still cannot access refs with "https://zuul:password@cvp-test-gerrit.vse.adapps.hp.com/p/project/info/refs" | 15:49 |
| jkt | katherine__: that URL has to end with ?service=git-upload-pack | 15:49 |
| katherine__ | jkt: no, it doesn't, actually | 15:49 |
| jkt | katherine__: well, my gerrit doesn't return anything for the URLs without that suffix, but it does the expected thing with that suffix | 15:50 |
| jkt | at least when I'm using anonymous, non-authenticated requests | 15:50 |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Add to rally non voting unstable performance job https://review.openstack.org/145098 | 15:50 |
| katherine__ | jkt: the https://review.hpcloud.net/p/openstack/neutron/info/refs will return the list of all refs | 15:50 |
| fungi | katherine__: also that /p/ is likely going to a local replica not to gerrit's jetty | 15:51 |
| jkt | katherine__: well, try hitting https://gerrit.vesnicky.cesnet.cz/r/p/trojita/info/refs and then add that suffix and try again | 15:51 |
| katherine__ | jkt: the first line i see is: | 15:51 |
| katherine__ | 73887ff03af42f84b515359cac618c85978420f9refs/cache-automerge/00/a372ad98a83879a2252562b10f7e6172bf8827 | 15:51 |
| *** wenlock has joined #openstack-infra | 15:51 | |
| *** e0ne has joined #openstack-infra | 15:51 | |
| fungi | katherine__: so you're saying you can clone from jetty but can't fetch refs from the replica. entirely different backends | 15:51 |
| katherine__ | fungi: if there is a p in the url, the git-http-backend script will be used | 15:52 |
| openstackgerrit | Julien Danjou proposed openstack-infra/git-review: Allow to specify which commit to send https://review.openstack.org/139701 | 15:52 |
| katherine__ | fungi: yes, good point | 15:52 |
| fungi | katherine__: right, just pointing out you're comparing to different backends there | 15:52 |
| TheJulia | Wini 6 | 15:52 |
| TheJulia | doh | 15:52 |
| fungi | er, two | 15:52 |
| katherine__ | fungi: got it. :) | 15:52 |
| *** tonytan4ever has joined #openstack-infra | 15:53 | |
| clarkb | oh so you have the local replica at p/ tht should bypass all auth | 15:53 |
| katherine__ | ok, so making the gerrit trigger more protocol-agnostic sounds like the way to go here | 15:53 |
| katherine__ | clarkb: no, i haven't tried the replica yet. was hoping adding the special gerrit user would fix this | 15:53 |
| jkt | katherine__: why don't you use the URL without /p/, then? | 15:54 |
| katherine__ | jkt: without the p, we will not be albe to use git-upload-pack | 15:54 |
| clarkb | what is git-http-backend? for the user to work it must talk to gerrit | 15:54 |
| jkt | katherine__: I don't follow here; maybe you don't know what I also didn't know prior to clarkb telling me | 15:55 |
| katherine__ | clarkb: git-http-backend is what provides git-upload-pack, which the gerrit trigger uses. | 15:55 |
| jkt | katherine__: there's a git server embedded in gerrit (I'm sure we both know that), and that server *also* listens for git-over-http operations | 15:55 |
| jkt | katherine__: so, why do you maintain a replica at /p/? Is that by any chance a repo maintained by zuul the merger? | 15:56 |
| katherine__ | jkt: but the git-http-backend relies on http access | 15:56 |
| katherine__ | jkt: no, the replica would be on gerrit | 15:56 |
| jkt | katherine__: it isn't clear to me what you need that replica for | 15:57 |
| katherine__ | the zuul gerrit trigger uses python's urllib2 and git-upload-pack so relies on an http url being accessible | 15:57 |
| jkt | katherine__: nor what you use to maintain it | 15:57 |
| katherine__ | take zuul and a replica out of the equation | 15:57 |
| jkt | katherine__: and they are already available and implemented with 100% native gerrit, no need for cgit's own git-upload-pack | 15:58 |
| katherine__ | this is strictly a gerrit issue and, to use the stock zuul gerrit trigger code, we must support http access and git-upload-pack | 15:58 |
| katherine__ | we have to use git-upload-pack | 15:58 |
| katherine__ | refer back to gerrit.py | 15:58 |
| *** e0ne_ has joined #openstack-infra | 15:59 | |
| fungi | katherine__: zuul should be able to use the jgit served by jetty inside the gerrit jvm, or a separate local replica served from apache with git-http-backend. they're individual git over http services | 15:59 |
| katherine__ | jkt: we must use both an http url and git-upload-pack in order to use stock zuul code | 15:59 |
| jkt | katherine__: I have no idea what makes you believe that, nor what exactly you mean by "we have to use git-upload-pack" | 15:59 |
| katherine__ | fungi: yep, i got that. jkt was asking about that | 15:59 |
| fungi | katherine__: you keep referring to git-upload-pack, does the http server in the gerrit jvm not support git-upload-pack? | 15:59 |
| katherine__ | jkt: please look at gerrit.py | 15:59 |
| katherine__ | it adds git-upload-pack to the http url | 15:59 |
| katherine__ | so, to use that code as-is, we need to be able to use that | 16:00 |
| jkt | katherine__: and? | 16:00 |
| krotscheck | Storyboard meeting in #openstack-meeting-3 | 16:00 |
| pelix | hashar: any chance you could see if https://review.openstack.org/143138 throws up any issues with your jjb configs? | 16:00 |
| jkt | katherine__: I understand that the zuul's own code requests an URL that ends with ?service=git-upload-pack | 16:01 |
| katherine__ | jkt: take to #gerrit | 16:01 |
| hashar | pelix: doh! will test it :-] | 16:01 |
| jkt | katherine__: I'm also saying that in my own gerrit instance which does *not* maintain any replica on the same host and which is accessed by zuul that is on another machine, stuff works | 16:02 |
| *** e0ne has quit IRC | 16:02 | |
| jkt | ok, #gerrit it is :) | 16:02 |
| *** unicell has quit IRC | 16:02 | |
| *** _nadya_ has joined #openstack-infra | 16:03 | |
| *** zz_sabari is now known as sabari | 16:03 | |
| *** bcourt has quit IRC | 16:04 | |
| *** dkranz has quit IRC | 16:04 | |
| *** sarob has joined #openstack-infra | 16:04 | |
| *** mestery has quit IRC | 16:05 | |
| *** arxcruz has quit IRC | 16:05 | |
| *** mestery has joined #openstack-infra | 16:05 | |
| hashar | pelix: that throws an exception for me :( | 16:06 |
| pelix | nuts, what is it? | 16:06 |
| *** dustins has joined #openstack-infra | 16:07 | |
| hashar | pelix: raw output http://paste.openstack.org/show/156487/ | 16:07 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Report source of duplicate entries where possible https://review.openstack.org/146543 | 16:07 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Skip duplicate input files https://review.openstack.org/146544 | 16:07 |
| hashar | pelix: gotta find a shorter test case to reproduce | 16:08 |
| *** pcrews has joined #openstack-infra | 16:09 | |
| *** dustins has quit IRC | 16:09 | |
| *** banix has joined #openstack-infra | 16:09 | |
| pelix | presuming that the top part of the output is confirming that it works fine with the latest tree without this change applied? | 16:10 |
| *** armax has left #openstack-infra | 16:10 | |
| *** jcoufal_ has quit IRC | 16:10 | |
| *** armax has joined #openstack-infra | 16:10 | |
| *** dustins has joined #openstack-infra | 16:12 | |
| *** e0ne_ is now known as e0ne | 16:12 | |
| pelix | I wonder if it's the deletion of the 'job' key that is triggering this. Did seem like it might be the riskiest part | 16:12 |
| *** dustins has quit IRC | 16:13 | |
| *** dizquierdo has quit IRC | 16:14 | |
| *** dustins has joined #openstack-infra | 16:14 | |
| *** asselin_ has quit IRC | 16:14 | |
| *** stevemar has joined #openstack-infra | 16:15 | |
| hashar | pelix: yeah gotta try with HEAD^ (which is 1.1.0) | 16:17 |
| *** bcourt has joined #openstack-infra | 16:19 | |
| *** dkranz has joined #openstack-infra | 16:19 | |
| *** mpaolino has quit IRC | 16:20 | |
| *** mpaolino has joined #openstack-infra | 16:21 | |
| *** reed has joined #openstack-infra | 16:21 | |
| *** ayoung has joined #openstack-infra | 16:23 | |
| *** Ala has quit IRC | 16:24 | |
| *** yfried_ has quit IRC | 16:24 | |
| *** coolsvap is now known as coolsvap|afk | 16:25 | |
| hashar | pelix: pass with parent commit :-/ | 16:25 |
| *** Longgeek_ has joined #openstack-infra | 16:29 | |
| *** dimtruck is now known as zz_dimtruck | 16:29 | |
| *** Longgeek has quit IRC | 16:30 | |
| *** zz_dimtruck is now known as dimtruck | 16:30 | |
| *** koolhead_ has joined #openstack-infra | 16:33 | |
| *** Masahiro has joined #openstack-infra | 16:34 | |
| *** koolhead17 has quit IRC | 16:34 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for heat unit test fail bug 1408704 https://review.openstack.org/146556 | 16:35 |
| uvirtbot | Launchpad bug 1408704 in heat "mocking of oslo.utils.timeutils.utcnow() is not working" [Critical,Fix committed] https://launchpad.net/bugs/1408704 | 16:35 |
| *** hemna has joined #openstack-infra | 16:36 | |
| *** bhunter71 has joined #openstack-infra | 16:36 | |
| *** e0ne_ has joined #openstack-infra | 16:37 | |
| *** salv-orl_ has quit IRC | 16:37 | |
| *** salv-orlando has joined #openstack-infra | 16:38 | |
| *** Masahiro has quit IRC | 16:39 | |
| *** mrmartin has quit IRC | 16:39 | |
| *** che-arne has joined #openstack-infra | 16:39 | |
| *** e0ne has quit IRC | 16:40 | |
| *** NithyaG has joined #openstack-infra | 16:40 | |
| *** nithyag_ has joined #openstack-infra | 16:40 | |
| *** slagle has quit IRC | 16:41 | |
| *** jlibosva has quit IRC | 16:42 | |
| *** dhellmann has quit IRC | 16:42 | |
| *** dhellmann has joined #openstack-infra | 16:42 | |
| *** coolsvap|afk has quit IRC | 16:42 | |
| *** ildikov has quit IRC | 16:42 | |
| *** sabari has quit IRC | 16:43 | |
| *** sabari has joined #openstack-infra | 16:43 | |
| *** slagle has joined #openstack-infra | 16:43 | |
| *** btran has quit IRC | 16:48 | |
| *** btran has joined #openstack-infra | 16:49 | |
| fungi | clarkb: looks like devstack-precise and devstack-trusty aren't building successfully in hpcloud, but devstack-precise-dib and devstack-trusty-dib are... are the latter being used at this point? | 16:49 |
| clarkb | not yet | 16:50 |
| fungi | okay, i'll see if i can figure out what broke on us then | 16:50 |
| clarkb | sorted out builds on friday and need tk switch to them this week | 16:51 |
| fungi | devstack-precise and devstack-trusty built successfully in some rax regions, so looks like an hp-only issue | 16:51 |
| clarkb | base image name maybe? | 16:51 |
| fungi | bare versions built fine | 16:51 |
| clarkb | Need to dig up my dib image test and run it for the new images today. if that works we can switch hpcloud to them | 16:52 |
| *** r-daneel has joined #openstack-infra | 16:52 | |
| *** _nadya_ has quit IRC | 16:53 | |
| krotscheck | jeblair is gone? | 16:53 |
| fungi | lca | 16:54 |
| krotscheck | I… I… I… don’t know what to do! | 16:54 |
| krotscheck | He’s GONE | 16:54 |
| krotscheck | He’s not online! | 16:54 |
| fungi | he's corvus | 16:54 |
| krotscheck | Oh :) | 16:54 |
| *** dannywilson has joined #openstack-infra | 16:54 | |
| krotscheck | Panic averted :) | 16:54 |
| dims__ | LOL | 16:54 |
| fungi | jenkins04 is down down | 16:55 |
| fungi | yeah, no jvm running | 16:55 |
| fungi | call traces in dmesg from its watchdog about it being blocked/hung at 09:36:52 utc | 16:57 |
| *** coolsvap has joined #openstack-infra | 16:57 | |
| fungi | the jenkins log basically ends with "There is insufficient memory for the Java Runtime Environment to continue." | 16:57 |
| *** vozcelik has joined #openstack-infra | 16:58 | |
| clarkb | nice | 16:59 |
| fungi | massive load spike just after that... http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1408&rra_id=all | 16:59 |
| *** gondoi is now known as zz_gondoi | 16:59 | |
| *** ildikov has joined #openstack-infra | 16:59 | |
| pelix | hashar: looks to be the named defaults that it blows up on | 16:59 |
| fungi | no obvious signs of memory pressure in the vm, but i guess whatever went sour happened within the context of the jvm | 16:59 |
| clarkb | fungi: looking at nodepool list really quickly it seems that our dib images may not be booting | 17:00 |
| *** sputnik13 has quit IRC | 17:00 | |
| clarkb | so I will have to sort that out first | 17:00 |
| fungi | k | 17:00 |
| *** tqtran has joined #openstack-infra | 17:00 | |
| hashar | pelix: yeah it provides a few default variables :/ | 17:01 |
| hashar | pelix: if I set the missing 'recipients' , I end up with another error. | 17:01 |
| *** mikedillion has joined #openstack-infra | 17:02 | |
| hashar | pelix: might be an issue in my config files, but most probably it highlights a corner case failure in the proposed patch | 17:02 |
| mriedem | anyone noticed the failures to install python-daemon after it's new release on 1/10? | 17:02 |
| mriedem | http://goo.gl/3IbPK2 | 17:02 |
| *** zz_avozza is now known as avozza | 17:02 | |
| clarkb | fungi: status is error and message is {"message": "No valid host was found. Exceeded max scheduling attempts 3 for instance 6f8e444f-12d0-4d57-b32c-2f07b0c28be7", "code": 500, "created": "2015-01-12T16:56:42Z"} so that may not be the images fault | 17:02 |
| *** rkukura has joined #openstack-infra | 17:03 | |
| hashar | mriedem: python-daemon 2.0+ is missing a dependency :( | 17:03 |
| clarkb | mriedem: yes they don't properly declare a dependency | 17:03 |
| mriedem | on docutils, ok | 17:03 |
| mriedem | not 100% fail | 17:03 |
| hashar | mriedem: the solution for openstack-infra/zuul.git was to pin it <2.0 ( https://review.openstack.org/#/c/146350/ ) | 17:03 |
| * hashar rushes out back home | 17:04 | |
| *** sputnik13 has joined #openstack-infra | 17:04 | |
| *** zz_gondoi is now known as gondoi | 17:04 | |
| *** hashar has quit IRC | 17:04 | |
| *** annegentle has quit IRC | 17:04 | |
| *** mrmartin has joined #openstack-infra | 17:05 | |
| *** Ryan_Lane has joined #openstack-infra | 17:05 | |
| *** shashankhegde has joined #openstack-infra | 17:06 | |
| *** dannywilson has quit IRC | 17:06 | |
| *** mikedillion has quit IRC | 17:06 | |
| fungi | okay, jenkins04 nodes/slaves cleaned up and jenkins service started again | 17:06 |
| *** dannywilson has joined #openstack-infra | 17:06 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Read user preferences from backend https://review.openstack.org/137798 | 17:08 |
| *** rwsu has joined #openstack-infra | 17:09 | |
| *** rwsu has quit IRC | 17:09 | |
| *** mrmartin has quit IRC | 17:09 | |
| clarkb | 'ERROR (BadRequest): Multiple possible networks found, use a Network ID to be more specific. (HTTP 400) (Request-ID: req-7871f07d-ba77-4833-87ac-b89da627f7cd)' then when I run `nova network-list` I get a 404 | 17:09 |
| fungi | neat | 17:09 |
| clarkb | I think I have to use neutron client to get a list of networks | 17:09 |
| mriedem | clarkb: assuming nova v2? | 17:10 |
| clarkb | (I am trying to manually boot the trusty dib image on a much smaller flavor to see if it can schedule that for me) | 17:10 |
| clarkb | mriedem: OS_VERSION is set to 2 | 17:11 |
| mriedem | which version of nova? master? juno? | 17:11 |
| clarkb | mriedem: whatever hpcloud runs | 17:11 |
| mriedem | so should be master - 2 weeks or something (guessing) | 17:11 |
| clarkb | also nova has network-list neutron has net-list | 17:11 |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Retrieve task statuses from the backend https://review.openstack.org/138389 | 17:12 |
| mriedem | clarkb: should be a straight proxy call to neutron http://git.openstack.org/cgit/openstack/nova/tree/nova/network/neutronv2/api.py#n1034 | 17:13 |
| pelix | hashar: I think I see the problem. For the 'UploadWizard-api-{mediawiki_url}' you define the value of "recipients:" explicitly, which currently overrides the default of "recipients: '{recipients}'" from the name defaults. For the other templates you are definition recipients at the project level which supplies the correct value when deep_formatting the template. What is needed is deep_format of the params without requiring all values to be | 17:13 |
| clarkb | mriedem: ok so likely something in hpcloud? | 17:13 |
| clarkb | mriedem: I was able to list it with neutron net-list and have a node booting now | 17:13 |
| mriedem | clarkb: not sure, | 17:13 |
| mriedem | clarkb: i'd need to dig up what tempest does, i can't remember if tempest uses novaclient or neutronclient for those calls depending on what you're doing for the network API (should be novaclient though...) | 17:14 |
| mriedem | well, there is a test for it http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/compute/test_networks.py#n31 | 17:15 |
| mriedem | and it only works with neutron | 17:15 |
| mriedem | oh wait, only works with nova-network | 17:15 |
| mriedem | fails if using neutron | 17:15 |
| mriedem | hmm | 17:15 |
| mriedem | hmm, look at the handsome fellow that added the test... https://review.openstack.org/#/c/112944/ | 17:16 |
| *** markus_z has quit IRC | 17:16 | |
| clarkb | that matt person should've made it work with neutron too :P | 17:16 |
| TheJulia | 5 | 17:17 |
| mriedem | i'm pretty sure i copied that test from the neutron one | 17:17 |
| mriedem | but that's using neutronclient | 17:17 |
| * TheJulia reminds her fingers that it is monday | 17:17 | |
| clarkb | fungi: `nova show 1e74337b-cc04-41eb-86b4-8f48ced05398` with hpcloud jenkins node account creds to see my reproduction | 17:17 |
| *** vozcelik has left #openstack-infra | 17:17 | |
| clarkb | fungi: i wonder if that error is misleading and maybe it can't schedule because it can't get hte image or something | 17:18 |
| mriedem | clarkb: wanna open a bug to nova then? | 17:18 |
| mriedem | clarkb: i'm not seeing any existing ones | 17:18 |
| clarkb | mriedem: sure | 17:18 |
| fungi | clarkb: yeah, that' | 17:19 |
| fungi | s odd | 17:19 |
| fungi | clarkb: does seem like a problem in hpcloud | 17:19 |
| *** bcourt has quit IRC | 17:19 | |
| fungi | OSError: [Errno 2] No such file or directory: '/opt/git/tempest' | 17:20 |
| *** Hal_ has quit IRC | 17:20 | |
| fungi | mtreinish: ^ might be your patch, checking | 17:20 |
| mordred | clarkb: problem with dib things? | 17:20 |
| clarkb | mordred: yes, the images do not boot in hpcloud | 17:20 |
| fungi | mtreinish: yeah, it's happening in prepare_tempest_testrepository.py so likely the case | 17:20 |
| clarkb | mordred: {"message": "No valid host was found. Exceeded max scheduling attempts 3 for instance 1e74337b-cc04-41eb-86b4-8f48ced05398", "code": 500, "created": "2015-01-12T17:16:48Z"} | 17:20 |
| mordred | clarkb: spectacular | 17:21 |
| clarkb | mordred: I get that from nodepool images and the node I manually booted. The node I manually booted used a much smaller flavor size in hopes that would help scheduling | 17:21 |
| fungi | mtreinish: should be /opt/git/openstack/tempest i think | 17:21 |
| *** emagana has joined #openstack-infra | 17:21 | |
| clarkb | mordred: I am going to try a few more builds with different flavors | 17:21 |
| mordred | clarkb: k. I wonder if we now need to mark images with specific metadata like we do on rax | 17:22 |
| *** otter768 has joined #openstack-infra | 17:22 | |
| mordred | tteggel: any chance you know if anything has change related to images and flavors on hpcloud? | 17:22 |
| *** shashankhegde has quit IRC | 17:23 | |
| *** MaxV has quit IRC | 17:23 | |
| *** rkukura has quit IRC | 17:23 | |
| tteggel | mordred: not AFAIK. | 17:23 |
| tteggel | mordred clarkb: i'll see what happened to that instance. give me some minutes. | 17:24 |
| *** rkukura has joined #openstack-infra | 17:24 | |
| clarkb | tteggel: awesome thank you, I won't delete it then | 17:24 |
| clarkb | tteggel: also I can dig up more uuids if that helps | 17:24 |
| *** vigneshvar has joined #openstack-infra | 17:24 | |
| tteggel | clarkb: possibly. let me look at that one first | 17:24 |
| zaro | morning | 17:25 |
| pleia2 | flu, I'll try to be back later if I'm feeling up to it | 17:25 |
| openstackgerrit | Randy Bertram proposed openstack/requirements: Add term.js to global requirements https://review.openstack.org/145825 | 17:25 |
| clarkb | pleia2: oh no | 17:25 |
| *** ihrachyshka has quit IRC | 17:25 | |
| *** jpich has quit IRC | 17:25 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Correct tempest clone location in node prep https://review.openstack.org/146581 | 17:25 |
| fungi | mtreinish: clarkb: ^ | 17:25 |
| fungi | pleia2: that's no fun. caught it too late to get the antivirals? | 17:26 |
| clarkb | fungi: looking | 17:26 |
| *** rkukura has quit IRC | 17:26 | |
| *** pcaruana is now known as pcaruana|off| | 17:27 | |
| *** otter768 has quit IRC | 17:27 | |
| fungi | pleia2: fwiw, i came down with it a day earlier than christine, so she got a tamiflu perscription and i didn't, but i was over it days earlier than she was. seems highly variable | 17:27 |
| *** rwsu has joined #openstack-infra | 17:27 | |
| fungi | prescription | 17:28 |
| clarkb | fungi: 146581 approved | 17:28 |
| zaro | fungi: do you have time to try to help fix zuul-dev today? | 17:28 |
| * clarkb won't bother with multiple +2's for simple tings like that this week | 17:28 | |
| fungi | zul: depends on how soon i manage to get nodepool fixed, now that jenkins04 seems to be back on track | 17:28 |
| fungi | er, sorry zul | 17:28 |
| fungi | zaro: ^ | 17:28 |
| fungi | (z names) | 17:28 |
| clarkb | mriedem: https://bugs.launchpad.net/nova/+bug/1409816 | 17:29 |
| uvirtbot | Launchpad bug 1409816 in nova "Listing neutron networks via nova api results in a 404" [Undecided,New] | 17:29 |
| zaro | also I've just noticed that Gerrit 2.9 requires a bouncy castle java lib that isn't available on precise. it's available on trusty. does that mean we should upgrade our Gerrit server to trusty or shimmy in the lib? | 17:29 |
| *** Ryan_Lane has quit IRC | 17:29 | |
| clarkb | zaro: its probably a good excuse to upgrade to trusty | 17:29 |
| mriedem | clarkb: thanks | 17:29 |
| *** romcheg has quit IRC | 17:29 | |
| *** romcheg has joined #openstack-infra | 17:30 | |
| clarkb | zaro: not sure how much addtional work that is, which will probably play into which way we go | 17:30 |
| fungi | we probably need to first migrate gerrit 2.8 to be running on trusty, then upgrade to gerrit 2.9 | 17:30 |
| *** romcheg has quit IRC | 17:30 | |
| clarkb | fungi: that may be easier ya | 17:30 |
| clarkb | to deal with db conversions and so on | 17:30 |
| zaro | clarkb: maybe should upgrade to trusty with existing Gerrit 2.8 first? | 17:30 |
| *** dhritishikhar has quit IRC | 17:30 | |
| mriedem | clarkb: admin tenant or not ? | 17:31 |
| zaro | fungi: ohh yeah, what fungi saide | 17:31 |
| clarkb | mriedem: not | 17:31 |
| clarkb | mriedem: just normal user account on hpcloud | 17:31 |
| mriedem | ok | 17:31 |
| zaro | would that mean upgrade Gerrit server and the trove DB or just the Gerrit server? | 17:32 |
| fungi | just the gerrit server | 17:32 |
| fungi | the trove db is fine unless new gerrit requires newer mysql features | 17:32 |
| clarkb | ya the trove db is database as a service so in theory it can be over there doing its thing without fuss | 17:32 |
| *** hdd has quit IRC | 17:33 | |
| *** TravT has joined #openstack-infra | 17:33 | |
| *** bcourt has joined #openstack-infra | 17:33 | |
| *** TravT has quit IRC | 17:33 | |
| *** bdpayne has joined #openstack-infra | 17:34 | |
| *** TravT has joined #openstack-infra | 17:34 | |
| clarkb | tteggel: I can confirm that flavors 103, 104, and 105 exhibit the same behavior (not sure if that is useful info but it is information I have) | 17:34 |
| *** andreykurilin has joined #openstack-infra | 17:34 | |
| tteggel | clarkb: thanks. i'll be a while - had to file access paperwork | 17:35 |
| zaro | cool. shouuld the strategy be.. stand up new trusty server, maybe 'review-dev-trusty', copy over gerrit 2.8, stop review-dev, test with review-dev-trusty, then switch name to review-dev when done? | 17:35 |
| clarkb | mordred: image builds themselves look much better now. dib_tmp isn't leaking everywhere | 17:35 |
| *** afazekas has quit IRC | 17:35 | |
| clarkb | mordred: and the source repos cache looks much happier. So last weeks problems seem to be mitigated | 17:36 |
| *** e0ne_ has quit IRC | 17:36 | |
| mriedem | clarkb: what version of python-novaclient are you using? the docs say the cli is 'nova net-list' | 17:37 |
| *** dannywilson has quit IRC | 17:38 | |
| clarkb | mriedem: 2.20.0 | 17:38 |
| clarkb | nova help says "network-list Print a list of available networks." | 17:38 |
| *** links has quit IRC | 17:38 | |
| *** pblaho has quit IRC | 17:39 | |
| *** melwitt has joined #openstack-infra | 17:39 | |
| mordred | clarkb: woot | 17:39 |
| fungi | zaro: probably disable puppet agent on review-dev and then stop its gerrit service, then launch a new review-dev using trusty and see if it works, then change dns and delete the old review-dev | 17:41 |
| *** Longgeek_ has quit IRC | 17:42 | |
| *** primeministerp has joined #openstack-infra | 17:42 | |
| *** primemin1sterp has joined #openstack-infra | 17:42 | |
| *** primemin2sterp has joined #openstack-infra | 17:43 | |
| *** ssam2 has quit IRC | 17:43 | |
| *** gyee has joined #openstack-infra | 17:44 | |
| *** primemin2sterp has quit IRC | 17:44 | |
| mriedem | clarkb: so this isn't confusing at all, but there is a network-list and net-list cli in novaclient, net-list is doc'ed later in the help (not ordered), but it works, but it goes to the os-tenant-networks extension which != os-networks (which is what nova network-list goes to) | 17:45 |
| *** primemin1sterp has quit IRC | 17:45 | |
| *** primeministerp has quit IRC | 17:45 | |
| *** primeministerp has joined #openstack-infra | 17:46 | |
| *** primemin1sterp has joined #openstack-infra | 17:46 | |
| mriedem | here's to usability | 17:46 |
| clarkb | mriedem: so it is a python-nvaclient bug then? | 17:46 |
| *** rkukura has joined #openstack-infra | 17:46 | |
| clarkb | (better help docs) | 17:46 |
| zaro | fungi: i think that approximates my suggestion. Did you mean a new review dev _not_ created by our puppet? just a random one i stand up on my own? | 17:46 |
| mriedem | clarkb: could be a bug in the os-networks API, i need to write a test to confirm | 17:47 |
| *** gondoi is now known as zz_gondoi | 17:49 | |
| fungi | zaro: a new review-dev i launch via our usual process (though you could set one up yourself with a local database if you wanted to just confirm it works that way) | 17:50 |
| *** zz_gondoi is now known as gondoi | 17:51 | |
| *** rfolco has joined #openstack-infra | 17:51 | |
| *** ddieterly has quit IRC | 17:53 | |
| *** ayoung is now known as ayoung-lunch | 17:54 | |
| *** ddieterly has joined #openstack-infra | 17:54 | |
| *** patrickeast has joined #openstack-infra | 17:54 | |
| tteggel | clarkb: "qemu-img: 'image' uses a qcow2 feature which is not supported by this qemu version" | 17:54 |
| tteggel | any use? | 17:54 |
| zaro | fungi: i'm assuming usual process means wipping up a gerrit change to stand up a new review-dev which i think is the best because it seems like we will want to upgrade to trusty no matter what. | 17:55 |
| *** shashankhegde has joined #openstack-infra | 17:55 | |
| tteggel | will dig some more | 17:55 |
| openstackgerrit | Merged openstack-infra/project-config: Correct tempest clone location in node prep https://review.openstack.org/146581 | 17:55 |
| *** rfolco has quit IRC | 17:56 | |
| clarkb | tteggel: ya we may be building a qcow2 image that your qemu-img doesn't understand. Any chance it specifies which feature is not supported? | 17:56 |
| tteggel | clarkb: looking | 17:56 |
| fungi | zaro: i don't think it should require whipping up any sort of a change (though we'll want to change the node type for it in the comment in the global site manifest so that we're testing subsequent changes appropriately) | 17:58 |
| *** sabari is now known as zz_sabari | 17:58 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Add test for name defaults overridden by template https://review.openstack.org/146585 | 17:58 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Interpolate params inside of params. https://review.openstack.org/143138 | 17:58 |
| *** annegentle has joined #openstack-infra | 17:59 | |
| *** bhuvan has joined #openstack-infra | 17:59 | |
| *** bhuvan has quit IRC | 17:59 | |
| *** bhuvan has joined #openstack-infra | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| fungi | zaro: i can also launch a fresh zuul-dev (on precise) if you agree that's the next step toward sanity troubleshooting it | 18:01 |
| *** mpaolino has quit IRC | 18:02 | |
| fungi | the biggest hassle with review-dev is that we need to copy configuration since it's not self-bootstrappin | 18:03 |
| fungi | g | 18:03 |
| pelix | hashar: believe https://review.openstack.org/146585 exposes the behaviour that causes problems for you, I've rebased the Interpolate patch on top of it so that it triggers the issue | 18:03 |
| *** jistr has quit IRC | 18:03 | |
| *** Sukhdev has joined #openstack-infra | 18:03 | |
| *** teran has quit IRC | 18:03 | |
| *** jcoufal has joined #openstack-infra | 18:06 | |
| zaro | fungi: yes, please launch a fresh zuul-dev, or just reset the current zuul-dev. I think that will help. | 18:08 |
| tteggel | clarkb: no luck getting more details. do you have a more recent boot attempt? | 18:08 |
| fungi | zaro: okay, will do that here in moments once i get more nodepool images kicked off | 18:08 |
| *** bswartz has quit IRC | 18:08 | |
| clarkb | tteggel: not really, but I can try again, would that help? | 18:08 |
| tteggel | clarkb: if I can get to a compute node while the image is still there I can get you more details | 18:09 |
| tteggel | clarkb: I don't have glance admin so can't get your image manually | 18:09 |
| *** derekh has quit IRC | 18:10 | |
| clarkb | tteggel: I can give you the image too if that helps though it is fairly large | 18:10 |
| tteggel | clarkb: I wouldn't be able to get it into the right environment easily | 18:10 |
| clarkb | kk let me kick off a new build then | 18:11 |
| *** annegentle has quit IRC | 18:11 | |
| tteggel | give me an instance id as soon as you have one | 18:11 |
| *** annegentle has joined #openstack-infra | 18:11 | |
| clarkb | tteggel: c96ee0ea-9331-450d-9372-12cf1c7d2b86 | 18:11 |
| zaro | fungi: i think i misunderstood what you mean about review-dev. yes, it would be great if you could launch a new review-dev (via usual process) on trusty for me to test with. I will just point it at the local mysql db for testing. | 18:12 |
| tteggel | clarkb: ack | 18:12 |
| *** bswartz has joined #openstack-infra | 18:12 | |
| *** koolhead17 has joined #openstack-infra | 18:13 | |
| *** koolhead17 has joined #openstack-infra | 18:13 | |
| *** markmcclain has joined #openstack-infra | 18:13 | |
| *** koolhea__ has joined #openstack-infra | 18:15 | |
| fungi | zaro: i intended to launch a replacement review-dev on trusty using the review-dev trove database, not a local mysql database | 18:16 |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Uncap boto now that nova commit f7b1af9e1 is merged https://review.openstack.org/146592 | 18:17 |
| fungi | zaro: i was saying that if _you_ wanted to test using a local database, then you can do that yourself easily enough | 18:17 |
| *** koolhead_ has quit IRC | 18:17 | |
| fungi | okay, the nodepool prep script fix made it onto the server, so taking another stab at an image update now | 18:17 |
| *** koolhead17 has quit IRC | 18:18 | |
| *** koolhead17 has joined #openstack-infra | 18:19 | |
| tteggel | clarkb: slightly more info but not much useful: "qemu-img: 'image' uses a qcow2 feature which is not supported by this qemu version: QCOW version 3" | 18:19 |
| clarkb | tteggel: that gives me something to work off of. Maybe I can force qcow version 2 :) | 18:21 |
| *** mrmartin has joined #openstack-infra | 18:21 | |
| *** koolhea__ has quit IRC | 18:22 | |
| zaro | fungi: replacing precise with trusty on review-dev would be great. However since I've already ran a Gerrit upgrade on review-dev the review-dev db schema has changed. We'll need to reset the db fisrt | 18:22 |
| clarkb | apparently 3 is supposed to be fully backward compatible with 2 but that doesn't appear to be the case if qemu-img is complaining | 18:22 |
| *** markmcclain has quit IRC | 18:22 | |
| *** isviridov is now known as isviridov_away | 18:22 | |
| zaro | fungi: would you like me to reset the db? or would you prefer to do it as part of the entire process? | 18:23 |
| *** dannywilson has joined #openstack-infra | 18:23 | |
| *** dannywilson has quit IRC | 18:23 | |
| *** sputnik13 has quit IRC | 18:23 | |
| *** Masahiro has joined #openstack-infra | 18:23 | |
| *** dannywilson has joined #openstack-infra | 18:23 | |
| clarkb | greghaynes: ^ that qcow stuff familiar to you? | 18:24 |
| tteggel | clarkb: qemu-img create -f qcow2 -o compat=0.10 | 18:25 |
| greghaynes | huh, whatd I do? | 18:25 |
| *** sputnik13 has joined #openstack-infra | 18:25 | |
| clarkb | tteggel: mordred: I think it is likely that when we moved to trusty we got a newer version of qemu-img that spits out images that older qemu-img on hpcloud doesn't like | 18:25 |
| clarkb | tteggel: aewsome I see that in the manpage now | 18:25 |
| tteggel | clarkb: mordred: agreed. hpcloud qemu is 1.0 | 18:26 |
| clarkb | tteggel: so 0.10 is supported by your qemu-img | 18:26 |
| greghaynes | clarkb: tteggel hrm, no. Ive never seen that before | 18:26 |
| clarkb | tteggel: looks like 1.1 is the default in our qemu-img so that should explain it | 18:26 |
| greghaynes | oh wow | 18:26 |
| clarkb | now to see if I can convince dib to take that optin | 18:26 |
| greghaynes | I wonder what the difference is | 18:27 |
| clarkb | tteggel: thanks a bunch for looking into that | 18:27 |
| *** bdpayne has quit IRC | 18:27 | |
| *** Masahiro has quit IRC | 18:28 | |
| tteggel | clarkb: np - hope you get it booting | 18:28 |
| *** dizquierdo has joined #openstack-infra | 18:28 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:28 | |
| fungi | zaro: i can put the db back if you want | 18:29 |
| *** ivar-lazzaro has quit IRC | 18:30 | |
| clarkb | cool looks like I can just set QEMU_IMG_OPTIONS as an image build var and that should work | 18:30 |
| clarkb | fungi: ^ will have patch in a few | 18:30 |
| *** jedimike has quit IRC | 18:30 | |
| *** markmcclain has joined #openstack-infra | 18:31 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:31 | |
| greghaynes | clarkb: -o compat=0.10 looks like it might work as a qemu-img option | 18:31 |
| clarkb | greghaynes: ya | 18:31 |
| clarkb | that is what I am doing | 18:31 |
| fungi | clarkb: awesome | 18:32 |
| zaro | fungi: would be great. thanks! | 18:32 |
| *** sarob has quit IRC | 18:33 | |
| *** hdd has joined #openstack-infra | 18:33 | |
| morganfainberg | fungi, clarkb, i apologize in advance - keystone's tests are going to get a little less "optional" in what we require for installation -- but it'll make our API less weird. we're eliminating extensions. | 18:33 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Set qemu-img qcow2 compat level to 0.10 https://review.openstack.org/146596 | 18:33 |
| clarkb | fungi: tteggel greghaynes ^ | 18:34 |
| morganfainberg | fungi, clarkb, so things like lxml [if it's required] will be moved out of test-reqs and to real reqs (for example) | 18:34 |
| *** markmcclain has quit IRC | 18:34 | |
| *** markmcclain has joined #openstack-infra | 18:34 | |
| mordred | morganfainberg: great | 18:35 |
| *** markmcclain has quit IRC | 18:35 | |
| clarkb | fungi: once that merges I can rebuild images and upload them | 18:35 |
| *** markmcclain has joined #openstack-infra | 18:35 | |
| mordred | clarkb: also - WOW IMPLEMENTATION DETAILS LEAKING | 18:36 |
| clarkb | mordred: just a tad | 18:36 |
| *** annegentle has quit IRC | 18:36 | |
| *** marun has joined #openstack-infra | 18:36 | |
| *** bdpayne has joined #openstack-infra | 18:38 | |
| *** harlowja_away is now known as harlowja | 18:39 | |
| morganfainberg | mordred, figured you'd approve. http://specs.openstack.org/openstack/keystone-specs/specs/kilo/replace_extensions.html :) no-more-extensions. APIs are not optional (they can be restricted though) | 18:40 |
| *** markmcclain has quit IRC | 18:41 | |
| fungi | morganfainberg: HUGE win for interop | 18:41 |
| *** Ryan_Lane has joined #openstack-infra | 18:41 | |
| morganfainberg | fungi, i'm hoping we have real success here and if it looks like it, you *know* I'm going to be talking with other projects at vancouver about following the same pattern | 18:43 |
| * morganfainberg hates the idea of "optional" APIs | 18:43 | |
| sdague | morganfainberg: ++ | 18:43 |
| bhunter71 | question/2nd set of eyes request: I have a bare-trusty builder that's trying to execute check jobs for 'trove-specs'. In doing so, underneath 'tox -v -epy27', It's failing to create/installto the virtualenv with this error "distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('pbr')" . See http://paste.openstack.org/raw/156167/ I suspect something with my bare-trusty host [as other trusty | 18:46 |
| bhunter71 | hosts build this code fine]. Any pointers greatly appreciated! | 18:46 |
| clarkb | tteggel: any reason for me to not delete those error'd nodes now? | 18:47 |
| tteggel | clarkb: nope - delete away | 18:47 |
| *** HeOS has joined #openstack-infra | 18:47 | |
| *** TravT has quit IRC | 18:49 | |
| *** jraim_ is now known as jraim | 18:50 | |
| openstackgerrit | Merged openstack-infra/system-config: Set qemu-img qcow2 compat level to 0.10 https://review.openstack.org/146596 | 18:50 |
| *** dannywilson has quit IRC | 18:52 | |
| *** e0ne has joined #openstack-infra | 18:54 | |
| clarkb | bhunter71: maybe you have a mirror that doesn't have pbr in it? | 18:54 |
| bhunter71 | not impossible, was my first hunch. I've tried with pypi.dfw.openstack.org in ~jenkins/.pip/pip.conf, and with no file present there (i assume pypi.python.org) | 18:57 |
| *** bdpayne has quit IRC | 18:57 | |
| *** mwagner_lap has quit IRC | 18:58 | |
| clarkb | bhunter71: on that node can you manually pip install pbr and see if that works? | 18:58 |
| bhunter71 | yeah, that works great. it is system installed (now) | 18:58 |
| *** nealph___ has joined #openstack-infra | 18:58 | |
| nealph___ | I'm not having any luck finding documentation on how to add dependencies between launchpad BP's...can anyone point me in the right direction? | 18:59 |
| *** bdpayne has joined #openstack-infra | 18:59 | |
| *** koolhead17 has quit IRC | 18:59 | |
| *** harlowja has quit IRC | 19:00 | |
| *** harlowja has joined #openstack-infra | 19:00 | |
| *** harlowja has quit IRC | 19:00 | |
| fungi | nealph___: no idea... the infra team doesn't really use those. you might consider asking in #launchpad instead | 19:01 |
| nealph___ | fungi: will do...thanks! | 19:01 |
| *** _nadya_ has joined #openstack-infra | 19:02 | |
| *** markmcclain has joined #openstack-infra | 19:04 | |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Update to oslo.db 1.4.0 https://review.openstack.org/146613 | 19:05 |
| *** markmcclain1 has joined #openstack-infra | 19:05 | |
| *** markmcclain has quit IRC | 19:05 | |
| fungi | ugh, this image update has been downloading the ubuntu trusty filesystem tarball for half an hour | 19:07 |
| fungi | are we actually using that in tests, or did we miss filtering that out of the devstack downloads list? | 19:07 |
| fungi | oh, it's for openvz testing? | 19:08 |
| clarkb | oh that image. Ya devstack should rm it imo | 19:08 |
| clarkb | and if they don't then we should maybe blacklist it | 19:08 |
| *** annegentle has joined #openstack-infra | 19:08 | |
| clarkb | I don't think openvz went anywhere and for years we have been downloading this image | 19:08 |
| clarkb | *openvz testing | 19:08 |
| fungi | won't somebody think of the bandwidth!?! | 19:09 |
| * fungi wonders how many bits of transfer we've wasted on this over time | 19:09 | |
| *** e0ne is now known as e0ne_ | 19:09 | |
| clarkb | ok dib options is in place now I am rebuilding trusty dib image | 19:10 |
| *** zz_sabari is now known as sabari | 19:10 | |
| *** mwagner_lap has joined #openstack-infra | 19:11 | |
| clarkb | hrm subunit2sql breaking images now | 19:11 |
| fungi | oh? did my patch not fix it? | 19:12 |
| fungi | or something else there now? | 19:12 |
| clarkb | ImportError: cannot import name unpack_url | 19:12 |
| clarkb | is that what you saw? | 19:12 |
| fungi | nope, i haven't gotten that far since the last related fix | 19:12 |
| fungi | previously it was dying trying to use the nonexistent tempest clone | 19:12 |
| clarkb | I think you fixed the nonexistent tempest clone just fine then :) | 19:13 |
| clarkb | actually maybe not? its dying right after creating the virtualenv | 19:13 |
| *** corvus is now known as jeblair | 19:13 | |
| *** dannywilson has joined #openstack-infra | 19:13 | |
| fungi | sequence on the dib elements may differ from the prep scripts | 19:13 |
| fungi | anyway, i'm starting to think my test is hung on this openvz ubuntu filesystem tarball download | 19:14 |
| *** e0ne_ has quit IRC | 19:15 | |
| fungi | been ~40 minutes now since it got to that step | 19:15 |
| *** sputnik13 has quit IRC | 19:15 | |
| clarkb | sudo -H /opt/git/subunit2sql-env/bin/pip install -U subunit2sql testrepository I think that is the line it fails on | 19:15 |
| *** nealph___ has left #openstack-infra | 19:15 | |
| fungi | curious why subunit2sql-env is in /opt/git rather than just /opt | 19:16 |
| *** Hefeweizen has quit IRC | 19:16 | |
| fungi | not that it's the problem, but seems out of place' | 19:16 |
| *** _nadya_ has quit IRC | 19:17 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: fix project matrix doc rendering https://review.openstack.org/146616 | 19:17 |
| jeblair | fungi: yeah, i did too, but it's deleted as soon as it's created, so i didn't think it was worth -1ing. happy for it to change tho | 19:17 |
| fungi | ahh, right, that | 19:17 |
| fungi | it's ephemeral to pre-cache the stuff | 19:17 |
| *** dalgaaf has quit IRC | 19:17 | |
| clarkb | I willspin my dib image build testing platform back up again after lunch | 19:17 |
| clarkb | but the tracebak is really weird. Let me paste the whole thing | 19:18 |
| clarkb | oh you know what | 19:18 |
| clarkb | I think it runs too early, but that isn't the cause of this failure | 19:18 |
| clarkb | arg `nodepool image-build` doesn't seem to use the cache dir set in the yaml file | 19:19 |
| clarkb | so now I have a ~/.cache | 19:19 |
| clarkb | http://paste.openstack.org/show/156518/ | 19:20 |
| *** e0ne has joined #openstack-infra | 19:20 | |
| clarkb | though it does seem to use dib_tmp so maybe there is a race or bug somewhere? | 19:21 |
| *** marcusvrn has quit IRC | 19:21 | |
| jeblair | krotscheck, yolanda: storyboard-core += [yolanda] | 19:21 |
| krotscheck | jeblair: Thanks! | 19:21 |
| fungi | clarkb: did pip maybe create ~/.cache? | 19:22 |
| *** pcrews has quit IRC | 19:22 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: Move project matrix documentation into a test. https://review.openstack.org/137972 | 19:23 |
| *** otter768 has joined #openstack-infra | 19:23 | |
| clarkb | CACHE_PATH=~/.cache/image-create/repository-sources/$CACHE_NAME is the bug in 50-early-source-repos | 19:23 |
| fungi | ahh | 19:24 |
| clarkb | it should use whatever DIB exposes athe cache path var | 19:24 |
| clarkb | fungi: I will work on a patch for that and testing of the subunit stuff locally once I resurrect that test bed and eat lunch | 19:26 |
| fungi | k | 19:26 |
| clarkb | though I think I need to rebuild my cache for that | 19:26 |
| clarkb | so it may be a while | 19:26 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: testtools requires unittest2 https://review.openstack.org/146618 | 19:27 |
| *** otter768 has quit IRC | 19:27 | |
| *** hichtakk has joined #openstack-infra | 19:28 | |
| *** jp_at_hp has quit IRC | 19:30 | |
| *** teran has joined #openstack-infra | 19:31 | |
| yolanda | jeblair, great, thx | 19:32 |
| timrc | yolanda, Congratulations! | 19:33 |
| yolanda | thx! | 19:34 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 19:37 | |
| zaro | yolanda: w00t! | 19:43 |
| * zaro afk, bbl | 19:43 | |
| fungi | clarkb: i'm getting a different exception from prepare_tempest_testrepository.py | 19:45 |
| *** markmcclain1 has quit IRC | 19:46 | |
| adam_g | mriedem, similar timeutils fix for ceilometer here https://review.openstack.org/#/c/146623/ | 19:47 |
| *** rfolco has joined #openstack-infra | 19:47 | |
| mriedem | adam_g: ah, i thought ceilometer was involved too somehow | 19:48 |
| *** wznoinsk has quit IRC | 19:48 | |
| *** wznoinsk has joined #openstack-infra | 19:49 | |
| *** StevenK has quit IRC | 19:49 | |
| clarkb | fungi: fun | 19:50 |
| *** StevenK has joined #openstack-infra | 19:50 | |
| fungi | clarkb: http://paste.openstack.org/show/156525/ | 19:50 |
| *** rfolco has quit IRC | 19:51 | |
| *** markmcclain has joined #openstack-infra | 19:52 | |
| fungi | clarkb: is it dying because the subprocess wants to use /opt/stack/new/tempest for cwd which possibly doesn't (yet) exist? | 19:52 |
| fungi | mtreinish: ^ | 19:52 |
| *** harlowja has joined #openstack-infra | 19:52 | |
| *** rfolco has joined #openstack-infra | 19:52 | |
| *** Sukhdev has quit IRC | 19:53 | |
| fungi | oh, wait, it wants to use /opt/git/openstack/tempest | 19:53 |
| fungi | because that's passed in as sys.argv[1] | 19:54 |
| *** bcourt has quit IRC | 19:54 | |
| clarkb | my test env was mostly intact so I have a run going locally whcih is updating my cache | 19:54 |
| mriedem | adam_g: is there some weird whitespace issue at the bottom of that backport? | 19:54 |
| clarkb | ya /opt/git/openstack/tempest is then rsync'd to /opt/stack/new/tempest when d-g runs | 19:54 |
| clarkb | fungi: so maybe /opt/git doesn't exist yet? | 19:55 |
| clarkb | or /opt/git/openstack | 19:55 |
| adam_g | mriedem, yeah, that is weird. one min | 19:55 |
| fungi | i saw it cloning tons of stuff before it got this far | 19:55 |
| clarkb | fungi: maybe permissions? | 19:55 |
| *** rfolco has quit IRC | 19:56 | |
| *** markmcclain has quit IRC | 19:57 | |
| clarkb | oh wow | 19:57 |
| *** markmcclain has joined #openstack-infra | 19:57 | |
| *** TravT has joined #openstack-infra | 19:57 | |
| clarkb | so extra-data.d scripst apparently run in the context of the hypervisor | 19:57 |
| clarkb | so its the completely wrong location for that stuff | 19:57 |
| *** e0ne has quit IRC | 20:00 | |
| *** tkelsey has quit IRC | 20:00 | |
| *** tkelsey has joined #openstack-infra | 20:01 | |
| *** david-lyle has quit IRC | 20:02 | |
| *** e0ne has joined #openstack-infra | 20:03 | |
| *** sputnik13 has joined #openstack-infra | 20:04 | |
| *** annegentle has quit IRC | 20:09 | |
| clarkb | fungi: I have my test for the dib elements fix running. Going to grab lunch and will report results when I get back | 20:09 |
| clarkb | I think its a simple fix of move this into the image build installs and not extradata.d | 20:10 |
| *** annegentle has joined #openstack-infra | 20:10 | |
| mordred | clarkb:which thing? | 20:11 |
| *** michchap has joined #openstack-infra | 20:11 | |
| *** reed has quit IRC | 20:11 | |
| *** wznoinsk has quit IRC | 20:12 | |
| clarkb | mordred: the subunit seeding that mtreinish is doing runs in extradata.d which is completely wrong because no repos have been cloned and it runs in the context of the host node not the chroot | 20:12 |
| *** Masahiro has joined #openstack-infra | 20:12 | |
| *** wznoinsk has joined #openstack-infra | 20:12 | |
| clarkb | so it exploded when I ran it because root already owned this venv or something in the hosts /opt/git | 20:12 |
| *** morgabra has quit IRC | 20:13 | |
| *** michchap_ has quit IRC | 20:14 | |
| *** sputnik13 has quit IRC | 20:14 | |
| mordred | clarkb: yes. I agree - totally wrong place for that | 20:14 |
| *** morgabra has joined #openstack-infra | 20:14 | |
| clarkb | so I am testing a move to install.d and will push patch once m local run completes and works | 20:14 |
| clarkb | but my cache is old and stale so taking tme to update | 20:15 |
| *** Sukhdev has joined #openstack-infra | 20:15 | |
| *** ldnunes has quit IRC | 20:16 | |
| fungi | still not entirely clear why the prep script for it is dying in a no such file or directory error in init_testr() | 20:16 |
| *** reed has joined #openstack-infra | 20:16 | |
| fungi | the cwd should definitely exist at that point | 20:16 |
| *** Masahiro has quit IRC | 20:16 | |
| *** ryanpetrello has quit IRC | 20:17 | |
| fungi | so maybe it can't find testr? i need to pick apart run_local() to see what that's really doing | 20:17 |
| *** ryanpetrello has joined #openstack-infra | 20:17 | |
| mriedem | adam_g: hmm, py26 is sad https://jenkins07.openstack.org/job/gate-ceilometer-python26/1258/console | 20:20 |
| mtreinish | fungi: hmm, it should install testr into a venv before it runs init_test() | 20:21 |
| *** shashankhegde has quit IRC | 20:21 | |
| *** banix has quit IRC | 20:21 | |
| fungi | mtreinish: can you make heads or tails of that traceback then? | 20:22 |
| *** hashar has joined #openstack-infra | 20:22 | |
| *** ayoung-lunch is now known as ayoung | 20:22 | |
| fungi | mtreinish: also, i can't find what common run_local is being imported from | 20:22 |
| *** pcrews has joined #openstack-infra | 20:23 | |
| *** melwitt has quit IRC | 20:23 | |
| *** jamielennox|away has quit IRC | 20:23 | |
| *** rainya has quit IRC | 20:23 | |
| *** sweston has quit IRC | 20:23 | |
| *** lbragstad has quit IRC | 20:23 | |
| *** markmcclain has quit IRC | 20:23 | |
| *** erw has quit IRC | 20:23 | |
| *** cdent has quit IRC | 20:23 | |
| fungi | oh, nevermind. it's the nodepool common.py | 20:23 |
| *** wendar has quit IRC | 20:24 | |
| *** mwagner_lap has quit IRC | 20:24 | |
| *** dannywilson has quit IRC | 20:24 | |
| *** melwitt has joined #openstack-infra | 20:24 | |
| *** dimtruck has quit IRC | 20:24 | |
| *** adalbas has quit IRC | 20:24 | |
| *** jasonamyers has quit IRC | 20:25 | |
| *** wendar has joined #openstack-infra | 20:25 | |
| *** dims__ has quit IRC | 20:25 | |
| *** radez is now known as radez_g0n3 | 20:25 | |
| *** rlandy has quit IRC | 20:25 | |
| *** mmedvede has quit IRC | 20:25 | |
| *** krtaylor has quit IRC | 20:25 | |
| *** boris-42 has quit IRC | 20:25 | |
| *** freyes has quit IRC | 20:25 | |
| *** russellb has quit IRC | 20:25 | |
| *** rm_work has quit IRC | 20:25 | |
| *** dims__ has joined #openstack-infra | 20:26 | |
| *** StevenK has quit IRC | 20:26 | |
| *** vishy has quit IRC | 20:26 | |
| *** Hunner has quit IRC | 20:26 | |
| *** stevebaker has quit IRC | 20:26 | |
| *** jroll has quit IRC | 20:26 | |
| *** morgabra has quit IRC | 20:26 | |
| *** morgabra has joined #openstack-infra | 20:26 | |
| *** jasonamyers has joined #openstack-infra | 20:26 | |
| *** Ng has quit IRC | 20:26 | |
| *** _nadya_ has joined #openstack-infra | 20:26 | |
| *** erw has joined #openstack-infra | 20:26 | |
| *** Guest58319 has quit IRC | 20:27 | |
| fungi | does subprocess maybe care that testr is being called without its full path? | 20:27 |
| mriedem | sdague: i'm looking to do a sqlalchemy-migrate 0.9.3 release, reading http://docs.openstack.org/infra/manual/drivers.html#tagging-a-release - are there any things i should do before that? i thought in the past some bad things happened with releases which could have been avoided by running some tests or something? | 20:27 |
| *** sweston has joined #openstack-infra | 20:27 | |
| fungi | aha! that's probably it | 20:27 |
| mtreinish | fungi: yeah looking at the code that's probably it | 20:28 |
| *** jraim has quit IRC | 20:28 | |
| *** barra204 has joined #openstack-infra | 20:28 | |
| fungi | oh, wait, but it's passing os.environ through when it makes the calling env | 20:28 |
| fungi | so it should pick up the executable search path... if subprocess uses that at all | 20:28 |
| *** dims__ has quit IRC | 20:28 | |
| *** dims__ has joined #openstack-infra | 20:29 | |
| *** roaet_ has quit IRC | 20:29 | |
| *** jbryce has quit IRC | 20:29 | |
| *** stevebaker has joined #openstack-infra | 20:29 | |
| sdague | mriedem: so, we probably should define a src job for it at some point, but that's probably a couple of days of work to get there, and the changes are small enough, I'd just risk it | 20:29 |
| *** mgagne has joined #openstack-infra | 20:29 | |
| *** rainya has joined #openstack-infra | 20:29 | |
| *** lbragstad has joined #openstack-infra | 20:29 | |
| *** jraim has joined #openstack-infra | 20:29 | |
| *** russellb has joined #openstack-infra | 20:29 | |
| mtreinish | fungi: but wouldn't it still need shell=true to know how to use PATH? | 20:29 |
| *** dimtruck has joined #openstack-infra | 20:29 | |
| *** jbryce has joined #openstack-infra | 20:29 | |
| fungi | mtreinish: ahh, yep probably | 20:30 |
| *** Hunner has joined #openstack-infra | 20:30 | |
| *** roaet_ has joined #openstack-infra | 20:30 | |
| *** rm_work has joined #openstack-infra | 20:30 | |
| *** mgagne is now known as Guest36580 | 20:30 | |
| *** jroll has joined #openstack-infra | 20:30 | |
| mriedem | sdague: ok, well, no one can say i did'nt ask now :) | 20:30 |
| *** boris-42 has joined #openstack-infra | 20:30 | |
| *** yamahata has joined #openstack-infra | 20:30 | |
| *** rlandy has joined #openstack-infra | 20:30 | |
| *** krtaylor has joined #openstack-infra | 20:30 | |
| *** andreykurilin has quit IRC | 20:31 | |
| *** masayukig has quit IRC | 20:31 | |
| *** mmedvede has joined #openstack-infra | 20:31 | |
| *** Ng has joined #openstack-infra | 20:31 | |
| *** tqtran is now known as tqtran_afk | 20:31 | |
| fungi | mtreinish: hrm, subprocess.Popen() seems to default to shell=True though | 20:31 |
| fungi | based on my tests | 20:31 |
| *** markmcclain has joined #openstack-infra | 20:31 | |
| *** freyes has joined #openstack-infra | 20:31 | |
| *** bcourt has joined #openstack-infra | 20:31 | |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Move heat-translator rtfd doc to openstack.org https://review.openstack.org/146632 | 20:31 |
| *** jamielennox|away has joined #openstack-infra | 20:32 | |
| fungi | or at least seems to figure out the execution path | 20:32 |
| *** barra204_ has joined #openstack-infra | 20:32 | |
| *** barra204 has quit IRC | 20:32 | |
| *** jamielennox|away is now known as jamielennox | 20:32 | |
| fungi | it does _claim_ to default to shell=False | 20:32 |
| mtreinish | fungi: hmm, ok | 20:32 |
| sdague | fungi: path would be inherited from a system level | 20:33 |
| fungi | sdague: rather than using whatever's defined in its env? | 20:33 |
| sdague | right | 20:34 |
| sdague | env still passes down | 20:34 |
| sdague | to child proc | 20:34 |
| sdague | just bash isn't sourced | 20:34 |
| *** vishy has joined #openstack-infra | 20:34 | |
| mtreinish | fungi, sdague: hmm so how to we subprocess within the venv then? | 20:35 |
| *** mwagner_lap has joined #openstack-infra | 20:36 | |
| *** masayukig has joined #openstack-infra | 20:36 | |
| sdague | so subprocess is just a fork, right? you get the parent process environment under those conditions, as it's a / fork / exec | 20:37 |
| sdague | so it should be fine from a venv | 20:37 |
| fungi | strangely, if i 'env PATH=foo:$PATH python' and then run a subprocess.Popen() for a script i put in foo without a fully qualified path, it still finds and runs it | 20:37 |
| fungi | without setting shell=True and without passing a custom env into it | 20:38 |
| sdague | that's not strange, that's expected, right? | 20:38 |
| sdague | parent process has env set as PATH=foo:$PATH | 20:38 |
| sdague | any child process inherits it | 20:39 |
| fungi | you were saying if shell wasn't True then it wouldn't know how to use the env's PATH | 20:39 |
| sdague | no, I don't think I was | 20:39 |
| stevemar | silly question, does the proposal bot try to upgrade hacking when it updates requirements? or is it smart enough to not try that? | 20:39 |
| * fungi rereads again | 20:39 | |
| sdague | oh, I might have mis understood the question | 20:39 |
| davidlenwell | trying to review this file.. getting internal server error.. https://review.openstack.org/#/c/144121/5/refstack/api/controllers/v1.py | 20:40 |
| davidlenwell | any ideas? | 20:40 |
| sdague | "inherited" was the key word | 20:40 |
| fungi | ahh, mtreinish suggested it was needed, and you said it would be inherited from a system level (which i misinterpreted to mean a baked-in PATH not from the env) | 20:40 |
| fungi | so, yeah, back to having no clue why i'm getting http://paste.openstack.org/show/156525/ | 20:41 |
| fungi | the cwd should exist at that point, and the command it's trying to run should be in the execution path too | 20:41 |
| *** alexpilotti has quit IRC | 20:41 | |
| mrmartin | fungi: I've added your ssh key to ask.openstack.org | 20:42 |
| *** roaet_ has quit IRC | 20:42 | |
| *** Rockyg has joined #openstack-infra | 20:43 | |
| fungi | mrmartin: the one at https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/users.pp#n60 ? | 20:43 |
| mtreinish | fungi: should we try adding some debug info to the script, like dump the state of paths, etc? | 20:43 |
| mrmartin | fungi: done. | 20:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Refactor glance version call into method https://review.openstack.org/145604 | 20:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add image upload support https://review.openstack.org/145605 | 20:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support uploading swift objects https://review.openstack.org/145603 | 20:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Debug log any time we re-raise an exception https://review.openstack.org/146633 | 20:44 |
| *** shashankhegde has joined #openstack-infra | 20:44 | |
| fungi | mrmartin: are ownership/permissions on ~fungi/.ssh/authorized_keys correct? i'm getting a permission denied | 20:44 |
| mrmartin | fungi: doublecheck | 20:44 |
| *** ddieterly has quit IRC | 20:44 | |
| mordred | jeblair: ^^ I believe I have addressed most of your concerns | 20:44 |
| fungi | mrmartin: Permission denied (publickey). | 20:45 |
| mordred | Shrews: ^^ also, since you're looking at shade - you might be un-bored by reviewing those .. | 20:45 |
| fungi | mrmartin: oh, it's working now | 20:45 |
| mrmartin | fungi: must be ok now | 20:45 |
| mrmartin | it is better to setup from puppet | 20:45 |
| fungi | yep | 20:45 |
| fungi | mrmartin: thanks! now i can help when the time comes to migrate | 20:45 |
| *** StevenK has joined #openstack-infra | 20:45 | |
| mrmartin | ok. | 20:45 |
| *** _nadya_ has quit IRC | 20:46 | |
| Shrews | mordred: hah... was looking at them now.... get outta my head | 20:46 |
| * mordred dances around in Shrews head | 20:46 | |
| mrmartin | Let's receive some patch review for the askbotm then we can launch the instance without domain redirection. | 20:46 |
| *** ZZelle has joined #openstack-infra | 20:47 | |
| *** annegentle has quit IRC | 20:48 | |
| fungi | mtreinish: i'll see if i can insert some debugging in the scripts without needing to get it merged to the repo | 20:48 |
| mtreinish | fungi: ok cool thanks, I'm not really in a place to push patches right now either | 20:49 |
| *** roaet_ has joined #openstack-infra | 20:49 | |
| mordred | clarkb: do you have any patches outstanding on nodepool that do big changes to openstack API things? | 20:50 |
| clarkb | just the first attempt to do vpc + qemu | 20:50 |
| clarkb | you can take over or nuke that one | 20:51 |
| mordred | cool | 20:51 |
| fungi | clarkb: i've disabled puppet agent on nodepool.o.o for a few minutes | 20:52 |
| *** pcrews has quit IRC | 20:52 | |
| *** MaxV has joined #openstack-infra | 20:52 | |
| clarkb | ok | 20:53 |
| fungi | stuck some print statements into /etc/nodepool/scripts/prepare_tempest_testrepository.py to validate some assumptions | 20:55 |
| fungi | just making sure puppet doesn't blow them away | 20:55 |
| *** thingee has joined #openstack-infra | 20:56 | |
| thingee | mriedem: /window left | 20:57 |
| thingee | mriedem: whoops, well not sure if you saw the response to https://bugs.launchpad.net/cinder/+bug/1408814 | 20:57 |
| uvirtbot | Launchpad bug 1408814 in glance "Image could not be found after upload. The image may have been deleted during the upload." [Undecided,Confirmed] | 20:57 |
| *** david-lyle has joined #openstack-infra | 20:57 | |
| mriedem | thingee: lp bug spam prevents me from keeping up in bug report discussion, | 20:58 |
| *** ildikov has quit IRC | 20:58 | |
| mriedem | thingee: but looks like a problem with connection pools in glanceclient? if so, that's an old issue | 20:58 |
| *** Rockyg has quit IRC | 20:59 | |
| *** radez_g0n3 is now known as radez | 20:59 | |
| *** TravT has quit IRC | 20:59 | |
| thingee | mriedem: ok, so what now? :) | 21:00 |
| mriedem | thingee: shrug? | 21:00 |
| *** mrunge has quit IRC | 21:00 | |
| mriedem | it's definitely not a top gate issue | 21:01 |
| *** andreykurilin has joined #openstack-infra | 21:02 | |
| *** mrmartin has quit IRC | 21:02 | |
| *** TravT has joined #openstack-infra | 21:03 | |
| *** sabari has quit IRC | 21:03 | |
| *** Guest36580 is now known as mgagne | 21:04 | |
| *** mgagne has joined #openstack-infra | 21:04 | |
| *** banix has joined #openstack-infra | 21:06 | |
| *** whoops has joined #openstack-infra | 21:07 | |
| *** MaxV has quit IRC | 21:07 | |
| *** TravT has quit IRC | 21:07 | |
| *** bswartz has quit IRC | 21:08 | |
| mriedem | the glanceclient bug is 1341777 | 21:08 |
| *** tkelsey has quit IRC | 21:09 | |
| *** hdd has quit IRC | 21:11 | |
| *** bhuvan has quit IRC | 21:11 | |
| *** markmcclain has quit IRC | 21:11 | |
| *** aysyd has quit IRC | 21:13 | |
| *** banix has quit IRC | 21:14 | |
| *** hughsaunders has quit IRC | 21:14 | |
| *** sputnik13 has joined #openstack-infra | 21:14 | |
| *** bswartz has joined #openstack-infra | 21:15 | |
| *** e0ne has quit IRC | 21:15 | |
| *** hughsaunders has joined #openstack-infra | 21:15 | |
| *** david-lyle has quit IRC | 21:16 | |
| *** david-ly_ has joined #openstack-infra | 21:16 | |
| fungi | zaro: the replacement zuul-dev is up and running. if your dns hasn't updated yet it's now 23.253.78.13 and 2001:4800:7817:101:be76:4eff:fe04:6632 | 21:16 |
| *** banix has joined #openstack-infra | 21:17 | |
| *** sabari has joined #openstack-infra | 21:17 | |
| *** annegentle has joined #openstack-infra | 21:19 | |
| fungi | mtreinish: i hacked a call to print(os.environ['PATH']) inside init_testr() and it definitely doesn't have an executable path within /opt/git/subunit2sql-env | 21:20 |
| *** HeOS has quit IRC | 21:20 | |
| fungi | mtreinish: so we likely need to prepend /opt/git/subunit2sql-env/bin to the calling env's PATH in there somewhere (preferably in a way that we don't have to keep sudo from stripping it away again) | 21:21 |
| *** otter768 has joined #openstack-infra | 21:24 | |
| ekarlso- | can I get a signoff on https://review.openstack.org/#/c/145561/ ? | 21:24 |
| *** yjiang5 has quit IRC | 21:25 | |
| *** annegentle has quit IRC | 21:25 | |
| *** julim_ has quit IRC | 21:26 | |
| *** banix has quit IRC | 21:27 | |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Move heat-translator rtfd doc to openstack.org https://review.openstack.org/146632 | 21:28 |
| *** pcrews has joined #openstack-infra | 21:28 | |
| *** otter768 has quit IRC | 21:28 | |
| *** bswartz has quit IRC | 21:30 | |
| *** TravT has joined #openstack-infra | 21:30 | |
| *** pabelanger has quit IRC | 21:31 | |
| asselin | anyone know what's up with testr_results.html.gz no longer working? http://logs.openstack.org/02/140502/3/check/check-tempest-dsvm-full/716ce67/logs/testr_results.html.gz | 21:31 |
| asselin | mtreinish, ^^? | 21:31 |
| *** pabelanger has joined #openstack-infra | 21:32 | |
| *** berendt has quit IRC | 21:32 | |
| *** yjiang5 has joined #openstack-infra | 21:32 | |
| *** xyang1 has joined #openstack-infra | 21:33 | |
| *** dprince has quit IRC | 21:33 | |
| openstackgerrit | ayoung proposed openstack-infra/project-config: Graduate oslo.policy https://review.openstack.org/146645 | 21:33 |
| fungi | okay, i _think_ i have a path hack which will work without having to pass extra parameters into the script. basically prepend path with the directory part of sys.argv[0] | 21:34 |
| *** mriedem has quit IRC | 21:36 | |
| *** mwagner_lap has quit IRC | 21:37 | |
| *** jroll has quit IRC | 21:38 | |
| *** jroll has joined #openstack-infra | 21:38 | |
| fungi | at least should be able to see what's broken next | 21:39 |
| clarkb | I made a mistake running my test so rerunning again | 21:39 |
| *** david-ly_ has quit IRC | 21:40 | |
| *** david-lyle has joined #openstack-infra | 21:41 | |
| *** _nadya_ has joined #openstack-infra | 21:43 | |
| *** banix has joined #openstack-infra | 21:44 | |
| clarkb | asselin: to debug you can grab that subunit log file and convert it locall | 21:45 |
| clarkb | oh that file is basically empty | 21:45 |
| clarkb | mtreinish's change to get the latest one must've broken somewhere | 21:45 |
| dhellmann | I seem to remember someone working on using wheels in the requirements integration check job to avoid timeouts, but I don't remember who that was. Did that change make it in? | 21:48 |
| dhellmann | I just had a job time out after 125 minutes (http://logs.openstack.org/13/146613/1/check/check-requirements-integration-dsvm/5023cea/console.html) | 21:48 |
| *** _nadya_ has quit IRC | 21:49 | |
| *** david-lyle has quit IRC | 21:49 | |
| *** david-lyle has joined #openstack-infra | 21:50 | |
| asselin | clarkb, yeah, hoping it's in someone's recent memory | 21:50 |
| *** MaxV has joined #openstack-infra | 21:51 | |
| clarkb | asselin: mtreinish updated how we get the subunit file so that it alwas grabs the latest version I don't think that is working quite right | 21:51 |
| asselin | clarkb, ok I see in devstack-gate https://github.com/openstack-infra/devstack-gate/commit/00f15b2508ca13c2968d790dd1e4f590b4c61b53 | 21:51 |
| clarkb | asselin: ya that change | 21:52 |
| *** jgrimm is now known as zz_jgrimm | 21:52 | |
| zaro | fungi: thanks, i think i'll wait until review-dev gets reset before doing anymore debugging on zuul-dev | 21:53 |
| cody-somerville | Did the release of boto 2.35.0 cause any problems for folks here? | 21:53 |
| clarkb | cody-somerville: yes, it got pinned out iirc | 21:53 |
| fungi | cody-somerville: yeah, impacted nova | 21:54 |
| clarkb | nova didn't support the new hmac things or something | 21:54 |
| sdague | cody-somerville: http://lists.openstack.org/pipermail/openstack-dev/2015-January/054117.html | 21:54 |
| cody-somerville | Thanks. | 21:55 |
| *** tqtran_afk is now known as tqtran | 21:56 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr: Be more aggressive about building wheels https://review.openstack.org/146650 | 21:56 |
| *** lttrl has left #openstack-infra | 21:56 | |
| dhellmann | clarkb: ^^ | 21:56 |
| clarkb | dhellmann: thanks | 21:57 |
| *** MaxV has quit IRC | 21:57 | |
| *** hdd has joined #openstack-infra | 21:57 | |
| dhellmann | clarkb: the other solution would be to merge and modify https://review.openstack.org/#/c/141184/ to support this case, but having the loop inline is probably simpler | 21:58 |
| clarkb | dhellmann: ya I think we can have both | 21:58 |
| dhellmann | yeah | 21:59 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: Revert "Handle more than one stream stored testrepository" https://review.openstack.org/146652 | 21:59 |
| clarkb | asselin: ideally we would fix it | 21:59 |
| clarkb | asselin: since we already have the half working half broken code in our images to use more than one subunit log file | 22:00 |
| clarkb | but I suppose we can revert that too | 22:00 |
| clarkb | fungi: ^ | 22:00 |
| asselin | clarkb, didn't realize it was fixing stuff | 22:00 |
| *** Masahiro has joined #openstack-infra | 22:01 | |
| clarkb | asselin: well its more feature with two halves. That is on half and the other is still in flight | 22:01 |
| *** dkranz has quit IRC | 22:01 | |
| openstackgerrit | ayoung proposed openstack-infra/project-config: Graduate oslo.policy https://review.openstack.org/146645 | 22:01 |
| asselin | clarkb, ok I see | 22:01 |
| clarkb | asselin: basically we are trying to seed tempest testrepository with historical data and when you do that you can't grab .testrepository/0 because you ma have 0 1 2 3 etc | 22:01 |
| clarkb | so you have to always grab the most recent run | 22:01 |
| asselin | I see | 22:02 |
| *** shashankhegde has quit IRC | 22:03 | |
| clarkb | fungi: ok I have dib doing the same error you ran into now | 22:03 |
| clarkb | fungi: any chance you tracked that down? | 22:03 |
| clarkb | maybe we should consider just reverting these changes though since they are broken in at least 3 different ways right now | 22:04 |
| clarkb | mtreinish: ^ | 22:04 |
| fungi | yeah, i tried to be too elegant in my initial fix i think, so retrying now with the path to testr hard-coded to see if that's really the problem | 22:04 |
| *** dustins has quit IRC | 22:05 | |
| *** annegentle has joined #openstack-infra | 22:05 | |
| *** Masahiro has quit IRC | 22:05 | |
| *** shashankhegde has joined #openstack-infra | 22:05 | |
| *** andreykurilin has quit IRC | 22:06 | |
| *** bhuvan has joined #openstack-infra | 22:07 | |
| *** andreykurilin has joined #openstack-infra | 22:07 | |
| *** arielb has quit IRC | 22:10 | |
| *** mriedem has joined #openstack-infra | 22:10 | |
| *** annegentle has quit IRC | 22:11 | |
| clarkb | fungi: can you paste/propose what changes you have? I want to tr them with dib too | 22:12 |
| *** annegentle has joined #openstack-infra | 22:12 | |
| *** mhanif has joined #openstack-infra | 22:13 | |
| mhanif | HI | 22:13 |
| fungi | clarkb: i think the solution is simply to prepend /opt/git/subunit2sql-env/bin to the PATH while calling prepare_tempest_testrepository.py | 22:13 |
| *** shashankhegde has quit IRC | 22:13 | |
| clarkb | fungi: thanks | 22:14 |
| mhanif | Anyone here from core team of infra? | 22:14 |
| clarkb | fungi: trying that now under dib | 22:15 |
| *** dmsimard is now known as dmsimard_away | 22:15 | |
| clarkb | mhanif: yes that are at least 2 of us here right now | 22:15 |
| *** Sukhdev has quit IRC | 22:15 | |
| mhanif | clarkb: Hi | 22:15 |
| fungi | clarkb: the script installs testrepository into a virtualenv and then tries to just run 'testr' but os.environ['PATH'] seems to be missing /opt/git/subunit2sql-env even though the script was itself run under /opt/git/subunit2sql-env/bin/python2 | 22:15 |
| clarkb | fungi: oh because that only affects python path | 22:15 |
| fungi | yep! | 22:16 |
| clarkb | not the env PATH variable | 22:16 |
| fungi | not sure that's the _only_ bug, but it is a bug | 22:16 |
| clarkb | ya | 22:16 |
| clarkb | mhanif: hello | 22:16 |
| mtreinish | clarkb: sure if we don't have a quick fix we can revert things. Although I'd prefer we fix it. But my time is divided because I'm jumping back and forth between sessions | 22:16 |
| mhanif | clarkb: I have submitted a spec for new stackforge project https://review.openstack.org/#/c/145160/ | 22:16 |
| clarkb | mtreinish: I haven't even started debugging the third problem yet :) | 22:16 |
| *** e0ne has joined #openstack-infra | 22:17 | |
| mhanif | clarkb: Would need to know the next steps? | 22:17 |
| *** hashar has quit IRC | 22:17 | |
| mtreinish | clarkb: the subunit stream issue? | 22:17 |
| clarkb | mhanif: patience. We are short handed right now and are still catching up after the holidays | 22:17 |
| clarkb | mtreinish: yes | 22:17 |
| clarkb | mhanif: and things like ^ are broken and we are trying to fix them | 22:17 |
| *** pelix has quit IRC | 22:17 | |
| *** stevemar has quit IRC | 22:18 | |
| mtreinish | clarkb: hmm that's weird gzipping an empty files is 43bytes | 22:19 |
| mhanif | clarkb: Got it. Thanks! Will wait. Meanwhile, I don't believe there is anything I can do in parallel while the review gets completed? | 22:19 |
| asselin | clarkb, I'm looking a bit a testr..see if it's a simple fix | 22:19 |
| mtreinish | but yeah it looks like testr last isn't actually writing anything | 22:19 |
| fungi | mtreinish: only weird if you've never looked at compressed and rotated empty log files | 22:19 |
| clarkb | mhanif: if ou are not importing any code then no | 22:19 |
| mriedem | sdague: bombs away https://github.com/stackforge/sqlalchemy-migrate/tree/0.9.3 | 22:20 |
| mtreinish | fungi: heh, fair enough | 22:20 |
| mtreinish | clarkb: looks like testr last is throwing: local variable 'run_subunit_content' referenced before assignment | 22:21 |
| clarkb | so testr bug? | 22:21 |
| clarkb | lifeless: ^ | 22:21 |
| fungi | doesn't help that some of my test runs are prematurely dying to bad package mirrors | 22:21 |
| lifeless | clarkb: bad dep perhaps | 22:22 |
| *** dizquierdo has quit IRC | 22:22 | |
| lifeless | mtreinish: pastebin the actual traceback please? | 22:22 |
| mhanif | clarkb: Initially, I will only be bringing in the spec. Later on, the code will follow. All of the code is a new code pertaining to the spec, of course. | 22:22 |
| clarkb | mhanif: I am not sure I follow | 22:22 |
| asselin | mtreinish, I think the issue is that you need to be in the right folder | 22:22 |
| lifeless | mtreinish: may need to use TESTR_PDB=1 and bt\n wen it crashes | 22:22 |
| clarkb | mhanif: that change creates a new project and repo for you in gerrit | 22:22 |
| clarkb | mhanif: that is what you want correct? | 22:22 |
| mtreinish | lifeless: unfortunately there isn't one: http://paste.openstack.org/show/156545/ | 22:23 |
| asselin | mtreinish, cd $BASE/new/tempest/ | 22:23 |
| *** r-daneel has quit IRC | 22:23 | |
| mtreinish | asselin: that's what it should be doing | 22:23 |
| lifeless | mtreinish: its missing an else: raise in there | 22:24 |
| asselin | mtreinish, not that I can tell https://github.com/openstack-infra/devstack-gate/blob/00f15b2508ca13c2968d790dd1e4f590b4c61b53/functions.sh#L636 | 22:24 |
| lifeless | mtreinish: so its a bug in that the error is not the real error | 22:24 |
| lifeless | mtreinish: but when fixed it will still be eroring | 22:24 |
| lifeless | mtreinish: please file a bug? | 22:25 |
| asselin | mtreinish, nevermind, I guess that's the pushd | 22:25 |
| lifeless | mtreinish: testrepository/repository/file.py line 136 is where the else: raise should be | 22:25 |
| lifeless | mtreinish: a patch with a test would be rocking | 22:25 |
| mtreinish | lifeless: sure I'll try to get to that soon | 22:25 |
| clarkb | mriedem: apparently sqlalchemy migrate doesn't have automagic releasing | 22:26 |
| asselin | mtreinish, does this error mean anything to you? "local variable 'run_subunit_content' referenced before assignment | 22:26 |
| asselin | " | 22:26 |
| clarkb | oh wait maybe it does | 22:26 |
| clarkb | gah I misread it should but I don't see 0.9.3 yet so let me follow that down the trail of crumbs | 22:26 |
| mriedem | clarkb: ok, my first time, but i thought it got setup | 22:27 |
| mtreinish | asselin: that's what lifeless and I were just talking about it, it's a red herring | 22:27 |
| asselin | that's what I get when I do testr last | 22:27 |
| *** bknudson has quit IRC | 22:27 | |
| asselin | but sudo testr last works fine | 22:27 |
| mtreinish | asselin: oh, you think it's just a permissions issue? | 22:27 |
| clarkb | mriedem: https://jenkins.openstack.org/job/sqlalchemy-migrate-pypi-both-upload/2/console is the upload job failing | 22:28 |
| asselin | I running this on one of my nodes. | 22:28 |
| mriedem | clarkb: no idea about that, does the project have to be setup for wheels support or something? | 22:28 |
| asselin | mtreinish, jenkins user fails running testr last | 22:28 |
| clarkb | mriedem: I think because http://tarballs.openstack.org/sqlalchemy-migrate/sqlalchemy_migrate-0.9.3.post0-py2-none-any.whl is the whl | 22:28 |
| mhanif | clarkb: Yes, that is correct | 22:28 |
| clarkb | mriedem: I think it is setup because we got ^ | 22:29 |
| mtreinish | asselin: push a patch up which adds a sudo | 22:29 |
| clarkb | mriedem: but that version string is wrong so it may be a pbr bug | 22:29 |
| *** mfink has quit IRC | 22:29 | |
| mtreinish | that'll be very easy to verify if it works | 22:29 |
| asselin | mtreinish, ok | 22:29 |
| clarkb | mriedem: I am looking for the tarball job logs now | 22:29 |
| mhanif | clarkb: Thanks! | 22:29 |
| *** tonytan4ever has quit IRC | 22:29 | |
| mriedem | clarkb: ok, yeah i guess migrate is using pbr now, but not sure how old it's setup all is | 22:29 |
| *** mattfarina has quit IRC | 22:29 | |
| mriedem | i feel like we hit new release problems every time migrate is released | 22:30 |
| fungi | proof you're not releasing "early and often" i guess | 22:30 |
| *** gondoi is now known as zz_gondoi | 22:30 | |
| mriedem | well | 22:31 |
| clarkb | mriedem: http://logs.openstack.org/84/844a293b07ed3d93557cabd842b4065c230103da/release/sqlalchemy-migrate-tarball/21e9a22/console.html definitely looks like the whl there was made with wrong version | 22:31 |
| mriedem | gotta merge a commit more than every 6 months probably :) | 22:31 |
| clarkb | mordred: ^ | 22:31 |
| *** mfink has joined #openstack-infra | 22:33 | |
| clarkb | python setup.py sdist definitely uses the 0.9.3.post0 version | 22:34 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding bool parameter support https://review.openstack.org/146665 | 22:35 |
| *** Rockyg has joined #openstack-infra | 22:36 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: testr last requires sudo https://review.openstack.org/146666 | 22:36 |
| clarkb | fungi: your fix makes it fail on missing mysqldb sqlalchemy connector | 22:37 |
| asselin | mtreinish, clarkb ^^ | 22:37 |
| clarkb | asselin: since you are going to use sudo there can I ask that you also update that function to write the file to its final destination wrather than doing the move after | 22:38 |
| asselin | clarkb, ok | 22:38 |
| clarkb | asselin: so change the > redirect destination and remove the sudo mv that was doing that before | 22:38 |
| *** signed8bit has joined #openstack-infra | 22:38 | |
| clarkb | asselin: thanks | 22:39 |
| clarkb | fungi: http://paste.openstack.org/show/156549/ so we likely want to add that to the virtualenv as well | 22:39 |
| clarkb | mtreinish: ^ | 22:39 |
| fungi | clarkb: ahh, yep. my current run hasn't gotten that far yet | 22:40 |
| *** Rockyg has quit IRC | 22:40 | |
| clarkb | fungi: I am testing that, not sure if we already have libmysqlclient-dev installed globally | 22:40 |
| clarkb | might be worth trying PyMSQL as an alternative too then we shouldn't need libmysqlclient-dev | 22:41 |
| *** Rockyg has joined #openstack-infra | 22:41 | |
| fungi | pure python ftw | 22:42 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: testr last requires sudo https://review.openstack.org/146666 | 22:42 |
| clarkb | hrm I can't reproduce the pbr thing with sqlalchemy-migrate if I run the steps to get the version y hand | 22:42 |
| fungi | yep, my current run finally just reached ImportError: No module named MySQLdb | 22:43 |
| mriedem | clarkb: i've got to run to get my kid and head home, | 22:43 |
| *** jcoufal has quit IRC | 22:43 | |
| mriedem | clarkb: anything you need from me right now? | 22:43 |
| mriedem | i'll be online later | 22:43 |
| asselin | clarkb, mtreinish done ^^ | 22:44 |
| clarkb | and if I manually install pbr in a venv and use _get_version_from_git against the repo it works fine | 22:44 |
| clarkb | mriedem: no I shouldn't need anything | 22:44 |
| *** banix has quit IRC | 22:44 | |
| mriedem | clarkb: ok, thanks, i'll check in later | 22:44 |
| clarkb | asselin: perfect _2 | 22:44 |
| *** TravT has quit IRC | 22:45 | |
| *** mriedem has quit IRC | 22:45 | |
| ryanpetrello | something wrong w/ jenkins01.openstack.org ? | 22:46 |
| fungi | ryanpetrello: seems a little slow, why? | 22:46 |
| *** rossella_s has quit IRC | 22:46 | |
| ryanpetrello | seems a little s/slow/unresponsive to me | 22:47 |
| fungi | looks like it has a bunch of cruft nodes | 22:47 |
| *** ddieterly has joined #openstack-infra | 22:47 | |
| ryanpetrello | just noticed a pecan run that's stuck on a job running there | 22:47 |
| fungi | but i'm able to get to the webui | 22:47 |
| clarkb | https://git.openstack.org/cgit/stackforge/sqlalchemy-migrate/tree/migrate/__init__.py#n13 is likely at fault because it is asking for a version in proxy? | 22:47 |
| *** dannywilson has joined #openstack-infra | 22:47 | |
| clarkb | fungi: it may be suffering from what 06 went through | 22:47 |
| clarkb | also we should get my reverse proxy change in to see if that makes any difference | 22:47 |
| *** rossella_s has joined #openstack-infra | 22:47 | |
| fungi | i wonder if whatever killed 04 this morning was related too | 22:47 |
| ryanpetrello | fungi: job in question (the pypy one): https://review.openstack.org/#/c/146656/ | 22:47 |
| clarkb | hrm maybe not? I don't know why sqlalchemy is being weird | 22:49 |
| clarkb | dhellmann: ^ you haven't seen an of that with your oslo releaes right? | 22:49 |
| clarkb | pretty sure oslo has been using new pbr just fine | 22:49 |
| *** armax has quit IRC | 22:50 | |
| * dhellmann reads scrollback | 22:50 | |
| fungi | ryanpetrello: seems like it already finished | 22:50 |
| ryanpetrello | fungi: yea, it just finished | 22:50 |
| ryanpetrello | must've just been bogged down | 22:50 |
| fungi | clarkb: trying now with PyMySQL | 22:51 |
| *** banix has joined #openstack-infra | 22:51 | |
| dhellmann | clarkb: I have not noticed oslo libs building with the wrong versions. Is it the wrong set of code, or just the wrong version strings? | 22:51 |
| clarkb | dhellmann: sqlalchemy-migrate code tagged as 0.9.3 emits 0.9.3.post0 as its version | 22:52 |
| clarkb | dhellmann: I am pretty sure pbr is working in the general case with oslo as the evidence | 22:52 |
| fungi | stray version declaration in setup.cfg? | 22:52 |
| clarkb | so sqlalchemy-migrate must be doing something funny | 22:52 |
| clarkb | fungi: not that I see | 22:52 |
| dhellmann | clarkb: in my local clone I get the 0.9.3 | 22:53 |
| clarkb | dhellmann: even when you python setup.py sdist? | 22:53 |
| dhellmann | where are you seeing the wrong version? | 22:53 |
| dhellmann | ah, no | 22:53 |
| clarkb | dhellmann: on sdists and wheels that are made using ^ | 22:53 |
| dhellmann | python setup.py --version | 22:53 |
| clarkb | let me try that | 22:53 |
| *** e0ne has quit IRC | 22:54 | |
| clarkb | yup that works | 22:54 |
| clarkb | so sdist and bdist_wheel are being weird | 22:54 |
| dhellmann | was there a new release of pbr recently? | 22:54 |
| clarkb | dhellmann: not since the setuptools crazyiness | 22:54 |
| dhellmann | ok | 22:54 |
| dhellmann | clarkb: testing with oslo.db works fine | 22:55 |
| *** signed8bit has quit IRC | 22:55 | |
| clarkb | dhellmann: cool so this must be sqlalchemy-migrate specific | 22:55 |
| *** signed8bit has joined #openstack-infra | 22:55 | |
| clarkb | fungi: you updated the protocol string in the uri for pymsql too? | 22:55 |
| fungi | clarkb: oh, no | 22:55 |
| fungi | thought it was supposed to be a drop-in replacement for MySQL-python | 22:56 |
| *** vigneshvar has quit IRC | 22:56 | |
| *** ryanpetrello_ has joined #openstack-infra | 22:56 | |
| dhellmann | clarkb, fungi : you might want to talk with zzzeek, victors, and rpodolyaka1 about mysql adapter libs, they've been looking into which one to use for python 3 and found some pretty ugly code in one of them | 22:57 |
| clarkb | dhellmann: yes they don't like pymysql | 22:57 |
| fungi | clarkb: interestingly, tip of master for sqlalchemy-migrate gives me 0.9.3 if i do `tox -e venv python setup.py sdist` | 22:57 |
| clarkb | I wasn't really convinced by any of the original arguments | 22:57 |
| clarkb | dhellmann: I have solid proof that pymysql just works at least for testing | 22:57 |
| clarkb | everyone else has jazz hands | 22:58 |
| openstackgerrit | James E. Blair proposed openstack/requirements: DO NOT MERGE https://review.openstack.org/146673 | 22:58 |
| clarkb | fungi: it is drop in but you have to tell sqlalchemy how to select the driver | 22:58 |
| dhellmann | clarkb: sure, I think it was mostly related to the actual dev processes for it (bad commit messages, lack of tests, etc.) | 22:58 |
| clarkb | dhellmann: which is no different than the one they argue for | 22:58 |
| dhellmann | clarkb: we weren't sure we wanted to recommend its use -- oh? | 22:58 |
| clarkb | does oracle even accept patches anymore? | 22:58 |
| jeblair | perhaps the whitespace is not up to par? | 22:58 |
| *** amitgandhinz has quit IRC | 22:59 | |
| adam_g | are there sudo related changes being synced out to slaves? seeing a failure /w msg 'This test has failed because it attempted to execute commands with sudo. See above for the exact commands used.' one other hit in logstash | 22:59 |
| dhellmann | yeah, I don't know | 22:59 |
| fungi | all its docstring titles are missing trailing periods | 22:59 |
| *** ryanpetrello has quit IRC | 22:59 | |
| *** ryanpetrello_ is now known as ryanpetrello | 22:59 | |
| fungi | instant fail | 22:59 |
| clarkb | adam_g: ya we had previously not properly disabled sudo but now we are | 22:59 |
| clarkb | also I don't follow the argument that the lib from oracle must be best lib because oracle | 22:59 |
| fungi | adam_g: there was a while where the sudo disablement was silently broken on trusty | 22:59 |
| dhellmann | ok, well, if you guys want to make fun then maybe I shouldn't spend any more time worrying about introducing new requirements. :-/ | 23:00 |
| *** TravT has joined #openstack-infra | 23:00 | |
| clarkb | dhellmann: make fun? I have been the one arguing that we at least allow it for testing since like icehouse | 23:00 |
| adam_g | clarkb, fungi i remember chatter about that last week, does that mean these failing jobs need to be updated to avoid sudo? the failed command is 'sudo /usr/local/jenkins/slave_scripts/jenkins-sudo-grep.sh post' | 23:00 |
| jeblair | dhellmann: don't cast aspersions on them because of my sarcasm. that's entirely me. afaik, clarkb is very serious and thorough about this. | 23:00 |
| fungi | adam_g: that's definitely odd. on what job? | 23:01 |
| adam_g | http://logs.openstack.org/23/146623/2/check/gate-ceilometer-python26/8020e2d/console.html is mine | 23:01 |
| adam_g | another i found in logstash http://logs.openstack.org/65/145565/4/check/gate-neutron-python27/363afb8/console.html | 23:01 |
| fungi | adam_g: that should be the command _looking_ for sudo failures | 23:01 |
| jeblair | dhellmann: i will stand behind my mocking of "bad commit messages" as a reason not to use a perfectly good library. but don't discount clarkb's good work for that. :) | 23:01 |
| clarkb | dhellmann: fwiw I am not surprised that testing and commit message quality isn't up to par with PyMYSQL but I don't think it is any worse than mysql-python but it comes with other goodness | 23:01 |
| adam_g | fungi, oh, maybe i need to look a bit closer | 23:02 |
| *** barra204__ has joined #openstack-infra | 23:02 | |
| adam_g | yeah | 23:02 |
| adam_g | COMMAND=/home/jenkins/workspace/gate-ceilometer-python26/.tox/py26/bin/ceilometer-rootwrap /etc/ceilometer/rootwrap.conf ipmitool sdr info | 23:02 |
| dhellmann | clarkb: I'm trying to get them to put notes together about criticisms of both, and try to figure out a way forward. I'd be happy to move to any lib that we can all agree to, and so far there is disagreement even within the small set of oslo devs looking into it. It sounds like you probably have good input into the discussion. | 23:02 |
| clarkb | mostly that since PyMySQL is native python we get eventlet support more for free than we did with mysql-python and it is a drop in replacement (it did pass devstack/tempest testing back when I tried it) and it doesn't require any C libs | 23:02 |
| dhellmann | I'm not arguing one way or another myself, because I'm uninformed -- I'm just trying to connect enough people to get to a critical mass to make a decision. | 23:02 |
| *** barra204_ has quit IRC | 23:02 | |
| clarkb | oh and iirc it fixes a neutron bug | 23:03 |
| clarkb | dhellmann: gotcha | 23:03 |
| dhellmann | yep, all of that sounds good | 23:03 |
| jeblair | dhellmann: thank you :) | 23:03 |
| *** andreaf has quit IRC | 23:03 | |
| *** ihrachyshka has joined #openstack-infra | 23:03 | |
| adam_g | did the fixing of sudo revocation just recently start hitting slaves? | 23:04 |
| clarkb | dhellmann: should I drop in on an irc channel or dig up a mail list thread? | 23:04 |
| clarkb | dhellmann: or maybe I need to attend a meeting? I am hppy to report what I found | 23:04 |
| fungi | adam_g: it's possible we had other issues preventing nodepool image updates over the weekend | 23:04 |
| clarkb | fungi: ya confirmed that libmysqlclient-dev isn't installed and things break when installing mysql-python to the venv | 23:04 |
| clarkb | going to try the pymysql thing | 23:05 |
| *** markmcclain has joined #openstack-infra | 23:05 | |
| dhellmann | clarkb: the best thing is probably to catch zzzeek and the others on irc in #openstack-oslo -- I asked them to put together an etherpad or something with notes | 23:05 |
| fungi | clarkb: where is the url i need to modify for that? not having much luck finding it | 23:05 |
| *** markmcclain has quit IRC | 23:05 | |
| *** markmcclain has joined #openstack-infra | 23:05 | |
| *** banix has quit IRC | 23:06 | |
| clarkb | fungi: its in nodepool/scripts/prepare_tempest_testrepository.py | 23:06 |
| clarkb | fungi: the DB_URI variable | 23:07 |
| *** mhanif has quit IRC | 23:07 | |
| fungi | clarkb: hah, yeah i was staring right at it | 23:07 |
| fungi | maybe i need a break | 23:07 |
| fungi | thanks | 23:07 |
| davidlenwell | did you guys see this? https://review.openstack.org/#/c/144121/5/refstack/api/controllers/v1.py | 23:07 |
| davidlenwell | https://review.openstack.org/#/c/144121/4/refstack/api/controllers/v1.py patchset 4 works | 23:08 |
| davidlenwell | patch set 5 .. gets internal server error | 23:08 |
| clarkb | let me check gerrit logs | 23:08 |
| fungi | clarkb: change musql:// to pymsql:// ? | 23:08 |
| fungi | aha, mysql+pymysql:// | 23:09 |
| fungi | docs to the rescue | 23:09 |
| *** barra204__ is now known as shakamunyi | 23:09 | |
| *** markmcclain has quit IRC | 23:09 | |
| *** markmcclain has joined #openstack-infra | 23:09 | |
| clarkb | davidlenwell: there is a giant traceback in the gerrit log when trying to build a patch for that file | 23:10 |
| clarkb | java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 2 | 23:10 |
| *** dimtruck is now known as zz_dimtruck | 23:10 | |
| davidlenwell | okay | 23:10 |
| clarkb | davidlenwell: looks like possibly a jgit bug | 23:10 |
| jeblair | nibalizer: aware of serverspec? http://serverspec.org/ | 23:10 |
| clarkb | davidlenwell: can you diff that file locally? | 23:10 |
| davidlenwell | yes | 23:11 |
| clarkb | zaro: ^ may interest you | 23:11 |
| *** Sukhdev has joined #openstack-infra | 23:12 | |
| *** vigneshvar has joined #openstack-infra | 23:12 | |
| *** hdd has quit IRC | 23:12 | |
| *** bswartz has joined #openstack-infra | 23:13 | |
| fungi | interestingly gerrit's summary claims that file has 16 lines, but if i check out the change it's 32 lines | 23:13 |
| clarkb | fungi: ya | 23:14 |
| clarkb | but the diff from git looks fine | 23:14 |
| *** dims__ has quit IRC | 23:14 | |
| *** dims__ has joined #openstack-infra | 23:15 | |
| *** vigneshvar has quit IRC | 23:15 | |
| davidlenwell | yeah .. from git locally it works fine .. but its currently impossible to review/ leave notes on files | 23:15 |
| *** zz_dimtruck is now known as dimtruck | 23:15 | |
| clarkb | davidlenwell: I think it is just that one file | 23:16 |
| davidlenwell | two files | 23:16 |
| *** signed8bit has quit IRC | 23:16 | |
| davidlenwell | root.py and v1.py in the same folder | 23:16 |
| davidlenwell | its just the one file I need to leave notes in .. thats all | 23:16 |
| clarkb | interesting that root.py has the same issue | 23:17 |
| clarkb | but there are other added files that don't have the problem | 23:17 |
| davidlenwell | yes | 23:17 |
| davidlenwell | it is weird .. | 23:17 |
| *** annegentle has quit IRC | 23:17 | |
| davidlenwell | we were thinking of pushing another minor change to force it into a new patch set to see if we can get around it .. but I figured you guys would want to be aware of the weird | 23:17 |
| *** signed8bit has joined #openstack-infra | 23:18 | |
| clarkb | best guess is a bug in jgit tickled by something specific about that commit | 23:18 |
| *** dims__ has quit IRC | 23:19 | |
| *** david-lyle has quit IRC | 23:20 | |
| Sukhdev | dear infra folks, my CI is broken since this morning with this error - 2015-01-12 23:07:54.258 | sed: can't read /etc/mysql/my.cnf: No such file or directory | 23:21 |
| clarkb | davidlenwell: maybe submit a bug with a link to those two file diffs on storyboard so that we can keep track of it | 23:22 |
| davidlenwell | k | 23:23 |
| dhellmann | I'm trying to debug a gate failure, and I see a "Hash Sum mismatch" for a translation file coming from security.ubuntu.com. The message seems to say the error is ignored, but the job dies right after that. Has anyone seen that problem? http://logs.openstack.org/50/146650/1/check/gate-tempest-dsvm-neutron-src-pbr/fc76c4d/console.html#_2015-01-12_22_07_14_361 | 23:23 |
| clarkb | davidlenwell: with additional info like client version of git and so on if you have it | 23:23 |
| clarkb | Sukhdev: where does that failure happen? | 23:23 |
| clarkb | dhellmann: I think that is our ubuntu mirrors flaking out on us | 23:23 |
| *** markmcclain has quit IRC | 23:23 | |
| Sukhdev | clarkb: Give me a sec - I will paste it | 23:23 |
| clarkb | dhellmann: though usually that happens in rax and that job run on hpcloud | 23:24 |
| dhellmann | clarkb: ok, that's what it looked like; I'll reverify it and see if it happens again. | 23:24 |
| clarkb | dhellmann: ya reverify should be fine | 23:24 |
| *** TravT has quit IRC | 23:24 | |
| dhellmann | clarkb: with the wording of that message, it wasn't clear if that was even the problem | 23:24 |
| *** TravT has joined #openstack-infra | 23:24 | |
| *** otter768 has joined #openstack-infra | 23:25 | |
| clarkb | dhellmann: ya devstack will bail out if it can't update packages cleanly | 23:25 |
| Sukhdev | clarkb: here it is http://paste.openstack.org/show/156555/ | 23:25 |
| zaro | davidlenwell, clarkb : i think unresolved issue, but i believe there is a workaround.. https://groups.google.com/d/msg/repo-discuss/H_xSKuefqgA/M367abo2AnEJ | 23:25 |
| clarkb | zaro: oh so this is a known proble upstream? thats good makes it easier on us :) | 23:25 |
| *** dims__ has joined #openstack-infra | 23:25 | |
| clarkb | Sukhdev: it looks like devstack either didn't install mysql properly or something deleted/changed perms on /etc/mysql/my.cnf | 23:26 |
| clarkb | Sukhdev: I would check that | 23:26 |
| zaro | clarkb: that seems like the same thing. maybe davidlenwell can verify? | 23:27 |
| *** mattfarina has joined #openstack-infra | 23:27 | |
| clarkb | zaro: ya definitely looks the same to me | 23:27 |
| davidlenwell | I'm looking at it now | 23:27 |
| clarkb | the traceback looks like the same code path as what we have | 23:27 |
| Sukhdev | clarkb: I uninstalled mysql and installed it and verified the config files in /etc/mysql - they were there. But, when I go back and run the stack.sh, these files disappear and stack.sh fails | 23:28 |
| davidlenwell | I have not seen your traceback clarkb | 23:28 |
| clarkb | davidlenwell: ya its fine thats the same issue | 23:28 |
| clarkb | Sukhdev: I would check devstack then | 23:28 |
| *** chlong has joined #openstack-infra | 23:29 | |
| *** mwagner_lap has joined #openstack-infra | 23:29 | |
| *** otter768 has quit IRC | 23:29 | |
| clarkb | fungi: woot I got it to work | 23:29 |
| clarkb | I am going to clean things up here then push up a patch for the dib side of things | 23:30 |
| fungi | i have a test running right now with that | 23:30 |
| Sukhdev | clarkb: any pointers as to where to start? | 23:30 |
| clarkb | Sukhdev: with devstacks git log to see if anything changed recently | 23:30 |
| fungi | hasn't gotten far enough to confirm yet though since snapshot images are so slow to build | 23:30 |
| Sukhdev | clarkb: got it - thanks | 23:30 |
| nibalizer | jeblair: ya | 23:31 |
| *** dims_ has joined #openstack-infra | 23:32 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Use PyMySQL and venv path when caching subunit2sql https://review.openstack.org/146682 | 23:32 |
| fungi | clarkb: that what you did ^ ? | 23:32 |
| fungi | clarkb: it's what i'm currently vetting with a snapshot image update | 23:33 |
| clarkb | fungi: basically. also need to move the element script to install.d/99-$name | 23:33 |
| clarkb | and I made that file +x | 23:33 |
| fungi | oh, doing | 23:33 |
| clarkb | fungi: er set -x | 23:33 |
| *** bhunter71 has quit IRC | 23:33 | |
| clarkb | there was another file that was missing its +x but that should be a difference change | 23:33 |
| *** bknudson has joined #openstack-infra | 23:34 | |
| *** dims__ has quit IRC | 23:35 | |
| *** signed8bit has quit IRC | 23:35 | |
| *** shakamunyi has quit IRC | 23:35 | |
| *** andreykurilin has quit IRC | 23:35 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Use PyMySQL and venv path when caching subunit2sql https://review.openstack.org/146682 | 23:35 |
| fungi | that? | 23:35 |
| clarkb | yup that looks right I will double check my local diff as soon as dib gives me my prompt back | 23:36 |
| clarkb | then I will +2 | 23:36 |
| *** dims_ has quit IRC | 23:36 | |
| fungi | it's too bad gerrit doesn't show the filesystem permissions | 23:37 |
| mordred | fungi: ++ | 23:38 |
| *** shakamunyi has joined #openstack-infra | 23:38 | |
| * mordred would like to say that the wifi on his last plane was abyssmal | 23:38 | |
| *** kmartin has quit IRC | 23:38 | |
| *** annegentle has joined #openstack-infra | 23:41 | |
| clarkb | fungi: ya oh well | 23:41 |
| clarkb | fungi: I am going to push a change atop your change to edit some other file perms for dib but I want to test those too (I haven't been worrying about that stuff so far) | 23:41 |
| clarkb | fungi: but your change lgtm | 23:41 |
| fungi | k | 23:41 |
| *** TravT has quit IRC | 23:41 | |
| clarkb | note I haven't gotten my prompt on test box back yet but I am impatient so +2 | 23:42 |
| fungi | still monitoring my snapshot image update to see if it's working there | 23:42 |
| nibalizer | jeblair: you thinkin to spin up some integration tests with severspec? | 23:43 |
| nibalizer | cus i'm +1 on that! | 23:43 |
| clarkb | asselin: you can blame me for that its likely that your first patchset would work | 23:43 |
| *** mattfarina has quit IRC | 23:44 | |
| *** ddieterly has quit IRC | 23:45 | |
| clarkb | mordred: if you could figure out why pbr and sqlalchemy-migrate hate each other that would be swell | 23:45 |
| *** ddieterly has joined #openstack-infra | 23:45 | |
| mordred | oh! | 23:45 |
| mordred | clarkb: any links I should look at? | 23:46 |
| clarkb | mordred: basically checkout sqlalchemy-migrate 0.9.3 tag then do a python setup.py sdist. You get version 0.9.3.post0 | 23:46 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: testr last requires sudo https://review.openstack.org/146666 | 23:46 |
| clarkb | mordred: there is a job log too let me get that for you | 23:46 |
| mordred | hrm | 23:46 |
| clarkb | mordred: http://logs.openstack.org/84/844a293b07ed3d93557cabd842b4065c230103da/release/sqlalchemy-migrate-tarball/21e9a22/console.html | 23:46 |
| mordred | clarkb: I agree with you - I get 0.9.3.post0 | 23:47 |
| *** dimtruck is now known as zz_dimtruck | 23:47 | |
| clarkb | mordred: ya, dhellman confirmed that oslo* don't have this problem and they just did a bunch of releases | 23:47 |
| clarkb | so I think its sqlalchemy-migrate specific but I wasn't quite sure where to look after checking the obvious thing | 23:47 |
| clarkb | mordred: I did check that _get_version_from_git() in pbr.packaging returns the correct info when run by hand | 23:47 |
| fungi | i'm having no luck reproducing that | 23:49 |
| *** Masahiro has joined #openstack-infra | 23:49 | |
| *** ddieterly has quit IRC | 23:50 | |
| *** mattfarina has joined #openstack-infra | 23:50 | |
| fungi | builds a sqlalchemy-migrate-0.9.3.tar.gz | 23:51 |
| clarkb | huh | 23:51 |
| *** annegentle has quit IRC | 23:51 | |
| *** mriedem has joined #openstack-infra | 23:52 | |
| fungi | git checkout 0.9.3; git clean -dfx; tox -e venv python setup.py sdist | 23:53 |
| *** Masahiro has quit IRC | 23:54 | |
| clarkb | fungi: where did sudo -i come from in your change? I don't have the -i | 23:54 |
| *** whoops has quit IRC | 23:55 | |
| Sukhdev | clarkb: I checked devstack - nothing related to mysql is changed. I also noticed that several CIs are broken with the same error - 2015-01-12 23:41:19.051 | + sudo mysql -uroot -psecret -h127.0.0.1 -e 'GRANT ALL PRIVILEGES ON *.* TO '\''root'\''@'\''%'\'' identified by '\''secret'\'';' | 23:55 |
| Sukhdev | 2015-01-12 23:41:19.075 | ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111) | 23:55 |
| fungi | clarkb: it was already there | 23:56 |
| *** signed8bit has joined #openstack-infra | 23:56 | |
| fungi | clarkb: the prep script used -i but the dib element did not | 23:56 |
| fungi | not really sure why, honestly. seems inconsistent, but maybe mtreinish had a reason | 23:57 |
| clarkb | oh they are different ok | 23:57 |
| davidlenwell | clarkb: just fyi .. pushing a new patchset doesn't get us around these issues.. | 23:58 |
| openstackgerrit | Merged openstack/requirements: Use oslo.serialization without the namespace package https://review.openstack.org/145937 | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!