| *** markvoelker has joined #openstack-infra | 00:02 | |
| *** sdake has quit IRC | 00:02 | |
| *** salv-orlando has quit IRC | 00:02 | |
| *** sdake has joined #openstack-infra | 00:03 | |
| *** harlowja_at_home has quit IRC | 00:05 | |
| *** sdake_ has quit IRC | 00:07 | |
| *** markvoelker has quit IRC | 00:07 | |
| *** otter768 has joined #openstack-infra | 00:08 | |
| *** salv-orlando has joined #openstack-infra | 00:08 | |
| *** salv-orlando has quit IRC | 00:13 | |
| *** dims_ has quit IRC | 00:16 | |
| *** teran has joined #openstack-infra | 00:17 | |
| *** nelsnelson has quit IRC | 00:17 | |
| *** stevemar has joined #openstack-infra | 00:18 | |
| *** teran has quit IRC | 00:22 | |
| *** nelsnelson has joined #openstack-infra | 00:24 | |
| *** harlowja_at_home has joined #openstack-infra | 00:25 | |
| *** nelsnelson has quit IRC | 00:28 | |
| *** salv-orlando has joined #openstack-infra | 00:29 | |
| *** salv-orlando has quit IRC | 00:33 | |
| *** otter768 has quit IRC | 00:37 | |
| *** salv-orlando has joined #openstack-infra | 00:38 | |
| *** salv-orlando has quit IRC | 00:42 | |
| *** stevemar has quit IRC | 00:43 | |
| *** salv-orlando has joined #openstack-infra | 00:44 | |
| *** stevemar has joined #openstack-infra | 00:46 | |
| *** stevemar has quit IRC | 00:48 | |
| *** stevemar has joined #openstack-infra | 00:49 | |
| *** salv-orl_ has joined #openstack-infra | 00:50 | |
| *** salv-orlando has quit IRC | 00:51 | |
| *** harlowja_at_home has quit IRC | 00:52 | |
| *** salv-orl_ has quit IRC | 00:54 | |
| *** salv-orlando has joined #openstack-infra | 01:04 | |
| *** sputnik13 has joined #openstack-infra | 01:06 | |
| *** sarob has joined #openstack-infra | 01:07 | |
| *** salv-orlando has quit IRC | 01:12 | |
| *** sarob has quit IRC | 01:12 | |
| *** sarob has joined #openstack-infra | 01:13 | |
| *** dimsum__ has joined #openstack-infra | 01:16 | |
| *** sarob has quit IRC | 01:16 | |
| *** dimsum__ has quit IRC | 01:22 | |
| *** dimsum__ has joined #openstack-infra | 01:22 | |
| *** sputnik13 has quit IRC | 01:34 | |
| *** btully has quit IRC | 01:43 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Remove invalid ensure parameter from apt::ppa https://review.openstack.org/179618 | 01:47 |
|---|---|---|
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-nodepool: Consume puppet-diskimage_builder https://review.openstack.org/167610 | 01:47 |
| *** sarob has joined #openstack-infra | 01:55 | |
| *** sdake_ has joined #openstack-infra | 01:59 | |
| *** sdake has quit IRC | 02:00 | |
| *** sdake__ has joined #openstack-infra | 02:00 | |
| *** markvoelker has joined #openstack-infra | 02:04 | |
| *** sdake_ has quit IRC | 02:04 | |
| *** markvoelker has quit IRC | 02:09 | |
| *** tsg has quit IRC | 02:20 | |
| *** achanda has quit IRC | 02:24 | |
| *** gokrokve has joined #openstack-infra | 02:25 | |
| *** achanda_ has joined #openstack-infra | 02:27 | |
| *** gokrokve_ has quit IRC | 02:27 | |
| *** boris-42 has quit IRC | 02:28 | |
| *** cody-somerville has joined #openstack-infra | 02:34 | |
| *** cody-somerville has quit IRC | 02:34 | |
| *** cody-somerville has joined #openstack-infra | 02:34 | |
| *** boris-42 has joined #openstack-infra | 02:35 | |
| *** otter768 has joined #openstack-infra | 02:38 | |
| *** _elmiko has joined #openstack-infra | 02:41 | |
| *** otter768 has quit IRC | 02:43 | |
| *** markvoelker has joined #openstack-infra | 03:04 | |
| *** otter768 has joined #openstack-infra | 03:05 | |
| *** salv-orlando has joined #openstack-infra | 03:08 | |
| *** markvoelker has quit IRC | 03:08 | |
| *** salv-orlando has quit IRC | 03:14 | |
| *** salv-orlando has joined #openstack-infra | 03:17 | |
| *** sdake has joined #openstack-infra | 03:18 | |
| *** stevemar has quit IRC | 03:20 | |
| *** sdake__ has quit IRC | 03:22 | |
| *** sdake_ has joined #openstack-infra | 03:22 | |
| *** salv-orlando has quit IRC | 03:24 | |
| *** sdake has quit IRC | 03:26 | |
| *** armax has quit IRC | 03:30 | |
| *** fedexo has joined #openstack-infra | 03:35 | |
| *** sarob has quit IRC | 03:41 | |
| *** markvoelker has joined #openstack-infra | 04:05 | |
| *** markvoelker has quit IRC | 04:10 | |
| *** blahdeblah_ has joined #openstack-infra | 04:55 | |
| *** markvoelker has joined #openstack-infra | 05:06 | |
| *** markvoelker has quit IRC | 05:10 | |
| *** abregman has joined #openstack-infra | 05:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Add tempest-dsvm-sahara https://review.openstack.org/167779 | 05:23 |
| *** boris-42 has quit IRC | 05:38 | |
| *** gokrokve_ has joined #openstack-infra | 05:42 | |
| *** gokrokve has quit IRC | 05:44 | |
| *** btully has joined #openstack-infra | 05:48 | |
| *** salv-orlando has joined #openstack-infra | 05:49 | |
| *** sdake has joined #openstack-infra | 05:49 | |
| *** sdake_ has quit IRC | 05:51 | |
| *** jamielennox is now known as jamielennox|away | 05:52 | |
| *** salv-orlando has quit IRC | 05:54 | |
| *** markvoelker has joined #openstack-infra | 06:07 | |
| *** fedexo has quit IRC | 06:07 | |
| *** markvoelker has quit IRC | 06:11 | |
| *** salv-orlando has joined #openstack-infra | 06:19 | |
| *** tnovacik has joined #openstack-infra | 06:21 | |
| *** salv-orlando has quit IRC | 06:23 | |
| *** yfried has joined #openstack-infra | 06:33 | |
| *** Somay has joined #openstack-infra | 06:40 | |
| *** yfried has quit IRC | 06:59 | |
| *** sdake has quit IRC | 07:05 | |
| *** markvoelker has joined #openstack-infra | 07:07 | |
| *** markvoelker has quit IRC | 07:13 | |
| *** heyongli has quit IRC | 07:16 | |
| *** heyongli has joined #openstack-infra | 07:18 | |
| *** _nadya_ has joined #openstack-infra | 07:19 | |
| *** Somay has quit IRC | 07:26 | |
| *** otter768 has quit IRC | 07:28 | |
| *** yamahata has quit IRC | 07:38 | |
| *** Somay has joined #openstack-infra | 07:42 | |
| *** AJaeger has joined #openstack-infra | 07:45 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix translation steps https://review.openstack.org/179642 | 07:45 |
| * AJaeger found another case that my testing did not catch - since tested did not include multiple days with changes. | 07:46 | |
| AJaeger | fungi, mordred, clarkb, could you review 179642, please? | 07:46 |
| *** boris-42 has joined #openstack-infra | 07:50 | |
| *** Somay_ has joined #openstack-infra | 07:53 | |
| *** Somay has quit IRC | 07:53 | |
| *** dhritishikhar has joined #openstack-infra | 07:54 | |
| *** sergsh has joined #openstack-infra | 07:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Minor translation cleanups https://review.openstack.org/179643 | 07:57 |
| *** dhritishikhar has quit IRC | 07:58 | |
| *** dhritishikhar_ has joined #openstack-infra | 07:58 | |
| *** _nadya_ has quit IRC | 08:01 | |
| *** hdd has joined #openstack-infra | 08:03 | |
| *** sabeen has quit IRC | 08:04 | |
| *** markvoelker has joined #openstack-infra | 08:08 | |
| *** hdd has quit IRC | 08:10 | |
| *** hdd has joined #openstack-infra | 08:10 | |
| *** hdd has quit IRC | 08:13 | |
| *** dhritishikhar_ has quit IRC | 08:13 | |
| *** markvoelker has quit IRC | 08:13 | |
| *** dhritishikhar_ has joined #openstack-infra | 08:13 | |
| *** blahdeblah_ has left #openstack-infra | 08:14 | |
| *** AJaeger has quit IRC | 08:20 | |
| *** subscope has joined #openstack-infra | 08:21 | |
| *** Somay_ has quit IRC | 08:23 | |
| *** sergsh has quit IRC | 08:28 | |
| *** salv-orlando has joined #openstack-infra | 08:31 | |
| *** unicell has joined #openstack-infra | 08:38 | |
| *** salv-orlando has quit IRC | 08:38 | |
| *** unicell1 has quit IRC | 08:39 | |
| *** yfried has joined #openstack-infra | 08:43 | |
| *** salv-orlando has joined #openstack-infra | 08:46 | |
| *** sergsh has joined #openstack-infra | 08:46 | |
| *** salv-orlando has quit IRC | 08:51 | |
| *** salv-orlando has joined #openstack-infra | 08:52 | |
| *** salv-orlando has quit IRC | 08:57 | |
| *** achanda_ has quit IRC | 09:00 | |
| *** _nadya_ has joined #openstack-infra | 09:02 | |
| *** swat30 has quit IRC | 09:04 | |
| *** markvoelker has joined #openstack-infra | 09:09 | |
| *** _nadya_ has quit IRC | 09:09 | |
| *** achanda has joined #openstack-infra | 09:10 | |
| *** yfried is now known as yfried|afk | 09:13 | |
| *** markvoelker has quit IRC | 09:14 | |
| *** dhritishikhar_ has quit IRC | 09:18 | |
| *** salv-orlando has joined #openstack-infra | 09:21 | |
| *** dhritishikhar_ has joined #openstack-infra | 09:23 | |
| *** salv-orlando has quit IRC | 09:26 | |
| *** salv-orlando has joined #openstack-infra | 09:27 | |
| *** dhritishikhar_ has quit IRC | 09:27 | |
| *** dhritishikhar_ has joined #openstack-infra | 09:28 | |
| *** otter768 has joined #openstack-infra | 09:29 | |
| *** salv-orlando has quit IRC | 09:32 | |
| *** btully has quit IRC | 09:32 | |
| *** yfried|afk is now known as yfried | 09:33 | |
| *** otter768 has quit IRC | 09:35 | |
| *** achanda has quit IRC | 09:35 | |
| *** dhritishikhar_ has quit IRC | 09:36 | |
| *** shivharis has quit IRC | 09:43 | |
| *** yfried is now known as yfried|afk | 09:43 | |
| *** subscope has quit IRC | 09:46 | |
| *** yfried|afk is now known as yfried | 09:53 | |
| *** swat30 has joined #openstack-infra | 10:01 | |
| *** markvoelker has joined #openstack-infra | 10:10 | |
| *** markvoelker has quit IRC | 10:15 | |
| *** swat30 has quit IRC | 10:22 | |
| *** salv-orlando has joined #openstack-infra | 10:37 | |
| *** salv-orlando has quit IRC | 10:40 | |
| *** salv-orlando has joined #openstack-infra | 10:46 | |
| *** swat30 has joined #openstack-infra | 10:48 | |
| *** salv-orlando has quit IRC | 10:51 | |
| *** tnovacik has quit IRC | 10:52 | |
| *** salv-orlando has joined #openstack-infra | 11:00 | |
| *** swat30 has quit IRC | 11:01 | |
| *** _nadya_ has joined #openstack-infra | 11:02 | |
| *** swat30 has joined #openstack-infra | 11:05 | |
| *** _nadya_ has quit IRC | 11:06 | |
| *** markvoelker has joined #openstack-infra | 11:11 | |
| *** yfried is now known as yfried|afk | 11:13 | |
| *** salv-orlando has quit IRC | 11:13 | |
| *** markvoelker has quit IRC | 11:15 | |
| *** salv-orlando has joined #openstack-infra | 11:15 | |
| *** alexpilotti has joined #openstack-infra | 11:16 | |
| *** yfried|afk is now known as yfried | 11:17 | |
| *** salv-orlando has quit IRC | 11:20 | |
| *** salv-orlando has joined #openstack-infra | 11:26 | |
| *** salv-orlando has quit IRC | 11:27 | |
| *** otter768 has joined #openstack-infra | 11:30 | |
| *** otter768 has quit IRC | 11:35 | |
| *** isviridov_away is now known as isviridov | 12:04 | |
| *** alexpilotti has quit IRC | 12:08 | |
| *** markvoelker has joined #openstack-infra | 12:11 | |
| *** markvoelker has quit IRC | 12:16 | |
| *** alexpilotti has joined #openstack-infra | 12:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix translation steps https://review.openstack.org/179642 | 12:19 |
| *** alexpilotti has quit IRC | 12:23 | |
| *** alexpilotti has joined #openstack-infra | 12:24 | |
| *** rlandy has joined #openstack-infra | 12:30 | |
| *** salv-orlando has joined #openstack-infra | 12:31 | |
| *** yfried has quit IRC | 12:37 | |
| *** zul has joined #openstack-infra | 12:41 | |
| *** salv-orlando has quit IRC | 12:47 | |
| *** salv-orlando has joined #openstack-infra | 12:49 | |
| *** ir2ivps has joined #openstack-infra | 12:49 | |
| *** isviridov is now known as isviridov_away | 12:50 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Convert node_set_provision_state to task https://review.openstack.org/177987 | 12:51 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Update recent Ironic exceptions https://review.openstack.org/177986 | 12:51 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Enhance error message in update_machine https://review.openstack.org/177985 | 12:51 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Enhance the OperatorCloud constructor https://review.openstack.org/179647 | 12:51 |
| *** salv-orlando has quit IRC | 12:55 | |
| *** salv-orlando has joined #openstack-infra | 12:57 | |
| *** mase_x200 has joined #openstack-infra | 12:59 | |
| *** marcusvrn has joined #openstack-infra | 13:01 | |
| *** salv-orlando has quit IRC | 13:02 | |
| *** salv-orlando has joined #openstack-infra | 13:06 | |
| *** sergsh has quit IRC | 13:12 | |
| *** markvoelker has joined #openstack-infra | 13:12 | |
| *** packet has joined #openstack-infra | 13:14 | |
| *** masayukig has quit IRC | 13:14 | |
| *** packet has quit IRC | 13:14 | |
| *** marcusvrn has quit IRC | 13:16 | |
| *** markvoelker has quit IRC | 13:17 | |
| *** salv-orlando has quit IRC | 13:19 | |
| *** masayukig has joined #openstack-infra | 13:20 | |
| openstackgerrit | Mark McLoughlin proposed openstack-infra/project-config: OpenStack Foundation Transparency Policy project https://review.openstack.org/179648 | 13:24 |
| *** tnovacik has joined #openstack-infra | 13:27 | |
| *** yfried has joined #openstack-infra | 13:31 | |
| *** otter768 has joined #openstack-infra | 13:31 | |
| *** salv-orlando has joined #openstack-infra | 13:33 | |
| *** otter768 has quit IRC | 13:36 | |
| *** salv-orlando has quit IRC | 13:40 | |
| *** ir2ivps has quit IRC | 13:41 | |
| openstackgerrit | Mark McLoughlin proposed openstack-infra/project-config: OpenStack Foundation Transparency Policy project https://review.openstack.org/179648 | 13:42 |
| *** mwagner_lap has joined #openstack-infra | 13:51 | |
| *** Somay has joined #openstack-infra | 13:57 | |
| *** sergsh has joined #openstack-infra | 13:57 | |
| *** sergsh_ has joined #openstack-infra | 14:07 | |
| *** ir2ivps has joined #openstack-infra | 14:13 | |
| *** markvoelker has joined #openstack-infra | 14:13 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 14:14 |
| *** rossella_s has quit IRC | 14:16 | |
| *** rossella_s has joined #openstack-infra | 14:17 | |
| *** markvoelker has quit IRC | 14:17 | |
| *** mestery_ has joined #openstack-infra | 14:21 | |
| *** mestery has quit IRC | 14:25 | |
| *** dkehn has quit IRC | 14:31 | |
| *** dkehn has joined #openstack-infra | 14:33 | |
| *** woodster_ has joined #openstack-infra | 14:38 | |
| *** mase_x200 has quit IRC | 14:48 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add script to split the secret hieradata file https://review.openstack.org/179653 | 14:54 |
| mordred | fungi, nibalizer: ^^ that should take our current common.yaml on the puppetmaster and splat it out into all of the smaller files | 14:55 |
| *** sdake has joined #openstack-infra | 14:57 | |
| *** ibiris_away has quit IRC | 14:57 | |
| *** ibiris_away has joined #openstack-infra | 14:57 | |
| *** ibiris_away is now known as ibiris | 14:57 | |
| *** tnovacik has quit IRC | 15:02 | |
| *** ibiris is now known as ibiris_away | 15:08 | |
| *** Somay has quit IRC | 15:08 | |
| *** armax has joined #openstack-infra | 15:11 | |
| *** Somay has joined #openstack-infra | 15:11 | |
| *** markvoelker has joined #openstack-infra | 15:14 | |
| *** sdake has quit IRC | 15:14 | |
| *** sdake has joined #openstack-infra | 15:14 | |
| *** markvoelker has quit IRC | 15:19 | |
| nibalizer | mordred: neat! | 15:25 |
| *** salv-orlando has joined #openstack-infra | 15:30 | |
| *** armax has quit IRC | 15:30 | |
| *** otter768 has joined #openstack-infra | 15:32 | |
| *** sdake_ has joined #openstack-infra | 15:32 | |
| openstackgerrit | Mark McLoughlin proposed openstack-infra/project-config: OpenStack Foundation Transparency Policy project https://review.openstack.org/179648 | 15:33 |
| *** HeOS has quit IRC | 15:35 | |
| *** sdake has quit IRC | 15:35 | |
| *** otter768 has quit IRC | 15:37 | |
| *** salv-orlando has quit IRC | 15:37 | |
| *** gokrokve has joined #openstack-infra | 15:38 | |
| *** gokrokve has quit IRC | 15:38 | |
| *** heyongli has quit IRC | 15:38 | |
| *** heyongli has joined #openstack-infra | 15:39 | |
| *** gokrokve has joined #openstack-infra | 15:39 | |
| *** salv-orlando has joined #openstack-infra | 15:39 | |
| *** HeOS has joined #openstack-infra | 15:39 | |
| *** salv-orlando has quit IRC | 15:41 | |
| *** gokrokve_ has quit IRC | 15:42 | |
| *** abregman has quit IRC | 15:42 | |
| *** gokrokve has quit IRC | 15:43 | |
| *** sdake has joined #openstack-infra | 15:50 | |
| *** sdake has quit IRC | 15:53 | |
| *** sdake_ has quit IRC | 15:54 | |
| *** yfried is now known as yfried|afk | 16:01 | |
| *** gokrokve has joined #openstack-infra | 16:02 | |
| *** _nadya_ has joined #openstack-infra | 16:10 | |
| *** yfried|afk is now known as yfried | 16:12 | |
| mordred | fungi, clarkb: btw - looks like there are unhappies with nodepool or something | 16:12 |
| *** markvoelker has joined #openstack-infra | 16:14 | |
| *** _nadya_ has quit IRC | 16:15 | |
| mordred | fungi: Exception: DIB failed creating /opt/nodepool_dib/centos-6-1430669672.qcow2 | 16:15 |
| mordred | fungi: seeing that a bunch, but I don't think that's the problem | 16:15 |
| greghaynes | Error: Cannot retrieve metalink for repository: epel. Please verify its path and try again | 16:15 |
| greghaynes | heh | 16:15 |
| mordred | greghaynes: where are you seeing that? | 16:16 |
| greghaynes | mordred: http://nodepool.openstack.org/hpcloud-b1.bare-centos6.log | 16:16 |
| mordred | hah. nice | 16:16 |
| mordred | greghaynes: so - that's not a dib node - I wonder why it has a borked epel repo | 16:18 |
| mordred | oh. install_puppet.sh | 16:19 |
| *** markvoelker has quit IRC | 16:19 | |
| *** Somay has quit IRC | 16:19 | |
| *** Somay has joined #openstack-infra | 16:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Disable EPEL before we use yum https://review.openstack.org/179658 | 16:26 |
| mordred | fungi, clarkb, greghaynes, jhesketh: ^^ | 16:26 |
| mordred | we added a line before the epel disable that calls yum, which is causing those centos-6 builds to fail over and over again | 16:27 |
| mordred | of course, we _also_ install redhat-lsb-core in install_puppet.sh - so I feel like this needs a better refactor | 16:27 |
| greghaynes | mordred: do we need to re-enable it too? | 16:27 |
| mordred | well, install_puppet will both enable and disable it in the way it needs | 16:28 |
| mordred | so I feel like we should have one place that's doing this | 16:28 |
| greghaynes | in dib land it might be less of an issue | 16:29 |
| mordred | yah - I agree | 16:29 |
| greghaynes | although, we do puppet install stuff during image build, huh? | 16:29 |
| * greghaynes should probably figure out how that bit works | 16:29 | |
| clarkb | hpclohd should fix their images | 16:30 |
| mordred | well, yes. but they won't | 16:30 |
| clarkb | that solves 90% of this and does so for everyone | 16:30 |
| mordred | clarkb: ++ | 16:30 |
| clarkb | it also enables epel by disabling it and getting new certs | 16:31 |
| clarkb | its yum weirdness | 16:31 |
| *** gokrokve has quit IRC | 16:31 | |
| mordred | yah. and the fun part is that install_puppet then completely overwrites the epel stuff done here | 16:31 |
| *** gokrokve has joined #openstack-infra | 16:32 | |
| mordred | so really, I kinda think we should just rm the epel repo so that we can install wget and then let install_puppet deal with it | 16:32 |
| mordred | but I'm probably crazy | 16:32 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Don't install redhat-lsb-core in prepare_node https://review.openstack.org/179658 | 16:34 |
| mordred | clarkb: different approach ^^ | 16:34 |
| clarkb | mordred we need it for something | 16:35 |
| clarkb | fungi just added that | 16:35 |
| greghaynes | oh? builds were failing because lsb_release was missing | 16:35 |
| mordred | clarkb: yes - because I added the following lines to do the apt repo config | 16:35 |
| clarkb | greghaynes yes | 16:35 |
| mordred | clarkb: the section in the "else" | 16:35 |
| clarkb | ah right | 16:35 |
| mordred | is what needed redhat-lsb-core - except we don't need to even run the program on rh :) | 16:36 |
| clarkb | why are we setting sources.list there? | 16:36 |
| *** gokrokve has quit IRC | 16:37 | |
| mordred | clarkb: however- we don't use centos-6 so it mostly doesn't matter ... are you around enough to help me figure out why we don't have nodes for jobs and the nodepool graphs all have no data for the last couple of hours? | 16:37 |
| mordred | clarkb: because the cloud provider mirrors break | 16:37 |
| mordred | clarkb: we added that when rax broke us last week | 16:37 |
| clarkb | mordred I think graphite may have died | 16:37 |
| mordred | clarkb: ah! simple explanations :) | 16:37 |
| clarkb | and nodepool may have leaked nodes again | 16:37 |
| clarkb | check if we have ready nodes that are hours old | 16:38 |
| clarkb | if so then you can delete them, appears to be a gearman plugin race around sending get job request and being told to reregister jobs | 16:38 |
| mordred | clarkb: I show graphite wsgi things on graphite.o.o - is there somethign else that should be runnign there too? | 16:38 |
| clarkb | zaro and I have been looking at it, I think I am going to try simplifying the state machine there | 16:39 |
| clarkb | mordred chrome? there is a second thing called something like that | 16:39 |
| clarkb | also double check disk space | 16:39 |
| mordred | plenty of disk | 16:39 |
| greghaynes | that change is amazing - we have to detect whether we can install the tool to detect our distro | 16:40 |
| clarkb | carbon | 16:40 |
| greghaynes | so we can fix the broken repos | 16:40 |
| * greghaynes is suddenly sad | 16:41 | |
| mordred | clarkb: I've gota carbon-cache init script | 16:41 |
| mordred | but no carbon in ps | 16:41 |
| mordred | clarkb: should I restart carbon-cache? | 16:41 |
| clarkb | I think we need a carbon running, it receives the events and writes them | 16:42 |
| clarkb | iirc | 16:42 |
| greghaynes | yea, I think thats right - carbon is the thing thta writes whisper files | 16:42 |
| mordred | well, there was definitely not one running | 16:42 |
| mordred | I have restarted carbon-cache | 16:42 |
| clarkb | ya go ahead and start it | 16:42 |
| mordred | and now there is one running | 16:43 |
| clarkb | http://graphite.readthedocs.org/en/latest/carbon-daemons.html | 16:43 |
| mordred | so that's good | 16:43 |
| greghaynes | and it is really annoying that their db server is called -cache | 16:43 |
| clarkb | cached on disk permanently | 16:43 |
| clarkb | we have graphs again | 16:44 |
| mordred | woot | 16:44 |
| mordred | clarkb: I just restored https://review.openstack.org/#/c/157512/ because the "1.1 is deprecated" messages are driving me crazy | 16:45 |
| mordred | clarkb: it has 3 +2's - any issue with me landing it/ | 16:45 |
| greghaynes | well, the merge conflict might be an issue | 16:45 |
| clarkb | merge co flict | 16:45 |
| *** samueldmq has joined #openstack-infra | 16:45 | |
| clarkb | but otherwise no, now you know why I asked about it :) | 16:45 |
| mordred | :) | 16:46 |
| mordred | SO ANNOYIN | 16:46 |
| clarkb | but sudo nodepool list | grep ready | sort -n -t'|' -k11 will give ypu ready nodes sorted by age iirc | 16:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Change references from v1_1 to v2 https://review.openstack.org/157512 | 16:46 |
| clarkb | my sort magic may be off | 16:46 |
| mordred | clarkb: yah - I'm already deleting | 16:47 |
| clarkb | mordred basically what seems to happen is after sending get job we decide to reregister jobs and then when the node is told to run a job it livelocks | 16:49 |
| clarkb | its still running but the state is off such that it doesnt ack and run anyrhing | 16:50 |
| clarkb | but that loop is confusing because state is altered in several independent places, I want to consolidate it to one loop so its easier to reason about | 16:50 |
| *** sdake has joined #openstack-infra | 16:54 | |
| mordred | clarkb: ++ | 16:54 |
| openstackgerrit | Merged openstack-infra/nodepool: Change references from v1_1 to v2 https://review.openstack.org/157512 | 16:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Don't install redhat-lsb-core in prepare_node https://review.openstack.org/179658 | 16:55 |
| mordred | sigh. bashate hates me :) | 16:56 |
| *** sdake_ has joined #openstack-infra | 16:58 | |
| *** sdake has quit IRC | 17:01 | |
| *** yfried is now known as yfried|afk | 17:04 | |
| *** cryptarium has joined #openstack-infra | 17:05 | |
| *** sdake has joined #openstack-infra | 17:06 | |
| mordred | clarkb: btw - I have a hound indexer up and running on all of our repos - I've been finding it helpful when I'm trying to look for stuff across our 75 puppet repos | 17:06 |
| mordred | clarkb: the puppet for it is up for review - super low priority - I mainly just hacked at it yesterday because I couldn't find something :) | 17:07 |
| *** sdake_ has quit IRC | 17:10 | |
| *** armax has joined #openstack-infra | 17:13 | |
| fungi | clarkb: the previous centos-6 failures should be fixed by https://review.openstack.org/179576 as of a couple hours ago now | 17:13 |
| fungi | but maybe there's yet still more | 17:13 |
| fungi | checking | 17:13 |
| *** yfried|afk is now known as yfried | 17:14 | |
| mordred | fungi: yeah - they broke - check the https://review.openstack.org/179658 patch | 17:15 |
| *** markvoelker has joined #openstack-infra | 17:15 | |
| mordred | fungi: oh - nm - different thing | 17:16 |
| samueldmq | well, this channel looks to be the most active at Sundays | 17:16 |
| samueldmq | you guys working a lot to keep things up, and having fun : ) | 17:16 |
| mordred | samueldmq: this channel is always active :) | 17:16 |
| *** sdake_ has joined #openstack-infra | 17:16 | |
| *** sdake has quit IRC | 17:16 | |
| mordred | samueldmq: the weekends are where I work on vendetta projects | 17:16 |
| mordred | like spinning up hound servers - which is not on the todo list | 17:16 |
| *** sdake has joined #openstack-infra | 17:17 | |
| samueldmq | mordred, yeah, that's why I am trying to find more time to work with you | 17:17 |
| samueldmq | mordred, cool : ) | 17:17 |
| samueldmq | mordred, I am working on experimental devstack jobs for keystone v3 only (v2 disabled) right now | 17:18 |
| fungi | mordred: was 179658 fixing breakage, or just cleanup? | 17:18 |
| samueldmq | mordred, but I realized it's much more qa than infra :p | 17:18 |
| fungi | regardless, lgtm | 17:20 |
| *** markvoelker has quit IRC | 17:20 | |
| *** sdake_ has quit IRC | 17:21 | |
| mordred | fungi: fixing breakage - the lsb-redhat-core was trying to install before epel was disabled | 17:22 |
| mordred | samueldmq: :) | 17:22 |
| openstackgerrit | Merged openstack-infra/project-config: Don't install redhat-lsb-core in prepare_node https://review.openstack.org/179658 | 17:28 |
| fungi | mordred: oh! | 17:30 |
| fungi | yeah, that's not what we wanted | 17:30 |
| fungi | thanks | 17:30 |
| *** unicell1 has joined #openstack-infra | 17:30 | |
| *** woodster_ has quit IRC | 17:30 | |
| mordred | fungi: did you see my fix for the logging? | 17:31 |
| *** unicell has quit IRC | 17:31 | |
| *** Somay has quit IRC | 17:32 | |
| *** woodster_ has joined #openstack-infra | 17:35 | |
| mordred | fungi: https://review.openstack.org/#/c/179615/ and the two after it | 17:37 |
| *** yfried is now known as yfried|afk | 17:37 | |
| *** rlandy has quit IRC | 17:38 | |
| *** yfried|afk is now known as yfried | 17:38 | |
| *** Somay has joined #openstack-infra | 17:39 | |
| *** armax has quit IRC | 17:41 | |
| *** otter768 has joined #openstack-infra | 17:42 | |
| *** salv-orlando has joined #openstack-infra | 17:44 | |
| fungi | reviewed them yesterday | 17:46 |
| mordred | oh! so you did | 17:47 |
| mordred | :) | 17:47 |
| *** shakamunyi has joined #openstack-infra | 17:47 | |
| mordred | yolanda: ^^ you mention tests related to logs - can you point me to them? | 17:48 |
| *** ZZelle has quit IRC | 17:52 | |
| *** ZZelle has joined #openstack-infra | 17:53 | |
| *** btully has joined #openstack-infra | 17:53 | |
| *** salv-orlando has quit IRC | 17:55 | |
| *** btully has quit IRC | 17:58 | |
| *** salv-orlando has joined #openstack-infra | 17:59 | |
| *** otter768 has quit IRC | 18:12 | |
| *** salv-orlando has quit IRC | 18:12 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/project-config: Experimental Devstack job for Identity v3 API only https://review.openstack.org/179661 | 18:14 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/devstack-gate: Pass the flag for Identity v3 API only jobs https://review.openstack.org/179662 | 18:14 |
| *** otter768 has joined #openstack-infra | 18:14 | |
| samueldmq | mordred, ^ | 18:15 |
| *** markvoelker has joined #openstack-infra | 18:16 | |
| samueldmq | mordred, I used the same topic on project-config, devstack-gate and devstack changes | 18:16 |
| samueldmq | mordred, https://review.openstack.org/#/q/topic:identity-v3-only-jobs,n,z | 18:16 |
| samueldmq | morganfainberg, mtreinish, dolphm cc Experimental Devstack job for Identity v3 API only ^ | 18:17 |
| *** markvoelker has quit IRC | 18:20 | |
| *** otter768 has quit IRC | 18:24 | |
| *** salv-orlando has joined #openstack-infra | 18:29 | |
| *** mwagner_lap has quit IRC | 18:31 | |
| *** salv-orlando has quit IRC | 18:34 | |
| *** sdake_ has joined #openstack-infra | 18:34 | |
| *** sdake has quit IRC | 18:35 | |
| yolanda | mordred, i meant the config validator tests, does it make sense to fit them there? although it only covers settings file, not log config | 18:37 |
| *** e0ne has joined #openstack-infra | 18:37 | |
| *** yfried is now known as yfried|afk | 18:46 | |
| *** _nadya_ has joined #openstack-infra | 18:47 | |
| *** mwagner_lap has joined #openstack-infra | 18:48 | |
| *** achanda has joined #openstack-infra | 18:49 | |
| *** hashar has joined #openstack-infra | 19:02 | |
| *** yfried|afk is now known as yfried | 19:06 | |
| *** yfried is now known as yfried|afk | 19:16 | |
| *** achanda has quit IRC | 19:16 | |
| *** markvoelker has joined #openstack-infra | 19:17 | |
| *** achanda has joined #openstack-infra | 19:17 | |
| *** achanda has quit IRC | 19:17 | |
| *** markvoelker has quit IRC | 19:21 | |
| *** e0ne has quit IRC | 19:42 | |
| *** dboik has quit IRC | 19:44 | |
| *** ociuhandu has joined #openstack-infra | 19:47 | |
| *** dkranz has quit IRC | 19:50 | |
| *** tnovacik has joined #openstack-infra | 20:03 | |
| *** salv-orlando has joined #openstack-infra | 20:04 | |
| *** achanda has joined #openstack-infra | 20:05 | |
| *** _nadya_ has quit IRC | 20:08 | |
| *** hashar has quit IRC | 20:12 | |
| *** e0ne has joined #openstack-infra | 20:13 | |
| *** salv-orl_ has joined #openstack-infra | 20:15 | |
| *** salv-orlando has quit IRC | 20:16 | |
| *** markvoelker has joined #openstack-infra | 20:18 | |
| *** _nadya_ has joined #openstack-infra | 20:20 | |
| *** salv-orlando has joined #openstack-infra | 20:22 | |
| *** markvoelker has quit IRC | 20:23 | |
| *** salv-orl_ has quit IRC | 20:23 | |
| *** otter768 has joined #openstack-infra | 20:24 | |
| *** ociuhandu has quit IRC | 20:25 | |
| *** fedexo has joined #openstack-infra | 20:26 | |
| *** salv-orlando has quit IRC | 20:27 | |
| *** boris-42 has quit IRC | 20:28 | |
| *** salv-orlando has joined #openstack-infra | 20:29 | |
| *** otter768 has quit IRC | 20:30 | |
| fungi | speaking of centos-6 image build failures... latest problem is: | 20:32 |
| fungi | Running: /opt/git/openstack-dev/devstack/tools/image_list.sh | 20:32 |
| fungi | No supported package data found. | 20:32 |
| *** _nadya_ has quit IRC | 20:32 | |
| fungi | so apparently that script is set to return nonzero under those conditions. i should probably tweak the cache script to skip running that on centos 6.x | 20:33 |
| *** fedexo has quit IRC | 20:33 | |
| mordred | nod | 20:33 |
| mordred | yolanda: I think it would be too much work for not enough gain - since we'd ultimately need to cross-reference with what the actually loggers we log to in the code is | 20:34 |
| fungi | alternatively i could see if the devstack authors are cool with a workaround in the image_list.sh | 20:34 |
| fungi | but probably just not running it in this case is fine too | 20:34 |
| *** fedexo has joined #openstack-infra | 20:34 | |
| mordred | yolanda: I _Do_ think that at some point we should perhaps move the code that does that into nodepool so taht we can - but as an external script in system-config I think it's not worth it | 20:35 |
| mordred | fungi: I think both sound fine to me | 20:35 |
| mordred | fungi: maybe workaround in our script for now, and then also maybe change devstack or something | 20:35 |
| fungi | mordred: well, in the end we want to cache all the things we can. in dibland it's likely fine to just not run the cache-devstack element on centos-6 because we'll never devstack on centos-6, but in snapshotburg we're still in need of platform detection in the outer script i think. i'll see what options are long term and try approximate them as best we can | 20:37 |
| mordred | ++ | 20:38 |
| mordred | fungi: honestly, I think it would be good for cache-devstack to work everywhere | 20:38 |
| mordred | because why not | 20:38 |
| mordred | fungi: especially once devstack consumes bindep | 20:38 |
| mordred | because at that point bindep will be handling "so, you need these packages on these platforms" and what we'll need from devstack is other artifacts like images that we need to download | 20:39 |
| *** e0ne has quit IRC | 20:40 | |
| fungi | fair enough. i'll see what's involved. i have to assume this is erroring on platforms for which devstack lacks package data for a reason, so it will need to know how to differentiate between "i couldn't come up with a list of packages for you because devstack is wrong" and "your platform doesn't have any packages listed for devstack" | 20:40 |
| *** yamahata has joined #openstack-infra | 20:46 | |
| *** hdd has joined #openstack-infra | 20:49 | |
| *** hdd has quit IRC | 20:52 | |
| *** ociuhandu has joined #openstack-infra | 20:56 | |
| *** hdd has joined #openstack-infra | 21:03 | |
| *** hdd has quit IRC | 21:12 | |
| *** Somay_ has joined #openstack-infra | 21:15 | |
| *** Somay has quit IRC | 21:15 | |
| *** markvoelker has joined #openstack-infra | 21:18 | |
| *** achanda has quit IRC | 21:21 | |
| *** markvoelker has quit IRC | 21:23 | |
| *** baoli has quit IRC | 21:27 | |
| *** samueldmq has quit IRC | 21:30 | |
| *** baoli has joined #openstack-infra | 21:32 | |
| *** Somay_ has quit IRC | 21:41 | |
| *** jamielennox|away is now known as jamielennox | 21:49 | |
| *** baoli has quit IRC | 21:50 | |
| *** ociuhandu has quit IRC | 21:50 | |
| *** tnovacik has quit IRC | 21:50 | |
| cody-somerville | mordred: Whats cache-devstack? It sounds interesting. | 21:51 |
| *** ociuhandu has joined #openstack-infra | 21:52 | |
| *** ociuhandu has quit IRC | 21:53 | |
| greghaynes | cody-somerville: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-devstack | 21:55 |
| greghaynes | cody-somerville: caches stuff on dib images for devstack | 21:55 |
| greghaynes | (I think thats the only cache-devstack thing around here) | 21:55 |
| *** jamielennox is now known as jamielennox|away | 22:01 | |
| *** jamielennox|away is now known as jamielennox | 22:02 | |
| *** sabeen1 has joined #openstack-infra | 22:04 | |
| *** fedexo has quit IRC | 22:16 | |
| mordred | yah | 22:18 |
| mordred | well, there is also the nodepool script | 22:18 |
| mordred | http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/cache_devstack.py | 22:19 |
| mordred | cody-somerville: ^^ | 22:19 |
| *** markvoelker has joined #openstack-infra | 22:19 | |
| mordred | cody-somerville: both do the same thing - it depends on whether nodepool images are being built with snapshots or dib ... but both versions of the script are the thing that caches all of the things that devstack might need on the image | 22:20 |
| *** jamielennox is now known as jamielennox|away | 22:22 | |
| *** markvoelker has quit IRC | 22:23 | |
| *** otter768 has joined #openstack-infra | 22:25 | |
| *** camunoz has joined #openstack-infra | 22:28 | |
| *** packet has joined #openstack-infra | 22:29 | |
| *** otter768 has quit IRC | 22:30 | |
| *** achanda has joined #openstack-infra | 22:37 | |
| *** jamielennox|away is now known as jamielennox | 22:39 | |
| *** sambetts has quit IRC | 22:42 | |
| *** sambetts has joined #openstack-infra | 22:43 | |
| *** sdake has joined #openstack-infra | 22:48 | |
| *** salv-orl_ has joined #openstack-infra | 22:51 | |
| *** sdake_ has quit IRC | 22:52 | |
| *** salv-orlando has quit IRC | 22:54 | |
| *** sergsh has quit IRC | 22:59 | |
| *** sergsh has joined #openstack-infra | 22:59 | |
| *** dboik has joined #openstack-infra | 23:00 | |
| *** dboik has quit IRC | 23:00 | |
| *** dboik has joined #openstack-infra | 23:01 | |
| *** sdake_ has joined #openstack-infra | 23:04 | |
| jhesketh | Morning | 23:04 |
| *** sdake has quit IRC | 23:08 | |
| *** otter768 has joined #openstack-infra | 23:09 | |
| mordred | morning jhesketh ! | 23:17 |
| *** markvoelker has joined #openstack-infra | 23:20 | |
| *** packet has quit IRC | 23:20 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 23:23 |
| *** harlowja has quit IRC | 23:23 | |
| *** dboik has quit IRC | 23:24 | |
| jhesketh | o/ mordred | 23:24 |
| *** markvoelker has quit IRC | 23:25 | |
| mordred | jhesketh: 179615 and the two after it could use an eye/land | 23:27 |
| * jhesketh looks | 23:28 | |
| *** sarob has joined #openstack-infra | 23:31 | |
| *** _nadya_ has joined #openstack-infra | 23:33 | |
| *** btully has joined #openstack-infra | 23:34 | |
| greghaynes | mordred: there appears to be a -1 on 179615 | 23:34 |
| jhesketh | mordred: will be you around if I merge these now? | 23:34 |
| *** mwagner_lap has quit IRC | 23:35 | |
| mordred | greghaynes: there is - I chatted with yolanda about it - I do not think the effort in fitting those into that structure is worth it in this case | 23:36 |
| mordred | jhesketh: I'm about to step out for about 15 - if you just leave the +2s if you're happy, I'll land and watch when I'm back | 23:36 |
| *** _nadya_ has quit IRC | 23:37 | |
| jhesketh | mordred: sounds good to me | 23:37 |
| *** sputnik13 has joined #openstack-infra | 23:39 | |
| *** chlong has joined #openstack-infra | 23:41 | |
| *** otter768 has quit IRC | 23:42 | |
| * mordred does a dance | 23:42 | |
| *** sputnik13 has quit IRC | 23:45 | |
| *** salv-orl_ has quit IRC | 23:46 | |
| *** mwagner_lap has joined #openstack-infra | 23:52 | |
| *** ivar-lazzaro has joined #openstack-infra | 23:56 | |
| *** mikeit_ has joined #openstack-infra | 23:57 | |
| *** sdake has joined #openstack-infra | 23:57 | |
| *** sdake_ has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!