| anteaya | add it to this file, I do believe: http://git.openstack.org/cgit/openstack/requirements/tree/projects.txt | 00:01 |
|---|---|---|
| sdake | nice thanks I'll give that a go ;) | 00:01 |
| sdake | magic of infra :) | 00:01 |
| anteaya | at the very least you will learn where to actully put it, if I am wrong | 00:01 |
| *** sdake_ has quit IRC | 00:01 | |
| anteaya | you are too kind | 00:01 |
| *** sdake_ has joined #openstack-infra | 00:02 | |
| sdake_ | anteaya looks like someone already did the job :) | 00:03 |
| sdake_ | nice | 00:03 |
| anteaya | yay, even better | 00:03 |
| sdake_ | I haven't seen any requirements sync reviews | 00:03 |
| anteaya | hmmmm | 00:03 |
| anteaya | when did it get added? | 00:03 |
| sdake_ | but I have to admit I've been really busy witht kolla and not on top of the magnum review queue | 00:03 |
| anteaya | has anyone edited global requirements since magnum was added? | 00:04 |
| sdake_ | april 6th | 00:04 |
| sdake_ | checking | 00:04 |
| *** ddieterly has joined #openstack-infra | 00:04 | |
| sdake_ | ya added april 6th, last commit to global-requirements.txt is may 19th | 00:04 |
| sdake_ | maybe I just missed it | 00:04 |
| anteaya | hmmmm | 00:04 |
| sdake_ | I know dims was doing some work to fix it up | 00:05 |
| anteaya | okay | 00:05 |
| sdake_ | we had version caps on some of our requirements | 00:05 |
| sdake_ | which was no beuno | 00:05 |
| anteaya | I'm not sure what to do to check the situation to ensure the files are accurate for your needs | 00:05 |
| *** sdake has quit IRC | 00:06 | |
| sdake_ | anteaya let me rtfm for a bit to double check :) | 00:07 |
| anteaya | I hope you find something of use | 00:09 |
| sdake_ | docs are good | 00:09 |
| anteaya | that they are | 00:10 |
| sdake_ | we need a check job for requirements | 00:10 |
| anteaya | ah ha | 00:10 |
| sdake_ | i'll sort that out | 00:10 |
| anteaya | sounds good | 00:10 |
| anteaya | I had two ducks in my driveway | 00:10 |
| anteaya | which is unusual, they usually select the pond | 00:10 |
| sdake_ | i used to live in flagstaff, ducks in teh neighboorhood walking around all the time | 00:11 |
| sdake_ | in phoenix, no ducks :) | 00:11 |
| anteaya | no idea what the attraction was for the wet asphalt | 00:11 |
| anteaya | ha ha ha | 00:11 |
| sdake_ | free human food | 00:11 |
| anteaya | doves and quail | 00:11 |
| anteaya | perhaps, for those who partake of ducks | 00:11 |
| sdake_ | no i mean they eat our leftovers | 00:11 |
| anteaya | Shrews: did you end up with any duck in Vancouver? | 00:11 |
| anteaya | ah | 00:11 |
| anteaya | yes, I have a friend who feeds them and if she is delayed they walk into the garage and tap on the glass door to get her attention | 00:12 |
| *** dkehn__ has joined #openstack-infra | 00:14 | |
| sdake_ | looks like our repo is up to date with the global requirements | 00:14 |
| sdake_ | so I guess we are good to go iminus the check job :) | 00:14 |
| anteaya | that is a good development | 00:14 |
| anteaya | yay | 00:14 |
| *** dkehn has quit IRC | 00:14 | |
| *** chlong has joined #openstack-infra | 00:15 | |
| *** dkehn_ has quit IRC | 00:15 | |
| *** salv-orlando has quit IRC | 00:16 | |
| *** asettle has joined #openstack-infra | 00:16 | |
| sdake_ | anteaya looks like we have a check-requirements job done as well | 00:17 |
| * sdake_ wonders when all this work gets done :) | 00:17 | |
| anteaya | elves | 00:17 |
| *** dkehn has joined #openstack-infra | 00:17 | |
| anteaya | you are blessed with elves | 00:17 |
| *** koolhead17 has joined #openstack-infra | 00:22 | |
| *** koolhead17 has quit IRC | 00:22 | |
| *** koolhead17 has joined #openstack-infra | 00:22 | |
| *** baoli has joined #openstack-infra | 00:23 | |
| *** amotoki has joined #openstack-infra | 00:26 | |
| *** baoli has quit IRC | 00:27 | |
| *** sarob has joined #openstack-infra | 00:28 | |
| *** mestery has joined #openstack-infra | 00:38 | |
| *** mestery has quit IRC | 00:41 | |
| *** sarob has quit IRC | 00:42 | |
| *** sarob has joined #openstack-infra | 00:42 | |
| *** mestery has joined #openstack-infra | 00:43 | |
| *** Pacheco has quit IRC | 00:43 | |
| *** mahito has joined #openstack-infra | 00:47 | |
| *** woodster_ has quit IRC | 00:50 | |
| *** zhiwei has joined #openstack-infra | 00:52 | |
| *** freerunner has joined #openstack-infra | 00:54 | |
| *** yamamoto has quit IRC | 00:58 | |
| *** marzif has quit IRC | 01:00 | |
| *** krtaylor has quit IRC | 01:02 | |
| *** ddieterly has quit IRC | 01:06 | |
| *** ddieterly has joined #openstack-infra | 01:08 | |
| *** dimsum__ has joined #openstack-infra | 01:12 | |
| *** krtaylor has joined #openstack-infra | 01:15 | |
| *** dimsum__ has quit IRC | 01:15 | |
| *** dimsum__ has joined #openstack-infra | 01:15 | |
| *** freerunner has quit IRC | 01:19 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: keystonemiddleware non-voting bandit job https://review.openstack.org/185478 | 01:20 |
| *** ericksonsantos has quit IRC | 01:21 | |
| *** julim has joined #openstack-infra | 01:21 | |
| *** julim has quit IRC | 01:21 | |
| *** banix has joined #openstack-infra | 01:28 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Fix branch for keystone bandit job https://review.openstack.org/185479 | 01:29 |
| *** baoli has joined #openstack-infra | 01:30 | |
| *** sarob has quit IRC | 01:30 | |
| *** ericksonsantos has joined #openstack-infra | 01:31 | |
| *** dimsum__ has quit IRC | 01:37 | |
| *** ivar-lazzaro has joined #openstack-infra | 01:41 | |
| *** dguerri`away has quit IRC | 01:41 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: keystonemiddleware non-voting bandit job https://review.openstack.org/185478 | 01:41 |
| *** tcammann has quit IRC | 01:42 | |
| *** dimsum__ has joined #openstack-infra | 01:43 | |
| *** otter768 has joined #openstack-infra | 01:45 | |
| *** dguerri`away has joined #openstack-infra | 01:45 | |
| *** dguerri`away is now known as dguerri | 01:45 | |
| *** rguillebert has quit IRC | 01:45 | |
| *** tcammann has joined #openstack-infra | 01:49 | |
| *** otter768 has quit IRC | 01:50 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: keystoneclient non-voting bandit job https://review.openstack.org/185482 | 01:52 |
| jamielennox | dhellmann: around? | 01:53 |
| *** mtanino has quit IRC | 02:02 | |
| *** ayoung has joined #openstack-infra | 02:03 | |
| *** macjack has joined #openstack-infra | 02:04 | |
| *** salv-orlando has joined #openstack-infra | 02:04 | |
| *** zhiwei has quit IRC | 02:05 | |
| *** zhiwei has joined #openstack-infra | 02:06 | |
| *** ajmiller has quit IRC | 02:07 | |
| *** salv-orlando has quit IRC | 02:11 | |
| *** macjack has quit IRC | 02:18 | |
| *** zz_dimtruck is now known as dimtruck | 02:18 | |
| *** samueldmq has quit IRC | 02:20 | |
| *** baoli has quit IRC | 02:26 | |
| *** armax has joined #openstack-infra | 02:28 | |
| *** woodster_ has joined #openstack-infra | 02:30 | |
| *** puranamr has joined #openstack-infra | 02:31 | |
| *** macjack has joined #openstack-infra | 02:33 | |
| *** puranamr has quit IRC | 02:36 | |
| *** yamamoto has joined #openstack-infra | 02:39 | |
| *** dimsum__ has quit IRC | 02:45 | |
| *** dimsum__ has joined #openstack-infra | 02:46 | |
| *** sdake has joined #openstack-infra | 02:48 | |
| *** sdake_ has quit IRC | 02:50 | |
| *** sdake_ has joined #openstack-infra | 02:50 | |
| *** dimsum__ has quit IRC | 02:51 | |
| *** sdake has quit IRC | 02:54 | |
| *** asselin has quit IRC | 02:56 | |
| *** koolhead17 has quit IRC | 02:57 | |
| *** yamahata has joined #openstack-infra | 03:03 | |
| *** asettle has quit IRC | 03:07 | |
| *** notmyname has joined #openstack-infra | 03:13 | |
| *** ddieterly has quit IRC | 03:15 | |
| *** ociuhandu has joined #openstack-infra | 03:18 | |
| *** ayoung is now known as ayoung_ZZZZzzzz_ | 03:19 | |
| *** koolhead17 has joined #openstack-infra | 03:19 | |
| *** panda has quit IRC | 03:21 | |
| *** panda has joined #openstack-infra | 03:21 | |
| *** sdake_ has quit IRC | 03:23 | |
| *** MarkAtwood has quit IRC | 03:23 | |
| *** MarkAtwood has joined #openstack-infra | 03:25 | |
| *** davideagnello has joined #openstack-infra | 03:32 | |
| *** Kennan2 has joined #openstack-infra | 03:33 | |
| *** Kennan has quit IRC | 03:34 | |
| *** banix has quit IRC | 03:36 | |
| *** davideagnello has quit IRC | 03:37 | |
| *** ivar-lazzaro has quit IRC | 03:42 | |
| *** unicell has joined #openstack-infra | 03:42 | |
| *** otter768 has joined #openstack-infra | 03:46 | |
| *** otter768 has quit IRC | 03:50 | |
| *** dimtruck is now known as zz_dimtruck | 04:01 | |
| *** dtantsur|afk is now known as dtantsur | 04:02 | |
| *** asettle has joined #openstack-infra | 04:05 | |
| *** alexpilotti has joined #openstack-infra | 04:06 | |
| *** yfried|afk is now known as yfried_ | 04:12 | |
| *** armax has quit IRC | 04:12 | |
| *** achanda has joined #openstack-infra | 04:12 | |
| *** btully has joined #openstack-infra | 04:15 | |
| *** ddieterly has joined #openstack-infra | 04:16 | |
| *** puranamr has joined #openstack-infra | 04:16 | |
| *** ddieterly has quit IRC | 04:21 | |
| *** puranamr has quit IRC | 04:21 | |
| *** yfried_ has quit IRC | 04:24 | |
| *** links has joined #openstack-infra | 04:27 | |
| *** dboik has joined #openstack-infra | 04:27 | |
| *** sarob has joined #openstack-infra | 04:28 | |
| *** achanda has quit IRC | 04:30 | |
| *** hdd has joined #openstack-infra | 04:31 | |
| *** mohitsharma has joined #openstack-infra | 04:33 | |
| *** sputnik13 has joined #openstack-infra | 04:33 | |
| *** abregman has joined #openstack-infra | 04:36 | |
| *** sks has joined #openstack-infra | 04:36 | |
| *** deepakcs has joined #openstack-infra | 04:40 | |
| *** abregman has quit IRC | 04:40 | |
| *** alexpilotti has quit IRC | 04:41 | |
| *** abregman has joined #openstack-infra | 04:42 | |
| *** jpeeler has joined #openstack-infra | 04:49 | |
| *** jpeeler has quit IRC | 04:51 | |
| *** maishsk_afk has joined #openstack-infra | 04:52 | |
| *** maishsk_afk has quit IRC | 04:54 | |
| *** jpeeler has joined #openstack-infra | 04:54 | |
| *** davideagnello has joined #openstack-infra | 05:00 | |
| *** aswadr has joined #openstack-infra | 05:05 | |
| *** BharatK has joined #openstack-infra | 05:10 | |
| *** _nadya_ has joined #openstack-infra | 05:10 | |
| *** dboik has quit IRC | 05:14 | |
| *** dboik has joined #openstack-infra | 05:14 | |
| *** mohitsharma has quit IRC | 05:15 | |
| *** sarob has quit IRC | 05:15 | |
| *** puranamr has joined #openstack-infra | 05:15 | |
| *** davideagnello has quit IRC | 05:16 | |
| *** puranamr has quit IRC | 05:20 | |
| *** pal has joined #openstack-infra | 05:28 | |
| *** dboik has quit IRC | 05:30 | |
| *** dimsum__ has joined #openstack-infra | 05:36 | |
| *** ParsectiX has joined #openstack-infra | 05:36 | |
| *** dimsum__ has quit IRC | 05:41 | |
| *** e0ne has joined #openstack-infra | 05:46 | |
| *** yfried_ has joined #openstack-infra | 05:47 | |
| *** otter768 has joined #openstack-infra | 05:47 | |
| *** asettle has quit IRC | 05:50 | |
| *** otter768 has quit IRC | 05:51 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool: Convert to use latest statsd version https://review.openstack.org/171890 | 05:53 |
| *** e0ne has quit IRC | 05:53 | |
| *** ildikov has quit IRC | 05:56 | |
| *** hdd has quit IRC | 05:56 | |
| pal | Can anyone tell me what all processes happen at backend when you launch an instance | 05:57 |
| *** ParsectiX has quit IRC | 06:07 | |
| *** mohitsharma has joined #openstack-infra | 06:15 | |
| *** maishsk_afk has joined #openstack-infra | 06:16 | |
| *** ddieterly has joined #openstack-infra | 06:17 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using puppet-cgit to manage cgitrc https://review.openstack.org/181835 | 06:22 |
| *** ddieterly has quit IRC | 06:22 | |
| *** ociuhandu has quit IRC | 06:23 | |
| *** ildikov has joined #openstack-infra | 06:24 | |
| *** chlong has quit IRC | 06:30 | |
| *** ujuc has joined #openstack-infra | 06:35 | |
| *** fedexo has joined #openstack-infra | 06:45 | |
| *** soren has joined #openstack-infra | 06:45 | |
| *** ZZelle has quit IRC | 06:48 | |
| *** maishsk_afk is now known as maishsk | 06:52 | |
| *** matbu has quit IRC | 06:58 | |
| *** matbu has joined #openstack-infra | 07:02 | |
| *** jtomasek has joined #openstack-infra | 07:03 | |
| *** achanda has joined #openstack-infra | 07:04 | |
| *** k4n0 has joined #openstack-infra | 07:08 | |
| *** cody-somerville has joined #openstack-infra | 07:10 | |
| *** cody-somerville has quit IRC | 07:10 | |
| *** cody-somerville has joined #openstack-infra | 07:10 | |
| *** yfried_ is now known as yfried|afk | 07:14 | |
| *** cody-somerville has quit IRC | 07:17 | |
| *** fijal has quit IRC | 07:20 | |
| *** yfried|afk is now known as yfried_ | 07:20 | |
| *** fijal has joined #openstack-infra | 07:27 | |
| *** Ala has joined #openstack-infra | 07:29 | |
| *** btully has quit IRC | 07:29 | |
| *** achanda has quit IRC | 07:30 | |
| *** mohitsha_ has joined #openstack-infra | 07:33 | |
| *** mohitsharma has quit IRC | 07:33 | |
| *** jlanoux has joined #openstack-infra | 07:35 | |
| *** arxcruz has joined #openstack-infra | 07:35 | |
| *** HeOS has quit IRC | 07:38 | |
| *** jistr has joined #openstack-infra | 07:39 | |
| *** e0ne has joined #openstack-infra | 07:39 | |
| *** e0ne is now known as e0ne_ | 07:40 | |
| *** _nadya_ has joined #openstack-infra | 07:40 | |
| *** markus_z has joined #openstack-infra | 07:44 | |
| *** otter768 has joined #openstack-infra | 07:47 | |
| *** achanda has joined #openstack-infra | 07:48 | |
| *** e0ne_ is now known as e0ne | 07:49 | |
| *** otter768 has quit IRC | 07:52 | |
| *** rcarrillocruz has quit IRC | 07:58 | |
| *** shardy has joined #openstack-infra | 07:58 | |
| *** ParsectiX has joined #openstack-infra | 07:58 | |
| openstackgerrit | Merged openstack/requirements: Add flag to include hacking https://review.openstack.org/170492 | 07:59 |
| *** samuelBartel has joined #openstack-infra | 07:59 | |
| *** mpavone has joined #openstack-infra | 08:01 | |
| *** devvesa has joined #openstack-infra | 08:04 | |
| *** dizquierdo has joined #openstack-infra | 08:04 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Revert "Pin puppet-memcached" https://review.openstack.org/185524 | 08:06 |
| electrical | pal: you mean of openstack it self? I think you'll need the #openstack channel for that. this is mainly the openstack infra part | 08:08 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 08:10 |
| *** gema_ is now known as gema | 08:10 | |
| *** maishsk is now known as maishsk_afk | 08:12 | |
| *** fedexo has quit IRC | 08:13 | |
| *** Hal has joined #openstack-infra | 08:15 | |
| *** Hal is now known as Guest88932 | 08:15 | |
| *** sarob has joined #openstack-infra | 08:15 | |
| *** ttx has quit IRC | 08:18 | |
| *** ttx has joined #openstack-infra | 08:19 | |
| *** ddieterly has joined #openstack-infra | 08:19 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Adds the 1st initial package for upstream infra packaging https://review.openstack.org/185164 | 08:19 |
| *** sarob has quit IRC | 08:20 | |
| *** derekh has joined #openstack-infra | 08:20 | |
| *** bkero has quit IRC | 08:21 | |
| *** bkero has joined #openstack-infra | 08:21 | |
| zigo | Is there something wrong in this ? https://review.openstack.org/#/c/185164/3/gerritbot/channels.yaml,unified | 08:22 |
| *** ddieterly has quit IRC | 08:24 | |
| *** hichihara has quit IRC | 08:24 | |
| *** fijal_ has joined #openstack-infra | 08:25 | |
| electrical | zigo: looks good to me. | 08:26 |
| zigo | electrical: Any idea why it fails the zuul test then? | 08:26 |
| *** fijal has quit IRC | 08:26 | |
| *** ZZelle has joined #openstack-infra | 08:27 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 08:28 |
| electrical | zigo: https://review.openstack.org/#/c/185164/3/zuul/layout.yaml your change there is wrong. | 08:28 |
| *** mpaolino has joined #openstack-infra | 08:28 | |
| electrical | to many indents | 08:28 |
| zigo | Ah? | 08:29 |
| zigo | Thanks. | 08:29 |
| zigo | Not sure where... :/ | 08:29 |
| electrical | the template key and the list under it should be 2 spaces back. | 08:30 |
| zigo | Ok. | 08:31 |
| electrical | like the block of 'stackforge/poppy' below it | 08:31 |
| *** koolhead17 has quit IRC | 08:31 | |
| electrical | and the irc access failure is that the channel is in gerritbot but not in accessbot. | 08:31 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Adds the 1st initial package for upstream infra packaging https://review.openstack.org/185164 | 08:31 |
| zigo | electrical: Thanks a lot. | 08:32 |
| electrical | np :-) | 08:32 |
| electrical | the irc check will most likely still fail though. | 08:32 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Adds the 1st initial package for upstream infra packaging https://review.openstack.org/185164 | 08:33 |
| *** hichihara has joined #openstack-infra | 08:33 | |
| electrical | and should work now with your latest patch set ;-) | 08:33 |
| *** hichihara has quit IRC | 08:33 | |
| *** hichihara has joined #openstack-infra | 08:33 | |
| *** Ala has quit IRC | 08:35 | |
| *** fhubik has joined #openstack-infra | 08:35 | |
| *** ttx has quit IRC | 08:35 | |
| *** ttx has joined #openstack-infra | 08:35 | |
| electrical | waynr: found the bug. if the key exists in the puppet namespace of defaults but not in global it doesn't get picked up :-( ( CC clarkb fungi ) should we consider that a bug or an undocumented feature? :-) | 08:36 |
| *** fedexo has joined #openstack-infra | 08:40 | |
| *** e0ne is now known as e0ne_ | 08:42 | |
| *** e0ne_ is now known as e0ne | 08:43 | |
| *** devvesa has quit IRC | 08:46 | |
| *** aswadr has quit IRC | 08:48 | |
| *** aswadr has joined #openstack-infra | 08:50 | |
| *** mpaolino has quit IRC | 08:50 | |
| *** sputnik13 has quit IRC | 08:56 | |
| *** mohitsha_ has quit IRC | 08:56 | |
| *** mohitsharma has joined #openstack-infra | 08:56 | |
| *** turul has joined #openstack-infra | 08:56 | |
| *** dalgaaf has joined #openstack-infra | 08:56 | |
| *** sputnik13 has joined #openstack-infra | 08:56 | |
| *** turul is now known as afazekas | 08:56 | |
| *** rlandy has joined #openstack-infra | 08:57 | |
| *** mohitsharma has quit IRC | 08:57 | |
| *** _nadya_ has quit IRC | 08:57 | |
| *** redixin has joined #openstack-infra | 08:59 | |
| electrical | waynr: also found a weird bug with setting defaults: to job-group or project. it is moaning it can't find some variables if i don't define them but they are not being applied. looks like the job-template part applying defaults is overriding it. | 08:59 |
| electrical | zigo: still got an error: #openstack-pkg is not registered with ChanServ. | 09:00 |
| electrical | i think that's something you or one of the admins will have to do :-) | 09:00 |
| *** HeOS has joined #openstack-infra | 09:00 | |
| zigo | electrical: Who should I ask to do that? | 09:01 |
| electrical | zigo: i think any of the channel admins can help you with that. http://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml#n37 <-- list | 09:02 |
| *** claudiub has joined #openstack-infra | 09:02 | |
| zigo | electrical: Ok, thanks. | 09:02 |
| electrical | np | 09:02 |
| zigo | clarkb: lifeless: jeblair: fungi: SergeyLukjanov: Can any of you register the #openstack-pkg channel? | 09:03 |
| *** leopoldj has joined #openstack-infra | 09:04 | |
| *** rcarrillocruz has joined #openstack-infra | 09:06 | |
| *** fijal_ is now known as fijal | 09:08 | |
| *** ildikov has quit IRC | 09:14 | |
| *** fedexo has quit IRC | 09:15 | |
| *** fhubik is now known as fhubik_afk | 09:17 | |
| *** fhubik_afk is now known as fhubik | 09:17 | |
| *** david-t_ has joined #openstack-infra | 09:18 | |
| david-t_ | Hi infra team, could you have a look on https://review.openstack.org/#/c/185006/ please in order to approuve my new project creation ? Thanks a lot | 09:19 |
| *** abregman is now known as abregman|afk | 09:19 | |
| *** ddieterly has joined #openstack-infra | 09:20 | |
| *** ddieterly has quit IRC | 09:25 | |
| *** mcdonagm__ has quit IRC | 09:27 | |
| *** fijal has quit IRC | 09:29 | |
| yfried_ | AJaeger: could you please review redixin's patch https://review.openstack.org/#/c/185027/3 | 09:37 |
| *** teran has quit IRC | 09:39 | |
| *** fijal has joined #openstack-infra | 09:40 | |
| *** ihrachyshka has joined #openstack-infra | 09:41 | |
| *** otter768 has joined #openstack-infra | 09:48 | |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Split slow rally job to several small ones https://review.openstack.org/185027 | 09:49 |
| *** sputnik13 has quit IRC | 09:49 | |
| *** Ala has joined #openstack-infra | 09:49 | |
| *** fhubik is now known as fhubik_afk | 09:49 | |
| *** salv-orlando has joined #openstack-infra | 09:51 | |
| *** otter768 has quit IRC | 09:53 | |
| *** yfried_ is now known as yfried|afk | 09:57 | |
| *** sputnik13 has joined #openstack-infra | 10:00 | |
| *** freerunner has joined #openstack-infra | 10:00 | |
| *** panda is now known as panda|afk | 10:02 | |
| *** Ala has quit IRC | 10:03 | |
| *** yfried|afk is now known as yfried_ | 10:03 | |
| *** jamespage_ has joined #openstack-infra | 10:06 | |
| *** e0ne is now known as e0ne_ | 10:08 | |
| *** ujuc has quit IRC | 10:09 | |
| *** ildikov has joined #openstack-infra | 10:09 | |
| *** fhubik_afk is now known as fhubik | 10:16 | |
| *** pc_m has joined #openstack-infra | 10:16 | |
| *** Guest88932 has quit IRC | 10:17 | |
| *** e0ne_ has quit IRC | 10:19 | |
| *** rossella_s has joined #openstack-infra | 10:19 | |
| *** abregman|afk is now known as abregman | 10:20 | |
| *** ddieterly has joined #openstack-infra | 10:20 | |
| *** afazekas_ has joined #openstack-infra | 10:21 | |
| *** nikeshm has quit IRC | 10:23 | |
| *** mmedvede has joined #openstack-infra | 10:25 | |
| *** ddieterly has quit IRC | 10:25 | |
| *** _nadya_ has joined #openstack-infra | 10:28 | |
| *** e0ne has joined #openstack-infra | 10:28 | |
| *** jamespage_ has quit IRC | 10:29 | |
| *** dpaterson has joined #openstack-infra | 10:29 | |
| *** mmedvede has quit IRC | 10:29 | |
| *** jlanoux_ has joined #openstack-infra | 10:29 | |
| *** woodster_ has quit IRC | 10:30 | |
| *** jlanoux has quit IRC | 10:32 | |
| *** mahito has quit IRC | 10:34 | |
| *** samueldmq has joined #openstack-infra | 10:35 | |
| samueldmq | morning | 10:35 |
| *** e0ne is now known as e0ne_ | 10:39 | |
| *** marzif has joined #openstack-infra | 10:39 | |
| *** jlanoux has joined #openstack-infra | 10:41 | |
| *** jlanoux_ has quit IRC | 10:43 | |
| openstackgerrit | Ekaterina Chernova proposed openstack-infra/project-config: Make 'gate-murano-devstack-dsvm' non-voting https://review.openstack.org/184809 | 10:44 |
| *** teran has joined #openstack-infra | 10:45 | |
| *** zhiwei has quit IRC | 10:48 | |
| *** e0ne_ has quit IRC | 10:49 | |
| *** boris-42 has joined #openstack-infra | 10:49 | |
| *** teran has quit IRC | 10:51 | |
| electrical | hiya samueldmq | 10:51 |
| *** Hal has joined #openstack-infra | 10:55 | |
| *** Hal is now known as Guest6609 | 10:55 | |
| *** yamahata has quit IRC | 10:59 | |
| samueldmq | electrical, hi .. things still look to be moving a little bit slow here (as in other channels) : ) | 11:00 |
| *** freerunner has quit IRC | 11:00 | |
| electrical | samueldmq: hehe yeah indeed | 11:00 |
| electrical | the other side ( across the pond ) isn't awake yet | 11:01 |
| samueldmq | electrical, hmm yes, this is important to notice as well ;) | 11:01 |
| *** shardy_ has joined #openstack-infra | 11:02 | |
| *** shardy has quit IRC | 11:02 | |
| *** david-t_ has quit IRC | 11:04 | |
| *** teran has joined #openstack-infra | 11:04 | |
| *** _nadya_ has quit IRC | 11:05 | |
| electrical | samueldmq: did you ever work with JJB ? ( Jenkins Job Builder ) | 11:05 |
| *** dguitarbite has joined #openstack-infra | 11:06 | |
| *** nadya has joined #openstack-infra | 11:06 | |
| *** matbu is now known as matbu_afk | 11:07 | |
| *** nadya is now known as Guest48956 | 11:07 | |
| samueldmq | electrical, well, I have a change that creates a job template and add it in the experimental job list of some projects | 11:07 |
| samueldmq | electrical, that's all I know so far | 11:07 |
| *** shardy_ has quit IRC | 11:07 | |
| *** fijal has quit IRC | 11:07 | |
| electrical | ah okay :-) | 11:07 |
| *** yfried_ is now known as yfried|afk | 11:07 | |
| electrical | Found a weird bug and still trying to chase it down. | 11:07 |
| *** shardy has joined #openstack-infra | 11:08 | |
| samueldmq | electrical, what is that JJB ? looks like you know more than me on that :) | 11:08 |
| *** Guest48956 is now known as _nadya_ | 11:08 | |
| *** marcusvrn has joined #openstack-infra | 11:08 | |
| electrical | JJB allows you to manage Jenkins jobs via yaml files instead via the web interface or ( even worse ) horrible xml files :-) | 11:08 |
| samueldmq | electrical, nice, so actually JJB is what allows me to use that devstack-gate.yaml (yaml format) for example, in my change :) | 11:11 |
| electrical | samueldmq: correct :-) | 11:11 |
| samueldmq | electrical, cool, I'd be glad to dig a bit more on that with you .. but time is a bit tight here atm | 11:12 |
| electrical | hehe that's fine :-) | 11:12 |
| *** fijal has joined #openstack-infra | 11:16 | |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add project arecibo to stackforge https://review.openstack.org/185562 | 11:17 |
| *** mohitsharma has joined #openstack-infra | 11:21 | |
| *** ddieterly has joined #openstack-infra | 11:21 | |
| *** yfried|afk is now known as yfried_ | 11:21 | |
| *** yfried_ is now known as yfried | 11:22 | |
| *** sputnik13 has quit IRC | 11:22 | |
| *** ddieterly has quit IRC | 11:26 | |
| *** woodster_ has joined #openstack-infra | 11:30 | |
| *** jistr is now known as jistr|class | 11:33 | |
| *** ldnunes has joined #openstack-infra | 11:33 | |
| *** mohitsharma has quit IRC | 11:36 | |
| *** matbu_afk is now known as matbu | 11:40 | |
| *** mohitsharma has joined #openstack-infra | 11:42 | |
| *** fhubik is now known as fhubik_afk | 11:44 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repositories for Fuel plugins https://review.openstack.org/185566 | 11:47 |
| *** freerunner has joined #openstack-infra | 11:48 | |
| *** otter768 has joined #openstack-infra | 11:49 | |
| *** panda|afk is now known as panda | 11:50 | |
| *** yamamoto has quit IRC | 11:50 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repositories for Fuel plugins https://review.openstack.org/185566 | 11:51 |
| *** otter768 has quit IRC | 11:54 | |
| *** pal has quit IRC | 11:55 | |
| *** baoli has joined #openstack-infra | 11:57 | |
| *** koolhead17 has joined #openstack-infra | 11:59 | |
| *** e0ne has joined #openstack-infra | 12:00 | |
| *** mohitsharma has quit IRC | 12:00 | |
| *** koolhead17 has quit IRC | 12:00 | |
| *** baoli has quit IRC | 12:02 | |
| *** k4n0 has quit IRC | 12:03 | |
| *** dguerri is now known as dguerri`away | 12:10 | |
| *** yamamoto has joined #openstack-infra | 12:12 | |
| *** arxcruz has quit IRC | 12:12 | |
| *** doug-fish has joined #openstack-infra | 12:15 | |
| *** ekarlso has quit IRC | 12:16 | |
| *** ekarlso has joined #openstack-infra | 12:16 | |
| *** fhubik_afk is now known as fhubik | 12:17 | |
| *** dprince has joined #openstack-infra | 12:18 | |
| *** alla__ has joined #openstack-infra | 12:18 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack/requirements: Bump ddt to min version 0.7.0 https://review.openstack.org/166162 | 12:18 |
| *** prad has joined #openstack-infra | 12:21 | |
| *** weshay has joined #openstack-infra | 12:21 | |
| *** ddieterly has joined #openstack-infra | 12:22 | |
| *** bswartz has quit IRC | 12:22 | |
| *** mohitsharma has joined #openstack-infra | 12:22 | |
| *** baoli has joined #openstack-infra | 12:24 | |
| *** mohitsharma has quit IRC | 12:25 | |
| *** mohitsharma has joined #openstack-infra | 12:26 | |
| *** mohitsharma has quit IRC | 12:26 | |
| *** ddieterly has quit IRC | 12:26 | |
| *** zz_dimtruck is now known as dimtruck | 12:29 | |
| *** dbite has joined #openstack-infra | 12:29 | |
| *** gordc has joined #openstack-infra | 12:31 | |
| russellb | lifeless: in case this doesn't show up in your queue, this patch could use your feedback: https://review.openstack.org/#/c/182746/ | 12:32 |
| *** achanda has quit IRC | 12:33 | |
| *** otter768 has joined #openstack-infra | 12:33 | |
| *** otter768 has quit IRC | 12:34 | |
| *** aysyanne has joined #openstack-infra | 12:35 | |
| *** baoli has quit IRC | 12:36 | |
| *** baoli_ has joined #openstack-infra | 12:38 | |
| *** mjturek1 has joined #openstack-infra | 12:41 | |
| *** xyang1 has joined #openstack-infra | 12:41 | |
| *** achanda has joined #openstack-infra | 12:41 | |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add project arecibo to stackforge https://review.openstack.org/185562 | 12:45 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 12:48 | |
| *** arxcruz has joined #openstack-infra | 12:48 | |
| *** dimsum__ has joined #openstack-infra | 12:49 | |
| *** btully has joined #openstack-infra | 12:49 | |
| *** bknudson has joined #openstack-infra | 12:49 | |
| *** deepakcs has quit IRC | 12:50 | |
| *** dguerri`away is now known as dguerri | 12:50 | |
| electrical | zaro: i have starred a few changes in Gerrit that may be easy to land in the next version. If you have some time today would like to run through them with you for review. | 12:51 |
| *** btully has quit IRC | 12:53 | |
| *** dimsum__ is now known as dims | 12:56 | |
| *** jistr|class is now known as jistr | 13:00 | |
| *** barnaby has quit IRC | 13:02 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 13:02 | |
| *** sks has quit IRC | 13:02 | |
| *** bswartz has joined #openstack-infra | 13:02 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:02 | |
| *** achanda has quit IRC | 13:05 | |
| mordred | zigo: http://docs.openstack.org/infra/system-config/irc.html#access | 13:05 |
| electrical | morning mordred | 13:08 |
| *** weshay is now known as weshay_brb | 13:08 | |
| *** bcourt has joined #openstack-infra | 13:09 | |
| *** e0ne is now known as e0ne_ | 13:10 | |
| mordred | morning electrical | 13:11 |
| *** changbl has quit IRC | 13:11 | |
| electrical | Had a good trip back or didn't you go to the summit ? | 13:11 |
| *** weshay_brb is now known as weshay | 13:12 | |
| *** mpaolino has joined #openstack-infra | 13:12 | |
| *** mpaolino has quit IRC | 13:12 | |
| *** alla__ has quit IRC | 13:12 | |
| *** julim has joined #openstack-infra | 13:12 | |
| *** stevemar has joined #openstack-infra | 13:14 | |
| mordred | good trip back ... and good to be home | 13:14 |
| *** peristeri has joined #openstack-infra | 13:15 | |
| *** zaneb has joined #openstack-infra | 13:16 | |
| electrical | hehe i can imagine. | 13:16 |
| *** sks has joined #openstack-infra | 13:16 | |
| *** alla__ has joined #openstack-infra | 13:16 | |
| electrical | I was away for 2 weeks for our user conference. was nice to be home after that. | 13:17 |
| fungi | fyi, i'm not around much today due to errands, but should be here when the meeting block starts at 1900z | 13:20 |
| *** e0ne_ has quit IRC | 13:21 | |
| electrical | laterz fungi | 13:21 |
| electrical | mordred: i found a weird thing in JJB and i did find the issue but not sure if its a bug or an undocumented feature. | 13:22 |
| *** ddieterly has joined #openstack-infra | 13:23 | |
| mordred | prolly both | 13:24 |
| mordred | :) | 13:24 |
| electrical | hehe :p | 13:24 |
| fungi | undocumented bugfeatures | 13:24 |
| mordred | 😈 | 13:24 |
| mordred | what did that show up as fungi? | 13:24 |
| mordred | (my phone has an emoji button ... curious what it does) | 13:25 |
| electrical | in the defaults part. i have a global namespace and puppet namespace.. If i specify something only in the puppet namespace for those specific jobs, it will barf and say it can't find it. if i put an empty version of that var in the global namespace it works like expected.. | 13:25 |
| *** wenlock has joined #openstack-infra | 13:25 | |
| fungi | mordred: a blank message in my client/terminal | 13:25 |
| *** wenlock1 has joined #openstack-infra | 13:26 | |
| electrical | mordred: i got a smiling_imp image | 13:26 |
| mordred | fungi: how useful! | 13:26 |
| *** e0ne has joined #openstack-infra | 13:26 | |
| fungi | likely a missing glyph in my fontset | 13:26 |
| mordred | electrical: intetesting | 13:26 |
| fungi | i'm waiting to see what the meetbot does with it | 13:27 |
| fungi | but it hasn't flushed yet | 13:27 |
| fungi | there we go. my browser knew what to do with it. odd | 13:27 |
| electrical | 1f608 is the id for that emoji ( according to irccloud ) | 13:28 |
| *** ddieterly has quit IRC | 13:28 | |
| *** dkranz has joined #openstack-infra | 13:28 | |
| fungi | i can't even paste it into my terminal to inspect it with python's unicodedata module | 13:29 |
| *** links has quit IRC | 13:29 | |
| *** akshai has joined #openstack-infra | 13:29 | |
| *** tiswanso has joined #openstack-infra | 13:29 | |
| mordred | electrical: I'm not sure if your thing is bug or feature, btw | 13:31 |
| electrical | mordred: Nor do i. | 13:32 |
| electrical | could be due to the way the defaults handling is done. | 13:32 |
| electrical | Oh, and defaults can only be specified in a job-template but nowhere else. not sure if that's expected or not. | 13:32 |
| *** hichihara has quit IRC | 13:33 | |
| fungi | there we go... unicodedata.name(u'\U0001f608') says 'SMILING FACE WITH HORNS' | 13:33 |
| electrical | hehe :p | 13:33 |
| fungi | but yeah, trying to print it... ignored by my terminal | 13:34 |
| *** koolhead17 has joined #openstack-infra | 13:37 | |
| *** mriedem has joined #openstack-infra | 13:41 | |
| *** dims has quit IRC | 13:45 | |
| *** btully has joined #openstack-infra | 13:45 | |
| *** woodster_ has quit IRC | 13:50 | |
| *** ayoung has joined #openstack-infra | 13:52 | |
| *** sdake has joined #openstack-infra | 13:56 | |
| electrical | Anyone have time to go through a few changes for JJB before the next release? :-) would be nice to have a few things merged in before a new release is done. | 13:56 |
| *** bnemec has joined #openstack-infra | 13:57 | |
| *** soren has quit IRC | 13:58 | |
| *** annegentle has joined #openstack-infra | 13:59 | |
| *** devvesa has joined #openstack-infra | 14:00 | |
| *** radez_g0n3 is now known as radez | 14:01 | |
| *** ayoung has quit IRC | 14:02 | |
| *** Kennan has joined #openstack-infra | 14:03 | |
| *** Kennan2 has quit IRC | 14:04 | |
| *** BharatK has quit IRC | 14:05 | |
| *** sks has quit IRC | 14:05 | |
| electrical | I guess everyone went back to sleep or breakfast :p lol | 14:06 |
| *** ddieterly has joined #openstack-infra | 14:06 | |
| *** mleroy1 has joined #openstack-infra | 14:07 | |
| *** mleroy has quit IRC | 14:08 | |
| *** spzala has joined #openstack-infra | 14:08 | |
| *** mattfarina has joined #openstack-infra | 14:10 | |
| *** maishsk_afk has quit IRC | 14:13 | |
| *** deepakcs has joined #openstack-infra | 14:14 | |
| *** spzala has quit IRC | 14:14 | |
| *** spzala has joined #openstack-infra | 14:15 | |
| *** gokrokve has joined #openstack-infra | 14:15 | |
| *** dimtruck is now known as zz_dimtruck | 14:15 | |
| *** freerunner has quit IRC | 14:16 | |
| *** zz_dimtruck is now known as dimtruck | 14:17 | |
| *** sks has joined #openstack-infra | 14:17 | |
| *** ayoung has joined #openstack-infra | 14:18 | |
| *** annegentle has quit IRC | 14:19 | |
| *** annegentle has joined #openstack-infra | 14:19 | |
| openstackgerrit | Alexis Lee proposed openstack-infra/elastic-recheck: gate-python-ironicclient-python34 #1454051 https://review.openstack.org/185620 | 14:20 |
| *** claudiub has quit IRC | 14:22 | |
| *** sks has quit IRC | 14:23 | |
| *** Bjoern__ has joined #openstack-infra | 14:24 | |
| *** timcline has joined #openstack-infra | 14:26 | |
| *** freerunner has joined #openstack-infra | 14:28 | |
| *** smccully has joined #openstack-infra | 14:33 | |
| *** otter768 has joined #openstack-infra | 14:34 | |
| *** dims has joined #openstack-infra | 14:35 | |
| openstackgerrit | Alexis Lee proposed openstack-infra/elastic-recheck: gate-python-ironicclient-python34 #1454051 https://review.openstack.org/185620 | 14:35 |
| pabelanger | morning! | 14:37 |
| *** claudiub has joined #openstack-infra | 14:38 | |
| *** annegentle has quit IRC | 14:38 | |
| *** otter768 has quit IRC | 14:40 | |
| *** emagana has joined #openstack-infra | 14:41 | |
| *** e0ne is now known as e0ne_ | 14:41 | |
| *** e0ne_ has quit IRC | 14:41 | |
| pabelanger | timrc, nibalizer: I wouldn't mind getting into etherpad and / or IRC for some high level dashboards you have going. See what's needed to import logic into grafyaml | 14:43 |
| *** dguerri is now known as dguerri`away | 14:44 | |
| openstackgerrit | Alexis Lee proposed openstack-infra/elastic-recheck: gate-heat-python27 #1458399 https://review.openstack.org/185632 | 14:44 |
| Kiall | Folks, the question of Py3 support in Designate came up today.. My usual answer of "we'll do it once our deps support it" applied ;) But.. It left me curious as to how many of our deps don't support py3 yet.. So, before I go assemble a list for Designate, what versions are we as a community aiming to support.. 2.7 and 3.4 or? | 14:44 |
| *** achanda has joined #openstack-infra | 14:45 | |
| *** cody-somerville has joined #openstack-infra | 14:45 | |
| *** cody-somerville has quit IRC | 14:45 | |
| *** cody-somerville has joined #openstack-infra | 14:45 | |
| *** mpavone has quit IRC | 14:47 | |
| electrical | Kiall: those are the 2 i would focus on yeah personally. truth be told. most distro's are still on 2.7 | 14:48 |
| mriedem | mordred: fungi: clarkb: jeblair: this is a fix for a bug blocking all stable/kilo changes: https://review.openstack.org/#/c/185073/ | 14:48 |
| mriedem | could use some review please | 14:48 |
| Kiall | Yea, 2.7 + 3.0 from memory can't actually be done without wayy more hassle than is necessary for 2.7+3.3ish.. Curious what Infra is seeing/expecting, as they probably see what every project is doing now by needing to provide the infra for it ;) | 14:49 |
| *** armax has joined #openstack-infra | 14:49 | |
| electrical | Kiall: i know ubuntu 14.04 ships Version: 3.4.0-2ubuntu1 | 14:49 |
| clarkb | mriedem: it would be nice if the commit message explained the problem a bit more | 14:50 |
| clarkb | Kiall: yes 2.7 and 3.4 for now | 14:50 |
| electrical | Kiall: for Jenkins Job Builder ( tool that infra uses ) they focus on 2.7 and 3.4 | 14:50 |
| electrical | like clarkb said :p | 14:50 |
| *** freerunner has quit IRC | 14:50 | |
| clarkb | mriedem: but Iam reading the bug | 14:50 |
| electrical | morning clarkb | 14:50 |
| *** annegentle has joined #openstack-infra | 14:50 | |
| mriedem | clarkb: basically sdague's change merged on 5/18 and logstash shows the spike in grenade failures on stable/kilo changes at the same time, in a keystone/apache change which is what this was | 14:51 |
| clarkb | mriedem: the bug doesn't really say its just a lot of "me too" | 14:51 |
| mriedem | we are'nt currently running grenade on stable branches for tempest and d-g changes, which are both branchless, which is bad | 14:51 |
| *** deepakcs has quit IRC | 14:51 | |
| clarkb | mriedem: right but why would that affect kilo? the old side (juno) localrc will get the flag, the new side won't because its default | 14:51 |
| *** freerunner has joined #openstack-infra | 14:51 | |
| mriedem | clarkb: http://goo.gl/W8SqEN | 14:52 |
| mriedem | the original change is specific to stable/kilo branch | 14:52 |
| dstufft | Kiall: https://caremad.io/2015/04/a-year-of-pypi-downloads/ fwiw | 14:52 |
| clarkb | no the original change is on a branchless project, so it handle icehouse, and juno special and allows defaults to work in kilo and master | 14:52 |
| mriedem | clarkb: my only guess was a question in the original change https://review.openstack.org/#/c/175531/4/devstack-vm-gate.sh | 14:52 |
| mriedem | mtreinish: do you know specifically why that d-g change doesn't work on stable/kilo ^ ? | 14:53 |
| Kiall | clarkb: thanks, exactly what I wanted to hear :) | 14:53 |
| *** bhunter71 has joined #openstack-infra | 14:53 | |
| clarkb | mriedem: oh I see, the comment about not being able to upgrade is likely at fault, since we disable it in juno but don't do so in kilo | 14:54 |
| clarkb | Kiall: also at this point I am not aware of any large openstack deps that pose a python3 problem | 14:54 |
| Kiall | For Designate, we have dnspython, which totally and utterly fails on py34 ;) | 14:54 |
| clarkb | mriedem: maybe you can record that on the bug? | 14:54 |
| Kiall | (Tests don't env get a chance to enumerate, as they have py2 only code as module init level stuff) | 14:55 |
| mriedem | clarkb: yeah i can update the bug | 14:56 |
| mtreinish | mriedem: that bug fix was only on kilo from what I saw, so when the kilo job tries to upgrade from juno to kilo it fails | 14:56 |
| clarkb | Kiall: sure but the eventlet is no longer the blocker so now we can actually go through and fix things without that being the big wall | 14:56 |
| mriedem | mtreinish: do you mean https://review.openstack.org/#/c/118740/ ? b/c that's in stable/juno | 14:56 |
| clarkb | mriedem: ya in the old code it always set wsgi off so we could do not wsgi to not wsgi upgrades, with that change it would be not wsig + juno to wsgi + kilo and that fails | 14:56 |
| *** matbu is now known as matbu_afk | 14:56 | |
| Kiall | clarkb: yea, if dnspython is our only gottcha, I could easily stick someone on that for a few days to get it sorted - assuming upstream is friendly and happy to accept etc etc | 14:56 |
| *** e0ne has joined #openstack-infra | 14:58 | |
| *** sputnik13 has joined #openstack-infra | 14:58 | |
| *** sputnik13 has quit IRC | 14:59 | |
| *** ayoung has quit IRC | 15:01 | |
| Kiall | clarkb: Oh, wow. I just spotted this - dnspython and dnspython3 are both on pypi, same version #, same author. Ignoring that being really annoying, do we have any way to pick the right version etc in our tooling? | 15:01 |
| *** arxcruz has quit IRC | 15:01 | |
| *** hemnafk is now known as hemna | 15:01 | |
| *** mtanino has joined #openstack-infra | 15:01 | |
| electrical | Kiall: that's annoying indeed. why can't they make 1 package work for both :-( | 15:01 |
| *** matbu_afk is now known as matbu | 15:02 | |
| Kiall | I'm going to fire the author an email to ask ;) | 15:02 |
| *** katyafervent_ is now known as katyafervent_awa | 15:03 | |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/manual/ http://ci.openstack.org/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/" | 15:04 | |
| jeblair | clarkb, fungi: i ordered parts to prototype a summit session streaming box; i should be able to start hacking on it next weekend | 15:05 |
| taron | erp, morning all | 15:05 |
| electrical | Morning taron | 15:06 |
| *** yfried is now known as yfried|afk | 15:06 | |
| *** yfried|afk is now known as yfried | 15:07 | |
| fungi | jeblair: awesome! | 15:07 |
| fungi | howdy taron | 15:07 |
| clarkb | Kiall: there are environment markers that we can use in pip reqs as of latest pip release aiui | 15:08 |
| *** ayoung has joined #openstack-infra | 15:08 | |
| Kiall | clarkb: oh, interesting.. I'll dig though the pip docs.. thanks | 15:09 |
| Daviey | jeblair: ~3 years ago stefanno tried the same using a bunch of rasp' pi's | 15:10 |
| Daviey | jeblair: might be worth finding out why he gave up? | 15:10 |
| jeblair | Daviey: i believe he didn't get around to actually getting started | 15:11 |
| *** annegentle has quit IRC | 15:11 | |
| clarkb | taron: good morning | 15:12 |
| taron | working on wrapping my head around go packaging, which probably doesn't require much input but I figured I should express my presence anyway | 15:12 |
| bswartz | what would a summit streaming box do exactly? | 15:12 |
| * bswartz is interested | 15:12 | |
| jeblair | bswartz: pipe fishbowl room audio to a conference server to facilitate remote participation | 15:13 |
| *** mattfarina has quit IRC | 15:13 | |
| bswartz | yeah -- for the Manila sessions we had a guy with a laptop, a google hangout, and a USB conference phone | 15:13 |
| bswartz | the audio quality was HIGHLY variable | 15:13 |
| bswartz | getting a decent microphone is a challenge | 15:14 |
| Daviey | jeblair: That is quite a blocker | 15:14 |
| fungi | Daviey: yeah, we _discussed_ something similar when we had so many issues with webex in san diego. the asterisk instance at pbx.openstack.org is part of what came out of those discussions but the dedicated hardware in the rooms has as of yet been unaddressed (so we've used laptops) | 15:14 |
| *** fhubik is now known as fhubik_afk | 15:14 | |
| *** alla__ has quit IRC | 15:15 | |
| *** ParsectiX has quit IRC | 15:15 | |
| jeblair | bswartz: yeah, i've ordered 3 mics for testing, since no one seems to have done real profiling of usb boundary mics | 15:15 |
| fungi | also, acoustics and audio engineering are super fun to geek out on ;) | 15:16 |
| *** banix has joined #openstack-infra | 15:16 | |
| Daviey | jeblair / fungi: As comparision, In Ubuntu Summits we found that two way audio was too slow to have a proper conversation and chose to use microphones streaming via icecast and IRC for feedback | 15:16 |
| clarkb | if other cores want to review https://review.openstack.org/#/c/168633/ today, my goal is to get that merged and have nodepool restarted today | 15:16 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/project-config: Add barbican-dogtag flag https://review.openstack.org/185183 | 15:16 |
| clarkb | then I can update our ubuntu-trusty image config to upload to rax too | 15:16 |
| *** dkehn__ is now known as dkehnx | 15:16 | |
| jeblair | Daviey: yeah, i recall -- and clarkb seemed to prefer to type into etherpad chat rather than speak. nibalizer spoke some, and it worked well enough as long as the conversation wasn't too fast-paced. | 15:17 |
| fungi | Daviey: for the most part this has been targeted at adding one or two necessary participants to an otherwise in-person conversation. it seemed to work well enough but i wouldn't want to try to virtualize the entire design summit that way | 15:17 |
| clarkb | ya, using the chat window was easier for me | 15:17 |
| clarkb | but having the audio to follow along was quite helpful | 15:17 |
| *** woodster_ has joined #openstack-infra | 15:17 | |
| *** bdemers has joined #openstack-infra | 15:18 | |
| electrical | clarkb: fungi found a ( what i think ) bug in JJB regarding defaults handing when specifying a defaults: foo in job-group and project. its not handing it in the same way when specifying defaults: foo in a job-template. | 15:19 |
| clarkb | jeblair: also, if you haven't started alread I was going to add a zuul-cloner step to the puppet beaker jobs | 15:19 |
| *** rossella_s has quit IRC | 15:19 | |
| jeblair | clarkb: i have not; i'm currently tracking down the eavesdrop/irc-meetings failure | 15:19 |
| pabelanger | fungi, Not this morning, but when time permits, I'd be interested in collaborating on the HTTP proxy (squid) stuff we talked about on Friday. | 15:20 |
| *** vahidh has joined #openstack-infra | 15:20 | |
| *** rossella_s has joined #openstack-infra | 15:20 | |
| clarkb | electrical: its entirely possible that defaults are not handled properly at all in job groups, I don't think we use JJB that way so its uncovered in production as a use case | 15:20 |
| clarkb | electrical: so likely need to fix, then add unittests to cover the behavior | 15:20 |
| electrical | clarkb: okay. i created some tests for it which are obviously failing atm. | 15:20 |
| mriedem | fungi: thanks | 15:20 |
| fungi | pabelanger: ooh! i've already completely forgotten talking about a squid proxy | 15:21 |
| *** panda has quit IRC | 15:21 | |
| pabelanger | :) | 15:21 |
| pabelanger | Well, not sure it was decided to use squid, but something to proxy HTTP requests to speed up yum / apt downloads | 15:21 |
| *** panda has joined #openstack-infra | 15:22 | |
| *** dannywilson has joined #openstack-infra | 15:22 | |
| clarkb | it should be noted that 168633 cannot be tested with devstack to use rax's upload system because rax has not upstreamed that stuff | 15:22 |
| fungi | pabelanger: ahh... a caching proxy in each provider/region for job workers? | 15:22 |
| *** achanda_ has joined #openstack-infra | 15:22 | |
| clarkb | so I have tested that it doesn't break the hpcloud case | 15:22 |
| clarkb | and intend on going from there | 15:22 |
| *** achanda has quit IRC | 15:22 | |
| *** changbl has joined #openstack-infra | 15:23 | |
| *** krtaylor has quit IRC | 15:23 | |
| clarkb | yum apt downloads should be fully cached on every slave image | 15:23 |
| jeblair | fungi: i'm reverse engineering our yaml2ical work -- i think we must have thought we wanted to put the output into its own dir and then symlink from the docroot into it. does that sound right? if so, i think we're missing the puppet change to create the symlinks | 15:23 |
| fungi | pabelanger: i'd be marginally worried about piecemeal cache invalidation causing index inconsistencies for package repositories. i know custom proxies like approx take care of those sorts of issues | 15:23 |
| clarkb | then you only deal with the delta between you and the mirror | 15:23 |
| pabelanger | fungi, Ya, that's what I'm thinking. To be honest, I don't have any metric on the time it takes to download packages from remote HTTP, however it could be beneficial once some of this packaging stuff starts landing | 15:23 |
| fungi | jeblair: yes, that's where i think we got to. could have sworn jhesketh wrote the puppet change to add that symlink but can't remember whether i reviewed it | 15:24 |
| pabelanger | fungi, right. So, maybe the play is to just wait until we have some need to get a cache proxy vs starting with it out of the box. | 15:24 |
| pabelanger | however, that goes back to your issue with upstream HTTP sources that blink in and out | 15:24 |
| clarkb | fungi: pabelanger we shouldn't *need* that as long as we are already caching packages on nodes | 15:24 |
| clarkb | I feel like I am issing something | 15:24 |
| fungi | pabelanger: i'm less worried about the time involved and more about intermittent uotages of remote repositories, so if proxies shield us from even some of that it's probably a great idea | 15:25 |
| jeblair | fungi: i think that was only the upload step | 15:25 |
| clarkb | ok maybe thats the missing bit, proxies would help with the "sorry not home" errors | 15:25 |
| jeblair | oh i thought we were going to run mirrors for that | 15:25 |
| pabelanger | clarkb, this was more inline with having package build environments within infra. Which could have packages we don't currently cache | 15:26 |
| clarkb | jeblair: yes me too | 15:26 |
| fungi | clarkb: well, the package indexes get retrieved multiple times on every worker, and that's usually where we see job problems from connectivity | 15:26 |
| clarkb | pabelanger: no, the cache should always have packages we need to cache in it | 15:26 |
| fungi | and yes, i too thought we were still planning to have mirrors in each region | 15:26 |
| pabelanger | either way, I was mostly wanting to hash thinks out vs trying and go off an implement it | 15:26 |
| *** dannywilson has quit IRC | 15:26 | |
| *** tim_o has joined #openstack-infra | 15:27 | |
| pabelanger | clarkb, we currently cache yum / apt package downloads? Or am I miss understanding | 15:27 |
| fungi | though honestly i don't know how mirrorable yum repos are (i remember red hat made it very hard to mirror their repos back in the bad old rhn_register days so you couldn't get security updates without paying for licenses) | 15:27 |
| fungi | pabelanger: we pre-cache them on our job workers, yes | 15:27 |
| pabelanger | Ah, I did not know that | 15:27 |
| pabelanger | off to check the code | 15:27 |
| *** patrickeast has joined #openstack-infra | 15:27 | |
| fungi | pabelanger: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/cache_devstack.py | 15:28 |
| fungi | pabelanger: and http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-devstack/install.d/50-download-pkgs | 15:28 |
| pabelanger | Oh, neat | 15:30 |
| fungi | and yeah, we don't currently cache everything you'd need to build a package building chroot, but we could easily add it. i'm working presently on generalizing our package caching mechanisms to cover more than just the devstack use case | 15:30 |
| clarkb | crinkle: do you see any problems with https://review.openstack.org/#/c/185104/2 ? | 15:30 |
| *** katyafervent_awa is now known as katyafervent | 15:30 | |
| clarkb | crinkle: specifically for the openstack puppet modules? | 15:30 |
| pabelanger | is that the bindep stuff mordred was talking about for ansible? | 15:30 |
| fungi | pabelanger: but beyond that, we also wanted to run a set of package mirrors (likely backed by afs) in all our providers/regions similar to our current pypi mirrors | 15:31 |
| fungi | pabelanger: yep | 15:31 |
| clarkb | fungi: right my point was more that if we need a package it belongs in the cache | 15:31 |
| clarkb | we don't intentionally not cache things we need | 15:31 |
| fungi | clarkb: that i agree with | 15:31 |
| *** dimtruck is now known as zz_dimtruck | 15:31 | |
| pabelanger | fungi, Right, I know there was some afs talk too. Okay, so let me read up on this code, sounds like there is already a plan in play for better caching. | 15:31 |
| *** dannywilson has joined #openstack-infra | 15:32 | |
| fungi | i hope to spend some time before the meeting today figuring out where i left off with the bindep integration patch series | 15:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Create dir on eavesdrop for ical publishing https://review.openstack.org/185644 | 15:32 |
| jeblair | fungi: ^ | 15:32 |
| *** nelsnelson has joined #openstack-infra | 15:32 | |
| *** mattfarina has joined #openstack-infra | 15:33 | |
| greghaynes | clarkb: did you figure out the glean + dib failues we were seeing? | 15:33 |
| *** markvoelker has joined #openstack-infra | 15:34 | |
| *** aswadr has quit IRC | 15:34 | |
| clarkb | greghaynes: yes mordred had fixed them but not released the fix | 15:34 |
| clarkb | greghaynes: so grumble grumble | 15:34 |
| *** mattfarina has quit IRC | 15:36 | |
| electrical | clarkb: i created some yaml/xml test files that are failing. will see if i can track down the issue for this. Want me to share the test files somewhere so others can take a peek as well? | 15:36 |
| clarkb | hopefully the change to log to the console log will make debugging this much better if you don't already know that glean is broken | 15:36 |
| clarkb | electrical: sure? I proably won't have time to look at them soon but others may | 15:36 |
| clarkb | (thinking about zaro in particular) | 15:37 |
| electrical | okay :-) | 15:37 |
| pabelanger | fungi, cool. When mordred was talking about it, the light bulbs in my brain started to turn on. | 15:37 |
| *** mattfarina has joined #openstack-infra | 15:37 | |
| pabelanger | fungi, There was also some possible discussion about removing the package installs from devstack too, well the package naming within devstack | 15:37 |
| *** fhubik_afk is now known as fhubik | 15:38 | |
| *** zz_dimtruck is now known as dimtruck | 15:38 | |
| pabelanger | which was news to me | 15:38 |
| *** _nadya_ has quit IRC | 15:38 | |
| *** dizquierdo has quit IRC | 15:39 | |
| pabelanger | jeblair, if you didn't see, I created the governance review for grafyaml: https://review.openstack.org/#/c/185446/ | 15:40 |
| *** jistr has quit IRC | 15:40 | |
| fungi | pabelanger: yeah, once we're using bindep to list the packages to cache and install for non-devstack jobs, i think devstack could be fairly easily converted to the same model for consistency and manageability | 15:41 |
| *** puranamr has joined #openstack-infra | 15:41 | |
| pabelanger | fungi, Ya, that is pretty hot actually. | 15:41 |
| *** mohitsharma has joined #openstack-infra | 15:41 | |
| *** imcsk8 has quit IRC | 15:41 | |
| *** gyee has joined #openstack-infra | 15:42 | |
| *** yamamoto has quit IRC | 15:42 | |
| openstackgerrit | Merged openstack-infra/nodepool: Use shade for image uploads https://review.openstack.org/168633 | 15:42 |
| jeblair | pabelanger: have you made a project-config change to create it? | 15:43 |
| *** e0ne is now known as e0ne_ | 15:43 | |
| pabelanger | jeblair, I did: https://review.openstack.org/#/c/182045/ | 15:43 |
| pabelanger | I linked the depend on in the other direction | 15:44 |
| jeblair | pabelanger: cool; you can actually reverse the dependencies for that since it's a simple git repo add to an existing openstack project (infra) | 15:44 |
| pabelanger | jeblair, Roger, doing now | 15:44 |
| *** leopoldj has quit IRC | 15:45 | |
| *** ujuc has joined #openstack-infra | 15:45 | |
| *** krtaylor has joined #openstack-infra | 15:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add grafyaml into openstack-infra https://review.openstack.org/182045 | 15:46 |
| *** e0ne_ is now known as e0ne | 15:46 | |
| *** mwhagedorn has joined #openstack-infra | 15:47 | |
| *** freerunner has quit IRC | 15:48 | |
| clarkb | Hunner: I am going to push up a fix for the linting happening on precise as soon as I can double check it | 15:48 |
| *** ddieterly has quit IRC | 15:49 | |
| *** derekh_ has joined #openstack-infra | 15:50 | |
| *** amitgandhinz has joined #openstack-infra | 15:51 | |
| *** tonytan4ever has joined #openstack-infra | 15:52 | |
| *** ujuc has quit IRC | 15:52 | |
| *** tonytan4ever has quit IRC | 15:53 | |
| *** eharney has joined #openstack-infra | 15:53 | |
| *** tonytan4ever has joined #openstack-infra | 15:53 | |
| *** derekh has quit IRC | 15:53 | |
| rbradfor | I'd like to add a feature request to optimize 7 mins (of 43 mins) from the devstack installation portion of check-functional-dsvm-magnum. Could somebody advise which is the right StoryBoard project to add this to? | 15:53 |
| *** hrubi has quit IRC | 15:53 | |
| greghaynes | clarkb: actually, looks like glean is released at the latest commit | 15:53 |
| clarkb | greghaynes: ya he fixed it on thursday iirc | 15:54 |
| jeblair | rbradfor: what git repo would the change go in, or if you are unsure, can you briefly describe the change? | 15:54 |
| *** afazekas_ has quit IRC | 15:54 | |
| greghaynes | clarkb: yea, so I think the nodepool stuff is good to go for images whenever we want? | 15:54 |
| greghaynes | er, nodepool+shade | 15:54 |
| clarkb | greghaynes: yup change just merged | 15:54 |
| greghaynes | w00t | 15:54 |
| clarkb | greghaynes: need to restarted nodepool, then update ubuntu-trusty to use config-drive in rax | 15:54 |
| *** hrubi has joined #openstack-infra | 15:55 | |
| pabelanger | Because I'm not sure, do project being added into stackforge need some governance approval now? | 15:55 |
| *** achanda has joined #openstack-infra | 15:56 | |
| Hunner | clarkb: Hi | 15:56 |
| electrical | Hunner: hiya bud | 15:56 |
| *** achanda_ has quit IRC | 15:56 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Revert "only force off KEYSTONE_USE_WSGI up until kilo" https://review.openstack.org/185073 | 15:56 |
| *** freerunner has joined #openstack-infra | 15:56 | |
| Hunner | clarkb: Okay. I was planning on getting back to the beaker/gemfile stuff today | 15:56 |
| clarkb | Hunner: hello, so looks like we run those jobs on both precise and trusty, so it passes on trusty and fails on precise. I am fixing it to only run on trusty for consistency. Then you changes are there to be actually correct | 15:56 |
| *** amitgandhinz has quit IRC | 15:56 | |
| rbradfor | jetblair: it takes almost 7 mins to retrieve a 735M image, specifically wget --progress=dot:giga -c https://fedorapeople.org/groups/magnum/fedora-21-atomic-3.qcow2 -O /opt/stack/new/devstack/files/fedora-21-atomic-3.qcow2 Ideally having a RS specific cache of this would help. It's not something that was discussed in Portland as a first pass of mirrored repos. | 15:56 |
| clarkb | greghaynes: ^ | 15:57 |
| clarkb | I think the tl;dr on that is there was a suggestion to fix it, and it was shot down because "special filesystem sauce" | 15:57 |
| *** erw has joined #openstack-infra | 15:58 | |
| *** claudiub has quit IRC | 15:58 | |
| greghaynes | heh | 15:58 |
| *** jlanoux has quit IRC | 15:59 | |
| *** ociuhandu has joined #openstack-infra | 15:59 | |
| greghaynes | Yea, I went and reverse engineered it a bit, its a pretty funky fs layout but wasnt anything that crazy | 15:59 |
| jd__ | fungi: could you git branch -d 1.0 in openstack/gnocchi? It was pushed by mistake a few weeks ago | 15:59 |
| *** juggler has quit IRC | 15:59 | |
| *** dtantsur is now known as dtantsur|afk | 16:00 | |
| *** juggler has joined #openstack-infra | 16:00 | |
| *** marun has joined #openstack-infra | 16:00 | |
| *** yfried has quit IRC | 16:00 | |
| *** ddieterly has joined #openstack-infra | 16:00 | |
| mordred | oh! zomg | 16:01 |
| mordred | 15:42:40 openstackgerrit | Merged openstack-infra/nodepool: Use shade for image uploads https://review.openstack.org/168633 | 16:01 |
| * mordred watches for carnage | 16:01 | |
| *** sarob has joined #openstack-infra | 16:01 | |
| clarkb | mordred: well I actually tested it so it should just work (granted did not test the rax specifics as that is not testable with devstack) | 16:01 |
| mordred | yah | 16:01 |
| clarkb | I will be restarting nodepool as soon as I get caffeine | 16:01 |
| mordred | I mean, it should work - I've tested uploading with shade to all of the clouds | 16:01 |
| mordred | still | 16:02 |
| mordred | greghaynes: did you see the dib patch for better glean debugging? | 16:02 |
| greghaynes | mordred: yep, +2'd | 16:02 |
| *** rwsu has joined #openstack-infra | 16:02 | |
| mordred | woot | 16:02 |
| jeblair | rbradfor: there is a facility in devstack to enumerate images that should be cached on our nodes; listing that image there should cause it to be locally cached when the run starts. it's probably a one-liner to fix. bugs would be in https://bugs.launchpad.net/devstack | 16:02 |
| *** Bjoern__ is now known as BjoernT | 16:02 | |
| electrical | zaro: https://gist.github.com/electrical/ff9d0b55544cbb58b82e <-- Created some tests regarding the defaults handing. except 001 they all fail. | 16:02 |
| greghaynes | mordred: actually, looks like it merged | 16:03 |
| mordred | clarkb: https://review.openstack.org/#/c/185130/ <-- that merged, so when that releases, we should have a better time debugging | 16:03 |
| greghaynes | clarkb: maybe we should cut a dib release too before doing this, will pull in the glean debugging | 16:03 |
| clarkb | jeblair: well sort of | 16:03 |
| *** e0ne is now known as e0ne_ | 16:04 | |
| *** fhubik has quit IRC | 16:04 | |
| clarkb | jeblair: there was a thread where they were asked to do the sane thing of not requiring 800MB images and the response was no its a totally custom filesystem so go away | 16:04 |
| *** soren_ has joined #openstack-infra | 16:04 | |
| rbradfor | jetblair: thanks, I'll take a look. I suspect you don't want to cache this size file in the daily image that is built correct? I was thinking more of a local wget not connecting to a slow fedora download site. | 16:04 |
| openstackgerrit | Julien Danjou proposed openstack/requirements: Add sqlalchemy-utils to requirements https://review.openstack.org/185652 | 16:05 |
| *** claudiub has joined #openstack-infra | 16:05 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run puppet-check-jobs on bare-trusty only. https://review.openstack.org/185653 | 16:05 |
| clarkb | Hunner: ^ | 16:05 |
| *** e0ne_ is now known as e0ne | 16:06 | |
| *** koolhead17 has quit IRC | 16:06 | |
| *** uberjay has quit IRC | 16:07 | |
| *** rguillebert has joined #openstack-infra | 16:07 | |
| openstackgerrit | Ryan Petrello proposed openstack-infra/project-config: Remove pecan+storyboard tests. https://review.openstack.org/185654 | 16:07 |
| *** teran has quit IRC | 16:08 | |
| mordred | rbradfor, jeblair: hrm. we normally do want to pre-cache all the images - otoh, a 735M fedora atomic image is a bit extreme and is used only for that one job. might be worth thinking more deeply about a more general solution to caching for thigns like that ... but for now I'd say caching it in the devstack image is probably fine, no? | 16:08 |
| *** krtaylor has quit IRC | 16:08 | |
| jeblair | clarkb, rbradfor: tbh, i'm not sure why anyone think's it's okay for magnum to require a file hosted on 'people.fedora.org'. | 16:08 |
| mordred | jeblair: taht too | 16:08 |
| clarkb | jeblair: we don't | 16:08 |
| jeblair | er, fedorapeople.org | 16:08 |
| fungi | jd__: i've now deleted the 1.0 branch which was formerly at commit 936a9c5 | 16:08 |
| ryanpetrello | mordred jeblair clarkb anybody mind a simple review to remove storyboard tests for pecan ^ | 16:08 |
| clarkb | there was a ml thread, greghaynes suggested they do a saner thing and was shot down | 16:08 |
| *** teran has joined #openstack-infra | 16:08 | |
| openstackgerrit | Merged openstack-infra/system-config: Create dir on eavesdrop for ical publishing https://review.openstack.org/185644 | 16:08 |
| *** amitgandhinz has joined #openstack-infra | 16:09 | |
| ryanpetrello | it's blocking me from passing pecan tests for an upcoming release | 16:09 |
| clarkb | ryanpetrello: looking | 16:09 |
| ryanpetrello | thx | 16:09 |
| jeblair | ryanpetrello: if not in your commit message, at least in a review comment, could you indicate why? :) | 16:09 |
| ryanpetrello | will do | 16:09 |
| clarkb | and also does this mean that the new release will break storyboard? | 16:09 |
| *** alexpilotti has joined #openstack-infra | 16:10 | |
| mordred | good question | 16:10 |
| *** uberjay has joined #openstack-infra | 16:10 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 16:10 |
| clarkb | supposedly the atomic filesytem setup is super fancy and thus custom made minimal images like those built by dib are not useable | 16:11 |
| clarkb | iirc greghaynes looked at it and its just an pair of lvm volumes for / and not / ? | 16:11 |
| *** ajmiller has joined #openstack-infra | 16:12 | |
| openstackgerrit | Ryan Petrello proposed openstack-infra/project-config: Remove pecan+storyboard tests. https://review.openstack.org/185654 | 16:12 |
| clarkb | in any case I don't think that the answer is as simple as just cache another giant image because this image shouldn't be that much more special than the one used by heat and is already cached | 16:12 |
| ryanpetrello | jeblair: done | 16:12 |
| ryanpetrello | sorry mordred, just undid your +2 | 16:12 |
| ryanpetrello | clarkb: it shouldn't | 16:13 |
| ryanpetrello | it's mostly just that I'm removing it from the tox.ini | 16:13 |
| jeblair | ryanpetrello: what kind of failure are you seeing? | 16:13 |
| *** amitgandhinz has quit IRC | 16:13 | |
| ryanpetrello | I'm updating pecan's tox.ini to with kilo tags | 16:13 |
| ryanpetrello | and figured I'd also remove storyboard | 16:13 |
| ryanpetrello | so there isn't a definition in pecan's tox.ini anymore, basically | 16:13 |
| *** zz_jgrimmn is now known as jgrimm | 16:13 | |
| jeblair | ryanpetrello: oh, i thought you said tests were failing | 16:14 |
| rbradfor | jetblair, clarkb, morded Hence my opening question, where could I pose the request to get more intelligent minds to think of a practical way to solve this. I have my own 2 cents but not experienced on the ideal infra ways of doing things. | 16:14 |
| *** amitgandhinz has joined #openstack-infra | 16:14 | |
| pleia2 | good morning | 16:14 |
| ryanpetrello | sorry, I was unclear | 16:14 |
| greghaynes | clarkb: yea, IIRC its two partitions, one ext4 and one lvm, on the lvm two partitions one xfs and one btrfs... or something like that | 16:14 |
| ryanpetrello | jeblair: the tests should still be working just fine, I just figured it didn't make sense to gate pecan on this project if it's going away | 16:14 |
| taron | pleia2: morning o/ | 16:14 |
| greghaynes | anyhow - dib has a phase dedicated to you doing whatever partition magic you want | 16:14 |
| greghaynes | so its not really a dib limitation | 16:14 |
| fungi | if we're dropping the pecan test for storyboard compat, i suppose that means we should make sure we update storyboard to pin to the last release of pecan so we don't break our storyboard server | 16:15 |
| ryanpetrello | jeblair: by "the tests are failing", I mean "I can't get a +1, because zuul's running this job, and the latest change I'm working on removes the tox.ini for storyboard definition in pecan" | 16:15 |
| ryanpetrello | are you all continuing to use it internally? | 16:15 |
| jeblair | ryanpetrello: we're still using storyboard, so it's still maintained, for now at least. so we would be concerned with and act upon any actual breakage. but if you want to drop it in anticipation of it no longer being supported at all, that's fine. | 16:15 |
| ryanpetrello | oh, okay, I'm fine to continue supporting it for the time being | 16:15 |
| ryanpetrello | I was under the impression from discussions I've heard and the mailing list that it's basically being abandoned | 16:15 |
| ryanpetrello | but if you all are still using it for some time, I'm happy to continue to run tests for it (assuming they keep passing :) ) | 16:16 |
| mordred | ryanpetrello: not yet - it's still infra's production tracker | 16:16 |
| ryanpetrello | gotcha | 16:16 |
| ryanpetrello | I'll do this later after you all officially discontinue it, then | 16:16 |
| mordred | jeblair: could I get an opinion from you on 179485? | 16:17 |
| mordred | jeblair: I'd like to either land it or abandon it | 16:17 |
| *** lnr has quit IRC | 16:17 | |
| *** lnr has joined #openstack-infra | 16:17 | |
| *** lnr has quit IRC | 16:17 | |
| mordred | jeblair: it's an opinion/judgement call thing | 16:17 |
| *** lnr has joined #openstack-infra | 16:17 | |
| *** lnr has quit IRC | 16:17 | |
| *** lnr has joined #openstack-infra | 16:18 | |
| *** lnr has quit IRC | 16:18 | |
| jeblair | mordred: +2 | 16:18 |
| *** lnr has joined #openstack-infra | 16:18 | |
| *** lnr has quit IRC | 16:18 | |
| mordred | jeblair: awesome. thanks | 16:18 |
| *** lnr has joined #openstack-infra | 16:18 | |
| *** lnr has quit IRC | 16:18 | |
| openstackgerrit | afazekas proposed openstack-infra/elastic-recheck: Remove the EOFError query https://review.openstack.org/184746 | 16:18 |
| *** unicell has quit IRC | 16:19 | |
| *** lnr has joined #openstack-infra | 16:19 | |
| *** lnr has quit IRC | 16:19 | |
| *** lnr has joined #openstack-infra | 16:19 | |
| *** annegentle has joined #openstack-infra | 16:20 | |
| *** soren_ has quit IRC | 16:21 | |
| *** ayoung has quit IRC | 16:22 | |
| *** ociuhandu has quit IRC | 16:24 | |
| *** ashleighfarnham has joined #openstack-infra | 16:24 | |
| *** lnr has quit IRC | 16:26 | |
| *** lnr has joined #openstack-infra | 16:27 | |
| *** lnr has quit IRC | 16:27 | |
| *** lnr has joined #openstack-infra | 16:27 | |
| *** lnr has quit IRC | 16:27 | |
| *** lnr has joined #openstack-infra | 16:28 | |
| *** lnr has quit IRC | 16:28 | |
| *** lnr has joined #openstack-infra | 16:28 | |
| *** lnr has quit IRC | 16:28 | |
| *** lnr has joined #openstack-infra | 16:29 | |
| *** lnr has quit IRC | 16:29 | |
| *** lnr has joined #openstack-infra | 16:29 | |
| *** lnr has quit IRC | 16:29 | |
| *** lnr has joined #openstack-infra | 16:29 | |
| *** lnr has quit IRC | 16:29 | |
| *** lnr has joined #openstack-infra | 16:30 | |
| *** lnr has quit IRC | 16:30 | |
| *** lnr has joined #openstack-infra | 16:30 | |
| *** lnr has quit IRC | 16:30 | |
| *** lnr has joined #openstack-infra | 16:30 | |
| *** lnr has quit IRC | 16:30 | |
| *** tiswanso has quit IRC | 16:30 | |
| *** vahidh has quit IRC | 16:30 | |
| *** redixin has quit IRC | 16:30 | |
| *** lnr has joined #openstack-infra | 16:30 | |
| *** lnr has quit IRC | 16:31 | |
| *** tiswanso has joined #openstack-infra | 16:31 | |
| *** lnr has joined #openstack-infra | 16:31 | |
| zxiiro | Is there any JJB reviewers available to review a patch? it only needs one more +2 https://review.openstack.org/#/c/182116/ | 16:31 |
| *** rbradfor has quit IRC | 16:34 | |
| *** aduarte has joined #openstack-infra | 16:34 | |
| *** sputnik13 has joined #openstack-infra | 16:35 | |
| *** ayoung has joined #openstack-infra | 16:35 | |
| *** miqui has joined #openstack-infra | 16:35 | |
| *** otter768 has joined #openstack-infra | 16:35 | |
| *** lnr has quit IRC | 16:35 | |
| *** lnr has joined #openstack-infra | 16:36 | |
| *** lnr has quit IRC | 16:36 | |
| *** asselin has joined #openstack-infra | 16:36 | |
| *** lnr has joined #openstack-infra | 16:36 | |
| *** lnr has quit IRC | 16:36 | |
| *** lnr has joined #openstack-infra | 16:36 | |
| *** lnr has quit IRC | 16:36 | |
| *** lnr has joined #openstack-infra | 16:37 | |
| *** lnr has quit IRC | 16:37 | |
| *** lnr has joined #openstack-infra | 16:37 | |
| *** ildikov has quit IRC | 16:37 | |
| *** claudiub has quit IRC | 16:38 | |
| *** _nadya_ has joined #openstack-infra | 16:38 | |
| clarkb | hrm rbradfor left... | 16:39 |
| clarkb | I have tea now and was going to suggest finding out what magnum needs from the image then hopefully making that overlap with what heat is using | 16:39 |
| clarkb | which I don't think is a feature request for infra but a write up requirements for magnum task | 16:39 |
| *** otter768 has quit IRC | 16:40 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 16:40 |
| *** davideagnello has joined #openstack-infra | 16:40 | |
| zaro | morning | 16:40 |
| electrical | Morning zaro | 16:42 |
| *** rbradfor has joined #openstack-infra | 16:42 | |
| *** rbradfor_ has joined #openstack-infra | 16:43 | |
| asselin | hi zaro | 16:43 |
| electrical | zaro: found a weird bug i can reproduce with some tests. concerns the handling of the defaults parts. | 16:44 |
| * anteaya also waves a flag at zaro's arrival | 16:45 | |
| *** e0ne has quit IRC | 16:45 | |
| *** unicell has joined #openstack-infra | 16:45 | |
| zaro | electrical: thanks. just push those up to gerrit with 'WIP: ..' in commit message and i'll take a look. | 16:46 |
| electrical | zaro: ah okay, will do. | 16:46 |
| *** _nadya_ has quit IRC | 16:46 | |
| *** lnr has quit IRC | 16:46 | |
| mordred | clarkb: jeblair has +2d 179485 - do you want to express an opinion on it? | 16:47 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 16:47 |
| *** lnr has joined #openstack-infra | 16:47 | |
| *** achanda has quit IRC | 16:48 | |
| openstackgerrit | Richard Pijnenburg proposed openstack-infra/jenkins-job-builder: [WIP] Adding tests surrounding handling of defaults values https://review.openstack.org/185661 | 16:48 |
| clarkb | mordred: not really, I am thinking that glean should document its set of behavior somewhere though | 16:48 |
| electrical | zaro: ^^ | 16:48 |
| clarkb | eitehr way is fine (append/truncate) but it should be clear to users which is used | 16:48 |
| zaro | electrical: just in case you haven't noticed, we have a policy to approve changes. a change requires two +2 reviews before it is approved. sorry these things can take a while :( | 16:49 |
| electrical | zaro: no worries. i know it takes a while and i'm patient. Just trying to make sure that changes that are out there are not forgotten ;-) | 16:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update team structure and add council https://review.openstack.org/182811 | 16:49 |
| mordred | clarkb: ++ | 16:50 |
| electrical | zaro: i gotta run to an Elastic meetup. but i'll be online on my phone if you have questions. | 16:51 |
| clarkb | I am waiting for the current set of nodepool dib builds to complete before restartin (just so we don't lose what is in progress) | 16:51 |
| clarkb | I also have a change just about ready to go for uploading ubuntu-trusty to rax | 16:52 |
| *** Swami has joined #openstack-infra | 16:52 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 16:52 |
| *** Swami_ has joined #openstack-infra | 16:52 | |
| *** gokrokve has quit IRC | 16:53 | |
| *** hdd has joined #openstack-infra | 16:55 | |
| *** lnr has quit IRC | 16:56 | |
| *** lnr has joined #openstack-infra | 16:57 | |
| *** dkehn has quit IRC | 16:58 | |
| zaro | electrical: for concat_defaults002.yaml looks like there are multiple default definitions? is that a regression? i'm not sure jjb ever supported that. | 16:59 |
| *** dkehnx has quit IRC | 16:59 | |
| *** dkehn has joined #openstack-infra | 16:59 | |
| *** dkehn_ has joined #openstack-infra | 17:00 | |
| *** markus_z has quit IRC | 17:00 | |
| jeblair | fungi: retriggering irc-meetings post job now that puppet is in place | 17:01 |
| clarkb | 2015-05-26 17:00:25,482 INFO nodepool.image.build.centos-6: grubby fatal error: unable to find a suitable template | 17:01 |
| *** mtanino has quit IRC | 17:02 | |
| clarkb | I don't think that causes the builds to break and may be intentional as the grub stuff is supposed to start very late in the dib process, but throwing it out there is anyone knows more | 17:02 |
| *** ihrachyshka has quit IRC | 17:03 | |
| *** tiswanso has quit IRC | 17:03 | |
| fungi | clarkb: i want to say we see the same in the devstack-centos7 builds? it looks like the template we're putting in place may be missing magic replacement macros grubby expects to find | 17:03 |
| mordred | I'm pretty sure I don't want to know anything about grubby or macros | 17:03 |
| electrical | zaro: will have to check. Currently in a taxi :-) | 17:03 |
| *** devvesa has quit IRC | 17:04 | |
| *** rkukura has joined #openstack-infra | 17:04 | |
| jeblair | fungi: oh! the upload job did not put things where i was expecting them to | 17:04 |
| *** tiswanso has joined #openstack-infra | 17:04 | |
| fungi | jeblair: hrm... i wonder if we neglect to flatten the upload since it's scp | 17:05 |
| jeblair | fungi: http://paste.openstack.org/show/238146/ | 17:05 |
| jeblair | fungi: i will move those files around manually then see about changing the job | 17:05 |
| electrical | zaro: in 002 I would expect that the myproject defaults are applied to all job templates. | 17:05 |
| fungi | jeblair: aha! we expected that to rename them, not create directories to stuff them in | 17:05 |
| clarkb | hrm I need to run the etherpad lite tests | 17:05 |
| *** lnr has quit IRC | 17:06 | |
| clarkb | I wonder how slow this will be on my fitlet | 17:06 |
| *** lnr has joined #openstack-infra | 17:06 | |
| *** harlowja has joined #openstack-infra | 17:07 | |
| jeblair | "irc-meetigs.ical" jeez | 17:07 |
| * mordred loves meetigs | 17:08 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 17:08 |
| mordred | btw ... sc68cal ^^ you rock for adding that. infra thanks you | 17:08 |
| *** akscram has joined #openstack-infra | 17:08 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Fix typo in irc-meetings https://review.openstack.org/185669 | 17:08 |
| sc68cal | mordred: thanks - anteaya has been a huge help | 17:09 |
| mordred | \o/ | 17:09 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Update SSH key for fungi https://review.openstack.org/185670 | 17:09 |
| *** annegentle has quit IRC | 17:09 | |
| clarkb | sc68cal: though see comment on the d-g change, it shouldn't be necessary | 17:09 |
| jeblair | unecessary changes are the best kind | 17:10 |
| *** yamahata has joined #openstack-infra | 17:10 | |
| mordred | jeblair: unless they are mandatory | 17:10 |
| clarkb | hrm github needs an easier way to fetch a pull request | 17:11 |
| mordred | clarkb: there is a cantrip | 17:11 |
| *** tonytan4ever has quit IRC | 17:11 | |
| *** markvan has quit IRC | 17:11 | |
| mordred | clarkb: git fetch origin pull/{ID}/head:{BRANCHNAME} | 17:11 |
| *** markvan has joined #openstack-infra | 17:12 | |
| *** markvan has quit IRC | 17:12 | |
| *** derekh_ has quit IRC | 17:12 | |
| * sc68cal starts grepping for DEVSTACK_LOCAL_CONFIG | 17:14 | |
| *** markvan has joined #openstack-infra | 17:14 | |
| sc68cal | clarkb: so something like DEVSTACK_LOCAL_CONFIG="Q_AGENT=linuxbridge" ? | 17:15 |
| clarkb | ya | 17:15 |
| *** ihrachyshka has joined #openstack-infra | 17:15 | |
| clarkb | in the job config then you can abandon the d-g change | 17:15 |
| sc68cal | clarkb: ok, works for me. Over in this chunk? https://review.openstack.org/#/c/184830/5/jenkins/jobs/devstack-gate.yaml | 17:15 |
| clarkb | sc68cal: ya you can replace line 536 with it | 17:16 |
| sc68cal | clarkb: excellent | 17:16 |
| *** mohitsharma has quit IRC | 17:18 | |
| *** dkranz has quit IRC | 17:19 | |
| mordred | mmm. Q_AGENT | 17:19 |
| *** jsavak has joined #openstack-infra | 17:19 | |
| sc68cal | quantum will live forever in our hearts | 17:20 |
| mordred | sc68cal: I thought that was just heartburn | 17:20 |
| waynr | ui | 17:20 |
| waynr | er | 17:20 |
| dims | haha | 17:21 |
| sc68cal | mordred: haha :) | 17:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Reconfigure irc-meetings output https://review.openstack.org/185677 | 17:21 |
| waynr | electrical: i see what you're talking about now, i never ran into that problem because I never use anything other than global defaults | 17:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/irc-meetings: In tox, write output to subdir https://review.openstack.org/185678 | 17:22 |
| *** mmedvede_ has quit IRC | 17:22 | |
| jeblair | fungi: https://review.openstack.org/185677 and https://review.openstack.org/185678 rejigger things around in a way that i think will work | 17:22 |
| waynr | i have a global defaults file that is about 600 lines long that is intended to primarily set default values for variables | 17:22 |
| waynr | although about 80% of that file is whitespace and comments that document the use case of each variable | 17:22 |
| waynr | if JJB supported a way to combine multiple sets of defaults i would probably use more than just global defaults | 17:23 |
| *** rguillebert has quit IRC | 17:25 | |
| *** davideagnello has quit IRC | 17:26 | |
| *** mohitsharma has joined #openstack-infra | 17:28 | |
| *** davideagnello has joined #openstack-infra | 17:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Jenkins slave for package builds https://review.openstack.org/185680 | 17:29 |
| pabelanger | fungi, v1 for packaging build environments. Decided to just use puppet to create initial mock chroots | 17:30 |
| pabelanger | but, open to suggestion | 17:31 |
| *** yamamoto has joined #openstack-infra | 17:31 | |
| *** achanda has joined #openstack-infra | 17:33 | |
| *** annegentle has joined #openstack-infra | 17:33 | |
| clarkb | pabelanger: I thought zigo's debian package existed for that? | 17:33 |
| clarkb | I may have misread the tehrapd | 17:33 |
| *** mohitsharma has quit IRC | 17:34 | |
| *** HeOS has quit IRC | 17:34 | |
| pabelanger | clarkb, Yes, talking to zigo he has specific scripts in pkg-openstacktools (nameing?) that bootstraps an local development environment for openstack packaging. I need to checkout how they work, but we could pull them into the bootstraping stage for nodepool to cache some things. | 17:35 |
| electrical | waynr: hehe. Maybe I have to redesign it but would be nice to have it working. | 17:35 |
| *** yamamoto has quit IRC | 17:35 | |
| zaro | electrical: ahh, yes that is a point of confusion for users of JJB. I believe this change is meant to address some of that confusion: https://review.openstack.org/#/c/179459/ | 17:35 |
| pabelanger | The other side, is to also allow developers to run their tool chains once the jenkins slave is launched by nodepool, which I see people doing that too | 17:36 |
| nibalizer | pabelanger: sure thing | 17:36 |
| nibalizer | let me know how I can help | 17:36 |
| mordred | look it's a nibalizer | 17:36 |
| electrical | zaro: yeah indeed. Besides that there is still something in the defaults handling that feels weird. If I specify in defaults namespace puppet but not in global it fails. | 17:37 |
| nibalizer | ohai mordred | 17:37 |
| pabelanger | clarkb, basically, if we infra, could do some initial creating of the chroots (via puppet or nodepool), it should help packagers speed up their builds. Thats my thought process | 17:37 |
| clarkb | pabelanger: isn't that cost very low already? | 17:38 |
| *** ihrachyshka has quit IRC | 17:38 | |
| clarkb | we don't do anything like that for dib and they haven't said they need it | 17:38 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Update SSH key for fungi https://review.openstack.org/185670 | 17:39 |
| zaro | electrical: yes, i agree that concat_defaults004.yaml | 17:39 |
| zaro | is a bug | 17:39 |
| pabelanger | clarkb, unsure to be honest. I think it is part of the line that needs to be figured out. For me, I don't see much over head to bootstrap chroots via the infra method (puppet or nodepool). However, people like zigo already have the scripts they have created to do the bootstrapping. So, I could go either way. If we provided chroots for people to use great, but if people want to do their own tooling for chroots, great too. | 17:40 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: [WIP] Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 17:40 |
| Clint | clarkb: would it be better to use per-target images than chroots? | 17:40 |
| pabelanger | honestly, it was just easy to get a mock chroot to build in puppet, that is why I added. It it required 10 hours of work, I likely wouldn't do the effort | 17:41 |
| clarkb | pabelanger: I don't want to get in the business of telling distro packagers how to run their tools | 17:41 |
| clarkb | pabelanger: if we can aid in the performance of those tools then we should think about these things otehrwise I think ts on the packaging to bootstrap their own envs | 17:41 |
| fungi | Clint: perhaps, though we may still end up with a handful of things preinstalled which wouldn't be in, say, a pbuilder chroot | 17:41 |
| *** matbu is now known as matbu_afk | 17:41 | |
| clarkb | Clint: we are trying very hard to get away from per target images in general | 17:41 |
| Clint | fungi: right | 17:42 |
| clarkb | they are very costly and I know more about all the distros now than I ever wanted to know | 17:42 |
| *** HenryG has quit IRC | 17:42 | |
| fungi | so might still end up with dirty builds (highly unlikely though as we're working to actively minimize the current volume of preinstalled things and just pre-cache it all instead) | 17:42 |
| *** alexpilotti has quit IRC | 17:42 | |
| fungi | but yes, i'd like to avoid additional nodepool images solely because someone wants to build packages for that particular platform (distro, release, processor architecture, et cetera) | 17:43 |
| *** mmedvede has joined #openstack-infra | 17:43 | |
| pabelanger | I didn't see specific nodepool images for each distro. I just seen a single packaging image, which people then installed the require packages for. EG: mock, sbuild, etc | 17:44 |
| *** mtanino has joined #openstack-infra | 17:44 | |
| pabelanger | some people I talked to even wanted to use containers for their builds | 17:44 |
| pabelanger | again, like clarkb said, I wouldn't want infra to decided what that tool chain looked like | 17:45 |
| pabelanger | just the place for builds to happen, a la the infra way | 17:45 |
| *** abregman has quit IRC | 17:45 | |
| pabelanger | disposable slaves | 17:45 |
| mordred | pabelanger: so ... | 17:45 |
| mordred | pabelanger: I think that on the one hand providing a place for people to do whatever is awesome | 17:45 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-elasticsearch: Add template support for the path.data https://review.openstack.org/185177 | 17:46 |
| mordred | pabelanger: otoh - infra DOES need a packaging toolchain that can produce packages that infra can publish and consume - and that does want to be opinionated and to work the same way across everything | 17:46 |
| *** HenryG has joined #openstack-infra | 17:46 | |
| *** igorbelikov has joined #openstack-infra | 17:46 | |
| mordred | pabelanger: so - it would be super awesome if the results of the distro folks moving things into infra could also result ina set of reusable things that infra could leverage | 17:47 |
| Kiall | mordred: Just.. Please, not another package manager! Pick one and use it :P | 17:47 |
| mordred | Kiall: we have both centos and ubuntu nodes right now - we need to acount for both | 17:47 |
| Kiall | ala http://xkcd.com/927/ ;) | 17:47 |
| pabelanger | mordred, Right. So, that is my primary goal too, rolling packages that infra can consume. | 17:47 |
| mordred | awesome | 17:47 |
| pabelanger | distro packaging is 2nd, nice to have | 17:47 |
| clarkb | also its good to not encode too much into the test env so that developers can more easily reproduce locally | 17:48 |
| mordred | ++ | 17:48 |
| clarkb | thats sort of a balancing act though and there are no hard answers to how to deal with it | 17:48 |
| pabelanger | If we, infra, could get the toolchain in place for our packages. I _could_ see an easy jump for disto people to also consume that environment. | 17:48 |
| pabelanger | agreed | 17:49 |
| *** SumitNaiksatam has joined #openstack-infra | 17:49 | |
| *** Guest6609 has quit IRC | 17:49 | |
| dstufft | software is terrible, trying to distribute software is extra terrible. Adjust your desires until you stop wanting to do that, then you'll be happier | 17:49 |
| mordred | dstufft: what about eating food? can I do that instead? | 17:49 |
| dstufft | mordred: yes | 17:50 |
| dstufft | that's a better use of time | 17:50 |
| mordred | sold | 17:50 |
| *** cloudm2 has joined #openstack-infra | 17:50 | |
| Clint | now i want food | 17:50 |
| *** ihrachyshka has joined #openstack-infra | 17:50 | |
| dstufft | I'm not responsible when we all have heart conditions though | 17:50 |
| mordred | Clint: I have just realized that I do not have any of it | 17:50 |
| Clint | that can be solved | 17:50 |
| anteaya | salad is food | 17:50 |
| anteaya | and good for your heart | 17:50 |
| dstufft | anteaya: I'm not convinced salad is human food tbh | 17:51 |
| anteaya | fair enough | 17:51 |
| dstufft | my wife assures me it is | 17:51 |
| Clint | i've made salad dressing with bacon fat on more than one occasion | 17:51 |
| dstufft | I remain unconvinced | 17:51 |
| anteaya | I got a carrot pencil sharpener | 17:51 |
| anteaya | I'm keen to try it out | 17:51 |
| anteaya | frilly salads | 17:52 |
| dstufft | I'm assuming the goal isn't to have sharp carrots, but to have carrot shavings? | 17:52 |
| anteaya | either | 17:52 |
| anteaya | I was going for the shavings part | 17:52 |
| anteaya | but sharp carrots will also result if if stop at a certain point | 17:52 |
| pabelanger | nibalizer, if I understood timrc, you might have some real world example dashboards for grafana? | 17:52 |
| pabelanger | using statsd from zuul and nodepool | 17:53 |
| timrc | pabelanger, I've only produced some dashboards tracking nodepool task execution times. | 17:53 |
| pabelanger | timrc, able to share the json for it? | 17:53 |
| timrc | pabelanger, http://grafana.busywait.com/ | 17:53 |
| pabelanger | coolio | 17:54 |
| timrc | pabelanger, You should be able to extract it from there. | 17:54 |
| *** claudiub has joined #openstack-infra | 17:54 | |
| *** doug-fish has quit IRC | 17:54 | |
| *** ashleighfarnham has quit IRC | 17:54 | |
| *** arxcruz has joined #openstack-infra | 17:55 | |
| *** doug-fish has joined #openstack-infra | 17:55 | |
| pabelanger | timrc, great! Exporting now, to see if grafyaml has coverage for them | 17:56 |
| timrc | pabelanger, Cool. The graph that depicts the average spark line between the min and max fill will be a good a test. | 17:56 |
| *** baoli_ has quit IRC | 17:57 | |
| timrc | pabelanger, e.g. http://grafana.busywait.com/dashboard/db/nodepool-performance-rackspace?panelId=2&fullscreen | 17:57 |
| *** BjoernT has left #openstack-infra | 17:57 | |
| *** baoli has joined #openstack-infra | 17:58 | |
| *** annegentle has quit IRC | 17:58 | |
| *** annegentle has joined #openstack-infra | 17:59 | |
| *** doug-fish has quit IRC | 17:59 | |
| pabelanger | timrc, Yup, will start with that one | 18:00 |
| *** HenryG has quit IRC | 18:01 | |
| *** HenryG has joined #openstack-infra | 18:01 | |
| *** tiswanso has quit IRC | 18:02 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Introduce an experimental job for Linux Bridge https://review.openstack.org/184830 | 18:02 |
| *** Kennan has quit IRC | 18:02 | |
| *** tiswanso has joined #openstack-infra | 18:03 | |
| *** cody-somerville has quit IRC | 18:03 | |
| *** Kennan has joined #openstack-infra | 18:03 | |
| *** bdemers has quit IRC | 18:04 | |
| *** cody-somerville has joined #openstack-infra | 18:04 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:05 | |
| electrical | zaro: glad you agree. Thought I was going nuts :) | 18:05 |
| *** harlowja_ has joined #openstack-infra | 18:06 | |
| *** harlowja has quit IRC | 18:06 | |
| * SpamapS decides its easier to just finish his obsession with pysaml2 than try to set it down and ignore the itch | 18:07 | |
| greghaynes | SpamapS: mordred so next step in hp1 is getting our inventory playbooks hitting all the nodes were supposed to have. A few of them are in error deleting or similar state, so I think we might need to do some nova db surgery unless youall have better ideas | 18:07 |
| SpamapS | so close to py3k | 18:07 |
| greghaynes | heh | 18:08 |
| *** mtanino is now known as mtanino_away | 18:08 | |
| *** doug-fish has joined #openstack-infra | 18:08 | |
| *** dguerri`away is now known as dguerri | 18:08 | |
| SpamapS | greghaynes: reset-state is sanctioned db surgery. ;) | 18:08 |
| *** davideagnello has quit IRC | 18:08 | |
| *** davideag_ has joined #openstack-infra | 18:08 | |
| greghaynes | Yea, I tried that with a few and no luck | 18:08 |
| SpamapS | greghaynes: reset-state, restart nova-compute | 18:09 |
| mordred | greghaynes: perhaps ironic commands? | 18:09 |
| greghaynes | hrm | 18:09 |
| clarkb | mriedem: fwiw you can't just cap tox on stable branches | 18:09 |
| greghaynes | mordred: Ironic doesnt want to do anything about the node until the instance uuid from nova is unassociated with the node :( | 18:09 |
| mordred | like, what does it matter what nova thinks of them right now? if the machine is powered off, it needs booted, no? | 18:09 |
| mordred | greghaynes: ah | 18:09 |
| mriedem | clarkb: yeah i see that now | 18:09 |
| greghaynes | I was considering just nulling that field though | 18:09 |
| mordred | works for me | 18:10 |
| SpamapS | mordred: I agree 100%. Worth hitting it with the hammer a few different ways before lighting it on fire though. | 18:10 |
| mriedem | clarkb: i have a fix for the tox thing anyway | 18:10 |
| mordred | SpamapS: ++ | 18:10 |
| greghaynes | yes, hammers saught | 18:10 |
| clarkb | mriedem: that would be preferable, otherwise we have to cap it everywhere then explain to everyone what version of tox they need to run the tests | 18:10 |
| greghaynes | s/saught/sought | 18:10 |
| mriedem | clarkb: the horizon jshint tests are a bit wonky since they use nodeenv | 18:11 |
| mriedem | some weird virtualenv stuff going on there, but i know that passenv = * fixes it, but i'd like to scope that down to what's actually needed | 18:11 |
| *** tonytan4ever has joined #openstack-infra | 18:11 | |
| *** dkranz has joined #openstack-infra | 18:12 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add pleia2 to statusbot_auth_nicks https://review.openstack.org/174962 | 18:14 |
| fungi | clarkb: starting to stare closer at centos-6 dib in hpcloud... we have images created successfully daily but none uploaded for a couple weeks. i' | 18:14 |
| fungi | m going to try manually uploading | 18:14 |
| *** maishsk_afk has joined #openstack-infra | 18:14 | |
| clarkb | fungi: ok I haven't restarted the server yet as there are a couple dib build sstill going | 18:14 |
| fungi | devstacl-precise seems to be in a similar situation there | 18:15 |
| fungi | er, devstacl-precise | 18:15 |
| fungi | gah. can't type | 18:15 |
| fungi | er, devstack-trusty too | 18:15 |
| fungi | also ubuntu-trusty | 18:15 |
| greghaynes | :/ | 18:15 |
| greghaynes | all the images? | 18:15 |
| * fungi is starting to think that dib-image-upload just hasn't been happening | 18:15 | |
| jroll | "devstacl is an open-source bash program to provision access lists for your development cloud" | 18:15 |
| * greghaynes hopes not related to shade | 18:15 | |
| clarkb | oh hrm | 18:16 |
| clarkb | greghaynes: well its not running the latest code yet | 18:16 |
| fungi | jroll: try again. it's our new common lisp variant! | 18:16 |
| clarkb | greghaynes: but entirely possible an earlier change did it, but its tested against devstack so that would surprise me | 18:16 |
| greghaynes | yea, but we did the os-client-config change a bit over a week ago | 18:16 |
| jroll | fungi: hehehe | 18:16 |
| mordred | greghaynes: which one? | 18:16 |
| greghaynes | mordred: switch to using shade for clients - which is switch to using os-client-config and friends for config | 18:17 |
| mordred | greghaynes: oh - the one that gets the glance client | 18:17 |
| mordred | yah | 18:17 |
| mordred | greghaynes: good point | 18:17 |
| clarkb | it does work with devstack at least, but possible not with hpcloud | 18:17 |
| clarkb | a manual upload should tell us and fungi is running one of those | 18:17 |
| *** freerunner has quit IRC | 18:17 | |
| mordred | os_client_config defaults image_api_version to v1 - so that should still work as before with nodepool | 18:18 |
| *** ihrachyshka has quit IRC | 18:18 | |
| mordred | and we haven't moved to using hp as a named cloud - I believe our nodepool config is still the "pass in all values explcitly" | 18:18 |
| greghaynes | It should be, yes | 18:19 |
| *** maishsk_afk has quit IRC | 18:19 | |
| fungi | yeah, i've got `sudo -H -u nodepool nodepool image-upload hpcloud-b1 devstack-trusty` going right now | 18:19 |
| clarkb | I am going to dig around in the logs | 18:19 |
| mordred | there are errors in the logs | 18:20 |
| mordred | HTTPUnauthorized: Authentication required (HTTP 401) | 18:20 |
| mordred | that tells me something is messed up in the config :( | 18:20 |
| fungi | http://paste.openstack.org/show/238259 | 18:21 |
| clarkb | mordred: where in the log? /var/log/nodepool/debug.log doesn't seem to have anything like that according to grep | 18:21 |
| mordred | clarkb: debug.log.2015-05-20_16 | 18:21 |
| mordred | fungi: oh! that's a whole different thing | 18:22 |
| mordred | SpamapS: ping ^^ | 18:22 |
| fungi | shadebreaky | 18:22 |
| *** sputnik13 has quit IRC | 18:22 | |
| mordred | SpamapS: please look at fungi's paste | 18:22 |
| *** maishsk_afk has joined #openstack-infra | 18:22 | |
| fungi | note that's from a manual nodepool image-upload run | 18:23 |
| mordred | ok. it seems to have gotten "None" for image_name | 18:23 |
| SpamapS | mordred: from a clientlib? lovely. | 18:24 |
| mordred | SpamapS: no - from the nodepool command line client | 18:25 |
| *** gokrokve has joined #openstack-infra | 18:25 | |
| *** sputnik13 has joined #openstack-infra | 18:25 | |
| mordred | fungi: mind if I poke? | 18:25 |
| fungi | mordred: feel free. i'm not doing anything since the exception | 18:26 |
| SpamapS | mordred: ahhh | 18:26 |
| clarkb | also worth noting that grepping for the logs around where nodepool does uploads returns nothing | 18:26 |
| waynr | zaro: https://review.openstack.org/#/c/179459/ isn't the same thing as what electrical is talking about | 18:27 |
| anteaya | sc68cal: and we should get mestery to review 184830 too | 18:27 |
| fungi | clarkb: yeah, from the logs i'm getting the feeling this might be something like "scheduled build completes but upload is never triggered" | 18:27 |
| mestery | andreaf: Will look | 18:27 |
| clarkb | fungi: ya | 18:27 |
| anteaya | mestery: thanks | 18:28 |
| fungi | clarkb: i have a feeling the traceback i'm getting is specific to the cli subcommand case | 18:28 |
| mordred | yah - I'm investigating that theory right now | 18:28 |
| mordred | if it pans out, I'll turn to the scheduled case | 18:28 |
| fungi | clarkb: or is it possible this is like that time where build was failing but switching to ready rather than delete? | 18:29 |
| clarkb | fungi: according to the build logs they are building properly | 18:29 |
| fungi | yeah, i'm not seeing any obvious aborts | 18:29 |
| *** salv-orlando has quit IRC | 18:29 | |
| *** sputnik13 has quit IRC | 18:31 | |
| *** davideag_ has quit IRC | 18:31 | |
| russellb | what does groups: in project-config/gerrit/projects.yaml do? | 18:31 |
| russellb | #lazyweb | 18:31 |
| clarkb | hrm I think I may see the issue | 18:31 |
| SpamapS | https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n921 | 18:32 |
| clarkb | russellb: it is a way of saying all these projects use the same bug tracking group | 18:32 |
| *** achanda has quit IRC | 18:32 | |
| russellb | clarkb: perfect, thanks! | 18:32 |
| mordred | clarkb: yah? is your issue you see that shade on the system is old? | 18:32 |
| SpamapS | seems like that shouldn't ever return "None" | 18:32 |
| armax | thanks clarkb | 18:32 |
| clarkb | russellb: with LP that means the same project with storyboard it means these projects have a super group that collects all of them together | 18:32 |
| clarkb | mordred: no thats no the problem I am seeing | 18:32 |
| mordred | clarkb: k | 18:32 |
| *** dprince has quit IRC | 18:32 | |
| mordred | clarkb: I have not yet investigated that problem | 18:33 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n1865 | 18:33 |
| clarkb | that check there doesn't seem to upload if the image is old | 18:33 |
| clarkb | fungi: ^ | 18:33 |
| *** davideagnello has joined #openstack-infra | 18:33 | |
| *** erhudy has joined #openstack-infra | 18:34 | |
| clarkb | except the code has been that way since february? | 18:34 |
| clarkb | but I think we don't run the upload code because of that | 18:35 |
| *** mohitsharma has joined #openstack-infra | 18:35 | |
| fungi | pip list says shade 0.6.1 | 18:35 |
| fungi | which is the latest release | 18:35 |
| fungi | from ~1.5 weeks ago | 18:35 |
| SpamapS | mordred: pretty sure that paste from fungi was not the image name from create_image coming back None | 18:36 |
| *** otter768 has joined #openstack-infra | 18:36 | |
| mordred | SpamapS: ok - so here's where I'm at | 18:36 |
| SpamapS | mordred: that is the cloud name | 18:36 |
| *** sgolovatiuk has joined #openstack-infra | 18:37 | |
| mordred | create_image gets a valid name into the name field | 18:37 |
| *** gyee has quit IRC | 18:37 | |
| clarkb | ya I take that back, its a different code path for the cron uploads | 18:37 |
| mordred | it is validly passing it to self.get_image(name) | 18:37 |
| clarkb | the check for missing is purely to get actually missing (and not just old) images uploaded | 18:37 |
| SpamapS | https://git.openstack.org/cgit/openstack-infra/shade/tree/shade/__init__.py#n288 | 18:37 |
| SpamapS | mordred: _that_ is what is None | 18:37 |
| *** krtaylor has joined #openstack-infra | 18:37 | |
| mordred | SpamapS: yes. that is None | 18:37 |
| clarkb | the checks at https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n1932 would have to be wrong | 18:38 |
| asselin | hello, I'm seeting this issue now that I apt-get update on my ci box. seems to be related to vhd-util. any ideas? I can open the link in my browser...?? http://paste.openstack.org/show/238273/ | 18:38 |
| mordred | SpamapS: OH - because we pass in direct values, the cloud object has no name | 18:38 |
| SpamapS | https://git.openstack.org/cgit/openstack-infra/shade/tree/shade/__init__.py#n236 is the only place that is set AFAICT | 18:38 |
| SpamapS | mordred: correct | 18:38 |
| *** rkukura has quit IRC | 18:38 | |
| SpamapS | so, we can be defensive and cast that to str | 18:38 |
| SpamapS | AND nodepool should name it. | 18:38 |
| mordred | yah | 18:38 |
| mordred | we should do both things | 18:38 |
| SpamapS | right | 18:39 |
| SpamapS | will handle the shade defense (and a test) | 18:39 |
| mordred | or - if it's none, we can exclude it from the key generation | 18:39 |
| mordred | ++ | 18:39 |
| mordred | either way | 18:39 |
| asselin | hmmm......I see i'm using precise and there's no foloder for that.... | 18:39 |
| mordred | I'll get a nodepool patch | 18:39 |
| clarkb | fungi: so we should be able to wait for the disk images to finish building | 18:39 |
| anteaya | asselin: it looks like a connection problem trying to connect to ppa.launchpad.net | 18:39 |
| *** sputnik13 has joined #openstack-infra | 18:39 | |
| clarkb | fungi: then we should hit the code I just linked, which is where the error should happen | 18:39 |
| *** mohitsharma has quit IRC | 18:39 | |
| zaro | waynr: i haven't reviewed that one carefully but from the commit message it seems like it's the same issue? could you please elaborate on change https://review.openstack.org/#/c/185661/ | 18:39 |
| asselin | is 'vhd-util' supported on precise? easy to do, or disable? | 18:40 |
| anteaya | asselin: I don't think it got that far, it says 404 not found | 18:40 |
| anteaya | so either the path has an error or the package has moved | 18:40 |
| *** angela-s has joined #openstack-infra | 18:40 | |
| clarkb | mordred: wait, what does nodepool need to do? | 18:40 |
| asselin | anteaya, b/c there's nothign there: http://ppa.launchpad.net/openstack-ci-core/vhd-util/ubuntu/dists/ | 18:40 |
| clarkb | mordred: the consumer should not be aware of caching, that should be transparent | 18:41 |
| mordred | clarkb: there is a VERY strange edge condition - the consumer may not need to do anything | 18:41 |
| anteaya | asselin: that would be the problem | 18:41 |
| mordred | clarkb: but whats happening right now is that nodepool is not passing a required parameter | 18:41 |
| mordred | clarkb: how it's bypassing that it's a required param is what I'm looking at right now | 18:41 |
| *** otter768 has quit IRC | 18:41 | |
| clarkb | ok | 18:41 |
| asselin | mordred, I see you're the maintainer? | 18:41 |
| mordred | aha. I see it. | 18:41 |
| mordred | asselin: I am the maintainer of that package | 18:42 |
| *** ildikov has joined #openstack-infra | 18:42 | |
| mordred | asselin: one sec - let me finish this | 18:42 |
| asselin | ok | 18:42 |
| fungi | asselin: yeah, i think it's not set to build a precise package | 18:42 |
| clarkb | mordred: looks like you overloaded cloud and name | 18:42 |
| clarkb | and I am guessing nodepool defaults cloud to None which gets passed as a positional arg properly | 18:43 |
| mordred | SpamapS, greghaynes: it's actually that os-client-config does not set self.name, and that's what the openstack_cloud function uses | 18:43 |
| jeblair | asselin, anteaya: http://docs.openstack.org/infra/system-config/nodepool.html#vhd-util | 18:43 |
| clarkb | then later breaks the caching | 18:43 |
| mordred | clarkb: nope | 18:43 |
| *** maishsk_afk has quit IRC | 18:43 | |
| mordred | clarkb: nodepool is doing the right thing. shade needs the defensive patch SpamapS is making - and I need to make an os-client-config patch real quick | 18:43 |
| clarkb | self.name = cloud | 18:43 |
| SpamapS | mordred: yeah, I think there's probably room for a unit test for the micro-level problem, and a functional test for the general scenario that we have | 18:43 |
| clarkb | if cloud == None then you lose | 18:43 |
| mordred | yes. that is correct | 18:43 |
| asselin | jeblair, I see....ok will disable. thanks | 18:44 |
| jeblair | clarkb: sounds like a tshirt | 18:44 |
| anteaya | jeblair: thanks | 18:44 |
| clarkb | fungi: I think debug.log doesn't have the errors yet because the log file rolled isnce the last time we tried uplaoding | 18:44 |
| fungi | oh, got it | 18:44 |
| clarkb | fungi: once the image builds complete we should fire off all the uploads and see if this breaks the same as the manual upload (I expect it to) | 18:44 |
| mordred | yes. it will | 18:45 |
| mordred | don't bother | 18:45 |
| mordred | patch incoming | 18:45 |
| *** davideagnello has quit IRC | 18:45 | |
| fungi | well, it's not a matter of bothering | 18:45 |
| mordred | :) | 18:46 |
| fungi | nodepoold is going to be doing this shortly regardless | 18:46 |
| clarkb | mordred: also I think I have confirmed my story | 18:46 |
| *** HeOS has joined #openstack-infra | 18:46 | |
| fungi | as part of its scheduled build process | 18:46 |
| mordred | clarkb: what was your story? | 18:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Reconfigure irc-meetings output https://review.openstack.org/185677 | 18:46 |
| clarkb | mordred: nodepool sets cloud to None, that is passed as a kwarg to the Cloud __init__ | 18:46 |
| mordred | no. that's not what happens | 18:46 |
| clarkb | mordred: self.name becomes None, then we lose | 18:46 |
| clarkb | mordred: how does that not happen? | 18:46 |
| mordred | although it's close | 18:46 |
| clarkb | we explicitly set it to None | 18:46 |
| mordred | because there is a check for if it's None | 18:46 |
| mordred | and if it's None, it does not get appended to kwargs | 18:47 |
| mordred | the bug is in os-client-config | 18:47 |
| clarkb | oh the check is in provider manager... | 18:47 |
| mordred | yah | 18:47 |
| clarkb | we have way too many onion layers here | 18:47 |
| mordred | yah. but unpeeling them will take some time | 18:48 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add ability to review multiple changes at once https://review.openstack.org/185695 | 18:48 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix updating flags on threaded changes https://review.openstack.org/185696 | 18:48 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow reviewing one change in change list https://review.openstack.org/185697 | 18:48 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Advance cursor on change list toggle https://review.openstack.org/185698 | 18:48 |
| jeblair | plane dump | 18:48 |
| greghaynes | clarkb: so AIUI nodepool doesnt retry dib uploads if the upload fails, right? | 18:48 |
| clarkb | greghaynes: correct | 18:48 |
| fungi | code airdrop | 18:48 |
| clarkb | greghaynes: it will try again the next day | 18:48 |
| jeblair | fungi: better | 18:49 |
| clarkb | (or on whatever interval you have it set to build images) | 18:49 |
| greghaynes | curious what the machinery is that youall are talking about that will re-kick off uploads? | 18:49 |
| greghaynes | is that just a new build? | 18:49 |
| clarkb | greghaynes: yes | 18:49 |
| greghaynes | ah, ok | 18:49 |
| clarkb | so we have nodepool, os-client-config, and shade all setting config and they don't agree on how to do it | 18:49 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Make caching work when cloud name is None https://review.openstack.org/185699 | 18:49 |
| clarkb | fix I am guessing based on what mordred says is to update os-client-config | 18:50 |
| mordred | clarkb: yes. I agree - there are patches coming to align that | 18:50 |
| *** davideagnello has joined #openstack-infra | 18:50 | |
| *** maishsk_afk has joined #openstack-infra | 18:50 | |
| SpamapS | defensive shade patch done | 18:51 |
| mordred | clarkb, SpamapS, dtroyer: https://review.openstack.org/185701 | 18:51 |
| *** e0ne has joined #openstack-infra | 18:53 | |
| mordred | (adding test) | 18:53 |
| *** ashleighfarnham has joined #openstack-infra | 18:53 | |
| clarkb | fungi: we are probably ~1 hour away from seeing hte error in production | 18:54 |
| clarkb | fungi: I don't know when these image builds got so slow but thats another thing we should look into | 18:54 |
| SpamapS | mordred: you really should start doing things the other way around. :) | 18:54 |
| clarkb | it used to take ~15 minutes with a warm cache to build these images | 18:54 |
| SpamapS | very comforting to have a test that breaks, and then code that fixes :) | 18:54 |
| pleia2 | wrt to a translations devstack instance, what's the nova driver thing to fake launch a fake vm? | 18:55 |
| clarkb | fungi: but random guess is that the cinder volume IO is much slower than the locally attached ephemeral disk | 18:55 |
| greghaynes | mordred: you got pep8'd | 18:55 |
| fungi | ooh, could be | 18:55 |
| mordred | SpamapS: good point. I ran the new test without the patch and confirmed that it breaks | 18:55 |
| clarkb | pleia2: instead of configuring it to qemu/kvm you tell it to load a "fake" driver that pretends to nova that a vm booted | 18:55 |
| mordred | clarkb, fungi: ++ | 18:55 |
| pleia2 | clarkb: ok, so just "fake" then | 18:56 |
| clarkb | pleia2: let me find an example of a test job that uses it | 18:56 |
| pleia2 | clarkb: thanks | 18:56 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 18:56 | |
| mordred | SpamapS, dtroyer: updated | 18:56 |
| clarkb | pleia2: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n224 | 18:56 |
| clarkb | pleia2: I think devstack-gate sets it up when the LARGE_OPS var is >0 | 18:57 |
| pleia2 | clarkb: cool | 18:57 |
| clarkb | pleia2: yup https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n326 | 18:57 |
| pleia2 | great, thanks | 18:57 |
| mordred | clarkb: you can +A https://review.openstack.org/#/c/185699/ ? | 18:58 |
| *** maishsk_afk is now known as maishsk | 18:59 | |
| *** tiswanso has quit IRC | 19:00 | |
| clarkb | mordred: ya I am trying to grok the test | 19:00 |
| clarkb | I guess the idea is getting [] back and not an exception is what we want | 19:00 |
| clarkb | shouldn't we be asserting the value being cached instead? | 19:01 |
| clarkb | meh | 19:01 |
| greghaynes | I think its a 'dont explode' test | 19:01 |
| mordred | clarkb: yes. the test will throw if self.cloud.name is None | 19:01 |
| clarkb | greghaynes: mordred right I get that, but what we need is a "did None get stringified properly" test | 19:01 |
| *** tiswanso has joined #openstack-infra | 19:01 | |
| clarkb | which can be a get against the cache assertion? | 19:02 |
| jeblair | it's meetin time | 19:02 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace https://review.openstack.org/185705 | 19:02 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Update delorean URL https://review.openstack.org/184640 | 19:03 |
| clarkb | SpamapS: see comment on https://review.openstack.org/#/c/185699/ | 19:09 |
| *** mpaolino has joined #openstack-infra | 19:10 | |
| SpamapS | clarkb: ty, it's more complicated than self._cache.get('None'), but not much. | 19:11 |
| SpamapS | clarkb: and worth the time to add, thanks. | 19:11 |
| *** mpaolino has quit IRC | 19:11 | |
| *** mtanino_away is now known as mtanino | 19:12 | |
| *** koolhead17 has joined #openstack-infra | 19:14 | |
| *** annegentle has quit IRC | 19:15 | |
| *** nelsnelson has quit IRC | 19:15 | |
| *** nelsnelson has joined #openstack-infra | 19:16 | |
| *** salv-orlando has joined #openstack-infra | 19:17 | |
| *** soren_ has joined #openstack-infra | 19:19 | |
| SpamapS | testtools.matchers._impl.MismatchError: <unprintable MismatchError object> | 19:20 |
| SpamapS | well thats a new one on me | 19:20 |
| *** panda has quit IRC | 19:21 | |
| mordred | SpamapS: I'd like to blame lifeless for that one | 19:22 |
| *** panda has joined #openstack-infra | 19:22 | |
| SpamapS | oh and tox -r -epy34 ends in misery on shade | 19:23 |
| SpamapS | distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('pbr<1.0,>=0.5.21') | 19:23 |
| mordred | SpamapS: how are we passing the gate? | 19:23 |
| *** annegentle has joined #openstack-infra | 19:23 | |
| *** banix has quit IRC | 19:23 | |
| SpamapS | Download error on https://pypi.python.org/simple/pbr/: [Errno -2] Name or service not known -- Some packages may not be found! | 19:23 |
| mordred | oh. well | 19:23 |
| SpamapS | my wifi is sketchy today maybe? :-P | 19:24 |
| mordred | that's a whole other thing | 19:24 |
| mordred | yah | 19:24 |
| *** mpavone has joined #openstack-infra | 19:24 | |
| *** teran has quit IRC | 19:25 | |
| *** rkukura has joined #openstack-infra | 19:29 | |
| *** hdd has quit IRC | 19:30 | |
| cody-somerville | SpamapS: I sometimes wonder if pip implements its own TCP/IP stack and has poor packet re-transmit support. | 19:30 |
| clarkb | it uses requests | 19:31 |
| openstackgerrit | Merged openstack-infra/project-config: Switch on docs and publish jobs for magnum https://review.openstack.org/182998 | 19:31 |
| SpamapS | clarkb: is that supposed to be better? :) | 19:31 |
| clarkb | SpamapS: no :) | 19:31 |
| clarkb | or at least I would be much happier about it if the whole urllib3 warning stuff wasn't so bad | 19:32 |
| *** SotK_ is now known as SotK | 19:33 | |
| cody-somerville | What did upstream do to fix the pip 7 trusted-host stuff btw? | 19:34 |
| clarkb | cody-somerville: set trusted host config | 19:35 |
| cody-somerville | We did the same but it turns out people do things like run things locally or in docker images. | 19:35 |
| clarkb | I think by definition you can't fix those things for them and the have to edit pip.conf themselves | 19:36 |
| cody-somerville | Does pip still try https before flailing? | 19:36 |
| *** mohitsharma has joined #openstack-infra | 19:36 | |
| clarkb | no, it uses the url you have given it, even if talking to upstream ppi | 19:37 |
| clarkb | *upstream pypi | 19:37 |
| *** jamespage_ has joined #openstack-infra | 19:38 | |
| *** patrickeast_ has joined #openstack-infra | 19:40 | |
| *** maishsk has quit IRC | 19:40 | |
| *** ParsectiX has joined #openstack-infra | 19:40 | |
| mordred | cody-somerville: people upstream do not consume our mirrors | 19:40 |
| *** mohitsharma has quit IRC | 19:41 | |
| mordred | cody-somerville: we do not run mirrors for public consumption - we tell people to point to pypi.python.org | 19:41 |
| fungi | (we hope) | 19:41 |
| mordred | if they do - it's not our job to fix them | 19:41 |
| mordred | cody-somerville: so - you have a different usecase here than we do | 19:41 |
| fungi | but yes, we reserve the right to break anyone using those mirrors, including us | 19:41 |
| mordred | cody-somerville: you probably want to get SSL certs for your mirrors | 19:42 |
| fungi | however, hosting a bandersnatch mirror via https and adding a trusted cert for it seems like an effective workaround | 19:42 |
| fungi | yeah, that | 19:42 |
| mordred | cody-somerville: you may want to get a proper SSL cert and not an HP one - as most people will not have the HP CA installed in their docker containers | 19:42 |
| mordred | and although they could- the cantrip for supporting that is more complex than just setting a pip.conf setting | 19:43 |
| mordred | cody-somerville: you could also get HP to just fix their horribly broken corporate network | 19:43 |
| mordred | :) | 19:43 |
| asselin | cody-somerville, this is what we do: http://paste.openstack.org/show/238392/ | 19:43 |
| *** patrickeast__ has joined #openstack-infra | 19:45 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Make caching work when cloud name is None https://review.openstack.org/185699 | 19:45 |
| clarkb | SpamapS: why did the test need to be so complicated? | 19:46 |
| *** rlandy has quit IRC | 19:46 | |
| clarkb | SpamapS: all we needed to do was assert the correct cache region existed if I understand the code properly | 19:46 |
| *** bhunter71 has quit IRC | 19:47 | |
| *** koolhead17 has quit IRC | 19:47 | |
| *** patrickeast_ has quit IRC | 19:48 | |
| SpamapS | clarkb: there is only one region. :-P | 19:48 |
| SpamapS | clarkb: I so wish it was that simple. | 19:48 |
| clarkb | right so assert it exists with the correct name | 19:48 |
| SpamapS | There is only one, and it is not named after the cloud. | 19:48 |
| *** Swanson has quit IRC | 19:48 | |
| clarkb | then what is the function that was fixed doing? | 19:48 |
| SpamapS | generating keys | 19:48 |
| *** panda has quit IRC | 19:48 | |
| clarkb | ok then all we need to do is check that the "None" key exists? | 19:49 |
| clarkb | I am confused why we need to make any images at all | 19:49 |
| SpamapS | no, it prefixes all keys with the cloud name | 19:49 |
| clarkb | wat | 19:49 |
| clarkb | ok maybe I should not dig into this | 19:49 |
| clarkb | (isn't that what different regions exist for?) | 19:49 |
| SpamapS | so the idea is to keep caching config simpler than cloud config. :) | 19:49 |
| SpamapS | which complicates the other end, but that seems like a win. | 19:50 |
| *** maishsk_afk has joined #openstack-infra | 19:50 | |
| SpamapS | if you want a region per cloud, that would be neat, but this gives one cache to bind them all. | 19:50 |
| clarkb | but there is no point to one cache for all clouds | 19:50 |
| SpamapS | go fix it | 19:50 |
| clarkb | because we are already namespacing them in a horrible way | 19:50 |
| *** Sukhdev has joined #openstack-infra | 19:50 | |
| SpamapS | have fun. :) | 19:50 |
| mordred | clarkb: so - yeah - this is just the way it works right now | 19:51 |
| SpamapS | I don't think it's broken, but you're welcome to report broken things. | 19:51 |
| clarkb | SpamapS: no I don't think it is broken either, I think it is highly confusing and makes no sense | 19:51 |
| clarkb | but the code likely works | 19:51 |
| *** yamamoto has joined #openstack-infra | 19:51 | |
| SpamapS | It also isn't such a nonsensical thing to say the cache is for _the client_ not for _the cloud_ | 19:51 |
| SpamapS | there is only one client. | 19:51 |
| mordred | right. that's the thing it's there for | 19:51 |
| clarkb | there is a 1:1 mapping between cloud and shade client | 19:52 |
| *** patrickeast__ has quit IRC | 19:52 | |
| mordred | also - I believe there was a reaon why using cloud name and cache region did not work when we first looked at it | 19:52 |
| clarkb | at least thats a object not class member | 19:52 |
| mordred | oh - no - so - I remember the details now | 19:52 |
| mordred | the dogpile cache "region" just does what our region code does, but it doesn't have enough information in it to segment appropriately | 19:53 |
| mordred | it's not realy a data concept | 19:53 |
| mordred | it's just an appended string into the cache key | 19:53 |
| mordred | but since we have to construct cache keys _anyway_ | 19:53 |
| clarkb | mordred: sure but now anything accessing the cache has to have special built code around it | 19:53 |
| clarkb | mordred: rather than just talking dogpile | 19:54 |
| mordred | that is the case regardless | 19:54 |
| clarkb | which leads to confusion | 19:54 |
| clarkb | and bugs | 19:54 |
| clarkb | (eg this one) | 19:54 |
| mordred | we don't have that custome code because of the keys | 19:54 |
| SpamapS | Yes, that is always going to be the case because dogpile is really dumb about key generation. | 19:54 |
| mordred | we have the custom code because of how dogpile likes to be instantiated and live | 19:54 |
| SpamapS | intentionally IIRC | 19:54 |
| *** panda has joined #openstack-infra | 19:54 | |
| clarkb | this particular bug is a direct descendant of this design decision | 19:54 |
| mordred | no | 19:54 |
| mordred | it's not a design decision | 19:54 |
| clarkb | and its undocumented and makes no sense so we will have more of them | 19:54 |
| mordred | it is 100% necessary | 19:54 |
| clarkb | mordred: ok you haven't explained that at all | 19:54 |
| clarkb | mordred: in theor dogpile handles keys for you | 19:55 |
| clarkb | at least on a region basis? | 19:55 |
| SpamapS | clarkb: read dogpile's default key generator. It will not work for us. You will _always_ need the key generator from shade. | 19:55 |
| clarkb | anyways, my point is the code here is confusing enough to have led to this bug, this makes me question the decision here, it may be necessary and thats fine but wow | 19:55 |
| *** e0ne has quit IRC | 19:55 | |
| mordred | well, I think the takeaway is that we could probably use a comment explaining why we have one | 19:56 |
| *** mpavone has quit IRC | 19:56 | |
| SpamapS | IIRC they'd like to fix that but it's relatively insane-unreadable-python to do it with a metaclass and some other magic. | 19:56 |
| mordred | so that when we go read the code we don't provoke clarkb (or others) to have a WTF, doesn't dogpile do this for you? | 19:56 |
| SpamapS | mordred: docstring for the key generator would do it I think. | 19:57 |
| mordred | SpamapS: yah | 19:57 |
| mordred | and would be a good idea in general | 19:57 |
| mordred | that said - I think we've grown big enough in this channel that we may need to step back away from the combative manner of poking at code. it puts people into a defensive mode and is not particularly pleasant | 19:57 |
| ParsectiX | clarkb: Hello. I have made all steps in Dev guide. How I can start contributing :) | 19:57 |
| mordred | I think it worked well when there were 4 of us | 19:58 |
| mordred | but there's like a billion active people up in here now | 19:58 |
| openstackgerrit | George Peristerakis proposed openstack-infra/system-config: Moved the server class out from the logstash and logstash_worker class https://review.openstack.org/185053 | 19:59 |
| *** marcusvrn has quit IRC | 19:59 | |
| timrc | fungi, Was good to meet ya :) | 20:00 |
| *** e0ne has joined #openstack-infra | 20:00 | |
| fungi | timrc: likewise! | 20:00 |
| clarkb | ParsectiX: once you have your account stuff setup next step is to find a bug/feature/etc to tackle and push up | 20:01 |
| SpamapS | mordred: btw this has forced me to go back and read dogpile.cache's docs again and it reminds me that we probably also need to use the sha1 key mangler. | 20:01 |
| clarkb | ParsectiX: I would star with something you are interest in or have some familiarity with | 20:02 |
| rbradfor_ | clarkb, why this specific image I do not know, it's sourced from https://git.openstack.org/cgit/openstack/magnum/tree/devstack/plugin.sh#n25 If I have a list of cached images I can ask the question why that cannot be used. | 20:02 |
| SpamapS | mordred: otherwise people will 'splode lots on memcached bits | 20:02 |
| mordred | SpamapS: k | 20:02 |
| yolanda | asselin, btw, about nodepool work for puppet-openstackci, i started job. But i'd prefer to start moving functionality bits to puppet-nodepool prior to the move to openstackci. As some bits, as configuring the nodepool.yaml, in a flexible way, are a bit complex | 20:02 |
| mordred | SpamapS: docs ... definitely needed | 20:02 |
| asselin | yolanda, +1 | 20:02 |
| SpamapS | mordred: also are we planning on running nodepool with some caching turned on? | 20:02 |
| ParsectiX | clarkb: Okay nice. | 20:02 |
| yolanda | i'd prefer to do incremental steps for that, or the review for the nodepool module is going to suck a bit | 20:03 |
| mordred | SpamapS: not right now - currently nodepool manages local caches itself | 20:03 |
| mordred | SpamapS: and since it uses a mix of shade and non-shade calls, I think it needs to | 20:03 |
| clarkb | rbradfor_: I think that is what we need to sort out, let me show you which one we currently cache | 20:03 |
| SpamapS | mordred: all in-memory? | 20:04 |
| asselin | yolanda, yeah, agree to do one way or the other...I prefer to avoid mixing the two approaches. | 20:04 |
| mordred | SpamapS: once the nodepool-dib use case is landed and solid, I thin kwe can start to look at that | 20:04 |
| mordred | SpamapS: yah - but it only caches 2 things- flavor list and image list | 20:04 |
| SpamapS | mordred: just thinking about purging.. the memory backends for dogpile don't free memory IIRC | 20:04 |
| *** radez is now known as radez_g0n3 | 20:04 | |
| mordred | SpamapS: right. it doesn't so anything fancy like that | 20:04 |
| mordred | SpamapS: it is a dict with values in it | 20:05 |
| *** ayoung has quit IRC | 20:05 | |
| *** erikmwilson_ has joined #openstack-infra | 20:05 | |
| mordred | SpamapS: if we do start to turn on dogpile caching for nodepool, I actually think the dbm backend might be nice - that way the cache will persist across restarts and we won't get a herd of nova flavor-list like we do now | 20:05 |
| SpamapS | mordred: ok thats exactly what MemoryBackend is for dogpile.cache | 20:06 |
| *** rbradfor has left #openstack-infra | 20:06 | |
| SpamapS | fine if you plan to just keep overwriting the same few keys. Not so good for a large breadth of things. | 20:06 |
| SpamapS | I'm actually surprised dogpile.cache can't short-circuit entirely and even skip key generation with the NullBackend. | 20:06 |
| openstackgerrit | Merged openstack-infra/project-config: Reconfigure irc-meetings output https://review.openstack.org/185677 | 20:07 |
| yolanda | asselin , yes, so i'll move the functionality i can to puppet-nodepool, then the refactor will be simpler | 20:07 |
| clarkb | rbradfor_: https://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/image_list.sh is the script we run to get the list of images devstack would like us to cache | 20:07 |
| SpamapS | we could actually noop things in the decorator if we detect nullbackend. That's not a terrible idea if we see CPU problems. | 20:07 |
| asselin | yolanda, ok, please use the same gerrit topic. thank you | 20:07 |
| clarkb | rbradfor_: it looks at stackrc to get a list of images. One of which is a fedora image for heat tests | 20:07 |
| yolanda | sure | 20:07 |
| *** yamahata has quit IRC | 20:07 | |
| *** timcline has quit IRC | 20:08 | |
| clarkb | rbradfor_: the HEAT_FETCHED_TEST_IMAGE looks like | 20:08 |
| * SpamapS steps away from the premature optimization trap and goes back to making things harder faster better stronger. | 20:08 | |
| *** koolhead17 has joined #openstack-infra | 20:09 | |
| clarkb | rbradfor_: in theory you can just run that script and have it tell you what images it is caching | 20:10 |
| clarkb | rbradfor_: I am working to confirm that now | 20:10 |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Kazoo 2.1 has a bug which is breaking tooz gate https://review.openstack.org/185095 | 20:10 |
| *** mtanino has quit IRC | 20:11 | |
| clarkb | thats interesting it doesn't list the fedora image when run against master, maybe that is from an older branch? | 20:11 |
| clarkb | rbradfor_: confirmed, stable/juno lists the fedora image | 20:12 |
| *** aduarte has quit IRC | 20:13 | |
| *** ZZelle_ has joined #openstack-infra | 20:13 | |
| *** prad has quit IRC | 20:13 | |
| rbradfor_ | clarkb, i am lost with what you mean by stable/juno | 20:14 |
| *** mtanino has joined #openstack-infra | 20:14 | |
| clarkb | rbradfor_: the stable/juno branch of devstack emits the fedora image when you run that script | 20:14 |
| *** samueldmq has quit IRC | 20:15 | |
| *** stevebaker has quit IRC | 20:17 | |
| *** stevebaker has joined #openstack-infra | 20:17 | |
| *** stevebaker has quit IRC | 20:17 | |
| *** stevebaker has joined #openstack-infra | 20:17 | |
| *** ayoung has joined #openstack-infra | 20:18 | |
| *** jamespage_ has quit IRC | 20:18 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 20:18 | |
| *** stevebaker has quit IRC | 20:18 | |
| *** stevebaker has joined #openstack-infra | 20:18 | |
| fungi | so i guess heat has moved their tests which used that to a functional testing job or something? | 20:18 |
| fungi | that might start to get ugly once juno reaches eol | 20:19 |
| fungi | or sooner if the image they used for juno devstack jobs gets replaced by a newer one in the functional jobs | 20:20 |
| clarkb | fungi: ya, its likely we need to do something here to better accomodate them | 20:20 |
| *** freerunner has joined #openstack-infra | 20:20 | |
| clarkb | and hopefully we can accomodate the current set of folks that have expressed a need for fedora images | 20:20 |
| *** tiswanso has quit IRC | 20:22 | |
| fungi | oh, looks like they're building and uploading a http://tarballs.openstack.org/heat-test-image/fedora-heat-test-image.qcow2 | 20:22 |
| fungi | so they followed in the trove agent tests' footsteps i guess | 20:22 |
| clarkb | but we don't cache it (unlike the trove agent image) | 20:22 |
| fungi | right | 20:23 |
| fungi | so that still needs solving | 20:23 |
| clarkb | yup | 20:23 |
| *** sgolovatiuk has left #openstack-infra | 20:23 | |
| *** stevebaker has quit IRC | 20:23 | |
| *** stevebaker has joined #openstack-infra | 20:23 | |
| clarkb | so really I think this ends up boiling down to "what do heat and magnum both need?" "build that image or pull one off the shelf" "cache it in nodepool images" | 20:24 |
| *** nikeshm has joined #openstack-infra | 20:24 | |
| *** stevebaker has quit IRC | 20:24 | |
| nikeshm | patrickeast : hi | 20:24 |
| *** stevebaker has joined #openstack-infra | 20:24 | |
| *** teran has joined #openstack-infra | 20:25 | |
| nikeshm | patrickeast: i am able to passthrough FC HBA in vms manually | 20:25 |
| *** maishsk_afk has quit IRC | 20:25 | |
| asselin | hi nikeshm, want to chat in cinder channel? | 20:26 |
| clarkb | mordred: I have +2'd SpamapS' latest patchset to fix caching, but could use your rereview | 20:26 |
| mordred | clarkb: awesome- will do after TC meeting | 20:26 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added npm-run jobs to refstack. https://review.openstack.org/185731 | 20:26 |
| clarkb | mordred: thanks, and i guess it will need a new release too | 20:26 |
| *** radez_g0n3 is now known as radez | 20:26 | |
| mordred | clarkb: yah. so will os-client-config | 20:26 |
| nikeshm | patrickeast: by your scripts but have some doubts in scripts | 20:26 |
| *** timcline has joined #openstack-infra | 20:26 | |
| nikeshm | asselin: ok | 20:27 |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add port resource methods https://review.openstack.org/179968 | 20:27 |
| mordred | I eman, strickly the shade patch will fix it - but the os-client-config is where the fix REALLY should be - as from shade's point of view clouds should always have names | 20:27 |
| *** stevebaker has quit IRC | 20:27 | |
| *** julim has quit IRC | 20:27 | |
| *** stevebaker has joined #openstack-infra | 20:27 | |
| *** ayoung has quit IRC | 20:27 | |
| clarkb | sure, but I can't affect change in that repo directly :) | 20:27 |
| *** gyee has joined #openstack-infra | 20:28 | |
| mordred | clarkb: we could fix that ... | 20:28 |
| *** samueldmq has joined #openstack-infra | 20:34 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Enable NeutronL3HA for the HA job https://review.openstack.org/185461 | 20:36 |
| *** otter768 has joined #openstack-infra | 20:37 | |
| *** yamamoto has quit IRC | 20:38 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add docs about using subunit2sql-graph https://review.openstack.org/183696 | 20:38 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add docs about using subunit2sql-graph https://review.openstack.org/183696 | 20:38 |
| *** prad has joined #openstack-infra | 20:38 | |
| *** yamahata has joined #openstack-infra | 20:41 | |
| *** otter768 has quit IRC | 20:42 | |
| *** ayoung has joined #openstack-infra | 20:42 | |
| *** yamamoto has joined #openstack-infra | 20:43 | |
| clarkb | mordred: did the os-client-config change release recently? because this was working in my devstack env that doesn't set cloud: et all iirc | 20:43 |
| clarkb | ya no cloud in nodepool.yaml using os-c-c 1.0.0 | 20:44 |
| clarkb | which is supposedly the latest release | 20:44 |
| *** bhunter71 has joined #openstack-infra | 20:45 | |
| mordred | clarkb: if you have a nodepool.yaml, you get a cloud name | 20:46 |
| mordred | clarkb: this only gets triggered if you use no external config at all and do everythign 100% programatically | 20:46 |
| clarkb | mordred: then why does it happen for prod nodepool? | 20:46 |
| mordred | beause we have not yet landed the clouds.yaml patch for nodepool | 20:46 |
| *** peristeri has quit IRC | 20:46 | |
| clarkb | that should be fine I don't have a clouds.yaml either | 20:46 |
| mordred | hrm | 20:47 |
| mordred | that is a good question | 20:47 |
| *** hdd has joined #openstack-infra | 20:47 | |
| mordred | clarkb: self.provider.cloud is definitely None in prod | 20:48 |
| clarkb | and definitely None in my test instance I am checking versions on nodepool.o.o too | 20:48 |
| greghaynes | mordred: I dont think we pass cloud to shade if you have nodepool.yaml | 20:48 |
| clarkb | they look the same. shade==0.6.1 and os-c-c==1.0.0 | 20:48 |
| greghaynes | We check if you have cloud set, if you dont then we dont pass that kwarg | 20:49 |
| mordred | ok. *facedesk* | 20:49 |
| mordred | nope. this is all the way back to clarkb's complaint from ages ago - the mixed use of cloud to mean name of cloud and cloud to mean name of cloud provider | 20:49 |
| mordred | I mean - the other thing IS a bug and it's good that we fixed it | 20:50 |
| clarkb | yes I agree its a bug should be fixed, but not understanding why we are only partially affected (eg only in prod and not in test instance) | 20:50 |
| mordred | yah | 20:50 |
| mordred | agree - and now looking further | 20:50 |
| *** stevebaker has quit IRC | 20:50 | |
| *** stevebaker has joined #openstack-infra | 20:50 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Advance cursor on change list toggle https://review.openstack.org/185698 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow reviewing one change in change list https://review.openstack.org/185697 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix updating flags on threaded changes https://review.openstack.org/185696 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Make "limit" a noop in queries https://review.openstack.org/172670 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix searching by reviewer account id https://review.openstack.org/172669 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Batch sync change by commit tasks https://review.openstack.org/172691 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix age searching https://review.openstack.org/172668 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix refresh on project and change lists https://review.openstack.org/183887 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix diff display of deleted empty files https://review.openstack.org/180546 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add database pruning https://review.openstack.org/179981 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Attach comments to files https://review.openstack.org/179980 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add files table https://review.openstack.org/179979 | 20:52 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add ability to review multiple changes at once https://review.openstack.org/185695 | 20:52 |
| clarkb | but I need lunch so back in a bit to dig in | 20:52 |
| jeblair | (minor changes + rebase) | 20:52 |
| *** stevebaker has quit IRC | 20:52 | |
| *** stevebaker has joined #openstack-infra | 20:52 | |
| *** ParsectiX has quit IRC | 20:53 | |
| *** jgrimm is now known as zz_jgrimm | 20:53 | |
| openstackgerrit | Merged openstack-infra/shade: Make caching work when cloud name is None https://review.openstack.org/185699 | 20:53 |
| clarkb | mordred: fwiw I was testing with your change to use shade for image uploads but I don't think that would affect shades cache at all | 20:53 |
| greghaynes | I also tested against devstack and no clouds.yaml or cloud: in my provider config | 20:54 |
| *** ParsectiX has joined #openstack-infra | 20:54 | |
| greghaynes | so theres something else wierd going on | 20:54 |
| *** aysyanne has quit IRC | 20:56 | |
| *** rguillebert has joined #openstack-infra | 20:57 | |
| mordred | ok. I must clearly still have jetlag | 20:58 |
| lifeless | mordred: SpamapS: looks like a bug in that particular matcher. | 20:59 |
| clarkb | mordred: greghaynes because food is apparently not that important the unauthorized 401 error is what I see in the logs | 20:59 |
| fungi | SpamapS: mordred: clarkb: now that 185699 has merged we need a 0.6.2 tagged, yeah? | 21:00 |
| clarkb | mordred: greghaynes so I am guessing that we actually have two issues | 21:00 |
| clarkb | the first is the one fungi hit and we just fixed (need a release) | 21:00 |
| clarkb | and the second is whatever causes the 401 errors | 21:00 |
| *** bswartz has quit IRC | 21:01 | |
| *** dannywilson has quit IRC | 21:01 | |
| greghaynes | seems plausible | 21:01 |
| mordred | ok | 21:01 |
| mordred | I foudn that | 21:01 |
| *** gokrokve has quit IRC | 21:01 | |
| clarkb | mordred: ya | 21:02 |
| mordred | the thing we fixed was a total red herring | 21:02 |
| *** gokrokve has joined #openstack-infra | 21:02 | |
| mordred | patch coming | 21:02 |
| clarkb | mordred: well sort of, it breaks our ability to fix things manually | 21:02 |
| clarkb | mordred: so good to fix both :) | 21:02 |
| mordred | well, yeah | 21:02 |
| clarkb | mordred: but I am not sure I grok why the unauthorized error happen | 21:02 |
| mordred | no - I mean, it was a good thing to fix, because yeah | 21:02 |
| mordred | I do | 21:02 |
| *** dannywilson has joined #openstack-infra | 21:02 | |
| greghaynes | such suspense | 21:02 |
| mordred | get_one_cloud() is broken - the code path of not passing a named cloud in is completely farscically wrong - I have NO IDEA how your testing worked | 21:02 |
| greghaynes | mordred: wah | 21:03 |
| mordred | yah | 21:03 |
| greghaynes | mordred: it was totally broken, I thought I fixed it | 21:03 |
| jeblair | mordred, tchaypo, lifeless, clarkb, fungi, *: does anyone else want to test gertty change 179980 before i land it? it's a major db migration, so if you haven't run it, you may want make a backup of .gertty.db. | 21:03 |
| *** erikmwilson_ has quit IRC | 21:03 | |
| mordred | greghaynes: nope. now- once I put up the next patch - I REALLY want to understand what's _working_ in your testing | 21:03 |
| greghaynes | mordred: oh! I bet im passing in a cloud | 21:03 |
| lifeless | russellb: commented on https://review.openstack.org/#/c/182746/ | 21:03 |
| mordred | because figuring out how we got a false positive is important | 21:03 |
| jeblair | tchaypo: (i think you tested it, right? you found a bug i fixed in 180546 iirc) | 21:03 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Use setuptools extras for graphing requirements https://review.openstack.org/184278 | 21:04 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add docs about using subunit2sql-graph https://review.openstack.org/183696 | 21:04 |
| clarkb | mordred: 104.130.164.77 is the node I tested on | 21:04 |
| *** patrickeast_ has joined #openstack-infra | 21:04 | |
| greghaynes | mordred: hrm, maybe not | 21:04 |
| mordred | clarkb: awesome. I'll poke there next | 21:04 |
| lifeless | jeblair: thanks for asking, but I'm ENOTHINK at the moment - I'll cope, or worst case just start over. | 21:04 |
| mordred | clarkb: I mean, I want to fix this - but I do not want to consider this fixed for us until we understand the false-positive | 21:04 |
| *** HenryG has quit IRC | 21:04 | |
| clarkb | mordred: you can login then run sudo -u clarkb -H venv/bin/nodepoold -c ./nodepool.yaml -d | 21:04 |
| mordred | bcause this should have hilariously broken | 21:04 |
| clarkb | mordred: and that will run nodepool for you as me in my homedir | 21:04 |
| mordred | woot | 21:04 |
| jeblair | lifeless: ack, thx | 21:04 |
| * tchaypo checks | 21:04 | |
| mordred | clarkb: should be able to trigger this with nodepool image-upload even | 21:05 |
| greghaynes | mordred: oh, yep, cloud: fake-cloud | 21:05 |
| *** jsavak has quit IRC | 21:05 | |
| mordred | greghaynes: that'll do it | 21:05 |
| *** patrickeast has quit IRC | 21:05 | |
| *** patrickeast_ is now known as patrickeast | 21:05 | |
| mordred | greghaynes: did you have fake-cloud defined somewhere? | 21:05 |
| *** baoli has quit IRC | 21:05 | |
| russellb | lifeless: thanks! | 21:05 |
| clarkb | jeblair: I can upgrade after lunch | 21:05 |
| fungi | jeblair: it's running for me now. i'll let you know once it completes | 21:05 |
| mordred | greghaynes: actually - let me make patch - it'll be easier to talk about the problem once you see the break | 21:05 |
| greghaynes | mordred: I dont think so. Just in the fixtures/node_osc.yaml | 21:06 |
| tchaypo | I’m currently running patchset 1 of 183887, which seems to include that | 21:06 |
| greghaynes | which is the config the test uses | 21:06 |
| tchaypo | if this was the big long migration, I was happy with that | 21:06 |
| *** rossella_s has quit IRC | 21:06 | |
| jeblair | clarkb, fungi: ack, thanks. | 21:06 |
| fungi | does seem to take a few minutes | 21:06 |
| fungi | must be doing lots of awesome | 21:06 |
| jeblair | tchaypo: yep. no substantial changes in the rebase. | 21:06 |
| fungi | ahh, it's indexing files for the search | 21:06 |
| greghaynes | hrm, but theres also a node.yaml test which doesnt have cloud: defined. so no idea how that one passes | 21:07 |
| mordred | oh - ok - it's not as broken as I thought | 21:07 |
| *** rossella_s has joined #openstack-infra | 21:07 | |
| * mordred has several test cases to write coming up ... | 21:07 | |
| clarkb | it gives you a little progress monitor, will eat while that runs | 21:07 |
| *** HenryG has joined #openstack-infra | 21:07 | |
| clarkb | mordred: greghaynes I definitely do not have a cloud: anything in my test nodepool.yaml | 21:07 |
| greghaynes | clarkb: yes, I didnt either | 21:08 |
| jeblair | clarkb: yeah, it's great meal-time entertainment | 21:08 |
| greghaynes | hrm, maybe I should try and load up a nodepool.yaml config to hit hpcloud | 21:09 |
| *** dahoo has joined #openstack-infra | 21:10 | |
| SpamapS | lifeless: unfortunately I haven't been able to reproduce, so it may have been a bug with incompatible old versions or something. | 21:11 |
| clarkb | greghaynes oh ya it could be bad config? | 21:11 |
| clarkb | and somehow its inferred? | 21:11 |
| greghaynes | clarkb: yea, all the logic for getting config defaults and creating clients is what changed so thats my suspicion | 21:12 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Use setuptools extras for graphing requirements https://review.openstack.org/184278 | 21:12 |
| *** ldnunes has quit IRC | 21:14 | |
| *** anthonyper has quit IRC | 21:15 | |
| *** mattfarina has quit IRC | 21:15 | |
| *** anthonyper has joined #openstack-infra | 21:16 | |
| *** ayoung has quit IRC | 21:17 | |
| fungi | jeblair: bad news. it just now died in a KeyError fire | 21:18 |
| *** rossella_s has quit IRC | 21:19 | |
| fungi | jeblair: http://paste.openstack.org/show/238511/ | 21:19 |
| *** ayoung has joined #openstack-infra | 21:19 | |
| *** rossella_s has joined #openstack-infra | 21:20 | |
| fungi | jeblair: want a copy of my ~/.gertty.db file? | 21:20 |
| clarkb | mine is still going fwiw | 21:21 |
| *** ildikov has quit IRC | 21:21 | |
| fungi | a copy of my original ~/.gertty.db from prior to the upgrade, i mean | 21:21 |
| *** weshay has quit IRC | 21:21 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova/oslo.vmware bug 1459021 https://review.openstack.org/185741 | 21:22 |
| openstack | bug 1459021 in OpenStack Compute (nova) "nova vmware unit tests failing with oslo.vmware 0.13.0" [Critical,Confirmed] https://launchpad.net/bugs/1459021 | 21:22 |
| jeblair | fungi: yes please, that would be great. | 21:23 |
| samueldmq | hi, could I have a couple of eyes on #179661 ? | 21:25 |
| samueldmq | anteaya had +2ed it, but it needed a rebase | 21:25 |
| *** mohitsharma has joined #openstack-infra | 21:25 | |
| *** ParsectiX has quit IRC | 21:26 | |
| *** ParsectiX has joined #openstack-infra | 21:26 | |
| *** mohitsharma has quit IRC | 21:29 | |
| tchaypo | I’m waiting for our tests to start using pip7.0.1 | 21:30 |
| tchaypo | I’m guessing that will come in the next image update? | 21:30 |
| *** timcline has quit IRC | 21:30 | |
| asselin | mordred, vhd-util should support precise? or should find a way to exclude from: https://git.openstack.org/cgit/openstack-infra/puppet-diskimage_builder/tree/manifests/init.pp#n27? | 21:30 |
| *** tonytan4ever has quit IRC | 21:31 | |
| mordred | asselin: I don't have much of an opinion on precise - I dont' personally really want to support it myself - but I'm not opposed to it existing | 21:31 |
| asselin | also...how long does -infra plan to support precise? | 21:31 |
| mordred | we already don't support building images on precise | 21:32 |
| asselin | ok, then I'll plan to upgrade | 21:32 |
| mordred | it will make you happier | 21:32 |
| fungi | jeblair: http://fungi.yuggoth.org/tmp/gertty_db.gz (11mib) | 21:33 |
| *** ildikov has joined #openstack-infra | 21:33 | |
| asselin | thanks | 21:33 |
| mordred | zomg.zomg.zomg. | 21:34 |
| mordred | it seems that the generator returned by glance.images.list() ... is a proxy object | 21:35 |
| mordred | and iterating over it results in api calls | 21:35 |
| greghaynes | hahahah | 21:35 |
| *** tonytan4ever has joined #openstack-infra | 21:37 | |
| clarkb | mordred: greghaynes anything else I can do to help debug this? | 21:38 |
| mordred | clarkb: no - I'm down a crazy rathole right now | 21:39 |
| mordred | the thing I thought was the problem was not | 21:39 |
| mordred | but I'm learning ALL SORTS of new evil | 21:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Add project-team-guide https://review.openstack.org/185746 | 21:39 |
| mordred | clarkb: so - when I come up from air - I expect to know many more things | 21:39 |
| clarkb | mordred: it almost looks to me like we aren't giving glanceclietn a keystoneclient | 21:39 |
| mordred | clarkb: and I expect you will not like any of them | 21:39 |
| clarkb | ha | 21:39 |
| jeblair | fungi: download complete, thanks. | 21:39 |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Block oslo.vmware 0.13.0 due to a backwards incompatible change https://review.openstack.org/185748 | 21:40 |
| clarkb | but its making a request and either we dn't have a token or it is invalid | 21:40 |
| mriedem | blacklist is fun! ^ | 21:40 |
| greghaynes | at this point id break once the clients are mafe in nodepool and check their config properties | 21:40 |
| *** claudiub has quit IRC | 21:40 | |
| clarkb | mordred: greghaynes so random thought, it takes us ~6 hours to build all the images could our token have expired by the time we try uploading? | 21:40 |
| mordred | I'm actually testing a very small python script that does the same thing | 21:40 |
| mordred | and I'm having issues | 21:40 |
| mordred | so - that's good | 21:40 |
| *** Swami_ has quit IRC | 21:41 | |
| greghaynes | clarkb: I think we upload one at a time... | 21:41 |
| greghaynes | If I red the dib code correctly | 21:41 |
| nibalizer | for new projects on project-config, use-storyboard: true or no? | 21:41 |
| mordred | clarkb: maybe | 21:41 |
| clarkb | greghaynes: we don't. we build all of them then upload all of them | 21:41 |
| clarkb | greghaynes: let me link you the code | 21:41 |
| mordred | clarkb: but I think we create a new OpenStackCloud object at the start of the upload thing, no? | 21:41 |
| *** Swami has quit IRC | 21:42 | |
| clarkb | greghaynes: https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n1930 | 21:42 |
| clarkb | mordred: we start a new DiskImageUpdater thread yes | 21:42 |
| greghaynes | the clients are created when the providers are IIRC | 21:43 |
| clarkb | greghaynes: the fun bit is we just changed this code but aren't running it yet :/ | 21:44 |
| clarkb | greghaynes: but I think you are correct | 21:44 |
| *** mtanino has quit IRC | 21:44 | |
| *** jsavak has joined #openstack-infra | 21:44 | |
| clarkb | the provider makes a shade openstack cloud client thing, and subclients are made at that point | 21:44 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova/oslo.vmware bug 1459021 https://review.openstack.org/185741 | 21:45 |
| openstack | bug 1459021 in oslo.vmware "nova vmware unit tests failing with oslo.vmware 0.13.0" [Undecided,In progress] https://launchpad.net/bugs/1459021 - Assigned to Matt Riedemann (mriedem) | 21:45 |
| *** pc_m has quit IRC | 21:45 | |
| SpamapS | zigo: https://github.com/rohe/pysaml2/pull/224 | 21:46 |
| SpamapS | zigo: =================================== 9 failed, 440 passed, 16 error in 27.40 seconds ==================================== | 21:46 |
| zigo | SpamapS: This rox! :) | 21:46 |
| SpamapS | zigo: it's become an obsession... one I need to let go of soon. ;-) | 21:46 |
| zigo | SpamapS: I hope you can finish them all. I am guessing that as you get deeper, the difficulty increases, right? | 21:46 |
| SpamapS | zigo: indeed, there are some questions about pickle formats and assumption of utf-8 now. | 21:47 |
| openstackgerrit | Merged openstack-dev/pbr: Add kerberos deps to build the kerberos wheel. https://review.openstack.org/184294 | 21:47 |
| openstackgerrit | Merged openstack-dev/pbr: Add home-page into sample setup.cfg https://review.openstack.org/184866 | 21:47 |
| SpamapS | zigo: and a few of the failures I think will require SAML deep knowledge | 21:47 |
| SpamapS | zigo: there are still a few shallow problems left, then the last few I am going to ask the core developers to address and then turn on python3 in travis-CI | 21:47 |
| mordred | ok. my local testing is now working | 21:48 |
| mordred | clarkb, greghaynes: I have now _successfully_ run the code path in question in nodepool by hand with our fixes added and it works against hpcloud | 21:48 |
| mordred | (skipping any named clouds, invoking methods with the same params, etc) | 21:49 |
| clarkb | mordred: these are fixes that have not been pushed yet? | 21:49 |
| mordred | SO - if we see the auth error, I'm going vote on token expiration | 21:49 |
| clarkb | mordred: or fixes that went into the 1.0.0 release? | 21:49 |
| mordred | clarkb: just the os-client-config one that needs to land and release | 21:49 |
| clarkb | mordred: for None cloud? | 21:49 |
| mordred | clarkb: I thought there was a more complex break - but the None was the main one | 21:49 |
| mordred | yeah | 21:49 |
| fungi | i wonder whether we should upload after each build rather than all at the end? | 21:50 |
| clarkb | mordred: kk | 21:50 |
| openstackgerrit | Clint Adams proposed openstack-infra/zuul-packaging: WIP - update zuul packaging for zuul 2.0.0 https://review.openstack.org/185752 | 21:50 |
| clarkb | fungi: well the clients are made once | 21:50 |
| mordred | clarkb: I have verified however | 21:50 |
| *** gokrokve has quit IRC | 21:50 | |
| fungi | ahh, right, at the beginning. not recreated at upload time | 21:50 |
| mordred | that glanceclient does an api call for each image in list | 21:50 |
| clarkb | mordred: nice | 21:50 |
| mordred | so it's TOTALLY skipping out rate limiting | 21:50 |
| mordred | jeblair: ^^ | 21:50 |
| mordred | jeblair: you'll enjoy that | 21:50 |
| *** Sukhdev has quit IRC | 21:50 | |
| clarkb | mordred: and its basically impossible to rate limit without major hax | 21:50 |
| fungi | yeah, that seems like a hole in someone's design | 21:50 |
| mordred | glanceclient.images.list() does not, in fact, talk to teh cloud | 21:51 |
| *** ParsectiX has quit IRC | 21:51 | |
| mordred | it only creates a generator which does as you iterate over it | 21:51 |
| *** Sukhdev has joined #openstack-infra | 21:51 | |
| fungi | probably worth opening a bug against glanceclient about that | 21:51 |
| clarkb | mordred: ok so getting back to upload problems with auth, do you expect the noew code which we just merged but are not running yet to fix it. eg using the sahde interface instead of client directly? | 21:51 |
| *** ParsectiX has joined #openstack-infra | 21:51 | |
| jeblair | wow. | 21:51 |
| clarkb | mordred: because I can go ahead and restart nodepool to get that in, but won't bother if not expected to work | 21:52 |
| * clarkb reads shade now | 21:52 | |
| mordred | well - so we can test by running a nodepool image-upload by hand | 21:52 |
| mordred | which will trigger the glance client code via shade and will fail if it's wrong | 21:52 |
| mordred | which I think is an easier way than restarting nodepool to make sure it'll work | 21:53 |
| mordred | also - if that works and nodepool itself gets 401s, then we know to chase token expiration | 21:53 |
| clarkb | mordred: except that os-c-c/shade bug fixes are still outstanding and that will always make a new token just prior to uploading I think | 21:54 |
| clarkb | mordred: but we can at least confirm it explodes less | 21:54 |
| *** jklare has quit IRC | 21:54 | |
| *** mriedem is now known as mriedem_away | 21:54 | |
| *** waynr has quit IRC | 21:54 | |
| greghaynes | So the theory is our image builds are now taking longer and therefore tokens expire? | 21:54 |
| clarkb | greghaynes: ya | 21:54 |
| clarkb | and instead of reauthing we fail | 21:54 |
| clarkb | I think ideally $client would deal with this transparently | 21:55 |
| mordred | OH - wait a sec - I may have yelled prematurely | 21:55 |
| mordred | jeblair, clarkb: there is only one call to the API - it just happens when you're not expecting it to | 21:55 |
| *** jklare has joined #openstack-infra | 21:55 | |
| mordred | so - it's fixable on our side by changing what we run in a task | 21:55 |
| clarkb | mordred: you mean for the list thing | 21:56 |
| mordred | yes | 21:56 |
| clarkb | mordred: want to make a shade release for the cache fix? | 21:56 |
| *** salv-orlando has quit IRC | 21:56 | |
| mordred | clarkb: well, yeah - we should release and install new shade/occ | 21:56 |
| mordred | yes I do | 21:56 |
| clarkb | I can make sure that gets installed on nodepool.o.o then try the manual image uploads | 21:56 |
| *** ddieterly has quit IRC | 21:57 | |
| *** jsavak has quit IRC | 21:57 | |
| *** alexsyip has joined #openstack-infra | 21:58 | |
| *** jsavak has joined #openstack-infra | 21:58 | |
| jeblair | fungi: can you "pip freeze|grep SQL"? | 21:58 |
| clarkb | jeblair: gertty update, about halfway through the migration | 21:58 |
| fungi | jeblair: SQLAlchemy==1.0.4 | 21:59 |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add beaker-localhost and beaker-nodepool hypervisors https://review.openstack.org/185754 | 21:59 |
| *** salv-orlando has joined #openstack-infra | 21:59 | |
| nibalizer | crinkle: ^^ | 21:59 |
| *** dahoo has quit IRC | 21:59 | |
| vipul | mordred: where would i find playbooks that utilize the os_ modules.. just want some examples | 21:59 |
| clarkb | nibalizer: project-config doesn't really have any puppet manifest to apply fwiw | 21:59 |
| jeblair | clarkb: i cleverly arranged the patch series so that change expiration happens _after_ the migration, so it will delete like 80% of the work it's doing right now. | 21:59 |
| fungi | rbradfor_: you're being summoned in #openstack-meeting | 21:59 |
| *** gokrokve has joined #openstack-infra | 21:59 | |
| fungi | rbradfor_: cross-project meeting | 21:59 |
| fungi | though it's about to end now | 21:59 |
| clarkb | jeblair: need to fuel my space heater somehow | 22:00 |
| mordred | vipul: gimme a sec- brain bleeding on a different task ... | 22:00 |
| nibalizer | clarkb: my change adds some repos for our (to be written) beaker plugins to make beaker less janky | 22:00 |
| jeblair | fungi: oh i'm 0.9.9. let me see if that's related. | 22:00 |
| vipul | mordred: no worries.. get back to me when you get a break | 22:00 |
| clarkb | nibalizer: oh thats a project add, I read title as add the yaml file that tells beaker how to do things | 22:00 |
| jeblair | fungi: yep. 0.9.9 works, 1.0.4 breaks | 22:01 |
| fungi | jeblair: yeah, i 'pip install -U .' for maximum chaos | 22:01 |
| clarkb | jeblair: fungi I did a pip install -U so have latest sqlalchemy | 22:01 |
| *** dannywilson has quit IRC | 22:01 | |
| clarkb | I guess mine will break shortly then | 22:01 |
| crinkle | nibalizer: why would we need both localhost and nodepool? | 22:01 |
| jeblair | clarkb: i would not be surprised, but if you don't mind letting it finish for extra data, would be nice. | 22:01 |
| clarkb | jeblair: will do | 22:01 |
| alexsyip | Hi, I’m tryihng to setup a tempest job to run in jenkins, but I have a question. Could someone spare a minute to help me out? | 22:02 |
| *** Sukhdev has quit IRC | 22:02 | |
| clarkb | alexsyip: usually best to just ask | 22:02 |
| crinkle | nibalizer: I'm not convinced we need another hypervisor, there seem to be settings internal to beaker that make it a little more complex | 22:03 |
| alexsyip | clarkb: ok. I have this congress.yaml as a jenkins job: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/congress.yaml | 22:03 |
| crinkle | nibalizer: working on that now | 22:03 |
| *** changbl has quit IRC | 22:03 | |
| alexsyip | when I run this job, there’s an error saying that the congress/contrib/tempest directory does not exist: http://logs.openstack.org/81/179181/4/experimental/gate-congress-dsvm-api/26311bf/console.html.gz | 22:04 |
| *** dannywilson has joined #openstack-infra | 22:04 | |
| *** Sukhdev has joined #openstack-infra | 22:04 | |
| alexsyip | I assume that’s because devstack does not fetch the congress directory by default. | 22:04 |
| *** freerunner has quit IRC | 22:04 | |
| clarkb | alexsyip: I think there are two problems there, the first is the one you mention, the jenkins workspace doesn't have congress cloned to it | 22:05 |
| alexsyip | I have a change to set ENABLED_SERVICES=congress,tempest here: https://review.openstack.org/#/c/180726/1/jenkins/jobs/congress.yaml | 22:05 |
| *** gokrokve has quit IRC | 22:05 | |
| alexsyip | Does this look like the right way to fix this? | 22:05 |
| clarkb | alexsyip: the other is going to be that devstack-gate clones to /opt/stack/new/congress not to the workspace | 22:05 |
| clarkb | alexsyip: likely the correct fix is to set it up like a devstack plugin so that all of the cloning is done for you | 22:06 |
| *** gokrokve has joined #openstack-infra | 22:06 | |
| clarkb | alexsyip: then you can copy files as appropriate before having tempest run. You can see how the glusterfs plugin is done | 22:06 |
| alexsyip | Is there a description I can read about that? | 22:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make sure glance image list actually runs in Tasks https://review.openstack.org/185756 | 22:07 |
| mordred | clarkb, jeblair, greghaynes, SpamapS: ^^ | 22:07 |
| clarkb | alexsyip: yes devstack has a documentation page on it http://docs.openstack.org/developer/devstack/plugins.html | 22:07 |
| alexsyip | where can I find the glusterfs example? | 22:07 |
| *** amitgandhinz has quit IRC | 22:07 | |
| mordred | that's not needed this instant, but is needed overall | 22:07 |
| clarkb | alexsyip: in the same dir as your congress job | 22:07 |
| mordred | I'm going to release the current patch | 22:08 |
| clarkb | alexsyip: I am not sure of the exact file bit grep should tell you | 22:08 |
| clarkb | mordred: thanks | 22:08 |
| alexsyip | clarkb: ok thanks, I”ll check it out. | 22:08 |
| mordred | clarkb: btw - I ran this: http://paste.openstack.org/show/238572/ | 22:09 |
| mordred | clarkb: except with the right password | 22:09 |
| mordred | clarkb: since that's what nodepool is doing | 22:09 |
| mordred | clarkb: to verify that I got an image list back | 22:09 |
| mordred | clarkb: and similarly tested that it breaks without the patch, and that it throws a 401 if it does not like my username/password | 22:10 |
| greghaynes | clarkb: any idea what changed to make image builds slower? | 22:10 |
| clarkb | greghaynes: the disk volume | 22:10 |
| fungi | i can try swapping it to an ssd | 22:10 |
| clarkb | greghaynes: I am fairly certain the local ephemeral drive is significantly faster for IO than a cinder volume over the network | 22:11 |
| fungi | as i discovered today, we have rather a lot of ssd quota available | 22:11 |
| greghaynes | clarkb: where its stored to or where the cace is or both? | 22:11 |
| clarkb | greghaynes: both | 22:11 |
| clarkb | fungi: its probably worht a shot | 22:11 |
| greghaynes | fun | 22:11 |
| clarkb | mordred: your shade patch will map a single task to many api calls so not perfect for rate limiting but slightly better than the old case | 22:11 |
| fungi | i'll go ahead and create/attach one while i'm thinking about it and get the rsync going | 22:11 |
| greghaynes | eatmydata? | 22:11 |
| fungi | eatmyshorts | 22:12 |
| mordred | clarkb: nope - it actually just winds up being one api call | 22:12 |
| clarkb | greghaynes: shouldn't help since dib syncs at several locations | 22:12 |
| greghaynes | hah | 22:12 |
| mordred | clarkb: because BONGHITS | 22:12 |
| mordred | clarkb: it creates a generator that yields, so the first time you iterate on the generator is when the API call gets triggered | 22:12 |
| greghaynes | clarkb: yeaaaa :/ | 22:12 |
| *** ParsectiX has quit IRC | 22:12 | |
| clarkb | mordred: gotcha | 22:13 |
| *** annegentle has quit IRC | 22:13 | |
| mordred | clarkb: I patched urllib3 locally so that I could watch when it was actually opening a socket :) | 22:13 |
| mordred | because, you know, that should be necessary | 22:14 |
| *** kutija has quit IRC | 22:14 | |
| mordred | clarkb: ok. 0.6.2 tag has been pushed | 22:14 |
| mordred | for shade | 22:14 |
| clarkb | I see the release jobs are queued | 22:14 |
| *** enikanorov_ has joined #openstack-infra | 22:15 | |
| mordred | also - there was another image upload patch outstanding ... although it does not affect HP | 22:15 |
| mordred | but we would have wanted to release before adding rax to the mix anyway | 22:16 |
| mordred | oh - or - wait - no - it affects zero clouds that we use | 22:16 |
| mordred | it's a fix for v2 + PUT | 22:16 |
| clarkb | which no one uses not even devstack | 22:16 |
| mordred | aka - all non HP and non RAX clouds | 22:17 |
| *** Gomeler has joined #openstack-infra | 22:17 | |
| mordred | or at least some of them - I added it because I ran in to it testing other clouds :( | 22:17 |
| *** claudiub has joined #openstack-infra | 22:17 | |
| clarkb | https://pypi.python.org/pypi/shade/ that shows 0.6.2 now | 22:18 |
| clarkb | I am going to pip install shade==0.6.2 now | 22:18 |
| clarkb | on nodepool.o.o | 22:18 |
| mordred | cool | 22:18 |
| *** hdd has quit IRC | 22:19 | |
| mordred | clarkb: actually, I'm queued up to run the image upload command from before | 22:19 |
| mordred | if you want | 22:19 |
| mordred | or - sudo -H -u nodepool nodepool image-upload hpcloud-b1 devstack-trusty is what I ran back then | 22:19 |
| clarkb | already running it, thanks | 22:19 |
| mordred | woot | 22:20 |
| * mordred crosses fingers | 22:20 | |
| clarkb | it hasn't immediately thrown an error | 22:20 |
| clarkb | so thats progress | 22:20 |
| mordred | yay! | 22:21 |
| SpamapS | seconds of uptime!! | 22:21 |
| mordred | well - it takes a few minutes - because it has to compute md5 and sha1 of the images | 22:21 |
| SpamapS | thats _plural_ baby | 22:21 |
| fungi | clarkb: jeblair: mordred: i have a pvmove of the sata pv to the ssd pv going on now for nodepool | 22:21 |
| mordred | so don't get excited YES | 22:21 |
| mordred | YET | 22:21 |
| *** doug-fish has left #openstack-infra | 22:21 | |
| mordred | fungi: woot | 22:21 |
| jeblair | fungi: er, can you tl;dr that? | 22:22 |
| fungi | clarkb: jeblair: mordred: in a few hours i should be able to vgreduce the sata out and delete it | 22:22 |
| jeblair | sorry, i got sqlalchemied. | 22:22 |
| clarkb | mordred: fungi assuming the manual upload works I can restart nodepool | 22:22 |
| clarkb | then tomorrow we will see how it does | 22:22 |
| fungi | jeblair: yep, done it many times in years gone by, for example replacing one disk array with another live without taking the server offline | 22:22 |
| jeblair | fungi: oh, sorry, i mean, i missed why you're doing that | 22:22 |
| fungi | er, i misread | 22:23 |
| fungi | dib performance has apparently gotten slow since we moved the cache from an ephemeral volume to cinder | 22:23 |
| *** jklare has quit IRC | 22:23 | |
| clarkb | jeblair: our per image build time has gone from ~15 minutes to >1hour leading to about 6 hours to build all our dib images each day. We think this is related to the switch from local epehemeral disk to cinder volume | 22:23 |
| clarkb | (those times assume a warm dib cache) | 22:23 |
| fungi | and this is easy to try | 22:24 |
| jeblair | got it. ++ | 22:24 |
| jeblair | thx | 22:24 |
| fungi | as in, i can leave it running while i go cook dinner, then check in on it in a while ;) | 22:24 |
| fungi | 2% complete now | 22:24 |
| mordred | mmm. dinner | 22:24 |
| jeblair | fungi, clarkb: i have fixed gertty, i'm just inserting the fix into the stack now | 22:24 |
| fungi | i realize i should have started it in a screen session. oh well | 22:25 |
| clarkb | jeblair: cool, still waiting for it to fail here | 22:25 |
| clarkb | about 3/4 of the way done according to my little counter | 22:25 |
| *** waynr has joined #openstack-infra | 22:25 | |
| mordred | clarkb: you havea little counter? | 22:25 |
| clarkb | fungi: iirc pvmoves are resilient to the process going away and can be restarted | 22:25 |
| clarkb | mordred: ya its telling me how far along it has gotten | 22:25 |
| mordred | neat | 22:25 |
| fungi | clarkb: yep, but i won't bother interrupting it | 22:25 |
| clarkb | 7550/10098 ish | 22:25 |
| *** dims has quit IRC | 22:25 | |
| *** shardy has quit IRC | 22:27 | |
| mordred | clarkb: if we are seeing a stale token issue when we run in the daemon - I'm going to have to yell at morganfainberg ... I mean learn more about how to detect and retry that | 22:27 |
| *** gordc has quit IRC | 22:27 | |
| clarkb | mordred: see I thought keystone clients session stuff was supposed to handle this for us which probably means glance client isn't using that stuff? | 22:27 |
| clarkb | jamielennox: ^ is probably the person to ask | 22:27 |
| *** dims has joined #openstack-infra | 22:28 | |
| *** jklare has joined #openstack-infra | 22:28 | |
| clarkb | mordred: image upload done manually worked | 22:28 |
| morganfainberg | clarkb: iirc glanceclient is the odd one out | 22:28 |
| clarkb | morganfainberg: awesome | 22:28 |
| morganfainberg | clarkb: it has some oddities that make it harder to do the session thing | 22:28 |
| morganfainberg | clarkb: jamielennox was talking about this at one point | 22:28 |
| *** nelsnelson has quit IRC | 22:28 | |
| clarkb | mordred: fungi so I am going to go ahead and restart nodepool.o.o now | 22:28 |
| clarkb | er not the host just the service | 22:29 |
| morganfainberg | clarkb: it means we have more work to do :( and my sincerest apology for not having it all done sooner. *sorry* :( | 22:29 |
| morganfainberg | clarkb: cause this does suck as a user to have to deal with | 22:29 |
| clarkb | morganfainberg: the thing that is weird to me is we all have to auth with keystone | 22:29 |
| clarkb | morganfainberg: so how hard can it be to all do that the same way in the same language as part of the asme project | 22:29 |
| *** akshai has quit IRC | 22:29 | |
| clarkb | argle bargle | 22:29 |
| mordred | morganfainberg: so - once it's on session it'll be good? | 22:29 |
| morganfainberg | clarkb: keystoneauth - we are making a push that way for *this* exact reason | 22:30 |
| clarkb | mordred: aiui yes | 22:30 |
| morganfainberg | mordred: yah that is my understanding | 22:30 |
| clarkb | morganfainberg: sure but keystoneclient was the thing before that | 22:30 |
| *** camunoz has joined #openstack-infra | 22:30 | |
| clarkb | morganfainberg: so we can't just say having a common lib is going to fix it | 22:30 |
| mordred | clarkb: yah. well, glance and ironic (/me glares at devananda) are the two holdouts | 22:30 |
| mordred | clarkb: well, no - it won't fix it | 22:30 |
| morganfainberg | clarkb: ksc was the way we got most things done. KSA is fixing some issues with KSC as we finish it all up | 22:30 |
| mordred | clarkb: but the other clients hadn't moved all the way to ksc.Session yet | 22:30 |
| mordred | most notably glanceclient | 22:30 |
| morganfainberg | clarkb: mostly a speed/load lots of cruft issue | 22:30 |
| clarkb | mordred: I know, my point is that saying KSA doesn't fix the problem which is we suck at actually implementing the things | 22:30 |
| mordred | clarkb: totally agree | 22:31 |
| clarkb | mordred: because KSC/KSA isn't aprt of the problem here | 22:31 |
| mordred | the problem here is finishing porting the client libs to teh solution we actually ahve | 22:31 |
| morganfainberg | and i know glanceclient is on the short list. | 22:31 |
| mordred | not the KSC/KSA thing | 22:31 |
| fungi | clarkb: sounds good | 22:31 |
| morganfainberg | so we can get it fixed. | 22:31 |
| mordred | morganfainberg: btw - while we're yelling and screaming | 22:31 |
| morganfainberg | i know it was a real issue in the internal workings. | 22:31 |
| *** hdd has joined #openstack-infra | 22:31 | |
| *** tonytan4ever has quit IRC | 22:31 | |
| mordred | morganfainberg: I would like to say something _nice_ for a change | 22:31 |
| clarkb | nodepool service has been restarted | 22:31 |
| *** miqui has quit IRC | 22:32 | |
| morganfainberg | mordred: oh crap! *braces for nice words* | 22:32 |
| mordred | I tried to use python to connect to a google API over the weekend using oauth | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Do not enqueue duplicate tasks https://review.openstack.org/172650 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Support regexes in search https://review.openstack.org/172649 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add database pruning https://review.openstack.org/179981 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Attach comments to files https://review.openstack.org/179980 | 22:32 |
| mordred | keystone is awesome | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add files table https://review.openstack.org/179979 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add ability to review multiple changes at once https://review.openstack.org/185695 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix searching for message https://review.openstack.org/172667 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Advance cursor on change list toggle https://review.openstack.org/185698 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow reviewing one change in change list https://review.openstack.org/185697 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix updating flags on threaded changes https://review.openstack.org/185696 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Make "limit" a noop in queries https://review.openstack.org/172670 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix searching by reviewer account id https://review.openstack.org/172669 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix age searching https://review.openstack.org/172668 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Batch sync change by commit tasks https://review.openstack.org/172691 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix refresh on project and change lists https://review.openstack.org/183887 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix diff display of deleted empty files https://review.openstack.org/180546 | 22:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add support for SQLAlchemy 1.0.4 https://review.openstack.org/185761 | 22:32 |
| jeblair | mordred: that's what i have to say about that | 22:32 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Add ubuntu-trusty images to rax https://review.openstack.org/185762 | 22:32 |
| morganfainberg | mordred: that... feels like damnation through faint praise :P but I'll still take it! | 22:32 |
| mordred | EVERYTHING about the google api experience was the worst thing ever | 22:32 |
| jroll | mordred: lol. been there, google oauth is the worst. | 22:32 |
| morganfainberg | mordred: that would be my experience with Oauth. | 22:32 |
| clarkb | mordred: fungi greghaynes ^ depending on how adventurous we are that is the next piece in this | 22:32 |
| morganfainberg | mordred: just in general | 22:32 |
| mordred | clarkb: I see no issues with landing that - it won't break existing thigns :) | 22:33 |
| jeblair | clarkb, fungi: ^ should fix it for 1.0.4. i increased the requirement but also made it work with both 0.9.9 and 1.0.4 to try to avoid breaking people during schema migrations | 22:33 |
| devananda | mordred: I feel like I'm missing some context about KSC and python-ironicclient | 22:33 |
| clarkb | mordred: correct, my vote is to land it then pay attention tomorrow | 22:33 |
| mordred | morganfainberg: yah. it wasn't really even google - it was "how the heck is someone supposed to _USE_ this oauth crap" | 22:33 |
| morganfainberg | clarkb: so let me chase down jamielennox here sooon and talk about glanceclient fixes and the move to KSA down the line should be good. | 22:33 |
| mordred | clarkb: ++ | 22:33 |
| devananda | i also haven't read all of backscroll | 22:33 |
| mordred | devananda: keystone Session | 22:33 |
| mordred | devananda: you're still not on it | 22:34 |
| jroll | morganfainberg: the bonus with google is there's a whole bunch of google-centric oauth libraries that barely work, so it takes a couple hours of rage before you even get to the "let's do normal oauth" rage | 22:34 |
| mordred | devananda: you want to me | 22:34 |
| mordred | devananda: you want to be | 22:34 |
| devananda | oh. yes. I hate our clients lack of session handling | 22:34 |
| mordred | devananda: yes | 22:34 |
| mordred | devananda: you do not disagree | 22:34 |
| clarkb | devananda: which means if tokens expire *I* have to get a new one | 22:34 |
| morganfainberg | jroll: oh so take the hell that is oauth and make it more... oauth-y? :P | 22:34 |
| fungi | jeblair: thanks. i'll try it again shortly | 22:34 |
| clarkb | jeblair: still waiting for mine to finish | 22:34 |
| jroll | morganfainberg: something like that, it's been years :P | 22:34 |
| mordred | jroll: it's gotten worse then if it's been years | 22:34 |
| *** radez is now known as radez_g0n3 | 22:34 | |
| morganfainberg | mordred: seriously, OIDC - its the least icky of the non-SAML things... | 22:35 |
| jroll | mordred: oh, goody | 22:35 |
| mordred | jroll: NOW they have multiple different api suites that barely work, docs that talk about old auth, and docs that say don't use that use the new oauth2 - except with no libraries really updated to use it | 22:35 |
| morganfainberg | but it's still a pile of ick | 22:35 |
| morganfainberg | as a developer | 22:35 |
| devananda | mrda: this might be a thing you have thoughts about / time to fix | 22:35 |
| morganfainberg | as a user... it's cool "click" oh lookie i'm logged in | 22:35 |
| *** lifeless has quit IRC | 22:35 | |
| clarkb | mordred: it would also be awesome if your token expired was a different error than lol auth failed | 22:35 |
| zigo | SpamapS: The urlparse issues are trivial to fix. | 22:35 |
| devananda | mrda: since you're already implementing some caching in our client. want to make it use keystone session too? (or does this request make you want to throw cats at me?) | 22:35 |
| fungi | jeblair: migration is running again with a fresh checkout of 179980 | 22:36 |
| zigo | SpamapS: Should I do it on top of your patches, or are you doing it? | 22:36 |
| SpamapS | zigo: Yes I'm working through things in smaller chunks because fixing those produces more not-easy errors. :) | 22:36 |
| clarkb | mordred: because then I as the user could more easily test that condition and get a new token, whereas the current implementation probably means we will naively assume expired token, make a new one, try then if still failing raise | 22:36 |
| jamielennox | morganfainberg: i'm in and out but the glanceclient review is https://review.openstack.org/#/c/141994/ they've been slow in reviewing it but i chased down a few people at summit to move it along | 22:36 |
| *** annegentle has joined #openstack-infra | 22:36 | |
| jroll | mordred: yeah, that sounds like the pain I was hitting, maybe they were google api libraries that didn't work with the oauth version the server was using | 22:36 |
| morganfainberg | clarkb: i'd be ok with making that kind of change - can i use HTTP 402? | 22:36 |
| mordred | clarkb: ++ | 22:36 |
| jamielennox | morganfainberg: i don't really want to wait for ksa, i'll get it merged like that and it can consume ksa like everyone else will | 22:36 |
| morganfainberg | clarkb: pay us and we'll let you back in? :P | 22:36 |
| morganfainberg | jamielennox: wasn't advocating waiting on glanceclient | 22:36 |
| mordred | clarkb: well, thing is - many things do late binding - so if I detected a token fail HEAVEN HELP ME to fix it | 22:36 |
| *** mwhagedorn has quit IRC | 22:36 | |
| *** krtaylor has quit IRC | 22:37 | |
| morganfainberg | jamielennox: was saying we should get them over to session *then* the move to KSA is easier | 22:37 |
| mordred | ++ | 22:37 |
| mordred | because the move to ksa will be the same as the other moves to ksa | 22:37 |
| mrda | devananda: will read this conversation over and take a look | 22:37 |
| morganfainberg | jamielennox: getting them on session is more important than KSA. | 22:37 |
| zigo | SpamapS: I've tried adding python3 support in oslo.messaging, though I get issues with eventlet.monkey_patch(), do you know what should be done for that? | 22:37 |
| SpamapS | zigo: Victor is working on that | 22:37 |
| clarkb | morganfainberg: 408? | 22:37 |
| zigo | Ah, cool. | 22:37 |
| SpamapS | zigo: it already passes most tests | 22:37 |
| zigo | :) | 22:37 |
| clarkb | morganfainberg: thats probbaly overloading things a bit | 22:38 |
| jamielennox | yep, ok so it's in progress and i've got a few people on the hook to get it done | 22:38 |
| morganfainberg | clarkb: nope, that implies no-change in the request needed | 22:38 |
| morganfainberg | clarkb: we need to change the request in this case, new authorization | 22:38 |
| *** otter768 has joined #openstack-infra | 22:38 | |
| clarkb | morganfainberg: glance could tell me 408 and I think that would be ok | 22:38 |
| morganfainberg | could a token be considered a pre-condition? | 22:38 |
| clarkb | morganfainberg: then go get a new token, and make same request back to glance again | 22:39 |
| morganfainberg | 412 Precondition Failed | 22:39 |
| clarkb | anyways I don't care what the error is just trying to point out that this is all very unhelpful to users | 22:39 |
| morganfainberg | clarkb: from a strict security perspective... timeout token is no different than invalid token | 22:39 |
| clarkb | morganfainberg: iirc preconditions are specific headers? | 22:39 |
| *** Gomeler has left #openstack-infra | 22:39 | |
| clarkb | morganfainberg: yes but it doesn't tell your user how to fix the problem | 22:39 |
| morganfainberg | clarkb: "The precondition given in one or more of the request-header fields evaluated to false when it was tested on the server." | 22:40 |
| clarkb | morganfainberg: 99% of your users will immediately go check username and password | 22:40 |
| SpamapS | zigo: in fact recently I think it was just qpid failing. | 22:40 |
| clarkb | morganfainberg: then swear up and down they are correct (because they are), then give up and drink until liver failure | 22:40 |
| zigo | SpamapS: As far as I know, the plan is to just disable tests in Py3 + qpid. | 22:40 |
| zigo | Which is fine to me ... | 22:40 |
| SpamapS | zigo: thats already done, they're just skipped | 22:40 |
| morganfainberg | clarkb: like i said, strictly from a security perspective. - i'd like to look to see if we can find some prior art on how to handle this. | 22:41 |
| zigo | So, what's the issue then? | 22:41 |
| *** ayoung has quit IRC | 22:41 | |
| zigo | listing tests? | 22:41 |
| morganfainberg | clarkb: and see if we can follow said accepted prior art | 22:41 |
| SpamapS | zigo: some zmq stuff and ??? ask Victor | 22:41 |
| samueldmq | 418 I'm a teapot lol | 22:41 |
| zigo | Ah ok. | 22:41 |
| morganfainberg | clarkb: if we are making a change. | 22:41 |
| morganfainberg | but i'm not really opposed to giving better feedback where we can reasonably do so. | 22:41 |
| mordred | morganfainberg: I may have convinced ayoung that it's ok for us to return unauthorized instead of api not found for api endpoints taht are disabled by policy | 22:41 |
| mordred | morganfainberg: because even though strict security would blanch at that from a probing perspective | 22:41 |
| morganfainberg | mordred: disabled by policy should be 403 | 22:42 |
| morganfainberg | period | 22:42 |
| morganfainberg | forbidden. | 22:42 |
| mordred | disagree 100% | 22:42 |
| morganfainberg | but not 404 | 22:42 |
| morganfainberg | definitely not 404 | 22:42 |
| mordred | oh! yes | 22:42 |
| mordred | agree 100% | 22:42 |
| mordred | :) | 22:42 |
| mordred | I believe right now they 404 | 22:42 |
| morganfainberg | if it's a policy, a 403 indicates your request [and authorization] cannot access the resource | 22:42 |
| clarkb | does KSC/KSA provide a method to check if the token is expired? | 22:42 |
| dstufft | it should be a random code every request | 22:43 |
| mordred | dstufft: ++ | 22:43 |
| clarkb | we could just brute force it and check expiry prior to every request | 22:43 |
| morganfainberg | clarkb: jamielennox ^ - i think we have a method for that. | 22:43 |
| clarkb | mordred: ^ | 22:43 |
| *** otter768 has quit IRC | 22:43 | |
| morganfainberg | clarkb: or a "near expired" check | 22:43 |
| mordred | clarkb: yah. I think we can do that | 22:43 |
| * mordred goes to look | 22:43 | |
| jamielennox | we do that | 22:43 |
| jamielennox | i think it's like within 2 minutes of expiry | 22:43 |
| clarkb | jamielennox: ya but now we need to do it again because glanceclient doesn't ksc/ksa session | 22:43 |
| mordred | and we're hitting app failures because of long-lived processes | 22:43 |
| morganfainberg | mordred: i really really hope we aren't 404ing policy disables. i might need to break some fingers if we are. | 22:43 |
| samueldmq | morganfainberg, looks like there is a "440 Login Timeout", but as a microsoft standard though | 22:44 |
| mordred | and we need to work around it in the short term | 22:44 |
| morganfainberg | samueldmq: euuuuuwwww. | 22:44 |
| openstackgerrit | Merged openstack-infra/irc-meetings: In tox, write output to subdir https://review.openstack.org/185678 | 22:44 |
| morganfainberg | samueldmq: :P | 22:44 |
| clarkb | mordred: so that would be my vote for the shade image_create method (and probably others) to check the token, manually make a new one if near expiry then do upload | 22:44 |
| jhesketh | Morning | 22:44 |
| samueldmq | morganfainberg, shhhh, I didnt really say that :p | 22:44 |
| pleia2 | morning jhesketh | 22:44 |
| openstackgerrit | John L. Villalovos proposed openstack/requirements: Add simplegeneric to requirements https://review.openstack.org/185770 | 22:44 |
| mordred | clarkb: ++ | 22:44 |
| clarkb | mordred: now to figure out how to do that in shade | 22:44 |
| mordred | clarkb: well, it probably wants to go into def _glance_client | 22:45 |
| morganfainberg | jamielennox: let me know if i need to chase any glance folks down so we can get that in ASAP | 22:45 |
| jeblair | jhesketh: if you can give 182811 a once-over and make sure the new rev lgty, i would appreciate it | 22:45 |
| mordred | clarkb: since that will get invoked to get the glance_client object anyway | 22:45 |
| morganfainberg | jamielennox: i'm in a chase people down and get things fixed soon for our users mood. | 22:45 |
| clarkb | mordred: you can't do it then as that is too late | 22:45 |
| clarkb | mordred: you have to do it prior to the request | 22:45 |
| mordred | clarkb: it is prior to the request | 22:45 |
| morganfainberg | ugh. | 22:46 |
| clarkb | mordred: let me rephrase, you have to check it immediately prior to the request | 22:46 |
| mordred | yes | 22:46 |
| mordred | I grok | 22:46 |
| morganfainberg | is this a case where glanceclient is spinning on something long enough to break due to timeout? | 22:46 |
| mordred | clarkb: self.glance_client is a property that gets the glance client object when you request it | 22:46 |
| jokke_ | sorry just noticed ... what's up with glance? | 22:46 |
| clarkb | mordred: anything in the middle opens you to breaking either because of the task manager or other | 22:46 |
| jamielennox | i was putting stuart mclaren on the hook (i ca'nt remember his irc) so if you want to go and poke glance people that would be useful | 22:46 |
| morganfainberg | jokke_: need to get keystoneclient session fix/support merged into glance client | 22:46 |
| jamielennox | what consumer are we discussing? | 22:46 |
| clarkb | jamielennox: shade | 22:47 |
| mordred | clarkb: ok. so it COULD break if the taskmanager kept the task in the queue long enough | 22:47 |
| jokke_ | nikhil is online and I'm here ... will have a look | 22:47 |
| morganfainberg | jokke_: https://review.openstack.org/#/c/141994/ | 22:47 |
| mordred | do we have the keystone api thing for checking a token handy? | 22:48 |
| clarkb | morganfainberg: yes I think what happens is we get glanceclient, then for image in images: client.upload() but since uploads are slow because lots of data eventually the token expires | 22:48 |
| clarkb | morganfainberg: and instaed of making a new token we fail | 22:48 |
| *** ddieterly has joined #openstack-infra | 22:48 | |
| jamielennox | expiry during the operation shouldn't matter | 22:48 |
| clarkb | mordred: no I haven't found it yet was reading shade first to figure out where to put this | 22:48 |
| clarkb | jamielennox: we have a ton of them | 22:49 |
| mordred | clarkb: I think for now let's solve it in glance_Client since the only race there is super-long task queue | 22:49 |
| morganfainberg | clarkb: ok but it's not fundamentally an issue with the operation it's a subsequent request? | 22:49 |
| clarkb | jamielennox: so the first one is fine | 22:49 |
| clarkb | morganfainberg: I think so | 22:49 |
| mordred | clarkb: we can re-fetch the glance_client each time, which would retrigger the token age check | 22:49 |
| morganfainberg | clarkb: cool | 22:49 |
| jamielennox | yea, ok, so if we consumed session then it would refresh the token automatically | 22:49 |
| mordred | clarkb: then expect glanceclient ksc.Session to solve it for realses | 22:49 |
| *** arxcruz has quit IRC | 22:49 | |
| mordred | jamielennox: yah - we're talking a fix for us by tomorrow | 22:49 |
| jamielennox | i'll refresh that patch today to address comments but if people want to put some pressure on the glance-core team to make it a priority that's useful | 22:49 |
| mordred | it can be hacky | 22:49 |
| mordred | while we wait on your patch to land and get released | 22:50 |
| morganfainberg | jamielennox: you have jokke_ ready to look at it | 22:50 |
| jamielennox | ok, the hacky fix is to fetch a new token and create a client with it before operation | 22:50 |
| *** ddieterly has quit IRC | 22:50 | |
| jamielennox | if you do Session(auth=plugin) | 22:50 |
| *** davideagnello has quit IRC | 22:50 | |
| morganfainberg | jamielennox: so i think we can address that with the refresh. | 22:50 |
| *** prad has quit IRC | 22:50 | |
| jamielennox | then do session.get_token() | 22:50 |
| jamielennox | that token will always be valid for the next 2 minutes | 22:50 |
| jamielennox | so if you do that prior to every op it should solve the immediate problem | 22:51 |
| *** davideagnello has joined #openstack-infra | 22:51 | |
| jokke_ | jamielennox: https://review.openstack.org/#/c/141994 < that one? | 22:51 |
| jokke_ | oh thanks morganfainberg | 22:52 |
| jamielennox | get_token will only re-auth if required as well, it will reuse if possible | 22:52 |
| jamielennox | jokke_: yep | 22:52 |
| clarkb | I probably don't want to know why image upload is really an image create then an image update | 22:52 |
| * clarkb goes back to fixing shade | 22:52 | |
| openstackgerrit | Merged openstack-infra/system-config: Fix typo in irc-meetings https://review.openstack.org/185669 | 22:53 |
| morganfainberg | clarkb: 1st rule of asking questions... if you don't want to know the answer........... | 22:53 |
| *** e0ne has quit IRC | 22:53 | |
| clarkb | jamielennox: by reuse you mean it its at no cost because it will return the same token if it isn't near expiry? | 22:54 |
| morganfainberg | clarkb: correct | 22:55 |
| clarkb | cool that simplifies shade a little | 22:55 |
| *** dimtruck is now known as zz_dimtruck | 22:55 | |
| *** bswartz has joined #openstack-infra | 22:55 | |
| jokke_ | yeah so looking the reviews, there is quite a bit of concerns to address still before that's gonna land. | 22:55 |
| mordred | hang on | 22:55 |
| mordred | clarkb: how does that simplify anything? | 22:55 |
| clarkb | mordred: because now shade doesn't ahve to check | 22:56 |
| jokke_ | jamielennox: btw thanks for addressing the spec and marking the bp to the commit message | 22:56 |
| mordred | clarkb: and no - you do NOT want to know about the create/update sequence | 22:56 |
| mordred | :) | 22:56 |
| clarkb | mordred: instead shades auth_token property is just return ksc.session.get_token() | 22:56 |
| mordred | clarkb: ah - instead of the caching it does | 22:56 |
| mordred | yah | 22:56 |
| clarkb | yup | 22:56 |
| openstackgerrit | Merged openstack-infra/shade: Make sure glance image list actually runs in Tasks https://review.openstack.org/185756 | 22:56 |
| clarkb | so I am working on that patch now | 22:56 |
| mordred | cool | 22:56 |
| mordred | clarkb: we'll need to ALSO not cache the glance client object I think | 22:57 |
| *** dguerri is now known as dguerri`away | 22:57 | |
| mordred | clarkb: so that each use of self.glance_client retriggers the auth_token | 22:57 |
| fungi | jeblair: gertty starts for me after migration now | 22:57 |
| jeblair | fungi: \o/ | 22:57 |
| mordred | clarkb: of course, given the cost of glance operations, that's probably fine | 22:57 |
| clarkb | mordred: correct | 22:58 |
| mordred | clarkb: cool - then we can move back to sanity when jamielennox's patch lands and glanceclient releases | 22:58 |
| clarkb | yup | 22:58 |
| *** stevemar has quit IRC | 22:58 | |
| fungi | jeblair: and i can successfully search for changes by changed filename... bonus! | 22:58 |
| mordred | although I think we should never cache the auth_token | 22:58 |
| morganfainberg | yay sanity will return. | 22:58 |
| clarkb | mordred: I need to figure out what OperatorCloud is doing with the auth token though as its special | 22:58 |
| mordred | since ksc.Session seems to be doing a good job of that already | 22:58 |
| jamielennox | afaik after glance it's only swift of the "major" projects that is lacking session | 22:59 |
| mordred | clarkb: it's related to ironic | 22:59 |
| mordred | clarkb: they have a no-keystone mode of operation | 22:59 |
| clarkb | mordred: because ironic doesn't always do keystone | 22:59 |
| clarkb | right | 22:59 |
| jamielennox | mordred: know any oyhers? | 22:59 |
| mordred | clarkb: which we represent with a auth_type of None | 22:59 |
| clarkb | mordred: gotcha | 22:59 |
| mordred | jamielennox: and ironic | 22:59 |
| jamielennox | mordred: a no-op plugin to ignore keystone auth will work just fine with Sessions | 23:00 |
| mordred | jamielennox: does one of those exist? | 23:00 |
| jamielennox | there's token_endpoint | 23:00 |
| mordred | jamielennox: if not, perhaps we should make one of those as part of moving python-ironicclient to ksc.Session | 23:00 |
| jamielennox | because you will still need to specify the ironic endpoint | 23:00 |
| jhesketh | jeblair: reviewed 182811 with a few comments | 23:00 |
| sigmavirus24 | is there a way in gertty to determine which changes are hidden? I'm trying to figure out why the dashboard says I have 2 unreviewed changes in a project that shows no changes and I'm guessing the reviews are hidden because of vim memory muscle | 23:01 |
| jamielennox | i can't remember if there is an issue if you pass an empty/None token to token_endpoint | 23:01 |
| clarkb | sigmavirus24: iirc its because by default you don't see WIP changes | 23:02 |
| clarkb | sigmavirus24: 'L' may list them all | 23:02 |
| sigmavirus24 | clarkb: Ah, that might be it. Thanks! | 23:02 |
| morganfainberg | clarkb, mordred: i've been having chats w/ devananda about ironic and non-keystone modes. | 23:02 |
| devananda | morganfainberg: ++ | 23:03 |
| mordred | morganfainberg: funny - I just pinged you about that in their channel | 23:03 |
| morganfainberg | mordred: my laptop lost wifis again... cannot wait for the x1c tomorrow. | 23:03 |
| morganfainberg | mordred: so missed the ping initially | 23:03 |
| mordred | morganfainberg: JEALOUS | 23:03 |
| *** soren_ has quit IRC | 23:04 | |
| morganfainberg | mordred: i next-day ordered it because i wanted it before the trip to vegas. | 23:04 |
| mordred | nice | 23:04 |
| *** bknudson has quit IRC | 23:05 | |
| *** ajmiller_ has joined #openstack-infra | 23:05 | |
| fungi | sigmavirus24: the context help in the change list view confirms l is "Toggle whether only unreviewed or all changes are displayed" | 23:05 |
| sigmavirus24 | fungi: That only shows changes that are already marked as reviewed though. I'm investigating | 23:06 |
| clarkb | mordred: once tox is done running I should be able to push up these changes | 23:06 |
| *** ZZelle_ has quit IRC | 23:07 | |
| *** jsavak has quit IRC | 23:07 | |
| fungi | sigmavirus24: if i switch an unreviewed change to hidden with the k yet then l redisplays it | 23:08 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update team structure and add council https://review.openstack.org/182811 | 23:08 |
| jeblair | jhesketh: ^ | 23:08 |
| fungi | er, s/yet/key/ | 23:08 |
| sigmavirus24 | fungi: ah, so it must be WIP changes that are being hidden by my config | 23:08 |
| sigmavirus24 | Thanks for the help fungi and clarkb | 23:09 |
| *** ParsectiX has joined #openstack-infra | 23:09 | |
| *** ajmiller has quit IRC | 23:09 | |
| *** chlong has joined #openstack-infra | 23:09 | |
| *** annegentle has quit IRC | 23:11 | |
| clarkb | mordred: this will also make our auth_token stuff more correct as the session we pass to eg novaclient may make a new token without us knowing | 23:11 |
| clarkb | mordred: also we do pass the session to glanceclient but I guess it isn't using it to its full potential | 23:12 |
| mordred | clarkb: ++ | 23:12 |
| mordred | clarkb: it pretty much ignores it AIUI | 23:12 |
| clarkb | fun | 23:12 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade: Don't cache keystone tokens as KSC does it for us https://review.openstack.org/185781 | 23:12 |
| openstackgerrit | Clark Boylan proposed openstack-infra/shade: Always refresh glanceclient for tokens validity https://review.openstack.org/185782 | 23:12 |
| clarkb | mordred: ^ that should do it | 23:12 |
| *** Sukhdev has quit IRC | 23:13 | |
| mordred | clarkb: woot | 23:13 |
| *** mohitsharma has joined #openstack-infra | 23:13 | |
| clarkb | I am trying to think about how we can test that, but by deferring to KSC I think we are relying on their tests instead | 23:14 |
| *** chlong has quit IRC | 23:15 | |
| *** markvoelker has quit IRC | 23:15 | |
| mordred | clarkb: I agree | 23:15 |
| mordred | clarkb: +2 from me on both | 23:16 |
| mordred | clarkb: perhaps jeblair or jhesketh or pleia2 or fungi will be friendly and give us a +A ... | 23:16 |
| pleia2 | I'll have a look | 23:16 |
| fungi | i can be convinced to take a break from evening and review it | 23:16 |
| mordred | \o/ | 23:16 |
| fungi | evening is not a gerund. eveninging | 23:16 |
| Clint | it is one, it's just not the one you want | 23:17 |
| * fungi successfully gerunds a noun which already ends in ing | 23:17 | |
| fungi | Clint: fair point. it was a gerund which got nouned in common parlance ages ago | 23:17 |
| *** annegentle has joined #openstack-infra | 23:17 | |
| *** mohitsharma has quit IRC | 23:18 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Add 'fasteners' package https://review.openstack.org/163666 | 23:18 |
| mordred | fungi: oh - wait - really? | 23:18 |
| *** yamamoto has quit IRC | 23:18 | |
| jokke_ | jamielennox: just read your spec ... makes way more sense than on the first read of the patch ... hopefully we get that moving | 23:19 |
| mordred | fungi: evening is actually originally related to the verb "to even" ? | 23:19 |
| fungi | mordred: according to the etymologies i find | 23:19 |
| jhesketh | jeblair: thanks, lgtm | 23:20 |
| clarkb | I don't even | 23:20 |
| *** Sukhdev has joined #openstack-infra | 23:20 | |
| Clint | because the light and the dark become even | 23:20 |
| jhesketh | mordred: looking | 23:20 |
| clarkb | harlowja_: I have to question why oslo.* exists if not to be the central location for these utilities (re fasteners above) | 23:20 |
| clarkb | harlowja_: what is the problem with having it live in oslo.concurrency? | 23:21 |
| harlowja_ | sooo i think the general idea is that oslo.* libraries just provide openstack specific config, tweaks, ..., while general libraries provide the actual functionality | 23:22 |
| clarkb | jeblair: I may be overthinking it but does the council voting thing need a quorum set? | 23:22 |
| harlowja_ | for ex, providing oslo.config common usage (which oslo.concurrency does), providing common decorators (which oslo.concurrency does) | 23:22 |
| mordred | clarkb: I vote overthinking, but we may not have reached quorum | 23:22 |
| clarkb | harlowja_: really? I was always under the impression that oslo was the general functionality lib (granted they grow out of what openstack has been doing) | 23:22 |
| harlowja_ | the world is bigger than just openstack imho | 23:22 |
| clarkb | harlowja_: ya but the world should just use oslo that is why oslo exists | 23:23 |
| pleia2 | fungi: were you looking at these clark patches too? (held off +A just in case you're in the middle of reviewing) | 23:23 |
| harlowja_ | clarkb the world isn't openstack though | 23:23 |
| fungi | pleia2: yep, jhesketh approved one and i approved the other | 23:23 |
| clarkb | harlowja_: at least that was the intention way back when markmc made oslo | 23:23 |
| fungi | so we'll all be to blame when it breaks even worse ;) | 23:23 |
| pleia2 | oh, hah, I didn't refresh quick enough :) | 23:23 |
| clarkb | harlowja_: yes but oslo isn't supposed to be openstack specific | 23:23 |
| harlowja_ | thats pretty much what all the oslo.* libraries are | 23:23 |
| jeblair | clarkb: let's see how it works without over-specifying first. i think that as long as we have notice, people will have ample time to vote on specs. | 23:23 |
| clarkb | anyways I don't oslo so don't really have a fight here, its just very odd to see oslo be less generic | 23:23 |
| harlowja_ | sure, https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Choosing_a_Name sorta states some of this | 23:25 |
| clarkb | mordred: where is the glance v2+PUT shade fix? I can review that so it gets in too before the next release | 23:25 |
| fungi | harlowja_: clarkb: i vaguely recall at least at one point that the idea was that oslo.* libraries were for openstack-specific shared/common functionality and that non-openstack-specific libraries were encouraged to not live in the oslo namespace | 23:25 |
| harlowja_ | ya thats my understanding to | 23:25 |
| mordred | clarkb: landed already | 23:25 |
| harlowja_ | its a balance in reality | 23:25 |
| mordred | clarkb: it's the the release we just made | 23:25 |
| fungi | but it's always possible the groupthink has moved on since the last time i updated | 23:25 |
| clarkb | fungi: hrm I really thought that the reason markmc picked a name like oslo was specifically so that we wouldn't assume it was all openstack specific | 23:25 |
| clarkb | fungi: otherwise we would've called it openstack-concurrency | 23:25 |
| mordred | clarkb: sorry - when I mentioned it earlier - it was from looking at the list of patches taht were being released | 23:26 |
| clarkb | mordred: gotcha | 23:26 |
| mordred | clarkb: I thnk we were trying to be carefuller about the name back then | 23:26 |
| mordred | the openstack name | 23:26 |
| mordred | like, "openstack-concurrency" or "openstack-db" might confusel people | 23:26 |
| harlowja_ | clarkb well oslo as a prefix i think has started to mean things like 'oslo.db' provides openstack specifics ontop of sqlalchemy | 23:27 |
| harlowja_ | maybe thats not what it was intented to be, but seems how thats how it has turned out | 23:27 |
| *** gokrokve has quit IRC | 23:27 | |
| harlowja_ | *imho thats for the better, let other libraries do the work, not recreate the world | 23:27 |
| clarkb | harlowja_: except in this case its a noop | 23:28 |
| clarkb | you are just taking code from concurrency and putting it in fasteners | 23:28 |
| clarkb | whether it lives in one or the other is functionally equivalent from a recreate the world perspective | 23:28 |
| clarkb | except that oslo.concurrency already exists and provides the functionality | 23:28 |
| *** annegentle has quit IRC | 23:29 | |
| *** hdd has quit IRC | 23:30 | |
| *** wenlock1 has quit IRC | 23:30 | |
| harlowja_ | sure, but then all consuming libraries must bring in https://github.com/openstack/oslo.concurrency/blob/master/requirements.txt (which then makes consuming projects that much more openstack only) | 23:30 |
| *** hemna is now known as hemnafk | 23:31 | |
| *** wenlock has quit IRC | 23:31 | |
| harlowja_ | and not all libraries configure themselves via oslo.config, so it just makes the dependency tree bigger, all required to just have a interprocess lock... | 23:32 |
| clarkb | harlowja_: probably the only problematic deps there are iso8601 and oslo.confg? | 23:32 |
| harlowja_ | right, which goes back to the oslo.concurrency not doing alot of its own stuff (providing the oslo.config 'glue' *only*), but using other libraries that are generalized | 23:33 |
| *** annegentle has joined #openstack-infra | 23:33 | |
| clarkb | or just providing the functionality without those deps | 23:33 |
| harlowja_ | sounds like the fasteners package ;) | 23:33 |
| * clarkb wonders what oslo.config is needed for concurrency helpers | 23:33 | |
| harlowja_ | https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L41 and a lot of that | 23:34 |
| clarkb | harlowja_: yes, I think my questions is why do we need two | 23:34 |
| clarkb | harlowja_: not that the idea of having simple functioanlity on its own is bad | 23:34 |
| clarkb | merely that if oslo isn't that then what it is | 23:34 |
| clarkb | er what is it | 23:34 |
| harlowja_ | well the general libraries in the community imho are the place where we should be using stuff from, providing openstack stuff ontop as needed (config, blah blah utility function) | 23:35 |
| harlowja_ | *the providing ontop is where oslo comes to be useful (at least the oslo.* libraries) | 23:35 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add ubuntu-trusty images to rax https://review.openstack.org/185762 | 23:35 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:35 | |
| fungi | clarkb: added logging config update ^ | 23:35 |
| clarkb | fungi: gah I missed that, thanks | 23:36 |
| fungi | np | 23:36 |
| clarkb | fungi: except | 23:36 |
| fungi | +2 | 23:36 |
| clarkb | fungi: that shouldn't need a logging update? | 23:36 |
| fungi | except? | 23:36 |
| clarkb | fungi: well its the same image so there is no new logging config | 23:36 |
| clarkb | ya I think our logging config generator is too greedy, we only need one logger per dib image | 23:37 |
| fungi | oh... this should be set to dib-type logs | 23:37 |
| clarkb | then its provider + image for snapshots | 23:37 |
| mordred | I really would love to do something different with that logging config | 23:38 |
| clarkb | fungi: so while it shouldn't hurt we may haev a small bug we can clean up here | 23:38 |
| mordred | ++ | 23:38 |
| fungi | yeah, i'm checking that now | 23:38 |
| mordred | I'm not going to | 23:38 |
| harlowja_ | clarkb now maybe this fasteners thing is a progression of moving to more general things (that aren't prefixed with oslo.*) that are useable by the whole python world (and then oslo shrinks); imho thats a fine way to go | 23:39 |
| clarkb | harlowja_: doesn't that imply either a bug in the underlying lib or a bug in how we are using the underlying lib? | 23:39 |
| clarkb | harlowja_: we shouldn't have to wrap every lib before using it, | 23:39 |
| mordred | harlowja_: I agree that its' a fine way to go | 23:39 |
| *** rguillebert has quit IRC | 23:39 | |
| mordred | I also agree with clarkb that for some of these things we should consider need to wrap them as a flaw upstream that should be fixed if possible | 23:39 |
| harlowja_ | flaw downstream imho ;) | 23:40 |
| harlowja_ | *in our usage | 23:40 |
| mordred | well, in this case I'd think the things we're wrapping are upstream from us | 23:40 |
| mordred | but - let's just say "a flaw in the thing we're wrapping" | 23:40 |
| harlowja_ | in some cases, yes, i think | 23:40 |
| harlowja_ | but not all | 23:40 |
| mordred | NO. ALL CASES MUST BE THE SAME | 23:40 |
| mordred | THERE ARE NO DIFFERENTS | 23:41 |
| harlowja_ | oslo.db, now u could say, jeez, why isn't that just all in sqlalchemy (maybe minus the common config stuff) | 23:41 |
| harlowja_ | lol | 23:41 |
| clarkb | harlowja_: yes exactly | 23:41 |
| harlowja_ | so then whats left over, the config stuff (only?) | 23:41 |
| clarkb | harlowja_: wheres oslo.config is harder because ConfigParse lives in python stdlin | 23:41 |
| mordred | harlowja_: also, zzzeek is here | 23:41 |
| harlowja_ | which is fine with me :- | 23:41 |
| harlowja_ | so then maybe oslo is just a bunch of config stuffs | 23:41 |
| clarkb | jeblair: I did eventually hit the keyerror | 23:41 |
| harlowja_ | mordred right, i've asked him about that before, maybe his ideas have changed | 23:41 |
| jeblair | clarkb: yay! | 23:41 |
| clarkb | fungi: do I need to start from my db backup or can I rerun with the output form the keyerror? | 23:41 |
| mordred | I mean, we have olso.config largely because termie stuck us originally with gconf because EFORMERGOOGLEEMPLOYEE | 23:42 |
| jeblair | mordred: well, not actually here. | 23:42 |
| fungi | clarkb: that's what i did anyway | 23:42 |
| mordred | jeblair: indeed | 23:42 |
| clarkb | fungi: you started from backup? | 23:42 |
| fungi | clarkb: yep | 23:42 |
| clarkb | fungi: thanks | 23:42 |
| *** nelsnelson has joined #openstack-infra | 23:42 | |
| *** jamielennox is now known as jamielennox|away | 23:42 | |
| *** hichihara has joined #openstack-infra | 23:42 | |
| fungi | clarkb: i didn't trust the partial migration | 23:42 |
| harlowja_ | mordred so in my ideal world, oslo becomes nothing more than config wrappers ontop of libraries (as we see fit) | 23:42 |
| mordred | harlowja_: I'm down with that | 23:42 |
| harlowja_ | and if we want to stop using oslo.config and its gconf like stuff, thats much easier | 23:42 |
| clarkb | jeblair: would it help you more if I grabbed the bottom of that stack or stuck to 179980 for now? | 23:43 |
| harlowja_ | dims and others i'm sure have different thoughts on this | 23:43 |
| *** tim_o has quit IRC | 23:43 | |
| harlowja_ | but thats my thinking, and u have to either split off the oslo.* libraries into there general part (and the not-general part) and in a proressive manner make the oslo.* libraries smaller (which seems to be happening) | 23:44 |
| *** ZZelle_ has joined #openstack-infra | 23:44 | |
| harlowja_ | ^ or u have to just start with the libraries/stuff being generic in the first place (Tooz, taskflow, a couple others) | 23:44 |
| fungi | clarkb: i think there might be a bug in nodepool_log_config.py | 23:44 |
| *** chlong has joined #openstack-infra | 23:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Alter governance repo voting rules https://review.openstack.org/185785 | 23:45 |
| clarkb | fungi: iirc it does try to do the correct thing for dib but I think thats only on the positive side of adding dib.imagename loggers, it likely doesn't remove image loggers from the normal setup if they have a diskimage property | 23:45 |
| *** annegentle has quit IRC | 23:45 | |
| jeblair | ttx: see https://review.openstack.org/185785 | 23:45 |
| clarkb | fungi: I can take a look shortly if it helps but want to get gertty sorted first | 23:45 |
| harlowja_ | i think sileht is working on making kombu (or pika now?) be more directly used in oslo.messaging (so this shrinks what oslo.messaging does, making upstream kombu do it better or other...) | 23:45 |
| harlowja_ | *same concept applies there | 23:45 |
| clarkb | jeblair: eg use 185698 or 179980 | 23:46 |
| fungi | clarkb: yeah, it looks like it falls back to prepending "dib" | 23:46 |
| harlowja_ | whether all of this was the intention of oslo from the start, or not, meh, things evolve | 23:46 |
| jeblair | clarkb: sorry? | 23:46 |
| clarkb | fungi: we do want that, but we don't need the loggers that were added in the latest patchset I think | 23:46 |
| mordred | jeblair: https://review.openstack.org/#/c/164870/ you have a procedural +2 on that pending merge of a dependent change. that change was replaced by two changes, both merged | 23:46 |
| clarkb | jeblair: for testing gertty, is it more valuable to just test 179980? or should I use the end of that stack | 23:46 |
| clarkb | harlowja_: yup evolving is fine. I think what I have issue with is using two libs when clearly one should be sufficient | 23:47 |
| fungi | clarkb: ahh, yep. so it's just adding extra handlers which we don't need | 23:47 |
| clarkb | harlowja_: either you handle concurrency or you don't we don't need two things as a default to handle it | 23:47 |
| jeblair | clarkb: the end of the stack is fine | 23:47 |
| harlowja_ | well its already not sufficent imho, seeing https://review.openstack.org/#/c/185249/ and https://review.openstack.org/#/c/185784/ already exist (which this removes) | 23:48 |
| fungi | clarkb: i'm seeing if i can figure out a good way for it not to add the non-dib handlers for images which aren't using snapshot | 23:48 |
| jeblair | mordred: +2 | 23:48 |
| clarkb | harlowja_: lets back up, from a functional perspective if tooz and taskflow can consume fasteners directly then why couldn't the rest of openstack do so | 23:49 |
| harlowja_ | i think this all really goes back to oslo.* libraries provide the openstack config, the openstack special sauce functions, and use other libraries to provide the generalized code (so that others in the bigger world can use this same general libraries if they want) | 23:49 |
| clarkb | harlowja_: and if the rest of openstack can, then could we just kill oslo.concurrency or merge oslo.concurrency and fasterners | 23:49 |
| harlowja_ | harlowja_ lack of that openstack config, openstack special sauce functions that aren't general | 23:49 |
| harlowja_ | *oops, clarkb ^ | 23:49 |
| *** yamamoto has joined #openstack-infra | 23:50 | |
| clarkb | harlowja_: openstack isn't that special | 23:50 |
| clarkb | harlowja_: if its useful it should go in the lib | 23:50 |
| *** annegentle has joined #openstack-infra | 23:50 | |
| jroll | I tend to think oslo_concurrency should wrap tooz, and provide a common API for "get a lock" that can be configured to use different things | 23:50 |
| jroll | (or merge with tooz) | 23:50 |
| jroll | that's what we really need imo | 23:50 |
| clarkb | and if it really is special then it shouldn't go in a lib | 23:50 |
| harlowja_ | jroll so that goes back to oslo.concurrency being a config wrapper | 23:51 |
| *** ashleighfarnham has quit IRC | 23:51 | |
| harlowja_ | clarkb possibly, maybe there never should have been oslo.concurrency, and it should have just stayed special in the incubator | 23:51 |
| *** marun has quit IRC | 23:51 | |
| jroll | harlowja_: right, which isn't terribad | 23:51 |
| *** salv-orlando has quit IRC | 23:51 | |
| jroll | how much usage outside of openstack does oslo.config really get? | 23:51 |
| harlowja_ | sure | 23:51 |
| harlowja_ | unsure of the numbers | 23:52 |
| harlowja_ | but from the download count its one of the most downloaded | 23:52 |
| harlowja_ | 384519 downloads in the last month | 23:52 |
| harlowja_ | *but how much of that is openstack CI idk | 23:52 |
| clarkb | harlowja_: only because openstack uses it | 23:52 |
| harlowja_ | right, i can't differentiate | 23:52 |
| clarkb | harlowja_: very little should be us since we have our per region mirrors in use | 23:53 |
| jroll | right, because every openstack/stackforge project uses it :P | 23:53 |
| clarkb | I think in general oslo.config likely isn't consumed in many places because it does weird things to config | 23:53 |
| *** dannywilson has quit IRC | 23:53 | |
| harlowja_ | yes, i agree with u clarkb | 23:53 |
| harlowja_ | its a different mechanism than what python ships with | 23:53 |
| harlowja_ | so therefore imho isn't likely highly consumed | 23:53 |
| harlowja_ | *outside of openstack stuffs | 23:53 |
| *** lifeless has joined #openstack-infra | 23:54 | |
| openstackgerrit | Merged openstack-infra/system-config: Add ubuntu-trusty images to rax https://review.openstack.org/185762 | 23:54 |
| *** Sukhdev has quit IRC | 23:54 | |
| clarkb | mordred: looks like shade changes will merge soon, were you planning on another release? | 23:54 |
| clarkb | I can get things prepped on nodepoo.o.o if so | 23:55 |
| harlowja_ | sooo anyway, at the current time i think the oslo prefixed libraries are trying to do less (and just be more config stuffs), this may help that (and its a totally valid question as to if oslo.concurrency is useful after this, and i'm not sure either) | 23:56 |
| openstackgerrit | Merged openstack-infra/shade: Don't cache keystone tokens as KSC does it for us https://review.openstack.org/185781 | 23:57 |
| openstackgerrit | Merged openstack-infra/shade: Always refresh glanceclient for tokens validity https://review.openstack.org/185782 | 23:57 |
| harlowja_ | maybe the longer term plan is that oslo.concurrency really does shrink down (more than it already has in https://review.openstack.org/#/c/185291/ | 23:57 |
| harlowja_ | but time will tell | 23:57 |
| harlowja_ | *doing said shrink-down(s) in a way that doesn't kill the world obviously | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!