| fungi | clarkb: hrm, it's still unhappy apparently | 00:00 |
|---|---|---|
| clarkb | :/ | 00:01 |
| *** otter768 has quit IRC | 00:01 | |
| *** zehicle has quit IRC | 00:02 | |
| *** wenlock1 has quit IRC | 00:04 | |
| *** baoli has joined #openstack-infra | 00:04 | |
| *** wenlock has quit IRC | 00:05 | |
| *** ashleighfarnham has quit IRC | 00:05 | |
| *** zehicle has joined #openstack-infra | 00:05 | |
| fungi | Error: Duplicate declaration: Tidy[/home/gerrit2/review_site/lib] is already declared... | 00:05 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-gerrit: Ensure only one set of bouncy castle libs are installed for Gerrit. https://review.openstack.org/181586 | 00:07 |
| fungi | that oughta solve it | 00:07 |
| *** mpopow has quit IRC | 00:09 | |
| clarkb | fungi seems reasonable | 00:10 |
| fungi | looks like all jobs are probably passing for it now | 00:12 |
| fungi | would be nice to at least have all this working and tested on review-dev before tomorrow | 00:12 |
| *** mtanino has quit IRC | 00:15 | |
| *** wznoinsk has quit IRC | 00:18 | |
| *** banix has quit IRC | 00:21 | |
| *** rwsu has joined #openstack-infra | 00:22 | |
| *** smccully has quit IRC | 00:28 | |
| pleia2 | clarkb: I have $things this evening, so left 179840 with latest status from tests, I'll resume on Monday | 00:28 |
| *** ddieterly has joined #openstack-infra | 00:28 | |
| *** smccully has joined #openstack-infra | 00:28 | |
| *** dimsum__ has joined #openstack-infra | 00:31 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Ensure only one set of bouncy castle libs are installed for Gerrit. https://review.openstack.org/181586 | 00:32 |
| *** rwsu has quit IRC | 00:33 | |
| *** shashankhegde has quit IRC | 00:33 | |
| *** ddieterly has quit IRC | 00:33 | |
| *** gyee has quit IRC | 00:34 | |
| *** julim has quit IRC | 00:37 | |
| *** dimsum__ has quit IRC | 00:42 | |
| *** dimsum__ has joined #openstack-infra | 00:42 | |
| *** ddieterly has joined #openstack-infra | 00:45 | |
| *** smarcet has joined #openstack-infra | 00:45 | |
| *** dimsum__ has quit IRC | 00:47 | |
| *** shashankhegde has joined #openstack-infra | 00:55 | |
| *** Krinkle|detached is now known as Krinkle | 00:55 | |
| *** mestery has joined #openstack-infra | 00:57 | |
| openstackgerrit | Chris Hoge proposed openstack-infra/project-config: Add gerritbot/accessbot to #openstack-defcore channel https://review.openstack.org/181590 | 00:57 |
| fungi | bingbong2.10.2-23-g039a170 https://review-dev.openstack.org/ | 00:58 |
| *** ivar-laz_ has joined #openstack-infra | 00:58 | |
| fungi | looks like we're good to poke at it a bit, anyone who's around | 00:58 |
| fungi | latest cleanup patch seems to do the trick | 00:58 |
| fungi | hopefully with this we're ready for tomorrow | 00:58 |
| *** ivar-lazzaro has quit IRC | 01:01 | |
| sigmavirus24 | Sounds ominous fungi | 01:02 |
| *** ivar-laz_ has quit IRC | 01:03 | |
| *** shashankhegde has quit IRC | 01:04 | |
| anteaya | I can sign into review-dev and leave a comment | 01:07 |
| *** Swami has quit IRC | 01:08 | |
| *** ZZelle has quit IRC | 01:19 | |
| *** samueldmq has joined #openstack-infra | 01:22 | |
| *** dimsum__ has joined #openstack-infra | 01:23 | |
| *** dimsum__ has quit IRC | 01:27 | |
| *** BharatK has quit IRC | 01:28 | |
| *** miqui has quit IRC | 01:38 | |
| *** dimsum__ has joined #openstack-infra | 01:39 | |
| *** baoli has quit IRC | 01:41 | |
| *** banix has joined #openstack-infra | 01:41 | |
| *** tjones1 has left #openstack-infra | 01:42 | |
| *** unicell has quit IRC | 01:51 | |
| *** Somay has joined #openstack-infra | 01:52 | |
| *** otter768 has joined #openstack-infra | 01:58 | |
| *** sarob has quit IRC | 02:02 | |
| *** otter768 has quit IRC | 02:03 | |
| *** chlong has quit IRC | 02:07 | |
| *** tiswanso has joined #openstack-infra | 02:12 | |
| *** achanda has quit IRC | 02:14 | |
| *** baoli has joined #openstack-infra | 02:15 | |
| *** yamahata has quit IRC | 02:19 | |
| *** baoli has quit IRC | 02:20 | |
| *** banix has quit IRC | 02:27 | |
| *** stevemar has joined #openstack-infra | 02:27 | |
| *** btully has quit IRC | 02:28 | |
| *** ajmiller has joined #openstack-infra | 02:40 | |
| *** ajmiller_ has joined #openstack-infra | 02:41 | |
| *** ajmiller has quit IRC | 02:45 | |
| *** sarob has joined #openstack-infra | 02:46 | |
| *** samueldmq has quit IRC | 02:49 | |
| *** koolhead17 has joined #openstack-infra | 02:51 | |
| *** unicell has joined #openstack-infra | 02:59 | |
| zaro | fungi, clarkb : back, but looks like you gents took care of it. thanks!! | 03:01 |
| *** mmedvede_ has quit IRC | 03:03 | |
| *** bhunter71 has quit IRC | 03:12 | |
| *** tiswanso has quit IRC | 03:14 | |
| *** achanda has joined #openstack-infra | 03:15 | |
| *** achanda has quit IRC | 03:20 | |
| *** baoli has joined #openstack-infra | 03:21 | |
| *** achanda has joined #openstack-infra | 03:37 | |
| *** ddieterly has quit IRC | 03:49 | |
| *** Somay has quit IRC | 03:54 | |
| *** otter768 has joined #openstack-infra | 03:59 | |
| *** baoli has quit IRC | 04:03 | |
| *** otter768 has quit IRC | 04:04 | |
| *** Somay has joined #openstack-infra | 04:40 | |
| *** Krinkle is now known as Krinkle|detached | 04:45 | |
| *** Somay has quit IRC | 05:00 | |
| *** sdake has joined #openstack-infra | 05:02 | |
| *** sdake_ has joined #openstack-infra | 05:06 | |
| *** sdake has quit IRC | 05:09 | |
| *** stevemar has quit IRC | 05:11 | |
| *** jlvillal has quit IRC | 05:13 | |
| *** jlvillal has joined #openstack-infra | 05:13 | |
| *** tiswanso has joined #openstack-infra | 05:15 | |
| *** tiswanso has quit IRC | 05:20 | |
| *** ddieterly has joined #openstack-infra | 05:20 | |
| *** hdd has joined #openstack-infra | 05:21 | |
| *** chlong has joined #openstack-infra | 05:22 | |
| *** sputnik13 has quit IRC | 05:22 | |
| *** ddieterly has quit IRC | 05:25 | |
| *** mmedvede has quit IRC | 05:25 | |
| *** ujuc has joined #openstack-infra | 05:27 | |
| *** ujuc has quit IRC | 05:31 | |
| openstackgerrit | Merged openstack-infra/system-config: Add the ability for template to manage exim https://review.openstack.org/180782 | 05:32 |
| openstackgerrit | Merged openstack-infra/nodepool: Add tox 'docs' env to build Sphinx documentation https://review.openstack.org/175941 | 05:34 |
| openstackgerrit | Merged openstack-infra/nodepool: Improve configuration documentation https://review.openstack.org/175959 | 05:35 |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Manage logging configuration files (feature flag) https://review.openstack.org/180614 | 05:35 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Add developer guidelines https://review.openstack.org/178559 | 05:38 |
| openstackgerrit | Merged openstack-infra/project-config: Add python34 job for proliantutils https://review.openstack.org/181104 | 05:40 |
| *** ildikov has quit IRC | 05:41 | |
| *** ildikov has joined #openstack-infra | 05:41 | |
| openstackgerrit | Sean Roberts proposed openstack-infra/project-config: update layout.yaml https://review.openstack.org/181613 | 05:42 |
| sarob | looking to add publish and release to akanda projects | 05:44 |
| sarob | anyone available to review? | 05:44 |
| *** mmedvede has joined #openstack-infra | 05:47 | |
| *** otter768 has joined #openstack-infra | 06:00 | |
| *** otter768 has quit IRC | 06:04 | |
| *** tnovacik has joined #openstack-infra | 06:17 | |
| *** ddieterly has joined #openstack-infra | 06:21 | |
| *** ddieterly has quit IRC | 06:25 | |
| *** shashankhegde has joined #openstack-infra | 06:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Add #openstack-defcore to the list of irc channels https://review.openstack.org/181576 | 06:48 |
| *** btully has joined #openstack-infra | 06:48 | |
| *** shashankhegde has quit IRC | 06:49 | |
| *** Longgeek has joined #openstack-infra | 06:50 | |
| *** hdd has quit IRC | 06:52 | |
| *** sabeen1 has quit IRC | 06:53 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add gerritbot/accessbot to #openstack-defcore channel https://review.openstack.org/181590 | 07:00 |
| *** abregman has joined #openstack-infra | 07:07 | |
| waynr | hmm i can't seem to create a story on storyboard.openstack.org | 07:18 |
| waynr | okay, figured out a different click path to make it | 07:20 |
| *** woodster_ has quit IRC | 07:20 | |
| *** ddieterly has joined #openstack-infra | 07:22 | |
| *** ddieterly has quit IRC | 07:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Add gerritbot/accessbot to #openstack-defcore channel https://review.openstack.org/181590 | 07:41 |
| *** e0ne has joined #openstack-infra | 07:51 | |
| *** openstackgerrit has quit IRC | 07:51 | |
| *** openstackgerrit has joined #openstack-infra | 07:51 | |
| *** e0ne is now known as e0ne_ | 07:51 | |
| *** e0ne_ is now known as e0ne | 07:52 | |
| *** e0ne has quit IRC | 07:54 | |
| *** e0ne has joined #openstack-infra | 07:57 | |
| *** koolhead17 has quit IRC | 07:58 | |
| *** otter768 has joined #openstack-infra | 08:00 | |
| *** e0ne has quit IRC | 08:02 | |
| *** otter768 has quit IRC | 08:05 | |
| *** e0ne has joined #openstack-infra | 08:06 | |
| *** sputnik13 has joined #openstack-infra | 08:13 | |
| *** e0ne has quit IRC | 08:15 | |
| *** Somay has joined #openstack-infra | 08:18 | |
| *** e0ne has joined #openstack-infra | 08:18 | |
| *** e0ne has quit IRC | 08:21 | |
| *** ddieterly has joined #openstack-infra | 08:22 | |
| *** e0ne has joined #openstack-infra | 08:25 | |
| *** e0ne has quit IRC | 08:26 | |
| *** ddieterly has quit IRC | 08:28 | |
| *** abregman has quit IRC | 08:28 | |
| *** e0ne has joined #openstack-infra | 08:31 | |
| *** e0ne has quit IRC | 08:33 | |
| *** e0ne has joined #openstack-infra | 08:37 | |
| *** jamielennox|away is now known as jamielennox | 08:39 | |
| *** e0ne has quit IRC | 08:39 | |
| *** achanda has quit IRC | 08:40 | |
| *** e0ne has joined #openstack-infra | 08:43 | |
| yolanda | jeblair, i've been looking at the agenda for the summit. I see mine moved to friday, it's fine. But i'm leaving on friday early afternoon, can we have that on friday morning? | 08:44 |
| *** e0ne has quit IRC | 08:46 | |
| *** e0ne has joined #openstack-infra | 08:49 | |
| *** luqas has joined #openstack-infra | 08:50 | |
| *** luqas has quit IRC | 08:51 | |
| *** luqas has joined #openstack-infra | 08:51 | |
| *** e0ne has quit IRC | 08:54 | |
| *** achanda has joined #openstack-infra | 08:55 | |
| *** luqas has quit IRC | 08:57 | |
| *** e0ne has joined #openstack-infra | 08:58 | |
| *** e0ne has quit IRC | 08:58 | |
| *** subscope_ has joined #openstack-infra | 09:05 | |
| *** koolhead17 has joined #openstack-infra | 09:07 | |
| *** jswarren has quit IRC | 09:09 | |
| *** ddieterly has joined #openstack-infra | 09:23 | |
| *** Somay has quit IRC | 09:24 | |
| *** ddieterly has quit IRC | 09:28 | |
| *** achanda has quit IRC | 09:39 | |
| *** e0ne has joined #openstack-infra | 09:47 | |
| *** btully has quit IRC | 09:49 | |
| *** e0ne has quit IRC | 09:49 | |
| *** e0ne has joined #openstack-infra | 09:53 | |
| *** e0ne has quit IRC | 09:55 | |
| *** e0ne has joined #openstack-infra | 09:59 | |
| *** otter768 has joined #openstack-infra | 10:01 | |
| *** e0ne has quit IRC | 10:01 | |
| *** teran has joined #openstack-infra | 10:02 | |
| *** Kennan2 has joined #openstack-infra | 10:03 | |
| *** sarob has quit IRC | 10:03 | |
| *** Kennan has quit IRC | 10:04 | |
| *** sarob has joined #openstack-infra | 10:04 | |
| *** e0ne has joined #openstack-infra | 10:05 | |
| *** prad has quit IRC | 10:05 | |
| *** otter768 has quit IRC | 10:06 | |
| *** teran has quit IRC | 10:08 | |
| *** e0ne has quit IRC | 10:10 | |
| *** e0ne has joined #openstack-infra | 10:15 | |
| *** e0ne has quit IRC | 10:17 | |
| *** hdd has joined #openstack-infra | 10:21 | |
| *** prad has joined #openstack-infra | 10:21 | |
| *** ddieterly has joined #openstack-infra | 10:24 | |
| *** ddieterly has quit IRC | 10:29 | |
| *** e0ne has joined #openstack-infra | 10:39 | |
| *** e0ne has quit IRC | 10:41 | |
| *** ddieterly has joined #openstack-infra | 10:45 | |
| *** teran has joined #openstack-infra | 10:53 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 10:55 | |
| *** teran has quit IRC | 11:01 | |
| *** jamielennox is now known as jamielennox|away | 11:36 | |
| *** sarob has quit IRC | 11:40 | |
| *** alexpilotti has quit IRC | 11:41 | |
| *** sarob has joined #openstack-infra | 11:45 | |
| *** hdd has quit IRC | 11:46 | |
| *** tiswanso has joined #openstack-infra | 11:46 | |
| *** sarob has quit IRC | 11:57 | |
| *** tiswanso has quit IRC | 11:58 | |
| *** teran has joined #openstack-infra | 12:02 | |
| *** otter768 has joined #openstack-infra | 12:02 | |
| *** teran has quit IRC | 12:07 | |
| *** otter768 has quit IRC | 12:07 | |
| *** banix has joined #openstack-infra | 12:12 | |
| *** baoli has joined #openstack-infra | 12:15 | |
| mordred | jhesketh: aroudn? | 12:15 |
| *** subscope_ has quit IRC | 12:25 | |
| *** baoli has quit IRC | 12:26 | |
| *** banix has quit IRC | 12:43 | |
| *** subscope_ has joined #openstack-infra | 12:46 | |
| *** mrmartin has joined #openstack-infra | 12:49 | |
| *** mrmartin has quit IRC | 12:50 | |
| *** woodster_ has joined #openstack-infra | 12:52 | |
| *** tiswanso has joined #openstack-infra | 12:54 | |
| *** prad has quit IRC | 12:54 | |
| *** subscope_ has quit IRC | 12:57 | |
| *** mmedvede_ has joined #openstack-infra | 12:59 | |
| *** teran has joined #openstack-infra | 13:03 | |
| *** baoli has joined #openstack-infra | 13:03 | |
| *** teran_ has joined #openstack-infra | 13:05 | |
| *** baoli has quit IRC | 13:05 | |
| *** teran has quit IRC | 13:08 | |
| *** teran_ has quit IRC | 13:10 | |
| *** tiswanso has quit IRC | 13:10 | |
| * koolhead17 pokes mordred | 13:12 | |
| mordred | how ya doing koolhead17 | 13:12 |
| koolhead17 | mordred: all good, hoping to see you soon. | 13:13 |
| mordred | you know it | 13:13 |
| koolhead17 | mordred: dm. | 13:18 |
| *** abregman has joined #openstack-infra | 13:21 | |
| *** ddieterly has quit IRC | 13:22 | |
| openstackgerrit | Merged openstack-infra/git-review: Use plumbing rev-parse to get the branch name https://review.openstack.org/179937 | 13:23 |
| *** bknudson has joined #openstack-infra | 13:26 | |
| koolhead17 | ttx: ping | 13:29 |
| kashyap | koolhead17: Please don't do blank pings. Leave him some context. | 13:31 |
| koolhead17 | kashyap: I think a pong means ttx is active & around. Am i missing something here? | 13:33 |
| kashyap | koolhead17: Yes, you're missing something: https://blogs.gnome.org/markmc/2014/02/20/naked-pings/ | 13:33 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Extend Gerrit ACL section https://review.openstack.org/181646 | 13:35 |
| kashyap | In short: If you'd have provided context/data with your ping, his response would have been your answer. | 13:35 |
| koolhead17 | kashyap: thanks for sharing, will never do naked ping anymore & will pay for beer to ttx next week when i meet him. I hope we are good now. :) | 13:36 |
| kashyap | Np. | 13:37 |
| koolhead17 | soren: are you around? | 13:38 |
| kashyap | Oh the irony! | 13:39 |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 13:39 |
| koolhead17 | kashyap: i have few things to discuss and i want to know if they are around. I just don`t want to broadcast here, like a spamming channel. All i want is if they are around so that i can dm and talk. | 13:42 |
| koolhead17 | not sure if am doing anything wrong according to the blog you posted. | 13:43 |
| fungi | koolhead17: if you intend to talk to someone via private /msg then you might as well initiate the conversation via private /msg | 13:44 |
| koolhead17 | fungi: but for that i have to confirm if the same person is around. | 13:44 |
| fungi | instead of, as you say, "broadcast here, like a spamming channel" | 13:44 |
| fungi | koolhead17: /query somenick | 13:45 |
| fungi | and then start typing | 13:45 |
| koolhead17 | fungi: my intension was just to check if they are around then initiate a DM. Seems like am doing it wrong | 13:48 |
| *** HeOS has quit IRC | 13:48 | |
| *** baoli has joined #openstack-infra | 13:48 | |
| koolhead17 | thanks fungi & kashyap | 13:48 |
| * koolhead17 goes back reading IRC guidelines & commands | 13:49 | |
| *** ajmiller_ has quit IRC | 13:50 | |
| fungi | koolhead17: if you intend to talk to someone publicly in channel instead, either ask them what you want to ask them and let them answer once they're paying attention or, if it's really critical for you to know whether they're actively engaged in irc, /whois their nick and see what the reported idle time is for them | 13:51 |
| fungi | and whether it reports them in an away status (which will often include information on why/where/how long they're away) | 13:53 |
| koolhead17 | fungi: noted. Thx | 13:53 |
| fungi | you're welcome! | 13:53 |
| *** baoli has quit IRC | 13:54 | |
| *** alexpilotti has joined #openstack-infra | 13:55 | |
| *** ddieterly has joined #openstack-infra | 13:56 | |
| *** ujuc has joined #openstack-infra | 13:57 | |
| *** otter768 has joined #openstack-infra | 14:03 | |
| *** teran has joined #openstack-infra | 14:05 | |
| *** dalgaaf has quit IRC | 14:07 | |
| *** otter768 has quit IRC | 14:08 | |
| *** teran has quit IRC | 14:10 | |
| *** koolhead17 has quit IRC | 14:13 | |
| *** koolhead17 has joined #openstack-infra | 14:14 | |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 14:15 |
| *** koolhead17 has quit IRC | 14:18 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add inventory command to shade https://review.openstack.org/175891 | 14:20 |
| jeblair | fungi: morning | 14:21 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make ironic use the API version system https://review.openstack.org/181651 | 14:22 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Consume os_client_config defaults as base defaults https://review.openstack.org/181652 | 14:22 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Rely on defaults being present https://review.openstack.org/181653 | 14:22 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Remove fallback from get_service_vales https://review.openstack.org/181654 | 14:22 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup openstack documentation Gerrit ACLs https://review.openstack.org/181655 | 14:24 |
| *** banix has joined #openstack-infra | 14:24 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup openstack documentation Gerrit ACLs https://review.openstack.org/181655 | 14:25 |
| jeblair | mordred: and to you too :) | 14:25 |
| mordred | jeblair: morning! | 14:25 |
| fungi | morning to all for whom it is indeed still morning | 14:26 |
| *** AJaeger has joined #openstack-infra | 14:27 | |
| fungi | and happiest gerritday greetings to all | 14:27 |
| AJaeger | happy gerritday greetings from me as well... | 14:27 |
| mordred | jeblair, fungi: so, I submitted a somewhat silly patch yesterda - 181377 - for making irc logs html. it'll need a manual find command to be run once by hand to get the backlog, and it seems the weekend is as good a time as any to run one of those ... either of you have love/hate opinions? | 14:27 |
| fungi | i am not opposed to htmlified logs | 14:28 |
| AJaeger | I went on the fringe a bit - gerrit ACLs: documentation in https://review.openstack.org/#/c/181646/1 and cleanup to see whether I really understand them: https://review.openstack.org/#/c/181655/ | 14:28 |
| mordred | ooh | 14:28 |
| mordred | docs | 14:28 |
| AJaeger | mordred: just the basics ;) | 14:29 |
| AJaeger | Btw. do we want to do against Louis Taylor's eye-damage? See his patch https://review.openstack.org/181000 that adds lots of empty lines to zuul/layout.yaml... | 14:30 |
| AJaeger | (s/to do against/do anything against) | 14:30 |
| jeblair | mordred: good with me | 14:30 |
| mordred | jeblair, fungi: awesome. I'll start the command and let it chug along | 14:31 |
| kragniz | AJaeger: I'm fine if that isn't merged, I just found myself going cross-eyed adding new items in there | 14:32 |
| jeblair | kragniz: are you louis taylor? | 14:32 |
| fungi | mordred: looks like that's not making use of the htmlifier we have in our supybot? i take it that wasn't particularly extensible to this end? | 14:32 |
| kragniz | jeblair: yeah | 14:32 |
| jeblair | kragniz: nice to meet you :) | 14:32 |
| kragniz | jeblair: you too! | 14:33 |
| kragniz | jeblair: (we also met afk a few weeks ago) | 14:34 |
| jeblair | kragniz: i have made the connection now! thanks! | 14:34 |
| jeblair | kragniz, AJaeger: i don't have a strong opinion, but i think it does look better :) | 14:35 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Merge openstack-doc tool ACLs https://review.openstack.org/181656 | 14:35 |
| AJaeger | kragniz: Thanks for the patch. | 14:36 |
| mordred | fungi: yah - the irclog2html thing knows how to process directories of logs like we have, which is nice for this. I could see consolidating the two in the future, but it didn't seem worth tons of effort for converging up front | 14:36 |
| kragniz | jeblair: face -> irc nick -> real name can be hard sometimes | 14:37 |
| kragniz | jeblair: cool! :) | 14:37 |
| mordred | this is why one should have one's IRC nick tattood on one's face | 14:37 |
| AJaeger | So, anybody with an objection to the whitespace? Otherwise let's get this in, I'll add my +2 now... | 14:37 |
| kragniz | mordred: a wise choice | 14:37 |
| jeblair | mordred: kragniz works on glance and would love to receive rants^Winput on api usage! ;) | 14:38 |
| kragniz | jeblair: lol | 14:38 |
| AJaeger | jeblair: do you really want to open that pandora's box today? ;) | 14:38 |
| fungi | mordred: cool. lgtm then | 14:38 |
| mordred | fungi: example of a directory of them done: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | 14:39 |
| kragniz | jeblair: oops, good spot on that random # character | 14:40 |
| kragniz | jeblair: want me to remove it? | 14:40 |
| mordred | kragniz: oh. yeah. I can definitely rant on API usage :) | 14:40 |
| jeblair | kragniz: maybe clean it up in a followup if AJaeger wants to go ahead and get it in...? | 14:40 |
| openstackgerrit | Thanh Ha proposed openstack-infra/nodepool: Clarify meaning of Jenkins master configuration settings in target https://review.openstack.org/167878 | 14:41 |
| kragniz | jeblair: okay | 14:41 |
| fungi | mordred: nice--i like that the url to the raw log is the same just with the .html suffix omitted too | 14:41 |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/jeepyb: Jeepyb based HEAD management https://review.openstack.org/181658 | 14:41 |
| mordred | fungi: ++ | 14:41 |
| mordred | fungi: I like the next/prev links too - makes reading through things that cross date boundaries friendlier | 14:42 |
| AJaeger | kragniz: if you have time now, clean it up and we review again... | 14:42 |
| AJaeger | if not, we can do it later. | 14:42 |
| fungi | mordred: agreed | 14:42 |
| AJaeger | your patch is large, I'd like to get it in quickly to avoid many rebases due to merge conflicts | 14:42 |
| kragniz | AJaeger: I'm ircing from my phone at the moment, so I'd rather not make patches from here | 14:43 |
| AJaeger | mordred: that looks nice! | 14:43 |
| *** ChanServ changes topic to "Gerrit 2.10 Upgrade starting at 1600 UTC: https://etherpad.openstack.org/p/gerrit-2.10-upgrade" | 14:43 | |
| *** banix has quit IRC | 14:43 | |
| AJaeger | kragniz: let me do it quickly... | 14:43 |
| nibalizer | AJaeger: i like the whitespace | 14:44 |
| nibalizer | also good morning everyone | 14:44 |
| kragniz | AJaeger: cool | 14:44 |
| openstackgerrit | Thanh Ha proposed openstack-infra/nodepool: Clarify project-id meaning for Rackspace deployment https://review.openstack.org/167881 | 14:44 |
| AJaeger | kragniz: and there's a wrong merge conflict resolution ;( | 14:45 |
| *** banix has joined #openstack-infra | 14:45 | |
| jeblair | fungi, zaro: dumb question: why are we running a mysql command manually -- why isn't it handled by gerrit's db migrations? | 14:45 |
| kragniz | AJaeger: it just gets worse :( | 14:45 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add extra padding to some entries in layout.yaml https://review.openstack.org/181000 | 14:46 |
| *** baoli has joined #openstack-infra | 14:46 | |
| AJaeger | kragniz: now it's really only empty lines added ^ | 14:46 |
| AJaeger | jeblair: do you want to double check and +A? ^ | 14:47 |
| fungi | jeblair: i honestly have no idea... i assumed this was a missing migration/upstream bug but that's actually a really great question | 14:48 |
| fungi | seeing now whether i can find an explanation | 14:48 |
| kragniz | AJaeger: awesome | 14:48 |
| jeblair | fungi: https://groups.google.com/forum/#!msg/repo-discuss/0qP1xZoOoDY/DWWcXkhOwu8J | 14:49 |
| jeblair | that was from 2.4-2.9 | 14:49 |
| fungi | yep, just found the same | 14:49 |
| fungi | now i vaguely recall the discussion we had around this | 14:49 |
| jeblair | fungi: also, i wonder if we need '--recheck-mergable' on our 'reindex' command | 14:49 |
| fungi | basically it's a missing migration that gerrit devs felt was not worth inserting because they no longer care about anyone who installed 2.4 or earlier initially | 14:50 |
| jeblair | they are nice people | 14:51 |
| jeblair | we are indeed missing that index | 14:51 |
| jeblair | we are not missing the _other_ index in that thread. which is also nice. | 14:51 |
| jeblair | however, our index on the other doesn't match tha thread | 14:52 |
| jeblair | mordred: can you help take a look at this | 14:52 |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/jeepyb: Jeepyb based HEAD management https://review.openstack.org/181658 | 14:52 |
| mordred | jeblair: yes I can - reading | 14:53 |
| jeblair | mordred: i pasted some stuff into etherpad https://etherpad.openstack.org/p/gerrit-2.10-upgrade | 14:53 |
| *** sputnik13 has quit IRC | 14:54 | |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/jeepyb: Jeepyb based HEAD management https://review.openstack.org/181658 | 14:54 |
| fungi | apparently that index is created by default on 2.5 and later when initializing the db, but they missed adding a migration to create it in 2.5 for upgrades. in 2.9 they start expecting it to be present and error out if it is not | 14:54 |
| mordred | jeblair: I believe we shoudl be able to run that command right now without taking gerrit down | 14:54 |
| openstackgerrit | Merged openstack-infra/puppet-meetbot: Produce html logs for our IRC logs https://review.openstack.org/181377 | 14:54 |
| mordred | it's just an index creation | 14:54 |
| jeblair | mordred: yeah, but i'm wondering what the index should actually be | 14:54 |
| mordred | ah - I see your paste | 14:54 |
| jeblair | the command they suggest in the thread does not match the index we actually have in prod | 14:54 |
| jeblair | mordred: key == index, right? | 14:55 |
| mordred | hrm. I bet that's because they've modifed the index in a later migration | 14:55 |
| mordred | jeblair: yes | 14:55 |
| * mordred goes to read gerrit source code | 14:55 | |
| jeblair | yeah, so just the columns then | 14:55 |
| mordred | wow. those are terrible indexes from 2.4 | 14:56 |
| jeblair | oh, haha | 14:56 |
| mordred | please tell me that in 2.10 they have dropped one of them | 14:56 |
| jeblair | schema 89 drops those indexes | 14:56 |
| mordred | yah | 14:56 |
| jeblair | we are on schema 86 | 14:57 |
| mordred | they're stupid indexes | 14:57 |
| mordred | so - we need to create an index named that so that schema 89 can drop it | 14:57 |
| jeblair | yep | 14:57 |
| mordred | neat | 14:57 |
| * jeblair is satisfied | 14:57 | |
| mordred | so - in that case, it does not matter what goes in it | 14:57 |
| fungi | looks like https://gerrit.googlesource.com/gerrit/+/242f0adc3407473d40d568acc5363669b6fc4a56%5E2..242f0adc3407473d40d568acc5363669b6fc4a56/ switches from patch_set_approvals_closedByUser to patch_set_approvals_closedByU | 14:57 |
| mordred | 'm glad they are dropping them - they are the worst indexes I've ever seen | 14:57 |
| mordred | they will literally never be used | 14:58 |
| fungi | gerrit has a lot of terrible database choices. i think they've realized many of them but are just trying to put less in the database rather than heavily reorganize it | 14:58 |
| mordred | they MIGHT get used occasionally if the order of the keys in the index was reversed | 14:58 |
| jeblair | are we thinking of doing a db dump before the migration? | 14:58 |
| mordred | jeblair: probably not a bad idea | 14:58 |
| fungi | i would recommend doing one after we stop gerrit before we proceed with any upgrading | 14:59 |
| jeblair | so let's stop gerrit; dump; add index; proceed... | 14:59 |
| fungi | just so we have last known state before upgrade, in case | 14:59 |
| *** baoli has quit IRC | 14:59 | |
| clarkb | morning | 14:59 |
| mordred | morning clarkb | 14:59 |
| jeblair | mordred: even though i agree we could add that now, we'll get a little bit of extra safety if we do it during downtime | 15:00 |
| *** woodster_ has quit IRC | 15:00 | |
| mordred | jeblair: kk | 15:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup openstack/* ACLs: remove "refs/heads/stable" https://review.openstack.org/181660 | 15:01 |
| clarkb | heh why wouldn't if make dropping that index optional if it wasn't added as migration step... I shouldn't think about it too hard | 15:03 |
| *** sdake has joined #openstack-infra | 15:04 | |
| *** woodster_ has joined #openstack-infra | 15:05 | |
| mordred | jeblair, fungi: ok. IRC logs all processed. subsequent runs of the operation are taking aroudn 10 seconds- so I think the 15-minute cron is safe | 15:05 |
| jeblair | oh, okay, it looks like --recheck-mergable was folded into init default behavior, so we should be okay on that front | 15:05 |
| mordred | woot | 15:06 |
| jeblair | (it was only needed for 2.9, but since we're going to 2.10, we should be okay) | 15:06 |
| *** teran has joined #openstack-infra | 15:06 | |
| jeblair | shall we stop puppet and merge the upgrade changes? | 15:06 |
| *** sputnik13 has joined #openstack-infra | 15:07 | |
| clarkb | makes sense, 2.8 didn't have the mergeable state and 2.9 added it | 15:07 |
| jeblair | fungi: did the patch you and zaro were working on yesterday get merged? | 15:07 |
| fungi | jeblair: yep, review-dev gets puppeted sanely now | 15:07 |
| fungi | and gerrit starts successfully on it | 15:08 |
| *** sdake_ has quit IRC | 15:08 | |
| zaro | morning | 15:08 |
| clarkb | good morning | 15:08 |
| zaro | jeblair: so your question about the mysql command.. that command is a workaround for something that the gerrit migration doesn't do. | 15:09 |
| * zaro looks up the discussion for it | 15:09 | |
| clarkb | zaro: I think mordred and jeblair and fungi were able to track it down and decide it ws mostly a noop for us but we have to do it to make migrations happy | 15:10 |
| mordred | yup. that is correct | 15:10 |
| jeblair | i updated the etherpad with an explanation even :) | 15:10 |
| openstackgerrit | Merged openstack-infra/project-config: Add extra padding to some entries in layout.yaml https://review.openstack.org/181000 | 15:11 |
| *** teran has quit IRC | 15:11 | |
| zaro | well here's the discussion if you want to read more: https://groups.google.com/d/msg/repo-discuss/0qP1xZoOoDY/a9LKSYkii5MJ | 15:12 |
| jeblair | zaro: yeah, i read that. it didn't actually explain much. :) | 15:12 |
| jeblair | for instance, why you would need two separate indexes on the same field | 15:13 |
| jeblair | that sent us to the source code which explained it | 15:13 |
| jeblair | status notice Gerrit will be offline from 1600-2000 UTC while it is upgraded to version 2.10 | 15:15 |
| jeblair | look good ^? | 15:15 |
| zaro | cool, i should have read more backscroll :) | 15:15 |
| zaro | lgtm | 15:15 |
| jeblair | #status notice Gerrit will be offline from 1600-2000 UTC while it is upgraded to version 2.10 | 15:16 |
| openstackstatus | jeblair: sending notice | 15:16 |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 15:16 |
| *** ZZelle has joined #openstack-infra | 15:16 | |
| -openstackstatus- NOTICE: Gerrit will be offline from 1600-2000 UTC while it is upgraded to version 2.10 | 15:17 | |
| mordred | ZZelle: hey - thanks for working on that | 15:17 |
| *** banix has quit IRC | 15:17 | |
| ZZelle | mordred, hi | 15:18 |
| openstackstatus | jeblair: finished sending notice | 15:18 |
| ZZelle | mordred, it's really difficult to correct gitreview tests as they become more and more complex | 15:18 |
| mordred | ZZelle: yah. this is a very true statement | 15:19 |
| *** sputnik13 has quit IRC | 15:20 | |
| *** banix has joined #openstack-infra | 15:20 | |
| ZZelle | mordred, i am wondering we should not start to rework git-review to test functionally integration with system/gerrit at low level instead of testing git review command | 15:21 |
| *** ihrachyshka has joined #openstack-infra | 15:24 | |
| openstackgerrit | Merged openstack-infra/publications: Update logos on System slide https://review.openstack.org/158134 | 15:27 |
| fungi | ZZelle: i've felt (since before we had tests for git-review) that we should just mock the cli interactions since it's purely a cli wrapper... or at least that was the case though now we'd probably need a separate solution to mock the http api interactions too | 15:28 |
| *** banix has quit IRC | 15:31 | |
| *** sputnik13 has joined #openstack-infra | 15:33 | |
| openstackgerrit | Merged openstack-infra/gerritbot: Update to modern pbr https://review.openstack.org/160069 | 15:36 |
| openstackgerrit | Merged openstack-infra/gerritbot: Replace six.iteritems with iter() https://review.openstack.org/160070 | 15:36 |
| openstackgerrit | Merged openstack-infra/puppet-cgit: Add puppet-cgit load balancer class https://review.openstack.org/179053 | 15:36 |
| ZZelle | fungi, it seems difficult to do currently because git_review.cmd is a script, it would be easier if business logic was clearly separated from low level drivers interacting with git/gerrit/system/ssh/http ... | 15:37 |
| jeblair | fungi, clarkb, mordred, zaro: should we go ahead and stop puppet and merge the upgrade changes? | 15:38 |
| clarkb | jeblair: sure | 15:39 |
| clarkb | I think I have reviewed the changes but will double check now | 15:39 |
| fungi | jeblair: sounds like a good way to shorten the outage | 15:40 |
| mordred | jeblair: ++ | 15:40 |
| clarkb | yup both have my +2 | 15:40 |
| jeblair | okay i ran 'puppet agent --disable' and puppet is not currently running | 15:41 |
| jeblair | so i think we're safe to aprv now | 15:41 |
| jeblair | both changes approved | 15:43 |
| mordred | k. I'm claiming the mysqldump step | 15:45 |
| *** ddieterly has quit IRC | 15:46 | |
| mordred | which I suppose means I should claim the create index step too | 15:46 |
| clarkb | might be good to tee he puppet agent --test output to a file so those not running puppet can tail it | 15:47 |
| zaro | ++ | 15:48 |
| *** tjones1 has joined #openstack-infra | 15:49 | |
| *** tjones1 has left #openstack-infra | 15:49 | |
| fungi | it looks like there's not a lot of steps to claim. i'm happy to do any nobody else wants, otherwise i'm mostly here to help test and if necessary debug/fix whatever we've overlooked | 15:51 |
| zaro | much cleaner than the 2.8 upgrade, right? | 15:51 |
| openstackgerrit | Merged openstack-infra/system-config: Upgrade Gerrit from 2.8 to ver 2.10 on review.o.o https://review.openstack.org/155463 | 15:52 |
| *** baoli has joined #openstack-infra | 15:52 | |
| jeblair | clarkb: something like puppet agent --test | tee /tmp/upgrade.log ? | 15:54 |
| clarkb | ya | 15:54 |
| jeblair | one down; one to go | 15:55 |
| openstackgerrit | Merged openstack-infra/project-config: Make gerritbot report changes from Gerrit 2.10.2 branch https://review.openstack.org/155450 | 15:55 |
| *** baoli has quit IRC | 15:56 | |
| jeblair | status alert Gerrit is offline from 16:00-20:00 UTC to upgrade to version 2.10. | 15:56 |
| jeblair | that look good? ^ | 15:56 |
| fungi | lgtm | 15:56 |
| clarkb | +1 | 15:56 |
| *** baoli has joined #openstack-infra | 15:56 | |
| *** banix has joined #openstack-infra | 15:57 | |
| jeblair | #status alert Gerrit is offline from 16:00-20:00 UTC to upgrade to version 2.10. | 15:59 |
| openstackstatus | jeblair: sending alert | 15:59 |
| jeblair | it takes a couple minutes to send :) | 15:59 |
| openstackgerrit | Merged openstack-infra/system-config: update Gerrit javamelody plugin on review.o.o https://review.openstack.org/173052 | 15:59 |
| jeblair | okay, that's all the changes in | 16:00 |
| jeblair | good timing on that :) | 16:00 |
| clarkb | zuul knows | 16:00 |
| jeblair | we should implement the "Merge-By: <timestamp>" header | 16:00 |
| *** Darkwan has joined #openstack-infra | 16:00 | |
| -openstackstatus- NOTICE: Gerrit is offline from 16:00-20:00 UTC to upgrade to version 2.10. | 16:01 | |
| *** ChanServ changes topic to "Gerrit is offline from 16:00-20:00 UTC to upgrade to version 2.10." | 16:01 | |
| *** sdake_ has joined #openstack-infra | 16:01 | |
| fungi | ready, set, breakstuff | 16:01 |
| jeblair | stopping gerrit | 16:01 |
| jeblair | i saved the zuul queue if we want to be nice later :) | 16:02 |
| jeblair | gerrit is stopped | 16:02 |
| mordred | ok. dumping db | 16:02 |
| *** baoli has quit IRC | 16:03 | |
| openstackstatus | jeblair: finished sending alert | 16:03 |
| mordred | creating index | 16:04 |
| mordred | done | 16:04 |
| mordred | db done - ready for next step | 16:04 |
| *** otter768 has joined #openstack-infra | 16:04 | |
| clarkb | oh your puppet agent command will need the lockfile arg | 16:04 |
| *** sdake has quit IRC | 16:05 | |
| mordred | jeblair: ^^ | 16:05 |
| clarkb | --agent_disabled_lockfile=/tmp/alt-lock-file | 16:05 |
| jeblair | clarkb: ep look good? | 16:05 |
| clarkb | yup | 16:05 |
| jeblair | okay, ready for me to run that now? | 16:05 |
| clarkb | I am | 16:06 |
| mordred | yup. have we verified that the latest revs are on puppetmaster? | 16:06 |
| clarkb | mordred: no | 16:06 |
| mordred | doing so | 16:06 |
| jeblair | waiting | 16:06 |
| clarkb | (also good catch) | 16:06 |
| mordred | they were not. they are now. proceed | 16:06 |
| fungi | i've made a note of the couple of changes which are likely to report while gerrit is still offline so i can bump them once it's back up | 16:06 |
| jeblair | fungi: i saved the zuul queues | 16:07 |
| fungi | oh, i missed that. cool | 16:07 |
| *** teran has joined #openstack-infra | 16:07 | |
| *** otter768 has quit IRC | 16:08 | |
| jeblair | running now | 16:10 |
| fungi | tailing | 16:10 |
| fungi | libs look like they're supposed to | 16:11 |
| clarkb | its still doing the initial init | 16:12 |
| *** baoli has joined #openstack-infra | 16:12 | |
| *** teran has quit IRC | 16:12 | |
| jeblair | it's reindexing; this usually takes, what, 20 minutes? | 16:13 |
| clarkb | 10-15 I think | 16:13 |
| *** tonytan4ever has quit IRC | 16:13 | |
| fungi | yeah, somewhere in there | 16:14 |
| *** tonytan4ever has joined #openstack-infra | 16:14 | |
| *** tonytan4ever has quit IRC | 16:14 | |
| fungi | hrm... we have a mysql-connector symlink and download version side-by-side. doesn't seem to be that way on review-dev | 16:14 |
| *** baoli has quit IRC | 16:14 | |
| fungi | review-dev just has the symlinked one | 16:14 |
| fungi | zaro: any idea whether that ^ will pose a problem? | 16:15 |
| zaro | fungi: no it should be ok | 16:15 |
| fungi | i guess it's just bcpg that gets touchy if we have more that one lying around | 16:16 |
| jeblair | oops, i think the tee missed stderr | 16:16 |
| jeblair | Error: /Stage[main]/Gerrit/Exec[gerrit-start]: Failed to call refresh: /etc/init.d/gerrit start returned 1 instead of one of [0] | 16:16 |
| jeblair | Error: /Stage[main]/Gerrit/Exec[gerrit-start]: /etc/init.d/gerrit start returned 1 instead of one of [0] | 16:16 |
| clarkb | it says starting gerrit failed, is that because indexing took too long? | 16:16 |
| fungi | clarkb: i suspect so. the timeout on the exec is likely way too short | 16:16 |
| nibalizer | default timeout is 300 seconds | 16:16 |
| jeblair | we think the reindex aborted? | 16:17 |
| jeblair | ugh | 16:17 |
| fungi | i see the reindex still running | 16:17 |
| jeblair | oh good | 16:17 |
| fungi | going on 8 minutes now | 16:17 |
| jeblair | so we'll just wait for it to finish, then run puppet again to make sure it's stable, then start | 16:17 |
| fungi | at least the process is still in the process table anyway | 16:17 |
| clarkb | ya I think from puppet/init's perspective it failed | 16:17 |
| clarkb | but we just have to wait then start the service directly | 16:17 |
| clarkb | everything else seems to have gone well, its just the start which can't happen when indexing | 16:18 |
| zaro | fungi: does the mysql file that's in the lib folder match tidy setting? | 16:19 |
| fungi | zaro: mysql-connector-java-5.1.21.jar | 16:19 |
| fungi | and we have a tidy for 2.10 with a matches mysql-connector-java-*.jar | 16:20 |
| *** armax has quit IRC | 16:20 | |
| fungi | so not sure why it ended up left behind | 16:21 |
| fungi | maybe it'll get cleared on the next puppet update | 16:21 |
| *** AJaeger has quit IRC | 16:24 | |
| *** ildikov has quit IRC | 16:24 | |
| clarkb | looks like index just finished | 16:24 |
| fungi | finished? | 16:24 |
| fungi | i agree | 16:25 |
| jeblair | i'll run puppet again? | 16:25 |
| jeblair | same command? | 16:25 |
| fungi | yep | 16:25 |
| jeblair | running | 16:25 |
| jeblair | done | 16:25 |
| fungi | as suspected, the mysql-connector spare got tidied up this time around | 16:26 |
| jeblair | um, do we need to do something about restTokenPrivateKey ? | 16:26 |
| clarkb | ok, now I think we have to start gerrit directly because it isn't started if we don't update the war | 16:26 |
| fungi | jeblair: why are you wondering if we need to do something with restTokenPrivateKey? | 16:26 |
| clarkb | zaro: ^ is restTokenPrivateKey still a thing | 16:26 |
| clarkb | fungi: it was removed by puppet | 16:26 |
| fungi | ahh, i see that in the log now | 16:27 |
| zaro | clarkb: not on review-dev so i don't know. | 16:27 |
| jeblair | yeah, the other changes look fine to me | 16:27 |
| fungi | i bet gerrit creates it at each start | 16:27 |
| clarkb | I think either gerrit wrote that to its config on init (really? writing back to config files?) or its old and we don't need it | 16:27 |
| clarkb | fungi: ya | 16:27 |
| fungi | gerrit does rewrite its config | 16:27 |
| mordred | well, we all have it in our logs | 16:27 |
| fungi | note all the empty strings getting updated | 16:27 |
| fungi | i agree it's insane | 16:27 |
| fungi | and not at all the most insane thing about gerrit | 16:28 |
| mordred | so if gertty is not happy, we can likely add it | 16:28 |
| fungi | yeah, i'm in favor of just starting it and seeing what we've broken | 16:29 |
| jeblair | hrm, i'd like to understand what that is first | 16:29 |
| zaro | i tested gerty with 2.10 and gertty was happy with it. | 16:29 |
| jeblair | i'm trying to find docs about it | 16:29 |
| clarkb | ya googling isn't returning much data about it | 16:29 |
| fungi | agreed. i see example configs in the gerrit docs including it, but no explanation | 16:30 |
| zaro | where was the restTokenPrivateKey setting? | 16:30 |
| mordred | secure.conf | 16:30 |
| zaro | gerrit config? | 16:30 |
| mordred | gerrit-pgm/src/main/java/com/google/gerrit/pgm/init/InitAuth.java: auth.setSecure("restTokenPrivateKey", SignedToken.generateRandomKey()); | 16:30 |
| clarkb | mordred: just found that too, so if it is null then we generate a new one | 16:31 |
| mordred | so - it's in the same place as registerEmailPrivateKey | 16:31 |
| *** dboik has quit IRC | 16:31 | |
| mordred | ayh - so I think we need it in our secure.config | 16:31 |
| mordred | with an entry in hiera | 16:31 |
| *** dboik has joined #openstack-infra | 16:32 | |
| clarkb | mordred: ya we likely want it there | 16:32 |
| fungi | heh, i see people asking what it is in gerrit irc logs... nobody answers | 16:32 |
| clarkb | it appears to be used to sign REST token | 16:32 |
| mordred | so - keep puppet disabled - add it to the file by hand, start gerrit, push patches to add it to the file and land those patches before we restart puppet, yeah? | 16:32 |
| *** banix has quit IRC | 16:33 | |
| clarkb | and if it is null you get a null restToken | 16:33 |
| jeblair | i actually can't find it used in gerrit, but maybe the AuthConfig class is passed to a library | 16:33 |
| clarkb | mordred: sounds good | 16:33 |
| jeblair | i will add it to the file | 16:33 |
| mordred | I'll add it to hiera | 16:34 |
| jeblair | someone else want to write the patch? | 16:34 |
| fungi | writing now | 16:34 |
| fungi | patches, likely (since we need to plumb it through the puppet module) | 16:34 |
| clarkb | jeblair: are you starting gerrit after adding it to the file? | 16:35 |
| jeblair | okay, that's staged on review.o.o; i'll wait to start gerrit until we have a quorum again so we can all poke at it | 16:35 |
| *** sputnik13 has quit IRC | 16:35 | |
| mordred | done. it's in gerrit_rest_token_private_key | 16:36 |
| mordred | jeblair: I'm ready for you to start gerrit | 16:36 |
| *** ddieterly has joined #openstack-infra | 16:36 | |
| jeblair | okay, i'll start gerrit now | 16:37 |
| jeblair | it's up | 16:37 |
| mordred | I agree that it is up | 16:37 |
| mordred | uhm | 16:38 |
| mordred | ALL of my patches are listed as being in merge conflict | 16:38 |
| clarkb | mordred: mostly the case here too | 16:38 |
| mordred | and it appears that is the case for all of the patches | 16:38 |
| zaro | mordred: should that be added to review-dev too? | 16:38 |
| jeblair | neat, that's the thing that --recheck-mergeable was supposed to fix | 16:38 |
| mordred | ah | 16:38 |
| mordred | sweet | 16:38 |
| jeblair | which is the flag they removed between 2.9 and 2.10 | 16:38 |
| *** ildikov has joined #openstack-infra | 16:38 | |
| clarkb | jeblair: mordred so maybe we bring it back down then rerun the indexing? | 16:38 |
| clarkb | oh they removed it? gah | 16:38 |
| clarkb | I thought it was just no longer necessary | 16:38 |
| jeblair | is it possible that we are required to upgrade to 2.9 first? | 16:38 |
| jeblair | review-dev _did_ upgrade to 2.9 first, didn't it? | 16:39 |
| mordred | maybe there is a db flag for it that 2.9 would have filled out and that they would not have bothered ssetting in a migration? | 16:39 |
| clarkb | the changelog says 2.8 or 2.9 first then 2.10 | 16:39 |
| zaro | no. i tested direct migration from 2.8 to 2.10 | 16:39 |
| clarkb | but it may be wrong | 16:39 |
| zaro | 0 | 16:39 |
| jeblair | okay, so try reindexing again sounds like the best next step | 16:40 |
| clarkb | https://gerrit-documentation.storage.googleapis.com/ReleaseNotes/ReleaseNotes-2.10.html is the changelog | 16:40 |
| jeblair | stopping gerrit | 16:40 |
| mordred | jeblair: changes has a mergeable field | 16:40 |
| jeblair | mordred: is there any variability in the field? | 16:41 |
| jeblair | maybe it was being updated in the background after start? | 16:41 |
| mordred | yes | 16:41 |
| mordred | it is N for one of my changes that was marked as non-mergable | 16:41 |
| mordred | let me see if I can get a count | 16:42 |
| jeblair | [2015-05-09 16:39:06,817] WARN com.google.gerrit.server.patch.PatchListLoader : 5000 ms timeout reached for Diff loader in project openstack-infra/project-config on commit 78f3ccde78e1acb7e2392b3fc5f1acfd75fe | 16:42 |
| jeblair | 5e93 on path jenkins/jobs/devstack-gate.yaml comparing 82ccb5fb8fa474c9a449fe8063508d9477a332ef..8a46c8017a8d7f020b8d78560500e9735dd10adf | 16:42 |
| fungi | i have the rest token patches ready to go once it's back up and running | 16:42 |
| jeblair | there were a few of those ^ in the logs -- maybe that was gerrit computing mergability while running | 16:42 |
| jeblair | (and not in the reindex step as we had supposed?) | 16:42 |
| clarkb | I can't find anything in the changelog saying it does things either way | 16:42 |
| mordred | there does not seem to be an obvious cut off - so yes, I think it's recalcing | 16:43 |
| jeblair | okay, so, er, restart it again? :) | 16:43 |
| mordred | 181629 is Y, 181664 is N | 16:43 |
| fungi | seems reasonable that it might be a background task | 16:43 |
| clarkb | jeblair: mordred ya we can restart then check the db periodically | 16:44 |
| mordred | kk | 16:44 |
| jeblair | started | 16:44 |
| jeblair | mordred: let us know if the numebrs change | 16:44 |
| mordred | I shall | 16:44 |
| fungi | probably easiest thing to do is query for a count on ='N' and then repeat a minute later and see if it's dropped | 16:44 |
| mordred | mysql> select max(change_id) from changes group by mergeable \G | 16:44 |
| mordred | btw | 16:44 |
| fungi | yeah, that | 16:44 |
| mordred | mysql> select max(change_id), count(change_id) from changes group by mergeable \G | 16:45 |
| fungi | should i hold off pushing up changes for the token key until we're sure we're not taking it offline again? | 16:45 |
| jeblair | fungi: yeah | 16:45 |
| jeblair | [2015-05-09 16:45:32,841] WARN com.google.gerrit.server.patch.PatchListLoader : 5000 ms timeout reached for Diff loader in project openstack-infra/release-tools on commit c51c2ed294ca7cbb8ce518daadae3488afa21ce8 on path stable_freeze.py comparing 4022d639a6b3d964495c2a4601b1aee1676660c6..c85afc933aca73dd419781305244a616589601e3 | 16:45 |
| jeblair | okay, whatever was doing that is doing it again | 16:45 |
| mordred | I am not seeing the nubmers change | 16:45 |
| mordred | oh! yes I am | 16:45 |
| jeblair | [2015-05-09 16:45:57,895] ERROR org.eclipse.jgit.internal.storage.file.ObjectDirectory : ERROR: Exception caught while accessing pack file /home/gerrit2/review_site/git/openstack-infra/shade.git/objects/pack/pack-4e3b4959ed4c7365a16a07dc39c578f6b05b5b8d.pack, the pack file might be corrupt | 16:46 |
| mordred | nope. no I'm not | 16:46 |
| clarkb | cool, fwiw I tried opening a change of mine to see if that would force it to check mergeability and it doesnt seem to do so | 16:46 |
| mordred | ok. now I can verify different numbers | 16:46 |
| clarkb | jeblair: er that doesn't look happy | 16:46 |
| mordred | sorry for the false start before | 16:46 |
| jeblair | oh look at show-queue | 16:46 |
| jeblair | a30f58fc waiting .... 16:45:56.163 mergeability-check-change-181102-project | 16:46 |
| jeblair | c31e0c3e waiting .... 16:45:56.163 mergeability-check-change-181268-project | 16:46 |
| mordred | why do I get the feeling this is NOT going to scale for us | 16:46 |
| fungi | indeed | 16:47 |
| jeblair | it's off to a slow start though; it's also right in the middle of 5000 git pushes | 16:47 |
| jeblair | [2015-05-09 16:46:44,837] ERROR org.eclipse.jgit.internal.storage.file.ObjectDirectory : ERROR: Exception caught while accessing pack file /home/gerrit2/review_site/git/openstack-infra/tripleo-ci.git/objects/pack/pack-0592bdb67756ca77439e46314897c256277ef793.pack, the pack file might be corrupt | 16:47 |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 16:47 |
| mordred | it does find 142k changes mergable | 16:47 |
| jeblair | and now we have diverged from our pre-upgrade state :) | 16:47 |
| mordred | and only 37k not | 16:48 |
| jeblair | that's a lot | 16:48 |
| fungi | ZZelle: you may want to hold off pushing patches up to review.o.o. we're still testing the waters with the gerrit upgrade and may need to revert the database | 16:48 |
| jeblair | [2015-05-09 16:48:24,399] ERROR org.eclipse.jgit.internal.storage.file.ObjectDirectory : ERROR: Exception caught while accessing pack file /home/gerrit2/review_site/git/stackforge/anchor.git/objects/pack/pack-217d5293ef3ca9dc902d2b23eaf76f4bab57f8e1.pack, the pack file might be corrupt | 16:48 |
| *** armax has joined #openstack-infra | 16:48 | |
| fungi | though worth noting, 109869 has "can merge: yes" | 16:48 |
| ZZelle | fungi, oups, i forgot it was gerrit update day, thx | 16:48 |
| mordred | yah | 16:49 |
| mordred | I've been stuck on the same mergeability count for a while | 16:49 |
| fungi | i have a feeling the merge checking is fragile, and if gerrit encounters any failure it assumes a corrupt git repo | 16:49 |
| jeblair | hrm; diff loader errors are still showing up | 16:49 |
| mordred | because, you know, jgit sucks at merging things it turns out | 16:50 |
| clarkb | fungi: you think that eplains the errors above? | 16:50 |
| jeblair | there are no more mergeabality check tasks running | 16:50 |
| fungi | clarkb: i'm still digesting the backtrace | 16:50 |
| jeblair | in the queue | 16:50 |
| mordred | ok. well, I still show 37k changes unmergable | 16:50 |
| clarkb | and all of my changes still show up as unmergeable | 16:51 |
| mordred | ok - so ... | 16:51 |
| mordred | look at these two; | 16:51 |
| clarkb | but there are open unmerged changes are are mergeable | 16:51 |
| mordred | https://review.openstack.org/#/c/181651/ - that shows can-merge no | 16:51 |
| mordred | and https://review.openstack.org/#/c/140840/ which shows can-merge no but ALSO "Patch is in Merge-Conflict" error | 16:51 |
| jeblair | mordred: "Patch in merge conflict" is from zuul | 16:52 |
| mordred | ah. silly me | 16:52 |
| clarkb | ya so that one likely can't merge | 16:52 |
| fungi | https://bugs.eclipse.org/bugs/show_bug.cgi?id=462868 | 16:52 |
| openstack | bugs.eclipse.org bug 462868 in JGit "IOException while accessing pack file" [Major,Resolved: fixed] - Assigned to jgit.core-inbox | 16:52 |
| mordred | yah. I trust zuul | 16:52 |
| clarkb | but the first one probably can | 16:52 |
| *** bknudson has left #openstack-infra | 16:52 | |
| sdake_ | say quick q, all the channels ge tthe gerrit notification but #kolla, is there something missing in the project-config? (or is now not hte right time to ask? :) | 16:52 |
| *** bknudson has joined #openstack-infra | 16:52 | |
| mordred | sdake_: not the right time | 16:52 |
| sdake_ | thanks | 16:53 |
| sdake_ | i'll ask later | 16:53 |
| fungi | http://comments.gmane.org/gmane.comp.version-control.repo/14199 | 16:53 |
| jeblair | fungi: i'm seeing more errors like "java.io.EOFException: Short compressed stream at 596,639 | 16:53 |
| fungi | yeah, a lot of these seem to be jgit dealing poorly with nfs, which is not our scenario | 16:54 |
| clarkb | fungi: that and out of band git gc | 16:55 |
| clarkb | whcih we do but shouldn't be a problem right now | 16:55 |
| jeblair | clarkb: yes, but not over nfs where locking is weird | 16:55 |
| fungi | https://groups.google.com/forum/#!searchin/repo-discuss/jgit/repo-discuss/Qdmbl-YZ4NU/VmLKVk4CnkEJ | 16:56 |
| fungi | mentions replacing pack files with new ones of the same name, cgit behavior which confuses jgit | 16:56 |
| jeblair | hrm, i think --recheck-mergeable might exist in our reindex | 16:57 |
| jeblair | did they just remove the documentation for it? | 16:57 |
| mordred | the docs on the 10.3 branch still list it | 16:58 |
| jeblair | i propose we stop and run reindex --recheck-mergeable | 16:58 |
| clarkb | fungi: and solved by upgrading git version? | 16:58 |
| *** armax has quit IRC | 16:58 | |
| jeblair | mordred: wow, okay. looks like they are in our version too. sorry about that. | 16:59 |
| jeblair | anyone agree/object to stop + reindex --recheck-mergabel? | 16:59 |
| mordred | I guess? I kinda want to find a way to turn off the stupid checker - but I'm guessing I will not find that | 16:59 |
| clarkb | jeblair: seems like a reasonable next step to get merges checked | 17:00 |
| jeblair | whats the reindex command? | 17:00 |
| jeblair | (see etherpad) | 17:01 |
| fungi | seems like the next logical step, yes | 17:01 |
| clarkb | `/usr/bin/java -jar /home/gerrit2/review_site/bin/gerrit.war reindex -d /home/gerrit2/review_site` is what I have according to ps from before | 17:01 |
| jeblair | running that now | 17:02 |
| jeblair | mordred: let us know if numbers change? | 17:03 |
| *** AJaeger has joined #openstack-infra | 17:03 | |
| *** AJaeger has joined #openstack-infra | 17:03 | |
| mordred | yes. they are changing | 17:03 |
| mordred | they are going down at a rate of about 10 per second | 17:04 |
| mordred | and there are 37k outstanding | 17:04 |
| jeblair | have we thought about the "--threads" option to reindex? | 17:04 |
| *** ihrachyshka has quit IRC | 17:04 | |
| mordred | we have not | 17:04 |
| fungi | at that rate, it might finish in an hour | 17:04 |
| jeblair | private int threads = Runtime.getRuntime().availableProcessors(); | 17:05 |
| jeblair | i guess it has a reasonable default | 17:05 |
| clarkb | it if is cpu bound we probably won't get much better performance changing that | 17:05 |
| jeblair | we're only at LA 3 with 8 vcpus | 17:06 |
| jeblair | we might double it to 16 and get performance | 17:06 |
| *** ddieterl_ has joined #openstack-infra | 17:06 | |
| mordred | 36655 | 17:06 |
| *** tiswanso has joined #openstack-infra | 17:07 | |
| jeblair | neat, so we're going to burn a scotty hour on this :) | 17:07 |
| clarkb | zaro: I remember the last patch on 2.10.3 was related to jgit, any chance its related to the things fungi has pointed out? | 17:07 |
| *** ivar-lazzaro has joined #openstack-infra | 17:08 | |
| *** teran has joined #openstack-infra | 17:08 | |
| fungi | it was to fix https://bugs.eclipse.org/bugs/show_bug.cgi?id=465509 | 17:08 |
| openstack | bugs.eclipse.org bug 465509 in JGit "Massive performance problem in Gerrit caused by ObjectWalk.markUninteresting marking the root tree as uninteresting" [Normal,Resolved: fixed] - Assigned to jgit.core-inbox | 17:08 |
| clarkb | ah ok so not the same | 17:08 |
| *** ivar-laz_ has joined #openstack-infra | 17:09 | |
| *** ddieterly has quit IRC | 17:10 | |
| *** ivar-lazzaro has quit IRC | 17:11 | |
| *** teran has quit IRC | 17:13 | |
| *** stevemar has joined #openstack-infra | 17:13 | |
| *** otter768 has joined #openstack-infra | 17:14 | |
| mordred | 35622 | 17:15 |
| * dimsum__ peeks | 17:15 | |
| mordred | we should put up a "service not available" page with a worstcat on it | 17:15 |
| *** AJaeger_ has joined #openstack-infra | 17:16 | |
| jeblair | the recheck command is producing no progress output, btw. | 17:17 |
| *** AJaeger_ is now known as Guest16702 | 17:17 | |
| jeblair | (i mean, it hasn't since starting, as in, it does not supply progress information) | 17:17 |
| clarkb | jeblair: a counter would be nice | 17:17 |
| *** sdake has joined #openstack-infra | 17:20 | |
| clarkb | jeblair: load has fallen to ~1 | 17:20 |
| mordred | 35405 | 17:21 |
| mordred | we COULD just set the flag to Y in sql | 17:21 |
| clarkb | ha | 17:22 |
| clarkb | mordred: then let things converge on sanity over time | 17:22 |
| mordred | yah | 17:22 |
| *** AJaeger has quit IRC | 17:22 | |
| *** Guest16702 has quit IRC | 17:23 | |
| *** sdake_ has quit IRC | 17:23 | |
| *** AJaeger has joined #openstack-infra | 17:23 | |
| *** AJaeger has joined #openstack-infra | 17:23 | |
| *** tiswanso has quit IRC | 17:23 | |
| jeblair | that suggests we would be comfortable interrupting the reindex | 17:26 |
| *** stevemar has quit IRC | 17:28 | |
| jeblair | i'm running the reindex in a root-owned screen, btw | 17:31 |
| jeblair | oh! | 17:31 |
| jeblair | Reindexing changes: projects: 80% (506/630), 87% (157151/180289) (\) | 17:31 |
| jeblair | that just started! | 17:31 |
| jeblair | and increasing quickly | 17:32 |
| zaro | i'm guessing --recheck-mergeable needs to be done for every upgrade going forward? meaning update puppet manifest? | 17:32 |
| jeblair | zaro: no i think only this one | 17:32 |
| zaro | because we going from 2.8->2.10? | 17:33 |
| *** isviridov_away is now known as isviridov | 17:33 | |
| jeblair | yes -- because the mergable field is being added | 17:33 |
| *** sputnik13 has joined #openstack-infra | 17:33 | |
| jeblair | i expect it to be done in <1min | 17:33 |
| jeblair | it's done | 17:33 |
| zaro | yah! | 17:34 |
| jeblair | starting gerrit | 17:34 |
| jeblair | okay, it's up and there are way fewer changes in conflict now | 17:34 |
| fungi | much better | 17:35 |
| fungi | oh, i accidentally terminated the screen session, though i have the last contents from it in my terminal buffer if anyone needs them | 17:35 |
| jeblair | fungi: np | 17:36 |
| *** isviridov is now known as isviridov_away | 17:36 | |
| fungi | nothing out of the ordinary. errors about the known ancient projects which we've never properly cleaned up in the db | 17:36 |
| clarkb | my changes are looking good | 17:36 |
| fungi | as are mine | 17:37 |
| jeblair | shade changes in general seem to work (shade was one of the projects that emitted an error in the log | 17:37 |
| fungi | i'm going to push up the token key changes if there are no objections | 17:37 |
| jeblair | fungi: ++ | 17:37 |
| clarkb | fungi: no, I think trying some changes out is the next step | 17:37 |
| clarkb | fungi: so go for it | 17:37 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-gerrit: Support restTokenPrivateKey as $token_private_key https://review.openstack.org/181667 | 17:37 |
| fungi | there's one | 17:37 |
| clarkb | diff works happily | 17:38 |
| clarkb | zuul is running jobs for it | 17:38 |
| jeblair | gertty seems to be working so far | 17:38 |
| jeblair | i'll review that with gertty; someone else should review it with gerrit webui | 17:38 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Support restTokenPrivateKey on review.o.o https://review.openstack.org/181669 | 17:38 |
| fungi | there's the other, with a depends-on for the first | 17:38 |
| clarkb | I will review with web ui | 17:38 |
| mordred | yah. I agree - it looks good | 17:38 |
| clarkb | ok used old change screen to review the first one, left an inline comment | 17:39 |
| clarkb | seems to work, will use new chnage screen on the second change | 17:39 |
| clarkb | Conflicts with (N/A) 500 Internal Server Error | 17:40 |
| clarkb | thats on the new change screen | 17:40 |
| fungi | fixing the whitespace problem on that first change now with a second patchset | 17:40 |
| jeblair | clarkb: can you paste the new screen link? | 17:40 |
| *** woodster_ has quit IRC | 17:40 | |
| clarkb | I wonder if it does that until it is able to check mergeability? | 17:40 |
| clarkb | jeblair: https://review.openstack.org/#/c2/181669/ | 17:40 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-gerrit: Support restTokenPrivateKey as $token_private_key https://review.openstack.org/181667 | 17:41 |
| fungi | there's pushing a second patchset | 17:41 |
| fungi | as predicted, updating 181667 while 181669 was being tested caused testing to abort with the "depends on a change that failed to merge" message | 17:42 |
| jeblair | clarkb, fungi: there's an exception logged about that | 17:42 |
| clarkb | jeblair: also zuul -1'd because it says it depends on a change that can't merge | 17:42 |
| clarkb | fungi: yup that | 17:43 |
| jeblair | Caused by: org.eclipse.jgit.errors.ObjectWritingException: Unable to create new object: /home/gerrit2/review_site/git/openstack-infra/system-config.git/objects/96/5337f2632f3a1ac55d77eb8afe86ba8a403176 | 17:43 |
| fungi | er, interesting | 17:43 |
| jeblair | at org.eclipse.jgit.internal.storage.file.ObjectDirectoryInserter.insertOneObject(ObjectDirectoryInserter.java:126) | 17:44 |
| jeblair | there are root owned directories | 17:44 |
| fungi | ick, yes | 17:44 |
| clarkb | jeblair: side effect of running the merge checks as root possibly? | 17:44 |
| jeblair | clarkb: ah, maybe so | 17:44 |
| jeblair | so, er, i'll stop gerrit and we'll do some chowning | 17:44 |
| fungi | good eye | 17:44 |
| clarkb | jeblair: sounds good | 17:44 |
| fungi | yes, lest we get any more missing commits | 17:45 |
| jeblair | just: chown -R gerrit2.gerrit2 /home/gerrit2/review_site/git ? | 17:45 |
| jeblair | perms look fine, just ownership is wrong | 17:46 |
| fungi | agreed, that should do it | 17:46 |
| fungi | and ought to be reasonably fast | 17:46 |
| clarkb | ya | 17:47 |
| *** koolhead17 has joined #openstack-infra | 17:48 | |
| jeblair | i'm going to do the same for the index dir, just in case | 17:48 |
| clarkb | oh good idea | 17:48 |
| *** koolhead17 has quit IRC | 17:48 | |
| *** koolhead17 has joined #openstack-infra | 17:48 | |
| jeblair | also tmp | 17:48 |
| jeblair | everything else looks good to me | 17:49 |
| clarkb | I believe the index should be read onl but don't trust gerrit enough to count on it | 17:49 |
| jeblair | ready to restart; anyone else want to check anything else first? | 17:49 |
| jeblair | clarkb: oh i thought that was the lucene thing? doesn't it write to that with new changes, etc? | 17:49 |
| fungi | oh, right, that also explains why we normally run teh reindex step as gerrit2 in the project renaming steps | 17:50 |
| fungi | i think we ran into this once before | 17:50 |
| clarkb | jeblair: oh right, its just updating things out of band that can't happen at run time | 17:50 |
| clarkb | jeblair: its read only to management commands like reindex and so on, but gerrit itself writes to it | 17:50 |
| jeblair | clarkb, fungi: ready to restart? | 17:50 |
| clarkb | jeblair: I think index/git/tmp covers it | 17:50 |
| fungi | ready | 17:50 |
| fungi | all lgtm now | 17:51 |
| jeblair | starting | 17:51 |
| *** ildikov has quit IRC | 17:51 | |
| jeblair | https://review.openstack.org/#/c2/181669/ looks correct now | 17:51 |
| clarkb | the conflicts with na 500 error went away | 17:51 |
| clarkb | I am approving the first change now | 17:52 |
| clarkb | rechecking the second one again, I think zuul must've tried to report back while gerrit was down | 17:54 |
| fungi | i just did | 17:54 |
| fungi | both of them tried to report form the check pipeline while gerrit was back offline for the chown, yeah | 17:54 |
| fungi | er, from the check pipeline | 17:54 |
| clarkb | change screen 2 is not pleasant but seems to work | 17:54 |
| jeblair | oh, we seem to have the polling turned on for cs2 | 17:55 |
| jeblair | i just got a little "update from ..." window at the bottom | 17:55 |
| clarkb | jeblair: ya gerrit does that, it is very similar to how gmail does it | 17:55 |
| jeblair | i had to click an 'update' link to actually update the page | 17:55 |
| clarkb | I really dislike that commenting covers over all of the important details of the change | 17:55 |
| jeblair | i sort of imagined it would just update the page, but oh well. | 17:56 |
| clarkb | jeblair: I am not sure why you have to manually ask for it to show the updates | 17:57 |
| clarkb | we seem to be waitnig on precise nodes /me checks nodepool | 17:57 |
| jeblair | clarkb: maybe it's naive and just refreshes everything and would therefore destroy comments in progress or something. | 17:57 |
| clarkb | we have a bunch building | 17:57 |
| jeblair | low min-ready there i guess | 17:58 |
| *** shashankhegde has joined #openstack-infra | 17:58 | |
| zaro | anybody notice the diff preferences in cs2? | 18:00 |
| zaro | pretty nice, but not intuitive to get to. | 18:01 |
| clarkb | zaro: fwiw they are in the old change screen too (and have been long before new change screen existed) | 18:01 |
| clarkb | zaro: do you see the monitoring tab across the top? | 18:02 |
| clarkb | its gone if I sign out | 18:02 |
| *** sabeen1 has joined #openstack-infra | 18:02 | |
| clarkb | just wondering if everyone sees the tab or not (also hitting it when not logged in still forbids access so not worried about that) | 18:02 |
| zaro | no, it's not there for me | 18:03 |
| clarkb | cool | 18:03 |
| jeblair | i reloaded the zuul queue -- people are using the system anyway :) | 18:04 |
| clarkb | the hideci.js stuff seems to work just fine | 18:04 |
| clarkb | what other things should I be checking? | 18:04 |
| clarkb | just approved the second change, once that is in we can update puppet on master then renable on review.o.o | 18:05 |
| fungi | yep, both are in the gate pipeline now | 18:05 |
| *** achanda has joined #openstack-infra | 18:05 | |
| zaro | clarkb: LP integration? | 18:05 |
| fungi | zaro: https://review.openstack.org/180974 is about to test that for us | 18:06 |
| *** ildikov has joined #openstack-infra | 18:06 | |
| zaro | cool | 18:07 |
| fungi | should hopefully merge any second | 18:07 |
| zaro | anybody following the gerrit log? | 18:07 |
| jeblair | zaro: i was but just stopped; want me to look for something? | 18:08 |
| jeblair | i switch to the apache log and i'm seeing a bunch of these: | 18:08 |
| jeblair | 2001:4800:7819:102:be76:4eff:fe05:c9f5 - - [09/May/2015:18:07:41 +0000] "GET /changes/?q=status:merged+owner:&n=250&N=0034f7bb0002c490 HTTP/1.1" 200 150112 "-" "-" | 18:08 |
| fungi | currently tailing it | 18:08 |
| zaro | not really, just wondering in case we see any errors | 18:08 |
| fungi | that's a machine in rackspace with no reverse dns entry | 18:09 |
| *** teran has joined #openstack-infra | 18:09 | |
| jeblair | i kinda want to iptables it | 18:10 |
| clarkb | its paging through all of the merged changes? | 18:10 |
| jeblair | the query isn't changing | 18:10 |
| clarkb | oh its not even shifting the window | 18:10 |
| fungi | wacky | 18:11 |
| clarkb | I think thats what N=0034... is there for right? | 18:11 |
| fungi | yeah that's something misbehaving, and i don't think it's something of ours | 18:11 |
| clarkb | you move that pointer to page | 18:11 |
| jeblair | is that even a valid query? | 18:11 |
| clarkb | jeblair: yes its valid, I ran it and got back the json | 18:11 |
| fungi | it seems to return json results | 18:11 |
| fungi | yeah, that | 18:11 |
| jeblair | weird | 18:11 |
| jeblair | the "owner:" bit seems strange to me | 18:11 |
| clarkb | I think it is saying give me all merged changes with any owner 250 at a time | 18:11 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Support restTokenPrivateKey as $token_private_key https://review.openstack.org/181667 | 18:12 |
| clarkb | manually searching owner: is an error | 18:12 |
| jeblair | yay things merge ^ | 18:12 |
| *** teran has quit IRC | 18:14 | |
| clarkb | the rally change to test LP integration is ~40 minutes out | 18:14 |
| zaro | shouldn't the jenkins result appear before merge succesfully message? | 18:14 |
| openstackgerrit | Merged openstack-infra/system-config: Support restTokenPrivateKey on review.o.o https://review.openstack.org/181669 | 18:14 |
| jeblair | zaro: they often appear in the other order | 18:15 |
| jeblair | ip6tables -I openstack-INPUT 3 -m tcp -s 2001:4800:7819:102:be76:4eff:fe05:c9f5 -j DROP | 18:15 |
| jeblair | how does that look ^ ? | 18:15 |
| clarkb | zaro: I think zuul does a gerrit review --verified 2 --submit "message here" then its up to gerrit to get the order | 18:15 |
| clarkb | jeblair: 3, is above the established allowing rule right? | 18:16 |
| clarkb | yup it is, lgtm | 18:16 |
| jeblair | clarkb: yeah, that is rule number 3 currently, and if i understand -I correctly, that means this will be the new #3 and push that down to 4 | 18:16 |
| *** Somay has joined #openstack-infra | 18:17 | |
| jeblair | clarkb: or i could put it after the established; i don't think we actually have long runinng connections from it | 18:17 |
| fungi | yeah, that looks right | 18:17 |
| clarkb | jeblair: before is where I would put it | 18:17 |
| clarkb | worked well when I Had to block the canonical ddoser thing | 18:17 |
| fungi | 181669 is on the puppetmaster now, so should be safe to try puppet again on gerrit and possibly reenable | 18:18 |
| clarkb | fungi: woot | 18:19 |
| fungi | i'm checking the noop now | 18:19 |
| clarkb | we can do a puppet agent --noop --test to confirm the diff | 18:19 |
| fungi | yeah | 18:19 |
| fungi | hrm... doesn't seem to indicate any changes to apply? | 18:19 |
| clarkb | fungi: thats what we want right? file was updated directly | 18:20 |
| jeblair | forgot the "-p tcp", but added that and the rule is in now | 18:20 |
| jeblair | and they switched to v4 | 18:20 |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 18:21 |
| fungi | clarkb: yeah, pretty sure. it's just gerrit always throws me because it modifies the config after start to insert explicit "" on empty values | 18:21 |
| jeblair | v4 blocked too | 18:21 |
| fungi | did someone else want to rerun puppet for real, or shall i and just do it and | tee /tmp/upgrade.log ? | 18:21 |
| jeblair | fungi: not i | 18:22 |
| fungi | running | 18:22 |
| clarkb | go for it | 18:22 |
| jeblair | (i feel like 5 times per second is too many times per second to check for merged changes) | 18:22 |
| *** koolhead17 has quit IRC | 18:22 | |
| fungi | yep, puppet updated with no changes, as expected | 18:23 |
| clarkb | looks like it ran successfully | 18:23 |
| jeblair | woot | 18:23 |
| fungi | all clear to reenable puppet agent now? | 18:23 |
| jeblair | fungi: ++ | 18:23 |
| clarkb | fungi: yup | 18:23 |
| fungi | done and done | 18:23 |
| jeblair | also, btw, gerrit load has gone down a bit. | 18:23 |
| fungi | heh, i can imagine | 18:24 |
| jeblair | "Update from Jenkins, Gerrit Code Review Show Ignore" is what pops up on CS2 | 18:24 |
| jeblair | "Show" and "Ignore" are links | 18:24 |
| clarkb | I was just able to abandon a change of mine that is no longer necessary. So that works | 18:25 |
| clarkb | jeblair: if you click show it just loads it on the same page though | 18:25 |
| jeblair | yep | 18:25 |
| clarkb | I can try pushing a draft change though I expect that to be blocked still | 18:25 |
| fungi | no reverse dns on that v4 addy either | 18:26 |
| clarkb | draft push was denied | 18:26 |
| jeblair | excellen | 18:26 |
| jeblair | t | 18:26 |
| jeblair | are we ready to #status ok? | 18:27 |
| fungi | i think so | 18:27 |
| fungi | i'm not seeing anything else out of the ordinary now | 18:27 |
| fungi | done with 1.5 scotty hours in the bank | 18:27 |
| jeblair | status ok Gerrit upgrade completed; please report problems in #openstack-infra | 18:27 |
| jeblair | ? | 18:27 |
| zaro | lgtm | 18:28 |
| * fungi makes a thumbs-up gesture | 18:28 | |
| jeblair | #status ok Gerrit upgrade completed; please report problems in #openstack-infra | 18:28 |
| openstackstatus | jeblair: sending ok | 18:28 |
| clarkb | ya I am not able to find anything else that looks wrong | 18:28 |
| openstackgerrit | Clint Adams proposed openstack-infra/system-config: Add #kolla to the list of statusbot channels https://review.openstack.org/181673 | 18:28 |
| clarkb | last thing was the 500 internal server errors that were corrected by the chowning | 18:28 |
| *** otter768 has quit IRC | 18:28 | |
| Clint | sdake: i think https://review.openstack.org/181673 is what you want | 18:28 |
| sdake | thanks clint | 18:28 |
| sdake | appreciate it | 18:28 |
| sdake | I thought one of our community submitted a change like that | 18:29 |
| sdake | maybe it was rejected or lost - not clear | 18:29 |
| *** ChanServ changes topic to "Gerrit 2.10 Upgrade starting at 1600 UTC: https://etherpad.openstack.org/p/gerrit-2.10-upgrade" | 18:30 | |
| -openstackstatus- NOTICE: Gerrit upgrade completed; please report problems in #openstack-infra | 18:30 | |
| *** ujuc has quit IRC | 18:30 | |
| fungi | jeblair: clarkb: i'm going to wager that ip address is a stats scraper (for stackalytics? activity.o.o? reviewstats? something else?) because it's also polling the "CLA Accepted - ICLA" group member list twice every 10 minutes | 18:30 |
| fungi | hopefully whoever it is will get up with us in short order and we can help them fine-tune their queries | 18:31 |
| zaro | thanks guys, have a great rest of the day. | 18:31 |
| superdan | looks good to me from here | 18:31 |
| jeblair | sdake: oh while you are around (and we're not super busy now) -- i don't think we have time in the official summit schedule for the docker registry topic; but i think in general we're happy to run additional infrastructure like that; we can talk about it informally at the summit or handle it in an ML thread | 18:31 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup gerrit ACLs: remove unneccary "refs/heads/stable" https://review.openstack.org/181660 | 18:32 |
| superdan | although I guess they changed the theme again | 18:32 |
| clarkb | fungi: lol hit it with your browser | 18:32 |
| jeblair | zaro: thank you! | 18:32 |
| *** superdan is now known as dansmith | 18:32 | |
| sdake | jeblair sounds good | 18:32 |
| openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Use git push-url instead of a second remote https://review.openstack.org/109869 | 18:32 |
| sdake | jeblair I don't know it warrants an entire hour of discussion anyway | 18:32 |
| sdake | know/think ;) | 18:32 |
| clarkb | fungi: look familiar :) I can ping todd | 18:32 |
| openstackstatus | jeblair: finished sending ok | 18:32 |
| fungi | clarkb: please do | 18:32 |
| jeblair | sdake: sounds good then :) | 18:32 |
| sdake | when we get our integrated gate rolling | 18:33 |
| sdake | I'll come back to the ml with the request | 18:33 |
| sdake | hopefully this will happen by l1 | 18:33 |
| fungi | clarkb: i'm betting that's the "cla management" feature tipit was saying they added to the foundation member system | 18:33 |
| sdake | code is starting to hit the repo | 18:33 |
| sdake | integrated gate/functional gate | 18:33 |
| sdake | too many terms - brain implodes :) | 18:34 |
| fungi | zuul estimates 18 minutes until gerrit (hopefully) auto-closes bug 1452710 | 18:35 |
| openstack | bug 1452710 in Rally "Unit tests for Mistral benchmark are not running in py27 gate" [Undecided,In progress] https://launchpad.net/bugs/1452710 - Assigned to Anastasia Kuznetsova (akuznetsova) | 18:35 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/manual/ http://ci.openstack.org/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/" | 18:35 | |
| *** achanda has quit IRC | 18:36 | |
| *** julim has joined #openstack-infra | 18:37 | |
| jeblair | i'm going to afk for 15 mins or so | 18:38 |
| clarkb | I have pinged foundation people about the iptables rule and have asked them to hop over here so we can figure out what the appropriate query and poll frequency would be | 18:39 |
| kragniz | new gerrit looks shiny! | 18:41 |
| kragniz | the registered date on my profile seems to have reset to today, though | 18:41 |
| kragniz | not sure if that is intended | 18:41 |
| *** yfried|afk has joined #openstack-infra | 18:41 | |
| clarkb | oh hey me too, I bet that is a broken db migration :/ | 18:42 |
| ZZelle | Is it intended that gerrit default screen is old screen? The "default" default screen is new screen when version >=2.0.9 | 18:42 |
| ZZelle | mordred, https://review.openstack.org/109869 is corrected: i corrected some incorrect autorebase and tests | 18:45 |
| *** mpopow has joined #openstack-infra | 18:48 | |
| *** AJaeger has quit IRC | 18:48 | |
| *** AJaeger has joined #openstack-infra | 18:48 | |
| *** AJaeger has joined #openstack-infra | 18:48 | |
| *** banix has joined #openstack-infra | 18:52 | |
| *** openstackgerrit has quit IRC | 18:52 | |
| *** openstackgerrit has joined #openstack-infra | 18:52 | |
| *** mpopow has quit IRC | 18:53 | |
| *** Sukhdev has joined #openstack-infra | 18:53 | |
| *** julim has quit IRC | 18:56 | |
| *** Somay has quit IRC | 18:57 | |
| jeblair | ZZelle: yes, openstack's system default is intentionally the old screen | 19:00 |
| jeblair | kragniz, clarkb: we might be able to update the database to fix that based on data in our mysqldump | 19:01 |
| ZZelle | jeblair, it's perhaps better, the new screen is not really user friendly at first | 19:01 |
| clarkb | jeblair: basically load the old db in under a new name then update rows where old row doesn't match | 19:01 |
| clarkb | ZZelle: s/at first// | 19:01 |
| jeblair | ZZelle: yeah, that's our thinking. 2.10 is a lot better than 2.8 was though. i'm at least ready to entertain discussion of it now, unlike 2.8. :) | 19:02 |
| jeblair | https://bugs.launchpad.net/rally/+bug/1452710 | 19:03 |
| openstack | Launchpad bug 1452710 in Rally "Unit tests for Mistral benchmark are not running in py27 gate" [Undecided,Fix committed] - Assigned to Anastasia Kuznetsova (akuznetsova) | 19:03 |
| ZZelle | jeblair, i see a "My Menu" in preferences is it inherited from the 2.10? or OpenStack custo? | 19:03 |
| jeblair | clarkb, fungi: looks like that bug was updated; shall i send a completion email announcement now? | 19:03 |
| clarkb | ZZelle: I think that is from upstraem, its definitely not our | 19:03 |
| clarkb | jeblair: ++ | 19:03 |
| clarkb | ZZelle: but this looks neat time to test it | 19:04 |
| jeblair | oh that'll be nice. now people can add their own queries there and stop abandoning other peoples changes | 19:04 |
| clarkb | greghaynes: ^ | 19:04 |
| clarkb | greghaynes: https://review.openstack.org/#/settings/preferences may be the start of something useful for making a dashboard | 19:05 |
| ZZelle | clarkb, let see what we can do we with it... perhaps it simplifies access to dashboards | 19:05 |
| greghaynes | clarkb: waaaa | 19:05 |
| greghaynes | clarkb: shiney | 19:05 |
| clarkb | ZZelle: it looks like it lets you make your own dashboard via a ui then you don't have to remember crazy urls | 19:05 |
| *** tiswanso has joined #openstack-infra | 19:05 | |
| clarkb | ya it puts the link up under the My ta | 19:05 |
| greghaynes | looks like you still cant order oldest first though :( | 19:05 |
| *** woodster_ has joined #openstack-infra | 19:06 | |
| clarkb | no, this is just for queries | 19:06 |
| clarkb | table returns are still broken | 19:06 |
| greghaynes | btw - Congrats on the successful upgrade infraers! | 19:06 |
| jeblair | greghaynes: thanks; i think we'll all still be hoping it's successful for the next few days ;) | 19:08 |
| fungi | jeblair: yeah, sorryl, had stepped away for a sec | 19:08 |
| fungi | seems successful to me (not sure if we care about the updated account creation times) | 19:08 |
| fungi | contact info update timestamps seem unchanged, but i think all existing accounts are now showing "registered on 2015-05-09 16:10" | 19:10 |
| *** teran has joined #openstack-infra | 19:10 | |
| fungi | i suppose we could try to mine the originals out of the mysqldump and correct those on the fly | 19:10 |
| fungi | if they're especially important | 19:10 |
| clarkb | The only thing that I can think of as being important for that is figuring out whcih of multiple accounts for a single user is the older/newer | 19:11 |
| clarkb | but that is infrequent enough of a problem that we can probably get by | 19:11 |
| jeblair | i think it would be worth correcting them if it's not too much trouble; should be a fairly simple process. i don't think we need to do it right now though. | 19:13 |
| *** teran has quit IRC | 19:14 | |
| jeblair | msg sent | 19:15 |
| clarkb | jeblair: added a note about the chowning that was required for the git repos to the etherpad | 19:17 |
| fungi | should also be possible to correct them with gerrit online | 19:20 |
| fungi | i believe it just uses that for display purposes, and queries it out of the db when needed | 19:20 |
| *** _nadya_ has joined #openstack-infra | 19:21 | |
| *** tiswanso has quit IRC | 19:22 | |
| *** shashankhegde has quit IRC | 19:41 | |
| dstufft | lifeless: fungi clarkb whoever else I forget, just talked to arigato, he's OK with a PR that has cffi compile to a temporary directory if the regular directory isn't writable + printing a warning to stderr saying that's it's doing that and import is gonna be slow | 19:44 |
| lifeless | thanks | 19:44 |
| dstufft | I also confirmed that he's thinking about ABI compat and how to handle that in cffi 1.0+ so that cffi-runtime upgrades don't make everything blow up | 19:45 |
| lifeless | thats excellent | 19:45 |
| dstufft | (or at the very least, if an upgrade happens that it really can't handle, printing out better error messages) | 19:45 |
| lifeless | we need to add conflicts: to pep-440 | 19:46 |
| lifeless | erm / 426 | 19:46 |
| lifeless | some way of saying 'I'm breaking all your shit' | 19:46 |
| dstufft | I know someone suggested it before, but I don't remember where that discussion went, I'm not opposed to it though | 19:47 |
| lifeless | not on my radar yet | 19:51 |
| lifeless | 3 deep, the dream is getting unstable | 19:51 |
| dstufft | I know that feeling | 19:51 |
| *** ddieterl_ has quit IRC | 19:53 | |
| *** rm_work is now known as rm_work|away | 19:54 | |
| *** trey has quit IRC | 20:01 | |
| fungi | lifeless: i get the feeling you only just found out that virtualenv always uses its bundled version of pip when creating a new virtualenv, regardless of what version of pip you have in the calling environment's path | 20:04 |
| lifeless | fungi: I thought it grabbed the active one yeah | 20:05 |
| fungi | (this being, i gather, the main reason dstufft has started releasing them together with matched version numbers) | 20:05 |
| mordred | oh - I didn't notice the matched version numbers | 20:05 |
| dstufft | so | 20:05 |
| fungi | they're now offset by 12, but otherwise in sync | 20:05 |
| fungi | er, by 6 | 20:05 |
| dstufft | for awhile virtualenv downloaded | 20:05 |
| dstufft | but it did it without any security | 20:06 |
| dstufft | or attempt at security | 20:06 |
| dstufft | so we removed it | 20:06 |
| dstufft | I can't decide if I like the consistency of always using the bundled one more or if I like always getting the latest pip/setuptools more | 20:06 |
| dstufft | I'm kinda leaning towards the second one though | 20:06 |
| fungi | i think the principle of least surprise violation there is in the case of "i already have a particular version of pip installed, why aren't you using that one?" | 20:06 |
| *** trey has joined #openstack-infra | 20:07 | |
| dstufft | we can't use the version of pip you have in the system because it's not a package we can install from | 20:07 |
| lifeless | dstufft: weeeel. | 20:07 |
| lifeless | dstufft: we have the file list :) | 20:07 |
| dstufft | the best we could do is inspect the version and essentially do ``pip install pip==<wahtever>`` | 20:07 |
| dstufft | ok so there are other even hackier things | 20:07 |
| dstufft | but I'd rather not :D | 20:08 |
| *** Darkwan has quit IRC | 20:08 | |
| fungi | yeah, i'm not saying it needs solving, just pointing out that a lot of people using virtualenv are caught unawares by this | 20:09 |
| dstufft | now that we install pip with pip it wouldn't be hard to have pip hit the network | 20:09 |
| dstufft | and do it safely | 20:09 |
| *** teran has joined #openstack-infra | 20:10 | |
| *** ddieterly has joined #openstack-infra | 20:13 | |
| *** teran has quit IRC | 20:16 | |
| lifeless | dstufft: do you release virtualenv every time pip releases? | 20:18 |
| dstufft | lifeless: yea | 20:18 |
| *** shashankhegde has joined #openstack-infra | 20:18 | |
| lifeless | k | 20:18 |
| lifeless | what about setuptools | 20:18 |
| lifeless | is it bundled in virtualenv? | 20:19 |
| *** _nadya_ has quit IRC | 20:19 | |
| dstufft | it's bundled in virtualenv yes, we don't release virtualenv everytime setuptools releases though | 20:19 |
| dstufft | a goal of mine is release automation behind pip and virtualenv so that a new pip or setuptools will just automatically trigger a virtualenv release | 20:20 |
| dstufft | but I haven't gotten around to that yet (partially because I don't like any of the options for automation like jenkins vs buildbot vs whatever) | 20:20 |
| *** banix has quit IRC | 20:23 | |
| *** otter768 has joined #openstack-infra | 20:29 | |
| *** e0ne has joined #openstack-infra | 20:31 | |
| *** e0ne is now known as e0ne_ | 20:31 | |
| *** mpopow has joined #openstack-infra | 20:31 | |
| *** e0ne_ is now known as e0ne | 20:31 | |
| *** e0ne has quit IRC | 20:33 | |
| *** otter768 has quit IRC | 20:35 | |
| *** e0ne has joined #openstack-infra | 20:37 | |
| *** e0ne has quit IRC | 20:39 | |
| *** patrickeast has joined #openstack-infra | 20:40 | |
| *** e0ne has joined #openstack-infra | 20:43 | |
| *** ihrachyshka has joined #openstack-infra | 20:44 | |
| *** harlowja_at_home has joined #openstack-infra | 20:45 | |
| *** e0ne has quit IRC | 20:48 | |
| *** ddieterl_ has joined #openstack-infra | 20:52 | |
| *** e0ne has joined #openstack-infra | 20:52 | |
| *** Sukhdev has quit IRC | 20:53 | |
| *** shashankhegde has quit IRC | 20:54 | |
| *** e0ne has quit IRC | 20:54 | |
| *** ddieterly has quit IRC | 20:55 | |
| *** mriedem has joined #openstack-infra | 20:56 | |
| *** sabeen1 has quit IRC | 20:58 | |
| *** e0ne has joined #openstack-infra | 20:59 | |
| *** tnovacik has quit IRC | 20:59 | |
| *** e0ne has quit IRC | 21:03 | |
| *** e0ne has joined #openstack-infra | 21:07 | |
| *** e0ne has quit IRC | 21:09 | |
| *** teran has joined #openstack-infra | 21:11 | |
| *** e0ne has joined #openstack-infra | 21:13 | |
| *** harlowja_at_home has quit IRC | 21:15 | |
| *** teran has quit IRC | 21:16 | |
| *** e0ne has quit IRC | 21:16 | |
| *** otter768 has joined #openstack-infra | 21:16 | |
| *** e0ne has joined #openstack-infra | 21:20 | |
| *** ibiris is now known as ibiris_away | 21:20 | |
| *** leakypipes has quit IRC | 21:21 | |
| *** e0ne has quit IRC | 21:22 | |
| *** banix has joined #openstack-infra | 21:23 | |
| *** e0ne has joined #openstack-infra | 21:25 | |
| *** e0ne has quit IRC | 21:26 | |
| *** shashankhegde has joined #openstack-infra | 21:27 | |
| *** mpopow has quit IRC | 21:28 | |
| *** shashankhegde has quit IRC | 21:28 | |
| *** otter768 has quit IRC | 21:28 | |
| *** e0ne has joined #openstack-infra | 21:31 | |
| *** ajo has quit IRC | 21:31 | |
| *** e0ne has quit IRC | 21:33 | |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Remove custom taskflow sqlalchemy environments https://review.openstack.org/181687 | 21:42 |
| mordred | lifeless, fungi: I have now read the thread between you where lifeless learns about pip bundling | 21:48 |
| mordred | so I'm caught up | 21:48 |
| *** ihrachyshka has quit IRC | 21:54 | |
| clarkb | keep in mind we havent allowed latest virtualenv because it brings in new pip/setuptools that breaks everything | 21:55 |
| clarkb | happy to switch to latest if we want to deal with that again | 21:56 |
| mordred | yah. I mean, we probably should at some point, but not today | 21:59 |
| clarkb | I do have a change up to use the current release but not 'latest' in puppet | 21:59 |
| clarkb | probably get that in monday | 21:59 |
| *** dmellado has quit IRC | 22:04 | |
| *** dmellado has joined #openstack-infra | 22:04 | |
| lifeless | clarkb: new pip breaks everything? | 22:05 |
| lifeless | clarkb: inside the virtualenv ? | 22:05 |
| *** e0ne has joined #openstack-infra | 22:08 | |
| *** soren has quit IRC | 22:09 | |
| *** tnovacik has joined #openstack-infra | 22:09 | |
| *** patrickeast has quit IRC | 22:10 | |
| clarkb | that has often been the case yes | 22:10 |
| clarkb | well that and/or setuptools | 22:10 |
| *** banix has quit IRC | 22:11 | |
| *** teran has joined #openstack-infra | 22:12 | |
| *** e0ne has quit IRC | 22:13 | |
| *** tjones1 has joined #openstack-infra | 22:13 | |
| *** teran has quit IRC | 22:16 | |
| *** sdake has quit IRC | 22:27 | |
| *** tjones1 has quit IRC | 22:31 | |
| *** sdake has joined #openstack-infra | 22:31 | |
| bknudson | I like the size column... handy | 22:33 |
| *** nzeer has joined #openstack-infra | 22:33 | |
| bknudson | can't sort by it but then I can't sort by any of the columns | 22:33 |
| *** nzeer has quit IRC | 22:40 | |
| *** nzeer has joined #openstack-infra | 22:42 | |
| *** achanda has joined #openstack-infra | 22:54 | |
| *** salv-orlando has quit IRC | 22:58 | |
| *** ddieterl_ has quit IRC | 23:03 | |
| *** Longgeek has quit IRC | 23:06 | |
| *** dboik has quit IRC | 23:09 | |
| *** teran has joined #openstack-infra | 23:13 | |
| *** abregman has quit IRC | 23:13 | |
| *** HeOS has joined #openstack-infra | 23:15 | |
| *** rm_work|away is now known as rm_work | 23:15 | |
| *** teran has quit IRC | 23:17 | |
| *** ddieterly has joined #openstack-infra | 23:23 | |
| *** otter768 has joined #openstack-infra | 23:28 | |
| *** sputnik13 has quit IRC | 23:32 | |
| *** woodster_ has quit IRC | 23:50 | |
| *** craigbr has joined #openstack-infra | 23:58 | |
| *** salv-orlando has joined #openstack-infra | 23:59 | |
| *** otter768 has quit IRC | 23:59 | |
| *** ddieterly has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!