| *** CaptTofu has quit IRC | 00:00 | |
| *** jerryz has quit IRC | 00:00 | |
| jog0 | https://review.openstack.org/#/c/51728/ | 00:04 |
|---|---|---|
| jog0 | lost logs ^ | 00:05 |
| *** wenlock has quit IRC | 00:06 | |
| *** rcleere has quit IRC | 00:08 | |
| *** CaptTofu has joined #openstack-infra | 00:12 | |
| *** UtahDave has quit IRC | 00:14 | |
| *** reed has quit IRC | 00:15 | |
| *** dims has quit IRC | 00:16 | |
| *** alexpilotti has quit IRC | 00:16 | |
| clarkb | jog0: the job itself was lost, I think the job hadn't been added to jenkins before zuul tried running it | 00:24 |
| *** dims has joined #openstack-infra | 00:24 | |
| clarkb | jog0: if you recheck it should see the job now | 00:24 |
| clarkb | there is a slight race between zuul updating and jenkins updating | 00:24 |
| jog0 | clarkb: is there a bug report for that? | 00:24 |
| clarkb | jog0: no, we haven't really been treating it as a bug. More a state of the world | 00:25 |
| jog0 | clarkb: thansk | 00:25 |
| clarkb | jog0: looks like it is still lost. I will poke at it | 00:27 |
| jog0 | clarkb: thanks | 00:28 |
| *** gyee has quit IRC | 00:28 | |
| sdague | clarkb: hmmm.... openstackgerrit need to take a restart to pick up the os-loganalyze repo for reporting? | 00:29 |
| clarkb | sdague: it should auto restart. I think our puppet stuff may not be updating everywhere | 00:30 |
| sdague | ok | 00:30 |
| sdague | well - https://review.openstack.org/#/c/51741/ | 00:30 |
| sdague | that's the fix for console.html | 00:30 |
| *** Loquacity has joined #openstack-infra | 00:30 | |
| *** sarob has quit IRC | 00:32 | |
| *** weshay has quit IRC | 00:32 | |
| sdague | yes | 00:43 |
| sdague | doh, wrong focus window :) | 00:44 |
| *** matsuhashi has joined #openstack-infra | 00:48 | |
| *** sarob has joined #openstack-infra | 00:51 | |
| SpamapS | http://paste.openstack.org/show/48455 <--- missing commits | 00:57 |
| SpamapS | git.openstack.org.1669INA192.237.223.224 | 00:57 |
| SpamapS | if that helps | 00:57 |
| pleia2 | unfortunately that's the address of the load balancer, not specific host | 01:01 |
| *** vipul is now known as vipul-away | 01:04 | |
| openstackgerrit | A change was merged to openstack-infra/config: Move docimpact from created hook to merged https://review.openstack.org/51658 | 01:04 |
| *** nosnos has joined #openstack-infra | 01:05 | |
| lifeless | fungi: ^ | 01:07 |
| pleia2 | I'm not seeing anything obviously out of whack on the git servers themselves (browsing cacti), so might need to look on the gerrit side if it has replication logs or something, fungi was looking at this earlier | 01:07 |
| lifeless | SpamapS: this is a somewhat new thing | 01:07 |
| lifeless | SpamapS: IIRC there is source ip hashing involved, so retrying wont' work | 01:07 |
| lifeless | SpamapS: suggest you pull from github instead | 01:08 |
| jeblair | i've forced a full replication push, let's see if that solves the superficial problem | 01:08 |
| jeblair | obviously it doesn't address the underlying problem | 01:08 |
| jeblair | it still has a few minutes to run until complete | 01:08 |
| *** vipul-away is now known as vipul | 01:09 | |
| jeblair | (a full replication for us is 1116 git push operations) | 01:09 |
| jeblair | lifeless, SpamapS: ok, all of the git.o.o replications are done (github is still running) | 01:10 |
| fungi | yeah, i scoured the logs, and while there are a lot of random transport errors related to replication, none correlated to the combinations of git server, project and last common or first missing commit in the head | 01:11 |
| fungi | and forcing replication for the project in question cleared it right up | 01:11 |
| fungi | maddening | 01:12 |
| fungi | stranger still, the commits were being replicated but heads simply stopped getting updated | 01:13 |
| fungi | and couldn't find any likely gerrit bug reports matching that set of symptoms either | 01:13 |
| jeblair | lifeless, SpamapS: i can find that commit in a fresh clone of heat from all 4 servers | 01:15 |
| jeblair | fungi: i wonder if the local repack has anything to do with it... | 01:15 |
| fungi | that's a promising theory | 01:15 |
| fungi | i wonder whether we should routinely gc those | 01:16 |
| *** nati_ueno has quit IRC | 01:16 | |
| jeblair | fungi: that's done as part of the repack | 01:19 |
| *** yamahata has joined #openstack-infra | 01:19 | |
| jeblair | fungi: it _shouldn't_ be a problem, just brainstorming.... | 01:19 |
| fungi | if maybe the repack holds a write lock and then the replication push ends up contending with that | 01:21 |
| fungi | i did see one unresolved bug (linked earlier) about gerrit replication not retrying on lock contention | 01:23 |
| fungi | though i didn't see any of the mentioned errors in our log for that | 01:23 |
| *** dims has quit IRC | 01:28 | |
| morganfainberg | jeblair, not sure how feasable this would be, but has there been any thoughts about multinode tempest runs? e.g. so we could do some functional tests for migrations. | 01:31 |
| morganfainberg | jeblair, and the like. | 01:31 |
| morganfainberg | jeblair, you might also not be the right person to ask. | 01:32 |
| *** ryanpetrello has quit IRC | 01:32 | |
| clarkb | morganfainberg: I think we would like multinode for testing things (not sure how it helps with migration tests), the tricky bit is networking | 01:37 |
| *** amotoki has joined #openstack-infra | 01:39 | |
| morganfainberg | clarkb, it would make it actually do migrations vs. emulating some of the code paths…but i agree networking is a challenge. I've been trying to figure out how to implement it in a cloud-like environment easily. if i stumble onto something awesome i'll share it :) though, i think you guys have a better handle on it than i do atm. | 01:40 |
| *** wenlock has joined #openstack-infra | 01:40 | |
| morganfainberg | clarkb, but there are other benefits to it vs. just migrations :) | 01:40 |
| clarkb | right I think jog0 would like it simply to test more typicaly deployments. eg controller on one node, compute on another | 01:41 |
| morganfainberg | clarkb, yep yep. | 01:41 |
| morganfainberg | clarkb, and i know we (my company) would like that as well. | 01:42 |
| *** dims has joined #openstack-infra | 01:43 | |
| *** sarob has quit IRC | 01:44 | |
| lifeless | clarkb: we'll be able to do multinode in the tripleo baremetal storyies | 02:00 |
| *** ArxCruz has quit IRC | 02:08 | |
| *** ArxCruz has joined #openstack-infra | 02:12 | |
| *** changbl has quit IRC | 02:17 | |
| *** julim has quit IRC | 02:17 | |
| *** dkranz has joined #openstack-infra | 02:17 | |
| *** xchu has joined #openstack-infra | 02:18 | |
| SpamapS | jeblair: still missing f478b1ec0c64a9cb92703ca8c0857dd0ab2c77e8 when I try to pull from git.o.o | 02:25 |
| SpamapS | and not missing at github | 02:26 |
| *** CaptTofu has quit IRC | 02:28 | |
| *** CaptTofu has joined #openstack-infra | 02:29 | |
| *** changbl has joined #openstack-infra | 02:30 | |
| fungi | SpamapS: on which project is that? | 02:33 |
| *** oubiwann has joined #openstack-infra | 02:33 | |
| pleia2 | fungi: heat http://paste.openstack.org/show/48455/ | 02:34 |
| SpamapS | fungi: Heat | 02:34 |
| *** CaptTofu has quit IRC | 02:35 | |
| SpamapS | and, silly me, I didn't save off my local repo before switching to github | 02:35 |
| *** CaptTofu has joined #openstack-infra | 02:35 | |
| fungi | thanks. saw the url in scrollback but was hoping not to fire up a browser. taking a closer look on the git servers | 02:36 |
| hub_cap | SpamapS: dont worry, when u get back from HK itll be before u left. that gives you time to correct one life mistake. Id correct the local repo issue | 02:36 |
| SpamapS | fantastic | 02:37 |
| SpamapS | that is definitely the one thing I'd go back and do over | 02:37 |
| pleia2 | lol | 02:38 |
| SpamapS | Most of the other things on the "shoulda" list, frankly, would have just gotten me into trouble. | 02:38 |
| hub_cap | right and chances are fixing those _other_ things will just get you into more trouble should u attempt to right them | 02:39 |
| fungi | strange thing is, git log master in the heat repo on all 4 git servers includes f478b1ec0c64a9cb92703ca8c0857dd0ab2c77e8 | 02:42 |
| lifeless | hub_cap: ok so caching | 02:42 |
| hub_cap | hey lifeless yes lets chat caching | 02:42 |
| hub_cap | so the original thought as per mordred was to just copy down the image | 02:42 |
| lifeless | hub_cap: AIUI nodepool images are built in non-privileged mode | 02:42 |
| hub_cap | ok | 02:43 |
| lifeless | hub_cap: the repacking requires root to preserve uids | 02:43 |
| hub_cap | :o | 02:43 |
| lifeless | fin | 02:43 |
| hub_cap | ya perty much | 02:43 |
| *** julim has joined #openstack-infra | 02:43 | |
| hub_cap | so i guess we have to mod dib then to accept a local file? | 02:44 |
| lifeless | there's already a variable you can set | 02:45 |
| lifeless | it's not a beautiful interface, but it's there | 02:45 |
| hub_cap | will it bypass some /cache-url goodness? | 02:45 |
| hub_cap | https://github.com/openstack/diskimage-builder/blob/master/elements/fedora/root.d/10-fedora-cloud-image | 02:45 |
| lifeless | dunno :) - basically give it a go and if needed submit fixes | 02:45 |
| hub_cap | heh cool | 02:46 |
| hub_cap | id rather have a flag in dib if thats ok w/ u to pull down the image and die | 02:46 |
| hub_cap | otherwise the nodepool code is stuck grep'ing at best case, or just guessing at worst | 02:46 |
| hub_cap | in terms of getting the correct dib image | 02:46 |
| lifeless | huh? | 02:46 |
| hub_cap | https://github.com/openstack/diskimage-builder/blob/master/elements/fedora/root.d/10-fedora-cloud-image#L12 | 02:47 |
| hub_cap | i can replicate all that | 02:47 |
| lifeless | why would you? | 02:47 |
| lifeless | you just need a single wgert | 02:47 |
| lifeless | wget | 02:47 |
| hub_cap | sure | 02:47 |
| hub_cap | but thats the "easy, and eventually needs changing" solution, and mordred and i toyed w/ the idea of making sure we are on the same page as dib | 02:48 |
| hub_cap | but i understand these "current" major releases dont change terribly often | 02:48 |
| lifeless | you have to change nodepool when moving to new ubuntu / fedora releases anyhow | 02:48 |
| hub_cap | okey thats enough to make me not worry about it then | 02:49 |
| lifeless | what problem are you anticipating that you want to solve? | 02:49 |
| hub_cap | just overplanning id think | 02:49 |
| lifeless | :) | 02:49 |
| hub_cap | u know, futureproofing and all | 02:49 |
| hub_cap | :P | 02:49 |
| *** guohliu has joined #openstack-infra | 02:49 | |
| *** michchap has quit IRC | 02:50 | |
| *** julim has quit IRC | 02:53 | |
| *** oubiwann has quit IRC | 02:58 | |
| *** CaptTofu has quit IRC | 03:03 | |
| *** aspiers has quit IRC | 03:04 | |
| *** CaptTofu has joined #openstack-infra | 03:04 | |
| *** emagana has quit IRC | 03:06 | |
| *** hogepodge has quit IRC | 03:07 | |
| *** dims has quit IRC | 03:08 | |
| *** oubiwann has joined #openstack-infra | 03:11 | |
| openstackgerrit | Zhongyue Luo proposed a change to openstack-dev/hacking: Add assertNotEquals check to H602 https://review.openstack.org/51355 | 03:18 |
| *** jecarey has joined #openstack-infra | 03:19 | |
| *** oubiwann has quit IRC | 03:26 | |
| *** sarob has joined #openstack-infra | 03:31 | |
| *** SergeyLukjanov has joined #openstack-infra | 03:33 | |
| *** dkehn_ has joined #openstack-infra | 03:34 | |
| *** vipul has quit IRC | 03:36 | |
| *** vipul has joined #openstack-infra | 03:37 | |
| *** dkehn has quit IRC | 03:38 | |
| *** michchap has joined #openstack-infra | 03:39 | |
| *** markmcclain has quit IRC | 03:40 | |
| *** markmcclain has joined #openstack-infra | 03:40 | |
| *** jecarey has quit IRC | 03:43 | |
| *** senk has quit IRC | 03:49 | |
| *** sarob has quit IRC | 03:49 | |
| *** sarob has joined #openstack-infra | 03:50 | |
| *** sarob_ has joined #openstack-infra | 03:51 | |
| *** sarob has quit IRC | 03:54 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 03:58 | |
| *** _SergeyLukjanov has quit IRC | 03:58 | |
| *** yamahata has quit IRC | 04:02 | |
| *** sarob_ has quit IRC | 04:05 | |
| *** sarob has joined #openstack-infra | 04:06 | |
| *** sarob has quit IRC | 04:10 | |
| *** reed has joined #openstack-infra | 04:13 | |
| *** nati_ueno has joined #openstack-infra | 04:16 | |
| *** Loquacities has joined #openstack-infra | 04:18 | |
| *** yaguang has joined #openstack-infra | 04:20 | |
| *** senk has joined #openstack-infra | 04:20 | |
| *** yaguang_ has joined #openstack-infra | 04:20 | |
| *** Loquacity has quit IRC | 04:20 | |
| *** jhesketh has quit IRC | 04:21 | |
| *** yaguang has quit IRC | 04:24 | |
| *** reed has quit IRC | 04:25 | |
| *** senk has quit IRC | 04:27 | |
| *** yamahata has joined #openstack-infra | 04:31 | |
| *** Loquacities has quit IRC | 04:33 | |
| *** sarob has joined #openstack-infra | 04:36 | |
| *** sarob has quit IRC | 04:41 | |
| *** sarob has joined #openstack-infra | 04:42 | |
| *** vipul is now known as vipul-away | 04:45 | |
| *** Loquacities has joined #openstack-infra | 04:49 | |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 05:07 |
| *** matsuhashi has quit IRC | 05:11 | |
| *** SergeyLukjanov has joined #openstack-infra | 05:11 | |
| *** matsuhashi has joined #openstack-infra | 05:11 | |
| *** matsuhashi has quit IRC | 05:13 | |
| *** matsuhashi has joined #openstack-infra | 05:14 | |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 05:16 |
| *** vipul-away is now known as vipul | 05:22 | |
| *** matsuhashi has quit IRC | 05:22 | |
| *** matsuhashi has joined #openstack-infra | 05:23 | |
| *** senk has joined #openstack-infra | 05:25 | |
| *** sarob has quit IRC | 05:27 | |
| *** mtreinish has quit IRC | 05:27 | |
| *** sarob has joined #openstack-infra | 05:27 | |
| *** matsuhashi has quit IRC | 05:27 | |
| *** nicedice_ has quit IRC | 05:28 | |
| *** sarob has quit IRC | 05:28 | |
| *** mtreinish has joined #openstack-infra | 05:29 | |
| *** senk has quit IRC | 05:29 | |
| *** afazekas has joined #openstack-infra | 05:29 | |
| *** __afazekas has quit IRC | 05:30 | |
| *** matsuhashi has joined #openstack-infra | 05:34 | |
| *** wenlock has quit IRC | 05:38 | |
| *** afazekas has quit IRC | 05:43 | |
| *** turul_ has joined #openstack-infra | 05:43 | |
| *** turul_ is now known as afazekas | 05:43 | |
| *** mtreinish has quit IRC | 05:44 | |
| *** pblaho has joined #openstack-infra | 05:47 | |
| *** mtreinish has joined #openstack-infra | 05:55 | |
| openstackgerrit | A change was merged to openstack-dev/hacking: Replace OpenStack LLC with OpenStack Foundation https://review.openstack.org/47439 | 06:02 |
| openstackgerrit | A change was merged to openstack-dev/hacking: Sync requirements with OS requirements https://review.openstack.org/50252 | 06:14 |
| *** Loquacities has quit IRC | 06:21 | |
| *** senk has joined #openstack-infra | 06:25 | |
| *** sarob has joined #openstack-infra | 06:28 | |
| *** senk has quit IRC | 06:29 | |
| *** sarob has quit IRC | 06:32 | |
| *** Loquacities has joined #openstack-infra | 06:34 | |
| *** ryanpetrello has joined #openstack-infra | 06:35 | |
| *** afazekas has quit IRC | 06:38 | |
| *** jcoufal has joined #openstack-infra | 06:38 | |
| *** rwsu has quit IRC | 06:45 | |
| *** ryanpetrello has quit IRC | 06:51 | |
| *** ryanpetrello has joined #openstack-infra | 06:51 | |
| *** ryanpetrello has quit IRC | 06:52 | |
| *** rwsu has joined #openstack-infra | 06:52 | |
| *** odyssey4me has joined #openstack-infra | 06:54 | |
| *** marun has joined #openstack-infra | 06:56 | |
| *** bingbu has joined #openstack-infra | 06:58 | |
| *** amotoki has quit IRC | 06:58 | |
| *** afazekas has joined #openstack-infra | 07:03 | |
| *** xchu has quit IRC | 07:17 | |
| *** qba73 has joined #openstack-infra | 07:26 | |
| *** sarob has joined #openstack-infra | 07:28 | |
| *** sarob has quit IRC | 07:32 | |
| *** xchu has joined #openstack-infra | 07:33 | |
| *** dafter has joined #openstack-infra | 07:38 | |
| *** dafter has quit IRC | 07:38 | |
| *** dafter has joined #openstack-infra | 07:38 | |
| *** yaguang_ has quit IRC | 07:38 | |
| *** yaguang has joined #openstack-infra | 07:39 | |
| *** mtreinish has quit IRC | 07:41 | |
| openstackgerrit | Ivan-Zhu proposed a change to openstack-infra/devstack-gate: enable novnc and xvpvnc https://review.openstack.org/51790 | 07:41 |
| *** mtreinish has joined #openstack-infra | 07:42 | |
| *** qba73 has quit IRC | 07:44 | |
| *** flaper87|afk is now known as flaper87 | 07:45 | |
| *** SergeyLukjanov has quit IRC | 07:46 | |
| *** fbo_away is now known as fbo | 07:54 | |
| *** senk has joined #openstack-infra | 07:56 | |
| *** yassine has joined #openstack-infra | 07:57 | |
| *** senk has quit IRC | 08:00 | |
| *** DinaBelova has joined #openstack-infra | 08:03 | |
| *** guohliu has quit IRC | 08:05 | |
| *** jpich has joined #openstack-infra | 08:05 | |
| *** aspiers has joined #openstack-infra | 08:07 | |
| *** derekh has joined #openstack-infra | 08:08 | |
| *** yamahata has quit IRC | 08:08 | |
| *** matsuhas_ has joined #openstack-infra | 08:14 | |
| *** matsuhashi has quit IRC | 08:15 | |
| *** tvb|afk has joined #openstack-infra | 08:15 | |
| *** tvb|afk has joined #openstack-infra | 08:15 | |
| *** matsuhashi has joined #openstack-infra | 08:15 | |
| *** guohliu has joined #openstack-infra | 08:17 | |
| *** dafter has quit IRC | 08:19 | |
| *** matsuhas_ has quit IRC | 08:19 | |
| *** qba73 has joined #openstack-infra | 08:20 | |
| *** xchu has quit IRC | 08:27 | |
| *** qba73 has left #openstack-infra | 08:27 | |
| *** sarob has joined #openstack-infra | 08:29 | |
| *** sarob has quit IRC | 08:33 | |
| *** nati_ueno has quit IRC | 08:37 | |
| *** nati_ueno has joined #openstack-infra | 08:37 | |
| *** xchu has joined #openstack-infra | 08:39 | |
| openstackgerrit | Ya Hong Du proposed a change to openstack-infra/devstack-gate: Enable Neutron FWaaS service https://review.openstack.org/51798 | 08:41 |
| *** nati_ueno has quit IRC | 08:42 | |
| *** tvb|afk has quit IRC | 08:49 | |
| *** johnthetubaguy has joined #openstack-infra | 08:51 | |
| *** senk has joined #openstack-infra | 08:57 | |
| *** senk has quit IRC | 09:01 | |
| *** guohliu has quit IRC | 09:04 | |
| *** dizquierdo has joined #openstack-infra | 09:06 | |
| *** DinaBelova has quit IRC | 09:08 | |
| *** yolanda has quit IRC | 09:10 | |
| *** yolanda has joined #openstack-infra | 09:11 | |
| *** guohliu has joined #openstack-infra | 09:17 | |
| *** hashar has joined #openstack-infra | 09:19 | |
| *** sarob has joined #openstack-infra | 09:29 | |
| *** CaptTofu_ has joined #openstack-infra | 09:32 | |
| *** mrodden1 has joined #openstack-infra | 09:33 | |
| *** bnemec_ has joined #openstack-infra | 09:34 | |
| *** sarob has quit IRC | 09:34 | |
| *** CaptTofu has quit IRC | 09:38 | |
| *** mrodden has quit IRC | 09:38 | |
| *** bnemec has quit IRC | 09:38 | |
| *** openstackgerrit has quit IRC | 09:38 | |
| *** pabelanger has quit IRC | 09:38 | |
| *** uvirtbot has quit IRC | 09:38 | |
| *** pabelanger has joined #openstack-infra | 09:39 | |
| *** uvirtbot has joined #openstack-infra | 09:40 | |
| *** dafter has joined #openstack-infra | 09:42 | |
| *** dafter has quit IRC | 09:43 | |
| *** markmc has joined #openstack-infra | 09:44 | |
| *** DinaBelova has joined #openstack-infra | 09:45 | |
| *** yamahata has joined #openstack-infra | 09:47 | |
| *** tvb|afk has joined #openstack-infra | 09:49 | |
| *** senk has joined #openstack-infra | 09:57 | |
| *** senk has quit IRC | 10:02 | |
| *** CaptTofu_ has quit IRC | 10:06 | |
| *** CaptTofu has joined #openstack-infra | 10:06 | |
| *** flaper87 is now known as flaper87|afk | 10:11 | |
| *** xchu has quit IRC | 10:15 | |
| *** pcm_ has joined #openstack-infra | 10:17 | |
| *** pcm_ has quit IRC | 10:22 | |
| *** pcm_ has joined #openstack-infra | 10:23 | |
| *** anteaya has joined #openstack-infra | 10:24 | |
| *** DinaBelova has quit IRC | 10:27 | |
| *** boris-42 has quit IRC | 10:27 | |
| *** nosnos has quit IRC | 10:28 | |
| *** nosnos has joined #openstack-infra | 10:28 | |
| *** sarob has joined #openstack-infra | 10:30 | |
| *** boris-42 has joined #openstack-infra | 10:31 | |
| *** nosnos has quit IRC | 10:33 | |
| *** yaguang has quit IRC | 10:34 | |
| *** sarob has quit IRC | 10:34 | |
| anteaya | clarkb: on the 12th you posted => <clarkb> anteaya: sdague: the biggest node we can get is 30GB of that 16GB is hard allocated to jvm heap | 10:35 |
| anteaya | to that i respond, hmmmm looks you already have that part then | 10:36 |
| anteaya | do you think any of the other optimization suggestions are worth considering? | 10:36 |
| anteaya | https://etherpad.openstack.org/p/elasticsearch-optimization-suggestions | 10:37 |
| *** tvb|afk has quit IRC | 10:37 | |
| *** dafter has joined #openstack-infra | 10:37 | |
| *** CaptTofu has quit IRC | 10:38 | |
| *** CaptTofu has joined #openstack-infra | 10:38 | |
| *** fifieldt_ has quit IRC | 10:39 | |
| *** michchap has quit IRC | 10:42 | |
| *** michchap_ has joined #openstack-infra | 10:42 | |
| *** tvb|afk has joined #openstack-infra | 10:42 | |
| *** tvb|afk has quit IRC | 10:42 | |
| *** tvb|afk has joined #openstack-infra | 10:42 | |
| *** bingbu has quit IRC | 10:43 | |
| *** dafter has quit IRC | 10:43 | |
| *** fifieldt has joined #openstack-infra | 10:45 | |
| *** senk has joined #openstack-infra | 10:46 | |
| *** johnthetubaguy1 has joined #openstack-infra | 10:46 | |
| *** johnthetubaguy has quit IRC | 10:48 | |
| *** DinaBelova has joined #openstack-infra | 10:59 | |
| *** tvb|afk has quit IRC | 11:01 | |
| *** bauzas is now known as bauzas_[lunch] | 11:02 | |
| *** dafter has joined #openstack-infra | 11:02 | |
| *** dafter has quit IRC | 11:02 | |
| *** dafter has joined #openstack-infra | 11:02 | |
| *** yamahata has quit IRC | 11:07 | |
| *** yamahata has joined #openstack-infra | 11:09 | |
| *** dhouck_ has joined #openstack-infra | 11:15 | |
| *** alexpilotti has joined #openstack-infra | 11:18 | |
| *** johnthetubaguy1 has quit IRC | 11:20 | |
| *** johnthetubaguy has joined #openstack-infra | 11:22 | |
| *** johnthetubaguy1 has joined #openstack-infra | 11:24 | |
| *** johnthetubaguy has quit IRC | 11:25 | |
| *** dkranz has quit IRC | 11:27 | |
| *** tvb|afk has joined #openstack-infra | 11:28 | |
| *** tvb|afk has joined #openstack-infra | 11:28 | |
| sdague | anyone want to take a look at this to get our console logs back to the way they were - https://review.openstack.org/#/c/51741/ | 11:28 |
| *** dafter_ has joined #openstack-infra | 11:29 | |
| *** dafter_ has quit IRC | 11:29 | |
| *** dafter_ has joined #openstack-infra | 11:30 | |
| *** dafter has quit IRC | 11:32 | |
| *** dafter_ has quit IRC | 11:32 | |
| *** tvb|afk has quit IRC | 11:33 | |
| *** dims has joined #openstack-infra | 11:36 | |
| *** marun has quit IRC | 11:42 | |
| *** marun has joined #openstack-infra | 11:44 | |
| *** lcestari has joined #openstack-infra | 11:47 | |
| *** bauzas_[lunch] is now known as bauzas | 11:47 | |
| anteaya | sdague: is there a prior patch that 51741 is addressing? | 11:49 |
| *** flaper87|afk is now known as flaper87 | 11:49 | |
| anteaya | if so, I would like to take a peek at it | 11:49 |
| *** mriedem has joined #openstack-infra | 11:50 | |
| sdague | anteaya: well, it's actually this config change - https://review.openstack.org/#/c/51707/ | 11:50 |
| anteaya | thanks | 11:50 |
| sdague | which is now running console.html through this filter as well | 11:51 |
| *** dafter has joined #openstack-infra | 11:52 | |
| anteaya | okay | 11:52 |
| *** boris-42 has quit IRC | 11:53 | |
| *** tvb|afk has joined #openstack-infra | 11:57 | |
| *** tvb|afk has quit IRC | 11:57 | |
| *** tvb|afk has joined #openstack-infra | 11:57 | |
| *** tvb|afk has quit IRC | 11:57 | |
| anteaya | sdague: do you think it would be worthwhile adding a comment to 51741 mentioning 51707? | 11:57 |
| *** guohliu has quit IRC | 11:57 | |
| *** tvb|afk has joined #openstack-infra | 11:57 | |
| *** yaguang has joined #openstack-infra | 11:58 | |
| sdague | anteaya: it couldn't hurt, but I thought we had enough context in there already | 11:58 |
| anteaya | oh okay, well I am coming in in the middle so I was weak on context | 11:58 |
| anteaya | but I will comment on the code and acknowledge that I am relying on others to ensure the patch is contextual | 11:59 |
| anteaya | done | 12:00 |
| *** dafter has quit IRC | 12:00 | |
| *** yassine has quit IRC | 12:04 | |
| *** beagles has joined #openstack-infra | 12:04 | |
| *** afazekas has quit IRC | 12:05 | |
| *** flaper87 is now known as flaper87|afk | 12:08 | |
| *** afazekas has joined #openstack-infra | 12:10 | |
| *** yassine has joined #openstack-infra | 12:12 | |
| *** marun has quit IRC | 12:15 | |
| *** flaper87|afk is now known as flaper87 | 12:16 | |
| sdague | cool, thanks | 12:18 |
| *** adalbas has joined #openstack-infra | 12:26 | |
| anteaya | sdague: I added the comment, since I had thought about it 3 times, it was easier to just do it | 12:30 |
| *** sandywalsh has joined #openstack-infra | 12:30 | |
| *** dolphm has joined #openstack-infra | 12:36 | |
| dolphm | bug 1021879 is particularly exciting | 12:39 |
| uvirtbot | Launchpad bug 1021879 in openstack-ci "have zuul handle cross-repo-dependencies" [Medium,Triaged] https://launchpad.net/bugs/1021879 | 12:39 |
| *** pblaho has quit IRC | 12:40 | |
| *** yolanda has quit IRC | 12:40 | |
| *** yolanda has joined #openstack-infra | 12:40 | |
| *** marun has joined #openstack-infra | 12:40 | |
| *** dizquierdo has left #openstack-infra | 12:42 | |
| *** dizquierdo has joined #openstack-infra | 12:43 | |
| *** rakhmerov has joined #openstack-infra | 12:45 | |
| *** weshay has joined #openstack-infra | 12:45 | |
| *** johnthetubaguy1 is now known as johnthetubaguy | 12:47 | |
| fungi | dolphm: more exciting would be if anyone had time to implement it. we did have a round-table about possible implementation interface back at the infra boot-camp in july, and the ideas were similar to what you described in your bug comment | 12:47 |
| rakhmerov | hi, how long does it usually take to approve and merge a new project's configs? We've sent a change req for a new proj (https://review.openstack.org/#/c/51205) and looks like one of the core reviewers said 'ok'. Not sure if somebody else should. | 12:49 |
| fungi | seems we've lost gerritbot and statusbot. giving them both a swift kick | 12:49 |
| *** miqui has joined #openstack-infra | 12:49 | |
| *** CaptTofu has quit IRC | 12:50 | |
| *** adalbas has quit IRC | 12:50 | |
| *** CaptTofu has joined #openstack-infra | 12:50 | |
| fungi | rakhmerov: since official openstack projects are our primary mission, work to help stackforge projects takes a little longer because of priorities. i'll try to have a look at that one today, but a week is not an unreasonable turn-around for those recently, what with the havana release going on | 12:51 |
| anteaya | fungi once they are back up, can you tell me is uvirbot under our umbrella? | 12:52 |
| fungi | anteaya: it is not. soren manages uvirtbot | 12:52 |
| anteaya | I don't see a git.o.o repo and I remember something about one of or bots not being with us | 12:52 |
| anteaya | ah | 12:52 |
| rakhmerov | fungi: yes, that's totally understandable. Thanks. Just was unsure about the routine | 12:53 |
| anteaya | is the plan for soren to continue to manage uvirtbot? | 12:53 |
| *** amotoki has joined #openstack-infra | 12:53 | |
| *** dolphm has quit IRC | 12:53 | |
| *** rakhmerov has left #openstack-infra | 12:53 | |
| *** bingbu has joined #openstack-infra | 12:53 | |
| *** bingbu has quit IRC | 12:54 | |
| fungi | anteaya: presumably. assuming he wants to continue managing it | 12:54 |
| anteaya | okay thanks, just reviewing bot structure | 12:55 |
| *** bingbu has joined #openstack-infra | 12:55 | |
| *** bingbu has quit IRC | 12:55 | |
| *** bingbu has joined #openstack-infra | 12:55 | |
| *** thomasm has joined #openstack-infra | 12:56 | |
| *** fifieldt has quit IRC | 12:56 | |
| fungi | so looks like we lost openstackgerrit to a ping timeout today at 09:38:36 (but the process is still running on the server), and openstackstatus disapeared at 10:20:51 yesterday closing its connection (process is not running at all on the server) | 12:56 |
| *** thomasm is now known as Guest81981 | 12:56 | |
| anteaya | utc time? | 12:57 |
| fungi | yeah. i'm checking their logs before i (re)start them | 12:57 |
| anteaya | k thanks | 12:57 |
| anteaya | are their logs accessible publicly | 12:58 |
| anteaya | would love to look | 12:58 |
| *** Guest81981 is now known as thomasem | 12:58 | |
| *** dolphm has joined #openstack-infra | 12:59 | |
| *** afazekas has quit IRC | 13:00 | |
| *** ryanpetrello has joined #openstack-infra | 13:01 | |
| *** openstackgerrit has joined #openstack-infra | 13:02 | |
| fungi | no, they're not. but also nothing of interest in the gerritbot logs. dug around a good 10 minutes before the timeout all the way up through when it fell off the server and no indication in the logs that it ever knew anything out of the ordinary happened | 13:03 |
| fungi | still maintained its connection for the gerrit event stream and was receiving events and thought it was announcing them | 13:04 |
| *** tvb|afk has quit IRC | 13:04 | |
| *** matty_dubs|gone is now known as matty_dubs | 13:06 | |
| *** jhesketh__ has quit IRC | 13:06 | |
| fungi | and statusbot's logs (even the debug log) just stop at the point where the process died | 13:07 |
| *** dafter has joined #openstack-infra | 13:07 | |
| fungi | no error, no traceback, nothing | 13:07 |
| soren | anteaya, fungi: I'm happy to continue maintaining it (uvirtbot). If I decide differently at some point, I'll get in touch. | 13:07 |
| *** openstackstatus has joined #openstack-infra | 13:08 | |
| fungi | soren: your efforts are greatly appreciated, as always! | 13:08 |
| soren | :) | 13:08 |
| anteaya | soren: okay thanks, just looking at the bots and wanted to get a clear picture | 13:09 |
| anteaya | fungi: okay thanks | 13:09 |
| anteaya | funny nothing showed up in the logs | 13:09 |
| ttx | openstackstatus seems like the bot which should always be up and it's down half the time :) | 13:09 |
| fungi | ttx: yes. perhaps we need an openstackstatusstatus bot to announce the status of openstackstatus | 13:10 |
| anteaya | ha ha ha | 13:10 |
| anteaya | does openstackstatus need better logging so that when it is down, we have a clearer picture as to why? | 13:10 |
| soren | anteaya: Understood. | 13:10 |
| fungi | or someone to leave it running under a debugger sometime and catch it when it dies. i suspect it wouldn't drag down performance much given its activity leve | 13:11 |
| fungi | l | 13:11 |
| fungi | anteaya: yes | 13:11 |
| *** ruhe has joined #openstack-infra | 13:11 | |
| anteaya | okay thanks, let me do up a bug report and then you have a place to offer your guidance and suggestions | 13:11 |
| *** dafter has quit IRC | 13:15 | |
| *** dafter has joined #openstack-infra | 13:15 | |
| anteaya | https://bugs.launchpad.net/openstack-ci/+bug/1240065 | 13:17 |
| uvirtbot | Launchpad bug 1240065 in openstack-ci "statusbot needs better logging" [Undecided,New] | 13:17 |
| anteaya | comments welcome | 13:17 |
| *** tvb|afk has joined #openstack-infra | 13:18 | |
| anteaya | time for me to move venues, back later | 13:18 |
| *** anteaya has quit IRC | 13:18 | |
| *** dafter has quit IRC | 13:20 | |
| *** dizquierdo has joined #openstack-infra | 13:20 | |
| *** johnthetubaguy has quit IRC | 13:20 | |
| *** adalbas has joined #openstack-infra | 13:20 | |
| *** senk has quit IRC | 13:22 | |
| *** yassine has quit IRC | 13:23 | |
| *** yassine has joined #openstack-infra | 13:23 | |
| *** johnthetubaguy has joined #openstack-infra | 13:24 | |
| *** dprince has joined #openstack-infra | 13:25 | |
| *** afazekas has joined #openstack-infra | 13:25 | |
| *** ryanpetrello has quit IRC | 13:27 | |
| *** ryanpetrello has joined #openstack-infra | 13:27 | |
| *** ruhe has quit IRC | 13:29 | |
| *** wenlock has joined #openstack-infra | 13:30 | |
| *** ruhe has joined #openstack-infra | 13:30 | |
| *** jpeeler has joined #openstack-infra | 13:31 | |
| *** blamar has joined #openstack-infra | 13:31 | |
| *** dguitarbite_ has joined #openstack-infra | 13:31 | |
| *** dguitarbite_ is now known as dguitarbite1 | 13:31 | |
| *** thomasbiege1 has joined #openstack-infra | 13:32 | |
| *** jcoufal has quit IRC | 13:36 | |
| *** thomasem has quit IRC | 13:40 | |
| *** ruhe has quit IRC | 13:43 | |
| *** DinaBelova has quit IRC | 13:46 | |
| *** jecarey has joined #openstack-infra | 13:48 | |
| *** ruhe has joined #openstack-infra | 13:49 | |
| *** prad has joined #openstack-infra | 13:50 | |
| *** vogxn has joined #openstack-infra | 13:53 | |
| *** thomasbiege1 has quit IRC | 13:56 | |
| *** boris-42 has joined #openstack-infra | 13:58 | |
| *** jcoufal has joined #openstack-infra | 14:04 | |
| *** wenlock has quit IRC | 14:05 | |
| *** ruhe has quit IRC | 14:06 | |
| *** rpodolyaka has joined #openstack-infra | 14:07 | |
| *** dcramer_ has joined #openstack-infra | 14:07 | |
| *** eharney has joined #openstack-infra | 14:10 | |
| sdague | fungi: woot, at least we know the CD on the os-loganalyzer works | 14:10 |
| fungi | yes | 14:10 |
| *** ruhe has joined #openstack-infra | 14:11 | |
| *** bingbu has quit IRC | 14:15 | |
| *** SergeyLukjanov has joined #openstack-infra | 14:16 | |
| *** changbl has quit IRC | 14:17 | |
| sdague | fungi: ok, out of my depth on this zuul config definition - https://review.openstack.org/#/c/51726/ pointers would be appreciated to help me create the right patch | 14:19 |
| jeblair | my gerritbot change merged, but i don't think gerritbot is cd from git, i think it deploys releases | 14:19 |
| *** thedodd has joined #openstack-infra | 14:19 | |
| mtreinish | fungi: quick question, all the elastic-recheck py27 jobs are coming up as "LOST" did I miss something on: https://review.openstack.org/#/c/50743/ | 14:20 |
| jeblair | lifeless: 02:44 < lifeless> hub_cap: AIUI nodepool images are built in non-privileged mode | 14:21 |
| *** yaguang has quit IRC | 14:22 | |
| *** dguitarbite1 has quit IRC | 14:22 | |
| *** dolphm has quit IRC | 14:23 | |
| *** oubiwann has joined #openstack-infra | 14:23 | |
| jeblair | lifeless: i'm not completely sure what you mean by that, but the image build scripts do run with root access. | 14:23 |
| fungi | jeblair: gerritbot is not cd. we've installed 1.2 on review.o.o so either we need to tag it and release or switch to cd | 14:27 |
| *** wenlock has joined #openstack-infra | 14:27 | |
| *** thomasm has joined #openstack-infra | 14:28 | |
| *** jecarey has quit IRC | 14:28 | |
| *** thomasm is now known as Guest12746 | 14:28 | |
| *** markmcclain has joined #openstack-infra | 14:29 | |
| *** SergeyLukjanov has quit IRC | 14:32 | |
| ttx | mordred: making progress on those postrelease meta-repo tasks ? Or should we just do it by hand Friday ? | 14:32 |
| mordred | ttx: well, the repo hasn't been approved yet | 14:32 |
| mordred | jeblair, fungi ? | 14:33 |
| ttx | mordred: ok, maybe we can reconstruct it next week then | 14:33 |
| mordred | jeblair, fungi: https://review.openstack.org/#/c/50212/ | 14:33 |
| *** dkehn_ is now known as dkehn | 14:33 | |
| *** ruhe has quit IRC | 14:33 | |
| *** matsuhashi has quit IRC | 14:34 | |
| *** david-lyle_ has joined #openstack-infra | 14:34 | |
| jeblair | mordred: lgtm; clarkb has questions | 14:35 |
| *** ruhe has joined #openstack-infra | 14:35 | |
| *** matsuhashi has joined #openstack-infra | 14:35 | |
| *** jecarey has joined #openstack-infra | 14:35 | |
| mordred | jeblair: sorry, I answered those to him in irc | 14:35 |
| fungi | sdague: left some comments on that review | 14:35 |
| * mordred adds to review | 14:35 | |
| *** rcleere has joined #openstack-infra | 14:36 | |
| *** SergeyLukjanov has joined #openstack-infra | 14:38 | |
| *** pentameter has joined #openstack-infra | 14:38 | |
| *** datsun180b has joined #openstack-infra | 14:38 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 14:38 | |
| fungi | mordred: do you have a writeup somewhere (wiki, ml thread, irc log) of the workflow surrounding 50212? | 14:39 |
| *** matsuhashi has quit IRC | 14:39 | |
| *** _SergeyLukjanov has quit IRC | 14:39 | |
| fungi | oh, i see the readme now | 14:40 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: add bash8 to devstack tests https://review.openstack.org/51726 | 14:40 |
| fungi | presumably the only reviews for openstack/openstack will be updates to the .gitmodules, readme.rst, et cetera | 14:42 |
| mordred | yes | 14:45 |
| *** adalbas has quit IRC | 14:45 | |
| *** bingbu has joined #openstack-infra | 14:48 | |
| sdague | fungi, man I hate that I can't post comments on the old patch after the new one is there :) | 14:52 |
| *** SergeyLukjanov has joined #openstack-infra | 14:52 | |
| jeblair | sdague: you should be able to; what happens when you try? | 14:53 |
| *** alcabrera has joined #openstack-infra | 14:53 | |
| sdague | jeblair: it's just permantly in a draft state, I can't seem to save it | 14:54 |
| fungi | sdague: weird--i just left another comment on patchset 2 | 14:55 |
| fungi | no problem | 14:55 |
| fungi | sdague: when you expand patchset 2 you should click the review button there rather than the review button for patchset 3. i think that might be your confusion | 14:56 |
| *** zojoncj has joined #openstack-infra | 14:56 | |
| sdague | ok, could be | 14:56 |
| fungi | i agree it's an odd interface, but i look at it as a deterrent to people accidentally commenting on the wrong patchset. you have to *really* want it ;) | 14:57 |
| sdague | ah, got it now | 14:58 |
| sdague | ok, I'm down to the 'gate-{name}-bash8' job group question | 14:58 |
| sdague | I guess I'm a little lost in that we don't have a devstack project definition in projects.yaml | 14:59 |
| * fungi looks | 15:00 | |
| fungi | it's possible if devstack has no jobs of its on yet (only shared/integration tests) | 15:01 |
| *** reed has joined #openstack-infra | 15:01 | |
| sdague | yes, that's the case | 15:01 |
| sdague | so in that case, I add a new entry for it? | 15:01 |
| fungi | yep, similar to others you see | 15:02 |
| sdague | ok, cool, thanks | 15:02 |
| fungi | the jobs: list could just contain the gate-{name}-bash8 template | 15:02 |
| *** vogxn has quit IRC | 15:02 | |
| *** rnirmal has joined #openstack-infra | 15:02 | |
| fungi | also does bash8 come as part of devstack or will we need to install it on the slaves (or have we already done that in an earlier change)? | 15:03 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: add bash8 to devstack tests https://review.openstack.org/51726 | 15:03 |
| sdague | fungi: it's in devstack | 15:03 |
| fungi | okay, great | 15:04 |
| fungi | that's what i was hoping | 15:04 |
| *** wenlock_ has joined #openstack-infra | 15:04 | |
| sdague | yeh this wrapper script still needs to land before the config would work - https://review.openstack.org/#/c/51711/ | 15:04 |
| *** afazekas has quit IRC | 15:04 | |
| *** senk has joined #openstack-infra | 15:04 | |
| sdague | but dtroyer just pushed it into the tree. It's something we'll evolve in devstack, and if it becomes useful enough, we'll spin it out | 15:04 |
| fungi | is it part of the devstack project? thoughts about eventually breaking it out into its own project if it's a generally useful shell script analyzer? | 15:05 |
| fungi | heh, you answer my questions before i can type them ;) | 15:05 |
| sdague | heh jinx, almost :) | 15:05 |
| sdague | yeh, consider devstack a good incubation ground to let it prove it's usefulness first | 15:05 |
| *** wenlock has quit IRC | 15:06 | |
| *** wenlock_ is now known as wenlock | 15:06 | |
| *** Guest12746 is now known as thomasem | 15:07 | |
| sdague | fungi: thanks for your help on this :) | 15:07 |
| *** hashar has quit IRC | 15:08 | |
| fungi | sdague: any time | 15:08 |
| *** hashar has joined #openstack-infra | 15:08 | |
| *** reed has quit IRC | 15:11 | |
| *** mgagne has joined #openstack-infra | 15:14 | |
| *** changbl has joined #openstack-infra | 15:19 | |
| *** iccha_ has joined #openstack-infra | 15:24 | |
| iccha_ | hey esheffield hows it going with the nova commit where one test was failing? | 15:24 |
| *** mrodden1 has quit IRC | 15:24 | |
| esheffield | badly - testr didn't reveal anything | 15:25 |
| iccha_ | clarkb: fungi any thoughts? ^ | 15:25 |
| *** ruhe has quit IRC | 15:26 | |
| *** jlk has left #openstack-infra | 15:26 | |
| fungi | iccha_: esheffield: which commit? | 15:26 |
| fungi | or review url? | 15:26 |
| esheffield | fungi: https://review.openstack.org/#/c/46507/ | 15:26 |
| esheffield | works fine locally | 15:27 |
| esheffield | and yesterday clarkb suggested analyzing the run with testr, but for that failing test for 'caused by test' it just shows 'unknown - no conflicts' | 15:28 |
| *** senk has quit IRC | 15:28 | |
| *** vogxn has joined #openstack-infra | 15:33 | |
| *** ruhe has joined #openstack-infra | 15:33 | |
| *** changbl has quit IRC | 15:34 | |
| fungi | esheffield: chances are something about your test environment differs from where these ran on our ci systems. i'll try and recreate the issue on a close facsimile of a jenkins unit test slave later today. are you running your local tests on an up to date ubuntu 12.04 lts (precise pangolin)? does a pip freeze in the virtualenv report the same package versions as you see in the console log? | 15:35 |
| fungi | note that we're also failing the same test under python 2.6 on an up to date centos 6.4 system as well | 15:36 |
| esheffield | fungi: I'll double check all that | 15:36 |
| fungi | those are fairly disparate platforms for the problem to be particularly platform-specific | 15:36 |
| *** DennyZhang has joined #openstack-infra | 15:36 | |
| sdague | fungi: just as an fyi, this is bash8 version 0 - https://review.openstack.org/#/c/51676/ - so you can see where we're going with it | 15:36 |
| *** mrodden has joined #openstack-infra | 15:37 | |
| esheffield | fungi: thanks for the assist | 15:37 |
| *** senk has joined #openstack-infra | 15:38 | |
| fungi | esheffield: you're welcome | 15:38 |
| iccha_ | thanks fungi :) I told esheffield that this channel has the most helpful and responsive members of the openstack community :) | 15:41 |
| fungi | we try ;) | 15:41 |
| *** jcoufal has quit IRC | 15:42 | |
| *** yassine has quit IRC | 15:46 | |
| *** changbl has joined #openstack-infra | 15:47 | |
| *** senk has quit IRC | 15:49 | |
| *** Bada has joined #openstack-infra | 15:50 | |
| *** dcramer_ has quit IRC | 15:53 | |
| *** DennyZhang has quit IRC | 15:55 | |
| *** dcramer_ has joined #openstack-infra | 15:56 | |
| *** beagles has quit IRC | 16:01 | |
| *** marun has quit IRC | 16:03 | |
| pleia2 | good morning | 16:05 |
| *** ruhe has quit IRC | 16:05 | |
| *** UtahDave has joined #openstack-infra | 16:07 | |
| *** hogepodge has joined #openstack-infra | 16:07 | |
| *** adalbas has joined #openstack-infra | 16:09 | |
| *** matty_dubs is now known as matty_dubs|lunch | 16:13 | |
| *** gyee has joined #openstack-infra | 16:14 | |
| *** tvb|afk has quit IRC | 16:16 | |
| *** vogxn has quit IRC | 16:16 | |
| *** fbo is now known as fbo_away | 16:18 | |
| * fungi is stepping out and will brb | 16:18 | |
| *** SergeyLukjanov has quit IRC | 16:20 | |
| *** lcestari is now known as lcestari_lunch | 16:20 | |
| *** Ryan_Lane has quit IRC | 16:31 | |
| *** bingbu has quit IRC | 16:34 | |
| *** dprince has quit IRC | 16:34 | |
| *** Sriki has joined #openstack-infra | 16:37 | |
| *** hogepodge_ has joined #openstack-infra | 16:38 | |
| *** hogepodge has quit IRC | 16:38 | |
| *** hogepodge_ is now known as hogepodge | 16:38 | |
| Sriki | Hello folks! new to this channel. | 16:39 |
| pleia2 | welcome Sriki | 16:40 |
| Sriki | I am trying to get CI going for my company. Where is a good place to start? | 16:40 |
| *** nicedice_ has joined #openstack-infra | 16:40 | |
| *** SergeyLukjanov has joined #openstack-infra | 16:41 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 16:42 | |
| *** _SergeyLukjanov is now known as SergeyLukjanov | 16:42 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 16:42 | |
| *** _SergeyLukjanov is now known as SergeyLukjanov | 16:42 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/publications: Add Alex Gaynor quote https://review.openstack.org/51878 | 16:43 |
| *** ruhe has joined #openstack-infra | 16:43 | |
| openstackgerrit | Dan Nguyen proposed a change to openstack/requirements: Add flufl.password to requirements https://review.openstack.org/51068 | 16:43 |
| *** Sriki has quit IRC | 16:44 | |
| clarkb | morning | 16:45 |
| lifeless | jeblair: ah, then I was confused. | 16:47 |
| *** Sriki has joined #openstack-infra | 16:47 | |
| clarkb | esheffield: one other thing to test is if the tests that fail when run in a full test run also fail when run individually | 16:49 |
| *** jlk has joined #openstack-infra | 16:49 | |
| wenlock | hey, morning, i got some errors during jenkins verify step. rake lint aborted... im trying to reproduce those locally so i can dig deeper. Any ideas on where i can get started to figure out what rake lint requires in terms of gems/libs? This was the error page: http://logs.openstack.org/25/51425/6/check/gate-config-puppet-lint/5284ef7/console.html | 16:51 |
| *** hashar has quit IRC | 16:52 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Allow ci admins to tag publications https://review.openstack.org/51881 | 16:54 |
| *** jlk has left #openstack-infra | 16:54 | |
| jeblair | clarkb: could i get a quick aprv on that? i'm trying to push a tag | 16:54 |
| clarkb | jeblair: looking | 16:55 |
| clarkb | jeblair: done | 16:56 |
| esheffield | clarkb: on my local vm the test never fails either individually or in a full run | 16:56 |
| *** nati_ueno has joined #openstack-infra | 16:56 | |
| esheffield | clarkb: I'm working on setting up another 'pristine' box to try and replicate it | 16:56 |
| clarkb | wenlock: there is a ruby gem you need to install. puppet-something-helper | 16:56 |
| clarkb | fungi: you looked into the puppet lint dependency yesterday, do you remember the package name? | 16:57 |
| *** mriedem has quit IRC | 16:57 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/publications: Make tagging instructions more clear https://review.openstack.org/51883 | 16:57 |
| wenlock | ahh | 16:58 |
| wenlock | i think i found it | 16:58 |
| openstackgerrit | A change was merged to openstack-infra/config: Allow ci admins to tag publications https://review.openstack.org/51881 | 16:58 |
| wenlock | gem install puppetlabs_spec_helper | 16:58 |
| wenlock | cool, i got the abort on my vagrant box | 16:58 |
| wenlock | thanks clarkb | 16:59 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/jeepyb: Do not force push branches please https://review.openstack.org/51885 | 17:00 |
| zaro | morning | 17:00 |
| *** derekh has quit IRC | 17:01 | |
| *** matty_dubs|lunch is now known as matty_dubs | 17:02 | |
| mordred | sooo ... ^^ | 17:04 |
| mordred | that's, well, kind of something I'd like to land asap | 17:04 |
| mordred | bad bug | 17:05 |
| *** julim has joined #openstack-infra | 17:05 | |
| mordred | clarkb, fungi, jeblair | 17:05 |
| fungi | k | 17:06 |
| jeblair | mordred: lgtm, have we started using that in infra yet? (eg, for the gerrit repo) | 17:06 |
| mordred | jeblair: yes | 17:06 |
| jeblair | mordred: cleanup required? | 17:06 |
| mordred | jeblair: I don't think it will affect us directly, since we put all of our work into openstack/ branches | 17:06 |
| jeblair | mordred: yeah, i was just thinking the same thing | 17:07 |
| fungi | clarkb: gem install puppet-lint puppetlabs_spec_helper | 17:07 |
| mordred | jeblair: the place I caught it was where I'd left an upstream-prefix off of a repo internally, and then also that was there - so it was happily pulling changes and then overwriting the master in gerrit :) | 17:07 |
| *** flaper87 is now known as flaper87|afk | 17:07 | |
| fungi | wenlock: gem install puppet-lint puppetlabs_spec_helper | 17:08 |
| fungi | nm, you found it | 17:08 |
| * fungi still hasn't learned how to read scrollback in reverse | 17:08 | |
| wenlock | fungi, np, tyvm.... i found why my jenkins job is failing now too... time to push that again | 17:08 |
| wenlock | hehe | 17:09 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Do not force push branches please https://review.openstack.org/51885 | 17:11 |
| *** sarob has joined #openstack-infra | 17:12 | |
| *** mriedem has joined #openstack-infra | 17:12 | |
| *** julim has quit IRC | 17:14 | |
| *** vipul is now known as vipul-away | 17:16 | |
| *** Ryan_Lane has joined #openstack-infra | 17:20 | |
| *** lcestari_lunch is now known as lcestari | 17:21 | |
| fungi | i think our pull request closer may not be working. i've seen a lot of pull requests and no automagic closures for a few weeks now. digging into it | 17:23 |
| *** DennyZhang has joined #openstack-infra | 17:25 | |
| *** odyssey4me has quit IRC | 17:27 | |
| *** dafter has joined #openstack-infra | 17:27 | |
| fungi | bam http://paste.openstack.org/show/48502/ | 17:29 |
| *** boris-42 has quit IRC | 17:30 | |
| fungi | looks like github.Issue.Issue() may have changed its api | 17:31 |
| *** dafter has quit IRC | 17:32 | |
| fungi | apparently at some point github.GithubObject.CompletableGithubObject() added a new "attributes" positional parameter, and it's not the last parameter | 17:34 |
| jeblair | fungi: fabulous | 17:34 |
| fungi | sound familiar to anyone? i'll see if i can get it sorted and a jeepyb patch posted asp | 17:34 |
| fungi | asap | 17:34 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/publications: Make zuul simulation work with webkit https://review.openstack.org/51889 | 17:36 |
| jeblair | fungi: news to me | 17:37 |
| *** wenlock has quit IRC | 17:37 | |
| *** openstackgerrit has quit IRC | 17:37 | |
| *** openstackgerrit has joined #openstack-infra | 17:38 | |
| jeblair | i think puppet was stuck on review.o.o. i'm running a --test run now and will restart it. | 17:38 |
| jeblair | it's about to create stackforge/murano-repository | 17:38 |
| fungi | k | 17:39 |
| jeblair | are any murano people around? | 17:39 |
| SergeyLukjanov | hi | 17:40 |
| SergeyLukjanov | I'm not from the Murano, but I know smth about it:) | 17:40 |
| mtreinish | jeblair, fungi, clarkb: it looks like all the elastic-recheck py27 jobs are being set to 'LOST' did I forget something in my patch that added them? | 17:40 |
| *** markmc has quit IRC | 17:40 | |
| fungi | mtreinish: probably, i'll take a look | 17:40 |
| mtreinish | fungi: ok cool, thanks | 17:41 |
| *** rakhmerov has joined #openstack-infra | 17:43 | |
| *** wenlock has joined #openstack-infra | 17:43 | |
| *** reed has joined #openstack-infra | 17:44 | |
| *** vipul-away is now known as vipul | 17:45 | |
| *** sandywalsh has quit IRC | 17:45 | |
| fungi | on first pass the job configuration in jjb/zuul look okay but it's not appearing on the jenkins masters. seeing if i can tell why | 17:46 |
| rakhmerov | hey, just got here. I'm from Murano | 17:46 |
| rakhmerov | need any info on creating murano-repository? | 17:46 |
| *** thomasem has quit IRC | 17:48 | |
| *** DennyZhang has quit IRC | 17:49 | |
| rakhmerov | jeblair: is your question still relevant about stackforge/murano-repository? | 17:50 |
| jeblair | rakhmerov: no question, just wanted to let you know that it was just created | 17:50 |
| rakhmerov | awesome, thanks! | 17:50 |
| *** esheffield has quit IRC | 17:51 | |
| *** afazekas has joined #openstack-infra | 17:52 | |
| sdague | so bash8 (and the test scripts) landed in devstack, so if anyone else wants to give a look for a second +2 here, that would be appreciated - https://review.openstack.org/#/c/51726/ | 17:52 |
| fungi | looks like puppet agent may not have been updating on jenkins01 (and probably the other jenkins masters) since yesterday. stopped the agent, ran puppet agent --test as root and it picked up quite a few job config changes (including the new elastic-recheck job). jeblair: what symptoms were you seeing of puppet failure on review.o.o? same? | 17:53 |
| sdague | then we can start the process of auto style checks and work towards bringing in unit tests | 17:53 |
| mtreinish | fungi: ok, that probably explains why the timeout wasn't updated for the neutron jobs too (which was going to be my next question) | 17:54 |
| fungi | mtreinish: yep, that showed up in the updates as well | 17:54 |
| jeblair | fungi: i didn't look to see why it was stuck; it's usually stuck on a github git request | 17:55 |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 17:55 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/publications: Make zuul simulation reflect NNFI. https://review.openstack.org/51897 | 17:55 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/publications: Make zuul simulation work with webkit https://review.openstack.org/51898 | 17:55 |
| *** aspiers has quit IRC | 17:56 | |
| fungi | jeblair: ahh, yep. agent hung on a git fetch --tags origin for https://github.com/openstack-infra/jenkins-job-builder.git | 17:56 |
| *** alcabrera is now known as alcabrera|afk | 17:57 | |
| fungi | cleaning those up on the other jenkins masters and making sure they start polling puppet configs again on their own | 17:58 |
| *** rakhmerov has quit IRC | 17:59 | |
| *** thomasm has joined #openstack-infra | 18:00 | |
| fungi | looks like all three of them were hung trying to check the jjb source repo on github from various times yesterday | 18:00 |
| *** atiwari has joined #openstack-infra | 18:00 | |
| mordred | sdague: I love bash8, btw | 18:00 |
| *** thomasm is now known as Guest47437 | 18:00 | |
| sdague | I'm glad it makes you happy :) | 18:00 |
| *** sandywalsh has joined #openstack-infra | 18:00 | |
| *** Sriki has quit IRC | 18:00 | |
| *** changbl has quit IRC | 18:02 | |
| *** Ryan_Lane has quit IRC | 18:03 | |
| *** Ryan_Lane has joined #openstack-infra | 18:03 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1239856 https://review.openstack.org/51728 | 18:05 |
| uvirtbot | Launchpad bug 1239856 in glance ""TimeoutException: Request timed out" on tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestXML " [Undecided,New] https://launchpad.net/bugs/1239856 | 18:05 |
| jog0 | bash8? | 18:05 |
| *** UtahDave has quit IRC | 18:06 | |
| sdague | jog0: https://github.com/openstack-dev/devstack/blob/master/tools/bash8.py | 18:06 |
| jog0 | sdague: haha nice! | 18:07 |
| jog0 | I wonder if we can get flake8 to run that | 18:07 |
| jog0 | on bash files | 18:07 |
| *** senk has joined #openstack-infra | 18:08 | |
| *** Bada has quit IRC | 18:09 | |
| *** dims has quit IRC | 18:10 | |
| *** johnthetubaguy has quit IRC | 18:12 | |
| *** salv-orlando_ has joined #openstack-infra | 18:16 | |
| *** changbl has joined #openstack-infra | 18:16 | |
| *** salv-orlando has quit IRC | 18:16 | |
| *** salv-orlando_ is now known as salv-orlando | 18:16 | |
| clarkb | mtreinish: fungi: sorry I was poking at the missing jobs yesterday and got distracted before I checked puppet. and I have been very distracted by logstash upgrades today | 18:17 |
| fungi | clarkb: no worries. seems sorted now | 18:18 |
| clarkb | trying to sort out a sane way to upgrade logstash, elasticsearch, and kibana. I think we are just going to have to jump in the deep end and sort through problems as they come up | 18:18 |
| sdague | jog0: maybe someday... though I think I'd feel dirty having to put setup.py in devstack just to run tox | 18:21 |
| *** UtahDave has joined #openstack-infra | 18:22 | |
| *** dizquierdo has left #openstack-infra | 18:23 | |
| *** _david_ has joined #openstack-infra | 18:25 | |
| jog0 | sdague: heh | 18:25 |
| sdague | I actually started down the tox route for running this yesterday, then realized the setup.py thing, and just wrote a run_tests.sh intead | 18:25 |
| *** _david_ has left #openstack-infra | 18:26 | |
| jog0 | so run tests will live on | 18:27 |
| sdague | in name only | 18:27 |
| sdague | it's not the same script | 18:27 |
| chmouel | jog0: so about https://review.openstack.org/#/c/36427/ | 18:28 |
| chmouel | i think my review should be abandoned in favour of https://review.openstack.org/#/c/45998/ | 18:28 |
| chmouel | it's a better version than a straight port of what we did in novaclient | 18:28 |
| chmouel | just need to add the argparse stuff to make it compatible with what we had before as commented by jamies there | 18:28 |
| chmouel | (anyone know jamies lennox irc handle?) | 18:28 |
| jog0 | chmouel: works for me | 18:32 |
| *** ruhe has quit IRC | 18:34 | |
| *** SergeyLukjanov has quit IRC | 18:35 | |
| clarkb | I am testing https://review.openstack.org/#/c/47928/4 on elasticsearch.o.o. I want that change merged before I upgrade anything elasticsearch related | 18:36 |
| *** fallenpegasus has joined #openstack-infra | 18:37 | |
| *** SergeyLukjanov has joined #openstack-infra | 18:39 | |
| *** Ryan_Lane has quit IRC | 18:41 | |
| *** Ryan_Lane has joined #openstack-infra | 18:41 | |
| *** ruhe has joined #openstack-infra | 18:41 | |
| *** fallenpegasus has quit IRC | 18:42 | |
| *** fallenpegasus has joined #openstack-infra | 18:43 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Separate logstash/elasticsearch and verify hash https://review.openstack.org/47928 | 18:44 |
| *** sandywalsh has quit IRC | 18:44 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Separate logstash/elasticsearch and verify hash https://review.openstack.org/47928 | 18:46 |
| *** senk has quit IRC | 18:48 | |
| *** fallenpegasus has quit IRC | 18:56 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Separate logstash/elasticsearch and verify hash https://review.openstack.org/47928 | 18:56 |
| *** dprince has joined #openstack-infra | 18:56 | |
| *** sandywalsh has joined #openstack-infra | 18:56 | |
| *** alcabrera|afk is now known as alcabrera | 18:56 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Separate logstash/elasticsearch and verify hash https://review.openstack.org/47928 | 18:57 |
| *** klrmn has left #openstack-infra | 18:59 | |
| jeblair | whee, the zuul status subway map is weird, but, i think, correct | 18:59 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/jeepyb: New headers argument for github.Issue.Issue https://review.openstack.org/51905 | 19:00 |
| sdague | jeblair: yeh, a bunch of glance patches from August got +Aed | 19:00 |
| fungi | meetin' time once keystoneites wrap up | 19:00 |
| sdague | so they fail in fun ways | 19:00 |
| *** derekh has joined #openstack-infra | 19:01 | |
| hub_cap | so, looking @ the "image caching" job for the heat/trove images. i was wondering if it'd make sense to go the easy route, and just put a few more #IMAGE_URLS= into stackrc, and let the job automagically grab them | 19:02 |
| *** oubiwann has quit IRC | 19:02 | |
| *** oubiwann has joined #openstack-infra | 19:03 | |
| *** ruhe has quit IRC | 19:04 | |
| *** fallenpegasus has joined #openstack-infra | 19:08 | |
| *** alcabrera has left #openstack-infra | 19:09 | |
| *** nayward has joined #openstack-infra | 19:13 | |
| miqui | hi, where can i find a "dummies" guide for zuul ? | 19:14 |
| clarkb | miqui: http://ci.openstack.org/zuul is the project documentation | 19:15 |
| pleia2 | miqui: seen http://ci.openstack.org/zuul/ ? | 19:15 |
| *** sarob has quit IRC | 19:15 | |
| *** sarob has joined #openstack-infra | 19:15 | |
| *** dcramer_ has quit IRC | 19:16 | |
| miqui | thanks...clarkb and pleia2... been thanks...was hoping for more of a "cheat cheat" ... | 19:18 |
| *** sarob has quit IRC | 19:20 | |
| clarkb | miqui: we are in the openstack infra meeting right now. Will be doing that for the next ~38 minutes. We will be able to chat more after that. However I don't think we have a cheat sheet for zuul | 19:21 |
| *** fallenpegasus has quit IRC | 19:23 | |
| *** sarob has joined #openstack-infra | 19:25 | |
| fungi | miqui: also the slide presentations at http://docs.openstack.org/infra/publications/ provide a great introduction to how we use it, so good for wrapping your head around the concepts described in greater detail within the project documentation | 19:25 |
| *** bnemec_ is now known as bnemec | 19:27 | |
| *** nati_uen_ has joined #openstack-infra | 19:29 | |
| *** fallenpegasus has joined #openstack-infra | 19:30 | |
| *** nati_ueno has quit IRC | 19:31 | |
| *** Ryan_Lane has quit IRC | 19:33 | |
| *** Ryan_Lane1 has joined #openstack-infra | 19:33 | |
| *** senk has joined #openstack-infra | 19:34 | |
| Ng | mordred: I have a GPG key, tis on my lp profile (https://launchpad.net/~cmsj) | 19:36 |
| mordred | Ng: great. release process is simple "git tag -s X.Y.Z ; git push gerrit X.Y.Z" | 19:36 |
| Ng | mordred: nice. I'm specifically charged with ensuring that infra and our repos have matching configs/mechanism to be able to do the releases - is there a way I can test things without potentially creating bogus releases? Or should I just plough through and clear up bogosity with infra folk after the fact? | 19:38 |
| mordred | nope. please check - you want to make sure that you have ... (one sec, link coming first) | 19:39 |
| mordred | Ng: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml#n535 | 19:40 |
| mordred | Ng: pypi-jobs | 19:40 |
| mordred | Ng: listed in jjb - and then | 19:40 |
| mordred | Ng: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n1331 | 19:41 |
| mordred | Ng: tarball, upload, and mirror jobs | 19:41 |
| mordred | Ng: and you want to make sure each thing has a pypi project and that openstackci has owner access to it | 19:41 |
| *** gyee has quit IRC | 19:42 | |
| Ng | mordred: ok, thanks. that gives me something to chew over in the morning :D | 19:42 |
| *** jlk has joined #openstack-infra | 19:42 | |
| *** Ryan_Lane1 has quit IRC | 19:43 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 19:46 | |
| *** _SergeyLukjanov has quit IRC | 19:47 | |
| *** woodspa has joined #openstack-infra | 19:49 | |
| *** ruhe has joined #openstack-infra | 19:53 | |
| *** Guest47437 has quit IRC | 19:54 | |
| *** nati_uen_ has quit IRC | 19:56 | |
| *** nati_ueno has joined #openstack-infra | 19:56 | |
| *** nati_ueno has quit IRC | 19:58 | |
| *** nati_ueno has joined #openstack-infra | 19:58 | |
| *** nati_ueno has quit IRC | 19:58 | |
| *** david-lyle_ has quit IRC | 19:58 | |
| *** SergeyLukjanov has joined #openstack-infra | 19:58 | |
| *** nati_ueno has joined #openstack-infra | 19:59 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/devstack-gate: Add a neutron parallel job https://review.openstack.org/51915 | 19:59 |
| *** boris-42 has joined #openstack-infra | 19:59 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add neutron-parallel job to experimental queue. https://review.openstack.org/51916 | 19:59 |
| *** ruhe has quit IRC | 20:00 | |
| *** svarnau has joined #openstack-infra | 20:01 | |
| *** alcabrera has joined #openstack-infra | 20:03 | |
| sdague | jeblair: the log thread seems to be a slightly different conversation than the one I think we were just having | 20:04 |
| clarkb | I am going to grab lunch now. afk for a bit | 20:05 |
| *** fallenpegasus has quit IRC | 20:05 | |
| jeblair | sdague: http://lists.openstack.org/pipermail/openstack-infra/2013-October/000327.html is my attempt at summary | 20:07 |
| jeblair | sdague: particularly the second part of that | 20:07 |
| *** derekh is now known as derekh_afk | 20:09 | |
| *** fallenpegasus has joined #openstack-infra | 20:11 | |
| *** SergeyLukjanov has quit IRC | 20:11 | |
| *** dprince has quit IRC | 20:11 | |
| *** hashar has joined #openstack-infra | 20:13 | |
| *** nayward has quit IRC | 20:17 | |
| *** dims has joined #openstack-infra | 20:18 | |
| *** senk has quit IRC | 20:18 | |
| *** alcabrera has left #openstack-infra | 20:18 | |
| *** sarob has quit IRC | 20:23 | |
| *** dizquierdo has joined #openstack-infra | 20:24 | |
| *** fallenpegasus has quit IRC | 20:24 | |
| *** rnirmal has quit IRC | 20:26 | |
| lifeless | pleia2: so AIUI mordred solved the nodepool stuff | 20:27 |
| mordred | lifeless: nope | 20:27 |
| mordred | lifeless: the tripleo image prep scripts don't work | 20:28 |
| *** sarob has joined #openstack-infra | 20:28 | |
| *** lcestari has quit IRC | 20:29 | |
| lifeless | mordred: thats not nodepool itself thoughm right? | 20:29 |
| lifeless | mordred: it's config-of | 20:30 |
| mordred | lifeless: correct | 20:30 |
| mordred | lifeless: but its lack of working does prevent nodepool from spinning up tripleo nodes | 20:30 |
| lifeless | pleia2: so I think you need to use refresh-env rather than doing pull-tools directly. | 20:30 |
| *** xeyed4good1 has joined #openstack-infra | 20:30 | |
| lifeless | mordred: the the nodepool changes in prod now ? | 20:30 |
| mordred | lifeless: yup | 20:31 |
| *** sarob_ has joined #openstack-infra | 20:33 | |
| pleia2 | I am still trying to untangle the mysteries of nodepool | 20:35 |
| pleia2 | mordred: does this log somewhere? | 20:35 |
| *** sarob has quit IRC | 20:35 | |
| mordred | pleia2: stdout | 20:35 |
| mordred | pleia2: if you run it with -d | 20:35 |
| pleia2 | yeah, there is that | 20:36 |
| mordred | pleia2: you can also set up a python logging config file, but I did not do that locally | 20:36 |
| pleia2 | `nodepool image-list` still shows status build, but how do I see what it's actually doing? | 20:36 |
| pleia2 | so I can fix it! | 20:36 |
| *** gyee has joined #openstack-infra | 20:43 | |
| *** dims has quit IRC | 20:45 | |
| mordred | pleia2: is that the same one that's been in build since you started? | 20:45 |
| sdague | jeblair: ok, responded | 20:46 |
| *** adalbas has quit IRC | 20:46 | |
| pleia2 | mordred: sure is | 20:47 |
| mordred | pleia2: nodepool image-delete it | 20:47 |
| mordred | pleia2: nodepool will then start from scratch and will log everthing to the screen | 20:47 |
| *** dcramer_ has joined #openstack-infra | 20:48 | |
| fungi | pleia2: openstack-infra/config modules/nodepool/files/logging.conf is the logging config we use in production. you can run nodepoold with -l /etc/nodepool/logging.conf to have it use that | 20:48 |
| jeblair | sdague: awesome, thanks very much | 20:48 |
| *** thomasm has joined #openstack-infra | 20:48 | |
| *** thomasm is now known as Guest42626 | 20:49 | |
| pleia2 | http://paste.openstack.org/show/48519/ | 20:49 |
| fungi | pleia2: i think you want nodepool image-delete 1 there instead? | 20:51 |
| pleia2 | ah, perhaps | 20:51 |
| fungi | not sure if it works with the server uuid | 20:52 |
| clarkb | can I request reviews on https://review.openstack.org/#/c/47928/ ? | 20:52 |
| pleia2 | fungi: thanks, that was it | 20:52 |
| fungi | clarkb: you bet | 20:52 |
| clarkb | fungi: danke | 20:52 |
| *** mkollaro1 has joined #openstack-infra | 20:52 | |
| mkollaro1 | http://logs.openstack.org/91/49491/2/gate/gate-tempest-devstack-vm-full/8f79253/console.html | 20:53 |
| *** mkollaro1 is now known as mkollaro | 20:53 | |
| mkollaro | have you seen this error before? | 20:53 |
| mkollaro | I don't see it anywhere on the rechecks site | 20:53 |
| clarkb | mkollaro: I think sdague mentioned it | 20:54 |
| mkollaro | hm, could be because it's the stable/grizzly branch | 20:54 |
| fungi | clarkb: you tried 47928 on the elasticsearch servers already? | 20:54 |
| clarkb | mkollaro: a problem with bit rot | 20:54 |
| clarkb | fungi: yes, I applied it by hand on elasticsearch.o.o | 20:54 |
| fungi | oh, great | 20:54 |
| clarkb | fungi: if it looks good to you it is safe to approve | 20:54 |
| mkollaro | clarkb: so, should I just recheck nobug? | 20:54 |
| clarkb | mkollaro: no, I think there is a bug and it needs fixing | 20:54 |
| mkollaro | clarkb: well, what exactly should I report? | 20:55 |
| mkollaro | it's this patch https://review.openstack.org/#/c/49491/ | 20:55 |
| *** derekh_afk has quit IRC | 20:55 | |
| clarkb | mkollaro: the problem is http://git.openstack.org/cgit/openstack/glance/tree/?h=stable/grizzly doesn't have requirements files. it has the old tools/*-requires files | 20:55 |
| clarkb | mordred: did you backport the requirements files to stable branches? | 20:56 |
| mkollaro | yeah, I thought so :/ | 20:56 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/jenkins-job-builder: Adds virtualenv builder from Shining Panda plugin https://review.openstack.org/49956 | 20:56 |
| clarkb | mkollaro: basically the location of requirements files needs to be sorted | 20:57 |
| fungi | clarkb: it sounds like the problem is that devstack-gate didn't retain teh ability to look for requirements files in the correct places on stable branches? | 20:57 |
| mkollaro | :/ | 20:57 |
| clarkb | mkollaro: either we backport a change to move them or make devstack-gate check the old locations too | 20:57 |
| clarkb | fungi: right, but this works for other stable branches so I wonder if backporting was the fix used in most places | 20:58 |
| jeblair | fungi, mordred: i'm starting to wish that git-review did not automatically set topics | 20:58 |
| fungi | clarkb: no, most (all?) of grizzly is still using tools/{pip,test}-requires last i looked | 20:58 |
| *** changbl has quit IRC | 20:59 | |
| clarkb | fungi: hmm have we just not merged any stable branch changes since devstack gate was updated? | 20:59 |
| fungi | jeblair: i've kinda always felt that way. it's easy to change, but it's a user-facing change in behavior. maybe it should be configurable | 20:59 |
| mordred | jeblair: ++ | 21:00 |
| fungi | clarkb: it's entirely possible. i've got a slew i'm about to submit to cap requirements on them all | 21:00 |
| fungi | just working out the remaining bits of separating out the pip-requires transitive dependencies from the test-requires transitive dependencies so they get filtered into the correct files | 21:01 |
| fungi | i've already got the master global-requirements.txt changes up for folsom and grizzly pending approval | 21:01 |
| fungi | basically covering the union of all integrated release project requirements with the intersection of their allowed versions | 21:02 |
| clarkb | fungi: so should we update d-g to get glance changes through? | 21:04 |
| fungi | clarkb: yeah, it's gotta be a recent d-g change which did it, since we've had security patches go in only a couple weeks ago | 21:05 |
| clarkb | fungi: I think it is the code that tests all changes against global reqs | 21:06 |
| clarkb | fungi: maybe there is an exclusion for the stable branches that broke? | 21:06 |
| clarkb | mordred: ^ | 21:06 |
| mordred | clarkb: I could believe that | 21:06 |
| fungi | ahh, yeah, so the job which explicitly tested that (not as a part of devstack-gate) only ran on master | 21:07 |
| fungi | because the global reqs on stable branches are in no way representative of the integrated projects from those releases (which is what my pending patches address) | 21:08 |
| svarnau | I'm setting up an instance of openstack-infra, and Jeepyb is giving me a problem when creating a new project | 21:09 |
| svarnau | It inits a repo in local dir (/var/lib), | 21:09 |
| svarnau | But creating a gerrit project fails, since it sees the repo in /var/lib as the project already existing | 21:09 |
| fungi | mordred: is that your fix from this morning? ^ | 21:10 |
| svarnau | Seemed to work last week | 21:11 |
| *** SergeyLukjanov has joined #openstack-infra | 21:12 | |
| *** changbl has joined #openstack-infra | 21:12 | |
| *** david-lyle_ has joined #openstack-infra | 21:12 | |
| fungi | svarnau: are you running latest jeepyb master branch tip? a54b0af Do not force push branches please | 21:14 |
| svarnau | fingi: yes | 21:14 |
| fungi | svarnau: does it manage to create the repository for your new project in ~gerrituser/review_site/git/? | 21:15 |
| svarnau | Yes | 21:15 |
| fungi | svarnau: also, if you 'sudo manage-projects --v' on your gerrit server and then paste the traceback for the error into http://paste.openstack.org/ and let us know the url, i'll see if it makes sense to me | 21:16 |
| fungi | er, that's -v not --v | 21:17 |
| svarnau | fungi: http://paste.openstack.org/show/48521/ | 21:19 |
| *** Guest42626 is now known as thomasem | 21:20 | |
| wenlock | question on gerrit both requirement for python, does it need 2 or 3? | 21:21 |
| wenlock | gerritbot even | 21:21 |
| wenlock | Readme's and headers of .py don't seem to indicate what version | 21:22 |
| *** yamahata has quit IRC | 21:22 | |
| *** malini has joined #openstack-infra | 21:22 | |
| fungi | svarnau: it looks like it's erroring out because gerrit thinks the project already exists in its database. did you delete the hptopl/topl2 project from the filesystem but leave the references in the gerrit db? | 21:23 |
| clarkb | wenlock: 2 | 21:24 |
| clarkb | wenlock: most of our stuff isn't 3 friendly yet | 21:24 |
| wenlock | cool, ty | 21:24 |
| fungi | wenlock: gerritbot is currently run by us with python 2.7 and i *think* supybot uses twisted which is 2-only | 21:24 |
| wenlock | ahh now that helps even more | 21:24 |
| fungi | clarkb: no twisted on py3k yah? | 21:24 |
| svarnau | fungi: No, I don't think there are any DB references. If I remove /var/lib/git/<repo> (and the /home/...<repo>) then I can manually run the create_project command and it succeeds. | 21:25 |
| clarkb | fungi: twisted isn't py3k, but gerritbot isn't twisted. it uses a different irc bot lib | 21:25 |
| fungi | clarkb: oh, was it meetbot using supybot? | 21:25 |
| clarkb | fungi: but in general we don't write py3k safe code when IO is involved (due to the change in string semantics). yes meetbot is supybot | 21:26 |
| wenlock | this one, right? https://pypi.python.org/pypi/gerritbot | 21:26 |
| svarnau | fungi: I can do that multiple times, but if /var/lib/git path exists, the create_project command fails. | 21:26 |
| clarkb | wenlock: that is gerritbot, there is a dependency it has ircbot or some such | 21:26 |
| mordred | svarnau: looking | 21:26 |
| wenlock | cool | 21:26 |
| *** jhesketh has joined #openstack-infra | 21:27 | |
| mordred | fungi: that's not related to this morning's issues | 21:28 |
| mordred | those were purely for /var/lib/jeepyb | 21:28 |
| *** aspiers has joined #openstack-infra | 21:29 | |
| *** jecarey has quit IRC | 21:31 | |
| fungi | svarnau: so... tracing back through manage_projects.py source it looks like createProject() only gets called if the project name is not reflected in the output of the 'gerrit ls-projects' api call (gerrit.listProjects) | 21:35 |
| mordred | that is correct | 21:35 |
| fungi | so something is going wrong on the previous run which is creating your git repository directories on disk but the project is not being successfully added in gerrit | 21:35 |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 21:36 |
| svarnau | fungi: no, I tried to add a new name, and it failed the same way, the very virst time. | 21:36 |
| svarnau | s/virst/first/ | 21:37 |
| *** pcm_ has quit IRC | 21:37 | |
| fungi | should have manifested in an earlier log as "Exception creatinghptopl/topl2 in Gerrit" | 21:37 |
| mordred | svarnau: you mention calling 'create_project" earlier - you didn't do that in this case, right? | 21:37 |
| fungi | oh, wait, it does raise that in the debug output you pasted too | 21:38 |
| svarnau | mordred: right. Only later as a debugging effort | 21:38 |
| fungi | along with the gerritlib exception | 21:38 |
| mordred | sck. just making sure | 21:38 |
| *** Steven____ has joined #openstack-infra | 21:38 | |
| *** jerryz has joined #openstack-infra | 21:39 | |
| fungi | okay, so it looks like we do create the local repository/repositories before calling gerrit.createProject() | 21:41 |
| *** sarob_ has quit IRC | 21:42 | |
| *** weshay has quit IRC | 21:43 | |
| *** thomasem has quit IRC | 21:43 | |
| fungi | i'm thinking the 'fatal: project "hptopl/topl2" exists' error is a red herring | 21:43 |
| *** sarob has joined #openstack-infra | 21:43 | |
| *** jcoufal has joined #openstack-infra | 21:43 | |
| svarnau | fungi: as a debugging, I run the gerrit create_project command manually -- it works if /va/lib/git/<repo> does not exist, but fails if it does. | 21:44 |
| russellb | gerrit permissions question ... can a group have +2 rights but not +A ? | 21:45 |
| fungi | which is really, really weird | 21:45 |
| fungi | svarnau: the repository in /var/lib/git/ is nothing gerrit should care about other than for replication purposes | 21:46 |
| russellb | i think i answered my own question (yes, you can) | 21:46 |
| fungi | russellb: yes, it's possible | 21:46 |
| russellb | ok thanks | 21:46 |
| svarnau | fungi: that's what I thought! I must have screwed up my gerrit config somehow | 21:46 |
| fungi | russellb: those are separate permissions | 21:46 |
| russellb | ok | 21:46 |
| fungi | svarnau: if /var/lib/git/projectname doesn't exist, manage-projects will try to create it and initialize a bare repository there, but gerrit is merely configured to replicate git commits to that path | 21:47 |
| *** sarob has quit IRC | 21:47 | |
| *** Bada has joined #openstack-infra | 21:47 | |
| *** Steven____ has quit IRC | 21:48 | |
| *** Steven____ has joined #openstack-infra | 21:49 | |
| svarnau | fungi: yes, I could not find any reference in the config other than replication.config | 21:49 |
| svarnau | fungi: could gerrit replication be trying to replicate as part of the create_project and giving error at that point? | 21:52 |
| fungi | svarnau: does your gerrit.config have gerrit.basePath=git and container.user=gerrit2? and is gerrit2's home /home/gerrit2 or somewhere else? and is GERRIT_SITE=/home/gerrit2/review_site being passed into the gerrit initscript from /etc/default/gerritcodereview? | 21:52 |
| *** miqui has quit IRC | 21:53 | |
| fungi | svarnau: i don't think so. replication doesn't kick in at the create-project api call stage anyway (and replication failures are non-fatal in gerrit from what i've seen) | 21:53 |
| svarnau | fungi: Yes, all those settings are as you suggest. | 21:54 |
| fungi | i am currently baffled but will keep thinking | 21:55 |
| fungi | what i've seen in the past is that if you delete the /home/gerrit2/review_site/git/projectname.git directory but don't remove the references to the project in the mysql database, *that's* when you get the "fatal: project x already exists" error from the create-project api call | 21:56 |
| fungi | and you're saying the reverse, that create-project succeeds as long as the directory (strangely the local mirror in /var/lib/git/projectname.git) is deleted first | 21:57 |
| *** changbl has quit IRC | 21:57 | |
| svarnau | fungi: right. Database was my first area to fix, but did not fix my problems. So that's why I tried the "2" suffix to start fresh. | 21:58 |
| *** michchap_ has quit IRC | 21:58 | |
| fungi | it's worth noting that, as a policy, we don't delete gerrit projects (ever). you might try blowing away your gerrit db and reinstalling gerrit just to make sure there's not some weird, lingering cruft (if that's not too much effort) | 21:59 |
| openstackgerrit | A change was merged to openstack-infra/config: Separate logstash/elasticsearch and verify hash https://review.openstack.org/47928 | 22:00 |
| svarnau | fungi: It's worth a try, as it'd be less effort than all this debugging, but I just tried it with a "3" suffix, and that fails the same way | 22:01 |
| *** michchap has joined #openstack-infra | 22:05 | |
| *** wenlock has quit IRC | 22:06 | |
| *** Ryan_Lane has joined #openstack-infra | 22:08 | |
| svarnau | fungi: I moved the replication.config file aside, restarted gerrit, and manage_projects worked! | 22:09 |
| *** wenlock has joined #openstack-infra | 22:09 | |
| *** oubiwann_ has joined #openstack-infra | 22:13 | |
| *** nayward has joined #openstack-infra | 22:14 | |
| *** jerryz has quit IRC | 22:14 | |
| pleia2 | OverLimit: Quota exceeded for cores: Requested 4, but already used 20 of 20 cores (HTTP 413) (Request-ID: req-774c4471-0901-4180-9462-63a72fd6e5f6) | 22:14 |
| *** mriedem has quit IRC | 22:14 | |
| pleia2 | hey, that's progress | 22:15 |
| *** dkranz has joined #openstack-infra | 22:15 | |
| *** oubiwann has quit IRC | 22:16 | |
| *** shardy is now known as shardy_afk | 22:17 | |
| mordred | pleia2: if it runs for a while, it will fail, not clean up after itself yet, and you'll have a bunch of failed template nodes | 22:18 |
| fungi | svarnau: very odd, | 22:18 |
| fungi | i've not seen gerrit complain about existing localmirrors | 22:19 |
| *** CaptTofu has quit IRC | 22:19 | |
| *** CaptTofu has joined #openstack-infra | 22:19 | |
| *** nayward has quit IRC | 22:19 | |
| jeblair | pabelanger: you mentioned something about proposing a patch for the asterisk server after our last round of testing.. did that happen? | 22:20 |
| pabelanger | jeblair, Ah, not yet. I can get that up for tomorrow. Apologies for the delay | 22:20 |
| *** vipul is now known as vipul-away | 22:21 | |
| jeblair | pabelanger: np | 22:22 |
| jeblair | pabelanger: thanks for working on it, just didn't want it to slip through the cracks | 22:22 |
| fungi | svarnau: gerrit 2.4.x or something newer? | 22:22 |
| pabelanger | jeblair, Ya, I should have done it the day we tested. But it's always been in the back of my plate | 22:22 |
| *** rcleere has quit IRC | 22:23 | |
| *** dkranz has quit IRC | 22:23 | |
| *** CaptTofu has quit IRC | 22:24 | |
| *** alexpilotti has quit IRC | 22:24 | |
| svarnau | fungi: exact same version of gerrit that review.openstack.org has | 22:25 |
| fungi | that rules out different gerrit versions treating local mirrors differently | 22:26 |
| zaro | svarnau: hey, gonna see you next week? | 22:27 |
| svarnau | fungi: The main difference in my config: in my projects.yaml (due to firewall issue) I have to use "has-github: False" | 22:29 |
| *** vipul-away is now known as vipul | 22:29 | |
| svarnau | fungi: I think that may take different path thru code | 22:29 |
| *** thedodd has quit IRC | 22:29 | |
| *** prad has quit IRC | 22:30 | |
| *** julim has joined #openstack-infra | 22:33 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 22:34 | |
| *** dkranz has joined #openstack-infra | 22:34 | |
| *** dizquierdo has quit IRC | 22:34 | |
| *** aspiers has quit IRC | 22:34 | |
| *** _SergeyLukjanov has quit IRC | 22:34 | |
| *** pentameter has quit IRC | 22:35 | |
| dkranz | Is this failure in devstack a known issue? error: pathspec 'requirements.txt' did not match any file(s) known to git | 22:35 |
| fungi | dkranz: a stable branch change? | 22:36 |
| *** SergeyLukjanov has joined #openstack-infra | 22:36 | |
| dkranz | fungi: Yes | 22:36 |
| fungi | dkranz: yes, i think a recent change to devstack-gate broke stable branch tests. in a meeting right now but want to look into it in a bit | 22:37 |
| dkranz | fungi: ok, thanks https://review.openstack.org/#/c/49491/ | 22:38 |
| *** marktraceur is now known as rdwrer | 22:44 | |
| *** SergeyLukjanov has quit IRC | 22:44 | |
| *** eharney has quit IRC | 22:46 | |
| dkranz | sdague: I thought we were enforcing "negative tests in separate file" now: https://review.openstack.org/#/c/46941/3 | 22:46 |
| *** mrodden has quit IRC | 22:47 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Change the description of two stackforge projects https://review.openstack.org/51965 | 22:47 |
| *** rdwrer is now known as marktraceur | 22:47 | |
| *** mrodden has joined #openstack-infra | 22:48 | |
| *** CaptTofu has joined #openstack-infra | 22:53 | |
| *** sarob has joined #openstack-infra | 22:55 | |
| *** jpich has quit IRC | 22:56 | |
| *** nicedice__ has joined #openstack-infra | 22:56 | |
| *** fifieldt has joined #openstack-infra | 22:56 | |
| *** oubiwann_ has quit IRC | 22:56 | |
| *** Ryan_Lane has quit IRC | 22:57 | |
| *** Bada has quit IRC | 22:57 | |
| *** nicedice_ has quit IRC | 23:00 | |
| *** sarob has quit IRC | 23:00 | |
| *** Ryan_Lane has joined #openstack-infra | 23:01 | |
| *** jerryz has joined #openstack-infra | 23:03 | |
| jerryz | mordred: in your email in ML about installing nodepool, git review -x is used to pull the patch down to local repo, is that correct? | 23:04 |
| mordred | jerryz: ah! that is no longer needed | 23:04 |
| mordred | all of those patches have been merged now | 23:05 |
| mordred | perhaps I should send an amended message | 23:05 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Make tempest-devstack-vm-neutron-large-ops voting https://review.openstack.org/51974 | 23:05 |
| jerryz | mordred: i see. just about the usage of git review -x, does it just do a git fetch from gerrit? | 23:06 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Separate row layout from formatting. https://review.openstack.org/51976 | 23:07 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Move file selection into reviewers.py. https://review.openstack.org/51977 | 23:07 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Add a CSV writer for reviewers. https://review.openstack.org/51978 | 23:07 |
| lifeless | russellb: ^ | 23:07 |
| lifeless | russellb: easy said as done | 23:07 |
| *** Ryan_Lane has quit IRC | 23:08 | |
| mordred | jerryz: it does. it's like git review -d - except instead of putting you into a new branch, it cherry picks the change down onto your current branch | 23:08 |
| mordred | jerryz: -d is what you want most of the time, but some times you want -x | 23:09 |
| *** datsun180b has quit IRC | 23:09 | |
| *** woodspa has quit IRC | 23:10 | |
| *** woodspa has joined #openstack-infra | 23:10 | |
| *** mriedem has joined #openstack-infra | 23:15 | |
| *** mrodden has joined #openstack-infra | 23:17 | |
| *** jcoufal has quit IRC | 23:17 | |
| lifeless | russellb: I will note I haven't tried this by hand | 23:19 |
| lifeless | russellb: so buyer beware | 23:19 |
| *** jhesketh_ has joined #openstack-infra | 23:20 | |
| *** david-lyle_ has quit IRC | 23:20 | |
| *** jhesketh has quit IRC | 23:21 | |
| *** changbl has joined #openstack-infra | 23:26 | |
| fungi | annegentle: what does the search form input processing on the openstack manuals? | 23:27 |
| reed | mordred, is Matt Joyce working in your team now? | 23:30 |
| reed | fungi, what do you mean? | 23:30 |
| mordred | reed: he is not | 23:30 |
| mordred | reed: is he workign at HP? | 23:30 |
| reed | mordred, bummer ... according to Linkedin he is | 23:31 |
| *** jgriffith has quit IRC | 23:31 | |
| *** mkollaro has quit IRC | 23:31 | |
| *** mkollaro has joined #openstack-infra | 23:32 | |
| *** jgriffith has joined #openstack-infra | 23:32 | |
| *** mkollaro has quit IRC | 23:33 | |
| *** mkollaro has joined #openstack-infra | 23:33 | |
| hashar | hi, does anyone know whether Zuul pass the parent job name / build number to sub jobs ? | 23:33 |
| *** mkollaro has quit IRC | 23:33 | |
| hashar | Iam pretty sure my version does not :] it is not in job parameters hu | 23:33 |
| jeblair | hashar: i don't think so, but i bet you could do that with a custom parameter function | 23:34 |
| fungi | annegentle: reed: i think i figured it out after digging in the page source... docbook ditasearch backed by oxygen | 23:34 |
| jeblair | hashar: (or we could think about adding it to zuul itself) | 23:34 |
| reed | jeblair, fungi: when is it a good time for you to meet with tipit? | 23:34 |
| fungi | annegentle: any idea how to upgrade the version of oxygen being used for that on the docs site? is that something which gets retrieved and embedded as part of the maven build? | 23:35 |
| reed | fungi, jeblair: give me a couple of options date/time | 23:35 |
| jeblair | reed: what's the topic? | 23:35 |
| hashar | jeblair: could use it to copy artifacts between jobs. Might attempt a parameter function first. if that fails, will fall back to Zuul itself. thanks! :] | 23:35 |
| reed | jeblair, setting them up with a -dev server, git, gerrrit/jenkins hooks | 23:35 |
| reed | to develop the SSO openid provider | 23:35 |
| *** atiwari has quit IRC | 23:36 | |
| *** xeyed4good1 has quit IRC | 23:36 | |
| jeblair | reed: any time tomorrow is good | 23:36 |
| fungi | reed: i'm open all of tomorrow and also most of monday and all of tuesday/wednesday next week. i think jeblair's schedule may be much more constrained | 23:36 |
| reed | ok | 23:37 |
| *** UtahDave has quit IRC | 23:39 | |
| pleia2 | reed: I am speaking at balug.org but I am out of openstack stickers! I'll need to raid your stash soon ;) | 23:45 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add gating tempest unit test job https://review.openstack.org/50952 | 23:45 |
| reed | pleia2, I have some in my pocket right now | 23:46 |
| reed | pleia2, when do you talk there? I'll be happy to go if I can | 23:46 |
| pleia2 | I gave the last of mine out at the codechix workshop | 23:46 |
| pleia2 | reed: meeting starts at 6:30, dinner at 7, presentation at 8 | 23:46 |
| reed | tonight? | 23:46 |
| pleia2 | reed: tonight | 23:46 |
| reed | damn | 23:46 |
| reed | i'll be kicking and punching then | 23:47 |
| pleia2 | well that's probably more fun than a lug meeting | 23:47 |
| *** jhesketh_ has quit IRC | 23:47 | |
| *** jhesketh has joined #openstack-infra | 23:47 | |
| *** jhesketh has quit IRC | 23:47 | |
| reed | I kind like that Chinese restaurant :) | 23:47 |
| *** jhesketh has joined #openstack-infra | 23:47 | |
| pleia2 | they have yummy honey chicken | 23:47 |
| reed | and a decadent atmosphere | 23:49 |
| *** oubiwann has joined #openstack-infra | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!