Tuesday, 2016-12-20

*** VW has quit IRC00:15
*** catintheroof has quit IRC00:29
*** leitan has quit IRC00:30
*** marst has quit IRC00:36
*** emagana has quit IRC00:56
*** ducttape_ has joined #openstack-operators00:56
*** emagana has joined #openstack-operators00:57
*** chlong has quit IRC00:59
*** ducttape_ has quit IRC01:01
*** emagana has quit IRC01:02
*** ducttape_ has joined #openstack-operators01:11
*** bsilverman_ has quit IRC02:13
*** bsilverman_3 has joined #openstack-operators02:13
*** ducttape_ has quit IRC02:27
*** ducttape_ has joined #openstack-operators02:28
*** ducttape_ has quit IRC02:32
*** mriedem has quit IRC02:33
*** fragatina has joined #openstack-operators02:37
*** ducttape_ has joined #openstack-operators02:48
*** saneax is now known as saneax-_-|AFK02:52
*** mriedem has joined #openstack-operators03:19
*** udesale has joined #openstack-operators03:30
*** ducttape_ has quit IRC03:38
*** VW has joined #openstack-operators03:49
*** VW has quit IRC04:09
*** sudipto has joined #openstack-operators04:20
*** sudipto_ has joined #openstack-operators04:20
*** sudipto has quit IRC04:42
*** sudipto_ has quit IRC04:42
*** beddari has quit IRC05:06
*** saneax-_-|AFK is now known as saneax05:31
*** ecrehar has joined #openstack-operators05:44
*** armax has quit IRC05:59
*** emagana has joined #openstack-operators06:08
*** ecrehar has quit IRC06:08
*** twiggy has joined #openstack-operators06:11
*** emagana has quit IRC06:12
*** rcernin has quit IRC06:59
*** Oku_OS-away is now known as Oku_OS07:10
*** rcernin has joined #openstack-operators07:11
*** tesseract has joined #openstack-operators07:11
*** tesseract is now known as Guest1497207:11
*** rcernin has quit IRC07:26
*** rcernin has joined #openstack-operators07:42
*** chaology has quit IRC08:01
*** jsheeren has joined #openstack-operators08:01
*** chaology has joined #openstack-operators08:02
*** simon-AS559 has joined #openstack-operators08:03
*** chaology has quit IRC08:05
*** chaology has joined #openstack-operators08:05
*** chaology has quit IRC08:06
*** chaology has joined #openstack-operators08:07
*** chaology has quit IRC08:07
*** chaology has joined #openstack-operators08:09
*** aluria` is now known as aluria08:10
*** pcaruana has joined #openstack-operators08:19
*** rcernin has quit IRC08:36
*** fragatin_ has joined #openstack-operators08:38
*** fragatina has quit IRC08:39
*** emagana has joined #openstack-operators08:51
*** emagana has quit IRC08:56
*** dbecker has joined #openstack-operators08:56
*** rcernin has joined #openstack-operators08:58
*** rarcea has joined #openstack-operators09:12
*** matrohon has joined #openstack-operators09:36
*** derekh has joined #openstack-operators09:36
*** snecklifter has quit IRC09:45
*** snecklifter has joined #openstack-operators09:45
*** snecklifter has quit IRC09:46
*** snecklifter_ has joined #openstack-operators09:46
*** sudipto_ has joined #openstack-operators09:53
*** sudipto has joined #openstack-operators09:53
*** paramite has joined #openstack-operators10:00
*** paramite_ has joined #openstack-operators10:00
*** sudipto has quit IRC10:21
*** sudipto_ has quit IRC10:21
*** armax has joined #openstack-operators10:22
*** Miouge has joined #openstack-operators10:26
*** armax has quit IRC10:38
*** udesale has quit IRC10:58
*** emagana has joined #openstack-operators11:03
*** emagana has quit IRC11:07
*** paramite has quit IRC11:12
*** paramite_ has quit IRC11:12
*** beddari has joined #openstack-operators11:18
*** matrohon has quit IRC11:20
*** paramite has joined #openstack-operators11:20
dewaneehello everyone11:23
*** fragatin_ has quit IRC11:51
*** electrofelix has joined #openstack-operators12:01
*** saneax is now known as saneax-_-|AFK12:24
*** catintheroof has joined #openstack-operators12:37
*** mathlin has left #openstack-operators12:37
*** chlong has joined #openstack-operators12:53
*** matrohon has joined #openstack-operators12:55
*** pcaruana has quit IRC13:01
*** pcaruana has joined #openstack-operators13:06
*** liverpooler has joined #openstack-operators13:21
*** saneax-_-|AFK is now known as saneax13:22
*** sudipto_ has joined #openstack-operators13:28
*** sudipto has joined #openstack-operators13:28
*** ducttape_ has joined #openstack-operators13:30
*** saneax is now known as saneax-_-|AFK13:34
*** racedo has quit IRC13:50
*** racedo has joined #openstack-operators13:53
*** dminer has joined #openstack-operators13:55
*** sudipto_ has quit IRC14:00
*** sudipto has quit IRC14:00
*** catinthe_ has joined #openstack-operators14:06
*** catintheroof has quit IRC14:08
*** ducttape_ has quit IRC14:12
*** chlong has quit IRC14:16
*** VW has joined #openstack-operators14:19
*** pcaruana has quit IRC14:23
*** jamesdenton has joined #openstack-operators14:25
*** pcaruana has joined #openstack-operators14:37
*** clayton has quit IRC14:38
*** VW has quit IRC14:39
*** VW has joined #openstack-operators14:39
*** clayton has joined #openstack-operators14:40
izaakkdewanee: Hello14:45
*** Guest67717 is now known as med_14:48
*** med_ has quit IRC14:48
*** med_ has joined #openstack-operators14:48
*** mihalis68 has joined #openstack-operators14:53
*** shintaro has joined #openstack-operators14:54
*** ducttape_ has joined #openstack-operators14:54
*** twiggy has quit IRC14:57
mihalis68about to start the operators-meetup team meeting14:59
mihalis68who's here for that?14:59
shintaroo/15:00
*** fifieldt has joined #openstack-operators15:00
*** jsheeren has quit IRC15:00
mihalis68Tom!15:00
*** udesale has joined #openstack-operators15:00
*** mcunietti has joined #openstack-operators15:00
mihalis68long time no IRC!15:00
mcuniettihi everyone15:01
mrhillsmano/15:01
mihalis68ok Matt Jarvis asked for a volunteer to chair this meeting via email because he has a conflict in second half15:01
mihalis68anyone? If not I will again15:01
mrhillsmango for it Chris15:01
mihalis68#startmeeting Ops Meetups Team15:01
openstackMeeting started Tue Dec 20 15:01:26 2016 UTC and is due to finish in 60 minutes.  The chair is mihalis68. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
openstackThe meeting name has been set to 'ops_meetups_team'15:01
fifieldthiya, sorry for falling off the face of the planet. reading old logs now and trying to catch up15:01
mihalis68good to "see" you! :)15:01
mrhillsman^15:02
izaakko/15:02
mihalis68I'll try to summarize. I didn't have time to pull together links to the official ether pad etc.15:02
mihalis68We have milan in progress now planning-wise15:02
mcuniettiyep15:02
mihalis68Matt is the benevolent dictator for that and asked for people to update the ether pad for this week15:02
mrhillsman#link https://etherpad.openstack.org/p/ops-meetups-team15:03
mihalis68we also have a proposal for hosting next August from Intel15:03
mihalis68Thanks Melvin15:03
shintaro#link https://etherpad.openstack.org/p/MIL-ops-meetup15:03
mattjarvishello guys15:03
mrhillsman#link https://etherpad.openstack.org/p/MIL-ops-meetup15:03
mattjarvissorry I'm late15:03
mihalis68we should discuss that proposal15:03
mrhillsmanhaha, thx shintaro15:03
mihalis68Matt I'm chairing at your request15:03
mattjarvisthank you mihalis6815:03
fifieldtwow, you guys are amazing15:03
mattjarvisI think Mariano from Enter is now probably in a position to be benevolent dictator around the logistics15:03
mihalis68yes. You're whipping us into shape re: the program15:04
mihalis68I also should mention that the hosts for Milan issued a request for sponsors15:04
mrhillsman#link https://docs.google.com/spreadsheets/d/1EUSYMs3GfglnD8yfFaAXWhLe0F5y9hCUKqCYe0Vp1oA15:04
mihalis68and Tom we moved this meeting to this time, as you obviously deduced15:04
mattjarvismihalis68, I put some agenda items in the etherpad15:05
mihalis68I even put it on the wiki (felt rather bold)15:05
mattjarvisI think Mariano now has costs, so perhaps he can share with the group15:05
mihalis68Thanks!15:05
mattjarvishey fifieldt !15:05
mattjarviswhere have you been ?15:05
fifieldthullo & sorry15:05
mcuniettiupdated the etherpad15:06
fifieldtI got a combination of heavy travel + holiday + sickness15:06
med_welcome back tom and hi all.15:06
mihalis68#topic review of last week's action items15:06
mihalis68https://www.irccloud.com/pastebin/ZP4bOCIY/15:07
mihalis68team to add ideas to the MIL-ops-meetup15:07
*** emccormick has joined #openstack-operators15:07
mihalis68I guess no progress on that?15:07
emccormickHey guys, sorry to be late15:07
mihalis68that's getting urgent now I would say15:08
mattjarvissorry, I think I had an action to transfer the seed content in15:08
mattjarvisbeen a busy couple of weeks with new job15:08
mihalis68so do it for next week?15:08
mattjarvisgive me an action to do that15:08
fifieldtI can help arrane the eventbrite, if you want15:08
fifieldtarrange*15:08
mihalis68#action matt jarvis to transfer seed content for milan meet up to the ether pad https://etherpad.openstack.org/p/MIL-ops-meetup15:09
mattjarvisI think we just need to finalise how many tickets on the eventbrite and how many reserved15:09
mcuniettiabout the registration fee, am I right if I think it will cover the night event on March 15th?15:09
fifieldtassuming it's a copy/pasta of the previous one, with ticket limit 150?15:09
mattjarvismy suggestion would be 100 on eventbrite15:09
mihalis68#action fifieldt to start work on eventbrite for Milan15:09
mcuniettiin that case, I would go for 20 euros15:09
mattjarvisfifieldt, I think we said 130 based on the size of the smaller rooms15:09
mihalis68100 was the consensus from last week15:09
mcunietti100 registered + 30 sponsors, it was15:10
mattjarvismihalis68, 100 on eventbrite, 30 reserved for host, sponsors and extras15:10
mcuniettiyep15:10
fifieldtok, done15:10
mihalis68yes 100 on eventbrite, exactly. Allowing a lot of unticketed guests15:10
mattjarviswe will need hotel and travel details for the eventbrite right ?15:10
mcuniettihow many unticketed shall we expect more than the 30?15:10
mihalis68second action last week was administrivia - update wiki with time of meeting, done15:10
mihalis68venue max limit was said to be 150 last week15:11
mcuniettiup to 150 is fine for plenary room15:11
mattjarvisso I'd be careful with how we think about max limits15:11
mattjarvisremember its not just the main room15:11
mcuniettiI think we'l be slightly packed in the break sessions15:11
mattjarviswe also need to be able to handle a split of everyone for the smaller sessions15:11
mcuniettiexactly15:12
VWhey folks15:12
mihalis68yo!15:12
mattjarvisI would definitely say 130 max15:12
mattjarvishi VW15:12
mrhillsmanhey VW15:12
mihalis68how to enforce?15:12
VWsorry - popped in an hour ago and assumed we weren't meeting15:12
mihalis68mat the meeting moved to this slot15:12
med_welcome VW15:12
med_welcome VW15:12
VWyou guys have confused me with all the times :P15:12
mrhillsmani think being packed is not necessarily a bad thing15:12
mattjarvisit is if you can't get into rooms or have a seat15:12
mrhillsmanbut we agreed on 100 :)15:12
emccormickAlso remember there are always people who register that don't show15:13
med_mrhillsman, the stackers that think together stink together?15:13
emccormickhow many of those did we have last time?15:13
VWyep15:13
fifieldtif we refer back to Manchester as "just right"- it was more on the packed side15:13
mihalis68I don't know eventbrite, does it have ticket "levels"15:13
mcuniettiwe have large tables in the middle of meeting rooms, so there's no room for standing people15:13
mrhillsmanmed_ indeed hehe15:13
fifieldtemccormick is right - we should pull the numbers for the previous times15:13
mihalis68attendee tickets and organizer tickets?15:13
fifieldtwhat we can do is give out some registration codes for 'organisers'15:13
* med_ assumed organizers, sponsors, etc still had to eventbrite15:13
fifieldtor 'sponsors' or whatevers15:13
fifieldtthey still eventbrite15:14
med_yep with free reg codes.15:14
fifieldtbut they put in a code15:14
med_agreed.15:14
*** matrohon has quit IRC15:14
mihalis68+115:14
mrhillsman+115:14
fifieldtwhich we can see on the data dump spreadsheet15:14
mihalis68if this works in eventbrite I'm all for it15:14
*** kstev has joined #openstack-operators15:14
fifieldtso it's: aim for 100 'normal' on site, 30 'spcial' codes on site15:14
med_OpenStack Days MW just happened and all attendees (sponsors, speakers, etc) had to eventbrite (via paid or free)15:14
fifieldt?15:14
mihalis68tom if you're evenbriting, can you confirm next week that we can have attendee and organizer tickets?15:14
mcuniettiok for me but be careful on maximum limits. It can lead to issues managing seats and catering15:14
fifieldtI can confirm it works mihalis68 - we did it to a limited extent for manchester15:15
mihalis68#action fifieldt to confirm an "all eventbrite" attendance system works in eventbrite with attendees and hosts/organiser codes15:15
fifieldtcan I confirm EUR 20 is the price?15:15
mihalis68final action from last week was to review intel's proposal to host in August https://etherpad.openstack.org/p/ops-meetup-venue-discuss-aug-201715:16
med_+115:16
mrhillsman+115:16
* med_ is +1 on the somewhat nebulous Intel proposal. They have the resources to make it work at either time, either location in spite of nebulousity.15:16
mihalis68I think we preferred keeping it cheap, yes15:16
mihalis68I am +1 on the intel proposal15:16
* mrhillsman +1 on the fee15:16
mrhillsmansame for intel proposal15:16
emccormick+1 on intel15:16
shintarosame here for intel15:16
mihalis68I think the first question is : is it "well-formed" by which I mean meets criteria for region, facilities, travel accomodation15:17
mcunietti+1 on the fee but I repeat my question: will it cover the night event?15:17
mihalis68I think we need a sponsor for the night event15:17
mihalis68we are crossing the streams a bit. I shall attempt to keep them clear15:17
med_Yes, I'd recommend a sponsor for the night event (big or small)15:17
med_in Milan15:17
mihalis68Milan needs additional sponsorship. I shall ask if Bloomberg can kick in15:17
mihalis68My employer15:17
mcuniettigreat15:17
mihalis68all comment so far on Intel/August 2017 is positive15:18
mcuniettino one has answered the call for sponsors yet15:18
mrhillsmanDid we get the feedback on amount15:18
med_?15:18
mrhillsmanI did not see anything on ML15:18
med_mrhillsman, you lost me.15:18
mcuniettiI am trying to get through Cloudbase, but they seem unresponsive so far15:18
mihalis68so I ask for anyone who has any objection to the intel/august thing to speak up soon15:18
* fifieldt reads15:18
mcuniettiI also emailed directly SUSe, RedHat and HPE15:18
mrhillsmanok wait, we are crossing things up, mihalis6815:18
mihalis68For milan we had discussed that a group of sponsors might form and each kick in a small amount, so it depends on the "funding gap"15:18
med_mihalis68, I've been noodling about proposing Denver but I'm not goign to make the EOY cutoff for a counter proposal in Aug for Denver (and I"m fine with Inte'ls proposal)15:19
VWyeah, can we stick to one meetup at a time ;)15:19
mrhillsman^15:19
mrhillsmanplease # topic us15:19
med_<snort>15:19
mcuniettiabout Milan: so far the expected cost is around 8.500 euros15:19
mrhillsmandanke15:19
mihalis68We will spend the rest of the meeting discussing Milan I expect. So I would like to close out last weeks actions15:19
mihalis68we should at least respond to intel15:20
mrhillsmanagreed15:20
mihalis68ok so final call - is intel's proposal fine by all?15:20
mrhillsmanvote? or we are all good?15:20
shintaroIntel proposal need clarification for the number of rooms/capacity for the breakout sessions.15:20
mihalis68because at this stage I think it will get locked in by default quite soon right?15:20
mihalis68end of year and all that15:20
fifieldt+1 shintaro15:20
mihalis68#action I will ask for more details15:21
* med_ is +1 on the somewhat nebulous Intel proposal. They have the resources to make it work at either time, either location in spite of nebulousity.15:21
mihalis68#action mihalis68 to get more detail on intel proposal15:21
mihalis68There's no objection to the intel proposal other than needs more details, which I contend is quite fine for something that far out15:21
mihalis68so... back to milan?15:21
mrhillsmanno objection from me either, intel has resources to handle i am quite sure15:22
mihalis68is there anyone else here who thinks their org might help with Milan costs?15:22
mrhillsmando you want me to follow up with Carol Chris?15:22
mihalis68Ah you're a partner of intel right?15:22
mrhillsmani know we will be looking for a benevolent come that time15:22
mihalis68works for me15:22
mrhillsmanand hate for you to have to go again15:23
mihalis68no worries15:23
mihalis68#action mrhillsman to talk to carol/intel about more detail on august 2017 meetup15:23
mattjarvisI'm going to have to drop in a minute, I have another call I have to be on - I've seeded the MIL ether pad with the session analysis stuff15:23
mihalis68mcunietti is that the total event cost?15:23
med_+115:23
mrhillsmanthx mattjarvis15:23
mihalis68mattjarvie I see, great, thanks!15:23
* med_ wonders if there is an #action-completed15:24
mcuniettiyep, budgetary15:24
mihalis68Ill ping the mailing list with this link now it's started to fill in15:24
mattjarvisexcellent mihalis68 - also ask for moderator volunteers15:24
mihalis68#action mihalis68 to share milan planning ether pad with operators mailing list now that content is landing15:24
mihalis68will do, thanks15:24
mcuniettiCatering 2 days + soft drinks 5.000€, night event 2.500€, prints 1.000€15:24
mrhillsmanmcunietti is that budgetary in terms of how much Enter can take on? or estimated cost, asking because ...15:24
mrhillsmanthx15:24
mrhillsmanyou answered :)15:25
mcuniettiestimated cost15:25
mcunietti:-)15:25
mihalis68so enter is paying for the space, and 8500 is the extras?15:25
mcuniettithe idea is that, yes15:25
mcuniettibut I am afraid that if we don't find the sponsors we'll have to pay all the remainder15:25
emccormickso $2k would come from registration15:25
mihalis68ok. This fits the recommendations15:25
emccormickso we need another $6500 in sponsorship?15:26
mcuniettiright15:26
mihalis68Ok... we finally worked out the funding gap15:26
mrhillsman\o/15:26
mihalis68Matt said that several sponsors put in about 1000 euro for manchester (might have been pounds not sure)15:27
mcuniettistay loose, make it 7.00015:27
mrhillsman^15:27
mihalis68so 7 sponsors at 1000 euro or 3-4 at 200015:27
mihalis68doesn't seem impossible15:27
*** armax has joined #openstack-operators15:27
fifieldtplease action me to work out how the money from the registration works15:27
mihalis68#mihalis68 to see if Bloomberg will kick in 2000 euro for milan15:28
mihalis68#action fifieldt to work out how money from eventbrite flows to the milan event15:28
mrhillsmanlol15:28
med_#action mihalis68 to check bberg15:28
emccormickAny kick-in from the foundation on this? Or just fifieldt travel expenses? :D15:28
mrhillsmanha15:28
fifieldtprobably :)15:29
mcuniettiany body in contact with Cloudwatt and/or Numergy? being a EU ops meetup they'd be interested I guess15:29
mrhillsman#action mrhillsman to check if Rackspace can chip in15:29
mcuniettiCityCloud as well15:29
mrhillsmani think we can send out a general ML call15:29
mcuniettiI already did yesterday, did you receive it?15:30
mihalis68I saw it15:30
mrhillsmanbut directly contacting will be good too!15:30
mattjarvisyou could also reach out to Patrick Petit at Mirantis - they wanted to sponsor in MAN15:30
mrhillsmansorry, i did not, apologies, will use that as template :)15:30
mcuniettithamks matt, can you share contact info?15:30
mrhillsmanAh, I sees it15:31
mcunietti(privately of course)15:31
izaakkHello guys, this is Isaac from Intel/OSIC, I'm planning to attend and I can check with Intel for sponsorship as well15:32
mihalis68Ah, great, thank you!15:32
mcuniettigreat!15:32
med_xlnt15:32
mattjarvisI also occasionally see David Ogden who's Mirantis MD for EMEA15:32
mattjarvishe's based in Manchester15:32
med_Welocme izaakk15:32
mattjarvisusually comes to our meetups, I will ask him if I see him15:33
mihalis68Ok, so from reviewing the minutes, I think we have at least touched on all the listed items15:33
mrhillsman? > action everyone check with who they have direct contact with along with the ML message15:33
med_ahead of schedule15:33
mihalis68one thing I brought up a little bit last week: PTG is turning out to be a bit divisive. Some people from Bloomberg even think that operators meet ups are no more and pTG is the only thing outside of the Summit15:34
mrhillsmanshould we consolidate via ML status of goal or just leave it to meetings to do that15:34
mihalis68the sponsors and funding level? I think people who can sponsor should update the meet ups team ASAP15:35
fifieldtmihalis68: the lack of information is certainly not helping ... I have ML post and SuperUser post ready to go on "the Forum" that I'm awaiting approval on :(15:35
mihalis68That would be great Tom.15:35
mihalis68I had to refer to "last item of FAQ all the way at bottom" as the definitive rebuttal15:35
fifieldtbut if anyone wanted to write up anything additional on what the ops meetup is, that'd be postable too15:35
mihalis68Speaking personally, neither I nor anyone from my team will attend PTG15:35
mihalis68I could have a go Tom15:36
VWwhen do you need something by, fifieldt?15:36
mihalis68shall I action myself to offline that with you?15:36
fifieldtI probably won't go to PTG myself15:36
fifieldtit's just a 'whenever' kinda thing :)15:36
fifieldtany time between now and PTG I guess15:36
VWI'd be happy to take a crack at the ops meetup write up15:36
mihalis68I'm really verbing stuff here. I can feel the pointy haired boss look developing15:36
mihalis68#action mihalis68 vw to look into posts about operators meetups15:36
VWgracias15:37
mihalis68Tom does this time slot work ok for you?15:37
med_many of us at Charter are signed up for PTG15:37
fifieldtdue to some sort of daylight savings time somewhere right now, this slot is OK15:37
fifieldt:)15:37
mrhillsmanlol15:38
fifieldtit will keep being ok until some daylight savings change somewhere15:38
med_we agreed to keep this UTC time even when DST kicks in15:38
mrhillsmanwe are going to keep it 1500 despite DST :)15:38
med_that question was posed last week.15:38
emccormickOurs switches back the Sunday before the Milan meetup15:38
emccormickSo probably we change back after the meetup15:38
mrhillsmaneveryone agreed on that15:38
mrhillsmanwell maybe not everyone, but majority15:39
med_no one was opposed afaik15:39
VWagreeing is one thing.  Learning how to use a clock is completely different - ;)15:39
mihalis68It was definitely a consensus last week, however I put it to you that the meeting time should be under review regularly as we really want as many of the meet ups team as possible to join15:39
fifieldtare we taking a break at all around end-of-year time?15:39
mihalis68it's on the wiki for now - good enough? P)15:40
VWyep!15:40
mihalis68I can't make next week's IRC meeting, but can do email15:40
mcuniettime neither15:40
VWI would propose at least take a break next week15:40
shintaro+115:40
mcunietti+115:40
mihalis68We could officially skip the meeting next week for respecting those of us out traveling or just not up for it15:40
VWthe third - I can go either way, personally15:40
mihalis68the original cadence was twice a month and we've put in a lot more than that, so yes +115:41
mihalis68#agreed no meeting 2016-12-2715:41
mrhillsman3rd works for me as well15:41
mihalis68#agreed next meeting Jan 3rd15:41
mihalis68Any other topics people would like to bring up? We have a lot of progress and actions15:42
mihalis68It might be good to "give back" 18 minutes here and ask people to get onto the ether pad and get to work15:42
med_+115:43
mihalis68that and using the mailing list to drum up suggestions and moderators15:43
mihalis68ok I will end the meeting shortly unless there are late-breaking topics15:43
*** emagana has joined #openstack-operators15:43
mihalis68I feel good about this one15:43
med_thanks mihalis68 and mj and VW and tom.15:43
med_and mrhillsman15:43
mihalis68Helle emagana we were just about to finish the meet ups team meeting15:43
mihalis68*Hello15:43
emaganamihalis68: Hi All!15:43
mihalis68any last minute urgent items?15:44
emaganaHow is all going?15:44
fifieldtthey are amazing emagana15:44
mihalis68we are finishing off here, so people can work on their actions15:44
mihalis68milan planning is good, intel hosting august looks like will be approved15:44
mihalis68we need sponsors for milan15:44
fifieldtI took 4 weeks off meetings, and the group has organised so much!15:44
mihalis68will be on mailing loist15:44
emaganaTime for sending emails all around15:44
mihalis68yes15:44
mattjarvisI hear workday have got loads of money15:45
emaganaI won't be able to travel to Milan unfortunately!15:45
mihalis68final call before I close this meeting. Next meeting january15:45
mihalis68oh shame15:45
mihalis68I think I shall15:45
mihalis68ok thanks everyone! Good work15:45
mihalis68#endmeeting15:45
mcuniettithank you!15:45
openstackMeeting ended Tue Dec 20 15:45:32 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:45
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ops_meetups_team/2016/ops_meetups_team.2016-12-20-15.01.html15:45
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ops_meetups_team/2016/ops_meetups_team.2016-12-20-15.01.txt15:45
openstackLog:            http://eavesdrop.openstack.org/meetings/ops_meetups_team/2016/ops_meetups_team.2016-12-20-15.01.log.html15:45
emaganaHappy Holidays!15:45
shintarothank you15:45
VWthanks, folks15:45
mattjarvishappy holidays emagana !15:45
mattjarvismerry xmas all :)15:46
mrhillsmanwait, what, over already!?15:46
mrhillsmanlol15:46
mrhillsmanhappy holidays emagana!15:46
emaganamattjarvis mrhillsman see you soon!15:46
mrhillsmanand everyone else! enjoy your family/friends/loved ones during this season!15:46
mrhillsmanindeed :)15:46
mihalis68Mrhillsman you get 15 minutes to work on ehterpad, actions, mailing list! :)15:46
mrhillsmanlol15:46
mihalis68seasonally appropriate greetings to all15:47
mattjarvisdefinitely emagana, see you in Boston probably15:47
izaakkThank you all15:47
emaganaBoston is a yes!15:47
mihalis68I hope for me too15:47
mihalis68my team will definitely represent at least15:47
mattjarvisI'm definitely coming to Milan anyway, just had my travel approved15:48
mattjarvisso I expect to also be in Boston, Canonical usually send tons of people15:48
*** udesale has quit IRC15:48
emccormickHappy holidays everyone :). I'll definitely be in Milan. Already got my plane tickets :)15:48
mihalis68+115:49
mihalis68:)15:49
*** harlowja has joined #openstack-operators15:49
emccormickand Boston of course since it's a 90 minute flight from me and I used to live there ;)15:49
mrhillsmanso you are our tour for those who have not been is what you saying emccormick?15:50
mrhillsmanguess not hehe15:50
emccormickI am glad to lead the staggering drunken hordes through the city ;)15:50
mrhillsmanha15:51
mihalis68drinking? Tssk tssk! <cough>15:51
mrhillsmanboston "tea" party?15:51
emccormickYeah, Long Island tea.15:51
*** shintaro has quit IRC15:52
*** chlong has joined #openstack-operators15:53
*** shintaro has joined #openstack-operators15:54
*** shintaro has quit IRC15:55
*** fifieldt has left #openstack-operators15:55
*** ducttape_ has quit IRC15:56
*** chlong has quit IRC16:01
*** markvoelker_ has joined #openstack-operators16:01
*** markvoelker has quit IRC16:03
*** markvoelker has joined #openstack-operators16:04
*** Oku_OS is now known as Oku_OS-away16:06
*** markvoelker_ has quit IRC16:07
*** kukacz has joined #openstack-operators16:08
*** mcunietti has quit IRC16:09
kukaczhi, I'd like to ask about some purge procedure for cleaning out instances which can't be deleted "normal way"16:10
med_kukacz, are they already NOT running on hte hypervisor?16:11
kukaczI mean `nova delete`, `nova force-delete` neither reset-state helps. the instances are removed from hypervisors16:11
med_nod.16:11
med_which version of Nova16:11
kukaczmed_: correct. there are no more present on hypervisors16:11
kukaczKilo16:11
med_and in this case, it generally means you need to massage the db16:11
med_yep, we had this in Kilo timeframe16:12
med_required manual db massage16:12
*** dminer has quit IRC16:12
med_concerns would be around attached volumes16:12
med_if no attached volumes, pretty straightforward16:12
*** dminer has joined #openstack-operators16:12
med_if attached volumes, you will also have to clean cinder.16:12
kukaczattached volumes - Cinder with Ceph backend16:12
med_yep, that's usually the issue then for being unable to delete16:13
med_cinder still has those vols marked as attached16:13
med_so unable to delete16:13
med_just a sec....16:13
kukaczyes, in cinder tables they are marked as attached to the proper instance16:13
med_something like this:16:14
med_update the following in cinder.volume_attachment16:14
med_set deleted=116:14
med_set attach_status=detached16:14
med_update the following in cinder.volume16:14
kukaczmed_: ... actualy, they were marked as "attached to NULL", but that's another issue we're facing independently16:14
med_attach_status=detached16:14
med_status=available16:14
med_after the above updates are done you can use cinder to delete the volume16:14
med_good luck.16:14
kukaczmed_: ok. so I'll start with the cinder volume. and then?16:15
kukaczmed_: will I be able to use nova delete or I need to do it via nova database anyway?16:15
med_once detached, try a force-delete again16:15
kukaczmed_: ok16:15
med_or even a regular delete16:15
kukaczmed_: I'll try that procedure16:16
kukaczmed_: do I understand that this has changed since Kilo somehow?16:16
*** chlong has joined #openstack-operators16:16
med_it got better in general (more maturity)16:16
kukaczmed_: or that there was some issue?16:16
med_I don't know of a specific bug, just that we had to do this a lot less in liberty16:17
med_probably 1/100th  as often16:17
kukaczmed_: OK. and just by chance - how about that "attached to NULL" issue with Cinder? does that sound familiar to you?16:17
med_nope16:18
kukaczmed_: it's a situation when Nova present correct volume ID as attached, but Cinder losses the backward connection to instance UUID16:18
med_nod.16:18
kukaczmed_: ok16:18
med_not familiar to me though16:18
med_under the circumstances, you may need to also clean the nova db I'd guess.16:20
*** clayton has quit IRC16:21
*** rarcea has quit IRC16:21
*** clayton has joined #openstack-operators16:22
dewaneeanyone hitting "Too many open files" error on nova-compute?16:26
*** fragatina has joined #openstack-operators16:26
dewaneesince we upgraded to Mitaka it appears to be an issue16:26
*** chlong has quit IRC16:28
*** TxGirlGeek has joined #openstack-operators16:35
*** catintheroof has joined #openstack-operators16:39
*** catinthe_ has quit IRC16:42
*** harlowja has quit IRC16:42
*** chlong has joined #openstack-operators16:42
*** ducttape_ has joined #openstack-operators16:45
*** ducttape_ has quit IRC16:57
*** fragatina has quit IRC16:59
*** fragatina has joined #openstack-operators17:00
*** Guest14972 has quit IRC17:03
klindgren_So we have been running into problems recently where we have a bunch of problems with neutron and large number of compute nodes being marked as down due to failed heartbeats and neutron-server chewing up a ton of cpu.  When we restart neutron server we see a ton of nova-sync messages being processed17:21
klindgren_if I look we have a bunch of ports in build status17:21
klindgren_when I compare a few of them the ports in build status are associated with vms that are in an "active" status and are passing traffic.17:22
klindgren_wondering if anyone else can check their clouds and see if they have a bunch of ports in build status.  My query: neutron port-list -F id -F device_id -F binding:host_id -F status -F binding:vif_type -F device_owner -c id -c device_id -c binding:host_id -c status -c binding:vif_type -c device_owner | grep -v floatingip | grep -v ACTIVE | grep -v neutron:LOADBALANCERV2 | grep -v network:router17:23
klindgren_I also have compute nodes that have ports that failed to bind that I can't backwards translate to actual ports in neutron17:23
klindgren_Does anyone have a cleanup script for handling that?17:24
klindgren_and no neutron-ovs-cleanup is not the thing, as that removes all ports, including those that work.17:24
*** Miouge has quit IRC17:25
klindgren_Also have ports that are marked as down in neutron but are plugged and correctly passing traffic for those vm's.17:28
mattjarvisdefinitely don't run neutron-ovs-cleanup manually, bad things happen17:44
*** slaweq_ has joined #openstack-operators17:44
klindgren_yea - ran tried that in a non-prod env17:45
klindgren_and it jsut nuked all the ports17:45
mattjarvisthink we did that one time in production trying to fix another issue, definitely didn't do it again17:46
klindgren_also dont restart ovs-agent without a connection to rabbitmq/neutron-server17:46
klindgren_thats an awesome way for security groups to get populated with nothing, and to blackhole all vm traffic17:46
mattjarvislol, at one of the ops meetups we should have a session on 'stuff you definitely don't want to do under any circumstances'17:47
mattjarvisthere's probably a book full17:47
*** emagana has quit IRC17:48
mattjarvisthe thing about neutron-ovs-cleanup is that the name suggests it might help you do something you need to do17:48
mattjarvislures you in17:48
mattjarvisto disaster17:48
*** ducttape_ has joined #openstack-operators17:51
*** emagana has joined #openstack-operators17:51
*** harlowja has joined #openstack-operators17:53
*** derekh has quit IRC17:55
klindgren_mattjarvis, can you run the above neutron port-list command as an admin and see if you have ports in a build state?17:56
mattjarvisklindgren_, would love to, but I'm at Canonical now and don't have admin rights anywhere yet ;) Ask yankcrime if he's lurking, I know he's done a lot of stuff around Neutron cleanup.17:57
*** pcaruana has quit IRC17:59
*** jamesdenton has quit IRC18:00
*** catinthe_ has joined #openstack-operators18:03
*** simon-AS5591 has joined #openstack-operators18:04
*** catintheroof has quit IRC18:06
*** simon-AS559 has quit IRC18:07
*** ducttape_ has quit IRC18:08
*** liverpooler has quit IRC18:08
*** liverpooler has joined #openstack-operators18:10
*** simon-AS5591 has quit IRC18:16
*** ducttape_ has joined #openstack-operators18:19
*** rcernin has quit IRC18:29
*** ducttape_ has quit IRC18:47
*** chlong has quit IRC18:56
*** fragatina has quit IRC19:05
*** racedo has quit IRC19:06
*** electrofelix has quit IRC19:07
*** cnf has quit IRC19:11
*** chlong has joined #openstack-operators19:13
*** paramite has quit IRC19:22
*** cnf has joined #openstack-operators19:22
*** ducttape_ has joined #openstack-operators19:25
mrhillsmanmattjarvis adding that to list :)19:29
*** cnf has quit IRC19:30
*** Miouge has joined #openstack-operators19:33
*** harlowja has quit IRC19:35
*** catintheroof has joined #openstack-operators19:37
erhudydewanee: do you use ceph?19:40
*** catinthe_ has quit IRC19:40
erhudybecause i just pushed out a hacky fix to the nova-compute upstart unit file to bump the nofile soft limit for some of our larger clusters19:40
*** jamesdenton has joined #openstack-operators19:41
erhudywhen a ceph-backed instance was getting terminated nova-compute would open a connection to every single OSD in the ceph cluster and would run itself out of handles, and then it would lose the connection to rabbit and the ship goes down with all hands19:41
*** jamesdenton has quit IRC19:51
*** jamesdenton has joined #openstack-operators19:57
*** ducttape_ has quit IRC19:57
*** cnf has joined #openstack-operators19:59
*** ducttape_ has joined #openstack-operators20:00
*** fragatina has joined #openstack-operators20:12
*** chlong has quit IRC20:15
*** ducttape_ has quit IRC20:21
*** fragatina has quit IRC20:22
*** fragatina has joined #openstack-operators20:23
*** chlong has joined #openstack-operators20:27
*** slaweq_ has quit IRC20:37
*** slaweq_ has joined #openstack-operators20:39
*** fragatina has quit IRC20:43
*** slaweq_ has quit IRC20:44
*** slaweq_ has joined #openstack-operators20:45
*** catintheroof has quit IRC20:47
*** slaweq_ has quit IRC20:56
*** slaweq_ has joined #openstack-operators20:57
*** kstev has quit IRC21:05
*** fragatina has joined #openstack-operators21:08
*** mihalis68 has quit IRC21:22
*** ducttape_ has joined #openstack-operators21:30
*** fragatina has quit IRC21:30
*** Miouge has quit IRC21:34
*** ducttape_ has quit IRC21:35
*** ducttape_ has joined #openstack-operators21:38
*** liverpooler has quit IRC21:38
*** chlong has quit IRC21:46
*** Miouge has joined #openstack-operators21:50
*** ducttape_ has quit IRC21:58
*** slaweq_ has quit IRC22:07
*** slaweq_ has joined #openstack-operators22:10
*** armax has quit IRC22:16
*** dminer has quit IRC22:18
*** fragatina has joined #openstack-operators22:23
*** jamesdenton has quit IRC22:26
*** Miouge has quit IRC22:34
*** vinsh has quit IRC22:35
*** slaweq_ has quit IRC22:41
*** slaweq_ has joined #openstack-operators22:43
*** fragatina has quit IRC22:47
*** TxGirlGeek has quit IRC22:47
*** ducttape_ has joined #openstack-operators22:53
*** chlong has joined #openstack-operators22:57
*** TxGirlGeek has joined #openstack-operators23:08
*** ducttape_ has quit IRC23:12
*** ducttape_ has joined #openstack-operators23:12

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!