Wednesday, 2021-11-10

*** melwitt is now known as Guest550810:12
belmoreira#startmeeting large_scale_sig15:00
opendevmeetMeeting started Wed Nov 10 15:00:25 2021 UTC and is due to finish in 60 minutes.  The chair is belmoreira. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'large_scale_sig'15:00
belmoreira#topic Rollcall15:00
belmoreiraHello! who is here for the Large Scale SIG meeting?15:00
genekuoo/15:00
belmoreirahi genekuo15:01
belmoreiraping maybe amorin ? mdelavergne ? imtiazc ?15:01
belmoreiragenekuo looks like we are the only ones15:02
belmoreiraour agenda for today:15:03
belmoreira#link https://etherpad.openstack.org/p/large-scale-sig-meeting15:03
belmoreira#topic Next Large Scale SIG show on Dec 9, 202115:03
belmoreiralast meeting we discussed to have something in the lines of: Tricks and tools that large deployments use for day to day ops ("Ugly tricks you hide from your boss")15:03
belmoreiragenekuo what do you think?15:04
amorinhello!15:04
amorinsorry I am late15:04
belmoreirahi amorin15:04
genekuosounds good to me, I was thinking earlier when I'm reviewing the log from last week.15:05
belmoreirawe started to discuss the topic for the Dec 9th OpenInfra live15:05
genekuoI haven't think of any tricks we've done yet, not sure if we can contribute to this topic15:05
amorinit can also be tools you use to manage your openstack15:06
belmoreirahonestly, I wasn't envision this topic to be something of horrible (ugly) hacks but legit tools that we built and use every day or for special situations15:06
belmoreirathose tools may point to the need to have them upstream or improve the CLI, operations, ...15:07
amorinexemple, within OVH, we have a external tool to collect all instances running on a bunch of hypervisors (in a rack e.g.) so that we can trigger some communication/mailing with the data15:07
amorindoes it sound like something that fit the topic?15:08
belmoreiranice, we have something similar15:08
belmoreiralooks perfect to me15:08
belmoreiraalso I'm thinking about the DB clean up from amorin for example15:08
amorinosarchiver15:08
amorinyes15:08
amorinwe are also building a tool to monitor/check the openflow rules in br-int for an instance15:09
amorinI asked for this on the list few weeks ago15:09
belmoreiragreat15:10
belmoreiraanother example... we built a tool to automatically migrate VMs and reboot the compute nodes for kernel upgrades or hardware decommission 15:10
belmoreiraanother one... a tool to automatically test the DB migrations in all cells before the real upgrade15:11
amorin:)15:11
amorinsounds like we do the same job belmoreira 15:11
belmoreira:)15:11
genekuoThe first one that came into mind that we have is a Ansible script to gracefully shutdown and then start RabbitMQ cluster15:11
genekuobut we currently doesn't have a lot of dirty hack script like this15:12
belmoreiraI think this OpenInfra episode can be very interesting15:12
amorinwe have a lot of ansible things :)15:12
belmoreiragenekuo i don't see it has a dirty hack, but something useful for you and maybe others15:12
genekuothere's something similar upstream IIRC15:13
belmoreirafor the rabbitmq example we didn't went that far with the ansible playbook but we just wrote a procedure :)15:13
belmoreiraI think the next question is to find participants for episode15:14
belmoreiraas usual a good number would be between 4 to 6 participants15:15
amorinis it going to be like neutron, with a bunch of question done by someone?15:15
amorinor more like what we did in the past, where each participant is presenting 5 minutes?15:16
genekuoFor this topic, I would prefer each participant is presenting 5 minutes15:16
belmoreiraamorin ttx contacted some users but I think he didn't get any reply yet15:16
amorinok15:18
belmoreiraanother suggestion is to be like podcast style, like a conversation between operators15:18
belmoreiranot sure if the 5min slides is the most appealing format 15:19
amorinpoldcast style needs more preparation15:19
genekuoAgree that podcast style needs more preparation as the converstation may stuck when there's no participant raising questions15:20
amorin+115:21
belmoreirasure, is more challenging. We would need to have a moderator and a light script or guidance15:21
belmoreirawe can discuss the format in the next meeting15:22
amorinack15:22
belmoreiraamorin genekuo would be in for the episode?15:22
amorinyup15:22
amorinmaybe someone from citynetwork and/or infomaniak?15:23
genekuoLet me think about it, I can confirm early next week.15:23
genekuoI'll send a mail to ttx if I'm able to participate15:23
belmoreirayes, I guess most of us have a lot of tools and tricks15:24
belmoreiraI guess ttx will try to contact them15:24
belmoreirathanks genekuo15:25
genekuo:)15:26
belmoreiramaybe blizzard and workday can participate15:26
amorinyup15:26
belmoreiragreat 15:26
belmoreiraI will work in the episode description and let you know next meeting15:27
belmoreirait would be a good idea to have an etherpad and collect the items that everyone would like to mention15:28
amorinyes15:28
belmoreiradepending ni the format it can help organising the session15:29
amorinso we can collect that with the team15:29
genekuosounds good15:29
belmoreirahow about we use the old etherpad were we have the meeting topics ideas?15:30
belmoreira*can't find the link*15:30
belmoreirawell, I can't find the link but I can put it in the channel later15:32
genekuoCouldn't find it also15:32
belmoreirais there anything else to be discussed about this topic?15:32
amorincant help, sry15:32
genekuohttps://etherpad.opendev.org/p/large-scale-sig-lightning-talks15:33
genekuoIs it this one?15:33
belmoreirayes it is. Thanks genekuo15:34
belmoreiralink: https://etherpad.opendev.org/p/large-scale-sig-lightning-talks15:34
belmoreira#link https://etherpad.opendev.org/p/large-scale-sig-lightning-talks15:35
belmoreiraif we don't have more feedback lets move to the next topic15:35
belmoreira#topic Large Scale Journey updates15:36
belmoreiraany update on this?15:36
belmoreiraI confess that I didn't update my section for awhile15:36
genekuoI just reorganized the structure in Monitoring section, no major updates15:37
belmoreiragreat, thanks15:37
belmoreiraok, let's move to the next meeting15:38
belmoreira#topic Next meeting(s)15:38
belmoreirawe should have our next meeting in 2 weeks (Nov 24th)15:38
belmoreirathen the OpenInfra live is on Dec 9th15:38
belmoreira#topic Open discussion15:39
belmoreiraanything else?15:39
genekuonothing from me15:39
amorinnothing here15:39
belmoreirasee you in 2 weeks15:40
belmoreirathanks15:41
belmoreira#endmeeting15:41
opendevmeetMeeting ended Wed Nov 10 15:41:12 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:41
opendevmeetMinutes:        https://meetings.opendev.org/meetings/large_scale_sig/2021/large_scale_sig.2021-11-10-15.00.html15:41
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/large_scale_sig/2021/large_scale_sig.2021-11-10-15.00.txt15:41
opendevmeetLog:            https://meetings.opendev.org/meetings/large_scale_sig/2021/large_scale_sig.2021-11-10-15.00.log.html15:41
genekuothanks15:41

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!