*** ricolin has joined #openstack-meeting-3 | 02:01 | |
*** baojg has quit IRC | 03:10 | |
*** psachin has joined #openstack-meeting-3 | 03:31 | |
*** maciejjozefczyk_ has joined #openstack-meeting-3 | 05:43 | |
*** halali_ has quit IRC | 06:10 | |
*** e0ne has joined #openstack-meeting-3 | 06:27 | |
*** halali_ has joined #openstack-meeting-3 | 06:34 | |
*** ralonsoh has joined #openstack-meeting-3 | 07:29 | |
*** markvoelker has joined #openstack-meeting-3 | 07:47 | |
*** dparkes has joined #openstack-meeting-3 | 07:48 | |
*** markvoelker has quit IRC | 07:52 | |
ttx | #startmeeting large_scale_sig | 08:00 |
---|---|---|
openstack | Meeting started Wed Jul 22 08:00:03 2020 UTC and is due to finish in 60 minutes. The chair is ttx. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:00 |
*** openstack changes topic to " (Meeting topic: large_scale_sig)" | 08:00 | |
openstack | The meeting name has been set to 'large_scale_sig' | 08:00 |
ttx | #topic Rollcall | 08:00 |
*** openstack changes topic to "Rollcall (Meeting topic: large_scale_sig)" | 08:00 | |
ttx | Hi everyone! Who is here for the Large Scale SIG meeting ? | 08:00 |
ttx | Our agenda for today is at: | 08:00 |
ttx | #link https://etherpad.openstack.org/p/large-scale-sig-meeting | 08:00 |
ttx | (please feel free to add to it) | 08:00 |
*** t0rrant has joined #openstack-meeting-3 | 08:02 | |
ttx | amorin, dparkes: hi! | 08:02 |
t0rrant | good morning! | 08:02 |
dparkes | Hi, hello | 08:02 |
ttx | t0rrant: welcome | 08:02 |
* t0rrant thanks | 08:03 | |
*** psahoo has joined #openstack-meeting-3 | 08:03 | |
ttx | waiting a minute for more people to join | 08:03 |
ttx | halali_: hi! | 08:04 |
ttx | OK let's start, I'm not sure we'll have more people, this is summer time | 08:04 |
ttx | #topic Welcome newcomers | 08:04 |
*** openstack changes topic to "Welcome newcomers (Meeting topic: large_scale_sig)" | 08:04 | |
ttx | A few weeks ago we had a great Opendev virtual event around large scale deployments of open infrastructure | 08:05 |
ttx | As a result of that event we have a number of new people joining us today | 08:05 |
ttx | So I'd like to take the time to welcome new attendees, and spend some time discussing what they are interested in | 08:05 |
ttx | t0rrant: care to introduce yourself and what you're interested in? | 08:05 |
t0rrant | sure | 08:06 |
*** mdelavergne has joined #openstack-meeting-3 | 08:07 | |
ttx | mdelavergne: hi! | 08:07 |
t0rrant | My name is Manuel Torrinha and I work with INESC-ID in Portugal. I collaborate with the IT services in a university setting which have a multi-region Openstack deployment. That said I'm here today to learn from your larger-scale examples overall and am specially interested in discussing different control plane architectures in order to improve our own | 08:07 |
mdelavergne | hi, sorry for being late | 08:07 |
ttx | t0rrant: welcome. I'm Thierry Carrez, VP of Engineering for the OpenStack Foundation, helping with running the SIG | 08:08 |
ttx | My interest is in getting operators of large scale deployments to collaborate together and share practices and tools | 08:09 |
ttx | dparkes: how about you? | 08:09 |
dparkes | yes, sure | 08:09 |
ttx | other regular members of the SIG are mdelavergne, amorin, masahito, belmoreira... but most of them are not around today | 08:11 |
ttx | dparkes: could you quickly introduce yourself? | 08:12 |
dparkes | Hi, I'm Daniel Parkes and work for services at Red Hat, I work with OSP, and have several large deployments that I work with were we fight daily with performance and operational issues, so I'm here to share experiences on what things I see break how we fix them so contribute to user stories, and share also your knowledge and discuss about all these topics | 08:12 |
ttx | nice! | 08:12 |
ttx | So when the SIG started, we tried to avoid boiling the ocean, and came up with two short-term objectives | 08:13 |
ttx | trying to keep it reasonable, as inflated expectations can quickly kill a group like this | 08:14 |
ttx | We'll now review progress on those two goals | 08:14 |
ttx | But obviously the SIG just goes where its members push it, so if there is a workstream you'd like to pursue, we are open | 08:14 |
ttx | halali_: are you around? | 08:15 |
ttx | I guess not, we can come back to intros if he shows up later | 08:15 |
ttx | #topic Progress on "Documenting large scale operations" goal | 08:15 |
*** openstack changes topic to "Progress on "Documenting large scale operations" goal (Meeting topic: large_scale_sig)" | 08:15 | |
ttx | #link https://etherpad.openstack.org/p/large-scale-sig-documentation | 08:15 |
ttx | So this is one of our current goals for the SIG - produce better documentation to help operators setting up large deployments. | 08:15 |
halali_ | Hello, Sorry for that, was away from the desk, discuss something with team, will join later | 08:15 |
ttx | sure no pb :) | 08:16 |
ttx | In particular, this goal is around documenting better configuration values when you start hitting issues with default values | 08:16 |
ttx | If you look at https://etherpad.openstack.org/p/large-scale-sig-documentation you can see the various things we are pushing in that direction | 08:16 |
ttx | I'll push back amorin's TODO from last meeting since he is in vacation those days | 08:17 |
ttx | #action amorin to add some meat to the wiki page before we push the Nova doc patch further | 08:17 |
ttx | We had another work item on collecting metrics/billing stories | 08:17 |
ttx | That points to one critical activity of this SIG: | 08:17 |
ttx | It's all about sharing your experience operating large scale deployments of OpenStack | 08:17 |
ttx | so that we can derive best practices and/or fix common issues | 08:17 |
ttx | Only amorin contributed the story for OVH on the etherpad so far (line 34+), so please add to that | 08:18 |
ttx | if you have any experience with such setups | 08:18 |
ttx | I'll log an action item to everyone on that | 08:18 |
ttx | #action all to describe briefly how you solved metrics/billing in your deployment in https://etherpad.openstack.org/p/large-scale-sig-documentation | 08:18 |
ttx | Finally, we had an action on discussing how to upstream osarchiver, OVH's internal tool for database cleanup | 08:19 |
ttx | amorin raised a thread about it: | 08:19 |
ttx | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015970.html | 08:19 |
ttx | I did reply as planned to discuss how to best land it: | 08:19 |
ttx | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015978.html | 08:19 |
ttx | Not much replies on that yet... so I'll escalate it to get a response | 08:19 |
ttx | #action ttx to escalate OSops revival thread for osarchiver hosting | 08:19 |
dparkes | Yes I have had interest in the osarchiver in the past, and did some testing, it would be a great addition | 08:20 |
ttx | That's it for status updates on this goal... did you have comments on this goal, does that sound like a good thing to pursue, any additional action you'd like to suggest in that area ? | 08:20 |
ttx | (the trick being, it's hard to push for best practices until we reach a critical mass of experience feedback) | 08:21 |
t0rrant | I wasn't aware of osarchiver but it looks like a very useful tool for large scale and even small scale deployments | 08:21 |
ttx | yes, we are trying to revive the "OSops" concept and land it there. OSops was an operator-led collection of small tools, with low bar to entry | 08:22 |
t0rrant | we don't use mistral for example, but I guess it goes through all the services | 08:22 |
ttx | ok, moving on to the other SIG goal... | 08:23 |
ttx | #topic Progress on "Scaling within one cluster" goal | 08:23 |
*** openstack changes topic to "Progress on "Scaling within one cluster" goal (Meeting topic: large_scale_sig)" | 08:23 | |
ttx | #link https://etherpad.openstack.org/p/large-scale-sig-cluster-scaling | 08:23 |
ttx | This is the other early goal of the SIG - identify, measure and push back common scaling limitations within one cluster | 08:23 |
ttx | To that effect we collect "scaling stories", like what happened when you started adding up nodes, what breaks first | 08:24 |
ttx | We collect the stories in https://etherpad.opendev.org/p/scaling-stories | 08:24 |
ttx | and then publish them to https://wiki.openstack.org/wiki/Large_Scale_Scaling_Stories for long-term storage | 08:24 |
ttx | One common issue when adding nodes is around RabbitMQ falling down | 08:25 |
ttx | And so this SIG has worked to produce code to instrument oslo.messaging calls and get good metrics from them | 08:25 |
ttx | This resulted in https://opendev.org/openstack/oslo.metrics -- a PoC that we hope to turn into a full-fledged oslo library to do taht instrumentation | 08:25 |
ttx | Next step is to add basic tests, so that we are reasonably confident we do not introduce regressions | 08:25 |
ttx | Let me know if you are interested in looking into that | 08:26 |
t0rrant | one thing we are seeing in our deployment is timeouts on the DB side, and probably MQ bottlenecks. We have still metrics collection to set up to be sure, but I can make it fail with a not so large rally test | 08:26 |
t0rrant | that tool would be very helpful | 08:26 |
*** baojg has joined #openstack-meeting-3 | 08:27 | |
ttx | yes, and the idea is to expand it beyond oslo.messaging, to oslo,db, which would allow to capture those DB timeouts | 08:27 |
t0rrant | +1 | 08:27 |
ttx | LINE used the feedback from that tool to efficiently shard its RabbitMQ setup | 08:27 |
ttx | allowing to push back the size of an individual cluster and not create too many of those | 08:28 |
dparkes | Because osprofiler doesn't have much traction these days? | 08:28 |
ttx | less traction, but also more scope | 08:28 |
ttx | this is more targeted | 08:28 |
dparkes | we sometimes find with the need of tracing to see where the issue is, so somethis like oslo.metrics would be great | 08:28 |
ttx | for me osprofiler is a dev tool, while this is an operational tool | 08:29 |
ttx | obviously there is overlap | 08:29 |
dparkes | ttx yes, something light, easy for ops, but that can give you and idea of where your spending your time | 08:29 |
ttx | dparkes: interested in your scaling (horror) stories. Not sure how much you can share from RH OSP customers, but even anonymized repotrs would be super-useful | 08:30 |
ttx | The idea being to identify what breaks first and focus on that, and gradually raise the number of hosts we can have in a given cluster | 08:32 |
ttx | OK, anything else on that topic? | 08:32 |
ttx | dparkes, t0rrant: do those two goals sound good to you? Or was there something completely different you were interested in pursuing? | 08:33 |
t0rrant | those goals seem reasonable to me, one thing I would like to discuss is advice on control plane architecture,m although I don't know if this meeting is the most appropriate :P | 08:34 |
dparkes | ttx yes I will go through the notes and try to add to the user stories, things that break ,etc | 08:34 |
ttx | dparkes: cool, thanks | 08:34 |
ttx | t0rrant: we rae not really at that level of detail yet, but we could come to it | 08:35 |
ttx | ok, moving on... | 08:35 |
t0rrant | sure thing | 08:35 |
ttx | #topic Discuss a US-friendly meeting time | 08:35 |
*** openstack changes topic to "Discuss a US-friendly meeting time (Meeting topic: large_scale_sig)" | 08:35 | |
ttx | Following the Opendev event we have a couple more people interested in joining | 08:35 |
ttx | But they are based on US Pacific TZ, so our current meeting time is not working for them :) | 08:35 |
ttx | (1am) | 08:35 |
ttx | The SIG members are currently mostly in EU, with a couple in APAC | 08:36 |
ttx | Given the SIG membership, I was thinking we could alternate between a APAC-EU time and a EU-US time. | 08:36 |
ttx | For example, have next meeting in two weeks at 16utc, then in four weeks, back to 8utc | 08:36 |
ttx | Would that work for you all? Obviously just attend the meetings you can attend :) | 08:36 |
dparkes | yes, sounds fair | 08:36 |
t0rrant | looks like a good compromise yes | 08:37 |
ttx | Since the goal of the SIG is really to collect and share experiences, I feel like we'll maximize input that way | 08:37 |
mdelavergne | fine by me, but 16utc every time is also fine | 08:37 |
ttx | even if that will make my work communicating each meeting output a bit more critical :) | 08:37 |
ttx | I'll confirm with our US-based prospects that 16utc every 4 weeks on wednesdays is ok, and update the meeting info. | 08:38 |
ttx | #action ttx to set alternating US-EU / EU-APAC meetings | 08:38 |
ttx | #topic Next meeting | 08:38 |
*** openstack changes topic to "Next meeting (Meeting topic: large_scale_sig)" | 08:38 | |
ttx | So... I'll be taking time off in two weeks, at when would be our first US-EU meeting... So I'd rather move it off one week | 08:38 |
ttx | Like first US-EU meeting on August 12, 16utc, then next EU-APAC meeting on August 26, 8utc. | 08:38 |
ttx | How does that sound? | 08:38 |
t0rrant | sounds good to me | 08:39 |
ttx | We have reduced attendance in summer months anyway | 08:39 |
mdelavergne | yep, sounds good | 08:39 |
ttx | OK, I'll keep you posted on openstack-discuss mailing-list as always | 08:39 |
mdelavergne | thanks :) | 08:39 |
ttx | we are using the [largescale-sig] prefix for all things SIG-related | 08:40 |
ttx | I announce the meetings, and post summaries after the fact there | 08:40 |
ttx | #info next meetings: Aug 12, 16:00UTC, Aug 26, 8:00UTC | 08:40 |
ttx | #topic Open discussion | 08:40 |
*** openstack changes topic to "Open discussion (Meeting topic: large_scale_sig)" | 08:40 | |
ttx | Anything else you'd like to discuss today? | 08:41 |
ttx | Thanks again for joining the SIG and helping making OpenStack better! | 08:41 |
t0rrant | Thank you! | 08:42 |
ttx | Alright, let's close this. Thanks everyone for attending today | 08:42 |
mdelavergne | Welcome to the newcomers, and thanks everyone | 08:42 |
ttx | #endmeeting | 08:42 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:42 | |
openstack | Meeting ended Wed Jul 22 08:42:54 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:42 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/large_scale_sig/2020/large_scale_sig.2020-07-22-08.00.html | 08:42 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/large_scale_sig/2020/large_scale_sig.2020-07-22-08.00.txt | 08:42 |
openstack | Log: http://eavesdrop.openstack.org/meetings/large_scale_sig/2020/large_scale_sig.2020-07-22-08.00.log.html | 08:42 |
dparkes | Thanks! | 08:43 |
mdelavergne | see you in august then! | 08:43 |
t0rrant | seen then | 08:43 |
t0rrant | *see you | 08:43 |
*** mdelavergne has quit IRC | 08:43 | |
*** t0rrant has left #openstack-meeting-3 | 09:04 | |
*** halali_ has quit IRC | 10:43 | |
*** ricolin has quit IRC | 10:48 | |
*** halali_ has joined #openstack-meeting-3 | 11:07 | |
*** raildo has joined #openstack-meeting-3 | 11:29 | |
*** baojg has quit IRC | 11:49 | |
*** baojg has joined #openstack-meeting-3 | 11:51 | |
*** maciejjozefczyk_ has quit IRC | 12:01 | |
*** maciejjozefczyk has joined #openstack-meeting-3 | 12:01 | |
*** baojg has quit IRC | 12:11 | |
*** baojg has joined #openstack-meeting-3 | 12:12 | |
*** tosky has joined #openstack-meeting-3 | 12:17 | |
*** artom has quit IRC | 12:24 | |
*** e0ne has quit IRC | 12:33 | |
*** e0ne has joined #openstack-meeting-3 | 12:37 | |
*** e0ne has quit IRC | 12:39 | |
*** artom has joined #openstack-meeting-3 | 13:21 | |
*** baojg has quit IRC | 13:23 | |
*** baojg has joined #openstack-meeting-3 | 13:24 | |
*** bnemec has joined #openstack-meeting-3 | 13:30 | |
*** baojg has quit IRC | 13:41 | |
*** baojg has joined #openstack-meeting-3 | 13:43 | |
*** ricolin has joined #openstack-meeting-3 | 13:43 | |
*** e0ne has joined #openstack-meeting-3 | 14:00 | |
*** e0ne has quit IRC | 14:22 | |
*** baojg has quit IRC | 14:22 | |
*** e0ne has joined #openstack-meeting-3 | 14:23 | |
*** psachin has quit IRC | 14:24 | |
*** baojg has joined #openstack-meeting-3 | 14:25 | |
ralonsoh | #startmeeting neutron_ci | 15:02 |
openstack | Meeting started Wed Jul 22 15:02:07 2020 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:02 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:02 | |
openstack | The meeting name has been set to 'neutron_ci' | 15:02 |
ralonsoh | hello, sorry for the delay | 15:02 |
ralonsoh | hmmmm summer time, I guess | 15:03 |
ralonsoh | ok, just for the records, I'll do a quick agenda review | 15:04 |
ralonsoh | #topic Actions from previous meetings | 15:04 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:04 | |
ralonsoh | maciejjozefczyk to check neutron_tempest_plugin.scenario.test_connectivity.NetworkConnectivityTest.test_connectivity_through_2_routers in ovn jobs | 15:04 |
ralonsoh | I don't know if you had time to review it | 15:04 |
ralonsoh | ok, that was the only item | 15:05 |
ralonsoh | on't know if you had time to review it | 15:05 |
ralonsoh | sorry | 15:05 |
ralonsoh | #topic Stadium projects | 15:05 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:05 | |
ralonsoh | two of them with active patches | 15:05 |
ralonsoh | networking-odl | 15:05 |
ralonsoh | #link https://review.opendev.org/#/c/725647/ | 15:06 |
ralonsoh | and Neutron OVN | 15:06 |
ralonsoh | #link https://review.opendev.org/#/c/729591/ | 15:06 |
ralonsoh | both are passing | 15:06 |
ralonsoh | about IPv6-only CI, no activity in the community | 15:07 |
ralonsoh | #link https://etherpad.openstack.org/p/neutron-stadium-ipv6-testing | 15:07 |
ralonsoh | all patches are still WIP | 15:07 |
ralonsoh | ok, next topic | 15:07 |
ralonsoh | #topic Switch to Ubuntu Focal | 15:07 |
*** openstack changes topic to "Switch to Ubuntu Focal (Meeting topic: neutron_ci)" | 15:07 | |
ralonsoh | #link https://etherpad.opendev.org/p/neutron-victoria-switch_to_focal | 15:07 |
ralonsoh | #link https://review.opendev.org/#/c/734304/ | 15:07 |
ralonsoh | the pending patch was merged | 15:08 |
ralonsoh | I rebased it to check if works now | 15:08 |
ralonsoh | next one https://review.opendev.org/#/c/737370/ | 15:08 |
ralonsoh | still waiting for https://review.opendev.org/#/c/734700/ | 15:09 |
ralonsoh | and for ODL | 15:09 |
ralonsoh | #link https://review.opendev.org/#/c/736703/ | 15:09 |
ralonsoh | WIP | 15:09 |
ralonsoh | #topic Stable branches | 15:09 |
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)" | 15:09 | |
ralonsoh | Ussuri dashboard: http://grafana.openstack.org/d/pM54U-Kiz/neutron-failure-rate-previous-stable-release?orgId=1 | 15:10 |
ralonsoh | Train dashboard: http://grafana.openstack.org/d/dCFVU-Kik/neutron-failure-rate-older-stable-release?orgId=1 | 15:10 |
ralonsoh | But I can make any statement about both dashboards, I didn't review them | 15:10 |
ralonsoh | #topic fullstack/functional | 15:10 |
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 15:10 | |
ralonsoh | The problems we had on Monday due tohttps://review.opendev.org/#/c/739306/, were solved in https://review.opendev.org/#/c/741957/ | 15:11 |
ralonsoh | I don't recall any other "big" problem in FT or fullstack tests | 15:11 |
ralonsoh | #topic Tempest/Scenario | 15:11 |
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:11 | |
ralonsoh | #link https://review.opendev.org/#/c/739955/ is already merged, increasing the tempest jobs timeout | 15:12 |
ralonsoh | the problem with neutron-ovn-tempest-full-multinode-ovs-master | 15:12 |
ralonsoh | reported in https://bugs.launchpad.net/neutron/+bug/1886807 | 15:12 |
openstack | Launchpad bug 1886807 in neutron "neutron-ovn-tempest-full-multinode-ovs-master job is failing 100% times" [High,Confirmed] - Assigned to Maciej Jozefczyk (maciej.jozefczyk) | 15:12 |
ralonsoh | that should be fixed in https://review.opendev.org/#/c/741606/ | 15:13 |
ralonsoh | setting both OVS and OVN branches to "master" | 15:13 |
ralonsoh | this patch is almost merged | 15:13 |
ralonsoh | and that's all this *slow* week | 15:13 |
ralonsoh | if you review the meeting logs and you have any question or problem, do not hesitate to ping me in IRC | 15:14 |
ralonsoh | thanks | 15:14 |
ralonsoh | #endmeeting | 15:14 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:14 | |
openstack | Meeting ended Wed Jul 22 15:14:37 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:14 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-07-22-15.02.html | 15:14 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-07-22-15.02.txt | 15:14 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-07-22-15.02.log.html | 15:14 |
*** factor has joined #openstack-meeting-3 | 15:26 | |
*** njohnston has joined #openstack-meeting-3 | 15:30 | |
*** baojg has quit IRC | 15:54 | |
*** baojg has joined #openstack-meeting-3 | 15:56 | |
*** factor has quit IRC | 16:08 | |
*** factor has joined #openstack-meeting-3 | 16:09 | |
*** e0ne has quit IRC | 16:15 | |
*** ricolin has quit IRC | 16:19 | |
*** halali_ has quit IRC | 16:30 | |
*** baojg has quit IRC | 16:34 | |
*** factor has quit IRC | 16:39 | |
*** factor has joined #openstack-meeting-3 | 16:40 | |
*** factor has quit IRC | 16:40 | |
*** halali_ has joined #openstack-meeting-3 | 16:46 | |
*** factor has joined #openstack-meeting-3 | 17:04 | |
*** halali_ has quit IRC | 17:05 | |
*** e0ne has joined #openstack-meeting-3 | 17:20 | |
*** psahoo has quit IRC | 17:25 | |
*** _erlon_ has joined #openstack-meeting-3 | 18:02 | |
*** icarusfactor has joined #openstack-meeting-3 | 18:07 | |
*** icarusfactor has left #openstack-meeting-3 | 18:08 | |
*** factor has quit IRC | 18:09 | |
*** e0ne has quit IRC | 18:15 | |
*** halali__ has joined #openstack-meeting-3 | 18:26 | |
*** ralonsoh has quit IRC | 18:45 | |
*** bnemec has quit IRC | 19:03 | |
*** baojg has joined #openstack-meeting-3 | 19:07 | |
*** e0ne has joined #openstack-meeting-3 | 19:17 | |
*** maciejjozefczyk has quit IRC | 19:26 | |
*** baojg has quit IRC | 19:31 | |
*** baojg has joined #openstack-meeting-3 | 19:32 | |
*** e0ne has quit IRC | 19:47 | |
*** e0ne has joined #openstack-meeting-3 | 20:04 | |
*** halali__ is now known as halali_ | 20:05 | |
*** e0ne has quit IRC | 20:12 | |
*** bnemec has joined #openstack-meeting-3 | 21:04 | |
*** bnemec has quit IRC | 21:11 | |
*** bnemec has joined #openstack-meeting-3 | 21:18 | |
*** baojg has quit IRC | 21:22 | |
*** baojg has joined #openstack-meeting-3 | 21:23 | |
*** raildo has quit IRC | 21:28 | |
*** tosky has quit IRC | 23:03 | |
*** halali_ has quit IRC | 23:15 | |
*** markvoelker has joined #openstack-meeting-3 | 23:27 | |
*** markvoelker has quit IRC | 23:32 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!