*** gyee has quit IRC | 00:36 | |
*** markvoelker has quit IRC | 00:49 | |
*** markvoelker has joined #openstack-meeting | 00:50 | |
*** longkb has joined #openstack-meeting | 00:52 | |
*** ssbarnea has quit IRC | 00:52 | |
*** markvoelker has quit IRC | 00:55 | |
*** ykatabam has quit IRC | 00:55 | |
*** ykatabam has joined #openstack-meeting | 01:04 | |
*** yamahata has quit IRC | 01:36 | |
*** iyamahat has quit IRC | 01:36 | |
*** iyamahat has joined #openstack-meeting | 01:52 | |
*** hongbin has joined #openstack-meeting | 02:02 | |
*** diablo_rojo has quit IRC | 02:02 | |
*** yamahata has joined #openstack-meeting | 02:10 | |
*** mhen has quit IRC | 02:13 | |
*** mhen has joined #openstack-meeting | 02:16 | |
*** erlon has quit IRC | 02:33 | |
*** tetsuro has joined #openstack-meeting | 02:45 | |
*** markvoelker has joined #openstack-meeting | 02:51 | |
*** psachin has joined #openstack-meeting | 02:52 | |
*** cloudrancher has quit IRC | 03:11 | |
*** cloudrancher has joined #openstack-meeting | 03:11 | |
*** tetsuro has quit IRC | 03:12 | |
*** tetsuro has joined #openstack-meeting | 03:16 | |
*** Nel1x has joined #openstack-meeting | 03:23 | |
*** markvoelker has quit IRC | 03:24 | |
*** martial__ has quit IRC | 03:31 | |
*** janki has joined #openstack-meeting | 03:47 | |
*** tetsuro has quit IRC | 03:51 | |
*** Nel1x has quit IRC | 03:52 | |
*** hongbin has quit IRC | 04:01 | |
*** markvoelker has joined #openstack-meeting | 04:21 | |
*** yamahata has quit IRC | 04:35 | |
*** yamahata has joined #openstack-meeting | 04:35 | |
*** ykatabam has quit IRC | 04:51 | |
*** ykatabam has joined #openstack-meeting | 04:53 | |
*** markvoelker has quit IRC | 04:54 | |
*** armax has joined #openstack-meeting | 05:28 | |
*** ykatabam has quit IRC | 05:29 | |
*** pcaruana|elisa| has joined #openstack-meeting | 05:29 | |
*** pcaruana|elisa| has quit IRC | 05:37 | |
*** janki has quit IRC | 05:46 | |
*** janki has joined #openstack-meeting | 05:49 | |
*** markvoelker has joined #openstack-meeting | 05:51 | |
*** ykatabam has joined #openstack-meeting | 05:56 | |
*** e0ne has joined #openstack-meeting | 06:16 | |
*** e0ne has quit IRC | 06:18 | |
*** janki has quit IRC | 06:18 | |
*** markvoelker has quit IRC | 06:26 | |
*** ykatabam has quit IRC | 06:33 | |
*** janki has joined #openstack-meeting | 06:37 | |
*** armax_ has joined #openstack-meeting | 06:42 | |
*** armax has quit IRC | 06:42 | |
*** armax_ is now known as armax | 06:42 | |
*** markvoelker has joined #openstack-meeting | 07:24 | |
*** pcaruana|elisa| has joined #openstack-meeting | 07:45 | |
*** tssurya has joined #openstack-meeting | 07:45 | |
*** markvoelker has quit IRC | 07:57 | |
*** hle2 has quit IRC | 08:00 | |
*** LiangFang has quit IRC | 08:01 | |
*** Liang__ has joined #openstack-meeting | 08:04 | |
*** e0ne has joined #openstack-meeting | 08:12 | |
*** liuyulong has quit IRC | 08:12 | |
*** larainema has quit IRC | 08:30 | |
*** ralonsoh has joined #openstack-meeting | 08:31 | |
*** ssbarnea has joined #openstack-meeting | 08:40 | |
*** a-pugachev has joined #openstack-meeting | 08:50 | |
*** markvoelker has joined #openstack-meeting | 08:54 | |
*** pcaruana|elisa| has quit IRC | 09:13 | |
*** Liang__ has quit IRC | 09:14 | |
*** pcaruana|elisa| has joined #openstack-meeting | 09:15 | |
*** Qiming has quit IRC | 09:16 | |
*** NikitaKonovalov has quit IRC | 09:16 | |
*** e0ne has quit IRC | 09:16 | |
*** Liang__ has joined #openstack-meeting | 09:18 | |
*** NikitaKonovalov has joined #openstack-meeting | 09:18 | |
*** Qiming has joined #openstack-meeting | 09:19 | |
*** e0ne has joined #openstack-meeting | 09:25 | |
*** markvoelker has quit IRC | 09:27 | |
*** ttsiouts has joined #openstack-meeting | 09:28 | |
*** ttsiouts has quit IRC | 09:29 | |
*** ttsiouts has joined #openstack-meeting | 09:45 | |
*** ianychoi has quit IRC | 09:51 | |
*** ianychoi has joined #openstack-meeting | 09:52 | |
*** kopecmartin|off is now known as kopecmartin | 10:05 | |
*** electrofelix has joined #openstack-meeting | 10:07 | |
*** apetrich has quit IRC | 10:12 | |
*** markvoelker has joined #openstack-meeting | 10:24 | |
*** apetrich has joined #openstack-meeting | 10:27 | |
*** rossella_s has joined #openstack-meeting | 10:31 | |
*** yamamoto has quit IRC | 10:34 | |
*** yamamoto has joined #openstack-meeting | 10:34 | |
*** Liang__ has quit IRC | 10:37 | |
*** yamamoto has quit IRC | 10:39 | |
*** yamamoto has joined #openstack-meeting | 10:40 | |
*** yamamoto has quit IRC | 10:41 | |
*** shrasool has joined #openstack-meeting | 10:42 | |
*** markvoelker has quit IRC | 10:58 | |
*** e0ne has quit IRC | 11:15 | |
*** e0ne has joined #openstack-meeting | 11:15 | |
*** ykatabam has joined #openstack-meeting | 11:23 | |
*** e0ne has quit IRC | 11:27 | |
*** yamamoto has joined #openstack-meeting | 11:28 | |
*** yamamoto has quit IRC | 11:35 | |
*** yamamoto has joined #openstack-meeting | 11:35 | |
*** rossella_s has quit IRC | 11:40 | |
*** longkb has quit IRC | 11:41 | |
*** raildo has joined #openstack-meeting | 11:51 | |
*** markvoelker has joined #openstack-meeting | 11:54 | |
*** rossella_s has joined #openstack-meeting | 11:55 | |
*** shintaro has joined #openstack-meeting | 12:00 | |
*** markvoelker has quit IRC | 12:13 | |
*** jchhatbar has joined #openstack-meeting | 12:28 | |
*** jchhatbar has quit IRC | 12:28 | |
*** janki has quit IRC | 12:29 | |
*** janki has joined #openstack-meeting | 12:29 | |
*** ttsiouts has quit IRC | 12:30 | |
*** tpsilva has joined #openstack-meeting | 12:38 | |
*** yamamoto has quit IRC | 12:44 | |
*** yamamoto has joined #openstack-meeting | 13:04 | |
*** e0ne has joined #openstack-meeting | 13:06 | |
*** erlon has joined #openstack-meeting | 13:08 | |
*** raildo has quit IRC | 13:09 | |
*** raildo_ has joined #openstack-meeting | 13:09 | |
*** rbudden has joined #openstack-meeting | 13:09 | |
*** eharney has joined #openstack-meeting | 13:13 | |
*** mriedem has joined #openstack-meeting | 13:14 | |
*** mriedem is now known as ash_williams | 13:15 | |
*** ttsiouts has joined #openstack-meeting | 13:16 | |
*** liuyulong has joined #openstack-meeting | 13:19 | |
*** dustins has joined #openstack-meeting | 13:20 | |
*** janki has quit IRC | 13:22 | |
*** janki has joined #openstack-meeting | 13:23 | |
*** sambetts|afk is now known as sambetts | 13:28 | |
*** daikk115 has joined #openstack-meeting | 13:28 | |
*** slaweq has quit IRC | 13:29 | |
*** eharney_ has joined #openstack-meeting | 13:30 | |
*** jamesmcarthur has joined #openstack-meeting | 13:31 | |
*** eharney_ has quit IRC | 13:35 | |
*** yamamoto has quit IRC | 13:37 | |
*** yamamoto has joined #openstack-meeting | 13:38 | |
*** yamamoto has quit IRC | 13:38 | |
*** cloudrancher has quit IRC | 13:53 | |
*** jamesmcarthur has quit IRC | 13:54 | |
*** cloudrancher has joined #openstack-meeting | 13:54 | |
*** jamesmcarthur has joined #openstack-meeting | 13:55 | |
*** awaugama has joined #openstack-meeting | 13:59 | |
*** yamamoto has joined #openstack-meeting | 14:00 | |
*** raildo_ has quit IRC | 14:00 | |
*** jamesmcarthur has quit IRC | 14:01 | |
*** shintaro has quit IRC | 14:09 | |
*** shrasool has quit IRC | 14:13 | |
*** hongbin has joined #openstack-meeting | 14:14 | |
*** e0ne has quit IRC | 14:19 | |
*** e0ne has joined #openstack-meeting | 14:26 | |
*** raildo has joined #openstack-meeting | 14:30 | |
*** cloudrancher has quit IRC | 14:38 | |
*** cloudrancher has joined #openstack-meeting | 14:39 | |
*** e0ne has quit IRC | 14:41 | |
*** slaweq has joined #openstack-meeting | 14:41 | |
*** e0ne has joined #openstack-meeting | 14:44 | |
*** Leo_m has joined #openstack-meeting | 14:52 | |
*** mpiwowarczy has joined #openstack-meeting | 14:58 | |
*** ianychoi has quit IRC | 15:00 | |
*** gyee has joined #openstack-meeting | 15:01 | |
*** slaweq has quit IRC | 15:01 | |
*** rossella_s has quit IRC | 15:04 | |
*** rossella_s has joined #openstack-meeting | 15:07 | |
*** dkrol has joined #openstack-meeting | 15:09 | |
*** rossella_s has quit IRC | 15:12 | |
*** ash_williams has left #openstack-meeting | 15:21 | |
*** ash_williams has joined #openstack-meeting | 15:21 | |
*** ykatabam has quit IRC | 15:27 | |
*** rossella_s has joined #openstack-meeting | 15:27 | |
*** slaweq has joined #openstack-meeting | 15:29 | |
*** ganso has joined #openstack-meeting | 15:48 | |
*** kopecmartin is now known as kopecmartin|off | 15:49 | |
*** woojay has joined #openstack-meeting | 15:54 | |
*** rosmaita has joined #openstack-meeting | 15:57 | |
*** eharney has quit IRC | 15:59 | |
*** fanzhang has quit IRC | 16:00 | |
*** fanzhang has joined #openstack-meeting | 16:00 | |
* smcginnis whistles | 16:01 | |
jungleboyj | #startmeeting Cinder | 16:01 |
---|---|---|
openstack | Meeting started Wed Oct 31 16:01:02 2018 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
*** openstack changes topic to " (Meeting topic: Cinder)" | 16:01 | |
openstack | The meeting name has been set to 'cinder' | 16:01 |
daikk115 | o/ | 16:01 |
smcginnis | o/ | 16:01 |
_alastor_ | o/ | 16:01 |
yikun | o/ | 16:01 |
e0ne | hi | 16:01 |
rosmaita | o/ | 16:01 |
whoami-rajat | Hi | 16:01 |
xyang | hi | 16:01 |
erlon | hey | 16:01 |
jungleboyj | courtesy ping jungleboyj diablo_rojo, diablo_rojo_phon, rajinir tbarron xyang xyang1 e0ne gouthamr thingee erlon tpsilva ganso patrickeast tommylikehu eharney geguileo smcginnis lhx_ lhx__ aspiers jgriffith moshele hwalsh felipemonteiro lpetrut lseki _alastor_ whoami-rajat yikun rosmaita | 16:01 |
jungleboyj | @! | 16:01 |
_pewp_ | jungleboyj (。・∀・)ノ | 16:01 |
geguileo | hi! o/ | 16:01 |
ganso | hello | 16:02 |
*** jbernard has joined #openstack-meeting | 16:03 | |
jungleboyj | Ok. Looks like we have a lot of people already so we can get started | 16:03 |
jungleboyj | #topic announcements | 16:03 |
*** openstack changes topic to "announcements (Meeting topic: Cinder)" | 16:03 | |
jungleboyj | Just a reminder that I have created Forum Etherpads for Berlin: | 16:04 |
jungleboyj | #link https://wiki.openstack.org/wiki/Forum/Berlin2018 | 16:04 |
jungleboyj | Please take a look and add your thoughts there. Hopefully we will have good discussion there. | 16:04 |
jungleboyj | I think that is all I have for announcements. | 16:05 |
jungleboyj | Anything to add smcginnis ? | 16:05 |
smcginnis | Hmm, not that I can think of, but I'll probably think of something later. | 16:05 |
jungleboyj | Ok. Sounds good. | 16:06 |
*** jamesmcarthur has joined #openstack-meeting | 16:06 | |
jungleboyj | #topic Cinder get together in Berlin? | 16:06 |
*** openstack changes topic to "Cinder get together in Berlin? (Meeting topic: Cinder)" | 16:06 | |
rosmaita | is the etherpad really slow or is it just me? | 16:06 |
jungleboyj | rosmaita: It is slow. I was having issues with it earlier. | 16:06 |
daikk115 | rosmaita, same with me. | 16:06 |
jungleboyj | So, a number of groups are having get togethers at Berlin. | 16:07 |
jungleboyj | are people interested in trying to do something in Berlin? | 16:07 |
* jungleboyj hears crickets | 16:08 | |
rosmaita | "if you plan it, they will come" | 16:08 |
erlon | I am | 16:08 |
jungleboyj | rosmaita: True enough. :-) | 16:09 |
erlon | it always good the get together | 16:09 |
smcginnis | Would be fun. Have to collected an informal show of hands who will be in Berlin? | 16:09 |
e0ne | erlon: +1 | 16:09 |
jungleboyj | I did in the last meeting. There are a few of us. | 16:09 |
jungleboyj | I will be there, smcginnis, geguileo , e0ne | 16:10 |
jungleboyj | #link https://etherpad.openstack.org/p/BER-cinder-outing-planning | 16:10 |
jungleboyj | There is an etherpad that we can use to plan the event. | 16:10 |
jungleboyj | Though etherpad is not happy at the moment so it is hard to start filling that in now. | 16:11 |
*** dustins has quit IRC | 16:12 | |
jungleboyj | smcginnis: You seemed to have an idea of what nights are already busy? | 16:12 |
jungleboyj | Sounded like Thursday might be the best night? | 16:13 |
smcginnis | I have something Monday. Other nights should be OK. | 16:13 |
e0ne | +1 | 16:13 |
*** janki has quit IRC | 16:13 | |
smcginnis | Folks are probably leaving Thursday night. | 16:13 |
smcginnis | So Wednesday might be best? | 16:13 |
jungleboyj | Ok. I don't have anything planned yet so Wednesday should be fine for me. | 16:14 |
geguileo | I don't have anything planned either | 16:14 |
jungleboyj | Wednesday night is the Meet and Geek Pub Crawl but people could join that later and would rather get time with the team. | 16:16 |
smcginnis | Oh right, forgot about that. | 16:16 |
smcginnis | We could combine to two as well. | 16:16 |
jungleboyj | Otherwise we could do it after the Market Place Mixer on Tuesday. | 16:17 |
jungleboyj | I don't have a strong preference. | 16:18 |
jungleboyj | So, I will put together the etherpad linked on the meeting agenda when etherpad is working again. | 16:19 |
jungleboyj | Will send an e-mail to the mailing list to get people involved. | 16:19 |
jungleboyj | People can then indicate their interest in joining and we can touch on it again next week. | 16:19 |
jungleboyj | Sound like a plan? | 16:20 |
jungleboyj | I will take that as a yes. | 16:20 |
jungleboyj | #topic New Cinder Incremental backup flow | 16:20 |
*** openstack changes topic to "New Cinder Incremental backup flow (Meeting topic: Cinder)" | 16:20 | |
jungleboyj | daikk115: Your floor. | 16:21 |
daikk115 | thank jungleboyj | 16:21 |
daikk115 | I'm using Ceph as a backend for Cinder, so the backup flow is so weird | 16:21 |
jungleboyj | Ok. | 16:22 |
smcginnis | Oh, you mean differential backup according to the description on the etherpad. | 16:22 |
daikk115 | the first one must be full backup and others always incremental | 16:22 |
smcginnis | In backup parlance, that is not incremental. | 16:22 |
daikk115 | smcginnis, yep. | 16:22 |
jungleboyj | I feel like we talked about this at the PTG. | 16:23 |
geguileo | I don't follow | 16:23 |
geguileo | RBD backups are incremental, right? | 16:23 |
smcginnis | So differential has been discussed before. We can't support that since we don't do change block tracking to know what parts to backup. | 16:23 |
jungleboyj | Ah, that is right. | 16:23 |
daikk115 | what I want to have is "multiple full backups and every new incremental backup should be based on latest full backup" | 16:24 |
smcginnis | Please stop saying incremental. | 16:24 |
geguileo | daikk115: there is a BZ to allow full backups after a full backup | 16:24 |
geguileo | and there is a patch to allow that | 16:24 |
whoami-rajat | https://bugs.launchpad.net/cinder/+bug/1790713 i think there was a discussion regarding this in a meeting and this bug was filed. | 16:24 |
openstack | Launchpad bug 1790713 in Cinder "Ceph RBD backup driver cannot create full backups after the first full backup" [Undecided,In progress] - Assigned to Sofia Enriquez (lsofia-enriquez) | 16:24 |
smcginnis | That's another issue with ceph. | 16:24 |
geguileo | that way it will follow the incremental flag | 16:24 |
jungleboyj | geguileo: Ah, that was what we talked about at the PTG. | 16:24 |
daikk115 | geguileo, I have tested that. | 16:24 |
geguileo | daikk115: and is it OK? | 16:25 |
daikk115 | but new "differential backup" always base on the first full | 16:25 |
smcginnis | BUt this is different. We have full and incremental backups already, just a bug in the ceph driver. Differential is different. | 16:25 |
smcginnis | And something we've discussed a few times already and determined we can't/won't do. | 16:25 |
e0ne | smcginnis: +1 | 16:26 |
geguileo | we could do differential just like we do it now | 16:26 |
daikk115 | smcginnis, the usecase is create full backup for the first day of week. | 16:26 |
geguileo | both for RBD and for chuncked | 16:26 |
smcginnis | I know the use case. | 16:26 |
daikk115 | and every day in that week we create diff backup. | 16:26 |
daikk115 | for the new week, we do the samething | 16:26 |
geguileo | daikk115: it can be done, are you willing to work on it? | 16:26 |
jungleboyj | geguileo: How can it be done? | 16:26 |
smcginnis | geguileo: I don't think it can be done. At least in the past, there were some backends that claimed it would not work for them. | 16:26 |
geguileo | jungleboyj: in which driver RBD or chunked one? | 16:27 |
smcginnis | I've fine if someone can figure it out, but they can't just look at ceph and assume everything works the same way. | 16:27 |
jungleboyj | RBD | 16:27 |
smcginnis | *I'm | 16:27 |
geguileo | smcginnis: we are not talking about "perfect differential", but a differential similar to our incremental | 16:27 |
jungleboyj | smcginnis: ++ | 16:27 |
*** kencjohnston has quit IRC | 16:27 | |
smcginnis | My statement still stands. :) | 16:27 |
geguileo | yeah, I think it could be done in RBD as well, though we would need to do tests to figure it out | 16:28 |
geguileo | smcginnis: +1 | 16:28 |
geguileo | I believe it can be done, but like smcginnis said, someone would have to confirm it and work on it | 16:28 |
*** aagate has joined #openstack-meeting | 16:28 | |
whoami-rajat | is this patch serving the similar purpose or otherwise ? https://review.openstack.org/#/c/612503/ geguileo | 16:28 |
daikk115 | But as my WIP patchset, the idea from my side is having new column to store "base" for each "differential backups" | 16:28 |
jungleboyj | Ok. | 16:28 |
*** kencjohnston has joined #openstack-meeting | 16:29 | |
daikk115 | this my propose https://review.openstack.org/#/c/614469/ | 16:29 |
smcginnis | You shouldn't need to store that. That can be determined when needed. | 16:29 |
daikk115 | whoami-rajat, that patch only help to create more full backups, that's | 16:29 |
jungleboyj | whoami-rajat: No, that was just fixing a bug where once you did an incremental backup, that was all you could do. | 16:29 |
e0ne | daikk115: how will it work for nfs and swift? | 16:29 |
geguileo | daikk115: I have just read the commit message and it doesn't sound right | 16:30 |
daikk115 | e0ne, that's question. I'm don't know about that backend, but just think new column will not affect other backend | 16:30 |
e0ne | daikk115: it's a bad idea to add a new column just for a one backend | 16:31 |
daikk115 | geguileo, sure, my commit message did not clear enough | 16:31 |
jungleboyj | geguileo: ++ | 16:31 |
geguileo | daikk115: what are you trying to fix? | 16:31 |
whoami-rajat | daikk115: jungleboyj ok, seems like that should be supported first to have multiple full backups | 16:31 |
daikk115 | e0ne, I know but the idea is parent_id and base_id should be present together for any backend | 16:32 |
jungleboyj | whoami-rajat: Correct. That is a known issue that needs to get resolved. | 16:32 |
smcginnis | Get rid of the new column and all the unnecessary shifting of code and it might be easier to see. | 16:32 |
daikk115 | in case we want create multile full backup and multiple incremental/diff from them | 16:32 |
geguileo | daikk115: I believe we can do that now, since we have the link to the parent | 16:32 |
e0ne | geguileo: +1\ | 16:33 |
smcginnis | daikk115: Oh, so you want to have the option to create a differential backup from a full backup other than the most recent? | 16:33 |
daikk115 | one incremental can be parent of other incremental | 16:33 |
daikk115 | right? geguileo | 16:33 |
geguileo | so we can have N backups to 1 parent backup relationship | 16:33 |
geguileo | daikk115: yes, it can be | 16:33 |
daikk115 | so we don't know which full backup is base full backup for new incremental/diff? | 16:33 |
geguileo | daikk115: actually that's how it works right now, the parent is the latest backup | 16:34 |
geguileo | that's why it's incremental and not differential at the moment | 16:34 |
geguileo | if we want to allow user to specify the parent, we would just have to modify the API, and a couple of places | 16:34 |
smcginnis | WIth incremental, it's always the last backup. Seems odd to want to do an incremental or differntial from something other than the last full backup. | 16:34 |
geguileo | incremental is always from the last backup (incremental or full) | 16:35 |
daikk115 | smcginnis, for Ceph backup, it always create new snap in first full | 16:35 |
geguileo | differential is from the last full | 16:35 |
daikk115 | did not create snap in latest full backup | 16:35 |
smcginnis | So I think 1) this needs a spec actually spelling out what you're trying to accomplish here clearly, 2) prototype code for more than just ceph. | 16:35 |
geguileo | daikk115: the snapshot is to set a marker | 16:35 |
geguileo | daikk115: so we can then request the diff between that point and current point | 16:35 |
geguileo | I think we are going into implementation details | 16:35 |
jungleboyj | smcginnis: ++ | 16:36 |
geguileo | smcginnis: +1 | 16:36 |
jungleboyj | Too complicated to just pound out in code. | 16:36 |
smcginnis | e0ne: Are you still working on this: https://specs.openstack.org/openstack/cinder-specs/specs/stein/generic-backup-implementation.html | 16:36 |
daikk115 | geguileo, but cinder did not allow to delete the first full(last week full backup)? | 16:36 |
e0ne | it's a day when I always agree with smcginnis | 16:36 |
smcginnis | :) | 16:36 |
jungleboyj | e0ne: Good place to be. | 16:36 |
geguileo | I think it's not too complicated if you are very familiar with the code, but complex otherwise, too many variables/options | 16:37 |
*** pcaruana|elisa| has quit IRC | 16:37 | |
e0ne | smcginnis: yep. I'll publish patches early next week to statr discussion | 16:37 |
jungleboyj | :-) | 16:37 |
geguileo | daikk115: you cannot delete it because you have dependent backups (the incremental ones) | 16:37 |
smcginnis | e0ne: Awesome! | 16:37 |
jungleboyj | e0ne: ++ | 16:37 |
e0ne | I rebased my old patch and split it into the chain | 16:37 |
smcginnis | Oh nice. | 16:38 |
daikk115 | geguileo, we should let new incremental backup know that it should be depend on last full backup not the first full is not | 16:38 |
geguileo | daikk115: once we fix the RBD problem and you can create full backups whenever you want, then you will be able to delete all incremental and the old full | 16:38 |
e0ne | need to test it more and clean up before publishing | 16:38 |
daikk115 | first full backup | 16:38 |
geguileo | daikk115: that's how it works right now! | 16:38 |
geguileo | daikk115: it's not based on the last full, but the last incremental | 16:38 |
geguileo | daikk115: in ALL backup drivers | 16:38 |
daikk115 | that is not real use case we have which smcginnis also know | 16:39 |
*** ttsiouts has quit IRC | 16:39 | |
geguileo | daikk115: I'm saying what we HAVE, not want you would like to have (aka your use case) | 16:39 |
*** ttsiouts has joined #openstack-meeting | 16:39 | |
geguileo | daikk115: if that's not the case, then it would be a bug in the RBD driver (because it would be doing differential instead of incremental) | 16:39 |
geguileo | and that's not what it used to do from the start, so it would have been changed at some point | 16:40 |
geguileo | unnitentionally | 16:40 |
smcginnis | daikk115: Let's get a spec written up that we can all read and make sure we're talking about the same solution. | 16:40 |
smcginnis | daikk115: And just to reiterate, it needs to be something that doesn't only apply to how ceph works. | 16:40 |
jungleboyj | I think that sounds like a good plan since this is not clear right now. | 16:40 |
jungleboyj | smcginnis: ++ | 16:40 |
geguileo | daikk115: sounds good | 16:40 |
geguileo | smcginnis: +1 | 16:41 |
daikk115 | smcginnis, the above link is not the same problem. | 16:41 |
smcginnis | What above link? | 16:41 |
jungleboyj | #action daikk115 To create a Spec for discussion. | 16:42 |
daikk115 | smcginnis, Oops, sorry, never mind | 16:42 |
daikk115 | jungleboyj, Ok, I will to that | 16:42 |
daikk115 | s/to/do | 16:42 |
enriquetaso | #info enriquetaso | 16:43 |
smcginnis | enriquetaso: You have been informed. :) | 16:43 |
jungleboyj | ? | 16:43 |
e0ne | :) | 16:43 |
smcginnis | jungleboyj: I think we can move on. | 16:43 |
jungleboyj | enriquetaso: Info | 16:43 |
daikk115 | ok :D thanks | 16:43 |
jungleboyj | With pleasure. | 16:43 |
enriquetaso | sorry, i'm late | 16:43 |
jungleboyj | enriquetaso: Ah. No problem. Welcome to the party. | 16:44 |
daikk115 | enriquetaso, hi | 16:44 |
*** ttsiouts has quit IRC | 16:44 | |
jungleboyj | @! | 16:44 |
_pewp_ | jungleboyj (◍˃̶ᗜ˂̶◍)ノ” | 16:44 |
jungleboyj | So, moving on. | 16:44 |
jungleboyj | #topic User Feedback Etherpad. | 16:45 |
*** openstack changes topic to "User Feedback Etherpad. (Meeting topic: Cinder)" | 16:45 | |
jungleboyj | Can anyone get to the etherpad right now> | 16:45 |
smcginnis | They just upgraded the instance I think. | 16:45 |
e0ne | #link https://etherpad.openstack.org/p/BER-Cinder_User_Survey_Responses | 16:46 |
jungleboyj | So, I have a cached copy here. So let me at least share what I did. | 16:46 |
daikk115 | jungleboyj, I can but quite slow | 16:46 |
jungleboyj | Ok. | 16:47 |
enriquetaso | hi daikk115 , geguileo thanks for discuss the incremental option for backups | 16:47 |
jungleboyj | So, I got the translated feedback for the user feedback survey from the Foundation. | 16:47 |
smcginnis | jungleboyj: Thanks for categorizing into common themes. That helps. | 16:47 |
geguileo | jungleboyj: I can't get to it, and the outing planning seems to have no content... r:-?? | 16:47 |
jungleboyj | geguileo: Correct at the moment. | 16:48 |
jungleboyj | smcginnis: You are welcome. | 16:48 |
geguileo | jungleboyj: OK, I can access now :-) | 16:48 |
geguileo | jungleboyj: thanks | 16:48 |
smcginnis | Infra is aware of the issue. | 16:48 |
jungleboyj | As smcginnis has idicated I looked through the feedback and documented the common themes for the comments. | 16:48 |
jungleboyj | Fell into 12 categories. | 16:48 |
jungleboyj | I have put some initial thoughts in there but given that all of you have expertise in different areas here I would appreciate all of you adding responses here. | 16:49 |
jungleboyj | What I am hoping is that we will get a good number of people in the forum summit session that maybe can help us understand the feedback given that it is so vague. | 16:50 |
*** gyee has quit IRC | 16:50 | |
jungleboyj | They want backup/disaster recovery improvements but they don't say what. | 16:50 |
jungleboyj | I think we have already addressed the question of automated backup processes. | 16:51 |
jungleboyj | I think all of the requests for multi-attach support is likely to be Ceph users. | 16:51 |
jungleboyj | That short-coming is being addressed. Correct? | 16:51 |
e0ne | jungleboy: we did. everybody can use mistral for such automation | 16:51 |
*** jgriffit1 is now known as jgriffith | 16:53 | |
jungleboyj | So, I think, looking at the list that we have a number of things in flight that address the comments. | 16:53 |
smcginnis | #link https://review.openstack.org/#/c/595827/ Ceph multiattach spec | 16:54 |
jungleboyj | If you know of details/patches/specs that apply to the comments please add them here so that we can be prepared to address comments/questions from anyone that makes it to the Forum Session. | 16:54 |
jungleboyj | smcginnis: Case in point. Thank you! | 16:54 |
jungleboyj | Wow. Now weird things happening in etherpad. | 16:55 |
jungleboyj | Anyone have anything else there they can update now? | 16:55 |
*** diablo_rojo has joined #openstack-meeting | 16:56 | |
smcginnis | Did we do read only multiattach? | 16:56 |
smcginnis | I remember that being something we were going to follow on the initial work to do, but I didn't think anything had been done yet. | 16:57 |
jungleboyj | smcginnis: Hmmm, you know. I think that is another things that we just talked about. | 16:57 |
jungleboyj | So, that one may be one that need to be given some priority. | 16:58 |
*** ash_williams is now known as ash_sawing | 16:59 | |
jungleboyj | Ok. Well. We have run out of time. | 16:59 |
smcginnis | Someone tell jgriffith he needs to work on multiattach some more. | 16:59 |
jungleboyj | Hope everyone has a safe and happy Halloween. | 16:59 |
jungleboyj | smcginnis: ++ | 16:59 |
jungleboyj | Thanks for joining the meeting and hope to talk to you all again next week! | 16:59 |
smcginnis | 🎃🎃🎃 | 16:59 |
jungleboyj | :-) | 17:00 |
daikk115 | see you :D | 17:00 |
jungleboyj | Thanks! | 17:00 |
jungleboyj | #endmeeting | 17:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
openstack | Meeting ended Wed Oct 31 17:00:23 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-10-31-16.01.html | 17:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-10-31-16.01.txt | 17:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-10-31-16.01.log.html | 17:00 |
*** jbernard has left #openstack-meeting | 17:01 | |
*** woojay has left #openstack-meeting | 17:01 | |
*** e0ne has quit IRC | 17:08 | |
*** walshh__ has joined #openstack-meeting | 17:08 | |
*** ganso has left #openstack-meeting | 17:09 | |
*** eharney has joined #openstack-meeting | 17:10 | |
*** Swami has joined #openstack-meeting | 17:12 | |
*** shrasool has joined #openstack-meeting | 17:22 | |
*** dustins has joined #openstack-meeting | 17:26 | |
*** Leo_m has quit IRC | 17:29 | |
*** shrasool has quit IRC | 17:33 | |
*** electrofelix has quit IRC | 17:38 | |
*** aojea has quit IRC | 17:40 | |
*** iyamahat has quit IRC | 17:42 | |
*** Leo_m has joined #openstack-meeting | 17:43 | |
*** gyee has joined #openstack-meeting | 17:44 | |
*** yamahata has quit IRC | 17:44 | |
*** sambetts is now known as sambetts|afk | 17:46 | |
*** a-pugachev has quit IRC | 17:53 | |
*** iyamahat has joined #openstack-meeting | 17:59 | |
*** walshh__ has quit IRC | 18:04 | |
*** ash_sawing has quit IRC | 18:07 | |
*** mriedem has joined #openstack-meeting | 18:11 | |
*** rosmaita has left #openstack-meeting | 18:11 | |
*** mriedem is now known as ash_williams | 18:11 | |
*** ralonsoh has quit IRC | 18:17 | |
*** yamahata has joined #openstack-meeting | 18:20 | |
*** cloudrancher has quit IRC | 18:23 | |
*** cloudrancher has joined #openstack-meeting | 18:23 | |
*** e0ne has joined #openstack-meeting | 18:31 | |
*** e0ne has quit IRC | 18:32 | |
*** psachin has quit IRC | 18:36 | |
*** tssurya has quit IRC | 18:39 | |
*** daikk115 has quit IRC | 18:42 | |
*** jamesmcarthur has quit IRC | 18:52 | |
*** jamesmcarthur has joined #openstack-meeting | 18:52 | |
*** jamesmcarthur has quit IRC | 18:57 | |
SotK | #startmeeting storyboard | 19:00 |
openstack | Meeting started Wed Oct 31 19:00:57 2018 UTC and is due to finish in 60 minutes. The chair is SotK. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:00 |
fungi | hey howdy! | 19:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
*** openstack changes topic to " (Meeting topic: storyboard)" | 19:01 | |
openstack | The meeting name has been set to 'storyboard' | 19:01 |
diablo_rojo | Hello! | 19:01 |
*** jamesmcarthur has joined #openstack-meeting | 19:01 | |
SotK | #link https://wiki.openstack.org/wiki/Meetings/StoryBoard#Agenda_for_next_meeting Agenda | 19:02 |
*** iyamahat has quit IRC | 19:02 | |
SotK | #topic Migration Updates | 19:02 |
*** openstack changes topic to "Migration Updates (Meeting topic: storyboard)" | 19:02 | |
SotK | any updates this week diablo_rojo? | 19:02 |
*** iyamahat has joined #openstack-meeting | 19:03 | |
* fungi hopes we're not keeping SotK from evening hallowe'en festivities | 19:03 | |
*** zaneb has quit IRC | 19:03 | |
diablo_rojo | Sadly not, just that I still haven't had time to dig into the LP API to figure why things are being cut short of the full migration | 19:04 |
diablo_rojo | Yeah we can make this quick | 19:04 |
fungi | full neutron migration, right | 19:04 |
diablo_rojo | Right | 19:04 |
clarkb | On the attachment spec I think it would be helpful for storyboard to describe the requirements it feels it has for this feature. Then we can build around that rather than going with whatever infra could do today. THis helps inform both directions of the needs and limitations I think. | 19:04 |
* fungi thinks clarkb is jumping ahead on the agenda ;) | 19:05 | |
* diablo_rojo thinks so too | 19:05 | |
clarkb | sorry | 19:05 |
diablo_rojo | Attachments are just so exciting :0 | 19:05 |
clarkb | (that was my update) | 19:05 |
clarkb | they are! | 19:06 |
SotK | diablo_rojo: no worries, I've also not had much time this week | 19:06 |
SotK | #topic Berlin | 19:07 |
*** openstack changes topic to "Berlin (Meeting topic: storyboard)" | 19:07 | |
clarkb | (I now see the topic was specifically migration updates) | 19:07 |
diablo_rojo | WRT the neutron migration, I am kind of prioritizing the attachment spec and moving that forward higher. Hence the lack of progress. | 19:07 |
diablo_rojo | clarkb, lol | 19:07 |
SotK | yeah that makes sense to me | 19:07 |
*** iyamahat_ has joined #openstack-meeting | 19:07 | |
diablo_rojo | Nothing new on the Berlin topic, just wanted to make sure those watching knew about it. | 19:08 |
*** iyamahat has quit IRC | 19:08 | |
*** jamesmcarthur has quit IRC | 19:08 | |
*** jamesmcarthur has joined #openstack-meeting | 19:09 | |
SotK | #topic Story Attachments | 19:09 |
*** openstack changes topic to "Story Attachments (Meeting topic: storyboard)" | 19:09 | |
diablo_rojo | I could send something to the ML telling people to bring last concerns to the Berlin forum session? | 19:09 |
diablo_rojo | Just a thought | 19:10 |
clarkb | diablo_rojo: ++ and remind them that storyboard will be there is probably worthwhile | 19:10 |
SotK | diablo_rojo: yep that sounds worthwhile | 19:10 |
* diablo_rojo adds that as a todo for today | 19:10 | |
diablo_rojo | Anywho, attachment things now :) | 19:11 |
fungi | so on the attachments spec, i feel like the actual requirements are fairly nominal/flexible, but a lot of that has to do with how we design the feature | 19:11 |
fungi | storage requirements i mean | 19:11 |
clarkb | ya I'm sure we can make something work. But I think it would be valuable to undersatnd how storyboard would like to see it work | 19:11 |
clarkb | Then see if the hosting can accomodate that (rather than the other way around) | 19:11 |
fungi | i'm also curious as to whether the comments i posted make sense, with regards to a simpler way to go about this security-wise | 19:12 |
diablo_rojo | fungi, it mostly made sense, I think I was failing to see how it was different than the undiscoverable URIs? | 19:12 |
fungi | if an attachment is only reachable by knowing its url which includes a uuid someone would have to guess or otherwise be provided, is that sufficiently secure? | 19:12 |
*** erlon has quit IRC | 19:13 | |
diablo_rojo | I would guess so? but I certainly am no security expert | 19:13 |
fungi | other parts of the spec described temporary urls and/or proxying all the content requests through storyboard | 19:13 |
SotK | I think the part I was misunderstanding from your idea was that the URL is determined at upload time and recorded in storyboard, rather than being generated on demand | 19:13 |
SotK | I think this way sounds much easier to implement | 19:13 |
SotK | but I don't really feel entirely qualified to comment on its security | 19:14 |
SotK | I don't see anything immediately wrong | 19:14 |
persia | One of the differences is that if there is a magic open URI, that can be pasted to e.g. IRC. Conversely, if control is managed by storyboard directly, pasting the URI doesn't disclose anything. Personally, I think having a separate storage system (with guessable UUIDs) is probably sufficiently secure for task tracking, but others may be more concerned. | 19:14 |
clarkb | The two big things seem to be controllable URIs and indexable content | 19:15 |
fungi | yeah, my take is that if someone can leak the persistent url to the attachment, then they can just as easily leak the contents of the attachment or other aspects of the private story anyway | 19:15 |
persia | What is the benefit of indexable content? | 19:15 |
clarkb | persia: you can store adsvertisements or similar that show up in google seraches | 19:15 |
persia | fungi: Absolutely. | 19:15 |
persia | clarkb: I consider that a detriment, but I can see the potential for abuse. | 19:16 |
clarkb | this is the sort of spamming we've seen on our wiki | 19:16 |
fungi | yeah, i think what clarkb means is we don't want them indexable. i mentioned some possible solutions to that as well | 19:16 |
persia | Has anyone asked #launchpad how they deal with the potential for spam? | 19:16 |
diablo_rojo | persia, I have not | 19:17 |
fungi | doesn't prevent someone from posting the url to an attachment somewhere else where it can then be indexed by a search engine i guess, but these days that's a less attractive prospect | 19:17 |
diablo_rojo | but that would be useful information | 19:17 |
fungi | basically if they already have somewhere unpoliced to post the url, then they'd just post the raw content there instead | 19:17 |
persia | My vague memory is that they have a policy and a means to delete things that seems to work. Dunno about volume of LP-hosted projects vs. OSF-hosted projects. | 19:17 |
fungi | that's what we saw happening with our wiki, fwiw | 19:18 |
*** iyamahat_ has quit IRC | 19:18 | |
diablo_rojo | fungi, posting advertisemnets or logs of things? | 19:19 |
fungi | i do agree with clarkb that it's something we should keep an eye out for, and don't think it should really factor too much into the design | 19:19 |
fungi | diablo_rojo: these days it's mostly people posting urls to scams or phone numbers for the same | 19:19 |
diablo_rojo | Got it. | 19:19 |
fungi | so that when you google "miscrosoft office support" you get friendly results for a phone number to call where they'll take your credit card info | 19:20 |
clarkb | fungi: from the design side if say swift publicly served content doesn't allow you to not index (or alternatively index at all) that is something that should factor in? I agree ti shouldn't be the main consideration, just another thing to check when considering options | 19:20 |
fungi | yes, if the object store conveniently provides a public index to all content you serve from it, that would be something to discount it | 19:21 |
fungi | i don't think swift forces a public index of your objects, for precisely this reason | 19:21 |
diablo_rojo | Something we don't want. | 19:21 |
fungi | basically, under my suggested design, we would want storyboard to privately maintain its index of (persistent public) object urls, and would not want the object store to serve an index of those | 19:22 |
clarkb | fungi: makes sense to me | 19:23 |
fungi | we also would want to be sure said urls couldn't be enumerated in any achievable amount of time | 19:23 |
*** diablo_rojo_phon has joined #openstack-meeting | 19:23 | |
fungi | by someone who lacks access to that index | 19:23 |
* SotK thinks that this sounds like the best solution of the ones that have been suggested | 19:24 | |
persia | Indeed | 19:24 |
fungi | anyway, i didn't want to monopolize the discussion, just want to be sure we don't go off overengineering complex solutions where simpler ones are possible | 19:24 |
clarkb | ++ | 19:25 |
*** ash_williams is now known as mriedem_away | 19:25 | |
diablo_rojo_phon | Lost connection on laptop. But I'll go back through meeting logs and get the spec updated with this approach. | 19:25 |
fungi | thanks diablo_rojo_phon! and i hope your laptop didn't have too much candu | 19:25 |
fungi | candy | 19:25 |
SotK | makes sense, I don't really see any worthwhile benefit to the more complicated suggestions I noted now | 19:25 |
diablo_rojo_phon | I had most comments addressed aside from this section so I should have it up today ish. | 19:26 |
SotK | nice, thanks :) | 19:26 |
*** diablo_rojo has quit IRC | 19:26 | |
fungi | my old life as a security wonk mostly involved reminding people that complex security solutions are really just increased opportunities for vulnerabilities | 19:26 |
diablo_rojo_phon | Maintenance is in my apartment and flipped the breakers so I haz no internets. | 19:27 |
*** erlon has joined #openstack-meeting | 19:27 | |
SotK | I think that basically covers attachments then | 19:27 |
SotK | #topic In Progress Work | 19:27 |
*** openstack changes topic to "In Progress Work (Meeting topic: storyboard)" | 19:27 | |
diablo_rojo_phon | Cool :) | 19:28 |
fungi | and you're sure these aren't neighborhood hooligans disguised as maintenance workers? | 19:28 |
diablo_rojo_phon | fungi: pretty sure since he's fixed a bunch of other things in the apartment previously | 19:28 |
diablo_rojo_phon | I have two patches that could use reviews. | 19:28 |
persia | It's a long con then? | 19:28 |
fungi | offer candy anyway | 19:28 |
clarkb | could be a really good costume | 19:29 |
diablo_rojo_phon | High level of dedication just to flip my breakers. | 19:29 |
* SotK failed to get anywhere with his backlog of reviews to do, I'll attempt to get to them this week | 19:29 | |
* diablo_rojo_phon doesn't have any candy in the apartment | 19:29 | |
fungi | i only managed to review the attachments spec, fwiw | 19:30 |
fungi | diablo_rojo_phon: shots then? | 19:30 |
diablo_rojo_phon | Thanks SotK :) We are all juggling a lot of stuff so we understand | 19:30 |
diablo_rojo_phon | fungi: could do that, there's no shortage of alcohol here lol | 19:30 |
fungi | when i lived in raleigh, there was a townhouse of russians across the street who always set up a bar in their driveway and served vodka shots to the parents taking their kids around | 19:30 |
fungi | it was pretty awesome | 19:31 |
diablo_rojo_phon | That is excellent. | 19:31 |
diablo_rojo_phon | SotK: I don't think I got around to reviewing your patch either so I guess it's only fair lol | 19:31 |
SotK | ha, that's a great idea | 19:31 |
SotK | I don't think I have enough alcohol around to do it though | 19:32 |
SotK | diablo_rojo_phon: no worries :) | 19:32 |
SotK | I think folk have mostly learnt the workaround for the bug that patch fixes at this point | 19:32 |
* diablo_rojo_phon thought about sharing a photo and decided that proof doesn't need to exist on the internet. | 19:32 | |
SotK | or at least, I've not noticed anyone complain recently | 19:32 |
diablo_rojo_phon | Still nice to get it fixed SotK :) | 19:33 |
SotK | indeed | 19:33 |
*** erlon has quit IRC | 19:35 | |
diablo_rojo_phon | Was someone investigating what happened with fatema's patch? | 19:35 |
SotK | I was going to but also didn't get around to that | 19:35 |
diablo_rojo_phon | What say we end early to do some of these things? | 19:36 |
diablo_rojo_phon | Unless someone else has something to talk about? | 19:36 |
SotK | sounds good to me | 19:37 |
SotK | I don't have anything else | 19:37 |
fungi | i'll review some storyboard changes | 19:37 |
diablo_rojo_phon | Oh! clarkb is there gonna be an infra dinner at the summit? | 19:37 |
diablo_rojo_phon | fungi: much appreciated! | 19:37 |
clarkb | diablo_rojo_phon: I haven't put together one | 19:39 |
clarkb | I guess I can take a look. Mostly its a huge pain to figure out reservations for a large group and half the time they want a deposit | 19:40 |
clarkb | Denver is easy because beer garden and nice weather. Berlin probably has the beer gardens but not the nice weather | 19:40 |
fungi | berlin doesn't seem to have actively staffed biergartens in november | 19:41 |
fungi | you need a bierstube instead, and seating will be more complicated | 19:41 |
clarkb | We can probably do an informal thing? I expect a smaller but also differentish group (frickler and ajaeger but no paul or david or robyn etc) | 19:41 |
clarkb | I'll send out an email trying to schedule an informal thing with the expectation that different tables/locations may happen | 19:42 |
clarkb | I think that is easiest | 19:42 |
fungi | we can say "everybody meet at $venue and we can try to get tables nearish to each other" | 19:42 |
clarkb | ++ | 19:42 |
fungi | but not actually organize anything | 19:42 |
diablo_rojo_phon | That works. | 19:43 |
*** jamesmcarthur has quit IRC | 19:44 | |
*** e0ne has joined #openstack-meeting | 19:44 | |
*** jamesmcarthur has joined #openstack-meeting | 19:45 | |
*** e0ne has quit IRC | 19:45 | |
*** diablo_rojo has joined #openstack-meeting | 19:45 | |
*** awaugama has quit IRC | 19:46 | |
SotK | ok, lets end the meeting | 19:47 |
SotK | thanks for coming folks :) | 19:47 |
SotK | #endmeeting | 19:47 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:47 | |
openstack | Meeting ended Wed Oct 31 19:47:21 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:47 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/storyboard/2018/storyboard.2018-10-31-19.00.html | 19:47 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/storyboard/2018/storyboard.2018-10-31-19.00.txt | 19:47 |
openstack | Log: http://eavesdrop.openstack.org/meetings/storyboard/2018/storyboard.2018-10-31-19.00.log.html | 19:47 |
diablo_rojo | Thanks SotK! | 19:47 |
fungi | thanks for chairing, SotK! | 19:47 |
clarkb | I found a 100% vegan brew pub | 19:48 |
clarkb | https://vaust.berlin/ if that helps anyone with food while in berlin | 19:48 |
diablo_rojo | clarkb, should probably tell hogepodge | 19:50 |
*** apetrich has quit IRC | 19:50 | |
*** erlon has joined #openstack-meeting | 19:51 | |
*** raildo has quit IRC | 19:53 | |
*** iyamahat_ has joined #openstack-meeting | 20:02 | |
*** apetrich has joined #openstack-meeting | 20:04 | |
hogepodge | ? | 20:09 |
clarkb | hogepodge: https://vaust.berlin/ vegan brewpub thing in berlin | 20:09 |
*** apetrich has quit IRC | 20:14 | |
*** liuyulong has quit IRC | 20:18 | |
*** raildo has joined #openstack-meeting | 20:22 | |
*** raildo has quit IRC | 20:22 | |
*** jamesmcarthur has quit IRC | 20:24 | |
*** e0ne has joined #openstack-meeting | 20:30 | |
*** imacdonn has quit IRC | 20:34 | |
*** imacdonn has joined #openstack-meeting | 20:34 | |
*** jamesmcarthur has joined #openstack-meeting | 20:38 | |
*** jamesmcarthur has quit IRC | 20:43 | |
*** e0ne has quit IRC | 20:50 | |
*** timburke has joined #openstack-meeting | 20:50 | |
*** shrasool has joined #openstack-meeting | 20:58 | |
*** patchbot has joined #openstack-meeting | 20:59 | |
notmyname | swift team meeting time | 20:59 |
notmyname | #startmeeting swift | 20:59 |
openstack | Meeting started Wed Oct 31 20:59:56 2018 UTC and is due to finish in 60 minutes. The chair is notmyname. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:59 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 20:59 |
*** openstack changes topic to " (Meeting topic: swift)" | 20:59 | |
openstack | The meeting name has been set to 'swift' | 21:00 |
notmyname | who's here for the swift team meeting? | 21:00 |
mattoliverau | o/ | 21:00 |
timburke | o/ | 21:00 |
kota_ | hi | 21:00 |
*** zaneb has joined #openstack-meeting | 21:00 | |
rledisez | o/ | 21:00 |
notmyname | welcome zaneb | 21:00 |
zaneb | o/ | 21:00 |
notmyname | clayg: tdasilva: ping | 21:00 |
clayg | ohai! | 21:01 |
tdasilva | hello! | 21:01 |
notmyname | zaneb: glad you could make it. do you have any particular schedule restrictions? (leaving early, etc) | 21:01 |
notmyname | agenda this week is at... | 21:01 |
notmyname | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
zaneb | notmyname: nope, I can be here for the duration | 21:01 |
notmyname | "normal" stuff, but the main topic is the tc vision proposal that zane is championing | 21:02 |
notmyname | zaneb: great! | 21:02 |
notmyname | #topic tc vision document | 21:02 |
*** openstack changes topic to "tc vision document (Meeting topic: swift)" | 21:02 | |
notmyname | #link http://lists.openstack.org/pipermail/openstack-dev/2018-October/136031.html | 21:02 |
notmyname | #link https://review.openstack.org/#/c/592205/ | 21:03 |
patchbot | patch 592205 - governance - [DRAFT] Add a Technical Vision statement - 4 patch sets | 21:03 |
notmyname | ok, so the first question is "who actually read it?" :-) | 21:03 |
zaneb | :D | 21:03 |
clayg | I skimmed it - but then I wanted to start making comments - so I stopped | 21:03 |
timburke | i read... some of it, anyway | 21:03 |
kota_ | :P | 21:03 |
clayg | the patch seemed fine, but then people start talking - it makes me want to drink | 21:04 |
notmyname | heh | 21:04 |
notmyname | I think the frustrating part of this kind of thing is that it is very meta. it's not about solving problems; it's for solving problems about how we solve problems. | 21:04 |
clayg | some people are better at that sort of thing | 21:04 |
timburke | i remember thinking "event notifications where appropriate" could use some fleshing out -- that's definitely something that swift's been interested in, but it's hard | 21:04 |
notmyname | rledisez: tdasilva: kota_: did you get a chance to read it? | 21:05 |
timburke | Bidirectional Compatibility seemed to be stepping outside of the service-only purview | 21:05 |
timburke | it's on the client to figure out how to maintain compatibility with older services, just as it's on the services to figure out how to maintain compat with older clients | 21:05 |
kota_ | briefly, not get in detail. | 21:05 |
rledisez | notmyname: not really, I'm going through it right now briefly | 21:05 |
notmyname | ok | 21:05 |
zaneb | timburke: it does apply to some stuff like Heat and Mistral on the service side | 21:05 |
notmyname | here's my summary ( zaneb, please correct me if I get things grossly wrong) | 21:06 |
notmyname | tc want's to write down some guidelines used for defining the "in" and "out" for openstack. it's doing this by describing and defining basic things about cloud infrastructure and then declaring them to be in scope for openstack. so that if project x shows how they match one or more of these basic principles, they are then in scope for being in openstack | 21:06 |
timburke | felt like fault-tolerance/high-availability might be another good pillar (and just so happens to be something we're good at ;-) | 21:06 |
zaneb | timburke: and arguably to e.g. microversions and stuff in APIs | 21:06 |
notmyname | swift often has a different perspective on openstack because we pioneered "independently deployable" and also have a data-centric API (instead of provisioning). this document describes several cloud principles that swift does, so zane says this should finally put that debate to bed | 21:06 |
*** shrasool has quit IRC | 21:07 | |
notmyname | zaneb: is that about right? maybe my understanding of the overall purpose is more limited than you have in mind | 21:07 |
zaneb | notmyname: that's a fair summary, although there are other reasons for doing it also | 21:07 |
notmyname | yes. please share :-) | 21:07 |
zaneb | one is, as you said, that the TC currently has no standard for judging which projects should be allowed to join, and it's a pain point for us | 21:08 |
zaneb | but another is that we want to give projects something they can refer to when making design decisions | 21:08 |
mattoliverau | I've skimmed it, seems notmyname you've had some interesting discussions in gerrit about some definitions | 21:08 |
notmyname | mattoliverau: I tried to avoid the biggest traps, I think :-) | 21:09 |
zaneb | and a lot of that stuff have previously only been at the level of folklore that people picked up by osmosis, if at all | 21:09 |
notmyname | zaneb: meaning that if eg we have a new feature we are designing, we could compare it against this list to see if it's good or bad? | 21:09 |
notmyname | well, appropriate or not | 21:09 |
zaneb | and it'd be nice to have a kind of framework within which the services sit so that the people independently designing them eventually produce something coherent | 21:10 |
notmyname | that last thing sounds terrific. design a system so that independent parties converge on a cohesive whole. (also sounds really hard) | 21:10 |
zaneb | yes, really hard to get it happen on purpose, but absolutely not going to happen by accident :) | 21:11 |
clayg | ^ that's rich | 21:11 |
timburke | designing converging systems in general is hard -- see our troubles with replication, dark data, and ghost listings :P | 21:11 |
notmyname | zaneb: so are you thinking this document will guide (or advise) feature development? | 21:12 |
timburke | it's even worse when the system's made up of people instead of programs | 21:12 |
zaneb | notmyname: to some extent, yes, but to different degrees for different projects | 21:12 |
zaneb | and a lot of it is stuff that we old-timers already know, but hadn't written down in one place | 21:13 |
notmyname | TBH I'm struggling with ... well, I'm struggling with how to express my thoughts via text chat :-) | 21:13 |
mattoliverau | meme? interpritive dance? | 21:14 |
notmyname | lol | 21:14 |
clayg | lol | 21:14 |
zaneb | one thing I personally would love to get is events out of every service. imagine if we'd had Storlets but for everything 5 years ago - we'd have invented Lambda before AWS did | 21:15 |
notmyname | I'm very concerned when someone starts defining boundries in the openstack ecosystem, because swift has oftentimes been put in the "other" group. that's why I pay attention to these sorts for discussions. but on the other hand, it's hard to see how it matters on an ongoing day-to-day basis | 21:16 |
clayg | I think that might be baggage - I feel more in-crowd cool kids these days | 21:16 |
notmyname | clayg: it totally could be | 21:17 |
zaneb | fwiw I think everyone else has a lot to learn from Swift, and allowing it to be defined as 'other' has prevented the rest of OpenStack from doing that as much as we should | 21:17 |
zaneb | so as I said in the email, I hope drawing the boundary where it is in this doc will help people to *stop* seeing Swift as 'other' | 21:18 |
clayg | :hugs: | 21:18 |
notmyname | clayg: that's the emoji thing I'm looking for! :-) | 21:19 |
clayg | zaneb: what would be most helpful from "us" (and by us I mostly mean other people besides me) | 21:19 |
clayg | ... but especially from notmyname :P | 21:19 |
clayg | :hugs: | 21:19 |
notmyname | heh | 21:19 |
zaneb | lol | 21:19 |
clayg | mattoliverau! mattoliverau is helpful | 21:20 |
mattoliverau | lol | 21:20 |
kota_ | lol | 21:20 |
* notmyname waits for zaneb before asking more questions | 21:20 | |
zaneb | the most helpful thing for me is people engaging with the review, because in the end this will be successful if people feel like we all came up with it together, and it's not something handed down from the TC | 21:21 |
notmyname | zaneb: the outreach you're doing to specific projects in great. thank you | 21:22 |
zaneb | if I start typing gibberish, it's because a miniature human is attacking the keyboard | 21:22 |
zaneb | I mean, more gibberish than usual | 21:22 |
notmyname | clayg: timburke: you both said you had some comments but help back from posting them | 21:22 |
notmyname | were they about the doc in general, any specifics in it, or just the commentary about the doc? | 21:23 |
mattoliverau | lol | 21:23 |
clayg | notmyname: honestly 9/10 of my "comments" were "hell, yeah!" the others were like "no YOU'RE WRONG, this is good." | 21:23 |
clayg | I'm paraphrasing | 21:24 |
zaneb | lol | 21:24 |
timburke | i think mostly just the comments i made here. seemed like actually posting would mostly add more noise (to what will definitely be a noisy review) rather than help, but i could be wrong | 21:25 |
zaneb | timburke: you mentioned fleshing out the 'event notifications where appropriate' - would be very interested in what sort of stuff you'd like to see there | 21:25 |
timburke | mostly just what "where appropriate" means | 21:26 |
timburke | because i honestly don't know where the appropriate line would be in swift | 21:26 |
notmyname | timburke: in my experience with openstack, it's very good to have noisy reviews early in order to get a right version of the doc from the start (but like clayg, that may be my own historic baggage) | 21:26 |
zaneb | that section is kind of toned down because that is TOTALLY MY HOBBY HORSE and I would write the whole thing about just that if I could ;) | 21:26 |
timburke | "on every swift operation" feels *incredibly* noisy, like we'd almost certainly cause whatever message queue we're putting those notifications in to fall over | 21:27 |
*** dkrol has quit IRC | 21:27 | |
clayg | TIL https://en.wikipedia.org/wiki/Hobby_horse#Other_meanings | 21:27 |
zaneb | clayg: it's fortunate that didn't take a much darker turn :D | 21:28 |
*** mhen has quit IRC | 21:28 | |
zaneb | timburke: maybe we should let users filter at the source? | 21:29 |
notmyname | zaneb: do you think this document will take a turn towards more "provisioning-only" language? one commenter seemed to want to move it in that direction | 21:29 |
timburke | notmyname: i was noticing that too... | 21:29 |
zaneb | notmyname: by that you mean just-Nova-providing-a-VPS? | 21:30 |
zaneb | aka the "free VMWare" model? | 21:30 |
notmyname | more generally, like "you ask openstack to give you resources that you can then use directly" | 21:30 |
zaneb | oh, ok | 21:31 |
notmyname | I have two general concerns with things that try to define openstack. the first is provisioning vs "data-plane" api disctinctions. the second is a focus on compute-only or compute-first language | 21:31 |
*** mhen has joined #openstack-meeting | 21:33 | |
clayg | ... so many half typed sentences ... | 21:33 |
zaneb | imo there's such a mixture of different things that it's never going to make sense to say openstack is control-plane-only | 21:33 |
notmyname | lol | 21:33 |
clayg | I actually need to cut out (happy halloween everybody!) | 21:33 |
kota_ | lol | 21:33 |
timburke | notmyname: yeah, i kinda want to point kevin at https://governance.openstack.org/tc/reference/principles.html#openstack-primarily-produces-software and say that while others may reimplement the swift protocol (we have no control over that, they can make their own decisions), that's not Swift | 21:33 |
clayg | +1 to everything zaneb says | 21:33 |
notmyname | clayg: thanks for joining while you could. I definitely appreciate your comments and perspective | 21:34 |
clayg | notmyname: was there anything else on the agenda? | 21:34 |
clayg | rledisez: ohai!? | 21:34 |
clayg | I'll read the logs | 21:34 |
zaneb | that comment from Kevin was interesting food for thought, but I don't think it's going to change the direction of the document in any major way | 21:34 |
notmyname | clayg: nah, jsut "normal" stuff like "go land the s3api patches" and review losf :-) | 21:34 |
clayg | k | 21:34 |
clayg | l8r | 21:35 |
zaneb | clayg: thanks o/ | 21:35 |
rledisez | clayg: ohai??? | 21:35 |
notmyname | kota_: rledisez: what do you think about this doc (or this discussion)? we haven't heard from you yet | 21:35 |
timburke | rledisez: don't worry, i speak clayg. "oh, hi there!" and in this particular context, "sorry we couldn't chat" | 21:36 |
rledisez | so, i just read it. it is interesting, i'm not sure i see how it could drive everydays decissions about feature/implementation. if we need something, will we really restict ourself to what this document allow? | 21:37 |
rledisez | timburke: thx for the translation :D | 21:37 |
kota_ | notmyname: i have (probably) same concerns with you on the definition of the openstack because swift provides data-centric apis. | 21:37 |
notmyname | rledisez: yeah, I completely agree about the feature development influence | 21:37 |
kota_ | and also, Storlets does... | 21:37 |
notmyname | kota_: yeah. did you notice anything that gives you concern? | 21:38 |
rledisez | notmyname: but I like the turn it takes about the place of Swift inside Openstack | 21:38 |
kota_ | just a guideline could be fine but if it'll be restriction, I could not sure I could follow it, maybe? | 21:38 |
notmyname | kota_: from what I understand of it, and from what zaneb has said, I do not expect there to be any definitions that turn in to "data-centric is bad" | 21:39 |
kota_ | notmyname: ok, | 21:39 |
zaneb | as far as features in Swift go, I'd be most interested in hearing if the things documented are consistent with the decisions about features you've made in the *past*, so we can hand the knowledge on to some of the newer teams | 21:40 |
kota_ | thanks for clarification. | 21:40 |
notmyname | zaneb: ah, yes, that cuts to the chase | 21:40 |
kota_ | zaneb: that sounds nice | 21:41 |
notmyname | zaneb: I question some of the "hardware virtualization" section. it mentions storage, but what we do with object storage is sortof hard to fit into a "storage virtualization" world. at least much harder than cinder | 21:41 |
zaneb | notmyname: that reminds me, we should discuss you comment about regions, but not sure if this is the time | 21:41 |
notmyname | zaneb: sure. we can discuss the regions in the review, I think. it doesn't seem like a major issue to me | 21:41 |
zaneb | ok | 21:41 |
zaneb | notmyname: IMHO hardware virtualisation is necessary for a cloud, but it also tends to scale in coarse-grained ways (from the application perspective) | 21:42 |
zaneb | so we need both that and things like Swift that provide more fine-grained scaling | 21:43 |
mattoliverau | yeah, just the term regions means different things in Swift and keystone, they can fit together depending on your deployment topology but doesn't have to. We need a venn diagram :P Just like Swift containers and containers (though they don't overlap at all) :P | 21:44 |
notmyname | yeah. the HW virtualization works well in the "free vmware" mindset. but swift (object storage) is really more about not thinking about hardware at all (from the app perspective). and that normally means the service is runnign on bare metal | 21:44 |
kota_ | i think it depends on the definition. IMO Swift API virtualized actual hardware and data placement. | 21:44 |
kota_ | we could assume. | 21:44 |
notmyname | kota_: yeah :-). I think the definition is vague enough that we could make what swift does fit in to it. swift abstracts hard drives. you can swap them out and everything just keeps working. | 21:45 |
timburke | notmyname: i think that whole section doesn't really apply, because we don't | 21:45 |
timburke | have a service "provided by a specialised piece of hardware" | 21:45 |
zaneb | kota_: you could say that about almost anything ;) | 21:45 |
notmyname | "a hard drive" | 21:45 |
clayg | Lol @ tburke is my opposite of Obama’s “Luther” | 21:46 |
zaneb | my 2c: they're separate things; we need both in OpenStack | 21:46 |
notmyname | zaneb: I'm not really sure what to do next. my summary of what we've said in here is that most people are mostly ok with it (or at least not too concerned about the current version). we have some smaller wording questions, but nothing that's very troubling | 21:47 |
notmyname | zaneb: so to repeat what clayg said earlier, what do you need from us now? have we given you anything that will help you? do we need to do something else? | 21:47 |
notmyname | based on the comments from the rest of the team, I'm ok with putting my own +1 on it as a swift representative. | 21:48 |
zaneb | comments on the review if you have changes to be addressed would be great | 21:48 |
zaneb | there will be another patchset coming soon, but +1s on that would be great | 21:49 |
notmyname | ok. I'll wait until the next patchset | 21:49 |
zaneb | we have a Forum session at the summit, so hoping to get folks along to that to discuss where we're at and what we need to do to finalise it | 21:49 |
* kota_ will be there. | 21:50 | |
notmyname | ok. I'll look for that on the schedule | 21:50 |
notmyname | (my time in berlin is a bit limited) | 21:50 |
*** rbudden has quit IRC | 21:50 | |
zaneb | #link https://www.openstack.org/summit/berlin-2018/summit-schedule/events/22818/vision-for-openstack-clouds-discussion | 21:50 |
notmyname | ok, last few minutes (thanks for being patient with a longer meeting this week) | 21:51 |
zaneb | really appreciate everyone's input, thank you! | 21:51 |
notmyname | zaneb: thank you for taking the time to specifically ask us about this doc | 21:51 |
notmyname | #topic other topics | 21:51 |
*** openstack changes topic to "other topics (Meeting topic: swift)" | 21:51 | |
notmyname | #link https://wiki.openstack.org/wiki/Swift/PriorityReviews | 21:52 |
notmyname | priority reviews page is looking pretty similar to where it's been | 21:52 |
mattoliverau | thanks zaneb for coming, listening and taking the time, great work on the vision work | 21:52 |
notmyname | timburke: I'm wondering about the s3api patches. I'd really like to land them soon. maybe if we threaten to jsut land them then maybe mattoliverau and kota_ will look at them? ;-) | 21:53 |
zaneb | mattoliverau: my pleasure, thanks! | 21:53 |
notmyname | rledisez: I saw new patches (or patch sets) from alex about losf? | 21:53 |
*** erlon has quit IRC | 21:53 | |
zaitcev | timburke was doing such a good job adapting proxy that at one point got my manager to write down a working py3 proxy as a checkpoint on 10/10. But now he's away doing god knows what that Swiftstack needs more... Like completely random things. | 21:53 |
kota_ | it looks 3 patches are remaining | 21:54 |
kota_ | for s3api in prioriry | 21:54 |
notmyname | kota_: yeah | 21:54 |
mattoliverau | Yeah, sorry, I've joined a new virtual team (happens every 6 months or so) so been busy ramping up. So haven't been reviewing as much as I should. I'll make sure I find work time to devote to more reivews :) | 21:54 |
timburke | notmyname: merge 'em all! | 21:54 |
notmyname | :-) | 21:54 |
rledisez | notmyname: maybe, tbh i was not focused on that. but as tim said, "merge 'em all!" | 21:54 |
timburke | zaitcev: i think we *are* really close to a working py3 proxy (at least for some requests?) | 21:55 |
*** eharney has quit IRC | 21:55 | |
timburke | having tests that verify that will be interesting, though :-/ | 21:55 |
kota_ | i think I could look at 2 patches w/o patch 592231 but only 592231 is still not sure it goes fine way... | 21:56 |
patchbot | https://review.openstack.org/#/c/592231/ - swift - s3api: Include '-' in S3 ETags of normal SLOs - 3 patch sets | 21:56 |
kota_ | i'd like to get another person's opinion for that | 21:56 |
notmyname | kota_: ok. could you leave a comment with your concerns or questions in gerrit? right now only tdasilva is on it | 21:57 |
notmyname | so between the two of you, maybe we can get it landed quickly | 21:57 |
kota_ | and sorry of my slow pace for the reviews, various things goes in work and private... | 21:58 |
kota_ | notmyname: ok | 21:58 |
notmyname | kota_: do not worry. I completely understand | 21:58 |
*** apetrich has joined #openstack-meeting | 21:58 | |
notmyname | zaitcev: I also wanted to say thanks for your py3 work. it's often tedious and thankless and hard to see progress, but as you know it's important. so thanks for working on it | 21:59 |
notmyname | zaitcev: also, good luck with IBM :-) | 21:59 |
mattoliverau | ^ +100 to both these things | 22:00 |
zaitcev | notmyname: I'm quite interested in IBM's public cloud, they have some storage running in there. Not sure if it's Swift or not. | 22:00 |
notmyname | zaitcev: the softlayer stuff is still, I think. eveything else is cleversafe (spectrum scale is the name now, i think) | 22:00 |
notmyname | ok, we're at full time | 22:00 |
mattoliverau | and I guess thats time. | 22:00 |
notmyname | thanks for coming today | 22:01 |
notmyname | thanks for working through the tc doc | 22:01 |
notmyname | and thanks for your work on swift! | 22:01 |
notmyname | #endmeeting | 22:01 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:01 | |
openstack | Meeting ended Wed Oct 31 22:01:22 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:01 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-10-31-20.59.html | 22:01 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-10-31-20.59.txt | 22:01 |
openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-10-31-20.59.log.html | 22:01 |
*** zaitcev has left #openstack-meeting | 22:01 | |
*** patchbot has left #openstack-meeting | 22:01 | |
*** timburke has left #openstack-meeting | 22:01 | |
*** jamesmcarthur has joined #openstack-meeting | 22:16 | |
*** dustins has quit IRC | 22:17 | |
*** diablo_rojo has quit IRC | 22:18 | |
*** gyee has quit IRC | 22:19 | |
*** jamesmcarthur has quit IRC | 22:21 | |
*** ykatabam has joined #openstack-meeting | 22:26 | |
*** mriedem_away has quit IRC | 22:44 | |
*** diablo_rojo has joined #openstack-meeting | 22:50 | |
*** erlon has joined #openstack-meeting | 22:59 | |
*** erlon has quit IRC | 23:04 | |
*** hongbin has quit IRC | 23:06 | |
*** _alastor_ has quit IRC | 23:06 | |
*** erlon has joined #openstack-meeting | 23:19 | |
*** tpsilva has quit IRC | 23:22 | |
*** ianychoi has joined #openstack-meeting | 23:35 | |
*** diablo_rojo has quit IRC | 23:45 | |
*** Swami has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!