| *** dschroeder has quit IRC | 00:38 | |
| *** c00281451 is now known as chenzeng | 02:18 | |
| *** sputnik13 has quit IRC | 02:32 | |
| *** zhonghua-lee has quit IRC | 04:23 | |
| *** zhonghua-lee has joined #openstack-freezer | 04:24 | |
| *** reldan has quit IRC | 08:55 | |
| *** reldan has joined #openstack-freezer | 09:05 | |
| *** smekel has quit IRC | 09:17 | |
| *** reldan has quit IRC | 09:20 | |
| *** smekel has joined #openstack-freezer | 09:39 | |
| *** zhonghua-lee has quit IRC | 09:44 | |
| *** zhonghua-lee has joined #openstack-freezer | 09:45 | |
| *** openstackgerrit has quit IRC | 09:47 | |
| *** openstackgerrit has joined #openstack-freezer | 09:48 | |
| *** reldan has joined #openstack-freezer | 09:52 | |
| *** vannif has quit IRC | 09:55 | |
| *** vannif has joined #openstack-freezer | 11:08 | |
| *** zhonghua-lee has quit IRC | 11:14 | |
| *** zhonghua-lee has joined #openstack-freezer | 11:15 | |
| *** reldan has quit IRC | 11:29 | |
| *** smekel has quit IRC | 11:41 | |
| *** smekel has joined #openstack-freezer | 11:43 | |
| *** reldan has joined #openstack-freezer | 12:03 | |
| *** daemontool has joined #openstack-freezer | 13:09 | |
| daemontool | Morning | 13:10 |
|---|---|---|
| daemontool | reldan: any update on https://review.openstack.org/#/c/247840/ ? | 13:11 |
| reldan | daemontool: Works great for me | 13:19 |
| reldan | Please try yourself | 13:19 |
| reldan | And if it works for you - let’s just merge without additional checks | 13:19 |
| reldan | It already waits for 1 months | 13:19 |
| *** smekel has quit IRC | 13:26 | |
| *** smekel has joined #openstack-freezer | 13:26 | |
| daemontool | reldan: can you do the tests with Slashme and see what his not working on his side? | 13:27 |
| daemontool | I'd like to merge it asap | 13:28 |
| daemontool | so we can branch liberty | 13:28 |
| reldan | You can see the bug - it seems problem with rights or something like that, ssh cannot make listdir on dir | 13:28 |
| daemontool | we need to do that asap but we need to understand | 13:28 |
| daemontool | if that works now | 13:29 |
| daemontool | ok | 13:29 |
| daemontool | Slashme: do you agree with that? | 13:29 |
| reldan | https://bugs.launchpad.net/freezer/+bug/1525322 | 13:29 |
| openstack | Launchpad bug 1525322 in Freezer "SSH storage is broken" [High,Confirmed] | 13:29 |
| daemontool | yes | 13:29 |
| reldan | It invokes return self.ftp.listdir(directory) | 13:29 |
| reldan | and then exception inside paramiko | 13:29 |
| reldan | IOError: [Errno 2] No such file | 13:30 |
| reldan | if directory is correct - then it may be 1) Bug in paramiko 2) Problem with rights | 13:30 |
| reldan | There may be a problem with restore - but I have fixed it recently | 13:31 |
| daemontool | ok | 13:31 |
| daemontool | reldan: is Pierre there? | 13:31 |
| vannif | not atm, but he's around | 13:32 |
| reldan | Daemontool: test please on your environement | 13:32 |
| reldan | It contains conf file | 13:32 |
| reldan | https://bugs.launchpad.net/freezer/+bug/1525322 | 13:32 |
| openstack | Launchpad bug 1525322 in Freezer "SSH storage is broken" [High,Confirmed] | 13:32 |
| reldan | Probably I’m wrong | 13:32 |
| daemontool | reldan: yes | 13:32 |
| *** smekel_ has joined #openstack-freezer | 13:35 | |
| daemontool | vannif: there's anything you are working on atm? | 13:42 |
| vannif | backup cinder volumes | 13:42 |
| daemontool | ok | 13:44 |
| vannif | but I'd like to go back on the code as well. I need some time to dwelve into the parallel storages code | 13:44 |
| daemontool | ok | 13:44 |
| daemontool | today during the meeting we'll about this | 13:44 |
| daemontool | reldan: I can dedicate 2 hours today to test the parallel code | 13:45 |
| reldan | daemontool: Great, thank you. I will test it today as well. I actualy wanted to get this pull request mergest quickly. And then propose improvements. But now we stuch at the first part | 13:46 |
| *** daemontool has quit IRC | 14:02 | |
| *** smekel_ has quit IRC | 15:03 | |
| *** daemontool has joined #openstack-freezer | 15:27 | |
| *** pennerc has joined #openstack-freezer | 15:31 | |
| daemontool | Hi pennerc :) | 15:33 |
| pennerc | Hello | 15:33 |
| Slashme | I have no time to re-test before next week. If you tell me the ssh bug is resoved, then I'm ok to merge as the rest seemed to work. | 15:36 |
| Slashme | But I'm against merging some code that introduces a bug that breaks SSH storage (even if you resolve it in a future commit) | 15:37 |
| daemontool | Slashme, I'm testing it right now | 15:37 |
| *** dschroeder has joined #openstack-freezer | 16:04 | |
| *** nullvariable has joined #openstack-freezer | 16:06 | |
| daemontool | did anyone received the talk submission email for Austin Summit? | 16:30 |
| daemontool | vannif, ping | 16:56 |
| daemontool | vannif, szaher Slashme reldan m3m0 frescof anyone around_ | 17:06 |
| daemontool | ? | 17:06 |
| reldan | I’m here | 17:06 |
| daemontool | ok | 17:06 |
| reldan | I can see szaher Slashme and vannif | 17:07 |
| daemontool | #startmeeting 17-12-2015 | 17:07 |
| openstack | Meeting started Thu Dec 17 17:07:43 2015 UTC and is due to finish in 60 minutes. The chair is daemontool. Information about MeetBot at http://wiki.debian.org/MeetBot. | 17:07 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 17:07 |
| openstack | The meeting name has been set to '17_12_2015' | 17:07 |
| daemontool | Hi all, I understand few of us are in holidays | 17:08 |
| daemontool | reldan, do you want to go first_ | 17:08 |
| daemontool | ? | 17:08 |
| reldan | Yes, sure. I have a parallel backup still in review. | 17:08 |
| daemontool | ok | 17:09 |
| daemontool | so If I understand well | 17:09 |
| daemontool | we have an exception | 17:09 |
| daemontool | when the user does not have the permission to write to the remote directory in the ssh node | 17:09 |
| reldan | And it actually takes so long, I even don’t understand why actually | 17:09 |
| daemontool | or the directory in the remote node does not exists | 17:09 |
| daemontool | right_ | 17:09 |
| daemontool | ? | 17:09 |
| reldan | Nope, it should create a directory if it doesn’t exists | 17:09 |
| daemontool | ok | 17:09 |
| daemontool | it creates the full directory tree ? | 17:10 |
| reldan | Anyway this exception from my point of view has no relation to parallel backup | 17:10 |
| daemontool | like /home/user/directory | 17:10 |
| daemontool | if user/directory does not exists | 17:10 |
| reldan | Yes, I’m not sure what it will be if you already has a directory with wrong rights | 17:10 |
| reldan | But it creates all subdirectories as well | 17:10 |
| daemontool | ok | 17:10 |
| daemontool | so I've tested it with swift and ssh and it works | 17:11 |
| daemontool | but I'm testing other edge cases | 17:11 |
| reldan | Great! it works as well for me | 17:11 |
| daemontool | like the one mentioned | 17:11 |
| reldan | Last days I hear a lot about tenant backup | 17:12 |
| daemontool | ok | 17:12 |
| reldan | But don’t see any document or blueprint or proposal | 17:12 |
| daemontool | yes I agree | 17:12 |
| daemontool | we don't have one yet | 17:12 |
| daemontool | I have to write it | 17:12 |
| reldan | I heard as well that we need multi region backup | 17:12 |
| reldan | But don’t see any blueprint | 17:13 |
| reldan | I also saw a mail about billing/metrics | 17:13 |
| reldan | And don’t know any proposal about it | 17:13 |
| daemontool | multi region backups_ | 17:13 |
| daemontool | ? | 17:13 |
| reldan | Like if you have a tenant in two regions. Let’s say us-west and us-east | 17:14 |
| daemontool | I think we already supports that | 17:14 |
| daemontool | ah ok, related to tenants backup | 17:14 |
| reldan | Yes, sure | 17:14 |
| reldan | Multi region tenant backup | 17:14 |
| reldan | I don’t know how it should works | 17:14 |
| reldan | If we talk about cinder backup - let’s say cindernatie | 17:15 |
| daemontool | generally the os_auth_url changes | 17:15 |
| reldan | It means that we should have some superbackup with links to both local backup in two regions or what | 17:15 |
| daemontool | like credentials are the same | 17:15 |
| daemontool | for what I understand | 17:16 |
| daemontool | let's say we have a user | 17:16 |
| daemontool | that has 1 vm on region-a | 17:16 |
| daemontool | and 1 vm on region-b | 17:16 |
| reldan | So when I hear question - do we support multi region tenant backup? I don’t know what to answer. Because I have no definition of tenant backup and multi region tenant backup | 17:16 |
| daemontool | the credentials are the same, what changes is the os_auth_url | 17:16 |
| daemontool | the answer is nope | 17:17 |
| daemontool | I mean | 17:17 |
| daemontool | you can do it | 17:17 |
| reldan | or how is difficult to implement it | 17:17 |
| daemontool | but it's about configuring | 17:17 |
| daemontool | a backup for each region | 17:17 |
| daemontool | for th same tenant | 17:17 |
| daemontool | so in the example I was providing | 17:17 |
| daemontool | 1vm -> region-a | 17:17 |
| daemontool | 1 vm -> region-b | 17:17 |
| daemontool | same tenant owns them | 17:18 |
| reldan | Yes | 17:18 |
| daemontool | but to access one region | 17:18 |
| reldan | And we should save superbackup with information about all backups in different regions | 17:18 |
| reldan | or metabackup | 17:18 |
| daemontool | so currently | 17:19 |
| daemontool | so supports that we need to have two backups | 17:19 |
| daemontool | indipendent | 17:19 |
| reldan | Yes, and we need some bluepring about tenant backup | 17:19 |
| daemontool | I think currently a quick workaround to provide this feature would be to create 2 jobs | 17:19 |
| daemontool | 1 for reagion-a and 1 for region-b | 17:19 |
| reldan | With definition, with description how it should work | 17:19 |
| daemontool | and the 2 jobs a part of the same session | 17:19 |
| daemontool | job session | 17:20 |
| daemontool | but the think is, that we don't have tenant based backups | 17:20 |
| daemontool | now | 17:20 |
| reldan | Yes | 17:20 |
| daemontool | so it would be a manual process | 17:20 |
| daemontool | i.e. 1 job for volumes, 1 job for vms, 1 job for the users, 1 job for networks | 17:20 |
| daemontool | etc | 17:20 |
| reldan | Yes, and restore should be manual as well | 17:21 |
| daemontool | all of them belonging to the same job session | 17:21 |
| daemontool | unfortunately yes | 17:21 |
| vannif | I think that if the two backups are unrelated then using a session to link them might even be counterproductive: if one backup fails, the whole sessione fails | 17:21 |
| daemontool | so we need to find a way to automatically discover | 17:21 |
| daemontool | well | 17:21 |
| daemontool | it make sense | 17:21 |
| daemontool | because | 17:21 |
| daemontool | if you are a tenant and you want to backup your vms with the volumes and users and networks | 17:21 |
| daemontool | if one of them fails | 17:22 |
| daemontool | the others should fails too | 17:22 |
| daemontool | or when you restore, let's say without networks, ot users | 17:22 |
| daemontool | it's not going to work | 17:22 |
| daemontool | what do you think? | 17:22 |
| vannif | then they *are* related | 17:22 |
| vannif | in that case yes. it makes sense ^^ | 17:23 |
| daemontool | I think they are related... | 17:23 |
| daemontool | so we need to find a way | 17:23 |
| daemontool | to automate all this | 17:23 |
| daemontool | by retrieving the data from the api in json format | 17:24 |
| daemontool | save it | 17:24 |
| daemontool | and then re upload it for the restore | 17:24 |
| daemontool | something like devstack does | 17:24 |
| daemontool | when creating roles, tenatns, networks, | 17:24 |
| reldan | I would like to have some blueprint with description what we actually want to have. And what we mean by tenant backup. How it should be connected with cinder native backup. The format of backup etc… | 17:24 |
| daemontool | + vms, volumes etc | 17:24 |
| daemontool | yes | 17:24 |
| daemontool | I think for Mitaka we need to make sure the backup session works | 17:25 |
| daemontool | the job session | 17:25 |
| daemontool | the an important thing | 17:25 |
| daemontool | anyway yes I-m goign to write the bp | 17:25 |
| daemontool | Friday | 17:25 |
| daemontool | I have a long flight to do | 17:25 |
| daemontool | and I-ll write couple of blueprints | 17:25 |
| reldan | It sounds very good. Thank you. | 17:26 |
| daemontool | ok ty | 17:27 |
| reldan | I also feel some problem | 17:27 |
| reldan | with parallel backups and cindernative backup | 17:27 |
| reldan | because cindernative means one storage | 17:27 |
| reldan | swift in the same region | 17:27 |
| daemontool | ah ok | 17:27 |
| reldan | So cindernative it is only swift and only one storage | 17:28 |
| reldan | So it a skew in all our architecture | 17:28 |
| daemontool | yes | 17:28 |
| daemontool | well that's an intrinsic limitation of using cindernative | 17:29 |
| daemontool | the only thing we can do is prepare a bp | 17:29 |
| daemontool | e talk with the cinder guys | 17:29 |
| daemontool | couple of weeks ago had a conversation with the nova ptl | 17:29 |
| daemontool | about something similar | 17:29 |
| daemontool | and he wasn't very interested | 17:30 |
| daemontool | I think for now we have to write clearly that limitation | 17:30 |
| daemontool | and provide advanced feature | 17:30 |
| daemontool | with the other approaches | 17:30 |
| daemontool | and after our approach works | 17:30 |
| daemontool | we can see how to natively integrate it to cinder and nova | 17:30 |
| reldan | I have feel that we trying to solve different tasks in freezer-agent. 1) It’s file backup (without any knowledge about OpenStack) 2) OpenStack specific backups | 17:31 |
| daemontool | well, it's the same task | 17:32 |
| daemontool | it's just different the way | 17:32 |
| reldan | We don’t use tar for cindernative, we don’t use encryption for cindernative, we don’t use compression ... | 17:32 |
| daemontool | we achieve the backup and restoer execution | 17:32 |
| daemontool | yes | 17:32 |
| daemontool | exactly | 17:32 |
| daemontool | let's implement | 17:33 |
| daemontool | and improve the approaches we have now | 17:33 |
| daemontool | for cinder backups | 17:33 |
| daemontool | other than cindernative | 17:33 |
| daemontool | then we can see what would be the better approach | 17:34 |
| daemontool | cause we can add backup modes in cinder and nova | 17:34 |
| reldan | Probably - but we don’t support incremental for cinder (not native) | 17:34 |
| daemontool | we have to do that | 17:34 |
| daemontool | that is our limitation | 17:34 |
| daemontool | in the meantime | 17:35 |
| daemontool | I writing a bp | 17:35 |
| daemontool | for the tenant backup | 17:35 |
| reldan | I also going to replace cinder/v1 to cinder/v2 | 17:35 |
| daemontool | ok | 17:35 |
| daemontool | good | 17:35 |
| reldan | It’s all from my side | 17:35 |
| daemontool | ok | 17:35 |
| daemontool | I submitted couple of changes in governance | 17:36 |
| daemontool | that was requested by the os tc | 17:36 |
| daemontool | about how we do release | 17:36 |
| daemontool | also I'm working to get more people on board with the project | 17:36 |
| daemontool | I think on February | 17:36 |
| daemontool | we should have 3 people more 50% of their time at least | 17:36 |
| daemontool | I hope even more | 17:36 |
| reldan | It’s good ) | 17:37 |
| reldan | I also would like to have sprints, if we have distributed team now | 17:37 |
| daemontool | also I'm working with one customer to add servers to opensta-infra | 17:37 |
| daemontool | not directly related to us | 17:37 |
| daemontool | but it's good for os anyway | 17:37 |
| daemontool | I'm also working on the python-freezerclient repo creation and code split | 17:38 |
| daemontool | https://review.openstack.org/#/c/255349/ | 17:38 |
| daemontool | that requires quite a few tasks | 17:38 |
| daemontool | like | 17:39 |
| daemontool | changing the name | 17:39 |
| daemontool | and so on | 17:39 |
| daemontool | so to be ready to add our project to the openstackclient | 17:39 |
| daemontool | after that and the bp | 17:40 |
| daemontool | I'll rework the bloc kbased incremental | 17:40 |
| reldan | I can help with block based incremental | 17:41 |
| daemontool | yes let's talk about that after Christmass holidays | 17:41 |
| reldan | Because now I have an abstraction layer | 17:41 |
| daemontool | yep >( | 17:41 |
| daemontool | :) | 17:41 |
| daemontool | that's all from me | 17:42 |
| daemontool | szaher, vannif Slashme do you have anything to add? | 17:42 |
| reldan | Do you know, have openstack projects some sort of sprints? | 17:42 |
| reldan | or milestones? | 17:43 |
| vannif | no | 17:43 |
| daemontool | reldan, yes | 17:43 |
| daemontool | 12 of June is Mitaka-2 | 17:43 |
| daemontool | vannif, there's a bp for the cinder backups? | 17:43 |
| daemontool | what's the activity there? | 17:43 |
| daemontool | by 12th of June we need to branch liberty and prepare the repo for Mitaka-2 | 17:44 |
| daemontool | ok, so the weekly meeting will stop for Christmass holidays | 17:45 |
| daemontool | we'll restart the 7th of January | 17:45 |
| reldan | I would like to adapt this approach, you know - have a well prepared blue prints and decision that we are going to do and some priortity | 17:45 |
| daemontool | yes reldan I agree | 17:46 |
| daemontool | we need to create also the openstack-specs repo | 17:46 |
| vannif | no. I don't think there's any bp for cinder | 17:46 |
| daemontool | sorry | 17:46 |
| daemontool | freezer-specs | 17:46 |
| vannif | I think we also need to rationalize how to get the lists of backups | 17:46 |
| daemontool | vannif, ok if you could write a bp describing the activity you are doing that'd be good, otherwise no one knows | 17:46 |
| vannif | sure | 17:47 |
| daemontool | vannif, ty | 17:47 |
| vannif | regarding the bakup listing, browsing the api is doable with a relatively low effort | 17:47 |
| daemontool | yes we need to provide a way to list the backups | 17:47 |
| daemontool | I think it's a bare minimum feature | 17:47 |
| vannif | but when there's no api, it's the agent that has to get the list | 17:47 |
| daemontool | vannif, ok let's do taht | 17:47 |
| daemontool | yes | 17:48 |
| vannif | and we need to agree and document that feature in case of local storages, containers, ssh storage | 17:48 |
| reldan | And we need to define metadata format for parallel backup | 17:49 |
| vannif | it's not (always) a simple list of files. the listing involves metadata | 17:49 |
| daemontool | yes | 17:49 |
| daemontool | #agreed | 17:50 |
| daemontool | ok | 17:54 |
| daemontool | thanks all | 17:54 |
| daemontool | #endmeeting | 17:54 |
| openstack | Meeting ended Thu Dec 17 17:54:39 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:54 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/17_12_2015/2015/17_12_2015.2015-12-17-17.07.html | 17:54 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/17_12_2015/2015/17_12_2015.2015-12-17-17.07.txt | 17:54 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/17_12_2015/2015/17_12_2015.2015-12-17-17.07.log.html | 17:54 |
| *** sputnik13 has joined #openstack-freezer | 18:05 | |
| *** reldan has quit IRC | 18:06 | |
| *** pennerc_ has joined #openstack-freezer | 19:56 | |
| *** pennerc has quit IRC | 19:56 | |
| *** reldan has joined #openstack-freezer | 20:01 | |
| *** daemontool has quit IRC | 20:57 | |
| *** daemontool has joined #openstack-freezer | 20:58 | |
| *** reldan has quit IRC | 21:59 | |
| *** reldan has joined #openstack-freezer | 22:19 | |
| *** pennerc_ has quit IRC | 23:04 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!