Friday, 2016-02-05

*** daemontool has joined #openstack-freezer02:25
*** c00281451 is now known as chenzeng03:32
*** dschroeder has quit IRC03:56
*** Slashme has joined #openstack-freezer06:25
*** Slashme has quit IRC06:31
*** samuelBartel has joined #openstack-freezer08:29
*** EinstCrazy has quit IRC09:01
*** EinstCrazy has joined #openstack-freezer09:02
*** EinstCrazy has quit IRC09:07
*** openstackgerrit has quit IRC09:17
*** openstackgerrit has joined #openstack-freezer09:18
*** pbourke has quit IRC10:00
*** pbourke has joined #openstack-freezer10:06
*** EinstCrazy has joined #openstack-freezer10:22
*** EinstCrazy has quit IRC10:35
*** EinstCrazy has joined #openstack-freezer10:36
*** EinstCrazy has quit IRC10:40
openstackgerritPierre Mathieu proposed openstack/freezer: Fixing database config file parsing  https://review.openstack.org/27633310:47
openstackgerritPierre Mathieu proposed openstack/freezer: Fixing database config file parsing  https://review.openstack.org/27633310:50
*** jokke_ has quit IRC11:12
*** jokke_ has joined #openstack-freezer11:13
openstackgerritEldar Nugaev proposed openstack/freezer: Switch cinder api to v2 and add --force and --incremental  https://review.openstack.org/27668511:18
*** reldan_ has joined #openstack-freezer11:38
*** memogarcia has quit IRC11:41
*** reldan_ has quit IRC11:44
*** memogarcia has joined #openstack-freezer12:06
*** reldan_ has joined #openstack-freezer12:09
*** EinstCrazy has joined #openstack-freezer12:29
*** EinstCrazy has quit IRC12:36
*** EmilDi_ has joined #openstack-freezer12:38
*** daemontool has quit IRC12:38
*** reldan_ has quit IRC12:46
*** reldan_ has joined #openstack-freezer12:51
*** daemontool has joined #openstack-freezer13:11
*** Slashme has joined #openstack-freezer13:12
daemontoolHi13:17
memogarciahello13:21
*** Slashme has quit IRC13:24
*** EmilDi_ has quit IRC13:31
*** EmilDi_ has joined #openstack-freezer13:33
*** chenzeng has quit IRC13:34
daemontoolEmilDi,  ping13:49
daemontoolEmilDi_, ^^13:50
EmilDi_hi daemontool13:51
*** Slashme has joined #openstack-freezer14:53
openstackgerritFausto Marzi proposed openstack/freezer-api: Add Sphinx doc build  https://review.openstack.org/27676814:57
*** Slashme has quit IRC15:02
openstackgerritFausto Marzi proposed openstack/freezer-web-ui: Add Sphinx doc build  https://review.openstack.org/27677715:19
daemontoolreldan_, as soon I'll finish couple of things for mitaka-315:27
daemontoolwe'll see the metadata15:27
reldan_daemontool: Great. For v2 and incremental everything is ok. But we need to add additional parameters to cli https://review.openstack.org/#/c/276685/115:28
daemontoolreldan_,  looking15:43
openstackgerritFausto Marzi proposed openstack/freezer: Add Sphinx doc build  https://review.openstack.org/27648815:53
daemontoolreldan_,  if you take a look at http://docs.openstack.org/admin-guide-cloud/blockstorage_volume_backups.html16:00
daemontoolin some point it says "Because volume backups are dependent on the Block Storage database, you must also back up your Block Storage database regularly to ensure data recovery."16:00
daemontoolin the following note16:00
daemontoolit explains how to do that by backing up also the metadata16:01
daemontoolI think we should probably include that16:01
reldan_I can store metadata, but what I should do during restore then?16:02
daemontoolI think we have to import that following docs.openstack.org/admin-guide-cloud/blockstorage_volume_backups_export_import.html#volume-backups-export-import16:03
reldan_From my point of view - it is something a little bit different. It is usefull during the complete loosing of object-storage database.16:05
reldan_I can store metadata somewhere16:05
reldan_It is not problem - but it looks like a hack16:05
reldan_because I don’t manage cindernative - I should create a folder in additional storage (where?) and create mechanism for restoring16:06
reldan_only for cindernative16:06
reldan_only for purposes of fatal failure of openstack16:06
*** m3m0 has quit IRC16:07
openstackgerritMerged openstack/freezer: Add check for name=='__main__'  https://review.openstack.org/26655216:08
*** dschroeder has joined #openstack-freezer16:10
openstackgerritMerged openstack/freezer: Fix configuration option restore_from_host  https://review.openstack.org/27536116:12
openstackgerritMerged openstack/freezer: Fix a mistake in 'plugin.sh'  https://review.openstack.org/27031516:12
daemontoolreldan_,  failure of cinder db I think is a good enough purpose16:12
daemontoolalso if we want to restore on a different openstack instance16:12
reldan_daemontool: Good. But where I should store this metadata?16:13
reldan_for cindernative I have no storage16:13
daemontoolin one of the media storage we support16:13
daemontoolthere's no other option I think16:13
daemontoolor16:13
daemontoolin the freezer api, but in that case we'll not be able to restore in case of cinder db failure16:13
daemontoolif the freezer api are also not available16:14
reldan_Let’s say I have this command freezerc --cindernative-vol-id c1580f0d-5414-48e4-9bf8-d8a5d40e166a16:14
daemontoolI'd use the supported media storage16:14
reldan_And I don’t specify any storage16:14
daemontoolif no storage is specified it would be the default one, which is swift16:14
daemontoolI think it make sense, so we offer some added value16:15
daemontoolto the pure cinder backup16:15
reldan_What if I have no swift, and cinder backend is ceph16:15
reldan_but I have cinder16:15
reldan_in this case we are unable to perform backup, aren’t we?16:16
daemontoolso the case would be16:16
daemontoolwe do not have swift16:16
daemontoolssh node16:16
reldan_Yes, only cindernative backup16:16
daemontoolthen we have local fs16:16
daemontoolI see your point is good16:17
daemontoolbut I think that is an issue we should cover16:17
daemontoolI know it complicates things a bit  lol16:17
reldan_Yes, because it is easy to implement, but hard to support16:17
reldan_I can check if we have swift16:17
daemontooldo you mean operationally?16:17
daemontoolwell16:17
daemontoolin most of the cases16:18
daemontoolin production16:18
daemontoolyou have swift16:18
reldan_create a container “cindernative_backups/uuid”16:18
reldan_and store there metadata16:18
daemontoolyes16:18
daemontoolthat's a good approach16:18
daemontoolwe think a bit more on it16:18
daemontoolbut we can differenciate and provide added value if we do that16:18
reldan_if I have no swift - I can store it in /tmp/cindernative_backups/uuid16:18
daemontoolwell16:18
daemontool$USER/.freezer/cindernative_backups/uuid16:19
daemontoolI'll check, 1) swift, 2) ssh node 3) local fs16:19
daemontooland if none of the 3 are available16:19
daemontoolwe do the backup16:19
daemontoolbut log the limitations16:19
daemontooldo you think is reasonable?16:20
reldan_I think it is doable, but I doubt that it is a freezer problem %)16:22
*** EmilDi_ has quit IRC16:22
daemontoolwell, always wants to provide a way to restore16:22
daemontoolif one or more openstack service is not available16:22
daemontoolit's not our problem16:23
daemontoolthat's right16:23
daemontoolbut providing a solution is good after all16:23
reldan_Yes, but it leads us from unified solution to the set of different mechanism (not related to each other) for every media16:24
reldan_If I should consider possibility that OS just unable to keep metainformation, why I should be sure that I cannot lose swift16:25
reldan_From my point of view freezer shouldn’t know much about OS and internal implementation.16:26
reldan_And now I know that OS can lose it is own database16:26
reldan_And prevent it in my code16:26
daemontoolyes, that's why I think we should use as much as possible the existing os services api16:27
daemontoolI totally agree16:27
reldan_If cinder guys know that they can lose it’s own database. Probably they should store metadata in backup config file16:28
reldan_Let’s say it the same, if freezer asks - please store all metadata about backup on you disk, because we can lose our database16:29
daemontoolwell I agree16:30
daemontoolthat's their limitation16:30
reldan_But yes, sure I can implement this16:32
daemontoolthat will be the same I think for vm backups16:34
daemontoolreldan_,  do we want to add that to the bp?16:40
daemontoolcheck also if zhangjn and EinstCrazy can be involved16:41
reldan_daemontool: But for vm we don’t have native approach16:46
*** samuelBartel has quit IRC16:46
reldan_or you mean snapshoots?16:46
daemontoolwe have backup api endpoint in nova, that uses snapshots internally16:48
daemontoolproblem is there's no incremental there16:48
daemontoolcause cinder also uses snapshots, the incrementals are computed on the snapshots16:49
reldan_I suppose snapshot is incremental already. If we don’t want to download it - we can have increments16:51
daemontoolwhere in Nova?16:52
daemontoolIn qemu yes, I don't know if that feature is exported16:53
daemontoolhave to check16:53
*** reldan_ has quit IRC17:15
*** reldan has joined #openstack-freezer17:40
*** pennerc has joined #openstack-freezer17:56
*** reldan has quit IRC17:56
*** reldan has joined #openstack-freezer18:02
*** reldan has quit IRC18:03
*** pbourke has quit IRC18:06
*** reldan has joined #openstack-freezer18:59
*** daemontool has quit IRC19:21
*** daemontool has joined #openstack-freezer19:25
*** memogarcia has quit IRC19:27
openstackgerritFausto Marzi proposed openstack/freezer: Add Sphinx doc build  https://review.openstack.org/27648820:00
openstackgerritFausto Marzi proposed openstack/freezer-api: Add Sphinx doc build  https://review.openstack.org/27676820:09
openstackgerritFausto Marzi proposed openstack/freezer-web-ui: Add Sphinx doc build  https://review.openstack.org/27677720:13
*** memogarcia has joined #openstack-freezer20:22
daemontoolHi memogarcia20:23
openstackgerritFausto Marzi proposed openstack/freezer-web-ui: Add Sphinx doc build  https://review.openstack.org/27677720:23
*** reldan has quit IRC20:53
*** pennerc has quit IRC21:44
*** reldan has joined #openstack-freezer22:17
*** daemontool has quit IRC22:30
*** reldan has quit IRC23:04
*** memogarcia has quit IRC23:15

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!