Thursday, 2015-08-13

*** reldan has quit IRC00:58
*** jonaspf has joined #openstack-freezer07:27
*** openstackgerrit has quit IRC07:41
*** jonaspf has quit IRC07:42
*** openstackgerrit has joined #openstack-freezer07:42
*** openstackgerrit has quit IRC07:45
*** fabriziov_ has joined #openstack-freezer07:52
*** fabriziov has quit IRC07:52
*** openstackgerrit has joined #openstack-freezer08:00
*** jonaspf has joined #openstack-freezer08:08
*** jokke_ has quit IRC08:20
*** reldan has joined #openstack-freezer08:58
*** jokke_ has joined #openstack-freezer09:30
openstackgerritPierre-Arthur MATHIEU proposed stackforge/freezer: Auto snap uses also mount to guess lvm info  https://review.openstack.org/21199110:16
*** reldan has quit IRC10:46
*** reldan has joined #openstack-freezer10:48
*** reldan has quit IRC10:51
*** reldan has joined #openstack-freezer11:07
*** marzif has joined #openstack-freezer11:51
openstackgerritFabrizio Vanni proposed stackforge/freezer: basic integration tests for freezer-agent  https://review.openstack.org/21005712:49
openstackgerritFabrizio Vanni proposed stackforge/freezer: fix scheduler job removal when api not available  https://review.openstack.org/21126313:01
*** openstackgerrit has quit IRC13:01
*** openstackgerrit has joined #openstack-freezer13:02
*** jonaspf has quit IRC13:13
*** jonaspf has joined #openstack-freezer13:15
openstackgerritFabrizio Vanni proposed stackforge/freezer: fix loop while getting list of resources from api  https://review.openstack.org/21252513:27
openstackgerritFausto Marzi proposed stackforge/freezer: ~/.freezer work_dir created automatically  https://review.openstack.org/21252613:28
openstackgerritFabrizio Vanni proposed stackforge/freezer: apiclient uses openstackclient.api  https://review.openstack.org/20610413:30
*** jonaspf has quit IRC13:38
*** jonaspf has joined #openstack-freezer13:41
openstackgerritMerged stackforge/freezer: Auto snap uses also mount to guess lvm info  https://review.openstack.org/21199113:49
*** jonaspf has quit IRC13:55
*** reldan has quit IRC13:57
openstackgerritFausto Marzi proposed stackforge/freezer: ~/.freezer work_dir created automatically  https://review.openstack.org/21252613:58
*** marzif has quit IRC14:04
*** marzif has joined #openstack-freezer14:04
*** jonaspf has joined #openstack-freezer14:18
*** jonaspf has quit IRC14:32
*** reldan has joined #openstack-freezer14:35
openstackgerritFabrizio Vanni proposed stackforge/freezer: apiclient uses openstackclient.api  https://review.openstack.org/20610414:46
*** jonaspf has joined #openstack-freezer14:47
*** dschroeder has joined #openstack-freezer14:54
*** marzif has quit IRC14:54
m3m0hello everyone, freezer meeting is about to start15:01
m3m0#startmeeting openstack-freezer 13-08-201515:01
openstackMeeting started Thu Aug 13 15:01:29 2015 UTC and is due to finish in 60 minutes.  The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
freezerBot`Meeting started Thu Aug 13 15:01:29 2015 UTC and is due to finish in 60 minutes.  The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
freezerBot`Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
freezerBot`The meeting name has been set to 'openstack_freezer_13_08_2015'15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
openstackThe meeting name has been set to 'openstack_freezer_13_08_2015'15:01
m3m0All: meetings notes available in real time at: https://etherpad.openstack.org/p/freezer_meetings15:01
m3m0fabriziov_ are you around?15:02
daemontool_m3m0, I can go first15:02
m3m0please daemontool_ go ahead15:02
daemontool_so I've been working the lvm auto snap improvement, also the work_dir creation  is now under review15:03
daemontool_I'm planning today and tromorrow15:03
daemontool_to improve the freezer-agent usability by automatic guessing command line params as the lvm dir mount, snap size, etc15:03
daemontool_progress on rsync are going slowly15:04
daemontool_no blockers15:04
daemontool_that's all from me :)15:04
m3m0the auto_snap used to work only in ubuntu right? now it works with hlinux and other distros?15:04
m3m0do you need help with rsync?15:04
m3m0fabriziov_ you are next15:13
fabriziov_ok15:13
fabriziov_The integration tests are in review. Darragh added some valid comments. I'm checking them.15:13
fabriziov_I think I'm going to have a look at the suggested fixtures library and update the code for the tests. But I think this can wait for another sprint, together with some other tests maybe.15:13
fabriziov_The code for apiclient support of keystone has been rebased and Pierre is deploying it so we can test what is the failure15:14
fabriziov_I've also to complete the support for falcon-0.1.10. the job.py has been converted, I just need to modify the code for sessions, clients etc15:15
fabriziov_no big deal. Updating the unit tests takes the most time :)15:15
fabriziov_only blocker is haveing the possibility to test K3 on HLM, but I have other things to do in the meantime15:16
m3m0does that refactoring will impact the implementation on windows?15:16
fabriziov_no. only the api code is involved15:17
fabriziov_I've to modify the code for the middlware15:17
fabriziov_but all is api side15:17
m3m0which functionality is not present on that falcon version?15:17
daemontool_m3m0,  sorry for the delay, yes the autosnap used to work only on ubuntu, yes rsync I have to find the time to work on it...15:18
daemontool_I might need some help in a bit....15:18
fabriziov_falcon>=0.2.0 support middleware objects that implement the methods:15:19
fabriziov_process_request15:19
fabriziov_process_response15:19
m3m0daemontool_ just let us know what do you need :) I'm a little bit busy but we can have a mini sprint on the weekend for that :)15:19
daemontool_haha! great :)15:20
daemontool_ty15:20
fabriziov_that's all for me.15:20
m3m0thanks15:22
m3m0reldan are you here?15:22
reldanyes, I’m here15:22
reldanI'm doing rsync integration. It requires some refactoring. And also I'm trying to unify approach of doing backups and use streams for local and ssh storages as well.15:22
reldanAfter this I should take rsync and integrate to our code15:23
reldanI am also trying to throw away “ssh” command invocation and allow to run it for windows as well15:23
reldanIt is all from my side15:23
m3m0if you remove ssh command what will you use? scp?15:25
reldanParamiko. I’m not sure about speed, but Paramiko allows to open remote file throw sftp15:25
reldan with self.ftp.open(filename, bufsize=chunk_size) as backup_file:15:26
reldan            data = backup_file.read(chunk_size)15:26
reldan            while data:15:26
reldan                queue.put(data)15:26
reldan                data = backup_file.read(chunk_size)15:26
m3m0that sounds nice, there are ssh binaries for windows for this version15:26
openstackgerritFabrizio Vanni proposed stackforge/freezer: apiclient uses openstackclient.api  https://review.openstack.org/20610415:26
m3m0but is better if we can get rid of those15:27
reldanm3m0: I will try to do it. It seems possible - but some guys are complaing about speed15:27
m3m0to fast or to slow?15:27
reldanm3m0: To slow, but I have idea that probably they have wrong size of buffer15:28
daemontool_reldan, my advice would be to focus on performance / limits after the feature is ready15:28
reldanYes, yes sure15:28
daemontool_I think the paramiko stuff is good15:28
daemontool_it allows us to be more portable15:28
daemontool_and to remove the binaries..15:28
daemontool_so well done15:28
reldanIYes, yes sure15:28
daemontool_also15:29
daemontool_we'll add the pypy support at some point15:29
daemontool_we need that anyway for rsync...15:29
daemontool_so with that we might get significan improvements on also the other bottlenecks15:29
openstackgerritFabrizio Vanni proposed stackforge/freezer: basic integration tests for freezer-agent  https://review.openstack.org/21005715:29
m3m0that sounds great, and pypy is available for windows as well15:31
m3m0only in 32 bits15:31
m3m0do you have anything more to add?15:32
reldanI have nothing to add from my side15:32
m3m0thanks reldan15:32
m3m0Slashme, you're next15:33
reldanThank you m3m015:33
SlashmeNot a lot on the public side. Just resolved a bug that was causing the freezer-scheduler not to find the freezerc binary if you were in a non-activated virtualenv. I hope I'll get some time soon to work on automatic devstack integration.15:33
m3m0did you commit that right?15:34
SlashmeYep15:34
m3m0is it the one relate to the paths when you overwrite them ?15:34
SlashmeYes, freezer-scheduler uses os.environ['path'], and not sys.path to find the binary15:35
SlashmeNot it falls back to sys.path15:36
m3m0nice, great job, do you have anything more to add?15:36
m3m0my turn15:37
*** jonaspf has quit IRC15:37
m3m0I'm writing a windows service in order to have the scheduler running as a "daemon" on windows15:37
m3m0I had to modify the behaviour on how its executed on linux in order to make it work on windows15:38
m3m0right now I'm debugging why the service stops as soon as I started15:38
m3m0for the freezer-agent side, I still have to some tests on the ssh implementation, and I need to do it before the paramiko module gets merged15:39
m3m0local and swift storages are working greate15:39
m3m0great*15:39
m3m0that's it for me15:39
m3m0does anyone wants to say anything?15:39
*** jonaspf has joined #openstack-freezer15:40
samuelBartelnop15:40
m3m0sorry samuelBartel didn't see you :(15:41
m3m0you are ok then?15:41
samuelBartelm3m0, no problem15:41
samuelBartelfinish the compression algo bp15:41
samuelBarteland will look in launchpad today for a new task15:42
m3m0nice :)15:42
m3m0thanks a lot everyone15:43
m3m0#endmeeting15:43
freezerBot`Meeting ended Thu Aug 13 15:43:34 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
freezerBot`Minutes:        http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-08-13-15.01.html15:43
freezerBot`Minutes (text): http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-08-13-15.01.txt15:43
freezerBot`Log:            http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-08-13-15.01.log.html15:43
openstackMeeting ended Thu Aug 13 15:43:35 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_freezer_13_08_2015/2015/openstack_freezer_13_08_2015.2015-08-13-15.01.html15:43
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_freezer_13_08_2015/2015/openstack_freezer_13_08_2015.2015-08-13-15.01.txt15:43
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_freezer_13_08_2015/2015/openstack_freezer_13_08_2015.2015-08-13-15.01.log.html15:43
daemontool_samuelBartel,  would you like to work on something else? do you have bandwidht?15:48
daemontool_not sure if I've relady asked this or not....15:48
samuelBarteldaemontool_, yes I am looking for a new bp to work in15:49
samuelBartelbut with average bandwith15:49
daemontool_samuelBartel, ok, anything in particular in your mind?15:50
samuelBartelsome other stream to manage in paralle15:50
samuelBartelnot yet15:50
samuelBartelI was just looking on launchpad to find out something which inspire me ;)15:50
daemontool_samuelBartel, we are trying to improve the usability of the freezer-agent15:51
daemontool_i.e. reducing as much as possible the use of --lvm-* args15:52
daemontool_would you like to work on that?15:52
daemontool_like settign the defaults15:52
daemontool_and/or automatically set --path-to-backup from --lvm-auto-snap15:52
daemontool_that kind of things15:52
daemontool_set default name for container15:53
daemontool_many small changes15:53
daemontool_that can improve a lots the usability15:53
samuelBartelyes would be great15:54
daemontool_ok15:55
daemontool_do you want to write the bp for that15:55
daemontool_like one that contains all these improvements ?15:55
daemontool_and commit one change per improvment?15:55
samuelBartelthere is no bp yet about that?15:55
daemontool_mmhhhh15:55
daemontool_nope as far as i can remember15:56
daemontool_but I can write it if you want15:56
daemontool_that's np at all15:56
daemontool_I'll write it today15:57
openstackgerritFabrizio Vanni proposed stackforge/freezer: basic integration tests for freezer-agent  https://review.openstack.org/21005715:57
daemontool_by eod15:57
daemontool_so you can review it15:57
samuelBartelhttps://blueprints.launchpad.net/freezer/+spec/lvm-auto-config << this is one seems to be related or am i wrong?15:57
daemontool_samuelBartel,  it was for https://review.openstack.org/#/c/211991/16:00
samuelBarteldaemontool_, ok16:00
daemontool_althought in the content it mention16:01
daemontool_these other things16:01
daemontool_use that if you want16:01
samuelBartelI won't have time today to work on the bp so if you can write i will review it otherwise I can also write the bp tomorrow16:01
daemontool_I'll try to extend that bp16:02
daemontool_ok16:02
samuelBarteldaemontool_, ok thanks16:02
samuelBartelI will review it tomorrow then16:02
*** jonaspf has quit IRC16:06
*** jonaspf has joined #openstack-freezer16:10
openstackgerritMemo Garcia proposed stackforge/freezer: windows service  https://review.openstack.org/21194916:11
openstackgerritMemo Garcia proposed stackforge/freezer: windows service  https://review.openstack.org/21194916:23
*** jonaspf has quit IRC16:30
*** openstackgerrit has quit IRC16:31
*** openstackgerrit has joined #openstack-freezer16:32
*** reldan has quit IRC17:03
*** zahari-gw has quit IRC17:08
*** reldan has joined #openstack-freezer17:18
*** reldan has quit IRC17:43
*** reldan has joined #openstack-freezer17:48
*** reldan has quit IRC17:50
*** reldan has joined #openstack-freezer17:52
*** reldan has quit IRC18:31
*** dschroeder has quit IRC18:33
*** reldan has joined #openstack-freezer18:34
*** reldan has quit IRC22:36
*** reldan has joined #openstack-freezer22:41

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!