Thursday, 2015-10-22

*** hidekazu has joined #openstack-freezer01:42
hidekazuhi, don't you have session at tokyo summit?01:43
*** memogarcia has joined #openstack-freezer03:24
*** memogarcia has quit IRC03:29
*** reldan has joined #openstack-freezer07:59
*** reldan has quit IRC08:28
*** memogarcia has joined #openstack-freezer08:49
*** reldan has joined #openstack-freezer08:49
*** memogarcia has quit IRC08:54
openstackgerritEldar Nugaev proposed openstack/freezer: swift backup should respect chunk size  https://review.openstack.org/23765209:00
*** openstackgerrit has quit IRC09:01
*** openstackgerrit has joined #openstack-freezer09:02
*** marzif has joined #openstack-freezer09:37
*** openstackgerrit has quit IRC09:46
*** openstackgerrit has joined #openstack-freezer09:47
*** marzif has quit IRC09:50
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Refactoring api.py  https://review.openstack.org/23617510:24
*** reldan has quit IRC10:43
*** reldan has joined #openstack-freezer10:57
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Refactoring api.py  https://review.openstack.org/23617512:54
*** reldan_ has joined #openstack-freezer13:15
*** reldan has quit IRC13:15
*** reldan_ is now known as reldan13:15
*** jonaspf has quit IRC13:20
*** jonaspf has joined #openstack-freezer13:26
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Refactoring api.py  https://review.openstack.org/23617514:05
*** marzif has joined #openstack-freezer14:42
*** marzif has quit IRC14:44
*** marzif has joined #openstack-freezer14:45
*** vannif has joined #openstack-freezer14:48
*** marzif has quit IRC14:54
*** marzif has joined #openstack-freezer14:55
*** reldan_ has joined #openstack-freezer14:57
vannifhello15:03
reldan_hello15:03
marzifHi :)15:04
vannifshall we start the meeting ?15:04
scvannif: no ;-P15:04
*** marzif has quit IRC15:04
vannif#startmeeting15:05
freezerBot`vannif: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee'15:05
openstackvannif: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee'15:05
*** marzif has joined #openstack-freezer15:05
vannif#startmeeting freezer-meeting_2015-10-2215:06
freezerBot`Meeting started Thu Oct 22 15:06:08 2015 UTC and is due to finish in 60 minutes.  The chair is vannif. Information about MeetBot at http://wiki.debian.org/MeetBot.15:06
freezerBot`Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:06
freezerBot`The meeting name has been set to 'freezer_meeting_2015_10_22'15:06
openstackMeeting started Thu Oct 22 15:06:09 2015 UTC and is due to finish in 60 minutes.  The chair is vannif. Information about MeetBot at http://wiki.debian.org/MeetBot.15:06
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:06
openstackThe meeting name has been set to 'freezer_meeting_2015_10_22'15:06
vannifhello everyone15:06
*** reldan has quit IRC15:06
*** reldan_ is now known as reldan15:06
vannifmarzif, would you start ?15:08
marzifok15:08
marzifI've been working on switching to testr from pytest, that still needs to be done on freezer-api and freezer-web-ui15:09
marzifit's done for freezer repo15:09
marzifthen we need to convert our tests that uses pytest monkeyaptch15:09
marzifto use mock or what is used in the other os projects15:09
marzifalso I'm helping vannif  with the integration tests, doing code reviews15:10
marzifif I can finish this asap, I'll restart to the block based incremental integration with the current code base15:10
marzifsoon we'll have a freezer logo also :)15:10
vannifwoohoo! :)15:10
marzifwe are not in the openstack big tent15:11
marzifwe probably should propose freezer as integrated project by end of the year, so we need to to many thinkgs like itnegrates testing15:11
marzifoslo.log15:11
marzifplace the right code on a python-freezerclient and so on15:12
marzifthis is on the general roadmap...15:12
marzifthat's all from me :)15:12
*** szaher has joined #openstack-freezer15:12
vannifyes. I think we should define clearly the various things needes and give priorities.15:12
vannif*needed15:12
marzifyes15:13
vannifI'm not a huge expert on mock, but if if I can help ... maybe I can learn something new too :)15:13
*** dschroeder has joined #openstack-freezer15:13
vannifgood.15:14
marzifI think we all have to use the same framerowk for testing15:14
marzifand taht framework for unittesting has to be the one most osed in os15:15
marzifs/osed/used/15:15
vannifyes definitely15:15
vannifand everyone should care about writing tests and avoid lowering the coverage when he submits patches15:15
marzif+115:15
vannifotherwise we delegate to someone the specific task to write the tests ... It's a solution ..15:16
vannifanything more to say ?15:16
marzifnope15:17
marzifdelegate to who ? :D15:17
marzifeach engineer has to write the unittests for the code he/she commit15:18
marzif:)15:18
vannifto a convict :)15:18
marzifhaha15:18
vannifok. thank you, marzif15:18
vannifreldan ?15:18
reldanYes, I was doing coverage this week and refactoring of ssh and local - now they are using much more common codebase15:19
reldanAfter switching to pbr and testr I have some problems with running coverage locally15:19
reldanI have checked nova backup and it doesn’t work with hpcloud, but I have installed kilo with devstack and testing it against kilo15:20
marzifreldan,  does it work?15:20
reldanYesterday we have had a conversation about refactoring swift storage and usage swiftclient.put_object instead of uploading chunks15:20
marzifor you didn't get the time to test it yet?15:20
reldanIt has some issues like race conditions, probably I will be able to fix it be inserting timeouts15:21
reldanI also removed 300 lines of code from tests common15:22
marzifmmhhh.... race conditions can be there even if we add timeouts...15:23
reldanI also have fixed bug with swift chunk_size, and it should work now15:23
reldanSure, we can create integration tests probably15:23
reldanfor nova backup15:23
reldanAs we have it now for swift storage15:24
reldanI have nothing to add what I’m doing now. I would like to have performance measurement tool and charts, real data continious tests and improved logging.15:25
reldanIt is all15:26
vannifyes, the need for performance testing is increasing15:27
vannifit will become the next big goal15:28
vanniffor testing15:28
reldanYes, I would like something like metrics in java. I would like to mark a block of code as critical and hava logging with time of executing in distributed log or chards15:28
reldancharts15:28
vannifregarding race condition, I'm dubious as well about solutions which involve "timing"15:29
reldanAnd it would be great to have history of previous runs15:29
vannifIt's not a trivial task, I know15:29
reldanAs I am, but when I’m doing image.get(id)15:29
reldansometime it returns me Image: {Propreties:{}}15:29
reldanAnd when I’m trying to update image.get - it throws exeption15:30
reldanAnd it’s really tricky to catch things like that, because novaclient, cinderclient can return unexpected something15:30
reldanThe only way to have something more-less stable - it runs continiously nova/cinder backups against different installations of openstack15:31
reldanIt’s my opinion15:31
reldanSo for my particular case: while not image.properties: sleep; recheck;15:32
marzifsounds reasonable15:32
reldanbut actually in case of nova we have a lot of different scenarious15:33
vannifyes, at some point you have to deal with the unexpected :)15:33
reldanlet’s imageine - I would like to make an image, and I exceed images limit in my project15:33
reldanI even don’t know what novaclient return me in that case15:34
reldanyes, agree15:35
vannifyou said you also have problem with unit tests after the switch to testr ?15:36
reldanYes, locally It shows no coverage, so I am using review for checking coverage now15:36
reldanProbably it is a Mac specific problem15:36
reldanI have nothing to add now15:39
vannifok. thank you reldan15:40
reldanThank you vannif!15:40
vannifOn my side.15:40
vannifthe devstack plugin are merged and working. I need to finalize the execution of the integration tests on the CI toolchain15:41
vannifI'm still not such a big expert on that. thanks marzif for the help :)15:42
marzifvannif, do you recall what's the exact command to execute only the integration tests?15:43
vannifno. when I run the tests locally I just run pytest15:44
vannifthe tests are run automatically if the correct environ vars are set15:44
marzifin testr what would be the command?15:45
*** marzif has quit IRC15:45
vannifbesides that, I've tested in a real hlm deployment, and it was a good thing :)15:45
daemontool_ok15:46
vannifnot yet looked into it. I'll reach you asap with expanded knowledge on the topic15:46
vannifthe last part took more time than expected indeed15:46
*** marzif has joined #openstack-freezer15:48
marzifok as soon as you can please help me with the exact testr command15:48
vannifI've also planned some "hidden" behaviors of the api. that is: it will extract the actions from a newly created job and add them to the action index. so that jobs created from the command line become editable from the web-ui15:48
marzifok15:48
marzifthat is important15:48
vannifyes15:49
vannifsince the web-ui is improving, we need to keep it "in sync" with the rest15:49
marzifyes15:49
vannifthat is all from me15:49
marzifwe need to include also the web ui15:50
marzifin the integrated gate tests15:50
vannifthe devstack plugin is working for the web-ui as well15:50
vannifI mean: you can have a devstack machine with a working freezer/freezer-api/freezer-web-ui environment15:50
marzifyes, but we need the integration tests for the web ui15:51
vannifbut I don't know how to actually do integration tests on a weg gui15:51
marzifand afaik we don't have them now15:51
marzifthat's m3m0 job :D15:51
vannifI think they involve a tool do actually open a browser and "click" and enter text15:52
vannifs/do/to15:52
marziflike selenium15:52
vannifyes :)15:52
vannifexactly15:52
marzifwe need something that render java script15:52
vannifI'll ping memo for a crash course on web ui testing :)15:53
marzifok15:53
vannifany questions ?15:54
vannifszaher, are you there ?15:55
szaherYes15:55
scvannif: get horizon code and look at it, I bet they are doing unit test15:55
szaherI was working on the oslo.log and oslo.config in freezer-api15:56
vannifsc, yes. that's a good starting point.15:56
vannifyes szaher, sorry15:56
vannifgo on15:56
szahernp15:56
szaherI did it with freezer-api and changed most of the files to use oslo.log instead of pythong logging15:57
szaherI was working today on freezer-db-init script to move it to oslo_config and oslo_log15:57
daemontool_sc, brilliant15:58
szaherI need to change some files for freezer-db-init script and will commit all together15:58
szaherI did a quick commit to fix the requirements of freezer-api find it here https://review.openstack.org/#/c/237514/15:59
*** marzif has quit IRC16:00
szaherto separate it from logging and config because it may take sometime for logging and config to be merged16:00
*** marzif has joined #openstack-freezer16:00
vannifare you going to send something for review ?16:03
szaherYes, if I finished freezer-db-init tomorrow will send everything together if not will be early next week16:04
vannifyou removed the freezer-db-init script and embedded everything in the freezer-api command ?16:06
szaherNo, I changed freezer-db-init to use oslo.config and oslo.log16:07
szaherbefore it wasn't using any kind of logging, so now will be using oslo.log16:08
szaherand oslo.config to get configs from either file or cli16:08
szaherI was thinking of using one config file for api and db-init like all os projects16:08
szaherwe could have a database or connection section in the configuration file and we use this section to store information related to backend16:09
vannifone for each ?16:09
szaherwhatever we decide we can use one file with 2 diff sections, for ex. DEFAULT will be for freezer-api and [connection] for freezer-db-init16:10
vannifwhat are the settings which are specific of each program and are not shared ?16:12
szaher the same existing one16:13
vannifsorry. I don't get it. what are the specific setting needed by the freezer-db-init which are not needed by the freezer-api ?16:16
szahersomething like mappings, confirmation and so on16:23
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Refactoring api.py  https://review.openstack.org/23617516:24
vannifok16:24
vannifremember to update the unit tests :)16:25
vannifI'll take some time to review it and we'll got through it together16:27
vannifin case16:27
vannifanything else to say ?16:27
szaherNo Thanks16:28
vannifthank you szaher16:28
vannifI think no one else is around. m3mo is busy16:28
vannifif anybody wants to add something ...16:28
vannifok. thank you all16:31
vannif#endmeeting16:31
freezerBot`Meeting ended Thu Oct 22 16:31:38 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:31
freezerBot`Minutes:        http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-22-15.06.html16:31
freezerBot`Minutes (text): http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-22-15.06.txt16:31
freezerBot`Log:            http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-22-15.06.log.html16:31
openstackMeeting ended Thu Oct 22 16:31:38 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:31
openstackMinutes:        http://eavesdrop.openstack.org/meetings/freezer_meeting_2015_10_22/2015/freezer_meeting_2015_10_22.2015-10-22-15.06.html16:31
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/freezer_meeting_2015_10_22/2015/freezer_meeting_2015_10_22.2015-10-22-15.06.txt16:31
openstackLog:            http://eavesdrop.openstack.org/meetings/freezer_meeting_2015_10_22/2015/freezer_meeting_2015_10_22.2015-10-22-15.06.log.html16:31
*** marzif has quit IRC16:32
*** marzif has joined #openstack-freezer16:32
*** marzif has quit IRC16:44
*** szaher has quit IRC16:46
*** marzif has joined #openstack-freezer16:47
*** reldan has quit IRC17:02
*** memogarcia has joined #openstack-freezer17:16
*** marzif has quit IRC17:29
*** jonaspf has quit IRC17:33
*** reldan has joined #openstack-freezer17:56
*** marzif has joined #openstack-freezer18:34
*** marzif_ has joined #openstack-freezer18:41
*** marzif has quit IRC18:43
*** marzif_ has quit IRC18:52
*** marzif_ has joined #openstack-freezer19:08
*** reldan has quit IRC19:38
*** reldan has joined #openstack-freezer20:00
*** dschroeder has quit IRC23:15
*** jonaspf has joined #openstack-freezer23:19
*** jonaspf has quit IRC23:34
*** reldan has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!