Thursday, 2016-09-22

*** Drago has quit IRC00:54
*** zhurong has joined #senlin01:05
*** yanyanhu has joined #senlin01:24
*** guoshan has joined #senlin01:26
openstackgerritYanyan Hu proposed openstack/senlin: Define new config options for receiver notifying  https://review.openstack.org/37386101:52
Qimingyanyanhu, fyi, I'm attempting to fix gate problem by bumping sdk version01:54
yanyanhuQiming, great01:54
Qiming https://review.openstack.org/37446901:55
yanyanhuso there will be sdk0.9.601:55
Qimingbasically, 0.9.6 was bad01:55
yanyanhuoh, I see01:55
Qimingthat was causing the gate breaking01:55
Qimingbrian has kindly cut a 0.9.7 last night01:55
yanyanhunice01:55
Qimingbut he didn't buy in our idea to change 'generated_at' back to 'timestamp'01:56
Qimingso I reverted that patch to make hime happy01:56
Qiminghttp://git.openstack.org/cgit/openstack/python-openstacksdk/commit/?id=95ba61263ed5f3ef02025913604cf94c33de0c6001:56
Qimingactually, I like this patch from miaohb: http://git.openstack.org/cgit/openstack/python-openstacksdk/commit/?id=619032ea1876078f22a1d8dec9509db4a9769f6301:56
QimingI tried to argue with him01:57
yanyanhuok. imo, timestamp is better for 'event' which is kind of timeserial record01:57
Qimingyes, https://review.openstack.org/#/c/372276/01:58
Qimingbut as a compromise, I have proposed a workaround at client side01:58
Qiminghttps://review.openstack.org/37412601:59
yanyanhuI see. that can be an alternate.02:01
yanyanhuhi, Qiming, about the event, I'm thinking maybe we can consider to store them into non-sql db, e.g. mongo in future.02:04
Qimingem, yes02:05
yanyanhusince it will grow very fast and could be used as history by user02:05
Qimingthat was something we have on newton agenda but wasn't able to deliver02:05
openstackgerritTony Breeds proposed openstack/senlin: [DNM] Gate test  https://review.openstack.org/37448702:05
yanyanhuI see02:05
Qimingevent can have some backends, db, file, messaging etc02:06
yanyanhuright02:06
Qimingwe can pipe them to something remote02:06
yanyanhuyes, that will be the complete solution02:06
Qimingbefore doing that, I was trying to make versioning work02:07
yanyanhuhope can have time to work on it in next cycle02:07
Qimingthen we don't lose control on the format02:07
yanyanhuyep02:07
yanyanhuformat compatible is important02:07
Qimingbefore we have a stable definition of event format, I'm not feeling comfortable to dump events to any external sinks02:08
openstackgerritYanyan Hu proposed openstack/senlin: Define new config options for receiver notifying  https://review.openstack.org/37386102:09
yanyanhuI see, it makes sense02:09
Qimingbasically a notification contains the following fields:02:10
Qimingnotification fields:02:10
Qiming timestamp: timeutils.utcnow(), with microseconds02:10
Qiming priority: string, e.g. INFO, WARN, ...02:10
Qiming publisher_id: string, e.g. clustering.engine02:10
Qiming event_type: string, e.g. cluster.create.started02:10
Qiming payload: dict, should be from a versioned object02:10
Qimingneed a protocol to convert/converge all events and notifications02:10
yanyanhuyes02:13
openstackgerritYanyan Hu proposed openstack/senlin: Define new config options for receiver notifying  https://review.openstack.org/37386102:13
openstackgerritYanyan Hu proposed openstack/senlin: Define new config options for receiver notification  https://review.openstack.org/37386102:30
openstackgerritRUIJIE YUAN proposed openstack/senlin: Not necessary to handle 'ResourceNotFound'  https://review.openstack.org/37450502:40
openstackgerritYanyan Hu proposed openstack/senlin: Define new config options for receiver notification  https://review.openstack.org/37386102:55
openstackgerritRUIJIE YUAN proposed openstack/senlin: Lighten the load  https://review.openstack.org/37451603:09
*** guoshan has quit IRC03:52
openstackgerritYanyan Hu proposed openstack/senlin: Add config options for Zaqar queue  https://review.openstack.org/37453105:13
openstackgerritYanyan Hu proposed openstack/senlin: Add config options for Zaqar queue  https://review.openstack.org/37453105:14
openstackgerritYanyan Hu proposed openstack/senlin: Add config options for Zaqar queue  https://review.openstack.org/37453105:44
*** guoshan has joined #senlin06:00
*** AlexeyAbashkin has quit IRC06:44
*** AlexeyAbashkin has joined #senlin06:46
*** lvdongbing has joined #senlin06:50
Qiminghi, guoshan06:52
Qimingabout the batching policy06:53
guoshanyes?06:53
Qimingit is not about policy.json06:54
Qimingit is about a usage scenario06:54
Qimingsay you want to create a cluster of 1000 VMs06:54
Qimingyou don't want to have senlin issue 1000 requests to nova simultaneously06:54
Qimingyou will want 10 batches, for example, each of which contain 100 requests06:55
Qimingthis applies to other cluster operations as well06:55
Qimingthe idea is to avoid DOS attack on other services06:56
Qiminganother aspect of batching policy is about update06:56
Qimingwhen you are updating a cluster, you may want to keep at least a certain number of nodes active at any time during the update06:56
guoshanoh, batches means lots of nodes operation at the same time?06:57
Qimingwhen updating a cluster of 100 VMs, for example, you may want to have at least 80 VMs active at any time, so you have to update the cluster in 5 batches, in each batch, you update only 20 VMs06:57
Qimingafter 5 batches, the whole cluster is updated, but at any time, you still have 80 VMs up and running06:58
Qimingbatching is about dividing a huge group of operations into several batches06:58
guoshanthx, I got that06:59
Qimingso ... you can see there are primarily two ideas combined06:59
Qimingthe first one is about avoiding DOS attack, the second one is about keeping clusters operational07:00
Qimingthe second one is of a higher priority in my opinion07:00
Qimingas for the first one, we can check if it fits into the same conceptual design or not07:01
Qimingwe can come up a throttling policy if it doesn't fit into the batching design07:01
ruijieLooks like nova do not support update a batch of servers?07:02
openstackgerritlvdongbing proposed openstack/senlin: Revise schema _validate_version  https://review.openstack.org/37457107:13
Qimingruijie, seems so07:17
Qimingfrom their api doc, http://developer.openstack.org/api-ref/compute07:17
QimingI only saw create in batch07:17
ruijieyep07:17
openstackgerritQiming Teng proposed openstack/senlin: Cleanse zaqar driver for functions unused  https://review.openstack.org/37460608:12
openstackgerritYanyan Hu proposed openstack/senlin: Add new config option for Zaqar queue  https://review.openstack.org/37453108:35
openstackgerritLu lei proposed openstack/python-senlinclient: Never use MagicMock  https://review.openstack.org/37463009:14
openstackgerritlvdongbing proposed openstack/python-senlinclient: Fix help msg of node-check and node-recover  https://review.openstack.org/37465309:41
*** lvdongbing has quit IRC09:41
*** zhurong has quit IRC10:00
*** yanyanhu has quit IRC10:09
*** guoshan has quit IRC10:36
*** xiaozhuangqing has joined #senlin10:57
*** guoshan has joined #senlin11:19
openstackgerritxiaozhuangqing proposed openstack/senlin: Replace 'MagicMock' with 'Mock'  https://review.openstack.org/37360711:35
*** guoshan has quit IRC11:41
*** guoshan has joined #senlin11:41
*** guoshan has quit IRC11:46
*** zigo has quit IRC11:54
*** zigo has joined #senlin11:58
*** zigo is now known as Guest8360111:59
*** guoshan has joined #senlin11:59
*** Guest83601 has quit IRC12:03
*** zhurong has joined #senlin12:09
*** guoshan has quit IRC12:09
*** guoshan has joined #senlin12:10
*** zigo_ has joined #senlin12:12
*** guoshan_ has joined #senlin12:14
*** guoshan has quit IRC12:14
*** zigo_ has quit IRC12:17
*** zigo_ has joined #senlin12:18
*** guoshan_ has quit IRC12:38
*** guoshan has joined #senlin12:39
openstackgerritMerged openstack/python-senlinclient: Replace 'MagicMock' with 'Mock'  https://review.openstack.org/37360812:45
*** guoshan has quit IRC12:46
*** guoshan has joined #senlin12:46
*** guoshan has quit IRC12:47
*** zigo_ has quit IRC12:48
*** zigo_ has joined #senlin12:51
openstackgerritOpenStack Proposal Bot proposed openstack/python-senlinclient: Updated from global requirements  https://review.openstack.org/37480813:16
openstackgerritOpenStack Proposal Bot proposed openstack/senlin: Updated from global requirements  https://review.openstack.org/37378513:16
*** guoshan has joined #senlin13:18
openstackgerritMerged openstack/senlin: Updated from global requirements  https://review.openstack.org/37378514:14
openstackgerritQiming Teng proposed openstack/senlin: Tweak CLUSTER_ADD_NODE action for capacity update  https://review.openstack.org/37301614:15
openstackgerritQiming Teng proposed openstack/senlin: Tweak CLUSTER_DEL_NODES for base capacity  https://review.openstack.org/37358714:16
openstackgerritQiming Teng proposed openstack/senlin: Fix capacity calculation in scaling actions  https://review.openstack.org/37361014:17
openstackgerritQiming Teng proposed openstack/senlin: Move is_engine_dead test to common utils  https://review.openstack.org/37373614:18
openstackgerritQiming Teng proposed openstack/senlin: Remove unuse keystone interface functions  https://review.openstack.org/37380914:18
openstackgerritQiming Teng proposed openstack/senlin: Clean neutron driver interface for unused calls  https://review.openstack.org/37413414:19
openstackgerritQiming Teng proposed openstack/senlin: Cleanse nova driver for unused calls  https://review.openstack.org/37416614:19
openstackgerritQiming Teng proposed openstack/senlin: Correct driver calls in affinity policy  https://review.openstack.org/37417214:20
openstackgerritQiming Teng proposed openstack/senlin: Cleanse zaqar driver for functions unused  https://review.openstack.org/37460614:20
openstackgerritQiming Teng proposed openstack/python-senlinclient: Fix list of event with timestamp field  https://review.openstack.org/37412614:22
openstackgerritQiming Teng proposed openstack/senlin: Revise TODO.rst  https://review.openstack.org/37379314:23
openstackgerritQiming Teng proposed openstack/senlin: API support node replace  https://review.openstack.org/36929114:23
openstackgerritXueFeng Liu proposed openstack/senlin: modify profile_update  https://review.openstack.org/37324114:23
openstackgerritQiming Teng proposed openstack/senlin: Fix typos in api-ref/source/policies.inc  https://review.openstack.org/37391014:23
openstackgerritQiming Teng proposed openstack/senlin: Use new min_size/max_size when eval cluster status  https://review.openstack.org/37405014:24
openstackgerritQiming Teng proposed openstack/senlin: Define new config options for receiver notification  https://review.openstack.org/37386114:24
openstackgerritQiming Teng proposed openstack/senlin: Replace 'MagicMock' with 'Mock'  https://review.openstack.org/37360714:24
openstackgerritQiming Teng proposed openstack/senlin: Add new config option for Zaqar queue  https://review.openstack.org/37453114:24
openstackgerritQiming Teng proposed openstack/senlin: Revise schema _validate_version  https://review.openstack.org/37457114:25
openstackgerritXueFeng Liu proposed openstack/senlin: Fix user/policy_types.rst error  https://review.openstack.org/37211614:25
openstackgerritQiming Teng proposed openstack/senlin: Not necessary to handle 'ResourceNotFound'  https://review.openstack.org/37450514:25
openstackgerritXueFeng Liu proposed openstack/senlin: Fix error in tutorial/receivers.rst  https://review.openstack.org/37316514:25
openstackgerritQiming Teng proposed openstack/senlin: Lighten the load  https://review.openstack.org/37451614:25
openstackgerritXueFeng Liu proposed openstack/senlin: Fix error in registry.py  https://review.openstack.org/37288614:26
*** ruijie has quit IRC14:26
openstackgerritXueFeng Liu proposed openstack/senlin: Fix cluster_check from health manage  https://review.openstack.org/36993714:26
openstackgerritQiming Teng proposed openstack/senlin: Modify eval status check  https://review.openstack.org/37409614:28
openstackgerritXueFeng Liu proposed openstack/senlin: Fix FEATURES.rst error  https://review.openstack.org/37284414:28
openstackgerritQiming Teng proposed openstack/python-senlinclient: Fix list of event with timestamp field  https://review.openstack.org/37412614:37
*** Drago has joined #senlin14:40
*** guoshan has quit IRC14:51
*** zhurong has quit IRC14:58
openstackgerritMerged openstack/senlin: Fix error in actions.rst  https://review.openstack.org/37293815:12
openstackgerritMerged openstack/senlin: Fix error in deletion_v1.rst  https://review.openstack.org/37313915:12
*** zigo_ is now known as zigo15:14
openstackgerritMerged openstack/senlin: Fix error in template.rst  https://review.openstack.org/37293915:33
openstackgerritMerged openstack/senlin: Fix a typo in template.rst  https://review.openstack.org/37358015:33
openstackgerritMerged openstack/senlin: fix typos in TODO.rst  https://review.openstack.org/37361315:43
openstackgerritMerged openstack/senlin: Fix user/policy_types.rst error  https://review.openstack.org/37211615:44
openstackgerritMerged openstack/senlin: Fix typos in api-ref/source/policies.inc  https://review.openstack.org/37391015:44
openstackgerritMerged openstack/senlin: Fix error in registry.py  https://review.openstack.org/37288615:44
openstackgerritMerged openstack/senlin: Fix FEATURES.rst error  https://review.openstack.org/37284415:44
openstackgerritMerged openstack/senlin: Fix error in tutorial/receivers.rst  https://review.openstack.org/37316515:52
openstackgerritMerged openstack/senlin: Replace 'MagicMock' with 'Mock'  https://review.openstack.org/37360715:53
*** zigo has quit IRC16:41
*** zigo has joined #senlin16:51
*** zigo is now known as Guest1865616:52
*** Guest18656 has quit IRC16:56
*** zigo_ has joined #senlin16:59
*** zigo_ has quit IRC17:07
*** zigo_ has joined #senlin17:11
*** zigo_ is now known as zigo19:30
*** Qiming has quit IRC21:37
*** AlexeyAbashkin has quit IRC21:37
*** chenfei has quit IRC21:37
*** zhenguo has quit IRC21:37
*** AlexeyAbashkin has joined #senlin21:38
*** chenfei has joined #senlin21:38
*** zhenguo has joined #senlin21:40
*** zhenguo has quit IRC21:40
*** Qiming has joined #senlin21:41
*** zhenguo has joined #senlin21:50
*** Drago has quit IRC22:51
*** zhurong has joined #senlin23:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!