Wednesday, 2018-09-26

*** pcaruana has joined #openstack-monasca04:14
*** pcaruana has quit IRC04:38
*** pcaruana has joined #openstack-monasca05:43
*** dpawlik has joined #openstack-monasca06:23
*** dougsz has joined #openstack-monasca08:07
openstackgerritDobroslaw Zybort proposed openstack/monasca-log-api master: Add tooling for building Docker image  https://review.openstack.org/57909208:38
*** witek_ has joined #openstack-monasca09:26
*** witek has quit IRC09:26
*** pcaruana has quit IRC11:15
*** pandy has joined #openstack-monasca11:31
*** dpawlik has quit IRC11:58
*** witek_ is now known as witek12:06
*** guimaluf has quit IRC12:21
*** guimaluf has joined #openstack-monasca12:26
*** witek has quit IRC13:52
*** bobh has joined #openstack-monasca14:08
*** bobh has quit IRC14:13
*** chaconpiza has quit IRC14:23
*** pandy has quit IRC14:28
*** bobh has joined #openstack-monasca14:35
openstackgerritDoug Szumski proposed openstack/monasca-specs master: Add Stein Monasca spec template  https://review.openstack.org/60544514:43
*** witek has joined #openstack-monasca14:47
witekCourtesy Monasca meeting reminder in #openstack-meeting-3: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz_,fouadben, amofakhar, aagate, haruki,kaiokmo,pandiyan,charana,guilhermesp,chaconpiza14:59
*** pandy has joined #openstack-monasca14:59
*** pcaruana has joined #openstack-monasca15:01
*** bobh has quit IRC15:03
*** bobh has joined #openstack-monasca15:17
*** dpawlik has joined #openstack-monasca15:32
*** dpawlik has quit IRC15:36
witekpandy: can you check if disabling `ping_checks` resolves the problme?16:01
*** koji_n has joined #openstack-monasca16:01
pandywitek, Yes, i did it and it slowed hit to Neutron API, would like to know do i need to turn off "vm_network_check_enable" "vm_ping_check_enable" also ?16:03
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L940-L94116:05
koji_nvm_ping_check_enable appears only here, so it seems no need to turn off vm_ping_check_enable if you turn off ping_check16:06
pandyAlso would like to know frequency interval of cache update of "libvirt-instances.json" & "libvirt-metrics.json" is it 4 hours interval or if i create new VM will it get updated immediately16:06
pandykoji_n, thanks :) understood. Even i dont have namespace method in my control plane https://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L18516:07
pandykoji_n, may i know whats the frequency interval of libvirt-instances.json" & "libvirt-metrics.json" is it 4 hours interval or if i create new VM will it get updated immediately under /dev/shm16:10
koji_nlet me see...16:10
pandyokay16:13
koji_nat a glance, you don't need turn off vm_network_check_enable to avoid to hit neutron API, but probably you cannot get the network information when you turn off ping_check16:13
pandymay i know what are metrics ping_check will collect ?16:14
koji_nsorry, i cannot tell it now16:15
pandyafter disabling "ping_checks" whether "vm_network_check_enable" will collect something ?16:15
koji_nbut probably the items related to 'instance_ports' cannot be collected16:15
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L37416:15
koji_ninstance_ports should be empty when turning off ping_checks16:16
pandyHow about "vm_network_check_enable" "m_ping_check_enable" values after turning off ping_checks16:17
pandywhether it will gives any values or set it to NULL or False, if True will it collect any metrics ?16:18
koji_nvm_ping_check_enable seems NOT to collect any metric when ping_check is turned off16:19
pandyHow about ""vm_network_check_enable"" ?16:20
koji_nvm_network_check_enable seems to collect some metrics, but i need to check it16:20
pandyokay, shall i conclude like if "ping_check" is turned off, will disable "vm_ping_check_enable"16:22
koji_nyes16:22
pandykoji_n, But would like to know how i can understand what are metrics will not collected when i turn off ping_check ?16:23
pandyhttps://github.com/openstack/monasca-agent/blob/master/docs/Libvirt.md#per-instance-metrics16:25
koji_ni need to check source code more...16:26
koji_ncan i answer it next weekly?16:27
pandysure thanks koji_n:)16:29
koji_nand another question, it seems that the new instance will be added soon16:29
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L779-L78916:29
pandyoh okay :)16:30
koji_ncheck method is called every 30 seconds, so it can be added in 30 seconds16:30
pandythis check method will hit Nova  & Keystone every 30 seconds if new instances is created isn't ?16:31
koji_nyes, i think so16:31
koji_nsorry, it's wrong16:32
pandyi think it getting updated how collect check_frequency value is set ?16:34
koji_nlibvirt plugin's check method always calls nova API (also keytone for authentication) even if there is no new instance16:34
koji_nand sorry again, 30 seconds means the frequency of agent run16:35
koji_nit's configurable in agent.yaml16:35
pandymay i know code where mentioned it as 30 seconds ?16:35
koji_nsorry, default value is 60 seconds16:36
pandyin my agent.yaml file i made check_frequency value to 30 seconds ( default 60 seconds )16:36
koji_nyes, that's it16:37
pandyyes, we are pointing same :)16:37
pandyHow frequently ping_checks does hit ? because by disabling it will loose network related metrics so16:37
pandyif there is any supported configuration to tune this ping_checks will be great16:38
koji_nso, as far as i checked, only here calls neutron API in libvirt plugin16:40
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L18716:40
koji_nand it's called when updating the instance cache16:40
pandyif i disable "ping_checks" this https://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L187 will update instance cache still ?16:41
koji_nin my understanding, ping_check calls neutron API every 4 hours basically, but it can be called when a new instance appears16:42
koji_nno, i don't thinks so16:43
pandyoh okay, what are the details ping_checks collects ?16:43
koji_nso, it's necessary for me to investigate more16:43
pandyso you mean, turning off ping_checks will stop updating instance cache instantly and need to wait to 4 hours ?16:44
koji_nno16:44
koji_nthe instance cache will be updated every 4 hours or when a new instance appears on that node16:45
koji_nin this timing, this method is called16:45
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L16416:45
koji_nand if you turn on ping_check, neutron API is also called in this method16:46
pandyi would like to understand little in detail, if you dont mind. Disabling "ping_checks" will affect instance_cache update ?  & what are the metrics or data will loose if i disable it16:46
koji_ndisabling "ping_check" will NOT affect the frequency/timing of updating instance cache, but it will affect the contents of instance cache, i think16:48
koji_nthe metrics you'll loose should be related to this two items16:49
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L19316:49
koji_nhttps://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L19616:49
koji_nbut i cannot tell the exact metric names at this moment16:49
koji_nneed to check source code more16:49
*** dougsz has quit IRC16:49
pandyport_cache & net_ns will fail to collect data16:50
koji_nyes16:50
pandybecause of this my instance cache content will be affected in what manner ?16:51
pandyI don't have network namespace in my compute node idealy.16:52
koji_nwhat do you mean?16:53
pandywhat issue will happen to content of instance-cache if port_cache & net_ns fails to collect data ?16:54
koji_nso, you cannot get some metrics16:55
koji_nbut as i said, i cannot answer what metrics you'll loos today16:55
pandyas per code, port_cache will build list of Neutron Ports  am i right ? what net_ns will do if i dont have network namespace16:56
pandywil it result me "Unable to ping VMs, no network namespaces found, Either no VMs are present, or routing is centralized'16:57
koji_nsorry, i have no idea about it...16:57
pandyokay, i am concluding it, disabling "ping_checks" will stop hit neutron and also affect contents of instance_cache in particular to port_cache & net_ns16:58
koji_nyes, i think so16:58
pandyokay, let me know what are metrics will be affected by this once you find time :)16:59
koji_nbut i just have a glance source code, so let me check it more16:59
pandyor give me hint metrics dependency with code, so i do reverse engineering and try to find17:00
koji_ni'll try to do it in next weekly17:00
pandy:)17:00
pandyokay thanks a lot :) :) :)17:00
koji_nnp:)17:00
pandythanks witek :)17:00
koji_nit's 2:00 am on my time, i'm sleeping...17:01
pandyGood night :)17:01
koji_nif you have any additional questions, feel free to send a mail to me or witek17:02
koji_ngood night17:02
*** koji_n has quit IRC17:02
*** pandy has quit IRC17:02
*** dpawlik has joined #openstack-monasca17:16
*** dpawlik has quit IRC17:16
*** dpawlik has joined #openstack-monasca17:17
*** dpawlik has quit IRC17:47
*** dpawlik has joined #openstack-monasca18:21
*** pcaruana has quit IRC18:24
*** dpawlik has quit IRC18:25
*** bobh has quit IRC20:59
openstackgerritJoseph Davis proposed openstack/monasca-specs master: Metrics retention policy enhancement, python persister perf  https://review.openstack.org/54723321:23
*** bobh has joined #openstack-monasca21:35
*** bobh has quit IRC21:40
*** dpawlik has joined #openstack-monasca22:48
*** dpawlik has quit IRC22:52
*** openstackgerrit has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!