Wednesday, 2018-12-05

*** pabelanger has joined #openstack-ansible00:00
*** jawad_axd has quit IRC00:02
*** priteau has joined #openstack-ansible00:04
kaiokmoderks: congratz :)00:07
*** priteau has quit IRC00:09
*** mma has joined #openstack-ansible00:11
*** mma has quit IRC00:17
*** DanyC has quit IRC00:17
redkriegadmin0: ansible exited successfully but I'm still having problems with instance creation.  fails to bind to the port :\00:18
redkriegI'm going to have another go at it tomorrow with data from your link earlier, maybe something to do with my br-vlan and/or br-vxlan bridges00:19
openstackgerritShangXiao proposed openstack/openstack-ansible-os_almanach master: Add bugs url link to README  https://review.openstack.org/62212600:25
openstackgerritShangXiao proposed openstack/openstack-ansible-lxc_container_create master: Add bugs url link to README  https://review.openstack.org/62211700:26
openstackgerritShangXiao proposed openstack/openstack-ansible-os_almanach master: Add bugs url link to README  https://review.openstack.org/62212600:27
openstackgerritMerged openstack/openstack-ansible-os_zun master: Add bugs url link to README  https://review.openstack.org/62219300:30
openstackgerritMerged openstack/openstack-ansible-os_rally master: Add bugs url link to README  https://review.openstack.org/62216300:32
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Add bugs url link to README  https://review.openstack.org/62218400:32
*** gyee has quit IRC00:33
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Add bugs url link to README  https://review.openstack.org/62213200:34
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Add bugs url link to README  https://review.openstack.org/62219000:34
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Add bugs url link to README  https://review.openstack.org/62215600:34
openstackgerritMerged openstack/openstack-ansible-galera_client master: Add bugs url link to README  https://review.openstack.org/62214200:34
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Add bugs url link to README  https://review.openstack.org/62218600:34
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: Add bugs url link to README  https://review.openstack.org/62218100:34
openstackgerritMerged openstack/openstack-ansible-galera_server master: Add bugs url link to README  https://review.openstack.org/62213700:36
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Add bugs url link to README  https://review.openstack.org/62216000:37
openstackgerritMerged openstack/openstack-ansible-pip_install master: Add bugs url link to README  https://review.openstack.org/62218200:37
openstackgerritMerged openstack/openstack-ansible-ops master: Add bugs url link to README  https://review.openstack.org/62212800:37
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Add bugs url link to README  https://review.openstack.org/62215800:37
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Add bugs url link to README  https://review.openstack.org/62214900:37
*** rodolof has joined #openstack-ansible00:37
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Add bugs url link to README  https://review.openstack.org/62217900:37
openstackgerritMerged openstack/openstack-ansible-os_nova master: Add bugs url link to README  https://review.openstack.org/62215400:37
openstackgerritMerged openstack/openstack-ansible-os_glance master: Add bugs url link to README  https://review.openstack.org/62217800:37
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Add bugs url link to README  https://review.openstack.org/62213300:38
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Add bugs url link to README  https://review.openstack.org/62212400:38
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Add bugs url link to README  https://review.openstack.org/62213100:41
*** ansmith has joined #openstack-ansible00:41
openstackgerritMerged openstack/openstack-ansible-os_heat master: Add bugs url link to README  https://review.openstack.org/62216400:41
*** weezS has quit IRC00:46
openstackgerritMerged openstack/openstack-ansible-os_swift master: fix 'an unique' to 'a unique'  https://review.openstack.org/61984500:52
openstackgerritMerged openstack/openstack-ansible-repo_server master: Add bugs url link to README  https://review.openstack.org/62216800:57
*** ansmith has quit IRC01:07
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_cloudkitty master: Update mailinglist from dev to discuss  https://review.openstack.org/62178101:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_watcher master: Update mailinglist from dev to discuss  https://review.openstack.org/62178501:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_zaqar master: Update mailinglist from dev to discuss  https://review.openstack.org/62176801:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_searchlight master: Update mailinglist from dev to discuss  https://review.openstack.org/62177901:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-specs master: Update mailinglist from dev to discuss  https://review.openstack.org/62178601:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-openstack_openrc master: Update mailinglist from dev to discuss  https://review.openstack.org/62178401:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_barbican master: Update mailinglist from dev to discuss  https://review.openstack.org/62177701:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_trove master: Update mailinglist from dev to discuss  https://review.openstack.org/62176101:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_gnocchi master: Update mailinglist from dev to discuss  https://review.openstack.org/62177401:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_sahara master: Update mailinglist from dev to discuss  https://review.openstack.org/62177801:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_designate master: Update mailinglist from dev to discuss  https://review.openstack.org/62174901:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-lxc_hosts master: Update mailinglist from dev to discuss  https://review.openstack.org/62175801:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_ceilometer master: Update mailinglist from dev to discuss  https://review.openstack.org/62176601:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-repo_build master: Update mailinglist from dev to discuss  https://review.openstack.org/62177201:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-ceph_client master: Update mailinglist from dev to discuss  https://review.openstack.org/62177501:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_neutron master: Update mailinglist from dev to discuss  https://review.openstack.org/62175101:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_ironic master: Update mailinglist from dev to discuss  https://review.openstack.org/62175901:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_monasca-agent master: Update mailinglist from dev to discuss  https://review.openstack.org/62176401:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-apt_package_pinning master: Update mailinglist from dev to discuss  https://review.openstack.org/62178701:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_zun master: Update mailinglist from dev to discuss  https://review.openstack.org/62174101:16
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_cinder master: Update mailinglist from dev to discuss  https://review.openstack.org/62175301:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-nspawn_hosts master: Update mailinglist from dev to discuss  https://review.openstack.org/62175501:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-repo_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62177101:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-ops master: Update mailinglist from dev to discuss  https://review.openstack.org/62174301:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-memcached_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62176901:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_horizon master: Update mailinglist from dev to discuss  https://review.openstack.org/62176501:17
openstackgerritzhongshengping proposed openstack/openstack-ansible-os_nova master: Update mailinglist from dev to discuss  https://review.openstack.org/62179401:17
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882001:38
*** jamesdenton has joined #openstack-ansible01:46
jamesdentonevenin'01:48
mnaserhiya jamesdenton01:57
kaiokmoo/01:59
*** DoberMann has quit IRC02:10
jamesdentonheya02:11
jamesdentonhadn't seen you around these parts lately, mnaser02:12
mnaserjamesdenton: been fighting fires :)02:12
jamesdentoni'm all too familiar with that02:12
mnaserjamesdenton: as a matter of fact having fun with 'vhost' process in an ovs deployment taking up a lot of cpu02:13
mnaser*and* another deployment where openvswitch agent is taking up 1200% cpu02:13
jamesdentonthat's concerning02:14
jamesdentoni was just thinking of that situation tonight, when i managed to creating a bridging loop inside a VM02:14
jamesdentonany luck so far?02:15
*** mma has joined #openstack-ansible02:17
*** mma has quit IRC02:22
*** cshen has quit IRC02:27
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882002:27
mnaserjamesdenton: upgrading kernel to see re: the high vhost cpu02:28
mnaserit's slowly climbing but we'll see if its better ovall02:28
jamesdentonwhat are you currently on? kernel and ovs versions?02:28
mnaserregarding neutron-openvswitch-agent doing 1600% cpu? i have no f'n idea.  it even does it on a *fresh* deploy with 0 ports on02:28
mnaserjamesdenton: for the vhost issue, im working with `3.10.0-957.1.3.el7.x86_64` .. for the ovs highcpu, thats on latest bionic, dont have the #'s easily accesisble02:29
mnaserthat'd involve finding a hardware token and its too late for that :P02:29
jamesdentonyou centos people02:29
mnaser:(02:31
mnaserit's enterprise, right?02:31
jamesdentonright02:31
mnaserjamesdenton: i mean i havent had TOO many issues in general, but there are these outliers here and there02:32
jamesdentoni take it you're running rocky on bionic, then? in production?02:35
mnaserjamesdenton: yep, not @ vexxhost but at another env02:41
jamesdentongotcha02:41
mnaservexxhost is running queens in one region and rocky in another region both on centso02:41
jamesdentondo you have any legacy stuff or is it all pretty current?02:42
mnaserjamesdenton: oldest thing i have to manage is queens :D02:43
mnaser(yay)02:43
jamesdentonluckyyyyy02:43
mnaserand that's just pending for a customer to move off glance v102:43
mnaserwe pretty much help them port their code to be able to upgrade02:43
mnaseronly way we can get away with upgrading :)02:43
* jamesdenton cries thinking of that one Havana environment still in use02:43
*** jawad_axd has joined #openstack-ansible02:43
mnaserbless you02:44
mnaserthats rough02:44
jamesdentonjust don't look it too long02:44
mnasertfw every single issue you run into is already fixed02:44
mnaser:(02:44
jamesdentonhaha exactly. fixed 4 years ago02:45
jamesdentonit's all good02:45
mnaseranyways, have a 9am meeting tomorrow and im still in the office so02:45
mnaseri shall run off :)02:46
mnasertake care jamesdenton , good chatting with ya02:46
jamesdentonyep - get on with it. see ya later02:46
kaiokmohave a good one mnaser02:46
guilhermespit's too early mnaser :)02:46
jamesdentongood luck with the OVS stuffs02:46
mnaseri'm only driving home..02:46
mnaseri'll probably get dragged into something surely :P02:46
* mnaser has totally looked at gate logs on an iphone scree nbefore02:46
jamesdentonthere's no shame in that02:47
*** jawad_axd has quit IRC02:48
*** jawad_axd has joined #openstack-ansible03:04
*** jawad_axd has quit IRC03:09
openstackgerritjacky06 proposed openstack/openstack-ansible-galera_client master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264403:09
openstackgerritjacky06 proposed openstack/openstack-ansible-ceph_client master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264303:09
openstackgerritjacky06 proposed openstack/openstack-ansible-haproxy_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264503:10
openstackgerritjacky06 proposed openstack/openstack-ansible master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264603:10
openstackgerritjacky06 proposed openstack/openstack-ansible-apt_package_pinning master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264703:10
openstackgerritjacky06 proposed openstack/openstack-ansible-galera_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264803:10
openstackgerritjacky06 proposed openstack/openstack-ansible-lxc_hosts master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62264903:10
openstackgerritjacky06 proposed openstack/openstack-ansible-lxc_container_create master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265003:10
openstackgerritjacky06 proposed openstack/openstack-ansible-nspawn_hosts master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265103:10
openstackgerritjacky06 proposed openstack/openstack-ansible-nspawn_container_create master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265203:10
openstackgerritjacky06 proposed openstack/openstack-ansible-memcached_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265303:10
openstackgerritjacky06 proposed openstack/openstack-ansible-openstack_hosts master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265403:10
openstackgerritjacky06 proposed openstack/openstack-ansible-openstack_openrc master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265503:10
openstackgerritjacky06 proposed openstack/openstack-ansible-ops master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265603:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_aodh master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265703:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_ceilometer master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265803:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_barbican master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62265903:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_cloudkitty master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266003:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_cinder master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266103:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_designate master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266203:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_glance master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266303:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_gnocchi master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266403:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_heat master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266503:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_horizon master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62266603:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_sahara master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268203:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_trove master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268303:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_tempest master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268403:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_swift master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268503:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_zaqar master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268603:10
openstackgerritjacky06 proposed openstack/openstack-ansible-os_zun master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268703:10
openstackgerritjacky06 proposed openstack/openstack-ansible-pip_install master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268803:10
openstackgerritjacky06 proposed openstack/openstack-ansible-plugins master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62268903:10
openstackgerritjacky06 proposed openstack/openstack-ansible-rabbitmq_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269003:10
openstackgerritjacky06 proposed openstack/openstack-ansible-repo_build master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269103:10
openstackgerritjacky06 proposed openstack/openstack-ansible-repo_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269203:10
openstackgerritjacky06 proposed openstack/openstack-ansible-rsyslog_client master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269303:10
openstackgerritjacky06 proposed openstack/openstack-ansible-rsyslog_server master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269403:10
openstackgerritjacky06 proposed openstack/openstack-ansible-specs master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269503:10
openstackgerritjacky06 proposed openstack/openstack-ansible-tests master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62269603:10
*** jawad_axd has joined #openstack-ansible03:25
*** jawad_axd has quit IRC03:29
prometheanfiredoes os_nova run libvirt code (can requirements cross gate on it)?03:53
*** rodolof has quit IRC03:57
jamesdentonmbuil_ I have to wonder if these sfc commands in the openstack/neutron client have been tested in a while. https://bugs.launchpad.net/python-neutronclient/+bug/180197004:01
openstackLaunchpad bug 1801970 in python-neutronclient "python-neutron client sfc port pair operations fail" [Undecided,New]04:01
*** rodolof has joined #openstack-ansible04:19
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882004:44
*** rodolof has quit IRC04:55
*** faizy98 has joined #openstack-ansible05:07
*** priteau has joined #openstack-ansible05:08
*** faizy98 has quit IRC05:09
*** faizy98 has joined #openstack-ansible05:09
*** faizy98 has quit IRC05:10
*** faizy98 has joined #openstack-ansible05:10
*** faizy98 has quit IRC05:11
*** faizy98 has joined #openstack-ansible05:12
*** priteau has quit IRC05:12
*** faizy_ has joined #openstack-ansible05:15
*** faizy98 has quit IRC05:17
*** ahosam has joined #openstack-ansible05:37
*** radeks__ has joined #openstack-ansible06:11
*** mma has joined #openstack-ansible06:12
*** mma has quit IRC06:16
*** mma has joined #openstack-ansible06:35
*** mma has quit IRC06:40
*** arbrandes1 has joined #openstack-ansible07:01
*** arbrandes has quit IRC07:04
*** pcaruana has joined #openstack-ansible07:10
*** ahosam has quit IRC07:15
*** jawad_axd has joined #openstack-ansible07:21
*** cshen has joined #openstack-ansible07:33
*** jawad_axd has quit IRC07:33
openstackgerritShangXiao proposed openstack/openstack-ansible-tests master: Add bugs url link to README  https://review.openstack.org/62286307:37
openstackgerritShangXiao proposed openstack/openstack-ansible-repo_build master: Add bugs url link to README  https://review.openstack.org/62286407:40
openstackgerritShangXiao proposed openstack/openstack-ansible-plugins master: Add code source link and bugs link to README  https://review.openstack.org/62286707:45
openstackgerritShangXiao proposed openstack/openstack-ansible-os_octavia master: Add bugs url link to README  https://review.openstack.org/62286807:49
*** mma has joined #openstack-ansible07:50
openstackgerritShangXiao proposed openstack/openstack-ansible-openstack_openrc master: Add bugs url link to README  https://review.openstack.org/62287007:52
*** mma has quit IRC07:55
*** mma has joined #openstack-ansible07:56
openstackgerritShangXiao proposed openstack/openstack-ansible-nspawn_container_create master: Add bugs url link to README  https://review.openstack.org/62287307:56
openstackgerritShangXiao proposed openstack/openstack-ansible-ceph_client master: Add bugs url link to README  https://review.openstack.org/62287507:59
*** ahosam has joined #openstack-ansible08:02
jrosserMorning08:12
MiougeGood morning!08:12
* jrosser wonders if centos is fixed yet....08:13
jrosserAh maybe https://github.com/CentOS/sig-cloud-instance-images/commit/a77b36c6c55559b0db5bf9e74e61d32ea709a179#diff-05b6053c41a2130afd6fc3b158bda4e608:15
openstackgerritShangXiao proposed openstack/openstack-ansible-os_blazar master: Add bugs url link to README  https://review.openstack.org/62288108:18
*** spatel has joined #openstack-ansible08:19
*** spatel has quit IRC08:19
*** priteau has joined #openstack-ansible08:21
openstackgerritShangXiao proposed openstack/openstack-ansible-os_congress master: Add bugs url link to README  https://review.openstack.org/62288308:21
*** lumir_ has quit IRC08:21
*** faizy_ has quit IRC08:22
*** faizy98 has joined #openstack-ansible08:30
*** cshen has quit IRC08:34
*** faizy_ has joined #openstack-ansible08:41
*** faizy98 has quit IRC08:43
*** dodo_o has joined #openstack-ansible08:49
*** tosky has joined #openstack-ansible08:50
*** fresta has quit IRC08:50
*** fresta has joined #openstack-ansible08:51
*** gkadam has joined #openstack-ansible08:52
*** cshen has joined #openstack-ansible08:53
*** sum12 has quit IRC08:55
*** shardy has joined #openstack-ansible09:00
*** cshen_ has joined #openstack-ansible09:00
*** cshen has quit IRC09:02
*** faizy98 has joined #openstack-ansible09:06
*** faizy_ has quit IRC09:09
*** DanyC has joined #openstack-ansible09:14
*** DanyC has quit IRC09:16
*** DanyC has joined #openstack-ansible09:17
*** sum12 has joined #openstack-ansible09:23
*** trident has quit IRC09:29
*** trident has joined #openstack-ansible09:31
*** ppetit has joined #openstack-ansible09:42
*** ppetit has quit IRC09:45
odyssey4mejrosser yeah, looks like the images are updated: https://github.com/CentOS/sig-cloud-instance-images/commit/a77b36c6c55559b0db5bf9e74e61d32ea709a17909:59
odyssey4methanks for the heads-up mnaser :)09:59
*** gisak has joined #openstack-ansible10:07
jrosserodyssey4me: looks like there is something else lurking wrt centos http://logs.openstack.org/41/621541/2/check/openstack-ansible-deploy-aio_lxc-centos-7/2f236ff/job-output.txt.gz#_2018-12-05_08_53_40_00486110:09
jrossersame symptom though10:09
odyssey4meyeah, perhaps we need to update a URL or something10:10
jrosserhmmm https://github.com/openstack/openstack-ansible-lxc_hosts/blob/df71862a17e2ab66b84f50ef1f71b5911f70e928/vars/redhat-7.yml#L1610:11
jrossersad thats not a versioned filename10:14
*** gisak has quit IRC10:17
*** ahosam has quit IRC10:20
*** ygk_12345 has joined #openstack-ansible10:24
*** gisak has joined #openstack-ansible10:25
gisakgood day guys10:25
gisakgot an interesting question :)10:26
ygk_12345hi all10:26
ygk_12345the OSA is not insntalling keepalived service when running the haproxy playbook10:26
ygk_12345can anyon ehelp m please10:26
ygk_12345*help me10:26
odyssey4meygk_12345 have you provided any information to inform it to?10:26
gisakwhere to seek for the mistake: made an external network, created a router and assigned floating IPs for some instances, but the network is unreacheable from extern10:27
odyssey4methe example production configuration in the user guide gives you the details10:27
ygk_12345odyssey4me: where exactly ?10:27
ygk_12345odyssey4me: in the user_variables file ?10:27
odyssey4meygk_12345 https://docs.openstack.org/openstack-ansible/rocky/user/prod/example.html#user-variables10:27
ygk_12345odyssey4me: yes I have done that10:28
gisakwhich logs should i watch to find the problem? its very strange thing why network is unreachable, even router's IP is unreachable10:28
ygk_12345odyssey4me: no matter how many times I reinstall it is not installingn keepalived10:28
odyssey4meygk_12345 then you'll need to look in detail at what's happening when the haproxy playbook executes, and follow the code to understand where it's going wrong10:29
odyssey4meSorry, I'm not in a position to guide you step by step for it. I'm tied up with other work.10:29
ygk_12345odyssey4me: its ok thanks10:30
ygk_12345it is showing this10:30
odyssey4mejrosser I think the worst may be that this will break centos 7.5 builds too - because there'll be a mix and match10:30
ygk_12345TASK [keepalived : Check if keepalived is already installed]  skipping: [c1]10:30
odyssey4meygk_12345 please use a paste service for logs10:30
ygk_12345odyssey4me: sure10:31
jrosserodyssey4me: yes it sould really be reading the minor version of the host (or something) and constructing the image name in a smart way10:31
odyssey4mewell, I've been threatening to replace the whole way the image build works with diskimage-builder... that really is something that must get done in stein - I've done a bunch of ground work and got it merged upstream... I just need to get on with doing it in OSA now10:33
Miougeygk_12345: can you also dump your user_variables and openstack_user_config files?10:39
ygk_12345Miouge: i got the issue now. thank. I missed the variable to specify haproxy to use keepalived boolean10:44
*** ygk_12345 has quit IRC10:49
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: WIP: Better tempest black and whitelist management  https://review.openstack.org/62160510:52
*** sep has quit IRC10:53
*** sep has joined #openstack-ansible10:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/62148610:55
jrossergisak: there are some guides for network debugging here https://docs.openstack.org/openstack-ansible/latest/admin/troubleshooting.html#troubleshooting-instance-connectivity-issues11:12
jrosserand the various neutron logs on your controller/network nodes are probably the place to start11:13
odyssey4mejrosser looks like it's working now - so it's all about rechecks: https://review.openstack.org/62255111:25
admin0how to say that only agents need to be in compute, but neutron server in controller11:38
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/62148611:38
admin0sorry .. network_hosts .. i want to have neutron-server run in infra, but the agents run in compute on metal11:39
jrosserwhy does haproxy_server set the rise/fall count to be the number of backend nodes, that seems curious particularly if the number of backends is large11:45
admin0never mind .. found it11:48
*** gisak has quit IRC11:49
*** ahosam has joined #openstack-ansible11:50
odyssey4mejrosser I have no idea. It might have just seemed like a good idea at the time. :p11:57
admin0anyone up and running with rocky ?11:59
admin0all works :D ?11:59
odyssey4meadmin0 well, mnaser has been using it since before the release - but of course a bunch of patches came in as a result of it... so the more users we get on it, the more we get bugs reported and fixed12:00
jrosseri'm running rocky - no disasters so far12:00
admin0was it a new or an upgrade,  jrosser ?12:00
jrosserand Q->R was mostly ok12:00
jrosserupgrade12:00
admin0"mostly" -- any hiccups ?12:01
jrossera few small things which were basically changed/removed vars that more thorough reading of the release notes would have shown up anyway iirc12:01
*** ansmith has joined #openstack-ansible12:02
admin0ok12:06
*** ansmith has quit IRC12:13
jamesdentonmornin'12:15
admin0\o12:19
*** dave-mccowan has joined #openstack-ansible12:23
*** ahosam has quit IRC12:25
*** dave-mccowan has quit IRC12:27
jamesdentonmbuil_ have a sec to talk sfc?12:32
mbuil_jamesdenton: yes, although I need to leave in 10 min for lunch12:33
jamesdentonahh, well i will make it quick. curious to know the workflow for implementing the chain (just in general). Is the VNF typically a bump-in-the-wire or a tap/span (IDS)?12:34
jamesdentonand this may be a larger discussion to be had post-lunch :)12:37
mbuil_jamesdenton: you can have both, depends on the use case. bump-in-the-wire normally means that traffic is accessed through port A and leaves from port B, that needs to be implemented in the SFC logic (e.g. ODL has the feature)12:38
guilhermespodyssey4me: https://review.openstack.org/#/c/618820/ :D12:39
guilhermespstill have some work, like use your rabbitmq pr for os_kesytone and figure out why openstack-ansible-functional-distro_install-opensuse-150 is failing12:40
kaiokmoguilhermesp: w00t12:40
mbuil_jamesdenton: One widely known use case is having a chain that makes the traffic be processed by a VNF which is a sniffer (DPI, deep packet inspection, I think is the term). That one classifies the traffic depending on the data into different chains. For example, if it detects illegal content then the traffic will go through a chain that has VNFs doing firther packet inspection, logging things, perhaps moving them to quarentine...12:41
jamesdentonit looks like i might be able to do the same thing with the ovs implementation, but a) trying to figure out how to handle the passthrough inside the vnf and b) need to ensure the return traffic comes back thru the vnf. Basically, I've shifted classified traffic from my vm to the vnf, but am not getting the return traffic back12:41
jamesdentonahh ok, i got ya12:41
mbuil_jamesdenton: another known use case is having two chains and classifying based on source mac address. If the mac belongs to a device from the children, then the traffic is first forwarded to a parental control VNF. If not, then it goes directly to the typical internet processing (NAT, maybe HTTP Header enrichment, caching...)12:43
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-haproxy_server master: Allow user defined options for the backend servers  https://review.openstack.org/62295212:44
mbuil_jamesdenton: when you don't have SFC, either you forward ALL traffic to parental control and then this one must classify (you need a beefy VNF) or you add very specific routing rules (incrementing the complexity)12:44
jamesdentonmbuil_ are you currently using the openstack client/api with odl backend?12:44
kaiokmoguilhermesp: you need to add vars/suse.yml for suse12:45
mbuil_jamesdenton: I think the openstack guys do the testing with a ovs in the VNF which just forwards packets back to the same interface but I am not 100% sure yet12:45
mbuil_jamesdenton: so, I think similar to what you are trying12:46
jamesdentonk12:46
mbuil_jamesdenton: yes. openstack client with odl backend12:46
kaiokmoguilhermesp: 'Gather variables' will need it, otherwise it will keep failing for suse12:46
mbuil_n-sfc propagates the config to ODL through the odl driver https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/neutron.conf.j2#L272-L27612:46
jamesdentonright, ok12:48
jamesdentonwell, so your patches worked great. there are just some bugs in the neutron client breaking the workflow.12:48
jamesdentonbut if you can get past that, it just comes down to properly building out port groups and making sure the VNF doesn't create bridging loops :D12:49
mbuil_jamesdenton: neutron client problems? oh dear, I must check that. OH! I am using the neutron pythong library12:50
mbuil_jamesdenton: what errors you see?12:50
mbuil_lunch time, be back in an hour12:50
jamesdentonmbuil_ https://bugs.launchpad.net/python-neutronclient/+bug/180197012:51
openstackLaunchpad bug 1801970 in python-neutronclient "python-neutron client sfc port pair operations fail" [Undecided,New]12:51
jamesdentonsounds good12:51
guilhermespwill take a look, thanks kaiokmo12:54
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882012:57
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: gnocchi_resources override fixed  https://review.openstack.org/62295612:59
odyssey4meguilhermesp nice - it's getting there!12:59
guilhermespodyssey4me: almost there o/13:00
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: gnocchi_resources override fixed  https://review.openstack.org/62295613:01
*** strattao has joined #openstack-ansible13:05
openstackgerritPaul Martin proposed openstack/openstack-ansible-os_nova master: Prevent using spice console on arm64  https://review.openstack.org/62295913:06
*** cshen_ has quit IRC13:12
*** udesale has joined #openstack-ansible13:26
*** vnogin has joined #openstack-ansible13:40
kaiokmoguilhermesp: suse-423 succeeded w00t13:44
*** ansmith has joined #openstack-ansible13:45
guilhermespnice kaiokmo it's time to break things in rabbitmq removal :)13:46
*** priteau has quit IRC13:50
*** vnogin has quit IRC13:51
*** vnogin has joined #openstack-ansible13:56
mbuil_jamesdenton: thanks. I actually saw that and when installing "pip install networking-sfc" it was gone. Not sure why14:01
jamesdentonhmm. you're saying you had the same errors but when installing that package they went away14:02
*** priteau has joined #openstack-ansible14:04
*** rodolof has joined #openstack-ansible14:05
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882014:11
*** vnogin has quit IRC14:28
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: gnocchi_resources override fixed  https://review.openstack.org/62295614:32
*** vnogin has joined #openstack-ansible14:35
openstackgerritMarc GariĆ©py (mgariepy) proposed openstack/openstack-ansible-os_neutron master: Add app-ovn.rst to index in documentation  https://review.openstack.org/62297814:36
mgariepyeasy one ^^ if 2 cores are available.14:37
openstackgerritMichael Vollman proposed openstack/openstack-ansible-ops master: Add missing prometheus port for ceph auto discover  https://review.openstack.org/61737514:37
*** vnogin has quit IRC14:40
openstackgerritPaul Martin proposed openstack/openstack-ansible-os_nova master: If nova is installed on arm64 with active KVM, default to that.  https://review.openstack.org/62298114:41
chandan_kumarodyssey4me: Hello14:41
chandan_kumarodyssey4me: tempest run uses -r <list of tests to run> and --black-regex to skip the tests14:41
mgariepyjamesdenton, do you have ovn in production somewhere ?14:42
chandan_kumarodyssey4me: but here https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L89  we have tempest whitelist file pathc and black list file path which is correct14:42
jamesdentonmgariepy production? no.14:43
chandan_kumarodyssey4me: but https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L95 temoest_test_whitelist /tempest_test_blacklist should be tempest_regex /test_black_Regex na?14:43
*** hamzaachi has joined #openstack-ansible14:43
chandan_kumarodyssey4me: whitelist file and blacklist file should use the file patch and nothing else14:43
jamesdentoni hope to have some patches up for the raft ha configuration. and then solicit any feedback i can get14:44
chandan_kumar*path14:44
mgariepyok14:44
chandan_kumarodyssey4me: what you sat?14:44
chandan_kumarsay?14:44
odyssey4mechandan_kumar we're only passing the whitelist/blacklist file - the file can contain regex or not14:44
mgariepyi think i'll start playing with it on my testbed to see what i find.14:45
*** vnogin has joined #openstack-ansible14:46
*** vnogin has quit IRC14:46
guilhermespodyssey4me: huum, depends-on not working? http://logs.openstack.org/20/618820/47/check/openstack-ansible-functional-centos-7/31f81eb/ara-report/result/4e31cb35-cba1-4094-b2d3-c35c1997e98f/14:46
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/pike: Add ability for HTTP access to horizon  https://review.openstack.org/62255214:46
odyssey4mechandan_kumar every list entry in tempest_test_whitelist is put into the whitelist file at the specified path, same with the blacklist14:46
chandan_kumarodyssey4me: yes I am getting but based on name (test_regex/test_black_regex used in tempest )so I was confused as we are dumping tests in a file and then running it so asked14:48
chandan_kumarodyssey4me: anyway I need to add a feature in os_tempest which i discovered in a situation on tripleo side on making sure if all the whitelist tests is in skip list then fail the tempest there itself14:50
*** rjgibson has joined #openstack-ansible14:53
odyssey4mechandan_kumar I don't think I understand the problem.14:54
odyssey4meguilhermesp hmm, that's odd - let me revise that patch again14:54
chandan_kumarodyssey4me: let me propose the patch14:55
chandan_kumarodyssey4me: for example we are keeping a series of blacklist test in os_tempest role in which foobar and alpha was also there, at some place we try to run the tempest with foobar and alpha test then tempest fails to run because both are in skip list user generally get confused that time why the tests does not run as tempest has not receoved any regex to run the test14:57
chandan_kumarodyssey4me: I am thinking of adding a precheck for the same before running and aborting tempest run saying no tests were there for running.14:57
chandan_kumarodyssey4me: https://launchpad.net/bugs/1803547 was one of the example14:59
openstackLaunchpad bug 1803547 in tripleo "tempest run failed with 'The specified regex doesn't match with anything ' on tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Fix released] - Assigned to chandan kumar (chkumar246)14:59
*** vakuznet has joined #openstack-ansible15:00
chandan_kumarodyssey4me: what do you think?15:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Allow messaging to be disabled  https://review.openstack.org/62255115:04
odyssey4meguilhermesp ^ that should prove if it's working ir not15:04
guilhermespnice odyssey4me lemme recheck15:05
odyssey4mechandan_kumar ok, although the tempest reult should say that it failed because there were no tests to run - so adding another test beforehand is a dfuplication15:05
chandan_kumarodyssey4me: tempest just returns this 'The specified regex doesn't match with anything ' so enduser get confused what actually happened there15:07
chandan_kumarthis message is coming from stestr runner15:07
ansmithodyssey4me: I checked out ^^^, not sure i understand what you are looking for...inhibit the configuration or try to turn off messaging?15:08
odyssey4mechandan_kumar that still sounds reasonably sensible, although if you can figure out how to do a pre-test, that's fine... I'm not entirely sure how ou'd go about doing so15:08
odyssey4meansmith both, actually15:08
ansmithodyssey4me: wouldn't the tests need the other services to have messaging running?15:11
ansmithor am I missing something15:11
odyssey4meansmith keystone, swift, placement and some others do not use any form of meesaging (or do not require it)15:12
*** cshen has joined #openstack-ansible15:13
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for running tempestconf from rpm  https://review.openstack.org/62299915:17
*** DanyC has quit IRC15:17
*** hamzaachi has quit IRC15:22
*** DanyC has joined #openstack-ansible15:23
*** DanyC has quit IRC15:24
*** DanyC has joined #openstack-ansible15:24
*** hwoarang has joined #openstack-ansible15:27
logan-reviews on https://review.openstack.org/#/q/starredby:logan2211%2540gmail.com+status:open+project:%255Eopenstack/openstack-ansible-.* will be appreciated15:30
openstackgerritmelissaml proposed openstack/ansible-hardening master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62300415:31
guilhermespodyssey4me: we have the first results of my recheck http://logs.openstack.org/20/618820/47/check/openstack-ansible-functional-opensuse-423/de9e62f/ara-report/result/e4c68dbc-45b5-4d12-b1fe-4bf9af975d95/15:36
*** weezS has joined #openstack-ansible15:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Allow messaging to be disabled  https://review.openstack.org/62255115:53
*** vakuznet has quit IRC16:05
*** spatel has joined #openstack-ansible16:06
*** mma has quit IRC16:10
*** pcaruana has quit IRC16:18
*** mma has joined #openstack-ansible16:20
*** mma has quit IRC16:25
*** gyee has joined #openstack-ansible16:34
jrosserodyssey4me: i don't think we're in a good place yet with centos - it looks like 7.5 hosts with 7.6 containers failing now? i'm confused.....16:36
odyssey4mejrosser yeah, I'm not sure - I think we might be hitting some hosts where everything's fine and others where it is not - it may take another day to burn through the older ones16:37
*** cshen has quit IRC16:46
*** udesale has quit IRC16:46
*** udesale has joined #openstack-ansible16:47
*** cshen has joined #openstack-ansible16:51
*** priteau has quit IRC16:59
*** priteau has joined #openstack-ansible17:00
*** priteau has quit IRC17:05
*** priteau has joined #openstack-ansible17:07
*** priteau has quit IRC17:08
*** priteau has joined #openstack-ansible17:09
*** shardy has quit IRC17:11
*** strattao has quit IRC17:11
*** shardy has joined #openstack-ansible17:13
mnaserodyssey4me: its probably because some clouds dont have 7.6 images and other that maybe do17:14
mnaseri can try to talk to infra17:14
mnaserCollecting systemd_python==234 (from -c http://172.29.236.100:8181/os-releases/19.0.0.0b1/centos-7.6-x86_64/requirements_absolute_requirements.txt (line 11))\n  Downloading http://mirror.dfw.rax.openstack.org/pypifiles/packages/e8/a8/00ba0f605837a8f69523e6c3a4fb14675a6430c163f836540129c50b3aef/systemd-python-234.tar.gz (53kB)\n\n:stderr: Command \"python setup.py egg_info\" failed with error code 1 in17:16
mnaser/tmp/pip-install-gWlQvk/systemd-python/\n17:16
mnaserthis is where its breaking now17:16
mnaserhttp://logs.openstack.org/51/620651/5/gate/openstack-ansible-deploy-aio_lxc-centos-7/01ca2fd/logs/openstack/aio1_keystone_container-c3bb8d22/python_venv_build.log.txt.gz17:18
mnaser"Cannot find libsystemd or libsystemd-journal"17:19
mnaseri think we're missing https://centos.pkgs.org/7/centos-x86_64/systemd-devel-219-62.el7.x86_64.rpm.html17:21
*** hamzaachi has joined #openstack-ansible17:22
*** cshen has quit IRC17:24
*** mma has joined #openstack-ansible17:25
mnaserit looks like we have some services that are using journals and other services that arent17:26
*** cshen has joined #openstack-ansible17:26
mnaserok we are installing systemd-devel17:28
mnaserbut for some reason it still complains17:28
*** mma has quit IRC17:30
guilhermespmnaser: can you review that one too when you have time? https://review.openstack.org/#/c/622551/17:38
mnaserguilhermesp: will do, priority is figuring out how to unbreak centos 7 gates :(17:39
guilhermesplemme know if I can help17:39
mnaserstill in progress of figuring out whats the root causes17:40
*** mubix has quit IRC17:51
*** mubix has joined #openstack-ansible17:51
*** mrhillsman has quit IRC17:51
*** mrhillsman has joined #openstack-ansible17:51
*** mmercer has quit IRC17:52
*** adrianreza has quit IRC17:52
*** mmercer has joined #openstack-ansible17:54
*** adrianreza has joined #openstack-ansible17:55
*** dave-mccowan has joined #openstack-ansible18:08
*** mmercer is now known as Daemoen18:11
*** Daemoen is now known as mmercer18:12
*** priteau has quit IRC18:38
*** shardy has quit IRC18:49
*** gkadam has quit IRC18:57
*** DanyC_ has joined #openstack-ansible19:01
*** DanyC has quit IRC19:04
*** spatel has quit IRC19:06
*** mmercer has quit IRC19:13
*** mmercer has joined #openstack-ansible19:16
*** mmercer has quit IRC19:19
*** mmercer has joined #openstack-ansible19:20
*** hamzaachi has quit IRC19:25
*** hamzaachi has joined #openstack-ansible19:25
*** DanyC_ has quit IRC19:40
*** DanyC has joined #openstack-ansible19:41
*** DanyC has quit IRC19:45
*** hamzaachi has quit IRC19:53
*** spatel has joined #openstack-ansible20:03
*** mmercer is now known as Daemoen20:04
*** Daemoen is now known as mmercer20:04
*** strattao has joined #openstack-ansible20:08
openstackgerritMerged openstack/openstack-ansible-pip_install master: Fix bug finding pip install method  https://review.openstack.org/62145720:09
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Allow user defined options for the backend servers  https://review.openstack.org/62295220:12
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Remove the dependency on SSH for monitors  https://review.openstack.org/50409420:13
*** strattao has quit IRC20:20
*** aedc has joined #openstack-ansible20:31
*** strattao has joined #openstack-ansible21:09
*** strattao has quit IRC21:14
*** priteau has joined #openstack-ansible21:33
*** radeks__ has quit IRC21:43
*** ansmith has quit IRC21:49
*** priteau has quit IRC21:50
*** strattao has joined #openstack-ansible21:53
*** strattao has quit IRC21:53
*** aedc has quit IRC22:01
*** mma has joined #openstack-ansible22:03
*** rodolof has quit IRC22:11
*** rodolof has joined #openstack-ansible22:11
*** rodolof has quit IRC22:17
*** udesale has quit IRC22:25
*** dave-mccowan has quit IRC22:35
*** aedc has joined #openstack-ansible22:38
redkriegHi all, I'm having trouble getting instances to create on my setup with openvswitch as my neutron agent and br-vlan as a flat network.  Does anyone have experience with a similar setup?  I've created a gist with configs and logs here: https://gist.github.com/RedKrieg/b1ec1ba4eff7266a879aab0bccd6e51922:55
redkriegThis is based on configs from a number of sources, primarily here: https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html and here: https://www.openstackfaq.com/openstack-ansible-with-openvswitch/22:56
*** aedc has quit IRC23:00
*** spatel has quit IRC23:22
jamesdentonhi redkrieg. can't really help now, but it looks like the network defined here: https://gist.github.com/RedKrieg/b1ec1ba4eff7266a879aab0bccd6e519#file-etc_openstack_deploy_openstack_user_config-yml-L47-L56 may be conflicting with the one here: https://gist.github.com/RedKrieg/b1ec1ba4eff7266a879aab0bccd6e519#file-etc_openstack_deploy_user_variables-yml-L20-L27. You'll have to provide the neutron-server.log file and23:31
jamesdenton maybe the ml2_conf.ini/openvswitch_agent.ini to see how it was implemented and see if neutron-server is running. If i hop on later i will try and take a closer look at that23:31
redkrieghi jamesdenton thanks for taking a look.  I think the part in user_variables is supposed to set up br-provider, tying it to the br-vlan network in openstack_user_config.yml via name (flat, which is dumb I know).  I've got nothing in my neutron-server.log on comp1, should I have something there?  the service isn't even running, just the neutron-openvswitch-agent service.  I'm adding23:41
redkriegml2_conf.ini and openvswitch_agent.ini to the gist now.23:41
jamesdentonthere should be a neutron server container.23:48
jamesdentonlxc-ls -f to get containers23:48
jamesdentonlxc-attach -n <container> to get in23:49
*** mma has quit IRC23:54
redkriegmy apologies, I was looking on the compute node.  I've added the neutron server log from the controller23:56
redkriegforgot to save, it's there now23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!