Thursday, 2017-11-16

*** rfxn has quit IRC00:02
*** jamesbenson has joined #openstack-kolla00:03
*** rfxn has joined #openstack-kolla00:03
*** jamesbenson has quit IRC00:07
*** yingjun has joined #openstack-kolla00:11
*** Pavo_ has joined #openstack-kolla00:12
*** Pavo has quit IRC00:13
*** Pavo_ is now known as Pavo00:13
*** hongbin has quit IRC00:18
*** jrist is now known as jrist-afk00:21
*** jrist-afk is now known as jrist00:21
*** jtriley has quit IRC00:24
*** zshi has joined #openstack-kolla00:26
*** zshi has quit IRC00:30
*** ansmith has joined #openstack-kolla00:37
*** jascott1 has joined #openstack-kolla00:43
*** zshi_ has joined #openstack-kolla00:44
*** jtriley has joined #openstack-kolla00:49
*** gfhellma__ has quit IRC00:52
*** tovin07_ has joined #openstack-kolla01:02
*** chas_ has joined #openstack-kolla01:04
*** zhangfei has joined #openstack-kolla01:06
*** itlinux has joined #openstack-kolla01:08
*** chas_ has quit IRC01:09
*** lxdong has quit IRC01:09
*** unicell1 has joined #openstack-kolla01:16
*** dciabrin_ has joined #openstack-kolla01:17
*** unicell1 has quit IRC01:20
*** unicell1 has joined #openstack-kolla01:21
*** unicell has quit IRC01:21
*** unicell1 has quit IRC01:21
*** dciabrin has quit IRC01:21
*** Pavo_ has joined #openstack-kolla01:21
*** itlinux has quit IRC01:21
*** Pavo has quit IRC01:21
*** unicell has joined #openstack-kolla01:21
*** chas_ has joined #openstack-kolla01:21
*** unicell has quit IRC01:21
*** unicell has joined #openstack-kolla01:21
*** Pavo_ is now known as Pavo01:21
*** obre has quit IRC01:22
*** hogepodge has quit IRC01:22
*** sdake has quit IRC01:22
*** NobodyCam has quit IRC01:22
*** nanliu_ has quit IRC01:22
*** markmcclain has quit IRC01:22
*** zioproto has quit IRC01:22
*** lvdombrkr has quit IRC01:22
*** bkero has quit IRC01:22
*** cduchesne has quit IRC01:22
*** hawi has quit IRC01:22
*** amoralej|off has quit IRC01:22
*** vkhanna has quit IRC01:22
*** xion- has quit IRC01:22
*** tonyb has quit IRC01:22
*** Aju has quit IRC01:22
*** zul has quit IRC01:22
*** srwilkers has quit IRC01:22
*** mrhillsman has quit IRC01:22
*** masber has quit IRC01:22
*** livelace has quit IRC01:22
*** pbourke has quit IRC01:22
*** zhenguo has quit IRC01:22
*** sgordon has quit IRC01:22
*** calbers has quit IRC01:22
*** gema has quit IRC01:22
*** harlowja has quit IRC01:22
*** wlmbasson has quit IRC01:22
*** japestinho has quit IRC01:22
*** andyjones2001 has quit IRC01:22
*** kklimonda has quit IRC01:22
*** mgkwill has quit IRC01:22
*** dklyle has quit IRC01:22
*** trozet has quit IRC01:22
*** numans has quit IRC01:22
*** EmilienM has quit IRC01:22
*** jistr has quit IRC01:22
*** honza has quit IRC01:22
*** spsurya has quit IRC01:22
*** liangqi has quit IRC01:22
*** chandankumar has quit IRC01:22
*** zhangfei has quit IRC01:22
*** tovin07_ has quit IRC01:22
*** yingjun has quit IRC01:22
*** hieulq has quit IRC01:22
*** daidv has quit IRC01:22
*** cliles has quit IRC01:22
*** sbezverk has quit IRC01:22
*** chason has quit IRC01:22
*** ipsecguy has quit IRC01:22
*** Zara has quit IRC01:22
*** thomasem has quit IRC01:22
*** Daviey has quit IRC01:22
*** openstackgerrit has quit IRC01:22
*** dims has quit IRC01:22
*** mwynne has quit IRC01:22
*** ianw has quit IRC01:22
*** manjeets has quit IRC01:22
*** clayton has quit IRC01:22
*** kolla-slack has quit IRC01:22
*** rwellum has quit IRC01:22
*** mwhahaha has quit IRC01:22
*** Jeffrey4l has quit IRC01:22
*** TheJulia has quit IRC01:22
*** karlamrhein has quit IRC01:22
*** robcresswell has quit IRC01:22
*** logan- has quit IRC01:22
*** kong has quit IRC01:22
*** DuncanT has quit IRC01:22
*** johnthetubaguy has quit IRC01:22
*** akwasnie has quit IRC01:22
*** SaMnCo has quit IRC01:22
*** portdirect has quit IRC01:22
*** Arminder- has quit IRC01:22
*** v1k0d3n has quit IRC01:22
*** ashu has quit IRC01:22
*** ChanServ has quit IRC01:22
*** classicsnail has quit IRC01:22
*** larsks has quit IRC01:22
*** jlvillal has quit IRC01:22
*** igordc has quit IRC01:22
*** jtriley has quit IRC01:22
*** jascott1 has quit IRC01:22
*** jbrooks has quit IRC01:22
*** xinliang has quit IRC01:22
*** jamespd_ has quit IRC01:22
*** kwazar has quit IRC01:22
*** bjolo has quit IRC01:22
*** cloudnull has quit IRC01:22
*** ansmith has quit IRC01:22
*** tvignaud has quit IRC01:22
*** mandre has quit IRC01:22
*** dosaboy has quit IRC01:22
*** leifmadsen has quit IRC01:22
*** ntpttr has quit IRC01:22
*** jrist has quit IRC01:22
*** rich1iu has quit IRC01:22
*** SamYaple has quit IRC01:22
*** Pavo has quit IRC01:22
*** zshi_ has quit IRC01:22
*** jbadiapa_ has quit IRC01:22
*** krtaylor has quit IRC01:22
*** inc0 has quit IRC01:22
*** ArminderSingh has quit IRC01:22
*** jdandrea has quit IRC01:22
*** klindgren_ has quit IRC01:22
*** jianghuaw_ has quit IRC01:22
*** kevinz has quit IRC01:22
*** niedbalski has quit IRC01:22
*** pomac has quit IRC01:22
*** calebb has quit IRC01:22
*** cinerama has quit IRC01:22
*** yee379 has quit IRC01:22
*** athomas has quit IRC01:22
*** snuffkin has quit IRC01:22
*** dalvarez has quit IRC01:22
*** randyl has quit IRC01:22
*** berendt has quit IRC01:22
*** cargonza has quit IRC01:22
*** mcnanci has quit IRC01:22
*** jbryce has quit IRC01:22
*** unicell has quit IRC01:22
*** rfxn has quit IRC01:22
*** salv-orl_ has quit IRC01:22
*** mrunge has quit IRC01:22
*** kbyrne has quit IRC01:22
*** retr0h has quit IRC01:22
*** nhlfr has quit IRC01:22
*** bachp has quit IRC01:22
*** oanson has quit IRC01:22
*** dmellado has quit IRC01:22
*** serverascode has quit IRC01:22
*** pron has quit IRC01:22
*** vkmc has quit IRC01:22
*** harmw_ has quit IRC01:22
*** alanmeadows has quit IRC01:22
*** peterjenkins__ has quit IRC01:22
*** kencjohnston has quit IRC01:22
*** Reepicheep has quit IRC01:22
*** ioni has quit IRC01:22
*** chas_ has quit IRC01:22
*** threestrands has quit IRC01:22
*** yangyapeng has quit IRC01:22
*** hemna has quit IRC01:22
*** jaosorior has quit IRC01:22
*** hrw has quit IRC01:22
*** flaper87 has quit IRC01:22
*** strigazi has quit IRC01:22
*** imcsk8 has quit IRC01:22
*** pc_m has quit IRC01:22
*** hoaile has quit IRC01:22
*** ansiwen has quit IRC01:22
*** brad[] has quit IRC01:22
*** cu5 has quit IRC01:22
*** SpamapS has quit IRC01:22
*** wirehead_ has quit IRC01:22
*** korean101 has quit IRC01:22
*** glycerine has quit IRC01:22
*** markus-k has quit IRC01:22
*** ddurst has quit IRC01:22
*** Bico_Fino has quit IRC01:22
*** llua has quit IRC01:22
*** ruhe has quit IRC01:22
*** timss has quit IRC01:22
*** zeus has quit IRC01:22
*** kfox1111 has quit IRC01:22
*** unicell has joined #openstack-kolla01:28
*** Pavo has joined #openstack-kolla01:28
*** zhangfei has joined #openstack-kolla01:28
*** tovin07_ has joined #openstack-kolla01:28
*** jtriley has joined #openstack-kolla01:28
*** zshi_ has joined #openstack-kolla01:28
*** jascott1 has joined #openstack-kolla01:28
*** ansmith has joined #openstack-kolla01:28
*** yingjun has joined #openstack-kolla01:28
*** rfxn has joined #openstack-kolla01:28
*** masber has joined #openstack-kolla01:28
*** llua has joined #openstack-kolla01:28
*** threestrands has joined #openstack-kolla01:28
*** livelace has joined #openstack-kolla01:28
*** jbadiapa_ has joined #openstack-kolla01:28
*** salv-orl_ has joined #openstack-kolla01:28
*** mrunge has joined #openstack-kolla01:28
*** jdandrea has joined #openstack-kolla01:28
*** yee379 has joined #openstack-kolla01:28
*** tvignaud has joined #openstack-kolla01:28
*** krtaylor has joined #openstack-kolla01:28
*** athomas has joined #openstack-kolla01:28
*** inc0 has joined #openstack-kolla01:28
*** pbourke has joined #openstack-kolla01:28
*** hieulq has joined #openstack-kolla01:28
*** daidv has joined #openstack-kolla01:28
*** yangyapeng has joined #openstack-kolla01:28
*** ArminderSingh has joined #openstack-kolla01:28
*** strigazi has joined #openstack-kolla01:28
*** mandre has joined #openstack-kolla01:28
*** hemna has joined #openstack-kolla01:28
*** jaosorior has joined #openstack-kolla01:28
*** japestinho has joined #openstack-kolla01:28
*** kbyrne has joined #openstack-kolla01:28
*** jbrooks has joined #openstack-kolla01:28
*** klindgren_ has joined #openstack-kolla01:28
*** niedbalski has joined #openstack-kolla01:28
*** cliles has joined #openstack-kolla01:28
*** Zara has joined #openstack-kolla01:28
*** hrw has joined #openstack-kolla01:28
*** jianghuaw_ has joined #openstack-kolla01:28
*** sbezverk has joined #openstack-kolla01:28
*** ashu has joined #openstack-kolla01:28
*** kevinz has joined #openstack-kolla01:28
*** kolla-slack has joined #openstack-kolla01:28
*** xinliang has joined #openstack-kolla01:28
*** andyjones2001 has joined #openstack-kolla01:28
*** retr0h has joined #openstack-kolla01:28
*** bachp has joined #openstack-kolla01:28
*** nhlfr has joined #openstack-kolla01:28
*** rwellum has joined #openstack-kolla01:28
*** mwhahaha has joined #openstack-kolla01:28
*** kklimonda has joined #openstack-kolla01:28
*** mgkwill has joined #openstack-kolla01:28
*** dklyle has joined #openstack-kolla01:28
*** flaper87 has joined #openstack-kolla01:28
*** pomac has joined #openstack-kolla01:28
*** trozet has joined #openstack-kolla01:28
*** calebb has joined #openstack-kolla01:28
*** zhenguo has joined #openstack-kolla01:28
*** imcsk8 has joined #openstack-kolla01:28
*** chason has joined #openstack-kolla01:28
*** cinerama has joined #openstack-kolla01:28
*** ipsecguy has joined #openstack-kolla01:28
*** gema has joined #openstack-kolla01:28
*** numans has joined #openstack-kolla01:28
*** obre has joined #openstack-kolla01:28
*** EmilienM has joined #openstack-kolla01:28
*** thomasem has joined #openstack-kolla01:28
*** Jeffrey4l has joined #openstack-kolla01:28
*** dosaboy has joined #openstack-kolla01:28
*** oanson has joined #openstack-kolla01:28
*** dmellado has joined #openstack-kolla01:28
*** leifmadsen has joined #openstack-kolla01:28
*** Daviey has joined #openstack-kolla01:28
*** pc_m has joined #openstack-kolla01:28
*** sgordon has joined #openstack-kolla01:28
*** openstackgerrit has joined #openstack-kolla01:28
*** serverascode has joined #openstack-kolla01:28
*** mrhillsman has joined #openstack-kolla01:28
*** srwilkers has joined #openstack-kolla01:28
*** zul has joined #openstack-kolla01:28
*** Aju has joined #openstack-kolla01:28
*** tonyb has joined #openstack-kolla01:28
*** xion- has joined #openstack-kolla01:28
*** vkhanna has joined #openstack-kolla01:28
*** hawi has joined #openstack-kolla01:28
*** cduchesne has joined #openstack-kolla01:28
*** bkero has joined #openstack-kolla01:28
*** lvdombrkr has joined #openstack-kolla01:28
*** zioproto has joined #openstack-kolla01:28
*** markmcclain has joined #openstack-kolla01:28
*** NobodyCam has joined #openstack-kolla01:28
*** nanliu_ has joined #openstack-kolla01:28
*** sdake has joined #openstack-kolla01:28
*** amoralej|off has joined #openstack-kolla01:28
*** hogepodge has joined #openstack-kolla01:28
*** dims has joined #openstack-kolla01:28
*** calbers has joined #openstack-kolla01:28
*** harlowja has joined #openstack-kolla01:28
*** ianw has joined #openstack-kolla01:28
*** mwynne has joined #openstack-kolla01:28
*** ntpttr has joined #openstack-kolla01:28
*** manjeets has joined #openstack-kolla01:28
*** TheJulia has joined #openstack-kolla01:28
*** karlamrhein has joined #openstack-kolla01:28
*** pron has joined #openstack-kolla01:28
*** wlmbasson has joined #openstack-kolla01:28
*** clayton has joined #openstack-kolla01:28
*** vkmc has joined #openstack-kolla01:28
*** harmw_ has joined #openstack-kolla01:28
*** jamespd_ has joined #openstack-kolla01:28
*** kwazar has joined #openstack-kolla01:28
*** jrist has joined #openstack-kolla01:28
*** SpamapS has joined #openstack-kolla01:28
*** hoaile has joined #openstack-kolla01:28
*** jlvillal has joined #openstack-kolla01:28
*** dalvarez has joined #openstack-kolla01:28
*** rich1iu has joined #openstack-kolla01:28
*** jistr has joined #openstack-kolla01:28
*** ansiwen has joined #openstack-kolla01:28
*** bjolo has joined #openstack-kolla01:28
*** brad[] has joined #openstack-kolla01:28
*** cu5 has joined #openstack-kolla01:28
*** snuffkin has joined #openstack-kolla01:28
*** robcresswell has joined #openstack-kolla01:28
*** classicsnail has joined #openstack-kolla01:28
*** wirehead_ has joined #openstack-kolla01:28
*** logan- has joined #openstack-kolla01:28
*** korean101 has joined #openstack-kolla01:28
*** larsks has joined #openstack-kolla01:28
*** glycerine has joined #openstack-kolla01:28
*** alanmeadows has joined #openstack-kolla01:28
*** cloudnull has joined #openstack-kolla01:28
*** ioni has joined #openstack-kolla01:28
*** kong has joined #openstack-kolla01:28
*** DuncanT has joined #openstack-kolla01:28
*** markus-k has joined #openstack-kolla01:28
*** randyl has joined #openstack-kolla01:28
*** berendt has joined #openstack-kolla01:28
*** cargonza has joined #openstack-kolla01:28
*** johnthetubaguy has joined #openstack-kolla01:28
*** igordc has joined #openstack-kolla01:28
*** akwasnie has joined #openstack-kolla01:28
*** SaMnCo has joined #openstack-kolla01:28
*** peterjenkins__ has joined #openstack-kolla01:28
*** portdirect has joined #openstack-kolla01:28
*** mcnanci has joined #openstack-kolla01:28
*** Arminder- has joined #openstack-kolla01:28
*** honza has joined #openstack-kolla01:28
*** v1k0d3n has joined #openstack-kolla01:28
*** spsurya has joined #openstack-kolla01:28
*** liangqi has joined #openstack-kolla01:28
*** jbryce has joined #openstack-kolla01:28
*** kencjohnston has joined #openstack-kolla01:28
*** chandankumar has joined #openstack-kolla01:28
*** ddurst has joined #openstack-kolla01:28
*** Bico_Fino has joined #openstack-kolla01:28
*** ruhe has joined #openstack-kolla01:28
*** timss has joined #openstack-kolla01:28
*** SamYaple has joined #openstack-kolla01:28
*** zeus has joined #openstack-kolla01:28
*** kfox1111 has joined #openstack-kolla01:28
*** Reepicheep has joined #openstack-kolla01:28
*** ChanServ has joined #openstack-kolla01:28
*** barjavel.freenode.net sets mode: +o ChanServ01:28
*** caowei has joined #openstack-kolla01:29
*** chas_ has joined #openstack-kolla01:36
*** kiennt26 has joined #openstack-kolla01:39
*** chas_ has quit IRC01:40
*** hieulq has quit IRC01:41
*** daidv has quit IRC01:41
*** tovin07_ has quit IRC01:41
*** daidv has joined #openstack-kolla01:41
*** tovin07_ has joined #openstack-kolla01:41
*** hieulq has joined #openstack-kolla01:41
*** itlinux has joined #openstack-kolla01:48
*** goldyfruit has joined #openstack-kolla01:51
*** goldyfruit has quit IRC01:55
*** zhangfei has quit IRC02:00
*** rwsu has joined #openstack-kolla02:07
*** chas_ has joined #openstack-kolla02:07
*** chas_ has quit IRC02:12
*** zhangfei has joined #openstack-kolla02:13
*** itlinux has quit IRC02:17
zhubingbing__Hi guys02:17
*** itlinux has joined #openstack-kolla02:21
*** chas_ has joined #openstack-kolla02:23
*** rwsu has quit IRC02:24
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544602:25
*** chas_ has quit IRC02:28
kolla-slack<inc0> Jeffrey4l https://review.openstack.org/#/c/519939/ <- it uses cache02:30
kolla-slack<inc0> need few cleanups and it's good to go02:31
Jeffrey4linc0, so mirror registry with url path should be put into configuration files rather than command line?02:32
Jeffrey4linteresting.02:32
Jeffrey4li will make some cleanup today.02:34
kolla-slack<inc0> Thanks02:35
*** chas_ has joined #openstack-kolla02:39
*** itlinux has quit IRC02:40
*** salv-orlando has joined #openstack-kolla02:41
*** chas_ has quit IRC02:43
*** zhurong has joined #openstack-kolla02:44
*** salv-orl_ has quit IRC02:44
*** zhurong has quit IRC02:46
*** danardelean has joined #openstack-kolla02:48
*** danardelean has quit IRC02:52
openstackgerritChason Chan proposed openstack/kolla master: Upgrade the rst convention of the Admin Guide  https://review.openstack.org/51165903:05
*** chas_ has joined #openstack-kolla03:10
*** dave-mccowan has joined #openstack-kolla03:10
*** zhubingbing__ has quit IRC03:11
*** lxdong has joined #openstack-kolla03:15
lxdongIs it possible to auto migrate if the ceph backend which instance reside on broken?03:15
*** chas_ has quit IRC03:15
*** Pavo has quit IRC03:16
*** Pavo has joined #openstack-kolla03:18
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [WIP] pull image from dockerhub  https://review.openstack.org/51993903:21
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [DNM] Test Depends-On feature  https://review.openstack.org/52027703:23
*** itlinux has joined #openstack-kolla03:25
*** unicell has quit IRC03:26
*** chas_ has joined #openstack-kolla03:26
*** chas_ has quit IRC03:31
spsuryamorning all03:35
*** coolsvap has joined #openstack-kolla03:49
*** skramaja has joined #openstack-kolla03:53
SamYaplelxdong: if ceph is busted what are you thinking you are migrating?03:58
*** mdnadeem has joined #openstack-kolla04:01
*** chas_ has joined #openstack-kolla04:03
lxdongI am not sure how to describe it accurately. I think it should be if one storage node using backend broken will the instance on it to be avaliable?04:04
SamYaplelxdong: ceph is distributed storage, so unless it goes down entirely, the instance will be available04:05
SamYaplejust because you have storage on your computes, doesnt mean your instances are stored on those local disks04:05
lxdonghow to stimulate this situation for testing, one node broken and instance still available?04:07
*** chas_ has quit IRC04:07
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544604:08
lxdongI tried reboot one node , instances page can't be accessible.04:08
openstackgerritMerged openstack/kolla master: Remove the installed packages in ceilometer-api container  https://review.openstack.org/51953804:09
lxdonguntil the node come to serve.04:10
lxdongthen instance becomes shut down.04:10
lxdongI wonder whether it has impact on the instance users are using ,will it be seamless?04:14
*** jamesbenson has joined #openstack-kolla04:23
*** chas_ has joined #openstack-kolla04:24
lxdong to meet high SLA requirements04:24
*** chas_ has quit IRC04:28
*** dave-mccowan has quit IRC04:34
*** skramaja_ has joined #openstack-kolla04:35
*** skramaja has quit IRC04:38
*** jamesbenson has quit IRC04:40
*** oanson has quit IRC04:44
*** chas_ has joined #openstack-kolla04:44
*** oanson has joined #openstack-kolla04:45
*** chas_ has quit IRC04:49
*** zhurong has joined #openstack-kolla04:55
openstackgerritHeetae Ahn proposed openstack/kolla master: Add RHEL subscription registration  https://review.openstack.org/49514804:58
*** caowei has quit IRC05:01
*** chas_ has joined #openstack-kolla05:05
*** chas_ has quit IRC05:10
*** Pavo has quit IRC05:16
*** Pavo has joined #openstack-kolla05:21
openstackgerritMerged openstack/kolla master: Fix the Ubuntu Fluentd image  https://review.openstack.org/51882005:22
*** chas_ has joined #openstack-kolla05:26
*** caowei has joined #openstack-kolla05:26
*** mdnadeem has quit IRC05:30
*** chas_ has quit IRC05:31
openstackgerritJeffrey Zhang proposed openstack/kolla master: Improve gate post jobs  https://review.openstack.org/51996905:33
*** pratapagoutham has joined #openstack-kolla05:37
lxdongSamYaple I noticed kolla-ansible ceph extend_start.sh is from you . I created a crushmap as the blog does http://ceph.com/geen-categorie/ceph-mix-sata-and-ssd-within-the-same-box/ but hints me bucket type 'host' is not defined05:41
openstackgerritChason Chan proposed openstack/kolla-ansible master: Fix the deprecated syntax in 01-rewrite.conf  https://review.openstack.org/51849005:42
lxdongThere is     ceph osd crush add-bucket "${HOSTNAME}${CEPH_ROOT_NAME:+-${CEPH_ROOT_NAME}}" host05:43
*** janki has joined #openstack-kolla05:44
*** dmellado has quit IRC05:46
*** chas_ has joined #openstack-kolla05:47
*** chas_ has quit IRC05:51
*** dmellado has joined #openstack-kolla05:55
openstackgerritWei Cao proposed openstack/kolla master: Add designate-producer container  https://review.openstack.org/52029905:55
*** mdnadeem has joined #openstack-kolla05:57
ashuissue with gnocchi kolla-ansible pike..cannot start gnocchi container during deployment05:57
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/51993905:58
*** jaosorior has quit IRC06:02
*** tovin07_ has quit IRC06:04
Jeffrey4lashu, maybe this issue? https://review.openstack.org/50625106:05
openstackgerritChason Chan proposed openstack/kolla-ansible master: Fix the deprecated syntax in 01-rewrite.conf  https://review.openstack.org/51849006:07
*** chas_ has joined #openstack-kolla06:08
*** oanson has quit IRC06:12
*** chas_ has quit IRC06:12
*** zhurong has quit IRC06:13
*** oanson has joined #openstack-kolla06:13
*** kiennt26 has quit IRC06:19
*** zhurong has joined #openstack-kolla06:23
*** chas_ has joined #openstack-kolla06:29
ashuso actually should gnocchi work if i use centos os source in kolla???06:31
*** jaosorior has joined #openstack-kolla06:32
*** danardelean has joined #openstack-kolla06:33
*** chas_ has quit IRC06:33
*** jaosorior has quit IRC06:35
*** jaosorior has joined #openstack-kolla06:35
*** danardelean has quit IRC06:37
*** pc_m has quit IRC06:38
*** unicell has joined #openstack-kolla06:39
*** jbadiapa_ has quit IRC06:39
*** pc_m has joined #openstack-kolla06:41
*** itlinux has quit IRC06:43
lxdongI created a crushmap as the blog http://ceph.com/geen-categorie/ceph-mix-sata-and-ssd-within-the-same-box does,  at  step `crushtool -c lamap.txt -o lamap.coloc`  hinted me bucket type 'host' is not defined06:49
*** chas_ has joined #openstack-kolla06:50
korean101i finished deploy Ocata releases06:50
korean101and also finished deploay Pike releases06:50
korean101now try to upgrade Ocata to Pike06:50
korean101so exciting06:51
lxdongjust kolla-ansible upgrade ?06:51
korean101lxdong: yes. I have not tried yet.06:52
korean101lxdong: kolla-ansible 4.0.0 -> 5.0.006:52
lxdongAre they in the same cluster?06:52
*** danardelean has joined #openstack-kolla06:52
korean101lxdong: and upgrade library projects (centos-openstack-ocata -> centos-openstack-pike)06:53
korean101lxdong: i expect no downtime upgrade06:53
lxdongwonder the mechanism.06:53
lxdongyes , I know.06:53
lxdongHow long will it take?06:54
korean101lxdong: not tried yet06:54
*** chas_ has quit IRC06:54
korean101lxdong: i just finish deploy each ocata/pike06:54
korean101lxdong: 10 minutes each releases06:54
*** jbadiapa_ has joined #openstack-kolla06:55
korean101kolla-ansible so easy and powerful06:55
korean101for me06:55
lxdongIt took me half an hour to deploy pike.06:55
korean101lxdong: hmmmmmm so long06:55
lxdongwith two all-in-one nodes.06:56
korean101lxdong: i use 6nodes06:56
korean101lxdong: controller, network, compute, ceph001, ceph002, ceph00306:56
*** danardelean has quit IRC06:57
korean101lxdong: i use own my custom pike builds06:57
lxdongme too06:57
korean101lxdong: and i use public hub.docker.com ocata release06:57
lxdongI'm exploring 0 downtime of vm in the condition of ceph node failure.06:59
*** jascott1 has quit IRC07:01
*** jascott1 has joined #openstack-kolla07:01
*** egonzalez has joined #openstack-kolla07:04
*** jascott1 has quit IRC07:06
lxdongHow long has it been since you get acquainted with openstack? korean101 ,you may from korean?07:07
korean101lxdong: yes. i'm korean07:08
korean101lxdong: since grizzly release07:08
*** Nix_ has joined #openstack-kolla07:08
korean101lxdong: and build & operate kilo release in production07:09
korean101(HA & DVR)07:09
Nix_HELP/ the precheck failed with Checking Docker SDK version "Checking docker SDK version] *********************************************************************************************************************************************** fatal: [kolla-evaluation]: FAILED! => {"changed": false, "cmd": ["/usr/bin/python", "-c", "import docker; print docker.__version__"], "delta": "0:00:00.175947", "end": "2017-11-16 07:08:07.012321"07:09
korean101lxdong: I have been to use a rpm/deb packages until now.07:09
korean101lxdong: but I will use kolla in the future.07:10
lxdongI'm from China.07:10
*** kiennt26 has joined #openstack-kolla07:10
*** chas_ has joined #openstack-kolla07:11
korean101lxdong: oh so close07:11
lxdongplay with openstack for 3 months by far. I'm pretty green on kolla.07:11
korean101lxdong: I decided to look at this and use kolla (https://i.imgur.com/YEA2d4Z.png)07:12
korean101future roadmap07:13
*** pratapagoutham has quit IRC07:13
lxdongPike will be the first release in our production ,rolling update is a concern.07:13
*** chas_ has quit IRC07:15
korean101lxdong: good07:15
*** xinliang has quit IRC07:15
korean101lxdong: ocata release still use mongodb07:15
korean101lxdong: ceilometer default backend07:15
korean101lxdong: but pike use gnocchi, so rolling upgrade is OK07:16
*** Pavo has quit IRC07:17
*** jianghuaw_ has quit IRC07:17
lxdongI see, is your upgrading in proccess?07:17
*** jianghuaw_ has joined #openstack-kolla07:17
egonzalezkorean101, can also define gnocchi instead of mongodb in globals.yml07:18
*** pratapagoutham has joined #openstack-kolla07:18
korean101egonzalez: but in ocata errors...07:18
korean101egonzalez: what's your timezone??07:19
korean101PDT?07:19
egonzalezlxdong, is are concern about rolling upgrade may check this change https://review.openstack.org/#/c/425446 which implements keystone db no downtime07:19
lxdongalright,thanks07:20
egonzalezkorean101, UTC+107:21
*** Pavo has joined #openstack-kolla07:21
egonzalezwhat are the errors?07:21
*** liangqi has quit IRC07:21
*** magicboiz has joined #openstack-kolla07:21
korean101egonzalez: hmmmmmm can't rememver07:22
*** spsurya has quit IRC07:22
*** lpetrut_ has joined #openstack-kolla07:22
korean101egonzalez: https://github.com/openstack/kolla-ansible/blob/stable/ocata/ansible/roles/ceilometer/tasks/precheck.yml#L2507:23
lxdongegonzalez I created a crushmap as the blog http://ceph.com/geen-categorie/ceph-mix-sata-and-ssd-within-the-same-box does,  at  step `crushtool -c lamap.txt -o lamap.coloc`  hinted me bucket type 'host' is not defined07:23
korean101egonzalez: not enable_mongodb | bool07:24
*** spsurya has joined #openstack-kolla07:25
lxdongwe both love egonzalez :)07:25
*** magicboiz has quit IRC07:25
korean101lxdong: after you~07:26
korean101lxdong: you first07:26
kolla-slack<egonzalez> korean101 have to set gnocchi in ceilometer_database_type07:27
korean101egonzalez: in globals.yml?07:28
kolla-slack<egonzalez> lxdong not really expert in ceph, iirc if you use ceph osd tree you can see the defined architecture07:28
*** xinliang has joined #openstack-kolla07:28
kolla-slack<egonzalez> korean101 yep07:28
korean101egonzalez: hmmmmm different ocata's globals.yml07:28
korean101egonzalez: thanks. i try that07:28
*** threestrands has quit IRC07:30
*** chas_ has joined #openstack-kolla07:31
lxdongceph irc channel is not alive enough , I found Jeffrey4l in it :).07:32
ashuhi cinder with ceph issue (suding single node kolla pike) shows cindervolume down logs:http://paste.openstack.org/show/626467/07:32
*** magicboiz has joined #openstack-kolla07:32
ashuplese help07:32
ashudocker ps does not show iscsid container is it the issue??07:33
egonzalezwith ceph not need iscsi07:34
egonzalezError starting thread.: IndexError: list index out of range07:34
egonzalez sounds like a code bug, never seen that07:34
Nix_Precheck ended with an error, Checking Docker SDK version. http://paste.ubuntu.com/25972864/ #Help07:36
egonzalezashu, if have a redhat account this might be helpful https://access.redhat.com/solutions/152773307:36
*** chas_ has quit IRC07:36
egonzalezNix_, pip freeze | grep - docker07:36
*** pratapagoutham has quit IRC07:37
Nix_egonzalez_, docker-py==1.10.6 docker-pycreds==0.2.107:37
egonzalezashu, share cinder.conf from /etc/kolla/cinder-volume07:37
ashuegonzalez : ceph.conf:http://paste.openstack.org/show/626470/07:38
egonzalezNix_, min docker version is '2.0.0'07:39
egonzalezif using pike or later docker-py is not supported07:39
egonzalezneed to unistall docker-py and install docker07:39
*** jbadiapa_ is now known as jbadiapa07:39
Nix_Thanks. egonzalez_07:41
*** Nix_ has quit IRC07:43
ashuegonzalez ceph with cinder in pike was working few weeks back..07:43
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/51993907:44
ashuone more question for cinder i need to stop the system iscsid service on all compute host..do i need to disable iscsid service in compute nodes for cinder with ceph as well???07:47
openstackgerritzenghui.shi proposed openstack/kolla-ansible master: Add ptp ansible role  https://review.openstack.org/51921907:48
*** shardy has joined #openstack-kolla07:52
*** chas_ has joined #openstack-kolla07:52
*** chas_ has quit IRC07:57
*** dmellado has quit IRC07:57
*** dmellado has joined #openstack-kolla07:58
*** lpetrut_ has quit IRC07:59
openstackgerritChason Chan proposed openstack/kolla-ansible master: Fix the deprecated syntax in 01-rewrite.conf  https://review.openstack.org/51849007:59
lxdongHow to change maxTotalVolumes of cinder?08:07
*** hachi_ has joined #openstack-kolla08:07
lxdongquota_volumes=30 in nova.conf?08:09
*** danardelean has joined #openstack-kolla08:10
*** lpetrut_ has joined #openstack-kolla08:12
*** reddreamster has joined #openstack-kolla08:13
*** chas_ has joined #openstack-kolla08:13
*** pcaruana has joined #openstack-kolla08:14
korean101egonzalez: deploy gnocchi succeeded in ocata. thanks08:15
reddreamsterhello, when I try to upgrade to the latest build of Ocala, nova_libvirt keeps restarting, and the log says "unsupported configuration: No server certificate path set to match server key", would you please help?08:17
*** chas_ has quit IRC08:18
*** chas_ has joined #openstack-kolla08:19
lxdongDidn't find anything useful in google.08:20
*** unicell has quit IRC08:20
*** unicell has joined #openstack-kolla08:21
*** unicell has quit IRC08:21
danardeleanegonzalez, hi, if I do a multinode deployment, do I need kolla-ansible installed on all controller nodes?08:22
egonzalezdanardelean, nope, just deployer node08:22
danardeleanok, do I need anything else than docker configured on those nodes?08:23
reddreamsterI just try to upgrade an older 4.0.3 to the latest 4.0.3, and I use the pull and upgrade command to do the upgrade. What's wrong with my procedure?08:24
lxdongkorean101 Do you know how to change cinder absolute-limits maxTotalVolumes ?08:27
*** pcaruana has quit IRC08:28
korean101lxdong: what exact config item?08:30
korean101lxdong: https://docs.openstack.org/cinder/pike/sample_config.html08:30
lxdongI can create no more than 10 volumes that is no more than 10 instances.08:31
lxdongyou mean in cinder.conf?08:32
korean101lxdong: yes08:32
*** pcaruana has joined #openstack-kolla08:32
korean101lxdong: quota_volumes = 10??08:33
lxdongyes08:33
korean101lxdong: but not recommended change cinder.conf08:33
korean101lxdong: but solution is this08:33
korean101https://docs.openstack.org/kolla-ansible/pike/advanced-configuration.html#openstack-service-configuration-in-kolla08:33
korean101https://docs.openstack.org/kolla-ansible/pike/deployment-philosophy.html#kolla-s-solution-to-customization08:33
korean101lxdong: /etc/kolla/config/cinder.conf08:34
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [DNM] Test Depends-On feature  https://review.openstack.org/52027708:34
*** zeus has quit IRC08:34
korean101lxdong: I can not be sure.08:34
lxdongyes,I know kolla override conf mechanism.08:35
korean101lxdong: OK08:35
reddreamster:q08:36
lxdongIs your upgrading going well?08:37
korean101lxdong: not tried yet08:37
korean101lxdong: i just finished deploey gnocchi in ocata release08:37
korean101ocata (gnocchi) --> pike (gnocchi)08:38
*** jamesbenson has joined #openstack-kolla08:38
korean101tomorrow i'll try08:38
korean101lxdong: it's time to get off08:39
korean101lxdong: :)08:39
korean1016 PM08:39
lxdonghaha08:39
lxdongget off early.08:39
korean101lxdong: nope. just 6 PM08:39
lxdongI see ,earlier than me.08:40
lxdongwe are after you about 1 hour.08:41
*** lpetrut_ has quit IRC08:41
*** ktibi has joined #openstack-kolla08:41
ktibiMorning all08:42
*** jamesbenson has quit IRC08:42
*** ashu has quit IRC08:43
lxdongTime zone is interesting.08:43
reddreamstercall help again, anyone has experience with upgrading of libvirt? My nova_libvirt keeps restarting after an upgrade.08:44
ktibiegonzalez do you had time to cherry pick the PR (about endpoint used)08:45
ktibireddreamster copy log (docker logs container)08:45
egonzalezreddreamster, distro?08:46
*** amoralej|off is now known as amoralej08:46
lxdongkorean101 seems no effect.08:46
korean101lxdong: huh08:46
egonzalezktibi, not now, cannot do that at $job time, can do it if wish to08:47
reddreamsterktibi, 2017-11-16 08:34:00.578+0000: 15821: info : libvirt version: 3.2.0, package: 14.el7_4.3 (CentOS BuildSystem <http://bugs.centos.org>, 2017-09-07-11:27:44, c1bm.rdu2.centos.org) 2017-11-16 08:34:00.578+0000: 15821: info : hostname: compute1 2017-11-16 08:34:00.578+0000: 15821: error : daemonSetupNetworking:554 : unsupported configuration: No server certificate path set to match server key08:48
lxdongvim cinder.conf [DEFAULT] quota_volumes = 100 and config files in nodes are consistent now but no effect.08:48
reddreamsteregonzalez Ocata centos source08:49
egonzalezktibi, re endpoints changed to IP, change the upgrade tasks urls to those ones keystone_admin_url: "{{ admin_protocol }}://{{ kolla_internal_fqdn }}:{{ keystone_admin_port }}"08:49
egonzalezkeystone_internal_url: "{{ internal_protocol }}://{{ kolla_internal_fqdn }}:{{ keystone_public_port }}"08:49
egonzalezkeystone_public_url: "{{ public_protocol }}://{{ kolla_external_fqdn }}:{{ keystone_public_port }}"08:49
ktibiegonzalez ok for now I had try with manual cherry pick on my local repo, and it works (except keystone endpoint)08:49
egonzalezreddreamster, probably is due centos 7.4 release which changed libvirt version08:49
lxdongegonzalez,Do you know how to change cinder absolute-limits maxTotalVolumes ?08:50
ktibiI use centos 7.4 for libvirt08:50
*** imcsk8_ has joined #openstack-kolla08:51
egonzalezreddreamster, https://review.openstack.org/#/c/495524/ try applying this patch08:51
reddreamsteregonzalez ktibi, my host is centos 7.308:51
*** Yashu has joined #openstack-kolla08:51
YashuHi all08:51
egonzalezreddreamster, but new containers images are build with 7.408:52
ktibireddreamster I use libvirt-libs-3.2.0-14.el7_4.3.x86_64 on centos7.4.170808:52
egonzalezthat broke us :(08:52
ktibiand it works08:52
YashuDuring kolla pike installation step gnochhi bootstrap container fails shows container exited with non zero return code08:53
YashuUsing ubuntu base for images08:53
reddreamsteregonzalez, thank you, can I just modify the libvirtd.conf?08:54
egonzalezreddreamster, to test yep, in /etc/kolla/nova-libvirt08:54
*** gfidente has joined #openstack-kolla08:54
*** imcsk8 has quit IRC08:55
ktibiegonzalez very strange, I have already keystone_admin_url: "{{ admin_protocol }}://{{ kolla_internal_fqdn }}:{{ keystone_admin_port }}"08:56
ktibior keystone_public_url: "{{ public_protocol }}://{{ kolla_external_fqdn }}:{{ keystone_public_port }}"08:56
ktibiBut endpoint is still with IP08:57
reddreamsteregonzalez, it works magically, thank you. Will new official images be built soon?08:57
ktibireddreamster for now no, you need to build your own images08:59
reddreamsterktibi, ok, thank you08:59
ktibireddreamster I builded all centos binary image for pike if you want09:00
ktibihttps://hub.docker.com/u/ktibi/09:00
egonzalezktibi, that urls should be in the update_endpoints.yml tasks09:01
*** gkadam has joined #openstack-kolla09:01
*** jascott1 has joined #openstack-kolla09:03
*** masber has quit IRC09:03
YashuDoes anyone have issue with gnochhi during kolla pike installation09:04
reddreamsterktibi, I have to stay at ocata for a while09:04
*** jascott1 has quit IRC09:07
*** Yashu has quit IRC09:08
*** dougsz has joined #openstack-kolla09:09
ktibiegonzalez in update_endpoints it's {'interface': 'public', 'url': '{{ keystone_public_url }}'}09:10
ktibineed to replace keystone_public_url  by ... keystone_public_url value ?09:11
*** ashu has joined #openstack-kolla09:12
ashuHi09:12
ashuIssue with ceph in kolla-pike cinder volume down with logo stating list index out of bounds09:13
lxdongit's in systeminfo09:13
*** jamesbenson has joined #openstack-kolla09:14
*** Pavo has quit IRC09:16
*** pratapagoutham has joined #openstack-kolla09:18
*** jamesbenson has quit IRC09:18
*** liangqi has joined #openstack-kolla09:19
lxdongA picture flashed into my mind which reminds me of something like system default values I had ever seen.09:19
*** jaosorior has quit IRC09:20
*** Pavo has joined #openstack-kolla09:21
*** reddreamster has quit IRC09:22
pratapagouthamHi all my deployment failed with this error https://hastebin.com/arotuziyaq.scala09:26
pratapagouthamDocker logs looks like this https://hastebin.com/webifayege.lua09:26
pratapagouthamany idea/help??09:26
*** mgoddard has joined #openstack-kolla09:28
chasonpratapagoutham checking09:29
ktibichason pratapagoutham https://github.com/openstack/kolla/commit/68be691ffdddb24a5099b8bb81a13d985f1c8d6e09:31
ktibimaybe you use old version of ceilometer python client09:31
pratapagouthamOk09:33
chasonktibi Aha, thx.09:33
pratapagouthami got it09:33
chasonpratapagoutham pls try this patch. :)09:33
ktibichason he have already patch, but I think image have wrong version of ceilometer client09:34
ktibipatch change  --skip-event-database to --skip-metering-database09:34
ktibierror : error: unrecognized arguments: --skip-metering-database09:34
chasonpratapagoutham where do you get the kolla images? Built by your own or the tarballs?09:35
*** athomas has quit IRC09:36
*** dougsz has quit IRC09:36
pratapagouthambuilt using kolla-build09:36
ktibidistro, source or binary ?09:37
pratapagouthamsource09:37
pratapagouthamim using 5.0.009:37
ktibican you check version of ceilometer client in your images ?09:37
pratapagouthamhow to check09:39
pratapagouthami forgot the command09:39
ktibiyou can go to python package path09:40
pratapagouthamok i will let u know09:40
pratapagouthamjust a sec09:40
ktibieg /usr/lib/python2.7/dist-packages for centos09:40
pratapagouthamyes yes09:41
pratapagouthami will do that09:41
pratapagouthamI deleted the container i will check it jus a sec09:43
*** ipsecguy has quit IRC09:45
*** ipsecguy has joined #openstack-kolla09:45
*** yingjun has quit IRC09:47
*** rmart04 has joined #openstack-kolla09:50
*** gfhellma has joined #openstack-kolla09:54
*** athomas has joined #openstack-kolla09:58
pratapagouthamktibi: the container is not up09:59
pratapagouthamthough i start it is going to shutoff state09:59
*** hachi_ has quit IRC10:01
*** lpetrut_ has joined #openstack-kolla10:03
*** kiennt26 has quit IRC10:05
ktibido you build log ?10:07
ktibido you have*10:07
ktibiif not try to rebuild and copy logs10:07
pratapagouthami found the issue i just kept the change u suggested https://github.com/openstack/kolla/commit/68be691ffdddb24a5099b8bb81a13d985f1c8d6e10:08
pratapagouthami am trying it now10:08
pratapagouthami m using kolla 5.0.0 master10:08
pratapagouthamso i assume im using older code and old ceilometer client10:09
pratapagouthami will try this if it fails i will ping the error10:09
ktibiyou use the new code => error: unrecognized arguments: --skip-metering-database10:09
pratapagouthamyes i cloned it from githb10:10
pratapagouthamso i got the latest code10:10
ktibiyeah, but I don't know why, ceilometer agent is not update in your image10:10
pratapagouthamBut the images are the ones which are built with 5.0.010:11
pratapagouthami guess10:11
pratapagouthamit might be10:11
pratapagouthambecause all the images i built are with the tag 5.0.010:11
pratapagouthamso ceilometer client might not be the updated one10:12
ktibimaybe issue with source code, I used binary for build10:12
*** gfhellma has quit IRC10:16
*** hachi_ has joined #openstack-kolla10:19
ktibipratapagoutham ok so copy your kolla-build.log10:22
pratapagouthamok10:23
pratapagouthamhttps://hastebin.com/iropikijuw.scala --110:24
pratapagouthamis this the one you are asking for ktibi ??10:25
ktibino, do you build your own images ?10:27
ktibiwith kolla-build command ?10:27
pratapagouthamkolla-build10:28
ktibiok on node where you build, you have a kolla-build.log10:29
ktibiand kolla-build.conf10:29
ktibicopy all10:29
pratapagouthamok10:31
pratapagouthamm sorry where can i find it in ubuntu10:32
*** reddreamster has joined #openstack-kolla10:33
*** zhurong has quit IRC10:35
*** coolsvap has quit IRC10:37
reddreamsteregonzalez, after the upgrade, I cannot create any new instances: nova_compute cannot create log file for this instance.  Do you have the same issue: libvirtError: internal error: process exited while connecting to monitor: 2017-11-16T10:31:58.129409Z qemu-kvm: -chardev pty,id=charserial0,logfile=/var/lib/nova/instances/033f8335-98b0-4e15-be66-4d57ccc28964/console.log,logappend=off: Unable to open logfile /var/lib/nova/inst10:41
ktibitry : kolla-build -t source -b ubuntu ceilometer-api > kolla-build.log10:42
ktibireddreamster distro of your images ?10:42
reddreamsterktibi, I'm using the office build of centos source ocata10:43
ktibican you copy your qemu.conf ?10:44
*** zhubingbing_ has joined #openstack-kolla10:46
reddreamsterktibi, the last upgrade is done by an old kolla-ansible version: dev40, now I have updated kolla-ansible to head of branch ocata (dev64).10:47
pratapagouthamok ktibi .10:47
ktibireddreamster ok, copy your qemu.conf from your libvirt container10:49
reddreamster[root@compute1 nova-libvirt]# cat qemu.conf stdio_handler = "file"  # TODO: this workaround need to be fixed in Pike # libvirt-bin latest version which runs vms as libvirt-qemu user. # This locks access to nova created files for vms which have # permissions 722 for nova user. We need to force qemu to use this user # to be able to access vm files. # see https://bugs.launchpad.net/kolla-ansible/+bug/1668654 # see https://bug10:49
openstackLaunchpad bug 1668654 in kolla-ansible ocata "ubuntu libvirtError Unable to open logfile" [Critical,Fix released]10:49
reddreamsterstdio_handler = "file"10:49
reddreamsteruser = "nova" group = "nova"10:49
ktibiok so you have the fix10:50
ktibihttps://review.openstack.org/#/c/506529/10:51
ktibifix for centos10:51
openstackgerritMerged openstack/kolla stable/ocata: Install python-openstackclient in kolla-toolbox container  https://review.openstack.org/51997210:52
reddreamsterdoes this fix merged into ocata branch?10:52
reddreamsterSo I'm waiting for the result of another upgrade using the latest kollla-ansible ocata10:54
*** pratapagoutham has quit IRC10:54
ktibiyes fix for ocata https://review.openstack.org/#/c/508211/110:57
*** pratapagoutham has joined #openstack-kolla10:59
pratapagouthamktibi: https://hastebin.com/cobevipaso.bash here is the build.log11:00
egonzalezreddreamster, that was fixed and backported as far i remember, but not present in a release tag, using stable/ocata branch works11:00
pratapagouthamegonzalez: stable pike is 5.0.0rc1 or rc2 ???11:00
egonzalezpratapagoutham, none, those are dev versions before final release11:01
egonzalezpratapagoutham, stable pike is 5.0.* with no rc* or dev* on it11:02
pratapagouthamok so if i want stable pike of kolla i have to download from github and then try r811:02
pratapagouthamok egonzalez :)11:02
*** reddreamster has quit IRC11:03
egonzalezashu, are you akarki in the ask.o.o?11:07
egonzalezmind share cinder.conf and openstack endpoint list?11:07
*** caowei has quit IRC11:08
egonzalezashu, kolla's ceph or external?11:08
*** zhangfei has quit IRC11:09
pratapagouthamegonzalez: when i git clone kolla and the build images then all images are built with tag 5.0.111:09
egonzalezpratapagoutham, yep, thats because of pbr11:11
pratapagouthamand then build images with that package **11:11
pratapagouthamahaa ok thanks egonzalez :)11:11
egonzalezversion from source code endup in version+111:11
egonzalezpratapagoutham, checkout stable/branch or 5.0.0 tag?11:12
*** jbadiapa has quit IRC11:12
*** zhubingbing_ has quit IRC11:12
lvdombrkrhello folks, where can be problem i deploy ocata 4.0.0 tag, but after deployment there is no hypervisors displayed in dashboard?11:12
lvdombrkrunder compute host i see my host, but under hypervisors not, AIO deployment11:13
*** ansmith has quit IRC11:13
pratapagouthamcheckout stable/branch<pike>11:16
pratapagouthamegonzalez: ^11:16
*** Pavo has quit IRC11:16
egonzalezcool, thats fine11:16
*** Pavo has joined #openstack-kolla11:17
danardeleani'm running into this issue https://ask.openstack.org/en/question/111005/kolla-ansible-pike-installation-fluentd-container-in-restarting-mode/11:18
danardeleananything I can do as a workaround?11:18
pratapagouthamdanardelean: thats a bug11:19
pratapagouthamits under review11:19
danardeleanso no workaround atm11:19
pratapagouthamin the mean while u can cherry pick these commits https://review.openstack.org/#/c/518820/5 https://review.openstack.org/#/c/518490/1511:19
pratapagouthamdanardelean: yes there is a workaround11:20
danardeleancool, thanks for the links pratapagoutham11:21
*** jbadiapa has joined #openstack-kolla11:28
*** ashu has quit IRC11:37
*** jamesbenson has joined #openstack-kolla11:42
*** jamesbenson has quit IRC11:47
*** jaosorior has joined #openstack-kolla11:48
*** skramaja_ is now known as skramaja11:49
*** yingjun has joined #openstack-kolla11:51
*** jascott1 has joined #openstack-kolla12:05
*** pbourke has quit IRC12:08
*** jascott1 has quit IRC12:09
*** pbourke has joined #openstack-kolla12:10
*** ktibi has quit IRC12:11
*** ashu has joined #openstack-kolla12:12
ashuHi ceph we are using here is kolla' ceph... And we are using secondly drive for ceph12:14
*** salv-orlando has quit IRC12:16
*** salv-orlando has joined #openstack-kolla12:16
*** salv-orl_ has joined #openstack-kolla12:16
*** yingjun has quit IRC12:17
*** yingjun has joined #openstack-kolla12:18
danardeleanpratapagoutham, if I apply this https://review.openstack.org/#/c/518820/5 I should be fine, yes?12:19
pratapagouthamThat is for kolla u also have to clone kolla-ansible to deploy openstack r8 then12:20
pratapagouthamu have to cherrypick the other one12:20
*** salv-orlando has quit IRC12:21
danardeleanso I have to cherry-pick both patches12:23
*** ashu has quit IRC12:23
*** yangyapeng has quit IRC12:26
*** yangyapeng has joined #openstack-kolla12:26
danardeleanis there any known issue with neutron_openvswitch_agent?12:28
danardeleanhttp://paste.ubuntu.com/25973942/12:28
*** yangyapeng has quit IRC12:30
pratapagouthamnothing as such danardelean12:31
*** yingjun has quit IRC12:33
danardeleanoh, it's my mistake, had the vxlan agent configured but did not have vxlan in enabled type_drivers12:36
*** rhallisey has joined #openstack-kolla12:42
pratapagouthamok12:46
*** ktibi has joined #openstack-kolla12:46
*** ansmith has joined #openstack-kolla12:51
*** ktibi has quit IRC12:58
sdakemorning12:59
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: mongodb: handle "user already exists" error on Debian  https://review.openstack.org/51937113:04
*** ktibi has joined #openstack-kolla13:04
sdakemorning peeps13:07
sdakeany core reviewers around?13:07
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: kubernetes: get it working on AArch64 as well  https://review.openstack.org/46404513:12
hrwsdake: in 1.5h I'll be back13:15
hrwbtw - whoever invented namespaces in kolla: thank you!13:15
*** Pavo has quit IRC13:16
hrw'kolla-build-images.sh debian source kube test16-kube-1414' = build kube images for debian/source combo with test16-kube-1414 namespace13:16
*** zeus has joined #openstack-kolla13:18
*** zeus is now known as Guest8471713:18
*** Pavo has joined #openstack-kolla13:21
danardeleanfluentd is part of which role? I just want to redeploy wit htags that role13:21
*** yangyapeng has joined #openstack-kolla13:25
danardeleanfound it, common13:26
lvdombrkrfolks who use kolla with external ceph?13:34
*** pratapagoutham has quit IRC13:36
*** gfidente is now known as gfidente|afk13:40
*** gfidente|afk has quit IRC13:40
*** skramaja has quit IRC13:51
danardeleanI have deployed a 3-way controller with TLS enabled13:51
danardeleangave it the certificate and everything13:51
danardeleanbut i get connection refused when I try to connect  to horizon13:52
danardeleanI am thinking is something in the HAproxy configs? it has mode http and horizon to :8013:52
danardeleanalso, cannot connect to kibana13:52
ktibianyone use LDAP with keystone ??13:54
ktibiI guess driver is not in docker image13:54
ktibiImportError: (u'Unable to find %(name)r driver in %(namespace)r.', {'namespace': 'keystone.identity', 'name': 'keystone.identity.backends.ldap.Identity'})13:54
*** jaosorior has quit IRC13:58
*** amoralej is now known as amoralej|lunch14:02
*** Guest84717 is now known as zeus14:04
*** zeus has quit IRC14:04
*** zeus has joined #openstack-kolla14:04
*** janki has quit IRC14:08
*** janki has joined #openstack-kolla14:09
*** jtriley has quit IRC14:18
*** ktibi has quit IRC14:21
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Removes weak SSL ciphers in HAProxy config  https://review.openstack.org/52060114:23
*** ktibi has joined #openstack-kolla14:24
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Removes weak SSL ciphers in HAProxy config  https://review.openstack.org/52060114:25
hawihi. i have question regarding netns - i guess if i do 'ip netns ls' all controllers should be the same, show same output?14:34
*** benjamin_diaz has joined #openstack-kolla14:35
egonzalezhawi, nope, can have different namespaces depending on your setup14:35
*** mdnadeem has quit IRC14:35
egonzalezsdake, by chance know someone from security team to take a look at this change https://review.openstack.org/52060114:36
sdakeindeed14:36
sdakehe may not be up yet14:36
*** gfidente has joined #openstack-kolla14:45
*** gfidente has quit IRC14:45
*** gfidente has joined #openstack-kolla14:45
sdakeegonzalez he is not up yet14:45
sdakeegonzalez i'll have him look when he is avialable - he wrote the original code14:46
egonzalezsdake, thanks, i prefer someone with knowledge about the subject validate the change :)14:46
*** ashu has joined #openstack-kolla14:46
ashuHiy14:46
*** jtriley has joined #openstack-kolla14:49
*** egonzalez has quit IRC14:51
*** egonzalez has joined #openstack-kolla14:59
*** ashu has quit IRC15:00
*** hachi__ has joined #openstack-kolla15:00
*** Teck7 has joined #openstack-kolla15:03
*** amoralej|lunch is now known as amoralej15:03
*** hachi_ has quit IRC15:03
*** jaosorior has joined #openstack-kolla15:04
openstackgerritAndy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends  https://review.openstack.org/46896615:05
*** rfxn has quit IRC15:06
*** jamesbenson has joined #openstack-kolla15:10
*** kelv_ has joined #openstack-kolla15:11
openstackgerritsean mooney proposed openstack/kolla-ansible master: This change allow setting kernel commandline args  https://review.openstack.org/40887615:14
*** Pavo has quit IRC15:16
*** owalsh has joined #openstack-kolla15:19
*** Pavo has joined #openstack-kolla15:21
*** hachi__ has quit IRC15:27
*** hongbin has joined #openstack-kolla15:30
*** dave-mccowan has joined #openstack-kolla15:34
*** dave-mcc_ has joined #openstack-kolla15:37
*** rsjethani has joined #openstack-kolla15:38
*** dave-mccowan has quit IRC15:39
rsjethanihey guys....m new to kolla...just a query is deployment host separate from the actual deployment??15:40
pbourkersjethani: it doesn't have to be but often I find it easier15:41
pbourkeegonzalez: currently we dont have a default cinder backend enabled, so if users set enable_cinder=true nothing happens15:42
rsjethanipbourke: m just trying out simple 1 controller+ 1compute from a different host15:42
pbourkeegonzalez: how do you feel about turning on lvm by default, we have a precheck for this also15:42
pbourkersjethani: sounds good15:42
rsjethaniprecheck is failing as the network names are different on host and VMs15:42
egonzalezpbourke, i'd really prefer ceph as default, was always the default value15:43
rsjethanidep. host should not be included in all tasks in playbooks15:43
egonzalezwhen this changed? I think this is an important upgrade release note15:43
ktibiegonzalez ceph default backend but if 0 disk tag, cinder fail no ?15:50
egonzalezktibi, not fail but not working15:51
egonzalezjust wont be able to create volumes15:51
egonzalezceph is what we test in gates15:51
*** itlinux has joined #openstack-kolla15:51
benjamin_diazHey guys. In relation to the addition of deployment host to inventory. One of the greatest problems I found was that setting enable_destroy_images = True, destroys images in deployment host. In stable/ocata that didn't happen, so it has a big (and sad) surprise.15:52
egonzalezbenjamin_diaz, known issue https://bugs.launchpad.net/kolla-ansible/+bug/1724306 we need to find a way to do it, on method could be add destroy_include_images=no for deployhost in inventory15:56
openstackLaunchpad bug 1724306 in kolla-ansible "destroy --include-images can remove operator node images" [Medium,Triaged]15:56
egonzalezdont know if due variable precedence can cause some issue15:56
*** egonzalez has quit IRC16:02
*** openstackgerrit has quit IRC16:03
*** jascott1 has joined #openstack-kolla16:06
*** rmart04 has quit IRC16:07
*** jaosorior has quit IRC16:10
*** janki has quit IRC16:10
*** jascott1 has quit IRC16:11
*** pcaruana has quit IRC16:13
*** spsurya has quit IRC16:17
*** ntpttr_laptop has joined #openstack-kolla16:26
*** jmccarthy has joined #openstack-kolla16:32
*** openstackgerrit has joined #openstack-kolla16:43
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Improves SSL ciphers in HAProxy config  https://review.openstack.org/52060116:43
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Improves SSL ciphers in HAProxy config  https://review.openstack.org/52060116:44
*** goldyfruit has joined #openstack-kolla16:44
*** gfhellma has joined #openstack-kolla16:46
*** goldyfruit has quit IRC16:48
*** goldyfruit has joined #openstack-kolla16:48
*** danardelean has quit IRC16:49
*** spsurya has joined #openstack-kolla16:57
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Improves SSL ciphers in HAProxy config  https://review.openstack.org/52060116:57
*** gfidente has quit IRC16:57
inc0good morning17:11
*** jascott1 has joined #openstack-kolla17:12
*** goldyfruit has quit IRC17:14
*** Pavo has quit IRC17:16
*** lrensing has joined #openstack-kolla17:19
*** ntpttr_laptop has quit IRC17:20
*** Pavo has joined #openstack-kolla17:21
*** jascott1 has quit IRC17:21
*** jascott1 has joined #openstack-kolla17:21
*** rsjethani has quit IRC17:23
*** jascott1 has quit IRC17:24
*** jascott1 has joined #openstack-kolla17:24
*** dave-mcc_ is now known as dave-mccowan17:26
*** livelace has quit IRC17:27
*** jascott1 has quit IRC17:29
*** rwsu has joined #openstack-kolla17:30
*** gkadam has quit IRC17:31
lvdombrkrfolks i deployed kolla 4.0.0 tag with external ceph, bet cant create any volume and in cinder-volume logs see this error:17:36
lvdombrkr2017-11-16 19:35:02.563 7 ERROR cinder.cmd.volume [-] Configuration for cinder-volume does not specify "enabled_backends". Using DEFAULT section to configure drivers is not supported since Ocata.17:36
lvdombrkr2017-11-16 19:35:02.564 7 ERROR cinder.cmd.volume [-] No volume service(s) started successfully, terminating.17:36
lvdombrkrany ideas?17:36
benjamin_diazCan you share your cinder-volume.conf? You can find it in your storage node, in /etc/kolla/cinder-volume/cinder.conf17:38
benjamin_diazAlso, I think 4.0.3 is the most updated tag in the Ocata version. Someone please correct me if I'm mistaken.17:39
*** jascott1 has joined #openstack-kolla17:40
*** hachi_ has joined #openstack-kolla17:49
lvdombrkrbenjamin_diaz: hi http://paste.openstack.org/raw/626540/17:55
benjamin_diazlvdombrkr Did you follow this guide? https://github.com/openstack/kolla-ansible/blob/master/doc/source/reference/external-ceph-guide.rst17:57
benjamin_diazYou are missing a block in your cinder.conf17:57
lvdombrkrbenjamin_diaz: yes i follow this guide18:00
*** goldyfruit has joined #openstack-kolla18:00
lvdombrkrbenjamin_diaz: what excatly is missing in conf?18:00
lvdombrkrif i run docker ps -a i see that cinder_volume container are stuck on "restarting"18:01
benjamin_diazDid you add in your deployment host the file /etc/kolla/config/cinder/cinder-volume.conf ?18:01
benjamin_diazYou need three files in that folder: cinder-volume.conf, cinder-backup.conf and ceph.conf. The contents are specified in the guide.18:03
benjamin_diazAfter adding that you need to execute 'kolla-ansible reconfigure'18:03
*** mgoddard has quit IRC18:04
*** jascott1 has quit IRC18:04
*** jmccarthy has quit IRC18:04
*** dklyle has quit IRC18:05
*** jascott1 has joined #openstack-kolla18:07
lvdombrkrbenjamin_diaz: i have two separate folders in cinder folder - cinder-backup and cinder-volume , there is output of each http://paste.openstack.org/raw/626541/18:08
lvdombrkrsure, i run reconigure after add configs18:08
*** jascott1 has quit IRC18:10
benjamin_diazYou have to follow the convention in the guide, or your config files won't be merged. In your deployment host, you need to have /etc/kolla/config/cinder/cinder-volume.conf, /etc/kolla/config/cinder/cinder-backup.conf and /etc/kolla/config/cinder/ceph.conf18:11
lvdombrkrbenjamin_diaz: and also two  keyrings?18:12
*** jascott1 has joined #openstack-kolla18:13
*** david-lyle has joined #openstack-kolla18:14
benjamin_diazYeah: /etc/kolla/config/cinder/cinder-backup/ceph.client.cinder.keyring and /etc/kolla/config/cinder/cinder-volume/ceph.client.cinder.keyring18:16
*** jascott1 has quit IRC18:17
benjamin_diazHere is the stable/ocata version of the guide: https://github.com/openstack/kolla-ansible/blob/stable/ocata/doc/external-ceph-guide.rst#cinder18:18
*** jascott1 has joined #openstack-kolla18:19
*** aagate has joined #openstack-kolla18:19
*** danardelean has joined #openstack-kolla18:19
*** lrensing has quit IRC18:22
*** amoralej is now known as amoralej|off18:23
*** danardelean has quit IRC18:23
*** jascott1 has quit IRC18:23
*** jascott1 has joined #openstack-kolla18:25
lvdombrkrbenjamin_diaz: excellent, now its works ) Thank you!18:27
benjamin_diazGreat !18:27
*** jascott1 has quit IRC18:28
*** jascott1 has joined #openstack-kolla18:31
*** jascott1 has quit IRC18:36
*** david-lyle is now known as dklyle18:36
*** jascott1 has joined #openstack-kolla18:37
*** jascott1 has quit IRC18:39
lvdombrkrbenjamin_diaz: mhmm interesting now i can create volumes etc, but when try create instance it stucks as spawning and after that get error:18:40
lvdombrkr<benjamin_diaz>18:40
lvdombrkrFailed to perform requested operation on instance "centos", the instance has an error status: Please try again later [Error: Secret not found: no secret with matching uuid 'fc69c6f9-b56c-47c1-89b8-b4a112a9119a'].18:40
*** jascott1 has joined #openstack-kolla18:42
*** mgoddard has joined #openstack-kolla18:43
*** jascott1 has quit IRC18:45
lvdombrkrsomeone had a same issue: https://bugs.launchpad.net/kolla-ansible/+bug/169704718:47
openstackLaunchpad bug 1697047 in kolla-ansible "Unable start an instance with cinder volume (ceph)" [Undecided,Invalid]18:47
*** jascott1 has joined #openstack-kolla18:48
*** goldyfruit has quit IRC18:50
*** jascott1 has quit IRC18:51
*** unicell has joined #openstack-kolla18:52
*** jascott1 has joined #openstack-kolla18:54
benjamin_diazlvdombrkr: https://www.sebastien-han.fr/blog/2015/01/14/fix-nova-scheduler-issue-with-rbd-and-uuid-not-found/18:57
benjamin_diazTry restarting de the nova_libvirt containers in the compute nodes. Note that this will affect your running instances.18:58
*** jascott1 has quit IRC18:58
*** lpetrut_ has quit IRC19:00
*** jascott1 has joined #openstack-kolla19:00
*** shardy has quit IRC19:03
*** jascott1 has quit IRC19:04
*** chas_ has quit IRC19:05
*** jascott1 has joined #openstack-kolla19:06
*** gfhellma_ has joined #openstack-kolla19:09
*** jascott1 has quit IRC19:10
*** itlinux has quit IRC19:12
*** gfhellma has quit IRC19:12
*** jascott1 has joined #openstack-kolla19:13
*** rloo has joined #openstack-kolla19:14
*** danardelean has joined #openstack-kolla19:14
*** Pavo has quit IRC19:16
*** jascott1 has quit IRC19:18
*** gfhellma__ has joined #openstack-kolla19:18
*** danardelean has quit IRC19:19
*** jascott1 has joined #openstack-kolla19:20
*** Pavo has joined #openstack-kolla19:21
*** gfhellma_ has quit IRC19:21
*** jascott1 has quit IRC19:24
*** jascott1 has joined #openstack-kolla19:26
*** dave-mccowan has quit IRC19:26
*** dave-mccowan has joined #openstack-kolla19:27
*** jascott1 has quit IRC19:30
*** jascott1 has joined #openstack-kolla19:32
*** jascott1 has quit IRC19:36
*** jascott1 has joined #openstack-kolla19:37
*** jascott1 has quit IRC19:42
*** jascott1 has joined #openstack-kolla19:43
*** jascott1 has quit IRC19:48
*** jascott1 has joined #openstack-kolla19:49
*** zshi_ has quit IRC19:50
*** jascott1 has quit IRC19:54
*** jascott1 has joined #openstack-kolla19:55
*** danardelean has joined #openstack-kolla19:58
*** jascott1 has quit IRC20:00
*** jascott1 has joined #openstack-kolla20:01
*** lpetrut_ has joined #openstack-kolla20:02
*** danardelean has quit IRC20:02
*** pcaruana has joined #openstack-kolla20:06
*** jascott1 has quit IRC20:06
*** jascott1 has joined #openstack-kolla20:07
*** mgoddard has quit IRC20:08
*** jascott1 has quit IRC20:10
*** jascott1 has joined #openstack-kolla20:10
*** lrensing has joined #openstack-kolla20:14
*** jascott1 has quit IRC20:14
*** Pavo has quit IRC20:16
*** jascott1 has joined #openstack-kolla20:16
*** Pavo has joined #openstack-kolla20:16
*** hachi_ has quit IRC20:18
*** jascott1 has quit IRC20:20
*** jascott1 has joined #openstack-kolla20:22
openstackgerritBenjamin Diaz proposed openstack/kolla-ansible master: Added var to disable deploy host image destruction  https://review.openstack.org/52076120:27
*** jascott1 has quit IRC20:33
*** ntpttr_laptop has joined #openstack-kolla20:36
*** jascott1 has joined #openstack-kolla20:39
*** mgoddard has joined #openstack-kolla20:43
*** jascott1 has quit IRC20:43
*** jascott1 has joined #openstack-kolla20:45
*** mgoddard has quit IRC20:49
*** jascott1 has quit IRC20:49
*** itlinux has joined #openstack-kolla20:50
*** jascott1 has joined #openstack-kolla20:51
*** jascott1 has quit IRC20:55
*** jascott1 has joined #openstack-kolla20:57
*** jascott1 has quit IRC21:02
*** jascott1 has joined #openstack-kolla21:03
*** gfhellma__ has quit IRC21:05
*** jascott1 has quit IRC21:06
*** spsurya has quit IRC21:06
*** benjamin_diaz has quit IRC21:06
*** jascott1 has joined #openstack-kolla21:09
*** jascott1 has quit IRC21:10
*** jascott1 has joined #openstack-kolla21:11
*** lpetrut_ has quit IRC21:13
*** rhallisey has quit IRC21:15
*** jascott1 has quit IRC21:15
*** lpetrut_ has joined #openstack-kolla21:15
*** Pavo has quit IRC21:16
*** Pavo has joined #openstack-kolla21:16
*** jascott1 has joined #openstack-kolla21:17
*** ansmith has quit IRC21:17
*** dmsimard has joined #openstack-kolla21:19
*** jamesbenson has quit IRC21:20
*** jascott1 has quit IRC21:21
dmsimardinc0: btw stumbled on a pretty neat feature of openshift registry :p21:21
dmsimardThey unfortunately don't go into too much details here: https://docs.openshift.com/container-platform/3.6/install_config/registry/extended_registry_configuration.html#middleware-repository-pullthrough21:22
*** jamesbenson has joined #openstack-kolla21:22
dmsimardbut tl;dr, openshift and periodically pull an image from an external registry and store it locally21:22
dmsimard-> oc tag --source=docker centos:latest yourproject/centos:latest --reference-policy=local --scheduled=true21:23
*** lpetrut_ has quit IRC21:23
*** gfhellma has joined #openstack-kolla21:23
*** pcaruana has quit IRC21:24
*** ktibi has quit IRC21:25
*** gfhellma_ has joined #openstack-kolla21:26
*** jamesbenson has quit IRC21:26
*** jascott1 has joined #openstack-kolla21:29
*** gfhellma has quit IRC21:30
*** jamesbenson has joined #openstack-kolla21:30
*** danardelean has joined #openstack-kolla21:30
*** jascott1 has quit IRC21:32
*** jascott1 has joined #openstack-kolla21:35
*** jascott1 has quit IRC21:40
*** jascott1 has joined #openstack-kolla21:41
*** jascott1 has quit IRC21:45
*** jascott1 has joined #openstack-kolla21:47
*** jascott1 has quit IRC21:48
*** jascott1 has joined #openstack-kolla21:51
*** jamesbenson has quit IRC21:53
*** jamesbenson has joined #openstack-kolla21:53
*** itlinux has quit IRC21:59
*** jascott1 has quit IRC22:05
*** jascott1 has joined #openstack-kolla22:06
*** ntpttr_laptop has quit IRC22:07
*** jtriley_ has joined #openstack-kolla22:08
*** jascott1 has quit IRC22:09
*** jtriley has quit IRC22:11
*** jtriley_ has quit IRC22:18
*** ansmith has joined #openstack-kolla22:24
*** zshi has joined #openstack-kolla22:34
*** jascott1 has joined #openstack-kolla22:42
*** masber has joined #openstack-kolla22:49
*** jamesbenson has quit IRC22:56
*** ntpttr_laptop has joined #openstack-kolla22:59
*** Pavo has quit IRC23:16
*** Pavo has joined #openstack-kolla23:16
*** itlinux has joined #openstack-kolla23:22
*** gfhellma_ has quit IRC23:29
*** lrensing has quit IRC23:56
inc0dmsimard: it's like registry cache +  cron;)23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!