*** eck` is now known as eck`gone | 00:04 | |
*** salv-orlando has joined #openstack-oslo | 00:20 | |
*** salv-orlando has quit IRC | 00:25 | |
*** larainema has quit IRC | 01:04 | |
*** edmondsw has joined #openstack-oslo | 01:13 | |
*** edmondsw has quit IRC | 01:18 | |
openstackgerrit | Vu Cong Tuan proposed openstack/oslo.middleware master: Removing oslo.serialization in test-requirements.txt https://review.openstack.org/580240 | 01:19 |
---|---|---|
*** salv-orlando has joined #openstack-oslo | 01:21 | |
*** larainema has joined #openstack-oslo | 01:25 | |
*** salv-orlando has quit IRC | 01:26 | |
*** bobh has joined #openstack-oslo | 01:26 | |
openstackgerrit | Vu Cong Tuan proposed openstack/oslo.messaging master: Moving stestr to correct package order in test-requirements.txt https://review.openstack.org/580242 | 01:32 |
*** salv-orlando has joined #openstack-oslo | 02:22 | |
*** salv-orlando has quit IRC | 02:26 | |
*** bobh has quit IRC | 02:27 | |
openstackgerrit | Vu Cong Tuan proposed openstack/stevedore master: Switch to stestr https://review.openstack.org/580250 | 02:31 |
*** edmondsw has joined #openstack-oslo | 03:02 | |
*** edmondsw has quit IRC | 03:06 | |
*** salv-orlando has joined #openstack-oslo | 03:23 | |
*** salv-orlando has quit IRC | 03:27 | |
*** lpetrut has joined #openstack-oslo | 03:44 | |
*** dkehn has quit IRC | 04:02 | |
*** dkehn has joined #openstack-oslo | 04:19 | |
*** salv-orlando has joined #openstack-oslo | 04:23 | |
*** lpetrut has quit IRC | 04:24 | |
*** salv-orlando has quit IRC | 04:28 | |
*** njohnston has quit IRC | 04:28 | |
*** njohnston has joined #openstack-oslo | 04:29 | |
*** lpetrut has joined #openstack-oslo | 04:33 | |
*** zzzeek has quit IRC | 04:40 | |
*** zzzeek has joined #openstack-oslo | 04:43 | |
*** edmondsw has joined #openstack-oslo | 04:51 | |
*** lpetrut has quit IRC | 04:53 | |
*** edmondsw has quit IRC | 04:55 | |
*** zzzeek has quit IRC | 05:10 | |
*** zzzeek has joined #openstack-oslo | 05:11 | |
*** e0ne has joined #openstack-oslo | 05:18 | |
*** e0ne has quit IRC | 05:21 | |
*** salv-orlando has joined #openstack-oslo | 05:24 | |
*** jbadiapa has quit IRC | 05:24 | |
*** lpetrut has joined #openstack-oslo | 05:27 | |
*** salv-orlando has quit IRC | 05:28 | |
*** lpetrut has quit IRC | 05:33 | |
*** ianychoi has joined #openstack-oslo | 05:34 | |
*** nicolasbock has joined #openstack-oslo | 05:49 | |
*** Guest38444 has quit IRC | 05:57 | |
*** salv-orlando has joined #openstack-oslo | 06:11 | |
openstackgerrit | Vu Cong Tuan proposed openstack/stevedore master: Switch to stestr https://review.openstack.org/580250 | 06:13 |
openstackgerrit | Steve Kowalik proposed openstack/oslo.messaging master: Remove transport aliases support https://review.openstack.org/580294 | 06:16 |
*** lpetrut has joined #openstack-oslo | 06:20 | |
*** salv-orlando has quit IRC | 06:24 | |
*** salv-orlando has joined #openstack-oslo | 06:24 | |
*** salv-orlando has quit IRC | 06:25 | |
*** jbadiapa has joined #openstack-oslo | 06:43 | |
*** lpetrut has quit IRC | 07:12 | |
*** yamamoto has quit IRC | 07:18 | |
*** lpetrut has joined #openstack-oslo | 07:21 | |
*** peereb has joined #openstack-oslo | 07:22 | |
*** salv-orlando has joined #openstack-oslo | 07:26 | |
*** yamamoto has joined #openstack-oslo | 07:26 | |
*** salv-orlando has quit IRC | 07:31 | |
*** Guest38444 has joined #openstack-oslo | 07:38 | |
*** yamamoto has quit IRC | 07:42 | |
*** e0ne has joined #openstack-oslo | 07:46 | |
*** rcernin has quit IRC | 07:54 | |
*** mago_ has joined #openstack-oslo | 07:58 | |
*** yamamoto has joined #openstack-oslo | 08:10 | |
*** salv-orlando has joined #openstack-oslo | 08:27 | |
*** edmondsw has joined #openstack-oslo | 08:28 | |
*** salv-orlando has quit IRC | 08:31 | |
*** edmondsw has quit IRC | 08:32 | |
*** pbourke has quit IRC | 09:13 | |
*** pbourke has joined #openstack-oslo | 09:15 | |
*** sambetts|afk is now known as sambetts | 09:19 | |
*** e0ne has quit IRC | 09:21 | |
*** e0ne has joined #openstack-oslo | 09:23 | |
*** salv-orlando has joined #openstack-oslo | 09:28 | |
*** salv-orlando has quit IRC | 09:34 | |
*** jbadiapa has quit IRC | 10:15 | |
openstackgerrit | Merged openstack/oslo.messaging master: Moving stestr to correct package order in test-requirements.txt https://review.openstack.org/580242 | 10:20 |
*** e0ne has quit IRC | 10:28 | |
*** salv-orlando has joined #openstack-oslo | 10:30 | |
*** salv-orlando has quit IRC | 10:34 | |
*** lpetrut_ has joined #openstack-oslo | 10:39 | |
*** lpetrut has quit IRC | 10:42 | |
*** gcb has joined #openstack-oslo | 10:58 | |
openstackgerrit | Vu Cong Tuan proposed openstack/stevedore master: Switch to stestr https://review.openstack.org/580250 | 11:02 |
openstackgerrit | James Page proposed openstack/oslo.messaging master: py37: drop use of 'async' as parameter name https://review.openstack.org/580343 | 11:05 |
openstackgerrit | James Page proposed openstack/oslo.messaging master: py37: drop use of 'async' as parameter name https://review.openstack.org/580343 | 11:10 |
*** gcb has quit IRC | 11:13 | |
*** edmondsw has joined #openstack-oslo | 11:29 | |
*** salv-orlando has joined #openstack-oslo | 11:31 | |
*** salv-orlando has quit IRC | 11:36 | |
openstackgerrit | James Page proposed openstack/oslo.messaging master: py37: deal with Exception repr changes https://review.openstack.org/580349 | 11:39 |
*** lifeless has quit IRC | 11:45 | |
*** e0ne has joined #openstack-oslo | 12:07 | |
*** edmondsw has quit IRC | 12:07 | |
*** edmondsw has joined #openstack-oslo | 12:13 | |
*** edmondsw_ has joined #openstack-oslo | 12:16 | |
*** edmondsw has quit IRC | 12:19 | |
*** jbadiapa has joined #openstack-oslo | 12:20 | |
*** salv-orlando has joined #openstack-oslo | 12:31 | |
*** raildo has joined #openstack-oslo | 12:32 | |
*** salv-orlando has quit IRC | 12:36 | |
*** e0ne has quit IRC | 12:48 | |
*** salv-orlando has joined #openstack-oslo | 12:53 | |
*** salv-orl_ has joined #openstack-oslo | 12:54 | |
*** salv-orlando has quit IRC | 12:56 | |
*** salv-orlando has joined #openstack-oslo | 12:57 | |
*** eck`gone is now known as eck` | 12:57 | |
*** salv-orl_ has quit IRC | 12:59 | |
*** kgiusti has joined #openstack-oslo | 13:03 | |
*** cdent has joined #openstack-oslo | 13:15 | |
*** salv-orlando has quit IRC | 13:15 | |
*** salv-orlando has joined #openstack-oslo | 13:16 | |
*** ansmith has joined #openstack-oslo | 13:32 | |
*** salv-orlando has quit IRC | 13:35 | |
*** rmascena has joined #openstack-oslo | 13:57 | |
*** e0ne has joined #openstack-oslo | 13:59 | |
*** raildo has quit IRC | 13:59 | |
openstackgerrit | Raildo Mascena proposed openstack/oslo.config master: New cache layer for external sources https://review.openstack.org/578144 | 14:11 |
*** rmascena is now known as raildo | 14:11 | |
*** rmascena has joined #openstack-oslo | 14:13 | |
*** raildo has quit IRC | 14:16 | |
openstackgerrit | Merged openstack/stevedore master: Switch to stestr https://review.openstack.org/580250 | 14:24 |
*** rmascena is now known as raildo | 14:24 | |
*** lpetrut_ has quit IRC | 14:24 | |
openstackgerrit | Michal Arbet proposed openstack/taskflow master: Fix code to support networkx > 1.0 https://review.openstack.org/577833 | 14:33 |
*** salv-orlando has joined #openstack-oslo | 14:36 | |
cdent | bnemec: do you know if there's been any further work or discussion on https://bugs.launchpad.net/cinder/+bug/1432387 ? It's come up in downstream discussions and I'm trying to track it, and maybe even fix it | 14:40 |
openstack | Launchpad bug 1432387 in oslo.concurrency "abandoned lock files" [Wishlist,Confirmed] | 14:40 |
*** salv-orlando has quit IRC | 14:40 | |
smcginnis | I haven't heard anything on that in a long time. | 14:41 |
openstackgerrit | Raildo Mascena proposed openstack/oslo.config master: add detail to driver options in config generator https://review.openstack.org/578461 | 14:42 |
smcginnis | cdent: If it's a downstream concern, maybe switch to using something other than the file locks? https://bugs.launchpad.net/cinder/+bug/1432387/comments/18 | 14:43 |
openstack | Launchpad bug 1432387 in oslo.concurrency "abandoned lock files" [Wishlist,Confirmed] | 14:43 |
bnemec | cdent: Wow, I'm surprised I didn't nack that when I triaged it. | 14:43 |
bnemec | I'm pretty strongly opposed to further attempts to "fix" this "problem". | 14:43 |
bnemec | Which is cosmetic at worst. | 14:44 |
openstackgerrit | Raildo Mascena proposed openstack/oslo.config master: User guide documentation for backend drivers for oslo.config https://review.openstack.org/576947 | 14:44 |
bnemec | And past attempts have had some fairly ugly side effects. | 14:44 |
openstackgerrit | Raildo Mascena proposed openstack/oslo.config master: New cache layer for external sources https://review.openstack.org/578144 | 14:44 |
cdent | smcginnis: yeah, that's kind of what I was thinking too, but apparently there's some past limitation, not sure what | 14:44 |
cdent | I'm digging in both directions | 14:45 |
smcginnis | OK, good. | 14:45 |
bnemec | cdent: Is it actually causing a problem? | 14:45 |
cdent | apparently in large enough and old enough setups it can results in either more files than a directory can handle or too many inodes | 14:46 |
bnemec | cdent: Are they cleaning up the lock files on reboot? Or are these setups being rebooted rarely enough that they still pile up? | 14:46 |
cdent | still digging in the direction, so don't have much data yet | 14:47 |
cdent | (i'm on the long end of a telephone game) | 14:47 |
bnemec | IIRC the number of files in a directory that is supported by all major Linux filesystems is something absurdly large. | 14:47 |
cdent | it _may_ be that it is just making people feel aesthetically uncomfy | 14:48 |
*** ansmith has quit IRC | 14:48 | |
cdent | like I said: telephone game | 14:48 |
bnemec | That's always been the case in the past. :-) | 14:48 |
bnemec | Unfortunately it's impossible to safely remove the lock files while a service is still running. | 14:48 |
cdent | but knowing that you both think it is not going to change and that using a different style of locking is good data, so thank you | 14:49 |
smcginnis | Just whack them and cross your fingers. :) | 14:49 |
smcginnis | But yeah, now that etcd is considered a base service, I think tooz can just be configured to use that and the file problem goes away. | 14:49 |
bnemec | cdent: Okay. If it does turn out that there is a legitimate functional issue feel free to follow up though. | 14:49 |
bnemec | It _is_ possible to clean up lock files manually if the service knows for certain that it's done with one. | 14:50 |
cdent | smcginnis: I first read that as "whack them across the fingers" and wondered if you were secretly a catholic nun running a school | 14:50 |
bnemec | https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L151 | 14:50 |
bnemec | For cinder it might be okay to call that after a volume is deleted and you're sure the id isn't going to be locked anymore. | 14:51 |
smcginnis | Ooh, can we get some rulers at the next Summit? That could be interesting. | 14:51 |
smcginnis | I'm not sure if we have visibility to that with how things are abstracted through tooz. | 14:52 |
smcginnis | But if it was a real issue I'm sure we could find a way around that. | 14:52 |
cdent | i've tried to gin up some proper feedback | 14:56 |
* smcginnis is failing to come up with a good tonic response pun to make cdent groan | 14:58 | |
cdent | I'll take it on faith | 14:58 |
smcginnis | :) | 14:58 |
* cdent can see some gin and tonic in his future this evening | 14:58 | |
smcginnis | Whoo hoo | 14:58 |
cdent | this stuff. http://www.tarquinsgin.com/ | 14:59 |
*** salv-orlando has joined #openstack-oslo | 15:01 | |
*** salv-orlando has quit IRC | 15:01 | |
*** namnh has joined #openstack-oslo | 15:01 | |
cdent | bnemec, smcginnis: looks like most of the lock files are coming from neutron (this is vmware nsx-v install), not cinder, and for the time being file locks are where things are. 900K files in the same directory. short term workaround is to shut down neutron, kill some files, start neutron back up | 15:04 |
smcginnis | Wow, 900k! | 15:06 |
bnemec | That is quite a lot. Is it causing failures? | 15:07 |
cdent | yes, sometimes that can't create files | 15:11 |
bnemec | Hmm, okay. | 15:13 |
bnemec | Would be interesting to see why there are so many and if we can reduce that number or clean some of them up. | 15:13 |
bnemec | I need to duck out and take my car in to the shop right now though. | 15:14 |
cdent | thanks for the engagement | 15:14 |
cdent | I'm trying to locate the offending code so I can see why so many are happening | 15:14 |
* bnemec biab | 15:21 | |
*** peereb has quit IRC | 15:22 | |
smcginnis | cdent: I can ping mlavalle if you need some help there. | 15:25 |
*** bnemec has quit IRC | 15:25 | |
cdent | smcginnis: It's nsx code being bad: https://github.com/openstack/vmware-nsx/blob/master/vmware_nsx/common/locking.py#L36 | 15:26 |
cdent | I'm not sure why locking_coordinator_url is never set. If it were this goes away, presumably. | 15:26 |
smcginnis | cdent: Well, I guess at least you can probably get to the right people to fix that. | 15:26 |
cdent | one would hope so | 15:26 |
cdent | it looks like a configuration problem to me, but what do I know | 15:27 |
smcginnis | Yeah, hard to tell just looking at that snippet. | 15:27 |
smcginnis | cdent: I wonder if they can just look at moving to tooz to follow what is being done elsewhere. | 15:32 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Add docstring from LocalManifestMaker.add_defaults https://review.openstack.org/580412 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Switch to stestr https://review.openstack.org/580413 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Remove 'tools/releasenotes_tox.sh' https://review.openstack.org/580414 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Fix file permissions https://review.openstack.org/580415 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: builddoc: Remove support for Sphinx < 1.6 https://review.openstack.org/580416 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: packaging: Remove support for pyN requirement files https://review.openstack.org/580417 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Fix formatting of packagers guide https://review.openstack.org/580418 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Add documentation for missing '[pbr]' options https://review.openstack.org/580419 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Add Sphinx extension https://review.openstack.org/580420 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'build_sphinx' integration https://review.openstack.org/580421 | 15:36 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'test' integration https://review.openstack.org/580422 | 15:36 |
*** e0ne has quit IRC | 15:42 | |
*** lpetrut_ has joined #openstack-oslo | 15:46 | |
*** dtruong has joined #openstack-oslo | 15:55 | |
*** bnemec has joined #openstack-oslo | 15:56 | |
openstackgerrit | wu.chunyang proposed openstack/debtcollector master: Add release note link in README https://review.openstack.org/580437 | 16:02 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Switch to stestr https://review.openstack.org/580413 | 16:03 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Remove 'tools/releasenotes_tox.sh' https://review.openstack.org/580414 | 16:03 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: trivial: Fix file permissions https://review.openstack.org/580415 | 16:03 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: builddoc: Remove support for Sphinx < 1.6 https://review.openstack.org/580416 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: packaging: Remove support for pyN requirement files https://review.openstack.org/580417 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Fix formatting of packagers guide https://review.openstack.org/580418 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Add documentation for missing '[pbr]' options https://review.openstack.org/580419 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Add Sphinx extension https://review.openstack.org/580420 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'build_sphinx' integration https://review.openstack.org/580421 | 16:04 |
openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Deprecate 'test' integration https://review.openstack.org/580422 | 16:04 |
*** mago_ has quit IRC | 16:11 | |
*** tosky has joined #openstack-oslo | 16:11 | |
*** Guest38444 has quit IRC | 16:13 | |
*** bobh has joined #openstack-oslo | 16:17 | |
namnh | bnemec: Long time did not get your comment. If you have free time, can you help me to review this patch: https://review.openstack.org/#/c/526314 | 16:25 |
bnemec | namnh: Yeah, sorry. I need to get back to that ASAP. | 16:25 |
namnh | bnemec: thanks in advance | 16:26 |
*** gcb has joined #openstack-oslo | 16:28 | |
*** gcb has quit IRC | 16:36 | |
*** bobh has quit IRC | 16:41 | |
*** bobh has joined #openstack-oslo | 16:43 | |
*** bobh has quit IRC | 16:47 | |
*** bnemec has quit IRC | 16:51 | |
*** e0ne has joined #openstack-oslo | 17:03 | |
openstackgerrit | Michal Arbet proposed openstack/taskflow master: Fix code to support networkx > 1.0 https://review.openstack.org/577833 | 17:09 |
*** lpetrut_ has quit IRC | 17:10 | |
*** bnemec has joined #openstack-oslo | 17:18 | |
*** namnh has quit IRC | 17:22 | |
kgiusti | bnemec: hey ben - I approved this https://review.openstack.org/#/c/580294/ - this contains an API change however... | 17:23 |
kgiusti | bnemec: and it looks like you just did a major bump... :( | 17:23 |
bnemec | kgiusti: Yeah, I saw that. | 17:24 |
bnemec | It's not the end of the world if we have to bump two major versions in a week. | 17:24 |
kgiusti | bnemec: maybe I should revert for now | 17:24 |
bnemec | Unfortunate timing, but what can you do? | 17:24 |
kgiusti | bnemec: should this wait until beginning of stein instead? | 17:24 |
bnemec | kgiusti: Unless you think there's significant risk to the change, I wouldn't bother. | 17:25 |
kgiusti | bnemec: the change itself isn't risky | 17:25 |
kgiusti | bnemec: folks may not be happy with api breakage so late in the dev cycle - that's my only concern. | 17:27 |
*** ansmith has joined #openstack-oslo | 17:28 | |
kgiusti | ansmith: hey, some vacation you must be having if you're here... | 17:28 |
bnemec | kgiusti: Is this blocking anything that needs to land in Rocky? If not, maybe it would be better to wait for Stein. | 17:29 |
kgiusti | bnemec: not aware of anything - StevenK might | 17:31 |
kgiusti | bnemec: I'll drop a comment in the review. | 17:32 |
bnemec | kgiusti: Sounds good. | 17:33 |
*** lpetrut_ has joined #openstack-oslo | 17:33 | |
*** e0ne has quit IRC | 17:36 | |
*** lpetrut_ has quit IRC | 17:41 | |
*** sambetts is now known as sambetts|afk | 17:47 | |
*** lpetrut_ has joined #openstack-oslo | 17:52 | |
*** e0ne has joined #openstack-oslo | 18:01 | |
*** e0ne_ has joined #openstack-oslo | 18:03 | |
*** e0ne__ has joined #openstack-oslo | 18:05 | |
*** e0ne has quit IRC | 18:06 | |
*** e0ne_ has quit IRC | 18:08 | |
openstackgerrit | Merged openstack/oslo.messaging master: Remove transport aliases support https://review.openstack.org/580294 | 18:26 |
*** lpetrut_ has quit IRC | 18:27 | |
*** lpetrut_ has joined #openstack-oslo | 18:27 | |
*** purplerbot has quit IRC | 18:48 | |
*** purplerbot has joined #openstack-oslo | 18:48 | |
*** cdent has quit IRC | 18:53 | |
*** lpetrut_ has quit IRC | 19:21 | |
*** lpetrut_ has joined #openstack-oslo | 19:22 | |
*** lifeless has joined #openstack-oslo | 19:39 | |
openstackgerrit | Monty Taylor proposed openstack/futurist master: Only install monotonic on python2 https://review.openstack.org/574372 | 19:52 |
openstackgerrit | Monty Taylor proposed openstack/futurist master: Restrict contextlib2 to only python2 https://review.openstack.org/574371 | 19:52 |
openstackgerrit | Monty Taylor proposed openstack/futurist master: Restrict contextlib2 to only python2 https://review.openstack.org/574371 | 19:53 |
openstackgerrit | Monty Taylor proposed openstack/taskflow master: Restrict contextlib2 to only python2 https://review.openstack.org/580482 | 19:54 |
*** lpetrut_ has quit IRC | 20:12 | |
*** kgiusti has left #openstack-oslo | 20:24 | |
*** dmellado has quit IRC | 20:28 | |
*** raildo has quit IRC | 20:40 | |
*** cdent has joined #openstack-oslo | 20:58 | |
*** cdent has quit IRC | 21:33 | |
*** e0ne__ has quit IRC | 21:41 | |
*** e0ne has joined #openstack-oslo | 22:00 | |
*** rcernin has joined #openstack-oslo | 22:00 | |
*** nicolasbock has quit IRC | 22:17 | |
*** edmondsw_ has quit IRC | 22:40 | |
*** edmondsw has joined #openstack-oslo | 22:41 | |
*** edmondsw has quit IRC | 22:45 | |
*** e0ne has quit IRC | 22:50 | |
*** e0ne has joined #openstack-oslo | 22:51 | |
*** e0ne has quit IRC | 22:55 | |
*** rcernin has quit IRC | 22:58 | |
openstackgerrit | Michal Arbet proposed openstack/taskflow master: Fix code to support networkx > 1.0 https://review.openstack.org/577833 | 23:01 |
*** rcernin has joined #openstack-oslo | 23:01 | |
*** tosky has quit IRC | 23:01 | |
*** ianychoi_ has joined #openstack-oslo | 23:01 | |
*** ianychoi has quit IRC | 23:04 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!