Monday, 2018-10-15

*** jaewook_oh has joined #openstack-containers01:30
*** hongbin has joined #openstack-containers02:24
*** ramishra has joined #openstack-containers03:18
*** chhagarw has joined #openstack-containers03:50
*** udesale has joined #openstack-containers03:57
*** udesale has quit IRC04:07
*** udesale has joined #openstack-containers04:20
*** hongbin has quit IRC04:28
*** pcaruana has quit IRC06:37
*** Bhujay has joined #openstack-containers06:47
*** Bhujay has quit IRC06:49
*** pcaruana has joined #openstack-containers07:02
*** rcernin has quit IRC07:04
*** rcernin has joined #openstack-containers07:08
*** rcernin has quit IRC07:21
*** mattgo has joined #openstack-containers07:36
*** ttsiouts has joined #openstack-containers08:04
*** ttsiouts has quit IRC08:06
*** kaiokmo has quit IRC08:07
*** kaiokmo has joined #openstack-containers08:07
*** ttsiouts has joined #openstack-containers08:17
*** ttsiouts has quit IRC08:22
*** ttsiouts has joined #openstack-containers08:24
*** Bhujay has joined #openstack-containers08:36
*** Bhujay has quit IRC08:37
*** Bhujay has joined #openstack-containers08:37
brtknrwhat do people in this channel use for their magnum dev environment?08:41
brtknri used to have a devstack on baremetal that worked okay... however, i have not had much luck getting devstack with magnum enabled up (it works fine without magnum)08:42
brtknr... inside a virtual machine that is08:44
mattgobrtknr, Here we are using DevStack in a VM, Magnum enabled, Queens. Works fine, to some extent.08:53
mattgobrtknr, I found it hard to find the correct lines to add to the local.conf file (documentation is hard to find..), but now it works fine. We are regulary spawning new instances of DevStack, it's stable. For the record, we have those additional lines in local.conf :08:56
mattgoenable_plugin heat https://git.openstack.org/openstack/heat $TARGET_BRANCH08:56
mattgoenable_plugin magnum https://git.openstack.org/openstack/magnum $TARGET_BRANCH08:56
mattgoenable_plugin magnum-ui https://github.com/openstack/magnum-ui $TARGET_BRANCH08:56
mattgoenable_plugin python-magnumclient https://github.com/openstack/python-magnumclient $TARGET_BRANCH08:56
*** ttsiouts has quit IRC09:11
*** ttsiouts has joined #openstack-containers09:12
*** ttsiouts has quit IRC09:16
*** ttsiouts has joined #openstack-containers09:17
brtknrmattgo: thanks! what does your full local.conf look like?09:21
brtknrdid you also need to configure fixed subnet?09:21
*** salmankhan has joined #openstack-containers09:22
mattgobrtknr, The full local.conf is not very much complex : http://paste.openstack.org/show/732146/09:28
mattgobrtknr, You could fix a subnet (we actually do fix the public network range), but that shouldn't be necessary.09:28
mattgobrtknr, Also, what you don't see here, we have are using a Heat Stack to deploy DevStack + Configure Keytsone to Keystone federation + install additional softwares on the VM. We use a DevStack ID to differenciate our multiple DevStack instances. I don't think this is relevant, just want to explain why you see $DEVSTACK_ID in the local.conf09:30
*** lpetrut has joined #openstack-containers09:35
*** Bhujay has quit IRC09:47
*** Bhujay has joined #openstack-containers09:54
*** ramishra has quit IRC09:55
*** Bhujay has quit IRC09:55
*** Bhujay has joined #openstack-containers09:56
*** ttsiouts has quit IRC10:19
*** ramishra has joined #openstack-containers10:23
*** udesale has quit IRC11:24
brtknrmattgo: nice! i was wondering that the $DEVSTACK_ID was11:25
brtknri currently have 2 ./stack.sh command running, one on bare metal and another on VM.... will wait and see if it has finally worked11:27
brtknrunfortunately, the VM is running in an openstack deployment deployed using default config.... so the parent subnet is 10.0.0.0/24, same as devstack default subnet11:28
brtknrso it keeps having issues...11:28
brtknrand not always the same... sometimes its related to python version, other times, related to lvm... and mostly it can't reach glance-api on 127.0.0.1/image11:29
*** ttsiouts has joined #openstack-containers11:40
*** kaiokmo has quit IRC11:54
*** kaiokmo has joined #openstack-containers11:54
*** canori01 has joined #openstack-containers11:57
*** zul has joined #openstack-containers12:21
*** ttsiouts has quit IRC12:25
*** ttsiouts has joined #openstack-containers12:35
mattgobrtknr, I don't exactly understand why the devstack default subnet being the same as the underlying openstack subnet is a problem, what are you trying to achieve ? To spawn DevStack with Magnum and play with it, the underlying subnet shouldn't matter in my understanding. Now, if your goal is to access your instances deployed within DevStack from the external world, then you'll have some additional work (but that's unrelated to Magnum)12:53
*** jaewook_oh has quit IRC12:54
mattgobrtknr, Also regarding python version, etc, I just can tell you what we are doing before ./stack.sh : From Ubuntu 16.04, enable nested virtualization, add stack user with sudo perm, clone DevStack (sudo -H -u stack git clone https://git.openstack.org/openstack-dev/devstack -b stable/queens), and then run ./stack.sh12:56
mattgobrtknr, DevStack is a sensible beast, finding the right config was tricky and sometimes I didn't exactly know why this or this option would make things work, or brake things... As I said, good documentation is hard to find.12:58
*** dave-mccowan has joined #openstack-containers13:43
*** robertomls has joined #openstack-containers13:59
robertomlsare we having any known problems with the zuul magnum-functional-api gate? I uploaded a patch set on the weekend and it failed there but I'm not sure what I did..14:03
robertomlsthis is the one: https://review.openstack.org/#/c/598142/14:03
robertomlsI saw other builds failing at that gate too so just checking if it's something known already14:04
*** Bhujay has quit IRC14:06
*** hongbin has joined #openstack-containers14:08
*** munimeha1 has joined #openstack-containers14:11
tobias-urdinstrigazi: did you see my message some days ago about releasing 7.0.2 for rocky?14:34
*** Bhujay has joined #openstack-containers15:02
brtknrmattgo: turns out the problem was actually due to default security policy which meant that i couldnt ping/ssh my nodes by default and had to add these policies myself15:03
brtknrmattgo: do you know why docker cannot pull images from its various sources? i can ping 1.1.1.1 however15:04
brtknrmattgo: my resolv.conf is using my virtual router as dns resolver15:06
brtknrhow do i make my router resolve dns correctly?15:06
brtknri know that i can add dns argument to my magnum cluster template15:07
mattgobrtknr, Glad you could resolve some of your issues. Are you working in a DevStack VM deployed in OpenStack or on BM ? where are you trying to do docker pull: DevStack itself, or an instance within DevStack ?15:10
strigazibrtknr: I'm using a physical machine, works fine for me.15:13
strigazitobias-urdin: no, but I saw this one. We need two more patches and I'll release ti15:13
tobias-urdincool, thanks!15:14
*** Bhujay has quit IRC15:14
brtknrmattgo: strigazi: I'm using DevStack VM deploying in Openstack. BM setup didnt quite work out, it was too slow15:17
brtknrmattgo: strigazi: I'm using DevStack VM deploying in Openstack. BM setup didnt quite work out, it ran into errors, will try again shortly15:17
strigazibrtknr: it takes 30mins for me, 4-core i7, 16GB ram, 500GB ssd15:18
brtknrstrigazi: to setup DevStack or to deploy k8s cluster?15:19
strigazibrtknr: to setup devstack15:19
brtknrstrigazi: Ah, I was talking about deploying k8s via magnum15:20
strigazibrtknr: with bm nodes?15:20
mattgoTo deploy DevStack VM in OpenStack, it also takes 30 minutes for me. Then, deploy a k8s cluster in this DevStack VM is rather slow, I think about 20 minutes. Interestingly, the more k8s cluster you deploy, the slower it gets to deploy new ones :/15:21
*** ttsiouts has quit IRC15:21
mattgobut if you can, I would suggest to deploy DevStack on BM directly. It should be faster, and you avoid one level of abstraction, the intermediate OpenStack, which makes things way more simple IMO.15:22
*** ramishra has quit IRC15:31
brtknrYeah I will try that15:32
*** Bhujay has joined #openstack-containers15:32
brtknrtrying to use magnum inside a vm is sooo slow15:32
strigazido you have you meed nested kvm enabled?15:32
*** munimeha1 has quit IRC15:33
*** jmlowe has quit IRC15:37
*** ttsiouts has joined #openstack-containers15:40
brtknrSo ive been told15:40
brtknris there a way to check this?15:40
strigazicat /etc/cpuinfo | grep vmx15:40
brtknryields nil15:43
brtknrhmm15:43
brtknrguess that means it isnt15:43
strigazicat /etc/cpuinfo | grep svm15:44
strigazithese are the only two modules15:44
strigazibut usually it is vmx15:44
brtknrdont you mean `cat /proc/cpuinfo | grep vmx|svm`15:44
brtknrno neither are loaded15:45
strigaziso , it is not15:46
*** openstackgerrit has quit IRC15:47
*** openstackgerrit has joined #openstack-containers15:48
brtknrdoes it make a huge difference?15:49
strigaziit does. the overhead is minimal15:50
strigazithe only thing that won't change is if the hypervisor has N disks and N+M vms doing IO15:50
*** robertomls has quit IRC15:52
*** munimeha1 has joined #openstack-containers15:53
*** ttsiouts has quit IRC16:10
*** ttsiouts has joined #openstack-containers16:11
*** ttsiouts has quit IRC16:15
*** jmlowe has joined #openstack-containers16:17
*** lpetrut has quit IRC16:37
brtknrstrigazi: just had this error while trying to deploy devstack on BM: http://paste.openstack.org/show/732160/16:40
brtknrstrigazi: after about 28 mins :(16:40
brtknrs/:(/:'(16:41
brtknrlooks like this was when this was triying to run: `/usr/bin/magnum-db-manage upgrade`16:44
*** Bhujay has quit IRC16:46
brtknrstrigazi: this is on Centos 7.416:47
*** lpetrut has joined #openstack-containers17:04
*** salmankhan has quit IRC17:10
strigazibrtknr: sorry, I was commuting17:11
*** itlinux has joined #openstack-containers17:12
strigazibrtknr: this error is not related to vm vs bm, for sure.17:12
strigazibrtknr: Can you share your local.conf?17:12
strigazibrtknr: can try to run magnum-db-manage upgrade again?17:13
*** chhagarw has quit IRC18:00
*** lpetrut has quit IRC18:43
*** jmlowe has quit IRC18:44
*** hongbin has quit IRC18:57
*** jmlowe has joined #openstack-containers19:19
*** mattgo has quit IRC19:36
brtknrstrigazi: I tried doing that, same error19:56
brtknrI changed my max_connections value from 1024 to 1024019:57
brtknrunder devstack/lib/databases/mysql20:05
*** hongbin has joined #openstack-containers20:30
*** hongbin has quit IRC20:33
*** hongbin has joined #openstack-containers20:36
brtknris there something about deploying devstack on centos thats buggy?21:30
brtknri understand that ubuntu is whats usually recommended21:31
brtknrI just noticed this:21:44
brtknrMariaDB [(none)]> show variables like "max_connections";21:44
brtknr+-----------------+-------+21:44
brtknr| Variable_name   | Value |21:44
brtknr+-----------------+-------+21:44
brtknr| max_connections | 214   |21:44
brtknr+-----------------+-------+21:44
brtknr1 row in set (0.00 sec)21:44
*** openstackgerrit has quit IRC21:56
*** openstackgerrit has joined #openstack-containers21:57
*** openstackgerrit has quit IRC21:58
*** openstackgerrit has joined #openstack-containers22:00
brtknrim about to try setting open_files_limit=1024 and trying to bring devstack up again! will keep it running and check tomorrow morning/post result22:06
mordredstrigazi: I can't remember if I got your attention the other day - but did I pointyou at the broken magnum jobs in the openstacksdk gate?22:12
mordredstrigazi: http://logs.openstack.org/18/608318/5/check/openstacksdk-functional-devstack-magnum/95e905a/ is an example22:12
mordred(or anyone else who knows things about devstack+magnum)22:12
*** openstackgerrit has quit IRC22:12
mordredit's non-voting, so it's not killing us, but I'm worried that we're not verifying magnum support now22:13
*** openstackgerrit has joined #openstack-containers22:14
openstackgerritErik Olof Gunnar Andersson proposed openstack/magnum master: [DNM] Testing amqp gate changes  https://review.openstack.org/61074022:23
*** hongbin has quit IRC22:32
*** hongbin has joined #openstack-containers22:34
*** munimeha1 has quit IRC22:34
*** rcernin has joined #openstack-containers22:41
*** openstackgerrit has quit IRC22:43
*** itlinux has quit IRC22:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!