Friday, 2018-11-16

*** Sravan has joined #openstack-kolla00:01
*** murphyslawbbs has quit IRC00:01
*** spiette has quit IRC00:04
*** Sravan has quit IRC00:05
*** spiette has joined #openstack-kolla00:08
*** Sravan has joined #openstack-kolla00:13
*** masber has joined #openstack-kolla00:13
*** Sravan has quit IRC00:14
*** Sravan has joined #openstack-kolla00:20
*** masber has quit IRC00:24
*** murphyslawbbs has joined #openstack-kolla00:59
*** Chaserjim has joined #openstack-kolla01:12
*** Sravan has quit IRC01:15
*** Chaserjim has quit IRC01:16
*** Chaserjim has joined #openstack-kolla02:00
*** Sravan has joined #openstack-kolla02:14
*** Sravan has quit IRC02:19
*** openstackgerrit has quit IRC02:22
*** Chaserjim has quit IRC03:05
*** unicell has joined #openstack-kolla03:07
*** unicell has quit IRC03:12
*** Chaserjim has joined #openstack-kolla03:12
*** Chaserjim has quit IRC03:19
*** unicell has joined #openstack-kolla03:30
*** unicell has quit IRC03:30
*** Chaserjim has joined #openstack-kolla03:31
*** Chaserjim has quit IRC03:45
*** Sravan has joined #openstack-kolla03:52
*** pvc has quit IRC03:56
*** murphyslawbbs has quit IRC04:14
*** Chaserjim has joined #openstack-kolla04:14
*** Chaserjim has quit IRC04:28
*** radeks has joined #openstack-kolla04:29
*** janki has joined #openstack-kolla04:32
*** radeks has quit IRC04:34
*** openstackgerrit has joined #openstack-kolla04:57
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Update image's tag to master rather than 6.0.0  https://review.openstack.org/58364104:57
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Update image's tag to master rather than 6.0.0  https://review.openstack.org/58364104:58
*** murphyslawbbs has joined #openstack-kolla05:00
*** murphyslawbbs has quit IRC05:12
*** unicell has joined #openstack-kolla05:17
*** unicell has quit IRC05:17
*** unicell has joined #openstack-kolla05:17
*** unicell has quit IRC05:21
*** unicell has joined #openstack-kolla05:23
*** Chaserjim has joined #openstack-kolla05:55
*** Chaserjim has quit IRC06:00
*** Sravan has quit IRC06:39
*** Chaserjim has joined #openstack-kolla06:45
*** Chaserjim has quit IRC06:50
*** radeks has joined #openstack-kolla06:51
*** Sravan has joined #openstack-kolla07:10
*** Sravan has quit IRC07:14
*** Luzi has joined #openstack-kolla07:15
*** kiennt26 has joined #openstack-kolla07:32
*** Sravan has joined #openstack-kolla07:51
*** Sravan has quit IRC07:55
*** cah_link has joined #openstack-kolla07:59
*** shardy has joined #openstack-kolla08:02
openstackgerritTakashi Sogabe proposed openstack/kolla stable/queens: Remove old directory so that link can be created properly  https://review.openstack.org/61848108:03
*** unicell has quit IRC08:05
*** jbadiapa has quit IRC08:07
*** robbbe has quit IRC08:09
sm806I added a new compute node to existing setup using the "kolla-ansible -i multinode --limit <node> deploy" command. After deploying I can see the new node in "nova hypervisor-list" output. But no new VMs are getting spawned on this host.08:35
sm806When I use "--availability-zone nova:<node>" to force spawning VM on this node, it is nova-scheduler is failing with "No hosts matched due to not matching 'force_hosts' value of <node>" log.08:37
sm806How do I add a new compute to the setup without disturbing existing nodes??08:37
*** pcaruana has joined #openstack-kolla08:39
*** coolsvap has joined #openstack-kolla09:14
*** Chaserjim has joined #openstack-kolla09:24
*** kiennt26 has quit IRC09:26
*** Chaserjim has quit IRC09:29
*** robbbe has joined #openstack-kolla09:32
egonzalezsm806 can you also check if nova service-list shows the hypervisor? check in the logs if is registered into placement-api09:35
egonzalezwhen a new host is added into a cell, a discover interval time (60 seconds by default) waits to start discovering09:36
egonzalezif your cluster is big may take more time09:36
*** dave-mccowan has joined #openstack-kolla09:46
*** dave-mccowan has quit IRC09:50
*** openstackgerrit has quit IRC09:52
*** sambetts_ has quit IRC09:52
*** jbadiapa has joined #openstack-kolla09:52
*** chrizl has quit IRC09:52
*** dpascheka has quit IRC09:53
*** Chaserjim has joined #openstack-kolla09:56
*** Chaserjim has quit IRC10:00
*** ducnv_ has quit IRC10:26
*** letrangg_ has quit IRC10:35
*** openstackgerrit has joined #openstack-kolla10:45
openstackgerritWill Szumski proposed openstack/kolla-ansible stable/rocky: Use iptables as section header instead of firewall  https://review.openstack.org/61850710:45
*** hamzaachi has joined #openstack-kolla10:50
*** jmccarthy has joined #openstack-kolla11:02
sm806egonzalez, the issue was with the limited hard disk size. When i installed the OS, it gave very little space to "/" and configured a bulk of space to "/home". As a result required disk space for the VMs were not available and hence VMs were not getting spawned on this node.11:04
sm806Thanks for the help.11:04
*** hamzaachi has quit IRC11:31
*** coolsvap has quit IRC11:58
*** tolisbar has joined #openstack-kolla12:01
*** tolisbar has quit IRC12:22
*** tolisbar has joined #openstack-kolla12:25
*** murphyslawbbs has joined #openstack-kolla12:35
*** Chaserjim has joined #openstack-kolla12:35
*** Chaserjim has quit IRC12:41
*** janki has quit IRC12:41
*** radeks has quit IRC12:45
*** radeks has joined #openstack-kolla12:46
openstackgerritMerged openstack/kolla-ansible stable/rocky: Use iptables as section header instead of firewall  https://review.openstack.org/61850713:00
*** nguyenhai93 has quit IRC13:00
*** tolisbar1 has joined #openstack-kolla13:09
*** tolisbar has quit IRC13:12
*** tolisbar has joined #openstack-kolla13:18
*** tolisbar has quit IRC13:19
*** murphyslawbbs has quit IRC13:38
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: [wip] Test zun container creation in gates  https://review.openstack.org/61734113:40
*** hawi has joined #openstack-kolla13:40
*** cah_link has quit IRC13:41
*** Sravan has joined #openstack-kolla13:48
*** Sravan has quit IRC13:53
*** shardy has quit IRC13:55
*** shardy has joined #openstack-kolla14:00
*** pbourke has quit IRC14:04
*** pbourke has joined #openstack-kolla14:04
robbbehi all, i've just deployed kolla just on a control node, but the external interface is now not working14:09
robbbethe "internal" network is br0. the external (public) was br0.100014:09
robbbebr0.1000 is not working anymore possibly due to ovs14:10
robbbeanyone got any idea how this should be?14:10
*** mjturek has joined #openstack-kolla14:29
*** mjturek has quit IRC14:33
*** Chaserjim has joined #openstack-kolla14:37
*** Chaserjim has quit IRC14:42
*** robbbe has quit IRC14:47
*** mjturek has joined #openstack-kolla14:48
*** jmccarthy has quit IRC14:50
*** Luzi has quit IRC14:56
*** mjturek has quit IRC14:58
*** Chaserjim has joined #openstack-kolla15:00
*** hjensas has quit IRC15:16
hawii havequestion regarding rocky - deploy went smooth and nice, but somehow hypervisor list is empty. [compute] had definitions for compute hosts15:18
hawiis there something needed more?15:19
hawiopenstack host list shows hosts15:20
egonzalezhawi check if rabbitmq is working properly15:22
egonzalezalso some logs from /var/lib/docker/volumes/kolla_logs/_data/nova in the compute host15:22
*** tolisbar has joined #openstack-kolla15:23
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: [wip] Test zun container creation in gates  https://review.openstack.org/61734115:25
*** jistr is now known as jistr|call15:29
*** Chaserjim has quit IRC15:40
*** zhubingbing has joined #openstack-kolla15:41
zhubingbingHi guys15:41
*** zhubingbing has quit IRC15:47
hawiegonzalez: https://pastebin.com/8EGDKidT No compute node record for host dc4-comp-001: ComputeHostNotFound_Remote: Compute host dc4-comp-001 cou15:55
hawild not be found.15:55
hawiwhat is ... weird,host name can be resolved15:55
*** pcaruana has quit IRC15:56
egonzalezhawi looks like, ceph config is not correct or cannot connect15:58
*** jistr|call is now known as jistr|biab15:59
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: [wip] Test zun container creation in gates  https://review.openstack.org/61734116:06
*** mchlumsky has joined #openstack-kolla16:06
hawiegonzalez: i do have external ceph, never set it up with it before, so it might be the reason yes.16:07
*** Chaserjim has joined #openstack-kolla16:08
*** lvdombrkr has joined #openstack-kolla16:09
*** tolisbar has quit IRC16:09
lvdombrkrhello folks, maybe someone can give me any clues. using cinder backend netapp nfs special cinder.nfs.ntetap driver... issue is that i cant create volume from snapshot if snapshot are created from running instance16:11
lvdombrkrif i create snapshot from de-atached volume, i can create volume from it16:11
lvdombrkrbut if i create snapshot from running instance, and make volume from it i get error16:12
lvdombrkrin cinder-volume logs16:12
lvdombrkrsee this error : 2018-11-16 16:00:53.094 41 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Volume c36c2b2a-edb6-430e-bf72-f37ec4e3bda0 could not be created on shares.16:13
*** Chaserjim has quit IRC16:13
*** munimeha1 has joined #openstack-kolla16:33
*** lvdombrkr has quit IRC16:38
*** hjensas has joined #openstack-kolla16:40
*** jistr|biab is now known as jistr16:43
*** jmccarthy has joined #openstack-kolla16:55
jmccarthyHmm how do the internal/external haproxy members for mariadb actually fit into the haproxy configuration ?16:59
*** shardy has quit IRC17:04
*** janki has joined #openstack-kolla17:11
*** unicell has joined #openstack-kolla17:14
*** jmccarthy has left #openstack-kolla17:24
*** unicell has quit IRC17:26
*** hadrianweb has joined #openstack-kolla17:30
*** hamzaachi has joined #openstack-kolla17:30
*** Sravan has joined #openstack-kolla17:33
*** Sravan has quit IRC17:34
*** Sravan has joined #openstack-kolla17:34
*** unicell has joined #openstack-kolla18:01
*** hamzaachi has quit IRC18:32
*** janki has quit IRC18:34
*** hamzaachi has joined #openstack-kolla18:36
*** Chaserjim has joined #openstack-kolla18:49
*** Chaserjim has quit IRC18:54
openstackgerritMartin Chlumsky proposed openstack/kolla-ansible master: Allow custom horizon policy files for disabled openstack projects.  https://review.openstack.org/61802918:54
openstackgerritMartin Chlumsky proposed openstack/kolla-ansible master: Allow custom horizon policy files for disabled openstack projects.  https://review.openstack.org/61802919:09
*** tolisbar has joined #openstack-kolla19:32
*** iclon has quit IRC19:45
*** iclon has joined #openstack-kolla19:53
*** hjensas has quit IRC20:11
*** hamzaachi has quit IRC20:27
*** hadrianweb has quit IRC20:43
*** tolisbar has quit IRC20:48
*** iclon has quit IRC20:59
*** hjensas has joined #openstack-kolla21:01
*** radeks_ has joined #openstack-kolla21:08
*** radeks has quit IRC21:08
*** Chaserjim has joined #openstack-kolla21:26
*** Chaserjim has quit IRC21:30
*** unicell has quit IRC21:37
*** unicell has joined #openstack-kolla21:49
*** radeks_ has quit IRC21:57
*** mchlumsky has quit IRC22:04
*** munimeha1 has quit IRC22:54
*** tolisbar has joined #openstack-kolla22:56
SravanHi I have a query regarding the error I'm facing while i'm launching an instance22:59
SravanThere are already few instances on compute host. Now i'm getting "No valid host was found. There are not enough hosts available." error when i'm trying to launch a new instance23:01
*** tolisbar1 has joined #openstack-kolla23:03
*** tolisbar has quit IRC23:03
Sravan2018-11-16 19:43:47.487 19 ERROR nova.conductor.manager23:03
Sravan2018-11-16 19:43:47.487 19 ERROR nova.conductor.manager23:03
Sravan2018-11-16 19:43:47.548 19 WARNING nova.scheduler.utils [req-030915ef-85cb-43cc-85b8-ade974d1ef07 ecce81ffebaf41c3b6cda47344170b72 41f9a8ab0ac54e23b50c62a736bc28d5 - - -] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available.23:03
SravanTraceback (most recent call last):23:03
Sravan  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 218, in inner23:03
Sravan    return func(*args, **kwargs)23:03
Sravan  File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 98, in select_destinations23:03
Sravan    dests = self.driver.select_destinations(ctxt, spec_obj)23:03
Sravan  File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 79, in select_destinations23:03
Sravan    raise exception.NoValidHost(reason=reason)23:03
SravanNoValidHost: No valid host was found. There are not enough hosts available.23:03
Sravan2018-11-16 19:43:47.549 19 WARNING nova.scheduler.utils [req-030915ef-85cb-43cc-85b8-ade974d1ef07 ecce81ffebaf41c3b6cda47344170b72 41f9a8ab0ac54e23b50c62a736bc28d5 - - -] [instance: d6d0b190-d1ea-4a1a-bd8a-b8b0e9fb8732] Setting instance to ERROR state.23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager [req-5486888f-bb4e-489f-a949-40433e1f4483 ecce81ffebaf41c3b6cda47344170b72 41f9a8ab0ac54e23b50c62a736bc28d5 - - -] Failed to schedule instances23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     return self.queryclient.select_destinations(context, spec_obj)23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 37, in __run_method23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     return getattr(self.instance, __name)(*args, **kwargs)23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/query.py", line 32, in select_destinations23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     return self.scheduler_rpcapi.select_destinations(context, spec_obj)23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/rpcapi.py", line 129, in select_destinations23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     retry=retry)23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 449, in _send23:03
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     raise result23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     dests = self.driver.select_destinations(ctxt, spec_obj)23:04
*** tolisbar has joined #openstack-kolla23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 79, in select_destinations23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager     raise exception.NoValidHost(reason=reason)23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager NoValidHost: No valid host was found. There are not enough hosts available.23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager23:04
Sravan2018-11-16 19:44:24.975 17 ERROR nova.conductor.manager23:04
*** ivve has quit IRC23:04
*** tolisbar1 has quit IRC23:07
*** tolisbar has quit IRC23:08
SravanAny help on How to debug this issue would be appreciated23:10
*** tolisbar has joined #openstack-kolla23:11
*** Chaserjim has joined #openstack-kolla23:26
manjeetsinc023:26
*** Chaserjim has quit IRC23:31
*** tolisbar has quit IRC23:33
*** tolisbar has joined #openstack-kolla23:37
*** tolisbar has quit IRC23:42
*** Chaserjim has joined #openstack-kolla23:46

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!