Tuesday, 2018-02-06

kolla-slack<henro001> Oh nice. I also redeploy the pods (with cleanup) after recreating the configmaps. Is there an easier way to apply them if they change?00:12
*** emccormick has joined #openstack-kolla00:13
*** emccormick has quit IRC00:14
*** emccormick has joined #openstack-kolla00:14
*** yangyapeng has joined #openstack-kolla00:25
*** yangyapeng has quit IRC00:30
kolla-slack<henro001> i guess this does it: kubectl get pod PODNAME -n NAMESPACE -o yaml | kubectl replace --force -f -00:33
kolla-slack<henro001> so when I change the wsgi port: ()[root@cinder-api-5656b67c5c-22s56 /]# ss -tunap Netid State      Recv-Q Send-Q                        Local Address:Port                                       Peer Address:Port               tcp   LISTEN     0      128                                       *:8776                                                  *:*                   tcp   LISTEN     0      12800:37
kolla-slack                                          *:*00:37
kolla-slack<henro001> ()[root@cinder-api-5656b67c5c-22s56 /]# grep 8776 /etc/* -r /etc/haproxy/haproxy.cfg:  bind 0.0.0.0:877600:37
*** dave-mccowan has joined #openstack-kolla00:42
kolla-slack<henro001> this is from cinder-api-haproxy config map00:47
kolla-slack<henro001> listen api   bind 0.0.0.0:8776   server local-api 127.0.0.1:8080 check inter 2000 rise 2 fall 500:47
kolla-slack<henro001> does it make sense?00:48
kolla-slack<henro001> 8080 is not even listening in the container00:48
hogepodgeIf I've redeployed an OpenStack installation, how do I clear out old ceph drives?01:15
hogepodgeMy ceph_osd_x containers are failing01:15
*** caowei has joined #openstack-kolla01:16
*** pengdake has joined #openstack-kolla01:16
*** zshi has joined #openstack-kolla01:17
*** yangyapeng has joined #openstack-kolla01:22
*** zhubingbing_ has joined #openstack-kolla01:26
*** caoyuan has joined #openstack-kolla01:28
*** caoyuan_ has quit IRC01:28
*** zhubingbing has quit IRC01:28
*** zhaochao has joined #openstack-kolla01:31
kolla-slack<henro001> @inc0 i changed the the wsgi listen port to 8080 (which makes sense from the haproxy configuration) and also had to set up permission on cinder-wsgi.log01:34
kolla-slack<henro001> [kuber@li03-01 kolla-bringup]$ kubectl -n kolla get pod | grep cinder       cinder-api-5656b67c5c-mx9dx        3/3       Running   0          14m cinder-scheduler-0                 1/1       Running   0          2h01:35
kolla-slack<inc0> Hodgepodge if you want to re deploy on fresh drives, just add bootstrap flag again01:36
kolla-slack<inc0> hogepodge ^01:36
hogepodgeah, ok01:36
hogepodgeinc0: turns out that's not the real problem I'm seeing. For some reason openstack image create is hanging01:37
hogepodgeno information in the glance api or registry logs01:37
hogepodge:-/01:37
kolla-slack<inc0> Well if ceph is unhealthy you might see that01:38
kolla-slack<inc0> Check ceph -s in container01:39
kolla-slack<inc0> Maybe you just need to adjust placement groups01:39
hogepodgeinc0: that's the issue. even though I configured glance to use file it defaults to ceph01:40
hogepodgehow do I reset the bootstrap flag?01:41
kolla-slack<inc0> Just add bootstrap label again01:41
kolla-slack<inc0> But if that's pg/pgp issue, you can edit it with single Conan01:42
kolla-slack<inc0> Command01:42
kolla-slack<inc0> No need to redeploy01:43
*** dardelean has joined #openstack-kolla01:44
*** salv-orlando has joined #openstack-kolla01:45
*** dardelean has quit IRC01:48
*** hongbin has joined #openstack-kolla01:49
*** unicell has joined #openstack-kolla01:50
*** unicell has quit IRC01:50
*** zhangfei has joined #openstack-kolla01:51
*** unicell has joined #openstack-kolla01:51
*** unicell has quit IRC01:51
*** zhangfei has quit IRC01:53
*** zhangfei has joined #openstack-kolla01:53
*** kevzha01 has joined #openstack-kolla01:57
*** kevzha01 is now known as kevinz01:58
zhubingbing_Hi guys01:58
*** zhangfei has quit IRC02:04
*** itlinux has joined #openstack-kolla02:13
*** zhangfei has joined #openstack-kolla02:18
*** harlowja has quit IRC02:18
*** salv-orlando has quit IRC02:33
*** salv-orlando has joined #openstack-kolla02:33
emccormickHey inc0 One more kolla-build issue. When it's building containers: I seem to get some pushed into the local registry, but most fail with this02:37
emccormick  File "/usr/lib/python2.7/site-packages/docker/api/image.py", line 451, in push02:37
emccormick    header = auth.get_config_header(self, registry)02:37
*** salv-orlando has quit IRC02:38
emccormickthe ever popular unknown error02:38
*** masahisa has quit IRC02:40
*** itlinux has quit IRC02:43
*** chmarkus has quit IRC02:45
*** chmarkus has joined #openstack-kolla02:46
*** dave-mccowan has quit IRC02:48
*** dave-mccowan has joined #openstack-kolla03:08
*** caoyuan_ has joined #openstack-kolla03:22
*** skramaja has joined #openstack-kolla03:23
*** dave-mccowan has quit IRC03:33
*** masahisa has joined #openstack-kolla03:35
*** unicell has joined #openstack-kolla03:38
*** pengdake has quit IRC03:38
*** pengdake_ has joined #openstack-kolla03:38
*** coolsvap has joined #openstack-kolla03:45
*** unicell has quit IRC03:46
*** pengdake_ has quit IRC03:46
*** ArminderSingh has quit IRC03:49
*** hongbin has quit IRC03:55
*** caoyuan_ has quit IRC03:55
SamYapleemccormick: full stacktrace?03:57
*** ArminderSingh has joined #openstack-kolla04:01
*** rajivk has joined #openstack-kolla04:07
*** rajivk has left #openstack-kolla04:07
*** caoyuan_ has joined #openstack-kolla04:10
*** caowei has quit IRC04:11
*** caowei has joined #openstack-kolla04:13
*** goldyfruit has quit IRC04:15
*** devananda has quit IRC04:22
*** lpetrut has joined #openstack-kolla04:41
*** rajivk has joined #openstack-kolla04:45
*** harlowja has joined #openstack-kolla04:46
*** zhangfei has quit IRC04:46
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Update install ntp to enable chrony container  https://review.openstack.org/53003904:52
*** rajivk has left #openstack-kolla04:56
*** pengdake_ has joined #openstack-kolla04:57
*** pengdake_ has quit IRC05:03
*** zhangfei has joined #openstack-kolla05:03
*** zhurong has quit IRC05:07
*** lpetrut has quit IRC05:08
*** harlowja has quit IRC05:11
*** janki has joined #openstack-kolla05:15
*** lpetrut has joined #openstack-kolla05:16
*** itlinux has joined #openstack-kolla05:17
*** gkadam has joined #openstack-kolla05:25
*** daidv has quit IRC05:26
sdake_hogepodge the other thing that is needed is the /etc/fstab mountpoint for ceph should be removed.05:30
*** sdake_ is now known as sdake05:30
*** lpetrut has quit IRC05:32
*** mdnadeem has joined #openstack-kolla05:44
*** zhangfei has quit IRC05:54
*** itlinux has quit IRC05:55
*** hw_wutianwei has quit IRC05:59
*** hw_wutianwei has joined #openstack-kolla05:59
*** pengdake_ has joined #openstack-kolla06:01
*** jchhatbar has joined #openstack-kolla06:06
*** janki has quit IRC06:06
*** zhangfei has joined #openstack-kolla06:07
*** lpetrut has joined #openstack-kolla06:11
*** rajivk has joined #openstack-kolla06:17
*** lpetrut has quit IRC06:18
*** rajivk has quit IRC06:22
*** rajivk has joined #openstack-kolla06:29
*** rajivk_ has joined #openstack-kolla06:30
*** rajivk has quit IRC06:30
*** rajivk_ has quit IRC06:32
*** threestrands has quit IRC06:40
*** unicell has joined #openstack-kolla06:50
*** cah_link has joined #openstack-kolla06:57
*** rwsu has joined #openstack-kolla07:01
*** AJaeger has left #openstack-kolla07:02
*** olivierbourdon38 has quit IRC07:06
*** caoyuan_ has quit IRC07:09
*** ipsecguy_ has joined #openstack-kolla07:09
*** zhurong has joined #openstack-kolla07:09
*** egonzalez has joined #openstack-kolla07:10
*** ipsecguy has quit IRC07:13
*** jchhatba_ has joined #openstack-kolla07:20
*** b_bezak has joined #openstack-kolla07:21
*** jchhatbar has quit IRC07:23
*** lpetrut has joined #openstack-kolla07:24
*** b_bezak has quit IRC07:25
*** xytis_ has joined #openstack-kolla07:33
*** rajivk has joined #openstack-kolla07:34
openstackgerritwangwei proposed openstack/kolla-ansible master: Fix ipc_mode comparison in the latest docker  https://review.openstack.org/54116007:35
*** rajivk has quit IRC07:39
*** lvdombrkr has joined #openstack-kolla07:39
*** olivierbourdon38 has joined #openstack-kolla07:43
*** unicell has quit IRC07:55
*** b_bezak has joined #openstack-kolla08:11
*** jchhatba_ has quit IRC08:12
*** jchhatba_ has joined #openstack-kolla08:12
*** pcaruana has joined #openstack-kolla08:14
*** caoyuan_ has joined #openstack-kolla08:22
openstackgerritTone Zhang proposed openstack/kolla-ansible master: Fix Ceph and Swift precheck error  https://review.openstack.org/54118008:32
*** lvdombrkr89 has joined #openstack-kolla08:36
*** lvdombrkr has quit IRC08:37
*** zhurong has quit IRC08:38
*** dardelean has joined #openstack-kolla08:45
*** dardelean has quit IRC08:47
*** dardelean has joined #openstack-kolla08:47
*** frti has joined #openstack-kolla08:48
*** rajivk has joined #openstack-kolla08:49
*** ktibi has joined #openstack-kolla08:51
*** mgoddard_ has joined #openstack-kolla08:54
*** zhurong has joined #openstack-kolla09:03
*** gfidente has joined #openstack-kolla09:04
*** gfidente has quit IRC09:04
*** gfidente has joined #openstack-kolla09:04
*** xytis_ has quit IRC09:04
*** xytis_ has joined #openstack-kolla09:05
*** threestrands has joined #openstack-kolla09:06
*** jaosorior has quit IRC09:06
*** xytis_ has quit IRC09:06
*** xytis_ has joined #openstack-kolla09:06
openstackgerritSaravanan KR proposed openstack/kolla master: Add DPDK support for centos and rhel family in ovsdpdk container  https://review.openstack.org/51224709:11
*** rajivk has left #openstack-kolla09:13
egonzalezktibi, does this change also fix the etcd issue https://review.openstack.org/#/c/540881/4/ansible/roles/skydive/templates/skydive-analyzer.conf.j2 ?09:13
*** masahisa_ has joined #openstack-kolla09:15
*** masahisa has quit IRC09:16
*** xytis_ has quit IRC09:18
*** threestrands has quit IRC09:21
*** frti_ has joined #openstack-kolla09:21
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Fix the warning when reload the docker  https://review.openstack.org/54064409:22
*** xytis_ has joined #openstack-kolla09:24
*** frti_ has quit IRC09:25
*** frti has quit IRC09:25
kolla-slack<chnmyron> Hi09:27
*** masahisa has joined #openstack-kolla09:28
*** jaosorior has joined #openstack-kolla09:29
*** xytis_ has quit IRC09:29
*** masahisa_ has quit IRC09:30
*** xytis_ has joined #openstack-kolla09:31
caoyuan_:)09:33
*** xytis_ has quit IRC09:36
*** xytis_ has joined #openstack-kolla09:37
*** xytis_ has quit IRC09:41
*** xytis_ has joined #openstack-kolla09:43
*** zhangfei has quit IRC09:44
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix cluster mode for skydive  https://review.openstack.org/54088109:44
*** xytis_ has quit IRC09:47
*** xytis_ has joined #openstack-kolla09:49
openstackgerritTone Zhang proposed openstack/kolla-ansible master: Fix Ceph and Swift precheck error  https://review.openstack.org/54118009:52
*** xytis_ has quit IRC09:54
dtkHi everyone09:54
dtkCould somebody please spare a bit of time to review a backport to stable please?09:55
dtkhttps://review.openstack.org/#/c/540940/09:55
dtkThanks!09:55
*** zhangfei has joined #openstack-kolla09:56
*** rmart04 has joined #openstack-kolla09:58
*** root__ has joined #openstack-kolla09:58
*** lvdombrkr89 has quit IRC09:58
*** caoyuan__ has joined #openstack-kolla10:06
*** janki has joined #openstack-kolla10:06
*** caoyuan__ has quit IRC10:06
*** jchhatba_ has quit IRC10:07
*** caoyuan has quit IRC10:09
*** caoyuan_ has quit IRC10:09
*** zshi has quit IRC10:15
*** pengdake_ has quit IRC10:16
*** caoyuan has joined #openstack-kolla10:17
*** caoyuan has quit IRC10:22
*** caoyuan has joined #openstack-kolla10:26
*** zshi has joined #openstack-kolla10:27
-openstackstatus- NOTICE: Our Zuul infrastructure is currently experiencing some problems and processing jobs very slowly, we're investigating. Please do not approve or recheck changes for now.10:30
*** caowei has quit IRC10:30
*** caoyuan has quit IRC10:31
*** n0isyn0ise has joined #openstack-kolla10:33
*** tvignaud_ has joined #openstack-kolla10:34
*** jmccarthy has joined #openstack-kolla10:34
*** tvignaud has quit IRC10:36
*** xytis_ has joined #openstack-kolla10:43
*** sambetts|afk is now known as sambetts10:54
*** gfidente has quit IRC11:02
*** gfidente has joined #openstack-kolla11:05
*** gfidente has quit IRC11:05
*** gfidente has joined #openstack-kolla11:05
*** root__ is now known as lvdombrkr11:20
*** zhangfei has quit IRC11:22
jmccarthyWith kolla-ansible upgrade, what determines the order the upgrade runs ?11:26
*** gkadam is now known as gkadam-brb11:27
*** xytis_ has quit IRC11:27
*** mnasiadka has joined #openstack-kolla11:27
*** xytis_ has joined #openstack-kolla11:27
jmccarthyIs it the order as listed in the inventory file ?11:31
egonzalezjmccarthy, https://github.com/openstack/kolla-ansible/blob/master/ansible/site.yml11:35
jmccarthyegonzalez: Of course .. Thanks ! My head Zzz can't think straight at the moment =]11:36
*** zhangfei has joined #openstack-kolla11:38
*** kevzha01_ has joined #openstack-kolla11:41
*** tone_z has joined #openstack-kolla11:42
*** kevzha01__ has joined #openstack-kolla11:42
*** kevinz has quit IRC11:45
*** tone_zrt has quit IRC11:45
*** kevzha01_ has quit IRC11:46
jmccarthyIn general, for upgrades, users should upgrade existing services/containers first, and *then deal with upgrading kolla-ansible itself, configuring new services etc, correct ? I didn't see anything about this in the guide (or I missed it)11:47
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/pike: Remove the unsupported 'insecure_registry' for >=docker 3.0.0  https://review.openstack.org/54124811:48
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/ocata: Remove the unsupported 'insecure_registry' for >=docker 3.0.0  https://review.openstack.org/54124911:48
*** gkadam-brb is now known as gkadam11:49
egonzalezjmccarthy, upgrade kolla, build new images, upgrade kolla-ansible, pull new images, upgrade services11:51
jmccarthyegonzalez: Yea that's what I thought, generally, upgrade kolla-ansible post kolla, and then deal with new services, kk cool11:53
egonzalezjmccarthy, yeah, add new services is not part of upgrade, should be done afterwards in a deploy11:54
*** xytis_ has quit IRC11:55
*** masahisa has quit IRC12:04
*** olivierbourdon38 has quit IRC12:11
*** absubram has joined #openstack-kolla12:25
*** xytis_ has joined #openstack-kolla12:25
*** b_bezak has quit IRC12:30
*** xytis_ has quit IRC12:30
*** xytis_ has joined #openstack-kolla12:31
*** xytis_ has quit IRC12:36
jmccarthyegonzalez: Oh hang on I have something backwards12:40
*** yangyapeng has quit IRC12:52
*** rhallisey has joined #openstack-kolla12:53
*** yangyapeng has joined #openstack-kolla12:53
*** yangyapeng has quit IRC12:53
*** coolsvap has quit IRC12:54
*** yangyapeng has joined #openstack-kolla12:54
*** goldyfruit has joined #openstack-kolla12:56
*** goldyfruit has quit IRC12:56
*** takamatsu has joined #openstack-kolla12:56
*** xytis_ has joined #openstack-kolla12:58
*** rhallisey has quit IRC12:59
*** rhallisey has joined #openstack-kolla12:59
jmccarthyegonzalez: When going from pike --> queens(master) , don't need to upgrade the ansible (kolla-ansible) parts *before upgrading kolla (the containers) ?13:00
jmccarthy*don't I need13:00
*** zhurong_ has joined #openstack-kolla13:01
*** yangyapeng has quit IRC13:02
*** zhurong has quit IRC13:08
*** jbadiapa has joined #openstack-kolla13:09
*** jbadiapa has quit IRC13:14
dtkWell, in theory13:14
dtkthe old version does not now how to upgrade to a newer version13:14
dtkso yes]13:14
dtkmost probably you'd need to install queens first13:15
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix cluster mode for skydive  https://review.openstack.org/54088113:15
*** holo_ has joined #openstack-kolla13:20
holo_Hello. Im cameing back againw with same problem: https://serverfault.com/questions/894998/openstack-kolla-installation-association-of-floating-ip-not-working13:21
holo_I reconfigure my servers and used hardware interfaces instead of vlans13:22
*** mrunge_ has joined #openstack-kolla13:22
holo_yesterday i reinstall all of them with ubuntu instead of centos and install everything according to kolla docs again from scratch13:22
holo_and on ubuntu same problem appear13:23
holo_everything looks is working expect that i can not assigne fixed ip to instance13:23
*** jaosorior has quit IRC13:23
*** mrunge has quit IRC13:24
holo_what is strange router public ip is assigned without problem13:24
holo_what can i do more?13:24
holo_manuall installation instead of kolla? Did anyone had same problem like me?13:24
holo_where can i find some help for kolla installation?13:25
egonzalezholo_, do your control/network nodes have connectivity to the public network range?13:27
egonzalezlooks like no interface is able to know where to find the instance *routes13:27
holo_yes i can ping router public ip which is in same network13:27
egonzalezholo_, whats the network configuration? how are created, interfaces attached on which vlans, etc13:28
holo_from the instnace i can ping "outside world" and other instances in same private subnet13:28
holo_right now im using just hw interfaces.. one sec will paste all configs in paste bin again13:29
*** dave-mccowan has joined #openstack-kolla13:29
holo_https://pastebin.com/4yE5Nfv213:29
holo_here is what is not working and how im trying to accheve it13:29
*** yangyapeng has joined #openstack-kolla13:30
holo_my actuall interfaces on compute and controller instance:Lhttps://pastebin.com/tjAEy4A613:30
holo_https://pastebin.com/tjAEy4A613:31
holo_my global file:13:31
holo_https://pastebin.com/QfMuvkN813:31
*** xytis_ has quit IRC13:31
holo_https://pastebin.com/MPNerCfi13:35
holo_router public ip like we can see here is pingable13:35
*** dave-mccowan has quit IRC13:35
holo_engonzalez: what more checks configs can be usefull to find out problem?13:36
*** dave-mcc_ has joined #openstack-kolla13:37
holo_https://pastebin.com/2dfFAGFg13:37
*** xytis_ has joined #openstack-kolla13:38
*** yangyapeng has quit IRC13:38
holo_ping from qrouter netns on compute node  is going to instance ip13:38
holo_(not working from controller13:38
holo_can it be issue?13:38
holo_maybe i missed some setting in global config?13:41
*** xytis_ has quit IRC13:42
*** pengdake_ has joined #openstack-kolla13:43
*** caoyuan has joined #openstack-kolla13:43
*** pengdake_ has quit IRC13:43
*** xytis_ has joined #openstack-kolla13:44
*** janki has quit IRC13:44
holo_https://pastebin.com/GTB1wtCH13:44
holo_here only uncommented lines from global13:44
*** yangyapeng has joined #openstack-kolla13:44
holo_i tried linuxbridge instead of openvswitch - did not help13:45
*** celo_r has joined #openstack-kolla13:48
holo_i just login to instance  via horizon and pings are working so underlaying networking i think is ok13:49
*** xytis_ has quit IRC13:49
*** yangyapeng has quit IRC13:50
*** masahisa has joined #openstack-kolla13:50
*** xytis_ has joined #openstack-kolla13:50
holo_what else i can say.. when i cretae instance connected directly to public network it working to and i can ssh to it13:50
holo_i can use it as router but it is not a isse solve but only workaround13:51
holo_anyone?13:51
*** zhurong_ has quit IRC13:52
holo_should i report a bug?13:52
*** masahisa_ has joined #openstack-kolla13:54
*** masahisa has quit IRC13:55
*** xytis_ has quit IRC13:55
*** xytis_ has joined #openstack-kolla13:58
*** masahisa_ has quit IRC13:59
*** hrw has quit IRC13:59
*** goldyfruit has joined #openstack-kolla14:00
jmccarthyIf using pip (vs repo) to install pike, should this work ? 'pip install kolla-ansible==5'14:01
*** hrw has joined #openstack-kolla14:01
*** skramaja has quit IRC14:02
*** caoyuan_ has joined #openstack-kolla14:03
*** xytis_ has quit IRC14:03
*** jaosorior has joined #openstack-kolla14:04
*** xytis_ has joined #openstack-kolla14:04
holo_Did anyone looks at my configs? They are looking ok?14:05
*** celo_r has quit IRC14:05
*** caoyuan_ has quit IRC14:07
pbourkejmccarthy: I think it should14:07
jmccarthypbourke: Will find out shortly =]14:09
*** jrist has quit IRC14:11
holo_should fixed ip be pingable in qurouter namespace from controler node when using DVR?14:11
*** yangyapeng has joined #openstack-kolla14:11
*** jrist has joined #openstack-kolla14:12
*** bmace_ has quit IRC14:16
*** b_bezak has joined #openstack-kolla14:25
egonzalezholo_, share docker exec openvswitch_db ovs-vsctl show from net and compute hosts14:25
holo_here it is: https://pastebin.com/fDgCWe3814:29
holo_egonzalez: *14:29
holo_egonzalez: network host is same server with controller14:31
holo_egonzalez: https://pastebin.com/UPnF6h4Q   <--- multinode inventory file14:32
*** david-lyle has quit IRC14:34
egonzalezholo_, eno1 interfaces are down14:37
egonzalezshould be up without IP address14:37
holo_oo yes i bring it up manually after i paste it14:37
holo_but still that same (you can see i can ping router public ip i couldn't do that wihtout bring it up)14:38
holo_and i do not have any ip on it14:39
*** zhangfei has quit IRC14:39
holo_https://pastebin.com/XwCCHHbj  <-- here You can see14:40
egonzalezholo_, neutron (net-subnet) show of each network output14:41
*** gkadam has quit IRC14:44
holo_root@ctrl00:~# neutron net-subnet show14:44
holo_neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.14:44
holo_Unknown command [u'net-subnet', u'show']14:44
holo_root@ctrl00:~#14:44
holo_ok i have openstack command14:45
holo_https://pastebin.com/2XSLZSrq14:46
holo_here it is. I created it with init-runonce script (some time ago i tried to do this manually but result was same everything is working but FIP not)14:47
holo_floating ip i created such way: openstack floating ip create public114:48
egonzalezholo_, init-runonce script should be customized with your network ranges14:48
holo_it is14:48
holo_root@ctrl00:~# cat /usr/local/share/kolla-ansible/init-runonce |grep NET14:49
holo_EXT_NET_CIDR='192.168.11.0/24'14:49
holo_EXT_NET_RANGE='start=192.168.11.10,end=192.168.11.200'14:49
holo_EXT_NET_GATEWAY='192.168.11.1'14:49
holo_    --allocation-pool ${EXT_NET_RANGE} --network public1 \14:49
holo_    --subnet-range ${EXT_NET_CIDR} --gateway ${EXT_NET_GATEWAY} public1-subnet14:49
holo_DEMO_NET_ID=$(openstack network list | awk '/ demo-net / {print $2}')14:49
holo_    --nic net-id=${DEMO_NET_ID} \\14:49
holo_root@ctrl00:~#14:49
holo_same like public network and router public ip  which is pingable14:49
holo_egonzalez, *14:51
*** mdnadeem has quit IRC14:52
*** zhangfei has joined #openstack-kolla14:53
*** lpetrut has quit IRC14:53
*** derekjhyang has quit IRC14:55
*** derekjhyang has joined #openstack-kolla14:56
*** kiennt26 has joined #openstack-kolla14:57
holo_egonzalez: https://pastebin.com/sFugQBwG <-- my docker services, maybe here is something missing?15:02
egonzalezholo_, bootstrap_heat containers shouldnt be there if deployment succeed15:03
holo_hmm.. i can run it again (but i did not have any errors). Starting it15:04
*** zhangfei has quit IRC15:04
egonzalezholo_, first destroy15:05
holo_ok15:05
egonzalezkeep the environment clean before deploy15:05
egonzalezensure prechecks pass15:05
*** zhubingbing has joined #openstack-kolla15:07
*** zshi has quit IRC15:07
*** lvdombrkr has quit IRC15:08
zhubingbinghi guys15:10
*** lvdombrkr has joined #openstack-kolla15:10
holo_in prechecks i turned of docker version check ( i have installed newest one docker-ce like it was in docs but this not going trough docker version check)15:11
holo_root@ctrl00:~# docker -v15:11
holo_Docker version 18.01.0-ce, build 03596f515:11
holo_root@ctrl00:~#15:11
*** mnasiadka has quit IRC15:11
holo_rest of prechecks are without any problem15:11
zhubingbing@helo_  you can skip prechecks15:12
chandankumarmandre: Anything more to add in this? https://review.openstack.org/537807 thanks :-)15:13
holo_prechecks: PLAY RECAP ********************************************************************************************************************************************************************************************************************************************************************************************************************************************15:13
holo_compute00                  : ok=14   changed=0    unreachable=0    failed=015:13
holo_ctrl00                     : ok=75   changed=0    unreachable=0    failed=015:13
holo_localhost                  : ok=1    changed=0    unreachable=0    failed=015:13
holo_with turned off docker version15:13
holo_starting deploy15:13
*** mgkwill has quit IRC15:14
zhubingbing@mandre done15:14
*** mgkwill has joined #openstack-kolla15:15
zhubingbing@holo_ What error did you deployed ?15:16
zhubingbingkolla-ansible prechecks  it look so good15:17
holo_zhubingbing, i have problem with floating IPs everything is working except that they are not associateing with instances15:18
zhubingbingok15:18
*** xytis_ has quit IRC15:18
zhubingbingFirst, you need two network interface15:19
zhubingbingfor exemple eth0 and eth115:19
holo_long story short: router public ip is pingable, i can ping outside world from instance and any other instance in private network, but when i want assigne FIP im getting just: "added" but its not15:19
holo_i tried lot of configurations, first with vlans yesterday i reinstall everything, even centos to ubuntu and use just phisical interfaces just like in documentation15:20
holo_and still that same15:20
holo_https://ask.openstack.org/en/question/112234/can-not-assigne-floating-ip-to-instance-with-dvr-router/15:20
zhubingbingcan u put the global.yaml files15:20
*** zshi has joined #openstack-kolla15:20
holo_one sec15:20
holo_https://pastebin.com/QfMuvkN8 <-- here it is15:21
holo_zhubingbing, *15:21
zhubingbinglook so good15:22
zhubingbingifconfig eno115:22
*** mnasiadka has joined #openstack-kolla15:22
holo_https://pastebin.com/tjAEy4A615:23
zhubingbingeno1 cannot set up the IP15:23
holo_actually set enp1 up15:23
holo_i do not have it15:23
holo_wow i reached limit on pastebin :)15:24
*** dasTor has quit IRC15:25
*** kolla-slack has quit IRC15:25
zhubingbingeno1 you set to neutron_extern use it,but  floating ip can not  be assigned to instance ?15:27
holo_in my post i added all links to global file and others at bottom15:27
*** mnasiadka has quit IRC15:27
*** kolla-slack has joined #openstack-kolla15:27
holo_yes15:27
holo_floating ip is createing but not associateing15:27
holo_in same network range my ip is assigneing to router and is pingable15:28
holo_same if i create instance in public network i can normally ssh to it15:28
holo_just assigneing not working15:28
zhubingbing。。15:28
zhubingbingi thinks floating-ip should set in public network15:29
*** kolla-slack has quit IRC15:29
holo_oo and when i use horizon console i can ping ouside world normally and other instances in same prvate network15:29
*** kolla-slack has joined #openstack-kolla15:30
holo_https://pastebin.com/4yE5Nfv215:30
holo_here are my commands how im trying to do it15:31
holo_ip was created with "openstack floating ip create public1"15:31
*** kolla-slack has quit IRC15:31
*** kolla-slack has joined #openstack-kolla15:31
*** kiennt26 has quit IRC15:31
holo_oo what i did not tell before, i created on hw switch 2 untaged vlans for external and api network15:32
holo_but do not thik it can be issue15:32
zhubingbingCan you set the switches the en哦15:32
zhubingbingeno1 in public network15:33
zhubingbingyeah15:33
zhubingbingFirst you have to switch to define on the network api network (eno2) and external network(eno1)15:34
holo_you want me to set eno1 as "api" network and eno2 as public?15:34
holo_(just to swap them?)15:34
*** lpetrut has joined #openstack-kolla15:34
zhubingbing# followed for other types of interfaces.15:35
zhubingbingnetwork_interface: "eno2"15:35
zhubingbing15:35
zhubingbing# These can be adjusted for even more customization. The default is the same as15:35
zhubingbing# the 'network_interface'. These interfaces must contain an IPv4 address.15:35
zhubingbing#kolla_external_vip_interface: "{{ network_interface }}"15:35
zhubingbing#api_interface: "{{ network_interface }}"15:35
zhubingbing#storage_interface: "{{ network_interface }}"15:35
zhubingbing#cluster_interface: "{{ network_interface }}"15:35
zhubingbing#tunnel_interface: "{{ network_interface }}"15:35
zhubingbing#dns_interface: "{{ network_interface }}"15:35
zhubingbing15:35
zhubingbing# This is the raw interface given to neutron as its external network port. Even15:35
zhubingbing# though an IP address can exist on this interface, it will be unusable in most15:35
zhubingbing# configurations. It is recommended this interface not be configured with any IP15:35
zhubingbing# addresses for that reason.15:35
zhubingbingneutron_external_interface: "eno1"15:35
zhubingbingthis is your globa.yml file15:35
holo_yes15:35
holo_on eno1 i do not have any ip assigned15:36
zhubingbingeno1 external network.15:36
holo_yes15:36
zhubingbing192.168.11.1/24 you should setting in switch15:37
*** mnasiadka has joined #openstack-kolla15:37
zhubingbinglet 192.168.11.1/24 network can ping www.google.com15:37
holo_i have it (like i wrote when im on horizon console on instance i can ping outside world)15:38
holo_networking on private instances is working, just after all when i try to assigne created FIP it is not happening15:38
zhubingbingdon;t assinge floating ip it can ping outside world15:39
holo_yes, via router15:40
holo_one sec i will push somewher screen from horizon console and instance15:40
zhubingbingI think you setting network have some problem15:41
*** lvdombrkr89 has joined #openstack-kolla15:41
zhubingbingeno2 should it private network15:41
zhubingbingeno1 is public network15:41
holo_https://i.imgur.com/8bJxu5N.png15:41
holo_yes it is like that15:41
*** mnasiadka has quit IRC15:41
*** lvdombrkr has quit IRC15:42
holo_on screenshot you can see instance can reach one of google ip15:42
*** karlamrhein has quit IRC15:42
holo_so networking looks ok (i tried on both DVR router and normal one)15:42
*** karlamrhein has joined #openstack-kolla15:42
holo_but when i want to make private instance public by adding fixed ip to it, im experiencing this: https://pastebin.com/4yE5Nfv215:43
zhubingbingcan i ssh to your machine?15:44
holo_yes give me 5min15:44
holo_need to make port redirection15:44
zhubingbingok15:45
*** vhosakot has joined #openstack-kolla15:45
holo_there is redeploy right now so You will have fresh install of it15:45
zhubingbinghttps://pastebin.com/LKBCT8Tr15:47
zhubingbinggive me your network setting information of the machine15:48
*** caoyuan_ has joined #openstack-kolla15:48
*** david-lyle has joined #openstack-kolla15:51
*** pcaruana has quit IRC15:51
*** caoyuan has quit IRC15:52
*** mnasiadka has joined #openstack-kolla15:52
holo_zhubingbing: i sent you login details on private chat15:53
*** lvdombrkr89 has quit IRC15:53
*** randyl has quit IRC15:54
*** randyl has joined #openstack-kolla15:55
*** martinst has quit IRC15:57
*** mnasiadka has quit IRC15:57
*** martinst has joined #openstack-kolla15:57
*** salv-orlando has joined #openstack-kolla15:57
*** egonzalez has quit IRC16:01
*** b_bezak has quit IRC16:01
*** salv-orlando has quit IRC16:03
*** salv-orlando has joined #openstack-kolla16:03
*** caoyuan_ has quit IRC16:04
*** v1k0d3n has quit IRC16:04
*** v1k0d3n has joined #openstack-kolla16:05
*** caoyuan has joined #openstack-kolla16:05
*** zioproto has quit IRC16:06
*** zioproto has joined #openstack-kolla16:06
*** jaosorior has quit IRC16:06
*** mnasiadka has joined #openstack-kolla16:07
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix cluster mode for skydive  https://review.openstack.org/54088116:10
*** mnasiadka has quit IRC16:12
*** caoyuan has quit IRC16:13
*** wlmbasson has quit IRC16:15
*** mnasiadka has joined #openstack-kolla16:17
emccormickHey guys. Asked this last night, but any answer got scrolled out of my history ;)16:20
emccormicktrying to build pike containers, getting a stack trace pushing to local registry16:20
*** retr0h has quit IRC16:20
*** retr0h has joined #openstack-kolla16:20
emccormickTraceback (most recent call last):16:20
emccormick  File "/usr/lib/python2.7/site-packages/kolla/image/build.py", line 217, in run16:20
emccormick    self.push_image(image)16:20
emccormick  File "/usr/lib/python2.7/site-packages/kolla/image/build.py", line 237, in push_image16:20
emccormick    insecure_registry=True):16:20
emccormick  File "/usr/lib/python2.7/site-packages/docker/api/image.py", line 451, in push16:20
emccormick    header = auth.get_config_header(self, registry)16:20
emccormickAttributeError: 'module' object has no attribute 'get_config_header'16:20
emccormickif anyone has a clue what might cause that, would love suggestions :)16:20
kolla-slack<egonzalez> emccomick, a fix was merged in master, in review queue for stable branchs16:23
zhubingbing@emccormick  pip install docker16:23
emccormickI did that already. down to 2.7.016:24
emccormickthat fixed not being able to run kolla-build at all16:24
zhubingbingemccormick  you can test pike/stable16:24
zhubingbingegonzalez h16:24
zhubingbinghi16:24
emccormickdocker==2.7.016:24
emccormickdocker-py==1.10.616:24
emccormickdocker-pycreds==0.2.116:24
kolla-slack<egonzalez> Docker-py and docker are not compatible16:25
emccormickzhubingbing Not sure what you mean. This is using pike stable16:25
kolla-slack<egonzalez> Use only docker16:26
emccormickso rm docker-py?16:26
*** zhaochao has quit IRC16:26
kolla-slack<egonzalez> Yes, remove docker-py and reinstall docker16:26
zhubingbingpip uninstall docker-py pip uninstall dokcer pip install docker16:26
emccormickok thanks. done and trying again.16:27
*** mnasiadka has quit IRC16:29
*** gmann has quit IRC16:33
*** gmann has joined #openstack-kolla16:33
inc0good morning16:34
*** itlinux has joined #openstack-kolla16:34
emccormickok looks like it's kicking along nicely. Thanks guys.16:34
emccormicko/ inc016:34
inc0emccormick: one thing - when you reinstall docker, make sure it's 2.716:35
emccormickyep did it ;)16:35
inc0cool cool16:35
inc0btw that should show you glimpse of world we live in - you need to install docker, not docker-py and in correct version16:35
emccormickAny other gotchas for Ocata->Pike upgrade you know of?16:35
inc0because they break things16:35
emccormickgoing to try and run this tonight.16:36
inc0if there are gotchas we generally try to either automate it or put it in release notes16:36
inc0I'd suggest reading those16:36
emccormickI have a nice ansible playbook to bootstrap everything. I'll just add that as a step.16:36
*** bmace_ has joined #openstack-kolla16:36
inc0but other than that, I can't think of anything tricky between these two16:36
emccormickI did read them16:36
inc0O->P was fairly straightforward as far as I remember16:37
*** mnasiadka has joined #openstack-kolla16:37
emccormickspiffy16:37
emccormickI'm gonna be current for a day or two. Hurray!16:38
inc0haha16:38
inc0more than that, like 2 weeks16:38
*** caoyuan has joined #openstack-kolla16:40
emccormickOh, one thing I was a tad confused about: I'm running standard OVS right now. Not planning to switch to dpdk. Do I need hosts in the new openvswitch inventory group?16:41
inc0yes16:41
emccormickand if so, all computes / network nodes need to be there?16:41
inc0yes16:41
inc0reason is we splitted ovs to separate role16:41
inc0besides dpdk there were people who wanted to install their own ovs16:42
emccormickyep that's what it looked like to me. Just wanted to confirm. Thanks :)16:42
emccormickah16:42
*** mnasiadka has quit IRC16:42
inc0or configure ovs their own way to be precise:)16:42
*** brad[] has quit IRC16:45
*** caoyuan has quit IRC16:48
*** mnasiadka has joined #openstack-kolla16:52
*** salv-orlando has quit IRC16:54
*** gfidente has quit IRC16:55
*** salv-orlando has joined #openstack-kolla16:55
*** mnasiadka has quit IRC16:57
*** salv-orlando has quit IRC16:59
*** gfidente has joined #openstack-kolla17:00
*** gfidente has quit IRC17:00
*** gfidente has joined #openstack-kolla17:00
*** dtk has quit IRC17:02
*** dtk has joined #openstack-kolla17:02
*** pbourke has quit IRC17:02
*** pbourke has joined #openstack-kolla17:04
*** salv-orlando has joined #openstack-kolla17:04
*** derekjhyang has quit IRC17:05
*** mnasiadka has joined #openstack-kolla17:07
*** dardelean has quit IRC17:07
*** dardelean has joined #openstack-kolla17:08
*** mnasiadka has quit IRC17:11
*** dardelean has quit IRC17:12
*** bmace_ has quit IRC17:15
*** bmace_ has joined #openstack-kolla17:15
*** caoyuan has joined #openstack-kolla17:16
*** cah_link has quit IRC17:16
*** rwsu has quit IRC17:19
*** zhubingbing has quit IRC17:20
*** rwsu has joined #openstack-kolla17:20
holo_With help of zhubinbing we figure out that openstackclient is buggy and command from officail doc is not working, we used other to to assigne ip to port and it associated my ip to instance finally. But do not think such things should be in stable client relase :(17:20
*** mnasiadka has joined #openstack-kolla17:22
*** caoyuan has quit IRC17:23
*** mnasiadka has quit IRC17:26
jmccarthypip install kolla-ansible==5 doesn't deploy .. do we still need the 'pip install --upgrade docker==2.*'  'fix' ?17:29
inc0yes17:29
jmccarthyWhat is the issue there, I mean can that be corrected or does it mean this table needs updating or ? https://docs.openstack.org/project-deploy-guide/kolla-ansible/pike/quickstart.html#install-dependencies17:30
inc0yes jmccarthy17:33
inc0we should update it17:33
inc0or rather17:33
inc0when we release, it'll still be ok17:33
inc0it's just this limbo now when docker 3.0 is fixed upstream, just not released yet17:34
jmccarthyOh ah ok17:34
inc0we release this week so well17:34
jmccarthyok cool17:35
*** mnasiadka has joined #openstack-kolla17:37
*** jbadiapa has joined #openstack-kolla17:38
*** gfidente is now known as gfidente|afk17:38
*** rmart04 has quit IRC17:39
*** mnasiadka has quit IRC17:42
*** jbadiapa has quit IRC17:45
*** caoyuan has joined #openstack-kolla17:50
*** mnasiadka has joined #openstack-kolla17:52
*** holo__ has joined #openstack-kolla17:54
*** dardelean has joined #openstack-kolla17:55
*** mnasiadka has quit IRC17:56
*** holo_ has quit IRC17:56
*** caoyuan has quit IRC17:57
*** dardelean has quit IRC17:59
*** keper7 has joined #openstack-kolla18:00
*** sambetts is now known as sambetts|afk18:01
*** absubram has quit IRC18:03
*** jmccarthy has left #openstack-kolla18:03
*** salv-orlando has quit IRC18:07
*** mnasiadka has joined #openstack-kolla18:07
*** salv-orlando has joined #openstack-kolla18:07
*** charliekang has joined #openstack-kolla18:07
*** holo__ has quit IRC18:09
*** yangzb09 has joined #openstack-kolla18:11
*** salv-orlando has quit IRC18:12
*** devananda has joined #openstack-kolla18:13
mgoddard_hi all. kolla-ansible mariadb has recently started failing for me. Is this a known issue?18:14
mgoddard_TASK [mariadb : Running MariaDB bootstrap container] *******************************************************************************************************************************************************18:15
mgoddard_fatal: [controller0]: FAILED! => {"changed": true, "failed": true, "msg": "Container exited with non-zero return code"}18:15
*** caoyuan has joined #openstack-kolla18:16
mgoddard_actually, I have docker==3.0.1 in my virtualenv. I'll try downgrading18:16
*** keper7 has quit IRC18:17
charliekangmgoddard: This just got merged into master https://review.openstack.org/#/c/539988/18:18
mgoddard_charliekang: yep, that looks like it should fix it. Thanks18:19
*** david-lyle has quit IRC18:20
*** caoyuan has quit IRC18:20
*** brad[] has joined #openstack-kolla18:21
*** caoyuan has joined #openstack-kolla18:25
*** lpetrut has quit IRC18:25
*** lpetrut has joined #openstack-kolla18:33
*** caoyuan has quit IRC18:33
*** brad[] has quit IRC18:34
*** harlowja has joined #openstack-kolla18:35
*** olivierbourdon38 has joined #openstack-kolla18:36
*** gmann has quit IRC18:43
*** brad[] has joined #openstack-kolla18:46
*** bmace_ has quit IRC18:48
*** bmace_ has joined #openstack-kolla18:51
*** unicell has joined #openstack-kolla18:55
*** mnasiadka has quit IRC18:57
*** caoyuan has joined #openstack-kolla19:01
*** david-lyle has joined #openstack-kolla19:08
*** caoyuan has quit IRC19:08
*** david-lyle has quit IRC19:08
*** david-lyle has joined #openstack-kolla19:09
hrwhttps://marcin.juszkiewicz.com.pl/2018/02/06/graphical-console-in-openstack-aarch64/ - thanks to kolla it was quite simple to test19:18
*** bmace_ has quit IRC19:19
*** vhosakot_ has joined #openstack-kolla19:20
*** vhosakot has quit IRC19:23
*** bmace_ has joined #openstack-kolla19:23
*** goldyfruit has quit IRC19:26
sdakehrw - heroic effort on making openstack work and work well on aarch6419:28
*** goldyfruit has joined #openstack-kolla19:28
hrwsdake: ;)19:28
*** salv-orlando has joined #openstack-kolla19:28
sdakehrw when you first came to me asking if it was possible - I was thinking "if your a massochist" :)19:29
hrwsdake: we made aarch64 servers boring as they should be. now it is time to get same with openstack19:29
hrwsdake: please add that comment on blog ;)19:29
hrwit is lovely ;)19:29
*** salv-orlando has quit IRC19:30
*** caoyuan has joined #openstack-kolla19:30
sdakeadded - cheers ;)19:32
*** caoyuan has quit IRC19:39
*** mgoddard_ has quit IRC19:47
*** lpetrut has quit IRC19:48
*** yangzb09 has quit IRC20:01
*** absubram has joined #openstack-kolla20:01
*** owalsh has quit IRC20:02
*** owalsh has joined #openstack-kolla20:02
*** caoyuan has joined #openstack-kolla20:04
*** caoyuan_ has joined #openstack-kolla20:06
*** caoyuan has quit IRC20:08
*** rmart04 has joined #openstack-kolla20:09
*** rmart04 has quit IRC20:10
*** caoyuan_ has quit IRC20:14
*** mgoddard_ has joined #openstack-kolla20:25
*** hw_wutianwei1 has joined #openstack-kolla20:32
*** hw_wutianwei has quit IRC20:34
*** hw_wutianwei1 is now known as hw_wutianwei20:34
*** mgoddard_ has quit IRC20:38
*** caoyuan has joined #openstack-kolla20:40
*** caoyuan has quit IRC20:49
*** olivierbourdon38 has quit IRC20:50
*** gfidente|afk has quit IRC20:51
*** takamatsu has quit IRC21:01
*** rhallisey has quit IRC21:01
dtkhi guys21:06
inc0YAY21:06
* inc0 happy21:06
dtkis there anything that would provide the ability to add some sort of http hooks or something when creating vm's ATM ?21:07
dtkany openstack component ?21:07
dtkI am aware of the notifications21:07
inc0dtk: nova notifications21:07
inc0ah..well21:07
inc0that21:07
dtkbut let's say when creating an instance21:07
dtkI want a callback made somewhere21:08
inc0ceilometer can hit hooks based on notifs21:08
dtkwith the machine's hostname21:08
inc0you can use ceilometer for that21:08
dtkip address and so on21:08
inc0look at ceilometer autoscaling with heat21:08
dtkhmmm, I'll take a look at that21:08
inc0what happens is ceilometer, when hit certain treshold, makes http call to heat to scale up21:08
dtkI was thinking about something that'd be easily configurable from horizon21:10
inc0not sure about that - I don't think I ever used ceilometer horizon plugin21:11
*** caoyuan has joined #openstack-kolla21:16
*** caoyuan has quit IRC21:25
*** salv-orlando has joined #openstack-kolla21:30
openstackgerritMerged openstack/kolla-ansible stable/pike: Improve mariadb_recovery  https://review.openstack.org/54094021:30
*** threestrands has joined #openstack-kolla21:32
*** threestrands has quit IRC21:32
*** threestrands has joined #openstack-kolla21:32
*** salv-orlando has quit IRC21:33
*** jbadiapa has joined #openstack-kolla21:36
*** jbadiapa has quit IRC21:40
*** dave-mcc_ has quit IRC21:41
*** itlinux has quit IRC21:50
*** caoyuan has joined #openstack-kolla21:51
*** itlinux has joined #openstack-kolla21:54
*** caoyuan has quit IRC21:59
*** vhosakot has joined #openstack-kolla22:03
*** salv-orlando has joined #openstack-kolla22:05
*** vhosakot_ has quit IRC22:07
*** vhosakot has quit IRC22:09
*** openstackgerrit has quit IRC22:16
*** salv-orlando has quit IRC22:17
*** caoyuan has joined #openstack-kolla22:26
*** caoyuan has quit IRC22:34
*** salv-orlando has joined #openstack-kolla22:47
*** ktibi has quit IRC22:50
*** itlinux has quit IRC22:53
*** caoyuan has joined #openstack-kolla23:01
*** caoyuan has quit IRC23:09
*** M4g1c5t0rM has joined #openstack-kolla23:26
*** brad[] has quit IRC23:29
*** M4g1c5t0rM has quit IRC23:31
*** caoyuan has joined #openstack-kolla23:36
*** absubram has quit IRC23:38
*** masahisa has joined #openstack-kolla23:41
*** masahisa has quit IRC23:44
*** caoyuan has quit IRC23:45
*** absubram has joined #openstack-kolla23:51
*** absubram has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!