Wednesday, 2017-08-02

*** renmak__ has quit IRC00:01
*** rfxn has joined #openstack-kolla00:03
*** vhosakot has quit IRC00:06
*** Teck7 has quit IRC00:07
*** Teck7 has joined #openstack-kolla00:09
*** rfxn has quit IRC00:12
*** rfxn has joined #openstack-kolla00:14
*** aagate has quit IRC00:15
*** emccormick has quit IRC00:15
*** Teck7 has quit IRC00:17
*** itlinux has joined #openstack-kolla00:22
*** itlinux_ has joined #openstack-kolla00:22
*** kevinz has joined #openstack-kolla00:27
*** ducttape_ has joined #openstack-kolla00:31
*** emccormick has joined #openstack-kolla00:32
*** Teck7 has joined #openstack-kolla00:32
*** jtriley has joined #openstack-kolla00:36
*** ducttape_ has quit IRC00:36
*** mdnadeem has joined #openstack-kolla00:36
*** rfxn has quit IRC00:36
*** rfxn has joined #openstack-kolla00:38
*** emccormick has quit IRC00:38
*** ducttape_ has joined #openstack-kolla00:38
*** ducttape_ has quit IRC00:40
*** Teck7 has quit IRC00:41
*** jtriley has quit IRC00:41
*** ducttape_ has joined #openstack-kolla00:41
*** Teck7 has joined #openstack-kolla00:41
*** ducttape_ has quit IRC00:43
*** ducttap__ has joined #openstack-kolla00:43
*** rfxn has quit IRC00:43
*** duonghq has joined #openstack-kolla00:44
*** rfxn has joined #openstack-kolla00:45
*** ducttap__ has quit IRC00:47
*** srwilkers_ has joined #openstack-kolla00:47
*** Teck7 has quit IRC00:49
*** Teck7 has joined #openstack-kolla00:51
*** ramishra has joined #openstack-kolla00:51
*** rfxn has quit IRC00:54
*** rfxn has joined #openstack-kolla00:56
*** unicell has quit IRC00:58
*** Teck7 has quit IRC00:59
*** tonanhngo has quit IRC01:04
*** tovin07_ has joined #openstack-kolla01:06
*** tonanhngo has joined #openstack-kolla01:12
*** tonanhngo_ has joined #openstack-kolla01:16
*** tonanhngo has quit IRC01:16
*** tonanhngo_ has quit IRC01:20
*** itlinux_ has quit IRC01:24
*** itlinux has quit IRC01:24
*** https_GK1wmSU has joined #openstack-kolla01:30
*** https_GK1wmSU has left #openstack-kolla01:31
duonghqmorning guys01:36
*** stefan_bo has joined #openstack-kolla01:49
*** jamesbenson has joined #openstack-kolla01:50
*** jamesbenson has quit IRC01:54
inc0hey Duong01:57
*** slagle has quit IRC01:59
*** lan1 has joined #openstack-kolla02:03
*** iniazi has joined #openstack-kolla02:04
*** dixiaoli has joined #openstack-kolla02:05
*** itlinux_ has joined #openstack-kolla02:07
*** itlinux has joined #openstack-kolla02:07
*** iniazi_ has quit IRC02:08
*** slagle has joined #openstack-kolla02:12
*** awiddersheim has quit IRC02:12
*** awiddersheim has joined #openstack-kolla02:13
*** dave-mcc_ has joined #openstack-kolla02:41
*** dave-mccowan has quit IRC02:42
*** jamesbenson has joined #openstack-kolla02:45
*** dixiaoli has quit IRC02:47
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add gnocchi log in fluentd  https://review.openstack.org/48957502:47
sdakesup peeps02:50
zhubingbingsup sdake02:50
*** dixiaoli has joined #openstack-kolla02:51
*** goldyfruit has quit IRC02:52
*** ramishra has quit IRC02:53
*** itlinux has quit IRC03:00
*** itlinux_ has quit IRC03:00
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add ironic log in fluentd  https://review.openstack.org/48983503:04
*** dave-mccowan has joined #openstack-kolla03:12
*** dave-mcc_ has quit IRC03:14
*** caowei has joined #openstack-kolla03:18
*** spsurya has joined #openstack-kolla03:31
*** stefan_bo has quit IRC03:31
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add panko log in fluentd  https://review.openstack.org/48984503:31
spsuryamorning guys03:32
*** dave-mccowan has quit IRC03:33
*** emccormick has joined #openstack-kolla03:34
zhubingbingmorning spsurya03:35
spsuryazhubingbing: sup03:35
zhubingbing;)03:36
*** yangyapeng has joined #openstack-kolla03:36
*** emccormick has quit IRC03:40
*** ducttape_ has joined #openstack-kolla03:42
ashishb_Hello Everyone~03:45
ashishb_I am trying to build Kolla images, using kolla-build command, however, during the build I see many errors:03:46
ashishb_INFO:kolla.image.build.base:http://repo.percona.com/release/7/RPMS/x86_64/repodata/b0768206a4dd3d75cafa84ea23326705f00b8ad213e93a6fe34d9b38e210217b-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found03:46
ashishb_on checking the url, I see there is no such repo03:47
ashishb_any thoughts, how I can somehow tell Kolla to not use this url for percona?03:48
ashishb_I tried changing my yum repo urls, but it did not help03:48
*** ducttape_ has quit IRC03:49
*** ducttape_ has joined #openstack-kolla03:49
*** eaguilar has joined #openstack-kolla03:54
*** ducttape_ has quit IRC03:54
*** eaguilar is now known as eaguilar|afk03:54
*** eaguilar|afk is now known as eaguilar03:54
*** ducttape_ has joined #openstack-kolla03:59
*** itlinux_ has joined #openstack-kolla04:02
*** itlinux has joined #openstack-kolla04:02
*** ducttape_ has quit IRC04:04
*** eaguilar has quit IRC04:23
*** unicell has joined #openstack-kolla04:24
*** kornicameister has quit IRC04:31
*** vharsh has joined #openstack-kolla04:31
*** kornicameister has joined #openstack-kolla04:32
*** kbaegis has joined #openstack-kolla04:36
*** dixiaoli has quit IRC04:40
*** jamesbenson has quit IRC04:42
*** ducttape_ has joined #openstack-kolla05:02
*** ducttape_ has quit IRC05:04
*** ducttape_ has joined #openstack-kolla05:06
*** ducttape_ has quit IRC05:08
*** ducttape_ has joined #openstack-kolla05:08
*** stefan_bo has joined #openstack-kolla05:09
*** caowei has quit IRC05:10
*** ramishra has joined #openstack-kolla05:12
*** ducttape_ has quit IRC05:13
*** skramaja has joined #openstack-kolla05:13
*** yangyapeng has quit IRC05:17
*** yangyapeng has joined #openstack-kolla05:19
*** robellison has joined #openstack-kolla05:22
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only neccesary tasks (all other roles)  https://review.openstack.org/39868505:25
*** ramishra has quit IRC05:26
*** robellison has quit IRC05:26
*** dixiaoli has joined #openstack-kolla05:28
*** ramishra has joined #openstack-kolla05:28
*** dixiaoli has quit IRC05:28
*** dixiaoli has joined #openstack-kolla05:29
*** jamesbenson has joined #openstack-kolla05:36
ashishb_ok, so I noticed that percona repo is added here in kolla:05:37
ashishb_docker/base/Dockerfile.j2:   'http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-4.noarch.rpm'05:37
ashishb_and somehow, this repo enables / causes the percona packages to be pulled from this url, during kolla-build: :http://repo.percona.com/release/7/RPMS/x86_64/repodata/b0768206a4dd3d75cafa84ea23326705f00b8ad213e93a6fe34d9b38e210217b-primary.sqlite.bz2:05:38
ashishb_and since there is no such url (at least when I tried to build the kolla images) it fails with:05:39
ashishb_[Errno 14] HTTP Error 404 - Not Found05:39
ashishb_anyone else seeing this issue with percona images?05:39
*** jamesbenson has quit IRC05:40
*** janki has joined #openstack-kolla05:41
*** kbaegis has quit IRC05:46
*** mdnadeem has quit IRC05:47
*** mdnadeem has joined #openstack-kolla05:48
*** mdnadeem has quit IRC05:49
*** mdnadeem has joined #openstack-kolla05:49
*** mdnadeem_ has joined #openstack-kolla05:50
*** mdnadeem has quit IRC05:51
*** mdnadeem has joined #openstack-kolla05:51
*** caowei has joined #openstack-kolla05:54
*** mdnadeem_ has quit IRC05:55
*** stefan_bo has quit IRC05:55
*** ducttap__ has joined #openstack-kolla06:11
*** ductta___ has joined #openstack-kolla06:13
*** ducttap__ has quit IRC06:13
*** stefan_bo has joined #openstack-kolla06:15
*** jamesbenson has joined #openstack-kolla06:18
*** ductta___ has quit IRC06:18
*** mdnadeem has quit IRC06:18
*** jamesbenson__ has quit IRC06:18
*** jamesbenson has quit IRC06:22
*** bmace has quit IRC06:24
*** bmace has joined #openstack-kolla06:24
*** jamesbenson_ has joined #openstack-kolla06:24
*** jaosorior has quit IRC06:25
*** rwsu has quit IRC06:30
*** jaosorior has joined #openstack-kolla06:34
*** pcaruana has joined #openstack-kolla06:34
*** yangyape_ has joined #openstack-kolla06:43
*** yangyape_ has quit IRC06:46
*** yangyape_ has joined #openstack-kolla06:46
*** yangyapeng has quit IRC06:46
openstackgerritAshish Billore proposed openstack/kolla master: Fix Underline as per the title length in .rst  https://review.openstack.org/48988206:48
*** mdnadeem has joined #openstack-kolla06:48
*** yangyapeng has joined #openstack-kolla06:50
*** yangyape_ has quit IRC06:50
masberhi all, I am having this issue while deploying kolla, any idea? fatal: [openstack-controller]: FAILED! => {"changed": false, "failed": true, "msg": "Unknown error message: Tag 4.0.2 not found in repository docker.io/kolla/centos-binary-fluentd"}06:51
masberhow can I tell kolla to use image 4.0.0 instead of 4.0.2? thanks06:52
*** yangyapeng has quit IRC06:54
*** prateek has joined #openstack-kolla06:59
*** jamesbenson has joined #openstack-kolla06:59
*** stefan_bo has quit IRC07:02
japestinhohi guys, I have an error keystone-fernet-setup-job wih NSS: client certificate not found07:03
*** jamesbenson has quit IRC07:04
japestinhohttps://www.irccloud.com/pastebin/PEafN2tj/07:04
japestinhohttps://www.irccloud.com/pastebin/ikpTHdVJ/07:04
japestinhoany clue what's wrong with configuration?07:06
*** zhangfei has joined #openstack-kolla07:08
*** janki is now known as janki|lunch07:10
*** stefan_bo has joined #openstack-kolla07:12
openstackgerritMerged openstack/kolla-ansible master: Add default volume_backend_name for rbd driver in cinder volume  https://review.openstack.org/48604307:15
openstackgerritJeffrey Zhang proposed openstack/kolla master: Run fluentd as root user  https://review.openstack.org/48989007:19
*** https_GK1wmSU has joined #openstack-kolla07:21
*** https_GK1wmSU has left #openstack-kolla07:22
*** stefan_bo has quit IRC07:23
*** reidrac has joined #openstack-kolla07:33
openstackgerritJeffrey Zhang proposed openstack/kolla master: Prevent check haproxy script from generating meaningless logs  https://review.openstack.org/48990207:35
*** lpetrut has joined #openstack-kolla07:37
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix modify external ceph.conf not restart related containers  https://review.openstack.org/48990307:37
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix modify external ceph.conf not restart related containers  https://review.openstack.org/48990307:39
*** eaxiom has joined #openstack-kolla07:44
*** stefan_bo has joined #openstack-kolla07:44
eaxiomhi all.07:44
eaxiomI am planning to deploy a production ready openstack using kolla07:44
openstackgerritweichuancheng proposed openstack/kolla-ansible master: Add external-ceph-scripts to create configration files  https://review.openstack.org/48990807:45
eaxiompreviously i have done this with openstack-ansible  but I want to try openstack-kolla this time07:45
eaxiomI have  3 physical controller nodes ,  5 compute nodes ,  and three storage nodes  (ceph osds)07:46
openstackgerritweichuancheng proposed openstack/kolla-ansible master: Add external-ceph-scripts to create configration files  https://review.openstack.org/48990907:46
eaxiomcan someone point me to a reference document to start with please?07:46
*** yangyapeng has joined #openstack-kolla07:50
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix modify external ceph.conf not restart related containers  https://review.openstack.org/48990307:52
*** robellison has joined #openstack-kolla07:52
*** egonzalez has joined #openstack-kolla07:53
*** ducttape_ has joined #openstack-kolla07:56
masbereaxiom, https://docs.openstack.org/kolla-ansible/latest/07:56
*** aagate has joined #openstack-kolla07:58
masbereaxiom, are you planing to use ironic?08:01
*** ducttape_ has quit IRC08:01
*** aagate has quit IRC08:02
*** robellison has quit IRC08:02
*** yangyapeng has quit IRC08:05
*** serlex has joined #openstack-kolla08:05
*** yangyapeng has joined #openstack-kolla08:06
*** robellison has joined #openstack-kolla08:06
*** mgoddard has joined #openstack-kolla08:08
*** robellison has quit IRC08:10
*** stefan_bo has quit IRC08:11
*** stefan_bo has joined #openstack-kolla08:13
eaxiommasber:  thanks for the link .   I am currently not using ironic . but i want to use  cpeh as storage08:20
*** https_GK1wmSU has joined #openstack-kolla08:21
eaxiomAnd I want to deploy ceph on bare metal servers08:21
*** https_GK1wmSU has left #openstack-kolla08:22
eaxiomI have three controllers which i want to use as ceph proxy nodes as well08:22
*** janki|lunch is now known as janki08:25
*** reddream has joined #openstack-kolla08:29
egonzalezeaxiom, may want to use external ceph https://docs.openstack.org/kolla-ansible/latest/external-ceph-guide.html08:30
eaxiomegonzalez:  actually i would like to deploy ceph  via  kolla but on baremetal instead of  containers08:30
eaxiomi think this link is helpful when i need to integrate to an existing ceph08:31
eaxiomwhereas in my case i do not have an existing ceph setup08:31
reddreamHi, my reconfigure failed at step [neutron : Copying over ml2_conf.int] fatal: [compute2]: FAILED! => {"failed": true, "msg": "{{ hostvars[inventory_hostname]['ansible_' + tunnel_interface]['ipv4']['address'] }}: 'dict object' has no attribute 'ipv4'"}08:31
egonzalezeaxiom, kolla does not deploy on baremetal only08:31
reddreamAny suggestion?08:32
eaxiomegonzalez:  so you think First I have to setup the ceph storage and then proceed with kolla ?08:33
egonzalezeaxiom, for that use case yes08:33
*** openstackgerrit has quit IRC08:33
egonzalezeaxiom, can use ceph-ansible is a simple project to deploy ceph, support baremetal and containers08:33
eaxiomhmm . okay thanks I will check it out. another question..  Can I deploy neutron  with openvswitch and DVR  (distributed virtual routing) with  Kolla08:34
*** stefan_bo has quit IRC08:35
egonzalezeaxiom, yep, ovs is default, add enable_neutron_dvr: "yes" into globals.yml08:36
egonzalezreddream, your compute2 have tunnel_interface?08:36
eaxiomegonzalez: thats great08:37
eaxiomegonzalez: I am grateful for your kind help08:37
*** openstackgerrit has joined #openstack-kolla08:38
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Remove symlink from fluentd global conf  https://review.openstack.org/48992708:38
*** yangyapeng has quit IRC08:43
*** yangyapeng has joined #openstack-kolla08:43
openstackgerritMathieu Rohon proposed openstack/kolla master: Skydive: bump the binary version  https://review.openstack.org/48993008:46
*** stefan_bo has joined #openstack-kolla08:53
*** rmart04 has joined #openstack-kolla08:53
masbereaxiom, I am using kolla-ansible with ceph as well, I am not an expert but happy to help08:57
eaxiommasber: thats cool09:00
masberegonzalez, I was playing with ansible templates and end up breaking it, i decided to reinstall kolla and now I am getting this error message fatal: [openstack-controller]: FAILED! => {"changed": false, "failed": true, "msg": "Unknown error message: Tag 4.0.2 not found in repository docker.io/kolla/centos-binary-fluentd"}09:00
masberis it trying to download image version 4.0.2? why?09:01
eaxiommasber:  have you deployed ceph via kolla09:01
masbereaxiom, yes09:01
egonzalezmasber, have you updated kolla-ansible?09:01
masbereaxiom, but I am not using it in a production environment09:01
masberegonzalez, I did pip uninstall and pip install ...09:02
egonzalezmasber, probably later pip install installed a newer version09:03
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add gnocchi log in fluentd  https://review.openstack.org/48957509:03
masberegonzalez, should I specify version inside the globals.yml?09:04
egonzalezmasber, if want to use other image tags yes, if not set the version kolla will detect your release based on pbr version09:04
eaxiommasber: I am using 3 controller nodes as proxy nodes for ceph and  there are 3 other nodes for osds09:05
reddreamegonzalez, thanks for your response, yes, it has vxlan to controller node09:06
masbereaxiom, I have 1 vm for control plane and 2 nodes for computing and ceph (hyperconverged configuration)09:06
eaxiommasber:  have you installed ceph on physical nodes  via kolla   or installed ceph into containers?09:06
eaxiomoh ok09:06
masbereaxiom, I installed everything (ceph included) using kolla-ansible, that means all ceph components are running on containers09:07
reddreamIt works well, I just want to change a parameter of cinder, so I use kolla-ansible reconfigure to update09:07
*** stefan_bo has quit IRC09:07
*** jamesbenson has joined #openstack-kolla09:07
eaxiommasber:  did you use ubuntu 16.04 LTS ?09:08
*** jmccarthy has quit IRC09:08
*** jmccarthy has joined #openstack-kolla09:08
*** yangyapeng has quit IRC09:08
*** jmccarthy has quit IRC09:08
masbereaxiom, baremetal hosts runs centos7 and container images are based on centos/binary09:08
egonzalezreddream, compute also need tunnel_interface to make connection to neutron in network nodes09:08
*** jmccarthy has joined #openstack-kolla09:09
masberegonzalez, np, but I am guessing images 4.0.2 are not 100% stable yet is that right?09:09
*** reidrac_ has joined #openstack-kolla09:10
egonzalezmasber, I would say 4.0.2 are more stable than 4.0.1 ;)09:10
egonzalezmasber, 4.0.2 is latest ocata release with bug fixes09:10
*** reidrac has quit IRC09:10
reddreamegonzalez, yes, my network node is also on the controller node09:11
*** stefan_bo has joined #openstack-kolla09:11
*** jamesbenson has quit IRC09:12
egonzalezreddream, is the interface name the same in all nodes?09:12
masberegonzalez, nice! but the centos-binary-fluentd 4.0.2 is missing from docker hub https://hub.docker.com/r/kolla/centos-binary-fluentd/tags/?09:13
*** reidrac_ has quit IRC09:14
*** yangyapeng has joined #openstack-kolla09:14
*** reidrac has joined #openstack-kolla09:15
*** yangyapeng has quit IRC09:16
*** yangyapeng has joined #openstack-kolla09:17
reddreamegonzalez, which interface name do you mean? I cannot find it in ml2_conf.ini . What do the task [neutron : Copying over ml2_conf.int] actually do?09:20
egonzalezreddream, that task use ml2_conf.ini.j2 in ansible/roles/neutron/templates and copy to remote nodes09:21
egonzalezreddream, the config is failing is local_ip (end of the file) which is the IP from tunnel_interface (defaults to network_interface)09:22
*** zhangfei has quit IRC09:26
reddreamegonzalez, I set the tunnel_interface to 'eno2' in my original conf. And neutron_external_interface is also set to 'eno2'. After my installation, I found that I have to move IP address of eno2 to br-ex, otherwise the tunnel cannot be setup properly.09:26
egonzalezreddream, tunnel_interface use to be under network/api_interfaces09:27
egonzalezneutron_external_interface is a separate NIC09:27
reddreamegonzalez, afterwards reconfiguration cannot get ip address of eno2, maybe it's the reason?09:28
egonzalezreddream, likely09:28
reddreamSo far my servers have only two NIC, so I want to share09:28
reddreamegonzalez, I think api/tunnel/storage/ceph cluster is too much for one interface, so I try to share neutron_external_interface with tunnel_interface...09:31
*** robellison has joined #openstack-kolla09:32
*** dpertin has joined #openstack-kolla09:32
*** stefan_bo has quit IRC09:32
*** stefan_bo has joined #openstack-kolla09:36
*** zhangfei has joined #openstack-kolla09:38
japestinhohi egonzalez, did you know why nova-api-create-cell pod keep in init state? I got nova-api-create-cell pod stuck for more than half hour.09:40
*** mewald has joined #openstack-kolla09:40
japestinhoI tried to get log file from /var/log/kolla but unfortunately there is no nova.log there09:41
japestinhohttp://paste.openstack.org/show/617226/ this is what I get from kubectl describe and logs09:41
egonzalezjapestinho, cell command log should be at nova-manage.log09:41
japestinhoegonzalez ah thank you for pointing me, I'll check for that09:42
*** mewald has quit IRC09:46
*** tovin07_ has quit IRC09:50
japestinhoegonzalez, I checked from /var/lib/kubelet but there is no log file from than nova-api-manage-db09:52
japestinhohttps://www.irccloud.com/pastebin/MK7LZ6Xx/09:52
*** ducttape_ has joined #openstack-kolla09:58
*** ducttape_ has quit IRC10:02
*** papacz has joined #openstack-kolla10:03
*** dixiaoli has quit IRC10:04
reddreamthank you egonzalez, I plan to destroy my old installation and change the tunnel-interface to network-interface10:09
*** sambetts|afk is now known as sambetts10:09
*** jaosorior has quit IRC10:10
*** robellison has quit IRC10:13
*** robellison has joined #openstack-kolla10:13
*** stefan_bo has quit IRC10:15
*** mewald has joined #openstack-kolla10:17
*** ramishra has quit IRC10:19
*** ramishra has joined #openstack-kolla10:21
*** robellison has quit IRC10:24
masberegonzalez, how can check and change the version of images that kolla-ansible will download?10:29
*** robellison has joined #openstack-kolla10:31
egonzalezmasber, openstack_release: "tag"10:33
mewaldIs anyone aware of problems with Magnum in Kolla?10:36
*** jascott1 has quit IRC10:36
*** jascott1 has joined #openstack-kolla10:37
openstackgerritweichuancheng proposed openstack/kolla-ansible master: Add external-ceph-scripts to create configration files  https://review.openstack.org/48996410:37
openstackgerritAshish Billore proposed openstack/kolla master: Fix title formatting and details  https://review.openstack.org/48996510:37
openstackgerritMerged openstack/kolla-ansible stable/ocata: Remove symlink from fluentd global conf  https://review.openstack.org/48992710:41
*** jascott1 has quit IRC10:41
*** zhurong has quit IRC10:43
masbermewald, I tried magnum few weeks back but couldn't deploy a kubernetes cluster, are you having any issue?10:43
mewaldmasber: Yeah I can deploy the services but cannot issue any API calls. I will always get this error: https://gist.github.com/mewald1/fdb154cf284ba23a484336e0a5984bd3 Could be configuration related or a bug in the software itself, too.10:47
*** mewald has quit IRC10:49
masberin my case I had an issue while deploying a k8s cluster where the director was not reachable10:49
*** robellison has quit IRC10:51
*** robellison has joined #openstack-kolla10:55
masberegonzalez, thank you it is working now10:58
masberegonzalez, do you know when the new docker images will be uploaded to the docker hub?11:00
*** jaosorior has joined #openstack-kolla11:02
*** robellison has quit IRC11:03
*** reidrac has quit IRC11:04
*** mewald has joined #openstack-kolla11:10
*** mewald has quit IRC11:10
reddreamegonzalez, if I need to modify some configurations of openstack services, should I run kolla_ansible reconfiguration or some other command?11:10
*** caowei has quit IRC11:12
*** robellison has joined #openstack-kolla11:14
*** zhangfei has quit IRC11:15
*** mewald has joined #openstack-kolla11:17
*** ducttap__ has joined #openstack-kolla11:17
*** robellison has quit IRC11:18
*** k_mouza has joined #openstack-kolla11:22
*** ducttap__ has quit IRC11:22
*** rhallisey has joined #openstack-kolla11:26
*** stefan_bo has joined #openstack-kolla11:29
openstackgerritweichuancheng proposed openstack/kolla-ansible master: Add external-ceph-scripts to create configration files  https://review.openstack.org/48998411:33
*** tonanhngo has joined #openstack-kolla11:40
*** janki has quit IRC11:41
*** ramishra has quit IRC11:41
*** markhargrove28 has joined #openstack-kolla11:48
*** markhargrove28 has quit IRC11:49
*** jamesbenson has joined #openstack-kolla11:56
*** jamesbenson has quit IRC12:01
*** mdnadeem has quit IRC12:03
*** ducttape_ has joined #openstack-kolla12:07
egonzalezreddream, it depends of what changed, if is s config file from a service do reconfigure and user --tags <service> to limit reconfigure12:12
*** ducttape_ has quit IRC12:12
*** reidrac has joined #openstack-kolla12:14
*** emccormick has joined #openstack-kolla12:16
*** sean-k-mooney has quit IRC12:16
*** ducttape_ has joined #openstack-kolla12:22
*** kbaegis has joined #openstack-kolla12:23
*** stefan_bo has quit IRC12:24
*** ducttape_ has quit IRC12:24
*** ducttape_ has joined #openstack-kolla12:24
*** schwicht has joined #openstack-kolla12:25
*** ramishra has joined #openstack-kolla12:26
*** stefan_bo has joined #openstack-kolla12:27
*** schwicht has quit IRC12:32
*** schwicht has joined #openstack-kolla12:37
*** jamesbenson has joined #openstack-kolla12:38
*** ducttape_ has quit IRC12:39
*** jamesbenson has quit IRC12:42
*** awidders_ has joined #openstack-kolla12:50
*** stefan_bo has quit IRC12:53
*** awiddersheim has quit IRC12:53
*** schwicht has quit IRC12:55
*** iniazi_ has joined #openstack-kolla12:56
masberegonzalez, I am facing this error in ironic_dnsmasq container. Is this normal because the dhcp pool settings are not setup by default? http://paste.openstack.org/show/617262/12:58
*** iniazi has quit IRC13:00
*** stefan_bo has joined #openstack-kolla13:01
egonzalezmasber, need to set ironic_dnsmasq_dhcp_range, no idea what value goes there, never used ironic13:02
masberegonzalez, thank you13:03
egonzalezmasber, there you have a patch to kolla docs ;)13:03
masberegonzalez, sure, let me find out which value I need to put there so I can update the docs properly13:05
*** dpertin has quit IRC13:06
*** dpertin has joined #openstack-kolla13:06
*** stefan_bo has quit IRC13:06
*** lucasxu has joined #openstack-kolla13:12
*** lan1 has quit IRC13:12
*** goldyfruit has joined #openstack-kolla13:13
*** athomas has quit IRC13:18
*** schwicht has joined #openstack-kolla13:20
*** aolwas has quit IRC13:21
*** aolwas has joined #openstack-kolla13:23
*** athomas has joined #openstack-kolla13:27
*** prateek has quit IRC13:28
*** kbaegis has quit IRC13:32
*** jistr is now known as jistr|mtg13:32
*** xinliang has quit IRC13:32
*** kbaegis has joined #openstack-kolla13:34
*** kbaegis has quit IRC13:34
*** kbaegis has joined #openstack-kolla13:34
*** kiennt has joined #openstack-kolla13:35
openstackgerritMerged openstack/kolla-kubernetes master: Fix rendering problem when yaml value gets overridden via cli  https://review.openstack.org/48851313:37
*** sgrasley has joined #openstack-kolla13:38
*** yangyapeng has quit IRC13:38
*** rwsu has joined #openstack-kolla13:41
*** xinliang has joined #openstack-kolla13:44
*** jtriley has joined #openstack-kolla13:46
*** zhangfei has joined #openstack-kolla13:47
*** robellison has joined #openstack-kolla13:48
jaosoriorhey folks, could I get a review on this https://review.openstack.org/#/c/489150/ ?13:48
*** aagate has joined #openstack-kolla13:50
*** jistr|mtg is now known as jistr13:52
masbersorry to bother you mgoddard, I would like to ask you a question regarding ironic running on kolla. According to kolla ironic documentation (post-deployment configuration) https://docs.openstack.org/kolla-ansible/latest/ironic-guide.html we need to create a network and a subnet with dhcp enabled and but also we need to setup dhcp-range parameter for ironic_dnsmasq container. I am confused because it gives me the idea that we are setting up 2 DHCP13:54
masberservers, is that right? and why?13:54
mgoddardhi masber, sorry I had to disappear the other day13:54
*** robellison has quit IRC13:55
mgoddardmasber: the ironic dhcp range is actually for ironic inspector, which requires its own dhcp server for hardware inspection13:55
mgoddardin kolla-ansible, ironic-inspector is quite tightly coupled to ironic which can get a bit confusing13:56
mgoddardif you're not using ironic-inspector, you can ignore the ironic dhcp range variable, or at most give it a value that allows it to start up13:57
-openstackstatus- NOTICE: We have disable infracloud-vanilla due to the compute host running mirror.regionone.infracloud-vanilla.o.o being offline. Please recheck your failed jobs to schedule them to another cloud.13:57
*** zhurong has joined #openstack-kolla13:57
*** vharsh has quit IRC14:00
*** robellison has joined #openstack-kolla14:00
*** k_mouza has quit IRC14:02
*** k_mouza has joined #openstack-kolla14:02
*** skramaja has quit IRC14:08
*** robellison has quit IRC14:10
*** hongbin has joined #openstack-kolla14:10
*** robellison has joined #openstack-kolla14:12
masbermgoddard, I see, thanks14:15
*** schwicht has quit IRC14:18
*** schwicht has joined #openstack-kolla14:19
*** prateek has joined #openstack-kolla14:20
*** mdnadeem has joined #openstack-kolla14:20
*** jiriprox has joined #openstack-kolla14:24
*** renmak_ has joined #openstack-kolla14:25
*** rwsu has quit IRC14:29
masbermgoddard, sorry again, I would to ask you another question if you have time. I think I have an issue where my baremetal node can't see the PXE server hence clean process fails. If I am not mistaken the PXE server is listening to interface eno33557248 but I do can ping that interface from the baremetal server, there is something I am missing and I don't know what is it, would you be able to give a hint? http://paste.openstack.org/raw/617277/14:33
*** zhurong has quit IRC14:38
*** rwsu has joined #openstack-kolla14:39
*** jamesbenson has joined #openstack-kolla14:40
*** hrw has quit IRC14:41
*** yangyapeng has joined #openstack-kolla14:45
*** prateek has quit IRC14:45
*** jamesbenson has quit IRC14:45
*** hrw has joined #openstack-kolla14:47
*** jamesbenson has joined #openstack-kolla14:47
*** aagate_ has joined #openstack-kolla14:48
*** aagate_ has quit IRC14:49
mgoddardmasber: try installing tftp on the baremetal server and downloading pxelinux.014:49
*** yangyapeng has quit IRC14:49
mgoddardmasber: are you familiar with tcpdump? If so it should be possible to watch the network traffic from the controller14:49
mgoddardmasber: I usually do sudo tcpdump -eni <interface> port bootps or port bootpc or port tftp14:50
masbermgoddard, I ran "sudo tcpdump -i any port 67 or port 68 or port 69" on the pxe server however I can't see any traffic from the baremetal server14:50
*** ducttape_ has joined #openstack-kolla14:51
*** jamesbenson has quit IRC14:51
mgoddardmasber: your instance deployment succeeds, right? is it only cleaning that fails14:51
*** yangyapeng has joined #openstack-kolla14:53
masbermgoddard, I have not tried deployment yet, I assumed that deployment would fail as well14:53
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add gnocchi log in fluentd  https://review.openstack.org/48957514:53
mgoddardmasber: ok. what does the networking on the controller look like? is there a separate network node?14:55
*** ducttape_ has quit IRC14:55
jmccarthyAre errors (as seen with docker logs for designate_backend_bind9) like this to be expected with deploy out-of-the-box ?14:55
jmccarthyhttp://paste.openstack.org/show/617284/14:55
jmccarthy(I have not done any additional config yet for creating a zone or updating /etc/kolla/config/designate/designate-sink.conf)14:55
*** duonghq has quit IRC14:58
*** duonghq has joined #openstack-kolla14:58
duonghqevening guys14:58
*** duonghq_ has joined #openstack-kolla14:59
*** kbaegis1 has joined #openstack-kolla14:59
*** kbaegis has quit IRC14:59
openstackgerritMerged openstack/kolla-ansible master: Remove unnecessary setUp function in testcase  https://review.openstack.org/47203115:00
*** kbaegis1 has quit IRC15:00
masbermgoddard, http://paste.openstack.org/show/617285/15:00
*** jamesbenson has joined #openstack-kolla15:01
inc0good morning15:03
*** ducttape_ has joined #openstack-kolla15:03
*** jistr is now known as jistr|mtg15:06
*** zhangfei has quit IRC15:06
duonghqmoring inc015:07
*** manheim has joined #openstack-kolla15:07
*** mdnadeem has quit IRC15:08
*** ducttape_ has quit IRC15:08
openstackgerritRich Wellum proposed openstack/kolla-kubernetes master: Moved ko.py to orchestration/tools  https://review.openstack.org/48797215:09
*** aagate has quit IRC15:09
inc0yay rwellum15:09
inc0damn that's a lot of code15:09
*** manheim has quit IRC15:10
*** manheim has joined #openstack-kolla15:10
*** emccormick has quit IRC15:11
*** ducttape_ has joined #openstack-kolla15:11
*** robellison has quit IRC15:17
*** robellison has joined #openstack-kolla15:21
*** mewald has quit IRC15:22
*** ducttape_ has quit IRC15:29
*** ducttape_ has joined #openstack-kolla15:30
*** tonanhngo has quit IRC15:35
mgoddardmasber: thanks. how is OVS wired up?15:36
mgoddardmasber: is eno33557248 plugged into br-ex?15:37
masbermgoddard, no15:38
mgoddardis anything plugged into br-ex?15:39
*** renmak_ has quit IRC15:39
kfox1111_morning.15:40
*** vhosakot has joined #openstack-kolla15:41
rwelluminc0: yeah I know. Thanks to tox -e pep8 I had to rewrite a lot of it. That's the last time I use global variables, now I know openstack no-likey... :)15:41
inc0and for good reason;)15:42
rwellumyup15:42
*** itlinux has quit IRC15:45
*** itlinux_ has quit IRC15:45
jmccarthyAre errors (as seen with docker logs for designate_backend_bind9) like this to be expected with deploy out-of-the-box ?15:47
jmccarthyhttp://paste.openstack.org/show/617284/15:47
jmccarthy(I have not done any additional config yet for creating a zone or updating /etc/kolla/config/designate/designate-sink.conf) or other steps yet15:47
*** robellison has quit IRC15:48
*** k_mouza has quit IRC15:48
egonzalezjmccarthy, yeah are expected iirc15:48
egonzalezi think some cleanup needs to be done in bind9 config15:48
jmccarthyegonzalez: Ok cool, as long as I'm in the ball park - thanks !15:49
egonzalezjmccarthy, is disable ipv615:49
jmccarthyOh on the dns_interface is it ?15:51
egonzalezjmccarthy, listen-on-v6 port 53 { none; }; in bind config file15:51
*** k_mouza has joined #openstack-kolla15:51
*** rmart04 has quit IRC15:53
jmccarthyHmm I'm not seeing a template or place to change that yet ?15:53
egonzalezjmccarthy, or add -4 in named cmd at designate-backend-bind9.json.j215:53
*** robellison has joined #openstack-kolla15:53
rwellummorning kfox1111_15:53
jmccarthy? Oh ok like ... ['ubuntu', 'debian'] else 'named -4' %15:54
duonghqinc0,  do we have meeting today?15:55
inc0yes15:56
inc0in 4min:)15:56
openstackgerritMarcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role  https://review.openstack.org/41636715:56
duonghqroger15:56
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: WIP Dockerfile to run ansible orchiestration  https://review.openstack.org/47477015:56
*** robellison has quit IRC15:56
jmccarthyegonzalez: Will this be doctored up sometime ? I'm less clear on the 'best' way to do this (will try adjust the designate-backend-bind9.json.j2 method for my env)15:57
kfox1111_morning.15:57
egonzalezjmccarthy, that will need to be fixed, just saying what was the fix :)15:58
*** kiennt has quit IRC15:58
*** gaoyan has joined #openstack-kolla15:59
jmccarthyegonzalez: :) Still working out how to get this going - thanks for the help !16:00
*** egonzalez has quit IRC16:01
*** egonzalez has joined #openstack-kolla16:01
*** robellison has joined #openstack-kolla16:03
*** lpetrut has quit IRC16:07
*** egonzalez90 has joined #openstack-kolla16:08
*** dpertin has quit IRC16:10
openstackgerritMarcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role  https://review.openstack.org/41636716:11
*** egonzalez has quit IRC16:13
*** pcaruana has quit IRC16:14
masbermgoddard, sorry, I found a network issue I didn't had before, I am redeploying and making sure the vms have connection to the internet16:14
mgoddardmasber: ok. I would investigate the connection between the neutron bridges and the bare metal node. without it dhcp will not be possible16:15
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Add gnocchi log in fluentd  https://review.openstack.org/48957516:16
*** gaoyan has quit IRC16:17
*** gaoyan has joined #openstack-kolla16:17
*** kbaegis has joined #openstack-kolla16:19
jamesbensonmeeting starts in 40 minutes?16:19
vhosakotjamesbenson: meeting is happening now.16:20
*** serlex has quit IRC16:22
*** jistr|mtg is now known as jistr16:22
*** gaoyan has quit IRC16:23
*** jascott1 has joined #openstack-kolla16:24
*** gaoyan has joined #openstack-kolla16:25
*** itlinux has joined #openstack-kolla16:28
*** itlinux_ has joined #openstack-kolla16:28
*** bmace has quit IRC16:29
*** k_mouza has quit IRC16:34
*** unicell has quit IRC16:37
*** gaoyan has quit IRC16:37
*** manheim has quit IRC16:39
*** gaoyan has joined #openstack-kolla16:39
*** sgrasley has left #openstack-kolla16:40
sbezverkkfox1111: what do you think about this one: https://review.openstack.org/484991 ?16:40
*** robellison has quit IRC16:40
*** bmace has joined #openstack-kolla16:42
*** gaoyan has quit IRC16:44
*** gaoyan has joined #openstack-kolla16:46
*** gaoyan has quit IRC16:46
*** manheim has joined #openstack-kolla16:46
*** manheim has quit IRC16:46
*** manheim has joined #openstack-kolla16:46
*** phuongnh has joined #openstack-kolla16:50
jmccarthyegonzalez: Yep the -4 got rid of most of the errors, but this one:16:50
jmccarthy02-Aug-2017 17:19:53.862 managed-keys-zone: Unable to fetch DNSKEY set '.': timed out16:50
*** ducttape_ has quit IRC16:50
*** ducttape_ has joined #openstack-kolla16:51
egonzalez90jmccarthy: will take a look tomorrow16:52
duonghqthank you inc0, egonzalez90, rwellum16:54
duonghqgood night and see you later16:54
rwellumgood night duonghq16:55
kolla-slack<srikrishna68> am trying to run this command in multinode setup kolla-ansible pull -i multinode but am getting the following error TASK [common : Pulling kolla-toolbox image] ****************************************************************************************************************************  [WARNING]: Module did not set no_log for auth_password  fatal: [10.125.154.19]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (16:55
kolla-slackcall last):\\n  File \"/tmp/ansible_ZzG7t_/ansible_module_kolla_docker.py\", line 777, in main\\n    dw = DockerWorker(module)\\n  File \"/tmp/ansible_ZzG7t_/ansible_module_kolla_docker.py\", line 214, in __init__\\n    self.dc = docker.Client(**options)\\nAttributeError: \\'module\\' object has no attribute \\'Client\\'\\n'"}         to retry, use: --limit @/usr/local/share/kolla-ansible/ansible/site.retry16:55
*** jascott1 has quit IRC16:55
*** duonghq has quit IRC16:55
*** egonzalez90 has quit IRC16:55
inc0srikrishna, did you install correct version of docker-py?16:55
inc0how did you install kolla and docker-py?16:56
kolla-slack<srikrishna68> which version i should install?16:56
*** yangyapeng has quit IRC16:56
*** yangyapeng has joined #openstack-kolla16:56
inc0docker-py==1.6.0 should be fine16:56
vhosakotnight duonghq_16:57
openstackgerritRich Wellum proposed openstack/kolla-kubernetes master: Moved ko.py to orchestration/tools  https://review.openstack.org/48797216:57
*** yangyapeng has quit IRC17:00
*** ramishra has quit IRC17:00
openstackgerritRich Wellum proposed openstack/kolla-kubernetes master: A python tool to bring up Kubernetes and OpenStack.  https://review.openstack.org/48797217:02
kolla-slack<srikrishna68> do you the exact command to install a particular version of docker-py?17:03
*** mgoddard has quit IRC17:03
inc0pip install docker-py==1.6.017:03
*** k_mouza has joined #openstack-kolla17:04
*** ducttape_ has quit IRC17:08
*** k_mouza has quit IRC17:08
kolla-slack<srikrishna68> i have cleared that error . i dont have any images in docker . should i give kolla-build command first or kolla ansible pull?17:09
*** ducttape_ has joined #openstack-kolla17:11
*** reidrac has quit IRC17:11
*** harlowja has joined #openstack-kolla17:13
inc0build first then pull17:16
*** unicell has joined #openstack-kolla17:17
*** ducttape_ has quit IRC17:17
*** ntpttr_laptop__ has joined #openstack-kolla17:20
*** ntpttr_laptop has joined #openstack-kolla17:20
*** prateek has joined #openstack-kolla17:22
*** tonanhngo has joined #openstack-kolla17:22
*** tonanhngo_ has joined #openstack-kolla17:25
kolla-slack<srikrishna68> when i try kolla-build it gives the following messages17:25
kolla-slack<srikrishna68> INFO:kolla.image.build:Found the docker image folder at /usr/local/share/kolla/docker Traceback (most recent call last):   File "/usr/local/bin/kolla-build", line 10, in <module>     sys.exit(main())   File "/usr/local/lib/python2.7/dist-packages/kolla/cmd/build.py", line 30, in main     statuses = build.run_build()   File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 1105, in run_build     kolla = KollaWo17:25
kolla-slackFile "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 581, in __init__     self.dc = docker.APIClient(version='auto', **docker_kwargs) AttributeError: 'module' object has no attribute 'APIClient'17:25
*** tonanhngo has quit IRC17:26
*** prateek has quit IRC17:28
*** mgoddard has joined #openstack-kolla17:28
*** tonanhngo_ has quit IRC17:28
*** tonanhngo has joined #openstack-kolla17:28
vhosakotrwellum also saw this issue the other day ^^  using 1.6 docker-py should resolve it.17:29
vhosakotsrikrishna68 ^^17:29
*** sambetts is now known as sambetts|afk17:30
*** johnrambo has joined #openstack-kolla17:32
johnrambohi all17:32
johnramboone question,17:32
johnrambodo kolla project have support for OpenContrail?17:33
inc0johnrambo: not natively17:33
inc0however in Pike we moved ovs to separate role17:34
kolla-slack<srikrishna68> @vhosakot i have installed 1.6 docker-py still the same error17:34
inc0sri on *all* of the nodes or just deploy?17:34
kolla-slack<egonzalez> johnrambo nope but may be possible to do your own implementation17:34
inc0I'm not sure what does it take to deploy opencontrail-based openstack tho17:35
johnrambook :)17:35
*** manheim has quit IRC17:37
johnramboI have not used OpenContrail yet, just read about it and sounds pretty nice17:37
vhosakotjohnrambo: kolla has OpenDaylight if you're not a Juniper fan ;)   https://github.com/openstack/kolla/tree/master/docker/opendaylight17:37
vhosakotOpenDaylight does a lot of SDN-ish, YANG-ish, OpenFlow-ish things17:38
kolla-slack<srikrishna68> i installed in all nodes @inc017:40
inc0vhosakot: it doesn't yet;) we didn't merge it just yet, we're close tho17:42
vhosakotinc0: right, I've seen many OpenDaylight patches in the queue, right :)17:42
inc0https://review.openstack.org/#/c/416367/ you can help reviewing;)17:43
kfox1111_sbezverk: the review looks ok to me.17:44
johnrambovhosakot, which one is better ? OpenDaylight or OpenContrail17:44
johnramboI saw the interface of OpenContrail much better than OpenDaylight17:44
rwellumsbezverk: kfox1111_ I know I asked this before. But how do I change a Service .conf file before running kolla-k8s? For example I want to change the cinder.conf to point to a different backend.17:46
*** mmehan has joined #openstack-kolla17:49
*** johnrambo has quit IRC17:49
vhosakotjohnrambo: I have not used OpenContrail.  I have used OpenDaylight and integrated OpenDaylight with OpenStack (using the networking-odl plugin) and I like it.  OpenDaylight takes OpenStack to the SP/NFV/Telco world and bridges the gap using YANG, OpenFlow, and other SDN-ish things that OpenStack lacks.17:51
vhosakotOpenStack is just VM-as-a-service and is just a bunch of VMs end of the day :)   SP/Telcos want more than that like NFV and service-chaining magic.17:52
*** krtaylor has quit IRC17:53
*** yangyapeng has joined #openstack-kolla17:56
*** ducttape_ has joined #openstack-kolla17:59
vhosakotwe wrote a heat template with 1,200 lines to create a service chain in OpenStack.  we were able to do it using just 3 APIs (3 lines) using OpenDaylight :)18:01
*** yangyapeng has quit IRC18:01
*** Pavo has joined #openstack-kolla18:03
*** robellison has joined #openstack-kolla18:10
*** phuongnh has quit IRC18:10
kfox1111_vhosakot: cool.18:12
kfox1111_was hoping maybe more of the nfv stuff landed in neutron so it worked out of the box.18:13
kfox1111_haven't ever had time to figure out how to add it.18:13
*** manheim has joined #openstack-kolla18:15
kfox1111_inc0: maybe they are serious about zuulv3 after all. :)18:15
kfox1111_"18:15
kfox1111_[openstack-dev] [all] Rollout of Zuul v3 at the PTG18:15
kfox1111_"18:15
inc0ahh going prod on conference18:16
inc0it's even better than release on friday18:16
kfox1111_that would be a great time to talk with them about getting our job in too.18:17
inc0I know18:17
inc0we'll be one of first gunnea pigs of zuulv3 I assume;)18:17
inc0we can go live with dockerhub pushing on PTG or soon after too18:17
kfox1111_lets make that one our top priority for the conference.18:18
*** kfox1111_ is now known as kfox111118:19
inc0well I have most of code written18:19
vhosakotyeah saw the email about zuul v3 rollout.18:19
vhosakotkfox1111: yes, neutron in OpenStack is adding a lot of NFV/SDN plugins to make OpenStack NFV ready OTB.18:20
kfox1111vhosakot: cool.18:21
*** Pavo has quit IRC18:21
kolla-slack<srikrishna68> am able to clear the kolla-ansible prechecks . But am getting error in kolla-build18:24
kolla-slack<srikrishna68> File "/usr/local/bin/kolla-build", line 10, in <module>     sys.exit(main())   File "/usr/local/lib/python2.7/dist-packages/kolla/cmd/build.py", line 30, in main     statuses = build.run_build()   File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 1105, in run_build     kolla = KollaWorker(conf)   File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 581, in __init__     self.dc =18:24
kolla-slackdocker.APIClient(version='auto', **docker_kwargs) AttributeError: 'module' object has no attribute 'APIClient'18:24
kolla-slack<srikrishna68> same error18:24
kolla-slack<srikrishna68> i dont have deployment host...am doing from controller host itself18:25
rwellumsrikrishna: "pip freeze | grep docker-py"18:30
*** ntpttr_laptop has quit IRC18:33
kolla-slack<srikrishna68> docker-py==1.10.6 docker-pycreds==0.2.118:36
kolla-slack<srikrishna68> am getting this output18:36
kolla-slack<srikrishna68> docker-py is 1.10.6 ..it should be 1.6?18:37
*** jtriley has quit IRC18:37
kolla-slack<srikrishna68> pip install -U docker-py==1.6 Collecting docker-py==1.6 Requirement already up-to-date: requests>=2.5.2 in /usr/local/lib/python2.7/dist-packages (from docker-py==1.6) Requirement already up-to-date: websocket-client>=0.32.0 in /usr/local/lib/python2.7/dist-packages (from docker-py==1.6) Requirement already up-to-date: six>=1.4.0 in /usr/lib/python2.7/dist-packages (from docker-py==1.6) Requirement already up-to-date: idna<2.6,18:37
kolla-slack/usr/local/lib/python2.7/dist-packages (from requests>=2.5.2->docker-py==1.6) Requirement already up-to-date: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.5.2->docker-py==1.6) Requirement already up-to-date: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.5.2->docker-py==1.6) Requirement already up-to-date: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from18:37
kolla-slackrequests>=2.5.2->docker-py==1.6) Installing collected packages: docker-py   Found existing installation: docker-py 1.10.6     Uninstalling docker-py-1.10.6:       Successfully uninstalled docker-py-1.10.6 Successfully installed docker-py-1.6.018:37
*** jtriley has joined #openstack-kolla18:38
kolla-slack<srikrishna68> pip freeze | grep docker-py docker-py==1.6.0 docker-pycreds==0.2.118:38
kolla-slack<srikrishna68> even after docker-py==1.6.0 i get the same error in kolla-build18:39
kolla-slack<srikrishna68> kolla-build --base ubuntu --type source --registry 10.125.154.19:4000 --push INFO:kolla.image.build:Found the docker image folder at /usr/local/share/kolla/docker Traceback (most recent call last):   File "/usr/local/bin/kolla-build", line 10, in <module>     sys.exit(main())   File "/usr/local/lib/python2.7/dist-packages/kolla/cmd/build.py", line 30, in main     statuses = build.run_build()   File18:39
kolla-slack"/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 1105, in run_build     kolla = KollaWorker(conf)   File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 581, in __init__     self.dc = docker.APIClient(version='auto', **docker_kwargs) AttributeError: 'module' object has no attribute 'APIClient'18:39
*** kevzha01_ has joined #openstack-kolla18:40
*** kevinz has quit IRC18:43
inc0vhosakot: nomination sent, poem included;)18:45
*** krtaylor has joined #openstack-kolla18:45
robellisonso.. rabbitmq.. i now can start it IF i comment out the RABBITMQ_BOOT_MODULE=rabbit_clusterer line in rabbitmq-env.conf18:45
robellisonanyone got any ideas as to why that doesn't work? its defo not name resolution!18:45
vhosakotinc0: cool, awesome!  :)18:45
rwellumsrikrishna: the actually command I used was: "pip install docker-py==1.6.*"18:47
robellisonalso, has anyone got any good inventory file examples for simple setups? i want a 3-node controllers and no network nodes (i'm going to use Nuage hopefully) and no storage (external ceph)18:49
kolla-slack<srikrishna68> still the same . no help :(18:49
robellisonidealy no nova nodes until the controllers are working too18:49
*** Pavo has joined #openstack-kolla18:49
*** jascott1 has joined #openstack-kolla18:49
*** Teck7 has joined #openstack-kolla18:50
sbezverkinc0: to return greenness to our gate please https://review.openstack.org/48499118:51
*** iniazi_ is now known as iniazi18:51
kolla-slack<jascott1> inc0 2017 Make the gates green again!18:53
rwellumsrikrishna: not sure - here are the exact steps I used:18:54
*** rfxn has quit IRC18:54
rwellumhttps://www.irccloud.com/pastebin/ED2jK61G/18:54
kolla-slack<srikrishna68> thanks will check18:54
*** rfxn has joined #openstack-kolla18:55
inc0lol18:58
*** Teck7 has quit IRC18:59
*** coolsvap has quit IRC19:01
rwelluminc0:  do you know offhand where 'kolla build' places it's build logs?19:05
inc0by default stdout19:06
inc0if you provide log dir....19:06
rwellumThen it's redirected? Cool...19:07
inc0--logs-dir is option you want19:08
rwellumty19:08
*** Pavo has quit IRC19:09
*** ducttape_ has quit IRC19:10
vhosakotright, kolla gate also uses log dir  http://logs.openstack.org/30/489930/1/check/gate-kolla-dsvm-build-centos-source-centos-7/43a1587/console.html#_2017-08-02_16_22_04_73493919:19
*** manheim has quit IRC19:33
*** mgoddard has quit IRC19:33
*** manheim has joined #openstack-kolla19:35
*** Pavo has joined #openstack-kolla19:38
*** spsurya has quit IRC19:40
*** ntpttr_laptop has joined #openstack-kolla19:54
*** ntpttr_laptop has quit IRC19:54
robellisonstupid question - where do i find the password to log in after install?19:55
inc0login to openstack?19:56
robellisonno doubt in the passwords.yml file, but which password?19:56
robellisonyea19:56
inc0admin_password19:56
inc0keystone_admin_password19:56
robellisoni can log into horizon with that as well?19:57
*** yangyapeng has joined #openstack-kolla19:57
robellisonso i have got all this working (ish) but i had to make rabbitmq run standalone. there was no way it would run as a cluster. are you sure there are no bugs? i cant think what it could possibly be19:57
inc0yes19:58
inc0robellison: interesting, it used to work well19:59
inc0can be something broken by rabbitmq release or whatever19:59
robellisoni even took the container (and config etc) and ran it on my mac. still wouldn't start19:59
*** yangyapeng has quit IRC20:02
robellisoni'm convinced it's something to do with overlayfs20:03
robellisoninteresting that the cluster method this is using is deprecated as well20:04
inc0clusterer might need some love20:08
*** krtaylor has quit IRC20:08
*** Pavo has quit IRC20:10
robellisoninc0 yeah i think there are newer alternatives20:13
inc0good change for Queens20:14
robellisonare you guys fixed on having the config outside the container?20:14
inc0you mean you'd like to put conf inside image?20:14
robellisoni need to build a rabbit cluster for something else20:14
robellisoni ususally use environment variables or autodiscorvery20:15
*** k_mouza has joined #openstack-kolla20:15
inc0you can do both in Kolla, also change conf file20:15
robellisonmainly because we use swarm services a lot and they need to be self contained really20:15
robellisonmaybe i'll build one in the same way you do it that can run as a swarm service as well20:16
robellisonjust related acutlaly - are you planning on using swarm at all?20:17
inc0plan-no20:17
inc0possible-yes20:17
inc0if someone would like to implement it, I see no reason why not;)20:17
robellisonin the kolla-ansible project?20:18
inc0env variables aren't good for configuring openstack services20:18
robellisonor a separate one?20:18
inc0no, it'd be separate project, as kolla-swarm20:18
robellisonok, interesting20:18
robellisonare there any example production setups anywhere ? i'm looking to add an external API layer somehow20:19
inc0API layer? as in external load balancer?20:19
robellisonwell an external 3 nodes, running haproxy and all the -api containers20:22
robellisonDMZ nodes20:22
inc0don't forget that Kolla runs haproxy on network nodes20:22
inc0not controllers20:22
inc0which means if you put your network nodes on dmz, which you shouild for l3 agents to be in dmz too20:23
inc0that's what you're getting really20:23
*** krtaylor has joined #openstack-kolla20:23
*** k_mouza has quit IRC20:23
robellisoni've not got any network nodes at the moment. i put haproxy on the control nodes20:23
inc0well that's the way I'd suggest doing this20:24
inc0as in, have 3 or so nodes connected to the world20:24
inc0haproxy and l3-agents will land there20:24
inc0other than that you can just look at our haproxy conf and replicate it exactly on dmz nodes20:25
robellisonall the network stuff i'm going to do with nuage so no need for the netwok nodes20:25
inc0ok20:25
robellisoncool, so create a new group in inventory, add all the *-api containers20:25
robellisonthen create a bespoke haproxy20:25
robellison?20:25
inc0no need to create new group, they're all there20:25
inc0https://github.com/openstack/kolla-ansible/blob/master/ansible/inventory/multinode#L8220:26
inc0override this20:26
robellisoni'm going to be running ceph, so really worried about api hacing access to ceph-client network20:26
robellisonso i need internal api's on the control nodes, and ideally all the api's also on some dmz nodes20:26
robellisonusers will only access the DMZ ones20:27
robellisonwhich wont have access to ceph20:27
robellisonnot direct anyway20:27
inc0right20:27
inc0so20:27
inc0put haproxy on dmz nodes20:27
inc0only haproxy-terminated ceph api is rados gw20:28
robellisonglance and cinder?20:28
inc0so if your users only have access to nodes you specify in haproxy group, it should work20:28
inc0glance and cinder won't go through haproxy20:28
robellisonnot even glance-api and cinder-api?20:29
robellisonthey seem to on most architecutre diagrams i've seen20:29
inc0well, control nodes will have to have access to ceph20:30
inc0thing is, users don't have access to control nodes20:30
robellisonby default all the api's seem to be on there though20:30
robellisonand they will access the API - though haproxy20:30
inc0right...to glance and cinder APIs20:31
inc0since they have to20:31
inc0for example to create image20:31
inc0they won't have direct access to ceph20:31
robellisonit's still a bit of a worry when i dont know who is trying to access it20:32
inc0so, you don't want your users to have access to cinder-api or glance-api?20:33
*** https_GK1wmSU has joined #openstack-kolla20:33
robellisonyeah i do, but i want an external copy of those apis to be running in a DMZ20:33
*** k_mouza has joined #openstack-kolla20:33
inc0that's haproxy20:33
*** https_GK1wmSU has left #openstack-kolla20:34
inc0users don't have direct access to cinder-api, only haproxy endpoints which will NAT it to actual api20:34
robellisonbut everything they do will just be passed though20:34
robellisonso if there is a vunerability in the web-server (whatever that is) it may be possible to execute code in that container which then has access to ceph etc etc20:35
robellisonin my environment, the access they will have would be extensive20:35
inc0well if you want to provide your own LB20:36
inc0that's also quite easy20:36
robellisoni'm aiming for something like this..20:36
inc0just configure your LB20:36
inc0(you can use haproxy conf for reference)20:36
inc0and then in globals:20:36
robellisonuser -> fw -> haproxy -> apis -> fw -> rabbitmq/mariadb/etc20:37
inc0https://github.com/openstack/kolla-ansible/blob/master/etc/kolla/globals.yml#L3020:37
inc0this will be IP to your Load balancer20:37
inc0and add enable_haproxy: "no"20:37
robellisoni assume all the internal services use that as well though?20:37
inc0yes, but you can have external ip too20:38
*** k_mouza has quit IRC20:38
robellisoni want users to all hit the DMZ api's and internal stuff to hit the contol nodes as normal20:38
inc0https://github.com/openstack/kolla-ansible/blob/master/etc/kolla/globals.yml#L41 this is your user-facing vip20:38
inc0but that's only for haproxy conf20:38
inc0if you have your own LB, that's up to you20:38
inc0our haproxy doesn't bind to 0.0.0.020:39
inc0it always binds to specific IP, so it will create 2 separate endpoints20:39
robellisonyeah ok, i guess i'd need that VIP to be on a different haproxy20:39
inc0one for private IP andother for public20:39
robellisonok, i guess it might just work then20:39
inc0yeah, if your dmz machines has access to both internal and external20:40
robellisonyeah i think that should be ok20:40
inc0you give one for users and another for internal and haproxy will have 2 separate endpoints20:40
robellisonyeah hopefully :)20:40
inc0then fw can make rules depending on endpoint one hits20:40
robellisoncool20:40
robellisonsounds like it might be ok20:41
inc0well if you'll find security loophole in this arch, please do let us know20:41
inc0we try hard to make it secure;)20:41
robellisonit's just glance and cinder with ceph that are the worry at the moment20:41
robellisoni'll let you know what setup i end up with though. it will hopefully be a good example secure reference20:42
*** jascott1 has quit IRC20:42
inc0fwiw ceph has nice auth on it's own20:42
robellisoni've given up with the commercial distros because they are not flexible to be secure20:42
robellisonyeah ceph auth seems good, but network-wise it's pretty open and we cant use firewalls because we need the performance20:42
robellisonso separation of user-facing roles is critical20:43
inc0yeah, we had couple people from orgs like military or investment banking trying kolla around and never heard anything too bad about our security20:43
robellisonyeah we have similar requirements20:43
inc0so if you hit some issues with way we deploy, do let us know20:44
robellisonit's just flexibility i'm after20:44
inc0right20:44
robellisonyeah i will. i'll contribute a reference back20:44
inc0well what I'm saying is we for example never bind to 0.0.0.020:44
inc0little things like that20:44
robellisonit seems good so far20:44
inc0making openstack secure one attack vector at the time;)20:45
robellisonvery well laid out20:45
*** k_mouza has joined #openstack-kolla20:45
*** k_mouza has quit IRC20:45
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Disable destroy_tests.sh as it constantly breaks ironic gate  https://review.openstack.org/48499120:46
sbezverkinc0: how about now? ^^^20:47
inc0+2'd20:47
*** krtaylor has quit IRC20:50
*** Teck7 has joined #openstack-kolla20:53
*** jrist has quit IRC20:54
rwellumsbezverk: is there a bug open on the faulty script - or that not something we are doing for kolla-k8s yet?20:55
sbezverkinc0: thanks20:55
sbezverkrwellum we do not, but I think we should start20:56
sbezverkrwellum if you have cycles, please file a bug20:56
rwellumsbezverk: Yeah sure.20:56
*** rfxn has quit IRC20:57
*** rfxn has joined #openstack-kolla20:58
*** vhosakot has quit IRC20:58
*** vhosakot has joined #openstack-kolla21:00
*** lucasxu has quit IRC21:00
*** Teck7 has quit IRC21:02
*** jtriley has quit IRC21:05
*** stefan_bo has joined #openstack-kolla21:05
*** stefan_bo has quit IRC21:10
rwellumsbezverk: pointer to the broken gate (logs)?21:13
sbezverkrwellum http://logs.openstack.org/05/485905/1/check/gate-kolla-kubernetes-deploy-centos-source-4-ironic-nv/360b62f/console.html.gz#_2017-07-21_01_49_19_53434921:16
*** robellison has quit IRC21:16
*** robellison has joined #openstack-kolla21:17
*** robellison has quit IRC21:17
*** robellison has joined #openstack-kolla21:18
*** robellison has quit IRC21:18
rwellumsbezverk: https://bugs.launchpad.net/kolla-kubernetes/+bug/170828821:18
openstackLaunchpad bug 1708288 in kolla-kubernetes "destroy_tests.sh breaks the Ironic gate" [Undecided,New]21:18
*** robellison has joined #openstack-kolla21:18
sbezverkrwellum thanks a lot!21:18
*** robellison has quit IRC21:19
*** robellison has joined #openstack-kolla21:20
*** robellison has quit IRC21:20
*** jascott1 has joined #openstack-kolla21:21
*** lpetrut has joined #openstack-kolla21:21
*** mgoddard has joined #openstack-kolla21:23
*** jrist has joined #openstack-kolla21:26
rwellumsbezverk: technically I guess, the +2 +w etc shouldn't be given until this PS has passed Jenkins?21:28
sbezverkrwellum right21:28
sbezverkbut jenkins will not let ps merge before passing21:29
rwellumOk fair enough.21:30
*** vhosakot has quit IRC21:47
*** manheim has quit IRC21:51
*** mgoddard has quit IRC21:52
*** jamesbenson has quit IRC21:52
*** jamesbenson has joined #openstack-kolla21:55
*** yangyapeng has joined #openstack-kolla21:58
*** jamesbenson has quit IRC22:00
openstackgerritMerged openstack/kolla-kubernetes master: Disable destroy_tests.sh as it constantly breaks ironic gate  https://review.openstack.org/48499122:02
*** yangyapeng has quit IRC22:03
*** goldyfruit has quit IRC22:04
iniaziwhere is tools/start-registry (on centos 7), from the multinode deployment and deploying a registry22:14
*** lpetrut has quit IRC22:14
*** https_GK1wmSU has joined #openstack-kolla22:17
*** https_GK1wmSU has left #openstack-kolla22:17
*** schwicht has quit IRC22:31
*** emccormick has joined #openstack-kolla22:35
*** goldyfruit has joined #openstack-kolla22:40
*** goldyfruit has quit IRC22:42
*** goldyfruit has joined #openstack-kolla22:46
*** eaguilar has joined #openstack-kolla22:50
*** pbourke has quit IRC22:55
*** jrist has quit IRC22:55
*** schwicht has joined #openstack-kolla22:56
*** pbourke has joined #openstack-kolla22:57
*** yangyapeng has joined #openstack-kolla23:02
*** yangyapeng has quit IRC23:07
*** jascott1 has quit IRC23:07
*** jascott1 has joined #openstack-kolla23:08
*** jascott1 has quit IRC23:10
*** eaguilar has quit IRC23:14
*** eaxiom has quit IRC23:15
*** eaguilar has joined #openstack-kolla23:19
*** itlinux has quit IRC23:20
*** itlinux_ has quit IRC23:20
*** hongbin has quit IRC23:21
*** tonanhngo has quit IRC23:24
*** _mmethot_ has joined #openstack-kolla23:24
*** mmethot_ has quit IRC23:26
*** mmehan has quit IRC23:27
*** schwicht has quit IRC23:28
*** eaguilar has quit IRC23:28
kfox1111rwellum: sbezverk: almost. jenkins will not let a W through for non passing voting jobs.23:35
kfox1111kolla-kubernetes doesn't have many voting jobs yet.23:35
kfox1111so its better to wait for the results before the final workflow.23:35
*** tonanhngo has joined #openstack-kolla23:42
*** goldyfruit has quit IRC23:42
*** jascott1 has joined #openstack-kolla23:42
*** krtaylor has joined #openstack-kolla23:43
*** Pavo has joined #openstack-kolla23:45
*** tonanhngo has quit IRC23:47
*** manheim has joined #openstack-kolla23:52
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Change mode after ceph and neutron log is rotated  https://review.openstack.org/49025423:52
*** Pavo has quit IRC23:53
*** manheim has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!