Friday, 2018-02-02

*** goldyfruit has joined #openstack-kolla00:04
*** Angeh has quit IRC00:04
*** goldyfruit has quit IRC00:14
Jeffrey4lkfox1111, inc0 how about use kubelet static pod in kolla-ansible. lol00:17
kfox1111hi00:17
kfox1111Sean-md: hi00:17
kfox1111Jeffrey4l: I'm only half joking... :)00:17
Jeffrey4lkfox1111, i am serious ;D00:18
kfox1111I have been swithcing out even our standalone boxes to kubelet from docker-compose, so I do get it.00:18
Jeffrey4lkfox1111, then kolla-ansible and kolla-k8s could go togather at the end.00:19
kfox1111its very useful. and with docker alternatives comeing out, even more useful.00:19
kfox1111maybe. or be compliementary.00:19
Jeffrey4lkfox1111, yes. we can use a abstract layer to support docker and kubelet at the same time.00:19
kfox1111kolla-ansible could more easily suppport cri-o/kata-containers with kubelet static pods.00:20
kfox1111as its just a cri driver to kubelet.00:20
Jeffrey4lyes. that is another advantage.00:20
kfox1111so ansible would just drop down static pods and remove them as needed.00:20
kfox1111reboots and the like would just work then.00:20
Sean-mdHi kfox1111. I have committed "https://review.openstack.org/#/c/538854/"00:21
Jeffrey4lkfox1111, yes. i am intrested in this solution.00:21
kfox1111Sean-md: ah. hi.00:21
Jeffrey4lkfox1111, let me put this into the ptg topics.00:21
kfox1111Sean-md: I think everything you are trying to do can already be done without the ps.00:21
Sean-mdIt's difficult to converse with you because of the time difference00:21
kfox1111Jeffrey4l: cool.00:22
kfox1111wish I could be there. :/00:22
kfox1111Sean-md: yeah. I get that.00:22
Jeffrey4lactually, i wish too. but i can not be there ;(00:22
kfox1111Sean-md: so, what can I do to help?00:22
Sean-mdI know, my charts are open to dispute, which is not directly for HA services of kolla-k8s but for HA kubernetes masters.00:22
kfox1111I still don't quite follow the distinction.00:24
Sean-mdActually, I wanted to provide a way to add master replicas to a existing single k8s master using a kolla's VIP variables.00:24
kfox1111we have 3 different components here I think.00:25
kfox1111k8s controller, kolla-k8s controller, and compute node.00:25
kfox1111kolla-k8s's controller pods are the control plane for openstack compute nodes. k8s contorllers are the control plane for kolla-kubernetes.00:26
kfox1111so, the control planes control plane. :)00:26
Sean-mdyes, my charts are just for k8s controller.00:26
kfox1111the haproxy config in the ps looks to be fronting all of the kolla-k8s services.00:26
Sean-mdso, they are not directly related to kolla-k8s. :)00:27
kfox1111but, you can expose all of that through the k8s masters without any more services.00:27
kfox1111you just use a vip hosted on the k8s masters and use that ip as ExternalIP on the openstack services.00:27
Sean-mdI agree with you.00:28
kfox1111so, way the haproxy stuff at all then?00:28
Sean-mdbut when i install kolla-k8s following "https://docs.openstack.org/kolla-kubernetes/latest/deployment-guide.html"00:29
kfox1111its over 1,000 lines of stuff.00:29
Sean-mdall services use master IP to access one another00:29
kfox1111if its just a doc issue, lets fix that.00:30
Sean-mdso, I thought, if HA masters, all services need to use haproxy00:30
kfox1111no, in that case you can run keepalived with the vip and use the vip instead.00:30
kfox1111should work the same otherwise.00:30
kfox1111we added the keepalived chart specifically for that use case.00:31
kfox1111unfortuantely its not documented anywhere yet. :/00:31
*** yangyapeng has quit IRC00:31
kfox1111which is what I think we really need to do.00:31
Sean-mdyou said, "This is incorrect. They use the k8s service discovery mechanism for communication. The config points at the k8s service name. That resolves to the ClusterIP of the service."00:31
kfox1111right.00:31
*** yangyapeng has joined #openstack-kolla00:32
kfox1111so, like, rabbit has a k8s service.00:32
Sean-mdhow can I create configmap which use dns names?00:32
kfox1111things that talk to rabbit do a dns resolve on the k8s service and contact the pod through the k8s service load balancer.00:32
*** masahisa has quit IRC00:32
kfox1111in the dev doc you pointed, search for: orchestration_engine: KUBERNETES00:32
*** masahisa has joined #openstack-kolla00:33
kfox1111that changes the genconfig to generate config that points to k8s service names.00:33
kfox1111like:00:33
Sean-mdactually, I create configmap using "sudo kolla-ansible genconfig"00:33
kfox1111https://github.com/openstack/kolla-kubernetes/blob/master/ansible/roles/cinder/templates/cinder.conf.j2#L2100:34
kfox1111don't. kolla-kubernetes genconfig has diverged a bit from kolla-ansible's.00:34
kfox1111if you look at L21 there, see the dns name is hardcoded to the k8s service name.00:34
kfox1111kolla-ansible kept breaking kolla-kubernetes's config. so we forked it temporarily.00:35
Sean-mdI follow your drift.00:36
*** yangyapeng has quit IRC00:36
Sean-mdThank you for your advice. :)00:37
Sean-mddoc needs correction00:37
kfox1111yeah. the docs are incomplete and somewhat inaccurate I think. :(00:38
Sean-mdcan I ask another issue?00:38
kfox1111if you hit anything wrong in the docs, please do submit a ps for it.00:38
kfox1111sure.00:38
Sean-mdWhen I deploy mariadb using charts in the doc.00:39
Sean-mdkeyston-paste.ini dosen't exist in configmap of mariadb.00:40
Sean-mdand I found that the file is only kolla-kubernetes00:40
kfox1111i wouldn't think mariadb would need keystone-paste.ini?00:40
Sean-mdbut configmaps are created using kolla-ansible.00:41
kfox1111inc0: can you please update the developer docs with the kolla-kubernetes version of the genconfig command?00:41
*** daidv has quit IRC00:43
*** daidv has joined #openstack-kolla00:43
Sean-mdyou are right, dns names are defined in orchestration_engine: KUBERNETES00:44
kfox1111yeah. now that the templates are in the kolla-kubernetes, we probably should always just set that.00:44
kfox1111change the defaults I mean.00:45
Sean-mdbut I think they are not in use when creating configmaps..00:45
Sean-mdThanks, and I want to help correct kolla-kubernetes to the best of my ability00:47
kfox1111yeah. I appreciate that.00:47
kfox1111ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml00:48
kfox1111ls -la /etc/kolla00:48
kfox1111that seems to be the right replacement for the genconfig command.00:49
Sean-mdOh, I see. Let me check..00:50
*** duonghq has joined #openstack-kolla00:51
kfox1111oh, in fact, looks like the default, orchestration_engine: "KUBERNETES"00:52
kfox1111is already in the kolla-kubernetes repo00:52
*** tovin07_ has joined #openstack-kolla00:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Update doc to use the right genconfig.  https://review.openstack.org/54019600:55
kfox1111Sean-md: can you try --^ and if it works, we'll get it merged asap.00:55
Sean-md"[WARNING]: provided hosts list is empty, only localhost is available"00:56
Sean-mdskipping: no hosts matched00:56
Sean-mdI can't generate files...00:57
kfox1111are you in the kolla-kubernetes directory?00:57
Sean-mdno /root/kolla-bringup/kolla-ansible00:58
Sean-mdsorry00:58
Sean-mdIt's all very well :)01:00
kfox1111oh good. :)01:00
Sean-mdThank you!!01:00
kfox1111np. sorry the docs lead you down the wrong path. :(01:00
kfox1111that part of the code is kind of in flux so it is a little rough. :(01:00
*** zhaochao has joined #openstack-kolla01:01
Sean-mdI am Ok.  I always appreciate your support. :)01:02
kfox1111ok. cool. please ping me again if you hit another road block.01:04
Sean-mdand I should have discuss with you, before pushing codes.01:04
Sean-mdOk! :)01:05
*** liuzz has joined #openstack-kolla01:14
*** liuzz_ has quit IRC01:14
*** pengdake_ has joined #openstack-kolla01:16
*** clayton has quit IRC01:22
*** zhurong has joined #openstack-kolla01:23
*** clayton has joined #openstack-kolla01:25
*** yangyapeng has joined #openstack-kolla01:26
*** zhangfei has joined #openstack-kolla01:39
*** masahisa_ has joined #openstack-kolla01:40
*** masahisa has quit IRC01:41
*** masahisa_ has quit IRC01:42
*** masahisa has joined #openstack-kolla01:42
*** dave-mccowan has joined #openstack-kolla01:42
openstackgerritQi Peng proposed openstack/kolla-ansible master: Update task about selinux set.  https://review.openstack.org/53983501:47
*** salv-orlando has joined #openstack-kolla01:50
*** dardelean has joined #openstack-kolla01:51
*** salv-orlando has quit IRC01:55
*** dardelean has quit IRC01:55
*** junboli has joined #openstack-kolla02:02
*** goldyfruit has joined #openstack-kolla02:19
*** goldyfruit has quit IRC02:19
*** goldyfruit has joined #openstack-kolla02:19
*** goldyfruit has quit IRC02:20
*** chmarkus has quit IRC02:48
*** chmarkus has joined #openstack-kolla02:48
*** derekjhyang has joined #openstack-kolla02:50
*** hongbin has joined #openstack-kolla02:56
*** liuzz has quit IRC03:06
*** zhurong has quit IRC03:24
*** zhurong has joined #openstack-kolla03:26
*** kolla-slack has quit IRC03:31
*** kolla-slack has joined #openstack-kolla03:31
*** pengdake_ has quit IRC03:33
*** pengdake_ has joined #openstack-kolla03:35
*** janki has joined #openstack-kolla03:38
*** dave-mccowan has quit IRC03:39
*** unicell has quit IRC03:39
*** salv-orlando has joined #openstack-kolla03:51
*** salv-orlando has quit IRC03:55
*** pengdake_ has quit IRC03:59
*** _jbadiapa has quit IRC04:08
openstackgerritMerged openstack/kolla-ansible master: XenAPI: support ceilometer service  https://review.openstack.org/53683804:09
*** harlowja_ has quit IRC04:09
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [DNM]optimise the post jobs  https://review.openstack.org/54024504:18
*** unicell has joined #openstack-kolla04:26
*** unicell has quit IRC04:26
*** masahisa_ has joined #openstack-kolla04:30
*** masahisa has quit IRC04:31
*** lpetrut has joined #openstack-kolla04:34
*** devananda has quit IRC04:38
*** goldyfruit has joined #openstack-kolla04:42
*** jbadiapa has joined #openstack-kolla04:50
*** lpetrut has quit IRC04:55
*** harlowja has joined #openstack-kolla04:56
*** zhurong has quit IRC04:56
*** pengdake_ has joined #openstack-kolla04:59
*** hongbin has quit IRC05:00
*** lpetrut has joined #openstack-kolla05:04
*** janki has quit IRC05:14
*** lpetrut has quit IRC05:17
*** masahisa has joined #openstack-kolla05:20
*** masahisa_ has quit IRC05:21
*** derekjhyang has quit IRC05:23
*** derekjhyang has joined #openstack-kolla05:23
*** pengdake_ has quit IRC05:24
*** yangyapeng has quit IRC05:25
*** pengdake_ has joined #openstack-kolla05:28
*** mdnadeem has joined #openstack-kolla05:34
*** janki has joined #openstack-kolla05:43
*** k_mouza has joined #openstack-kolla05:47
*** k_mouza has quit IRC05:52
*** salv-orlando has joined #openstack-kolla05:52
*** xinliang has quit IRC05:52
*** lpetrut has joined #openstack-kolla05:55
*** salv-orlando has quit IRC05:56
*** zhangfei has quit IRC05:59
*** yangyapeng has joined #openstack-kolla06:00
*** xinliang has joined #openstack-kolla06:04
*** lpetrut has quit IRC06:07
*** goldyfruit has quit IRC06:09
*** zhurong has joined #openstack-kolla06:15
*** pengdake has joined #openstack-kolla06:21
*** pengdake_ has quit IRC06:23
*** unicell has joined #openstack-kolla06:31
*** mnasiadka has joined #openstack-kolla06:32
*** unicell1 has joined #openstack-kolla06:47
*** unicell has quit IRC06:49
*** lpetrut has joined #openstack-kolla06:54
*** olivierbourdon38 has quit IRC06:56
*** threestrands has quit IRC07:05
*** egonzalez has joined #openstack-kolla07:07
*** imcsk8 has quit IRC07:10
*** imcsk8 has joined #openstack-kolla07:17
openstackgerritMerged openstack/kolla-ansible stable/ocata: Make kollda_docker works with new released python docker 3.0 package  https://review.openstack.org/54012407:25
*** olivierbourdon38 has joined #openstack-kolla07:30
*** gfidente has joined #openstack-kolla07:31
*** olivierbourdon38 has quit IRC07:32
*** cah_link has joined #openstack-kolla07:37
*** b_bezak has joined #openstack-kolla07:43
*** salv-orlando has joined #openstack-kolla07:43
*** zhenguo has joined #openstack-kolla07:59
*** gfidente is now known as gfidente|not08:03
*** gfidente has joined #openstack-kolla08:06
*** gfidente has quit IRC08:06
*** gfidente has joined #openstack-kolla08:06
*** vabada2 has joined #openstack-kolla08:06
*** vabada2 has quit IRC08:06
*** vabada has quit IRC08:06
*** vabada has joined #openstack-kolla08:07
*** pcaruana has joined #openstack-kolla08:09
*** tom221 has joined #openstack-kolla08:18
*** dasTor has joined #openstack-kolla08:31
*** tom221 has quit IRC08:33
*** masahisa has quit IRC08:36
*** yangyapeng has quit IRC08:55
*** yangyapeng has joined #openstack-kolla08:55
*** mgoddard_ has joined #openstack-kolla09:03
*** athomas has joined #openstack-kolla09:03
*** k_mouza has joined #openstack-kolla09:08
*** ktibi has joined #openstack-kolla09:09
*** ktibi has quit IRC09:10
*** ktibi has joined #openstack-kolla09:10
*** dtk__ has joined #openstack-kolla09:10
*** dtk__ has quit IRC09:11
*** goldyfruit has joined #openstack-kolla09:12
*** goldyfruit has quit IRC09:12
*** mandre is now known as mandre_afk09:18
*** junboli has quit IRC09:34
*** jmccarthy has joined #openstack-kolla09:34
*** duonghq has quit IRC09:37
*** dardelean has joined #openstack-kolla09:49
*** dardelean has quit IRC09:50
*** dardelean has joined #openstack-kolla09:51
ktibihi kolla, what is the min version of ansible for Q ?09:51
ktibi2.2 ?09:52
*** yangyapeng has quit IRC09:55
openstackgerritQi Peng proposed openstack/kolla-ansible master: Update task about selinux set.  https://review.openstack.org/53983509:57
*** tovin07_ has quit IRC10:02
*** lpetrut_ has joined #openstack-kolla10:03
*** bjolo has quit IRC10:03
dardeleanlet me check ktibi10:04
*** lpetrut has quit IRC10:05
dardeleanyou have ubuntu or centos?10:07
dardeleanyour safest bet would be this 'pip install -U ansible'10:07
dardeleanhttps://docs.openstack.org/kolla-ansible/latest/user/quickstart.html10:08
dardeleanhere are some infos about ansible versions10:08
*** ktibi has quit IRC10:11
*** hieulq_ has quit IRC10:13
*** ktibi has joined #openstack-kolla10:20
*** pengdake has quit IRC10:21
ktibidardelean, I use centos, for pike it's ansible >=2.2.010:21
ktibiinc0 remove the table https://github.com/openstack/kolla-ansible/commit/742960aa59dba6ad7725d5643785ebb4a98c6d91#diff-b9d4f960b5c71310b496a14b81a6eaedL8410:23
*** dardelean has quit IRC10:24
*** shardy has joined #openstack-kolla10:27
*** tone_zrt has quit IRC10:28
*** zhurong has quit IRC10:32
*** olivierbourdon38 has joined #openstack-kolla10:39
*** pbourke has quit IRC10:49
*** pbourke has joined #openstack-kolla10:51
openstackgerritChandan Kumar proposed openstack/kolla master: Bundle tempest plugins in tempest container  https://review.openstack.org/53780710:51
kolla-slack<aslancimbom100> anyone using ceph-ansible with kolla and hit "PermissionDeniedError: error connecting to the cluster" on nova-compute?10:52
chandankumaregonzalez: ^^ updated the patch10:52
*** xinliang has quit IRC10:56
*** dardelean has joined #openstack-kolla10:56
*** daidv has quit IRC10:58
*** dardelean has quit IRC11:01
*** egonzalez has quit IRC11:19
*** xinliang has joined #openstack-kolla11:30
*** sambett|afk is now known as sambetts11:41
*** kbyrne has quit IRC11:43
*** kbyrne has joined #openstack-kolla11:46
*** kbaegis has joined #openstack-kolla11:47
*** pengdake has joined #openstack-kolla11:48
*** dardelean has joined #openstack-kolla11:52
*** pengdake has quit IRC11:55
*** pcaruana has quit IRC12:04
*** dave-mccowan has joined #openstack-kolla12:16
*** pcaruana has joined #openstack-kolla12:23
*** dardelean has quit IRC12:26
openstackgerritDaniel proposed openstack/kolla stable/pike: Remove insecure registry setting from docker > 3.0.0  https://review.openstack.org/54036112:29
dasTori'm stupid, all patches against master, right?12:30
*** masahisa has joined #openstack-kolla12:31
*** k_mouza has quit IRC12:33
*** kbaegis has quit IRC12:33
*** rhallisey has joined #openstack-kolla12:34
*** dardelean has joined #openstack-kolla12:35
*** k_mouza has joined #openstack-kolla12:35
*** dardelean has quit IRC12:36
*** dardelean has joined #openstack-kolla12:36
openstackgerritDaniel proposed openstack/kolla master: Remove insecure registry setting from docker push  https://review.openstack.org/54036412:37
*** lpetrut__ has joined #openstack-kolla12:37
*** lpetrut_ has quit IRC12:40
*** yangyapeng has joined #openstack-kolla12:42
*** gfidente has quit IRC12:53
*** gfidente|not is now known as gfidene12:54
*** gfidene is now known as gfidenyr12:54
*** gfidenyr is now known as gfidente12:54
*** bjolo has joined #openstack-kolla12:55
*** k_mouza has quit IRC12:58
*** k_mouza has joined #openstack-kolla12:59
*** janki has quit IRC13:15
*** Angeh has joined #openstack-kolla13:22
*** salv-orlando has quit IRC13:37
*** salv-orlando has joined #openstack-kolla13:38
*** salv-orlando has quit IRC13:42
*** masahisa has quit IRC13:44
*** pcaruana has quit IRC13:46
*** k_mouza has quit IRC13:49
*** k_mouza has joined #openstack-kolla13:52
*** goldyfruit has joined #openstack-kolla13:57
*** k_mouza has quit IRC14:00
*** pcaruana has joined #openstack-kolla14:06
*** k_mouza has joined #openstack-kolla14:08
*** Jezekus has joined #openstack-kolla14:15
JezekusHello all,14:19
Jezekusis there someone running kolla-ansible with separated internal and external APIs with different interfaces and different IP ranges?14:19
Jezekuswe have a trouble that rabbitmq won't export the 5672 port from the docker container and even a management port of rabbitmq is not working. strange thing is rabbitmq container staying up without restarts14:25
*** k_mouza has quit IRC14:30
*** k_mouza has joined #openstack-kolla14:31
openstackgerritDaniel proposed openstack/kolla master: Remove insecure registry setting from docker push  https://review.openstack.org/54036414:31
openstackgerritDaniel proposed openstack/kolla master: implemented changes proposed by Mark Goddard  https://review.openstack.org/54039914:31
*** k_mouza has quit IRC14:31
*** k_mouza has joined #openstack-kolla14:32
*** salv-orlando has joined #openstack-kolla14:39
jmccarthyAre there gates that run for the pike release ? If so, where are they ? I'm wondering if the latest pike images are kosher14:39
dasTormgoddard, do you have a moment? launchpad drives me kind of crazy14:40
*** salv-orlando has quit IRC14:43
*** dardelean has quit IRC14:44
*** dardelean has joined #openstack-kolla14:45
pbourkejmccarthy: there are14:45
*** masahisa has joined #openstack-kolla14:48
*** dardelean has quit IRC14:49
*** b_bezak_ has joined #openstack-kolla14:50
*** zhaochao has quit IRC14:50
*** kristian__ has joined #openstack-kolla14:51
*** kristian__ has quit IRC14:51
openstackgerritDaniel proposed openstack/kolla master: Remove insecure registry setting from docker push  https://review.openstack.org/54036414:52
*** b_bezak has quit IRC14:52
*** masahisa has quit IRC14:53
jmccarthypbourke: Are they green ? :)14:55
*** mdnadeem has quit IRC14:56
*** iclon has quit IRC14:56
*** dardelean has joined #openstack-kolla14:57
*** david-lyle has quit IRC15:01
jmccarthyWell I suppose the daily images wouldn't get pushed up to dockerhub unless everything passed ok ..15:03
openstackgerritDaniel proposed openstack/kolla master: Remove insecure registry setting from docker push  https://review.openstack.org/54036415:07
*** salv-orlando has joined #openstack-kolla15:09
*** Jezekus has quit IRC15:10
*** iclon has joined #openstack-kolla15:11
inc0good morning15:13
*** pcaruana has quit IRC15:13
*** pcaruana has joined #openstack-kolla15:14
*** david-lyle has joined #openstack-kolla15:15
dardeleanhei inc015:17
dardeleanhow's going?15:17
inc0slowly waking up15:17
dardeleanhah, that's how I'm after fisstech15:18
inc0lol15:18
*** kbaegis has joined #openstack-kolla15:18
inc0afair it's supposed to make you more active15:19
inc0but I've read these books long ago15:19
dardeleanhah15:19
*** livelace-link has joined #openstack-kolla15:23
*** livelace-link has quit IRC15:26
*** livelace-link has joined #openstack-kolla15:28
pbourkeim quite liking ceph-ansible15:28
*** kbaegis has quit IRC15:28
inc0pbourke: yeah it seems good15:28
pbourkethere seems to be a few rough edges but that could be user error at this point15:29
inc0ceph-deploy is also quite cool15:30
inc0pbourke: since you're around, mind reviewing https://review.openstack.org/#/c/540125/ ?15:30
inc0pike is no worky without it15:31
pbourkekollda15:31
inc0yeah I've noticed it after we merged master15:31
pbourkeno big deal :)15:32
inc0yeah, much bigger deal is "no worky" part;)15:32
pbourkeI think we can learn a thing or two from ceph-ansible even if we dont end up using it15:32
pbourkee.g. I see they're using systemd to control the containers15:32
inc0well I'd love to start using it tbh15:32
inc0so on that note, one interesting experiment we could do is to edit kolla_docker module in a way that it can support cri-o15:33
inc0I think this would be only requirement for kolla-ansible to start just magically work on different contaienr runtimes15:33
dasTorinc0, for docker 3.0 this should also be reviewed: https://review.openstack.org/#/c/540364/15:34
dasTori ran into that issue yesterday15:34
jmccarthyinc0: 'pike is no worky without it', does this mean pike images on dockerhub no worky right now ?15:34
inc0we could rename kolla_docker to kolla_container and have pluggable runtimes15:34
inc0jmccarthy: no, that means if you'd run pip install kolla-ansible today deployment would fail15:34
inc0images are fine, interface between ansible->docker is not15:35
jmccarthyinc0: yes, that is the boat I'm in15:35
inc0if you are, just run this:15:35
*** Jezekus has joined #openstack-kolla15:35
inc0ansible -m shell -i << your inv >> -a "pip install --upgrade docker=2.*" all15:35
jmccarthyinc0: My bad - I assumed the issue was something to do with images15:35
inc0no, images are fine15:36
ktibiinc0 hi, do you know if ansible > 2.2.0 is always the requierments for kolla Q release ?15:36
jmccarthyinc0: ty - I will try that !15:36
inc0python docker module changed it's API and broke our ansible module15:36
inc0ktibi: it might be...15:36
pbourkeinc0: what's the main benefit of using other container formats15:37
inc0I can't think of any 2.2+ feature we use from top of my head, but that doesn't mean it's not there15:37
pbourkeas opposed to docker15:37
inc0pbourke: well docker broke us multiple times already15:37
inc0that's why we pin to 1.1215:37
inc0but it's not sustainable15:37
inc0that's one of potential reasons, another one would be vendor lockin15:38
inc0lock-in15:38
pbourkeI thought that pin had been removed a long time ago15:38
inc0k8s seems to be moving towards cri-o15:38
inc0pbourke: nope, our bootstrap-servers and gates pin to 1.1215:38
inc0not because there is some change that needs to be made, because new releases of docker were notorious'15:39
inc0to break stuff15:39
openstackgerritMerged openstack/kolla-ansible stable/pike: Make kollda_docker works with new released python docker 3.0 package  https://review.openstack.org/54012515:40
*** lpetrut__ has quit IRC15:43
*** lucasxu has joined #openstack-kolla15:43
jmccarthyinc0: I get: Invalid requirement: 'docker=2.*15:44
inc0try ==2.*15:44
inc0two =15:44
*** lucasxu has quit IRC15:44
jmccarthyoh lol yea was about to say15:45
jmccarthynevermind =]15:45
jmccarthyinc0: How did you discover that ? I was checking bootstrap logs etc but couldn't find a hint15:46
inc0not sure, Jeffrey4l found it15:46
*** owalsh_ has joined #openstack-kolla15:50
*** mdnadeem has joined #openstack-kolla15:51
*** owalsh- has joined #openstack-kolla15:52
*** owalsh has quit IRC15:52
*** owalsh_ has quit IRC15:54
*** owalsh has joined #openstack-kolla15:55
*** owalsh_ has joined #openstack-kolla15:58
*** owalsh- has quit IRC15:58
*** salv-orlando has quit IRC15:59
jmccarthyinc0: Thanks for that ! It's way past where it was failing earlier, so I think the deploy will finish now15:59
*** salv-orlando has joined #openstack-kolla15:59
*** cah_link has quit IRC16:00
*** dardelean has quit IRC16:00
*** owalsh has quit IRC16:01
*** dardelean has joined #openstack-kolla16:01
*** salv-orlando has quit IRC16:01
*** salv-orlando has joined #openstack-kolla16:01
*** dardelean has quit IRC16:05
*** dardelean has joined #openstack-kolla16:08
*** olivierbourdon38 has quit IRC16:10
*** pcaruana has quit IRC16:11
*** dmellado has quit IRC16:11
*** mdnadeem has quit IRC16:11
*** b_bezak_ has quit IRC16:12
*** b_bezak has joined #openstack-kolla16:13
*** dmellado has joined #openstack-kolla16:14
*** owalsh_ is now known as owalsh16:14
*** livelace-link has quit IRC16:15
*** yangyapeng has quit IRC16:15
*** livelace-link has joined #openstack-kolla16:16
*** yangyapeng has joined #openstack-kolla16:16
inc0jmccarthy: cool16:16
*** livelace-link has quit IRC16:17
*** b_bezak has quit IRC16:17
*** b_bezak has joined #openstack-kolla16:18
*** b_bezak has quit IRC16:18
*** b_bezak has joined #openstack-kolla16:19
*** yangyapeng has quit IRC16:20
*** mnasiadka has quit IRC16:21
*** b_bezak has quit IRC16:23
*** yangyapeng has joined #openstack-kolla16:30
*** mnasiadka has joined #openstack-kolla16:32
*** mnasiadka has quit IRC16:37
*** mnasiadka has joined #openstack-kolla16:47
*** devananda has joined #openstack-kolla16:50
*** mnasiadka has quit IRC16:52
*** pbourke has quit IRC16:56
*** pbourke has joined #openstack-kolla16:57
*** dtk has joined #openstack-kolla16:58
*** dtk has quit IRC16:58
*** mnasiadka has joined #openstack-kolla17:02
*** mnasiadka has quit IRC17:06
*** M4g1c5t0rM has joined #openstack-kolla17:09
*** M4g1c5t0rM has quit IRC17:10
*** M4g1c5t0rM has joined #openstack-kolla17:10
*** jtriley has joined #openstack-kolla17:12
*** M4g1c5t0rM has quit IRC17:12
*** M4g1c5t0rM has joined #openstack-kolla17:13
*** athomas has quit IRC17:16
*** mnasiadka has joined #openstack-kolla17:17
*** dardelean has quit IRC17:18
*** dardelean has joined #openstack-kolla17:19
*** mnasiadka has quit IRC17:22
*** jmccarthy has left #openstack-kolla17:22
*** jtriley has quit IRC17:23
*** dasTor has quit IRC17:23
*** dardelean has quit IRC17:23
*** dasTor has joined #openstack-kolla17:23
*** jtriley has joined #openstack-kolla17:24
*** lpetrut has joined #openstack-kolla17:27
*** jtriley has quit IRC17:30
*** mnasiadka has joined #openstack-kolla17:32
*** dmellado has quit IRC17:34
*** mnasiadka has quit IRC17:37
*** harlowja has quit IRC17:37
*** mnasiadka has joined #openstack-kolla17:37
*** sambetts is now known as sambetts|afk17:40
*** k_mouza has quit IRC17:42
*** Jezekus has quit IRC17:50
*** mnasiadka has quit IRC17:50
ktibihi, with drv enable, compute node must be access to external network ?17:58
*** mgoddard_ has quit IRC17:59
*** jtriley has joined #openstack-kolla18:05
*** jaosorior has quit IRC18:07
*** lpetrut has quit IRC18:11
*** gfidente has quit IRC18:11
*** spsurya has quit IRC18:12
inc0ktibi: yes18:14
inc0dvr means that floating IPs are terminated on compute nodes18:14
ktibiok so ha agent is the best way for ha on router without add public network to compute18:14
inc0yeah18:14
*** dklyle has joined #openstack-kolla18:16
ktibiinc0 but with HA, kolla deploy dhcp agent on compute ?18:18
*** unicell1 has quit IRC18:18
inc0negative18:18
inc0both dhcp and l3 agents by default land on [network] nodes18:18
ktibispecial option in kolla to add dhcp agent on compute ?18:18
inc0you can do it in inventory, but why?18:19
ktibithe reference for VRRP is https://docs.openstack.org/neutron/pike/admin/deploy-ovs-ha-vrrp.html#deploy-ovs-ha-vrrp18:19
inc0just add more than one node in network group and that's going to be HA18:20
inc0vrrp included18:20
ktibithe DHCP is on compute18:20
*** jbadiapa has quit IRC18:20
ktibiwithout l3 ha option ?18:20
inc0well, we don't do it this way and I really don't understand resoning18:21
*** harlowja has joined #openstack-kolla18:21
inc0DHCP is different agent than l3 agent18:21
ktibinot clear sorry18:21
inc0also, vrrp is l3 agent thing not dhcp18:21
ktibiadd more than one node in network without ha_l3_agent add VRRP ?18:21
ktibiI can see vrp is enable if option is true https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/neutron/templates/l3_agent.ini.j2#L1518:22
*** dasTor_ has joined #openstack-kolla18:22
inc0well we have keepalived on network nodes done separately tho18:23
inc0funny, for some reason I thought we enable l3 ha by default, I guess I was wrong18:24
ktibihttps://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L44918:25
dasTor_hi all, again18:27
ktibiinc0 ok now with l3 ha enable, my router have 3 interface :)18:28
dasTor_is there no docker version, when testing in kolla and not kolla-ansible? because all my kolla-ansible tasks are failing18:28
dasTor_or am i not seeing something very obvious?18:29
inc0dasTor_: this might be due to yesterdays release of docker (python package)18:29
inc0if you're running master, get fresh code, it should be fixed in master already18:29
inc0stable branches - run pip install --upgrade docker==2.* on all your nodes18:29
dasTor_i mean this review: https://review.openstack.org/#/c/540364/18:29
inc0oh fun18:30
inc0I missed that18:30
inc0well...gates still fail18:30
dasTor_i am not very sure where my mistake lies, sorry18:31
*** jtriley has quit IRC18:31
inc0check Mark's comments18:34
inc0also it doesn't seem to be working - pushing to insecure registry has to work18:34
*** dmellado has joined #openstack-kolla18:35
dasTor_it does with docker below 3.0, cause 3.0 doesn't recognize the argument anymore18:36
inc0yes, but gates install docker 318:36
inc0so we need to figure out how to push to insecure registry with docker 3+18:37
inc0or hard pin to 2.x if it's not possible (would be bad)18:37
dasTor_they removed it from docker, i can search for the commit18:37
inc0so you're saying you can't use insecure registry with docker 3.0?18:38
inc0at all?18:38
dasTor_https://github.com/docker/docker-py/commit/b180b8770a265e33099bd6da76c3e556a102849118:38
inc0sooo...no way ot push to insecure registry with docker-py?18:40
dasTor_i am still searching for a way, but there doesn't seem to be any obvious fix18:40
*** yangyape_ has joined #openstack-kolla18:41
inc0damn it18:41
*** yangyapeng has quit IRC18:45
sean-k-mooneythats a pain in the ass18:45
inc0yeah18:46
sean-k-mooneysound like we need to swap to generating registry passwords and figure out how to use secure registires18:46
dasTor_so yes, it gave a deprecated warning before and now they removed it18:46
inc0well we can't just screw insecure registry people18:46
inc0I'd rather pin to 2.718:47
dasTor_no, please not - is pinning no option?18:47
*** unicell has joined #openstack-kolla18:47
sean-k-mooneypinning for queens makes sense but it will have to be fixed in rocky18:47
inc0pinning is bad for long term, but I'd say let's do it18:47
inc0on both kolla-ansible and kolla18:47
sean-k-mooneydasTor_: how does the client check for insecure registries. is it just checking for ssl or is it checking for password auth?18:49
sean-k-mooneyi think its just ssl right18:49
*** sbezverk has joined #openstack-kolla18:49
dasTor_it's just ssl, but i#ll search for it18:49
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Pin docker-py to 2.x  https://review.openstack.org/54048718:50
sean-k-mooneydasTor_: well we can use the private cert generation code we already have to generate certs when we deploy a registry in the gate.18:52
dasTor_so yes, if the registry uses tls, it's considered secure18:53
*** jtriley has joined #openstack-kolla18:55
sean-k-mooneyfor multinode users in a dev environment private certs would be fine. for production if they are useing our scripts to create the registry perhaps letsencrypt support could be added18:55
dasTor_i will test it and submit a new patch for a secure registry, i really hope the documentation isn't as bad as usual with docker18:55
sean-k-mooneyletsencrypt would be a cool feature all by its self.18:55
dasTor_sean-k-mooney, docker also recommends let's encrypt18:55
sean-k-mooneyya but lest encrypt wont work behind corpreate firwalls so we also need a priveate cert option or bring your own cert option18:56
dasTor_that's true18:57
sean-k-mooneyif there was a way to use lets encrypts via a proxy i would love to add it to our haproxy container for external tls.18:58
*** jtriley has quit IRC19:00
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Pin docker-py to 2.x  https://review.openstack.org/54048719:00
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla master: Pin docker-py to 2.x  https://review.openstack.org/54049119:01
sean-k-mooneyinc0: by the way has anyone reported issue with vitual interface creation failure in nova with stable pike on centos19:01
inc0can't think of anything from top of my mind19:02
sean-k-mooneythats annoying i did a deploy of stable pike form the docker hub about 3 weeks ago and i cant stabley boot vms19:03
*** jtriley has joined #openstack-kolla19:04
sean-k-mooneyif i restart all the nova and neutorn contianers it works for a short time but then i get boot failure in nova because it fails to allocate the netwroks for the vms19:04
inc0that's annoying19:06
inc0no idea19:06
sean-k-mooneythe only nova bug i have found related to this are form like 3 or 4 cycles ago. not that im blaming centos or anything but going with centos has been a pain.19:08
sean-k-mooneyi also noticed another issue by the way. i think we have a race between the ovs neutron agent, ovs db and ovs vsiwtchd. depending on the order of startup sometimes the ovsdb socket gets replaced with a directory19:09
sean-k-mooneyim guessing it happens if the neutron agent or vswitchd happens to start before the ovsdb but its bizzar19:10
sean-k-mooneyinc0: anyway thank im going to head off. enjoy your weekend19:11
inc0you too man19:11
*** jtriley has quit IRC19:13
dasTor_i'm off for today, have a nice weekend guys19:39
*** dasTor_ has quit IRC19:39
*** jtriley has joined #openstack-kolla19:40
*** imcsk8 has quit IRC19:45
*** imcsk8 has joined #openstack-kolla19:48
*** lpetrut has joined #openstack-kolla19:57
*** dciabrin_ has quit IRC20:01
*** Angeh has quit IRC20:01
*** iclon has quit IRC20:02
*** jtriley has quit IRC20:02
hogepodgeI was wondering, with Octavia, is there any work being done to automatically generate the required certs?20:03
*** dciabrin has joined #openstack-kolla20:04
*** unicell has quit IRC20:07
*** unicell has joined #openstack-kolla20:08
*** david-lyle_ has joined #openstack-kolla20:11
*** dklyle has quit IRC20:11
*** david-lyle_ is now known as dklyle20:11
sean-k-mooneyhogepodge: i used the scripts from the octavia repo when i deployed it but not in kolla-ansible as far as i know20:12
*** iclon has joined #openstack-kolla20:13
hogepodgesean-k-mooney: do I put the certs into kolla deploy node?20:17
hogepodgeand have them pushed out by kolla-ansible?20:17
hogepodgelbaasv2 has some nasty race conditions and resource deadlocks that octavia fixed20:18
*** owalsh_ has joined #openstack-kolla20:18
sean-k-mooneyyes20:18
sean-k-mooney[sean@silpixa00385139 ~]$ ls /etc/kolla/config/octavia/20:18
sean-k-mooneyca_01.pem  cakey.pem  client.pem20:18
hogepodgecool, thanks :-)20:18
sean-k-mooneythat need to be documented in the kolla-ansible docs better20:19
*** owalsh has quit IRC20:21
*** owalsh has joined #openstack-kolla20:23
*** semoac has quit IRC20:24
*** owalsh_ has quit IRC20:26
*** salv-orlando has quit IRC20:28
*** salv-orlando has joined #openstack-kolla20:28
*** jtriley has joined #openstack-kolla20:29
*** salv-orlando has quit IRC20:33
*** jtriley has quit IRC20:34
*** jtriley has joined #openstack-kolla20:36
*** jtriley has quit IRC20:42
*** jtriley has joined #openstack-kolla20:48
*** dardelean has joined #openstack-kolla20:52
*** jtriley has quit IRC20:55
*** dardelean has quit IRC20:56
*** sean-k-mooney has quit IRC20:56
*** mchlumsky has quit IRC20:58
*** mchlumsky has joined #openstack-kolla21:03
*** dave-mccowan has quit IRC21:04
*** dtk has joined #openstack-kolla21:11
*** dtk_ has joined #openstack-kolla21:14
*** dtk has quit IRC21:14
*** dtk_ has quit IRC21:15
*** dave-mccowan has joined #openstack-kolla21:18
*** dave-mccowan has quit IRC21:24
*** lpetrut has quit IRC21:26
*** jtriley has joined #openstack-kolla21:27
*** salv-orlando has joined #openstack-kolla21:29
*** owalsh has quit IRC21:32
*** owalsh has joined #openstack-kolla21:33
*** salv-orlando has quit IRC21:33
*** jtriley has quit IRC21:42
*** jbadiapa has joined #openstack-kolla21:46
*** dave-mccowan has joined #openstack-kolla21:51
*** owalsh has quit IRC21:52
*** owalsh has joined #openstack-kolla21:53
*** dave-mccowan has quit IRC22:03
*** itlinux has joined #openstack-kolla22:08
*** bmace_ has quit IRC22:19
*** bmace_ has joined #openstack-kolla22:19
*** salv-orlando has joined #openstack-kolla22:31
*** ktibi has quit IRC22:35
*** salv-orlando has quit IRC22:36
*** itlinux has quit IRC22:41
*** mchlumsky has quit IRC23:00
*** shardy has quit IRC23:30
*** shardy has joined #openstack-kolla23:30
*** salv-orlando has joined #openstack-kolla23:37
*** pengdake has joined #openstack-kolla23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!