| *** manheim has joined #openstack-kolla | 00:08 | |
| *** manheim has quit IRC | 00:12 | |
| *** caoyuan has joined #openstack-kolla | 00:18 | |
| *** caoyuan has quit IRC | 00:33 | |
| *** tovin07_ has joined #openstack-kolla | 00:33 | |
| *** mdnadeem has joined #openstack-kolla | 00:45 | |
| *** duonghq has joined #openstack-kolla | 00:55 | |
| duonghq | morning guys | 01:00 |
|---|---|---|
| *** ducttape_ has joined #openstack-kolla | 01:03 | |
| *** ducttape_ has quit IRC | 01:07 | |
| daidv__ | morning duonghq ;) | 01:17 |
| *** zhurong has joined #openstack-kolla | 01:20 | |
| *** zhurong has quit IRC | 01:23 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Remove ceilometer-api and ceilometer-collector services https://review.openstack.org/470752 | 01:24 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware DVS support to kolla-ansible https://review.openstack.org/459270 | 01:25 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware DVS support to kolla-ansible https://review.openstack.org/459270 | 01:31 |
| *** caowei has joined #openstack-kolla | 01:31 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER https://review.openstack.org/475670 | 01:33 |
| *** sbezverk has quit IRC | 01:42 | |
| *** kevzha01 has joined #openstack-kolla | 01:47 | |
| *** kevzha01 is now known as kevinz | 01:47 | |
| *** caoyuan has joined #openstack-kolla | 01:48 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Switch from oslosphinx to openstackdocstheme https://review.openstack.org/483726 | 01:57 |
| *** itlinux has quit IRC | 02:00 | |
| *** itlinux_ has quit IRC | 02:00 | |
| *** mdnadeem has quit IRC | 02:01 | |
| *** tovin07__ has joined #openstack-kolla | 02:04 | |
| *** tovin07_ has quit IRC | 02:06 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Fix wsgi file path and log-file parameter https://review.openstack.org/484226 | 02:08 |
| *** itlinux has joined #openstack-kolla | 02:10 | |
| *** itlinux_ has joined #openstack-kolla | 02:10 | |
| *** mdnadeem has joined #openstack-kolla | 02:14 | |
| *** zhurong has joined #openstack-kolla | 02:31 | |
| *** kevinz has quit IRC | 02:56 | |
| *** dave-mccowan has quit IRC | 03:04 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER https://review.openstack.org/475670 | 03:05 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Remove ceilometer-api and ceilometer-collector services https://review.openstack.org/470752 | 03:05 |
| *** spsurya has joined #openstack-kolla | 03:07 | |
| spsurya | morning | 03:07 |
| *** tovin07 has joined #openstack-kolla | 03:11 | |
| *** tovin07__ has quit IRC | 03:13 | |
| *** kristian__ has joined #openstack-kolla | 03:16 | |
| *** itlinux has quit IRC | 03:23 | |
| *** itlinux_ has quit IRC | 03:23 | |
| *** itlinux_ has joined #openstack-kolla | 03:30 | |
| *** itlinux has joined #openstack-kolla | 03:30 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Apply neutron database migration https://review.openstack.org/407922 | 04:09 |
| *** kristian__ has quit IRC | 04:41 | |
| *** kristian__ has joined #openstack-kolla | 04:52 | |
| *** kristian__ has quit IRC | 04:54 | |
| *** kristian__ has joined #openstack-kolla | 05:00 | |
| *** kristian__ has quit IRC | 05:00 | |
| *** kristian__ has joined #openstack-kolla | 05:00 | |
| *** ducttape_ has joined #openstack-kolla | 05:03 | |
| *** zhurong has quit IRC | 05:04 | |
| *** kristian__ has quit IRC | 05:05 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Updated from global requirements https://review.openstack.org/484065 | 05:07 |
| *** ducttape_ has quit IRC | 05:08 | |
| *** tonanhngo has quit IRC | 05:10 | |
| openstackgerrit | Merged openstack/kolla master: Fixing mariadb bootstrap failure in kolla-kubernetes https://review.openstack.org/484211 | 05:10 |
| *** tonanhngo has joined #openstack-kolla | 05:16 | |
| *** zhurong has joined #openstack-kolla | 05:28 | |
| *** tonanhngo has quit IRC | 05:30 | |
| *** sbezverk has joined #openstack-kolla | 05:34 | |
| *** skramaja has joined #openstack-kolla | 05:44 | |
| *** prateek has joined #openstack-kolla | 06:03 | |
| *** kristian__ has joined #openstack-kolla | 06:16 | |
| *** vincent_vdk has left #openstack-kolla | 06:19 | |
| *** kristian__ has quit IRC | 06:20 | |
| *** magicboiz has joined #openstack-kolla | 06:28 | |
| *** vharsh has joined #openstack-kolla | 06:30 | |
| *** prateek has quit IRC | 06:30 | |
| *** kristian__ has joined #openstack-kolla | 06:40 | |
| *** kristian__ has quit IRC | 06:40 | |
| *** kristian__ has joined #openstack-kolla | 06:41 | |
| *** magicboiz has quit IRC | 06:41 | |
| *** kristian__ has quit IRC | 06:41 | |
| *** kristian__ has joined #openstack-kolla | 06:41 | |
| *** kristian__ has quit IRC | 06:42 | |
| *** kristian__ has joined #openstack-kolla | 06:43 | |
| *** caowei has quit IRC | 06:45 | |
| *** kristia__ has joined #openstack-kolla | 06:46 | |
| *** kristian__ has quit IRC | 06:47 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add VMware Documentation https://review.openstack.org/484262 | 06:47 |
| *** janki has joined #openstack-kolla | 06:49 | |
| *** magicboiz has joined #openstack-kolla | 06:50 | |
| *** magicboiz has quit IRC | 06:54 | |
| *** magicboiz has joined #openstack-kolla | 06:55 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Updated from global requirements https://review.openstack.org/484126 | 06:57 |
| *** itlinux has quit IRC | 06:59 | |
| *** itlinux_ has quit IRC | 06:59 | |
| *** itlinux_ has joined #openstack-kolla | 07:00 | |
| *** itlinux has joined #openstack-kolla | 07:01 | |
| *** tonanhngo has joined #openstack-kolla | 07:02 | |
| *** tonanhngo has quit IRC | 07:03 | |
| *** itlinux_ has quit IRC | 07:04 | |
| *** shardy has joined #openstack-kolla | 07:06 | |
| *** shardy has quit IRC | 07:07 | |
| *** manheim has joined #openstack-kolla | 07:07 | |
| *** gfidente has joined #openstack-kolla | 07:08 | |
| *** gfidente has quit IRC | 07:08 | |
| *** gfidente has joined #openstack-kolla | 07:08 | |
| *** serlex has joined #openstack-kolla | 07:08 | |
| *** itlinux has quit IRC | 07:08 | |
| *** shardy has joined #openstack-kolla | 07:09 | |
| *** caowei has joined #openstack-kolla | 07:09 | |
| *** lyang__ has left #openstack-kolla | 07:28 | |
| *** prateek has joined #openstack-kolla | 07:37 | |
| *** egonzalez has joined #openstack-kolla | 07:40 | |
| openstackgerrit | Merged openstack/kolla stable/ocata: Updated from global requirements https://review.openstack.org/484125 | 07:49 |
| *** athomas has joined #openstack-kolla | 08:01 | |
| openstackgerrit | Martin André proposed openstack/kolla master: Only copy symlinks when merge and preserve_properties are set https://review.openstack.org/484278 | 08:02 |
| *** ducttape_ has joined #openstack-kolla | 08:03 | |
| *** ducttape_ has quit IRC | 08:08 | |
| openstackgerrit | Merged openstack/kolla-ansible master: delete delimiter from init fernet condition check https://review.openstack.org/480853 | 08:18 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix wsgi file path and log-file parameter https://review.openstack.org/484226 | 08:21 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Use latest docker ce in gate https://review.openstack.org/482763 | 08:25 |
| *** vharsh has quit IRC | 08:34 | |
| *** mgoddard_ has joined #openstack-kolla | 08:36 | |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add vpnaas support to vsphere by vmware-nsx plugin https://review.openstack.org/484293 | 08:50 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add VMware DataStore support to cinder https://review.openstack.org/452131 | 08:57 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add fwaas support to vsphere by vmware-nsx plugin https://review.openstack.org/484105 | 08:58 |
| *** tvignaud has quit IRC | 08:59 | |
| *** yeyon has joined #openstack-kolla | 09:06 | |
| *** dixiaoli has joined #openstack-kolla | 09:07 | |
| *** dixiaoli has quit IRC | 09:07 | |
| *** tvignaud has joined #openstack-kolla | 09:11 | |
| yeyon | I download the builded images from web site http://tarballs.openstack.org/kolla/images/centos-binary-registry-ocata.tar.gz,but make mistake by using tar to extract ,error info(tar: Skipping to next header ),somewhere error?? | 09:16 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Make ceph default cinder backup driver again https://review.openstack.org/484301 | 09:17 |
| egonzalez | pbourke, could you review ^^? | 09:18 |
| egonzalez | yeyon, I use tar -xzf <file>.tar.gz -C <dest_path> | 09:20 |
| *** sambetts|afk is now known as sambetts | 09:25 | |
| yeyon | still error:(tar: Skipping to next header | 09:34 |
| egonzalez | yeyon, was the file correctly downloaded? | 09:35 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add vpnaas support to vsphere by vmware-nsx plugin https://review.openstack.org/484293 | 09:35 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fernet deploy https://review.openstack.org/484309 | 09:36 |
| yeyon | i use wget -c http://tarballs.openstack.org/kolla/images/centos-binary-registry-ocata.tar.gz | 09:37 |
| egonzalez | yeyon, just use wget https://tarballs.openstack.org/kolla/images/centos-binary-registry-ocata.tar.gz | 09:40 |
| *** lpetrut has joined #openstack-kolla | 09:40 | |
| egonzalez | dont know if -c can be causing the issue or not | 09:41 |
| egonzalez | hrm , im seeing ocata registry is returning Forbiden | 09:41 |
| egonzalez | 2017-07-17 11:41:16 ERROR 403: Forbidden | 09:42 |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla-ansible master: Add possibility to configure tenant VLANs https://review.openstack.org/464675 | 09:46 |
| *** mdnadeem has quit IRC | 09:47 | |
| yeyon | wget -c means wget support resume from break point | 09:52 |
| *** tovin07 has quit IRC | 09:52 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vSphere support to nova_compute https://review.openstack.org/449529 | 09:55 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware support to ceilometer https://review.openstack.org/462842 | 09:57 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add fwaas support to vsphere by vmware-nsx plugin https://review.openstack.org/484105 | 09:58 |
| egonzalez | yeyon, error is caused because tar file is not downloaded due 403 Forbidden, asked in openstack-infra why is returning 403 | 09:59 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add vpnaas support to vsphere by vmware-nsx plugin https://review.openstack.org/484293 | 09:59 |
| egonzalez | yeyon, until is fixed can use other distros or master registries | 10:00 |
| openstackgerrit | Merged openstack/kolla stable/newton: Updated from global requirements https://review.openstack.org/484138 | 10:02 |
| *** caoyuan has quit IRC | 10:03 | |
| *** jistr is now known as jistr|afk | 10:09 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add VMware Documentation https://review.openstack.org/484262 | 10:11 |
| *** caowei has quit IRC | 10:11 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add VMware Documentation https://review.openstack.org/484262 | 10:13 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Restart lbaas agent when lbaas conf changed https://review.openstack.org/484318 | 10:15 |
| *** awidders_ has joined #openstack-kolla | 10:27 | |
| *** awiddersheim has quit IRC | 10:27 | |
| *** gusan1 has joined #openstack-kolla | 10:40 | |
| *** magicboiz has quit IRC | 10:47 | |
| *** magicboiz has joined #openstack-kolla | 10:48 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Wait keystone_fernet running before init tokens https://review.openstack.org/484324 | 10:51 |
| *** gusan1 has quit IRC | 10:54 | |
| *** lpetrut_ has joined #openstack-kolla | 10:57 | |
| *** ansmith has quit IRC | 11:00 | |
| *** lpetrut has quit IRC | 11:00 | |
| *** tonanhngo has joined #openstack-kolla | 11:04 | |
| *** tonanhngo has quit IRC | 11:05 | |
| *** mandre_away is now known as mandre | 11:08 | |
| manheim | hello | 11:09 |
| manheim | how can I debug a running kolla env? | 11:10 |
| manheim | if I kill a service from the container to PDB it, the process is restarted | 11:10 |
| manheim | https://docs.openstack.org/kolla-ansible/latest/kolla-for-openstack-development.html | 11:11 |
| manheim | this can be done post-deploymeny? | 11:11 |
| manheim | ah, it's only for pike | 11:12 |
| manheim | i have mitaka | 11:12 |
| *** rwallner has joined #openstack-kolla | 11:13 | |
| manheim | egonzalez can you help me? | 11:14 |
| kristia__ | Hey, did somebody get neutron with floating ips working on ovh dedicated server? | 11:24 |
| *** bmace has quit IRC | 11:26 | |
| *** bmace has joined #openstack-kolla | 11:26 | |
| egonzalez | manheim, about kolla for development pbourke can help more | 11:30 |
| egonzalez | but from what i understand is that debugging can be done even without that change | 11:31 |
| manheim | that's what i'm trying | 11:31 |
| egonzalez | kristia__, I have server in OVH but I create VMs inside them for openstack, not directly running in OVH public networks | 11:31 |
| kristia__ | egonzalez: do you understand openstack and ovs networking along with ip ns? | 11:32 |
| egonzalez | kristia__, yep | 11:33 |
| kristia__ | then could you help me? pm | 11:33 |
| kristia__ | I found this guide, and I got exgress connectivity working | 11:33 |
| kristia__ | http://dohuyhoang.github.io/openstack/ovh/neutron/2014/07/07/Configure-OpenStack-network-on-OVH.html | 11:33 |
| kristia__ | now I need ingress via floating ips | 11:34 |
| manheim | managed to do it with remote_pdb | 11:36 |
| manheim | put the brakepoint from within the container | 11:37 |
| *** gusan1 has joined #openstack-kolla | 11:37 | |
| *** gusan1 has quit IRC | 11:38 | |
| *** schwicht has quit IRC | 11:50 | |
| *** tumble has quit IRC | 11:51 | |
| *** rhallisey has joined #openstack-kolla | 12:13 | |
| *** iniazi has joined #openstack-kolla | 12:16 | |
| *** jistr|afk is now known as jistr | 12:17 | |
| sbezverk | mandre: sorry about direct email. I sent it just because I needed to share larger than usual amount of information. | 12:17 |
| mandre | sbezverk: haha, no worries, have you seen the patch I sent this morning? | 12:18 |
| mandre | sbezverk: https://review.openstack.org/#/c/484278/ | 12:19 |
| *** iniazi_ has quit IRC | 12:19 | |
| sbezverk | mandre: not yet, need to build new image and re-deploy keystone.. I will let you know in the review today. | 12:20 |
| mandre | sbezverk: cool, keep in mind I'll be unavailable starting from tonight, so feel free to take over the patch | 12:21 |
| *** schwicht has joined #openstack-kolla | 12:22 | |
| *** emccormick has joined #openstack-kolla | 12:23 | |
| *** hrw has quit IRC | 12:27 | |
| *** ansmith has joined #openstack-kolla | 12:27 | |
| *** ducttape_ has joined #openstack-kolla | 12:27 | |
| *** schwicht has quit IRC | 12:29 | |
| *** hrw has joined #openstack-kolla | 12:30 | |
| *** schwicht has joined #openstack-kolla | 12:31 | |
| *** prateek has quit IRC | 12:33 | |
| *** kbaegis has joined #openstack-kolla | 12:39 | |
| kbaegis | Morning all! | 12:39 |
| kbaegis | Who here is our resident networking expert ooc? | 12:39 |
| kbaegis | Can Neutron-ovs play nicely with a host that's already using ovs? | 12:40 |
| *** ducttape_ has quit IRC | 12:42 | |
| *** ducttape_ has joined #openstack-kolla | 12:43 | |
| *** caoyuan has joined #openstack-kolla | 12:46 | |
| *** prateek has joined #openstack-kolla | 12:53 | |
| *** pbourke has quit IRC | 12:53 | |
| *** schwicht has quit IRC | 12:53 | |
| *** pbourke has joined #openstack-kolla | 12:54 | |
| *** rwallner has quit IRC | 12:56 | |
| sbezverk | kbaegis: yes in kolla-kubernetes, not sure about kolla-ansible though | 12:59 |
| *** rwallner_ has joined #openstack-kolla | 13:01 | |
| *** schwicht has joined #openstack-kolla | 13:09 | |
| *** emccormick has quit IRC | 13:15 | |
| *** mmehan has joined #openstack-kolla | 13:16 | |
| kbaegis | sbezverk: Thanks | 13:21 |
| *** zhurong has quit IRC | 13:22 | |
| *** skramaja has quit IRC | 13:34 | |
| sbezverk | mandre: just tested the fix, looks good, thanks a lot for quick turn around.. | 13:40 |
| mandre | sbezverk: awesome! at least I learned something in the process today... that you kubernetes uses symlinks when mounting the config files | 13:43 |
| mandre | sbezverk: is that something you did in kolla-kubernetes or is it a k8s thing? | 13:43 |
| sbezverk | mandre : it is k8s thing, when you mount configmap to the container and it has file reference | 13:44 |
| *** ducttape_ has joined #openstack-kolla | 13:45 | |
| mandre | sbezverk: isn't that a problem for you though, that we copy the target of the symlink inside the container rather than copying the link itself? what if the file in the configmap is updated? | 13:46 |
| sbezverk | mandre: right :) but k8s deals with is differently. if config gets changed, then pod will be terminated and new one started which will use new configs | 13:49 |
| *** ducttape_ has quit IRC | 13:50 | |
| *** jtriley has joined #openstack-kolla | 13:51 | |
| *** emccormick has joined #openstack-kolla | 13:51 | |
| *** sbezverk has quit IRC | 13:51 | |
| *** ducttape_ has joined #openstack-kolla | 13:51 | |
| *** sbezverk has joined #openstack-kolla | 13:51 | |
| mandre | sbezverk: ack, thanks for the explanation | 13:52 |
| sbezverk | mandre: could you ping your kolla core buddies to get this fix merge ;) ?? | 13:52 |
| *** spsurya has quit IRC | 13:55 | |
| mandre | egonzalez, pbourke, inc0, Jeffrey4l: a super simple review that fixes kolla-kubernetes, https://review.openstack.org/#/c/484278/ | 13:57 |
| *** emccormick has quit IRC | 13:58 | |
| *** zhurong has joined #openstack-kolla | 13:59 | |
| *** zhurong has quit IRC | 13:59 | |
| *** tonanhngo has joined #openstack-kolla | 14:01 | |
| *** tonanhngo has quit IRC | 14:02 | |
| sbezverk | portdirect : https://review.openstack.org/#/c/484014/ if you have spare minute, please check.. | 14:04 |
| *** lucasxu has joined #openstack-kolla | 14:06 | |
| rwellum | sbezverk: any chance you can move tomorrows meeting to Wednesday please? | 14:09 |
| openstackgerrit | Merged openstack/kolla master: Remove empty line in config.py https://review.openstack.org/482174 | 14:09 |
| rwellum | hg | 14:09 |
| sbezverk | rwellum : ok | 14:09 |
| rwellum | sbezverk: ty | 14:10 |
| *** emccormick has joined #openstack-kolla | 14:10 | |
| *** hongbin has joined #openstack-kolla | 14:11 | |
| openstackgerrit | Merged openstack/kolla master: Updated from global requirements https://review.openstack.org/484064 | 14:11 |
| *** emccormick has quit IRC | 14:16 | |
| sbezverk | rwellum : I am playing with current master trying to deploy, two issues found so far. | 14:18 |
| sbezverk | rwellum : I need a critical review for this one https://review.openstack.org/#/c/484014/ | 14:19 |
| rwellum | I was looking at that this morning sbezverk - will get to it after my 10:30 meeting. I saw your discussion about it last week - but I'm not 100% understanding how it works. | 14:22 |
| rwellum | Complicated issues for master sbezverk ? | 14:23 |
| *** emccormick has joined #openstack-kolla | 14:27 | |
| sbezverk | rwellum : one is already fixed, second one fix is tested, both on kolla side | 14:27 |
| *** awiddersheim has joined #openstack-kolla | 14:32 | |
| *** jtriley has quit IRC | 14:34 | |
| *** awidders_ has quit IRC | 14:35 | |
| egonzalez | hey pbourke around? | 14:38 |
| pbourke | egonzalez: hey | 14:38 |
| egonzalez | pbourke, you use ovh? seems to be an outage | 14:38 |
| egonzalez | all my sites are down :/ | 14:38 |
| pbourke | egonzalez: I don't | 14:38 |
| kristia__ | bare metal is up | 14:39 |
| egonzalez | dont know why but i though you uses it hehe | 14:39 |
| pbourke | just github hosted pages :) | 14:39 |
| pbourke | I would like some cloud servers available but dont want to pay | 14:40 |
| kristia__ | egonzalez: where are your sites? region | 14:40 |
| egonzalez | canada | 14:40 |
| kristia__ | ok | 14:40 |
| kristia__ | bhs-1-6 | 14:40 |
| kristia__ | what one? | 14:40 |
| sbezverk | egonzalez : really? I thought you were in Spain? | 14:40 |
| egonzalez | sbezverk, yeah, but main public is from US, better latency for them :) | 14:41 |
| *** spsurya has joined #openstack-kolla | 14:41 | |
| egonzalez | really im in ireland | 14:41 |
| sbezverk | egonzalez : ah ok.. got it I thought you moved to canada | 14:41 |
| *** StephenWang1991 has joined #openstack-kolla | 14:42 | |
| sbezverk | egonzalez pbourke please review this fix, without it I cannot install kolla-k8s with master kolla images.. https://review.openstack.org/#/c/484278/ | 14:48 |
| *** yeyon has quit IRC | 14:49 | |
| *** yeyon has joined #openstack-kolla | 14:49 | |
| *** caoyuan_ has joined #openstack-kolla | 14:51 | |
| *** caoyuan has quit IRC | 14:54 | |
| *** schwicht has quit IRC | 14:57 | |
| *** schwicht has joined #openstack-kolla | 14:59 | |
| *** kolla-slack2 has quit IRC | 15:00 | |
| *** lucasxu has quit IRC | 15:00 | |
| *** kolla-slack has joined #openstack-kolla | 15:00 | |
| *** janki has quit IRC | 15:02 | |
| *** jtriley has joined #openstack-kolla | 15:03 | |
| *** rwsu has joined #openstack-kolla | 15:06 | |
| *** Pavo has joined #openstack-kolla | 15:06 | |
| *** jbadiapa has quit IRC | 15:08 | |
| inc0 | good morning | 15:09 |
| *** jbadiapa has joined #openstack-kolla | 15:09 | |
| *** serlex has quit IRC | 15:09 | |
| sbezverk | inc0: good morning | 15:13 |
| *** schwicht has quit IRC | 15:15 | |
| *** schwicht has joined #openstack-kolla | 15:18 | |
| *** Pavo has quit IRC | 15:23 | |
| *** rwallner_ has quit IRC | 15:25 | |
| *** lucasxu has joined #openstack-kolla | 15:27 | |
| manheim | good morning | 15:28 |
| *** manheim has quit IRC | 15:28 | |
| *** rwallner has joined #openstack-kolla | 15:30 | |
| *** jamesbenson has joined #openstack-kolla | 15:35 | |
| jamesbenson | morning all :-) | 15:35 |
| sbezverk | inc0: please these two :https://review.openstack.org/484278 and https://review.openstack.org/#/c/484014/ if you have time | 15:36 |
| rwellum | sbezverk: can you explain the context of 484014? What are we gaining, how do we use it? I can add this as a comment if you prefer. | 15:39 |
| sbezverk | rwellum: it adds helm chart for registry, which can be used to serve images to anybody in the cluster | 15:40 |
| *** david-lyle has joined #openstack-kolla | 15:40 | |
| *** schwicht has quit IRC | 15:40 | |
| kfox1111 | sbezverk: should that chart be to kubernetes/charts instead? | 15:40 |
| sbezverk | it can also load tar files with already built images | 15:40 |
| sbezverk | kfox1111: hey, could you clarify what you mean? | 15:41 |
| kfox1111 | sbezverk: the local repo chart. its pretty non kolla specific? | 15:41 |
| kfox1111 | would it have a better home at github.com/kubernetes/charts? | 15:41 |
| sbezverk | kfox1111: sure, but it will take way more time to get it in there.. once it is in kolla-k8s I can take care of pushing it upstream | 15:42 |
| kfox1111 | ok. that sounds like a good plan. | 15:42 |
| sbezverk | kfox1111: I started deploying master and already hit two issues with kolla master images | 15:43 |
| kfox1111 | interesting. | 15:43 |
| sbezverk | I think kolla should add our new gate jobs in their gating | 15:44 |
| kfox1111 | the mc is finally looking better, so I'm hoping to dust off a few ps's. | 15:44 |
| kfox1111 | +1 | 15:44 |
| *** emccormick has quit IRC | 15:44 | |
| kfox1111 | we need the trunk gate for that I think. | 15:44 |
| kfox1111 | I can't quite remember, but I think that ps was pending still? | 15:44 |
| sbezverk | then we do not have to go back with cleaning and all will be caught before merge.. | 15:44 |
| sbezverk | kfox1111: I already added 2 new trunk jobs | 15:45 |
| sbezverk | please see this ps https://review.openstack.org/#/c/484014/ | 15:45 |
| kfox1111 | oh. cool. | 15:45 |
| sbezverk | that is how I caught kolla issues | 15:45 |
| kfox1111 | yeah, I'm in the middle of review of that one. | 15:46 |
| rwellum | sbezverk: so without 484014 - no master deployment - or am I mixing this up? | 15:46 |
| sbezverk | rwellum 484014 add registry that uses master tar and also adds two new gate jobs to test master deployment | 15:47 |
| *** schwicht has joined #openstack-kolla | 15:47 | |
| sbezverk | but there are 1 kolla PS which also needs to be merged so master deployment does not fail | 15:47 |
| rwellum | sbezverk: got it | 15:48 |
| kfox1111 | we should merge it with the other trunk ps too. | 15:48 |
| kfox1111 | that should bring in ceph support. | 15:48 |
| inc0 | sbezverk: so question about registry | 15:49 |
| inc0 | can we predict what will be ip of registry *before* we run it? | 15:49 |
| *** ducttape_ has quit IRC | 15:49 | |
| sbezverk | inc0: we do not need | 15:49 |
| inc0 | yes, yes we do | 15:49 |
| *** emccormick has joined #openstack-kolla | 15:49 | |
| sbezverk | we use 127.0.0.1 to. access | 15:49 |
| inc0 | ah | 15:50 |
| sbezverk | and node port helps us | 15:50 |
| inc0 | so we'll run proxy on each node? | 15:50 |
| sbezverk | nope, but nodeport feature makes like we do | 15:50 |
| kfox1111 | hmm.... not finding it... maybe we merged it? | 15:50 |
| inc0 | how does nodeport work? | 15:50 |
| sbezverk | inc0: kubeproxy will listen on ALL compute nodes | 15:51 |
| sbezverk | for a specific port | 15:51 |
| inc0 | oh interesting | 15:51 |
| kfox1111 | inc0: its like a service but the ip is every node's ip. | 15:51 |
| sbezverk | and then when there is a request it will forward it to the compute where it actually runs | 15:51 |
| inc0 | that's cool | 15:51 |
| sbezverk | inc0: please check PS I pasted | 15:51 |
| sbezverk | it implements exactly what we tlk about now | 15:52 |
| kfox1111 | sbezverk: got a couple minor changes | 15:52 |
| inc0 | that's why I was asking about it | 15:52 |
| sbezverk | kfox1111: sure are they in the review? | 15:52 |
| kfox1111 | inc0: know what happened to the trunk ps? | 15:52 |
| kfox1111 | sbezverk: yeah, I'm still finishing the review. | 15:52 |
| inc0 | trunk ps? | 15:52 |
| inc0 | slower guys, I'm still waiting for caffeine to kick in | 15:53 |
| sbezverk | kfox1111 sure will address them when I see them.. | 15:53 |
| kfox1111 | inc0: a long time ago, you started a ps for adding trunk support to the gate to kolla-kubernetes. | 15:53 |
| kfox1111 | I then added a bunch to it. | 15:53 |
| inc0 | ah | 15:53 |
| inc0 | right | 15:53 |
| kfox1111 | trying to remember if that merged or is pending. | 15:53 |
| sbezverk | kfox1111 that trunk PS will need registry | 15:53 |
| inc0 | https://review.openstack.org/#/c/418550/ dead or dying;) | 15:53 |
| inc0 | sbezverk's approach seems to be better tho | 15:54 |
| inc0 | if we could change pod run in gate | 15:54 |
| inc0 | for registry | 15:54 |
| inc0 | we can make this our registry for trunk images | 15:54 |
| kfox1111 | yeah, thats the one. | 15:54 |
| sbezverk | inc0: do you mean like permanent registry? | 15:55 |
| inc0 | what I'm thinking about is sth like this: | 15:55 |
| inc0 | you're running registry | 15:55 |
| *** manheim has joined #openstack-kolla | 15:55 | |
| kfox1111 | inc0: thanks for the link. | 15:55 |
| kfox1111 | yeah, I like sbezverk's version better too. | 15:56 |
| kfox1111 | ok. lets merge sbezverk's, and then rebase inc0's on top. | 15:56 |
| kfox1111 | should remove most of it but the ceph bits. | 15:56 |
| inc0 | we'll run small shell script inside pod to download tarball and populate registry | 15:56 |
| inc0 | kfox1111: I odn't think my patchset will be compatible with k8s-run registry | 15:56 |
| inc0 | nvm | 15:57 |
| kfox1111 | inc0: I'm talking about the ceph bits mostly. | 15:57 |
| inc0 | I see you're running this | 15:57 |
| kfox1111 | was in the middle of debugging why ceph trunk was failing... | 15:57 |
| sbezverk | kfox1111: +1 let's add ceph bits on top of registry ps | 15:57 |
| inc0 | cool, running tarball pull in init container is perfect | 15:57 |
| kfox1111 | oh... but I think that merged when 4.x support merged I think. | 15:57 |
| kfox1111 | this may be totally dead... | 15:58 |
| sbezverk | inc0: glad you liked it ;) | 15:58 |
| inc0 | this is great addition in general I think | 15:58 |
| sbezverk | it add 7 -9 minutes though I tomed it | 15:58 |
| sbezverk | timed | 15:59 |
| kfox1111 | sbezverk: have you tried ceph? | 15:59 |
| sbezverk | kfox1111: not yet | 15:59 |
| inc0 | sbezverk: good that you mention it, I have one fix to ps we need to make;) | 15:59 |
| sbezverk | I wanted to merge registry in general and then address specifics | 15:59 |
| kfox1111 | please remove the check that denies it and let the gate test it. it may just work now. :) | 15:59 |
| *** manheim has quit IRC | 16:00 | |
| sbezverk | kfox1111: sure thing I do not believe in miracles lately but who knows ;) | 16:00 |
| kfox1111 | hehe | 16:00 |
| kfox1111 | its bound to happen eventually just by sheer dumb luck. :) | 16:00 |
| sbezverk | kfox1111: there is one thing, ceph workflow must call setup_registry at one point | 16:00 |
| kfox1111 | ah. yeah. | 16:01 |
| kfox1111 | that probably should always happen if branch = 't' | 16:01 |
| *** egonzalez has quit IRC | 16:02 | |
| sbezverk | kfox1111: agree, but you see we cannot setup it up BEFORE we install k8s cluster, helm etc | 16:02 |
| kfox1111 | gluster-kubernetes is trying to join the cncf... interesting. | 16:02 |
| *** ddyer has quit IRC | 16:02 | |
| kfox1111 | sbezverk: ah. ok. | 16:02 |
| sbezverk | so far now it should be inside of ceph workflow | 16:02 |
| inc0 | reviewed | 16:03 |
| kfox1111 | sbezverk: yeah, that makes sence. | 16:04 |
| kfox1111 | I'm ok punting that till after the ps merges. | 16:05 |
| kfox1111 | shouldn't take too long to add after. | 16:05 |
| rwellum | sbezverk: if I'm running kolla-k8s, but I've substituted my own built image for say horizon - how do i definitively tell that it's picked that image up? docker ps | grep horizon doesn't help. | 16:06 |
| kfox1111 | kubectl describe pod shows it I think. | 16:07 |
| kfox1111 | it does help to uniquely tag your images too. if nothing else, makes it quicker to spot. | 16:08 |
| inc0 | rwellum: docker inspect | 16:08 |
| inc0 | if you changed tag/name | 16:08 |
| inc0 | or just docker exec -it your-horizon bash and examine files | 16:08 |
| kfox1111 | inc0: yeah, but no need to go to hosts, when you can talk to k8s. | 16:08 |
| sbezverk | rwellum, on the compute node, you will see built date ;) | 16:08 |
| kfox1111 | thats like saying, ssh and virsh when you can nova. | 16:09 |
| inc0 | kubectl exec riiiight;) | 16:09 |
| kfox1111 | :) | 16:09 |
| inc0 | I like this thing a lot tbh | 16:09 |
| *** ddyer has joined #openstack-kolla | 16:09 | |
| sbezverk | kfox1111: rwellum inc0 thanks for review, will update it. kfox1111: please answer some follow up questions. | 16:09 |
| kfox1111 | I expect in the next 3-4 months, there will be a big push to containerd. | 16:09 |
| kfox1111 | which wouldn't work with docker inspect anyway. :/ | 16:10 |
| kfox1111 | sbezverk: np. thanks for working on it. :) | 16:10 |
| *** yeyon has quit IRC | 16:13 | |
| *** prateek has quit IRC | 16:14 | |
| *** iniazi_ has joined #openstack-kolla | 16:17 | |
| *** iniazi has quit IRC | 16:20 | |
| *** mgoddard_ has quit IRC | 16:22 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 16:30 |
| *** caoyuan_ has quit IRC | 16:30 | |
| *** jtriley has quit IRC | 16:32 | |
| *** ducttape_ has joined #openstack-kolla | 16:34 | |
| sbezverk | inc0: one +2 is missing for this one https://review.openstack.org/484278 | 16:39 |
| *** StephenWang1991 has quit IRC | 16:40 | |
| inc0 | workflowed | 16:41 |
| sbezverk | inc0: thanks a lot. how often tarball with master gets built? | 16:42 |
| inc0 | right now every time anything merges to master | 16:42 |
| inc0 | soon it will be once a day | 16:42 |
| sbezverk | perfect | 16:42 |
| sbezverk | so I should be able to see the fix in action then very soon.. | 16:42 |
| sbezverk | inc0: do you think we could add a couple of k8s master jobs to kolla gate? | 16:43 |
| sbezverk | to prevent these type or issues | 16:43 |
| inc0 | sbezverk: I definetly want to add k8s jobs to publishing pipeline | 16:43 |
| sbezverk | inc0: great | 16:44 |
| inc0 | kolla gate - single job for ubu/centos would be nice for smoke test | 16:44 |
| kfox1111 | sbezverk: once we get ceph and iscsi trunk support merged, I think it woudl be pretty easy to get them into kolla-containers gate | 16:44 |
| sbezverk | kfox1111: yep I think so too | 16:44 |
| sbezverk | I was more worried about politics ;) | 16:45 |
| kfox1111 | ah. | 16:45 |
| *** jtriley has joined #openstack-kolla | 16:45 | |
| inc0 | what politics? | 16:46 |
| kfox1111 | inc0: not saying there are politics. I think he was just doublechecking there wasn't. | 16:49 |
| inc0 | https://review.openstack.org/#/c/475469/ I even included k8s here;) | 16:50 |
| inc0 | placeholder for it anyhow | 16:50 |
| inc0 | wanywya* | 16:50 |
| inc0 | anyway* | 16:50 |
| inc0 | my god | 16:50 |
| kfox1111 | inc0: is very monday today. | 16:51 |
| inc0 | this Monday is definetly very. | 16:51 |
| sbezverk | kfox1111: about defaults comment. when we deploy, we provide values in cloud.yaml but it is a bit kolla-k8s way | 16:53 |
| sbezverk | so values.yaml that comes with repo will not be used | 16:53 |
| *** vhosakot has joined #openstack-kolla | 16:53 | |
| kfox1111 | no, kubernetes charts are moving away from | default too. | 16:53 |
| sbezverk | I saw some upstream chart with similar approach | 16:53 |
| kfox1111 | as its much hader for a user to discover what the default is without reading code. | 16:53 |
| kfox1111 | yeah, there are a lot of upstream charts not following best practices yet. | 16:53 |
| sbezverk | kfox1111: in this case I will add these defaults in two places | 16:54 |
| kfox1111 | users can much more easily look at the values.yaml file then hunt for |defaults. | 16:54 |
| kfox1111 | no, then its a lot of dead code. | 16:54 |
| sbezverk | 1 values.yaml in the repo and then into cloud.yaml | 16:54 |
| sbezverk | kfox1111 no no I will remove from the code | 16:55 |
| kfox1111 | whats the second place then? | 16:55 |
| sbezverk | cloud.yaml I actually pass to deploy it | 16:55 |
| kfox1111 | ah. | 16:55 |
| kfox1111 | yeah, ok. wfm. | 16:55 |
| sbezverk | so users then will need to copy paste | 16:55 |
| *** mgoddard_ has joined #openstack-kolla | 16:55 | |
| kfox1111 | no, cause cloud.yaml merges with values.yaml. | 16:56 |
| kfox1111 | its not either or. | 16:56 |
| kfox1111 | if its default in values.yaml and you don't want to override it, ou don't have to explicitlyy state it in cloud.yaml. | 16:56 |
| sbezverk | kfox1111: hmm, I double check but in some cases it did not | 16:56 |
| kfox1111 | it would be a bug if it doesn't. | 16:56 |
| sbezverk | but maybe it was something with may setup | 16:56 |
| kfox1111 | yeah. if you find an instance of that, we need to report it to helm. | 16:57 |
| sbezverk | so ALL defaults go away? | 16:57 |
| kfox1111 | yes please. | 16:57 |
| sbezverk | ok | 16:57 |
| *** vhosakot has quit IRC | 16:58 | |
| *** vhosakot has joined #openstack-kolla | 16:58 | |
| *** vhosakot_ has joined #openstack-kolla | 17:01 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 17:03 |
| *** vhosakot has quit IRC | 17:03 | |
| rwellum | kfox1111: so why is master called trunk? :) | 17:06 |
| kfox1111 | master/trunk are basically synonyms. | 17:08 |
| *** jascott1 has joined #openstack-kolla | 17:09 | |
| rwellum | kfox1111: ok gtk | 17:09 |
| *** vcn[m] has quit IRC | 17:10 | |
| sbezverk | every time I hear trunk, I think about the elephant ;) | 17:10 |
| *** bachp has quit IRC | 17:11 | |
| *** retr0h has quit IRC | 17:11 | |
| kfox1111 | more, tree trunk then elephent trunk. :) | 17:11 |
| *** nhlfr has quit IRC | 17:11 | |
| sbezverk | :) | 17:11 |
| kfox1111 | the analogy comes from, branches get branched off of the trunk. | 17:12 |
| *** jascott1 has quit IRC | 17:12 | |
| rwellum | sbezverk - so this indicates it was built 12 days ago - that's sufficient proof it picked up my local image? bearing in mind this is mitaka... https://www.irccloud.com/pastebin/LXRBd6fY/ | 17:17 |
| sbezverk | rwellum : yep it is yours | 17:17 |
| *** harlowja has joined #openstack-kolla | 17:17 | |
| rwellum | Sweet - I was expecting some local changes but it looks like standard horizon. | 17:18 |
| *** jtriley has quit IRC | 17:18 | |
| *** jascott1 has joined #openstack-kolla | 17:18 | |
| sbezverk | kfox1111 : here is example, as soon as I moved defaults into values.yaml it started failing http://logs.openstack.org/14/484014/23/experimental/gate-kolla-kubernetes-deploy-ubuntu-source-t-iscsi-nv/f21eccd/console.html#_2017-07-17_17_15_18_405193 | 17:19 |
| *** nhlfr has joined #openstack-kolla | 17:22 | |
| *** vcn[m] has joined #openstack-kolla | 17:24 | |
| *** bachp has joined #openstack-kolla | 17:24 | |
| *** retr0h has joined #openstack-kolla | 17:24 | |
| kfox1111 | sbezverk: can you please throw a debug on that? | 17:25 |
| openstackgerrit | Merged openstack/kolla master: Point ubuntu ODL repos to PPA's https://review.openstack.org/473359 | 17:25 |
| kfox1111 | it should work. if it doesn't, its a bug in helm. | 17:25 |
| sbezverk | kfox1111: will dig deeper, just to be 100% it is not my fault.. will ping you in a bit | 17:26 |
| kfox1111 | k. thanks. | 17:26 |
| *** tonanhngo has joined #openstack-kolla | 17:28 | |
| *** ducttape_ has quit IRC | 17:28 | |
| *** ducttape_ has joined #openstack-kolla | 17:28 | |
| *** tonanhngo has quit IRC | 17:32 | |
| *** prateek has joined #openstack-kolla | 17:34 | |
| *** sambetts is now known as sambetts|afk | 17:38 | |
| *** tonanhngo has joined #openstack-kolla | 17:38 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 17:39 |
| *** ducttape_ has quit IRC | 17:39 | |
| openstackgerrit | Merged openstack/kolla master: Only copy symlinks when merge and preserve_properties are set https://review.openstack.org/484278 | 17:39 |
| *** schwicht has quit IRC | 17:39 | |
| *** schwicht has joined #openstack-kolla | 17:40 | |
| sbezverk | kfox1111: check this http://logs.openstack.org/14/484014/23/check/gate-kolla-kubernetes-python27-ubuntu-xenial/653547a/console.html#_2017-07-17_17_10_51_658591 | 17:40 |
| sbezverk | it seems it does not pick up image name and version | 17:41 |
| *** ducttape_ has joined #openstack-kolla | 17:44 | |
| *** kristia__ has quit IRC | 17:49 | |
| *** kristian__ has joined #openstack-kolla | 17:50 | |
| *** gfidente is now known as gfidente|afk | 17:50 | |
| *** kristian__ has quit IRC | 17:54 | |
| *** ducttape_ has quit IRC | 17:59 | |
| *** lpetrut_ has quit IRC | 18:00 | |
| *** ducttape_ has joined #openstack-kolla | 18:04 | |
| *** ducttap__ has joined #openstack-kolla | 18:06 | |
| *** jtriley has joined #openstack-kolla | 18:06 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 18:08 |
| *** ducttape_ has quit IRC | 18:10 | |
| *** jtriley has quit IRC | 18:11 | |
| sbezverk | kfox1111: any chance values.yaml does not get added into the archive or it gets overwritten by helm_build_all at the gate? | 18:11 |
| *** jtriley has joined #openstack-kolla | 18:13 | |
| kfox1111 | we're just doing a helm package, which should grab it I think. | 18:13 |
| sbezverk | kfox1111: yep confirmed, by some reason local values.yaml does not get picked up | 18:22 |
| sbezverk | kfox1111 check this out http://paste.openstack.org/show/615651/ | 18:24 |
| sbezverk | I can workaround it by starting the chart from local folder | 18:24 |
| sbezverk | to confirm with 100% certainty | 18:24 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 18:28 |
| jascott1 | sbezverk whats the command you are executing there? | 18:28 |
| sbezverk | jascott1 : helm install kolla/registry-deployment --version $VERSION --debug --namespace kolla --name registry --set initial_load=true --set node_port=30401 --set distro=$Distro --set type=$Type | 18:30 |
| sbezverk | so it picks up only locally defined values in command line but ignores all defaults in values.yaml which is located in the local chart folder | 18:31 |
| *** ducttap__ has quit IRC | 18:32 | |
| *** ducttape_ has joined #openstack-kolla | 18:32 | |
| *** kristian__ has joined #openstack-kolla | 18:37 | |
| *** rwsu has quit IRC | 18:39 | |
| *** lpetrut_ has joined #openstack-kolla | 18:41 | |
| *** kristian__ has quit IRC | 18:42 | |
| *** mgoddard_ has quit IRC | 18:43 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 18:46 |
| *** SamYaple has quit IRC | 18:47 | |
| *** lpetrut_ has quit IRC | 18:47 | |
| *** SamYaple has joined #openstack-kolla | 18:47 | |
| *** gfidente|afk has quit IRC | 18:48 | |
| *** ducttape_ has quit IRC | 18:49 | |
| *** rwallner has quit IRC | 18:51 | |
| *** rwsu has joined #openstack-kolla | 18:55 | |
| *** ducttape_ has joined #openstack-kolla | 18:56 | |
| jascott1 | sbezverk looks like its working to me | 18:58 |
| jascott1 | i made a copy of your values. in original values I changed the image version to 16.04 and in the copy I changed the image os to ubuntu | 18:59 |
| jamesbenson | should enable_ceph_rgw be enabled if you are doing external ceph? | 18:59 |
| jascott1 | I also deleted image ver from values2.yaml | 18:59 |
| sbezverk | jascott1 : in this case it is the way we package | 19:00 |
| jascott1 | when I ran `helm install --dry-run --debug .` I could see 16.04 from values.yaml and ubuntu from values2.yaml | 19:00 |
| sbezverk | thanks a lot for checking | 19:01 |
| jascott1 | the command also had `--values values2.yaml` | 19:01 |
| jascott1 | ok cool | 19:01 |
| jascott1 | working on that crazy helm delete hang for days now | 19:01 |
| sbezverk | jascott1 good luck!! I am sure you will nail it | 19:02 |
| jascott1 | concurrency hell, this mutex just goes into a black hole... :/ | 19:02 |
| jascott1 | haha thanks for the vote of confidence | 19:02 |
| inc0 | jamesbenson: I don't think swo | 19:02 |
| inc0 | so | 19:02 |
| jascott1 | thanks for working on registry, i was also starting to before I hit this bug | 19:02 |
| inc0 | I mean I don't think it'll be used at all | 19:03 |
| *** ducttape_ has quit IRC | 19:10 | |
| *** lpetrut_ has joined #openstack-kolla | 19:11 | |
| *** jtriley has quit IRC | 19:14 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 19:16 |
| sbezverk | kfox1111: I think when you add default values from all_values.yaml to each microchart, you need to merge them and not overwrite. | 19:18 |
| *** ducttape_ has joined #openstack-kolla | 19:22 | |
| *** goldyfruit has joined #openstack-kolla | 19:25 | |
| *** kristian__ has joined #openstack-kolla | 19:25 | |
| *** kbaegis has quit IRC | 19:26 | |
| *** ducttape_ has quit IRC | 19:28 | |
| *** harlowja has quit IRC | 19:32 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 19:33 |
| *** ducttape_ has joined #openstack-kolla | 19:34 | |
| *** dave-mccowan has joined #openstack-kolla | 19:44 | |
| *** gbc has joined #openstack-kolla | 19:47 | |
| *** jbrooks has quit IRC | 19:47 | |
| *** jbrooks has joined #openstack-kolla | 19:51 | |
| *** ducttape_ has quit IRC | 19:53 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 19:53 |
| *** manheim has joined #openstack-kolla | 19:55 | |
| gbc | hi .. can anyone please help me figure out why mariadb cluster bootstrap is failing when trying to do a multinode deployment? http://paste.openstack.org/show/615659/ | 19:56 |
| *** shardy has quit IRC | 19:58 | |
| *** rwallner has joined #openstack-kolla | 20:00 | |
| *** rwallner has quit IRC | 20:00 | |
| *** rwallner has joined #openstack-kolla | 20:01 | |
| *** ducttape_ has joined #openstack-kolla | 20:02 | |
| *** emccormick has quit IRC | 20:03 | |
| *** jtriley has joined #openstack-kolla | 20:04 | |
| *** rwallner has quit IRC | 20:08 | |
| *** ducttape_ has quit IRC | 20:09 | |
| *** lpetrut_ has quit IRC | 20:10 | |
| *** dklyle has joined #openstack-kolla | 20:12 | |
| *** david-lyle has quit IRC | 20:13 | |
| *** ducttape_ has joined #openstack-kolla | 20:13 | |
| *** dave-mccowan has quit IRC | 20:17 | |
| gbc | hi all ... would be grateful for any help ... multinode deployment error ... mariadb cluster bootstrap fail ... logs -> http://paste.openstack.org/show/615659 | 20:17 |
| *** iniazi has joined #openstack-kolla | 20:18 | |
| *** iniazi_ has quit IRC | 20:21 | |
| *** gfidente has joined #openstack-kolla | 20:23 | |
| *** gfidente has quit IRC | 20:23 | |
| *** gfidente has joined #openstack-kolla | 20:23 | |
| *** david-lyle has joined #openstack-kolla | 20:26 | |
| *** dklyle has quit IRC | 20:27 | |
| *** kristian__ has quit IRC | 20:29 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 20:29 |
| *** kristian__ has joined #openstack-kolla | 20:29 | |
| *** prateek has quit IRC | 20:33 | |
| *** kristian__ has quit IRC | 20:34 | |
| *** emccormick has joined #openstack-kolla | 20:37 | |
| *** ansmith has quit IRC | 20:51 | |
| inc0 | gbc: was it your first deploy on clean system? | 20:55 |
| inc0 | because if you had previously deployed mariadb and restarted all nodes, it will faik | 20:55 |
| inc0 | fail | 20:55 |
| inc0 | also which verison of kolla? | 20:56 |
| *** harlowja has joined #openstack-kolla | 20:56 | |
| *** lucasxu has quit IRC | 21:01 | |
| *** emccormick has quit IRC | 21:01 | |
| *** mandre has quit IRC | 21:08 | |
| *** jtriley has quit IRC | 21:10 | |
| gbc | inc0: i'm trying to follow your kolla-ansible workshop instructions ... | 21:11 |
| gbc | inc0: i'm using 4.0.2 ... | 21:11 |
| sbezverk | inc0: I have addressed all comments. I think it is ready to get merged.. https://review.openstack.org/484014 | 21:12 |
| gbc | inc0: the deployment failed ... i deleted the mariadb containers and mariadb docker volumes from the controller nodes ... and then restarted | 21:12 |
| gbc | ... restarted the deployment | 21:12 |
| gbc | i just did a 'kolla-ansible destroy' a while back ... trying again from scratch | 21:13 |
| gbc | (i'm assuming the "destroy" command is sufficient to get me back to a "clean" system) | 21:15 |
| inc0 | gbc: that's the issue | 21:27 |
| inc0 | you need to do kolla-ansible destroy | 21:28 |
| inc0 | simply removing containers will seem to galera like just full restart | 21:28 |
| inc0 | and then you need to perform some recovery | 21:28 |
| inc0 | if you do kolla-ansible destroy it won't be the case | 21:28 |
| *** goldyfruit has quit IRC | 21:30 | |
| gbc | ok, i'll try that | 21:30 |
| gbc | inc0: thank you | 21:32 |
| inc0 | np, good luck:) | 21:32 |
| *** dave-mccowan has joined #openstack-kolla | 21:34 | |
| *** ducttape_ has quit IRC | 21:43 | |
| *** ducttape_ has joined #openstack-kolla | 21:45 | |
| *** ducttape_ has quit IRC | 21:46 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 21:46 |
| *** ducttape_ has joined #openstack-kolla | 21:48 | |
| sbezverk | inc0: why there is a difference in timestamp for centos and ubuntu tarballs? I thought they should match, no? | 21:52 |
| *** itlinux has joined #openstack-kolla | 21:52 | |
| *** itlinux_ has joined #openstack-kolla | 21:52 | |
| *** wahnsinn has joined #openstack-kolla | 21:53 | |
| SamYaple | sbezverk: you mean the ones in tarball.o.o ? | 22:01 |
| sbezverk | SamYaple : yep | 22:01 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements https://review.openstack.org/474652 | 22:03 |
| sbezverk | SamYaple this morning one fix got merged into kolla repo, now I see it in centos tarball but do not see it in ubuntu, not very nice.. | 22:03 |
| *** emccormick has joined #openstack-kolla | 22:03 | |
| *** jamesbenson has quit IRC | 22:03 | |
| *** lpetrut_ has joined #openstack-kolla | 22:04 | |
| *** emccormick has quit IRC | 22:09 | |
| *** ducttap__ has joined #openstack-kolla | 22:10 | |
| *** ducttape_ has quit IRC | 22:14 | |
| *** mmehan has quit IRC | 22:17 | |
| *** manheim has quit IRC | 22:19 | |
| *** lpetrut_ has quit IRC | 22:19 | |
| *** manheim has joined #openstack-kolla | 22:20 | |
| *** tonanhngo has quit IRC | 22:20 | |
| *** tonanhngo has joined #openstack-kolla | 22:22 | |
| inc0 | sbezverk: they'll build tarball per job | 22:23 |
| inc0 | so if ubuntu will be different job than centos | 22:23 |
| *** manheim has quit IRC | 22:24 | |
| sbezverk | inc0: ok, not very consistent, but hopefully they will get in sync tomorrow.. | 22:25 |
| *** emccormick has joined #openstack-kolla | 22:26 | |
| *** tonanhngo_ has joined #openstack-kolla | 22:26 | |
| *** tonanhngo has quit IRC | 22:26 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding chart for docker registry and serving master images https://review.openstack.org/484014 | 22:28 |
| *** tonanhngo_ has quit IRC | 22:30 | |
| dmsimard | sdake, inc0: found another dep on EPEL | 22:32 |
| inc0 | dmsimard: what's that | 22:32 |
| inc0 | ? | 22:32 |
| dmsimard | https://github.com/openstack/kolla/blob/master/docker/openstack-base/Dockerfile.j2#L32 | 22:32 |
| dmsimard | not sure what that is or what it's used for | 22:32 |
| inc0 | not sure as well, I guess we could remove it and try build? | 22:33 |
| sdake | libtomcrypt is a dep of crypto.py iirc | 22:34 |
| sdake | but Icouldbe wrong | 22:34 |
| sdake | take it out and build :) | 22:34 |
| *** rwsu has quit IRC | 22:34 | |
| *** spsurya has quit IRC | 22:34 | |
| *** vhosakot_ has quit IRC | 22:35 | |
| dmsimard | sdake: we're doing okay without libtomcrypt in RDO :p | 22:35 |
| sdake | you dont build from source | 22:35 |
| sdake | that is probaably a source only requirement | 22:35 |
| sdake | (as in it is misplaced in the dependencies list) | 22:35 |
| sdake | better to test then speculate | 22:35 |
| inc0 | sdake: no, it's in binary only block | 22:35 |
| dmsimard | libtommath too from openstack_base. | 22:36 |
| inc0 | maybe it's leftover | 22:36 |
| *** rwsu has joined #openstack-kolla | 22:36 | |
| inc0 | also you build all of images or subset? | 22:36 |
| dmsimard | inc0: we only build what we need | 22:36 |
| sdake | i'll build - takes about 30 minutes | 22:36 |
| dmsimard | https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml | 22:37 |
| dmsimard | It's ok, I guess I am using trial/error to find EPEL deps | 22:37 |
| dmsimard | We should document them somewhere :) | 22:37 |
| dmsimard | percona-xtrabackup from EPEL too. | 22:38 |
| * dmsimard goes down the rabbit hole | 22:38 | |
| openstackgerrit | Steven Dake proposed openstack/kolla master: DNM: Test removal of libtomcrypt/libtommath https://review.openstack.org/484514 | 22:40 |
| sdake | dmsimard i have a patch for that | 22:40 |
| dmsimard | sdake: to take out xtradb ? | 22:40 |
| dmsimard | sdake: I know there's something from mariadb | 22:41 |
| sdake | https://review.openstack.org/#/c/468632/ | 22:41 |
| sdake | xtradb is built into mariadb 10.1 | 22:41 |
| *** itlinux has quit IRC | 22:42 | |
| *** itlinux_ has quit IRC | 22:42 | |
| sdake | and is the only dependency required of mariadb in addition | 22:42 |
| sdake | (from percona) | 22:42 |
| dmsimard | pv from mariadb is also EPEL https://github.com/openstack/kolla/blob/master/docker/mariadb/Dockerfile.j2#L16 | 22:42 |
| dmsimard | pv sounds like a weird dependency too | 22:44 |
| dmsimard | It's used to calculate the bandwidth of a pipe iirc ? I used it before dd supported --progress | 22:44 |
| *** vhosakot has joined #openstack-kolla | 22:45 | |
| dmsimard | INFO:kolla.image.build.openstack-base:Package pyOpenSSL is obsoleted by python2-pyOpenSSL, trying to install python2-pyOpenSSL-16.2.0-3.el7.noarch instead | 22:46 |
| dmsimard | INFO:kolla.image.build.openstack-base:No package python2-crypto available. | 22:46 |
| sbezverk | sdake: could you please review your delete ansible playbook, it seems failing consistently on ironic job and it has not been modified for a bit.. | 22:46 |
| sdake | well in theory i'm supposed to be on pto this week | 22:47 |
| sdake | however, yes I'll take a look | 22:47 |
| sbezverk | sdake: ok, do you mind then I comment it until you fix it? | 22:47 |
| sdake | i'll take a look today sbezverk | 22:47 |
| sbezverk | sdake: cool thanks.. | 22:47 |
| sdake | clearly we dont want a broken gate for a week | 22:47 |
| sbezverk | sdake: it is already not very stable.. some random failure accessing kubernetes bits outside | 22:48 |
| dmsimard | inc0: python2-crypto is another example of EPEL potentially biting you in the ass | 22:49 |
| dmsimard | inc0: no such thing as python2-crypto in RDO, we carry python-crypto | 22:49 |
| inc0 | I guess we can just make it bp for Q | 22:49 |
| inc0 | remove epel | 22:49 |
| *** emccormick has quit IRC | 22:50 | |
| inc0 | although dmsimard any chances you guys would try to build all the containers from RDO and see if it works? | 22:50 |
| inc0 | then in early Q we'd just pull your overrides in and have a release worth of testing to pinpoint everything that breaks | 22:51 |
| dmsimard | inc0: I'll try and build the containers we're interested in first, document the changes required for taking out EPEL and then if I have the luxury of time I'll also do the other containers | 22:51 |
| inc0 | dmsimard: thanks | 22:52 |
| dmsimard | inc0: sorry, I just have so much on my plate right now :( | 22:52 |
| inc0 | no worries, it's Q anyway | 22:52 |
| kfox1111 | back. | 22:52 |
| sdake | i am pretty sure we can handle most of these problems in pike | 22:52 |
| kfox1111 | sbezverk: oh... your doing all values too? yeah, we don't merge currently. | 22:52 |
| kfox1111 | all values should be in all_values. | 22:53 |
| inc0 | I'm worried about stuff that will successfully build but not work properly | 22:53 |
| kfox1111 | the real solution is to switch to parent values. | 22:53 |
| sbezverk | kfox1111: but then it will become kolla specific | 22:53 |
| inc0 | if someone will commit to write and test it extensively, yeah, we can do it in Pike | 22:53 |
| sdake | test which | 22:53 |
| inc0 | but I want someone to lead the effort and commit to testing not just build | 22:53 |
| kfox1111 | sbezverk: its already rather kolla specific? | 22:53 |
| sdake | you mean remove epel - or sort out the unnecessary dependencies | 22:53 |
| sbezverk | for now I will explicitly use values._local.yaml | 22:54 |
| inc0 | remove epel | 22:54 |
| kfox1111 | sbezverk: I don't think that gets included? | 22:54 |
| sdake | i think we dont need to necessairly remove epel - rdo has a solution for that | 22:54 |
| sbezverk | kfox1111 : nope no any specific things | 22:54 |
| sdake | we do need to sort out the unnecessary dependencies | 22:54 |
| inc0 | but if we don't need it, I want it out | 22:54 |
| sdake | i do as well | 22:54 |
| sbezverk | kfox1111 I specify it in command line with --values | 22:54 |
| inc0 | just worried that we'll break some less used service in the process | 22:54 |
| kfox1111 | sbezverk: that doesn't work like values.yaml is intended. | 22:54 |
| sbezverk | it is wroking until we can figure out cleaner solution.. | 22:55 |
| inc0 | that's why I don't want to commit to this in Pike | 22:55 |
| kfox1111 | values.yaml is automatically included. | 22:55 |
| kfox1111 | so thats where defaults belong. | 22:55 |
| sbezverk | kfox1111: agree but then these default needs to go into all_values.yaml | 22:56 |
| kfox1111 | yeah. | 22:56 |
| kfox1111 | or we need to start on the parent value migration. | 22:56 |
| sbezverk | which does not exist in upstream | 22:56 |
| kfox1111 | none of the stuff in all_values does iether. | 22:56 |
| kfox1111 | if you want it to work without kolla, it cant depend on kolla-common at all. | 22:56 |
| sbezverk | kfox1111 right but nothing from there is used in registry chart | 22:56 |
| kfox1111 | oh. so your saying, your not using kolla-common at all, but all_values is still overwriting values.yaml? | 22:57 |
| sbezverk | kfox1111 that was the goal, no dependency | 22:57 |
| sbezverk | exactly | 22:57 |
| kfox1111 | ah. gotcha. | 22:57 |
| sbezverk | so it will be very easy to upstream it | 22:57 |
| kfox1111 | so, maybe we just tweak the prebuild to skip that dir? | 22:57 |
| sbezverk | kfox1111 ideally it would be great to intelligently merge them | 22:58 |
| kfox1111 | but if your trying to skip it entirely, I think its better to have it never touch it? | 22:58 |
| sbezverk | but I suspect that might be difficult | 22:58 |
| kfox1111 | yeah. the intelegent part comes in as part of the parent values work I think. | 22:58 |
| kfox1111 | then the chart itself specifies what chunks of all_values it pulls in. | 22:59 |
| sbezverk | kfox1111 : cool, skipping works for me too | 22:59 |
| sdake | inc0 i'm pretty sure the only fundamental dependency that is difficult to deal with in EPEL removal is the iscsi thing in cinder-volume, and that is because of a desire for upgradeability | 22:59 |
| sdake | as far as I can tell, there is not and will not be a way to upgrade that particular component if its in use | 23:00 |
| kfox1111 | sbezverk: helm_prebuild_microservices.py, the 'with open' at 197, stick in an if checking the package name != to yours. | 23:00 |
| inc0 | there are ways always | 23:00 |
| sdake | sure there is always a way out | 23:00 |
| inc0 | I just don't want to deal with all the nuts and bolts right now | 23:00 |
| inc0 | 1month before release | 23:00 |
| sdake | however that particular dep with the desire for upgrade- the only way out I can think of fis to write a replacement that does BOTh | 23:01 |
| sdake | so - either the upgrade requireemnt there has to give or the dependency has to e permanent | 23:01 |
| sbezverk | kfox1111: ok, will do that, now I am waiting for master deployment result | 23:01 |
| inc0 | Pike-3 cuts next week | 23:01 |
| *** vhosakot has quit IRC | 23:06 | |
| dmsimard | Can you have multiple "set" commands in overrides for the same var ? | 23:07 |
| dmsimard | Like, multiple appends or removes for openstack_base_packages | 23:07 |
| dmsimard | Just because I'd keep the EPEL stuff separate from the stuff we're already overriding for other reasons | 23:08 |
| dmsimard | If it's not, it's OK, I'll add inline comments or something | 23:08 |
| sdake | dmsimard inc0 would know the answer for certain - but i suspect the answer is not | 23:08 |
| sdake | dmsimard can you please put the list of issues here: etherpad https://etherpad.openstack.org/p/sanitize-rdo | 23:19 |
| dmsimard | sdake: I already started here: https://etherpad.openstack.org/p/kolla-epel | 23:20 |
| sdake | o sound sgood | 23:21 |
| inc0 | dmsimard: should work | 23:22 |
| *** gfidente has quit IRC | 23:27 | |
| dmsimard | I think I should have a successful build for the images we're interested in with the batch I just started, let's see | 23:27 |
| dmsimard | after that I can try building everything | 23:27 |
| *** hongbin has quit IRC | 23:28 | |
| inc0 | cool, thanks dmsimard | 23:28 |
| inc0 | dmsimard: also, what would you say about putting bp for both tripleo and kolla to get rid of overrides? | 23:29 |
| inc0 | I understand you need puppet in containers, but you're going for ansible right? | 23:29 |
| inc0 | so we can reasonably draft this goal | 23:30 |
| dmsimard | I'll run it through the people that should be taking care of this in the first place, just stepping up to help cause they're not gonna make it | 23:30 |
| dmsimard | I'm actually not very involved in TripleO at all | 23:30 |
| inc0 | mandre would be person to talk to? | 23:30 |
| dmsimard | mandre is a good person yeah, he's part of the team working on containerization | 23:30 |
| inc0 | ok I'll run it with him | 23:31 |
| inc0 | can you share overrides you're making? | 23:31 |
| dmsimard | np, happy to help with any RDO specific questions as usual | 23:31 |
| dmsimard | The overrides TripleO is currently using are here: https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j2 | 23:31 |
| dmsimard | My last commit on that was very naive and for some reason my local testing didn't catch all those other issues I'm picking up now | 23:32 |
| dmsimard | (Gate jobs on the overrides are coming soon..) | 23:32 |
| *** manheim has joined #openstack-kolla | 23:33 | |
| dmsimard | inc0: so far as plans for puppet, ansible, heat, mistral or k8s are concerned in TripleO I'm not super aware of where things are going, again, mandre should know (or know who would) | 23:35 |
| dmsimard | I've seen some amount of helm discussions around too. | 23:35 |
| inc0 | yeah | 23:39 |
| inc0 | it's fun thread on ML | 23:40 |
| kfox1111 | we're meeting wednesday to talk more about that. | 23:41 |
| dmsimard | There will certainly be a lot of heated debate at the PTG | 23:43 |
| inc0 | fun fun | 23:43 |
| *** jamesbenson has joined #openstack-kolla | 23:48 | |
| *** jamesbenson has quit IRC | 23:53 | |
| *** wahnsinn has quit IRC | 23:58 | |
| dmsimard | sdake, inc0: so far as I can tell, removing EPEL means adding these overrides to get the our containers to build: https://review.openstack.org/#/c/484444/2/container-images/tripleo_kolla_template_overrides.j2 | 23:59 |
| dmsimard | I'll try building everything now. | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!