| inc0 | vhosakot: did you submit talks? | 00:00 |
|---|---|---|
| vhosakot | no, will do.. | 00:00 |
| vhosakot | inc0: will let you know | 00:01 |
| inc0 | sure, just poking with a pike:P | 00:01 |
| vhosakot | inc0: lol, sure, will keep you posted | 00:01 |
| *** awiddersheim has quit IRC | 00:02 | |
| *** awiddersheim has joined #openstack-kolla | 00:03 | |
| *** manheim has quit IRC | 00:07 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER https://review.openstack.org/475670 | 00:08 |
| *** dave-mccowan has joined #openstack-kolla | 00:09 | |
| *** spsurya has quit IRC | 00:11 | |
| *** Teck7 has quit IRC | 00:12 | |
| *** yingjun has joined #openstack-kolla | 00:21 | |
| *** manheim has joined #openstack-kolla | 00:25 | |
| *** manheim has quit IRC | 00:25 | |
| *** ashishb has joined #openstack-kolla | 00:26 | |
| *** manheim has joined #openstack-kolla | 00:26 | |
| *** manheim has quit IRC | 00:30 | |
| masber | ih | 00:35 |
| *** zhurong has joined #openstack-kolla | 00:37 | |
| masber | good morning, neutron_server is not starting --> https://pastebin.com/raw/3YTvPXM1 apparently /etc/neutron/plugins/ml2/ml2_conf_sriov.ini is missing. I am using kolla-ansible and centos binary 4.0.0 | 00:37 |
| *** rwallner has joined #openstack-kolla | 00:39 | |
| *** jtriley has joined #openstack-kolla | 00:40 | |
| *** duonghq_ is now known as duonghq | 00:41 | |
| duonghq | vhosakot, inc0 morning \ | 00:42 |
| duonghq | sorry for last night I cannot awake with you | 00:42 |
| vhosakot | duonghq: cool, np.. morning to you too! | 00:44 |
| duonghq | just got really heavy rain :( | 00:44 |
| duonghq | not so good | 00:45 |
| duonghq | :( | 00:45 |
| sbezverk | vhosakot : another one liner for you :) https://review.openstack.org/483050 | 00:56 |
| vhosakot | I like how sbezverk gived me one-liners :) | 00:56 |
| sbezverk | vhosakot I know you are busy man ;) | 00:58 |
| vhosakot | :) | 00:58 |
| sbezverk | so do not want to waste your time too much | 00:58 |
| ashishb | Hello everyone~ | 01:00 |
| *** unicell has quit IRC | 01:00 | |
| ashishb | I wish to run openstack as containers and new to kolla | 01:02 |
| *** tovin07_ has joined #openstack-kolla | 01:02 | |
| ashishb | I quickly checked the options and I see few possibilities: | 01:02 |
| ashishb | kolla-ansible, kolla-kubernetes and then openstack-helm | 01:02 |
| ashishb | and there is one more: fuel-ccp | 01:03 |
| ashishb | so, I am a bit confused, which one should I start with? any recommendations..? | 01:03 |
| vhosakot | LGTM sbezverk :) | 01:09 |
| sbezverk | vhosakot thanks a lot, one step closer to my target ;) | 01:11 |
| vhosakot | sbezverk: cool, np :) | 01:11 |
| *** ansmith has quit IRC | 01:16 | |
| *** ansmith has joined #openstack-kolla | 01:18 | |
| *** prateek has quit IRC | 01:19 | |
| *** rwallner has quit IRC | 01:25 | |
| *** kristian__ has joined #openstack-kolla | 01:26 | |
| *** kristian__ has quit IRC | 01:31 | |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add VMware DataStore support to cinder https://review.openstack.org/452131 | 01:44 |
| *** jascott1_ has joined #openstack-kolla | 01:46 | |
| masber | I think I screw my kolla and I forgot the changes I did, I would like to check the original content of the "run_command" file in the neutron_server image, how can I check that? | 01:47 |
| *** jascott1 has quit IRC | 01:48 | |
| *** iniazi_ has quit IRC | 02:00 | |
| *** caoyuan has joined #openstack-kolla | 02:06 | |
| *** itlinux has joined #openstack-kolla | 02:10 | |
| rwellum | Hi ashishb | 02:35 |
| ashishb | Hello rwellum | 02:38 |
| rwellum | Regarding your question it depends what you want imo. I don't know much about fuel-ccp except it's a wrapper for kargo. Of all those technologies kolla-ansible is the most mature - but it's also not Kubernetes. So if you want kubernetes then you need one of the other three. kolla-kubernetes and openstack-helm share a lot of similarities, they both use kolla images. They both use kubernetes and helm but they | 02:43 |
| rwellum | have a philosophical difference or two. I could give you my opinion (and I like them both) but it's probably better to play with both and see what suits your work-flow the most. All of them (except fuel-ccp - don't know about this), have great communities that are very welcoming and need contributors. | 02:43 |
| ashishb | thanks rwellum for your inputs, yes, I probably need to try these to see if they suit my needs. | 02:45 |
| ashishb | thanks for the help! | 02:45 |
| rwellum | np | 02:46 |
| *** jamesbenson has joined #openstack-kolla | 02:55 | |
| openstackgerrit | Merged openstack/kolla master: Adding targetcli tool to cinder-volume https://review.openstack.org/483050 | 03:00 |
| jamesbenson | Reepicheep: thanks ;-) somethings just need bash. I like python scripting too, but when it can be done in bash nicely, I don't mind. | 03:03 |
| jamesbenson | kristian__: the kolla_bridge.yml is my older file, but for ubuntu, the content should be the same. I migrated from that file to separate ansible scripts to help clean it up some. | 03:04 |
| *** jamesbenson has quit IRC | 03:04 | |
| *** schwicht has quit IRC | 03:14 | |
| *** spsurya has joined #openstack-kolla | 03:23 | |
| spsurya | morning all | 03:23 |
| *** dave-mccowan has quit IRC | 03:24 | |
| *** manheim has joined #openstack-kolla | 03:27 | |
| rwellum | 11:30 pm spsurya :) | 03:28 |
| duonghq | morning spsurya | 03:31 |
| duonghq | evening Rich | 03:31 |
| *** manheim has quit IRC | 03:32 | |
| spsurya | rwellum: :) | 03:32 |
| spsurya | its's 9:00 AM | 03:32 |
| spsurya | hi duonghq | 03:32 |
| *** prateek has joined #openstack-kolla | 03:35 | |
| *** mdnadeem has joined #openstack-kolla | 03:39 | |
| rwellum | hey duonghq | 03:40 |
| duonghq | hi rwellum | 03:40 |
| *** vhosakot_ has joined #openstack-kolla | 03:51 | |
| *** emccormick has quit IRC | 03:52 | |
| *** vhosakot has quit IRC | 03:54 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER https://review.openstack.org/475670 | 04:03 |
| *** jascott1_ has quit IRC | 04:05 | |
| *** jascott1 has joined #openstack-kolla | 04:05 | |
| *** jtriley has quit IRC | 04:06 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER https://review.openstack.org/475670 | 04:07 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Ansible strategy for Rolling upgrade https://review.openstack.org/482863 | 04:07 |
| *** jascott1 has quit IRC | 04:11 | |
| *** mdnadeem has quit IRC | 04:42 | |
| *** mdnadeem has joined #openstack-kolla | 04:54 | |
| masber | kolla documentation https://docs.openstack.org/kolla-ansible/latest/ironic-guide.html says that a flat network needs to be added to the list of tenant network types --> neutron_tenant_network_types: "vxlan,flat". My question is, in which file is that neutron_tenant_network_types parameter? | 05:08 |
| masber | is there anyone here able to help me? | 05:08 |
| spsurya | inc0: ping.. | 05:09 |
| *** vharsh has joined #openstack-kolla | 05:12 | |
| *** caoyuan has quit IRC | 05:26 | |
| *** caoyuan has joined #openstack-kolla | 05:26 | |
| *** unicell has joined #openstack-kolla | 05:31 | |
| *** unicell1 has joined #openstack-kolla | 05:39 | |
| *** unicell has quit IRC | 05:41 | |
| *** kristian__ has joined #openstack-kolla | 05:43 | |
| *** duonghq has quit IRC | 05:45 | |
| *** tovin07_ has quit IRC | 05:45 | |
| *** hieulq has quit IRC | 05:45 | |
| *** tovin07_ has joined #openstack-kolla | 05:46 | |
| *** duonghq has joined #openstack-kolla | 05:46 | |
| *** hieulq has joined #openstack-kolla | 05:46 | |
| *** kristian__ has quit IRC | 05:47 | |
| *** caoyuan has quit IRC | 05:59 | |
| vhosakot_ | masber: https://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L539 | 06:01 |
| *** lpetrut has joined #openstack-kolla | 06:06 | |
| masber | vhosakot_, wow!, I have been using kolla for a several months now and didn't know about this file!! this is amazing, thanks! | 06:07 |
| vhosakot_ | masber: np, that is the group_vars | 06:08 |
| masber | vhosakot_, ok, so I can just put that variable on the globals.yml and it will override the group_vars is that right? | 06:10 |
| vhosakot_ | yes | 06:10 |
| masber | this is gold | 06:10 |
| masber | thanks! | 06:10 |
| *** jiriprox has quit IRC | 06:14 | |
| *** caoyuan has joined #openstack-kolla | 06:18 | |
| *** caoyuan_ has joined #openstack-kolla | 06:22 | |
| *** caoyuan has quit IRC | 06:26 | |
| *** skramaja has joined #openstack-kolla | 06:28 | |
| *** caoyuan_ has quit IRC | 06:34 | |
| *** jamesbenson has joined #openstack-kolla | 06:41 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Magnum: Enable cluster trust customization https://review.openstack.org/472658 | 06:43 |
| *** jamesbenson has quit IRC | 06:46 | |
| *** pcaruana has joined #openstack-kolla | 06:52 | |
| *** kristian__ has joined #openstack-kolla | 06:53 | |
| *** manheim has joined #openstack-kolla | 07:00 | |
| *** vhosakot_ has quit IRC | 07:01 | |
| *** manheim has quit IRC | 07:01 | |
| *** manheim has joined #openstack-kolla | 07:01 | |
| *** manheim has quit IRC | 07:05 | |
| *** lpetrut has quit IRC | 07:07 | |
| zhubingbing_ | hi guys | 07:16 |
| *** janki has joined #openstack-kolla | 07:16 | |
| openstackgerrit | Dennis Mueller proposed openstack/kolla-ansible master: Added neutron metering-agent support https://review.openstack.org/445858 | 07:23 |
| kristian__ | hey everyone | 07:26 |
| *** reidrac has joined #openstack-kolla | 07:31 | |
| *** magicboiz has joined #openstack-kolla | 07:31 | |
| *** lpetrut has joined #openstack-kolla | 07:34 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Apply neutron database migration https://review.openstack.org/407922 | 07:35 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Apply neutron database migration https://review.openstack.org/407922 | 07:36 |
| *** lpetrut has quit IRC | 07:43 | |
| *** egonzalez has joined #openstack-kolla | 07:47 | |
| *** itlinux has quit IRC | 07:47 | |
| *** manheim has joined #openstack-kolla | 07:50 | |
| *** shardy has joined #openstack-kolla | 07:52 | |
| *** kristian__ has quit IRC | 07:54 | |
| *** kristian__ has joined #openstack-kolla | 07:55 | |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: Changed fluentd repository for CentOS/RHEL/Oraclelinux https://review.openstack.org/467219 | 07:55 |
| *** vharsh has quit IRC | 07:58 | |
| *** kiennt has joined #openstack-kolla | 08:04 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Revert "Fix a typo and complement doc in ceph-guide.rst" https://review.openstack.org/475611 | 08:05 |
| kristian__ | inc0: could you help me do the veth with bridge on my server? | 08:06 |
| *** jascott1 has joined #openstack-kolla | 08:09 | |
| *** jascott1 has quit IRC | 08:15 | |
| *** jbadiapa_ is now known as jbadiapa | 08:18 | |
| openstackgerrit | jiriprox proposed openstack/kolla master: Enable config parameter opendaylight_distro propagation to dockerfile. https://review.openstack.org/482974 | 08:18 |
| *** serlex has joined #openstack-kolla | 08:18 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fluentd kolla change https://review.openstack.org/482528 | 08:18 |
| egonzalez | jbadiapa, around? | 08:20 |
| jbadiapa | egonzalez, yep | 08:20 |
| *** blallau has joined #openstack-kolla | 08:21 | |
| egonzalez | jbadiapa, you know what is fluentd /var/run/? defaults? | 08:21 |
| openstackgerrit | Merged openstack/kolla master: Fix gnocchi in version_check script https://review.openstack.org/482162 | 08:21 |
| egonzalez | tested fluentd and fluent but none seems to work | 08:21 |
| openstackgerrit | Merged openstack/kolla master: Remove ignore tempest project in version-check https://review.openstack.org/482171 | 08:22 |
| jbadiapa | let me check it | 08:22 |
| reidrac | egonzalez: I may give it a go today | 08:24 |
| jbadiapa | egonzalez, the /var/run/fluentd directory needs to be created because is used by the configuration of the fluentd-filters | 08:28 |
| egonzalez | jbadiapa, yep, but with tg-agent it was present without creation | 08:28 |
| egonzalez | is there any other dir created by fluentd instead of create the directory. I can change the path in ansible to match the existing directory | 08:29 |
| jbadiapa | egonzalez, I think because it is created by the rpm | 08:29 |
| *** athomas has joined #openstack-kolla | 08:30 | |
| egonzalez | jbadiapa, yep is created by the ini script https://github.com/treasure-data/td-agent/blob/master/redhat/td-agent.init#L40 | 08:30 |
| egonzalez | jbadiapa, thanks, lets see if the latest change make gates green | 08:31 |
| jbadiapa | egonzalez, thx to you for the help | 08:32 |
| reidrac | fluentd itselg is not using that dir | 08:32 |
| reidrac | I think creating it in the Dockerfile sounds good | 08:32 |
| jbadiapa | reidrac, It's the configuration which makes /var/run/fluentd directory needed | 08:34 |
| reidrac | jbadiapa: OK, thanks; keep up the good work, it is getting there! | 08:34 |
| jbadiapa | reidrac, thanks | 08:35 |
| serlex | egonzalez: I did have my globals.yml incorrect yesterday, thanks, https all good now | 08:36 |
| reidrac | egonzalez: I have potentially bad news; I've been moved to a different project and it is unclear if I'll be working on Kolla short term | 08:37 |
| egonzalez | serlex, cool, maybe some services are not able to communicate internally between them, if found one of them let us know to point to internalURL | 08:37 |
| reidrac | I'm handing it over, but I can't tell if/when it'll be continued | 08:37 |
| egonzalez | reidrac, sorry to hear that :( | 08:38 |
| *** sbezverk has quit IRC | 08:39 | |
| reidrac | I'll try to wrap up the fluentd packages so at least that blocker is gone once jbadiapa change is merged | 08:39 |
| reidrac | egonzalez: yes; shame because I really enjoy working on Kolla, but that's how this things go :) | 08:39 |
| reidrac | I may be back at some point anyway | 08:40 |
| jbadiapa | reidrac, ops, that's a bad news :( | 08:44 |
| openstackgerrit | Merged openstack/kolla-ansible master: Clean some Boolean condition checks https://review.openstack.org/480225 | 08:48 |
| manheim | do you guys know how can I delete all my repos from dockerhub? not the gui mode | 08:54 |
| *** karimb has joined #openstack-kolla | 08:56 | |
| *** tvignaud has quit IRC | 08:58 | |
| *** reidrac_ has joined #openstack-kolla | 09:00 | |
| *** reidrac has quit IRC | 09:03 | |
| openstackgerrit | jiriprox proposed openstack/kolla master: Enable config parameter opendaylight_distro propagation to dockerfile. https://review.openstack.org/482974 | 09:05 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware support to ceilometer https://review.openstack.org/462842 | 09:06 |
| *** gfidente has joined #openstack-kolla | 09:06 | |
| *** tvignaud has joined #openstack-kolla | 09:11 | |
| *** mgoddard_ has joined #openstack-kolla | 09:13 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Support configuration of custom fluentd outputs https://review.openstack.org/483026 | 09:15 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware DVS support to kolla-ansible https://review.openstack.org/459270 | 09:17 |
| *** kristia__ has joined #openstack-kolla | 09:18 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware DVS support to kolla-ansible https://review.openstack.org/459270 | 09:20 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Revert "Add default_boot_option configuration" https://review.openstack.org/479850 | 09:21 |
| *** kristian__ has quit IRC | 09:21 | |
| *** sambetts_ is now known as sambetts | 09:23 | |
| *** gfidente has quit IRC | 09:25 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add Swift backend support to Glance https://review.openstack.org/452059 | 09:26 |
| *** gfidente has joined #openstack-kolla | 09:28 | |
| *** gfidente has quit IRC | 09:28 | |
| *** gfidente has joined #openstack-kolla | 09:28 | |
| openstackgerrit | Merged openstack/kolla stable/ocata: Install net-tools for neutron-base container https://review.openstack.org/482998 | 09:32 |
| *** yingjun has quit IRC | 09:35 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vSphere support to nova_compute https://review.openstack.org/449529 | 09:36 |
| *** vharsh has joined #openstack-kolla | 09:38 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Set api_v2 to True in image-feature-enabled https://review.openstack.org/482770 | 09:40 |
| *** karimb has quit IRC | 09:44 | |
| *** karimb has joined #openstack-kolla | 09:46 | |
| openstackgerrit | jiriprox proposed openstack/kolla master: Fix handling of opendaylight_distro parameter https://review.openstack.org/482974 | 09:50 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix depends-on kolla gates https://review.openstack.org/482053 | 10:07 |
| *** kiennt has quit IRC | 10:09 | |
| *** reidrac_ has quit IRC | 10:09 | |
| *** reidrac has joined #openstack-kolla | 10:09 | |
| *** reidrac has quit IRC | 10:13 | |
| *** reidrac has joined #openstack-kolla | 10:14 | |
| *** jamesbenson has joined #openstack-kolla | 10:18 | |
| *** jamesbenson has quit IRC | 10:22 | |
| *** tovin07_ has quit IRC | 10:24 | |
| *** gfidente has quit IRC | 10:25 | |
| *** gfidente has joined #openstack-kolla | 10:28 | |
| openstackgerrit | Merged openstack/kolla master: Fix Horizon container starting if Watcher is enabled https://review.openstack.org/483086 | 10:36 |
| *** karimb_ has joined #openstack-kolla | 10:36 | |
| *** duonghq has quit IRC | 10:38 | |
| *** karimb has quit IRC | 10:38 | |
| *** zhurong has quit IRC | 10:43 | |
| *** lpetrut has joined #openstack-kolla | 10:45 | |
| *** ansmith has quit IRC | 10:46 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware DVS support to kolla-ansible https://review.openstack.org/459270 | 11:09 |
| *** gfidente has quit IRC | 11:26 | |
| openstackgerrit | Pavel Gluschak (scsnow) proposed openstack/kolla-ansible master: Make cinder-backup service optional https://review.openstack.org/464620 | 11:28 |
| *** gfidente has joined #openstack-kolla | 11:30 | |
| *** gfidente has quit IRC | 11:30 | |
| *** gfidente has joined #openstack-kolla | 11:30 | |
| *** jascott1 has joined #openstack-kolla | 11:35 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Migrate cinder-api under apache https://review.openstack.org/471753 | 11:37 |
| *** lpetrut_ has joined #openstack-kolla | 11:38 | |
| egonzalez | jbadiapa, I'm looking a bit deeper into fluentd package from opstools. Noticed they have files owned by root by default. What can affect this to kolla? I'm starting to get worried about possible mismatch between centos's fluentd and official fluentd packages | 11:40 |
| *** jascott1 has quit IRC | 11:41 | |
| *** lpetrut has quit IRC | 11:41 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: DNM: test master branch https://review.openstack.org/456140 | 11:41 |
| egonzalez | jbadiapa, https://github.com/centos-opstools/fluentd/blob/master/fluentd.spec#L147 | 11:43 |
| jbadiapa | egonzalez, afaik that was for a problem getting logs for all the openstack services, that most of the logs are only read by the owner | 11:49 |
| *** awiddersheim has quit IRC | 11:49 | |
| *** awiddersheim has joined #openstack-kolla | 11:50 | |
| jbadiapa | egonzalez,is there a way of checking the content of the fluentd container on the gate? | 11:50 |
| egonzalez | jbadiapa, nope, fluentd does not store logs we can do a docker logs fluentd, give me a sec | 11:51 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fluentd kolla change https://review.openstack.org/482528 | 11:54 |
| reidrac | that fluentd doesn't store logs is kind of funny, isn't it? :) | 11:54 |
| egonzalez | jbadiapa, once gates finish, can see logs in logs/docker_logs/fluentd | 11:55 |
| jbadiapa | egonzalez, we are going to see the same, I would like to see the content of this file /var/lib/kolla/config_files/filter/00-record_transformer.conf inside the fluentd container | 11:57 |
| egonzalez | jbadiapa, http://logs.openstack.org/28/482528/4/check/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv/f29bab2/logs/kolla_configs/fluentd/filter/00-record_transformer.conf | 12:00 |
| *** dave-mccowan has joined #openstack-kolla | 12:01 | |
| egonzalez | jbadiapa, all configs used by ansible http://logs.openstack.org/28/482528/4/check/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv/f29bab2/logs/kolla_configs/fluentd/ | 12:01 |
| openstackgerrit | Merged openstack/kolla-ansible master: Only use br-tun on network and compute nodes https://review.openstack.org/463509 | 12:08 |
| jbadiapa | egonzalez, thx, looking at them | 12:10 |
| openstackgerrit | Pavel Gluschak (scsnow) proposed openstack/kolla master: Ensure interface exists before adding OVS port https://review.openstack.org/477884 | 12:12 |
| *** schwicht has joined #openstack-kolla | 12:22 | |
| *** schwicht has quit IRC | 12:30 | |
| *** hrw has quit IRC | 12:30 | |
| *** ducttape_ has joined #openstack-kolla | 12:31 | |
| *** hrw has joined #openstack-kolla | 12:32 | |
| *** rwsu has joined #openstack-kolla | 12:32 | |
| *** schwicht has joined #openstack-kolla | 12:38 | |
| *** rwsu has quit IRC | 12:39 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements https://review.openstack.org/474652 | 12:39 |
| *** ansmith has joined #openstack-kolla | 12:41 | |
| *** deep-book-gk_ has joined #openstack-kolla | 12:41 | |
| *** prateek has quit IRC | 12:41 | |
| *** deep-book-gk_ has left #openstack-kolla | 12:43 | |
| *** ducttape_ has quit IRC | 12:44 | |
| *** gillesMo has joined #openstack-kolla | 12:45 | |
| *** pbourke has quit IRC | 12:45 | |
| *** pbourke has joined #openstack-kolla | 12:47 | |
| openstackgerrit | Pavel Gluschak (scsnow) proposed openstack/kolla-ansible master: Make cinder-backup service optional https://review.openstack.org/464620 | 12:49 |
| egonzalez | pbourke, any idea why oracle source gates randomly fail with this error? NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'scheduler_fanout' in vhost '/' | 12:50 |
| pbourke | egonzalez: no... got a link to an example? | 12:51 |
| *** blallau has quit IRC | 12:51 | |
| egonzalez | pbourke, http://logs.openstack.org/70/459270/21/check/gate-kolla-ansible-dsvm-deploy-multinode-oraclelinux-source-centos-7-2-node-nv/cb9d7c6/logs/subnodes/centos-7-2-node-osic-cloud1-s3500-9817897-706346/logs/kolla/nova/nova-compute.log | 12:51 |
| egonzalez | this is a multinode, first nova-compute works fine and is able to boot an instance, but the subnode have the error | 12:52 |
| *** kristia__ has quit IRC | 12:55 | |
| *** kristian__ has joined #openstack-kolla | 12:56 | |
| *** kristian__ has quit IRC | 12:56 | |
| *** kristian__ has joined #openstack-kolla | 12:56 | |
| *** mattmceuen has quit IRC | 12:58 | |
| *** schwicht has quit IRC | 12:58 | |
| *** sbezverk has joined #openstack-kolla | 13:02 | |
| *** mdnadeem has quit IRC | 13:03 | |
| sbezverk | rwellum : ping | 13:03 |
| *** vharsh has quit IRC | 13:04 | |
| rwellum | sbezverk: nearly there! | 13:07 |
| sbezverk | rwellum ok | 13:07 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla stable/ocata: Adding targetcli tool to cinder-volume https://review.openstack.org/483377 | 13:09 |
| *** skramaja has quit IRC | 13:10 | |
| *** ducttape_ has joined #openstack-kolla | 13:10 | |
| *** rhallisey has quit IRC | 13:11 | |
| *** goldyfruit has joined #openstack-kolla | 13:11 | |
| *** rhallisey has joined #openstack-kolla | 13:12 | |
| *** schwicht has joined #openstack-kolla | 13:17 | |
| sbezverk | rwellum : if you are not far, please rejoin, it was a false alarm, really sorry | 13:17 |
| rwellum | sure 1s sbezverk | 13:17 |
| jbadiapa | egonzalez, have you got a minute? | 13:22 |
| egonzalez | jbadiapa, sure | 13:23 |
| jbadiapa | egonzalez, the problem with the oraclelinux is that the hostname parameter is not installed by default on the base image. | 13:23 |
| egonzalez | hrm, why was working before :/ | 13:24 |
| jbadiapa | apparently only the fluentd image is the one complaining about it, I'm going to add it on the fluentd images. | 13:25 |
| jbadiapa | I dont know, maybe the td-agent is using differently | 13:26 |
| egonzalez | jbadiapa, INFO:kolla.image.build.fluentd:--> Processing Dependency: hostname for package: initscripts-9.49.37-1.0.1.el7_3.1.x86_64 | 13:27 |
| egonzalez | thats why was working | 13:27 |
| egonzalez | tg-agent uses init | 13:28 |
| jbadiapa | I'm going to add that dependancy on the fluentd rpm for opstools | 13:28 |
| egonzalez | thanks! | 13:30 |
| *** omenvl has quit IRC | 13:31 | |
| *** ducttape_ has quit IRC | 13:31 | |
| jbadiapa | egonzalez, but it's not going to deliver it soon | 13:31 |
| egonzalez | jbadiapa, can add it to fluentd package list with a TODO note for removal | 13:31 |
| jbadiapa | sure | 13:32 |
| *** mattmceuen has joined #openstack-kolla | 13:33 | |
| *** omenv has joined #openstack-kolla | 13:34 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Remove Kafka from Infrastructure components list https://review.openstack.org/483395 | 13:36 |
| *** jascott1 has joined #openstack-kolla | 13:38 | |
| *** jascott1 has quit IRC | 13:44 | |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: Changed fluentd repository for CentOS/RHEL/Oraclelinux https://review.openstack.org/467219 | 13:54 |
| openstackgerrit | Pavel Gluschak (scsnow) proposed openstack/kolla master: Ensure interface exists before adding OVS port https://review.openstack.org/477884 | 14:02 |
| *** jtriley has joined #openstack-kolla | 14:03 | |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: Changed fluentd repository for CentOS/RHEL/Oraclelinux https://review.openstack.org/467219 | 14:05 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Make docs gate fail with warnings https://review.openstack.org/483405 | 14:05 |
| *** hongbin has joined #openstack-kolla | 14:06 | |
| *** emccormick has joined #openstack-kolla | 14:06 | |
| *** jamesbenson has joined #openstack-kolla | 14:06 | |
| *** jamesbenson has quit IRC | 14:11 | |
| sbezverk | egonzalez : do you want me to open a bug for the backport I pushed this morning? | 14:16 |
| egonzalez | sbezverk, im not sure in this case of the policy, since is a backport | 14:17 |
| sbezverk | egonzalez I will check then with inc0 | 14:17 |
| *** athomas has quit IRC | 14:19 | |
| *** athomas has joined #openstack-kolla | 14:20 | |
| *** itlinux_ has joined #openstack-kolla | 14:23 | |
| *** jamesbenson has joined #openstack-kolla | 14:24 | |
| *** ducttape_ has joined #openstack-kolla | 14:26 | |
| *** vhosakot has joined #openstack-kolla | 14:36 | |
| *** eaguilar has joined #openstack-kolla | 14:38 | |
| *** ducttape_ has quit IRC | 14:39 | |
| jamesbenson | morning all :-) | 14:40 |
| *** itlinux_ has quit IRC | 14:42 | |
| *** serlex has quit IRC | 14:44 | |
| *** lucasxu has joined #openstack-kolla | 14:46 | |
| *** schwicht has quit IRC | 14:48 | |
| *** schwicht has joined #openstack-kolla | 14:49 | |
| *** vhosakot has quit IRC | 14:55 | |
| *** vhosakot has joined #openstack-kolla | 14:56 | |
| jamesbenson | inc0: ping? | 15:00 |
| *** jamesbenson has left #openstack-kolla | 15:01 | |
| *** jamesbenson has joined #openstack-kolla | 15:01 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Support configuration of custom fluentd outputs https://review.openstack.org/483026 | 15:02 |
| *** vhosakot_ has joined #openstack-kolla | 15:03 | |
| *** vhosakot has quit IRC | 15:05 | |
| *** ducttape_ has joined #openstack-kolla | 15:05 | |
| *** vhosakot_ has quit IRC | 15:06 | |
| *** serlex has joined #openstack-kolla | 15:06 | |
| *** vhosakot has joined #openstack-kolla | 15:06 | |
| *** serlex has left #openstack-kolla | 15:07 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove doc build errors https://review.openstack.org/483405 | 15:08 |
| *** lucasxu has quit IRC | 15:09 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove doc build errors https://review.openstack.org/483405 | 15:11 |
| *** janki has quit IRC | 15:17 | |
| *** gbc has joined #openstack-kolla | 15:18 | |
| *** yingjun has joined #openstack-kolla | 15:20 | |
| *** ducttap__ has joined #openstack-kolla | 15:20 | |
| gbc | hi ... anyone willing to help a newbie troubleshoot a deployment issue? | 15:20 |
| Reepicheep | gbc: what do you have going on? | 15:22 |
| gbc | deployment fails at TASK [mariadb : Waiting for MariaDB service to be ready | 15:23 |
| gbc | i think it's trying to connect to the DB port, but can't ... | 15:23 |
| *** ducttape_ has quit IRC | 15:23 | |
| gbc | what i suspect is happening is that the database is running inside the 'mariadb' container, but that the port hasn't been exposed | 15:24 |
| Reepicheep | gbc: and this is a fresh deploy? allinone or multinode? | 15:24 |
| gbc | fresh .. multinode | 15:24 |
| openstackgerrit | Matthias Runge proposed openstack/kolla master: Add collectd-disk plugin https://review.openstack.org/483444 | 15:25 |
| Reepicheep | have you looked at the mariadb logs? | 15:25 |
| Reepicheep | on the nodes that have the mariadb containers, probably your controllers, /var/lib/docker/volumes/kolla_logs/_data/mariadb/mariadb.log | 15:26 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla master: Fix doc build warnings https://review.openstack.org/483445 | 15:26 |
| gbc | yes, i've looked at mariadb logs ... | 15:27 |
| gbc | the only thing suspicious is ... | 15:27 |
| gbc | 170712 21:59:43 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) at gcomm/src/pc.cpp:connect():158 170712 21:59:43 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) 170712 21:59:43 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1404: Failed to open channel 'openstack' at 'gcomm://10.0.20 | 15:27 |
| Reepicheep | how many controllers do you have? | 15:27 |
| gbc | three | 15:28 |
| Reepicheep | and your configs passed the prechecks? | 15:29 |
| *** manheim has quit IRC | 15:30 | |
| gbc | yes ... just ran prechecks again to make sure ... no failures | 15:31 |
| rwellum | pin sbezverk | 15:31 |
| Reepicheep | gbc: can you share your globals.yml? | 15:32 |
| gbc | globals.yml -> http://www.heypasteit.com/clip/0IIOPO | 15:34 |
| Reepicheep | gbc: I don't see anything glaring wrong | 15:37 |
| Reepicheep | is that log entry on all three controllers? | 15:37 |
| gbc | let me tell you what i think is wrong ... | 15:37 |
| *** pcaruana has quit IRC | 15:38 | |
| gbc | according to kolla-ansible/ansible/roles/mariadb/tasks/start.yml, the wait_for is trying to connect to a particular IP:port ... | 15:38 |
| gbc | host: "{{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] }}" port: "{{ mariadb_port }}" | 15:38 |
| gbc | if i've traced all the config correctly, i think in my case it works out to 10.0.200.250:3306 ... | 15:38 |
| gbc | haproxy is configured to listen to that port ... | 15:39 |
| gbc | haproxy is configured to forward to my three controllers ... | 15:39 |
| gbc | the controllers are at 10.0.200.[10, 11, 12] ... | 15:40 |
| sbezverk | rwellum please do not pin me ;) | 15:40 |
| Reepicheep | the galara cluster doesn't actually use haproxy for the intercomunication between nodes | 15:40 |
| rwellum | :) | 15:40 |
| rwellum | typing... | 15:41 |
| gbc | if i do a netstat on the deployment host, i see haproxy listening to 10.0.200.250:3306 | 15:41 |
| rwellum | sbezverk: I have about 30m now? | 15:41 |
| *** unicell has joined #openstack-kolla | 15:41 | |
| *** unicell has joined #openstack-kolla | 15:41 | |
| *** unicell1 has quit IRC | 15:41 | |
| sbezverk | rwellum: sounds good | 15:41 |
| gbc | if i do a netstat on the controllers, i do not see anybody listening to 10.0.200.[10,11,12]:3306 | 15:41 |
| gbc | the database is running inside the mariadb container ... | 15:41 |
| Reepicheep | let me look maybe it does.. I know the FIP uses it | 15:42 |
| gbc | i don't think the mariadb container is exposing those ports to the outside work | 15:42 |
| gbc | world* | 15:42 |
| Reepicheep | gbc: it should only expose it to the private network | 15:42 |
| gbc | here's haproxy.cfg snippet ... | 15:43 |
| gbc | listen mariadb mode tcp timeout client 3600s timeout server 3600s option tcplog option tcpka option mysql-check user haproxy post-41 bind 10.0.200.250:3306 server kolla10 10.0.200.10:3306 check inter 2000 rise 2 fall 5 server kolla11 10.0.200.11:3306 check inter 2000 rise 2 fall 5 backup server kolla12 10.0.200.12:3306 check inter 2000 rise 2 fall 5 backup | 15:43 |
| Reepicheep | gbc: mariadb / galara listens on a differnt port 4567 for interconnections instead of 3306 | 15:44 |
| Reepicheep | gbc: how familiar are you with galara? | 15:45 |
| gbc | true ... but according to kolla-ansible/ansible/group_vars/all.yml ... | 15:46 |
| gbc | database_port: "3306" | 15:46 |
| gbc | mariadb_port: "{{ database_port }}" | 15:46 |
| egonzalez | gbc, database port is for client communication | 15:47 |
| gbc | (i'm not familar with galara at all) | 15:47 |
| Reepicheep | yeah. that is for other services to access the database but the galara cluster needs to directly access each node | 15:47 |
| egonzalez | are mariadb containers running? what kolla version? | 15:47 |
| Reepicheep | so basicly when a galara cluster is started one node needs to start first as a bootstrap node | 15:47 |
| gbc | yes, mariadb containers are running (10.0.200.10:5379/kolla/ubuntu-source-mariadb:4.0.2) | 15:48 |
| Reepicheep | then the other nodes sync with that bootstap node direectly.. after that the bootstrap nod is rebooted and joins the cluster a a full member | 15:48 |
| Reepicheep | so yeah. I would guess the error you are seeing is on one of the nodes trying to connect to the bootstrap node to sync / join and the connection is failing | 15:49 |
| *** lucasxu has joined #openstack-kolla | 15:49 | |
| gbc | what's failing is the wait_for command in kolla-ansible/ansible/roles/mariadb/tasks/start.yml | 15:50 |
| gbc | and the wait_for command is trying to connect to mariadb_port ... | 15:50 |
| gbc | which is defined in kolla-ansible/ansible/group_vars/all.yml to be 3306 ... | 15:51 |
| gbc | which is assigned to haproxy ... which tries to pass the connection on to the mariadb container | 15:52 |
| egonzalez | gbc, Reepicheep is right, you are noticing the error in wait_for step, but root cause is likely produced because galera has not created the cluster | 15:52 |
| gbc | ok | 15:52 |
| egonzalez | hence, mariadb nodes are not listening in 3306 because cannot connect the cluster | 15:52 |
| egonzalez | gbc, is there a bootstrap_mariadb container? | 15:53 |
| egonzalez | please share logs from /var/lib/docker/volumes/kolla_logs/_data/mariadb | 15:53 |
| *** karimb_ has quit IRC | 15:54 | |
| Reepicheep | egonzalez: do you know if there is a system to tell which node will be used to bootstrap? | 15:54 |
| *** reidrac has quit IRC | 15:55 | |
| Reepicheep | is it the first one listed in inventory? | 15:55 |
| gbc | egonzalez, there is no bootstrap_mariadb container on any of the controller nodes | 15:55 |
| gbc | egonzalez, is there a convenient site for me to upload mariadb logs? | 15:55 |
| egonzalez | gbc, paste.openstack.org | 15:55 |
| egonzalez | Reepicheep, inventory_hostname == groups['mariadb'][0] | 15:56 |
| Reepicheep | egonzalez: i see, thanks, so you can determine which node will be the bootstrap node | 15:58 |
| Reepicheep | I have always just watched the ansible output to see which one it used :| | 15:58 |
| gbc | (still trying to move logs around so i can paste them...) | 16:00 |
| *** serlex has joined #openstack-kolla | 16:02 | |
| *** kristia__ has joined #openstack-kolla | 16:04 | |
| *** lucasxu has quit IRC | 16:04 | |
| *** schwicht has quit IRC | 16:06 | |
| *** athomas has quit IRC | 16:06 | |
| *** kristian__ has quit IRC | 16:07 | |
| gbc | mariadb logs -> http://paste.openstack.org/show/615288/ | 16:07 |
| *** schwicht has joined #openstack-kolla | 16:08 | |
| *** gillesMo has quit IRC | 16:10 | |
| Reepicheep | gbc is a mariadb container running on that node? | 16:10 |
| *** manheim has joined #openstack-kolla | 16:10 | |
| Reepicheep | you should see port listening on port 4567 on the host | 16:11 |
| gbc | reppicheep, yes, a mariadb container is running | 16:11 |
| gbc | reppicheep, yes i see mysqld listening to port 4567 | 16:12 |
| Reepicheep | you can also test it by connecting to it directly | 16:12 |
| Reepicheep | gbc: what are the logs on the other two nodes? | 16:14 |
| gbc | reppicheep, how would i connect to the port directly .. i tried "mysql -P 4567 -e 'show databases;'", but got an error "ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)" | 16:15 |
| *** manheim has quit IRC | 16:15 | |
| *** saneax has quit IRC | 16:18 | |
| gbc | reppicheepm, mariadb logs from second controller node ... http://paste.openstack.org/show/615290/ | 16:19 |
| Reepicheep | gbc: try this to connect directly "docker exec -ti mariadb mysql -uroot -p -h <the nodes ip>" | 16:20 |
| Reepicheep | the password is in your password.yml file | 16:21 |
| *** lucasxu has joined #openstack-kolla | 16:21 | |
| gbc | reepicheep, mariadb logs from third controller node -> http://paste.openstack.org/show/615292/ | 16:22 |
| Reepicheep | so it looks like your first node has the bootstrap container up but the other two are timing out when connecting | 16:25 |
| Reepicheep | gbc: you have no firewall on the nodes correct? and what version of docker? | 16:27 |
| *** vhosakot_ has joined #openstack-kolla | 16:28 | |
| gbc | reepicheep: docker version Client: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Tue Jan 10 20:38:45 2017 OS/Arch: linux/amd64 | 16:28 |
| Reepicheep | that should be fine | 16:28 |
| gbc | reepicheep: not aware of any firewalls ... it's a fresh ubuntu 16.04 server cloud image | 16:29 |
| gbc | reepicheep: regarding connecting to db directly, i tried the "database_password" from /etc/kolla/passwords.yml, but got a "connection refused" error | 16:31 |
| *** vhosakot has quit IRC | 16:32 | |
| Reepicheep | gbc: and that was from the first node correct? | 16:33 |
| gbc | reepicheep: connecting to db directly? i've tried it on all three controllers. same result | 16:34 |
| inc0 | good morning | 16:36 |
| jamesbenson | morning inc0 | 16:36 |
| gbc | reepicheep: dump docker question .. if I do a "docker inspect mariadb", look under NetworkSettings, I see "Ports": {}, ... does that mean there's no port mapping between host and container? | 16:37 |
| Reepicheep | gbc: there is a chance that you can't do that until the cluster is up | 16:37 |
| inc0 | gbc: kolla-ansible runs net=host everywhere | 16:37 |
| *** schwicht has quit IRC | 16:38 | |
| inc0 | so you'll see hosts networking stack inside container, so no need for port mapping | 16:38 |
| gbc | inc0: ok, thanks for clarification | 16:38 |
| jamesbenson | inc0: I was looking at the docs, are the only network interfaces that need external access: kolla_external_vip_interface, neutron_external_interface & dns_interface (if you are using designate)? all else no outside access? | 16:40 |
| inc0 | yup, that's correct | 16:40 |
| inc0 | and only nodes that requres external network are ones from group [network] | 16:41 |
| jamesbenson | controllers? | 16:41 |
| inc0 | netwrork nodes, not controllers | 16:41 |
| jamesbenson | interesting, okay. | 16:41 |
| inc0 | controllers doesn't need external networking | 16:41 |
| inc0 | haproxy lands on network nodes in kolla | 16:42 |
| *** lpetrut_ has quit IRC | 16:42 | |
| jamesbenson | yeah I saw that... cool | 16:42 |
| jamesbenson | you use ceph and your storage is internal 100%? | 16:42 |
| jamesbenson | storage_interface | 16:42 |
| inc0 | yeah | 16:42 |
| jamesbenson | weird, because I had to put that external to work properly... | 16:42 |
| inc0 | yeah, that's weird, you shouldn't have to | 16:43 |
| inc0 | anyway, maybe that was quirk of network conf in your case | 16:43 |
| jamesbenson | so I have 2 ports, eno1 (internal) and a bridge (with my eno2, external, tied to veno0 and veno1) | 16:44 |
| *** itlinux has joined #openstack-kolla | 16:45 | |
| jamesbenson | I have network_interface: eno1; kolla_external_vip: br0; neutron_external_interface: "veno1"; | 16:46 |
| jamesbenson | I also have the storage_interface: "br0" | 16:46 |
| *** reidrac has joined #openstack-kolla | 16:47 | |
| inc0 | I don't know what to tell, mtu maybe? | 16:47 |
| inc0 | especially that it was ceph-mons that hung | 16:48 |
| jamesbenson | for the storage? | 16:48 |
| inc0 | and they use cluster interface to communicate | 16:48 |
| inc0 | yeah, no idea tho, shooting blind | 16:48 |
| *** mgoddard_ has quit IRC | 16:48 | |
| jamesbenson | okay, well I just want to get it right for the doc too | 16:49 |
| *** rwsu has joined #openstack-kolla | 16:49 | |
| jamesbenson | also, bringing up 2 veths for cent is complicated and long, all of this info might be good for a separate page? | 16:50 |
| gbc | reepicheep: i appreciate you trying to help me out ... i'll look more closely at the galera cluster... see what i can figure out | 16:50 |
| *** egonzalez has quit IRC | 16:50 | |
| sbezverk | inc0: qq for backports, do I need to file a bug? that cinder-volume PS got merged into master, but I need it in stable/ocata. | 16:51 |
| inc0 | sbezverk: yes, you need bug for backport | 16:51 |
| sbezverk | inc0: even if it is not an actual issue fix, right? | 16:52 |
| inc0 | well, technically then we should not backport | 16:52 |
| inc0 | at all | 16:52 |
| inc0 | (that's why I keep saying that we need to move kolla-k8s to master) | 16:52 |
| sbezverk | inc0: we already have some jobs on master, but not all | 16:53 |
| sbezverk | so to test ocata, that fix needs to be in ocata images | 16:53 |
| inc0 | yes, but I assume this thing is new, so new jobs? | 16:54 |
| inc0 | can we move it to master then | 16:54 |
| inc0 | ? | 16:54 |
| inc0 | I mean Kolla is stable project, which means we don't backport features. While adding one package to install is debatable if that's an feature | 16:54 |
| inc0 | reason we're in this place is because kolla-k8s is not based of master images as kolla-ansible is | 16:54 |
| sbezverk | inc0: https://review.openstack.org/#/c/483377/ | 16:55 |
| sbezverk | here what I was talking about.. | 16:55 |
| inc0 | and really I like methodology that deploying version X of kolla-k8s means version X of kolla images | 16:55 |
| Reepicheep | gbc: you may try stopping and removing the docker containers and the volumes for mariadb on all your nodes and deploy again | 16:55 |
| Reepicheep | gbc: only because this is a fresh deploy ^ ^ | 16:55 |
| inc0 | brb | 16:56 |
| *** inc0 has quit IRC | 16:56 | |
| *** ducttap__ has quit IRC | 16:57 | |
| sbezverk | inc0: or two have code supporting 2 max 3 versions which are all tested and certified by the gate. I think it gives more confidence that upgrade from one version to another does not break too much.. | 16:57 |
| *** inc0 has joined #openstack-kolla | 16:57 | |
| inc0 | duh my weechat is acting up | 16:57 |
| inc0 | anyway, sbezverk you see why I don't want to change stable images without good reason to right | 16:58 |
| inc0 | ? | 16:58 |
| *** shardy has quit IRC | 16:58 | |
| sbezverk | inc0: absolutely, but what should I do then? | 16:58 |
| inc0 | I'd say keep ocata gates using old style iscsi and when this job moves to Pike move to lioadm? | 16:59 |
| gbc | reepicheep:i'll try that (i'll try anything:) ... thx | 16:59 |
| sbezverk | inc0: that is an option, but then it will take long time and somebody wanted to have lioadm asap | 17:00 |
| inc0 | in images, yes | 17:00 |
| sbezverk | basically to complete this ordeal only one change left is this one, after that we are all done | 17:01 |
| inc0 | and ansible:) | 17:01 |
| inc0 | issue was (afair) that rdo won't supply us with old pkg | 17:01 |
| inc0 | sdake: help me out here, you know more about red hat repos | 17:02 |
| sbezverk | inc0: sure I can work with ansible expert to show what is done on k8s side so he/she could replicate | 17:02 |
| sdake | shoot | 17:02 |
| inc0 | iscsi issue | 17:02 |
| inc0 | we wanted to drop one of red hat repos right | 17:02 |
| inc0 | ?? | 17:02 |
| sbezverk | inc0: I thought they wanted to drop epel | 17:03 |
| sdake | we want to drop the mariadb repo and epel reo | 17:03 |
| inc0 | well | 17:03 |
| inc0 | epel | 17:03 |
| inc0 | I don't know what is RH and what's not | 17:03 |
| sdake | iscsi is aabout dropping epel repo | 17:03 |
| sdake | epel is a rht repo | 17:03 |
| inc0 | and only thing we need from epel was iscsi right? | 17:03 |
| sdake | inc0 i am not 100% sure - I tried building and the build fails now on teh firstfailed build | 17:03 |
| inc0 | ok, so there is no value of backporting lio to ocata becasue we keep epel in ocata | 17:03 |
| sdake | inc0 i am unclear on the value of backporting - it may be valuble it may not be | 17:04 |
| inc0 | we can drop epel in master, but that means we need to do it for both ansible and k8s and provide upgrade path | 17:04 |
| sdake | fwiw its not a feature, its a defect | 17:04 |
| sbezverk | inc0: the only value I see is that we can test it right now and be prepared for pike to support it | 17:04 |
| inc0 | sdake: how is it defect? I mean having epel is more like technical debt | 17:04 |
| inc0 | and we don't backport techdebt to stable.. | 17:05 |
| sdake | in the minds of red hat (and in my mind) using EPEL is incorrect | 17:05 |
| *** kbaegis has joined #openstack-kolla | 17:05 | |
| sdake | rdo is a standalone repo of all things needed for openstack | 17:05 |
| sbezverk | sdake: what is epel offers what other repos do not, we use some tools on k8s side from epel as well | 17:05 |
| inc0 | right, which means we can drop epel, but not in stable branch | 17:05 |
| sbezverk | I meant what IF | 17:05 |
| sdake | sbezverk lets get that out on the table then | 17:06 |
| *** unicell has quit IRC | 17:06 | |
| inc0 | sbezverk: do you know of something like that? | 17:06 |
| sbezverk | jq-1.5-1.el7.x86_64 : Command-line JSON processor | 17:06 |
| sbezverk | Repo : @epel | 17:06 |
| sbezverk | here you go | 17:06 |
| *** unicell has joined #openstack-kolla | 17:06 | |
| sbezverk | we use alot | 17:06 |
| inc0 | and it's not available outside epel? | 17:07 |
| sdake | any other packages? | 17:07 |
| *** unicell has quit IRC | 17:07 | |
| sbezverk | sdake: possibly | 17:07 |
| sbezverk | crudini thank god is not epel | 17:07 |
| sbezverk | that is the second most used tool | 17:08 |
| inc0 | so let's do this | 17:08 |
| inc0 | let's make this full fledged blueprint for Queens | 17:08 |
| inc0 | dropping epel seems to be bigger issue than just iscsi and we're month short of P-3 | 17:08 |
| inc0 | I don't want to remove epel right now only to find out we broke some use case in stable/pike | 17:09 |
| inc0 | do you agree guys? | 17:10 |
| sdake | dmsimard ping | 17:10 |
| sbezverk | inc0: +1 | 17:10 |
| dmsimard | sdake: pong | 17:10 |
| sdake | dmsimard does rht intend to ship ocata containers built from a kolla framework | 17:11 |
| inc0 | dmsimard: how important for you guys is to drop epel from images? | 17:11 |
| inc0 | in Pike | 17:11 |
| sdake | dmsimard if the answer is no - then we can do that work early in pike | 17:11 |
| inc0 | early queens* | 17:11 |
| sdake | yaqueens is what i meant | 17:11 |
| inc0 | if answer is yes, we need serious help with this | 17:11 |
| dmsimard | It's important -- RDO got rid of EPEL as a dependency since Mitaka and including it can cause nothing but trouble for us. | 17:12 |
| dmsimard | We already use an overrides file to customize the images | 17:12 |
| sdake | dmsimard we grasp its importance, we just need to know "when" its important :) | 17:12 |
| dmsimard | Can we compromise in putting the EPEL setup inside a block we can override ? | 17:12 |
| inc0 | do you have overrides that drops epel? | 17:12 |
| inc0 | I think it's already there | 17:12 |
| inc0 | let me check | 17:12 |
| dmsimard | inc0: EPEL is not inside a block that can be overridden right now | 17:12 |
| dmsimard | inc0: it's hardcoded | 17:13 |
| sdake | simply dropping epel is not sufficient | 17:13 |
| sdake | then e.g. cinder doesn't bulid | 17:13 |
| sdake | i see no harm in adding a block to drop epel however | 17:13 |
| dmsimard | sdake: meh, I don't know, I'm not actively working on this | 17:13 |
| dmsimard | sdake: mandre might have a better idea | 17:13 |
| inc0 | yeah, making it overridable is no-brainer | 17:13 |
| inc0 | but once you write overrides, let's just get rid of it alltogether early queens | 17:14 |
| inc0 | in master | 17:14 |
| inc0 | dmsimard: https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L129 | 17:14 |
| inc0 | seems overridable;) | 17:14 |
| *** sambetts is now known as sambetts|afk | 17:14 | |
| dmsimard | inc0: hm, let me see | 17:15 |
| inc0 | try having override like this | 17:15 |
| dmsimard | inc0: so we can just do a "set" on base_centos_yum_repo_packages and it'll work ? | 17:15 |
| sdake | simply dropping epel is not sufficient - containers dont build without epel | 17:16 |
| inc0 | https://paste.fedoraproject.org/paste/MI5v3perDwcLACjDZNtRrg | 17:16 |
| dmsimard | inc0: I didn't know we could do that, we can try it. | 17:16 |
| sdake | reference: https://review.openstack.org/#/c/468576/ | 17:16 |
| dmsimard | inc0: the overrides would then also need to drop scsi-target-utils from cinder-volume | 17:16 |
| inc0 | https://docs.openstack.org/kolla/latest/image-building.html ctrl-f package customisation | 17:17 |
| sdake | fwiw I think we should fix that now rather than wait aorund | 17:17 |
| dmsimard | I think we can work with that until we figure a way to drop it cleanly | 17:17 |
| inc0 | dmsimard: you can do it in same way | 17:17 |
| inc0 | sdake: let's not do it 4 weeks before end of release all I'm saying | 17:17 |
| inc0 | and do it cleanly in next release | 17:18 |
| dmsimard | sdake: I agree but reality is we're already super late on a bunch of things and we'll gladly take the path of least resistance to get going | 17:18 |
| sdake | the othe rproblem to be solved is rabbitmq | 17:18 |
| inc0 | dmsimard: so way it works is you need to set new variable with one of 3 suffixed - append, remove or override | 17:19 |
| inc0 | to modify lists of packages and stuff | 17:19 |
| dmsimard | inc0: yeah we use append, just didn't know remove was a thing | 17:19 |
| inc0 | it's a thing;) override rewrites whole thing | 17:19 |
| dmsimard | inc0: turns out someone knew remove was a thing because it's used in our overrides file -- it's just me that is a noob :p | 17:19 |
| inc0 | anyway, let's make this part of our regular images, | 17:20 |
| inc0 | or rather, make epel not a part of them | 17:20 |
| inc0 | in queens | 17:20 |
| *** serlex has quit IRC | 17:20 | |
| sdake | i've got an implementation of rabbitmq: https://review.openstack.org/#/c/468632/ | 17:20 |
| inc0 | once you figure out overrides, it should be straightforward to port them to mainline kolla | 17:20 |
| inc0 | sdake: reason we *can't* do it right now is ocata iscsi has to upgrade to pike iscsi | 17:21 |
| inc0 | which means we can't switch architectures that carelessly | 17:21 |
| sdake | inc0 not sure what rabbitmq has to do with iscsi | 17:22 |
| inc0 | dropping epel does | 17:22 |
| *** schwicht has joined #openstack-kolla | 17:22 | |
| inc0 | rabbitmq might be another issue to solve | 17:22 |
| inc0 | and jq yet another | 17:22 |
| inc0 | how much more there are? no idea. That's why I'm -1 to do it this close to release | 17:22 |
| sbezverk | inc0: so no lioadm in Ocata then? | 17:23 |
| sdake | rabbitmq should be done now - it is not dependent on epel | 17:23 |
| inc0 | sbezverk: no lioadm in ocata | 17:23 |
| sbezverk | inc0: then I will make sure new code does not touch 2/3/4 versions and concentrate on master | 17:23 |
| sdake | also our current rabbitmq implmeentation is defective (which above review fixes) | 17:23 |
| dmsimard | why is rabbitmq a problem ? | 17:23 |
| sdake | dmsimard we pull form rabbitmq.org | 17:23 |
| inc0 | thanks sbezverk let's do that | 17:24 |
| sdake | rather then rdo | 17:24 |
| sdake | dmsimard https://review.openstack.org/#/c/468632/ | 17:25 |
| *** gfidente has quit IRC | 17:26 | |
| *** harlowja has quit IRC | 17:27 | |
| *** mgoddard_ has joined #openstack-kolla | 17:27 | |
| *** kristia__ has quit IRC | 17:28 | |
| *** kristian__ has joined #openstack-kolla | 17:28 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Make Ironic inspector honour inventory https://review.openstack.org/436929 | 17:28 |
| kbaegis | sdake does it fix the outer rabbitmq? | 17:29 |
| sdake | kbaegis i dont follow | 17:29 |
| *** yingjun has quit IRC | 17:29 | |
| kbaegis | nvm :) | 17:30 |
| *** gfidente has joined #openstack-kolla | 17:30 | |
| *** gfidente has quit IRC | 17:30 | |
| *** gfidente has joined #openstack-kolla | 17:30 | |
| *** emccormick has quit IRC | 17:31 | |
| *** kristian__ has quit IRC | 17:32 | |
| sdake | 10:32:07] <@dmsimard>sdake: There's some traces on kolla before Pike (as limited tech previews) but official containerization lands in TripleO pike. | 17:32 |
| inc0 | yay | 17:33 |
| sdake | hacking around epel will probably be sufficient for that objective | 17:34 |
| sdake | mariadb needs that patch above - or some variant thereof | 17:34 |
| *** tonanhngo has joined #openstack-kolla | 17:36 | |
| *** rwsu has quit IRC | 17:38 | |
| *** unicell has joined #openstack-kolla | 17:38 | |
| *** rwsu has joined #openstack-kolla | 17:39 | |
| *** schwicht has quit IRC | 17:45 | |
| *** Manheim has joined #openstack-kolla | 17:48 | |
| inc0 | can I have reviews please? https://review.openstack.org/#/c/475940/ | 17:50 |
| *** pradk has quit IRC | 17:53 | |
| rwellum | Done inc0 | 17:55 |
| inc0 | thanks | 17:55 |
| *** krtaylor has quit IRC | 17:55 | |
| *** gfidente has quit IRC | 17:56 | |
| *** manheim_ has joined #openstack-kolla | 17:57 | |
| *** emccormick has joined #openstack-kolla | 18:02 | |
| *** jascott1 has joined #openstack-kolla | 18:02 | |
| *** manheim_ has quit IRC | 18:05 | |
| *** reidrac has quit IRC | 18:05 | |
| *** dmsimard is now known as dmsimard|afk | 18:08 | |
| *** schwicht has joined #openstack-kolla | 18:09 | |
| *** kristian__ has joined #openstack-kolla | 18:15 | |
| openstackgerrit | Thierry Vignaud proposed openstack/kolla master: scsi-target-utils doesn't exist on rhel7+ https://review.openstack.org/483496 | 18:16 |
| *** kristian__ has quit IRC | 18:18 | |
| *** schwicht has quit IRC | 18:18 | |
| openstackgerrit | Thierry Vignaud proposed openstack/kolla master: scsi-target-utils doesn't exist on rhel7+ https://review.openstack.org/474999 | 18:19 |
| *** mgoddard_ has quit IRC | 18:30 | |
| *** krtaylor has joined #openstack-kolla | 18:31 | |
| *** pcaruana has joined #openstack-kolla | 18:38 | |
| *** kristian__ has joined #openstack-kolla | 18:41 | |
| *** harlowja has joined #openstack-kolla | 18:54 | |
| rwellum | vhosakot_: any news on the submissions? | 18:55 |
| vhosakot_ | rwellum: was busy yeterday, will submit soon, all speakers should an email once i submit the talks | 18:56 |
| rwellum | vhosakot_: lemme know if you need assistance. You should have had one from sbezverk today? | 18:56 |
| vhosakot_ | cool, will do rwellum! :) | 18:56 |
| *** mgoddard_ has joined #openstack-kolla | 18:58 | |
| *** chandankumar has quit IRC | 19:00 | |
| *** ducttape_ has joined #openstack-kolla | 19:03 | |
| *** ducttape_ has quit IRC | 19:04 | |
| *** schwicht has joined #openstack-kolla | 19:04 | |
| *** ducttape_ has joined #openstack-kolla | 19:05 | |
| *** johnrambo has joined #openstack-kolla | 19:07 | |
| johnrambo | hi all | 19:08 |
| *** johnrambo is now known as Guest8505 | 19:08 | |
| Guest8505 | is posible to configure rgw + swift using kolla ? | 19:08 |
| *** Guest8505 is now known as johnrambo1 | 19:08 | |
| *** kristian__ has quit IRC | 19:14 | |
| *** kristian__ has joined #openstack-kolla | 19:15 | |
| *** sbezverk has quit IRC | 19:21 | |
| *** sbezverk has joined #openstack-kolla | 19:22 | |
| *** kbaegis has quit IRC | 19:23 | |
| *** ducttap__ has joined #openstack-kolla | 19:23 | |
| *** ducttape_ has quit IRC | 19:27 | |
| Manheim | stable/mitaka is no longer a branch in kolla? | 19:29 |
| *** kristian__ has quit IRC | 19:32 | |
| johnrambo1 | Manheim, I think does versions are obsolete | 19:35 |
| *** bmace has joined #openstack-kolla | 19:38 | |
| *** kristian__ has joined #openstack-kolla | 19:39 | |
| *** johnrambo1 has quit IRC | 19:40 | |
| *** kristian__ has quit IRC | 19:43 | |
| *** kristian__ has joined #openstack-kolla | 19:45 | |
| *** lucasxu has quit IRC | 19:50 | |
| *** pcaruana has quit IRC | 19:52 | |
| *** rhallisey has quit IRC | 19:55 | |
| *** rwallner has joined #openstack-kolla | 19:59 | |
| *** dmsimard|afk is now known as dmsimard | 20:00 | |
| *** spsurya has quit IRC | 20:01 | |
| *** rwallner has quit IRC | 20:03 | |
| *** reidrac has joined #openstack-kolla | 20:05 | |
| *** manheim_ has joined #openstack-kolla | 20:05 | |
| *** mgoddard_ has quit IRC | 20:06 | |
| *** reidrac has quit IRC | 20:09 | |
| *** manheim_ has quit IRC | 20:09 | |
| inc0 | Manheim: yeah, mitaka is eol | 20:15 |
| inc0 | you still have tags if you want to get to mitaka code tho | 20:15 |
| Manheim | yeah, I'll do it from tags | 20:15 |
| *** harlowja has quit IRC | 20:19 | |
| *** lpetrut_ has joined #openstack-kolla | 20:21 | |
| *** harlowja has joined #openstack-kolla | 20:22 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla master: Fix Horizon container starting with Watcher enabled https://review.openstack.org/483542 | 20:23 |
| *** ducttap__ has quit IRC | 20:24 | |
| *** Teck7 has joined #openstack-kolla | 20:26 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Remove warning during kolla_docker execution https://review.openstack.org/483544 | 20:31 |
| *** ducttape_ has joined #openstack-kolla | 20:32 | |
| sbezverk | inc0: which tag is used for master kolla images? | 20:36 |
| inc0 | 5.0.3 | 20:36 |
| inc0 | or sry | 20:36 |
| inc0 | 5.0.0 | 20:36 |
| jamesbenson | does anyone use tempest? | 20:37 |
| rwellum | Hey sbezverk if you use my tool you would just do --image-tag(-it) 5.0.0 :) | 20:38 |
| Manheim | yes | 20:38 |
| Manheim | <jamesbenson> i used it some days ago | 20:38 |
| *** johnrambo1 has joined #openstack-kolla | 20:38 | |
| jamesbenson | Manheim, I can't get my auths to validate, | 20:39 |
| Manheim | ocata? | 20:39 |
| sbezverk | inc0: cool, thanks. how about when 5.0.0 were pushed to docker? | 20:39 |
| jamesbenson | yeah | 20:39 |
| sbezverk | rwellum it is for the gate, I am adding master testing jobs | 20:39 |
| Manheim | hmm, i can't remember having issues on this | 20:40 |
| jamesbenson | http://paste.openstack.org/show/615317/ tempest.conf | 20:40 |
| jamesbenson | http://paste.openstack.org/show/615318/ account.yaml | 20:41 |
| jamesbenson | do these look right? I've never really played with tempest before... | 20:41 |
| *** ansmith has quit IRC | 20:41 | |
| *** krtaylor has quit IRC | 20:41 | |
| Manheim | can you paste the test output? | 20:41 |
| Manheim | try to get a tempest.conf from a CI, that's what I usually do, and adapt it after | 20:42 |
| rwellum | sbezverk: yeah be interesting to see how that works out. | 20:42 |
| inc0 | sbezverk: uhh...as we speak I'm working on doing master images in docker (they won't be tagged 5.0 tho to avoid confusion) | 20:42 |
| sbezverk | inc0: ok please share with me how you tag them, will use this tag then.. | 20:43 |
| jamesbenson | http://paste.openstack.org/show/615319/ | 20:44 |
| Manheim | also, i had some tempest issues with a stable/mitaka deployed env, there are some tempest nova tests looking for 2.1 endpoint, but nova only has 2.0 | 20:44 |
| Manheim | tempest was with mitaka tag, not latest | 20:44 |
| jamesbenson | yeah, i'm on master | 20:44 |
| *** johnrambo1 has quit IRC | 20:44 | |
| inc0 | sbezverk: so I think we'll just call them master | 20:45 |
| inc0 | when we do dockerhub publishing | 20:45 |
| inc0 | but let's not try to push this before we have it please | 20:45 |
| sbezverk | inc0: works for me | 20:45 |
| sbezverk | I am not going to push anything | 20:46 |
| inc0 | we need to manage expectations, if people will see master they'll expect it to be master | 20:46 |
| sbezverk | for now I will use 5.0.0 for tests | 20:46 |
| sbezverk | then change the code for master tag | 20:46 |
| jamesbenson | http://paste.openstack.org/show/615320/. this was my tempest run command... | 20:47 |
| inc0 | btw if you need master images, they are available in tarballs | 20:47 |
| Manheim | <jamesbenson> what command do you run there? i only worked with testr tempest functionality | 20:49 |
| sbezverk | inc0: how do I access them> | 20:49 |
| sbezverk | ? | 20:49 |
| Manheim | rally? | 20:49 |
| sbezverk | do we have registry already? | 20:49 |
| jamesbenson | Manheim is the account.yaml look right? seems like I've seen 2 different ways to set it up, maybe a version issue | 20:49 |
| inc0 | sbezverk: http://tarballs.openstack.org/kolla/images/ | 20:50 |
| Manheim | <jamesbenson> http://paste.ubuntu.com/25084360/ put something like this in tempest.conf | 20:50 |
| jamesbenson | Manheim, how does it know the auth url? I'm doing it on a remote system | 20:50 |
| sbezverk | inc0: I should be able to restore images into local dpcker image store right? | 20:50 |
| inc0 | https://github.com/openstack/kolla-ansible/blob/master/tools/setup_gate.sh#L159 | 20:51 |
| sbezverk | I mean it might not work for multinode though :( | 20:51 |
| inc0 | you can use this code to download and start registry | 20:51 |
| inc0 | there are 2 ways to do it | 20:51 |
| sbezverk | running per job registry will increate job running time | 20:52 |
| sbezverk | I think | 20:52 |
| Manheim | <jamesbenson> http://paste.ubuntu.com/25084372/ try something like this, not really sure | 20:52 |
| inc0 | easiest for k8s I think is just download and run this registry on every node and use 127.0.0.1/imagename | 20:52 |
| inc0 | sbezverk: negative | 20:52 |
| inc0 | we have this tarball cached in every region now | 20:52 |
| inc0 | so getting full set of images will be quick | 20:52 |
| sbezverk | inc0: ok cool I will give it a try for master | 20:53 |
| inc0 | docker makes 127.0.0.1 insecure registry | 20:53 |
| sbezverk | inc0: do you have code to load images from tarball into registry? | 20:55 |
| inc0 | sbezverk: you have master and ocata available this way | 20:55 |
| inc0 | sbezverk: this tarball *is* registry:) | 20:55 |
| inc0 | look what this function do | 20:55 |
| sbezverk | inc0: will do | 20:55 |
| sbezverk | thanks | 20:55 |
| *** jtriley has quit IRC | 20:55 | |
| inc0 | runs registry with -v /var/lib/registry:/tmp/kolla_registry | 20:55 |
| inc0 | and then untars contents to /tmp/kolla_registry | 20:56 |
| sbezverk | yeah I got it | 20:57 |
| inc0 | that would be awesome if we could gate on master | 20:57 |
| Manheim | <jamesbenson> i never tried doing tempest remote but it should work, I mean you put IPs in the config file anways | 21:00 |
| jamesbenson | https://aptira.com/testing-openstack-tempest-part-1/ | 21:00 |
| jamesbenson | this is the guide i followed | 21:00 |
| Manheim | oh great, let me take a look | 21:01 |
| rwellum | inc0: why not 5.0.0? | 21:02 |
| inc0 | on master? | 21:02 |
| inc0 | tfu dockerhub? | 21:02 |
| inc0 | because 5.0.0 will be actual 5.0.0 when we release it | 21:02 |
| inc0 | I want to clearly differentiate top-of-the-branch from released tag | 21:03 |
| rwellum | Ah ok | 21:03 |
| Manheim | never worked with this, I would recommend running vanilla tempest with testr | 21:04 |
| rwellum | I thought master=5.0.0 and eventually 6.0.0. etc | 21:05 |
| *** vhosakot_ has quit IRC | 21:05 | |
| jamesbenson | guide? | 21:06 |
| *** jascott1 has quit IRC | 21:06 | |
| jamesbenson | lol, I thought this was vanilla tempest :-( | 21:07 |
| *** jascott1 has joined #openstack-kolla | 21:07 | |
| *** rwallner has joined #openstack-kolla | 21:07 | |
| Manheim | it is but it has a layer on top of itm dunno how interacts with it | 21:07 |
| jamesbenson | refstack? | 21:08 |
| *** rods has left #openstack-kolla | 21:09 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding lioadm iscsi_helper support to master https://review.openstack.org/481690 | 21:09 |
| Manheim | yep, tell you what, try this http://paste.ubuntu.com/25084453/ i saw it installs tempest so this should work | 21:10 |
| *** jascott1_ has joined #openstack-kolla | 21:10 | |
| *** jascott1 has quit IRC | 21:10 | |
| Manheim | or rather 'cd ~/.tempest/' | 21:10 |
| *** jascott1_ has quit IRC | 21:14 | |
| *** jascott1 has joined #openstack-kolla | 21:17 | |
| *** jtriley has joined #openstack-kolla | 21:21 | |
| *** jascott1 has quit IRC | 21:22 | |
| *** kbaegis has joined #openstack-kolla | 21:24 | |
| *** krtaylor has joined #openstack-kolla | 21:26 | |
| *** kbaegis has quit IRC | 21:28 | |
| *** rwallner has quit IRC | 21:31 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding lioadm iscsi_helper support to master https://review.openstack.org/481690 | 21:33 |
| *** schwicht has quit IRC | 21:38 | |
| *** ansmith has joined #openstack-kolla | 21:39 | |
| *** goldyfruit has quit IRC | 21:42 | |
| jamesbenson | ng.. -bash: test: run: unary operator expected | 21:46 |
| *** ducttap__ has joined #openstack-kolla | 21:51 | |
| kfox1111 | sbezverk: https://github.com/kubernetes-incubator/external-storage/issues/99#issuecomment-315209441 :) | 21:52 |
| inc0 | sbezverk kfox1111 can kolla-k8s deploy with 4.0.3 all the way? | 21:52 |
| *** eaguilar has quit IRC | 21:52 | |
| kfox1111 | inc0: I think so. | 21:52 |
| kfox1111 | well... | 21:53 |
| kfox1111 | not sure we ever figured out the ceph cinder issue. | 21:53 |
| kfox1111 | I think I might have fixed that but can't quite remember... | 21:53 |
| sbezverk | kfox1111: of course you have figured it out | 21:54 |
| inc0 | ad this k8s issue | 21:54 |
| sbezverk | it was authentication with ceph cluster | 21:54 |
| *** ducttape_ has quit IRC | 21:54 | |
| sbezverk | inc0: I think so, I think it will work | 21:55 |
| inc0 | right, I'll try | 21:55 |
| kfox1111 | sbezverk: yeah. that rings a bell. couldn't remember if it actually merged or not though. been a crazy crazy week. my brains pretty fried. :/ | 21:55 |
| sbezverk | kfox1111: Have you tried that kube rbd thing? | 21:55 |
| kfox1111 | sbezverk: not yet. | 21:56 |
| kfox1111 | It just got released earlier today. | 21:56 |
| inc0 | btw I have an idea | 21:56 |
| sbezverk | kfox1111: Ah missed the release date ;) | 21:56 |
| inc0 | we can create pod that will serve kolla images | 21:56 |
| rwellum | sbezverk - does this look ok to make 3.x work? https://www.irccloud.com/pastebin/jaQHtPlX/ | 21:57 |
| kfox1111 | inc0: +1. | 21:57 |
| sbezverk | inc0: sure we can | 21:57 |
| inc0 | we could setup our k8s with insecure registry = kolla-registry:5000 | 21:57 |
| inc0 | and then create pod that will download tarball and serve it | 21:57 |
| kfox1111 | no insecure registries. | 21:57 |
| inc0 | well we can create secure registry | 21:57 |
| kfox1111 | +1 :) | 21:57 |
| inc0 | not sure how to do it tho, we'd need to distribute certs across cluster right? | 21:58 |
| kfox1111 | so, here's what I'm thinking for that... | 21:58 |
| kfox1111 | I've heard rumer --insecure is implied if its localhost. | 21:58 |
| inc0 | it is | 21:58 |
| sbezverk | kfox1111: I was just about to start as I added 2 jobs to the gate for master so I can test lioadm | 21:58 |
| inc0 | I've seen hack that you run registry proxy on every node | 21:59 |
| kfox1111 | so if we made a http proxy daemonset that landed on all nodes, that had a self signed cert, | 21:59 |
| inc0 | and acces via localhost | 21:59 |
| kfox1111 | and preloaded with a self signed cert for a remote docker registry container loaded as a deployment, | 21:59 |
| inc0 | yeah, I've seen it, it's hacky as hell but should work | 21:59 |
| kfox1111 | then you would own the chain of trust all the way to the node without needing anything special. | 21:59 |
| inc0 | so, you'd create set of certs in secrets | 22:00 |
| kfox1111 | yeah. | 22:00 |
| inc0 | and mount them to all the proxy containers | 22:00 |
| kfox1111 | yeah. :) | 22:00 |
| inc0 | fun small project | 22:00 |
| *** omenv has quit IRC | 22:00 | |
| kfox1111 | yup. :) | 22:00 |
| kfox1111 | could be very generic too. not just kolla. | 22:01 |
| sbezverk | guys, why you always plan for something huge | 22:01 |
| sbezverk | it will take month to implement | 22:01 |
| inc0 | sbezverk: distribution of images is pita in k8s :/ | 22:01 |
| *** saneax has joined #openstack-kolla | 22:01 | |
| kfox1111 | huge? 4 objects. a daemonset, a deployment, a svc and a secret. | 22:01 |
| inc0 | kfox1111: https://github.com/kubernetes/kubernetes/tree/master/cluster/addons/registry | 22:02 |
| *** jamesbenson has quit IRC | 22:02 | |
| sbezverk | + certificates + handling them + details with usual devils in them. | 22:02 |
| kfox1111 | inc0: yeah. something liek that. | 22:02 |
| kfox1111 | inc0: yeah. basically just those instructions put into a helm chart I think. | 22:03 |
| sbezverk | ok for me to test lioadm with new directions from inc0, I need running master | 22:03 |
| *** schwicht has joined #openstack-kolla | 22:04 | |
| sbezverk | how fast and who can develop this idea? | 22:04 |
| *** jamesbenson has joined #openstack-kolla | 22:04 | |
| kfox1111 | sbezverk: which idea? the registry? | 22:04 |
| *** jtriley has quit IRC | 22:04 | |
| *** vhosakot has joined #openstack-kolla | 22:04 | |
| sbezverk | kfox1111: yep | 22:04 |
| kfox1111 | without gate tests, probably would take me about 4 hours of work I think. I have all the building blocks already. | 22:05 |
| *** mattmceuen has quit IRC | 22:05 | |
| kfox1111 | time though is another issue. :/ | 22:05 |
| kfox1111 | its been a crazy busy week. :/ | 22:05 |
| kfox1111 | things were supposed to settle. and its just been problem after problem. :/ | 22:06 |
| *** rhallisey has joined #openstack-kolla | 22:06 | |
| sbezverk | kfox1111: I know the feeling, have almost the same since May | 22:06 |
| *** lpetrut_ has quit IRC | 22:06 | |
| kfox1111 | yeah. :/ | 22:07 |
| *** jtriley has joined #openstack-kolla | 22:07 | |
| *** jamesbenson has quit IRC | 22:08 | |
| sbezverk | kfox1111: how about I put together registry pod to serve images just to get going and then you add security when you have time? | 22:09 |
| kfox1111 | should be super easy to do that one... | 22:10 |
| kfox1111 | launch the registry as a deployment. | 22:10 |
| kfox1111 | make a service exposed as a nodeport. | 22:10 |
| kfox1111 | profit. :) | 22:10 |
| *** jtriley has quit IRC | 22:13 | |
| sbezverk | kfox1111: ok we want all these as helm charts, right? | 22:15 |
| kfox1111 | I'm thinking that is so basic maybe just one chart? | 22:16 |
| kfox1111 | aslo might be good to do that one upstream? | 22:16 |
| kfox1111 | there shouldn't be anything kolla specific about it I think. | 22:16 |
| sbezverk | kfox1111: so no common libraries then | 22:17 |
| sbezverk | kfox1111: last thing, will you have time to do it anytime soon, since it seems you have already figured it out? | 22:18 |
| kfox1111 | not sure what my time availability is. :/ | 22:18 |
| kfox1111 | I think the link inc0 gave should have all the needed bits to get a non ssl version going? | 22:19 |
| sbezverk | it has even for ssl version too | 22:19 |
| inc0 | kfox1111: trying it out but no luck so far | 22:19 |
| kfox1111 | if you can get to that bit before I can, then I can add the ssl bits. | 22:19 |
| sbezverk | so if you have no time I could give it a shot | 22:19 |
| kfox1111 | oh, nice. | 22:19 |
| kfox1111 | inc0: whats not working? | 22:20 |
| inc0 | I'm still ignorant in k8s | 22:20 |
| sbezverk | it will just take longer in my case ;) | 22:20 |
| inc0 | well proxy is up but ss -plant | grep 5000 on host returns nothing | 22:20 |
| sbezverk | kfox1111: inc0: please let me know if you decide to do it or not, so we do not duplicate efforts, I need to step out for a couple of hours.. | 22:21 |
| inc0 | sbezverk: I'll try | 22:22 |
| inc0 | it would be so nice if I'd could just say "dear kubernetes, take this local image and make it available" | 22:22 |
| inc0 | maybe some image mgmt toolset would be actually great addition to kubernetes apps | 22:23 |
| inc0 | kube-image push imageid123 --tag my-favorite-image | 22:24 |
| kfox1111 | sbezverk: will do. | 22:25 |
| kfox1111 | sbezverk: I'll ping you before I start. | 22:25 |
| kfox1111 | inc0: there's some compitition in this space probably. | 22:25 |
| kfox1111 | for example, I think artefactory supports docker images too. | 22:25 |
| kfox1111 | k8s is trying to remain agnostic to images though. | 22:26 |
| inc0 | k8s itself might very well be | 22:27 |
| inc0 | it'd be satellite service | 22:27 |
| kfox1111 | there's no reason you couldn't use snap packages as containers, or lxc images or even glance images with vm's as pods. | 22:27 |
| inc0 | it's going to be good for anyone not using quay.iop | 22:27 |
| kfox1111 | yeah. a very easy to add service on top I'm sure would be welcome. | 22:27 |
| *** rwallner has joined #openstack-kolla | 22:28 | |
| inc0 | with docker these pesky certificates would be issue | 22:28 |
| kfox1111 | localhost + hostport though shoudl work around that. | 22:29 |
| inc0 | but making small ansible that makes and distributes self signed cert should be fine | 22:29 |
| kfox1111 | no. | 22:29 |
| inc0 | well | 22:29 |
| kfox1111 | thats like using a hammer to screw in a screw. | 22:29 |
| kfox1111 | oh... btw... | 22:30 |
| inc0 | proxy thing is hacky | 22:30 |
| inc0 | ideally it would be something like running service my-registry in k8s and docker being able to just use my-registry | 22:30 |
| kfox1111 | https://www.edx.org/course/introduction-kubernetes-linuxfoundationx-lfs158x | 22:30 |
| inc0 | sweet | 22:31 |
| *** rwallner has quit IRC | 22:32 | |
| inc0 | I'm half tempted to make kolla images registry image and publiush it on my personal dockerhub;) | 22:32 |
| *** jtriley has joined #openstack-kolla | 22:32 | |
| inc0 | docker run -d inc0/kolla-ubuntu-source:master | 22:32 |
| kfox1111 | inc0: that would be cool. | 22:33 |
| inc0 | I'll just do it, it's 10min of work + upload speed | 22:33 |
| *** ducttap__ has quit IRC | 22:34 | |
| *** Manheim has quit IRC | 22:36 | |
| *** schwicht has quit IRC | 22:37 | |
| *** kbaegis has joined #openstack-kolla | 22:42 | |
| *** manheim has joined #openstack-kolla | 22:44 | |
| *** kristian__ has quit IRC | 22:47 | |
| inc0 | fun fact I just noticed | 22:47 |
| inc0 | this is totally buildable in dockerhub:D | 22:47 |
| *** kbaegis has quit IRC | 22:49 | |
| *** kbaegis has joined #openstack-kolla | 22:50 | |
| *** itlinux has quit IRC | 22:58 | |
| *** jtriley has quit IRC | 23:02 | |
| kfox1111 | hmm... | 23:12 |
| kfox1111 | yeah... probably is, isn't it... | 23:12 |
| *** kristian__ has joined #openstack-kolla | 23:12 | |
| *** schwicht has joined #openstack-kolla | 23:12 | |
| inc0 | kfox1111: yup, I'll make quay build it for me;) | 23:13 |
| kfox1111 | haven't tried quey yet. | 23:13 |
| kfox1111 | any better then docker hub? | 23:13 |
| inc0 | didn't try it yet but integration with github seems easier | 23:14 |
| *** jascott1 has joined #openstack-kolla | 23:14 | |
| inc0 | not sure if I'll be able to use ARG there or have dockerifles per distro/type | 23:15 |
| inc0 | if I could use ARG it would be awesome | 23:15 |
| kfox1111 | yeah. | 23:16 |
| inc0 | on automated builds | 23:16 |
| *** kristian__ has quit IRC | 23:17 | |
| *** kbaegis has quit IRC | 23:21 | |
| *** kbaegis has joined #openstack-kolla | 23:21 | |
| *** manheim has quit IRC | 23:27 | |
| *** jamesbenson has joined #openstack-kolla | 23:32 | |
| *** jtriley has joined #openstack-kolla | 23:32 | |
| *** hongbin has quit IRC | 23:34 | |
| *** ducttape_ has joined #openstack-kolla | 23:35 | |
| *** kbaegis has quit IRC | 23:35 | |
| *** jamesbenson has quit IRC | 23:36 | |
| *** ducttape_ has quit IRC | 23:40 | |
| sbezverk | kfox1111: I switched it back to WIP, since it needs to go into only master, but I would appreciate your review https://review.openstack.org/481690 | 23:40 |
| kfox1111 | k. will take a look. | 23:41 |
| *** awidders_ has joined #openstack-kolla | 23:51 | |
| *** awiddersheim has quit IRC | 23:51 | |
| sbezverk | kfox1111: thanks, no rush without master images it cannot be merged anyway | 23:53 |
| kfox1111 | k. | 23:53 |
| kfox1111 | nice work. :) | 23:53 |
| *** itlinux has joined #openstack-kolla | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!