Thursday, 2017-06-15

*** eaguilar has joined #openstack-kolla00:05
*** srwilkers has quit IRC00:14
*** karimb has quit IRC00:15
*** unicell has quit IRC00:18
*** itlinux has joined #openstack-kolla00:25
*** itlinux_ has joined #openstack-kolla00:25
*** itlinux_ has quit IRC00:32
*** itlinux has quit IRC00:32
*** ducttape_ has joined #openstack-kolla00:33
*** duonghq_ is now known as duonghq00:35
duonghqmorning guys00:36
*** iniazi has quit IRC00:36
duonghqmorning guys00:37
duonghqsdake, how are you00:39
*** zhurong has joined #openstack-kolla00:39
*** eaguilar has quit IRC00:52
*** manheim has joined #openstack-kolla00:56
*** rstarmer has joined #openstack-kolla00:56
*** cuongnv has joined #openstack-kolla00:57
*** sbezverk_ has joined #openstack-kolla00:59
*** tovin07_ has joined #openstack-kolla00:59
rstarmerhas anyone seen ceph ignore the match_mode='prefix' default in 4.0.0?  I'm trying to add a system with multiple disks to ceph, and tried to differentiate the dissk with a suffix of _diskname, but they dont' get discovered.00:59
duonghqmorning sbezverk01:00
sbezverk_duonghq : hey, how is it going?01:00
*** hieulq has quit IRC01:00
*** sbezverk has quit IRC01:02
duonghqsbezverk_, just as normal, hope that I have more time to  share with k8s, how about you?01:02
*** eaguilar has joined #openstack-kolla01:07
*** hieulq has joined #openstack-kolla01:07
sbezverk_duonghq : busy lots of things happening01:09
*** rstarmer has quit IRC01:09
*** jamesbenson has joined #openstack-kolla01:13
*** rstarmer has joined #openstack-kolla01:14
*** jamesbenson has quit IRC01:17
*** lucasxu has joined #openstack-kolla01:19
openstackgerritMerged openstack/kolla-ansible stable/ocata: Add timeout parameter for precheck tasks  https://review.openstack.org/47320501:20
openstackgerritMerged openstack/kolla-ansible stable/ocata: Rewrite haproxy precheck conditions to not use string interpolation  https://review.openstack.org/47320601:20
*** lucasxu has quit IRC01:21
*** rstarmer has quit IRC01:25
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Revert "Enable port_security in gate to fix the neutron broken"  https://review.openstack.org/47440201:26
*** manheim has quit IRC01:30
*** rstarmer has joined #openstack-kolla01:36
rstarmerany guidance on ceph beyond what's in the documentation?  The prefix bit is clearly broken, and I think the docs are either out of sync, or just plain wrong.  Hoping someone might have a better blog article somewhere...01:39
*** eanylin has quit IRC01:50
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Add vlan tenant network support  https://review.openstack.org/47441602:02
*** rstarmer has quit IRC02:03
*** ducttape_ has quit IRC02:06
*** ducttape_ has joined #openstack-kolla02:07
*** ducttape_ has quit IRC02:08
duonghqJeffrey4l, ping02:09
Jeffrey4lduonghq, pong02:09
duonghqhttps://blueprints.launchpad.net/kolla-ansible/+spec/migrate-to-ansible-2.2.002:10
duonghqcan you take a look?02:10
Jeffrey4lLGTM. approved.02:12
duonghqthanks Jeffrey4l02:13
Jeffrey4lnp ;)02:14
*** zhubingbing has joined #openstack-kolla02:20
*** eanylin has joined #openstack-kolla02:21
*** kjelly has quit IRC02:24
*** manheim has joined #openstack-kolla02:27
openstackgerritMerged openstack/kolla master: Use https links for documentation  https://review.openstack.org/47349302:39
*** manheim has quit IRC03:00
*** dklyle has joined #openstack-kolla03:01
*** david-lyle has quit IRC03:04
*** ducttape_ has joined #openstack-kolla03:08
*** itlinux has joined #openstack-kolla03:09
*** itlinux_ has joined #openstack-kolla03:09
*** spsurya has joined #openstack-kolla03:14
spsuryamorning all03:15
*** kbaegis has joined #openstack-kolla03:22
*** kbaegis has left #openstack-kolla03:36
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Replace always_run by check_mode  https://review.openstack.org/47443903:48
*** eaguilar has quit IRC03:49
*** dave-mcc_ has quit IRC03:51
*** zhubingbing has quit IRC04:01
*** tonanhngo has joined #openstack-kolla04:15
*** sbezverk_ has quit IRC04:16
*** salv-orlando has joined #openstack-kolla04:16
*** salv-orlando has quit IRC04:21
*** zhurong has quit IRC04:28
*** salv-orlando has joined #openstack-kolla04:28
*** unicell has joined #openstack-kolla04:32
*** tonanhngo has quit IRC04:37
*** zhurong has joined #openstack-kolla04:40
*** tonanhngo has joined #openstack-kolla04:41
*** itlinux has quit IRC04:44
*** itlinux_ has quit IRC04:44
*** kolla-slack has quit IRC04:51
*** kolla-slack has joined #openstack-kolla04:51
*** zhubingbing has joined #openstack-kolla04:53
*** tonanhngo_ has joined #openstack-kolla04:56
*** tonanhngo has quit IRC04:59
*** zhubingbing has quit IRC05:00
*** zhubingbing has joined #openstack-kolla05:00
*** jaosorior has quit IRC05:00
*** salv-orl_ has joined #openstack-kolla05:05
*** salv-orlando has quit IRC05:08
*** ansmith has quit IRC05:13
*** tonanhngo_ has quit IRC05:17
*** tonanhngo has joined #openstack-kolla05:18
*** skramaja has joined #openstack-kolla05:18
*** zhubingbing has quit IRC05:19
*** zhubingbing has joined #openstack-kolla05:19
*** tonanhngo has quit IRC05:23
*** janki has joined #openstack-kolla05:26
*** ansmith has joined #openstack-kolla05:40
*** zhubingbing has quit IRC05:48
*** zhubingbing has joined #openstack-kolla05:53
*** calbers has quit IRC06:02
*** salv-orl_ has quit IRC06:02
openstackgerritDmitry Tantsur proposed openstack/kolla master: Add Apache packages to ironic-api container  https://review.openstack.org/47414106:08
openstackgerritDmitry Tantsur proposed openstack/kolla master: Add Apache packages to ironic-api container  https://review.openstack.org/47414106:11
*** caowei has joined #openstack-kolla06:17
*** calbers has joined #openstack-kolla06:18
*** rwsu has quit IRC06:26
*** tonanhngo has joined #openstack-kolla06:28
*** ArchiFleKs has quit IRC06:44
*** dims has quit IRC06:44
*** dims has joined #openstack-kolla06:46
*** rwallner has joined #openstack-kolla06:51
*** rwallner has quit IRC06:55
*** pcaruana has joined #openstack-kolla06:58
*** jaosorior has joined #openstack-kolla07:12
*** salv-orlando has joined #openstack-kolla07:12
*** ajafo has quit IRC07:13
*** ajafo has joined #openstack-kolla07:13
*** reidrac has joined #openstack-kolla07:19
*** manheim has joined #openstack-kolla07:20
*** tonanhngo has quit IRC07:23
*** manheim has quit IRC07:24
bjolomorning07:26
*** shardy has joined #openstack-kolla07:36
*** egonzalez has joined #openstack-kolla07:37
*** manheim has joined #openstack-kolla07:40
*** zhubingbing has quit IRC07:43
*** manheim has quit IRC07:45
*** mgoddard has joined #openstack-kolla07:47
*** zhubingbing has joined #openstack-kolla07:47
*** blallau has joined #openstack-kolla07:54
spsuryabjolo: sup07:57
egonzalezduonghq, around?08:08
duonghqegonzalez, I'm here08:09
egonzalezduonghq, changed the bp link to migrate-to-ansible-2-2-0 so that gerrit picks correct url08:09
duonghqegonzalez, roge08:09
egonzalezcan update commit with that link08:09
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Replace always_run by check_mode  https://review.openstack.org/47443908:10
duonghqegonzalez, done, thank you very much08:11
*** dosaboy has quit IRC08:11
*** dosaboy has joined #openstack-kolla08:19
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Add vlan tenant network support  https://review.openstack.org/47441608:23
*** caowei has quit IRC08:24
*** caowei has joined #openstack-kolla08:24
*** jamesbenson has joined #openstack-kolla08:25
*** k_mouza has joined #openstack-kolla08:26
*** jamesbenson has quit IRC08:30
*** shardy has quit IRC08:31
*** pbourke has joined #openstack-kolla08:32
*** lpetrut has joined #openstack-kolla08:32
*** rstarmer has joined #openstack-kolla08:34
*** rstarmer_ has joined #openstack-kolla08:34
*** mewald has joined #openstack-kolla08:36
*** rstarmer_ has quit IRC08:41
*** rstarmer_ has joined #openstack-kolla08:42
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Implement blazar Docker images  https://review.openstack.org/45474508:44
blallauHi all, if some cores can look at this it will be great https://review.openstack.org/47297708:50
*** dosaboy has quit IRC08:50
*** dosaboy has joined #openstack-kolla08:51
*** dosaboy has quit IRC08:53
*** tvignaud has quit IRC08:55
*** manheim has joined #openstack-kolla08:55
*** manheim has quit IRC08:56
*** manheim has joined #openstack-kolla08:56
manheimhello08:59
*** tvignaud has joined #openstack-kolla09:08
*** dosaboy has joined #openstack-kolla09:08
*** rstarmer_ has quit IRC09:19
openstackgerritMerged openstack/kolla master: Make rabbitmq log dir configurable  https://review.openstack.org/45373509:20
*** pbourke has quit IRC09:21
*** rstarmer_ has joined #openstack-kolla09:21
*** mewald has quit IRC09:27
openstackgerritMerged openstack/kolla master: Remove unused function set_status  https://review.openstack.org/47321109:29
rstarmer_anyone using the ceph deployment in kolla-ansible? I'm trying to figure out if I'm just doing it wrong, or if there's a bug.09:37
*** mewald has joined #openstack-kolla09:38
egonzalezrstarmer_, whats the problem?09:46
rstarmer_well, firstly, we are building an initial ceph cluster, and initially were going to deploy 3 1.5TB drives as OSDs, and 1 1.5TB drive as a cache, with erasure coding.09:47
rstarmer_I first tried to label the disks with KOLLA_CEPH_ OSD_BOOTSTRAP_{dev} where we called each device out differently (sdb, sdc, sdd), and the KOLLA_CEPH_OSD_CACHE_BOOTSTRAP_{dev} with {dev}=sde09:49
rstarmer_But that seems to fail, as the system tries to launch, but ends up with no disks found.09:49
rstarmer_I then removed the _{dev} bit, and at least the system found the disks for the bootstrap operation, but the start tasks fail09:50
*** rwallner has joined #openstack-kolla09:51
rstarmer_It looks like the start tasks want disks labeld KOLLA_CEPH_DATA, but I can't find anything that changes the disk label!?!?  And at least currently that fails anyway, as the start processes don't find anything.09:51
rstarmer_for one 'prefix' searc doesn't seem to work.09:52
rstarmer_two, seems the implication (From the docs) that you define Journal vs. Data as _J or _D if you build two partitions on a disk, also doesn't seem to work.09:52
rstarmer_I think multiple partitions (or at least two) on a disk need to be defined in order, so if nothing else seems the docs are really not right based on at least the 4.0.0 code.09:54
rstarmer_Anyway, really trying to get this to work, and my next task is to figure out how to at least build a version with 20 OSDs instead of 3, so I'd really like this to work!09:55
*** rwallner has quit IRC09:56
*** tovin07_ has quit IRC09:58
egonzalezrstarmer, can you share debug logs for ansible execution with -vvv (only ceph part)10:07
egonzalezrstarmer, re-label to ceph_data is done during osd_bootstrap https://github.com/openstack/kolla/blob/master/docker/ceph/ceph-osd/extend_start.sh#L6610:09
egonzalezrstarmer, but that need to find disks in the previous tasks https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/ceph/tasks/bootstrap_osds.yml#L210:10
*** pbourke has joined #openstack-kolla10:10
egonzalezrstarmer, also, please share labels for disks before deploy and after10:10
*** rstarmer_ has quit IRC10:12
*** jascott1 has quit IRC10:15
*** jascott1 has joined #openstack-kolla10:15
*** rstarmer_ has joined #openstack-kolla10:16
rstarmer_egonzalez: I'll see if I can reproduce, as we've tried a bunch of times, and I won't have access to the systems again until next week (so I'm trying in a different env.)10:16
egonzalezrstarmer, btw, the _J thing for journal is only applied with external_journal is true https://github.com/openstack/kolla/blob/master/docker/kolla-toolbox/find_disks.py#L15410:17
*** jascott1 has quit IRC10:19
*** cuongnv has quit IRC10:20
egonzalezpbourke, around?10:23
*** sambetts|afk is now known as sambetts10:23
pbourkeegonzalez: morning10:25
rstarmer_egonzalez: thanks for the data, I'll ping if I can get a failure result or can get the logs from the system I've tried on in the past.10:25
egonzalezpbourke, can you try python -c "import pbr.version; print(pbr.version.VersionInfo('kolla'))" in kolla master (from git)10:25
egonzalezpbourke, pbr is telling me 3.0.4 which is weird ;/10:25
egonzalezpbourke, should be 5.0.0 (kolla-ansible is)10:26
pbourkeegonzalez: 4.0.0 here10:26
egonzalezpbourke, hrm, removing kolla.egg-info fixed10:29
*** ansmith has quit IRC10:49
*** shardy has joined #openstack-kolla10:50
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add ansible logs in deploy gates  https://review.openstack.org/47453910:53
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add openstack logs in deploy gates  https://review.openstack.org/47453910:54
*** rstarmer_ has quit IRC10:55
*** salv-orlando has quit IRC10:56
*** rstarmer has quit IRC11:02
egonzalezpbourke, any idea why outward is not running merge gate jobs? depend change was already merged11:06
pbourkeegonzalez: no :/11:11
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a new 'outward' rabbitmq instance  https://review.openstack.org/45373811:12
pbourkeegonzalez: tried rebasing and just readded the +a, will see if it does anything11:13
pbourkeegonzalez: actually still not comfortable with +a my own change, can you add it please11:13
*** skramaja has quit IRC11:18
*** k_mouza has quit IRC11:32
*** k_mouza has joined #openstack-kolla11:32
*** salv-orlando has joined #openstack-kolla11:34
egonzalezpbourke, done11:38
*** rhallisey has joined #openstack-kolla11:39
openstackgerritMerged openstack/kolla-ansible master: Add a new 'outward' rabbitmq instance  https://review.openstack.org/45373811:43
Davieyegonzalez: what are you trying to do with pbr?12:10
egonzalezDaviey, already done, had kolla in cache, so was giving me wrong version12:11
*** eaguilar has joined #openstack-kolla12:21
*** mewald has quit IRC12:22
*** hrw has quit IRC12:24
*** zhurong has quit IRC12:26
*** rwallner has joined #openstack-kolla12:27
*** rwallner has quit IRC12:28
*** zhurong has joined #openstack-kolla12:28
*** ansmith has joined #openstack-kolla12:28
*** hrw has joined #openstack-kolla12:30
*** schwicht has joined #openstack-kolla12:30
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add vhost to outward rabbitmq for Murano  https://review.openstack.org/45420612:33
*** schwicht has quit IRC12:35
*** zhurong has quit IRC12:36
*** eanylin has quit IRC12:38
*** schwicht has joined #openstack-kolla12:43
*** rwallner has joined #openstack-kolla12:53
*** eanylin has joined #openstack-kolla12:54
*** rwallner has quit IRC12:54
*** schwicht has quit IRC12:55
*** rwallner has joined #openstack-kolla12:55
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add openstack logs in deploy gates  https://review.openstack.org/47453913:02
*** srwilkers has joined #openstack-kolla13:12
*** eaguilar has quit IRC13:12
openstackgerritDan Ardelean proposed openstack/kolla-ansible master: Add Hyper-V role  https://review.openstack.org/45568413:12
*** srwilkers has left #openstack-kolla13:13
*** srwilkers has joined #openstack-kolla13:13
*** eaguilar has joined #openstack-kolla13:14
*** schwicht has joined #openstack-kolla13:16
*** bmaltais_ has joined #openstack-kolla13:18
bmaltais_Anyone else having issue with mariadb taking more and more memory as time goes by?13:18
bmaltais_When I start the mariadb container it will take 3GB of RAM... but give it 3 days and it will be up to 9GB.13:19
*** eaguilar has quit IRC13:19
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add vhost to outward rabbitmq for Murano  https://review.openstack.org/45420613:19
bmaltais_Restarting the container will bring it back down to 3 GB usage... and it will grow again from there. Give it enough time and it consume all availab le memory and the whole environment becomes unusable.13:19
*** lucasxu has joined #openstack-kolla13:26
*** dave-mccowan has joined #openstack-kolla13:26
openstackgerritMartin André proposed openstack/kolla master: Permit changing yum configuration in the base image  https://review.openstack.org/47458213:47
*** jtriley has joined #openstack-kolla13:47
openstackgerritDmitry Tantsur proposed openstack/kolla master: Add Apache packages to ironic-api container  https://review.openstack.org/47414113:47
openstackgerritMartin Mágr proposed openstack/kolla master: Add health check to sensu-client container  https://review.openstack.org/47029813:47
*** zhurong has joined #openstack-kolla13:49
openstackgerritDmitry Tantsur proposed openstack/kolla master: Add Apache packages to ironic-api container  https://review.openstack.org/47414113:52
*** jistr is now known as jistr|mtg13:59
*** karimb has joined #openstack-kolla13:59
*** schwicht has quit IRC14:04
*** karimb has quit IRC14:04
*** caowei has quit IRC14:08
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add openstack logs in deploy gates  https://review.openstack.org/47453914:10
*** tonanhngo has joined #openstack-kolla14:11
*** caowei has joined #openstack-kolla14:12
*** karimb has joined #openstack-kolla14:15
*** tonanhngo has quit IRC14:15
*** jascott1 has joined #openstack-kolla14:17
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add dev mode for Horizon  https://review.openstack.org/47459514:20
*** jascott1 has quit IRC14:21
*** zhurong has quit IRC14:22
*** huzhengchuan has joined #openstack-kolla14:24
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla master: Tweaks to allow Horizon dev mode  https://review.openstack.org/47459814:25
karimbhi buddies, i m launching instances on my nova compute container and getting Stdout: ; Stderr: sysctl: cannot stat /proc/sys/net/bridge: No such file or directory from neutron side..14:26
karimbdid you hit such things with kolla ?14:27
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla master: Tweaks to allow Horizon dev mode  https://review.openstack.org/47459814:27
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/newton: Fix kolla-toolbox build  https://review.openstack.org/47373214:29
*** ducttape_ has quit IRC14:29
*** ducttape_ has joined #openstack-kolla14:30
*** srwilkers has quit IRC14:31
egonzalezkarimb, kolla-ansible or kolla-kubernetes? ocata?14:32
karimbkolla-ansible newton14:32
karimbbut really those are my own containers, i just want to see if this is something that has been git on kolla14:32
*** jamesbenson has joined #openstack-kolla14:33
*** karimb has quit IRC14:36
egonzalezkarimb, hrm, maybe have missing volume mounts in the container, is "/lib/modules:/lib/modules:ro" mounted?14:37
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Use unified vars in task  https://review.openstack.org/47316614:37
*** jtriley_ has joined #openstack-kolla14:40
*** jtriley has quit IRC14:43
*** huzhengchuan has quit IRC14:50
openstackgerritBertrand Lallau proposed openstack/kolla-ansible stable/ocata: Fix Grafana config file template to use variables  https://review.openstack.org/46216114:53
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix openvswitch-agents when enable_nova_fake=true  https://review.openstack.org/47268114:54
*** manheim has quit IRC14:55
*** jtriley_ has quit IRC14:57
*** schwicht has joined #openstack-kolla14:59
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add dev mode for Horizon  https://review.openstack.org/47459514:59
*** jistr|mtg is now known as jistr14:59
*** rstarmer has joined #openstack-kolla14:59
rcritmandre, jaosorior suggested you might be able to help me figure out a problem I'm having with file perms on bind mounted files in the novajoin container I'm working on15:01
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add dev mode for Murano  https://review.openstack.org/46760815:01
*** caowei has quit IRC15:01
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla master: Tweaks to allow Horizon dev mode  https://review.openstack.org/47459815:02
*** huzhengchuan has joined #openstack-kolla15:04
*** jemcevoy has joined #openstack-kolla15:04
*** yingjun has joined #openstack-kolla15:05
*** caowei has joined #openstack-kolla15:06
*** srwilkers has joined #openstack-kolla15:07
srwilkersmorning o/15:07
jamesbensonmorning all :-)15:07
*** huzhengchuan has quit IRC15:08
*** rstarmer has quit IRC15:09
*** karimb has joined #openstack-kolla15:09
*** dklyle is now known as david-lyle15:10
*** schwicht has quit IRC15:11
*** janki has quit IRC15:12
*** karimb has quit IRC15:14
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Simplify condition check on standalone services  https://review.openstack.org/47461015:15
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add openstack logs in deploy gates  https://review.openstack.org/47453915:15
*** schwicht has joined #openstack-kolla15:15
mandrercrit: sure, how can I help you?15:16
*** yingjun has quit IRC15:18
*** yingjun has joined #openstack-kolla15:19
rcritmandre, trying to run the container in the undercloud. I bind mount in the service config file and a Kerberos keytab15:19
rcritthe perms on the keytab in the host FS are 600, owned by the service15:19
rcritso of course it is unreadable when bind mounted, with the differing uids15:19
rcritthe config file is mode 640, root:<host service gid> so is also unreadable15:20
rcritthe WIP container is at https://review.openstack.org/#/c/466268/ if that provides some context15:21
mandrercrit: do you update the file on the host and expect it to be refreshed in the container?15:21
mandrercrit: if not, you can copy it inside the container (not bind mount) with the right permission and ownership and that would solve your problem I think15:22
rcritso maybe what I'm doing is expected to not work, trying to replace a running service on the undercloud with a container15:22
rcritto see if it works15:22
rcritwould that be something I'd specify in the docker file or in t-h-t?15:23
*** yingjun has quit IRC15:23
rcritor is this something I could fix with a sudoer command to fix up the perms?15:24
*** yingjun has joined #openstack-kolla15:25
*** lpetrut has quit IRC15:26
*** yingjun has quit IRC15:26
*** hongbin has joined #openstack-kolla15:28
*** manheim has joined #openstack-kolla15:35
*** caowei has quit IRC15:35
*** caowei has joined #openstack-kolla15:36
*** manheim has quit IRC15:44
*** rwsu has joined #openstack-kolla15:47
*** bmace has quit IRC15:48
*** bmace has joined #openstack-kolla15:48
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Skydive: fix facts retrieved two times  https://review.openstack.org/47461515:50
*** sbezverk has joined #openstack-kolla15:51
*** blallau has quit IRC15:59
*** egonzalez has quit IRC16:00
EmilienMinc0: please look [deployment][kolla][openstack-ansible][kolla][openstack-helm] ansible role to produce oslo.config files for openstack services16:09
EmilienMkfox1111: ^16:10
*** jsalvachua has joined #openstack-kolla16:13
jsalvachuaHello16:13
jsalvachuaI am Spanish Professor. I really think your project is great for teaching openstack.16:14
jsalvachuai would love some students (for their master thesis) may help or contribute to the project.16:14
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/47465216:25
*** athomas has quit IRC16:26
*** itlinux_ has joined #openstack-kolla16:26
*** jascott1 has joined #openstack-kolla16:26
*** itlinux has joined #openstack-kolla16:26
*** jsalvachua has quit IRC16:30
*** manheim has joined #openstack-kolla16:33
*** jtriley has joined #openstack-kolla16:35
*** Mannheim has joined #openstack-kolla16:37
*** unicell has quit IRC16:37
*** manheim has quit IRC16:37
*** athomas has joined #openstack-kolla16:39
*** k_mouza has quit IRC16:39
*** jtriley has quit IRC16:43
*** reidrac has quit IRC16:43
inc0EmilienM so I don't see overrides in what Doug created16:50
inc0the only reason we have merge_conf is to enable hierarchical overrides16:50
inc0so sdake kfox1111 you know what's funny? if we go with ansible in container16:51
*** jtriley has joined #openstack-kolla16:51
inc0helm becomes...redunant16:51
inc0;)16:51
kfox1111not really.16:53
kfox1111because ansible is orchestration and optional.16:53
kfox1111helm is not.16:53
inc0well, helm will be templating engine16:53
inc0and ansible has templating engine16:53
kfox1111right.16:53
inc0which, I will argue, is better16:53
inc0looks more tidy imho16:54
kfox1111-116:54
kfox1111I do prefer jinja to gotl,16:54
kfox1111but not rewriting it back to jinja.16:54
kfox1111its not that critical.16:54
inc0no, I'm not suggesting that16:54
inc0I agree completely16:54
inc0just saying, if we'd start fresh today I'd be on boat without helm (khe khe)16:55
kfox1111thats where we started. :/16:55
inc0yeah16:55
sbezverkkfox1111: I will not do that either, it is crazy ;)16:55
inc0well, good learning16:55
kfox1111spent a huge amount of work/time moving a way from jinja2. :/16:56
inc0yeah, but we didn't get it totally right at first, I think lots of ideas had to be flushed out16:56
kfox1111anyway. could of, would of, should of16:56
inc0anyway, we're not moving away from helm16:56
kfox1111we're where we are now.16:56
inc0exactly16:56
inc0we're designing this field really16:56
sbezverkand in addition speedy sdake already purged all our jinja2 work ;(16:57
kfox1111I'm ok hiding ansible orchestration in a container. then its just an implementation deatail and far less religious arguments will happen.16:57
inc0that was missing piece to me16:57
inc0now we could deploy whole of kolla by running one job called compute kit16:57
inc0which will run play to deploy services which will run jobs to deploy microservices16:58
inc0and it can be done with helm16:58
inc0just helm becomes glorified templating engine16:58
inc0on the other hand, if helm would get notion of "chart is ready"16:58
inc0to provide entrypoint-like orchiestration16:59
kfox1111in a distributed system, there isn't nessisarily something as clean cut as "chart is ready"16:59
inc0lots could me modeled with this alone16:59
inc0well, we need to wait for some trigger before we move on right?16:59
kfox1111"what does it mean to be ready".16:59
kfox1111right, but thats orchestration logic.16:59
inc0that is very hard question which doesn't have good answer16:59
kfox1111and its usually non trivial.16:59
kfox1111which is why orchestration is hard.16:59
kfox1111its almost always application specific.17:00
inc0but ansible is not really orchiestration, it's glorified shellscript17:00
kfox1111so doesn't belong in a generic engine.17:00
kfox1111yes/no.17:00
inc0I think it might17:00
kfox1111ansible is an engine that makes it possible to write orchestration scripts "more easily"17:00
kfox1111(if you believe whats in the quotes :)17:00
inc0helm could assume chart is ready when all it's resources are ready as far as k8s is concenred17:00
inc0and it's up to app to create proper readiness probes17:00
kfox1111inc0: thats a big assumption.17:00
inc0that's only assumption we can make really17:01
kfox1111what happens when you have a deployment that has 3 pods, and 2 are ready, and one node in the cluster is sick, so the 3rd doesnt' schedule?17:01
kfox1111is it ready then or not?17:01
inc0will deployment in k8s be ready?17:01
kfox1111depoyments arent ready/not ready in k8s.17:02
kfox1111only pods.17:02
kfox1111kube-entrypoint has maybe an interesting definition of ready.17:02
kfox1111service exists with at least one ready pod.17:02
sbezverkinc0: the problem here is even if k8s object is ready , it does not mean that openstack process is ready too17:02
inc0which might or might not be true17:02
kfox1111but that doesn't cover thigns like nova-openstack-agent which have no svc.17:02
inc0but however we want to do it, we need to do it anyway17:03
kfox1111in the neutron-openvswitch-agent case,17:03
inc0sbezverk: that's up to readiness probes17:03
kfox1111its only ready when it shows up as ready in the openstack api17:03
sbezverkI noticed in many instances that there is a big gap17:03
kfox1111k8s has a gap in readyness probes.17:04
sbezverknot sure if readiness probes can be as flexible as to test opensatck service17:04
kfox1111they can target a pod,17:04
kfox1111but I want to ask another pod about the readyness of another pod.17:04
inc0they're shellscripts afaik17:04
inc0so should be17:04
inc0well17:04
inc0ugly17:04
kfox1111"ask nova-api if neutron-openvswitch-agent pod xxx is ready"17:04
inc0it's a shellscript which is being called, it can have "nova service list | grep <<hostname>> | grep :-)"17:05
*** Mannheim has quit IRC17:05
*** eaguilar has joined #openstack-kolla17:05
kfox1111inc0: yeah. but then you need admin creds and a route back from computes to api just to do something that should be done directly on the api server. :/17:06
sbezverkinc0: I would suggest instead to curl for api17:06
inc0well, I said it's ugly, but possible17:06
kfox1111yeah.17:06
sbezverkat least it is not that ugly and it is aligned with k8s approach17:06
kfox1111agreed.17:06
inc0either way we need to have wait conditions anyway17:06
inc0sbezverk: I'd probably write short python to do it if it would come to that17:07
*** Manheim has joined #openstack-kolla17:07
*** sambetts is now known as sambetts|afk17:08
*** vhosakot has joined #openstack-kolla17:09
sbezverkinc0: how about a small go program like entry-point which can get all endpoints from keystone and takes an argument a service name17:09
sbezverkthen returns whether process up or not as a boolean17:09
vhosakotinc0: when is the deadline to buy the kolla PTG pass?  is there a link about it?  I'll search in the IRC logs too..17:09
inc0vhosakot: when they run out:)17:10
vhosakotinc0: so, they haven't run out I'm assuming :)17:10
inc0there are fixed amount of ~500 ptg passes total17:10
vhosakotah I see, cool17:10
inc0don't think so17:10
inc0I'm not sure if they ran out at all last time, but that's your deadline17:10
vhosakotah cool17:10
*** jsalvachua has joined #openstack-kolla17:10
kfox1111for http, not sure kubernetes-entrypoint isn't good enough?17:12
kfox1111I think the issue is rabbit services/agents.17:13
kfox1111neutron agent-list, nova service-list, etc.17:13
*** salv-orl_ has joined #openstack-kolla17:14
*** pcaruana has quit IRC17:16
*** omenvl has quit IRC17:17
*** salv-orlando has quit IRC17:17
*** omenvl has joined #openstack-kolla17:19
sbezverkkfox1111: I think building openstack-entrypoint is very doable17:22
kfox1111yeah.17:23
kfox1111and I think its probably useful outside of k8s as well.17:23
kfox1111for prometheus monitoring for example.17:23
*** unicell has joined #openstack-kolla17:24
sbezverkkfox1111: if you could help to come up with architecture, I would be happy to work on it17:25
kfox1111ok. cool. :)17:25
*** jsalvachua has quit IRC17:26
*** Mannheim has joined #openstack-kolla17:29
openstackgerritRob Crittenden proposed openstack/kolla master: Add images for novajoin services  https://review.openstack.org/46626817:30
spsuryaJeffrey4l: now LGTM https://review.openstack.org/#/c/473166/317:31
*** Manheim has quit IRC17:32
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multi-scenerio gates  https://review.openstack.org/46681517:40
*** srwilkers has quit IRC17:44
*** jascott1 has quit IRC17:46
*** jascott1 has joined #openstack-kolla17:46
*** shardy has quit IRC17:47
*** eaguilar has quit IRC17:50
*** jascott1 has quit IRC17:51
*** eaguilar has joined #openstack-kolla17:57
*** srwilkers has joined #openstack-kolla17:57
*** jascott1 has joined #openstack-kolla18:03
*** srwilkers has quit IRC18:06
*** ansmith has quit IRC18:11
*** rstarmer has joined #openstack-kolla18:25
*** eaguilar has quit IRC18:29
*** rstarmer has quit IRC18:36
*** manheim has joined #openstack-kolla18:37
*** rstarmer has joined #openstack-kolla18:40
*** mgoddard has quit IRC18:42
Mannheimhei19:04
Mannheimlet me know if you had time to take another look on my patchset, did not change anything from last +2 just resolved a merge conflict19:04
*** jaosorior is now known as jaosorior_away19:08
*** lucasxu has quit IRC19:10
*** lucasxu has joined #openstack-kolla19:11
*** egonzalez has joined #openstack-kolla19:13
*** srwilkers has joined #openstack-kolla19:13
*** eaguilar has joined #openstack-kolla19:16
*** ducttap__ has joined #openstack-kolla19:21
*** ducttape_ has quit IRC19:24
*** jsalvachua has joined #openstack-kolla19:26
*** ducttape_ has joined #openstack-kolla19:27
*** ducttap__ has quit IRC19:29
*** manheim has quit IRC19:33
*** karimb has joined #openstack-kolla19:36
inc0sdake I'm thinking how to best put ansible to containers19:48
inc0in a way that will be easy to edit contents of containers from kolla-k8s19:48
inc0I kinda dislike idea of having image with git clone in it19:49
kfox1111what do you mean edit contents?19:49
kfox1111ansible should be orchestrating, not editing?19:49
inc0so we'll have ansible roles in kolla-k8s tree19:49
inc0but Dockerfile in kolla tree19:49
inc0which means if you push change to ansible, simple rebuild of container won't catch it19:50
inc0if it does git clone19:50
kfox1111of the ansible container?19:50
inc0yeah19:50
karimbgetting back with an early question, are there some hacks to avoid following mesage cannot stat /proc/sys/net/bridge: No such file or directory19:50
inc0if you don't do git clone, how are you going to put it there?19:50
kfox1111hmm.... yeah.19:50
karimbwithin a nova-compute container....19:50
kfox1111so, its a development workflow issue.19:51
inc0exactly19:51
inc0and gatint19:51
inc0gating19:51
kfox1111gotcha.19:51
kfox1111we're kind of in the same boat as when we tried to use helm pre-local-path.19:51
inc0karimb: never seen this one...is linux bridge fine in you system?19:51
kfox1111it has to clone from git, but then you have to push the change to git...19:52
kfox1111you need something like localpath...19:52
inc0one of ideas would be to host kolla-k8s specific images in kolla-k8s repo19:52
kfox1111that would solve it.19:52
inc0and build it with kolla toolset19:52
kfox1111another might be to have a kolla-k8s checkout in a place the dockerfile can ADD it?19:52
karimbinc0 in the host it is19:52
inc0kfox1111: hacky to me...19:53
kfox1111having the kolla toolset extensible enough that other repos' can reuse it has other benifits.19:53
inc0also I kinda dislike not being able to replicate real case secenerio19:53
inc0and I won't be able to unless I set up local tarball server and pull from it19:53
kfox1111its kind of in a wird place though...19:53
kfox1111is kolla-k8s any different then mariadb-x-y-z in the docker file.19:54
kfox1111we pull stuff from all over the place.19:54
inc0right19:54
inc0that was my thinking too19:54
inc0but it is different19:54
inc0we host both19:54
kfox1111so being able to override and cache it locally so that it can easily be overridden would be another way to solve it.19:54
inc0we are Kolla community19:54
kfox1111both things are really problems.19:55
inc0or somehow put ansible into kolla-toolbox container19:55
inc0tarbal over configmap kind of bs19:55
kfox1111I think it arleady is there.19:55
inc0ansible playbooks from kolla-k8s19:55
kfox1111yeah, -1 to the roles though.19:55
kfox1111thats really sketchy.19:56
inc0it is19:56
kfox1111toolbox is already way overblown.19:56
kfox1111its not very dockery.19:56
kfox1111its not one tool, but a lot of tools in an uber container.19:56
inc0well, it's kinda operator before operators were cool19:56
inc0I was thinking of child image from toolbox19:56
inc0but however we call it, we still need to solve problem of putting codebase in it19:57
kfox1111right.19:57
inc0I think best idea I have now is to add "auxiliary dockerfile dirs" to kolla19:59
*** itlinux_ has quit IRC19:59
*** itlinux has quit IRC19:59
kfox1111I guess there are benifits/drawbacks to both aproaches.19:59
kfox1111yeah.19:59
inc0so it will build it's regular set and sets you provide19:59
kfox1111kinda like devstack plugins.19:59
inc0kind of, yes19:59
inc0it's going to be beneficial in more cases too19:59
kfox1111there's some other kolla-k8s specific containers in there laready. those could be moved out too.20:00
inc0yup, that was my thinkning20:00
inc0would streamline dev tbh20:00
kfox1111for good and bad.20:00
inc0would also enable different communities to work with Kolla, which is nice20:01
kfox1111kolla-k8s devs don't have too much exp building containers. so we might produce suboptimal ones.20:01
kfox1111but would get more velosity too though.20:01
inc0we're in same boat, we can and should cross-review stuff20:01
inc0I mean I'll review containers and I have experience20:01
inc0sdake too20:01
inc0ok, let's just do this20:02
kfox1111one drawback is it complicates the operators life when needing to build containers.20:03
inc0on the flipside...we already have change for it:) https://review.openstack.org/#/c/466132/320:03
inc0kfox1111: but we'll have publisher20:03
kfox1111insteda of git clone kolla; cd kolla; build all the things, then its clone a few things, set env vars to link things, etc.20:03
inc0so if all of these containers will land in dockerhub20:03
kfox1111true.20:03
inc0you'll do pip install kolla20:03
inc0kolla-build --dockerfile-dir /pat/to/k8s/dir20:04
inc0all it takes20:04
*** spsurya has quit IRC20:04
kfox1111with agit checkout. but yeah. not too bad.20:04
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla master: enable the kolla build system to use out of tree docker files  https://review.openstack.org/46613220:08
*** itlinux has joined #openstack-kolla20:12
*** itlinux_ has joined #openstack-kolla20:12
inc0heh now when I look at this https://review.openstack.org/#/c/473588/2/ansible/roles/deploy/tasks/glance.ymlhttps://review.openstack.org/#/c/473588/2/ansible/roles/deploy/tasks/glance.yml unless we have whole kolla-k8s container20:19
inc0it won't work;)20:20
inc0so yeah...kolla-k8s container20:20
*** goldyfruit has joined #openstack-kolla20:20
kfox1111inc0: I don't follow.20:22
inc0let me make small patch to show what I mean20:22
kfox1111k20:24
*** manheim has joined #openstack-kolla20:24
*** eaguilar has quit IRC20:24
*** rwallner has quit IRC20:28
*** manheim has quit IRC20:28
*** rstarmer has quit IRC20:31
*** rwallner has joined #openstack-kolla20:32
*** iniazi has joined #openstack-kolla20:33
*** srwilkers has quit IRC20:34
*** egonzalez has quit IRC20:35
*** jsalvachua has quit IRC20:37
*** jtriley has quit IRC20:39
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: WIP Dockerfile to run ansible orchiestration  https://review.openstack.org/47477020:46
inc0kfox1111: ^20:46
*** rwallner has quit IRC20:51
*** lucasxu has quit IRC20:55
*** rhallisey has quit IRC20:56
kfox1111inc0: yeah. what about it though?21:00
inc0is that enoug?21:00
kfox1111for operators? probably.21:00
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Remove Ubuntu Wily 15.10 related code  https://review.openstack.org/47477821:06
*** eaguilar has joined #openstack-kolla21:07
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Remove Ubuntu Wily 15.10 related code  https://review.openstack.org/47477821:08
*** ducttape_ has quit IRC21:09
*** kbaegis has joined #openstack-kolla21:10
openstackgerritMarcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role  https://review.openstack.org/41636721:11
*** oanson has quit IRC21:23
*** oanson has joined #openstack-kolla21:26
*** Mannheim has quit IRC21:31
*** ducttape_ has joined #openstack-kolla21:34
*** rwallner has joined #openstack-kolla21:37
*** ducttape_ has quit IRC21:38
*** manheim has joined #openstack-kolla21:38
*** ducttape_ has joined #openstack-kolla21:41
*** goldyfruit has quit IRC21:45
*** rwallner has quit IRC21:53
*** ducttape_ has quit IRC21:54
*** jascott1 has quit IRC21:55
*** ducttape_ has joined #openstack-kolla21:55
*** jascott1 has joined #openstack-kolla21:55
*** jascott1 has quit IRC21:56
*** jascott1 has joined #openstack-kolla21:56
*** omenvl has quit IRC22:03
*** jamesbenson has quit IRC22:04
*** jamesbenson has joined #openstack-kolla22:07
*** manheim has quit IRC22:09
*** jamesbenson has quit IRC22:11
*** ducttape_ has quit IRC22:14
*** eaguilar has quit IRC22:17
*** ducttape_ has joined #openstack-kolla22:17
*** ducttape_ has quit IRC22:17
*** ducttape_ has joined #openstack-kolla22:17
*** vhosakot has quit IRC22:23
*** ducttape_ has quit IRC22:33
*** ducttape_ has joined #openstack-kolla22:34
*** oanson has quit IRC22:38
*** salv-orl_ has quit IRC22:39
*** schwicht has quit IRC22:39
*** oanson has joined #openstack-kolla22:39
*** schwicht has joined #openstack-kolla22:54
*** itlinux_ has quit IRC23:00
*** itlinux has quit IRC23:00
*** karimb has quit IRC23:02
*** itlinux has joined #openstack-kolla23:08
*** itlinux_ has joined #openstack-kolla23:08
*** itlinux has quit IRC23:10
*** itlinux_ has quit IRC23:10
*** ducttape_ has quit IRC23:16
*** ducttape_ has joined #openstack-kolla23:18
*** schwicht has quit IRC23:20
*** ducttape_ has quit IRC23:21
*** ducttape_ has joined #openstack-kolla23:22
*** jascott1 has quit IRC23:22
*** jascott1 has joined #openstack-kolla23:22
*** schwicht has joined #openstack-kolla23:23
*** jascott1 has quit IRC23:24
*** jascott1 has joined #openstack-kolla23:24
*** ducttape_ has quit IRC23:26
*** schwicht has quit IRC23:26
*** jascott1 has quit IRC23:27
*** jascott1 has joined #openstack-kolla23:27
*** jascott1 has quit IRC23:31
*** ducttape_ has joined #openstack-kolla23:32
*** hyakuhei has joined #openstack-kolla23:36
*** ducttape_ has quit IRC23:37
*** jascott1 has joined #openstack-kolla23:47
*** rstarmer has joined #openstack-kolla23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!