Monday, 2016-08-08

« Sunday, 2016-08-07 Index Tuesday, 2016-08-09 »
*** zhurong has quit IRC00:01
*** godleon has joined #openstack-kolla00:10
*** hieulq_ has joined #openstack-kolla00:39
*** huikang has joined #openstack-kolla00:40
*** duonghq has joined #openstack-kolla00:45
*** zhurong has joined #openstack-kolla01:12
openstackgerritLi Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218001:23
*** rhallisey has quit IRC01:25
*** RA_ has joined #openstack-kolla01:26
*** RA_ is now known as RossKrumbeck01:29
*** RossKrumbeck is now known as rkrum01:35
*** rkrum has left #openstack-kolla01:39
*** rkrum has joined #openstack-kolla01:39
*** rkrum has quit IRC01:40
*** rkrum has joined #openstack-kolla01:40
openstackgerritHiroki Ito proposed openstack/kolla: Fix prechecks of a vip address  https://review.openstack.org/35158801:49
*** huikang has quit IRC01:58
*** huikang has joined #openstack-kolla02:00
*** signed8bit_Zzz is now known as signed8bit02:01
*** signed8bit has quit IRC02:02
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425502:36
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Add an --all-in-one flag to the CLI  https://review.openstack.org/35213802:36
*** fragatina has joined #openstack-kolla02:38
*** fragatina has quit IRC02:43
*** huikang has quit IRC02:46
*** zhubingbing has joined #openstack-kolla02:48
*** zhugaoxiao has quit IRC02:57
openstackgerritzhubingbing proposed openstack/kolla: Add Barbibcan container dockerfile  https://review.openstack.org/35182203:09
*** daneyon has joined #openstack-kolla03:15
*** daneyon has quit IRC03:19
*** huikang has joined #openstack-kolla03:28
*** zhugaoxiao has joined #openstack-kolla03:36
*** ayoung has quit IRC03:39
*** dave-mccowan has quit IRC03:47
*** sdake has joined #openstack-kolla03:58
openstackgerritRoss Annetts proposed openstack/kolla: Fix designate bootstrap commands.  https://review.openstack.org/35220603:59
openstackgerritRoss Annetts proposed openstack/kolla: Fix designate bootstrap commands.  https://review.openstack.org/35220604:03
sdakeevening ffolks04:03
sdakegod was hoping when i woke up it was monday04:04
*** zhurong has quit IRC04:04
*** zhurong has joined #openstack-kolla04:05
zhubingbing- -04:18
sdakeanyone know if sbezverk had success?04:23
*** senk_ has joined #openstack-kolla04:24
zhubingbingi don't know04:25
*** bootsha has quit IRC04:27
openstackgerritOpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements  https://review.openstack.org/35190104:32
*** evewind has joined #openstack-kolla04:35
*** evewind has left #openstack-kolla04:41
*** evewind has joined #openstack-kolla04:43
*** coolsvap has joined #openstack-kolla04:46
*** huikang has quit IRC04:57
*** huikang has joined #openstack-kolla04:57
*** huikang has quit IRC05:02
*** mdnadeem_ has joined #openstack-kolla05:02
*** daneyon has joined #openstack-kolla05:03
*** evewind has left #openstack-kolla05:06
*** fragatina has joined #openstack-kolla05:07
*** daneyon has quit IRC05:08
*** senk_ has quit IRC05:09
*** senk_ has joined #openstack-kolla05:13
*** fragatina has quit IRC05:13
*** senk_ has quit IRC05:26
*** bootsha has joined #openstack-kolla05:28
*** bootsha has quit IRC05:33
openstackgerritMerged openstack/kolla: Updated from global requirements  https://review.openstack.org/35190105:47
*** duonghq has quit IRC05:48
*** duonghq has joined #openstack-kolla06:01
*** mewald has joined #openstack-kolla06:10
*** senk_ has joined #openstack-kolla06:28
*** bootsha has joined #openstack-kolla06:29
*** bootsha has quit IRC06:35
*** dmueller-evoila has joined #openstack-kolla06:35
*** sdake has quit IRC06:38
*** duonghq has quit IRC06:40
*** zhubingbing has quit IRC06:44
*** zhubingbing_ has joined #openstack-kolla06:46
*** fragatina has joined #openstack-kolla06:47
*** fragatina has quit IRC06:52
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican container dockerfile  https://review.openstack.org/35182206:54
*** Mr_Broken has joined #openstack-kolla07:12
*** duonghq has joined #openstack-kolla07:20
*** rkrum has quit IRC07:23
*** Serlex has joined #openstack-kolla07:35
*** ad_rien_ has joined #openstack-kolla07:37
*** Mr_Broken has quit IRC07:43
*** daneyon has joined #openstack-kolla07:45
*** ad_rien_ has quit IRC07:47
*** diga has joined #openstack-kolla07:50
*** daneyon has quit IRC07:50
*** bootsha has joined #openstack-kolla07:51
*** matrohon has joined #openstack-kolla07:58
*** zhubingbing__ has joined #openstack-kolla08:00
*** zhubingbing_ has quit IRC08:03
*** zhubingbing__ has quit IRC08:06
*** ad_rien_ has joined #openstack-kolla08:13
*** athomas has joined #openstack-kolla08:13
*** ad_rien_1 has joined #openstack-kolla08:14
*** ad_rien_ has quit IRC08:18
*** matrohon has quit IRC08:19
*** sean-k-mooney has quit IRC08:24
*** b_bezak has joined #openstack-kolla08:27
*** athomas has quit IRC08:34
*** athomas has joined #openstack-kolla08:35
*** matrohon has joined #openstack-kolla08:36
*** matrohon has quit IRC08:36
-openstackstatus- NOTICE: Gerrit is going to be restarted08:39
*** gfidente has joined #openstack-kolla08:39
openstackgerritDuong Ha-Quang proposed openstack/kolla: Port rabbitmq bootstrap to Ansbile 2.0  https://review.openstack.org/35227508:43
*** fragatina has joined #openstack-kolla08:50
*** bmace has joined #openstack-kolla08:51
duonghqcoolsvap: are you deploy Kolla in VM or directly on machine for dev Kolla?08:51
coolsvapmostly directly on a test machine08:52
duonghqhas you tried every base distro config?08:52
*** matrohon has joined #openstack-kolla08:52
coolsvapduonghq: anything particular blocking you?08:54
*** fragatina has quit IRC08:55
duonghqcoolsvap: I got strange behavior, I described in #160950208:57
duonghqhttps://bugs.launchpad.net/kolla/+bug/160950208:57
openstackLaunchpad bug 1609502 in kolla "Container bootstrap_mariadb exits due to Galera failed" [Undecided,New]08:57
duonghqIt happen in centos base image08:57
duonghqbut when I switch to ubuntu it disappear for 1st run, and appear again in 2nd,...08:58
duonghqbut when I re-execute kolla-ansible deploy is disappear again08:58
coolsvapduonghq: alright I will confirm and get back to you08:59
duonghqthank you08:59
*** dmueller-evoila_ has joined #openstack-kolla09:03
*** dmueller-evoila has quit IRC09:07
*** matrohon has quit IRC09:08
*** b_bezak_ has joined #openstack-kolla09:19
*** b_bezak has quit IRC09:20
*** matrohon has joined #openstack-kolla09:24
*** Guest52040 has joined #openstack-kolla09:28
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Cinder  https://review.openstack.org/35058709:30
*** diga has quit IRC09:32
*** daneyon has joined #openstack-kolla09:34
*** rmart04 has joined #openstack-kolla09:37
*** daneyon has quit IRC09:38
*** athomas has quit IRC09:45
openstackgerritPaul Bourke proposed openstack/kolla: Document the Dockerfile customisation mechanism  https://review.openstack.org/35112309:46
*** rkrum has joined #openstack-kolla09:46
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Cinder  https://review.openstack.org/35058709:49
*** fragatina has joined #openstack-kolla09:51
*** athomas has joined #openstack-kolla09:53
*** fragatina has quit IRC09:56
*** matrohon has quit IRC10:01
*** zhurong has quit IRC10:03
*** bootsha has quit IRC10:04
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Nova  https://review.openstack.org/35167610:10
openstackgerritPaul Bourke proposed openstack/kolla: Document the Dockerfile customisation mechanism  https://review.openstack.org/35112310:13
*** mnasiadka has joined #openstack-kolla10:14
openstackgerritRoss Krumbeck proposed openstack/kolla: Fix designate bootstrap.  https://review.openstack.org/35230910:15
*** matrohon has joined #openstack-kolla10:17
openstackgerritRoss Krumbeck proposed openstack/kolla: Fix designate bootstrap.  https://review.openstack.org/35220610:18
*** duonghq has left #openstack-kolla10:24
*** hieulq_ has quit IRC10:27
*** rkrum has quit IRC10:38
pbourkehey coolsvap10:56
*** matrohon has quit IRC10:57
pbourkecoolsvap: I think we're good to go for the rally/tempest testing in osic10:57
pbourkecoolsvap: can you let us know whats your status on that?10:57
*** zhubingbing__ has joined #openstack-kolla10:57
*** senk__ has joined #openstack-kolla10:59
*** senk_ has quit IRC11:01
coolsvappbourke: I have not checked the status over the weekend, I can start the tests tonight11:02
pbourkecoolsvap: cool let us know if you need help, im sure there'll be others on in a few hours also11:02
pbourkecoolsvap: are you ok with the vpn/tmux etc?11:03
coolsvappbourke: no, I need to configure that as well, was working on my system + a test system from friday11:04
coolsvapjust getting relaxed after I got everything up and runnig as expected11:04
coolsvappbourke: do you have steps for the vpn/tmux config?11:05
pbourkecoolsvap: Most of what you need is in the email we got11:06
coolsvappbourke: alright I will check, will ask you if I need any help regarding it11:07
pbourkecoolsvap: I run the vpn client in docker if you prefer to the browser plugin thing in the email11:07
pbourkehttps://github.com/brk3/docker-f5fpc11:07
pbourkecoolsvap: once on the vpn, the deploy node is root@172.21.8.253 password 'cobbler'11:07
pbourkecoolsvap: when you get there, run 'tmux att'11:08
pbourkecoolsvap: https://etherpad.openstack.org/p/kolla-N-midcycle-osic for notes11:08
coolsvapyeah I was reading the notes in etherpad11:08
*** sdake has joined #openstack-kolla11:08
*** sdake has quit IRC11:08
*** sdake has joined #openstack-kolla11:08
*** godleon has quit IRC11:10
coolsvapsdake: hey11:11
*** coolsvap is now known as coolsvap_11:12
*** matrohon has joined #openstack-kolla11:13
*** zhubingbing_ has joined #openstack-kolla11:13
*** zhubingbing__ has quit IRC11:17
zhubingbing_111:17
zhubingbing_ping11:17
*** daneyon has joined #openstack-kolla11:22
*** daneyon has quit IRC11:26
*** sdake has quit IRC11:36
*** dwalsh has joined #openstack-kolla11:36
*** bootsha has joined #openstack-kolla11:39
*** sdake has joined #openstack-kolla11:39
*** Guest52040 has quit IRC11:40
*** sdake has quit IRC11:41
*** sdake has joined #openstack-kolla11:43
sdakezhubingbing_ what can i do for you11:44
sdakehey coolsvap_11:44
zhubingbing_help me review mycode11:44
zhubingbing_--“）11:44
sdakehey coolsvap_ how much competition do you have for requirements repo11:44
sdakezhubingbing_ just woke up - i dont review until atleast 1 hour after i'm up11:45
zhubingbing_ok11:45
*** matrohon has quit IRC11:45
sdakepbourke around?11:55
pbourkesdake: hey11:56
sdakepbourke did you see my review for documentation of the osic cluster11:56
pbourkesdake: I did, looks good11:56
sdakei saw you volunteered to be emea coordinator11:56
pbourkesdake: yeah, good with you?11:56
sdakeit looks good but is incompoelte - i'd like to keep it up to date as we proceed11:56
sdakeyup- just was going to ask you to help enforce the documentation along the way concept :)11:57
pbourkesdake: we can do our best, an alternate is to just have people update the etherpad then we'll compose into the review towards the end11:57
pbourkesdake: otherwise there will be huge churn on the review11:57
pbourkewhat you reckon?11:57
sdakethat will be alot of pain (etherpad) - data will get lost - i dont mind churn in he review11:57
pbourkeok no prob11:57
sdakei would like coauthor list to be long on that review :)11:57
sdakeetherpad is a fantastic tool11:58
sdakebut I feel in this case critical data will become lost and there will be no way to point it out11:59
pbourkesdake: ive updated the pad with big text pointing to the review11:59
openstackgerritChristian Berendt proposed openstack/kolla: Add script to validate syntax of Jinja2 template files  https://review.openstack.org/35237812:00
sdakewonder how good thi ssafe is nd reproduce the problem with strace without a direct segfault of ovs-ddb12:01
sdakehttps://www.amazon.com/dp/B00ZYHR412?psc=112:02
openstackgerritPaul Bourke proposed openstack/kolla: Move haproxy to control nodes in sample inventories  https://review.openstack.org/35237912:02
*** matrohon has joined #openstack-kolla12:02
*** senk__ is now known as senk12:04
*** senk has quit IRC12:05
*** mliima has joined #openstack-kolla12:09
*** jtriley has joined #openstack-kolla12:14
*** rhallisey has joined #openstack-kolla12:15
rhalliseysbezverk, sdake, so mounting /dev fixed that problem12:21
rhalliseythat's awesome12:21
sdakerhallisey i think so - but sbezverk never confirmed before i ptfo'ed last night12:21
rhalliseyok12:21
rhalliseywhat is ovs doing with /dev?12:22
*** matrohon has quit IRC12:23
*** rkrum has joined #openstack-kolla12:31
rkrumI've written the ansible role for Designate, currently testing but should be complete in the next few days. Can this be assigned to me https://blueprints.launchpad.net/kolla/+spec/ansible-designate.12:36
*** matrohon has joined #openstack-kolla12:39
*** bootsha has quit IRC12:46
*** dave-mccowan has joined #openstack-kolla12:52
*** fragatina has joined #openstack-kolla12:52
rhalliseyrkrum, assigned it12:53
rkrumthanks12:53
*** fragatina has quit IRC12:58
*** matrohon has quit IRC13:01
sbezverksdake ping13:06
sdakesbezverk shoot13:06
sbezverkwhat happened with -2???13:06
sdakei was blocking temporarily until we gotconfirmation that /dev:/dev was the correct solution - rather then sleep 113:07
sbezverksdake: ok you have confirmation, but I want that people understand dev mount fixed only sleep 1, we still need this script for Daemonset13:08
sdakecool13:09
sdakebusy - atm - give me 5 minutes13:09
sbezverksdake I am going to push final version for review..13:10
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Introduce a script to launch ovsdb-server process  https://review.openstack.org/35178413:14
*** fragatina has joined #openstack-kolla13:15
*** matrohon has joined #openstack-kolla13:17
*** fragatina has quit IRC13:20
openstackgerritChristian Berendt proposed openstack/kolla: Add script to validate syntax of Jinja2 template files  https://review.openstack.org/35237813:21
openstackgerritChristian Berendt proposed openstack/kolla: Fix service_type of mistral endpoint  https://review.openstack.org/35212013:24
sdakesbezverk back13:27
*** zhurong has joined #openstack-kolla13:27
sdakesbezverk i think rhallisey had some concern that the abi shouldbe used13:27
sdakebut the issue there is the abi doesn't currently support multiple process runs13:27
rhalliseymy point was that the command is customizable13:28
rhalliseywhere as the config stuff was not13:28
rhalliseythat's why I'm a little hesitant13:29
rhalliseyyou can change to command to execute a file13:29
*** zhurong has quit IRC13:31
sbezverksdake: well in this case we need to decide, if we want to use kube features to the maximum, then we need to change a bit the strategy. but if we want to use old aproach of controlling each step in ansible, that is fine too, but we will get get kube advantages..13:31
sdakeok rhallisey well can you sort out a proposal for the nedium term13:31
sdakeand we can just merge this in the short term since it seems to fix the problem13:31
sbezverksdake: s/get/not/13:32
sdakewhat i'm missing in this patch is where is the dev bindmount?13:32
sbezverksdake: dev mount in daemonset definition13:32
*** zhurong has joined #openstack-kolla13:32
sbezverkI am about to push it to kolla-kubernetes13:33
*** banix has joined #openstack-kolla13:33
*** ayoung has joined #openstack-kolla13:34
*** matrohon has quit IRC13:35
*** ayoung has quit IRC13:37
*** ayoung has joined #openstack-kolla13:43
*** rkrum has quit IRC13:46
*** matrohon has joined #openstack-kolla13:51
rhalliseysbezverk, can you add todo comment in that patch13:52
rhalliseyjust so we track this temp fix13:52
openstackgerritChristian Berendt proposed openstack/kolla: Set up libvirt to use huge pages  https://review.openstack.org/35242913:53
*** mntdevops has joined #openstack-kolla13:54
sbezverkrhallisey: sure thing, as soon as I push out my DaemonSet :-)13:54
rhalliseykk thanks13:54
mntdevopshello there, Kolla folks.  I've been trying for a few days now to install an all-in-one from the current master branch on bare metal13:55
mntdevopsand I think I'm running into several problems stemming from my lack of a working globals.yml13:55
mntdevopsdoes anyone have a currently working globals.yml, say from the devstack instance?13:56
*** huikang has joined #openstack-kolla13:56
mntdevopsI notice the bootstrap code for the vagrant file does a few seds to replace some thigns13:56
mntdevopsso is that the recommended method?13:57
mntdevopstake the current globals.yml from master13:57
pbourkemntdevops: the one that ships in the repo works, but you will need to tweak some things for your environment as outlined in the docs13:57
mntdevopsand apply those seds by hand?13:57
mntdevopsI think that's where I'm getting into trouble13:57
mntdevopssome of the plays fail with empty items (options being passed to kolla_docker.py)13:58
mntdevopsand that stems from misconfiguration13:58
mntdevopsI guess what I'm saying is13:58
mntdevopsthere are a lot of options that all have to be right :-(13:58
*** coolsvap_ is now known as coolsvap13:58
pbourkeif you like you could pastebin your globals and some of the errors you're seeing. then we might be able to see where the problems are13:58
coolsvapsdake: i have tough competition13:58
mntdevopsand I was hoping you all had one that worked13:58
mntdevopsso I could compare mine to yours that way13:58
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Introducing DaemonSet for Neutron Openvswitch components  https://review.openstack.org/35243313:58
coolsvapthink they sent the poll to participating projects PTLs13:59
mntdevopsthanks pbourke13:59
mntdevopstell you what13:59
mntdevopsI'll share my github13:59
mntdevopsrepo13:59
mntdevopsjust give me a min14:00
mntdevopsvery much appreciate the extra eyes14:00
*** Liuqing has joined #openstack-kolla14:00
mntdevopshttps://github.com/mntdevops/netpxemirror-ac/blob/master/ansible/roles/os-aio/files/globals.yml\14:01
mntdevopshttps://github.com/mntdevops/netpxemirror-ac/blob/master/ansible/roles/os-aio/files/globals.yml14:01
*** huikang has quit IRC14:02
mntdevopsmy key issue at the moment surrounds cinder and nova14:02
mntdevopsI can start instances provided no volume needs to be created14:02
mntdevopsI've created the cinder-volumes vg14:02
mntdevopsand I just this morning enabled LVM2 backed cinder14:03
mntdevopswhich I hope resolves things14:03
pbourkemntdevops: so if you're getting errors during deploy we should look into those first14:03
mntdevopsit's kolla-ansible building now14:03
pbourkemntdevops: otherwise all bets are off for runtime14:03
pbourkemntdevops: do you have output for the parts of the deploy that are failing?14:03
mntdevopsthe deploy works cleanly atm14:04
mntdevopsit's when I go to start a new instance with a volume14:04
pbourkeok14:04
mntdevopsI'm in the process of rebuilding from scratch14:04
mntdevopswith the iscsi and tgt stuff now in there14:04
mntdevopsenable_cinder_backend_lvm: "yes" cinder_backend_iscsi: "{{ enable_iscsi }}" cinder_backend_ceph: "{{ enable_ceph }}"  # Cinder's iSCSI backend !!!REQUIRES!!! two parameters: # 1 - IP address of the server hosting LVM Volume group # 2 - The name of Volume group which Cinder will use. cinder_volume_group: cinder-volumes14:05
mntdevopsah14:05
mntdevopsenable_cinder_backend_lvm: "yes"14:05
mntdevopscinder_backend_iscsi: "{{ enable_iscsi }}"14:05
mntdevops(which is yes)14:05
mntdevopscinder_volume_group: cinder-volumes14:05
mntdevopsI think this is the area of issue14:05
mntdevopsthese specific settings14:06
*** matrohon has quit IRC14:06
mntdevopsI'm not sure what the setting has to be for "# 1 - IP address of the server hosting LVM Volume group"14:06
mntdevops#2 should be correct14:06
mntdevopsagain, thank you for looking into this14:07
mntdevopsI'll post the logs/errors when I get them14:07
mntdevopsanother question: If I have a registry on my network, how/when do I need to re-run kolla-ansible build --push?14:08
mntdevopsin other words14:08
mntdevopsis absolutely zero configuration baked into the containers?14:09
mntdevopssuch that I can build them once and just reconfigure as needed?14:09
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Introduce a script to launch ovsdb-server process  https://review.openstack.org/35178414:09
sbezverkrhallisey: done with note about tmp workaound..14:09
mntdevopsor do some configuration changes require certain containers to have to be rebuild14:09
mntdevopst14:09
mntdevopsI think what I'm struggling with is "if I make a change to globals.yml, what build/pull/deploy/reconfigure related things must be done to make that take effect?"14:11
rhalliseysbezverk, k wfm14:12
*** fragatina has joined #openstack-kolla14:17
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Introducing DaemonSet for Neutron Openvswitch components  https://review.openstack.org/35243314:18
coolsvappbourke: which browser did you use for the sslvpn plugin installation?14:19
coolsvapI am not able te do it with either chrome or firefox14:19
pbourkecoolsvap: I couldn't get the plugin to work with any browser14:19
pbourkecoolsvap: that's why I made the dockerfile14:19
sdakemntdevops - zero configuration is built into the containers - one push is all you need unless there is a security update on a maintenance branch - then you would want to push again14:21
*** fragatina has quit IRC14:21
sdakecoolsvap i used safari14:21
coolsvapah. let me check that14:22
sdakethe sslvpn plugin does not work with chrome14:22
sdakechrome took out the nssapiv2 iirc14:22
sdakefirefox may have done the same hting14:22
*** matrohon has joined #openstack-kolla14:22
coolsvapsdake: hmm chrome blocked it so did firefox14:22
sdakei dont know if blocked is the right word - thiink defeatured is more accurate14:23
sdakenot sure aobut firefox - i didnt tr ythat14:23
*** matrohon has quit IRC14:24
*** mnasiadka has quit IRC14:25
wirehead_sdake: "the afternoons are typically downtime for our community"  Yeah.  I've had to completely alter my routine to keep up with the community. :P14:25
coolsvaphmm blocked may be a bit harsh, chrome discontinued support for NPAPI plugins :)14:26
pbourkecoolsvap: try the dockerfile you'll be connected in no time14:26
coolsvappbourke: building it14:26
mntdevopsok, thanks sdake.  That makes sense14:30
sdakehey core reviewers14:31
sdakeone of the glare cats is coming by at 16:00 utc to chat14:31
sdakewe need to understand how this impacts openstack - because rom my parsing of jay's comments, itseems like glare will eventually replace glance entirely14:32
*** ad_rien_1 has quit IRC14:32
sdakeso lets be nice and just ask the technical questions that need to be sked14:32
sdakemain concern being how do we upgrade14:33
openstackgerritMerged openstack/kolla-kubernetes: Neutron-network services split out into discrete pods  https://review.openstack.org/35026014:33
wirehead_So, we can't just sit around and glare at them?14:33
sdakeyou can do whaever you like as long sa it is polite :)14:37
*** mewald1 has joined #openstack-kolla14:39
*** zhubingbing_ has quit IRC14:39
*** matrohon has joined #openstack-kolla14:40
*** mewald has quit IRC14:41
*** fragatina has joined #openstack-kolla14:43
*** b_bezak_ has quit IRC14:45
mntdevopswell I'll be... the iscsi/lvm2 bits were the trick14:45
mntdevopsenable_cinder_backend_lvm: "yes" was the key14:46
sbezverkwirehead_ could you please check this PS: https://review.openstack.org/35243314:46
mntdevopsI guess it just took the extra set of eyes! Thanks again14:47
wirehead_yeah.14:47
*** zhubingbing has joined #openstack-kolla14:50
*** mewald has joined #openstack-kolla14:50
zhubingbinghi14:50
zhubingbingsdake，14:50
*** huikang has joined #openstack-kolla14:51
*** mewald1 has quit IRC14:51
*** huikang has quit IRC14:55
zhubingbing114:56
*** mliima has quit IRC14:58
zhubingbing- -15:02
sdakepbourke re coordination, any updates on where we are currently?15:02
sdake(related to osic)15:02
*** egonzalez90 has joined #openstack-kolla15:03
pbourkesdake: going by the etherpad (https://etherpad.openstack.org/p/kolla-N-midcycle-osic) we're ready for stage 1.2 which is running tempest/rally15:03
*** fragatina has quit IRC15:03
*** duonghq has joined #openstack-kolla15:04
pbourkecoolsvap is looking into it and has informed me he'll shout when he needs us :)15:04
sdakenice15:04
coolsvapsdake: i am configuring rally15:04
sdakei dont know that we specifically need rally or tempest reports15:04
*** fragatina has joined #openstack-kolla15:04
sdakebut i've never run rally so i don't nkow what type of  reportit produces15:04
sdakeperhaps the master doc should include those reports15:04
sdakeand then we can break them out later as separate docs15:04
coolsvapsdake: rally has nice reports15:05
sdakebut lookingto folks doingthe work to comment on whether we should or shouldn't include reports for each scneario15:05
pbourkecoolsvap: if/when you're building or deploying stuff, can you time the commands15:06
pbourkewe can do more specific benchmarking also but nice to have an overall set of times for general operations15:06
coolsvappbourke: sure15:07
openstackgerritLi Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218015:07
*** srwilkers has joined #openstack-kolla15:09
openstackgerritEduardo Gonzalez proposed openstack/kolla: Customizations for Ceph  https://review.openstack.org/35182315:09
*** matrohon has quit IRC15:10
*** srwilkers_ has joined #openstack-kolla15:11
*** srwilkers has quit IRC15:13
*** srwilkers_ is now known as srwilkers15:13
*** srwilkers has quit IRC15:15
*** egonzalez90 has quit IRC15:16
*** srwilkers has joined #openstack-kolla15:16
*** zhurong has quit IRC15:18
*** mliima has joined #openstack-kolla15:19
*** matrohon has joined #openstack-kolla15:27
*** rmart04 has quit IRC15:31
*** matrohon has quit IRC15:32
duonghqrhallisey: according to your sugestion, I will head to bp swift-kubernetes first, so who is working on this bp?15:34
rhalliseyduonghq, nobody is.  I can assign it to you15:34
duonghqokay, thank you15:35
wirehead_Yay! :)15:36
rhalliseywirehead_, hey15:37
wirehead_duonghq: There's a pod that was created for Swift a long time ago and hasn't been touched since.15:37
duonghqwirehead_: interesting15:38
sdakesay wirehead_ - any idea on the state of nova booting in kolla-kubernetes15:38
wirehead_sdake: Very very very close. :)15:39
*** dmueller-evoila_ has quit IRC15:39
wirehead_sdake: As in, the processes are up, and I was starting to actually poke at it.15:39
rhalliseynice15:39
sdakeneed any guidnace with compute?15:39
sdakeI did that work initially and have extensive understanding of all the things that need to go toghether to make computehappen15:39
wirehead_sdake: hm.  Not yet.  Will probably need some help shortly.15:41
sdakeping if needed15:41
*** ppowell has joined #openstack-kolla15:42
*** harlowja_at_home has joined #openstack-kolla15:42
*** Liuqing has quit IRC15:43
duonghqI think Hiroki Ito has nice work at https://review.openstack.org/#/c/351588/ but he just got one +2, can somebody verify his work?15:44
patchbotduonghq: patch 351588 - kolla - Fix prechecks of a vip address15:44
*** srwilkers has quit IRC15:44
*** Serlex has quit IRC15:46
*** fragatina has quit IRC15:49
*** matrohon has joined #openstack-kolla15:49
*** srwilkers has joined #openstack-kolla15:51
*** daneyon has joined #openstack-kolla15:52
*** mewald has quit IRC15:53
duonghqcoolsvap: can you take a look at Hiroki Ito's work15:54
*** jrich523 has joined #openstack-kolla15:55
coolsvapduonghq: done15:56
duonghqcoolsvap: I saw, thanks15:57
*** michauds has joined #openstack-kolla15:57
*** daneyon has quit IRC15:57
*** inc0 has joined #openstack-kolla15:58
inc0hey15:59
inc0any news my dear kollagues?15:59
inc0any movement on osic cluster? pbourke sdake15:59
*** matrohon has quit IRC15:59
*** haplo37__ has joined #openstack-kolla16:00
*** mfedosin has joined #openstack-kolla16:00
sdakeinc0 yes16:00
*** srwilkers_ has joined #openstack-kolla16:00
pbourkeinc0: inc0 http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/latest.log.html#t2016-08-08T15:03:3116:01
sdakewe have yet to have a US coordinator though16:01
inc0count me in16:01
sdakenot sure who that would be16:01
sdakeI am too busy atm to take on that role16:01
mfedosinsdake: hey :) you may ask me any questions about Glare16:01
sdakefortunately our emea coordinator (pbourke) is here16:01
sdakemfedosin cool16:02
sdakemfedosin did I understand the thread correctly that glare will eventually take on image storage?16:02
jrich523hey guys, trying to do the kolla-build and im getting some failures, but, its failing and im not really getting any details other than which packages failed..16:02
sdakejrich523 we are having an impromptu community meeting related to an important dependency in openstack16:02
jrich523however it doesnt say why, or how they are being installed (which packages)16:02
jrich523ahh i'll wait :)16:03
*** srwilkers has quit IRC16:03
*** srwilkers_ is now known as srwilkers16:03
sdakejrich523 can you wait a bit - and we will be with you in about 30 mins?16:03
jrich523sounds good!16:03
mfedosinsdake: correct :) It is my greatest wish16:03
sdakemfedosin cool - is an upgrade approach being defined16:03
sdakemfedosin the reason I ask is nova and cinder both have provided upgrade approaches for their software16:03
inc0sdake, I can take on it16:03
sdakemfedosin and other big tent projects as well16:03
inc0I won't be online 100% of time but thats one of my priorities for this week16:04
mfedosinsdake: at least we support microversions16:04
mfedosinit's for API16:04
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Introducing DaemonSet for Neutron Openvswitch components  https://review.openstack.org/35243316:04
mfedosinfor artifact type we follow standard oslo_versionedobjects techniques16:05
sdakemfedosin more concerned about upgrade approach from glance to glare for the image specific portions16:05
sdakethe rest we can handle since there is no history of glare implementation in ODMs16:05
mfedosinah, that one...16:05
mfedosinit's under discussions, but Glare is able to work with Glance images in parallel16:06
mfedosinso, you can create an image with Glare and use it in Glance, and vice versa16:06
sdakemfedosin i could probably read the code and find out - but mind expanding in more detail?16:06
sdakeok so a occata deployment would include both glance and glare?16:07
sdakeand have endponits for both?16:07
sdakeand glare would sort out working with glance in that model?16:07
Mech422Morning16:08
mfedosinokay, so, first of all, Glare has pluggable db api , which means that images artifact type is able to work with Glance tables16:08
sdakeah16:09
sdakecool16:09
*** srwilkers has quit IRC16:09
mfedosinwe wrote an adapter that transforms one format to ours16:09
sdakeso in occata in a pefect world, glance would not be needed, just the database contents for an upgrade?16:09
mfedosinI hope so16:10
sdakecool different topic16:10
mfedosinthen we want to add Glare support to Nova16:11
sdakeglance has been pretty negative about supporting file backed storage with multi-controller model (for ha)16:11
mfedosinthere are no big differences in APIs16:11
sdakeany plans to solve that problem?16:11
sdakewe need it to make cinder work properly16:11
sdakewith multiple controllers with iscsi16:12
sdakecinder integrates many hardware based storage solutions via iscsi16:12
mfedosininitially we will use glance_store library to communicate with storage backends16:12
sdakethe last statement on the review was that glance should create a whole slew of plugins for harwdware vendor gear16:13
mfedosinhttps://github.com/openstack/glance_store/tree/master/glance_store16:13
sdakemfedosin not an expert in all this stuff - thanks for the link :)16:13
sdakemind giving me a TLDR :)16:13
sdakei want to keep it at 30 minutes - rather then reading that doc now16:13
mfedosinat least there are cinder driver to work with cinder https://github.com/openstack/glance_store/blob/master/glance_store/_drivers/cinder.py16:14
sdakeyes - that is not the issue16:14
sdakemoment let me find a link16:14
sdakehttps://bugs.launchpad.net/cinder/+bug/157121116:15
openstackLaunchpad bug 1571211 in Cinder "In multinode setup VM fails to launch due to cinder not checking with all glance api servers" [Medium,In progress] - Assigned to John Griffith (john-griffith)16:15
sdakeanyone else from kolla community have any questions for Mike?16:16
coolsvapinc0: i have configured rally16:16
openstackgerritMerged openstack/kolla: Fix prechecks of a vip address  https://review.openstack.org/35158816:16
inc0coolsvap, great, I need to work out VPN connection here16:16
inc0and will join you guys later16:16
*** huikang has joined #openstack-kolla16:17
coolsvapi am taking a look at benchmarking tests to run16:17
mfedosinsdake: ha, it's a know bug - they got the same in Nova16:18
mfedosinknown16:18
sdakewe worked aorudn it in nova by using the nova api list16:18
sdakecinder has a same api lsit feature16:18
sdakebut cinder reviewers dont want to ping all the api servers16:18
mfedosinsdague fixed it there16:18
sdakekolla core cats16:20
sdakeglare is meant to be an artifact storage system - and one of the artifacts it will be storing is images16:21
sdakeany quesetions related to upgrade or reconfigure?16:21
sdakeor anything else?16:21
sdake(thanks Mike btw, this is greatly appreciated so we can plan properly)16:21
mfedosinYou're welcome :)16:22
*** srwilkers has joined #openstack-kolla16:22
mfedosinif there are any other questions feel free to ping me in IRC or by email: mfedosin@gmail.com16:22
sdakemfedosin irc is better - recorded that way16:23
sdakeglare channel  is #openstack-glare?16:23
mfedosinit's not created yet16:24
mfedosinbut will be in a couple of days16:24
sdakewhats its planned name?16:24
mfedosin#openstack-glare for sure16:24
sdakecool16:28
sdakei'll post a folllowup link to this irc conversation so the other ODM folks can learn from it16:28
sdakethanks for your time :)16:28
sdakei guess the rest of the kolla community found the answers useful or they would have asked more :)16:28
*** harlowja_at_home has quit IRC16:29
*** david-lyle_ has joined #openstack-kolla16:29
inc0pbourke, coolsvap sdake anyone downloaded f5fpc by any chance?16:31
sdakeinc0 no idea dude, i just downloaded a plugin into safari16:31
sdakesome f5 plugin16:31
pbourkeinc0: https://github.com/brk3/docker-f5fpc16:31
inc0pbourke, woot thanks16:31
*** jem_ has joined #openstack-kolla16:31
*** jem_ is now known as Guest9984616:32
inc0one of us made it?16:32
*** david-lyle has quit IRC16:33
coolsvapi think pbourke did16:33
Guest99846I'll sign back in with the longer nicname I was using last weel16:33
Guest99846I'll sign back in with the longer nicname I was using last week16:33
*** Guest99846 has left #openstack-kolla16:33
*** srwilkers has quit IRC16:33
*** jemcevoy has joined #openstack-kolla16:34
*** rmart04 has joined #openstack-kolla16:35
*** unicell has quit IRC16:36
sdakejrich523 ok - i'm from the federal government and I'm here to help16:37
sdakejrich523 could you repeat your question16:37
*** jemcevoy has quit IRC16:38
jrich523im trying to run the build-kolla and its having a problem with a few of the packages16:39
jrich523mostly around Watcher it seems16:40
sdakeok watcher isn't mandatory16:40
sdakeif watcher fails, ignore it16:40
sdakeanything else failing?16:40
*** srwilkers has joined #openstack-kolla16:40
jrich523but senlin16:40
sdakejrich523 are you doing an eval or planning to do development?16:40
jrich523kuryr16:40
sdakesenlin also not relevant yet16:40
jrich523just trying to  get my feet under me :)16:40
sdakekuryr BDWNF16:40
sdakekuryr needs keystonev3 support before we support it in kolla16:41
jrich523yeah just those 3, watcher, senlin, kuryr16:41
sdakegood - your golden on your build then16:41
sdakethe other 3 are new services16:41
sdakei'd highly recommend if you are doing an eval, to use a stable branch16:41
jrich523ok then! back to following directions :)16:41
jrich523oh, well im just following the step by step directions16:42
sdake(which are not in the instructions unfortunately)16:42
jrich523kind of a bummer :)16:42
sdakewhat you are deploying (master) is the master of all openstack projects16:42
sdakeand really meant for developers16:42
sdakeplease oh please would omeone fix that in our documentation!16:42
jrich523well i didnt specify, so i assume master, unless someone changed the default branch16:42
coolsvapokay so I have started tempest verification with rally16:42
sdakethe default branch is master16:42
jrich523yeah, thought so16:43
jrich523so shouldnt master be stable?16:43
coolsvapI am still getting hold of benchmark scenarios most of them are failing16:43
coolsvapnot failing as faling on kolla but cannot be validated by rally itself :)16:44
sdakejrich523 master deploys all openstack services from master16:45
sdakejrich523 do you think all oepnstack services from master are stable?16:45
jrich523... should be16:45
sdakeinteresting perspective :)16:46
jrich523normally you make a branch to dev on, and then once its stable merge it... but apparently there is a different workflow here :)16:46
sdakemaster of openstack is broken o na constant basis16:46
jrich523lol good to know16:46
jrich523is there a "stable" branch or something i should use?16:46
sdakeye16:46
sdakes16:46
sdakegit checout stable/mitaka16:46
sdakegit checkout stable/mitaka16:46
sdakepip remove (or uniinstanll forget which) kolla16:46
sdakethen pip install -e . from the kolla directory16:47
sdakealso you will need ansible 1.9.416:47
*** b_bezak has joined #openstack-kolla16:48
*** athomas has quit IRC16:48
jrich523looks like current is 2.1.0.0, roll that back to 1.9.4?16:48
sdakeright16:48
sdakepip install ansible==1.9.4 should do the trick16:49
jrich523yup, that did it16:49
*** fragatina has joined #openstack-kolla16:50
*** diogogmt has joined #openstack-kolla16:50
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Introducing DaemonSet for Neutron Openvswitch components  https://review.openstack.org/35243316:51
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role Partially-Implements: blueprint barbican-ansible  https://review.openstack.org/35251516:51
*** jemcevoy has joined #openstack-kolla16:51
coolsvapsdake: we are missing scenario for swift in osic16:51
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Introduce a script to launch ovsdb-server process  https://review.openstack.org/35178416:51
*** chopmann has joined #openstack-kolla16:51
zhubingbingI completed the Barbican ansible role, we can go to help me review under the code16:53
zhubingbingthinks all16:53
sdakecoolsvap you mean in the etherpad?16:53
sdakewe are missing scnearios for lots of services16:53
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251516:53
coolsvapsdake: yes16:54
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Cinder  https://review.openstack.org/35058716:54
sdakelets tackle what we have16:54
coolsvapyes16:55
sdakethen we can add if we have more time16:55
sdakei want to give sean-k-mooney a full week as promise to sort out bifrost16:55
sdakethat takes priority imo over invidiual service sccale testing16:55
sdakebut open to arguents against :)16:55
*** inc0 has quit IRC16:55
coolsvapagree, just something I saw failed because service not configured in tests16:56
coolsvapso :)16:57
sdakeso rally wont work at all?16:57
jemcevoyMorning inc0,  I got further over the weekend with my install when I switched to the mitaka branch... Now I am a bit confused by the Ceph disk labeling... Do the partition names need to be unique across the cluster of for each host?  I am using _1 _2 _3 on all my hosts and bootstrapping OSD's failed.  I have 5 nodes in my cluster and an example of how I am labeling the disks is in this host_vars file: http://paste.openstack16:58
sdakejrich523 just to duble check, can you past e outpu of pip show kolla please16:59
coolsvapsdake: it works but I think it has got some issues with v3 in general16:59
coolsvapkeystone v316:59
sdakev3 of which - keystone?16:59
jrich523sure, once the build finishes17:00
*** rmart04 has quit IRC17:00
duonghqcoolsvap: finally I got kolla up and running today afternoon with ubuntu/source (my local time), I just run deploy twice and I ran, still cannot figure out why it didn't run. I'll investigate more on this case when I have time. It seems that strange behavior17:01
sdakeduonghq cool - nice work!17:02
coolsvapduonghq: cool17:04
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Cinder  https://review.openstack.org/35058717:05
*** unicell has joined #openstack-kolla17:05
zhubingbingsdake,17:06
zhubingbingCan you assign BP trove to me17:06
zhubingbing?17:06
sdakezhubingbing otp atm - coolsvap can you do so or rhallisey ?17:06
sdakezhubingbing orjust work on it and i'll ge tto it in 30 ins17:07
duonghqI need to take a rest, bye bye17:09
*** duonghq has left #openstack-kolla17:09
*** sdake_ has joined #openstack-kolla17:13
*** sdake has quit IRC17:15
*** daneyon has joined #openstack-kolla17:22
*** daneyon_ has joined #openstack-kolla17:23
*** daneyon has quit IRC17:27
jrich523sdake_ i assume you want to see the version from that output, 2.0.3.dev1017:28
srwilkersgood afternoon everyone — a coworker and I are following the quickstart guide for kolla-kubernetes for developing, not the full install for evaluation.  when we go to bootstrap mariadb, we get the following:  ‘ansible_processor_vcpus’ is undefined.  is there something we’re missing, or are we just making a silly mistake?17:28
rhalliseysrwilkers, no that is a config issue17:29
rhalliseysrwilkers, https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml#L18817:29
srwilkersrhallisey, thanks17:30
rhalliseyif you change that to be openstack_service_workers: "" and run the kolla-ansible genconfig it will fix the issue17:30
rhalliseysrwilkers, that will work for now.  May need to change it when we add rabbitmq17:30
srwilkersgreat, thanks17:31
*** timss has quit IRC17:33
openstackgerritDuane DeCapite proposed openstack/kolla: Change cleanup to remove as cleanup is a misnomer  https://review.openstack.org/35186917:34
*** ppowell has quit IRC17:37
openstackgerritDuane DeCapite proposed openstack/kolla: Change cleanup to destroy as cleanup is a misnomer  https://review.openstack.org/35186917:37
sdake_rhallisey ping - can you review the above ^17:40
*** senk has joined #openstack-kolla17:42
sdake_jrich523 looksgood17:42
senkcan someone review this? https://review.openstack.org/#/c/352030/17:42
patchbotsenk: patch 352030 - kolla - Change Quickstart to follow code conventions17:42
*** david-lyle_ has quit IRC17:42
sdake_senk i'm struggling to understand the rationale17:44
sdake_senk iff one were provided, I think it may help tha treview along17:44
senksdake_: official code conventions @ http://docs.openstack.org/contributor-guide/writing-style/code-conventions.html say it's bad practice.. i mentioned it in the commit?17:45
*** david-lyle has joined #openstack-kolla17:45
sdake_it doesn't say why17:46
senki guess it's better to turn brain on when installing something than to simply copy paste commands and hoping it works :D17:46
senkand of course anyone agreed to that convention and consistency is king :D17:47
senkyou get no information about the dependencies that get installed along with the package17:51
*** ppowell has joined #openstack-kolla17:52
mntdevopssenk, may I suggest also adding items for disabling/configuring firewalld and setting SELinux to permissive/disabled?17:52
mntdevopson centos, at least17:52
mntdevopsboth of those items were a "duh" moment for me17:53
mntdevopsbut just a hint about them would be beneficial, IMO17:54
mntdevopsthe SELinux bit was silently preventing nova-compute from accessing /dev/kvm17:54
senkfeel free to push a review on that17:54
mntdevopsme?17:54
*** sdake has joined #openstack-kolla17:55
senkif you want17:55
mntdevopsI'm just a new user here who *just* got it working :)17:55
senkdocker and SELinux caused me some sleepless nights :D17:55
sdakecoolsvap results look good17:55
sdake10% of test cases fail it looks like17:55
sdakebut who knows if hat is tempest or kolla17:56
mntdevopssenk, not sure how to "push a review"17:56
mntdevopssign up for launchpad?17:56
mntdevopsthen do the equivalent of a pull request?17:56
coolsvapyes we can analyse that17:56
sdakemntdevops no its a bit more involved then that17:56
mntdevopslol17:56
mntdevopsI just suggested a couple tweaks to the getting started guide17:57
sdakemntdevops if your interested in becoming an openstack developer, I cna gie you a crash course in how to setup your environment17:57
mntdevopswell17:57
mntdevopsbaby steps first17:57
sdakeroger17:57
mntdevopsnot new to linux17:57
sdakeoffer stands :)17:57
mntdevopsnot new to ansible17:57
mntdevopsnew to openstack17:57
mntdevops:)17:57
*** sdake_ has quit IRC17:57
mntdevopstell you what17:57
mntdevopsI'll stick with it some more17:57
mntdevopsand see if I start picking up on it17:57
mntdevopsit's a fire hose now17:57
sdakeright17:58
mntdevopsall I was saying to senk was that a mention to firewalld and selinux in the getting started would be gootd17:58
mntdevopsgood17:58
senkmntdevops: http://docs.openstack.org/infra/manual/developers.html17:58
mntdevopse.g. disabling them17:58
mntdevopsuntil you know what the heck you're doing, at least :)17:58
coolsvapsdake: I will try some hands on benchmark tests before handing over for scenario 2, is it fine?17:58
sdakeall yours17:59
senkmntdevops: you can follow that from top to bottom and test your setup at http://docs.openstack.org/infra/manual/sandbox.html#sandbox17:59
sdakea table summary in the documentation we are producing of the pass/fail/skip or tempet would be helpful17:59
sdakecoolsvap can you pull down the review, modify it, and git review it again?18:00
coolsvapsdake: will do18:00
mntdevopssenk, thanks18:00
mntdevopsI'll look into that18:00
sdakethat is probably the first time anyone has run tempest against kolla18:00
rhalliseysdake, how did it go?18:01
sdakecoolsvap is master being deployed - or mitaka?18:01
sdakecoolsvap can you get a link up somewhere for people to download the html18:01
coolsvapsdake: master18:01
rhalliseyI think pbourke has done it18:01
coolsvapsdake: yes I will do18:01
sdakeoh well then those results aren't all that good18:01
sdakei mean valuable18:01
senkmntdevops: always hard to get started. if you need help, feel free to ping me18:01
rhalliseynot sure though18:01
*** chopmann has quit IRC18:03
*** timss has joined #openstack-kolla18:03
coolsvapsdake: rhallisey https://paste.fedoraproject.org/404471/1470679418:04
coolsvaphttps://paste.fedoraproject.org/404471/14706794/raw/18:05
coolsvapraw looks good18:05
sdakenap time18:10
sdakebbiaf18:10
irtermite@all you don't happen to see anything going on with iLo device 10.15.243.222 ? I am reviewing an old ticket I had before handing it off to this group.18:12
*** b_bezak has quit IRC18:12
*** gfidente has quit IRC18:19
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Added support for template variables  https://review.openstack.org/35140818:23
sdakeirtermite - need me to login and check it out?18:25
sdakeI don't really know the ilo command set18:25
sdakepbourke would know but he is in EU tz18:25
sdakeinc0 may know but he isn't around18:25
sdakebritthouser woulddefinatey know but he is on pto for a week18:25
coolsvapsdake: I am off to bed, will update the review tomorrow morning18:27
sdakecoolsvap rq, does tempest output in rst?18:27
sdakethat is what we really need in terms of output18:27
*** ayoung has quit IRC18:27
sdakehtml and json isn't particularly helpful18:27
sdakei guess we could convert the json to rst18:28
coolsvapsdake: its not in rst as per say but we an convert as per req18:28
coolsvapbecause the paste i showed you is too big, I am not too inclined to include that after every scenario18:29
sdakewe could have a file per scenario18:29
coolsvapI will truncate it to keep only info part18:29
coolsvapyes18:30
sdakewould be good data to haveo n what failed atleat in one place18:34
sdakeso people could eval if they care about those scenarios18:35
*** senk has quit IRC18:44
openstackgerritPatrick Powell proposed openstack/kolla: Add Nova sanity check  https://review.openstack.org/34741618:49
*** Kimmo___ has joined #openstack-kolla18:50
*** tuvenen has joined #openstack-kolla18:50
*** qbjolof has joined #openstack-kolla18:50
*** ntpttr has quit IRC18:50
*** bjolo_ has quit IRC18:50
*** macsz has quit IRC18:50
*** tuvenen_ has quit IRC18:50
*** Kimmo__ has quit IRC18:50
*** ntpttr- has joined #openstack-kolla18:50
openstackgerritPatrick Powell proposed openstack/kolla: Add Heat sanity check  https://review.openstack.org/35007118:50
*** macsz has joined #openstack-kolla18:50
*** mliima has quit IRC18:56
jemcevoy I got further over the weekend with my install when I switched to the mitaka branch... Now I am a bit confused by the Ceph disk labeling... Do the partition names need to be unique across the cluster of for each host?  I am using _1 _2 _3 on all my hosts and bootstrapping OSD's failed.  I have 5 nodes in my cluster and an example of how I am labeling the disks is in this host_vars file: http://paste.openstack.org/show/552019:21
sdakejemcevoy iwould think they wouldn't but i am not certain19:25
sdakejemcevoy your system databae is not setup properly -did you run kolla-ansible -i inventory-file clenaup?19:26
jrich523hey guys getting the following error when i try to do kolla-ansible pull : msg: Unknown error message: Tag 2.0.3 not found in repository docker.io/kolla/centos-binary-kolla-toolbox19:26
sdakejrich523 yes - your using a git checkout instead of a git tag19:26
sdaketo make it work add "openstack_release: 2.0.3' to globals.yml19:26
jrich523ok19:27
sdakejrich523 fwiw we are working on sorting out the best way to solve this problem but without a clear solution atm19:27
sdakeits al pbr related19:27
*** mfedosin has quit IRC19:28
jrich523well, i tried starting with devstack, and that went really badly... talked to the openstack folks and they said my best bet was to start here since its the most stable/best documented19:28
jrich523which, even tho its not perfect, its still a lot easier :)19:28
sdakewhich openstack folks did you talk to19:28
jrich523and also you guys respond, which helps a lot :)19:28
jrich523#openstack19:28
jrich523it was tossing a ton of errors when i followed the docs and basically i got "yup, thats what it does right now"19:29
jrich523and was suggest to try this one, or one other, forget the other flavor19:29
jemcevoysdake, Between installs I have been cobbler kickstarting the cluster then my ansible scripts that add a bunch os ssh keys tweak the network and label the disks for ceph... Then I run kolla-ansible deploy.19:32
sdakejemcevoy you need to cleanup between those i suspect19:33
sdakewhich other flavor19:33
sdakedevstack?19:33
sdakeoh nm didn't read your full thread19:33
jrich523nah, let me see if i have the logs19:33
jemcevoyA kickstart is pretty clean...19:34
sdakei think what hey wer esuggesting is to use an actual deployment tool not a development tool such as devstack ;)19:34
*** dwalsh has quit IRC19:34
jrich523OSA19:34
jrich523right19:35
openstackgerritMerged openstack/kolla-kubernetes: 3/4 of the Neutron Compute services start correctly  https://review.openstack.org/35028519:35
*** zhubingbing has quit IRC19:42
*** macsz has quit IRC19:47
*** macsz has joined #openstack-kolla19:47
*** v1k0d3n has joined #openstack-kolla19:52
jemcevoyjrich523, I am doing my first install using Kolla... My first problem was that I was installing master which is a moving target.   Make sure that you are using a stable branch.19:56
*** v1k0d3n has quit IRC19:57
jemcevoyI am using origin/stable/mitaka19:57
*** dwalsh has joined #openstack-kolla20:02
*** ppowell has quit IRC20:02
Mech422jemcevoy: partition names for ceph are machine local - each machine CAN have a _1 _2 _320:02
*** dwalsh has quit IRC20:03
Mech422jemcevoy: btw - I rebuild my stuff pretty much the same way, but I use foreman instead of cobbler20:03
Mech422jemcevoy: oh - not sure the ceph partition stuff got backported to Mitaka ?20:04
Mech422jemcevoy: you might need to use full disks on Mitaka20:04
jemcevoyWhat is the label pattern for full disks?20:04
Mech422jemcevoy: errgg...some long string...hang on, let me check...20:05
Mech422jemcevoy: shell: sgdisk --change-name=4:KOLLA_CEPH_OSD_BOOTSTRAP_1 /dev/sda20:05
Mech422jemcevoy: shell: sgdisk --change-name=3:KOLLA_CEPH_OSD_BOOTSTRAP_1_J /dev/sda20:06
Mech422jemcevoy: remember, they need to be GPT partition tables20:06
openstackgerritChristian Berendt proposed openstack/kolla: Add cloudkitty ansible role  https://review.openstack.org/34930520:08
jemcevoyI have 3 ceph disks on my vmhosts  Would then be named KOLLA_CEPH_OSD_BOOTSTRAP_1 KOLLA_CEPH_OSD_BOOTSTRAP_2 KOLLA_CEPH_OSD_BOOTSTRAP_3 and and the journals on the same disk?20:08
*** jtriley has quit IRC20:09
Mech422jemcevoy: theoretically...not sure if mitaka supports partitions for ceph20:09
Mech422jemcevoy: I run off master, which had a patch applied20:10
Mech422jemcevoy: I have KOLLA_CEPH_OSD_BOOTSTRAP_1 and KOLLA..._BOOTSTRAP_1_J on my boot drive20:11
Mech422jemcevoy: but unpatched, I think you need a whole disk for ceph use20:11
jemcevoyMech422, so where do I put the journals?20:12
Mech422jemcevoy: if you use a whole disk, kolla does that for ya...20:13
rhalliseydcwangmit01, one more thing we need in the CLI is the ability to check that status of a pod that was started by a job/rc/daemon-set20:16
rhalliseythe status you get from pods are descriptive enough to know if the service is healthy20:17
rhalliseyfor example a job resource won't tell you the health of a pod20:17
*** srwilkers has quit IRC20:22
sbezverkdcwangmit01: it looks like kolla-kubernetes does not return status of job20:25
sbezverkrhallisey: but it does check the status ofservice20:25
rhalliseysbezverk, we need the pod status20:25
rhalliseyor we will never know if it's healthy20:26
sbezverkrhallisey: it return pod status20:26
rhalliseyyou can't check that status of a mariadb bootstrap pod20:27
rhalliseyfrom the cli20:27
sbezverkdcwangmit01: please check this: http://paste.openstack.org/show/552084/20:27
sbezverkrhallisey: in all cases bootstrap is a job, right, if pod keeps crashing job status should reflect it20:27
rhalliseysbezverk, it doesn't20:28
rhalliseybecause kubernetes views the job as created20:28
rhalliseyso it's kubernetes thinks it's healthy20:28
rhalliseysame goes for rc20:28
rhalliseywhen you query a pod it will return that status of the containers20:28
rhalliseywhich is what were after20:28
rhalliseybut we need the pods attached to the bootstrap resource20:29
rhalliseyjob/rc/daemonset20:29
sbezverkrhallisey: I see what you mean but there is no easy way to get pod name for rc and jor job as they are auto-generated20:30
rhalliseyyou have to do a string search20:30
rhalliseyhttps://github.com/ansible/ansible-modules-extras/pull/2466/commits/3b2fa43dedfac30cf37fa367cdff1cdf2fcbb673#diff-76158272904e427e5435304fb425a193R34620:30
*** sdake has quit IRC20:33
*** inc0 has joined #openstack-kolla20:33
*** Jeffrey4l has quit IRC20:35
*** Jeffrey4l has joined #openstack-kolla20:35
*** bootsha has joined #openstack-kolla20:36
*** vhosakot has joined #openstack-kolla20:37
*** inc0 has quit IRC20:38
sbezverkrhallisey: if job has 3-4 pods do you want to see individual ok for each pod or one consolidated?20:38
rhalliseysbezverk, good question20:38
*** mark-casey has joined #openstack-kolla20:40
rhalliseyjust a second20:40
rhalliseysbezverk, can you get them individually based on name?20:43
rhalliseysbezverk, what pods show up for you when you do a keystone bootstrap20:43
rhalliseymine isn't working atm20:44
openstackgerritMerged openstack/kolla-kubernetes: Fix Nova bootstrap  https://review.openstack.org/34645220:46
openstackgerritMerged openstack/kolla-kubernetes: Register Nova with Keystone  https://review.openstack.org/35195720:46
dcwangmit01rhallisey: If kolla-kube creates a job, it can check the status of a job.  If it creates an RC, it can check the status of the RC.20:47
rhalliseydcwangmit01, right, but we also need to status of the pods associated with the job/rc20:48
dcwangmit01rhallisey: sbezverk The arg to kolla-kube "job" is just a label.  It could be "foobar", at which point it would check all of the kube resources defined under services_resources.yml, which could be of any types20:48
dcwangmit01rhallisey: Yes ^ true.20:48
dcwangmit01So job isn't a type in service_resources.yml.  If you mean job, it probably is under the label bootstrap20:49
dcwangmit01kolla-kubernetes resource status job keystone -v --debug20:49
dcwangmit01resource_type [job] not in valid resource_types [configmap|disk|pv|pvc|svc|bootstrap|pod]20:49
dcwangmit01sbezverk: Try kolla-kube resource status bootstrap keystone20:49
*** jeh has quit IRC20:51
*** vhosakot has quit IRC20:51
dcwangmit01What that does is look under service_resources.yml, finds service keyston, finds all files under the bootstrap resource_type.  Then, one file at a time run through jinja, then feeds each individual kube yaml snippet to kubectl describe, testing the output on the "kind".  E.g. If it's an RC, it ensures pod# actual==desired.  If it's a SVC, it ensures the svc has an IP, etc.20:51
*** vhosakot has joined #openstack-kolla20:52
openstackgerritKen Wronkiewicz proposed openstack/kolla: Nova kubernetes changes  https://review.openstack.org/34645120:53
dcwangmit01Also, the naming of the job to be "bootstrap" is an unfortunate legacy.  kfox1111 Wants me to patch and rename bootstrap to be job, to match the kube type.  I'll do so after a bunch of the kolla-kube patches/merge conflicts go through20:53
wirehead_well, also, we should probably change the -pod to -rc, except we should wait on that till after we turn them into deployments, so people’s head doesnt spin.20:55
*** ayoung has joined #openstack-kolla20:55
*** jeh has joined #openstack-kolla20:56
*** jeh has quit IRC20:56
*** jeh has joined #openstack-kolla20:56
dcwangmit01Yes!20:57
rhalliseydcwangmit01, job or bootstrap works20:57
rhalliseyjob might be better since that is the kube object name20:57
dcwangmit01Yes!20:57
rhalliseydcwangmit01, just need some clarification from above.  Are you agreeing that we don't get that status of the pods from an rc/job20:58
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Remove hostnetworking for Nova control plane and convert to RC  https://review.openstack.org/34757220:58
*** egonzalez90 has joined #openstack-kolla20:58
rhalliseycurrently I'm not seeing, but I may need a pointer :)20:58
dcwangmit01We don't get the status if one Kube resource spawns others.  For example, an RC spawns Pods.  A deployment spawns pods.  Right now, if kolla-kube creates an RC, it can check the status of the RC, and not the subpods.  However, it does get some high-level info from the RC itself, such as the number of pods actual==desired.20:59
dcwangmit01^ so yes I agree, and yes, we need to figure out the linkage21:00
rhalliseygotcha21:00
dcwangmit01However, will that require kolla-kube interpreting labels and selectors?21:00
dcwangmit01We'll be re-implementing part of kubernetes!21:00
dcwangmit01Which makes me reluctant21:00
dcwangmit01So kolla-kube resource status commands (currently) check only the status of the kube resources that it directly creates21:01
dcwangmit01Not any of the spawned sub-pods21:01
rhalliseyhow about rest calls21:01
*** coolsvap has quit IRC21:01
dcwangmit01rhallisey: That's where we would have to go next.  Basically, do not rely on kubectl describe.  Go directly to the API.21:02
rhalliseyhm ok21:02
rhalliseymay put that on hold for this week21:02
dcwangmit01I did not go that way for the first implementation, because it's a lot of work.  We have to worry about kube configuration, proper authentication, etc.21:02
dcwangmit01Although, we must go that way eventually21:02
rhalliseytrue21:02
rhalliseycli v2.021:03
dcwangmit01It's just, when do we want to break that seal and go down that path of lots of work (but much better information).21:03
rhalliseywell it's once we tackle the most urgent matter21:03
rhalliseywhich is a solid demo21:04
dcwangmit01And for now, can we just rely on a combination of "kolla-kube resource status" which only check the status of kube resources that we create, and a "kolla-kube resource health mariadb" which does actual papplcation level port checking, etc.  The latter doesn't exist21:04
rhalliseyprobably won't show deploment, but features of using kube21:04
wirehead_Hm.  I could use a few patches +workflow’d.21:04
dcwangmit01In kolla?  Can't help you.21:05
rhalliseydcwangmit01, I'll bring it up wed at the meeting21:05
*** vhosakot_ has joined #openstack-kolla21:05
wirehead_Kolla-kube21:05
rhalliseyand make a bp21:05
*** bootsha has quit IRC21:05
wirehead_https://review.openstack.org/#/c/347572/21:05
patchbotwirehead_: patch 347572 - kolla-kubernetes - Remove hostnetworking for Nova control plane and c...21:05
*** vhosakot has quit IRC21:05
dcwangmit01wirehead_: A bunch of your patches just went through minutes ago21:05
wirehead_Yeah, that one needed to be rebased after the earlier patches went through21:05
*** bootsha has joined #openstack-kolla21:06
dcwangmit01wirehead_: Just did it.  I see you rebased21:06
dcwangmit01Do you guys know why the CI system isn't running for this: https://review.openstack.org/#/c/351408/21:07
patchbotdcwangmit01: patch 351408 - kolla-kubernetes - Added support for template variables21:07
*** vhosakot_ has quit IRC21:07
dcwangmit01^ I posted a "recheck" which didn't do anything.  Right now, it should be a merge conflict, but still I don't get why CI hasn't run21:07
wirehead_Jenkins has not run on that one.21:08
dcwangmit01I'm wondering why?  Jenkins hasn't run for any of the 3 patchsets21:08
*** haplo37__ has quit IRC21:08
rhalliseyneeds a reverify21:09
dcwangmit01does recheck==reverify?21:12
dcwangmit01rhallisey: Last comment here says it's recheck:  https://bugs.launchpad.net/openstack-ci/+bug/106192921:13
openstackLaunchpad bug 1061929 in OpenStack Core Infrastructure "Reduce confusion between recheck/reverify" [Wishlist,Invalid]21:13
dcwangmit01I'll do both from now on :)21:14
*** bootsha has quit IRC21:15
rhalliseydcwangmit01, recheck will re run the gate.  Reverify will re run the approval to see if it's good to be merged21:15
wirehead_Wow.21:17
*** daneyon has joined #openstack-kolla21:17
*** inc0 has joined #openstack-kolla21:20
dcwangmit01rhallisey: Thanks for the explanation.21:21
rhalliseyno problem21:21
*** huikang has quit IRC21:22
*** daneyon has quit IRC21:22
wirehead_Like, I can’t go full snark and call gerrit hipster-made, artisinal, small-batch custom software run at openstack scale, because it is used by other large projects that hate gitjub.21:22
wirehead_But.  Sometimes.. :P21:23
rhallisey:)21:23
*** haplo37__ has joined #openstack-kolla21:23
rhalliseywirehead_, dcwangmit01 if you guys have a few minutes, scan through the review q and see if anything is good to go21:24
wirehead_I also can’t go full snark at hipster-made artisinal, small-batch anything, given my known cullinary preferences, but..21:24
rhalliseythere are a few patches that have a +221:24
*** inc0 has quit IRC21:24
rhalliseyI g2g for today.  I'll ttyl21:24
*** rhallisey has quit IRC21:25
openstackgerritMerged openstack/kolla-kubernetes: Added support for template variables  https://review.openstack.org/35140821:42
*** inc0 has joined #openstack-kolla21:44
*** egonzalez90 has quit IRC21:47
*** mark-casey has quit IRC21:55
*** banix has quit IRC22:03
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425522:04
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Add Ceph support for Mariadb  https://review.openstack.org/35031222:11
inc0anyone working on OSIC cluster atm?22:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Glance bootstrap to create service/project/role  https://review.openstack.org/34621522:26
*** haplo37__ has quit IRC22:32
*** michauds has quit IRC22:37
*** bmace has quit IRC22:47
inc0networking question guys, how to check with tcpdump if I'm having mtu issue?22:47
inc0and fragmetation happends22:47
inc0?22:47
jemcevoyinc0,  I usually use tracepath to checkout mtu's22:50
jemcevoyinc0, You can also force ping not to fragment like this : ping -M do -s 8972 -c 1 $addr22:53
jemcevoythat is for jumbo frames.  You have to subtract 28 from the mtu size for the headers22:54
inc0my network is fleaky and I wonder if that's because of mtu22:55
inc0but now I added few v's into tcpdump and see lot's of incorrect packets22:55
inc0so I guess retransmissions happens22:55
*** banix has joined #openstack-kolla23:00
*** bmace has joined #openstack-kolla23:04
openstackgerritXinyuan Huang proposed openstack/kolla: Trivial typo fix in doc  https://review.openstack.org/35263123:10
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add persistent volume to Glance  https://review.openstack.org/34830423:22
*** inc0 has quit IRC23:24
openstackgerritChristian Berendt proposed openstack/kolla: Improve script to check used source versions  https://review.openstack.org/35264023:27
*** inc0 has joined #openstack-kolla23:29
*** rkrum has joined #openstack-kolla23:32
openstackgerritChristian Berendt proposed openstack/kolla: Do not iterate over listing in the sanity checks  https://review.openstack.org/35264223:39
*** bmace has quit IRC23:42
*** inc0 has quit IRC23:42
openstackgerritXinyuan Huang proposed openstack/kolla: Fix typo in doc  https://review.openstack.org/35263123:43
openstackgerritChristian Berendt proposed openstack/kolla: Replace horizon default config with custom config  https://review.openstack.org/30692823:45
*** zhurong has joined #openstack-kolla23:46
openstackgerritChristian Berendt proposed openstack/kolla: Customizations for kibana  https://review.openstack.org/34625223:49
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Moving mariadb-disk.sh.j2 script to become common/common-disk.sh.j2  https://review.openstack.org/35264623:55
*** zhurong has quit IRC23:55
*** sdake has joined #openstack-kolla23:56
sdakehey cats23:57
« Sunday, 2016-08-07 Index Tuesday, 2016-08-09 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!