| *** imcsk8 has quit IRC | 00:09 | |
| *** yee3795 has quit IRC | 00:24 | |
| *** yee379 has joined #openstack-kolla | 00:25 | |
| *** huikang has quit IRC | 00:29 | |
| *** huikang has joined #openstack-kolla | 00:29 | |
| *** huikang has quit IRC | 00:34 | |
| *** salv-orlando has joined #openstack-kolla | 00:52 | |
| *** HyperJohnGraham has joined #openstack-kolla | 00:56 | |
| *** salv-orlando has quit IRC | 00:57 | |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Kolla Kubernetes Gate Test https://review.openstack.org/378056 | 01:03 |
|---|---|---|
| *** absubram has joined #openstack-kolla | 01:11 | |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Kolla Kubernetes Gate Test https://review.openstack.org/378056 | 01:41 |
| *** jtriley has quit IRC | 01:46 | |
| *** Pavo has quit IRC | 01:48 | |
| *** Pavo has joined #openstack-kolla | 01:49 | |
| *** jtriley has joined #openstack-kolla | 01:49 | |
| *** salv-orlando has joined #openstack-kolla | 01:53 | |
| *** salv-orlando has quit IRC | 01:58 | |
| *** schwicht_at_work has joined #openstack-kolla | 02:03 | |
| *** schwicht has quit IRC | 02:05 | |
| *** b_bezak has joined #openstack-kolla | 02:18 | |
| *** b_bezak has quit IRC | 02:22 | |
| openstackgerrit | Merged openstack/kolla-kubernetes: Kolla Kubernetes Gate Test https://review.openstack.org/378056 | 02:23 |
| *** daneyon has joined #openstack-kolla | 02:30 | |
| *** daneyon has quit IRC | 02:36 | |
| *** jtriley has quit IRC | 02:39 | |
| *** david-lyle has quit IRC | 03:04 | |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Ansible workflow for Glance https://review.openstack.org/380801 | 03:14 |
| *** rhallisey has quit IRC | 03:14 | |
| *** v1k0d3n has quit IRC | 03:22 | |
| *** jtriley has joined #openstack-kolla | 03:39 | |
| *** Pavo has quit IRC | 03:48 | |
| *** Pavo has joined #openstack-kolla | 03:48 | |
| *** salv-orlando has joined #openstack-kolla | 03:54 | |
| *** salv-orlando has quit IRC | 03:59 | |
| *** jmccarthy has quit IRC | 04:02 | |
| *** jmccarthy has joined #openstack-kolla | 04:03 | |
| *** g3ek has quit IRC | 04:05 | |
| *** haplo37 has quit IRC | 04:05 | |
| *** g3ek has joined #openstack-kolla | 04:07 | |
| *** haplo37 has joined #openstack-kolla | 04:07 | |
| *** tonanhngo has quit IRC | 04:19 | |
| HyperJohnGraham | Hi all | 04:27 |
| HyperJohnGraham | Every 2.0s: kubectl get jobs --namespace kolla | 04:29 |
| *** huikang has joined #openstack-kolla | 04:29 | |
| HyperJohnGraham | NAME DESIRED SUCCESSFUL AGE | 04:29 |
| HyperJohnGraham | mariadb-bootstrap 1 0 18m | 04:29 |
| HyperJohnGraham | rabbitmq-bootstrap 1 0 18m | 04:29 |
| HyperJohnGraham | How long should this take ? | 04:29 |
| *** bjolo has joined #openstack-kolla | 04:49 | |
| *** tonanhngo has joined #openstack-kolla | 04:51 | |
| *** jtriley has quit IRC | 04:52 | |
| *** salv-orlando has joined #openstack-kolla | 04:55 | |
| *** huikang has quit IRC | 04:56 | |
| *** huikang has joined #openstack-kolla | 04:56 | |
| *** salv-orlando has quit IRC | 05:00 | |
| *** huikang has quit IRC | 05:01 | |
| *** haplo37_ has quit IRC | 05:09 | |
| *** haplo37_ has joined #openstack-kolla | 05:10 | |
| *** daneyon has joined #openstack-kolla | 05:13 | |
| *** daneyon has quit IRC | 05:18 | |
| *** bjolo has quit IRC | 05:46 | |
| *** Pavo has quit IRC | 05:48 | |
| *** Pavo has joined #openstack-kolla | 05:53 | |
| *** salv-orlando has joined #openstack-kolla | 06:57 | |
| *** salv-orlando has quit IRC | 07:01 | |
| *** hieulq_ has joined #openstack-kolla | 07:28 | |
| *** salv-orlando has joined #openstack-kolla | 07:32 | |
| *** salv-orl_ has joined #openstack-kolla | 07:44 | |
| *** salv-orlando has quit IRC | 07:47 | |
| openstackgerrit | caoyuan proposed openstack/kolla: Delete the registry.yml from do_upgrade.yml https://review.openstack.org/380814 | 07:47 |
| *** hieulq_ has quit IRC | 07:47 | |
| *** Pavo has quit IRC | 07:48 | |
| *** msimonin has joined #openstack-kolla | 07:49 | |
| openstackgerrit | caoyuan proposed openstack/kolla: Update the upgrade.yml for mariadb roles https://review.openstack.org/380814 | 07:51 |
| *** Pavo has joined #openstack-kolla | 07:53 | |
| *** salv-orl_ has quit IRC | 08:07 | |
| *** hieulq_ has joined #openstack-kolla | 08:17 | |
| *** tonanhngo has quit IRC | 08:22 | |
| *** sdake has joined #openstack-kolla | 08:37 | |
| *** sdake_ has joined #openstack-kolla | 08:40 | |
| *** sdake has quit IRC | 08:42 | |
| *** daneyon has joined #openstack-kolla | 08:50 | |
| *** daneyon has quit IRC | 08:54 | |
| *** sdake_ has quit IRC | 09:00 | |
| *** pbourke has quit IRC | 09:15 | |
| *** pbourke has joined #openstack-kolla | 09:15 | |
| *** dwalsh has joined #openstack-kolla | 09:16 | |
| *** tonanhngo has joined #openstack-kolla | 09:23 | |
| *** tonanhngo has quit IRC | 09:25 | |
| *** hieulq_ has quit IRC | 09:36 | |
| *** kong has quit IRC | 09:41 | |
| *** Pavo has quit IRC | 09:48 | |
| *** Pavo has joined #openstack-kolla | 09:52 | |
| *** huikang has joined #openstack-kolla | 10:00 | |
| *** dwalsh has quit IRC | 10:04 | |
| *** dwalsh has joined #openstack-kolla | 10:10 | |
| *** huikang has quit IRC | 10:15 | |
| *** huikang has joined #openstack-kolla | 10:16 | |
| *** huikang has quit IRC | 10:20 | |
| *** dwalsh has quit IRC | 10:46 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Handle the KeyboardInterrunpt properly for build.py script https://review.openstack.org/380824 | 11:16 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Handle the KeyboardInterrunpt properly for build.py script https://review.openstack.org/380824 | 11:17 |
| *** tonanhngo has joined #openstack-kolla | 11:44 | |
| *** tonanhngo has quit IRC | 11:46 | |
| *** Pavo has quit IRC | 11:48 | |
| *** Pavo has joined #openstack-kolla | 11:53 | |
| *** tonanhngo has joined #openstack-kolla | 12:04 | |
| *** tonanhngo has quit IRC | 12:05 | |
| *** daneyon has joined #openstack-kolla | 12:26 | |
| *** daneyon has quit IRC | 12:31 | |
| *** egonzalez90 has joined #openstack-kolla | 12:34 | |
| *** egonzalez90 has quit IRC | 12:35 | |
| *** Jeffrey4l_ has quit IRC | 12:38 | |
| *** msimonin has quit IRC | 12:48 | |
| *** msimonin has joined #openstack-kolla | 12:53 | |
| *** david-lyle has joined #openstack-kolla | 12:56 | |
| *** dave-mccowan has joined #openstack-kolla | 12:58 | |
| *** egonzalez90 has joined #openstack-kolla | 12:58 | |
| *** egonzalez90 has quit IRC | 13:00 | |
| *** msimonin has quit IRC | 13:00 | |
| *** sdake has joined #openstack-kolla | 13:05 | |
| *** awiddersheim has joined #openstack-kolla | 13:09 | |
| *** Jeffrey4l has joined #openstack-kolla | 13:16 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Fixing neutron-openvswitch missing mount and variable https://review.openstack.org/380836 | 13:26 |
| *** sdake has quit IRC | 13:27 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq bust https://review.openstack.org/379960 | 13:29 |
| *** sdake has joined #openstack-kolla | 13:40 | |
| *** Pavo has quit IRC | 13:48 | |
| *** Pavo has joined #openstack-kolla | 13:48 | |
| *** Pavo has quit IRC | 14:00 | |
| *** tonanhngo has joined #openstack-kolla | 14:02 | |
| *** tonanhngo has quit IRC | 14:02 | |
| *** Pavo has joined #openstack-kolla | 14:04 | |
| *** sdake has quit IRC | 14:05 | |
| *** sdake has joined #openstack-kolla | 14:05 | |
| sdake | morning peeps | 14:07 |
| *** v1k0d3n has joined #openstack-kolla | 14:09 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq bust https://review.openstack.org/379960 | 14:09 |
| sdake | morning Jeffrey4l | 14:18 |
| sdake | whats story on rabbitmq atm? | 14:18 |
| Jeffrey4l | sdake, i made some change. https://review.openstack.org/#/c/379960/ | 14:19 |
| sdake | ya my patch was just a proposal to fix someone immediately | 14:19 |
| sdake | feel free to not co-author me | 14:19 |
| sdake | or co-author me, up to you :) | 14:19 |
| sdake | Jeffrey4l the real q i have is "is rabbitmq now working" | 14:20 |
| sdake | (with your patch) | 14:20 |
| Jeffrey4l | now centos use rabbitmq 3.6.x and ubuntu use 3.5.x | 14:20 |
| sdake | ya so inc0 was keen on ubuntu using 3.6 | 14:20 |
| sdake | he was also keen on the rabbitmq version #'s being the same | 14:20 |
| Jeffrey4l | both of them install from repo rather than github. | 14:20 |
| sdake | I require installs from distro repos for the rdocase | 14:21 |
| Jeffrey4l | why? we are using different apache version in ubuntu/centos. | 14:21 |
| sdake | i dont require installs from distro repos for the ubuntu case | 14:21 |
| sdake | no idea Jeffrey4l | 14:21 |
| sdake | Jeffrey4l we use lots of different versions for different components in the base repos | 14:22 |
| sdake | perhaps it is because rabbitmq is so critical to operation | 14:22 |
| Jeffrey4l | imho, use the package from offical repo is the best choice. | 14:22 |
| sdake | and we want one set of problems to solve, not two | 14:22 |
| sdake | Jeffrey4l this has already been agreed upon for the rdo case, but not the ubuntu case | 14:23 |
| sdake | for the ubuntu case I relented and negotiated a from-github approach | 14:23 |
| sdake | even though the entire "from githubapproach" is super non-ideal | 14:23 |
| Jeffrey4l | sdake, ok. so we can upgrade the ubuntu rabbitmq to 3.6.4 too. | 14:23 |
| sdake | if you think it the agreemenet is wrong say as much to inc0 and i when he rolls in | 14:24 |
| sdake | we are a team here, and we dont make decisions in a vacuum :) | 14:24 |
| sdake | but we sort of did on this one ;) | 14:24 |
| sdake | the core reviewer team opens up the vacuum during reviews | 14:24 |
| sdake | whateer the case, we need something merged immediately that solves the rabbitmq not working on centos problem :) | 14:25 |
| sdake | because it is blocking all forward progress | 14:25 |
| Jeffrey4l | np. i will push a PS try to use the same version of rabbitmq. | 14:25 |
| sdake | cool - then we can revisit the ubuntu from repos as a separte patch then? | 14:25 |
| sdake | if you care strongly about it worth the effort | 14:26 |
| sdake | I don't use ubuntu directly so it doesn't affect me | 14:26 |
| Jeffrey4l | sdake, me too. i do not care ubuntu :) | 14:26 |
| sdake | and i don't know the ins and outs other then on rdo *we must install from distro packaging* | 14:26 |
| sdake | cool sso let slet the people who do care (inc0 in this case) make that decision I think :) | 14:26 |
| Jeffrey4l | sdake but if we use 3.6.x in newton eventually, it is impossible to back 3.5.x ( from repo ). | 14:27 |
| sdake | to go back to 3.5 you mean? | 14:27 |
| sdake | in rdo? | 14:27 |
| sdake | rdo has moved on to 3.6.5 | 14:27 |
| sdake | we move with it | 14:27 |
| Jeffrey4l | right. | 14:27 |
| Jeffrey4l | i am say the rabbitmq version in ubuntu. | 14:27 |
| sdake | i didn't completely pare your sentence 3rd above | 14:28 |
| sdake | it is impossible to back 3.5.x ( from repo ). | 14:28 |
| sdake | pare/parse | 14:28 |
| sdake | what do you mean by this part | 14:28 |
| Jeffrey4l | if we use 3.6.x in kolla newtone for ubuntu distro, it is impossible to back to rabbitmq 3.5.x if it do not work well. | 14:29 |
| sdake | the plan is to use 3.6.5 in newton on centos immediately not eventually | 14:29 |
| sdake | i see | 14:29 |
| sdake | we can rely on an army of testing hapepning on 3.6.5 on rdo | 14:30 |
| sdake | i wonder if we get same advantage with 3.6.5 on ubuntu | 14:30 |
| Jeffrey4l | sdake, but we are upgrade the rabbitmq version in ubuntu when rdo using the newer version. | 14:30 |
| sdake | to me, the problem with rabbitmq is not rabbitmq itself but the erlang dep | 14:30 |
| sdake | 3.6.5 fixes the dependency problem by using a more modern erlang | 14:31 |
| sdake | oxymoron in there somewhere ;) | 14:31 |
| Jeffrey4l | ok. use the distro repo keep us from the dep issue, imo | 14:31 |
| sdake | right | 14:31 |
| sdake | i dont knwo if i communicated this clearly to michal | 14:32 |
| sdake | i did what i could to do so :) | 14:32 |
| Jeffrey4l | anyway, i will push a new patchset and let michal make the decision. | 14:32 |
| sdake | but the distro version of ubuntu may not have a modern erlang on ubuntu | 14:32 |
| sdake | sounds good - lets keep just rdo touched | 14:32 |
| sdake | and ubuntu untouched | 14:32 |
| sdake | and tackle that discussion with michal around | 14:33 |
| sdake | he has to live with the mess we create ;-) | 14:33 |
| Jeffrey4l | sdake, rdo upgrade 3.6.4 and we install rabbitmq 3.6.2 on ubuntu. shouldn't we use the same version? | 14:34 |
| sdake | rdo is on 3.6.5 no? | 14:34 |
| Jeffrey4l | if so, we need upgrade the rabbitmq on ubuntu to 3.6.4 too. | 14:34 |
| Jeffrey4l | hmm, i think it is 3.6.4 | 14:34 |
| sdake | Jeffrey4l yes - inc0 wanted same versions | 14:34 |
| sdake | pretty sure last time i tested it was 3.6.5 | 14:34 |
| sdake | maybe it was reverted | 14:35 |
| Jeffrey4l | sdake, sorry. 3.6.5 | 14:35 |
| sdake | ok - cool - you had me questioning my sanity there :) | 14:35 |
| *** tonanhngo has joined #openstack-kolla | 14:37 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq bust https://review.openstack.org/379960 | 14:41 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq bust https://review.openstack.org/379960 | 14:45 |
| *** david-lyle has quit IRC | 14:54 | |
| *** daneyon has joined #openstack-kolla | 15:08 | |
| *** daneyon has quit IRC | 15:13 | |
| *** salv-orlando has joined #openstack-kolla | 15:14 | |
| *** dave-mccowan has quit IRC | 15:23 | |
| *** awiddersheim has quit IRC | 15:28 | |
| *** sdake has quit IRC | 15:29 | |
| *** schwicht_at_work has quit IRC | 15:33 | |
| *** schwicht has joined #openstack-kolla | 15:34 | |
| *** haplo37_ has quit IRC | 15:38 | |
| *** haplo37_ has joined #openstack-kolla | 15:40 | |
| *** Pavo has quit IRC | 15:48 | |
| *** Pavo has joined #openstack-kolla | 15:48 | |
| *** awiddersheim has joined #openstack-kolla | 15:49 | |
| *** eaguilar has joined #openstack-kolla | 15:53 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Enable further sanity checks on the gates https://review.openstack.org/380151 | 16:02 |
| *** eaguilar has quit IRC | 16:05 | |
| *** huikang has joined #openstack-kolla | 16:18 | |
| *** david-lyle has joined #openstack-kolla | 16:18 | |
| *** david-lyle has quit IRC | 16:23 | |
| openstackgerrit | Merged openstack/kolla-kubernetes: Remove 'MANIFEST.in' https://review.openstack.org/368713 | 16:27 |
| *** sdake has joined #openstack-kolla | 16:32 | |
| HyperJohnGraham | morning all | 16:32 |
| HyperJohnGraham | so i wiped my install and started over... Again ;) | 16:33 |
| HyperJohnGraham | At this moment, what is the recommended installation process for a multi-node ( 8 nodes and a master ) Kolla-Kubernetes system ? | 16:35 |
| HyperJohnGraham | I prefer Centos7 but am willing to take the path of least resistance. | 16:36 |
| sdake | back | 16:37 |
| sdake | HyperJohnGraham our kubernetes implemmentation is just getting off the ground | 16:38 |
| HyperJohnGraham | Also I hope using kubeadm is compatible with the Kolla-Kubernetes install | 16:38 |
| HyperJohnGraham | http://kubernetes.io/docs/getting-started-guides/kubeadm/ | 16:38 |
| sdake | HyperJohnGraham are you planning an eval or doing dev? | 16:38 |
| HyperJohnGraham | i found it extremely nice | 16:38 |
| *** eaguilar has joined #openstack-kolla | 16:38 | |
| HyperJohnGraham | production environment | 16:38 |
| sdake | i can't recommend that | 16:39 |
| HyperJohnGraham | ScienceDMZ | 16:39 |
| HyperJohnGraham | :) | 16:39 |
| sdake | if you want production i'd recommend the ansible take on deployment | 16:39 |
| sdake | HyperJohnGraham one problem with kolla-k8s is the orchestration part isn't sorted out yet | 16:40 |
| sdake | another problem is 1.0.0 has not been released | 16:40 |
| sdake | 1.0.0 = production in the core team's eyes | 16:40 |
| sdake | if you want to live in the bleeding edge and try a deployment with kolla-kubernetes given the above - kfox111 or sbezverk can help you get rolling | 16:41 |
| sdake | or possibly others - although its sunday morning so not sure they will be around ;) | 16:41 |
| HyperJohnGraham | its only production environment because of the hardware and network its attached to | 16:41 |
| HyperJohnGraham | I will be the only user | 16:41 |
| sdake | so more for dev then? | 16:41 |
| HyperJohnGraham | test environment for UCSD | 16:42 |
| HyperJohnGraham | SDN SDX | 16:42 |
| sdake | ok those acronyms don't click with me but whatever - :) we roll with it here | 16:42 |
| HyperJohnGraham | we want to use it during demos at SC16 in Salt Lake City | 16:43 |
| sdake | as far as getting kubernetes itself deployed | 16:43 |
| sdake | there are numerous tools to do this work | 16:43 |
| HyperJohnGraham | i have kubernetes happy | 16:44 |
| HyperJohnGraham | running 1.4 on centos | 16:45 |
| *** brad[] has quit IRC | 16:46 | |
| HyperJohnGraham | should i be following the multi-node doc https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/multi-node.rst | 16:46 |
| HyperJohnGraham | which tells me to run the quickstart doc first | 16:46 |
| HyperJohnGraham | https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/quickstart.rst#configure-kolla-kubernetes | 16:47 |
| sdake | HyperJohnGraham - our model is to show people how all-in-one works first | 16:47 |
| sdake | then from that, they learn multinode | 16:47 |
| HyperJohnGraham | yes i have no problem getting that going | 16:47 |
| sdake | if you try to mix in multinode with kolla and kubernetes all at once - too many concepts to grasp | 16:47 |
| sdake | [09:35:41] <HyperJohnGraham>At this moment, what is the recommended installation process for a multi-node ( 8 nodes and a master ) Kolla-Kubernetes system ? | 16:48 |
| sdake | \ | 16:48 |
| HyperJohnGraham | i like to aim high | 16:48 |
| sdake | so when reading this question, the first thing that comes to mind is "have you instatlled an 8 node kubernetes system first" | 16:48 |
| HyperJohnGraham | yup | 16:48 |
| HyperJohnGraham | [root@gateway ~]# kubectl get nodes | 16:49 |
| HyperJohnGraham | NAME STATUS AGE | 16:49 |
| HyperJohnGraham | centos-compute-1.calit2.optiputer.net Ready 21m | 16:49 |
| HyperJohnGraham | centos-compute-2.calit2.optiputer.net Ready 21m | 16:49 |
| sdake | HyperJohnGraham i see - i thought that was the question you were asking :) | 16:49 |
| HyperJohnGraham | centos-compute-3.calit2.optiputer.net Ready 21m | 16:49 |
| HyperJohnGraham | centos-master-1.calit2.optiputer.net Ready 22m | 16:49 |
| HyperJohnGraham | centos-master-2.calit2.optiputer.net Ready 21m | 16:49 |
| HyperJohnGraham | centos-storage-1.calit2.optiputer.net Ready 21m | 16:49 |
| HyperJohnGraham | centos-storage-2.calit2.optiputer.net Ready 20m | 16:49 |
| HyperJohnGraham | centos-storage-3.calit2.optiputer.net Ready 20m | 16:49 |
| HyperJohnGraham | gateway.calit2.optiputer.net Ready 24m | 16:49 |
| *** eaguilar has quit IRC | 16:49 | |
| HyperJohnGraham | sorry no I want to get kolla-kubernetes running on it now :) | 16:50 |
| sdake | HyperJohnGraham Following this guide will result in a minimal kolla-kubernetes multi-node deployment consisting of: | 16:50 |
| sdake | looks like next step from docs are laid out | 16:50 |
| sdake | HyperJohnGraham our docs are imperfect - you may run into trouble spots | 16:51 |
| HyperJohnGraham | ;) | 16:51 |
| *** huikang has quit IRC | 16:52 | |
| *** huikang has joined #openstack-kolla | 16:52 | |
| sdake | docs for the ansible orchestration are about perfect | 16:54 |
| *** eaguilar has joined #openstack-kolla | 16:54 | |
| HyperJohnGraham | I will try to combine the docs into a single multi-node install. I have the same number of hosts an in the current Kolla Kubernetes Multi-Node Guide | 16:54 |
| sdake | HyperJohnGraham its super helpful for us if you follow the docs and tell us what is broken | 16:55 |
| sdake | so we can fix for everyone | 16:55 |
| sdake | you mentioned above "again" | 16:55 |
| sdake | i got impression from that you tried the docs once to no success? | 16:55 |
| HyperJohnGraham | many times | 16:56 |
| HyperJohnGraham | I have gotten close several times | 16:56 |
| * sdake sadfaces | 16:56 | |
| sdake | what blocks you from completion? | 16:56 |
| HyperJohnGraham | i had a good experience with the all-in-one ! | 16:56 |
| sdake | right | 16:57 |
| *** salv-orlando has quit IRC | 16:57 | |
| sdake | i would expec thtose docs to be better ;) | 16:57 |
| *** huikang has quit IRC | 16:57 | |
| HyperJohnGraham | thats why i am trying so hard to get my monster sysytem installed | 16:57 |
| sdake | ok - well sunday is not ideal to get with the people that know this stuff inside and out (me being not one of those people) | 16:58 |
| sdake | ideal ay that is | 16:58 |
| sdake | but if you can tell me whereo u get stuck | 16:58 |
| sdake | i might have some ideas to unblock you | 16:58 |
| HyperJohnGraham | cool thanks | 16:58 |
| sdake | wow these docs make my red pen police eyeballs hurt | 17:00 |
| HyperJohnGraham | One of the cool projects i plan on using this for is Ceph/SDN | 17:00 |
| sdake | sounds good | 17:00 |
| sdake | so just reading throug hthese docs | 17:01 |
| sdake | do you have a registry? | 17:01 |
| HyperJohnGraham | i have a private registry running on gateway | 17:02 |
| sdake | nice | 17:02 |
| sdake | have you built master of kolla images into that private registry? | 17:02 |
| HyperJohnGraham | well i will again ... I just blew it all away | 17:02 |
| HyperJohnGraham | last night | 17:02 |
| sdake | nice - so you know how to do that | 17:02 |
| sdake | can yo urun pip show kolla for me real quick pls | 17:03 |
| HyperJohnGraham | yes that works very nicly | 17:03 |
| HyperJohnGraham | only one failed to build | 17:03 |
| sdake | some failures are expected | 17:03 |
| sdake | some are not | 17:03 |
| HyperJohnGraham | kolla is not installed right now... just starting. give me 10min | 17:04 |
| sdake | atm - you should be warned - rabbitmq is completely busted - it is blocking the entire project-> https://review.openstack.org/379960 | 17:04 |
| sdake | HyperJohnGraham you will want ot cherrypick that change into your kolla repo when building rabbitmq | 17:04 |
| HyperJohnGraham | yes thats what i was reading and prompted me to ask direction ;) | 17:04 |
| HyperJohnGraham | is centos7 the best starting platform ? | 17:05 |
| sdake | Jeffrey4l ping!! | 17:05 |
| sdake | HyperJohnGraham i 'd roll with centos yes | 17:05 |
| HyperJohnGraham | ok great | 17:05 |
| sdake | Jeffrey4l 's patch wont work with kubernetes | 17:06 |
| * sdake groans | 17:06 | |
| HyperJohnGraham | There are TCP network improvements in Centos7 that we take advantage of in our ScienceDMZ http://www.es.net/assets/Uploads/100G-Tuning-TechEx2016.tierney.pdf | 17:08 |
| sdake | HyperJohnGraham make sure to follow the updated quickstart on kolla install | 17:09 |
| HyperJohnGraham | my servers only have dual 10G interfaces but the TCP tweaks mean i can use it all | 17:09 |
| sdake | it was updated about a month ago | 17:09 |
| sdake | pip install kolla for a master use case should show nothing | 17:10 |
| sdake | rather pip show kolla should show nothing | 17:10 |
| sdake | we don't pip install kolla itself in the master variant of the workflow | 17:10 |
| sdake | pbr madness ftw ;) | 17:10 |
| HyperJohnGraham | this one https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/quickstart.rst | 17:10 |
| sdake | yup if your reading that your in good shape :) | 17:10 |
| sdake | actually HyperJohnGraham i was speaking of kolla itself | 17:14 |
| sdake | to build the images | 17:14 |
| sdake | http://docs.openstack.org/developer/kolla/quickstart.html | 17:14 |
| HyperJohnGraham | no | 17:16 |
| HyperJohnGraham | do i need to also do this /? | 17:16 |
| sdake | HyperJohnGraham that above doc has descriptions on how to build the actual images | 17:16 |
| sdake | HyperJohnGraham not sure - but from the kolla-kubernetes docs: | 17:17 |
| HyperJohnGraham | i ran kolla-build mariadb glance neutron nova openvswitch memcached kolla-toolbox keystone horizon | 17:17 |
| HyperJohnGraham | from https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/host-setup.rst | 17:17 |
| sdake | ok let me check that doc out | 17:18 |
| HyperJohnGraham | then https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/quickstart.rst | 17:18 |
| *** msimonin has joined #openstack-kolla | 17:18 | |
| HyperJohnGraham | then https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/multi-node.rst | 17:18 |
| HyperJohnGraham | feel my pain ;) | 17:18 |
| sdake | yup | 17:19 |
| sdake | feeling it | 17:19 |
| sdake | this is wrong | 17:19 |
| sdake | # Install Kolla | 17:19 |
| sdake | pushd kolla | 17:19 |
| sdake | sudo pip install . | 17:19 |
| sdake | sudo cp -r ./etc/kolla /etc | 17:19 |
| sdake | popd | 17:19 |
| HyperJohnGraham | :) | 17:19 |
| sdake | lets focus first on getting kolla images built in your registry | 17:19 |
| sdake | HyperJohnGraham these docs need some information architects to fix ;) | 17:19 |
| HyperJohnGraham | :) | 17:20 |
| sdake | if your environment is completley empty | 17:20 |
| sdake | lets start from that | 17:20 |
| sdake | if you ahve already pulled the trigger on sudo pip install . (in kolla) lets undo that first | 17:20 |
| HyperJohnGraham | nope | 17:21 |
| HyperJohnGraham | i am still clean | 17:21 |
| sdake | sounds good | 17:21 |
| sdake | ok follow these docs: | 17:21 |
| sbezverk | HyperJohnGraham: thanks for sharing 100g optimization doc, intersting info | 17:21 |
| sdake | http://docs.openstack.org/developer/kolla/quickstart.html | 17:21 |
| sdake | follow the developer workflow | 17:21 |
| HyperJohnGraham | ok cool | 17:22 |
| sdake | specifically: | 17:22 |
| sdake | Installing Kolla and dependencies for development¶ | 17:22 |
| sdake | once you finish with that step - then lets go back to the kolla-host guide ;) | 17:22 |
| sdake | i.e. stop at "install python clients" | 17:23 |
| sdake | then I'll wlak you throug hthe getting images into your registry part ;) | 17:23 |
| HyperJohnGraham | [root@gateway ~]# docker --version | 17:24 |
| HyperJohnGraham | Docker version 1.10.3, build cb079f6-unsupported | 17:24 |
| sdake | wonder why it says unsupported | 17:25 |
| sdake | oh well :) | 17:25 |
| HyperJohnGraham | yum installed docker not curl | 17:25 |
| sdake | i see | 17:26 |
| HyperJohnGraham | should be fine | 17:26 |
| sdake | that is red hat's fork of docker | 17:26 |
| sdake | its kind of a pita to deal with -a asks for confirmations and whatnot | 17:26 |
| sdake | but whatever works foryou :) | 17:26 |
| sdake | note our docs haven't been tested for variance | 17:27 |
| sdake | i.e. if you do somethign the docs don't say to do, you may end in a odd situation :) | 17:27 |
| HyperJohnGraham | yup | 17:28 |
| sdake | in this case, pip install . / is completely wrong | 17:29 |
| sdake | notice the 3 or 4 warnings peppered in the kolla QSG about it :) | 17:29 |
| HyperJohnGraham | stopping at Install Python Clients and switching to https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/host-setup.rst | 17:32 |
| sdake | ok befoer picking up there | 17:32 |
| sdake | let me read that and see what else is wrong :) | 17:33 |
| HyperJohnGraham | First, edit /etc/kolla/globals.yml and add the following: | 17:33 |
| sdake | under full install | 17:33 |
| sdake | ignore this: | 17:33 |
| sdake | # Clone Kolla | 17:33 |
| sdake | git clone https://git.openstack.org/openstack/kolla | 17:33 |
| sdake | # Install Kolla | 17:33 |
| sdake | pushd kolla | 17:33 |
| sdake | sudo pip install . | 17:34 |
| sdake | sudo cp -r ./etc/kolla /etc | 17:34 |
| sdake | popd | 17:34 |
| sdake | and proceed with the rest of the docs as they are laid out | 17:34 |
| sdake | one thing you will need to do is build nad push your images | 17:35 |
| sdake | the command above you said you used to push is not correct | 17:35 |
| sdake | it should be somethign like | 17:35 |
| HyperJohnGraham | yup the first doc had me do a git clone https://git.openstack.org/openstack/kolla | 17:35 |
| sdake | tools/build.py --registry ip:4000 --push | 17:35 |
| sdake | HyperJohnGraham roger that | 17:35 |
| HyperJohnGraham | yup i figured out that part | 17:35 |
| sdake | cool | 17:35 |
| sdake | the --registry and --push are mandatory | 17:36 |
| sdake | that was missing from your build above | 17:36 |
| HyperJohnGraham | its unclear what needs done in /etc/kolla/globals.yml | 17:36 |
| *** huikang has joined #openstack-kolla | 17:36 | |
| sdake | HyperJohnGraham so your registry is all built then? | 17:36 |
| HyperJohnGraham | not yes | 17:36 |
| sdake | your network must be smoking fast ;) | 17:36 |
| HyperJohnGraham | not yet | 17:37 |
| sdake | roger | 17:37 |
| sdake | ok - well lets get images building - that takes me about 20 mins, then we can start on globals.yml | 17:37 |
| HyperJohnGraham | in /etc/kolla/globals.yml do i need to customize for all my hosts ? | 17:37 |
| HyperJohnGraham | keystone_admin_url: "http://keystone-admin:35357/v3" | 17:38 |
| HyperJohnGraham | keystone_internal_url: "http://keystone-public:5000/v3" | 17:38 |
| HyperJohnGraham | keystone_public_url: "http://keystone-public:5000/v3" | 17:38 |
| HyperJohnGraham | or are those names mapped somehow ? | 17:38 |
| HyperJohnGraham | from https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/host-setup.rst | 17:38 |
| sdake | HyperJohnGraham the hostnames are mapped via skydns internally in kubernetes | 17:39 |
| sdake | so yes | 17:39 |
| sdake | just cut and paste that stuff into globals.ylm as is | 17:39 |
| sdake | without modification | 17:39 |
| HyperJohnGraham | ok thats what i have been doing | 17:39 |
| sdake | the reason we dont have it in globals.yml yet is because we want to make sure of what is needed | 17:39 |
| sdake | i think we will be ready shortly to just merge that into globals.yml | 17:40 |
| sdake | remember, bleeding edge ;) | 17:40 |
| HyperJohnGraham | yup | 17:40 |
| sdake | cd kolla | 17:40 |
| sdake | ./tools/kolla-ansible genconfig | 17:40 |
| sdake | Jeffrey4l pingola | 17:41 |
| sdake | HyperJohnGraham this step is wrong: Build Kolla's containers locally: | 17:43 |
| * sdake so frustrated by docs :( | 17:43 | |
| HyperJohnGraham | i need to start my local registry before i move forward | 17:45 |
| sdake | sounds good | 17:45 |
| HyperJohnGraham | this doc has clues for that https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/multi-node.rst | 17:46 |
| sdake | HyperJohnGraham those docs look plausible to me | 17:48 |
| sdake | I'd leave out --namespace | 17:48 |
| *** Pavo has quit IRC | 17:48 | |
| HyperJohnGraham | ok | 17:48 |
| sdake | and docker_namespace i'd leave commented | 17:48 |
| sdake | although I'm not sure if genconfig will do the right thing there or not | 17:49 |
| sdake | try docker_namespace: "kolla" | 17:49 |
| sdake | and just build without the --namespace flag | 17:49 |
| *** Pavo has joined #openstack-kolla | 17:50 | |
| *** daneyon has joined #openstack-kolla | 17:51 | |
| HyperJohnGraham | there it is docker run -d -p 4000:5000 --restart=always --name registry registry:2 | 17:52 |
| sdake | yup that is wht you need | 17:52 |
| HyperJohnGraham | and add INSECURE_REGISTRY | 17:52 |
| sdake | that too | 17:52 |
| sdake | on all nodes | 17:53 |
| sdake | the registyr only needs to run on one node tho :) | 17:55 |
| HyperJohnGraham | yup | 17:55 |
| HyperJohnGraham | i never did it on all the nodes ... first mistake found | 17:55 |
| *** daneyon has quit IRC | 17:56 | |
| *** eaguilar has quit IRC | 17:56 | |
| *** huikang has quit IRC | 17:57 | |
| sdake | yup that would cause problems ;-) | 17:58 |
| *** huikang has joined #openstack-kolla | 17:58 | |
| *** huikang has quit IRC | 18:02 | |
| openstackgerrit | Steven Dake proposed openstack/kolla: Fix docs to require docker config on all nodes https://review.openstack.org/380851 | 18:11 |
| sdake | HyperJohnGraham - see first fix from our live docs debugging session :) | 18:12 |
| sdake | parental emergnecy - bbl | 18:17 |
| *** sdake has quit IRC | 18:17 | |
| Pavo | good evening everyone | 18:20 |
| Pavo | hows everyone been | 18:20 |
| *** awiddersheim has quit IRC | 18:21 | |
| *** bmace_ has quit IRC | 18:22 | |
| *** bmace_ has joined #openstack-kolla | 18:22 | |
| *** david-lyle has joined #openstack-kolla | 18:25 | |
| *** haplo37_ has quit IRC | 18:26 | |
| *** haplo37_ has joined #openstack-kolla | 18:28 | |
| *** david-lyle has quit IRC | 18:29 | |
| *** jamesdenton has joined #openstack-kolla | 18:35 | |
| HyperJohnGraham | docker run -d -p 4000:5000 --restart=always --name registry -v /docker_images:/var/lib/registry registry:2 /docker_images is a 1TB NVMe | 18:45 |
| *** msimonin has quit IRC | 18:45 | |
| *** msimonin has joined #openstack-kolla | 18:46 | |
| *** msimonin has quit IRC | 18:52 | |
| *** msimonin has joined #openstack-kolla | 18:59 | |
| *** matrohon has joined #openstack-kolla | 19:07 | |
| *** schwicht_at_work has joined #openstack-kolla | 19:22 | |
| *** schwicht has quit IRC | 19:23 | |
| *** tonanhngo has quit IRC | 19:27 | |
| HyperJohnGraham | https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/host-setup.rst#development-install section missing sudo cp -r ./etc/kolla-kubernetes /etc | 19:28 |
| *** sdake has joined #openstack-kolla | 19:30 | |
| sdake | back | 19:31 |
| sdake | HyperJohnGraham still in need of assistance? | 19:31 |
| HyperJohnGraham | still hacking away at the ghosts | 19:31 |
| HyperJohnGraham | just ran [root@gateway kolla-kubernetes]# ./tools/secret-generator.py create sucessfully | 19:31 |
| HyperJohnGraham | going for ./tools/setup-resolv-conf.sh now | 19:32 |
| HyperJohnGraham | its thinking | 19:33 |
| HyperJohnGraham | still | 19:35 |
| HyperJohnGraham | sdake how long should ./tools/setup-resolv-conf.sh take ? | 19:35 |
| sdake | no idea | 19:35 |
| sdake | how long has it taken? | 19:36 |
| HyperJohnGraham | 2 min | 19:36 |
| sdake | note rhallisey runs this project - i'm mostly a spectator on the review front | 19:36 |
| sdake | (the kolla-kubernetes project that is) | 19:36 |
| HyperJohnGraham | :) | 19:36 |
| sdake | runs/leads | 19:36 |
| sdake | anyway you get the idea ;) | 19:36 |
| * sdake hates people that "run" projects | 19:37 | |
| HyperJohnGraham | [root@gateway kolla-kubernetes]# ./tools/setup-resolv-conf.sh | 19:39 |
| HyperJohnGraham | Error from server: pods "fetchresolv" already exists | 19:39 |
| HyperJohnGraham | well stopping it was a bad idea | 19:39 |
| HyperJohnGraham | here is where i normally get frustrated ! | 19:43 |
| *** msimonin has quit IRC | 19:44 | |
| *** Pavo has quit IRC | 19:48 | |
| *** msimonin has joined #openstack-kolla | 19:48 | |
| *** Pavo has joined #openstack-kolla | 19:49 | |
| sdake | so setup-resolv-conf.sh doesn't work then? | 19:57 |
| sdake | HyperJohnGraham ^ | 19:58 |
| HyperJohnGraham | i killed it after 3 minutes | 19:58 |
| sdake | ok moment | 19:58 |
| HyperJohnGraham | i am debugging now | 19:58 |
| sdake | run kubectl pods get | 19:58 |
| sdake | lets see if we can get rid of the fetchresolv pod | 19:58 |
| HyperJohnGraham | kubectl get pods empty | 19:59 |
| sdake | kubectl get configmaps | 20:02 |
| sdake | blind leading blind here ;) | 20:02 |
| HyperJohnGraham | empty | 20:02 |
| sdake | run kubectl run --help -> paste | 20:03 |
| sbezverk | HyperJohnGraham: do not forget to add --namespace=koll | 20:04 |
| sbezverk | kolla | 20:04 |
| sdake | oh sweet | 20:04 |
| sdake | we found an expert HyperJohnGraham :) | 20:04 |
| *** kong has joined #openstack-kolla | 20:04 | |
| sbezverk | when you run kubectl commands | 20:04 |
| HyperJohnGraham | ahhh | 20:04 |
| sdake | sbezverk he cancelled the setup-resolv-conf because it was taking 2+ minutes | 20:04 |
| sdake | sbezverk how to undo that partial operation? | 20:04 |
| sbezverk | sdake: for this to work, there must be at least one pod running | 20:04 |
| HyperJohnGraham | [root@gateway kolla-kubernetes]# kubectl get pods --namespace=kolla | 20:05 |
| HyperJohnGraham | NAME READY STATUS RESTARTS AGE | 20:05 |
| HyperJohnGraham | fetchresolv 0/1 ContainerCreating 0 32m | 20:05 |
| sbezverk | HyperJohnGraham: resolv.conf workaround needed only for containers with net=host | 20:05 |
| HyperJohnGraham | how long is ./tools/setup-resolv-conf.sh supposed to take ? | 20:06 |
| sbezverk | you can proceed with mariadb/rabbitmq/glance/kaystone | 20:06 |
| sbezverk | when these are running resolv.conf will be able to build this configmap | 20:06 |
| sdake | sbezverk docs don't say that! | 20:06 |
| sbezverk | it takes seconds to generate it | 20:06 |
| HyperJohnGraham | net=host is not needed for a multi-host install ? | 20:06 |
| sdake | HyperJohnGraham only for nova and neutron | 20:07 |
| HyperJohnGraham | sorry newbie me | 20:07 |
| sdake | maybe not nova - not sure on current state | 20:07 |
| sbezverk | net=host needed only for pod which require access to host's interfaces directly | 20:07 |
| sbezverk | regardless of a type og install aio or multi | 20:07 |
| sdake | HyperJohnGraham lets get rid of that pod first - sbezverk ideas? | 20:07 |
| HyperJohnGraham | sounds good | 20:08 |
| sbezverk | kubectl get jobs --namespace=kolla | 20:08 |
| HyperJohnGraham | eliminate distractions | 20:08 |
| HyperJohnGraham | empty | 20:08 |
| sbezverk | kubectl get pods --namespace=kolla | 20:08 |
| HyperJohnGraham | no jobs | 20:08 |
| HyperJohnGraham | fetchresolv 0/1 ContainerCreating 0 36m | 20:08 |
| sbezverk | then kubectl describe pod {pod-name } --namespace=kolla | 20:09 |
| *** Mech422 has quit IRC | 20:09 | |
| v1k0d3n | hey sdake looks like you're around this afternoon... | 20:09 |
| *** Mech422 has joined #openstack-kolla | 20:09 | |
| HyperJohnGraham | interesting | 20:09 |
| sdake | v1k0d3n i'm around all the time | 20:10 |
| sdake | except when sleeping | 20:10 |
| sdake | what can i do for ya fine sir | 20:10 |
| v1k0d3n | you need a vacation at some point. | 20:10 |
| v1k0d3n | busy year... | 20:10 |
| sdake | no doubt aout that | 20:10 |
| sdake | had one over july 4th | 20:10 |
| HyperJohnGraham | http://pastebin.com/CbPHGC3q | 20:10 |
| sdake | so i'm in good shape | 20:10 |
| v1k0d3n | :) | 20:10 |
| HyperJohnGraham | do all my hosts need FQHN ? | 20:11 |
| sdake | spent a week out of town | 20:11 |
| sdake | was glorious :) | 20:11 |
| v1k0d3n | been pulled on a lot of internal stuff lately (kubernetes tasks), but want to get back to kolla. newton rc2...how stable is it at the moment (enough to launch and use "normally")? | 20:11 |
| sbezverk | HyperJohnGraham: hmmm, it looks like thew issue is with kube setup | 20:11 |
| v1k0d3n | sorry for the silly question... | 20:11 |
| sdake | v1k0d3n it was until rdo reved the version of rabbitmq | 20:12 |
| sdake | now rabbitmq doesn't build | 20:12 |
| v1k0d3n | yeah, i need one. don't think barcelona counts. | 20:12 |
| v1k0d3n | crap. | 20:12 |
| v1k0d3n | that's what i was wondering. let me check issues... | 20:12 |
| sdake | no problem there though | 20:12 |
| HyperJohnGraham | i used http://kubernetes.io/docs/getting-started-guides/kubeadm/ | 20:12 |
| sdake | we have a work in progress patch to fix it | 20:12 |
| HyperJohnGraham | i skipped Installing a pod network section 4 | 20:13 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/375989 | 20:13 |
| HyperJohnGraham | figuring kolla-kubernetes brings that | 20:13 |
| v1k0d3n | mitaka stable still good though, or does the change need backported? | 20:13 |
| sdake | v1k0d3n cherrypick this https://review.openstack.org/#/c/379960/ | 20:13 |
| sdake | ya mitaka stable works afaik | 20:13 |
| sbezverk | HyperJohnGraham: kubectl get nodes | 20:14 |
| v1k0d3n | cool. if i can cherry pick and that's all...i will get started with newton. may need to reach out to you folks if there are issues though. | 20:14 |
| HyperJohnGraham | [root@gateway kolla-kubernetes]# kubectl get nodes | 20:14 |
| HyperJohnGraham | NAME STATUS AGE | 20:14 |
| HyperJohnGraham | centos-compute-1.calit2.optiputer.net Ready 3h | 20:14 |
| HyperJohnGraham | centos-compute-2.calit2.optiputer.net Ready 3h | 20:14 |
| v1k0d3n | want to get familiar before summit. | 20:14 |
| HyperJohnGraham | centos-compute-3.calit2.optiputer.net Ready 3h | 20:14 |
| HyperJohnGraham | centos-master-1.calit2.optiputer.net Ready 3h | 20:14 |
| HyperJohnGraham | centos-master-2.calit2.optiputer.net Ready 3h | 20:14 |
| HyperJohnGraham | centos-storage-1.calit2.optiputer.net Ready 3h | 20:14 |
| HyperJohnGraham | centos-storage-2.calit2.optiputer.net Ready 3h | 20:14 |
| sdake | v1k0d3n we are always here - except possibly weekends :) | 20:15 |
| HyperJohnGraham | centos-storage-3.calit2.optiputer.net Ready 3h | 20:15 |
| HyperJohnGraham | gateway.calit2.optiputer.net Ready 3h | 20:15 |
| v1k0d3n | yikes, HyperJohnGraham...what's going on man? | 20:15 |
| HyperJohnGraham | i got some nodes | 20:15 |
| v1k0d3n | HyperJohnGraham: what issues are you having with kubernetes? | 20:15 |
| sdake | v1k0d3n docs issue | 20:15 |
| HyperJohnGraham | ;) | 20:15 |
| v1k0d3n | ah.... | 20:15 |
| v1k0d3n | my guys had issues this past week too. | 20:15 |
| sbezverk | HyperJohnGraham: looks good, but networking between kube nodes must be setup prior installing kolla-kubernetes | 20:15 |
| v1k0d3n | told them to work with ryan and help fix the docs. | 20:16 |
| v1k0d3n | right... | 20:16 |
| v1k0d3n | HyperJohnGraham: use add-ons to add the networking. | 20:16 |
| HyperJohnGraham | so section 4 http://kubernetes.io/docs/getting-started-guides/kubeadm/ | 20:16 |
| v1k0d3n | HyperJohnGraham: yup! you got it. | 20:17 |
| sbezverk | HyperJohnGraham: I have not tried kubeadm yet, so in my setup I did everything maually and using flanneld | 20:17 |
| sdake | needs to be in docs ;) | 20:17 |
| HyperJohnGraham | its super easy ! | 20:17 |
| v1k0d3n | kubeadm is very new...like dropped a week ago | 20:17 |
| v1k0d3n | so...UAYOR | 20:17 |
| HyperJohnGraham | i like fresh code | 20:17 |
| v1k0d3n | :) | 20:17 |
| v1k0d3n | don't we all like fresh | 20:18 |
| sdake | VIM - the power of 100 lemons! | 20:18 |
| v1k0d3n | lol | 20:18 |
| v1k0d3n | HyperJohnGraham: not sure if you've seen luke's videos from weaveworks yet? | 20:18 |
| HyperJohnGraham | should i force namespace ? kubectl apply -f https://git.io/weave-kube --namespace=kolla | 20:18 |
| v1k0d3n | they are doing a lot of great things...https://www.youtube.com/watch?v=b_fOIELGMDY | 20:19 |
| *** matrohon has quit IRC | 20:19 | |
| HyperJohnGraham | cool will watch | 20:19 |
| v1k0d3n | no...don't | 20:19 |
| v1k0d3n | just deploy it. watch the video. | 20:19 |
| HyperJohnGraham | :) | 20:19 |
| HyperJohnGraham | daemonset "weave-net" created | 20:20 |
| v1k0d3n | then your cluster will be up, and you can start on the kolla-kube "as-is"....ah....maybe? | 20:20 |
| v1k0d3n | yeah, so you can view it by looking at your daemonsets. | 20:20 |
| sdake | sbezverk don't we need to get rid of that resolvconf job? | 20:20 |
| HyperJohnGraham | should i kill the fetchresolv pod ? | 20:20 |
| *** jamesdenton has left #openstack-kolla | 20:20 | |
| sdake | the one floating around in HyperJohnGraham 's system? | 20:21 |
| HyperJohnGraham | yea i killed it when is never finished | 20:21 |
| HyperJohnGraham | [root@gateway kolla-kubernetes]# kubectl get pods --namespace=kolla | 20:21 |
| HyperJohnGraham | NAME READY STATUS RESTARTS AGE | 20:21 |
| HyperJohnGraham | fetchresolv 0/1 ContainerCreating 0 48m | 20:21 |
| *** huikang has joined #openstack-kolla | 20:22 | |
| HyperJohnGraham | pod "fetchresolv" deleted | 20:23 |
| HyperJohnGraham | :) | 20:23 |
| sdake | ok cool well whether that was needed or not- its done deal now :) | 20:23 |
| sdake | sbezverk can you have a look over the docs | 20:23 |
| sdake | and pick out any trouble spots | 20:23 |
| HyperJohnGraham | kubectl get pods --all-namespaces | 20:23 |
| HyperJohnGraham | looks good | 20:23 |
| HyperJohnGraham | lots of things getting created | 20:24 |
| sbezverk | HyperJohnGraham: just before you go further, why do not you launch a simple centos pod | 20:24 |
| sdake | sbezverk i htink he has gone further ;) | 20:24 |
| sbezverk | sdake: ok | 20:24 |
| HyperJohnGraham | still waiting for weave-net to finish | 20:24 |
| sdake | https://review.openstack.org/#/c/379960/ | 20:25 |
| sdake | sbezverk - see above review - it removes somethign you added | 20:25 |
| sbezverk | HyperJohnGraham: ok when it is done, let's just try to start busy box to test your setup | 20:25 |
| sdake | and i'm not sure why you added it | 20:25 |
| sdake | but i think it has to do with kolla-kubernetes | 20:25 |
| HyperJohnGraham | http://pastebin.com/L9s1nj4H | 20:25 |
| sdake | HyperJohnGraham containercreating = container downloading... | 20:26 |
| *** haplo37_ has quit IRC | 20:26 | |
| HyperJohnGraham | do i need to clean out scraps from there? | 20:26 |
| HyperJohnGraham | ok | 20:26 |
| HyperJohnGraham | kube-system kube-dns-2247936740-z3241 0/3 ContainerCreating 0 4h | 20:26 |
| HyperJohnGraham | seems like this one is not happy at 4 hours | 20:27 |
| sbezverk | HyperJohnGraham: I think it got stuck for the same reason as resolv | 20:27 |
| sbezverk | you need to kill everything which is not in healthy state | 20:28 |
| *** haplo37_ has joined #openstack-kolla | 20:28 | |
| sdake | kubernetes a little more fragile then google lets on | 20:28 |
| HyperJohnGraham | :) | 20:28 |
| HyperJohnGraham | so kill all that are not running STATUS | 20:28 |
| sbezverk | sdake: you know it is getting much much better | 20:28 |
| sdake | sbezverk indeed - i was just typing: | 20:28 |
| sdake | "Kubernetes is the future of the datacenter under which all other components will be laid, so we better learn to love it." :) | 20:29 |
| sbezverk | +2 | 20:29 |
| sbezverk | HyperJohnGraham: yes please, you can check: kubectl get pods --all-namespaces | 20:29 |
| v1k0d3n | sdake: whoops...did i get HyperJohnGraham off course? | 20:30 |
| v1k0d3n | didn't intend to. | 20:30 |
| *** tonanhngo has joined #openstack-kolla | 20:30 | |
| HyperJohnGraham | no we are good | 20:31 |
| v1k0d3n | ok...would've felt bad. | 20:31 |
| HyperJohnGraham | I needed to start weave-net | 20:31 |
| sdake | deploying kolla-kubernetes = spectator sport :) | 20:32 |
| *** tonanhngo has quit IRC | 20:32 | |
| v1k0d3n | haha! trust me...hear about it all the time on our side. | 20:32 |
| sdake | ya the deploy part is rough around the edges | 20:32 |
| sdake | sharp objects even rough | 20:32 |
| HyperJohnGraham | kube-system weave-net-4yajx 0/2 Terminating 0 12m | 20:32 |
| HyperJohnGraham | they even die slow | 20:32 |
| v1k0d3n | sdake: also, another qestion...have docs for newton been updated on docs.openstack.org or do i need to find elsewhere? seems like some older stuff is out there, which...perhaps this next week i might be able to help with if needed. | 20:33 |
| sdake | v1k0d3n docs.oo contains master copies of all docs | 20:33 |
| HyperJohnGraham | should i restart kubernetes ? :) | 20:33 |
| HyperJohnGraham | reboot for fun | 20:33 |
| v1k0d3n | HyperJohnGraham: | 20:33 |
| sdake | HyperJohnGraham i think that would not be optimal :) | 20:33 |
| v1k0d3n | don't need to | 20:33 |
| HyperJohnGraham | :) | 20:34 |
| v1k0d3n | ^^ yes...THAT | 20:34 |
| sbezverk | HyperJohnGraham: it should not take that long. DO you mind to check /var/log/messages for recent errors? | 20:34 |
| *** daneyon has joined #openstack-kolla | 20:34 | |
| *** Jeffrey4l_ has joined #openstack-kolla | 20:34 | |
| sdake | v1k0d3n if the master version of the docs need attention, lets get that going for sure :) | 20:34 |
| *** schwicht_at_work has quit IRC | 20:34 | |
| v1k0d3n | also you can do a kubectl log or docker log for watching container activities (unless i'm misunderstanding your issue). | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: -A KUBE-SERVICES -m comment --comment "kube-system/kube-dns:dns has no endpoints" -m udp -p udp -d 100.64.0.10/32 --dport 53 -j REJECT | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: COMMIT | 20:34 |
| sdake | Jeffrey4l_ re https://review.openstack.org/#/c/379960/ | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: *nat | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: :KUBE-SERVICES - [0:0] | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: :KUBE-NODEPORTS - [0:0] | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: :KUBE-POSTROUTING - [0:0] | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway journal: :KUBE-MARK-MASQ - [0:0] | 20:34 |
| HyperJohnGraham | Oct 2 13:30:45 gateway rsyslogd-2177: imjournal: begin to drop messages due to rate-limiting | 20:34 |
| v1k0d3n | also, HyperJohnGraham...can i make a suggestion? | 20:35 |
| HyperJohnGraham | sure | 20:35 |
| v1k0d3n | gist.github.com | 20:35 |
| v1k0d3n | there are others out there...but i use that. | 20:35 |
| sdake | or paste.fedoraproject.org ;) | 20:35 |
| v1k0d3n | exactly. :) | 20:35 |
| sdake | although 1 liner pastes are ok in channel | 20:35 |
| HyperJohnGraham | ok ;) | 20:35 |
| *** Jeffrey4l has quit IRC | 20:36 | |
| sdake | HyperJohnGraham you can sudo yum install fpaste | 20:36 |
| sdake | then tail -100 /var/log/messages | fpaste | 20:36 |
| v1k0d3n | everyone has one they like. pretty much the same. and yes to sdake comment ^^. sometimes multi-lines are harder in IRC than with a paste to gist/paste.fxxx.org | 20:36 |
| sdake | it will kick back a link | 20:36 |
| *** huikang has quit IRC | 20:36 | |
| sdake | fpaste is a paste.fedoraproject.org client | 20:37 |
| v1k0d3n | dang...just realized that last comment looks bad. won't try to shorten fedora like that again.... :-/ | 20:37 |
| *** huikang has joined #openstack-kolla | 20:37 | |
| HyperJohnGraham | http://paste.fedoraproject.org/442138/40636147 | 20:37 |
| HyperJohnGraham | cool | 20:37 |
| sdake | HyperJohnGraham are you permitted to use webex in your environment? | 20:37 |
| HyperJohnGraham | sure | 20:37 |
| sdake | if so, a webex session with sbezverk may go faster | 20:37 |
| HyperJohnGraham | :) | 20:38 |
| sdake | requires windows/mac | 20:38 |
| sdake | http://cisco.webex.com/join/stdake | 20:38 |
| HyperJohnGraham | yup we use it all the tima | 20:38 |
| HyperJohnGraham | yup we use it all the time | 20:38 |
| sdake | v1k0d3n your welcome to join if you like | 20:38 |
| *** daneyon has quit IRC | 20:38 | |
| v1k0d3n | sure man | 20:38 |
| *** schwicht has joined #openstack-kolla | 20:39 | |
| sbezverk | pasted log looks ok | 20:39 |
| HyperJohnGraham | sdake: waiting for host on webex | 20:40 |
| *** huikang has quit IRC | 20:41 | |
| *** tonanhngo has joined #openstack-kolla | 20:45 | |
| *** tonanhngo has quit IRC | 20:48 | |
| v1k0d3n | https://github.com/ceph/ceph-ansible | 20:48 |
| *** brad[] has joined #openstack-kolla | 21:06 | |
| *** tonanhngo has joined #openstack-kolla | 21:14 | |
| *** msimonin1 has joined #openstack-kolla | 21:14 | |
| *** msimonin has quit IRC | 21:16 | |
| *** tonanhngo has quit IRC | 21:16 | |
| sdake | https://review.openstack.org/#/c/379960/ | 21:17 |
| *** david-lyle has joined #openstack-kolla | 21:27 | |
| *** huikang has joined #openstack-kolla | 21:27 | |
| *** david-lyle has quit IRC | 21:31 | |
| *** salv-orlando has joined #openstack-kolla | 21:33 | |
| *** g3ek has quit IRC | 21:38 | |
| *** g3ek has joined #openstack-kolla | 21:40 | |
| *** HyperJohnGraham has quit IRC | 21:42 | |
| *** HyperJohnGraham has joined #openstack-kolla | 21:42 | |
| *** Pavo has quit IRC | 21:48 | |
| *** Pavo has joined #openstack-kolla | 21:48 | |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Start testing the deployments https://review.openstack.org/380868 | 21:50 |
| *** tonanhngo has joined #openstack-kolla | 21:53 | |
| sdake | kfox1111 yo dude | 22:00 |
| sdake | kfox1111 we are having a multinode doc debugging session on kolla-k8s | 22:01 |
| sdake | kfox1111 want to pitch in? | 22:01 |
| sbezverk | http://paste.openstack.org/show/583906/ | 22:02 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Start testing the deployments https://review.openstack.org/380868 | 22:06 |
| *** tonanhngo has joined #openstack-kolla | 22:14 | |
| kfox1111 | yeah. | 22:15 |
| *** tonanhngo has quit IRC | 22:15 | |
| kfox1111 | sdake: in a hangout or something? | 22:15 |
| sdake | kfox1111 http://cisco.webex.com/join/stdake | 22:16 |
| v1k0d3n | docker-py<1.8.0,>=1.6.0 # Apache-2.0 | 22:17 |
| kfox1111 | k. trying to join. | 22:18 |
| *** huikang has quit IRC | 22:28 | |
| *** huikang has joined #openstack-kolla | 22:28 | |
| *** salv-orlando has quit IRC | 22:29 | |
| v1k0d3n | sdake: so if i cherry pick the changes on rabbitmq then master should build fine currently? | 22:33 |
| sdake | v1k0d3n roger | 22:33 |
| *** huikang has quit IRC | 22:33 | |
| v1k0d3n | this is AIO for now... | 22:33 |
| *** haplo37_ has quit IRC | 22:44 | |
| *** haplo37_ has joined #openstack-kolla | 22:45 | |
| *** msimonin1 has quit IRC | 22:50 | |
| *** dave-mccowan has joined #openstack-kolla | 22:57 | |
| kfox1111 | ~. | 23:00 |
| *** schwicht has quit IRC | 23:05 | |
| *** schwicht has joined #openstack-kolla | 23:06 | |
| v1k0d3n | sdake: is newton still building 2.0.2 container versions? (example: kolla/centos-binary-base 2.0.2 is showing in docker images command out of master). | 23:14 |
| *** dave-mccowan has quit IRC | 23:20 | |
| *** schwicht has quit IRC | 23:39 | |
| *** schwicht has joined #openstack-kolla | 23:39 | |
| *** eaguilar has joined #openstack-kolla | 23:55 | |
| *** rstarmer has joined #openstack-kolla | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!