| sdake | aNupoisc yes - 2.0.3 is unreleased s of yet | 00:00 |
|---|---|---|
| aNupoisc | or is the latest tag is 2.0.2 with stable/mitika | 00:00 |
| sdake | the latest release is 2.0.2 | 00:00 |
| sdake | you cn check the docs - they receently changed on install method depending on whether your doing an eval or dev | 00:00 |
| aNupoisc | so if i clone kolla stable/mitika what tag would I get? | 00:00 |
| sdake | 2.0.3 | 00:00 |
| sdake | but that wont work correctly without hacking | 00:01 |
| *** dwalsh has quit IRC | 00:01 | |
| sdake | read quickstart - it covers this in detail | 00:01 |
| *** zhurong has quit IRC | 00:02 | |
| sdake | inc0 init-runonce-osic does the network setup and image loading? | 00:02 |
| inc0 | yeah | 00:02 |
| sdake | anything needed after that ? | 00:02 |
| inc0 | should be enough | 00:02 |
| aNupoisc | sdake: ahh that's why. I am getting an error "Tag 2.0.3 not found in repository docker.io/kolla/ubuntu-source-heka" so wondering did I cloned something wrong | 00:03 |
| sdake | i think next ste pfor somoene thta understands the caching layer in ceph is to create a labeling playbook for that | 00:04 |
| aNupoisc | sdake: thanks, I will clone with tag 2.0.2 | 00:04 |
| inc0 | aNupoisc did you setup your docker registry in globals.yml? | 00:04 |
| sdake | aNupoisc you cn still work from git if you want | 00:04 |
| sdake | aNupoisc to do that, set openstack_release: "2.0.2" in globals.yml | 00:04 |
| aNupoisc | inc0: my docker registry is default #docker_registry: "172.16.0.10:4000" | 00:05 |
| aNupoisc | sdake: Okay let me try with that approach | 00:05 |
| inc0 | aNupoisc, this is commented;) | 00:06 |
| sdake | ya he wants to pull from the hub | 00:06 |
| aNupoisc | Yes. | 00:07 |
| aNupoisc | do i need to enable this? inc0 | 00:07 |
| sdake | not if pulling from hub | 00:07 |
| inc0 | only if you're running local registry | 00:07 |
| aNupoisc | i am running on all-in-one environment and i read no need of local registry | 00:08 |
| sdake | even multinode you cana pull from hub | 00:08 |
| sdake | its just slower | 00:08 |
| *** david-lyle has quit IRC | 00:08 | |
| *** Guest20708 has quit IRC | 00:08 | |
| aNupoisc | sdake: inc0: okay so for my case what I am doing is correct | 00:08 |
| sdake | yup | 00:08 |
| aNupoisc | i just need to get kolla of tag 2.0.2 | 00:09 |
| sdake | aNupoisc 2.0.3 is compatible with 2.0.2 images | 00:09 |
| sdake | our z streams are bug fix only | 00:09 |
| *** dwalsh has joined #openstack-kolla | 00:10 | |
| aNupoisc | sdake: But it is throwing an error "Tag 2.0.3 not found in repository docker.io/kolla/ubuntu-source-heka" when i try to deploy | 00:10 |
| *** bmace has joined #openstack-kolla | 00:11 | |
| *** dcwangmit01_ has quit IRC | 00:12 | |
| *** dcwangmit01 has joined #openstack-kolla | 00:12 | |
| aNupoisc | sdake: I am trying to deploy ceph with kolla | 00:12 |
| aNupoisc | so not sure openstack_release=2.0.2 or not? | 00:13 |
| sdake | ceph aio requires specil config | 00:13 |
| sdake | read thee ceph guide | 00:13 |
| aNupoisc | sdake: yes i am following https://github.com/openstack/kolla/blob/master/doc/ceph-guide.rst#managing-ceph but I am at deploy step | 00:14 |
| aNupoisc | and it is failing at heka bootstrap container | 00:14 |
| aNupoisc | sdake: till now I have installed docker and run prechecks | 00:15 |
| sdake | in globals.yml | 00:15 |
| sdake | do you have the line | 00:15 |
| sdake | openstack_rlelease: "2.0.2" | 00:15 |
| aNupoisc | sdake: nope | 00:15 |
| sdake | pretty sure i mentioned that as a workaround at timestamp 17:04:31 ;) | 00:15 |
| aNupoisc | yeah, you mentioned | 00:16 |
| aNupoisc | sdake: but I was not sure to use openstack_release as I don't want all opestack services as i am deploying ceph | 00:17 |
| aNupoisc | so confirmed | 00:17 |
| sdake | you need to use that flag - it wont enable extra services | 00:17 |
| aNupoisc | sdake: so are you saying if i put the option and run deploy then it would work | 00:17 |
| aNupoisc | sdake: okay | 00:17 |
| sdake | unless you use the enable_service: true or whatever it is | 00:17 |
| sdake | aNupoisc yup thats right | 00:17 |
| aNupoisc | sdake: no i am enabling just the service that i want. :) | 00:18 |
| aNupoisc | sdake: that's quicker way then cloning again with tag 2.0.2, cool | 00:18 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha https://review.openstack.org/352180 | 00:20 |
| *** wally__ has quit IRC | 00:23 | |
| aNupoisc | sdake: yeah that worked | 00:27 |
| aNupoisc | :) | 00:27 |
| aNupoisc | sdake: so that means even if i have 2.0.3 it uses images of 2.0.2 | 00:28 |
| aNupoisc | is that correct | 00:28 |
| sdake | yup | 00:28 |
| aNupoisc | sdake: but why does not use 2.0.3 images | 00:28 |
| sdake | see pbr note in quickstart | 00:28 |
| sdake | there are no 2.0.3 images in the docker hub | 00:29 |
| sdake | because it is unreleased software | 00:29 |
| *** dwalsh has quit IRC | 00:29 | |
| aNupoisc | sdake: hmm. interesting | 00:30 |
| aNupoisc | sdake: great to know | 00:30 |
| *** yingjun has joined #openstack-kolla | 00:33 | |
| sdake | inc0 not runonce | 00:34 |
| sdake | it has to be in the parent script | 00:34 |
| inc0 | no, as we create deployment here | 00:34 |
| inc0 | also we need to hack around this deployment crap | 00:34 |
| sdake | and tempest shoudl be installed | 00:34 |
| sdake | you can create a deployment in the parent too | 00:34 |
| sdake | we need that line there | 00:36 |
| sdake | i want a separate deployment per rally scenario | 00:36 |
| sdake | for easier data collection | 00:36 |
| sdake | source dir i swrong | 00:40 |
| sdake | inc0 cp -ar | 00:40 |
| sdake | probably want a rally verify install in there | 00:41 |
| sdake | to make sure rally knows tempest is installed | 00:41 |
| sdake | lets clean db | 00:41 |
| inc0 | yeah good idea | 00:42 |
| sdake | and give it a spin | 00:42 |
| inc0 | btw we could just dump sqlite after each iteration | 00:42 |
| inc0 | so we'll have all the rally data | 00:42 |
| sdake | rather have the json | 00:42 |
| sdake | there is a capture script in there too | 00:42 |
| sdake | which needs work | 00:42 |
| inc0 | verification data is somewhere else | 00:42 |
| *** duonghq has joined #openstack-kolla | 00:43 | |
| sdake | looks like that worked | 00:44 |
| inc0 | yeah | 00:44 |
| duonghq | sdake: OSIC worked? | 00:44 |
| sdake | duonghq we hae almost all data capture ully automated | 00:44 |
| sdake | that is what i was referring to | 00:44 |
| inc0 | sdake, I'd just copy sqlite and dump stuff later | 00:44 |
| inc0 | with htmls and shit | 00:45 |
| sdake | dangerous | 00:45 |
| sdake | i'd rather have json | 00:45 |
| sdake | we will convert json to rst | 00:45 |
| inc0 | archiving whole sqlite as a precaucion | 00:45 |
| inc0 | let's archive all of it | 00:45 |
| sdake | ok archive for backup wfm | 00:45 |
| duonghq | sdake: it can run automatically or still somebody must kick it off | 00:45 |
| sdake | duonghq well yes someone needs to type in one command... | 00:45 |
| sdake | after getting the escenario we want | 00:46 |
| sdake | which is a little morecomplex ;) | 00:46 |
| *** ssurana has quit IRC | 00:47 | |
| sdake | need another grep in those tasks | 00:47 |
| *** ssurana has joined #openstack-kolla | 00:47 | |
| duonghq | roger | 00:48 |
| sdake | so tired | 00:48 |
| duonghq | it is your shift atm? | 00:49 |
| inc0 | sdake, just dump all of it | 00:51 |
| inc0 | tomorrow we'll make it better | 00:51 |
| sdake | that isn't good enough | 00:51 |
| sdake | oh you mean dump everything | 00:51 |
| inc0 | dumping all of them? | 00:51 |
| inc0 | yeah | 00:51 |
| sdake | i expect to be on scenario 3 by today | 00:51 |
| duonghq | hmm, gate still is unstable, sad | 00:52 |
| sdake | we dont have time to wait around until tomorrow | 00:52 |
| inc0 | someone else will have to bump up the number | 00:52 |
| sdake | there are two operations | 00:52 |
| sdake | one to capture html | 00:52 |
| sdake | one to capture json | 00:52 |
| *** ssurana has quit IRC | 00:52 | |
| sdake | inc0 pretty sure the line includes the name which is 128x24, 128x48, or 128x96 | 00:55 |
| sdake | the problem with that copying the lines 3 times is that the output to wrong dir | 00:56 |
| sdake | i guess we could hardcode the output dir too ;) | 00:56 |
| sdake | i need to run to circklee k to grab a soda, bbi10 | 00:56 |
| britthouser | Need ; before do, @inc | 00:57 |
| britthouser | Need ; before do, inc0 | 00:57 |
| britthouser | yeah | 00:57 |
| duonghq | hmm, circle-K store become more and more wide spread here | 00:57 |
| *** gfhellma has quit IRC | 00:57 | |
| *** yingjun has quit IRC | 00:57 | |
| *** yingjun has joined #openstack-kolla | 00:58 | |
| inc0 | sdake that will be ok | 01:01 |
| inc0 | ? | 01:01 |
| duonghq | anybody know where is coolsvap? he doesn't active in IRC for awhile? | 01:03 |
| inc0 | I haven't seen him for couple days | 01:03 |
| *** jtriley has joined #openstack-kolla | 01:03 | |
| *** phuongnh has joined #openstack-kolla | 01:06 | |
| *** sdake has quit IRC | 01:06 | |
| *** zhubingbing has joined #openstack-kolla | 01:06 | |
| inc0 | I hate bash | 01:11 |
| duonghq | irc0: what's wrong | 01:11 |
| *** caowei has joined #openstack-kolla | 01:14 | |
| *** zhurong has joined #openstack-kolla | 01:17 | |
| inc0 | I give up. | 01:20 |
| duonghq | inc0: can I help you? | 01:20 |
| inc0 | nah, I'll take a look tomorrow | 01:21 |
| inc0 | cya guys | 01:21 |
| inc0 | thanks duonghq tho | 01:21 |
| duonghq | cya inc0 | 01:21 |
| *** inc0 has quit IRC | 01:21 | |
| *** yingjun has quit IRC | 01:33 | |
| *** fguillot has quit IRC | 01:33 | |
| *** yingjun has joined #openstack-kolla | 01:33 | |
| *** zhiwei has joined #openstack-kolla | 01:34 | |
| *** sdake has joined #openstack-kolla | 01:36 | |
| sdake | inc0 | 01:37 |
| *** sdake_ has joined #openstack-kolla | 01:39 | |
| *** sdake has quit IRC | 01:42 | |
| *** unicell has quit IRC | 01:43 | |
| *** fguillot has joined #openstack-kolla | 01:45 | |
| *** aNupoisc has quit IRC | 01:49 | |
| *** sdake_ has quit IRC | 01:54 | |
| duonghq | sdake_ inc0 take a rest atm | 01:55 |
| zhubingbing | - - | 02:02 |
| *** yingjun has quit IRC | 02:02 | |
| *** yingjun has joined #openstack-kolla | 02:03 | |
| *** sdake has joined #openstack-kolla | 02:04 | |
| *** jrist has quit IRC | 02:05 | |
| *** zhurong_ has joined #openstack-kolla | 02:09 | |
| duonghq | nearly all gate is green, phew... (except bandit) | 02:10 |
| *** zhurong has quit IRC | 02:11 | |
| *** jrist has joined #openstack-kolla | 02:18 | |
| zhubingbing | ping hui Kang | 02:18 |
| *** zhubingbing has quit IRC | 02:23 | |
| *** duonghq has quit IRC | 02:24 | |
| *** serverascode has quit IRC | 02:28 | |
| *** serverascode has joined #openstack-kolla | 02:30 | |
| *** sdake has quit IRC | 02:34 | |
| *** sdake has joined #openstack-kolla | 02:35 | |
| *** mdnadeem has joined #openstack-kolla | 02:40 | |
| *** fguillot has quit IRC | 02:43 | |
| *** mdnadeem_ has quit IRC | 02:43 | |
| *** jamesdenton has joined #openstack-kolla | 02:44 | |
| *** sdake has quit IRC | 02:45 | |
| *** jtriley has quit IRC | 02:45 | |
| *** sdake has joined #openstack-kolla | 02:47 | |
| *** zhubingbing_ has joined #openstack-kolla | 02:48 | |
| *** yuanying has quit IRC | 02:49 | |
| *** yuanying has joined #openstack-kolla | 02:53 | |
| *** duonghq has joined #openstack-kolla | 02:54 | |
| *** daneyon has joined #openstack-kolla | 02:57 | |
| *** daneyon has quit IRC | 03:02 | |
| *** zhubingbing_ has quit IRC | 03:12 | |
| *** sdake has quit IRC | 03:12 | |
| *** zhubingbing_ has joined #openstack-kolla | 03:15 | |
| *** jtriley has joined #openstack-kolla | 03:17 | |
| *** salv-orlando has joined #openstack-kolla | 03:17 | |
| *** salv-orl_ has quit IRC | 03:20 | |
| *** jtriley has quit IRC | 03:22 | |
| *** senk has joined #openstack-kolla | 03:25 | |
| *** zhubingbing_ has quit IRC | 03:26 | |
| *** zhubingbing has joined #openstack-kolla | 03:27 | |
| *** huikang has joined #openstack-kolla | 03:41 | |
| *** senk has quit IRC | 03:43 | |
| *** yuanying has quit IRC | 03:45 | |
| *** yuanying has joined #openstack-kolla | 03:48 | |
| *** coolsvap_ has joined #openstack-kolla | 03:50 | |
| duonghq | long time no sê coolsvap_ | 03:55 |
| duonghq | long time no see | 03:55 |
| coolsvap_ | duonghq: approx 16hrs i suppose :) | 03:55 |
| coolsvap_ | not feeling well from yesterday | 03:56 |
| *** zhubingbing has quit IRC | 03:56 | |
| duonghq | are you better now? | 03:56 |
| *** zhubingbing has joined #openstack-kolla | 03:57 | |
| *** zhubingbing has quit IRC | 03:59 | |
| coolsvap_ | kinda | 04:04 |
| duonghq | anybody got (\"Container command \\'kolla_start\\' not found or does not exist.\" randomly but frequently? | 04:08 |
| *** yingjun has quit IRC | 04:11 | |
| *** yingjun has joined #openstack-kolla | 04:11 | |
| *** yingjun has quit IRC | 04:15 | |
| *** yingjun has joined #openstack-kolla | 04:16 | |
| *** senk has joined #openstack-kolla | 04:18 | |
| duonghq | Pavo: are you there? | 04:20 |
| *** yingjun has quit IRC | 04:26 | |
| *** yingjun has joined #openstack-kolla | 04:26 | |
| openstackgerrit | Hui Kang proposed openstack/kolla: Fix mariadb bootstrap error https://review.openstack.org/360218 | 04:27 |
| duonghq | coolsvap_: would you mind review my ps: https://review.openstack.org/#/c/359596/ | 04:28 |
| *** yingjun has quit IRC | 04:31 | |
| coolsvap_ | duonghq: will do | 04:33 |
| *** unicell has joined #openstack-kolla | 04:37 | |
| *** caowei has quit IRC | 04:39 | |
| *** aswadr_ has joined #openstack-kolla | 04:41 | |
| duonghq | thank coolsvap_ | 04:42 |
| *** zhubingbing has joined #openstack-kolla | 04:42 | |
| *** unicell has quit IRC | 04:45 | |
| *** unicell1 has joined #openstack-kolla | 04:45 | |
| *** yingjun has joined #openstack-kolla | 04:48 | |
| *** huikang has quit IRC | 04:48 | |
| *** senk has quit IRC | 04:54 | |
| *** yingjun has quit IRC | 04:58 | |
| *** yingjun has joined #openstack-kolla | 04:59 | |
| *** ayoung has quit IRC | 05:03 | |
| *** yingjun has quit IRC | 05:03 | |
| *** zhubingbing has quit IRC | 05:13 | |
| *** senk has joined #openstack-kolla | 05:23 | |
| openstackgerrit | Tin Lam proposed openstack/kolla: Remove base_distro type 'fedora' https://review.openstack.org/360249 | 05:25 |
| *** harlowja_at_home has joined #openstack-kolla | 05:25 | |
| *** phuongnh has quit IRC | 05:27 | |
| *** yingjun has joined #openstack-kolla | 05:37 | |
| *** zhubingbing has joined #openstack-kolla | 05:41 | |
| *** david-lyle has joined #openstack-kolla | 05:43 | |
| *** harlowja_at_home has quit IRC | 05:45 | |
| *** david-lyle has quit IRC | 06:09 | |
| *** caowei has joined #openstack-kolla | 06:10 | |
| *** egonzalez90 has joined #openstack-kolla | 06:18 | |
| duonghq | thank egonzalez90 | 06:21 |
| *** fragatina has quit IRC | 06:46 | |
| *** Serlex has joined #openstack-kolla | 06:48 | |
| *** salv-orlando has quit IRC | 06:51 | |
| *** Mr_Broken has joined #openstack-kolla | 06:59 | |
| *** senk has quit IRC | 06:59 | |
| *** senk has joined #openstack-kolla | 07:08 | |
| *** zhubingbing has quit IRC | 07:18 | |
| *** zhiwei has quit IRC | 07:21 | |
| *** daneyon has joined #openstack-kolla | 07:28 | |
| *** Mr_Broken has quit IRC | 07:30 | |
| *** Mr_Broken has joined #openstack-kolla | 07:30 | |
| *** bootsha has joined #openstack-kolla | 07:32 | |
| *** daneyon has quit IRC | 07:33 | |
| *** zhubingbing has joined #openstack-kolla | 07:33 | |
| *** Mr_Broke_ has joined #openstack-kolla | 07:34 | |
| *** Mr_Broken has quit IRC | 07:35 | |
| *** Satya has joined #openstack-kolla | 07:43 | |
| Satya | Hi All, I have deployed openstack multinode set up using openstack-kolla. When I enable l3 HA and create a router and assign subnet router I am observing the below error | 07:45 |
| Satya | ERROR neutron.agent.l3.agent RuntimeError: Exit code: 99; Stdin: ; Stdout: ; Stderr: /var/lib/kolla/venv/bin/neutron-rootwrap: Unauthorized command: ip netns exec qrouter-90a719b6-c447-4dc7-a1c5-e21e16d9f03f keepalived -P -f /var/lib/neutron/ha_confs/90a719b6-c447-4dc7-a1c5-e21e16d9f03f/keepalived.conf -p /var/lib/neutron/ha_confs/90a719b6-c447-4dc7-a1c5-e21e16d9f03f.pid -r /var/lib/neutron/ha_confs/90a719b6-c447-4dc7-a1c5-e21e1 | 07:45 |
| Satya | Does any one come across this error | 07:46 |
| *** shardy has joined #openstack-kolla | 07:47 | |
| *** Satya has quit IRC | 07:55 | |
| *** zhubingbing has quit IRC | 07:56 | |
| *** zhubingbing has joined #openstack-kolla | 07:59 | |
| *** chas has joined #openstack-kolla | 07:59 | |
| *** salv-orl_ has joined #openstack-kolla | 07:59 | |
| *** salv-orl_ has quit IRC | 07:59 | |
| *** salv-orl_ has joined #openstack-kolla | 08:00 | |
| *** berendt has joined #openstack-kolla | 08:00 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Move to transport_url for rabbitmq configuration https://review.openstack.org/356449 | 08:08 |
| *** Mr_Broke_ has quit IRC | 08:08 | |
| *** Mr_Broken has joined #openstack-kolla | 08:08 | |
| *** ankush has quit IRC | 08:09 | |
| *** ankush has joined #openstack-kolla | 08:11 | |
| *** Mr_Broke_ has joined #openstack-kolla | 08:12 | |
| *** zhubingbing has quit IRC | 08:12 | |
| *** zhubingbing has joined #openstack-kolla | 08:12 | |
| *** Mr_Broken has quit IRC | 08:13 | |
| *** athomas has joined #openstack-kolla | 08:15 | |
| *** zhubingbing has quit IRC | 08:16 | |
| *** zhubingbing has joined #openstack-kolla | 08:16 | |
| *** senk has quit IRC | 08:29 | |
| *** zhubingbing has quit IRC | 08:34 | |
| *** zhubingbing has joined #openstack-kolla | 08:36 | |
| *** senk has joined #openstack-kolla | 08:38 | |
| *** zhubingbing has quit IRC | 08:46 | |
| *** openstackgerrit has quit IRC | 08:48 | |
| *** zhubingbing has joined #openstack-kolla | 08:48 | |
| *** openstackgerrit has joined #openstack-kolla | 08:48 | |
| berendt | Do we have a documentation of our gate setup? | 08:54 |
| bjolo | good morning | 08:56 |
| *** yingjun has quit IRC | 08:56 | |
| *** yingjun has joined #openstack-kolla | 08:56 | |
| *** zhubingbing has quit IRC | 08:57 | |
| *** zhubingbing has joined #openstack-kolla | 08:58 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Set 'balance source' for Horizon in haproxy https://review.openstack.org/356514 | 09:04 |
| *** bootsha has quit IRC | 09:07 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Import the Murano core libary as part of setup https://review.openstack.org/360002 | 09:09 |
| *** daneyon has joined #openstack-kolla | 09:17 | |
| *** salv-orlando has joined #openstack-kolla | 09:18 | |
| *** salv-orl_ has quit IRC | 09:20 | |
| *** daneyon has quit IRC | 09:21 | |
| *** mnasiadka has joined #openstack-kolla | 09:31 | |
| Mr_Broke_ | Hey guys | 09:32 |
| Mr_Broke_ | does kolla at somew point run neutron-ovs-cleanup ? | 09:32 |
| Mr_Broke_ | I am running into problems after reboot with my dhcp, l3 and metadata agent | 09:32 |
| Mr_Broke_ | are you aware of this ? : https://bugs.launchpad.net/cloud-archive/+bug/1249708 | 09:32 |
| openstack | Launchpad bug 1249708 in neutron (Ubuntu) "Missing neutron-ovs-cleanup service" [High,Fix released] - Assigned to James Page (james-page) | 09:32 |
| Mr_Broke_ | this script should run, when neutron_server starts | 09:35 |
| *** fragatina has joined #openstack-kolla | 09:43 | |
| *** bootsha has joined #openstack-kolla | 09:47 | |
| *** fragatina has quit IRC | 09:47 | |
| openstackgerrit | Prithiv proposed openstack/kolla: Dockerfiles for collectd Container https://review.openstack.org/358632 | 09:53 |
| openstackgerrit | Merged openstack/kolla: Updated from global requirements https://review.openstack.org/360234 | 09:53 |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla: Add option to support dhcp/l3 agent ha https://review.openstack.org/352180 | 09:55 |
| *** gfidente|afk is now known as gfidente | 09:56 | |
| *** yingjun has quit IRC | 09:56 | |
| *** zhurong_ has quit IRC | 10:01 | |
| openstackgerrit | Prithiv proposed openstack/kolla: Dockerfiles for collectd Container https://review.openstack.org/358632 | 10:01 |
| *** zhubingbing has quit IRC | 10:02 | |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Add full support for fernet https://review.openstack.org/349366 | 10:08 |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode https://review.openstack.org/356544 | 10:09 |
| *** prithiv has joined #openstack-kolla | 10:12 | |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Add dockerfiles for keystone fernet https://review.openstack.org/351139 | 10:13 |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Customizations for RabbitMQ https://review.openstack.org/354409 | 10:16 |
| *** duonghq has quit IRC | 10:16 | |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Customizations for MariaDB https://review.openstack.org/354422 | 10:19 |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Customizations for MariaDB https://review.openstack.org/354422 | 10:19 |
| *** zhiwei has joined #openstack-kolla | 10:19 | |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Customizations for Ironic https://review.openstack.org/354427 | 10:22 |
| *** zhiwei has quit IRC | 10:24 | |
| openstackgerrit | Shaun Smekel proposed openstack/kolla: Fix incorrectly implemented footer blocks https://review.openstack.org/358193 | 10:26 |
| *** Mr_Broke_ has quit IRC | 10:27 | |
| *** Mr_Broken has joined #openstack-kolla | 10:27 | |
| *** Serlex has quit IRC | 10:28 | |
| *** yingjun has joined #openstack-kolla | 10:29 | |
| *** Mr_Broken has quit IRC | 10:32 | |
| *** Serlex has joined #openstack-kolla | 10:39 | |
| *** prithiv has quit IRC | 11:04 | |
| *** Mr_Broken has joined #openstack-kolla | 11:04 | |
| Mr_Broken | @Sarya: looks like a rootwrap problem, have you seen this ? :https://bugs.launchpad.net/kolla/+bug/1599489 ? Other people seem to report issues when deploying from images built from sources | 11:10 |
| openstack | Launchpad bug 1599489 in kolla "Neutron Open vSwitch Agent hangs because of Sudo" [High,Incomplete] - Assigned to Michał Jastrzębski (inc007) | 11:10 |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode https://review.openstack.org/356544 | 11:13 |
| pbourke | Jeffrey4l__: ping | 11:32 |
| yingjun | ping pbourke | 11:36 |
| pbourke | yingjun: hi | 11:36 |
| yingjun | hi pbourke, i answered your comment in this patch: https://review.openstack.org/#/c/358973/ | 11:37 |
| yingjun | Could you recheck on that? | 11:37 |
| pbourke | yingjun: hmm | 11:38 |
| Mr_Broken | hey guys, according to this https://bugs.launchpad.net/cloud-archive/+bug/1249708 neutron-ovs-cleanup should be run in the event of hosts reboot , just before neutron_server starts | 11:38 |
| openstack | Launchpad bug 1249708 in neutron (Ubuntu) "Missing neutron-ovs-cleanup service" [High,Fix released] - Assigned to James Page (james-page) | 11:38 |
| pbourke | yingjun: ok maybe it's best to do it at runtime then, but could we do it in the kolla-toolbox start task rather than ceph? | 11:39 |
| Mr_Broken | I've looked through kolla sources, and cant find this being used - therefore having issues with my neutron network agents after reboos | 11:39 |
| Mr_Broken | should I open a bug in Kolla ? or you guys are aware of that ? | 11:39 |
| pbourke | Mr_Broken: sounds like we need that functionality | 11:40 |
| pbourke | Mr_Broken: i would log a bug | 11:40 |
| Mr_Broken | kk will do, thanks | 11:40 |
| *** gbialas has joined #openstack-kolla | 11:41 | |
| yingjun | pbourke, i think it could, i’ll try :) | 11:41 |
| *** mewald has joined #openstack-kolla | 11:43 | |
| *** dwalsh has joined #openstack-kolla | 11:44 | |
| Jeffrey4l__ | pbourke, pong | 11:47 |
| pbourke | Jeffrey4l__: was just looking again at https://review.openstack.org/#/c/311125/ | 11:48 |
| pbourke | Jeffrey4l__: would be great to get that fixed. is it on your radar or would you like me to try submitting an update for it? | 11:48 |
| pbourke | Jeffrey4l__: it looks good if we could avoid the extra site.yml | 11:48 |
| Jeffrey4l__ | pbourke, OK. i can handle it. | 11:49 |
| pbourke | Jeffrey4l__: thanks! | 11:49 |
| Jeffrey4l__ | thanks for the reminder. | 11:49 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Fix toolbox permission issue when enabling ceph https://review.openstack.org/358973 | 11:50 |
| yingjun | pbourke thanks | 11:51 |
| pbourke | yingjun: thanks also | 11:52 |
| openstackgerrit | Mathias proposed openstack/kolla: Added telegraf role https://review.openstack.org/346448 | 11:53 |
| openstackgerrit | Mathias proposed openstack/kolla: Added influxdb role https://review.openstack.org/346449 | 11:53 |
| openstackgerrit | Mathias proposed openstack/kolla: Added grafana container https://review.openstack.org/346447 | 11:53 |
| mewald | What do I need to do to solve these "Patch in Merge Conflict" errors in gerrit? | 11:58 |
| *** dwalsh has quit IRC | 11:59 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Customizations for Nova https://review.openstack.org/351676 | 12:02 |
| egonzalez90 | mewald, yes is needed because some change was merged in some place your patchset is changing | 12:13 |
| egonzalez90 | as example inventory files | 12:13 |
| *** salv-orlando has quit IRC | 12:15 | |
| *** akwasnie has quit IRC | 12:18 | |
| *** akwasnie has joined #openstack-kolla | 12:18 | |
| *** haplo37 has quit IRC | 12:20 | |
| *** shardy has quit IRC | 12:21 | |
| *** bradjones has quit IRC | 12:21 | |
| *** haplo37 has joined #openstack-kolla | 12:22 | |
| *** shardy has joined #openstack-kolla | 12:22 | |
| *** bootsha has quit IRC | 12:24 | |
| *** peterjenkins has quit IRC | 12:25 | |
| *** bradjones has joined #openstack-kolla | 12:27 | |
| *** bradjones has quit IRC | 12:27 | |
| *** bradjones has joined #openstack-kolla | 12:27 | |
| *** peterjenkins has joined #openstack-kolla | 12:27 | |
| *** bootsha has joined #openstack-kolla | 12:28 | |
| *** JoseMello has joined #openstack-kolla | 12:35 | |
| *** sbezverk_ has joined #openstack-kolla | 12:37 | |
| *** sbezverk has quit IRC | 12:39 | |
| *** dave-mccowan has joined #openstack-kolla | 12:41 | |
| *** rhallisey has joined #openstack-kolla | 12:41 | |
| *** jtriley has joined #openstack-kolla | 12:54 | |
| *** bootsha has quit IRC | 12:54 | |
| *** bootsha has joined #openstack-kolla | 12:55 | |
| *** egonzalez90 has quit IRC | 12:56 | |
| *** zhurong has joined #openstack-kolla | 12:58 | |
| *** salv-orlando has joined #openstack-kolla | 12:58 | |
| *** jrist has quit IRC | 13:00 | |
| *** bootsha has quit IRC | 13:00 | |
| *** fguillot has joined #openstack-kolla | 13:03 | |
| *** dwalsh has joined #openstack-kolla | 13:04 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Customizations for Nova https://review.openstack.org/351676 | 13:07 |
| *** Mr_Broken has quit IRC | 13:09 | |
| *** Mr_Broken has joined #openstack-kolla | 13:09 | |
| openstackgerrit | sean mooney proposed openstack/kolla: generate bifrost yaml configs https://review.openstack.org/349684 | 13:10 |
| openstackgerrit | sean mooney proposed openstack/kolla: add bifrost deploy ansible support https://review.openstack.org/349685 | 13:10 |
| openstackgerrit | sean mooney proposed openstack/kolla: introduce bifrost-deploy container https://review.openstack.org/319703 | 13:10 |
| openstackgerrit | sean mooney proposed openstack/kolla: adds bifrost ssh key generation https://review.openstack.org/350692 | 13:10 |
| openstackgerrit | sean mooney proposed openstack/kolla: add deploy-servers command https://review.openstack.org/349729 | 13:10 |
| *** Mr_Broke_ has joined #openstack-kolla | 13:11 | |
| *** jrist has joined #openstack-kolla | 13:13 | |
| *** Mr_Broken has quit IRC | 13:14 | |
| *** fguillot_ has joined #openstack-kolla | 13:15 | |
| *** fguillot has quit IRC | 13:28 | |
| *** Satya has joined #openstack-kolla | 13:28 | |
| *** Mr_Broke_ has quit IRC | 13:30 | |
| *** Mr_Broken has joined #openstack-kolla | 13:30 | |
| *** yingjun has quit IRC | 13:34 | |
| *** Mr_Broken has quit IRC | 13:34 | |
| *** lrensing_ has joined #openstack-kolla | 13:34 | |
| *** salv-orlando has quit IRC | 13:35 | |
| *** senk has quit IRC | 13:38 | |
| *** gbialas has quit IRC | 13:39 | |
| *** inc0 has joined #openstack-kolla | 13:41 | |
| *** srwilkers_ has joined #openstack-kolla | 13:43 | |
| *** mgoddard_ has joined #openstack-kolla | 13:45 | |
| *** mgoddard has quit IRC | 13:48 | |
| inc0 | good morning | 13:53 |
| mewald | morning | 13:53 |
| srwilkers_ | morning inc0 | 13:53 |
| *** rhallisey has quit IRC | 13:54 | |
| *** rhallisey has joined #openstack-kolla | 13:57 | |
| *** mnasiadka has quit IRC | 13:59 | |
| inc0 | pbourke, around? | 13:59 |
| pbourke | inc0: hu | 13:59 |
| pbourke | *hi | 13:59 |
| inc0 | mind taking a look at https://review.openstack.org/#/c/358042/ | 13:59 |
| inc0 | oracle linux is failing for me and to me it looks like repo issue...is this correct/incorrect? | 14:00 |
| *** NachoDuck has quit IRC | 14:01 | |
| *** huikang has joined #openstack-kolla | 14:02 | |
| *** NachoDuck has joined #openstack-kolla | 14:04 | |
| *** mgoddard_ has quit IRC | 14:04 | |
| *** mgoddard has joined #openstack-kolla | 14:05 | |
| *** yingjun has joined #openstack-kolla | 14:06 | |
| pbourke | looking | 14:10 |
| *** fguillot_ has quit IRC | 14:16 | |
| *** fguillot has joined #openstack-kolla | 14:19 | |
| *** michauds has joined #openstack-kolla | 14:21 | |
| sbezverk_ | inc0: need your advise. I am chasing a nova bug and folks from nova channel suggested a change in os_vif package. How I could bring cutomized os_vif package into nova-compute image? | 14:25 |
| inc0 | customized how? | 14:25 |
| sbezverk_ | inc0: line changed in python code | 14:26 |
| *** prithiv has joined #openstack-kolla | 14:28 | |
| *** berendt has quit IRC | 14:28 | |
| *** chas has quit IRC | 14:31 | |
| *** prithiv has quit IRC | 14:33 | |
| *** ravig has joined #openstack-kolla | 14:37 | |
| inc0 | hmm | 14:40 |
| inc0 | sbezverk_, so you can make use of our customization mechanism | 14:40 |
| inc0 | to inject something like sed into build | 14:41 |
| inc0 | also this will be trickier with binary build | 14:41 |
| inc0 | s | 14:41 |
| inc0 | meh | 14:41 |
| sbezverk_ | no need binary I am on source | 14:42 |
| *** sdake has joined #openstack-kolla | 14:42 | |
| inc0 | yeah but people might be on binary | 14:43 |
| sdake | morning | 14:43 |
| sdake | pbourke where we at with osic? | 14:43 |
| inc0 | who uses it at the end | 14:43 |
| inc0 | anyway, worth to try | 14:43 |
| sdake | inc0 where we aat on osic | 14:43 |
| inc0 | best bet - use customizations | 14:43 |
| inc0 | rally is running | 14:43 |
| inc0 | that's what I'm seeing now;) | 14:43 |
| sdake | for which scenario? | 14:43 |
| inc0 | I have no idea | 14:43 |
| sdake | can you check the nextsteps file in the /root dir | 14:44 |
| inc0 | todays deployment tho | 14:44 |
| inc0 | you are last author man:P | 14:44 |
| inc0 | anyway we probably killed our cloud | 14:44 |
| * sdake groans | 14:44 | |
| sdake | why killed our cloud? | 14:44 |
| inc0 | lots of timeouts and shit | 14:44 |
| sdake | timeouts are ok | 14:45 |
| inc0 | I bet that space on disk ran out | 14:45 |
| inc0 | how they are ok? | 14:45 |
| sdake | because we are running an overload test | 14:45 |
| inc0 | hence killed our cloud | 14:45 |
| sdake | i just fnid it hand to believe its been running for 12 hours | 14:45 |
| inc0 | as overloaded it | 14:45 |
| *** senk has joined #openstack-kolla | 14:46 | |
| sdake | so are you saying someone redeployed the cloud? | 14:46 |
| inc0 | no idea | 14:46 |
| inc0 | aaaand yeah | 14:47 |
| inc0 | we ran out of disk | 14:47 |
| sdake | what type of scenario is it on? | 14:47 |
| inc0 | told ya we should mount big disk to var/lib/docker | 14:47 |
| sdake | ran out of disk in ceph? | 14:47 |
| inc0 | no | 14:47 |
| inc0 | elastic | 14:47 |
| inc0 | ceph is ok | 14:47 |
| inc0 | but on controls / is on 40G partition | 14:47 |
| inc0 | and elastic stores a lot...a lot of data | 14:47 |
| *** ravig has quit IRC | 14:48 | |
| inc0 | I'll stop this stuff and fix our env if you don't mid | 14:48 |
| sdake | i'd like to know what scenario its on | 14:48 |
| *** openstackgerrit has quit IRC | 14:48 | |
| sdake | run rally task list | wc -l | 14:48 |
| *** openstackgerrit has joined #openstack-kolla | 14:49 | |
| inc0 | 81 | 14:49 |
| sdake | somehting deinatley wrong it was at 60 when i left 12 hrs ago... | 14:49 |
| inc0 | it's new deployment | 14:49 |
| inc0 | first task was finished 2hrs agio | 14:49 |
| inc0 | so it's not that horrible | 14:50 |
| pbourke | inc0: the problem is "7server" in http://mirror.centos.org/centos/7Server/virt/x86_64/kvm-common/repodata/repomd.xml | 14:50 |
| *** yingjun has quit IRC | 14:50 | |
| *** yingjun has joined #openstack-kolla | 14:50 | |
| inc0 | pbourke, so it's not issue with my code? | 14:50 |
| *** ravig has joined #openstack-kolla | 14:50 | |
| pbourke | inc0: there's a sed to swap that with '7' but whatever repo provides that one above must be getting missed | 14:50 |
| sdake | was any datacaptured in scenario-2 directory? | 14:50 |
| inc0 | I see | 14:50 |
| pbourke | inc0: your change seems to be fine but there must be something odd with it as the other patches aren't failing | 14:50 |
| inc0 | sdake, onlu what I was doing yesterday | 14:51 |
| pbourke | inc0: I'll try your change locally to see if I can pin it down | 14:51 |
| sdake | why would soemone redeploy the cloud? | 14:51 |
| inc0 | as it stands today, it's broken | 14:52 |
| inc0 | I'm stopping this crap, fixing env and redeploying | 14:52 |
| *** yingjun_ has joined #openstack-kolla | 14:53 | |
| pbourke | sdake: yeah I just saw rally running and assumed someone was on it | 14:53 |
| *** yingjun has quit IRC | 14:53 | |
| *** david-lyle has joined #openstack-kolla | 14:53 | |
| *** caowei has quit IRC | 14:56 | |
| britthouser | Is it fair to say we should have a '/var/lib/docker is huge' pre-deployment check? | 14:57 |
| sdake | YES | 14:57 |
| pbourke | inc0: weird its building locally for me | 14:57 |
| pbourke | britthouser: its sort of dodging the issue that we're lashing a lot of large data into one partition though | 14:58 |
| pbourke | britthouser: we have ops who dont like this about kolla but I dont have a good answer yet | 14:58 |
| sdake | pbourke first time i've ever heard the complaint | 14:59 |
| britthouser | Is it basically all the logs go into volume, and all volumes live in /var/lib/docker? | 14:59 |
| pbourke | sdake: yeah i haven't been vocal enough about it | 14:59 |
| *** david-lyle has quit IRC | 14:59 | |
| pbourke | britthouser: yes | 14:59 |
| *** JoseMello has quit IRC | 15:00 | |
| sdake | one directory or spread across the system - i don't see the delta | 15:00 |
| pbourke | its common enough to mount /var/lib/nova/instances on a separate large disk | 15:01 |
| pbourke | how do I do this with kolla? | 15:01 |
| pbourke | any dont say use ceph ;) | 15:01 |
| sdake | mount /var/ib/kolla on a large disk | 15:01 |
| sdake | sorry v/ar/lib/docker | 15:01 |
| pbourke | along with /var/lib/cinder ? and /var/lib/glance ? | 15:02 |
| sdake | it is true there is no spindle separation of storage to specific disk | 15:03 |
| sdake | but that is an orthogonal problem to running out of disk space in general | 15:03 |
| sbezverk_ | pbourke: second for question? | 15:04 |
| pbourke | I wondering would it be possible to mount /var/lib/docker/volumes/_data/nova on separate disk for example | 15:04 |
| pbourke | i haven't tried yet | 15:04 |
| sdake | Jeffrey4l__ still here? | 15:06 |
| britthouser | Typically on systems I deploy, /var is my largest partition | 15:06 |
| Jeffrey4l__ | sdake, yep | 15:06 |
| sdake | Jeffrey4l__ did you redeploy the cluster last night? | 15:07 |
| Jeffrey4l__ | sdake, no.. | 15:07 |
| sdake | ok - there is a file clled NEXTSTEPS | 15:07 |
| sdake | it contians directions for what to do next | 15:07 |
| Jeffrey4l__ | sdake, writing the rally script to test the io | 15:07 |
| sdake | we now have 5 days | 15:07 |
| Jeffrey4l__ | yep.. | 15:08 |
| sdake | inc0 if you rerun tests amke sure to wipe out db | 15:09 |
| *** jamesdenton is now known as Guest1506 | 15:11 | |
| *** salv-orlando has joined #openstack-kolla | 15:12 | |
| inc0 | well fuck | 15:12 |
| inc0 | I might have broken our controllers | 15:12 |
| inc0 | I'm going to redeploy baremetal | 15:12 |
| inc0 | it's long overude anyway | 15:12 |
| sdake | how long will that take? | 15:13 |
| inc0 | hour or so | 15:13 |
| sdake | just deploy xenial then | 15:13 |
| inc0 | gonna fix the storage issue when I'm at it | 15:13 |
| inc0 | not that easy | 15:13 |
| inc0 | I don't have preseed xenial image handy | 15:13 |
| sdake | if we can skip to xenial before having done any work | 15:14 |
| sdake | we should do so | 15:14 |
| sdake | at this point we haven't done any work... | 15:14 |
| inc0 | centos is same issue exacrly | 15:14 |
| sdake | ok - well wen eed to sovle those | 15:14 |
| inc0 | I don't agree | 15:14 |
| sdake | britthouser is your man | 15:14 |
| inc0 | I'm about to start writing best practices guide | 15:15 |
| sdake | tell me how long it takes to make an image | 15:15 |
| sdake | if its a 3 day process | 15:15 |
| inc0 | lot's of stuff we learned | 15:15 |
| sdake | then we have problems | 15:15 |
| sdake | my point is i'd rather have xenial data then 14.04 data | 15:15 |
| sdake | and at this pace we will not hae time for xenial data | 15:15 |
| sdake | can i get an estimate on time needed to get xenail deployed? | 15:17 |
| sdake | i realize its more work | 15:17 |
| *** salv-orl_ has joined #openstack-kolla | 15:18 | |
| sdake | inc0 britthouser ^^ | 15:18 |
| *** vhosakot has joined #openstack-kolla | 15:19 | |
| *** salv-orlando has quit IRC | 15:20 | |
| *** vbel has quit IRC | 15:22 | |
| *** vbel has joined #openstack-kolla | 15:23 | |
| pbourke | so because elasticsearch is full we're tearing down and going ubuntu? | 15:23 |
| pbourke | what? | 15:23 |
| pbourke | sdake: ^ | 15:23 |
| sdake | pbourke isn't it alrady ubuntu? | 15:23 |
| pbourke | oh right | 15:23 |
| sdake | i dont get the teardown | 15:23 |
| pbourke | inc0: why are you tearing down | 15:23 |
| sdake | why not just fix the 3 controlers | 15:23 |
| sdake | but whatever | 15:23 |
| sdake | pbourke he cratered the controllers | 15:23 |
| pbourke | why still need to do upgrade/stress test scenarios | 15:23 |
| inc0 | pbourke, I ran rm -rf /var/lib on controllers;) | 15:24 |
| inc0 | but on the other hand controllers were out of space | 15:24 |
| inc0 | and thrown a lot of errors | 15:24 |
| inc0 | so I'm going to redeploy whole thing and make controllers disks...bigger | 15:24 |
| sdake | pbourke check out etherpad - i tuned our test sceanrios | 15:24 |
| sdake | but woudl like estimate on exenail deployment | 15:25 |
| sdake | if we dont do it now | 15:25 |
| sdake | its not going to happen at all | 15:25 |
| britthouser | The import of xenial shouldnt take too long sdake. *but* the risk of going to xenial now is we had to install special driver for the NICs. Not sure how/if/etc that works in xenial | 15:25 |
| sdake | these teset scenarios take6-8 hrs to run | 15:25 |
| sdake | britthouser it wasn't just a kernel update? | 15:25 |
| pbourke | chaosmonkey tests would be useful | 15:26 |
| pbourke | sdake: sure you want to drop those? | 15:26 |
| sdake | ya lets make it harder | 15:26 |
| sdake | pbourke - we have 5 days to run tatleast 2 platforms worth of tests | 15:26 |
| britthouser | I wasn't around for the specifics of what it required to get the NICs to work right | 15:26 |
| sdake | do the math | 15:26 |
| britthouser | I came back from travel after the fact | 15:26 |
| britthouser | if it was just new kernel, and xenial has kernel, then pobably low risk | 15:27 |
| sdake | britthouser pretty sure itw as just a ernel update | 15:27 |
| *** rhallisey_ has joined #openstack-kolla | 15:28 | |
| britthouser | Ok, then probably lower risk. | 15:28 |
| britthouser | Lemme login the cobbler container and work on importing it. | 15:28 |
| sdake | britthouser is that something you an hep with ? | 15:28 |
| britthouser | yes | 15:28 |
| sdake | thank god ;) | 15:28 |
| sdake | pbourke sorry for being so short - just runnign out of time trying to reduce our scope as much as possible | 15:29 |
| pbourke | sdake: no prob | 15:30 |
| pbourke | sdake: final question though. benefit of testing on xenial over 14.04 is? | 15:30 |
| sdake | pbourke master onl yruns on xenial | 15:30 |
| pbourke | sdake: thanks | 15:30 |
| *** fguillot has quit IRC | 15:32 | |
| *** rhallisey has quit IRC | 15:32 | |
| *** egonzalez90 has joined #openstack-kolla | 15:32 | |
| *** ravig has quit IRC | 15:32 | |
| *** huikang has quit IRC | 15:33 | |
| *** ravig has joined #openstack-kolla | 15:33 | |
| sdake | britthouser osic uses a cobbler container? | 15:35 |
| britthouser | Yeah...an LXC container with cobbler in it | 15:35 |
| *** prithiv has joined #openstack-kolla | 15:35 | |
| britthouser | Its running on teh deploy node | 15:36 |
| sdake | cool | 15:36 |
| britthouser | root@729494-comp-s3500-002:~# lxc-ls | 15:36 |
| britthouser | osic-prep | 15:36 |
| *** v1k0d3n has joined #openstack-kolla | 15:39 | |
| inc0 | hmm..how did we add first IP for nodes? | 15:40 |
| britthouser | taht was from spreadsheet? | 15:41 |
| britthouser | You're talking about the 10.15.243.X inc0? | 15:41 |
| britthouser | The ILO addresses were in the email | 15:42 |
| britthouser | I cut/pasted them into ilo.csv | 15:42 |
| inc0 | no, I already deploy first node | 15:43 |
| britthouser | which is just a compliation of m9*.txt files | 15:43 |
| inc0 | OS | 15:43 |
| inc0 | trying to get to them | 15:43 |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Import the Murano core libary as part of setup https://review.openstack.org/360002 | 15:43 |
| britthouser | then I'm not sure what you're asking | 15:43 |
| v1k0d3n | hey rhallisey_ or sdake, have a question as a new guy.... | 15:44 |
| v1k0d3n | looking through blueprints...and this one came up (has my interest): https://blueprints.launchpad.net/kolla/+spec/consul-container | 15:44 |
| v1k0d3n | could we just use etcd though? how can i make suggestions to the author huikang27? | 15:44 |
| *** Serlex has quit IRC | 15:44 | |
| rhallisey_ | v1k0d3n, that bp doesn't look very active | 15:45 |
| sdake | etcd is already in the review queue | 15:45 |
| rhallisey_ | you can probably take it | 15:45 |
| *** rhallisey_ is now known as rhallisey | 15:45 | |
| sdake | there is already an implemtnation of consul in teh queue as well | 15:45 |
| v1k0d3n | good. i think etcd meets the request and better aligns. | 15:45 |
| sdake | its just that we dont see a good need for it | 15:45 |
| v1k0d3n | ^^ agreed. | 15:45 |
| kfox1111 | v1k0d3n: and depends on if your looking at ansible or k8s. the k8s side is doing service descovery via k8s. | 15:45 |
| rhallisey | https://review.openstack.org/#/c/355156/ | 15:45 |
| v1k0d3n | well, etcd could be used for either, no? | 15:46 |
| kfox1111 | it could, but its extranious in k8s as k8s provides dns based service discovery. | 15:46 |
| v1k0d3n | yeah, that review is good. like i said...i'm new to this fulltime role. just taking things in right now. | 15:46 |
| rhallisey | v1k0d3n, ya I guess we could go with etcd | 15:46 |
| rhallisey | it's in much better shape | 15:46 |
| v1k0d3n | that's my thought too. | 15:47 |
| sdake | v1k0d3n i'd recommend having a look at the review queue | 15:47 |
| sdake | to see whta peopel are working on | 15:47 |
| *** Serlex has joined #openstack-kolla | 15:47 | |
| v1k0d3n | reusable configs/skills if we just go with etcd...not that i'd want to limit options later though. | 15:47 |
| v1k0d3n | ok. | 15:47 |
| v1k0d3n | sdake / rhallisey wanted to also ask about something like LKVM or hypervirtualization of the containers. do we have that on the roadmap at all (support some form of hypervirtualization of the containers)? | 15:48 |
| sdake | youo mean like intel's clear containers ? | 15:49 |
| v1k0d3n | yes | 15:49 |
| v1k0d3n | increased security | 15:49 |
| sdake | v1k0d3n this project doesn't have a super roadmap :) | 15:49 |
| sdake | v1k0d3n basiclly people work on what interests them | 15:49 |
| sdake | and that defines our roadmap | 15:49 |
| sdake | but i'd liek to see clear containers optionally implemented if its possible | 15:50 |
| sdake | not sure if that iss the case | 15:50 |
| v1k0d3n | i think it can be done, but the prep would most likely be out of kolla or kolla-kubernetes. at the kolla level, it would be using the flags to support what's been prepared. | 15:51 |
| sdake | does clear containers support host bindmounts? | 15:51 |
| sdake | does clear containers support host netowrking mode? | 15:51 |
| *** ravig has quit IRC | 15:51 | |
| sdake | or ipc mode | 15:51 |
| v1k0d3n | i was going to check on this. | 15:51 |
| sdake | or pid=host | 15:51 |
| sdake | thse are things we need to hve any kind of extra barrier | 15:52 |
| v1k0d3n | i probably need to come up with a list of kolla requirements based on what's in place, and then compare. | 15:52 |
| v1k0d3n | right, agreed. | 15:52 |
| *** britthouser has quit IRC | 15:52 | |
| v1k0d3n | it 'should' support docker: https://clearlinux.org/blogs/clear-containers-docker-engine | 15:53 |
| sdake | but does it support all docker flags needed | 15:53 |
| sdake | unknown | 15:53 |
| v1k0d3n | right. i will look into it. | 15:54 |
| *** britthouser has joined #openstack-kolla | 15:54 | |
| britthouser | rut row | 15:54 |
| v1k0d3n | something to blueprint maybe? | 15:54 |
| *** aNupoisc has joined #openstack-kolla | 15:54 | |
| v1k0d3n | i'm 1000% new to blueprints. and i don't want to put something out there just to put it out there. | 15:54 |
| sdake | v1k0d3n that is usually how it wors - think of blueprints as a brainstorming area | 15:55 |
| sdake | britthouser sup problem? | 15:55 |
| britthouser | freenode disconnect me. Back now. =) | 15:55 |
| britthouser | I need to get the contents of the ISO into the LXC container. Does LXC have something equivalent to 'docker copy' ? | 15:56 |
| sdake | lxc may have binddmounts? | 15:56 |
| sdake | docker copy only copie from insdie to outside the container | 15:56 |
| britthouser | I tried to mount the ISO while in the LXC, and got errors, just like I do with docker. | 15:57 |
| *** mark-casey has joined #openstack-kolla | 15:57 | |
| sdake | another option is curl | 15:57 |
| britthouser | https://paste.fedoraproject.org/413935/14721406/ | 15:57 |
| britthouser | Yeah I curl'd the ISO down...or do you mean somethingelse? | 15:58 |
| *** yingjun_ has quit IRC | 15:59 | |
| *** ravig has joined #openstack-kolla | 16:05 | |
| *** Marcellin_ has joined #openstack-kolla | 16:05 | |
| sdake | thats what i meant - curl inside the lxc ontainer | 16:05 |
| britthouser | Sure...I can curl down the ISO to host or LXC | 16:06 |
| sdake | britthouser t oget that to work in docker - you have to bindmount /dev | 16:06 |
| britthouser | but I need the files inside the ISO | 16:06 |
| sdake | oh you need to modify the iso? | 16:06 |
| sdake | modify outside - then curl inside? | 16:06 |
| britthouser | no cobbler just needs to pull files out of it | 16:06 |
| sdake | i see | 16:06 |
| sdake | does cobbler use mount to do that? | 16:07 |
| *** ravig has quit IRC | 16:07 | |
| britthouser | typically user does the mount, and then points cobbler at the mount point | 16:07 |
| sdake | a loopback mount? | 16:07 |
| britthouser | right | 16:07 |
| sdake | is ubuntu mounted atm? | 16:07 |
| britthouser | I think i found a way | 16:07 |
| sdake | if it just needs the files in the iso, loopback mount on the host, then tar em up then curl the tar in | 16:08 |
| britthouser | From host I can mount ISO, and then copy contents into /var/lib/lxc/osic-prep/rootfs/blah | 16:08 |
| sdake | nice | 16:08 |
| *** mewald has quit IRC | 16:08 | |
| sdake | hey folks i am in flagstaff today and have a 2-3 hour travel time back to phoenix around noon pst | 16:09 |
| jrich523 | fly like the wind! | 16:09 |
| britthouser | =) | 16:11 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Ansible config for nova-serialproxy console https://review.openstack.org/358839 | 16:11 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Deployment, Readiness, Safe Shutdown, & Scaling for glance https://review.openstack.org/354895 | 16:12 |
| v1k0d3n | so steve, if i put a blueprint out there about hypervirtualization of the container, would that work? it may actually be a better fit into kolla-kubernetes rhallisey, since kubernetes will soon (or at somepoint) support a runtime interface for other runtimes. | 16:13 |
| v1k0d3n | even those runtimes can support docker format, like hyperd | 16:13 |
| sdake | so guys our quickstart gets about 2k page views a month | 16:13 |
| jrich523 | not bad | 16:13 |
| jrich523 | oh i noticed that the order was... well... problematic | 16:14 |
| jrich523 | the python stuff should come frist | 16:14 |
| jrich523 | i'll fix it if i can ever get down the whole process | 16:14 |
| rhallisey | sdake, what | 16:14 |
| jrich523 | but basically ansible needed a dev package that is part of the python setup | 16:14 |
| v1k0d3n | wow. that's good. sdake how are you getting those stats? | 16:14 |
| sdake | v1k0d3n magic | 16:14 |
| rhallisey | sdake, how did you find that out | 16:14 |
| sdake | dont ask questions you dont want the answers to | 16:14 |
| v1k0d3n | google analytics? :) | 16:14 |
| v1k0d3n | hahaha | 16:14 |
| v1k0d3n | i use analytics on my blog. really helps because then i know how users got there, and demographical information :) | 16:15 |
| jrich523 | i use it on most sites i manage, fairly useful | 16:15 |
| v1k0d3n | it may help understand if they're searching for docker on openstack or visa versa :) | 16:16 |
| jrich523 | well if you're at the quickstart, you're there for a reason | 16:17 |
| jrich523 | i can imagine you stumble on to kolla, but the quickstart is intentional | 16:17 |
| *** zhurong has quit IRC | 16:20 | |
| *** michauds has quit IRC | 16:21 | |
| *** michauds has joined #openstack-kolla | 16:21 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Ansible config for nova-serialproxy console https://review.openstack.org/358839 | 16:22 |
| *** aNupoisc has quit IRC | 16:23 | |
| v1k0d3n | jrich523: maybe, but not really sure about that. i think there's still some unfortunate misunderstandings about containers/openstack and the use of each. | 16:23 |
| v1k0d3n | i'm realizing this at our kubernetes meetups. there's a lot of misunderstanding out there. | 16:23 |
| jrich523 | i know im completely lost 90% of the time, and im a fairly smart guy... some times.... | 16:24 |
| v1k0d3n | but analytics could show new/return traffic. i would imagine a high percentage of return traffic is keenly interested in Openstack on Docker. | 16:25 |
| v1k0d3n | jrich523: ha! so true. easy to get lost. | 16:25 |
| jrich523 | lol actually a chunk of those hits are me :) | 16:25 |
| jrich523 | yesterday i saw 3 browser windows open to the quick start | 16:25 |
| jrich523 | not sure why... just too many open i guess lol | 16:25 |
| *** fguillot has joined #openstack-kolla | 16:27 | |
| britthouser | ok slight bad news sdake, the cobbler (2.4.1) that came in the container only supports up to trusty | 16:29 |
| britthouser | gonna look to see if it easy to make it recognize xenial or not | 16:31 |
| *** lamt has quit IRC | 16:31 | |
| *** chas has joined #openstack-kolla | 16:31 | |
| *** wally__ has joined #openstack-kolla | 16:34 | |
| wally__ | hi guys, how can I check all logs like nova log, neutron log,? I login different container, but where is the log | 16:35 |
| sdake | wally__ docker exec heka ls -l /var/log/kolla | 16:36 |
| sdake | britthouser thats annoying :( | 16:36 |
| britthouser | sdake - cobbler 2.6 supports up through Wily | 16:36 |
| *** chas has quit IRC | 16:36 | |
| sdake | so there is no way to deploy xenial? | 16:37 |
| britthouser | no easy way | 16:37 |
| britthouser | we can try to upgrade cobbler in the lxc container. | 16:37 |
| britthouser | but even then it will probalby require some small hacking to get it to recnogize xenial | 16:37 |
| sdake | is the cobbler container easy to reproduce? | 16:38 |
| wally__ | thx got it | 16:38 |
| sdake | or can it be backed up | 16:38 |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Add option ceilometer_database_type for ceilometer https://review.openstack.org/345881 | 16:39 |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Allow mysql to be used as a database for Ceilometer https://review.openstack.org/360669 | 16:39 |
| britthouser | the container we pulled down had cobbler pre-installed. It was pretty straightforward to launch. | 16:39 |
| sdake | cool lets try upgrding then and hacking it | 16:39 |
| sdake | by lets i mean yuo :) | 16:39 |
| britthouser | we addeda bunch of scripts specific to the topology that we'd want to save off if we had to re-deploy | 16:39 |
| sdake | can you back up that stuff? | 16:40 |
| britthouser | Ok let me first see if 2.6 is even available for the distro the LXC is running | 16:40 |
| wally__ | I want to restart horizon apache server, I login to the horizon container, but do not see the apache service | 16:40 |
| wally__ | how to restart horizon apache | 16:40 |
| sdake | docker horizon restart | 16:40 |
| sdake | or docker restart horizon | 16:41 |
| wally__ | ok, thx | 16:41 |
| britthouser | yeah sdake the container is trusty, so its repo only holds cobbler 2.4 | 16:42 |
| sdake | is cobbler c or python or what? | 16:42 |
| britthouser | I think to get 2.6 we'd need a xenial container. | 16:42 |
| britthouser | mostly python I think? | 16:43 |
| *** prithiv has quit IRC | 16:43 | |
| sdake | try a pip install of it | 16:43 |
| sdake | best to make a backup | 16:43 |
| britthouser | Cobbler (0.6.3-2) - Provisioning control application & library for PXE, Virtualization, and Re-Provisioning | 16:43 |
| pbourke | sdake: bit tired today so sorry if Im getting in the way here. But - we've been doing kolla master on top of 14.04 fine up till this point | 16:46 |
| wally__ | when I do the kolla delploy, in the global.yaml file , I enable enable_murano: "yes", but when the murano pannel, not showing on the horizon dashboard | 16:46 |
| pbourke | sdake: your earlier statement about why we need 16.04 actually still doesn't make sense to me | 16:46 |
| sdake | pbourke the master containers run xenail now rather then 14.04 | 16:46 |
| *** fragatina has joined #openstack-kolla | 16:47 | |
| pbourke | yes but it runs fine on top of a host 14.04 | 16:47 |
| *** fragatina has quit IRC | 16:47 | |
| sdake | here is the deal | 16:47 |
| britthouser | Yeah I feel like we're right on the edge of "this is too risky too late in the game" | 16:47 |
| sdake | if we ar egoing to do any xenail teting at all | 16:47 |
| britthouser | but I'm a risk averse person | 16:47 |
| sdake | it needs to be setup now | 16:47 |
| sdake | so lets make a choice as a team | 16:47 |
| sdake | no xenial testing or xenail teseting | 16:48 |
| *** fragatina has joined #openstack-kolla | 16:48 | |
| pbourke | before we that we need to ask why we're abandoning 14.04 half way through | 16:48 |
| pbourke | *we ask that | 16:48 |
| sdake | we aren't abanondineding 14.04 halfway through | 16:48 |
| pbourke | so we have all scenarios done for 14.04? | 16:48 |
| sdake | we have no *resULts* for 14.04 as of yet | 16:48 |
| sdake | we have done no scenarios! | 16:48 |
| pbourke | what have we been doing that past few days | 16:49 |
| sdake | but we ehave a fully automated setup for doing the testing | 16:49 |
| sdake | we have been automating evreything so that anyone can run the scripts | 16:49 |
| sdake | and making rally work properly with kolla | 16:49 |
| irtermite | tick tock ... one week left, folks! ;) You're welcome, inc0 | 16:49 |
| *** fragatina has quit IRC | 16:49 | |
| britthouser | What if we do this: keep on with 14.04. I'll stand up a second OSIC-prep container, and just play with getting cobble 2.6 and xenial loaded. that would mitigate the upgrade risk while letting 14.04 work continue? | 16:50 |
| sdake | britthouser yes plz | 16:50 |
| pbourke | hacking cobbler at this stage in the game is bad idea | 16:50 |
| *** fragatina has joined #openstack-kolla | 16:50 | |
| sdake | pbourke tend to agree | 16:50 |
| britthouser | yeah I don't want planA to depend on my hacking cobbler. =) | 16:50 |
| *** david-lyle has joined #openstack-kolla | 16:50 | |
| pbourke | there's no gain in upgrading the host OS | 16:50 |
| britthouser | Happy to make that planB,C,D =) | 16:50 |
| sdake | perfomrnace deltas | 16:50 |
| pbourke | we started with 14.04, that's what osic recommend | 16:50 |
| sdake | britthouser - pleae do a plan b for xenial - we may or may not have time ot get to testing it if you get the osic prep container working | 16:51 |
| pbourke | stick with it, plough through the scenarios | 16:51 |
| *** aNupoisc has joined #openstack-kolla | 16:51 | |
| inc0 | yeah, I need to prep ansible inventoryu | 16:51 |
| inc0 | nodes are back up | 16:51 |
| pbourke | i honestly thought we were on like #3 as of today before the controllers went down | 16:51 |
| inc0 | just ansible doesn't understand this | 16:51 |
| sdake | inc0 ue same inventory | 16:51 |
| sdake | it is setup for the node counts i wwant | 16:51 |
| sdake | 3 contor 20 storage 100 compute | 16:51 |
| sdake | pbourke we ehave done a bare metal deploy | 16:52 |
| sdake | pbourke we are on ceph + cinder + gathering data | 16:52 |
| inc0 | that's what I'm saying, ansible doesn't understand it for whatever reason | 16:52 |
| sdake | pbourke and our deployment crater | 16:52 |
| sdake | inc0 ok - well whatever you need ot do to get to 3 control 20 stoage 100 comput e;) | 16:52 |
| sdake | i.e scenario #2 | 16:53 |
| sdake | pbourke all documentd in nextsteps file ;) | 16:53 |
| sdake | britthouser also if you could get centos sorted out in cobbler | 16:54 |
| sdake | that is actually more important then xenial at this point | 16:54 |
| sdake | centos is part of our plan a - and we have basically 3 days per distro | 16:54 |
| britthouser | Ok, the cobbler in the current OSIC-prep should be able to import centos7. I'll do that first. | 16:55 |
| wally__ | hi sdake, when I do the kolla delploy, in the global.yaml file , I enable enable_murano: "yes", but when the murano pannel, not showing on the horizon dashboard | 16:55 |
| sdake | wally__ - we dont have plugins directly implemented for services at this time | 16:55 |
| sdake | wally__ but newton will have the ability to do whatever type of plugin you desire ;) | 16:56 |
| wally__ | ok i see, so the murano gui not working at this time, right | 16:56 |
| *** ssurana has joined #openstack-kolla | 16:56 | |
| sdake | wally__ - yup i know not ideal for stable branches | 16:56 |
| sdake | wally__ - we are not superpeople :) takes time to develop this stuff | 16:57 |
| wally__ | ok, another quesiton, how to restart all different kind of service, like nova-api, neutron, l3, dhcp,, serivce, | 16:57 |
| sdake | pbourke may have some murano gui workaround he can provide you | 16:57 |
| sdake | wally__ our api at present doesn't include a restart option | 16:57 |
| *** unicell1 has quit IRC | 16:58 | |
| pbourke | wally__: we dont ship the dashboard by default unfortuantely | 16:58 |
| sdake | you can use docker manually of course t odo that | 16:58 |
| *** fguillot_ has joined #openstack-kolla | 16:58 | |
| pbourke | wally__: I have a patch but not ready yet. Luckily it's easy to do via templates | 16:58 |
| *** fguillot_ has quit IRC | 16:58 | |
| *** fguillot has quit IRC | 16:58 | |
| sdake | wally__ templates are the thing we implemented in newton to make plugins possible for any scenario | 16:58 |
| pbourke | wally__: create a file called 'template-overrides.j2' and put the following in it http://paste.openstack.org/show/563425/ | 16:59 |
| jrich523 | how do i install ansible 1.9.4, i thought it was pip install ansible==1.9.4 ,or yum install ansible-1.9.4 | 16:59 |
| sdake | pbourke wally__ i think is running table | 16:59 |
| wally__ | ok, thanks, i will try | 16:59 |
| sdake | jrich523 pip install ansible==1.9.4 | 16:59 |
| jrich523 | crap... thanks | 16:59 |
| pbourke | then rebuild horizon with --template-overrides template-overrides.j2 | 16:59 |
| pbourke | wally__: if you're using stable the templates aren't there, but you can put the same code right into the dockerfile (minus the jinja parts) | 16:59 |
| wally__ | ok, thanks. I will try, | 17:00 |
| pbourke | wally__: you also need to add a plugin block to kolla-build.conf to clone the repo | 17:00 |
| *** aNupoisc has quit IRC | 17:00 | |
| pbourke | wally__: lot of steps I know :/ PM me if you need more help. but will have to be tomorrow! | 17:00 |
| wally__ | okok i will take to you tomorrow | 17:00 |
| wally__ | so to restart all the different serfvice, I need to restar the docker, right, like nova, nova-api, neutron,,..l3 dhcp...etc | 17:01 |
| egonzalez90 | add {% block horizon_footer %} at the begining of the file | 17:01 |
| sdake | egonzalez90 he is using stable | 17:01 |
| *** athomas has quit IRC | 17:01 | |
| *** ravig has joined #openstack-kolla | 17:01 | |
| egonzalez90 | up sorry | 17:02 |
| sdake | inc0 when you get the cluster deplyed again please let me know | 17:02 |
| sdake | so our plan a is as follows | 17:03 |
| inc0 | settying up networking now | 17:03 |
| sdake | 1) deploy all scenarios on 14.04 2) deploy all scenarios on centos 7 3) hack the osic-prep container to support xenial 4) try to get through xenial testing | 17:03 |
| sdake | 3 and 4 are stretch goals here :) | 17:03 |
| inc0 | fuck | 17:04 |
| inc0 | I messed it up again | 17:04 |
| sdake | i've nuked /var/lib several times during kolla dev | 17:05 |
| sdake | it happens :( | 17:05 |
| inc0 | but I have most of stuff in place now | 17:05 |
| inc0 | so I can nuke it up and make it back up in couple mins now | 17:05 |
| sdake | please dont nuke the deployment host | 17:06 |
| sdake | i haven't backed it up lately | 17:06 |
| britthouser | ^^ this | 17:06 |
| jrich523 | lol | 17:06 |
| sdake | inc0 - need ceph+cinder | 17:07 |
| sdake | as our rallly test cases are selected for that combo | 17:07 |
| wally__ | hi guys, is there a network architecture diagram for the VM in kolla. my VM still have no internet access, and canot ping and cannot ssh into the VM, I just check the l3 log, there are some errors. | 17:10 |
| *** aNupoisc has joined #openstack-kolla | 17:10 | |
| wally__ | I think somthing wrong with my network | 17:10 |
| *** huikang has joined #openstack-kolla | 17:13 | |
| *** pbourke has quit IRC | 17:13 | |
| *** pbourke has joined #openstack-kolla | 17:13 | |
| jrich523 | sounds like it :) | 17:17 |
| *** egonzalez90 has quit IRC | 17:19 | |
| *** fguillot has joined #openstack-kolla | 17:21 | |
| inc0 | well fuck | 17:21 |
| inc0 | deploy ndoe ran out of space | 17:21 |
| *** wally___ has joined #openstack-kolla | 17:21 | |
| *** Satya has quit IRC | 17:22 | |
| *** unicell has joined #openstack-kolla | 17:22 | |
| *** wally__ has quit IRC | 17:22 | |
| *** senk has quit IRC | 17:23 | |
| wally___ | hi guys, in my dnsmasq.log. I always got this (heka)[heka@kolla neutron]$ tail -f dnsmasq.log Aug 25 10:22:12 dnsmasq-dhcp[87]: DHCPDISCOVER(tapf44fe0a4-95) 2a:50:bd:00:71:94 no address available Aug 25 10:22:15 dnsmasq-dhcp[87]: DHCPDISCOVER(tapf44fe0a4-95) 2a:50:bd:00:71:94 no address available | 17:24 |
| wally___ | anyone know what is wrong? | 17:24 |
| wally___ | dhcp now working? | 17:24 |
| jrich523 | its looking for a pool of addresses, and you've got none | 17:24 |
| jrich523 | basically | 17:24 |
| wally___ | u mean when I setup the network ? | 17:25 |
| wally___ | for vm? | 17:25 |
| jrich523 | im not really sure, i imagine thats the case tho | 17:25 |
| wally___ | so because of that, the vm cannot go to internet? is the the reason? | 17:26 |
| jrich523 | yeah | 17:27 |
| jrich523 | my instances isnt setup, so cant really provided any more info | 17:27 |
| jrich523 | you've gotten ahead of me :-/ | 17:27 |
| wally___ | ok, please setup, man | 17:28 |
| jrich523 | im working on it now :) | 17:28 |
| jrich523 | after i submit my damn timecard | 17:28 |
| wally___ | let me know if your instance can go outside or now, and ping and ssh to the vm | 17:29 |
| jrich523 | will do | 17:29 |
| sdake | inc0 | 17:32 |
| sdake | inc0 there is a /backup.tar file | 17:32 |
| sdake | remove it | 17:32 |
| inc0 | I removed all the images besides registry | 17:32 |
| sdake | inc0 there is a hue ass tarfile that i a bkackup | 17:32 |
| inc0 | freed up 50% of space | 17:32 |
| sdake | okthen allgodo :) | 17:32 |
| *** chas has joined #openstack-kolla | 17:33 | |
| jrich523 | feels like friday today | 17:34 |
| wally___ | jrich523,. how is your network setup, do u have a network digram? | 17:34 |
| jrich523 | well its really flat | 17:35 |
| jrich523 | as in, its all in VMWare Workstation with a single subnet for internal/external | 17:35 |
| wally___ | how is your netowrk setut , how many nic | 17:35 |
| jrich523 | so my setup wont be as useful | 17:35 |
| jrich523 | but i'll probably be able to figure out how the IP pool works | 17:35 |
| jrich523 | i use two nics, because you have to | 17:35 |
| wally___ | how many nodes? | 17:35 |
| jrich523 | but each nic is the same subnet | 17:35 |
| jrich523 | there will be 2, a controller node (basically all of kolla) and a compute/storage node (to build VMs on) | 17:36 |
| wally___ | how many interfaces? | 17:36 |
| jrich523 | ? | 17:36 |
| jrich523 | what sort of interfaces? | 17:36 |
| wally___ | how many netowrk interfacce, like eth0 eth1...? | 17:36 |
| jrich523 | 2 | 17:36 |
| jrich523 | because its a must | 17:37 |
| jrich523 | mgmt, and external | 17:37 |
| wally___ | can u send me your ifconfig output | 17:37 |
| jrich523 | nothing useful t here | 17:37 |
| jrich523 | because its flat | 17:37 |
| jrich523 | so for example | 17:37 |
| *** chas has quit IRC | 17:37 | |
| wally___ | ok, pleaes | 17:37 |
| jrich523 | i use my host IPs as 2* | 17:37 |
| inc0 | guys, let's start some flame war | 17:37 |
| jrich523 | so the controller is 192.168.11.20, node1, is 192.168.11.21 | 17:37 |
| inc0 | I just grabbed popcorn and need moral reason for it | 17:37 |
| wally___ | so 192.168.11.20 is your eth0 and this is management interfface? | 17:38 |
| jrich523 | everything i have is 192.168.11.* | 17:38 |
| sdake | inc0 i have nthing to complain about atm :) | 17:38 |
| jrich523 | yes | 17:38 |
| jrich523 | so its 21 and 31 | 17:38 |
| wally___ | what about eth1? no ip assigned? | 17:38 |
| jrich523 | correct (based on our conversation yesterday) | 17:39 |
| jrich523 | i forget who told us, but.. yeah.. only assign the mgmt ip | 17:39 |
| wally___ | ok , ,my is the same setup,,.., | 17:39 |
| wally___ | so you ssh into your server using ssh 192.168.11.20 right | 17:40 |
| jrich523 | yes | 17:40 |
| wally___ | ok, i got it | 17:40 |
| jrich523 | i used bridge mode for the adapters, so my pc is .99, super flat :) | 17:40 |
| wally___ | ok | 17:40 |
| jrich523 | i mostly need to learn HEAT and other automation type stuff, so i could care less about how the network is setup | 17:40 |
| jrich523 | we have a client who wants to use openstack as their main entry point for system managment, but they also use puppet and ansible | 17:41 |
| *** Jeffrey4l__ has quit IRC | 17:41 | |
| jrich523 | and they want me to tie it all together | 17:41 |
| * jrich523 shurgs | 17:41 | |
| wally___ | i got the same setup, but my vm cannot go to internet, let me know if your are ok | 17:41 |
| jrich523 | ok | 17:41 |
| jrich523 | might take an hour or two before im up and running | 17:42 |
| jrich523 | got a couple of actual work things to do first | 17:42 |
| wally___ | ok | 17:42 |
| inc0 | irtermite, btw one node seems fubared | 17:46 |
| inc0 | 729583-comp-s3700-023.cloud7.osic.rackspace.com not that it hits us badly, but take a look at it | 17:46 |
| inc0 | fuck the servers. 16 managed to stand up with ssh | 17:53 |
| inc0 | rest did not | 17:53 |
| inc0 | nvm, fuck ssh not servers, servers are cool | 17:55 |
| sdake | inc0 jefrey4l pointd out 23 has a nocarrier on one of its nics | 17:56 |
| sdake | hence why its not in the inventory file ;) | 17:56 |
| inc0 | yeah I already moved it out of stuff | 17:56 |
| inc0 | just want irtermite to know that it has issues | 17:56 |
| inc0 | as I'm sure he'd be interested;) | 17:56 |
| *** dwalsh has quit IRC | 17:57 | |
| *** dwalsh has joined #openstack-kolla | 18:00 | |
| *** david-lyle has quit IRC | 18:00 | |
| inc0 | ok, sdake wanna see Seans playbook in action? | 18:00 |
| *** senk has joined #openstack-kolla | 18:02 | |
| sdake | inc0 yes | 18:02 |
| sdake | moment let me switch vpns | 18:02 |
| *** Serlex has quit IRC | 18:03 | |
| *** rhallisey has quit IRC | 18:03 | |
| *** sdake has quit IRC | 18:03 | |
| *** huikang has quit IRC | 18:04 | |
| *** david-lyle has joined #openstack-kolla | 18:04 | |
| *** sdake has joined #openstack-kolla | 18:04 | |
| *** huikang has joined #openstack-kolla | 18:04 | |
| *** lamt has joined #openstack-kolla | 18:05 | |
| *** huikang_ has joined #openstack-kolla | 18:06 | |
| *** kbaegis has joined #openstack-kolla | 18:08 | |
| kbaegis | Afternoon | 18:08 |
| *** huikang has quit IRC | 18:09 | |
| *** david-lyle has quit IRC | 18:11 | |
| jrich523 | howdy kbaegis | 18:12 |
| *** david-lyle has joined #openstack-kolla | 18:12 | |
| *** kbyrne has quit IRC | 18:13 | |
| *** david-lyle_ has joined #openstack-kolla | 18:15 | |
| *** david-lyle_ has quit IRC | 18:15 | |
| *** mewald has joined #openstack-kolla | 18:15 | |
| *** kbyrne has joined #openstack-kolla | 18:16 | |
| *** fragatina has quit IRC | 18:17 | |
| *** aswadr_ has quit IRC | 18:21 | |
| *** senk has quit IRC | 18:21 | |
| sdake | inc0 that was a kernel update no? | 18:28 |
| inc0 | #yeah | 18:28 |
| inc0 | cool, now I start to chat with # in irc | 18:28 |
| inc0 | tmux broken me | 18:28 |
| sdake | are we waiting on a reboot | 18:29 |
| inc0 | correct | 18:31 |
| *** rhallisey has joined #openstack-kolla | 18:33 | |
| sdake | inc0 how long does this take | 18:37 |
| *** salv-orl_ has quit IRC | 18:37 | |
| inc0 | no clue, put time on it | 18:37 |
| inc0 | so we'll have benchmark of it | 18:37 |
| sdake | never run it before | 18:37 |
| sdake | ? | 18:37 |
| inc0 | it was merged 3 days ago... | 18:38 |
| inc0 | or so | 18:38 |
| inc0 | not on 100+ nodes | 18:38 |
| sdake | looks jammed up to me | 18:38 |
| inc0 | let's wait, it's including stuff in loop | 18:38 |
| inc0 | that's good learning too btw | 18:39 |
| inc0 | btw rhallisey wirehead_ we have kolla-k8s talk | 18:39 |
| inc0 | so one woot for kolla k8s;) | 18:39 |
| wirehead_ | Just saw. | 18:39 |
| inc0 | woot | 18:39 |
| wirehead_ | woot | 18:39 |
| sdake | inc0 our other talk gte rejected? | 18:40 |
| inc0 | general kolla - yeah | 18:40 |
| rhallisey | wow | 18:41 |
| wirehead_ | My cynical prediction is that Barcelona will be a Kubernetes conference with an OpenStack sideshow. | 18:42 |
| wirehead_ | Because that's what OpenStack Days SV kinda devolved into. :/ | 18:43 |
| *** srwilkers_ has quit IRC | 18:43 | |
| *** lrensing_ has quit IRC | 18:44 | |
| *** wally___ has quit IRC | 18:44 | |
| sdake | inc0 two paths - repave the way you hae in the past - or use the playbook | 18:45 |
| inc0 | nah, I make notes on what to improve on playbook | 18:45 |
| inc0 | it's actually important learining | 18:45 |
| sdake | yes - but it can be done later not now ;) | 18:45 |
| inc0 | yeah this part is suboptimal, we need to fix it | 18:49 |
| *** salv-orlando has joined #openstack-kolla | 18:51 | |
| *** wally__ has joined #openstack-kolla | 18:52 | |
| sdake | why did the playbook implode? | 18:52 |
| inc0 | not sure | 18:52 |
| wally__ | hi guys, I just check my neutron agent-list, Metadata agent | kolla | | xxx | True L3 agent | kolla | nova | xxx | True DHCP agent | kolla | nova | xxx | True | 18:53 |
| wally__ | these service not start, how to start the docker container? | 18:53 |
| *** chas has joined #openstack-kolla | 18:54 | |
| sdake | scroll u plets find source of that problem | 18:55 |
| sdake | since we a re now debugging the host playbook... | 18:55 |
| *** srwilkers_ has joined #openstack-kolla | 18:55 | |
| sdake | inc0 | 18:55 |
| sdake | i think its an undeifned variable buty ou move around too fast for my screen size | 18:55 |
| wally__ | cannot start the docker start neutron_metadata_agent..Error response from daemon: linux mounts: Path /run/netns is mounted on /run but it is not a shared mount. Error: failed to start containers: neutron_metadata_agent | 18:56 |
| wally__ | any idea? | 18:56 |
| sdake | wally__ you hve to read the quickstart dude ;) | 18:56 |
| *** lrensing_ has joined #openstack-kolla | 18:57 | |
| sdake | this playbook isn't idempotent | 18:57 |
| inc0 | it is, I just messed it up | 18:57 |
| sdake | kolla_ssh_key | 18:58 |
| sdake | just disable the ssh key instlalation | 18:58 |
| sdake | kolla_ssh-key and whatnot go in passwords.yml | 18:58 |
| wally__ | ok i gotit | 18:58 |
| *** chas has quit IRC | 18:59 | |
| *** dwalsh has quit IRC | 18:59 | |
| inc0 | vim is hard | 19:01 |
| *** fragatina has joined #openstack-kolla | 19:02 | |
| sdake | inc0 did ou time it? | 19:02 |
| inc0 | yeah, but it wont be that relevant now | 19:02 |
| inc0 | I changed it | 19:03 |
| *** ccesario has joined #openstack-kolla | 19:03 | |
| sdake | give us a rough idea | 19:03 |
| inc0 | yeah after I'll upstream these changes | 19:03 |
| inc0 | so it will be close to what we have now | 19:03 |
| sdake | wonder why python-dev and libssl-dev get installed | 19:04 |
| inc0 | ok, we should be ready to deploy | 19:08 |
| sdake | so what went wrong with the playbook there? | 19:08 |
| sdake | ok in meeting atm, can you deploy | 19:09 |
| *** lrensing_ has quit IRC | 19:09 | |
| *** david-lyle has quit IRC | 19:10 | |
| sdake | bare metal config should be under 15 mins i think | 19:10 |
| inc0 | 1. it has loop with it to fill up hostfiles | 19:10 |
| inc0 | and it is O^2 currently | 19:11 |
| inc0 | we need to make it just for controller nodes | 19:11 |
| inc0 | other than that it's pretty much ok | 19:11 |
| sdake | that was't the only problem | 19:11 |
| inc0 | oh and this first task is strange | 19:11 |
| inc0 | well, I messed up dpkg by breaking it mid-work | 19:12 |
| inc0 | so that was partially my bad | 19:12 |
| *** dwalsh has joined #openstack-kolla | 19:15 | |
| *** jheroux has joined #openstack-kolla | 19:17 | |
| sdake | use lei's labeling script dude | 19:17 |
| inc0 | that's not it | 19:18 |
| inc0 | something is fucked up on networking layer | 19:18 |
| inc0 | yay | 19:18 |
| *** zhiwei has joined #openstack-kolla | 19:20 | |
| *** salv-orlando has quit IRC | 19:21 | |
| kbaegis | Yay! | 19:22 |
| jrich523 | YaY! | 19:22 |
| dasm | inc0: maybe networking problems are similar to this? http://lists.openstack.org/pipermail/openstack-dev/2016-August/102211.html | 19:24 |
| inc0 | dasm, no, it's low lever | 19:24 |
| inc0 | bonding kind of stuff | 19:24 |
| dasm | mhm | 19:24 |
| inc0 | britthouser, you there on tmux? | 19:24 |
| *** zhiwei has quit IRC | 19:24 | |
| britthouser | oh..no I closed it out | 19:24 |
| britthouser | lemme login | 19:24 |
| jrich523 | wally__: did you setup a docker registry? | 19:24 |
| wally__ | no | 19:25 |
| britthouser | ok I'm there inc0 | 19:25 |
| jrich523 | you have two nodes tho right? | 19:25 |
| inc0 | sooo...how did we break this britthouser ? | 19:25 |
| *** rhallisey has quit IRC | 19:25 | |
| wally__ | i am useing all ini one, now, just to make sure i have everything right | 19:25 |
| *** rhallisey has joined #openstack-kolla | 19:26 | |
| sdake | bond-slaves none looks suspicious | 19:26 |
| sdake | britthouser inc0 and I are struggling after a repave | 19:26 |
| *** ravig has quit IRC | 19:26 | |
| jrich523 | ahh ok, the all-in-one is a bit different, not easy to add compute nodes.. cuz... its obviously no longer all in one :) | 19:26 |
| britthouser | this is the deploy node? | 19:26 |
| sdake | it has something to do with bond0 showing no carrier | 19:26 |
| sdake | not sure - wasn't driving | 19:26 |
| wally__ | yeah i know, i just want to try first, then I will go to multinode | 19:27 |
| britthouser | modprobe bonding ? | 19:27 |
| inc0 | well damn, I did that! | 19:27 |
| britthouser | =) | 19:28 |
| britthouser | I still can't cat /proc/net/bonding | 19:28 |
| britthouser | which is odd | 19:28 |
| inc0 | it works | 19:29 |
| *** srwilkers_ has quit IRC | 19:29 | |
| britthouser | ok. =) | 19:29 |
| sdake | check ip a again | 19:29 |
| inc0 | redeploying | 19:30 |
| sdake | dont you need to relabel the disks? | 19:30 |
| *** srwilkers_ has joined #openstack-kolla | 19:31 | |
| sdake | britthouser its still busted | 19:33 |
| inc0 | take it for few minutes, gotta take some air;) | 19:34 |
| inc0 | get some air* | 19:34 |
| inc0 | and swear a lot | 19:34 |
| sdake | i dont know anything about ubuntu | 19:35 |
| sdake | i am pretyt sure the slaves are not being assigned tho from that config file | 19:35 |
| wally__ | hi guys, I got some error in the neutron-l3-agent.log , can anyone please have a look for me,http://pastebin.com/nbxPp24t | 19:36 |
| wally__ | i got this error when i create a subnet for demo, and create demo-router, and assign the demo subnet interface to the demo router | 19:37 |
| britthouser | sdake are these problems on teh deploy node, or all the other ndoes? | 19:38 |
| sdake | other nodes i think | 19:38 |
| sdake | i am not realy sure | 19:38 |
| britthouser | Tehre isa $ on the end of that p1p1 interface | 19:38 |
| britthouser | that doesn't look right | 19:38 |
| britthouser | in the right hand tab | 19:39 |
| britthouser | got it | 19:39 |
| sdake | that was me typoing | 19:39 |
| sdake | on the right is the deply node | 19:39 |
| sdake | on the left is the node not working | 19:39 |
| britthouser | looks right. lemme drive a secon | 19:39 |
| britthouser | can I reboot it/ | 19:42 |
| sdake | free free | 19:42 |
| sdake | feel free | 19:42 |
| sdake | pokey reboot times | 19:44 |
| britthouser | is it kickstarting again? | 19:45 |
| sdake | no idea | 19:45 |
| sdake | keep trying to ssh in | 19:45 |
| *** huikang_ has quit IRC | 19:45 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting to implement some performance tuning adjustments, and should return to working order momentarily. | 19:46 | |
| britthouser | usually when you can ping but no ssh, its b/c its kickstarting | 19:46 |
| sdake | is there nay wy to tell for sure? | 19:46 |
| *** huikang has joined #openstack-kolla | 19:46 | |
| britthouser | console | 19:46 |
| britthouser | what was the name of that node? | 19:46 |
| sdake | .23 | 19:46 |
| britthouser | 729517-comp-s3500-023 ? | 19:47 |
| sdake | http://729537-comp-s3500-047.cloud7.osic.rackspace.com/ | 19:47 |
| sdake | without the http part i think | 19:48 |
| *** jheroux has quit IRC | 19:48 | |
| sdake | atleast thtat is what the email says.... | 19:48 |
| sdake | ok we are in | 19:49 |
| sdake | ok so no bonding was loaded on reboot i modprobe bonding bonding0 comes up | 19:50 |
| sdake | but in a down state | 19:50 |
| britthouser | weird....the bonding driver is loaded | 19:51 |
| *** huikang has quit IRC | 19:51 | |
| britthouser | but its not not configuring the bond according tot eh config file | 19:51 |
| *** jheroux has joined #openstack-kolla | 19:51 | |
| *** srwilkers_ has quit IRC | 19:51 | |
| sdake | that would be my impression | 19:51 |
| *** huikang has joined #openstack-kolla | 19:53 | |
| *** dwalsh has quit IRC | 19:54 | |
| *** chas has joined #openstack-kolla | 19:55 | |
| * britthouser scratches my head | 19:59 | |
| *** jheroux has quit IRC | 19:59 | |
| *** chas has quit IRC | 20:00 | |
| britthouser | gotta meeting...bbiab | 20:02 |
| *** sdake has quit IRC | 20:03 | |
| *** jheroux has joined #openstack-kolla | 20:03 | |
| *** sdake has joined #openstack-kolla | 20:04 | |
| *** dwalsh has joined #openstack-kolla | 20:04 | |
| sdake | https://help.ubuntu.com/community/UbuntuBonding | 20:07 |
| britthouser | ahh...good call sdake | 20:09 |
| *** rhallisey has quit IRC | 20:09 | |
| britthouser | need that ifenslave | 20:09 |
| sdake | right | 20:09 |
| sdake | now its doing something else annoying | 20:09 |
| sdake | nice | 20:15 |
| *** lamt has quit IRC | 20:15 | |
| *** Marcellin_ has quit IRC | 20:17 | |
| wally__ | hi anyone know what the issue is http://pastebin.com/nbxPp24t | 20:18 |
| *** mewald has quit IRC | 20:19 | |
| *** lamt has joined #openstack-kolla | 20:21 | |
| *** rhallisey has joined #openstack-kolla | 20:28 | |
| *** sdake has quit IRC | 20:29 | |
| *** jtriley has quit IRC | 20:34 | |
| *** sdake has joined #openstack-kolla | 20:35 | |
| *** JoseMello has joined #openstack-kolla | 20:38 | |
| *** dwalsh has quit IRC | 20:40 | |
| *** aNupoisc has quit IRC | 20:44 | |
| *** salv-orlando has joined #openstack-kolla | 20:46 | |
| *** senk has joined #openstack-kolla | 20:47 | |
| *** aNupoisc has joined #openstack-kolla | 20:49 | |
| *** senk has quit IRC | 21:00 | |
| *** sdake_ has joined #openstack-kolla | 21:05 | |
| *** sdake has quit IRC | 21:08 | |
| *** salv-orl_ has joined #openstack-kolla | 21:17 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Architectural guide doc https://review.openstack.org/360796 | 21:18 |
| *** salv-orlando has quit IRC | 21:19 | |
| *** sdake_ has quit IRC | 21:20 | |
| *** sdake has joined #openstack-kolla | 21:22 | |
| inc0 | sdake, can you take rally from there | 21:23 |
| inc0 | I'm out of juice today | 21:23 |
| inc0 | btw take a look at this awesome doc I submitted | 21:23 |
| inc0 | https://review.openstack.org/360796 | 21:23 |
| sdake | i am not sure where its at at preent | 21:23 |
| sdake | did the deploy work? | 21:23 |
| inc0 | yeah | 21:23 |
| sdake | so should be able to run script and off itgoes/ | 21:24 |
| inc0 | I'm running init runonce now | 21:24 |
| *** david-lyle has joined #openstack-kolla | 21:26 | |
| sdake | ok i'm out for a bit as well - traveling on the road | 21:28 |
| sdake | looks like its ticking along | 21:28 |
| Pavo | awesome doc inc0 | 21:28 |
| Pavo | exactly what is needed | 21:29 |
| inc0 | :) | 21:29 |
| Pavo | clears alot of the networking questioned I had up | 21:29 |
| inc0 | yeah also storage driver for docker seems to make people confused to say the least | 21:30 |
| inc0 | the storage part - we actually ran out of storage on osic cluster | 21:30 |
| irtermite | well, why'd you go and do that, inc0 | 21:31 |
| irtermite | ? | 21:31 |
| irtermite | ;) | 21:31 |
| inc0 | do what? | 21:31 |
| *** david-lyle has quit IRC | 21:31 | |
| sdake | inc0 run out of space | 21:32 |
| sdake | irtermite because someone thought 40g was plenty for kolla.. | 21:32 |
| irtermite | 40g? you have a LOT more than that there | 21:33 |
| sdake | which is fine for the entire os and kolla on any node but a control node ;-) | 21:33 |
| inc0 | as it turns out 130 nodes of openstack does produce rather significant amount of logs | 21:33 |
| inc0 | irtermite, yeah, but we didnt mount it in correct place;) | 21:33 |
| sdake | irtermite / was 40g | 21:33 |
| irtermite | hahahah | 21:33 |
| sdake | irtermite /var/lob/docker was in / | 21:33 |
| irtermite | logrotate | 21:33 |
| sdake | yup we need to look into that for elasticsearch | 21:34 |
| sdake | we already have fs log rotation | 21:34 |
| irtermite | boy, that sure sucks. do you have to start over, or are you going to dump and roll forward? You guys only have until Tuesday left. | 21:34 |
| inc0 | irtermite, issue is elasticsearch and kibana | 21:34 |
| sdake | right - so we reloaded | 21:34 |
| sdake | scenario 2 is running of 12 ;) | 21:34 |
| sdake | but everything is automated | 21:34 |
| inc0 | irtermite, deployment of fresh openstack is 20min, today we repaved it from scratch | 21:34 |
| irtermite | wow | 21:35 |
| inc0 | not that horrible | 21:35 |
| sdake | so assuming someone is around to run the script and do he setup of the scenario, it takes about 20 mins to do that | 21:35 |
| irtermite | nice | 21:35 |
| irtermite | well done guys | 21:35 |
| inc0 | once you get hang of it | 21:35 |
| sdake | still i am concerned about the amount of time available | 21:36 |
| sdake | because scenario run time is 6-8 hrs | 21:36 |
| inc0 | if we'll be nice and community open - we're open, not sure about nice part | 21:36 |
| inc0 | we might ask OSIC for another installment somewhere in future:) | 21:37 |
| inc0 | irtermite, does osic have rules against asking for it twice? | 21:37 |
| inc0 | if we provide good reason to ofc | 21:37 |
| sdake | now it would take much less time that we have figured out how to operate in osic ;-) | 21:37 |
| sdake | now that we | 21:37 |
| irtermite | inc0: nope... but it won't be consecutive, nor is it guaranteed to be approved. | 21:37 |
| sdake | its all good | 21:38 |
| inc0 | yeah bulk of today was dealing with 14.04 | 21:38 |
| sdake | this is a great great gift irtermite - appreciate it alot | 21:38 |
| irtermite | sdake: you can thank Intel and Rackspace. I merely manage the deal. :) | 21:38 |
| sdake | this will be the first public scale testing doucment i've heard of of openstack being published | 21:38 |
| irtermite | for kolla that is, sdake | 21:39 |
| sdake | ya not sure of any others | 21:39 |
| sdake | not saying there isn't | 21:39 |
| sdake | just don't knowof any | 21:39 |
| irtermite | there are plenty of other white papers that are coming out of OSIC access | 21:39 |
| sdake | cool | 21:39 |
| sdake | i dont know everything ;) | 21:40 |
| irtermite | everyone who uses these environments is expected to upstream commit and to contribute a writeup | 21:40 |
| irtermite | that is part of the agreement. nothing is free ;) | 21:40 |
| sdake | we have a review in work that will be going on docs.oo | 21:40 |
| sdake | so i think that is satisified | 21:41 |
| irtermite | I say "expected," but... it really is actually "strongly suggested" as part of the acceptance criteria. | 21:41 |
| sdake | once merged of course | 21:41 |
| sdake | once filled with data ;) | 21:41 |
| irtermite | don' worry... inc0 will be bugged quite often by his co-workers and me for the docs | 21:41 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Architectural guide doc https://review.openstack.org/360796 | 21:42 |
| *** huikang has quit IRC | 21:42 | |
| inc0 | irtermite, couple of learinings have jsut been published in patch above | 21:42 |
| inc0 | feel free to review;) | 21:43 |
| *** huikang has joined #openstack-kolla | 21:43 | |
| irtermite | You know Marketing won't read that inc0 | 21:43 |
| *** jtriley has joined #openstack-kolla | 21:43 | |
| inc0 | irtermite, for marketing we have this https://www.youtube.com/watch?v=RNZMtym5x1c | 21:44 |
| inc0 | caution, slavic accent included | 21:44 |
| irtermite | They are going to want a PDF as well, I'm sure of it. | 21:44 |
| sdake | t-28 minutes is where it climaxes | 21:45 |
| inc0 | .rst is best they can get | 21:45 |
| inc0 | sdake, when deploy is finished | 21:45 |
| sdake | pretty sure rst converts to pdf | 21:45 |
| *** huikang_ has joined #openstack-kolla | 21:45 | |
| *** huikang has quit IRC | 21:45 | |
| irtermite | Yea, this .rst looks like a technical review of work. I am sure they are going to want business case outputs as well along with this when it is done. | 21:46 |
| inc0 | sdake, btw mind reviewing my doc patch? | 21:46 |
| inc0 | irtermite, hey, openstack from naught to running in 20min, that's a business case output right there! | 21:47 |
| sdake | irtermite - not sure the broader community can help with business case outputs | 21:47 |
| irtermite | oh, it does sdake... but, it's more of the content I am talking about. There is one that is about to be posted from one of the last users. When it is, give it a look to give you an idea of what I am talking about. | 21:47 |
| irtermite | It is... so make a pretty graph of it, comparing to other methods, inc0 that is what they will be looking for | 21:48 |
| irtermite | Control, another example, and your example. | 21:48 |
| inc0 | we'll figure it out | 21:48 |
| inc0 | I'll keep leaving next revisions on your desk | 21:48 |
| sdake | irtermite would you mind defining for me "business case output" | 21:48 |
| irtermite | sdake: What was your testing to prove? What did it confirm? Give comparisons to other options. Etc etc. | 21:49 |
| irtermite | Saying it deployed in 20 min needs to be compared to another deployment for baseline and to actually prove something. | 21:50 |
| sdake | not interested in comparing kolla to other tools | 21:50 |
| sdake | our testing is to prove that kolla is fast and works properly at scale as I promised originally 3 years ago when I signed up for the PTL gig | 21:51 |
| irtermite | then what is the use-case here? | 21:51 |
| inc0 | comparing to anytning else will cause a flame war we don't want | 21:51 |
| inc0 | we will just shovel up data | 21:51 |
| irtermite | But "fast" relative to what? I'm preparing you for the feedback that will come. | 21:51 |
| openstackgerrit | Tin Lam proposed openstack/kolla: Add ansible role for vmtp container https://review.openstack.org/358305 | 21:52 |
| inc0 | let people compare themself | 21:52 |
| sdake | fast compared to manual install | 21:52 |
| sdake | let people judge that baseline on their own | 21:52 |
| sdake | never mention your competition in your marketing ;-) | 21:53 |
| sdake | i hear mirantis getting shot at osic gear with fuel | 21:54 |
| sdake | they can provide a comparison if they like -or users of the tools can | 21:54 |
| *** chas has joined #openstack-kolla | 21:56 | |
| *** shardy has quit IRC | 21:57 | |
| *** jtriley has quit IRC | 21:59 | |
| *** chas has quit IRC | 22:01 | |
| irtermite | sdake OSIC Project is about community, not competition. Baselines are indeed useful and can be positioned to not be viewed as slander. If the compared group feels they are being stomped on, that is another matter. | 22:02 |
| sdake | perhaps a future osic study by a group of deployment tools could be a baseline on deployment times from nothing to running | 22:03 |
| aNupoisc | Hi all, my deploy with ceph is failing at fetching ceph keyrings task and when i run docker exec ceph_mon fetch_ceph_keys.py on terminal i see it return "failed":"false" in the json. Should it have "changed" in the json | 22:03 |
| aNupoisc | that gets returned? | 22:03 |
| sdake | our philosophy specificlaly states our objective: | 22:05 |
| sdake | irtermite : Kolla has an objective to replace the inflexible, painful, resource-intensive deployment process of OpenStack with a flexible, painless, inexpensive deployment process. Often to deploy OpenStack at the 100+ node scale small businesses may require means building a team of OpenStack professionals to maintain and manage the OpenStack deployment. Finding people experienced in OpenStack deployment is very difficult and expensive, resulting in | 22:05 |
| sdake | a big barrier for OpenStack adoption. Kolla seeks to remedy this set of problems by simplifying the deployment process but enabling flexible deployment models. | 22:05 |
| *** michauds has quit IRC | 22:05 | |
| irtermite | basically, what I am saying is... whether you are comparing to another tool or not, the proposal for the kolla testing on OSIC was to test time of deployment and scaling beyond what was previously available. Even if you had metrics that showed how quickly kolla deployed before any work that was done here, or how it performed before throwing a larger node count at it; that would be good for your baseline and t | 22:05 |
| irtermite | est case results. | 22:05 |
| aNupoisc | the error I am getting is this http://pastebin.com/rXhP8gAf. When I checked distribute_keyrings.yml I see it is failing on docker exec | 22:06 |
| sdake | ya i can compare to my 3 node cluster I use typically :) | 22:06 |
| *** fguillot has quit IRC | 22:10 | |
| sdake | inc0 27 rally tasks already run | 22:13 |
| sdake | out of about 400 | 22:13 |
| *** lamt has quit IRC | 22:16 | |
| aNupoisc | any idea about the error http://pastebin.com/rXhP8gAf | 22:17 |
| kbaegis | inc0: lol yeah, that'll be a lot of logs. :) how many gigs you generate? | 22:22 |
| *** vhosakot has quit IRC | 22:23 | |
| inc0 | kbaegis, after a day around 30+gig | 22:23 |
| kbaegis | Sounds about right. I had 3/day with a 5 node deployment, so makes sense. | 22:24 |
| *** sdake has quit IRC | 22:24 | |
| kbaegis | I was also hammering it with requests though | 22:24 |
| inc0 | so are we | 22:25 |
| inc0 | stress testing 130node cloud | 22:25 |
| kbaegis | 30 gb of logs | 22:25 |
| kbaegis | Wow | 22:25 |
| *** jheroux has quit IRC | 22:26 | |
| kbaegis | Did you grep for any shakespearean clauses? | 22:26 |
| inc0 | shakespearean? Like "you will all die in horrible way" ? | 22:26 |
| kbaegis | You might find some quotes from the tempest in there | 22:26 |
| kbaegis | Like in enough monkeys, infinite time kind of way | 22:27 |
| inc0 | ahh, this kind, no | 22:28 |
| inc0 | I don't believe this theory | 22:28 |
| inc0 | existance of internet proven it wrong | 22:28 |
| kbaegis | lol Yeah, but we've only had 40 years or so | 22:28 |
| kbaegis | Think of all the great things said on twitter and youtube comments. ;) | 22:29 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Deployment, Readiness, Safe Shutdown, & Scaling for glance https://review.openstack.org/354895 | 22:29 |
| inc0 | but trends looks like it goes more towards sexist and racist flame wars than poetic | 22:29 |
| *** ntpttr has quit IRC | 22:31 | |
| kbaegis | iambi pent-up-meter? | 22:31 |
| kbaegis | Okay, that was a stretch :) | 22:32 |
| inc0 | I do not have slighest idea what you're talking about | 22:33 |
| kbaegis | Quipping iambic pentameter. Ignore me. :) | 22:33 |
| *** salv-orl_ has quit IRC | 22:34 | |
| kbaegis | Is the testing going well? Any unforeseen reason not to use kolla at-scale? | 22:35 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Deployment, Readiness, Safe Shutdown, & Scaling for glance https://review.openstack.org/354895 | 22:36 |
| *** ntpttr has joined #openstack-kolla | 22:36 | |
| *** sdake has joined #openstack-kolla | 22:37 | |
| sdake | thats 10 terabytes a year inc0 - we need to work on gc ;) | 22:39 |
| kbaegis | sdake logrotate? | 22:41 |
| sdake | kbaegis nah its elasticsearch that is storing the logs | 22:41 |
| inc0 | rather something for elastic | 22:41 |
| sdake | aNupoisc thats easy enough to fix | 22:43 |
| sdake | aNupoisc make your authorized_keys file match your public key in ssh | 22:44 |
| kbaegis | Hey, is there a convenient way to deploy on a different ssh port? I know ansible supports it | 22:44 |
| sdake | kbaegis dont know | 22:45 |
| kbaegis | <— Making things difficult for himself :) | 22:45 |
| *** Guest1506 is now known as jamesdenton | 22:45 | |
| kbaegis | I found that changing from 22, 99% of your spam brute-forcing at the edge disappears | 22:45 |
| *** Pavo has quit IRC | 22:46 | |
| sdake | its the 1% i'd be worried about in that case - as they had to run a port scan to determine your ssh port to brute force | 22:47 |
| kbaegis | sdake Yeah, that's true. Portknockers help there | 22:48 |
| kbaegis | Or ids | 22:48 |
| *** daneyon has joined #openstack-kolla | 22:49 | |
| kbaegis | I just disable password logins. Unless there's a 0-day against openssl, I'm probably fine. If they want to use one of those, well I have tcpdump. :) | 22:49 |
| *** Pavo has joined #openstack-kolla | 22:50 | |
| aNupoisc | sdake: the private key that i am using matches with the public key in authorized_keys | 22:50 |
| sdake | authorized_keys = public key contents? | 22:51 |
| sdake | and mode on .ssh is 700 | 22:51 |
| sdake | and mdoe on all files in .ssh dir is 600? | 22:51 |
| *** daneyon has quit IRC | 22:53 | |
| sdake | aNupoisc you will probably need to run that as sudo for the moment | 22:54 |
| sdake | aNupoisc and make sure your authorized_keys in ~root/.ssh/authorized_keys = public key of private key your using | 22:54 |
| *** rhallisey has quit IRC | 22:57 | |
| *** huikang_ has quit IRC | 23:00 | |
| aNupoisc | sdake: yes the modes are correct but let me check the modes and all under root | 23:01 |
| *** Pavo has quit IRC | 23:08 | |
| *** Pavo has joined #openstack-kolla | 23:08 | |
| *** JoseMello has quit IRC | 23:20 | |
| *** wally__ has quit IRC | 23:20 | |
| aNupoisc | sdake: so the authorized_keys is matching public key of private key i am using but what i noticed is that my authorized_keys is owned by different user than root | 23:30 |
| aNupoisc | sdake: will that cause a problem | 23:30 |
| *** wally__ has joined #openstack-kolla | 23:30 | |
| wally__ | hi guys, I am just wondering it use ovs-bridge in the neutron config , right? | 23:32 |
| sdake | aNupoisc yes that will not work if sshing in via root | 23:33 |
| sdake | wally__ yes ovs or liuxbridge is selectable | 23:33 |
| wally__ | bridge_mappings = physnet1:br-ex | 23:33 |
| wally__ | how to select linuxbridge when do the deploy | 23:33 |
| wally__ | by default it use ovs, right | 23:33 |
| *** inc0 has quit IRC | 23:34 | |
| aNupoisc | _wally: if you are using devstack then in local.conf you have to specift Q_type=linuxbridge | 23:34 |
| wally__ | i am deploying all in one | 23:34 |
| wally__ | in the global.yaml, can I set to linux bridge? | 23:35 |
| wally__ | if I use ovs to deploy then, my server need to create ovs bridge "br-ex" before doing the deploy, right ? | 23:37 |
| aNupoisc | wally__: http://docs.openstack.org/developer/devstack/guides/neutron.html#using-linux-bridge-instead-of-open-vswitch | 23:38 |
| aNupoisc | here is the pointer | 23:39 |
| aNupoisc | wally__: i am not sure what option should be used when using globals.yml | 23:40 |
| wally__ | thx i got it, but I dont use devstack, then how to deploy it witll linux bridged, with kollo-ansible deploy | 23:40 |
| aNupoisc | sdake: it seems some different problem because even I changed the ownership still it is giving the same error. Is this correct output for docker exec ceph_mon fetch_ceph_keys.py correct? http://pastebin.com/WrRxu7vM | 23:42 |
| jrich523 | ok.. using the quickstart, multinode... prechecks were happy, went to deploy and i got this | 23:43 |
| jrich523 | The requested image does not exist: 192.168.11.20:4000/kolla/centos-binary-heka:2.0.2 | 23:43 |
| wally__ | well, I can use ovs , so I need to create ovs br-ex, is that correct? | 23:44 |
| jrich523 | shouldnt it auto populate the registry? | 23:44 |
| aNupoisc | jrich523: I believe you have to run docker that populates registry | 23:46 |
| aNupoisc | jrich523: I am not 100% sure I am also playing with kolla | 23:47 |
| *** kbaegis has quit IRC | 23:47 | |
| wally__ | hi jrich523, how is your deployment | 23:48 |
| sdake | jrich523 is your registry (192.168.11.20) accessible? | 23:51 |
| jrich523 | great question | 23:51 |
| jrich523 | i wasnt really able to find a way to test that | 23:51 |
| *** david-lyle has joined #openstack-kolla | 23:52 | |
| sdake | run docker ps -ef | grep docker on the deploy target | 23:52 |
| sdake | and paste output | 23:52 |
| jrich523 | hmm so its telling me it doesnt know what e is | 23:53 |
| sdake | jrich523 did you build images? | 23:53 |
| jrich523 | docker ps works fine | 23:53 |
| sdake | sorry ps -ef | grep docker | 23:53 |
| jrich523 | k | 23:54 |
| jrich523 | also, as far as the build, i did the pip install of kolla, based on the quick start, didnt seem like i had to build it? | 23:54 |
| sdake | you hae to build images if you want to use your own registry | 23:54 |
| jrich523 | ps output: http://paste.openstack.org/show/563697/ | 23:54 |
| *** zhurong has joined #openstack-kolla | 23:54 | |
| sdake | we have nothing at present that takes the docker hub and replicates it to your local docker registry | 23:55 |
| sdake | dockerd needs the --insecure-registry flag as well | 23:55 |
| jrich523 | ok so that was something i asked the other day | 23:55 |
| jrich523 | thats my node01, but ctrl01 has the docker settings for the registry (hosting it) | 23:55 |
| sdake | yes the deploy target should have --insecure-registry flag | 23:56 |
| jrich523 | so basically every node needs that done manually | 23:56 |
| sdake | and you need to build images (which will psuh them to hte registry) | 23:56 |
| jrich523 | weird that it says it looked there tho? | 23:56 |
| jrich523 | wait nvm | 23:56 |
| jrich523 | ok | 23:56 |
| sdake | jrich523 your globals.yml has that address in teh egistry location | 23:57 |
| jrich523 | so for the build, just kolla build? | 23:57 |
| jrich523 | it does | 23:57 |
| sdake | if you just want to try multinode without a registry | 23:57 |
| sdake | just comment out the registry option | 23:57 |
| sdake | and it will pull from docker hub | 23:57 |
| jrich523 | no user info tho, that was a tad murky to me, didnt see any specific info on setting security so i assume its just open based on the directions? | 23:57 |
| *** chas has joined #openstack-kolla | 23:57 | |
| jrich523 | well i did all this work to get the registry setup, i might as well use it now :) | 23:57 |
| sdake | to secure docker registry - you have to use rls | 23:57 |
| sdake | ok - to use the registry | 23:57 |
| jrich523 | well i dont want to, just making sure i dont need to add any creds in globals | 23:58 |
| sdake | kolla-build --type source --base ubuntu | 23:58 |
| sdake | or if on centos | 23:58 |
| sdake | kolla-build --type source --base ubuntu | 23:58 |
| sdake | you need more options too | 23:58 |
| sdake | --registry (the ip of your registry):4000 | 23:58 |
| wally__ | hi sdake, so I need to create ovs bridge br-ex before doing the deployment? | 23:58 |
| sdake | and --push | 23:58 |
| sdake | wally__ dont think so - pretty sure kolla does that for you | 23:58 |
| jrich523 | kolla-build --registry registry_ip_address:registry_ip_port --push | 23:59 |
| jrich523 | based on the dev build in quickstart ^ | 23:59 |
| sdake | jrich don't forget the build types | 23:59 |
| wally__ | but after the dopoymnet, I check the ifconfig on my sever, i do not see the bridge | 23:59 |
| jrich523 | so put it all togther | 23:59 |
| jrich523 | yeah | 23:59 |
| sdake | that will build centos binary | 23:59 |
| sdake | wally__ not sure - ask sbezverk_ | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!