wally__ | hi sbeverk, there | 00:00 |
---|---|---|
wally__ | how can I just ping someone here | 00:00 |
sdake | i am off to get dinner | 00:00 |
sdake | sbezverk_ is probaby asleep by noow - on eas tcoast | 00:00 |
sdake | bbiaf | 00:00 |
jrich523 | enjoy sdake | 00:00 |
wally__ | ok, | 00:00 |
wally__ | hi jrich523, there | 00:01 |
jrich523 | that pings, but its based on my client | 00:01 |
wally__ | did u create a ovs bridge when u do the deploy? | 00:01 |
jrich523 | nah | 00:01 |
jrich523 | im still struggling with other parts | 00:01 |
jrich523 | mostly the docker/ansible multinode part | 00:01 |
jrich523 | but, im close | 00:01 |
jrich523 | real close | 00:01 |
wally__ | did u do the kolla-ansible deploy? | 00:01 |
jrich523 | if this populates my registry correctly, then i'll be able to deploy | 00:01 |
*** chas has quit IRC | 00:02 | |
jrich523 | not yet | 00:02 |
wally__ | ok i c | 00:02 |
jrich523 | just finished building the docker registry | 00:02 |
jrich523 | now im building the images and pushing them in to the registry | 00:02 |
jrich523 | then i'll do the deploy | 00:02 |
aNupoisc | jrich523: you need to run docker, build images and then run deploy | 00:03 |
jrich523 | yeah docker is setup no the controller, its compiling now and populating registry | 00:04 |
*** zhurong has quit IRC | 00:04 | |
wally__ | anyone know do i need to create ovs bridge be-ex when do the deploy? | 00:04 |
jrich523 | im configuring the registry on the next node now | 00:04 |
jrich523 | ok, node01 is configured for registry | 00:06 |
jrich523 | just waiting on the image creation | 00:06 |
aNupoisc | wally__ what are you trying to deploy? Openstack right? | 00:06 |
aNupoisc | wally__ or is it ceph | 00:06 |
aNupoisc | or something | 00:06 |
jrich523 | hey he has a all in one kolla setup | 00:06 |
wally__ | yeah, openstack | 00:06 |
wally__ | use kolla, AIO | 00:07 |
aNupoisc | wally__ yeah then you don't need create ovs bridge | 00:07 |
wally__ | I know it use ovs, but i check the openvswithc.config file, it will create a bridge "br-ex" | 00:08 |
wally__ | right | 00:08 |
wally__ | bridge_mappings = phynset1-ex | 00:08 |
wally__ | bridge_mappings = phynset1: br-ex | 00:08 |
aNupoisc | wally__ this was my globals http://pastebin.com/BM1W6LC5 | 00:08 |
wally__ | but i do not see the br-ex is create in my server when i do ifconfig | 00:09 |
aNupoisc | wally__ also there is a option # Valid options neutron_plugin_agent: "openvswitch" | 00:09 |
aNupoisc | where you can specify linuxbridge if you want | 00:09 |
aNupoisc | wally__ ahh | 00:09 |
wally__ | ok i c | 00:10 |
aNupoisc | wally__ i never faced that. Interesting | 00:10 |
wally__ | so u have br-ex create? | 00:10 |
wally__ | can u output your ifconfig for me please | 00:10 |
aNupoisc | wally__ i am actually right now trying to deploy ceph so don't have setup for openstack | 00:10 |
*** bmace has quit IRC | 00:11 | |
aNupoisc | wally__ but yeah when i tried couple of weeks back that time the globals. yml above worked | 00:11 |
*** bmace has joined #openstack-kolla | 00:11 | |
wally__ | on your globla,ayml file | 00:11 |
wally__ | neutron_external_interface: "p787p1" | 00:11 |
wally__ | the interface is a bridge? | 00:11 |
aNupoisc | that's my bridge | 00:11 |
wally__ | or a phycial net working interface? | 00:12 |
Pavo | wally__ kolla should build the br-ex interface based off the interface you use as neutron_external_interface setting in globals | 00:12 |
Pavo | and neutron_external_interface should be named as the what the host sees the physical interface | 00:12 |
aNupoisc | wally__ its a physical one | 00:13 |
aNupoisc | wally__ that i had | 00:13 |
wally__ | oh u mean, kolla will create a br-ex and add the br to the port:neutron_external_interface? | 00:13 |
Pavo | eth, en, etc.... | 00:13 |
Pavo | no what ever interface you set in your globals.yml file kolla will use to to make the br-ex interface off of | 00:13 |
wally__ | like #ovs-vsctl add-port br-ex neutron_external_interface? | 00:14 |
Pavo | no, what interface did you set in globals.yml as your neutron_external_interface? | 00:14 |
wally__ | eth1 | 00:14 |
wally__ | then what is the bridge, | 00:15 |
Pavo | then on the network node you should be able to do a ifconfig or ip addr and see br-ex which is bridged to eth1 | 00:15 |
wally__ | i use allinone, do i need to long to the neutron docker container? | 00:16 |
Pavo | physical to logical it should go eth1 -> br-ex -> ovs -> br-int | 00:16 |
Pavo | so for allinone all interfaces inside globals.yml should be the same interface | 00:17 |
wally__ | so eth1 is my pyhsical network interface, and i should br-ex showing when i check ifconfig, right | 00:18 |
Pavo | yes | 00:18 |
Pavo | if there isn't a br-ex or ovs-bridge then something went wrong | 00:18 |
wally__ | i have 4 nics, eth0, eth1. eth2, eth3, i use eth0 for management. so I can use eth1 or eth2,, eth3 for the bridge? | 00:19 |
wally__ | correct? | 00:19 |
Pavo | not sure for allinone deployment | 00:19 |
Pavo | I think allinone deployment uses the same interface for all | 00:19 |
Pavo | ie.... as the title says allinone | 00:20 |
wally__ | u mean, use eth0 as well | 00:20 |
Pavo | yes | 00:20 |
wally__ | so but if this is the case, then during the deploying, it will disconnect when it create bridge, | 00:21 |
*** david-lyle has quit IRC | 00:21 | |
Pavo | for a mill sec yeah, but when its creating this section all the cmds its needs is already there and should reconnect afrer | 00:22 |
Pavo | after | 00:22 |
Pavo | I could be completely wrong here but thats how I see it | 00:24 |
Pavo | I haven't rried allinone deployment yet | 00:24 |
Pavo | tried* | 00:24 |
jrich523 | ok, starting the deploy! | 00:25 |
jrich523 | ugh | 00:25 |
jrich523 | rewind! | 00:26 |
*** fguillot has joined #openstack-kolla | 00:37 | |
openstackgerrit | Li Yingjun proposed openstack/kolla: Add option ceilometer_database_type for ceilometer https://review.openstack.org/345881 | 00:40 |
Pavo | wally__ maybe this article will help you | 00:45 |
Pavo | http://mntdevops.com/2016/08/08/iaas-2/ | 00:45 |
*** salv-orlando has joined #openstack-kolla | 00:46 | |
openstackgerrit | Li Yingjun proposed openstack/kolla: Fix toolbox permission issue when enabling ceph https://review.openstack.org/358973 | 00:46 |
*** salv-orlando has quit IRC | 00:51 | |
*** unicell has quit IRC | 00:58 | |
*** unicell has joined #openstack-kolla | 01:00 | |
*** unicell1 has joined #openstack-kolla | 01:01 | |
*** unicell has quit IRC | 01:01 | |
*** zhubingbing has joined #openstack-kolla | 01:02 | |
*** Jeffrey4l__ has joined #openstack-kolla | 01:04 | |
*** dave-mccowan has quit IRC | 01:06 | |
*** ssurana has quit IRC | 01:16 | |
*** zhurong has joined #openstack-kolla | 01:17 | |
*** huikang has joined #openstack-kolla | 01:19 | |
*** aNupoisc has quit IRC | 01:26 | |
*** dave-mccowan has joined #openstack-kolla | 01:29 | |
*** daneyon has joined #openstack-kolla | 01:31 | |
*** zhiwei has joined #openstack-kolla | 01:33 | |
*** daneyon has quit IRC | 01:36 | |
*** unicell1 has quit IRC | 01:52 | |
*** kbaegis has joined #openstack-kolla | 01:53 | |
*** salv-orlando has joined #openstack-kolla | 01:53 | |
*** wally__ has quit IRC | 01:55 | |
*** salv-orlando has quit IRC | 02:04 | |
*** fguillot has quit IRC | 02:06 | |
*** sdake_ has joined #openstack-kolla | 02:08 | |
*** fguillot has joined #openstack-kolla | 02:09 | |
zhubingbing | hello | 02:11 |
*** sdake has quit IRC | 02:12 | |
*** chas has joined #openstack-kolla | 02:14 | |
kbaegis | zhubingbing: Hello | 02:14 |
*** zhubingbing has quit IRC | 02:16 | |
*** zhubingbing has joined #openstack-kolla | 02:16 | |
*** sdake_ has quit IRC | 02:17 | |
*** chas has quit IRC | 02:18 | |
*** sdake has joined #openstack-kolla | 02:19 | |
zhubingbing | sdakeļ¼ morning | 02:19 |
*** sdake has quit IRC | 02:23 | |
*** sdake has joined #openstack-kolla | 02:29 | |
*** lamt has joined #openstack-kolla | 02:32 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Doc for multi node development https://review.openstack.org/360853 | 02:34 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: repair gnocchi dockerfile https://review.openstack.org/348388 | 02:39 |
sdake | Jeffrey4l__ did you do any work on the oosic cluster? | 02:42 |
Jeffrey4l__ | sdake, no. | 02:42 |
sdake | Jeffrey4l__ - ok we are on scenario #2 atm | 02:42 |
sdake | it is almost finished | 02:42 |
Jeffrey4l__ | cool. | 02:43 |
sdake | may need hep setting up next scenario | 02:43 |
Jeffrey4l__ | OK. | 02:43 |
Jeffrey4l__ | i can help today. | 02:43 |
sdake | i dont know what is required to make ceph run with caching | 02:43 |
sdake | which is scneario 3 | 02:43 |
sdake | i have been thinking we may just cut this scenario out | 02:43 |
sdake | and go straight to linuxbridge | 02:44 |
Jeffrey4l__ | I can try ( but never tried) | 02:44 |
Jeffrey4l__ | we all all ssd, the ceph cache should not improve the performance very much. | 02:44 |
Jeffrey4l__ | The disks we use are all ssd.. | 02:45 |
sdake | yup | 02:45 |
sdake | we are also running different scenarios now | 02:45 |
sdake | 128x96, 128x48, 128x24 | 02:45 |
sdake | and tempest | 02:46 |
sdake | there is one script that runs these | 02:46 |
sdake | i wrote a script to get the data out but it doesnt seem to work with deployments | 02:46 |
sdake | so i will ahve to sort that out aftre this rally finishes | 02:46 |
Jeffrey4l__ | we are running tempest now? | 02:47 |
sdake | rally | 02:47 |
sdake | tempest is part of the script to run all 4 cases | 02:47 |
sdake | look at the script | 02:47 |
sdake | so you understand whatit does | 02:47 |
sdake | i think we need a rally deployment use operation in the reporting | 02:48 |
sdake | it takes about 3 hours to run rally now | 02:48 |
sdake | maybe 4 | 02:48 |
sdake | all 4 scenarios | 02:48 |
sdake | all 4 cases we test | 02:48 |
*** britthouser has quit IRC | 02:48 | |
*** britthouser has joined #openstack-kolla | 02:49 | |
Jeffrey4l__ | lost the context. | 02:49 |
Jeffrey4l__ | :( | 02:49 |
sdake | need me to do something on my side? | 02:50 |
Jeffrey4l__ | not clear what should do next. | 02:50 |
sdake | look at scripts in ~/rally.git | 02:50 |
sdake | attach to tmux | 02:50 |
*** ntpttr has quit IRC | 02:53 | |
*** fguillot has quit IRC | 02:53 | |
*** brad[] has quit IRC | 02:55 | |
*** ntpttr has joined #openstack-kolla | 03:00 | |
*** salv-orlando has joined #openstack-kolla | 03:03 | |
openstackgerrit | zhubingbing proposed openstack/kolla: Add gnocchi ansible role https://review.openstack.org/349351 | 03:05 |
*** salv-orlando has quit IRC | 03:06 | |
sdake | Jeffrey4l__ just lot access to the clussteer for some reaosn | 03:11 |
Jeffrey4l__ | sdake, do not get the point.. | 03:12 |
*** sdake has quit IRC | 03:12 | |
*** sdake has joined #openstack-kolla | 03:13 | |
Jeffrey4l__ | sdake, do not get the point. :( | 03:13 |
Jeffrey4l__ | OK lot-> lost. | 03:13 |
sdake | point of which | 03:13 |
*** brad[] has joined #openstack-kolla | 03:13 | |
sdake | oh i'm back in | 03:14 |
sdake | nm | 03:14 |
*** inc0 has joined #openstack-kolla | 03:19 | |
*** daneyon has joined #openstack-kolla | 03:20 | |
openstackgerrit | Tin Lam proposed openstack/kolla: Add ansible role for vmtp container https://review.openstack.org/358305 | 03:23 |
*** daneyon has quit IRC | 03:24 | |
kbaegis | Anyone played around with novnc baseurl? | 03:32 |
kbaegis | I'm actually hiding horizon behind an apache reverse proxy. UI works perfectly, but vnc is still broken | 03:32 |
kbaegis | I'm noticing that clients are still redirected to the old url | 03:34 |
*** Jeffrey4l__ has left #openstack-kolla | 03:34 | |
*** Jeffrey4l__ has joined #openstack-kolla | 03:34 | |
Jeffrey4l__ | kbaegis, change it to the url u want. | 03:34 |
kbaegis | I did, restarted the container for novnc | 03:35 |
kbaegis | Do I need to do that in nova-api instead? | 03:35 |
kbaegis | Cause clients are still getting redirected to the old url | 03:35 |
Jeffrey4l__ | kbaegis, how did u changed it? | 03:35 |
Jeffrey4l__ | kbaegis, you should change the nova_compute | 03:36 |
kbaegis | Jeffrey4l__: Thanks. I have copy_always, and was just editing /etc/kolla/nova-novncproxy/nova.conf | 03:36 |
kbaegis | restart the container | 03:36 |
mdnadeem | Jeffrey4l__, sdake , coolsvap_ , can you please review https://review.openstack.org/#/c/350629/ | 03:37 |
Jeffrey4l__ | kbaegis, check this http://docs.openstack.org/developer/kolla/advanced-configuration.html#openstack-service-configuration-in-kolla | 03:37 |
Jeffrey4l__ | mdnadeem, ok | 03:38 |
*** gfidente has quit IRC | 03:40 | |
*** duonghq has joined #openstack-kolla | 03:42 | |
kbaegis | So that's the correct way to do it, but mine works too, no :) | 03:42 |
kbaegis | It's ultimately restarting the container and copying it from a shared directory | 03:42 |
kbaegis | nova compute it is :) | 03:43 |
kbaegis | Okay, did that in nova-compute | 03:45 |
kbaegis | Horizon is still redirecting to the wrong host | 03:45 |
*** zhubingbing has quit IRC | 03:53 | |
kbaegis | Jeffrey4l__: So on that link- is it based on fqdn or hostname? | 03:54 |
kbaegis | 'myhost' | 03:55 |
*** sdake has quit IRC | 03:56 | |
Jeffrey4l__ | use fqdn, or use the custom configuration file. | 03:59 |
kbaegis | that's what I was asking. Tied to the path :) | 03:59 |
Jeffrey4l__ | change nova_base url in the /etc/kolla/config/nova.conf and run kolla-ansible reconfigure | 04:00 |
*** huikang has quit IRC | 04:06 | |
*** salv-orlando has joined #openstack-kolla | 04:07 | |
*** dave-mccowan has quit IRC | 04:09 | |
kbaegis | Jeffrey4l__: Thanks. Just did that | 04:10 |
*** mark-casey has quit IRC | 04:10 | |
*** senk has joined #openstack-kolla | 04:14 | |
kbaegis | how about cpu_allocation_ratio? Anyone play with that? | 04:14 |
*** salv-orlando has quit IRC | 04:14 | |
*** chas has joined #openstack-kolla | 04:15 | |
kbaegis | Didn't work. Old url is still being used | 04:17 |
kbaegis | File was '/etc/kolla/config/crucible.lab/nova/nova.conf', aio | 04:19 |
*** chas has quit IRC | 04:20 | |
*** sdake has joined #openstack-kolla | 04:22 | |
kbaegis | Well, copied nova.conf to the root config directory and symlinked the fqdn to the hostname | 04:24 |
kbaegis | retrying | 04:24 |
duonghq | kbaegis: what are you doing? | 04:27 |
kbaegis | duonghq: trying to alter the baseurl for novnc proxy. I'm hiding it behind a reverse httpd proxy | 04:28 |
duonghq | kbaegis: roger | 04:28 |
duonghq | how many node you have for now | 04:29 |
kbaegis | duonghq: aio still | 04:29 |
duonghq | okay | 04:30 |
sdake | Jeffrey4l__ we need the json output | 04:30 |
Jeffrey4l__ | sdake, yep. | 04:30 |
sdake | Jeffrey4l__ so we can parse it and produce rsts with it | 04:30 |
Jeffrey4l__ | just test the html group report. | 04:30 |
sdake | also would like html output | 04:30 |
Jeffrey4l__ | result seem have no such parameter. | 04:31 |
kbaegis | Yay! That worked | 04:33 |
kbaegis | So either the path is not accurately linked to fqdn (maybe just hostname) | 04:33 |
kbaegis | Or it's only reading out of /etc/kolla/config/ | 04:33 |
sdake | Jeffrey4l__ i'm all done, i wantedd to see if switching deployments got us at the other data | 04:33 |
Jeffrey4l__ | sdake, ok | 04:33 |
*** kbaegis has quit IRC | 04:35 | |
sdake | ervice-level agreement | 04:41 |
sdake | CriterionDetailSuccess | 04:41 |
sdake | something_went_wrongUnexpected error: Invalid scenario argument: 'Image with pattern '^cirros.*uec$' not found' | 04:41 |
*** chas has joined #openstack-kolla | 04:46 | |
*** chas has quit IRC | 04:50 | |
sdake | Jeffrey4l__ aftere this finishes i want an hour with oprofile | 04:52 |
sdake | then on to next scenario | 04:52 |
Jeffrey4l__ | sdake, the script seems good now. will check later. need be out. brb | 04:52 |
sdake | sound good? | 04:52 |
Jeffrey4l__ | sdake, good. no idea about the oprofile :( | 04:53 |
Jeffrey4l__ | never used it. | 04:53 |
sdake | i got it | 04:53 |
Jeffrey4l__ | brb | 04:53 |
Jeffrey4l__ | need check the collected report. should OK. but double check is batter :) | 04:54 |
*** v1k0d3n has quit IRC | 04:56 | |
*** duonghq has quit IRC | 04:56 | |
*** unicell has joined #openstack-kolla | 05:01 | |
*** unicell has quit IRC | 05:02 | |
*** unicell has joined #openstack-kolla | 05:03 | |
*** unicell has quit IRC | 05:03 | |
*** unicell has joined #openstack-kolla | 05:04 | |
*** unicell has quit IRC | 05:04 | |
*** inc0 has quit IRC | 05:09 | |
*** unicell has joined #openstack-kolla | 05:10 | |
*** senk has quit IRC | 05:11 | |
*** salv-orlando has joined #openstack-kolla | 05:17 | |
*** unicell1 has joined #openstack-kolla | 05:19 | |
*** unicell has quit IRC | 05:19 | |
*** salv-orlando has quit IRC | 05:20 | |
*** salv-orlando has joined #openstack-kolla | 05:25 | |
*** salv-orlando has joined #openstack-kolla | 05:26 | |
sdake | Jeffrey4l__ to get any good data out of oprofile we will need dbg info files in them | 05:27 |
sdake | Jeffrey4l__ so for hte moment going to just run a quck test | 05:27 |
sdake | and then if we have time i'll build images with dbginfo in them | 05:28 |
sdake | i dont want to break the images we have ;-) | 05:28 |
*** zhubingbing has joined #openstack-kolla | 05:32 | |
*** senk has joined #openstack-kolla | 05:49 | |
*** duonghq has joined #openstack-kolla | 06:05 | |
*** unicell has joined #openstack-kolla | 06:11 | |
*** unicell1 has quit IRC | 06:11 | |
*** chas has joined #openstack-kolla | 06:12 | |
*** fragatin_ has joined #openstack-kolla | 06:12 | |
*** fragatina has quit IRC | 06:15 | |
*** fragatin_ has quit IRC | 06:17 | |
*** shardy has joined #openstack-kolla | 06:23 | |
*** egonzalez90 has joined #openstack-kolla | 06:24 | |
openstackgerrit | Md Nadeem proposed openstack/kolla: Added Ansible playbook for congress deploy https://review.openstack.org/350629 | 06:28 |
*** bjolo has quit IRC | 06:30 | |
*** bjolo has joined #openstack-kolla | 06:31 | |
*** salv-orlando has quit IRC | 06:31 | |
*** caowei has joined #openstack-kolla | 06:33 | |
sdake | Jeffrey4l__ - something is busted on the test cluster - complaining about domian not found in all client calls | 06:33 |
sdake | Jeffrey4l__ inc0 said he fixed this by adding a user domain | 06:34 |
sdake | but we already have a default domain | 06:34 |
sdake | and i read the relevant bugs, our admin-openrc.shlooks ok | 06:34 |
*** fragatina has joined #openstack-kolla | 06:36 | |
*** Serlex has joined #openstack-kolla | 06:39 | |
*** fragatina has quit IRC | 06:41 | |
*** mewald has joined #openstack-kolla | 06:44 | |
sdake | post deploy is broken | 06:45 |
*** salv-orlando has joined #openstack-kolla | 06:45 | |
sdake | instead of ID shoudd be NAME for the domains | 06:45 |
Jeffrey4l__ | sdake, back | 06:47 |
sdake | Jeffrey4l__ i am running an oprofile test atm | 06:47 |
Jeffrey4l__ | sdake, still failed? | 06:47 |
sdake | as soon sa rally wraps up | 06:47 |
sdake | time to move on to scenario 3 | 06:47 |
sdake | can you get that kicked off, getting pretty late here | 06:47 |
sdake | i think this rally job will take about 45 mins or so | 06:47 |
Jeffrey4l__ | cool. is the domain not found solved? | 06:47 |
Jeffrey4l__ | sdake, i think i can fix it. | 06:47 |
sdake | i solved it | 06:48 |
sdake | %s/ID/NAME with domain in the lines | 06:48 |
Jeffrey4l__ | yep | 06:48 |
sdake | i'll get it fixed | 06:48 |
Jeffrey4l__ | or change the `default` domain name to `Default` | 06:49 |
*** aNupoisc has joined #openstack-kolla | 06:49 | |
sdake | Jeffrey4l__ jump in tmux - I want ot show you oprofile | 06:51 |
sdake | this is something you need to know how to use | 06:52 |
openstackgerrit | Mathias proposed openstack/kolla: Added influxdb role https://review.openstack.org/346449 | 06:53 |
*** Mr_Broken has joined #openstack-kolla | 06:55 | |
*** daneyon has joined #openstack-kolla | 06:56 | |
sdake | what is #3 in cpu cycles | 06:59 |
sdake | Jeffrey4l__ ^ | 06:59 |
sdake | thats right, #1 is java | 06:59 |
sdake | 30% of control node consumed by java | 06:59 |
sdake | 25% python | 07:00 |
sdake | 13% by hekad | 07:00 |
Jeffrey4l__ | OK. clearly about his.\ | 07:00 |
Jeffrey4l__ | this | 07:00 |
sdake | there was one above hekad | 07:00 |
Jeffrey4l__ | rabbitmq | 07:01 |
sdake | beam.smp | 07:01 |
sdake | ya rabbitmq | 07:01 |
sdake | pretty useful huh? | 07:01 |
Jeffrey4l__ | yes. | 07:01 |
sdake | tells me we need to eject java from our system if it were possibel :( | 07:01 |
*** daneyon has quit IRC | 07:01 | |
sdake | when you get done with that simple view i'll show you a more comlex one | 07:01 |
sdake | let me know | 07:01 |
sdake | in channel | 07:02 |
Jeffrey4l__ | sdake, ok. go on | 07:02 |
sdake | pretty flat across symbols | 07:04 |
*** unicell has quit IRC | 07:04 | |
sdake | that is what you like to see when optimizing | 07:04 |
Jeffrey4l__ | yep | 07:04 |
sdake | it typically means those symbols are highly optimized already | 07:04 |
sdake | 6687 0.2704 vmlinux-4.4.0-34-generic sudo /vmlinux-4.4.0-34-generic | 07:05 |
sdake | busy users of sudo :) | 07:05 |
Jeffrey4l__ | hmm. Cool | 07:05 |
Jeffrey4l__ | sdake, but few we can do in Kolla, right | 07:07 |
sdake | not a whole lot unless it involves ejecting elasticsearch | 07:08 |
*** zhubingbing has quit IRC | 07:08 | |
Jeffrey4l__ | ok. | 07:08 |
sdake | hekad cpu hog | 07:09 |
sdake | uses the kernel way too much | 07:09 |
Jeffrey4l__ | yes. | 07:09 |
sdake | 7% of the total sample time of the systme is spent processing hekad systemcalls | 07:09 |
Jeffrey4l__ | can we get more info about what kernel call he used? | 07:10 |
sdake | try --callgraph | 07:10 |
sdake | on centos the system call names are printed out | 07:11 |
sdake | but on 14.04 looks like that is no bueno | 07:11 |
sdake | nope it is treating the kernel as one blob | 07:11 |
Jeffrey4l__ | ok | 07:11 |
sdake | annoying | 07:11 |
Jeffrey4l__ | but very useful tools :) | 07:12 |
*** unicell has joined #openstack-kolla | 07:12 | |
sdake | lets go back to the run of rally | 07:12 |
*** salv-orlando has quit IRC | 07:16 | |
mewald | git noob needs help :D https://review.openstack.org/#/c/346450/ How can I solve this "Patch in Merge Conflict" thing? | 07:16 |
Jeffrey4l__ | mewald, make a local rebase origin/master and solve the merge conflict, then `git review` | 07:17 |
*** jrich523 has quit IRC | 07:23 | |
*** jrich523 has joined #openstack-kolla | 07:24 | |
bjolo | morning | 07:24 |
*** zhubingbing has joined #openstack-kolla | 07:27 | |
*** egonzalez90 has quit IRC | 07:38 | |
*** matrohon has joined #openstack-kolla | 07:39 | |
*** zhiwei has quit IRC | 07:44 | |
*** caowei has quit IRC | 07:44 | |
zhubingbing | snake ping | 07:48 |
zhubingbing | snake ping | 07:49 |
zhubingbing | snake ping | 07:49 |
zhubingbing | sdake ping | 07:49 |
sdake | snake here | 07:49 |
sdake | sup | 07:49 |
zhubingbing | hi, | 07:50 |
sdake | mewald - git pull --rebase | 07:50 |
zhubingbing | https://review.openstack.org/#/c/348388/ | 07:50 |
duonghq | snake, where is snake | 07:50 |
zhubingbing | Sdake, you look at this branch can not hurry review merger, because I role gnocchi rely on this branch | 07:51 |
zhubingbing | - -duonqhq sorry, I'm spelling mistakes. | 07:52 |
duonghq | just kiding, don't mind | 07:52 |
zhubingbing | --ļ¼ | 07:52 |
duonghq | zhubingbing: As I understand: you have other ps depend on this ps? | 07:54 |
duonghq | or you just want to make this feature running? | 07:54 |
*** salv-orlando has joined #openstack-kolla | 07:54 | |
zhubingbing | role gnocchi branch before the dockerfile gnocchi branch was carried out with the rebase operation | 07:57 |
*** aNupoisc has quit IRC | 07:58 | |
zhubingbing | Now I submit the role gnocchi branch, which will cause the 2 branch to submit, | 07:58 |
zhubingbing | ping Hui Kong | 07:59 |
zhubingbing | ping Hui Kang | 07:59 |
duonghq | zhubingbing: seem that he don't online right now | 08:00 |
duonghq | and I think you should ping using his irc nick than his name | 08:00 |
zhubingbing | okļ¼ thanks | 08:01 |
zhubingbing | I need to talk to him about the issue of etcd. | 08:01 |
*** sdake has quit IRC | 08:05 | |
*** sdake has joined #openstack-kolla | 08:05 | |
*** berendt has joined #openstack-kolla | 08:18 | |
*** openstackgerrit has quit IRC | 08:18 | |
*** openstackgerrit has joined #openstack-kolla | 08:18 | |
*** zhubingbing has quit IRC | 08:20 | |
*** egonzalez90 has joined #openstack-kolla | 08:21 | |
*** gfidente has joined #openstack-kolla | 08:21 | |
*** gfidente has joined #openstack-kolla | 08:21 | |
*** coolsvap_ has quit IRC | 08:21 | |
*** zhubingbing has joined #openstack-kolla | 08:23 | |
openstackgerrit | Christian Berendt proposed openstack/kolla: Add cloudkitty containers for type source https://review.openstack.org/349295 | 08:26 |
openstackgerrit | zhubingbing proposed openstack/kolla: Add gnocchi ansible role https://review.openstack.org/349351 | 08:26 |
openstackgerrit | Li Yingjun proposed openstack/kolla: Add option ceilometer_database_type for ceilometer https://review.openstack.org/345881 | 08:28 |
*** zhubingbing has quit IRC | 08:34 | |
*** zhubingbing has joined #openstack-kolla | 08:35 | |
openstackgerrit | Li Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha https://review.openstack.org/352180 | 08:36 |
*** zhubingbing has quit IRC | 08:40 | |
duonghq | what happen if a host is in compute group but network group? | 08:41 |
*** daneyon has joined #openstack-kolla | 08:44 | |
openstackgerrit | Andreas Jaeger proposed openstack/kolla-kubernetes: Properly use constraints https://review.openstack.org/360984 | 08:46 |
Jeffrey4l__ | pbourke, ping | 08:47 |
pbourke | Jeffrey4l__: hey | 08:47 |
Jeffrey4l__ | do u have any idea the default gw 172.21.112.1 can not reach on isic pbourke | 08:48 |
*** sdake has quit IRC | 08:48 | |
Jeffrey4l__ | osic | 08:48 |
pbourke | what do you mean it can not reach osic? | 08:49 |
*** daneyon has quit IRC | 08:49 | |
Jeffrey4l__ | pbourke, i can not ping the 172.21.112.1 ip | 08:49 |
Jeffrey4l__ | it should be the default gw. | 08:49 |
Jeffrey4l__ | for p4p1 interface | 08:49 |
Jeffrey4l__ | with vlan 733 | 08:50 |
openstackgerrit | Andreas Jaeger proposed openstack/kolla-kubernetes: Cleanup tox.ini constraints https://review.openstack.org/360984 | 08:52 |
pbourke | Jeffrey4l__: on now | 08:52 |
pbourke | im not sure but can have a look | 08:52 |
pbourke | Jeffrey4l__: whats the latest in the testing | 08:52 |
Jeffrey4l__ | OK. thanks. | 08:52 |
Jeffrey4l__ | pbourke, i need setup a external network now for some rally tests. They need connect the vms through ssh from the deploy node. | 08:54 |
pbourke | Jeffrey4l__: there is a script to do that | 08:57 |
Jeffrey4l__ | pbourke, this init-runonce-osic ? if so, it set up a wrong external network. | 08:58 |
*** athomas has joined #openstack-kolla | 08:59 | |
Jeffrey4l__ | pbourke, found some thing wrong. fixing.. | 08:59 |
pbourke | ok | 09:06 |
*** salv-orl_ has joined #openstack-kolla | 09:17 | |
*** salv-orlando has quit IRC | 09:20 | |
*** dwalsh has joined #openstack-kolla | 09:20 | |
*** zhubingbing has joined #openstack-kolla | 09:36 | |
*** duonghq has left #openstack-kolla | 09:57 | |
*** zhubingbing has quit IRC | 09:59 | |
*** zhurong has quit IRC | 10:01 | |
*** rmart04 has joined #openstack-kolla | 10:09 | |
*** zhubingbing_ has joined #openstack-kolla | 10:10 | |
*** Mr_Broken has quit IRC | 10:24 | |
*** Mr_Broken has joined #openstack-kolla | 10:25 | |
*** kbaegis has joined #openstack-kolla | 10:28 | |
kbaegis | Good morning everyone | 10:28 |
egonzalez90 | morning kbaegis | 10:29 |
kbaegis | egonzalez90: We're up early :) | 10:30 |
*** Mr_Broken has quit IRC | 10:30 | |
egonzalez90 | not really, EMEA time ;) | 10:30 |
kbaegis | Oh, gotcha | 10:31 |
kbaegis | 'round noon there? | 10:31 |
*** daneyon has joined #openstack-kolla | 10:33 | |
egonzalez90 | midday | 10:33 |
*** zhubingbing_ has quit IRC | 10:35 | |
*** zhubingbing has joined #openstack-kolla | 10:36 | |
openstackgerrit | zhubingbing proposed openstack/kolla: repair aodh image dockerfile https://review.openstack.org/350715 | 10:37 |
*** daneyon has quit IRC | 10:38 | |
*** chas_ has joined #openstack-kolla | 10:40 | |
*** zhiwei has joined #openstack-kolla | 10:41 | |
*** chas has quit IRC | 10:42 | |
*** rhallisey has joined #openstack-kolla | 10:43 | |
*** zhiwei has quit IRC | 10:46 | |
*** JoseMello has joined #openstack-kolla | 11:01 | |
openstackgerrit | zhubingbing proposed openstack/kolla: repair aodh image dockerfile https://review.openstack.org/350715 | 11:08 |
*** Mr_Broken has joined #openstack-kolla | 11:11 | |
*** shardy is now known as shardy_lunch | 11:13 | |
*** zhubingbing has quit IRC | 11:21 | |
*** salv-orl_ has quit IRC | 11:27 | |
*** bootsha has joined #openstack-kolla | 11:34 | |
*** bootsha has quit IRC | 11:44 | |
*** senk has quit IRC | 11:47 | |
*** chas_ has quit IRC | 11:51 | |
*** jamesdenton has quit IRC | 11:57 | |
*** shardy_lunch is now known as shardy | 12:11 | |
*** senk has joined #openstack-kolla | 12:16 | |
*** pece has joined #openstack-kolla | 12:16 | |
*** jtriley has joined #openstack-kolla | 12:17 | |
*** daneyon has joined #openstack-kolla | 12:21 | |
bjolo | is it possible to overide network names for particular hosts? i.e. in globals i have network_interface: "bond0" | 12:23 |
bjolo | but a slew of my machines will not have a bonb0 | 12:23 |
bjolo | bond0 | 12:23 |
bjolo | they will just have eth0 and eth0.<vlan ID> | 12:24 |
bjolo | etc | 12:24 |
*** daneyon has quit IRC | 12:26 | |
*** jtriley has quit IRC | 12:27 | |
*** msimonin has joined #openstack-kolla | 12:34 | |
*** jtriley has joined #openstack-kolla | 12:36 | |
*** celo_r has joined #openstack-kolla | 12:37 | |
*** senk has quit IRC | 12:41 | |
*** v1k0d3n has joined #openstack-kolla | 12:43 | |
*** jtriley has quit IRC | 12:44 | |
Mr_Broken | hello | 12:46 |
Mr_Broken | I believe you can do it in ansible Inventory file | 12:46 |
Mr_Broken | look at this : | 12:46 |
Mr_Broken | https://github.com/openstack/kolla/blob/master/ansible/inventory/multinode | 12:46 |
Mr_Broken | # When compute nodes and control nodes use different interfaces, | 12:47 |
Mr_Broken | # you can specify "api_interface" and another interfaces like below: | 12:47 |
Mr_Broken | #compute01 neutron_external_interface=eth0 api_interface=em1 storage_interface=em1 tunnel_interface=em1 | 12:47 |
Mr_Broken | you can also, change the names of your interfaces on the machines, and standarize then across the infrastructure ... but thats more hustle ;] | 12:47 |
vbel | Mr_Broken: https://review.openstack.org/#/c/354173/2/etc/kolla/globals.yml | 12:54 |
vbel | bjolo, ^ | 12:54 |
Mr_Broken | uuu new documentation changes :D | 12:55 |
*** egonzalez90 has quit IRC | 12:55 | |
Mr_Broken | did it get to stable/mitaka too ? | 12:56 |
Mr_Broken | or just master branch ? | 12:56 |
kbaegis | Anyone have issues with scheduling boot from images? | 12:56 |
kbaegis | I can boot from volumes just fine | 12:57 |
Mr_Broken | sounds like glance issues | 12:57 |
Mr_Broken | had different issues depending on glance backend and OS release | 12:58 |
Mr_Broken | finally in stable/mitaka on ceph - everything seems to be working fine | 12:58 |
Mr_Broken | are you trying to use multinode topology and glance with file backend ? | 12:59 |
kbaegis | Mr_Broken: glance logs look clean | 12:59 |
kbaegis | Mr_Broken: I just have a little aio install | 12:59 |
Mr_Broken | so what are the issues exactly ? | 13:00 |
Mr_Broken | in what state is the Instance after trying to boot ? | 13:00 |
Mr_Broken | what image are you using ? | 13:00 |
kbaegis | Mr_Broken: Checking now. I'm guessing either a cinder-volume timeout or something else I just fixed | 13:01 |
kbaegis | I'm running kolla on gentoo, so I have to configure firewall_driver to noop | 13:01 |
kbaegis | But I just persisted it in /etc/kolla/conf/ml2_conf.ini | 13:02 |
kbaegis | Forgot to do that last time I reconfigured :) | 13:02 |
Mr_Broken | yae, might also be a network issue :] | 13:03 |
kbaegis | Mr_Broken: ovs runs on the host uncontainerized. Works just fine. iptables is the issue | 13:03 |
*** salv-orlando has joined #openstack-kolla | 13:03 | |
*** zhurong has joined #openstack-kolla | 13:04 | |
kbaegis | something about the syntax w/ iptables_manager in neutron doesn't work well with the 4.8 kernel or utilities | 13:04 |
Mr_Broken | and neutron_server (with agents) still on container ? | 13:04 |
kbaegis | Yeah | 13:04 |
Mr_Broken | and it works ?! :P | 13:04 |
kbaegis | Everything except ovs is managed by kolla | 13:04 |
kbaegis | including ovs-db | 13:04 |
kbaegis | Mr_Broken: I made it work, yes :) | 13:04 |
Mr_Broken | you managed to get ovs uncontenerized with contenerized ovs-db ?! | 13:04 |
kbaegis | I'm just that good ;) | 13:05 |
Mr_Broken | my hero ! | 13:05 |
Mr_Broken | how ?! :P | 13:05 |
Mr_Broken | share ! | 13:05 |
Mr_Broken | I was strugling with the same problem weeks ago | 13:05 |
Mr_Broken | <--- gave up and uncontenerized ovs-db and some neutron_agents ;] | 13:05 |
kbaegis | I have ovs running in foreground in screen. Command: http://hastebin.com/ebijijevex.vbs | 13:06 |
msimonin | Hi All | 13:06 |
msimonin | I've some trouble with the reconfigure action, should I expose here or in launchpad ? | 13:06 |
Mr_Broken | @kbaegis: heh, good idea :] | 13:08 |
Mr_Broken | @kbaegis: did you run into any issues across reboots ? | 13:08 |
kbaegis | Let's see | 13:09 |
Mr_Broken | or with ovs-ports not being removed when instance is being removed ? | 13:09 |
Mr_Broken | etc | 13:09 |
Mr_Broken | guess my multinode topology also adds a little network complexity | 13:10 |
kbaegis | "mount --make-shared /run" | 13:10 |
Mr_Broken | since my l3 agents and dhcp agents actually have some work to do, and are "trying" to work in HA :P | 13:10 |
Mr_Broken | classic :} | 13:10 |
kbaegis | , firewall noop | 13:10 |
kbaegis | Those were the only 3 issues | 13:10 |
kbaegis | ovs, noop firewall, and mount āmake-shared /run | 13:11 |
kbaegis | Also disabled haproxy/keepalived | 13:11 |
Mr_Broken | yeah ;] | 13:11 |
kbaegis | I don't need them, since my other nodes have <4GB ram | 13:11 |
Mr_Broken | and master branch ? | 13:11 |
kbaegis | Yes | 13:11 |
Mr_Broken | yeah, a lot is fixed there | 13:11 |
kbaegis | Only serious drawback I'm running into: no ui support for designate, magnum, etc | 13:11 |
kbaegis | Also, w/ my setup I was having issues w/ my reverse proxy and novnc | 13:12 |
Mr_Broken | do those even fully work in master branch already ? :P | 13:12 |
kbaegis | Yes | 13:12 |
Mr_Broken | magnum / designate ? | 13:12 |
kbaegis | You can make bays from cli | 13:12 |
*** dave-mccowan has joined #openstack-kolla | 13:12 | |
kbaegis | The BIND backend I haven't tested w/ designate | 13:12 |
Mr_Broken | i think there are some ansible roles still missing for designate | 13:13 |
kbaegis | Makes sense | 13:13 |
*** jtriley has joined #openstack-kolla | 13:13 | |
Mr_Broken | i am kind of forced to use stable/mitaka branch, so I might be wrong though | 13:13 |
kbaegis | ipv6 would be nice with neutron too. Also dvr | 13:13 |
Mr_Broken | dvr support is being worked on currently | 13:14 |
*** sdake has joined #openstack-kolla | 13:14 | |
Mr_Broken | should be merged soon | 13:14 |
Mr_Broken | seen some blueprints | 13:14 |
*** v1k0d3n has quit IRC | 13:15 | |
*** sdake_ has joined #openstack-kolla | 13:15 | |
Mr_Broken | https://blueprints.launchpad.net/kolla/+spec/support-network-ha | 13:15 |
kbaegis | That'll be nice. That's when I'll really move from AIO | 13:16 |
Mr_Broken | we actually have internal stable/mitaka branch that support dvr's in HA | 13:16 |
kbaegis | I need about 10k worth of equipment before I'll even get much use out of dvr | 13:16 |
Mr_Broken | but dont have approvals from my company yet , to publish into community | 13:16 |
sdake_ | morning | 13:16 |
Mr_Broken | morning | 13:17 |
kbaegis | sdake: morning | 13:17 |
sdake_ | Jeffrey4l__ - hows testing going | 13:17 |
kbaegis | sdake_: Wait, are there two of you? | 13:17 |
kbaegis | sdake_: Underscore the difference? | 13:17 |
sdake_ | connecte to vpn | 13:17 |
sdake_ | disconnects my original connection - it willl ping timeout | 13:17 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Getting NOVA pieces together to launch VM https://review.openstack.org/358911 | 13:17 |
*** jtriley has quit IRC | 13:17 | |
Jeffrey4l__ | sdake_, fixed some network issue. Just try to start the test | 13:17 |
sdake_ | start linuxbridge test | 13:18 |
sdake_ | or start fio test | 13:18 |
sbezverk_ | sdake: vm in kube is running, how is this for good morning ;-) | 13:18 |
sdake_ | pbourke i gathered oprofile data | 13:18 |
sdake_ | pbourke interested in seeing? | 13:18 |
sdake_ | sbezverk_ fantastic | 13:18 |
sdake_ | sbezverk_ the talk on kube was accepted | 13:18 |
sdake_ | so I guess we should have something working by summit then ;) | 13:19 |
*** sdake has quit IRC | 13:19 | |
openstackgerrit | Merged openstack/kolla: Fix toolbox permission issue when enabling ceph https://review.openstack.org/358973 | 13:19 |
sdake_ | kbaegis the way to tell its me is my cloak will be @fedora i.e. sdake@fedora/dake | 13:19 |
sdake_ | i do this so people dont gather my home ip address and harass my gear | 13:20 |
sdake_ | it is infinately more feasible to hack soemone you know | 13:20 |
Jeffrey4l__ | sdake_, test started | 13:20 |
sdake_ | then someone you don't ;) | 13:20 |
sdake_ | jefwhich test, fio or the scenario 3? | 13:20 |
sdake_ | or rather scenario 4 | 13:21 |
Jeffrey4l__ | made some small fio test. | 13:21 |
Jeffrey4l__ | no is scenario 4 | 13:21 |
Jeffrey4l__ | now is | 13:21 |
sdake_ | fio worked on scenario 2 | 13:21 |
sdake_ | ? | 13:21 |
Jeffrey4l__ | yep | 13:21 |
Jeffrey4l__ | network issue. | 13:21 |
Jeffrey4l__ | fixed. | 13:22 |
sdake_ | we might as well be capturing thse fio tets | 13:22 |
msimonin | (sorry for interrupting) I've some issue with the reconfigure action when using fake driver and neutron_openvswitch_agent : can anyone help me here or should I go to launchpad ? | 13:22 |
sdake_ | the network issue- was it codified in init-runonce-osic? | 13:22 |
Jeffrey4l__ | sdake_, yes. | 13:22 |
sdake_ | msimonin does it just fail? | 13:22 |
sdake_ | Jeffrey4l__ i mean did you codify the fix | 13:22 |
Jeffrey4l__ | sdake_, a fixed version is here /root/osic_playbooks/init-runonce-osic | 13:23 |
msimonin | sdake_: yes, just like this (stable/mitaka) : | 13:23 |
msimonin | TASK: [neutron | Restart the neutron_openvswitch_agent container] ************* | 13:23 |
msimonin | skipping: [parasilo-28-kavlan-4.rennes.grid5000.fr] | 13:23 |
msimonin | skipping: [parasilo-8-kavlan-4.rennes.grid5000.fr] | 13:23 |
msimonin | fatal: [parasilo-5-kavlan-4.rennes.grid5000.fr] => error while evaluating conditional: openvswitch_agent_envs['KOLLA_CONFIG_STRATEGY'] != 'COPY_ONCE' | 13:23 |
sdake_ | msimonin file a bug pleae | 13:23 |
sdake_ | msimonin may I suggest you use stable? | 13:24 |
Jeffrey4l__ | check the fio test html report on the deployment node:/tmp/a.html | 13:24 |
sdake_ | msimonin are are you aprt of the project to test openstack at 5k node scale? | 13:24 |
Jeffrey4l__ | sdake_, ^ | 13:24 |
msimonin | sdake_: yes | 13:24 |
msimonin | I think the test here https://github.com/openstack/kolla/blob/stable/mitaka/ansible/roles/neutron/tasks/do_reconfigure.yml#L237 is wrong | 13:25 |
sdake_ | msimonin i'd still recommend stable unless you want to test all of openstack master | 13:25 |
msimonin | I can fill a bug | 13:25 |
msimonin | I'm using stable/mitaka | 13:25 |
sdake_ | there should be no problem with stable/mitaka with that code | 13:25 |
msimonin | hm | 13:25 |
sdake_ | but pleawe filea bug | 13:25 |
msimonin | Actually I've some more traces I can attach them in the bug | 13:26 |
sdake_ | different issues? | 13:26 |
msimonin | no same on with more debug to help identifying | 13:26 |
msimonin | same one* | 13:26 |
sdake_ | msimonin - attaching your globals.yml would be helpfu a well | 13:26 |
sdake_ | or linking to it | 13:26 |
sdake_ | ;) | 13:26 |
msimonin | sure | 13:26 |
sdake_ | what scale are you at currently with kolla? | 13:27 |
msimonin | 1000 compute fake driver | 13:27 |
sdake_ | interesting | 13:27 |
sdake_ | and that works? | 13:27 |
msimonin | actually I had also an issue with the mariadb configuration | 13:27 |
*** aswadr_ has joined #openstack-kolla | 13:28 | |
sdake_ | Jeffrey4l__ did you get fio output in json? | 13:28 |
msimonin | that works after removing all wrep* configuration from galera.cnf | 13:28 |
msimonin | (I was using only one mariadb node) | 13:28 |
sdake_ | so without ha, mariadb scales just fine :) | 13:28 |
sdake_ | how many control nodes? | 13:28 |
Jeffrey4l__ | sdake_, just small test, to test my script work. | 13:28 |
Jeffrey4l__ | i will get the detailed test result later. | 13:29 |
msimonin | sdake_: only one control | 13:29 |
sdake_ | 1 control node for 1000 computes? | 13:29 |
msimonin | yes | 13:29 |
msimonin | I don't say the rally benchmarks were smooth :) | 13:29 |
sdake_ | we can help theree | 13:30 |
msimonin | ok cool ! | 13:30 |
msimonin | I'll be pleased | 13:30 |
sdake_ | we hae just been jering aroudn with getting rallly running for over 2 weeks | 13:30 |
sdake_ | on a 130 node physical cluster | 13:30 |
kbaegis | so when I created /etc/kolla/config/ml2_config.ini, it's options didn't overwrite openvswitch-agent | 13:30 |
sdake_ | without fake driver | 13:30 |
kbaegis | What did I do wrong there? | 13:30 |
sdake_ | maybe m2_config.ini isn't customizable | 13:31 |
sdake_ | but i'm not certain | 13:31 |
msimonin | sdake_: how things are going with this deployment ? | 13:31 |
sdake_ | msimonin we can do a 123 node deployment in roughly 20 minutes | 13:31 |
sdake_ | w ehae 6 scale scenarios we are testing across two different oses | 13:31 |
sdake_ | i think we are eliminating one of the scale test | 13:31 |
sdake_ | so we will haea total of 10 tests | 13:31 |
sdake_ | we are on test #2 now | 13:32 |
sdake_ | it takes about 5 hours to run rally scenarios e have defined | 13:32 |
msimonin | sdake_: What strategy do you have to speed up the deployment (prefetched images ? ) | 13:32 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Getting NOVA pieces together to launch VM https://review.openstack.org/358911 | 13:33 |
sdake_ | the tactical plan we executed on was to automate testing, and automate information gathering | 13:33 |
sdake_ | the automated testing takes about 4-5 hours | 13:33 |
sdake_ | sbezverk_ does that nova vm have ovs connectivity? | 13:33 |
sbezverk_ | sdake_ I do VM interface plugged into ovs bridge, but I need to bring up vnc pod to actually test it | 13:34 |
kbaegis | Nice. boot from image is working | 13:35 |
sbezverk_ | sdake_: I meant I do see VM interface .. | 13:35 |
sdake_ | msimonin wee can share our automatation and test selection that works | 13:35 |
kbaegis | Think I'm still having issues with root volumes from flavor though. Can those timeout? | 13:35 |
pbourke | Jeffrey4l__: you still on osic? need any help? | 13:36 |
sdake_ | msimonin i am happy with teh peed of deployment - 20 minutes for 123 nodess | 13:36 |
sdake_ | pbourke if your on osic check out the file in there ending in .txt startin with oprofile | 13:36 |
*** jtriley has joined #openstack-kolla | 13:36 | |
msimonin | sdake_: That would be great if you can share | 13:36 |
sdake_ | msimonin ya give me a moment to get on the test cluster | 13:37 |
*** senk has joined #openstack-kolla | 13:37 | |
*** sdake_ has quit IRC | 13:37 | |
msimonin | sdake_: we don't have yet a real strategy to deploy at scale just a local prefecthed registry | 13:37 |
Jeffrey4l__ | pbourke, no right now. the test is running. | 13:38 |
Jeffrey4l__ | we are testing scenario 4, now. | 13:38 |
*** rcherrueau has joined #openstack-kolla | 13:39 | |
*** sdake has joined #openstack-kolla | 13:40 | |
kbaegis | msimonin: Use bittorrent! ;) | 13:40 |
*** salv-orlando has quit IRC | 13:40 | |
kbaegis | msimonin: Docker containers can be spread by torrent, right | 13:40 |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Document some Conventions https://review.openstack.org/361186 | 13:40 |
kbaegis | Use riffle just to make it complicated | 13:41 |
*** jtriley has quit IRC | 13:41 | |
msimonin | kbaegis: wow right ! | 13:42 |
sdake | msimonin : http://paste.fedoraproject.org/414343/21896914/ -> http://paste.fedoraproject.org/414343/21896914 | 13:43 |
*** mgoddard_ has joined #openstack-kolla | 13:44 | |
msimonin | sdake: bookmarked :) | 13:44 |
*** berendt has quit IRC | 13:44 | |
msimonin | sdake: what is the diff between the two ? | 13:44 |
sdake | msimonin i'd download it - fpaste doesnt' keep data around for a long time | 13:46 |
sdake | same link | 13:46 |
sdake | msimonin fpaste is supposed to url shorten things | 13:46 |
sdake | but that doesn't seem tobe working lately | 13:46 |
msimonin | ok | 13:46 |
msimonin | :) | 13:46 |
*** mgoddard has quit IRC | 13:47 | |
sdake | Jeffrey4l__ can you update nextsteps file pls | 13:48 |
Jeffrey4l__ | sdake, hmm, what's the detail? | 13:49 |
Jeffrey4l__ | next scenario? | 13:49 |
openstackgerrit | Paul Bourke proposed openstack/kolla: Architecture guide doc https://review.openstack.org/360796 | 13:53 |
sdake | exact steps | 13:55 |
sdake | clearly the next scenario isn't 2 its 3 i think | 13:55 |
sdake | check etherpad | 13:55 |
sdake | its about setting up tls | 13:55 |
*** pece has quit IRC | 13:56 | |
sdake | https://etherpad.openstack.org/p/kolla-N-midcycle-osic | 13:56 |
sdake | msimonin there are several scripts in there as well as our"ignore" file | 13:57 |
*** fguillot has joined #openstack-kolla | 14:00 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Document some Conventions https://review.openstack.org/361186 | 14:01 |
msimonin | sdake: I filled a bug report -> https://bugs.launchpad.net/kolla/+bug/1617334 | 14:03 |
openstack | Launchpad bug 1617334 in kolla "reconfigure action fails on [neutron | Restart the neutron_openvswitch_agent container] " [Undecided,New] | 14:03 |
openstackgerrit | Li Yingjun proposed openstack/kolla: Add option ceilometer_database_type for ceilometer https://review.openstack.org/345881 | 14:04 |
*** bootsha has joined #openstack-kolla | 14:05 | |
*** jtriley has joined #openstack-kolla | 14:07 | |
*** senk has quit IRC | 14:09 | |
*** mgoddard_ has quit IRC | 14:09 | |
*** mgoddard has joined #openstack-kolla | 14:10 | |
*** daneyon has joined #openstack-kolla | 14:10 | |
msimonin | kbaegis: to distribute over torrent do you use a modified registry ? | 14:13 |
kbaegis | msimonin: The only place I've seen that model is with cisco phones | 14:14 |
*** daneyon has quit IRC | 14:14 | |
kbaegis | they set up p2p connections to redistribute firmware. Never seen it w/ docker | 14:14 |
msimonin | My point is how kolla team achiev 20min deployment for 123 nodes ? | 14:15 |
kbaegis | 10gb/s connections | 14:15 |
kbaegis | And network copy | 14:15 |
kbaegis | I don't think ansible hyperscales | 14:17 |
kbaegis | I haven't looked into tower's architecture | 14:18 |
*** michauds has joined #openstack-kolla | 14:18 | |
sdake | irtermite are we on 40gig network in the osic lab, or 20gig or 10gig? | 14:20 |
*** bootsha has quit IRC | 14:21 | |
*** dwalsh has quit IRC | 14:23 | |
*** inc0 has joined #openstack-kolla | 14:26 | |
inc0 | good morning | 14:27 |
*** Mr_Broken has quit IRC | 14:31 | |
*** Mr_Broken has joined #openstack-kolla | 14:32 | |
*** dwalsh has joined #openstack-kolla | 14:34 | |
sdake | sup inc0 | 14:35 |
sdake | we finally have one scenario captured | 14:35 |
sdake | scenartio #3 in progress now | 14:35 |
inc0 | yay | 14:35 |
inc0 | pbourke, ping | 14:35 |
pbourke | inc0: yo | 14:35 |
sdake | so i need some shell help | 14:35 |
inc0 | pbourke, why do we want to move haproxy to control? | 14:35 |
sdake | I've got a document that has as its first column a list of numbers | 14:35 |
sdake | inc0 i asked the same hting :) | 14:36 |
sdake | pbourke said it was ineffecient | 14:36 |
inc0 | it'll make upgrades harder, security weaker...and I can't see much value in it | 14:36 |
pbourke | inc0: it's standard convention to run it on the control nodes | 14:36 |
*** Mr_Broken has quit IRC | 14:36 | |
pbourke | it should never have been placed on the network | 14:36 |
inc0 | but why? | 14:36 |
inc0 | if you want to have public endpoints, you don't really want to expose your controllers to external net | 14:37 |
pbourke | requests on control nodes have to go to another node | 14:37 |
inc0 | and you always need to do this for network node | 14:37 |
inc0 | well, 2/3 of controllers will go on a different node anyway | 14:37 |
inc0 | actually more | 14:38 |
inc0 | 8/9 of requests will cross between nodes with 3 controllers | 14:38 |
pbourke | ok im happy enough to leave it if you dont think it makes sense | 14:39 |
inc0 | well, changing arch is hell of a migration | 14:39 |
inc0 | control downtime will be required | 14:39 |
inc0 | maybe even long as ARP tables would need to reload | 14:39 |
inc0 | also it might break if somebody would make their arch with external network only connected to network node | 14:40 |
*** jheroux has joined #openstack-kolla | 14:40 | |
inc0 | and just ran upgrade with pre-defined inventory | 14:40 |
inc0 | actually no, if they have pre-defined inventory then it's ok | 14:40 |
inc0 | but moment they rebase their inventory and miss this change | 14:41 |
inc0 | things might break | 14:41 |
inc0 | granted, it's not super trivial to understand why haproxy+keepalived is on network node, but it does make a lot of sense | 14:41 |
inc0 | from security standpoint | 14:41 |
inc0 | in fact, I wanted to suggest people in this arch guide | 14:42 |
inc0 | to connect external facing network just to network node | 14:43 |
inc0 | s | 14:43 |
inc0 | and hide control plane from the world alltogether | 14:43 |
sbezverk_ | kfox1111: ping | 14:43 |
sdake | inc0 use my diagram pls | 14:45 |
sdake | inc0 it explains the network architecture clearly | 14:45 |
inc0 | sdake, mind linking it? | 14:45 |
sdake | inc0 moment | 14:45 |
sdake | so folks, here are oprofile results of one kolla controller node under rally 128x96 test case | 14:50 |
sdake | https://drive.google.com/file/d/0B8q6xDPETSkHY3RFWE51U1J3WlE/view?usp=sharing | 14:50 |
sdake | inc0: https://www.gliffy.com/go/publish/10486755 | 14:52 |
inc0 | that's incorrect sdake | 14:53 |
sdake | pbourke just looking at that diagram, it appears the controller nodes will rquire *4* IPS | 14:53 |
*** coolsvap_ has joined #openstack-kolla | 14:53 | |
sdake | inc0 feel free to fix it | 14:53 |
sdake | inc0 i want it to be correct - its part off our security analysis | 14:53 |
sdake | it took about 6 hours to make | 14:54 |
inc0 | so my point is, you don't need to connect to external network from controllers at all | 14:54 |
sdake | so i'd suggest just finetuningthat one | 14:54 |
inc0 | also we're missing few networks | 14:54 |
sdake | the api network shoudl connect to routed internet for CSPs | 14:54 |
sdake | maybe we need anothe rline "externally routed API network link" | 14:55 |
sdake | so it runs well in lab enironments as well | 14:55 |
sdake | i can make you a collaborator on this document | 14:55 |
sdake | tha tlittle ebox on the api network line is a router with firewlal ;) | 14:56 |
sdake | notice the title of the document "Deployment Architecture" | 14:57 |
sdake | that is probably what you should call your doc in the queue | 14:58 |
sdake | inc0 do you know if osic is 40gig, 20gig, or 10gig? | 14:58 |
sdake | the nic in use is 10gig | 14:58 |
sdake | rather 40gig | 14:59 |
sdake | butnot sure about the actual gear behind it | 14:59 |
*** kbaegis1 has joined #openstack-kolla | 15:00 | |
*** kbaegis has quit IRC | 15:01 | |
*** ajpower has quit IRC | 15:02 | |
*** senk has joined #openstack-kolla | 15:02 | |
*** zhurong has quit IRC | 15:03 | |
*** Serlex has quit IRC | 15:04 | |
*** kbaegis has joined #openstack-kolla | 15:04 | |
*** kbaegis1 has quit IRC | 15:04 | |
cloudnull | sdake: the OSIC uses 10GBE devices. The nics are intel x710, the switches are cisco nexus and are setup to allow for LACP if you configure it | 15:05 |
sdake | cloudnull thnks bro | 15:05 |
cloudnull | all of the nics are the same using: X710 for 10GbE SFP+ (rev 01) | 15:06 |
cloudnull | anytime | 15:06 |
*** signed8bit has joined #openstack-kolla | 15:08 | |
sdake | cloudnull thanks :) | 15:09 |
sdake | brb need to relog networks | 15:09 |
inc0 | sdake, 10gig all the way | 15:11 |
inc0 | sdake, API network should *never* connect to external | 15:11 |
*** sdake_ has joined #openstack-kolla | 15:11 | |
inc0 | public endpoints sits on HAProxy which sits on network node | 15:11 |
sdake_ | hey folks | 15:12 |
sdake_ | so from my oprofile analysis, and using top, we are only using about 10-30% of the control node's capacity | 15:12 |
sdake_ | under full load | 15:12 |
sdake_ | for folks that wnat to see oprofile summary report: https://drive.google.com/open?id=0B8q6xDPETSkHY3RFWE51U1J3WlE | 15:14 |
*** sdake has quit IRC | 15:15 | |
*** berendt has joined #openstack-kolla | 15:16 | |
*** rmart04 has quit IRC | 15:18 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Document some Conventions https://review.openstack.org/361186 | 15:18 |
britthouser | sdake - I'm not gonna be able to pitch in on OSIC today. Gotta take my kid to doc appt in 30min. | 15:19 |
britthouser | sdake_ - I'm not gonna be able to pitch in on OSIC today. Gotta take my kid to doc appt in 30min. | 15:19 |
openstackgerrit | Paul Bourke proposed openstack/kolla: Move rabbitmq precheck from start https://review.openstack.org/361298 | 15:20 |
sdake_ | britthouser I htink we have it under control | 15:20 |
sdake_ | britthouser I do hae a huge favor to ask | 15:20 |
*** mewald has quit IRC | 15:20 | |
britthouser | sure | 15:20 |
sdake_ | britthouser assuming we get ubuntu finished this weekend, I'm going to need centos7 deployed | 15:20 |
sdake_ | (this weekend) | 15:20 |
britthouser | I started on that yesterday, lemme see if I can wrap it up. | 15:21 |
sdake_ | i'll also needsoemone to do the actual deploy | 15:21 |
sdake_ | as I honestly dont know how :) | 15:21 |
sdake_ | what i need is 2-4 hours of your time this wekeend to sort this out | 15:21 |
sdake_ | i'll get inc0 lined up on the timing as well so we can all3 bang on it | 15:22 |
britthouser | This weekend I'm not gonna be home. =/ Heading to Atlanta | 15:22 |
sdake_ | oh bummer | 15:22 |
*** bootsha has joined #openstack-kolla | 15:22 | |
sdake_ | ok - well then if you can finish anything you have around centos import | 15:22 |
sdake_ | and provide some instructions somewhere | 15:22 |
sdake_ | on how to get rolling | 15:22 |
*** zhubingbing has joined #openstack-kolla | 15:22 | |
sdake_ | that would be super appreciated then :) | 15:22 |
sdake_ | the reason i asked for weekend time - we only he cluster until tuesday | 15:23 |
*** vbel has quit IRC | 15:23 | |
*** rcherrueau has quit IRC | 15:23 | |
*** vbel has joined #openstack-kolla | 15:23 | |
sdake_ | so we need to make sure its fullly utilized the next 4 days | 15:23 |
britthouser | Yeah I understand. If I was gonna be at home I would. | 15:23 |
sdake_ | np | 15:23 |
sdake_ | ifyou could get it staged and ready - that owuld be a huge help too :) | 15:23 |
sdake_ | thats something you may be able to do today? | 15:23 |
sdake_ | after retrieving munchkins from dr? | 15:24 |
sdake_ | inc0 pbourke open up this document: https://drive.google.com/open?id=0B8q6xDPETSkHY3RFWE51U1J3WlE | 15:26 |
*** bootsha has quit IRC | 15:27 | |
pbourke | what is this showing | 15:27 |
*** michauds has quit IRC | 15:27 | |
sdake_ | total cpu cycle count on controller node | 15:27 |
sdake_ | divided by cateegory of service | 15:28 |
*** ajpower has joined #openstack-kolla | 15:28 | |
pbourke | wow ehkstack taking almost 25% | 15:29 |
sdake_ | load avg was 9-20 | 15:30 |
sdake_ | so we have plenty of cpu cycles to burn | 15:30 |
sdake_ | load avg measures running processes sor processes waiting to be schedueld | 15:30 |
sdake_ | but ya, heka piggy | 15:30 |
sdake_ | heka must have implementation problems, it spends alot of time in kernel space | 15:31 |
sdake_ | elasticsearch - well thats java for you | 15:32 |
sdake_ | pehraps we can do some jre optimziation | 15:32 |
*** bootsha has joined #openstack-kolla | 15:36 | |
*** zhubingbing has quit IRC | 15:38 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: l3/metadata DaemonSets + DVR, & labels https://review.openstack.org/357557 | 15:52 |
*** senk has quit IRC | 15:52 | |
sdake_ | sean mooney available anywhere? | 15:56 |
*** michauds has joined #openstack-kolla | 15:58 | |
sdake_ | what would be nice is an elasticseach log forwarder written in c specifically for kolla's needs | 16:03 |
*** matrohon has quit IRC | 16:03 | |
sdake_ | we are not running a log forwarder in java | 16:03 |
sdake_ | and the heka implementation seems pokey | 16:04 |
sdake_ | possibly because of the lua parsing | 16:04 |
sdake_ | hard to tell, I couldn't get a symbol list of heka because it is stripped... | 16:05 |
openstackgerrit | Merged openstack/kolla: Add etcd container https://review.openstack.org/355156 | 16:10 |
jrich523 | ok, so everything got installed on multiple nodes, now horizon is giving me a 503 'no server availble to handle this request' | 16:13 |
openstackgerrit | Tin Lam proposed openstack/kolla: Add ansible role for vmtp container https://review.openstack.org/358305 | 16:15 |
jrich523 | which based on coversations from other folks a few days ago, its a known issue? | 16:15 |
*** senk has joined #openstack-kolla | 16:17 | |
inc0 | back - was pulled out to meeting | 16:17 |
sdake_ | inc0 https://drive.google.com/open?id=0B8q6xDPETSkHY3RFWE51U1J3WlE | 16:18 |
sdake_ | look | 16:18 |
inc0 | what's that? | 16:18 |
sdake_ | click and you will see | 16:18 |
*** salv-orlando has joined #openstack-kolla | 16:18 | |
inc0 | yeah, I still don't know what these numbers mean | 16:19 |
*** Mr_Broken has joined #openstack-kolla | 16:19 | |
inc0 | a pie chart, nice colors | 16:19 |
sdake_ | percentages of that components systemwide cpu count | 16:19 |
sdake_ | cpu cycle count | 16:19 |
sdake_ | the components include their kernel access | 16:19 |
sdake_ | with a 128x96 rally run | 16:20 |
inc0 | it waits on IO... | 16:20 |
inc0 | which is kinda expected | 16:20 |
sdake_ | waiting on io count doesn't generate cycle count | 16:21 |
sdake_ | this is pure execution - no waiting included | 16:21 |
inc0 | ok, we do share controllers and network nodes | 16:21 |
sdake_ | this isn't runtime, but clock cycles used by binary | 16:21 |
inc0 | we might want to separate these | 16:21 |
inc0 | and re-bench | 16:21 |
sdake_ | its not a benchmark its a performance profile | 16:22 |
sdake_ | (just to be accurate:) | 16:22 |
*** aNupoisc has joined #openstack-kolla | 16:22 | |
inc0 | ok, rerun benchmark and get new performance profile | 16:22 |
inc0 | brb | 16:22 |
sdake_ | anyway i thiink we wont have time to do that, but if we do i can do it | 16:22 |
sdake_ | inc0 i am going to need your help this weekend to redeploy the nodees to centos most likely | 16:22 |
*** bootsha has quit IRC | 16:25 | |
sdake_ | inc0 also Jeffrey4l__ fixed a network issue in the osic setup script | 16:25 |
sdake_ | so now vms can access the interneets | 16:25 |
sdake_ | and wrote a specific io benchmark test for rally | 16:25 |
sdake_ | using fio | 16:25 |
sdake_ | its really a nice peice of work | 16:25 |
sdake_ | hope he submits to rally | 16:25 |
*** wirehead_ has quit IRC | 16:26 | |
*** ssurana has joined #openstack-kolla | 16:26 | |
*** vhosakot has joined #openstack-kolla | 16:29 | |
*** wirehead_ has joined #openstack-kolla | 16:29 | |
*** fragatina has joined #openstack-kolla | 16:31 | |
*** fragatina has quit IRC | 16:33 | |
*** fragatina has joined #openstack-kolla | 16:33 | |
*** Mr_Broken has quit IRC | 16:34 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Getting NOVA pieces together to launch VM https://review.openstack.org/358911 | 16:34 |
*** Mr_Broken has joined #openstack-kolla | 16:35 | |
*** msimonin has quit IRC | 16:35 | |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Architecture guide doc https://review.openstack.org/360796 | 16:36 |
*** david-lyle has joined #openstack-kolla | 16:36 | |
*** Mr_Broken has quit IRC | 16:40 | |
jrich523 | when i do a pip install, where do the tools end up? specifically the admin-openrc.sh | 16:44 |
*** unicell has quit IRC | 16:46 | |
*** unicell has joined #openstack-kolla | 16:46 | |
*** gfidente has quit IRC | 16:50 | |
*** gfidente has joined #openstack-kolla | 16:51 | |
ntpttr___ | jrich523: You have to run the post-install script to generate that one pretty sure | 16:52 |
jrich523 | you sir are correct | 16:52 |
jrich523 | jsut did that | 16:53 |
ntpttr___ | jrich523: noice | 16:53 |
jrich523 | indeed! | 16:53 |
jrich523 | and im in! | 16:53 |
jrich523 | lets see if both nodes show up | 16:53 |
jrich523 | nice :) | 16:54 |
ntpttr___ | jrich523: happy stacking! | 16:54 |
jrich523 | lol oh i dont think we're there yet :) | 16:54 |
jrich523 | i've made it this far before | 16:54 |
jrich523 | hmm so i noticed in the globals, that heat was an options (just like horizon, which i turned on) | 16:56 |
jrich523 | i left heat off for now, cuz.. why add complexity... but i noticed it built the docker images | 16:56 |
jrich523 | which is cool cuz i want heat, but... shouldnt it have not done that? | 16:56 |
sdake_ | jrich523 all images are built unles you specify the --profile otpion | 16:57 |
jrich523 | oh cool | 16:57 |
jrich523 | hmm built, deployed and configured? | 16:58 |
ntpttr___ | jrich523: also I could be wrong, but it looks like unless you explicitly uncomment the 'enable_heat: no' in globals it's enabled by default | 16:58 |
ntpttr___ | jrich523: https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml#L222 | 16:58 |
jrich523 | oh cool | 16:59 |
jrich523 | thanks | 16:59 |
jrich523 | yeah, this is all the defaults, good to look at, thanks | 16:59 |
*** gfidente has quit IRC | 16:59 | |
ntpttr___ | np | 17:00 |
*** unicell has quit IRC | 17:00 | |
*** unicell has joined #openstack-kolla | 17:02 | |
*** bootsha has joined #openstack-kolla | 17:02 | |
*** srwilkers_ has joined #openstack-kolla | 17:12 | |
openstackgerrit | Christine Hicks proposed openstack/kolla: Changed admin-openrc from DOMAIN_ID to DOMAIN_NAME https://review.openstack.org/361390 | 17:13 |
*** pbourke has quit IRC | 17:14 | |
*** pbourke has joined #openstack-kolla | 17:14 | |
sdake_ | pbourke mind reviewing the above change ^^ | 17:16 |
sdake_ | dont workflow a +2 would do ;) | 17:16 |
sdake_ | want to wait for gate on workflow | 17:16 |
sdake_ | inc0 ^^ | 17:18 |
*** fragatina has quit IRC | 17:23 | |
*** aswadr_ has quit IRC | 17:31 | |
*** lyncos has joined #openstack-kolla | 17:33 | |
sdake_ | rhallisey ping | 17:39 |
rhallisey | sdake_, yo | 17:41 |
sdake_ | can you review https://review.openstack.org/361390 | 17:41 |
sdake_ | a +2 will do | 17:41 |
sdake_ | and i'll workflow after gate shows success | 17:41 |
*** wally__ has joined #openstack-kolla | 17:42 | |
*** bootsha has quit IRC | 17:42 | |
wally__ | hi aNuposic, there | 17:42 |
*** lyncos has quit IRC | 17:42 | |
rhallisey | look fine | 17:43 |
wally__ | I use the global.yaml file you send to me yesterday, and tried to deploy again, but I still not see the bridage was created..:( | 17:44 |
*** daneyon has joined #openstack-kolla | 17:46 | |
*** berendt has quit IRC | 17:47 | |
*** v1k0d3n has joined #openstack-kolla | 17:47 | |
*** jheroux has quit IRC | 17:49 | |
*** daneyon has quit IRC | 17:50 | |
*** mewald has joined #openstack-kolla | 17:51 | |
*** rhallisey has quit IRC | 17:53 | |
*** bootsha has joined #openstack-kolla | 17:58 | |
*** fragatina has joined #openstack-kolla | 17:58 | |
*** bootsha has quit IRC | 17:59 | |
wally__ | hi , i just check the debug log ,there is no bridge was create, http://pastebin.com/qz13FwGm | 17:59 |
wally__ | can anyone please take a look for me | 18:00 |
wally__ | this is my global.yaml | 18:01 |
wally__ | http://pastebin.com/RLU1zEZh | 18:01 |
*** fragatin_ has joined #openstack-kolla | 18:02 | |
*** sdake_ has quit IRC | 18:02 | |
*** fragatina has quit IRC | 18:06 | |
*** senk has quit IRC | 18:08 | |
*** msimonin has joined #openstack-kolla | 18:11 | |
*** msimonin has quit IRC | 18:13 | |
*** matrohon has joined #openstack-kolla | 18:16 | |
*** bootsha has joined #openstack-kolla | 18:20 | |
*** ntpttr___ is now known as ntpttr__ | 18:21 | |
*** bootsha has quit IRC | 18:22 | |
*** ntpttr__ has quit IRC | 18:25 | |
*** ntpttr___ has joined #openstack-kolla | 18:25 | |
*** ntpttr___ is now known as ntpttr__ | 18:25 | |
*** dwalsh has quit IRC | 18:27 | |
*** ntpttr has quit IRC | 18:27 | |
*** ntpttr has joined #openstack-kolla | 18:28 | |
*** ntpttr has quit IRC | 18:28 | |
*** ntpttr__ is now known as ntpttr | 18:28 | |
*** ntpttr is now known as ntpttr__ | 18:28 | |
*** ntpttr__ is now known as ntpttr | 18:28 | |
*** ntpttr- has joined #openstack-kolla | 18:28 | |
*** shardy has quit IRC | 18:33 | |
*** msimonin has joined #openstack-kolla | 18:40 | |
wally__ | hi guys, I am trying to use linux bridge to deploy, but I got some error when i did the kolla-ansible deploy | 18:42 |
wally__ | changed: [localhost] TASK: [haproxy | Waiting for virtual IP to appear] **************************** failed: [localhost] => {"elapsed": 301, "failed": true} msg: Timeout when waiting for 10.145.213.62:3306 FATAL: all hosts have already failed -- aborting | 18:42 |
openstackgerrit | Merged openstack/kolla: Changed admin-openrc from DOMAIN_ID to DOMAIN_NAME https://review.openstack.org/361390 | 18:42 |
wally__ | the precheck is fine, is anyone know what happen | 18:42 |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Customization for base https://review.openstack.org/358042 | 18:42 |
inc0 | wally__, you check if keepalived managed to setup floating ip | 18:43 |
inc0 | go to first controller node and do ip a | 18:43 |
inc0 | see if ip lands on network_interface | 18:43 |
wally__ | hi inc0 can you take alook at this for me http://pastebin.com/87zzLEta | 18:44 |
wally__ | i paste the ip a output | 18:45 |
inc0 | can I see your globals.yml? | 18:45 |
wally__ | ok one sec | 18:45 |
wally__ | http://pastebin.com/Pas5XYPP | 18:46 |
wally__ | this is one, I use linux bridge, | 18:46 |
wally__ | before I use ovsbridg,but i dontknow why it did not create ovs bridge for me | 18:46 |
inc0 | how many controllers do you have? | 18:47 |
wally__ | i am install AIO | 18:48 |
wally__ | just one | 18:48 |
inc0 | please paste output of docker ps -a | 18:48 |
wally__ | ok | 18:48 |
*** wirehead_ has quit IRC | 18:49 | |
wally__ | http://pastebin.com/0X1SSvET | 18:49 |
*** wirehead_ has joined #openstack-kolla | 18:49 | |
wally__ | in the middle of deploy | 18:49 |
inc0 | ok, docker logs keepalived | 18:49 |
*** msimonin has quit IRC | 18:50 | |
wally__ | http://pastebin.com/Q8fdXnGR | 18:50 |
wally__ | somthing wrong | 18:50 |
inc0 | hmm...yeah | 18:51 |
wally__ | how do deploy kolla with linux bridge | 18:51 |
inc0 | just change driver to linuxbridge | 18:51 |
*** dwalsh has joined #openstack-kolla | 18:51 | |
inc0 | but that's not this issue | 18:51 |
inc0 | keepalived is the same regardless | 18:52 |
wally__ | do u have your global.yaml | 18:52 |
wally__ | can i see | 18:52 |
inc0 | do you have another kolla running in same network? | 18:53 |
wally__ | yeah, | 18:53 |
inc0 | or rather, another keepalived running? | 18:53 |
inc0 | there ya goi | 18:53 |
wally__ | yeah, how do u know | 18:53 |
inc0 | #keepalived_virtual_router_id: "51" | 18:53 |
wally__ | yeah, that is another one | 18:53 |
inc0 | uncomment this line and change a number | 18:53 |
inc0 | to something else | 18:53 |
inc0 | then cleanup and redeploy | 18:53 |
*** wally__ has quit IRC | 18:54 | |
*** wally__ has joined #openstack-kolla | 18:55 | |
wally__ | hi inc) | 18:55 |
wally__ | hi inc0 | 18:55 |
inc0 | you were out for a minute...or less;) | 18:55 |
inc0 | but hello;) | 18:56 |
wally__ | yeahn | 18:56 |
wally__ | so hwat do u need to do | 18:56 |
wally__ | i did not see it | 18:56 |
wally__ | waht do i need to do | 18:56 |
inc0 | <inc0> #keepalived_virtual_router_id: "51" | 18:56 |
inc0 | [13:53] <inc0> uncomment this line and change a number | 18:56 |
wally__ | this line is #keepalived_virtual_router_id: "51" | 18:56 |
wally__ | alrady | 18:56 |
inc0 | after that cleanup and redeploy | 18:56 |
wally__ | uncoment | 18:56 |
wally__ | okok | 18:56 |
inc0 | change number to anything else | 18:56 |
wally__ | what is this for | 18:57 |
wally__ | keepalived_virtual_router_id: "61" | 18:57 |
inc0 | keepalived communicates with each other using broadcasts | 18:57 |
wally__ | is thati ok? | 18:57 |
inc0 | yeah | 18:57 |
wally__ | ok let me try again | 18:58 |
inc0 | so if old keepalived, from another kolla, will broadcast its shit, new one will get confused | 18:58 |
inc0 | this identifies mutliple keepalived instances | 18:58 |
wally__ | ok, i c , | 18:58 |
inc0 | so number itself doesn't really mean anything, it just has to be unique | 18:58 |
wally__ | so if i have one than one kolla in the same subnet, I need to uncommend this | 18:58 |
inc0 | and change number, yeah | 18:59 |
wally__ | ok | 18:59 |
inc0 | let me know if it fixes your issue | 18:59 |
wally__ | ok i am doing the cleaning | 18:59 |
inc0 | good luck:) | 18:59 |
*** rhallisey has joined #openstack-kolla | 19:00 | |
wally__ | another quesiotn, i use ovs-bridge before, but why there is no br-ex create when i do the ifcofig | 19:00 |
wally__ | so confused | 19:00 |
wally__ | so I now use linux bridge | 19:00 |
inc0 | wally__, it's inside container | 19:02 |
inc0 | try docker exec -it openvswitch vsctl show | 19:02 |
inc0 | it's there | 19:02 |
wally__ | oh,, | 19:02 |
wally__ | but after that why my VM has not internet accesss, cannot reach outside, | 19:03 |
*** fragatin_ has quit IRC | 19:03 | |
inc0 | then we should debug this:) | 19:03 |
wally__ | ok, let me try again, | 19:04 |
*** fragatina has joined #openstack-kolla | 19:04 | |
wally__ | do u have a globla.yaml file , can you send to me | 19:04 |
openstackgerrit | Merged openstack/kolla: Move rabbitmq precheck from start https://review.openstack.org/361298 | 19:04 |
*** jemcevoy has joined #openstack-kolla | 19:06 | |
*** vhosakot has quit IRC | 19:07 | |
wally__ | hi inc0 | 19:08 |
inc0 | sorry I wasnt looking at irc | 19:09 |
inc0 | I don't have any linuxbridge conf atm | 19:09 |
wally__ | http://pastebin.com/t43YNKzM | 19:09 |
*** salv-orlando has quit IRC | 19:10 | |
wally__ | I just check the ovs bridge , seems it there. can you plese check | 19:10 |
wally__ | but seems something wrong | 19:10 |
inc0 | wally__, inside docker | 19:10 |
wally__ | yeah, i login the docker | 19:10 |
wally__ | (openvswitch-vswitchd) | 19:10 |
inc0 | a yeah I see that | 19:10 |
wally__ | http://pastebin.com/t43YNKzM | 19:11 |
wally__ | can you cehck this | 19:11 |
inc0 | seems like something broke during deployment | 19:11 |
wally__ | it is down | 19:11 |
wally__ | ovs-vsctl ovs-vswitchd (openvswitch-vswitchd)[root@kolla /]# ovs-vsctl show 2016-08-26T19:08:26Z|00001|ovsdb_idl|WARN|Interface table in Open_vSwitch database lacks error column (database needs upgrade?) f554bb5b-4dba-42d1-ae59-3352997afe21 ovs_version: "2.0.2" | 19:12 |
wally__ | somthing wrong? | 19:12 |
inc0 | yeah | 19:12 |
inc0 | can you do docker logs openvswitch_vswitchd | 19:12 |
inc0 | and openvswitch_db? | 19:12 |
wally__ | once sec | 19:12 |
wally__ | http://pastebin.com/AHXgMXi5 | 19:13 |
wally__ | http://pastebin.com/yppcfXdN | 19:13 |
wally__ | thses all | 19:13 |
wally__ | somehting wrong with db? | 19:14 |
inc0 | can you look at /var/log/openvswitch...? | 19:14 |
inc0 | inside containers | 19:14 |
wally__ | one sec | 19:14 |
wally__ | http://pastebin.com/1L8k6XtV | 19:15 |
wally__ | this is the one | 19:15 |
*** bootsha has joined #openstack-kolla | 19:16 | |
*** fbarilla has joined #openstack-kolla | 19:17 | |
wally__ | all the br-ex, br-int are down,,, it created the bridge,, | 19:17 |
jemcevoy | inc0, I almost have my cluster working... But have a couple of Neutron questions. Does neutron/openvswitch need to own a NIC on all six server or only the three controller running neutron-network? | 19:18 |
inc0 | hmm logs looks good | 19:18 |
*** michauds has quit IRC | 19:18 | |
*** michauds has joined #openstack-kolla | 19:18 | |
inc0 | jemcevoy, nic has to be owned really on compute | 19:18 |
inc0 | and network | 19:19 |
wally__ | :( then waht is the problem, the error | 19:19 |
inc0 | pretty much wherever openvswitch is running | 19:19 |
jemcevoy | I need to know If I need 3 cables run from eth1 to the switch or six | 19:19 |
jemcevoy | so it is six cables | 19:19 |
inc0 | yeah | 19:19 |
inc0 | computes needs it | 19:19 |
wally__ | is my globla.yaml ok? | 19:20 |
inc0 | well you've shown me one for linuxbridge, but looks correct | 19:20 |
inc0 | problem maybe somewhere else, hard to say now | 19:20 |
jemcevoy | Cool... And how do I force the uplink to use VLAN 10. the only way to the outside of my dev rack is on VLAN 10 | 19:20 |
inc0 | jemcevoy, there 2 ways | 19:21 |
*** bootsha has quit IRC | 19:21 | |
inc0 | either you make it native vlan on neutron_external_interface | 19:21 |
inc0 | and use flat network | 19:21 |
inc0 | or you use tagged vlan networking, but for that you need to change neutron config slightly | 19:21 |
wally__ | where? | 19:21 |
*** senk has joined #openstack-kolla | 19:22 | |
wally__ | neutron_external_interface: "eth1" | 19:22 |
wally__ | this is for my ovs deploy | 19:22 |
inc0 | wally__, so, logs of ovs looks good | 19:22 |
wally__ | eth1 is another interface with no ip assign | 19:22 |
*** lamt has quit IRC | 19:22 | |
inc0 | can you show me logs of ovs_db too? | 19:22 |
*** michauds has quit IRC | 19:22 | |
wally__ | ok | 19:23 |
*** michauds has joined #openstack-kolla | 19:23 | |
wally__ | (openvswitch-db)[root@kolla openvswitch]# vi ovsdb-server.log 2016-08-26T17:36:23.651Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovsdb-server.log 2016-08-26T17:36:23.657Z|00002|ovsdb_server|INFO|ovsdb-server (Open vSwitch) 2.5.0 2016-08-26T17:36:33.660Z|00003|memory|INFO|8388 kB peak resident set size after 10.0 seconds 2016-08-26T17:36:33.660Z|00004|memory|INFO|cells:232 monitors:1 sessions:1 | 19:23 |
wally__ | only this | 19:23 |
wally__ | seem good | 19:23 |
wally__ | but when i do ovs-vsctl list-br, in the container ,nothing | 19:24 |
kfox1111 | Update cadvisor to v0.23.9 to fix a problem where attempting to gather container filesystem usage statistics could result in corrupted devicemapper thin pool storage for Docker. (#30307, @sjenning) | 19:26 |
*** bootsha has joined #openstack-kolla | 19:27 | |
kfox1111 | thats probably the issue that broke my box before... :/ | 19:27 |
inc0 | yay | 19:27 |
inc0 | well, you're using devicemapper | 19:27 |
inc0 | you're kinda asking for it | 19:27 |
kfox1111 | heh. I switched to btrfs this last time... | 19:27 |
kfox1111 | not sure which one I trust more though... | 19:28 |
inc0 | ubuntu seems to trust btrfs enough to put it's os on top of it by default | 19:28 |
inc0 | overlay is there by default in xenial too | 19:28 |
*** kbyrne has quit IRC | 19:29 | |
inc0 | wally__, tbh I don't have idea now | 19:30 |
inc0 | you need to debug, check perms of ovs db | 19:30 |
inc0 | although we had some issues with perms before...just didn't show always | 19:31 |
inc0 | which is strange | 19:31 |
wally__ | ..... | 19:31 |
wally__ | so .did u try deploy with ovs before? | 19:31 |
*** bootsha has quit IRC | 19:31 | |
inc0 | lest time yesterday on 130 nodes... | 19:31 |
wally__ | oh, really, it work? | 19:32 |
inc0 | ofc | 19:32 |
inc0 | anyway, you might have hit some bug | 19:32 |
wally__ | can u see your globla.yaml file | 19:32 |
inc0 | which we haven't seen before | 19:32 |
wally__ | please | 19:32 |
Pavo | evening everyone and happy friday | 19:32 |
*** kbyrne has joined #openstack-kolla | 19:32 | |
inc0 | nothing too fancy there, let me see if it's published in our review:) | 19:33 |
inc0 | anyway, could you try to deploy master please? | 19:33 |
inc0 | I might have theory | 19:33 |
wally__ | yeah, I am goinng to do it again | 19:33 |
inc0 | try master+ovs | 19:33 |
inc0 | and let's see | 19:33 |
wally__ | waht do u mena master + ovs | 19:34 |
inc0 | kolla from master | 19:34 |
wally__ | waht do u mean, mastger +ovs | 19:34 |
wally__ | how many nodes, | 19:34 |
inc0 | https://github.com/openstack/kolla | 19:34 |
wally__ | one for kolla | 19:34 |
inc0 | similar setup as one broken | 19:34 |
wally__ | i am using allin one | 19:35 |
inc0 | that's ok, try it | 19:35 |
wally__ | ok, can you please send me your globla file | 19:36 |
kfox1111 | nice... k8s 1.4 alpha 3 has scheduled jobs. | 19:36 |
kfox1111 | we can do fernet token roling with that. :) | 19:36 |
inc0 | wally__, I really don't want to send this config, I have several of them with all sorts of different stuff in it | 19:37 |
wally__ | ok, i c | 19:37 |
inc0 | also we need to figure out what's wrong with yours if anything | 19:37 |
inc0 | I couldn't find anythign wrong wit it | 19:37 |
inc0 | with it | 19:37 |
wally__ | before I do it agin, i just want to make sue my network setup is good | 19:38 |
wally__ | how is your netowrk setup in your master | 19:38 |
inc0 | for aio it doesn't mean that much anyway | 19:38 |
inc0 | same as mitaka, also again, for aio it's not a big issue | 19:38 |
*** senk has quit IRC | 19:38 | |
Pavo | wally__ did you read the article I posted for you lastnight? | 19:39 |
Pavo | it was about aio deployments | 19:39 |
*** bootsha has joined #openstack-kolla | 19:39 | |
wally__ | Yeah, i following the same | 19:39 |
Pavo | ok cool | 19:39 |
wally__ | but there iss some probloem about the bridge | 19:39 |
Pavo | have you tried with stable branch? | 19:40 |
Pavo | or master? | 19:40 |
wally__ | http://pastebin.com/t43YNKzM | 19:40 |
wally__ | can you pleas cehfck this | 19:40 |
wally__ | @pavo | 19:40 |
Pavo | looks right to me | 19:40 |
wally__ | the bridge is down | 19:40 |
jemcevoy | inc0, Do all [compute] nodes as well as [network] nodes need to have "neutron_external_interface="enp1s0f1" defined? | 19:41 |
Pavo | and you should use the openstack clients and sourcing your keystone rc to check ovs cmds | 19:41 |
inc0 | jemcevoy, yeah | 19:41 |
Pavo | bridge status might say down but thats might because of how the bridge works | 19:41 |
*** zhiwei has joined #openstack-kolla | 19:41 | |
inc0 | jemcevoy, https://review.openstack.org/#/c/360796/4/doc/architecture-guide.rst | 19:41 |
wally__ | (openvswitch-vswitchd)[root@kolla /]# ovs-vsctl show 2016-08-26T19:24:01Z|00001|ovsdb_idl|WARN|Interface table in Open_vSwitch database lacks error column (database needs upgrade?) f554bb5b-4dba-42d1-ae59-3352997afe21 ovs_version: "2.0.2" | 19:42 |
inc0 | take a look at this | 19:42 |
wally__ | and i did not see any bridge | 19:42 |
wally__ | so, u tried it and it working for you right? | 19:42 |
Pavo | wally__ install the openstck-clients and do a kolla-ansible post-deploy on master node | 19:42 |
jemcevoy | inc0, Thanks that doc looks very helpful... | 19:43 |
Pavo | and then source keystone rc file and then from master node use openstack ovs blah blah | 19:43 |
inc0 | hehe | 19:43 |
wally__ | I did the post deploy | 19:43 |
inc0 | just wrote it yesterday;) I figured it'll gonna be useful | 19:43 |
Pavo | ok source /etc/kolla/rc file | 19:43 |
Pavo | then do openstack ovs-vsctl list | 19:44 |
wally__ | openstack ovs blah? | 19:44 |
wally__ | root@kolla:/etc/kolla# openstack ovs-vsctl list openstack: 'ovs-vsctl' is not an openstack command. See 'openstack --help'. Did you mean one of these? | 19:44 |
wally__ | ?? | 19:44 |
Pavo | I don't have my environment up right now so don't know the rc file name or ovs cmds right off bat sorry | 19:44 |
Pavo | ok try ovs-vsctl list | 19:45 |
Pavo | without openstack | 19:45 |
Pavo | I can't remember | 19:45 |
*** zhiwei has quit IRC | 19:45 | |
wally__ | root@kolla:/etc/kolla# ovs-vsctl list-br root@kolla:/etc/kolla# | 19:46 |
wally__ | show nothing, | 19:46 |
wally__ | but this is only for the master node, right | 19:46 |
Pavo | I'll throw up a aio VM later tonight and see what I can do | 19:47 |
wally__ | when you insall the kolla, did u use stable branch or the master? | 19:47 |
Pavo | I do stable | 19:47 |
Pavo | unless you plan on doing development and testing I would use stable | 19:47 |
wally__ | how did u insall kolla | 19:47 |
wally__ | pip install kolla? | 19:47 |
Pavo | yeah | 19:48 |
wally__ | then I use the same | 19:48 |
Pavo | and pip install ansible==1.9.4 | 19:48 |
wally__ | yeah, the same | 19:48 |
wally__ | ok, man, can you plase try aio again? | 19:48 |
wally__ | just take 15 mins to do | 19:48 |
Pavo | yeah I will once I get done with dinner | 19:48 |
inc0 | wally__, also, which distro you have on host and which one in container? | 19:49 |
Pavo | I use centos for host and centos for containers | 19:49 |
wally__ | ubunt 1404 | 19:49 |
wally__ | all ubuntu | 19:49 |
inc0 | you did mount --make-shared /run? | 19:49 |
Pavo | I never use ubuntu | 19:49 |
inc0 | right? | 19:49 |
wally__ | yeah | 19:49 |
wally__ | i use mount --make-shared /run? | 19:49 |
inc0 | ok, it would break otherwise | 19:49 |
wally__ | yeah i run mount --make-shared /run | 19:50 |
inc0 | well without ? but yeah you need this in ubu14 | 19:50 |
wally__ | yeah i did | 19:50 |
*** berendt has joined #openstack-kolla | 19:50 | |
wally__ | can you pleaes try with ubuntn | 19:50 |
aNupoisc | Hi all, is it always required to have 2 or more nics on the machine where kolla is deployed? http://docs.openstack.org/developer/kolla/quickstart.html | 19:50 |
inc0 | yesterday - that was all ubuntu | 19:50 |
inc0 | but master | 19:50 |
openstackgerrit | Merged openstack/kolla: Add full support for fernet https://review.openstack.org/349366 | 19:50 |
inc0 | aNupoisc, yes, if you're running neutron that is | 19:51 |
rhallisey | inc0, nice! | 19:51 |
rhallisey | fernet got in | 19:51 |
*** bootsha has quit IRC | 19:51 | |
rhallisey | inc0, https://review.openstack.org/#/c/351139/25 | 19:51 |
inc0 | yeah with one caveat | 19:51 |
rhallisey | what's the caveat | 19:51 |
inc0 | I don't really like keystone_ssh | 19:51 |
inc0 | we have nova_ssh | 19:51 |
inc0 | which kinda became a standard | 19:52 |
inc0 | but I guess we need to figure out this stuff | 19:52 |
rhallisey | I don't know what you mean | 19:52 |
inc0 | fernet requires token distribution | 19:52 |
inc0 | it uses ssh here | 19:52 |
inc0 | it should use ansible | 19:52 |
inc0 | but I don't want to stop whole feature on this | 19:52 |
aNupoisc | inc0: ahh good to know. I am doing all-in-one setup with just ceph | 19:52 |
wally__ | and also, pavo, do u have your init-runonce file | 19:52 |
wally__ | can I see it | 19:53 |
*** srwilkers_ has quit IRC | 19:53 | |
wally__ | to create the network | 19:53 |
aNupoisc | inc0: so i will be enabling ceph and ceph_rgw from globals.yml | 19:53 |
inc0 | rhallisey, can you take a look at it? https://review.openstack.org/#/c/360796/ | 19:53 |
aNupoisc | inc0: so I assume that requirement is not meant for me. | 19:53 |
rhallisey | I get your point, but how would that look with anisble | 19:53 |
rhallisey | I'm not seeing it | 19:53 |
rhallisey | inc0, was going to ask you to rebase on my doc struacture | 19:53 |
inc0 | aNupoisc, no, you should be ok without this setting | 19:54 |
rhallisey | let me fix my doc structure though real quick | 19:54 |
inc0 | sure | 19:54 |
jemcevoy | inc0, I have a few things that i have stumbled over that may be useful in a doc like yours. Can I email then to you next week? IRC seems too ephemeral | 19:54 |
aNupoisc | inc0: cool. | 19:54 |
inc0 | jemcevoy, either that or write a patch with it | 19:54 |
inc0 | I'd prefere latter ;) you should take credit for this stuff too | 19:55 |
inc0 | but if you don't want to submit it for whatever reason, sure mail would be ok | 19:55 |
jemcevoy | That would mean that I would need to signup with OpenStack? | 19:55 |
inc0 | yeah, it only cost a soul | 19:55 |
inc0 | but jokes apart, it's really cool when you see your patch merged | 19:56 |
inc0 | I really like this feeling;) | 19:56 |
jemcevoy | I'll ask my buddy from Marantis if he can help me through that hurdle | 19:57 |
*** dwalsh has quit IRC | 19:57 | |
inc0 | we can help you if you need help | 19:57 |
inc0 | there is guide for it actually, hold on | 19:57 |
inc0 | http://docs.openstack.org/infra/manual/developers.html | 19:58 |
jemcevoy | First question... Should I use my work or personal email? | 19:58 |
inc0 | depends, is your company contributing to openstack? | 19:58 |
jemcevoy | They may have done a little... Penguin Computing not sure | 19:59 |
inc0 | well, let me put it this way, if it's just you, I'd go with personal mail and individual contributor agreement | 20:00 |
inc0 | there is paragraph about this in guide I've linked | 20:00 |
jemcevoy | I will get stared on that over the weekend... | 20:01 |
inc0 | thanks! | 20:01 |
inc0 | it's not as bad as it seems, and you'll be listed as one of authors of kolla | 20:01 |
inc0 | also contributors get free access to summit | 20:01 |
inc0 | full pass | 20:02 |
jemcevoy | Cool.. | 20:02 |
*** NachoDuck has quit IRC | 20:03 | |
wally__ | hi, pavo, can I give you a server, and you can try on it? | 20:03 |
wally__ | i will give you a public ip to loing | 20:03 |
wally__ | login | 20:03 |
Pavo | I have never used ubuntu before so not sure if that would be good idea | 20:03 |
inc0 | wally__, I can do it if you want | 20:04 |
wally__ | ok | 20:04 |
wally__ | good, I will set up a ubuntnu 1404 server and give you public ip later | 20:04 |
*** lamt has joined #openstack-kolla | 20:04 | |
wally__ | give me 2 hours | 20:04 |
*** serverascode has quit IRC | 20:04 | |
*** NobodyCam has quit IRC | 20:04 | |
wally__ | ubuntu 1404 server, right? | 20:04 |
inc0 | ahh 2 hrs...Friday evening:( | 20:04 |
wally__ | ok, ik c | 20:04 |
wally__ | next monday | 20:05 |
inc0 | I'll play over weekend if that's ok | 20:05 |
inc0 | or Monday | 20:05 |
wally__ | is it ok for your? | 20:05 |
inc0 | sure, thanks | 20:05 |
*** bootsha has joined #openstack-kolla | 20:05 | |
wally__ | i will set it up fist , then email to you? can u tell me your email? | 20:05 |
wally__ | i will send you all the detail include network subnet range, then you can assign for the floating ip | 20:08 |
openstackgerrit | Merged openstack/kolla: Add dockerfiles for keystone fernet https://review.openstack.org/351139 | 20:09 |
*** elemoine__ has joined #openstack-kolla | 20:17 | |
openstackgerrit | Merged openstack/kolla: Fix bug in Elasticsearch role https://review.openstack.org/359596 | 20:18 |
*** elemoine_ has quit IRC | 20:20 | |
*** elemoine__ is now known as elemoine_ | 20:20 | |
*** mewald has quit IRC | 20:21 | |
jemcevoy | inc0, One more question... Can neutron/openvswitch share a NIC with haproxy, horizon, etc? Or will I need two NICs on VLAN 10? | 20:26 |
*** lyncos has joined #openstack-kolla | 20:26 | |
inc0 | you want 2 nics | 20:26 |
inc0 | neutron will bind bridge to the port | 20:26 |
inc0 | which will render port unreachable | 20:26 |
inc0 | there are ways to make them share network, but not supported here | 20:26 |
inc0 | however | 20:26 |
inc0 | what you can do | 20:27 |
inc0 | is to make 2 nivs | 20:27 |
inc0 | nics | 20:27 |
jemcevoy | OK... I am going to need another 1Gig switch | 20:27 |
inc0 | one for vlan 10 another in whatever you want | 20:27 |
inc0 | nah | 20:27 |
inc0 | can you trunk your netowork therE? | 20:27 |
wally__ | hi inc0, can you gvie me you email, then I send you the server info later | 20:28 |
inc0 | wally__, sent over in pm | 20:28 |
inc0 | elemoine_, hey Eric, long time no see:) | 20:28 |
wally__ | in pm? | 20:28 |
inc0 | private message, you should have it in irc | 20:28 |
inc0 | somewhere | 20:28 |
*** lyncos has quit IRC | 20:28 | |
wally__ | how to send in pm? | 20:29 |
jemcevoy | I will need eth0.10 for haproxy horizon, etc and eth1 native VLAN10 for neutron and the rest of the traffic on the 10Gig internal network | 20:29 |
inc0 | hmm, sooo | 20:31 |
inc0 | let me think | 20:31 |
inc0 | you want flat network to be in same net as haproxy | 20:31 |
inc0 | ok, so what we can do | 20:31 |
inc0 | is change your inventory in a way to put haproxy and keepalived on control nodes | 20:32 |
inc0 | they don't need connection to public network at all | 20:32 |
inc0 | so you can just create port.10 there and bind haproxy to irt | 20:32 |
*** NachoDuck has joined #openstack-kolla | 20:33 | |
inc0 | either that or you just create virtual interface in network node and manually add it to br-ex | 20:34 |
inc0 | and use it for haproxy | 20:34 |
*** Jeffrey4l_ has joined #openstack-kolla | 20:34 | |
*** Jeffrey4l__ has quit IRC | 20:35 | |
*** bootsha has quit IRC | 20:36 | |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Architecture guide doc https://review.openstack.org/360796 | 20:38 |
inc0 | jemcevoy, ^ added note about kolla external interface | 20:38 |
inc0 | you might want to laverage that | 20:38 |
*** aNupoisc has quit IRC | 20:39 | |
*** fguillot has quit IRC | 20:39 | |
*** serverascode has joined #openstack-kolla | 20:42 | |
*** aNupoisc has joined #openstack-kolla | 20:55 | |
*** ayoung has joined #openstack-kolla | 20:59 | |
*** sdake has joined #openstack-kolla | 21:02 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Add docs for host setup https://review.openstack.org/343223 | 21:03 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Shrink the quickstart massively and break it into 2 https://review.openstack.org/343224 | 21:03 |
*** salv-orlando has joined #openstack-kolla | 21:03 | |
*** inc0 has quit IRC | 21:06 | |
*** NobodyCam has joined #openstack-kolla | 21:08 | |
*** slagle has quit IRC | 21:12 | |
*** matrohon has quit IRC | 21:12 | |
*** salv-orl_ has joined #openstack-kolla | 21:18 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Add docs for host setup https://review.openstack.org/343223 | 21:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Shrink the quickstart massively and break it into 2 https://review.openstack.org/343224 | 21:20 |
*** salv-orlando has quit IRC | 21:20 | |
rhallisey | down to 277 for devs | 21:20 |
rhallisey | would like under 150.. | 21:20 |
*** daneyon has joined #openstack-kolla | 21:23 | |
*** daneyon has quit IRC | 21:27 | |
*** jtriley has quit IRC | 21:33 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Getting NOVA pieces together to launch VM https://review.openstack.org/358911 | 21:33 |
sdake | rhallisey 27 comments in the quickstart guide change | 21:38 |
sdake | look at comment #7 | 21:38 |
sdake | rhallisey like under r15 0what rhallisey ? | 21:38 |
rhallisey | 150 lines | 21:39 |
*** rhallisey has quit IRC | 21:48 | |
*** lamt has quit IRC | 21:54 | |
sdake | 150 line of what? | 21:55 |
*** kbaegis has quit IRC | 21:57 | |
*** kbaegis has joined #openstack-kolla | 21:57 | |
*** JoseMello has quit IRC | 22:00 | |
*** sdake_ has joined #openstack-kolla | 22:01 | |
haplo37 | Hi guys, i am not able to take a snapshot of my instance. I have this issue : http://paste.openstack.org/show/564088/ . Do you have an idea what happen ? | 22:03 |
*** sdake has quit IRC | 22:03 | |
*** lamt has joined #openstack-kolla | 22:05 | |
*** lamt has quit IRC | 22:05 | |
*** fbarilla has quit IRC | 22:06 | |
*** dmsimard is now known as dmsimard|pto | 22:12 | |
*** fguillot has joined #openstack-kolla | 22:18 | |
*** unicell has quit IRC | 22:22 | |
*** unicell has joined #openstack-kolla | 22:23 | |
*** michauds has quit IRC | 22:25 | |
*** berendt has quit IRC | 22:30 | |
*** berendt has joined #openstack-kolla | 22:36 | |
*** berendt has quit IRC | 22:36 | |
*** kbaegis has quit IRC | 22:37 | |
*** kbaegis has joined #openstack-kolla | 22:45 | |
*** signed8bit is now known as signed8bit_Zzz | 22:54 | |
*** signed8bit_Zzz is now known as signed8bit | 22:56 | |
*** salv-orl_ has quit IRC | 23:00 | |
*** serverascode has quit IRC | 23:01 | |
*** NobodyCam has quit IRC | 23:01 | |
*** NachoDuck has quit IRC | 23:02 | |
*** daneyon has joined #openstack-kolla | 23:11 | |
*** NobodyCam has joined #openstack-kolla | 23:15 | |
*** daneyon has quit IRC | 23:15 | |
*** vhosakot has joined #openstack-kolla | 23:16 | |
*** vhosakot has quit IRC | 23:19 | |
*** serverascode has joined #openstack-kolla | 23:20 | |
jemcevoy | inc0, I got those eth1 ports plugged in to a switch... How do I restart to get neutron running properly... | 23:23 |
*** unicell1 has joined #openstack-kolla | 23:25 | |
*** unicell has quit IRC | 23:26 | |
*** NachoDuck has joined #openstack-kolla | 23:29 | |
*** fguillot is now known as fguillot_afk | 23:29 | |
*** fguillot_afk has quit IRC | 23:30 | |
*** unicell1 has quit IRC | 23:40 | |
*** unicell has joined #openstack-kolla | 23:42 | |
*** fguillot has joined #openstack-kolla | 23:43 | |
sdake_ | jemcevoy best hting to do is probably redeploy but i don't know what state your in | 23:46 |
*** NachoDuck has quit IRC | 23:46 | |
*** NobodyCam has quit IRC | 23:46 | |
*** serverascode has quit IRC | 23:46 | |
sdake_ | what version are you running? | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!