| *** goldyfruit has quit IRC | 00:02 | |
| *** yangyapeng has quit IRC | 00:04 | |
| *** yangyapeng has joined #openstack-kolla | 00:05 | |
| *** seanmurphy has quit IRC | 00:05 | |
| *** yangyapeng has quit IRC | 00:09 | |
| *** goldyfruit has joined #openstack-kolla | 00:26 | |
| *** goldyfruit has quit IRC | 00:28 | |
| *** faridda has joined #openstack-kolla | 00:29 | |
| *** zhurong has joined #openstack-kolla | 00:38 | |
| *** faridda has quit IRC | 00:40 | |
| *** zhubingbing has joined #openstack-kolla | 00:43 | |
| *** itlinux has joined #openstack-kolla | 00:45 | |
| *** rhallisey has quit IRC | 00:46 | |
| *** zhubingbing has quit IRC | 00:49 | |
| *** hrw has quit IRC | 00:49 | |
| *** hrw has joined #openstack-kolla | 00:51 | |
| *** awidders_ has quit IRC | 00:51 | |
| *** itlinux has quit IRC | 00:51 | |
| *** awiddersheim has joined #openstack-kolla | 00:52 | |
| *** goldyfruit has joined #openstack-kolla | 00:56 | |
| *** tovin07_ has joined #openstack-kolla | 00:56 | |
| *** duonghq has joined #openstack-kolla | 01:02 | |
| duonghq | moring guys | 01:02 |
|---|---|---|
| *** faridda has joined #openstack-kolla | 01:02 | |
| *** faridda has quit IRC | 01:08 | |
| *** kevzha01 has joined #openstack-kolla | 01:10 | |
| *** faridda has joined #openstack-kolla | 01:11 | |
| *** yangyapeng has joined #openstack-kolla | 01:13 | |
| *** yangyapeng has quit IRC | 01:14 | |
| *** yangyapeng has joined #openstack-kolla | 01:14 | |
| *** kevzha01 is now known as kevinz | 01:15 | |
| *** goldyfruit has quit IRC | 01:30 | |
| lxdong | openvswitch-agent container keeps restarting , how to check its internal log | 01:31 |
| lxdong | tailf openvswitch-vswitchd /var/log/kolla/neutron/neutron-openvswitch-agent.log : ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Tunneling can't be enabled with invalid local_ip '192.168.4.103'. IP couldn't be found on this host's interfaces. | 01:34 |
| *** frzn_ has quit IRC | 01:35 | |
| *** yangyapeng has quit IRC | 01:38 | |
| *** yangyapeng has joined #openstack-kolla | 01:39 | |
| *** caowei has joined #openstack-kolla | 01:39 | |
| *** malcomX194 has joined #openstack-kolla | 01:40 | |
| *** yangyapeng has quit IRC | 01:42 | |
| *** yangyapeng has joined #openstack-kolla | 01:43 | |
| openstackgerrit | zhongshengping proposed openstack/kolla-ansible master: `bind_host` and `bind_port` are coming under `api_setting https://review.openstack.org/503982 | 01:44 |
| *** yangyape_ has joined #openstack-kolla | 01:45 | |
| *** yangyapeng has quit IRC | 01:47 | |
| *** goldyfruit has joined #openstack-kolla | 01:47 | |
| *** jiriprox has quit IRC | 01:48 | |
| *** dardelean_ has joined #openstack-kolla | 01:58 | |
| *** gkadam has quit IRC | 01:59 | |
| *** jamesbenson has joined #openstack-kolla | 02:00 | |
| *** dardelean_ has quit IRC | 02:02 | |
| *** jamesbenson has quit IRC | 02:04 | |
| *** dave-mccowan has quit IRC | 02:17 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Remove keystone-paste.ini file in kolla https://review.openstack.org/498699 | 02:23 |
| Jeffrey4l | duonghq, around? | 02:23 |
| duonghq | Jeffrey4l, yes | 02:24 |
| Jeffrey4l | duonghq, do have any 20 min to learn how to release a new kolla version on lp? | 02:24 |
| Jeffrey4l | do u have* | 02:25 |
| duonghq | Jeffrey4l, sure | 02:26 |
| Jeffrey4l | cool. we will going to release kolla 5.0.0. | 02:27 |
| Jeffrey4l | open https://launchpad.net/kolla duonghq | 02:27 |
| duonghq | but iirc, there is somebody volunteered for it? if not, I'll do it, | 02:27 |
| duonghq | Jeffrey4l, opened | 02:28 |
| Jeffrey4l | duonghq, i trained them. ( during pike-rc1) . | 02:28 |
| Jeffrey4l | since pike-rc2 is the pike 5.0.0( from github commit view) | 02:28 |
| Jeffrey4l | we need release pike-rc2 and pike 5.0.0 at the same time. | 02:28 |
| Jeffrey4l | duonghq, click "pike-rc2" | 02:29 |
| Jeffrey4l | which is https://launchpad.net/kolla/+milestone/pike-rc2 | 02:29 |
| duonghq | done | 02:29 |
| Jeffrey4l | duonghq, then click "Create release" | 02:29 |
| Jeffrey4l | duonghq, fill the "Date released" | 02:29 |
| Jeffrey4l | you can get the date from releases project. | 02:30 |
| Jeffrey4l | here it is https://github.com/openstack/releases/blame/master/deliverables/pike/kolla.yaml | 02:30 |
| Jeffrey4l | git blame shows it is "Sep 13 2017" | 02:31 |
| duonghq | Jeffrey4l, do I need fill the time? | 02:32 |
| Jeffrey4l | correct | 02:32 |
| duonghq | Jeffrey4l, I cannot find exact time (hr:mm) | 02:33 |
| Jeffrey4l | aha, only date is required. no need exact time | 02:33 |
| Jeffrey4l | the click "Create release" button | 02:34 |
| Jeffrey4l | then click* | 02:34 |
| duonghq | Keep the pike-rc2 milestone active. -> do I need checking that? | 02:34 |
| duonghq | or leave it uncheck | 02:34 |
| *** huzhengchuan has joined #openstack-kolla | 02:34 | |
| Jeffrey4l | duonghq, yes. leave it uncheck. | 02:35 |
| Jeffrey4l | pike-rc2 is done. | 02:35 |
| Jeffrey4l | no need keep it active. | 02:35 |
| duonghq | Jeffrey4l, done | 02:35 |
| Jeffrey4l | cool. | 02:35 |
| Jeffrey4l | next, we need create pike 5.0.0 milestone. | 02:36 |
| Jeffrey4l | click "pike" from https://launchpad.net/kolla | 02:36 |
| Jeffrey4l | which is https://launchpad.net/kolla/pike | 02:36 |
| Jeffrey4l | click "Create milestone" link | 02:36 |
| duonghq | ok | 02:37 |
| Jeffrey4l | file the form with proper data. | 02:37 |
| Jeffrey4l | name: 5.0.0 | 02:37 |
| Jeffrey4l | code name: pike | 02:37 |
| *** mdnadeem has joined #openstack-kolla | 02:37 | |
| *** skramaja has joined #openstack-kolla | 02:38 | |
| Jeffrey4l | Date targeted: 2017-09-14 ( which is the next day of pike-rc2) | 02:38 |
| Jeffrey4l | then submit by clicking "Create midlestone" button. | 02:39 |
| duonghq | ya, the milestone is registered | 02:39 |
| Jeffrey4l | duonghq, then release 5.0.0, just like what u did for release pike-rc2 | 02:40 |
| duonghq | it seems that we "back-dated" for this? | 02:40 |
| Jeffrey4l | hrm, back-dated means? | 02:40 |
| Jeffrey4l | this should be done last week, but i have no time to do this ;) | 02:41 |
| duonghq | Got it | 02:41 |
| *** jascott1 has quit IRC | 02:41 | |
| Jeffrey4l | based on the process pike-rc2 is the same with pike 5.0.0 | 02:42 |
| duonghq | so, 5.0.0 is one day after rc1? | 02:42 |
| Jeffrey4l | that why we need create two almost the same release. | 02:42 |
| Jeffrey4l | it depends. 5.0.0 is created by release team. | 02:42 |
| Jeffrey4l | check here https://github.com/openstack/releases/blame/master/deliverables/pike/kolla.yaml | 02:42 |
| Jeffrey4l | 9 days ago, i created pike-rc2 tag. 8 days gao. dhellman create the 5.0.0 final tag | 02:43 |
| duonghq | it's merged on Sep 14, | 02:44 |
| duonghq | so it should be Sep 14 2017? | 02:44 |
| duonghq | https://review.openstack.org/#/c/503949/ | 02:45 |
| duonghq | this one | 02:45 |
| Jeffrey4l | duonghq, correct. | 02:45 |
| *** goldyfruit has quit IRC | 02:46 | |
| duonghq | Jeffrey4l, done | 02:47 |
| Jeffrey4l | cool. | 02:47 |
| Jeffrey4l | next, create 5.0.1 tag | 02:47 |
| duonghq | Jeffrey4l, why we do not have 4.0.0? | 02:47 |
| duonghq | you mean 5.0.1 milestone? | 02:48 |
| Jeffrey4l | and the release data should be creating queens-rc1 date | 02:48 |
| Jeffrey4l | duonghq, yes. | 02:48 |
| Jeffrey4l | 4.0.0 is my bad. i managed ocata release cycle. but i forget(or do not know) to release 4.0.0 ;( | 02:49 |
| duonghq | so, 5.0.1 code name is pike, the date is 2017-10-18 (same as q1)? | 02:49 |
| Jeffrey4l | duonghq, yes. | 02:50 |
| duonghq | yeah, done | 02:50 |
| Jeffrey4l | but technically, it depends. | 02:50 |
| Jeffrey4l | there is no official z stream release scheduler for openstack project. | 02:51 |
| Jeffrey4l | same as q1 is what kolla's way. | 02:51 |
| Jeffrey4l | next is move all "pike-rc2" unsolved bp to 5.0.1 | 02:52 |
| Jeffrey4l | https://launchpad.net/kolla/pike/pike-rc2 | 02:52 |
| duonghq | we have no bp here | 02:52 |
| duonghq | only 2 bugs | 02:52 |
| duonghq | strager | 02:52 |
| duonghq | stranger | 02:52 |
| Jeffrey4l | yep. bp is moved to Q already. | 02:52 |
| Jeffrey4l | bp and bugs is moved to Q already when released rc1 | 02:53 |
| Jeffrey4l | if pike have the same issue, need add another track for bug. | 02:53 |
| duonghq | I saw it before | 02:53 |
| Jeffrey4l | saw what? | 02:54 |
| duonghq | ah, the bug tracking | 02:54 |
| duonghq | I see " libvirt raise Could not access KVM kernel module error" is triaged but not fix | 02:54 |
| duonghq | so, I will move it to 5.0.1? | 02:54 |
| Jeffrey4l | duonghq, correct. | 02:54 |
| Jeffrey4l | btw, all bug is tracking in q1 now https://launchpad.net/kolla/+milestone/queens-1 | 02:54 |
| duonghq | done | 02:55 |
| Jeffrey4l | cool. this is all about release for kolla. | 02:55 |
| Jeffrey4l | any question for this? | 02:55 |
| duonghq | hmm, so if we tag, release in time, we only need release current milestone and create next milestone? | 02:56 |
| Jeffrey4l | duonghq, yes. | 02:57 |
| Jeffrey4l | for rc2 and 5.0.0 is special, before they are released almost the same date. | 02:57 |
| openstackgerrit | ShangXiao proposed openstack/kolla-kubernetes master: Update and replace http with https for doc links https://review.openstack.org/505913 | 02:58 |
| Jeffrey4l | duonghq, next, could u release rc2 and 5.0.0 for kolla-ansible? | 03:03 |
| duonghq | sure | 03:05 |
| *** sbezverk has quit IRC | 03:06 | |
| Jeffrey4l | thanks. | 03:08 |
| *** gkadam has joined #openstack-kolla | 03:13 | |
| openstackgerrit | caoyuan proposed openstack/kolla-ansible master: Make the pg and pgp value configurable https://review.openstack.org/504845 | 03:22 |
| duonghq | Jeffrey4l, all done | 03:26 |
| Jeffrey4l | duonghq, move bugs https://launchpad.net/kolla-ansible/pike/pike-rc2 | 03:27 |
| duonghq | done | 03:28 |
| Jeffrey4l | cool. seems all is OK. thanks duonghq | 03:29 |
| duonghq | np | 03:30 |
| duonghq | will you go to next summit and ptg? | 03:30 |
| Jeffrey4l | guess no ;( | 03:30 |
| duonghq | so, what is your last summit/ptg? | 03:31 |
| Jeffrey4l | i only attend once. it is Barcelona. | 03:32 |
| iniazi | is 5.0.1 out? | 03:47 |
| Jeffrey4l | iniazi, no. | 03:47 |
| iniazi | are the bug fixes in for compute? | 03:47 |
| *** caowei has quit IRC | 03:47 | |
| *** caowei has joined #openstack-kolla | 03:48 | |
| Jeffrey4l | iniazi, sorry? for compute? | 03:48 |
| iniazi | 5.0.0 nova-compute is not working | 03:48 |
| duonghq | I think it's nova-compute? | 03:48 |
| *** jamesbenson has joined #openstack-kolla | 03:48 | |
| iniazi | or atleast for me | 03:48 |
| duonghq | can you provide logs | 03:48 |
| Jeffrey4l | iniazi, is there a bug for this? | 03:48 |
| iniazi | i was talking to egonzalez or inc0 about 12 hours ago and he said it was known problem. yeah let me get you the log entry | 03:49 |
| iniazi | "No compute node record for host HOSTNAME: ComputeHostNotFound_Remote: Compute host HOSTNAME could not be found." and then a stack over and over, on all the nova-computes | 03:51 |
| Jeffrey4l | iniazi, which distro are u using? | 03:52 |
| iniazi | 5.0.0/pike, centos built w/ source | 03:52 |
| Jeffrey4l | it there any bug on lp tracking this? | 03:52 |
| iniazi | oh, i just realized it wasn't inc0/egonzalez. it was rwellum i think who said he was having the same issue. thought it was a known bug. but I didn't create one | 03:55 |
| Jeffrey4l | iniazi, please file a bug for this. :) | 03:55 |
| iniazi | ok.. whats lp? | 03:56 |
| *** mdnadeem has quit IRC | 03:56 | |
| Jeffrey4l | https://bugs.launchpad.net/kolla | 03:56 |
| Jeffrey4l | launchpad | 03:56 |
| iniazi | oh launchpad. | 03:56 |
| iniazi | ok | 03:56 |
| Jeffrey4l | thanks. | 03:56 |
| duonghq | iniazi, what is your nodes configuration? | 03:56 |
| iniazi | centos 7.4 | 03:57 |
| openstackgerrit | zhongshengping proposed openstack/kolla-ansible stable/pike: Fix Pike nova.conf for HyperV https://review.openstack.org/506514 | 03:57 |
| iniazi | actually what specific config do you mean? | 03:57 |
| openstackgerrit | wanghongxu proposed openstack/kolla-ansible master: Make qemu use nova user in centos https://review.openstack.org/506515 | 03:59 |
| duonghq | iniazi, I mean you test on AIO or multinode, and what is distro run on nodes... | 04:07 |
| iniazi | sorry, multinode, centos 7.4. 1 net host, 2 controller, and 3 computes (but deploying nova-compute on controllers also) | 04:08 |
| *** wanghongxu has joined #openstack-kolla | 04:08 | |
| iniazi | submitted this bug... but did I forget to assign a project? | 04:13 |
| iniazi | https://bugs.launchpad.net/kolla/+bug/1718836 | 04:13 |
| openstack | Launchpad bug 1718836 in kolla "nova-compute ComputeHostNotFound_Remote on a new kolla-ansible deployment" [Undecided,New] | 04:13 |
| duonghq | nice, btw I think it should belong to kolla-ansible | 04:14 |
| iniazi | ok, changed | 04:14 |
| *** jamesbenson has quit IRC | 04:15 | |
| iniazi | is there a template with what info I need to put in? i probably forgot some other pertinent information | 04:15 |
| *** coolsvap has joined #openstack-kolla | 04:16 | |
| lxdong | when systemctl stop docker of compute01 which is the other compute node composed up to my cluster to test horizon HA, horizon lost layout and failed login with gateway timeout , otherwise works well.Cluster have enabled haproxy , got any ideas? | 04:17 |
| *** jascott1 has joined #openstack-kolla | 04:18 | |
| *** jamesbenson has joined #openstack-kolla | 04:19 | |
| duonghq | iniazi, you can put it anywhere you fell it should be | 04:23 |
| duonghq | and any infomation you find it related | 04:23 |
| iniazi | hopefully I have enough info. I guess I'll probably get a question about it tomorrow | 04:24 |
| duonghq | ;) | 04:26 |
| jamesbenson | duonghq: I'm deploying kolla 5.0 and got a weird failure in the image pull: http://paste.openstack.org/show/621680/ | 04:27 |
| jamesbenson | Is it because my hostnames are r2-710-1... the '-' causing issues? | 04:27 |
| *** yangyape_ has quit IRC | 04:29 | |
| *** yangyapeng has joined #openstack-kolla | 04:30 | |
| duonghq | jamesbenson, how about other images? | 04:34 |
| *** yangyapeng has quit IRC | 04:34 | |
| *** jtriley has quit IRC | 04:35 | |
| jamesbenson | it quit after that failure, but cinder, common, they pulled successfully | 04:37 |
| jamesbenson | glance... | 04:37 |
| jamesbenson | These passed: http://paste.openstack.org/show/621682/ | 04:39 |
| jamesbenson | ceph is external | 04:39 |
| jamesbenson | duonghq: It's just odd that a pull failed, especially with that message. | 04:40 |
| duonghq | jamesbenson, did you try to pull it manually? | 04:41 |
| jamesbenson | i only know kolla-ansible for pulling.. | 04:42 |
| duonghq | jamesbenson, you can try to grab image name | 04:44 |
| duonghq | and pull it manually | 04:44 |
| jamesbenson | cmd? | 04:44 |
| duonghq | jamesbenson, docker images on build node | 04:45 |
| jamesbenson | export and import? | 04:46 |
| *** itlinux has joined #openstack-kolla | 04:46 | |
| *** janki has joined #openstack-kolla | 04:47 | |
| openstackgerrit | Kevin Zhao proposed openstack/kolla master: nova-libvirt: fix kvm permission issue https://review.openstack.org/501653 | 04:48 |
| *** itlinux has quit IRC | 04:49 | |
| openstackgerrit | Kevin Zhao proposed openstack/kolla master: nova-libvirt: fix kvm permission issue https://review.openstack.org/501653 | 04:51 |
| *** itlinux has joined #openstack-kolla | 04:51 | |
| *** mdnadeem has joined #openstack-kolla | 04:52 | |
| *** jamesbenson has quit IRC | 04:59 | |
| *** itlinux has quit IRC | 05:12 | |
| *** yangyapeng has joined #openstack-kolla | 05:20 | |
| lxdong | Is it because docker registry resided in compute01? | 05:21 |
| *** jtriley has joined #openstack-kolla | 05:24 | |
| lxdong | backend is ceph and osd pool default size = 2 | 05:25 |
| *** Arminder has quit IRC | 05:50 | |
| *** Arminder has joined #openstack-kolla | 05:51 | |
| openstackgerrit | wanghongxu proposed openstack/kolla-ansible stable/pike: Make qemu use nova user in centos https://review.openstack.org/506529 | 05:55 |
| *** aolwas has quit IRC | 06:30 | |
| *** aolwas has joined #openstack-kolla | 06:31 | |
| *** zhurong has quit IRC | 06:32 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Make qemu use nova user in centos https://review.openstack.org/506515 | 06:37 |
| *** seanmurphy has joined #openstack-kolla | 06:41 | |
| *** gfidente has joined #openstack-kolla | 06:56 | |
| *** gfidente has quit IRC | 06:56 | |
| *** gfidente has joined #openstack-kolla | 06:56 | |
| *** dardelean_ has joined #openstack-kolla | 07:04 | |
| *** serlex has joined #openstack-kolla | 07:05 | |
| *** dardelean_ has quit IRC | 07:08 | |
| *** zhurong has joined #openstack-kolla | 07:13 | |
| *** magicboiz has joined #openstack-kolla | 07:32 | |
| *** robbbe has quit IRC | 07:34 | |
| *** pcaruana has joined #openstack-kolla | 07:34 | |
| *** egonzalez has joined #openstack-kolla | 07:44 | |
| *** kornicameister has joined #openstack-kolla | 07:49 | |
| *** hieulq has quit IRC | 07:51 | |
| *** daidv has quit IRC | 07:51 | |
| *** duonghq has quit IRC | 07:51 | |
| *** daidv has joined #openstack-kolla | 07:51 | |
| *** duonghq has joined #openstack-kolla | 07:52 | |
| *** hieulq has joined #openstack-kolla | 07:52 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE] https://review.openstack.org/422786 | 07:52 |
| egonzalez | iniazi, still around? hostnames cannot have dashes on it os-compute-01 | 07:53 |
| Jeffrey4l | egonzalez, do u have any idea about this http://logs.openstack.org/15/506515/2/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/abeb3ac/logs/kolla/nova/nova-compute.txt.gz#_2017-09-22_07_17_02_105 | 07:56 |
| egonzalez | Jeffrey4l, I think have something to be with centos 7.4, kolla gates uses docker 17 while ansible 12.6 | 07:57 |
| egonzalez | the thing is that is working for me locally with kvm | 07:57 |
| Walex | egonzalez: that about dashes is that a question or a statement? | 07:58 |
| Jeffrey4l | i am using docker 1.12.6 locally which works too. | 07:58 |
| Jeffrey4l | i am thinking it is caused by centos 7.4 | 07:59 |
| Walex | egonzalez: because I have an issue with an all-in-one on a host called "test-m" | 07:59 |
| Jeffrey4l | kolla gate works? | 07:59 |
| Jeffrey4l | hrm. i will push a patch to test use latest docker engine. | 08:00 |
| *** jiriprox has joined #openstack-kolla | 08:00 | |
| *** imcsk8 has quit IRC | 08:01 | |
| *** imcsk8 has joined #openstack-kolla | 08:01 | |
| *** iniaziaway has joined #openstack-kolla | 08:03 | |
| egonzalez | Jeffrey4l, yeah, this change also creates an instance to verify it works https://review.openstack.org/#/c/504941/ | 08:03 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install latest docker engine https://review.openstack.org/506556 | 08:03 |
| Jeffrey4l | cool. i pushed a patch to test against docker latest engine. | 08:04 |
| Jeffrey4l | egonzalez, ^^ | 08:04 |
| *** xinliang has quit IRC | 08:04 | |
| *** dardelean_ has joined #openstack-kolla | 08:05 | |
| *** zhangfei has joined #openstack-kolla | 08:05 | |
| *** magicboiz has quit IRC | 08:05 | |
| *** krtaylor has quit IRC | 08:05 | |
| *** harlowja has quit IRC | 08:06 | |
| *** iniazi has quit IRC | 08:06 | |
| *** huzhengchuan has quit IRC | 08:06 | |
| *** magicboiz has joined #openstack-kolla | 08:06 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install docker engine 1.12.6 https://review.openstack.org/506558 | 08:06 |
| *** sgordon has quit IRC | 08:06 | |
| egonzalez | Walex, iniaziaway was wrong, only domains cannot have dash, hostnames can except the first and last digit | 08:08 |
| *** sgordon has joined #openstack-kolla | 08:10 | |
| *** zhubingbing__ has quit IRC | 08:12 | |
| *** krtaylor has joined #openstack-kolla | 08:17 | |
| *** xinliang has joined #openstack-kolla | 08:18 | |
| *** xinliang has joined #openstack-kolla | 08:18 | |
| *** dardelean_ has quit IRC | 08:18 | |
| *** zhubingbing has joined #openstack-kolla | 08:18 | |
| *** huzhengchuan has joined #openstack-kolla | 08:21 | |
| lxdong | when stopping docker of compute01 which is the other compute node composed of cluster to test horizon HA, horizon lost layout and failed login with gateway time-out , otherwise worked well. Cluster has enabled haproxy , docker registry resides in compute01 and ceph pool size is 2 | 08:27 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Fix rabbitmq tag not match in fluentd https://review.openstack.org/503190 | 08:28 |
| *** dardelean has joined #openstack-kolla | 08:31 | |
| *** jascott1 has quit IRC | 08:38 | |
| *** jascott1 has joined #openstack-kolla | 08:38 | |
| *** jascott1 has quit IRC | 08:43 | |
| *** magicboiz has quit IRC | 08:49 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: [TEST][MASTER][KOLLA] https://review.openstack.org/431289 | 08:54 |
| *** skramaja has quit IRC | 08:56 | |
| *** jamesbenson has joined #openstack-kolla | 09:00 | |
| *** livelace has joined #openstack-kolla | 09:03 | |
| *** jamesbenson has quit IRC | 09:04 | |
| hrw | ~curse http://mirror.dfw.rax.openstack.org/ubuntu-cloud-archive | 09:08 |
| hrw | I did a fix which works. then it turned out that gates do not use repos from kolla but own ones | 09:09 |
| hrw | fuck | 09:09 |
| hrw | https://review.openstack.org/#/c/506135/ (use ceph/jewel on ubuntu) will have to wait | 09:11 |
| *** faridda has quit IRC | 09:17 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: base: use ceph/jewel on ubuntu https://review.openstack.org/506135 | 09:17 |
| hrw | found a way | 09:18 |
| *** livelace has quit IRC | 09:19 | |
| *** dardelean_ has joined #openstack-kolla | 09:20 | |
| *** pbourke has quit IRC | 09:20 | |
| *** pbourke has joined #openstack-kolla | 09:20 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install docker engine 1.12.6 https://review.openstack.org/506558 | 09:31 |
| *** zhangfei has quit IRC | 09:36 | |
| *** magicboiz has joined #openstack-kolla | 09:45 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' to necessary tasks (general roles) https://review.openstack.org/398682 | 09:56 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles) https://review.openstack.org/398684 | 09:56 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only neccesary tasks (all other roles) https://review.openstack.org/398685 | 09:56 |
| *** duonghq has quit IRC | 10:00 | |
| *** tovin07_ has quit IRC | 10:01 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install latest docker engine https://review.openstack.org/506556 | 10:02 |
| *** yangyapeng has quit IRC | 10:09 | |
| *** yangyapeng has joined #openstack-kolla | 10:09 | |
| *** yangyapeng has quit IRC | 10:14 | |
| *** sambetts|afk is now known as sambets | 10:15 | |
| *** sambets is now known as bamsetts | 10:15 | |
| *** kevinz has quit IRC | 10:15 | |
| *** hieulq has quit IRC | 10:18 | |
| *** daidv has quit IRC | 10:23 | |
| *** magicboiz has quit IRC | 10:31 | |
| *** caowei has quit IRC | 10:36 | |
| *** caowei has joined #openstack-kolla | 10:36 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Fix Pike nova.conf for HyperV https://review.openstack.org/506514 | 10:38 |
| *** zhurong has quit IRC | 10:39 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Remove unused configuration items from tacker role https://review.openstack.org/505075 | 10:39 |
| openstackgerrit | Merged openstack/kolla-ansible master: Retrieve fluentd logs in gates https://review.openstack.org/503182 | 10:44 |
| *** caowei has quit IRC | 10:45 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Fluentd: rework and fix tail source config https://review.openstack.org/500833 | 10:57 |
| *** dave-mccowan has joined #openstack-kolla | 11:06 | |
| dardelean_ | hi, can this be put on stable/pike? https://review.openstack.org/#/c/499594/ | 11:16 |
| dardelean_ | without this RDP is not working at all | 11:16 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Update simple_cell_setup to manual creation https://review.openstack.org/482513 | 11:20 |
| openstackgerrit | Mathias Ewald proposed openstack/kolla master: Add sensu images https://review.openstack.org/486379 | 11:26 |
| *** rhallisey has joined #openstack-kolla | 11:32 | |
| *** magicboiz has joined #openstack-kolla | 11:35 | |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla-ansible master: Use Swift store for Glance backend even if Ceph is enabled https://review.openstack.org/506599 | 11:37 |
| openstackgerrit | Mathias Ewald proposed openstack/kolla-ansible master: Add role to deploy prometheus https://review.openstack.org/485150 | 11:39 |
| *** yangyapeng has joined #openstack-kolla | 11:47 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install latest docker engine https://review.openstack.org/506556 | 11:58 |
| *** magicboiz has quit IRC | 12:02 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install latest docker engine https://review.openstack.org/506556 | 12:04 |
| rwellum | sdake: inc0 - Workflow needed on https://review.openstack.org/#/c/506278/1 if you get a chance? | 12:26 |
| *** gkadam has quit IRC | 12:31 | |
| *** Croata2 has joined #openstack-kolla | 12:34 | |
| *** huzhengchuan has quit IRC | 12:35 | |
| *** erlon has joined #openstack-kolla | 12:36 | |
| *** jaosorior has quit IRC | 12:40 | |
| *** dave-mcc_ has joined #openstack-kolla | 12:42 | |
| *** dave-mccowan has quit IRC | 12:43 | |
| *** dave-mccowan has joined #openstack-kolla | 12:44 | |
| *** dave-mcc_ has quit IRC | 12:46 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Do not merge, testing kolla-kubernetes gate https://review.openstack.org/506651 | 13:07 |
| *** sbezverk has joined #openstack-kolla | 13:08 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Console broken, as novncProxyPort is incorrectly formed. https://review.openstack.org/506278 | 13:13 |
| *** awiddersheim has quit IRC | 13:14 | |
| *** awiddersheim has joined #openstack-kolla | 13:14 | |
| *** goldyfruit has joined #openstack-kolla | 13:16 | |
| *** janki has quit IRC | 13:27 | |
| *** seanmurphy has quit IRC | 13:32 | |
| *** coolsvap has quit IRC | 13:37 | |
| *** kolla-slack has quit IRC | 13:38 | |
| *** kolla-slack has joined #openstack-kolla | 13:38 | |
| *** fuegoel_ has joined #openstack-kolla | 13:41 | |
| *** fuegoel_ has quit IRC | 13:45 | |
| *** fuegoel_ has joined #openstack-kolla | 13:46 | |
| *** fuegoel is now known as Guest2202 | 13:51 | |
| *** hoaile has joined #openstack-kolla | 13:52 | |
| *** fuegoel has joined #openstack-kolla | 13:52 | |
| *** fuegoel has left #openstack-kolla | 13:54 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: [Trivialfix]Fix typos https://review.openstack.org/505916 | 13:54 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [TEST] install latest docker engine https://review.openstack.org/506556 | 14:02 |
| *** fuegoel has joined #openstack-kolla | 14:06 | |
| *** NobodyCam is now known as BlartVersenwald | 14:06 | |
| *** kevinz has joined #openstack-kolla | 14:07 | |
| *** kevinz has quit IRC | 14:09 | |
| *** kevinz has joined #openstack-kolla | 14:09 | |
| *** jascott1 has joined #openstack-kolla | 14:14 | |
| *** jascott1 has quit IRC | 14:19 | |
| *** infinitydon has joined #openstack-kolla | 14:21 | |
| infinitydon | How to disable RetryFilter in Ocata? | 14:21 |
| infinitydon | Some instances are getting double IP addresses | 14:21 |
| infinitydon | I can't find the configuration in nova.conf | 14:22 |
| *** jamesbenson has joined #openstack-kolla | 14:28 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: refactor build.py https://review.openstack.org/506677 | 14:33 |
| *** mdnadeem has quit IRC | 14:34 | |
| *** jtriley has quit IRC | 14:36 | |
| jamesbenson | inc0: you around? | 14:40 |
| openstackgerrit | Andy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends https://review.openstack.org/468966 | 14:40 |
| *** bmace has quit IRC | 14:42 | |
| *** bmace has joined #openstack-kolla | 14:42 | |
| *** ansmith has joined #openstack-kolla | 14:46 | |
| jamesbenson | egonzalez: ping? | 14:46 |
| infinitydon | Pls my centos instances are getting 2 IPs | 14:48 |
| infinitydon | On Kolla Ocata | 14:48 |
| infinitydon | Any idea why this is happening? | 14:49 |
| *** jtriley has joined #openstack-kolla | 14:51 | |
| pbourke | infinitydon: maybe this will help? https://ask.openstack.org/en/question/85238/instance-getting-two-ip-addresses/ | 14:53 |
| infinitydon | let me check | 14:56 |
| infinitydon | <pbourke> I already checked that link | 14:57 |
| infinitydon | Could not find RetryFilter in my nova.conf file | 14:58 |
| infinitydon | Strange thing is that Ubuntu instances are not behaving like this | 15:01 |
| infinitydon | Only Centos 7 image is behaving like this | 15:01 |
| infinitydon | Got the centos image from the official link: http://cloud.centos.org/centos/7/images/ | 15:02 |
| Zophar | Hello guys... | 15:04 |
| Zophar | Just a simple question: I want to add admin_token to keystone configuration with kolla-ansible... what is the best way to do that? Should i implement it in kolla-ansible? If so should i implement something through genpwd or can i simply add it to globals.yml and then add it the to keystone.conf.j2 template? Or should i look elsewhere? | 15:06 |
| *** lrensing has joined #openstack-kolla | 15:07 | |
| Zophar | I was able to add it through globals.yml and add some line in keystone.conf.j2 and it's working... but as it's a token maybe i should implement it through genpwd tool (and go for a code review).... what will you recommand? | 15:07 |
| Zophar | The genpwd tool use to generate password/ssh-key/uuid... but according to keystone documentation i should generate a random hex of 10.... which would be very specific for the keystone admin token | 15:11 |
| Zophar | Any direction/clue on this topic would be greatly appreciated ;) | 15:12 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Fix ci gate failure https://review.openstack.org/506515 | 15:13 |
| *** vhosakot has joined #openstack-kolla | 15:13 | |
| *** kevinz has quit IRC | 15:14 | |
| *** egonzalez has quit IRC | 15:25 | |
| *** infinitydon has quit IRC | 15:27 | |
| pbourke | Zophar: Id recommend using a combination of passwords.yml and an override file | 15:35 |
| pbourke | Zophar: assuming of course you know admin_token is not recommended in the first place ;) | 15:35 |
| *** serlex has quit IRC | 15:40 | |
| *** jascott1 has joined #openstack-kolla | 15:41 | |
| *** dardelean_ has quit IRC | 15:44 | |
| *** ntpttr_laptop has joined #openstack-kolla | 15:44 | |
| *** gfidente has quit IRC | 15:50 | |
| *** fuegoel_ has quit IRC | 15:51 | |
| *** jascott1 has quit IRC | 15:52 | |
| inc0 | good morning | 15:52 |
| *** jascott1 has joined #openstack-kolla | 15:52 | |
| kfox1111 | inc0: morning | 15:56 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: Helm Native Values Step 2. https://review.openstack.org/506383 | 15:56 |
| *** jascott1 has quit IRC | 15:57 | |
| *** lrensing has quit IRC | 15:57 | |
| vhosakot | morning all | 15:59 |
| vhosakot | after in one min here in the Boston area | 16:00 |
| vhosakot | afternoon* in one min here in the Boston area | 16:00 |
| vhosakot | and, good noon all :) | 16:00 |
| kfox1111 | vhosakot: morning. :) | 16:01 |
| vhosakot | (still) morning (for you) kfox1111 :) lol | 16:02 |
| *** sbezverk has quit IRC | 16:03 | |
| kfox1111 | hehe. :) | 16:03 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml. https://review.openstack.org/505761 | 16:06 |
| *** lrensing has joined #openstack-kolla | 16:08 | |
| *** dardelean_ has joined #openstack-kolla | 16:09 | |
| jamesbenson | inc0: morning | 16:09 |
| jamesbenson | inc0: need to chat with you in a few... meeting here almost done. | 16:09 |
| inc0 | hey jamesbenson | 16:09 |
| inc0 | kk | 16:09 |
| jamesbenson | i'll ping | 16:09 |
| *** dardelea_ has joined #openstack-kolla | 16:11 | |
| *** dardelean has quit IRC | 16:13 | |
| vhosakot | I like how inc0 said "for good or ill" in brackets next to "revolutionary" in his reply about kolla gates :) | 16:13 |
| *** dardelea_ has quit IRC | 16:15 | |
| inc0 | not all revolutions end well;_) | 16:15 |
| *** shardy has quit IRC | 16:17 | |
| vhosakot | right :) | 16:17 |
| *** igordc has quit IRC | 16:19 | |
| jamesbenson | hey inc0 | 16:20 |
| inc0 | what's up? | 16:20 |
| *** jascott1 has joined #openstack-kolla | 16:20 | |
| jamesbenson | so, I was reading the logs from last night, and someone else ran into the same issues as I did it seems. server hostnames can't have '-' in them in pike? | 16:20 |
| inc0 | hmm we don't block that...but some services might | 16:21 |
| inc0 | not sure | 16:21 |
| jamesbenson | egonzalez mentioned it to Walex at 8:08 | 16:22 |
| jamesbenson | http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-09-22.log.html | 16:22 |
| jamesbenson | oh, that was in domains... | 16:22 |
| jamesbenson | weird... | 16:22 |
| jamesbenson | so the issue I had are two fold. | 16:22 |
| jamesbenson | 1st, in bootstrap, filling out /etc/hosts failed because of a '-' error it seemed (I don't have the logs anymore)... but I copied the code in from 4.0.2 and it then /etc/hosts worked and the rest fo the prechecks passed. | 16:23 |
| jamesbenson | 2nd, in image pull, it failed as well: http://paste.openstack.org/show/621731/ | 16:25 |
| *** huzhengchuan has joined #openstack-kolla | 16:25 | |
| jamesbenson | http://paste.openstack.org/show/621722/ | 16:25 |
| jamesbenson | they all failed with the same error | 16:25 |
| jamesbenson | I tried with both ansible 2.3 and 2.2 | 16:25 |
| jamesbenson | Unable to look up a name or access an attribute in template string ({{ inventory_hostname in groups['neutron-bgp-dragent'] }}) | 16:27 |
| jamesbenson | my /etc/hosts: http://paste.openstack.org/show/621732/ | 16:27 |
| kolla-slack | <egonzalez> jamesbenson , ensure your inventory file is up to date for pike release | 16:39 |
| kolla-slack | <egonzalez> Bgp group was added in pike | 16:39 |
| jamesbenson | is it a child of anything? | 16:39 |
| kolla-slack | <egonzalez> of neutron iirc | 16:41 |
| jamesbenson | hmm... yeah, I didn't update that. I only checked the globals was the same between versions. | 16:45 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml. https://review.openstack.org/505761 | 16:46 |
| jamesbenson | egonzalez: bingo. good call! | 16:47 |
| jamesbenson | thank you! | 16:47 |
| kolla-slack | <oxkipo> hey jamesbenson, how are you? Did you upgrade to pike successfully? | 16:50 |
| *** athomas has quit IRC | 16:50 | |
| jamesbenson | oxkipo: I didn't upgrade, I did a fresh deploy. | 16:50 |
| jamesbenson | mostly working...for some reason two servers didn't pull images correctly. | 16:50 |
| kolla-slack | <oxkipo> jamesbenson good, me too :). Had problems with rabbitmq. All images were built successfully | 16:51 |
| *** jascott1 has quit IRC | 16:51 | |
| *** ntpttr_laptop has quit IRC | 16:54 | |
| inc0 | rabbitmq seems to misbehave a lot lately | 16:55 |
| inc0 | which is sad. | 16:55 |
| kolla-slack | <oxkipo> yeah, but since that incident openstack is rock solid | 16:56 |
| inc0 | https://github.com/rabbitmq/rabbitmq-clusterer <- fuck. | 16:56 |
| inc0 | pardon my language | 16:56 |
| kolla-slack | <oxkipo> :) :) | 16:57 |
| inc0 | that explains a lot | 16:57 |
| kolla-slack | <oxkipo> will upgrade to 5.0.1 be painless? | 16:57 |
| inc0 | well, off to work then | 16:57 |
| jamesbenson | oxkipo inc0 egonzalez: pull finished successfully now.. deploying; I'll keep you posted | 16:57 |
| inc0 | less paiful than 4->5 | 16:57 |
| inc0 | thanks jamesbenson | 16:57 |
| kolla-slack | <oxkipo> :) waiting to see, but I will do a test upgrade in a vm | 16:58 |
| kolla-slack | <oxkipo> thanks, I will be here | 16:58 |
| jamesbenson | hmm, fun! | 16:58 |
| jamesbenson | 5.0.1? :-p inc0 | 16:58 |
| jamesbenson | oxkipo in my experience, the upgrades usually work easily within versions | 16:59 |
| jamesbenson | haven't tried 4.0.2 to 5.0.0 | 16:59 |
| inc0 | can't promise rabbitmq behaviour, we need to fix this thing :/ | 16:59 |
| kolla-slack | <oxkipo> jamesbenson remember friday night (my time) deployments and upgrades == not a good plan | 16:59 |
| jamesbenson | lol, never do that! | 17:00 |
| kolla-slack | <oxkipo> @inc0 jamesbenson did you try kolla on coreos? is it possible? | 17:02 |
| kolla-slack | <egonzalez> oxkipo, fridays are read only | 17:02 |
| inc0 | you need to install python + docker-py on coreos | 17:02 |
| *** ntpttr_laptop has joined #openstack-kolla | 17:02 | |
| inc0 | other than that it should be fine | 17:03 |
| inc0 | egonzalez nooo, friday 4pm is RELEASE TIME!!! | 17:03 |
| kolla-slack | <oxkipo> @egonzalez what about bots and automatic deployment and upgrades? are they alowed? | 17:03 |
| kolla-slack | <oxkipo> inc0 ok I will try | 17:03 |
| jamesbenson | inc0: can you deploy with uuid and do a reconfigure to fernet? | 17:04 |
| inc0 | I have no idea | 17:04 |
| inc0 | well | 17:04 |
| inc0 | I'm sure you can but might be more than single command | 17:04 |
| jamesbenson | ...and back again if it fails? (fernet doesn't like my systems, could never get it deployed in 4.x) | 17:05 |
| kolla-slack | <oxkipo> jamesbenson, you have maas and “plenty” of servers. cann’t you deploy 4.0.2 version on them and do an upgrade there? | 17:05 |
| kolla-slack | <oxkipo> I have fernet on 5.0.0 | 17:06 |
| jamesbenson | yes, plan on doing that on our dev cluster | 17:06 |
| jamesbenson | we are always in a state of flux here ;-) | 17:06 |
| kolla-slack | <oxkipo> its always good to clone prod and f*** (inc0 I censor my rude words :D) that you are sure upgrade works | 17:07 |
| *** zhubingbing_ has joined #openstack-kolla | 17:07 | |
| inc0 | you are better man than me | 17:08 |
| kolla-slack | <oxkipo> :) | 17:08 |
| *** jascott1 has joined #openstack-kolla | 17:17 | |
| *** jascott1 has quit IRC | 17:21 | |
| *** itlinux has joined #openstack-kolla | 17:22 | |
| *** jascott1 has joined #openstack-kolla | 17:24 | |
| *** jascott1 has quit IRC | 17:29 | |
| *** bamsetts is now known as sambetts|afk | 17:38 | |
| *** itlinux has quit IRC | 17:40 | |
| vhosakot | jamesbenson: yes, I've seen issues when hostname have hypens (-) in the past. | 18:01 |
| jamesbenson | thanks vhosakot, I got it worked out. I didn't update my multinode file from 4 -> 5 | 18:02 |
| jamesbenson | so I was missing options. | 18:02 |
| *** rwsu has quit IRC | 18:02 | |
| vhosakot | jamesbenson: cool, also, instead if saying "egonzalez mentioned it to Walex at 8:08", you can click on the right on the timestamp in the kolla IRC logs and send the link to exact message at 8:08 http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-09-22.log.html#t2017-09-22T08:08:59 :) | 18:03 |
| vhosakot | jamesbenson: right, good to check all three files when we upgrade (change versions of kolla) - kolla-build.conf, globals.yml and the inventory file. cool | 18:04 |
| *** zhubingbing_ has quit IRC | 18:05 | |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml. https://review.openstack.org/505761 | 18:06 |
| *** huzhengchuan has quit IRC | 18:09 | |
| vhosakot | egonzalez.. good call.. read only fridays.. lol | 18:10 |
| vhosakot | inc0: are you releasing anything in kolla today? | 18:10 |
| inc0 | eee why would I? | 18:10 |
| vhosakot | inc0: lol, I saw you said friday 4 pm in release time here ;) | 18:11 |
| inc0 | no, that's a general rule of thumb | 18:11 |
| vhosakot | ah gotcha | 18:11 |
| inc0 | always release to prod beforee weekend | 18:11 |
| inc0 | and run out of office as soon as it finishes | 18:11 |
| inc0 | or even before | 18:11 |
| vhosakot | lol, right | 18:11 |
| vhosakot | run to bar | 18:11 |
| inc0 | and turn off cellphone | 18:12 |
| *** lrensing has left #openstack-kolla | 18:13 | |
| vhosakot | rofl | 18:14 |
| *** rwsu has joined #openstack-kolla | 18:15 | |
| kolla-slack | <oxkipo> jamesbenson got an idea of doing major upgrades | 18:16 |
| inc0 | jets for tomorrows air show started to come in | 18:17 |
| * inc0 stops music to listen to jets | 18:17 | |
| kolla-slack | <oxkipo> Can you scale down you prod env and deploy 5.0.0 on the decomissioned servers and configure the new deployment as a new region and migrate instances from 4.0.2 to 5.0.0?? | 18:18 |
| kolla-slack | <oxkipo> Should be possible but I haven’t tested it | 18:18 |
| inc0 | uhh | 18:19 |
| inc0 | well | 18:19 |
| kolla-slack | <oxkipo> Will it work or its not like that? | 18:19 |
| inc0 | lots of manual labor as you probably want 2 control planes too | 18:19 |
| inc0 | that being said | 18:19 |
| inc0 | I think it's less risky to just upgrade | 18:19 |
| inc0 | scaling down - no problem | 18:19 |
| inc0 | deploying Pike - no problem | 18:20 |
| kolla-slack | <oxkipo> Yeah, but remember the rabbirmq issue??? :-):-) | 18:20 |
| inc0 | migration of vms...have fun with that | 18:20 |
| inc0 | well technically you could just keep rabbitmq the same | 18:20 |
| jamesbenson | ooo jets :-) | 18:20 |
| kolla-slack | <oxkipo> I had problems when I was upgrading | 18:21 |
| kolla-slack | <oxkipo> We will see | 18:21 |
| jamesbenson | inc0: when you upgrade it messes with the VM's? | 18:21 |
| inc0 | so you can test this: | 18:21 |
| inc0 | when you call kolla-ansible upgrade | 18:21 |
| inc0 | it will output long ansible-playbook command | 18:21 |
| kolla-slack | <oxkipo> Me?? | 18:21 |
| inc0 | stop it there and copy that command | 18:21 |
| inc0 | yes oxkipo;) | 18:21 |
| inc0 | then add flag --skip-tags rabbitmq | 18:21 |
| kolla-slack | <oxkipo> I’m already on 5.0.0 | 18:21 |
| inc0 | ah ok | 18:22 |
| inc0 | jamesbenson: negative | 18:22 |
| inc0 | well, no if you use kvm | 18:22 |
| jamesbenson | ok, thought so | 18:22 |
| inc0 | if you use pure qemu, it will | 18:22 |
| inc0 | but if you use pure qemu and care about vms you're doing it wrong anyway | 18:22 |
| jamesbenson | how many actually use qemu? small %, right? | 18:22 |
| kolla-slack | <oxkipo> Just had an idea to do blue green deploy | 18:23 |
| jamesbenson | oxkipo, that's why we have kolla deployer VM living in our management plane accessible to all of our racks | 18:24 |
| jamesbenson | we can 100% verify that our deployment is exactly the same | 18:24 |
| *** huzhengchuan has joined #openstack-kolla | 18:25 | |
| kolla-slack | <oxkipo> Oh ok | 18:25 |
| jamesbenson | now we have 2 kolla VM's. ;-). one for 4 and one for 5 hours ^_^ | 18:27 |
| jamesbenson | del hours | 18:27 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: Helm Native Values Step 2. https://review.openstack.org/506383 | 18:28 |
| *** jbrooks has quit IRC | 18:28 | |
| vhosakot | killa those rabbits | 18:29 |
| vhosakot | kill those rabbits | 18:29 |
| *** jbrooks has joined #openstack-kolla | 18:30 | |
| *** ntpttr_laptop has quit IRC | 18:32 | |
| *** dardelean_ has quit IRC | 18:33 | |
| jamesbenson | what's the [deployment] section in the multinode file for now? | 18:35 |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml. https://review.openstack.org/505761 | 18:38 |
| *** dmsimard is now known as dmsimard|afk | 18:47 | |
| *** vhosakot has quit IRC | 18:52 | |
| *** vhosakot has joined #openstack-kolla | 18:53 | |
| *** kolla-slack has quit IRC | 18:54 | |
| *** kolla-slack has joined #openstack-kolla | 18:54 | |
| *** pcaruana has quit IRC | 18:56 | |
| *** fuegoel has left #openstack-kolla | 18:59 | |
| *** vhosakot has quit IRC | 18:59 | |
| *** vhosakot has joined #openstack-kolla | 19:00 | |
| jamesbenson | any idea on why this is failing? http://paste.openstack.org/show/621755/ | 19:02 |
| *** dardelean_ has joined #openstack-kolla | 19:07 | |
| *** dardelean_ has quit IRC | 19:11 | |
| kolla-slack | <oxkipo> jamesbenson, first of all, censor out your pass before putting to a public paste :) | 19:14 |
| kolla-slack | <oxkipo> and secondly, can you access the endpoint? | 19:14 |
| jamesbenson | yeah I noticed that.. I can always regen it... | 19:14 |
| kolla-slack | <oxkipo> ok | 19:14 |
| vhosakot | jamesbenson: are you SSL certs fine? | 19:18 |
| jamesbenson | all prechecks, bootstrap_servers, pass. vhosakot: I did the cert generation that kolla recommends. I verified that they are all in the correct path, /etc/kolla/certificates/* | 19:19 |
| jamesbenson | I'm doing another deploy, then I'll check netstat | 19:21 |
| jamesbenson | destroy/deploy.... | 19:22 |
| *** lrensing has joined #openstack-kolla | 19:24 | |
| vhosakot | jamesbenson: did you run "kolla-ansible certificates" | 19:27 |
| jamesbenson | that port is there | 19:27 |
| jamesbenson | vhosakot: yes | 19:27 |
| vhosakot | cool, jamesbenson do you have "kolla_enable_tls_external: "yes" too in globals? | 19:28 |
| jamesbenson | yep | 19:28 |
| vhosakot | cool, it should be fine | 19:28 |
| jamesbenson | agreed, which is why I'm confused... | 19:29 |
| jamesbenson | the IP/port is on all of the controllers | 19:33 |
| *** dmsimard|afk is now known as dmsimard | 19:33 | |
| jamesbenson | where are the certs stored in the controllers? | 19:33 |
| jamesbenson | found it... they match what is on the kolla deployer node. | 19:36 |
| vhosakot | jamesbenson: haproxy.pem and haproxy-ca.pem will be generated and stored in the /etc/kolla/certificates/ directory | 19:37 |
| vhosakot | jamesbenson: https://github.com/openstack/kolla-ansible/blob/master/doc/source/user/advanced-configuration.rst#self-signed-certificates | 19:38 |
| jamesbenson | yes, I matched the /etc/kolla/certificates/haproxy.pem with the /etc/kolla/haproxy/haproxy.pem on the controller and they match | 19:39 |
| kolla-slack | <oxkipo> jamesbenson did you restart haproxy on controllers? | 19:42 |
| jamesbenson | not manually. | 19:43 |
| kolla-slack | <oxkipo> try it | 19:43 |
| *** Suicky has joined #openstack-kolla | 19:48 | |
| jamesbenson | oxkipo no luck | 19:49 |
| kolla-slack | <oxkipo> :S | 19:49 |
| jamesbenson | SSL routines', 'tls_process_server_certificate', 'certificate verify failed'. It seems it's hitting it, but they are bad? | 19:50 |
| kolla-slack | <oxkipo> did you regenerate the certs and try? | 19:51 |
| jamesbenson | twice :-( | 19:51 |
| kolla-slack | <oxkipo> :( | 19:51 |
| jamesbenson | that's why I compared them manually to see if the were different/matched.. | 19:51 |
| kolla-slack | <oxkipo> what about doing deploy on fresh nodes? or you are just running kolla-ansible upgrade? | 19:52 |
| *** Suicky has left #openstack-kolla | 19:52 | |
| jamesbenson | these are fresh nodes. I've only deployed 5 on them (these are my first times) | 19:53 |
| jamesbenson | I'm going to check if the rest of the deploy will work without it.... | 19:53 |
| openstackgerrit | Christopher Nipper proposed openstack/kolla-ansible master: Add details about SRIOV enablement to the networking guide https://review.openstack.org/498112 | 19:53 |
| kolla-slack | <oxkipo> try to deploy without ssl and then try do deploy ssl on top of the deployment | 19:54 |
| *** ntpttr_laptop has joined #openstack-kolla | 19:55 | |
| openstackgerrit | Christopher Nipper proposed openstack/kolla-ansible master: Add support for Neutron SRIOV agent container https://review.openstack.org/487610 | 19:56 |
| jamesbenson | yeah, that's what I'm attempting now. | 19:57 |
| jamesbenson | inc0 would a reconfigure update the tls? | 19:58 |
| *** jascott1 has joined #openstack-kolla | 19:58 | |
| inc0 | jamesbenson: I think yes | 19:59 |
| jamesbenson | well tls it went past the failed step.... | 20:00 |
| jamesbenson | well withouth tls* | 20:00 |
| kolla-slack | <oxkipo> jamesbenson, told ya friday deployments are not very good ;) | 20:01 |
| *** vhosakot_ has joined #openstack-kolla | 20:03 | |
| *** jiriprox has quit IRC | 20:04 | |
| jamesbenson | oxkipo: ha, yeah I know that.... still got to get stuffies done ;-) | 20:05 |
| *** vhosakot has quit IRC | 20:05 | |
| *** ansmith has quit IRC | 20:23 | |
| *** dave-mccowan has quit IRC | 20:32 | |
| *** vhosakot_ has quit IRC | 20:35 | |
| *** vhosakot has joined #openstack-kolla | 20:35 | |
| jamesbenson | passed: 43min 36 sec :-) | 20:37 |
| jamesbenson | no tls though | 20:37 |
| manjeets | just a question I used stable/pike version of kolla, now in cloud im spinning hundreds of vms, I doubt db cleaning not happening properly or there is some bug or it could be something wrong in config | 20:41 |
| manjeets | for first two runs all 100 vms get active but after two runs when i delete them re spin they all end in error | 20:42 |
| manjeets | i see two types of errors (1. no valid host found) (2. unable to attach network) | 20:42 |
| inc0 | manjeets: check scheduler logs | 20:43 |
| inc0 | and nova-compute logs | 20:43 |
| *** vhosakot_ has joined #openstack-kolla | 20:43 | |
| manjeets | inc0, i grepped for ERROR in /var/log/kolla/nova couldn't find anything related its all clean. I'll walk through logs once again | 20:45 |
| *** vhosakot has quit IRC | 20:46 | |
| jamesbenson | hmm..nova-compute are all enabled but down. | 20:48 |
| jamesbenson | I have a feeling I might deploy ocata.... :-( | 20:57 |
| jamesbenson | inc0: I think openstack is mocking me... http://paste.openstack.org/show/621759/ | 20:58 |
| *** jtriley has quit IRC | 21:00 | |
| Croata2 | It is a way to execute a deploy like en "strategy debug" http://docs.ansible.com/ansible/latest/playbooks_debugger.html ? For executing step-by-step and inspecting ansible variables on-the-run | 21:00 |
| jamesbenson | -vvv ? | 21:01 |
| jamesbenson | but it wont do step by step.. | 21:02 |
| Croata2 | Wow lots of info. Gonna analyze output. Thanks jamesbenson | 21:04 |
| jamesbenson | np | 21:04 |
| jamesbenson | for a little less, you could also do -vv.... | 21:04 |
| *** vhosakot has joined #openstack-kolla | 21:15 | |
| *** vhosakot has quit IRC | 21:15 | |
| *** vhosakot has joined #openstack-kolla | 21:16 | |
| *** vhosakot_ has quit IRC | 21:16 | |
| *** harlowja has joined #openstack-kolla | 21:23 | |
| *** jiriprox has joined #openstack-kolla | 21:29 | |
| *** ansmith has joined #openstack-kolla | 21:43 | |
| *** rhallisey has quit IRC | 21:51 | |
| *** jamesbenson has quit IRC | 21:53 | |
| manjeets | inc0, I checked ovs logs only thing i found is a warning message not sure if thats the issue | 21:55 |
| manjeets | 2017-09-22T18:44:16.472Z|00103|netdev|WARN|netdev ports map has dpif port 8 but | 21:55 |
| manjeets | netdev has no ifindex: Unknown error -19 | 21:55 |
| *** jamesbenson has joined #openstack-kolla | 21:55 | |
| *** jamesbenson has quit IRC | 21:57 | |
| *** vhosakot_ has joined #openstack-kolla | 21:58 | |
| *** vhosakot has quit IRC | 22:00 | |
| *** kbyrne has joined #openstack-kolla | 22:11 | |
| *** vhosakot_ has quit IRC | 22:14 | |
| *** vhosakot has joined #openstack-kolla | 22:15 | |
| *** vhosakot has quit IRC | 22:29 | |
| *** vhosakot has joined #openstack-kolla | 22:30 | |
| *** lrensing has quit IRC | 22:40 | |
| jascott1 | any k8s peeps in here? | 22:49 |
| vhosakot | aren't we all k8s peeps? ;) | 23:01 |
| *** erlon has quit IRC | 23:04 | |
| *** Croata2 has quit IRC | 23:08 | |
| jascott1 | hey whats up vhosakot! | 23:08 |
| vhosakot | jascott1: you tell me! I'm staring to learn some go... going go slowly :) | 23:08 |
| jascott1 | nice | 23:09 |
| jascott1 | rebuilding my cluster had no DNS and then I fixed that and pods couldnt talk to k8s API | 23:09 |
| jascott1 | in the end it was all RBAC and yaml ( i hope) | 23:09 |
| jascott1 | hows life? | 23:09 |
| *** goldyfruit has quit IRC | 23:16 | |
| vhosakot | jascott1: cool, RBAC stuff, life's good man :) PTG was very cool | 23:17 |
| jascott1 | yeah def enjoyed meeting kolla peoples such as yourself and rwellum :) | 23:18 |
| vhosakot | yep, miss late night drinking and chatting next gen tech ;) | 23:24 |
| *** vhosakot has quit IRC | 23:40 | |
| *** jtriley has joined #openstack-kolla | 23:44 | |
| *** kevzha01 has joined #openstack-kolla | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!