Wednesday, 2017-07-12

*** tonanhngo has joined #openstack-kolla00:01
*** kbaegis has quit IRC00:06
*** tonanhngo has quit IRC00:07
*** tonanhngo has joined #openstack-kolla00:09
*** tonanhngo has quit IRC00:14
*** tonanhngo has joined #openstack-kolla00:16
*** jbadiapa_ has quit IRC00:17
*** tonanhngo has quit IRC00:20
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Fix wrong extra name for glance_store  https://review.openstack.org/48274900:21
*** eaguilar has joined #openstack-kolla00:22
*** tonanhngo has joined #openstack-kolla00:22
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169000:23
*** awiddersheim has quit IRC00:24
*** awiddersheim has joined #openstack-kolla00:24
masbergood morning, on which container is virsh running?00:25
masberI need to deal with a bug in nova and need to check the vms in virsh00:25
*** vhosakot has quit IRC00:26
*** kbaegis has joined #openstack-kolla00:26
*** tonanhngo has quit IRC00:27
*** kbaegis has quit IRC00:29
*** kbaegis has joined #openstack-kolla00:29
*** kbaegis has joined #openstack-kolla00:29
*** jbadiapa_ has joined #openstack-kolla00:32
*** caowei has joined #openstack-kolla00:33
*** eaguilar has quit IRC00:35
*** goldyfruit has joined #openstack-kolla00:42
*** zhurong has joined #openstack-kolla00:43
*** hieulq has quit IRC00:44
*** daidv has quit IRC00:44
*** eaguilar has joined #openstack-kolla00:55
*** daidv has joined #openstack-kolla00:58
*** lyang__ has joined #openstack-kolla00:58
*** hieulq has joined #openstack-kolla00:59
*** tovin07_ has joined #openstack-kolla01:02
*** YuYangWang has quit IRC01:06
*** dixiaoli has joined #openstack-kolla01:09
*** aagate has quit IRC01:10
*** goldyfruit has quit IRC01:10
*** goldyfruit has joined #openstack-kolla01:11
*** masuberu has joined #openstack-kolla01:14
*** itlinux has joined #openstack-kolla01:15
*** goldyfruit has quit IRC01:16
*** hieulq has quit IRC01:16
*** tovin07_ has quit IRC01:16
*** daidv has quit IRC01:17
*** masber has quit IRC01:18
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169001:20
*** manheim has joined #openstack-kolla01:35
*** eaguilar has quit IRC01:36
*** eaguilar has joined #openstack-kolla01:37
*** manheim has quit IRC01:40
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Revert "Fix a typo and complement doc in ceph-guide.rst"  https://review.openstack.org/47561101:40
*** caoyuan has joined #openstack-kolla01:43
*** vhosakot has joined #openstack-kolla01:46
*** ducttape_ has joined #openstack-kolla01:48
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Removing ovs bridge before destroying container  https://review.openstack.org/47497001:49
*** Pavo has joined #openstack-kolla01:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169001:53
openstackgerritMerged openstack/kolla-ansible master: Use /run for all containers when need access namespace  https://review.openstack.org/48179701:55
openstackgerritMerged openstack/kolla-ansible master: Use unified vars in task  https://review.openstack.org/47316601:56
*** masber has joined #openstack-kolla01:57
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use latest docker engine in gate  https://review.openstack.org/48276301:58
*** masuberu has quit IRC02:00
*** tonanhngo has joined #openstack-kolla02:01
*** ducttape_ has quit IRC02:02
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Use /run for all containers when need access namespace  https://review.openstack.org/48276402:03
*** tonanhngo has quit IRC02:06
*** tonanhngo has joined #openstack-kolla02:06
*** tovin07_ has joined #openstack-kolla02:07
*** hieulq has joined #openstack-kolla02:07
*** daidv has joined #openstack-kolla02:08
openstackgerritJeffrey Zhang proposed openstack/kolla stable/newton: [TEST][NEWTON][KOLLA] Run periodic  https://review.openstack.org/41703302:09
*** daidv has quit IRC02:12
*** tonanhngo has quit IRC02:12
*** unicell has quit IRC02:13
openstackgerritjimmygc proposed openstack/kolla-ansible master: Add Swift backend support to Glance  https://review.openstack.org/45205902:17
*** ducttape_ has joined #openstack-kolla02:19
*** duonghq has joined #openstack-kolla02:19
duonghqmorning guys02:19
*** ducttape_ has quit IRC02:25
vhosakotduonghq: morning, I'm almost done with the etherpad for the upgrade talk for Sydney.  Will send the link once I'm done.02:27
*** daidv has joined #openstack-kolla02:27
duonghqvhosakot, thanks02:27
vhosakotduonghq: np02:27
vhosakotinc0: i see in infra channel that tarballs.o.o started getting flooded again and sites became unresponsive again... hmm02:28
*** jamesbenson has joined #openstack-kolla02:29
*** kbaegis has joined #openstack-kolla02:31
*** itlinux has quit IRC02:31
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Move nova scheduler related parameters to [scheduler] group  https://review.openstack.org/45396602:31
*** kbaegis has quit IRC02:32
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Set api_v2 to True in image-feature-enabled  https://review.openstack.org/48277002:32
*** jamesbenson has quit IRC02:33
*** kbaegis has joined #openstack-kolla02:34
*** kbaegis has quit IRC02:35
vhosakotinc0: since all all gates that build from source pull tarballs from tarballs.openstack.org, I think running such gates is parellal is causing the flood02:37
*** duonghq has quit IRC02:39
*** daidv has quit IRC02:39
*** hieulq has quit IRC02:39
*** tovin07_ has quit IRC02:40
spsuryamorning all02:55
*** zhurong has quit IRC03:08
kolla-slack1<inc0> All gates build from tarballs true03:08
*** itlinux has joined #openstack-kolla03:09
kolla-slack1<inc0> But we will build proxy cache for them in every infra region03:09
*** caoyuan_ has joined #openstack-kolla03:09
*** jamesbenson has joined #openstack-kolla03:11
*** caoyuan has quit IRC03:13
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169003:13
*** jamesbenson has quit IRC03:15
*** brad[] has quit IRC03:16
*** hieulq has joined #openstack-kolla03:16
*** duonghq has joined #openstack-kolla03:17
*** daidv has joined #openstack-kolla03:17
*** dave-mccowan has joined #openstack-kolla03:19
*** tovin07_ has joined #openstack-kolla03:21
*** duonghq has quit IRC03:21
*** daidv has quit IRC03:22
*** itlinux has quit IRC03:23
*** jamesbenson has joined #openstack-kolla03:32
*** schwicht has quit IRC03:35
*** duonghq has joined #openstack-kolla03:35
*** daidv has joined #openstack-kolla03:36
*** jamesbenson has quit IRC03:36
*** eaguilar has quit IRC03:38
*** dave-mccowan has quit IRC03:40
*** zhurong has joined #openstack-kolla03:44
sbezverkany ubuntu experts online?03:46
*** itlinux has joined #openstack-kolla03:54
openstackgerritKuo-tung Kao proposed openstack/kolla-ansible master: copy cinder_backup keyring from cinder_backup  https://review.openstack.org/48279003:57
sbezverkJeffrey4l ping04:00
*** rfxn has joined #openstack-kolla04:10
*** mdnadeem has joined #openstack-kolla04:13
*** Teck72 has quit IRC04:13
*** jamesbenson has joined #openstack-kolla04:13
*** jamesbenson has quit IRC04:18
*** jtriley has joined #openstack-kolla04:26
*** duonghq has quit IRC04:27
*** daidv has quit IRC04:27
*** tovin07_ has quit IRC04:27
*** jamesbenson has joined #openstack-kolla04:29
*** hieulq has quit IRC04:30
*** jtriley has quit IRC04:31
*** yingjun has joined #openstack-kolla04:32
*** pcaruana has joined #openstack-kolla04:41
Jeffrey4lsup sbezverk04:42
sbezverkJeffrey4l the same :) that image.. cannot add into cinder-volume helm chart version dependency, it must stay the same..04:44
Jeffrey4lmeans? need add the iscsid_target image?04:44
sbezverkyou see we have mitaka, newton and ocata all use the same helm chart for cinder-volume04:44
sbezverkyeah04:44
Jeffrey4lbut i do not get the point. does this related to other branches?04:45
*** duonghq has joined #openstack-kolla04:45
sbezverkok mitaka and newton will not support lioadm04:45
sbezverkbut ocata will support ot04:46
*** daidv has joined #openstack-kolla04:46
sbezverkright now at the gate we have all three versions jobs04:46
Jeffrey4laha, there is no mitaka or newton branch for kolla-k8s?04:46
sbezverkthey all use exactly the same charts  for all three versions04:46
sbezverkkolla-k8s is almost version agnostic04:46
*** hieulq has joined #openstack-kolla04:47
*** jamesbenson has quit IRC04:47
sbezverkbut we deal with difference in versions by combining/enabling.disabling  different containers04:47
Jeffrey4lso there will not have branch in kolla-k8s?04:47
sbezverkright04:47
sbezverkno branching only versions04:48
sbezverk1.0 etc04:48
Jeffrey4ldoesn't dynamic mod load works?04:48
sbezverkno because if cinder-volume called for newton image, how I can know that inside of charts?04:49
sbezverkand I need to know that because newton will use tgtd04:49
sbezverkso cinder-volume chart should not load the module04:49
sbezverkyou see it adds nightmare into the chart and we try to keep charts version agnostic04:49
*** unicell has joined #openstack-kolla04:50
sbezverkso combination cinder-volume + tgtd will work with mitaka and newton but cinder-voume + iscsi-tagrget will work with ocata and above04:50
sbezverkbut in all these cases cinder-volume is the same chart04:51
Jeffrey4limho, version agnostic is a nightmare too. if will full of if-else in deployment logic04:51
sbezverkpossibly but we are not there04:51
Jeffrey4lfor example, ocata nova require nova cell but mitaka not.04:51
sbezverkmaybe we will decide later to switch but so far we are version agnostic04:51
sbezverkyep and we handle it04:52
sbezverkwith packaging cell only with ocata deployment04:52
sbezverkbut it is done by orchestration tool04:52
Jeffrey4lthen chart should know the what the version really is. it is not version agnostic,04:53
Jeffrey4lsince openstack is adding more and more feature. you can hardly not deploy without know what the image version is.04:55
sbezverkchart is version agnostic, but deployment tool know which version is the target04:55
sbezverkJeffrey4l for now we seem to be ok04:56
*** coolsvap has joined #openstack-kolla04:56
Jeffrey4li do not see the difference between nova cell and cinder-volume + lioadm04:57
sbezverkas I said we might reconsider it later but for now please unblock me :)04:57
sbezverkI mean you do not have to use it in kolla or kolla ansible04:57
*** pcaruana has quit IRC04:58
Jeffrey4lhrm... :(   unload is OK. but when kolla-ansible implement such feature, we probably use cinder-volume + dynamic mod load.04:59
Jeffrey4lunlock**05:00
sbezverkand it is great, if ansible decides to use this way, great, we might compare then results05:01
sbezverkand see which way is more optimal based on use05:01
Jeffrey4lkolla-ansible use such pattern in lots of container. including nova_libvirt ( load kvm ) and ironic conduction ( load iscsi_tcp)05:03
Jeffrey4lon the other hand, it is not a bid deal to load iscsi_target_mod module on newton and mitaka branch, even you do not use lioadm05:06
*** vhosakot has quit IRC05:06
sbezverkJeffrey4l right, but not all ansible ways are the ideal for k8s05:06
sbezverkyou cannot it might conflict on ports05:07
sbezverktgtd will open 3260 right away, not sure how module will react05:07
Jeffrey4lthat's a issue. let me find how iscsi_target works.05:08
Jeffrey4li guess run tgtd and iscsi_target_mod should be OK.05:08
Jeffrey4lrun them at the same time *05:08
sbezverkwhat about to have two flavours? why everything has to be ansible way?05:10
Jeffrey4lnot be ansible way. just wanna to find a better way.05:11
sbezverkbut then you have to know how it is best for k8s too, right?05:12
sbezverkbased on our current architecture05:12
Jeffrey4lyes. i am trying to understand.05:12
Jeffrey4lso my question is: " it is not a bid deal to load iscsi_target_mod module on newton and mitaka branch, even you do not use lioadm"05:12
sbezverkwhy would I want to load it if I do not need it?05:13
sbezverkcan you guarantee it will not fire back at one point?05:14
Jeffrey4lthe we can use dynamic load i mentioned yesterday? just pass one variable from deployment tool to indicate load/unload that module.05:14
Jeffrey4lit will not fire back at one point?  run tgtd and iscsi_target_mod at the same time?05:15
sbezverkyes05:15
Jeffrey4li can test this. I guess i this it should be OK. load iscsi_target_mod do not listen on port. it is kernel feature.05:16
Jeffrey4li guess targetcli talk with kernel through /proc folder.05:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169005:16
Jeffrey4li am trying to make clear of this.05:16
*** krtaylor has quit IRC05:17
sbezverkI am not so sure about it, targetcli creates targets in configfs and then module builds portals05:20
sbezverkwhich listens on 326005:21
Jeffrey4llet me test this. the easier way to test is: run cinder with tgtd, create volumes and move to lioadm, then create volume again.05:21
Jeffrey4liscsi_target_mod do not listen on port.05:22
sbezverkI do not know how all this will behave under different circumstances and even if you load it in your test bed, where is the guarantee it will cover all possible cases??05:22
sbezverkJeffrey4l what listens then?05:22
Jeffrey4ltargetcli talk with kernel. through certain file in /sys or /proc05:22
*** jamesbenson has joined #openstack-kolla05:23
sbezverkwhich process listens on 3260 then?05:23
Jeffrey4ltgtd?05:23
sbezverktargetcli is not active all the time?05:23
sbezverkno there is no tgtd on the picture with lioadm05:23
Jeffrey4lwait. let me search something about this. i have no idea about those now.05:24
Jeffrey4lanother way is ask some experince guys that: tgtd works with iscsi_target_mod at the same time?05:24
sbezverkno guys can guarantee anything05:25
Jeffrey4l;(05:25
sbezverkthe way to reduce is to minimize the risk05:25
sbezverkby avoiding this situations05:25
sbezverkload only what you need, etc..05:25
Jeffrey4lload only what you need is OK. i said one solution: "just pass one variable from deployment tool to indicate load/unload that module."05:26
sbezverkanyway it is late.. I will have to bring up this at the meeting, because05:26
sbezverkI see we are not moving anywhere05:26
*** daidv has quit IRC05:27
*** duonghq has quit IRC05:27
sbezverkI cannot add any logic to the chart, period05:27
sbezverkcharts stays version agnostic05:27
sbezverkwe deal with different version by combining pieces05:27
Jeffrey4lanyway let talk this in today's meeting, ok?05:27
sbezverkso this is how it is now and we cannot change it05:27
sbezverkyes05:27
*** hieulq has quit IRC05:27
*** jamesbenson has quit IRC05:28
*** tonanhngo has joined #openstack-kolla05:28
*** janki has joined #openstack-kolla05:40
*** duonghq has joined #openstack-kolla05:44
*** daidv has joined #openstack-kolla05:44
*** hieulq has joined #openstack-kolla05:45
*** lpetrut has joined #openstack-kolla05:46
*** itlinux has quit IRC05:52
*** prateek has joined #openstack-kolla05:58
*** Teck7 has joined #openstack-kolla06:02
*** rfxn has quit IRC06:05
*** manheim has joined #openstack-kolla06:10
*** manheim has quit IRC06:14
*** tonanhngo has quit IRC06:28
*** tonanhngo has joined #openstack-kolla06:32
*** tonanhngo has quit IRC06:34
*** SwapnilKulkarni[ has joined #openstack-kolla06:38
*** SwapnilKulkarni[ has left #openstack-kolla06:39
*** SwapnilKulkarni[ has joined #openstack-kolla06:40
*** SwapnilKulkarni[ has left #openstack-kolla06:40
*** lpetrut has quit IRC06:41
*** dixiaoli has quit IRC06:41
*** openstackgerrit has quit IRC06:48
-openstackstatus- NOTICE: FYI, ask.openstack.org is down, review.o.o is slow - please have patience until this is fixed06:51
*** kman has joined #openstack-kolla06:53
*** zhurong has quit IRC06:55
spsuryahttps://www.irccloud.com/pastebin/ZLfCboBR/06:57
*** jamesbenson has joined #openstack-kolla06:58
spsuryarwellum: FYI06:58
spsuryastuck06:58
masberhi, where are the containers taking the configuration files from? I have neutron_server container complaining about --> oslo_config.cfg.ConfigFilesNotFoundError: Failed to find some config files: /etc/neutron/plugins/ml2/ml2_conf_sriov.ini06:59
masberI found the missing file here https://docs.openstack.org/ocata/config-reference/networking/samples/ml2_conf_sriov.ini.html and I copied in this location in the controller node /etc/kolla/neutron-server/ but still can't find it07:01
masberdo I need to put the file inside the container?07:01
*** jamesbenson has quit IRC07:02
*** tonanhngo has joined #openstack-kolla07:03
*** vincent_vdk has quit IRC07:05
*** vincent_vdk has joined #openstack-kolla07:06
*** unicell has quit IRC07:08
*** unicell has joined #openstack-kolla07:11
*** shardy has joined #openstack-kolla07:13
*** skramaja has joined #openstack-kolla07:15
*** kman has quit IRC07:17
*** jamesbenson has joined #openstack-kolla07:19
*** hieulq has quit IRC07:19
*** duonghq has quit IRC07:20
*** daidv has quit IRC07:20
*** tonanhngo has quit IRC07:20
*** jamesbenson has quit IRC07:23
*** pcaruana has joined #openstack-kolla07:31
*** zhurong has joined #openstack-kolla07:32
*** unicell has quit IRC07:34
*** egonzalez has joined #openstack-kolla07:34
*** daidv has joined #openstack-kolla07:35
*** hieulq has joined #openstack-kolla07:35
*** duonghq has joined #openstack-kolla07:35
*** reidrac has joined #openstack-kolla07:39
reidracgood morning07:41
*** pcaruana has quit IRC07:41
*** kristian__ has joined #openstack-kolla07:44
*** kristian__ has quit IRC07:45
*** pcaruana has joined #openstack-kolla07:45
*** serlex has joined #openstack-kolla07:48
-openstackstatus- NOTICE: Gerrit is going to be restarted, due to low performance07:49
serlexhaha07:53
-openstackstatus- NOTICE: Gerrit has been successfully restarted07:56
*** kristian__ has joined #openstack-kolla08:00
*** jamesbenson has joined #openstack-kolla08:00
*** openstackgerrit has joined #openstack-kolla08:04
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Move nova scheduler related parameters to [scheduler] group  https://review.openstack.org/45396608:04
*** jamesbenson has quit IRC08:05
*** manheim has joined #openstack-kolla08:24
*** kristian__ has quit IRC08:26
*** iniazi_ has joined #openstack-kolla08:26
*** manheim has quit IRC08:28
*** manheim has joined #openstack-kolla08:29
*** iniazi has quit IRC08:29
*** pcaruana has quit IRC08:33
*** serlex has quit IRC08:35
*** serlex has joined #openstack-kolla08:35
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Remove all kolla-kubernetes configurations  https://review.openstack.org/48285208:39
*** jamesbenson has joined #openstack-kolla08:42
*** jascott1 has quit IRC08:44
*** dklyle has joined #openstack-kolla08:45
*** jascott1 has joined #openstack-kolla08:45
*** david-lyle has quit IRC08:45
*** pcaruana has joined #openstack-kolla08:46
*** karimb has joined #openstack-kolla08:46
*** jamesbenson has quit IRC08:46
*** jascott1 has quit IRC08:49
*** jbadiapa_ has quit IRC08:50
*** jbadiapa_ has joined #openstack-kolla08:52
*** mgoddard_ has joined #openstack-kolla08:53
*** caoyuan has joined #openstack-kolla08:53
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Move nova scheduler related parameters to [scheduler] group  https://review.openstack.org/45396608:54
*** pbourke has quit IRC08:55
*** caoyuan_ has quit IRC08:56
*** karimb has quit IRC08:56
*** pbourke has joined #openstack-kolla08:57
*** tvignaud has quit IRC08:58
*** klindgren has joined #openstack-kolla09:06
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Remove ceilometer-api and ceilometer-collector services  https://review.openstack.org/47075209:07
*** klindgren_ has quit IRC09:07
*** karimb has joined #openstack-kolla09:07
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER  https://review.openstack.org/47567009:08
*** tvignaud has joined #openstack-kolla09:11
openstackgerritMick Thompson proposed openstack/kolla-ansible master: Omit outward_rabbitmq from check for upgrade  https://review.openstack.org/48286109:14
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Ansible strategy for Rolling upgrade  https://review.openstack.org/48286309:19
openstackgerritMick Thompson proposed openstack/kolla-ansible master: Omit outward_rabbitmq from check for upgrade  https://review.openstack.org/48286109:20
*** tonanhngo has joined #openstack-kolla09:21
*** tonanhngo has quit IRC09:23
*** jamesbenson has joined #openstack-kolla09:23
*** lpetrut has joined #openstack-kolla09:27
*** jamesbenson has quit IRC09:28
*** dciabrin has quit IRC09:31
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Use openvswitch firewall instead of iptables hyper driver  https://review.openstack.org/47946509:32
*** pcaruana has quit IRC09:32
*** pcaruana has joined #openstack-kolla09:32
openstackgerritMick Thompson proposed openstack/kolla-ansible master: Omit outward_rabbitmq from check for upgrade  https://review.openstack.org/48286109:33
*** athomas has joined #openstack-kolla09:36
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Ansible strategy for Rolling upgrade  https://review.openstack.org/48286309:36
*** magicboiz has quit IRC09:38
*** sambetts|afk is now known as sambetts09:40
*** yingjun has quit IRC09:40
*** jamesbenson has joined #openstack-kolla09:44
*** dciabrin has joined #openstack-kolla09:46
*** jamesbenson has quit IRC09:49
*** kristian__ has joined #openstack-kolla09:49
*** karimb has quit IRC09:50
*** caowei has quit IRC09:53
*** brad[] has joined #openstack-kolla09:57
*** karimb has joined #openstack-kolla09:58
*** iniazi_ has quit IRC10:04
*** hieulq has quit IRC10:16
*** daidv has quit IRC10:17
*** duonghq has quit IRC10:18
*** jamesbenson has joined #openstack-kolla10:20
*** jamesbenson has quit IRC10:24
*** dklyle has quit IRC10:28
*** david-lyle has joined #openstack-kolla10:28
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Fix opendayligh custom release  https://review.openstack.org/48289410:28
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Fix opendaylight custom distribution  https://review.openstack.org/48289410:29
hawiquestion: i enabled enable_ceph_rgw and enable_ceph_rgw_keystone, but having trouble of finding endpoint from where to use service itself10:31
hawihow to find it?10:31
*** iniazi has joined #openstack-kolla10:32
hawiopenstack endpoint list shows some swift        | object-store   | True    | internal  | http://192.168.253.199:6780/swift/v110:33
hawiand admin and public urls are same obviously (trying it on all-in-ine)10:34
hawiall-in-one setup10:34
egonzalezhawi, rgw uses swift endpoint10:34
hawiyes, true - this is what i understood, but trying to connect to it gives me 404 not found10:35
hawii guess it should be somehow accessible from this url?10:36
hawii get <?xml version="1.0" encoding="UTF-8"?><ListAllMyBucketsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>anonymous</ID><DisplayName></DisplayName></Owner><Buckets></Buckets></List10:37
hawiAllMyBucketsResult>10:37
egonzalezhawi, verify haproxy binds VIP in port 6780 and host IP in 6780 too10:37
hawiwhen i try it from url without swift/v110:37
*** k_mouza has joined #openstack-kolla10:39
egonzalezhawi, iirc with rados first need to create something before any other thing10:40
egonzalezhawi, can you try swift post something and then swift stats10:40
*** zhurong has quit IRC10:41
*** bmace has quit IRC10:41
k_mouzahey guys! I have a small issue when running a kolla-ansible deploy. It gets stuck in the "Creating haproxy mysql user" play, with the error unable to connect to database, check login_user and login_password are correct or /var/lib/ansible/.my.cnf has the credentials. Exception message: (1130, \"Host '<hostname>' is not allowed to connect to this MariaDB server\")"}10:42
k_mouzathat's with the stable/ocata release of kolla10:43
egonzalezk_mouza, are mariadb containers running?10:43
k_mouzaI've checked and it is restarting constantly, which I thought it was because of the error I was seeing10:44
k_mouzacould there be something with the container image ?10:44
egonzalezk_mouza, there was any other error before during deployment, from this " "Host '<hostname>' is not allowed to connect to this MariaDB server" i guess bootstrap was not done properly10:45
k_mouzahmm ok, let me rerun bootstrap again10:46
egonzalezk_mouza, is bootstrap_mariadb container present?10:46
egonzalezk_mouza, if bootstrap fails in mariadb need to destroy and deploy again10:46
k_mouzaonly the "mariadb" container exists and it is restarting constantly10:47
k_mouzaI've destroyed the environment, I'll rerun the bootstrap servers and then re-deploy10:48
*** xinliang has quit IRC10:48
egonzalezk_mouza, by bootstrap I mean mariadb bootstrap (executed during deploy), not bootstrap-servers10:48
k_mouzaah ko10:49
k_mouzaok*10:49
k_mouzait doesn't fail at that point10:49
egonzalezk_mouza, then check logs at /var/lib/docker/volumes/kolla_logs/_data/mariadb/mariadb.log10:50
hawiegonzalez: i was able to create container and upload from horizon there, but unable to connect via url and cli10:50
hawiegonzalez: of course i'm not familiar how to use python-swiftclient (3.3.0), yet10:51
*** bmace has joined #openstack-kolla10:53
openstackgerritMerged openstack/kolla master: Add OVN specific neutron-server container  https://review.openstack.org/47989010:54
*** xinliang has joined #openstack-kolla11:01
*** jamesbenson has joined #openstack-kolla11:02
*** duonghq has joined #openstack-kolla11:03
*** daidv has joined #openstack-kolla11:04
*** hieulq has joined #openstack-kolla11:04
*** dciabrin has quit IRC11:05
*** jamesbenson has quit IRC11:06
*** rhallisey has joined #openstack-kolla11:07
*** hieulq has quit IRC11:08
*** dciabrin has joined #openstack-kolla11:09
*** daidv has quit IRC11:16
*** duonghq has quit IRC11:16
*** ansmith has quit IRC11:19
*** dave-mccowan has joined #openstack-kolla11:19
*** jiriprox has joined #openstack-kolla11:23
*** emccormick has joined #openstack-kolla11:24
jiriproxprivate chat11:26
*** daidv has joined #openstack-kolla11:30
*** shardy is now known as shardy_lunch11:32
jiriproxegonzalez: Hi, I'm able to login to https://review.openstack.org/ but I can't post gerrit review due to Authentication failed. What needs to be set?11:36
*** schwicht_at_work has joined #openstack-kolla11:43
*** jamesbenson has joined #openstack-kolla11:44
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169011:44
*** hieulq has joined #openstack-kolla11:44
*** daidv_ has joined #openstack-kolla11:45
*** kristia__ has joined #openstack-kolla11:45
*** duonghq has joined #openstack-kolla11:45
*** kristian__ has quit IRC11:47
*** jamesbenson has quit IRC11:48
*** daidv_ has quit IRC11:49
egonzalezhawi, paste ``swift --debug list`` output11:49
egonzalezstrange that with horizon works but not with command11:50
hawiegonzalez: https://pastebin.com/CKJkd3KD11:51
*** karimb has quit IRC11:52
hawiim almost sure that the way im doing it is wrong11:52
*** pradk has joined #openstack-kolla11:55
egonzalezhawi, just use swift --debug list without any other parameter11:55
egonzalezhawi, those parameters are needed if adminrc credentials are not the same to be used for the command11:56
hawihttps://pastebin.com/5b2XctpD11:58
egonzalezjiriprox, pushed a change to fix the odl custom distro bug, kind of different from your proposed change to github https://review.openstack.org/#/c/482894/11:58
hawibut what is interesting is https://pastebin.com/93Wc3Qww11:58
egonzalezjiriprox, to push code, have to add the ssh in gerrit/preferences11:58
hawii can curl container if it's set to public, and denies it when it's private11:58
egonzalezhawi, add --auth-version 3 in the command12:00
*** jamesbenson_ has joined #openstack-kolla12:01
hawiso it actually works, but i just have no idea how to access it with swift client :)12:01
hawiERROR:swiftclient.service:Authorization Failure. Authorization failed: The resource could not be found. (HTTP 404)12:01
jiriproxegonzalez, I've seen your change. I'm testing it. Nevertheless I would like to get my environment running for future12:01
hawiis still the error12:01
*** k_mouza has quit IRC12:01
*** awiddersheim has quit IRC12:01
*** awiddersheim has joined #openstack-kolla12:02
*** k_mouza has joined #openstack-kolla12:03
*** daidv_ has joined #openstack-kolla12:03
egonzalezhawi, any error/warn in keystone logs? can you share your endpoints?12:04
*** jamesbenson_ has quit IRC12:05
*** schwicht_at_work has quit IRC12:08
*** shardy_lunch is now known as shardy12:10
*** ansmith has joined #openstack-kolla12:18
jiriproxegonzalez, What does it mean "add the ssh in gerrit/preferences"?  Do you mean add SSH Public key?12:18
egonzalezjiriprox, yeah12:19
hawiegonzalez: sure, takes some time for me to organize it. no logs found for it12:19
egonzalezjiriprox, also have to accept OpenStack Individual Contributor License Agreement ICLA in https://review.openstack.org/#/settings/agreements12:19
egonzalezhawi, try using --os-auth-url http://192.168.253.199:5000/v3 in the command, remove any other option12:20
egonzalezhawi, i think the problem is swift client does not point to correct url12:20
hawigreat, it seems to work!12:21
hawiegonzalez: thanks!12:21
egonzalezhawi, almost all clients detect auth url based on version (v3) and url (versionless) and auth to the correct url. seems swift does not do that :/12:23
*** krtaylor has joined #openstack-kolla12:23
*** leni1 has joined #openstack-kolla12:23
*** schwicht has joined #openstack-kolla12:24
rwellumsbezverk - is this expected? I thought 4.0.2 was the latest stable? https://www.irccloud.com/pastebin/IQEUrnym/12:26
egonzalezrwellum, images were not pushed to dockerhub https://hub.docker.com/r/kolla/centos-source-openvswitch-db-server/tags/12:27
*** kbyrne has quit IRC12:28
rwellumegonzalez: thanks. Deliberate?12:28
*** serlex has quit IRC12:28
*** schwicht has quit IRC12:28
*** ducttape_ has joined #openstack-kolla12:29
*** hrw has quit IRC12:30
*** jtriley has joined #openstack-kolla12:30
*** kbyrne has joined #openstack-kolla12:30
*** hrw has joined #openstack-kolla12:32
*** ducttape_ has quit IRC12:32
*** schwicht has joined #openstack-kolla12:33
*** dciabrin has quit IRC12:34
openstackgerritMerged openstack/kolla-ansible master: Fix glance Upload large image haproxy timeout when using external  https://review.openstack.org/47598812:35
*** imcsk8 has quit IRC12:37
*** imcsk8 has joined #openstack-kolla12:37
sbezverkrwellum: at the gate we run 4.0.0 because kolla cores do not consistently pushing new images to docker hub, so missing images it is very expected..12:37
*** klindgren_ has joined #openstack-kolla12:38
*** kbyrne has quit IRC12:38
sbezverkrwellum you are ubuntu expert right?12:38
hawiegonzalez: is it possible to use some other clients as well for accessing swift?12:38
*** kbyrne has joined #openstack-kolla12:39
*** calbers has quit IRC12:39
*** akwasnie_ has joined #openstack-kolla12:39
*** manheim_ has joined #openstack-kolla12:39
*** daidv__ has joined #openstack-kolla12:39
egonzalezhawi, no idea, last time I used radosgw a couple years ago I had to create a script for all the aws shitty auth12:40
*** zhenguo_ has joined #openstack-kolla12:40
*** v1k0d3n_ has joined #openstack-kolla12:40
hawianyway, it's really cool i got it working so quick12:40
*** chandankumar has quit IRC12:41
egonzalezhawi, you can try adding v3 to adminrc file12:41
sbezverkrwellum: I cannot understand why this code works perfectly fine in centos and does not in ubuntu :( http://paste.openstack.org/show/615148/12:41
*** daidv_ has quit IRC12:41
*** v1k0d3n has quit IRC12:41
*** zhenguo has quit IRC12:41
*** klindgren has quit IRC12:41
*** akwasnie has quit IRC12:41
*** numans has quit IRC12:41
*** eglute_s has quit IRC12:41
*** v1k0d3n_ is now known as v1k0d3n12:41
*** akwasnie_ is now known as akwasnie12:41
*** zhenguo_ is now known as zhenguo12:41
*** mgoddard_ has quit IRC12:41
*** chandankumar has joined #openstack-kolla12:41
*** mrunge has quit IRC12:41
*** numans has joined #openstack-kolla12:41
*** eglute has joined #openstack-kolla12:42
*** mrunge has joined #openstack-kolla12:42
*** manheim has quit IRC12:42
*** mgoddard_ has joined #openstack-kolla12:42
*** pbourke has quit IRC12:43
*** rwallner has joined #openstack-kolla12:43
*** rwallner has quit IRC12:43
*** ddyer2 has quit IRC12:43
*** kbyrne has quit IRC12:44
*** rwallner has joined #openstack-kolla12:44
*** calbers has joined #openstack-kolla12:44
*** ddyer has joined #openstack-kolla12:44
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169012:44
*** dgonzalez has quit IRC12:44
*** rods has quit IRC12:44
*** pbourke has joined #openstack-kolla12:45
*** rods has joined #openstack-kolla12:46
*** kbyrne has joined #openstack-kolla12:46
*** dgonzalez has joined #openstack-kolla12:46
*** dciabrin has joined #openstack-kolla12:46
*** jbrooks has quit IRC12:48
*** jbrooks has joined #openstack-kolla12:50
reidracgot my fluentd RPM accepted in security:logging repo: https://build.opensuse.org/package/show/security:logging/fluentd12:51
reidracgetting close!12:51
reidrac(that's for Kolla's port to SUSE)12:52
egonzalezreidrac, cool o/12:53
reidrac\o/12:53
*** karimb has joined #openstack-kolla12:55
*** schwicht has quit IRC12:56
*** xinliang has quit IRC12:56
*** xinliang has joined #openstack-kolla12:57
egonzalezreidrac, will need a blueprint for suse support12:57
reidracegonzalez: understood; we may have a chat or I may send an email with information12:58
reidracre: what I have, what are my targets, etc; and we can discuss the process12:58
reidracI think someone told me that perhaps would be useful to streamline a bit the process of adding a new distro12:59
reidracI'm happy with that, whatever you think is best12:59
egonzalezreidrac, add a topic for today meeting https://wiki.openstack.org/wiki/Meetings/Kolla12:59
reidracsure12:59
egonzalezbut basically will need, images build/deploy, gates and maintain support for the rest of your life ;)13:03
reidracI'm not sure I understand how to add a topic entry; but anyway, I'm part of a research spike and I'm pushing forward with the port of some components13:04
reidracbut I can't commit to anything yet13:05
reidracwhat do you want to discuss today?13:05
egonzalezyour plans about suse, what is done, what will do and if someone else have something to say13:06
egonzalezlogin in the meetings site, and push edit button next to Agenda for next meeting (July 5th, 2017)13:07
reidracI have a meeting at 16 UTC13:07
reidractime travel? today is July 12nd13:07
reidracif you don't mind I'll do it next week, I'm not sure I can re-shuffle my meeting of today in that short time13:08
egonzalezreidrac, no problem13:08
*** schwicht has joined #openstack-kolla13:08
reidracthanks13:09
*** serlex has joined #openstack-kolla13:11
*** goldyfruit has joined #openstack-kolla13:14
*** zhurong has joined #openstack-kolla13:14
emccormickHey guys. When I run deploy a second time (adding some services) I get an error from a domain conflict for Magnum. Shouldn't that just move on if the domain already exists?13:15
emccormickfatal: [v69ctrl01]: FAILED! => {"attempts": 10, "changed": false, "extra_data": null, "failed": true, "msg": "Error in creating user magnum_trustee_domain_******** (Inner Exception: Conflict occurred attempting to store user - Duplicate entry found with name magnum_trustee_domain_******** at domain ID 7a0199a6e62c4fa1995d94261bff169b. (HTTP 409) (Request-ID: req-5dead4ed-ee69-4c18-8182-3c12d4b14b74))"}13:15
*** mdnadeem has quit IRC13:16
egonzalezpbourke, around? re horizon dev mode13:20
pbourkeegonzalez: hey13:20
egonzalezpbourke, should line 34 be murano_dev_mode instead of horizon_dev_mode https://review.openstack.org/#/c/474595/3/ansible/roles/horizon/defaults/main.yml ?13:20
egonzalezhorizon_murano_dev_mode13:21
pbourkeegonzalez: seems so, good catch13:21
egonzalezjust asking, maybe there was some reason13:22
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add dev mode for Horizon  https://review.openstack.org/47459513:22
pbourkeegonzalez: thanks13:22
*** tonanhngo has joined #openstack-kolla13:23
*** tonanhngo has quit IRC13:25
*** skramaja has quit IRC13:25
*** jtriley has quit IRC13:28
jiriproxegonzales, Authentication seems to work now nevertheless following error appeared: ICLA contributor agreement requires current contact information.  I can't update contact info: https://review.openstack.org/#/settings/contact  -> Server Error - Cannot store contact information.   Any help?13:33
*** caoyuan has quit IRC13:34
*** ansmith has quit IRC13:34
egonzalezjiriprox, sure, go to your openstack profile https://www.openstack.org/profile/13:37
egonzalezand click button "Change to Foundation Member" or something similar13:38
egonzalezto push code your profile need to be foundation member13:38
*** coolsvap has quit IRC13:45
*** schwicht has quit IRC13:46
*** jtriley has joined #openstack-kolla13:46
*** leni1 has quit IRC13:47
*** jascott1 has joined #openstack-kolla13:47
*** schwicht has joined #openstack-kolla13:48
*** ansmith has joined #openstack-kolla13:50
*** jascott1 has quit IRC13:52
*** kristia__ has quit IRC13:52
rwellumsbezverk - this is my output with your code. Note I had to do 'sudo cat' at the end. https://www.irccloud.com/pastebin/ZOfECCYd/13:55
sbezverkrwellum : thanks have no clue why it fails in ubuntu based container13:56
sbezverkrwellum : by some reason echo does not insert value of iqn variable13:57
rwellumDo you know what the failure is?13:57
rwellumoh13:57
rwellumMaybe put quotes around the echo?13:57
rwellumecho ' InitiatorName=iqn.1994-05.com.redhat:$iqn'13:58
dmsimardSo, this thing: # The number of threads to user while pushing Images. Note: Docker can not handle threading push properly (integer value)14:00
*** goldyfruit has quit IRC14:01
dmsimardIt creates concurrent docker push commands I would assume ? It doesn't control, say, Docker's --max-concurrent-uploads ?14:01
dmsimardAt least looking at https://github.com/openstack/kolla/blob/e3a1c1de20c31754bac920f6b16da53e923827df/kolla/image/build.py#L1137 :/14:01
*** janki has quit IRC14:03
*** kristian__ has joined #openstack-kolla14:04
*** hongbin has joined #openstack-kolla14:06
openstackgerritjiriprox proposed openstack/kolla master: Enable config parameter opendaylight_distro propagation to dockerfile. https://bugs.launchpad.net/kolla/+bug/1703774  https://review.openstack.org/48297414:07
openstackLaunchpad bug 1703774 in kolla "Configuration parameter opendaylight_distro doesn't work" [Low,In progress] - Assigned to Eduardo Gonzalez (egonzalez90)14:07
dmsimardTrying to speed up pushes..14:07
*** kristian__ has quit IRC14:11
*** kiennt has joined #openstack-kolla14:11
*** kristian__ has joined #openstack-kolla14:12
sbezverkrwellum : I can try, just confused bash is the same on centos and ubuntu why it is fine on centos and not fine on ubuntu14:12
sbezverkrwellum : btw thanks for your help..14:12
openstackgerritMerged openstack/kolla master: Install net-tools for neutron-base container  https://review.openstack.org/48179814:13
rwellumsbezverk: np not much help yet. Only think I think is either permissions, or different versions of shell - which is why I hate shell coding :)14:13
jiriproxegonzalez, thank you for help to set up my environment. You can abandon my change (https://review.openstack.org/482974) once your change is merged14:15
*** tonanhngo has joined #openstack-kolla14:20
*** tonanhngo has quit IRC14:21
serlexanyone using "kolla_enable_tls_external=yes"?14:23
sbezverkrwellum : for sure not permission as I run with priv 0 in that container, maybe shell, will check versions14:23
egonzalezserlex, yep14:24
*** jamesbenson has joined #openstack-kolla14:25
serlexI thought I got right, but getting "connection refused" when connecting to horizon on HTTPS14:25
sbezverkrwellum : btw I submitted just for kicks a session on kolla-k8s project overview14:25
egonzalezserlex, to which url are you accessing to public VIP or internal VIP?14:26
serlexpublic VIP14:26
*** bmace has quit IRC14:26
serlexI clearly got another variable wrong, but not sure what14:27
*** ansmith has quit IRC14:27
*** duonghq has quit IRC14:27
*** duonghq has joined #openstack-kolla14:27
duonghqevening guys14:27
*** duonghq_ has joined #openstack-kolla14:28
*** goldyfruit has joined #openstack-kolla14:28
egonzalezserlex, this is my config http://paste.openstack.org/show/615169/14:31
*** goldyfruit has quit IRC14:31
jamesbensoninc0: ping14:33
serlexthanks egonzalez, that's what I have as well...hmm14:34
serlexI will try clean deploy14:34
*** itlinux has joined #openstack-kolla14:37
*** ansmith has joined #openstack-kolla14:40
jamesbensoninc0: I got it to all finally deploy properly with 4.0.2... doing some initial testing now.14:42
*** k_mouza has quit IRC14:42
*** ansmith_ has joined #openstack-kolla14:45
*** Bico_Fino has joined #openstack-kolla14:45
*** itlinux has quit IRC14:49
jamesbensonI'm looking to see what the default settings are for services, I know about /etc/kolla/config/, is there another spot besides that?14:51
*** zhurong has quit IRC14:53
*** k_mouza has joined #openstack-kolla14:53
egonzalezjamesbenson, /etc/kolla/<service_name> config is for user custom config14:54
jamesbensonyeah, I saw that in the docs, is there another spot too?14:54
jamesbensonfor the defaults14:54
egonzalezansible templates14:56
jamesbensonthanks :-)14:57
inc0good morning14:57
inc0jamesbenson: good to hear14:58
inc0I wonder what's up with ceph tho14:58
*** david-lyle has quit IRC14:58
*** david-lyle has joined #openstack-kolla14:58
duonghqmorning inc014:59
inc0hey Duong14:59
inc0we need to submit talk proposal14:59
inc0are we ready for that?14:59
*** prateek has quit IRC14:59
k_mouzaHello all (again)! Hitting some nova-compute errors. Basically the nova-compute and nova-libvirt containers are constantly restarting, so the controller can't access the nova-compute service on the hypervisor nodes.15:00
k_mouzaAnyone had that before15:00
k_mouzadeploying with kolla stable/ocata15:01
inc0k_mouza: logs please15:01
inc0/var/lib/docker/volumes/kolla_logs15:01
egonzalezk_mouza, what distro, logs from docker logs <container_name>15:01
*** jamesbenson has quit IRC15:02
k_mouzaI'll grab them in a min and I'll let you know15:02
rwellumsbezverk: +1 on the submission.15:03
rwellumLet me know if you need backup.15:03
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Install net-tools for neutron-base container  https://review.openstack.org/48299815:03
*** aagate has joined #openstack-kolla15:04
*** jamesbenson has joined #openstack-kolla15:05
*** jamesbenson has quit IRC15:10
sbezverkrwellum sure, you could talk about your tool15:10
rwellumsbezverk: maybe if I get it committed to upstream15:11
*** karimb has quit IRC15:12
*** goldyfruit has joined #openstack-kolla15:13
sbezverkrwellum now we have orchestration folder where all deployment tools would go. why do not you build PS and then it would be a part or kolla-k8s at the same level as ansible playbooks or some other deployment mechanisms15:15
sbezverkrwellum unless you plan to sell it ;)15:17
rwellumI have not seen that folder sbezverk but I'll put it there. The issue is I have to get it through legal at $$JOB15:17
rwellumShould be another day or 2. Not Cisco - which took me 9 months. :)15:18
rwellumOooh - i should sell it. Maybe a startup you think?15:18
sbezverkrwellum I know the pain ;)15:18
*** goldyfruit has quit IRC15:18
sbezverkrwellum if somebody is ready to invest a few millions why not :)15:18
duonghqinc0, yes, iirc Vikram told me that he prepared something, we should submit it asap15:19
rwellumI have a good friend who's an investor - and he's actually looking at Kubernetes now that I told him abou ti...15:19
*** prateek has joined #openstack-kolla15:20
inc0let's do it right after meeting15:20
duonghqsure15:21
*** athomas has quit IRC15:24
sbezverkwhat is wrong with zuul, the job stays queued for more than hour..15:24
*** daidv has quit IRC15:26
*** emccormick has quit IRC15:26
*** daidv has joined #openstack-kolla15:29
*** k_mouza has quit IRC15:31
*** coolsvap has joined #openstack-kolla15:34
*** k_mouza has joined #openstack-kolla15:34
*** schwicht has quit IRC15:36
*** aagate has quit IRC15:39
*** jamesbenson has joined #openstack-kolla15:41
*** schwicht has joined #openstack-kolla15:42
spsuryamorning inc015:47
*** k_mouza has quit IRC15:47
spsuryasup sbezverk15:48
sbezverkspsurya hey, not happy with zuul performance15:48
spsuryanot faced in near time15:49
sbezverkwell the job sits in the queue for 1.5 hours now15:50
*** k_mouza has joined #openstack-kolla15:50
*** kiennt has quit IRC15:51
openstackgerritMerged openstack/kolla-ansible master: Add ceph rgw object store support into trove  https://review.openstack.org/47155315:52
*** itlinux has joined #openstack-kolla15:54
*** egonzalez has quit IRC15:57
*** egonzalez has joined #openstack-kolla15:57
*** egonzalez90 has joined #openstack-kolla15:58
*** jascott1 has joined #openstack-kolla16:00
duonghqanybody heard anything from Vikram? if he join the meeting?16:00
*** schwicht has quit IRC16:02
*** egonzalez has quit IRC16:02
*** goldyfruit has joined #openstack-kolla16:03
*** goldyfruit has quit IRC16:03
*** goldyfruit has joined #openstack-kolla16:03
*** vhosakot has joined #openstack-kolla16:12
*** goldyfruit has quit IRC16:14
*** goldyfruit has joined #openstack-kolla16:15
*** emccormick has joined #openstack-kolla16:23
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support configuration of custom fluentd outputs  https://review.openstack.org/48302616:24
*** shardy has quit IRC16:25
*** emccormickva has joined #openstack-kolla16:26
*** emccormick has quit IRC16:28
*** kristian__ has quit IRC16:29
*** reidrac has quit IRC16:31
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support configuration of custom fluentd outputs  https://review.openstack.org/48302616:32
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable proxy cache for tarballs download  https://review.openstack.org/48221716:35
*** lpetrut has quit IRC16:35
*** emccormick has joined #openstack-kolla16:35
*** emccormickva has quit IRC16:38
*** k_mouza has quit IRC16:45
*** emccormickva has joined #openstack-kolla16:51
*** egonzalez90 has quit IRC16:51
*** emccormick has quit IRC16:53
*** daidv has quit IRC16:53
*** pcaruana has quit IRC16:56
inc0vhosakot duonghq ready to roll?16:57
duonghqyeah16:57
inc0vhosakot: you had something already prepared?16:57
*** manheim_ has quit IRC16:58
vhosakotinc0: I haven't created the etherpad yet, let create one and start working on, yes, I have some notes about the upgrade talk and I'll add them in the etherpad we create.16:58
inc0sure, go ahead vhosakot16:59
vhosakotinc0: 1 sec..16:59
*** unicell has joined #openstack-kolla16:59
*** kristian__ has joined #openstack-kolla16:59
spsuryanight all17:01
duonghqlater spsurya17:01
vhosakotnight spsurya17:02
vhosakotinc0: duonghq here is the ehterpad https://etherpad.openstack.org/p/kolla-sydney-upgrade-talk.  Let's work on it.17:03
spsuryaduonghq: np, please continue  :)17:04
*** mgoddard_ has quit IRC17:05
Jeffrey4linc0, sbezverk hi. sorry i am late.17:08
inc0no worries17:09
sbezverkJeffrey4l Hi, np, we can chat now I guess17:09
Jeffrey4lyep.17:09
*** emccormickva has quit IRC17:09
Jeffrey4lso. what do u think about that patch? inc017:10
sbezverkJeffrey4l inc0 here is my point.. for kolla-k8s charts are bricks17:10
sbezverkhow you put those breaks should not change its content17:10
sbezverkit is business of deployment tool17:11
Jeffrey4li tested tgtd and iscsi_target_mod. they can start at the same time.17:11
sbezverkJeffrey4l they can but 1: why would I need it both if I need only 1, 2: can you guaranteed it will never cuase any iossues?17:11
Jeffrey4lbut when create iscsi and start it in iscsi_target_mod, it will try to listen on port 3260.17:12
inc0sbezverk: how about adding rts lib to volume image17:12
vhosakotinc0: duonghq is rolling upgrade a "hot" upgrade where VMs do not go down?17:12
inc0and running volume image with command "modprobe" as a job for example?17:12
sbezverkinc0 rtslib is already rthere17:12
sbezverkwhat I am against is adding module to cinder volume17:12
Jeffrey4linc0, the key point sbezverk and i  talk is: which container load the module.17:12
sbezverkand then passing information to the chart whether to load it or not17:13
inc0vhosakot: vms shouldn't go down in any upgrade, rolling is when API's and services don't go down17:13
duonghqvhosakot, the official definition is https://governance.openstack.org/tc/reference/tags/assert_supports-rolling-upgrade.html17:13
vhosakotinc0: yeah, cool.. just wanted to check,17:13
inc0sbezverk: and loading module using command in k8s and cinder-volume as image would be ok?17:13
sbezverkinc0: yes and it follow what we already have17:14
duonghqactually, supports-accessible-upgrade is tag for no-impact on data plane, but it's very hard to test17:14
sbezverkas tgtd17:14
inc0sbezverk: and we won't need new image right?17:14
sbezverkso we follow the same model, cinder-volume + tgtd ot cinder-volume + iscsi-target17:14
Jeffrey4linc0, sbezverk wanna to use a new image which is called iscsi_target to load the module and sleep the images forever.17:15
Jeffrey4lsbezverk, tgtd is a service. whereas iscsi_target is not.17:15
sbezverkJeffrey4l so what? what is important how users see it17:15
sbezverkthey see consistency17:15
sbezverka pair for 1  use case and 1 for another17:16
vhosakotinc0: duonghq: update whatever you think is needed in the ehterpad for the upgrade talk, and we'll finalize an abstract.17:16
inc0sbezverk: my question is, can we use one of containers we already have?17:16
sbezverkinc0: we could use cindeer-volume17:17
Jeffrey4lwhen i use iscsi_target. i do not care why iscsi_target started. and if i have no idea about tgt. i will ask my self, isn't iscsi_target_mod implemented by kernel? why there is a contianer for this?17:17
sbezverkbut it is a bit overkill17:17
sbezverkas it has way more than needed17:17
inc0I think it's opposite, we lower number of images17:17
duonghqvhosakot, I think one more thing we need is notify user about downtime if any17:17
Jeffrey4land why that kernel is run as sleep forever?17:17
inc0and since cinder-volume will need to run in node anyway17:17
inc0to interact with lvm17:17
Jeffrey4lthat container is run as sleep forever?17:18
inc0we don't lose any disk space17:18
sbezverkJeffrey4l and it is bad because ??17:18
vhosakotduonghq: yes, handling and accouncing downtime is very important in any upgrade.. agreed.17:18
inc0docker run cinder-volume modprobe iscsi_target_mod17:18
Jeffrey4lit make no sense to start a sleep infinity container.17:18
inc0then it won't run forever and we won't need new container17:18
inc0and sbezverk you can do this in a job17:19
sbezverkit is only your opinion, I do not get why you try to enforce it,17:19
inc0hey guys calm down17:19
Jeffrey4linc0, need care about node restart or service migrate.17:19
sbezverkit is opensource after all and I am not sure why you took lawenforcement role17:19
inc0I agree that having sleeping container at very least would make debugging env harder17:19
inc0more noise17:20
inc0sbezverk: hold on now, Jeffrey's points are valid17:20
inc0it's not personal17:20
sbezverkjob will not work17:20
inc0why?17:20
sbezverkbecause who is going to restart it17:20
inc0you mean to start it up on node restart?17:21
sbezverkyes17:21
inc0but you can still do this in pod17:21
inc0and have pod with command modprobe17:21
sbezverkinc0: you run job at the deoyment time17:21
sbezverkthen everything is deployed and nice17:22
inc0yeah I get that and it's valid17:22
sbezverkthen you need to reboot compute node17:22
inc0but I still don't get why we need new container17:22
sbezverkwho is going to re start job to loadf module agaoin?>17:22
duonghqvhosakot, I think I'm done17:22
sbezverkinc0: I am ok to reuse cinder volume17:22
*** lpetrut has joined #openstack-kolla17:22
sbezverkit is just it is way mopre heavy that it is really needed17:23
inc0right, for kolla-k8s let's reuse cinder volume and for ansible deal with modprobe with ansible17:23
inc0(same way we do with other modules)17:23
sbezverkthat is all we are blamed for large images already17:23
inc0sbezverk: but you need this image on the node anyway17:23
sbezverkso having a small specific image for a change is not too bad17:23
inc0so in fact if you add new image it'll only waste space17:23
Jeffrey4lthe new added iscsi_target image isn't small.17:23
Jeffrey4land cinder_volume is already on the node.17:24
inc0you still need to have cinder-volume image on same node17:24
sbezverkJeffrey4l that you should yourself why it is not small17:24
inc0sbezverk: do you agree that you'll need cinder-volume image there?17:24
duonghqvhosakot, so what should we do next?17:24
Jeffrey4lsorry, i missed something. iscsi_target's parent is base.17:25
inc0duonghq vhosakot I think we need to write abstract in a more text than list17:25
sbezverkinc0: ok I will try to see if cinder-volume image will serve for the purpose and let you know.. I need to test it.. it should17:25
Jeffrey4lbut it still more than 500MB.17:25
vhosakotduonghq: cool, I'll leave the etherpad as-is for few hours today so we can add whatever we have in mind, then one of us will just submit the abstract.17:25
inc0sbezverk: please do17:25
inc0I think it's simple matter to solve really:)17:26
Jeffrey4land as inc0 said. cinder_volume is already and must on the same node.17:26
vhosakotinc0: duonghq yeah, abstract needs text/paragraph, not bulleted list :)17:27
vhosakotbrb, rebooting17:27
duonghqand only 1000 chars is allowed17:27
inc0so, sbezverk Jeffrey4l are we in agreement? Using cinder-volume is at least good for now?17:27
Jeffrey4lLGTM.17:27
inc0let's not optimize prematurely17:27
sbezverkinc0: if it works then fine..17:27
inc0cool, let's try that17:28
inc0thank you guys17:28
*** jamesbenson has quit IRC17:28
*** tonanhngo has joined #openstack-kolla17:31
sbezverkinc0: with current cinder-volume it will not work, just tested17:32
inc0why?17:32
sbezverkas it is missing targetcli tool17:32
*** kristian__ has quit IRC17:32
inc0let's add it then17:32
*** sambetts is now known as sambetts|afk17:32
sbezverkit is needed to restore and save targets17:32
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Remove all kolla-kubernetes configurations  https://review.openstack.org/48285217:32
vhosakotwow, that's a bug change ^^17:33
Jeffrey4lyep. targetcli tool should be added.17:33
vhosakotbig*17:33
inc0vhosakot: we moved k8s out of ansible so it's good17:33
vhosakotgood to remove kolla-k8s configs/references from kolla-ansible17:33
vhosakotinc0: yes17:33
*** tonanhngo has quit IRC17:33
Jeffrey4l37 files changed, 47 insertions(+), 229 deletions(-) , i like delete codes ;)17:34
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169017:34
sbezverkJeffrey4l hm you share that with sdake ;) , he likes to wiping out code from repo17:35
Jeffrey4llol17:35
*** tonanhngo has joined #openstack-kolla17:36
inc0less code is good;) if we keep things workign17:36
*** manheim has joined #openstack-kolla17:37
sbezverkI do not know, I like to keep things ;) just in case17:37
inc0lol17:37
Jeffrey4lgit will keep things ;)17:38
inc0there is name for it, hoarding17:38
inc0;)17:38
*** schwicht has joined #openstack-kolla17:39
duonghqvhosakot, inc0 I draft a short paragrahp for abstract17:40
*** ddyer has quit IRC17:40
*** manheim has quit IRC17:41
inc0vhosakot: lol good quote17:41
vhosakot;)17:41
duonghqyeah, lol17:41
duonghqnice quote17:41
vhosakott's ain't about how hard ya hit, it's all about how hard you can get hit and keep upgrading forward17:42
vhosakothaha17:42
inc0we're putting it on slide.17:43
vhosakot:)17:43
*** manheim has joined #openstack-kolla17:43
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Adding targetcli tool to cinder-volume  https://review.openstack.org/48305017:43
vhosakotinc0: I'm loving "Poke a Pike"17:43
vhosakot:)17:44
*** Mannheim has joined #openstack-kolla17:44
inc0we should have some pikemen photos in slides too17:44
*** mgoddard_ has joined #openstack-kolla17:45
duonghq+1 inc0, but I think we should finish the abstract 1st17:45
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Do Not Merge, kolla-kubernetes gate tests  https://review.openstack.org/46106317:46
*** emccormick has joined #openstack-kolla17:47
vhosakotinc0: duonghq pike means interstate-90 (the longest highway in the US that connects Boston to Seattle) here in the Boston area..17:48
*** lpetrut has quit IRC17:49
vhosakot"I'm taking the pike because the backroutes are messed up with snow" is a common sayinh17:49
inc0also nice piece of trivia for presentation:)17:49
duonghqoh, nice17:49
inc0are we doing live demo of working upgrade on stage17:50
inc0?17:50
inc0would be cool:)17:50
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use log-file rather than logfile in gnocchi extend start script  https://review.openstack.org/48305517:50
duonghqsure, but it will be time consuming17:51
inc0there are ways:)17:51
inc0to make it work17:51
*** ddyer has joined #openstack-kolla17:51
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]TEST CLEAN CEILOMETER  https://review.openstack.org/47567017:51
inc0for example we can kick off upgrade and keep talking17:51
duonghqyup17:51
duonghqvhosakot, inc0  can I take a sleep and catch up with you guys in a few hours?17:55
*** jamesbenson has joined #openstack-kolla17:56
inc0duonghq: sure17:56
duonghqcya17:56
inc0we can submit17:56
inc0and edit later if somethign is off17:56
inc0bye17:56
*** jascott1 has quit IRC17:57
duonghqsure, please add me as speaker so I can contribute to it17:57
inc0ofc17:57
duonghqbye17:57
*** duonghq has quit IRC17:57
jemcevoyinc0:  Will you be going to the Cloud Native (docker) Meetup tonight?17:58
vhosakotduonghq_: good night!17:58
inc0no, I have kittens in shelter to care about:)17:58
inc0my wife volunteers and I help her17:58
vhosakotcool17:59
jemcevoyCatch you next time then...  Have fun with the kittens... (sniff, sniff, I think I need to change the catbox here!!!)18:00
inc0and I could definetly use some quality kitten time;)18:00
*** jamesbenson has quit IRC18:00
*** jascott1 has joined #openstack-kolla18:04
*** jascott1 has quit IRC18:04
*** emccormick has quit IRC18:05
*** ducttape_ has joined #openstack-kolla18:06
*** jamesbenson_ has joined #openstack-kolla18:07
rwellumsbezverk: for 2.0.0 - you said it works in the gates - I am seeing a lot of issues. Is there a values.yaml file I could look at?18:08
sbezverkrwellum: it is 2.0.2 with some containers 3.0.0 you need to check which ones18:09
inc0vhosakot: wanna submit upgrade talk?18:10
sbezverkthe best way is to check one of v2 gate jobs, and check in logs/dockerimages18:10
*** lpetrut has joined #openstack-kolla18:10
rwellumsbezverk: don't have much clue on how to pick that apart. This is where I find the gate code hard to interpret - reproduce manually etc. But I'll look.18:11
sbezverkrwellum one sec18:12
sbezverkI am looking for an example18:12
*** dan__ has joined #openstack-kolla18:12
sbezverkrwellum http://logs.openstack.org/90/481690/37/check/gate-kolla-kubernetes-deploy-ubuntu-binary-2-iscsi-nv/023fd01/logs/docker_images.txt18:12
sbezverkthis is job for v2, gives you an idea of version of images18:13
sbezverkrwellum we do not have any source v2 images used/testwed18:14
rwellumsbezverk: I am building keystone, horizon and cinder from source, then trying 2.0.218:15
*** Mannheim has quit IRC18:15
*** dan__ has quit IRC18:16
*** Mannheim has joined #openstack-kolla18:16
rwellumSo a combination I guess.18:17
rwellumsbezverk: the list above is great - ty!18:18
sbezverkrwellum give it a try but since we do not test this config at the gate it is hard to predict results18:18
rwellumsbezverk: I think cinder will be the issue if anything. My source is 2.x, but the above uses 3.x.18:19
rwellumI might be better using 3.x as a base and sources the three with 2.x? :)18:20
sbezverkrwellum I played a bit with v3 and the only issue I hit was with ironic, but you do not need it I suspect right now18:21
rwellumMight try - I think I got further when I accidentally did this before.18:21
rwellumsbezverk: any luck with the ubuntu container?18:22
*** emccormick has joined #openstack-kolla18:23
*** ddyer has quit IRC18:23
*** jemcevoy has quit IRC18:24
sbezverkrwellum: yes :( initi container was using 'sh' for running commands, it seems there is a difference in implementation 'sh' in ubuntu and centos, when I switch to bash, it started working with both distros..18:26
vhosakotinc0: yes, I can submit upgrade talk, will do today18:26
inc0cool18:26
inc0wanna wrap up customization too?18:26
vhosakotinc0: are you submitting the DockerHub publisher talk?18:26
inc0depends, if you want to submit it too, feel free to;)18:27
*** ddyer has joined #openstack-kolla18:27
vhosakotsure, I can submit the DockerHub+customization talk too, np18:27
inc0thank you18:27
inc0do we need anything else for it? Abstract I wrote works?18:27
inc0rwellum vhosakot?18:27
rwellumsbezverk: thought so :) Always stick to bash imo. But then you need to use [[]] etc ::)18:27
rwelluminc0: I like the abstract as is. But are you combining with the dockerhub or not?18:28
vhosakotinc0: are you talking about the abstract in https://etherpad.openstack.org/p/kolla-sydney-custom-repo-talk ?18:29
vhosakotit looks good, yeah18:29
inc0yeah18:29
inc0title?18:29
rwellumCan we get a vote going? :)18:30
rwellumOk I have voted..18:31
rwellumGotta say thought when I think about 'images that fill my imagination' - it's not kolla.18:32
inc0vhosakot: we voted for 2 so pick one you like more:)18:32
vhosakoti voted too :)  for "Images that fit your imagination. Deep dive into container images in Kolla"18:32
inc0lol18:32
inc0cool, so we're done on both right?18:33
vhosakotinc0: for the upgrade talk, I wanna vote for "Poke a Pike" :)18:33
inc0hehe18:33
vhosakotinc0: rwellum so, shall i lock the titles, speakers and submit them today?18:34
vhosakotdoung too ^^^18:34
inc0we can modify stuff later if we need to, but that sounds good to me18:34
rwellumvhosakot: I keep asking - are we combining the talks?18:34
vhosakotright18:34
vhosakotrwellum: yes18:35
inc0we will have 2 distinct talks - images and upgrades18:35
rwellumSounds great then.18:35
inc0no gate/dockerhub talk on it's own18:35
rwellumack18:35
vhosakotinc0: rwellum does the "Images that fit your imagination. Deep dive into container images in Kolla " cover both DockerHub+customization topic ?18:35
inc0yes18:36
rwellumYes18:36
vhosakotI meant does the title cover, I know the talk itself covers/combines both topic.18:36
inc0I think it makes sense to combine these two and make image-centric talk18:36
inc0we never had one like this18:36
vhosakotyes18:36
rwellumvhosakot: I think it covers both but no1 100% sure - hence why I asked about the combining.18:37
rwellumAlso I can't type.18:37
*** jascott1 has joined #openstack-kolla18:37
inc0Title doesn't need to "cover"18:37
vhosakotinc0: rwellum cool, I'll submit the combined talk today... good work..18:37
inc0it needs to be eye catching:)18:37
inc0abstract covers both18:37
vhosakotright18:38
rwellumFair point.18:38
inc0thanks Vikram!18:38
vhosakotnp18:38
inc0bbiaf, gonna hunt for lunch18:38
vhosakotinc0: I'll submit the upgrade talk too today18:38
rwellumThanks guys - it's a privilege to be included.18:38
vhosakotrwellum: haha, np, everyone's same here/open source :)18:39
inc0I wouldn't use term privilege, you are as much part of this community as we are, but thanks:)18:39
rwellumvhosakot: no according to sbezverk I am to turn my k8s tool into a startup and make a million bucks... ;)18:39
inc0now we have titles all left to do is to implement these things and make talk stuff:D18:39
vhosakotright, we're all privilege to drink Fosters, hopefully ;)18:40
inc0ok, brb18:41
*** lpetrut has quit IRC18:41
vhosakotrwellum: lol, that startp idea is not bad... no company has figured out k8s fully ;)18:41
inc0I expect k8s consultants to make a lot of $ in following years18:42
vhosakotinc0: N-->O upgrade worked like a charm when i tested it last time.  so, hoping implementation is not a blocker, I'll start doing it.18:43
inc0vhosakot: gates are on you;)18:43
inc0dockerhub publisher is on me18:43
vhosakotcool18:43
rwellumvhosakot: is the upgrade process documented?18:43
*** mgoddard_ has quit IRC18:44
vhosakotrwellum: yes  https://github.com/openstack/kolla-ansible/blob/master/doc/operating-kolla.rst18:45
inc0bbiaf18:46
vhosakot"kolla-build --tag <new version>"18:46
rwellumvhosakot: that's cool. But boy we need more than just upgrades in an Operation Guide?18:46
sbezverkvhosakot you are joking, how about google?? do you think they have not still figured it out !?!?!18:47
*** lpetrut has joined #openstack-kolla18:48
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable proxy cache for tarballs download  https://review.openstack.org/48221718:50
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support  https://review.openstack.org/48169018:51
vhosakotsbezverk: haha, ofcourse google knows k8s, they invented it.  I read k8s was started in early 2000's, hardened internally by Google as the "Borg shceduler" in 2004-2005, and finally released to public and made open source in 2014.18:52
vhosakotofcourse, founders of a new technology knows how to do it, Google figured out k8s long time back.18:53
rwellumAnd they gave it out as free for a reason... Look at Android? :)18:54
inc0vhosakot: which means they have it pretty much figured out;)18:54
vhosakotyeah, Android too :)18:54
inc0I'd bet Red Hat also have it figured18:54
vhosakotLoot at OpenShift :)18:54
inc0ok got to run before people go to lunch and my sandwitch will be hit with long line18:54
jascott1^this checks out18:55
*** coolsvap has quit IRC19:03
inc0back19:07
*** jamesbenson_ has quit IRC19:10
rwellumsandwich ok?19:11
inc0sandwich awesome19:11
inc0I have nice sandwich shop 2min walking from my home19:11
inc0it's literally closer than caffeteria is to my desk at office19:12
jascott1haha everything is closer to me when Im at home as well19:12
rwellumIt's like 98 outside though and I've walked miles today. My English DNA does not stand up to the heat well.19:12
inc0jascott1: but I'm talking about place where I can go eat outside:)19:13
inc0rwellum: where are you?19:13
inc0It's really really nice here in OR today19:13
rwellumNC19:13
jascott1oh man btw they have a e-san thai cart at JF now. red curry was super fantastic yesterday19:14
jascott1love western NC. lived in Boone and Asheville19:14
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding lioadm iscsi_helper support  https://review.openstack.org/48169019:14
jascott1rwellum what town are you in?19:16
*** harlowja has quit IRC19:17
*** david-lyle has quit IRC19:17
rwellumIt's RTP jascott1 - technically Morrisville - but close to Durham too. IBM, Cisco, NetApp, Lenovo, Siemens to name a few here.19:17
*** david-lyle has joined #openstack-kolla19:17
*** jamesbenson has joined #openstack-kolla19:19
rwellumBoth those towns are awesome jascott1 - have several friends who's kids are at App State in Boone. We love it there.19:19
*** hawi_ has joined #openstack-kolla19:19
*** kristian__ has joined #openstack-kolla19:19
*** hawi_ has quit IRC19:19
*** spsurya has quit IRC19:20
jascott1loved it there but really digging the oregon beauty as well. there are similar in a lot ways, Eugene is like the prototype for Boone it seems19:21
rwellumNice. Oregan probably doesn't have the 'Southern' feel a lot of NC has? :)19:22
jascott1no but there is definitely red necks everywhere you go and I dont mean that offensively as I am from AL/MS and come from a long line of them :)19:23
*** jamesbenson has quit IRC19:23
*** ducttap__ has joined #openstack-kolla19:23
jascott1although im more of the southern hippie variety if I had to identify19:23
rwellum:)19:24
rwellumNot many of those.19:24
rwellumActually I guess there are - in clusters.19:24
jascott1haha19:24
jascott1yeah ive noticed that in the south we did cluster but out here "everyones cool" so people are great but dont immediately socialize like we did19:25
jascott1man i cant type today, it must be all this time ive been spending on mutex deadlocks19:25
rwellumMy wife broke down just outside of Raleigh area once - she was helped by three locals. She said nicest people ever, and they shared about 5 teeth between them.19:26
jascott1southern hospitality is real19:26
*** ducttape_ has quit IRC19:26
jascott1unfortunately some of the other things are still real there too but thats slowly changing19:27
rwellumTrue19:27
jascott1yeah I was suprised to learn what a racist state OR was originally19:27
jascott1easy to think everythings great because of the culture but yeah the history is about as bad as other states19:28
rwellumInteresting19:28
jascott1i will say if you like Boone and Asheville youd probably love Eugene and Portland...19:29
jascott1Seattle is a little too big for me but living right outside Portland is pretty sweet19:30
jascott1rwellum what tool did you write that sbezverk wants to startupize?19:31
rwellumYeah it would be up there in my top-3 places to live in the States. Based on watching Frasier mainly. :)19:31
jascott1haha my wife loves frasier19:32
rwellumjascott1: it's nothing really - which is why I joke about it. https://github.com/RichWellum/k8s19:32
rwellumJust a python script to run through the deployment guide.19:33
inc0I'll say more, I thnk PDX is one of best places to live worldwide* (* - places inc0 has visited in his life)19:33
jascott1awesome!19:33
Reepicheepanyone have an idea what this is about?  http://paste.openstack.org/show/615208/19:33
ReepicheepI'm attempting to setup karbor but my karbor_operationengine is stuck in "Restarting"19:34
jascott1i feel for people who have only lived here and think "someday Im going to get outta this place and go somewhere cool" or whatever.. goodluck19:34
inc0Reepicheep: you might want to ask Karbor community, I don't know anything about iot19:34
rwellumBut jascott1 feel free to try it out - only costs one VM and you'll have a working kolla-k8s in 40m or less. :)19:34
Reepicheepinc0: will do that19:34
*** manheim has quit IRC19:35
inc0jascott1: well there are few potentially good places I've never bootn to tho. Really excited about Australia and I must say Vancouver, BC is pretty fking awesome19:35
jascott1rwellum looks great19:35
jascott1inc0 oh yeah I will give you there are many awesome places on the west coast19:35
jascott1especially if you are 100% telecommute19:36
jascott1rwellum Ive been toying with go-client (golang lib for k8s) and working on a troubleshooting tool19:37
vhosakotrwellum: I'll try https://github.com/RichWellum/k8s one day and let you know, looks awesome :)19:38
jascott1soooo tired of `kubectl get pods -n kube-system` then `kubectl describe <podname>` and getting "error no type <pod name>"19:38
rwellumjascott1: wow that sounds very cool. What have you been doing with it?19:38
jascott1i see other people do this even19:38
rwellumvhosakot: yes please do :)19:39
vhosakotrwellum: sure, thanks19:39
jascott1so one cool thing about us using init containers as we can walk the dependency tree19:39
jascott1so my idea is to create the tree, find the lowest demoninator of the container thats crashing and get all the info for it in one swoop19:40
jascott1or something like that19:40
rwellumGood idea. Anything that can simplify debugging is great.19:40
jascott1basically k8s says "heres a bunch of pods in crashloop, good luck" and I want to have the tool sift through that to get to the root of the problem19:40
jascott1or at least point to it19:41
rwellumYeah. I usually ask sbezverk19:41
rwellum:)19:41
jascott1LOL19:41
jascott1me too!19:41
vhosakotrwellum: yes, I think sbezverk is right, https://github.com/RichWellum/k8s must be startup-ized, just needs marketing babes and a logo ;)19:41
rwellumvhosakot: nice! ;)19:42
vhosakotrwellum: so, I boot stock CentOS, run your script, I get kolla-k8s up?19:43
jascott1i vote vhosakot tzar of marketing he already knows what needs to be done19:43
vhosakotjascott1: haha19:43
rwellumYeah. Just make sure you have two NIC's - one for management and one for Neutron. Same as normal.19:43
vhosakotrwellum: I see, very cool19:43
rwellumvhosakot: the funny part is adding --demo - tries to walk you through each step. Probably half my info is wrong - but the people trying it here at my job don't know any better.19:44
vhosakotrwellum: cool, I like the demo option, kinda like Ansible's check/dry-run arg.. cool19:45
rwellumvhosakot: technically should be make good enough that as an option in the k8s workshop - we can just get them to run the tool and do --demo. It's basically just peforming the same steps I got from all you guys anyway.19:48
rwellummade - not make19:48
vhosakotrwellum: your script is great for the workshop, like they run demo and see what will happend, and then can run the script to standup kolla-k8s... but, giving a VM to each attendee to around 100+ attendees is the tougher part IMO.19:51
*** lucasxu has joined #openstack-kolla19:51
inc0any kolla-ansible cores? I need reviews on these 3: https://review.openstack.org/#/c/482217/19:56
inc0this one is very important19:56
inc0without that we're breaking infra19:56
inc0https://review.openstack.org/#/c/475940/ https://review.openstack.org/#/c/475469/ <- these two (in this order plz) moves dockerhub publisher forward19:57
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Fixing the kolla-kubernetes gates  https://review.openstack.org/48308219:57
*** yaosu has joined #openstack-kolla19:58
yaosuhi, is there a way to use cinder with lvm without iscsi? I have now had two seperate setups where tgt has crashed taking down all VMs and leaving inconsistent filesystems, which is critical19:59
inc0yaosu: you need a protocol to connect volume to vm20:00
vhosakotinc0: +2'ed https://review.openstack.org/#/c/482217/, long live proxy cache.20:00
inc0yeah20:01
*** harlowja has joined #openstack-kolla20:02
*** ducttape_ has joined #openstack-kolla20:03
rwelluminc0: on that review - why force port 8080? The other proxy does not.20:05
inc0rwellum: it's not us, it's infra20:05
inc0infra had set up it on 808020:05
inc0we're just using this20:05
*** ducttap__ has quit IRC20:06
rwellumOh ok -20:06
*** lucasxu has quit IRC20:08
yaosuinc0: well it would be a single node system atm20:09
inc0yeah, I'm not sure if it's even possible with cinder, but it's not possible with kolla20:09
yaosuand if more nodes are added then I'd have a look that I move it to drbd20:09
yaosuok, so what at best to do?20:10
inc0also if you like your data, use ceph:)20:10
yaosubecause having iscsi crash after just a week is not something i can run with20:10
inc0or something that has replication built into the kit20:10
yaosuceph on single node? ^^20:10
inc0possible, obviously you won't have replication20:10
openstackgerritBertrand Lallau proposed openstack/kolla master: Fix Horizon container starting if Watcher is enabled  https://review.openstack.org/48308620:10
yaosuand I've been using finde with ganeti + drdb fine for the last 4-5 years or so20:11
inc0I have no idea how cinder works with drbd20:11
rwellumReminds me I thought this was a good and recent article on ceph: https://medium.com/linode-cube/ceph-block-storage-for-the-21st-century-b59f3b62d4ca20:15
*** ansmith_ has quit IRC20:18
*** ansmith has quit IRC20:18
*** jamesbenson has joined #openstack-kolla20:19
*** ansmith has joined #openstack-kolla20:20
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Adding targetcli tool to cinder-volume  https://review.openstack.org/48305020:20
sbezverkrwellum : do you have a time slot available tomorrow to submit handson workshop for k8s?20:21
*** jamesbenson has quit IRC20:23
*** jamesbenson has joined #openstack-kolla20:23
rwellumsbezverk: between 8-10, 11-2 and 3:30 EST onwards.20:25
sbezverkrwellum: let's do at 9:00AM then, I will send you webex..20:25
rwellumcool20:29
rwellumsbezverk: were you looking at sriov - like vfs per pod etc? I thought you mentioned something before.20:32
sbezverkrwellum: what is vfs?20:34
rwellumVirtual Functions20:35
rwellumhttps://docs.microsoft.com/en-us/windows-hardware/drivers/network/sr-iov-virtual-functions--vfs-20:35
sbezverkrwellum : ah ok yeah20:37
openstackgerritMerged openstack/kolla-ansible master: Enable proxy cache for tarballs download  https://review.openstack.org/48221720:38
*** jamesbenson_ has joined #openstack-kolla20:42
*** yaosu has quit IRC20:44
*** jamesbenson has quit IRC20:45
*** ansmith has quit IRC20:46
*** jtriley has quit IRC20:47
sbezverkrwellum: I sent invite to your gmail address20:52
*** vhosakot has quit IRC21:01
*** vhosakot has joined #openstack-kolla21:02
*** rwallner has quit IRC21:04
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: Fixing the kolla-kubernetes gates  https://review.openstack.org/48308221:04
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: pass the correct app type when initializing command in tests  https://review.openstack.org/48309721:04
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: do not check in build files  https://review.openstack.org/48309821:04
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: ignore the helm directory created by tests  https://review.openstack.org/48309921:04
*** goldyfruit has quit IRC21:08
*** dave-mccowan has quit IRC21:09
*** mgoddard_ has joined #openstack-kolla21:14
*** jtriley has joined #openstack-kolla21:15
*** manheim has joined #openstack-kolla21:19
kristian__Hi, is it possible to deploy kolla-ansible on single nic?21:20
inc0kristian__: if you'll use vlans yes21:21
inc0or you can create fake nic21:21
kristian__inc0, no vlans, ovh network21:21
inc0but that's just for poc21:21
inc0that's gonna be hard then since neutron likes to own it's network21:22
inc0one way to do it (only in master)21:22
kristian__it will be for now an aio install21:22
inc0would be to manually configure ovs and then deploy on top of it21:22
*** jtriley has quit IRC21:22
inc0https://github.com/openstack/kolla-ansible/blob/master/tools/setup_gate.sh#L221 this is what we do in gates21:23
inc0ip l fake...21:23
kristian__the hard part is, that Im a newbie in that stuff21:23
kristian__could I put a virtual nic on it?21:23
kristian__like eth0:0?21:23
inc0this will create totally fake interface21:24
kristian__so will eth0:0 and maybe eth0:1 work?21:24
kristian__with some static ips21:25
kristian__no dhcp21:25
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: ignore the helm directory created by tests  https://review.openstack.org/48309921:25
*** mgoddard_ has quit IRC21:26
*** trozet has quit IRC21:26
sbezverkinc0: this ps restores kolla-kubernetes gates, could you please ack when it is completed? https://review.openstack.org/48309721:26
inc0sbezverk: as soon as gates finish21:27
openstackgerritDoug Hellmann proposed openstack/kolla-kubernetes master: ignore helm lock files  https://review.openstack.org/48310321:27
*** lpetrut has quit IRC21:30
*** ducttape_ has quit IRC21:32
*** trozet has joined #openstack-kolla21:32
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Allow tmp path to download registry  https://review.openstack.org/47594021:34
Reepicheepkristian__: the issue to be aware of is nuetron will blow away any configuration on the NIC it is given,  I have used a vlan interface before for neutron_external_interface21:35
Reepicheepbut in that instance you are limited to a single flat external network for neutron21:36
kristian__Reepicheep: then what can I do when in the best case I want to have horizon and every ext stuff running on eth0:021:36
inc0neutron will take over any bridge on the nic21:36
kristian__and I have a ripe public ips21:37
kristian__I dont need any complicated vlans and that stuff21:37
kristian__just basic bridge, and use of one interface21:37
kristian__thats all21:37
Reepicheeplike inc0 mentioned I don't think a sub interface will work.. it well just get blown away21:38
Reepicheepwhen I used a vlan interface it was on a team bonded interface with an external vlan21:39
inc0yeah, etc0.200 works for example21:39
inc0btw you can do it even without external net21:39
kristian__Reepicheep: so please tell me. For example you have a server at ovh with /28 ripe block and for now you need to do an aio install, later it might be scaled21:39
inc0ovh being vms or bare metal?21:40
kristian__also ovh is strict at their public ips. you need to assign mac addresses to public ips,  but I think I got that covered kinda21:40
kristian__bare metal21:40
inc0ok, and we have single network available right? single L221:41
kristian__6 core xeon, 128gb of ram, no veack unfortunetly21:41
kristian__I think yes21:41
*** ducttape_ has joined #openstack-kolla21:41
kristian__only the public ip is configured, and one on a virt nic from a ripe block21:41
inc0thing is, when we spawn VM, what network it's going to be connected to? and will it be same network as control plane?21:41
*** spsurya has joined #openstack-kolla21:42
inc0control plane will be on same network?21:42
inc0L2?21:42
Reepicheepkristian__: the ovh is not providing you some kinda "private" nic?21:42
kristian__I really dunno21:42
kristian__Nope, vrack is their solution21:42
inc0so we need 2 sets of IP - one for control plane to communicate (things like database)21:43
inc0and second for vms21:43
kristian__I found that there is a second nic there and in the dash there is Ovh to ovh: 1gbit connection21:43
kristian__so really dunno21:43
jamesbenson_kristian__: doing something similiar, we have 2 nics, one solely internal and one external, but putting all compute on only internal...21:43
ReepicheepI bet the private network connection they provide21:43
*** serlex has quit IRC21:44
kristian__I will talk to them tomorrow about vrack21:44
kristian__but if the server is ready, dunno how to check if ethernet cable is plugged in, but I will talk to them21:44
inc0what neutron will want to do is to take over single interface to put floating IPs on it21:45
inc0I assume that would be network your RIPE subnet would be connected to21:45
inc0you still need another network to access hardware nodes for example21:45
kristian__cannt it be all from one nic?21:46
Reepicheepyeah.. so if you are depending on the external nic for management you would loose it when you deploy21:46
inc0kristian__: issue is bridge will take ownership of the nic21:46
inc0that's kernel network stack21:46
kristian__I will talk to them21:47
inc0what you could do21:47
inc0is to spawn fake interface21:47
jamesbenson_inc0: we use bridge and virtual interfaces here,21:47
inc0give it to neutron21:47
jamesbenson_and have veno0 to neutron_external_interface21:47
inc0and manually bridge it to public network21:47
inc0yeah, how jamesbenson_ described it21:48
jamesbenson_kristian__ I can send you my globals if you want21:48
inc0you create 2 virtual ifaces, put regular public ip on one and give another to neutron21:48
kristian__we will see, but I dont like creating bridges, because I will mess something uo21:48
inc0jamesbenson_: can you actually make doc about it? not only globals but also commands to put both ifaces up21:48
inc0ip link add ..21:48
kristian__I know what you mean21:49
jamesbenson_yeah, that's why I wrote all of my scripts, now I can do it on both ubuntu and cent21:49
inc0yeah it's easy to mess u[p21:49
kristian__ubuntu 16.04 is me21:49
Reepicheepkristian__: what distro are you using .. it's not to bad21:49
inc0jamesbenson_: cool addition to docs tbh21:49
inc0we get this quesiton a lot21:49
kristian__yeah21:49
jamesbenson_granted my scripts are custom to the hardware here... but nothing special21:49
kristian__because openstack-ansible requires min one I think21:49
jamesbenson_inc0: I'll work on that soon for you21:50
inc0jamesbenson_: just as example21:50
inc0thank you good sirt21:50
kristian__I have eth0, so basic21:50
inc0sir21:50
jamesbenson_kristian__ in the mean time, check out https://github.com/JamesOBenson/Kolla-misc21:50
jamesbenson_you can find the ubuntu interfaces here: https://github.com/JamesOBenson/Kolla-misc/blob/master/tasks/Generate_interfaces.yml21:50
kristian__ok21:50
kristian__thank you21:50
jamesbenson_np21:50
jamesbenson_:-)21:51
jamesbenson_my globals is in there too somewhere21:51
jamesbenson_but still modifying it slightly21:51
kristian__Im gonna quickly install kolla and I will ping you when I will get stuck21:51
jamesbenson_inc0, actually can I pick your brain tomorrow about that. I think something in my networking setup isn't quiet right.21:51
jamesbenson_the interfaces is fine, the globals is the issue21:51
inc0networking always twists my brain, but I'll try to help21:52
jamesbenson_yeah, tell me about it21:52
kristian__jamesbenson_: so you have a wrapper for kolla-ansible, right?21:52
jamesbenson_yep21:52
kristian__then I will use it :D21:53
jamesbenson_you'll need to modify... so use at your own risk ;-)21:53
*** mattmceuen has joined #openstack-kolla21:53
kristian__I will21:54
jamesbenson_and we deploy 1 rack at a time and that rack number gets injected into IP's... so the wrapper is definitely custom to us here, I started making it more generic but tired of typing in things....21:54
*** schwicht has quit IRC21:54
jamesbenson_but you'll get the idea and shoot me questions if needed21:54
kristian__and kolla should work on docker 1.12.6-cs12, right?21:54
jamesbenson_I'm headed out for now though, see you tomorrow.21:54
jamesbenson_yeah, anything past 1.10 if I remember correctly21:55
kristian__I only have one server, not a rack :D21:55
kristian__yeah, bye21:55
jamesbenson_hey, our dev is only 4, so no worries21:55
jamesbenson_later21:55
kristian__cu21:55
Reepicheepjamesbenson_: setup_networking.sh .. functions in bash nice ;)21:55
*** jamesbenson_ has quit IRC21:56
*** jamesbenson has joined #openstack-kolla21:57
*** jamesbenson has quit IRC22:02
kristian__inc0: here https://github.com/JamesOBenson/Kolla-misc/blob/master/kolla_bridge.yml from line 129, eno1 should not be touched (in my case eth0) and br0 has the same ip and gateway (theoretically) as eno1?22:07
*** Mannheim has quit IRC22:08
*** iniazi_ has joined #openstack-kolla22:21
jascott1inc0 it just blew my mind that the first value for `ii` var is not 0 in this example https://goplay.space/#FDOCEKrlkt,3822:23
*** iniazi has quit IRC22:23
*** schwicht has joined #openstack-kolla22:25
*** kristian__ has quit IRC22:26
*** kristian__ has joined #openstack-kolla22:26
*** kolla-slack has joined #openstack-kolla22:30
*** kolla-slack has quit IRC22:31
*** mmethot_ has joined #openstack-kolla22:31
*** mmethot has quit IRC22:31
*** kolla-slack has joined #openstack-kolla22:32
*** kolla-slack has quit IRC22:32
*** kolla-slack has joined #openstack-kolla22:32
*** kolla-slack1 has quit IRC22:32
*** kristian__ has quit IRC22:32
*** ansmith has joined #openstack-kolla22:33
*** csuttles has quit IRC22:35
*** slagle has quit IRC22:35
*** csuttles has joined #openstack-kolla22:35
*** slagle has joined #openstack-kolla22:35
*** cmceniry has quit IRC22:35
*** sambetts|afk has quit IRC22:36
*** sambetts_ has joined #openstack-kolla22:37
*** cmceniry has joined #openstack-kolla22:41
*** schwicht has quit IRC22:46
*** dciabrin has quit IRC22:47
*** schwicht has joined #openstack-kolla22:51
*** schwicht has quit IRC22:54
*** mattmceuen has quit IRC23:00
*** itlinux has quit IRC23:06
*** manheim has quit IRC23:08
sbezverkinc0: if you are still here, please ack this one: https://review.openstack.org/#/c/483097/123:09
*** dciabrin has joined #openstack-kolla23:10
*** ducttape_ has quit IRC23:11
inc0done sbezverk23:17
*** manheim has joined #openstack-kolla23:18
manheimfun fact, some months ago at a conference I won a k8s t-shirt, it says kollaborator on the back23:19
openstackgerritMerged openstack/kolla-kubernetes master: pass the correct app type when initializing command in tests  https://review.openstack.org/48309723:22
sbezverkinc0: thanks so much!!23:22
openstackgerritMerged openstack/kolla-kubernetes master: ignore helm lock files  https://review.openstack.org/48310323:23
sbezverkmanheim you know that they you have to start actively contributing to kolla-k8s!!23:23
manheimhehe23:24
manheimafter i'm finishing my k8s book :D23:24
manheimto read&learn I mean23:24
*** schwicht has joined #openstack-kolla23:26
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding lioadm iscsi_helper support  https://review.openstack.org/48169023:26
*** tonanhngo has quit IRC23:27
sbezverkmanheim sure, but do not forget, the best learning is in the field ;)23:28
manheimfor sure :D23:29
vhosakotwell, if you don't/can't contribute code, helping others by being a part of the community and doing all one can help is an A in my book :)  contributing code needs much time on open-source (and not everyone may have it) :)23:30
manheimthat's also true23:30
*** tonanhngo has joined #openstack-kolla23:32
*** tonanhngo has quit IRC23:37
*** mattmceuen has joined #openstack-kolla23:39
*** hongbin has quit IRC23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!