Friday, 2017-05-05

*** yingjun has joined #openstack-kolla00:01
*** Daviey_ has quit IRC00:11
*** guoshan has quit IRC00:15
*** Pavo has quit IRC00:23
*** eanylin__ has joined #openstack-kolla00:28
duonghqhas anybody arrived in Boston?00:36
duonghqsdake, will you join inc0's workshop?00:37
*** eanylin__ has quit IRC00:38
*** eanylin__ has joined #openstack-kolla00:39
*** salv-orlando has joined #openstack-kolla00:55
*** salv-orlando has quit IRC00:59
*** dixiaoli has joined #openstack-kolla01:06
*** gianpietro has quit IRC01:08
*** guoshan has joined #openstack-kolla01:16
inc0duonghq: I'll be there Sunday afternoon01:18
*** ssurana has joined #openstack-kolla01:18
*** ssurana has quit IRC01:19
inc0duonghq: https://github.com/inc0/kolla-ansible-workshop check this out01:19
duonghqinc0, roger01:19
*** guoshan_ has joined #openstack-kolla01:19
*** guoshan has quit IRC01:19
inc0this is what we'll be doing basically01:20
* duonghq reading01:20
*** dave-mccowan has joined #openstack-kolla01:21
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Remove keystone-paste.ini file in kolla  https://review.openstack.org/46253501:30
*** zhurong has joined #openstack-kolla01:31
*** hrw has quit IRC01:31
*** hrw has joined #openstack-kolla01:33
*** zhurong has quit IRC01:50
*** ever has left #openstack-kolla01:55
*** salv-orlando has joined #openstack-kolla01:56
*** goldyfruit has joined #openstack-kolla01:58
*** Chenn has joined #openstack-kolla01:59
*** salv-orlando has quit IRC02:00
*** georgem1 has joined #openstack-kolla02:01
*** yingjun has quit IRC02:03
*** unicell has quit IRC02:03
*** salv-orlando has joined #openstack-kolla02:04
*** salv-orlando has quit IRC02:09
inc0hmm....can someone build stable/ocata centos source?02:11
sdakeinc0 question - your lab requires 5 vms02:12
inc0yeah02:12
inc0it does02:12
sdakewhat kind of computer do you expect peple will run that on?02:12
inc0I'm prepping env02:12
inc0I have 50 strong nodes for vms02:12
sdakeis that the 50 node cluster?02:13
sdakecool02:13
inc0yeah02:13
sdakeI was wonderign "where are people going to get 32gb laptops :)02:13
inc0everyone is getting 5*8gig ram vms02:13
sdake10/24 is your management network?02:14
inc0this guide should be our quickstart;) I think it's simpler than what we have today02:14
inc0it goes like this - every vm will have one shared net 10.0.0.0/1602:14
inc0and 2 nets private to env02:14
inc010.1.0.0/24 and 10.1.1.0/2402:15
sdakeEvery node will be hooked up to shared network 10.0.0.0/2402:15
sdakeif you share the management network you will need to configure keepalived appropriately02:15
inc03 nets02:16
inc01 shared and 2 private per person02:16
inc0shared is for deploy02:16
inc01 private is control andother is data02:16
inc0so no l2 connectivity on between envs02:16
inc0I was thinking of making one big but I figured that keepalived will bite us02:17
sdakeit does work in a shared network02:17
inc0also I'd need to add allowed-address-pair for vms and it would be hell02:17
inc0if you chage router id02:17
inc0I know02:17
inc0but I want to keep guide simple02:17
sdakeyup02:17
inc0so try to minimize env-specific changes02:17
sdakesounds like you considered it already02:17
inc0yeah02:17
inc0I did02:17
inc0sdake: can you build stable/ocata?02:18
inc0influx repo times out for me02:18
sdakeinc0 i am heading out to dinner now02:18
inc0kk02:18
sdakeinc0 when i get back I can02:18
inc0nvm02:18
inc0it seems to be something on my end02:19
inc0it works outside of docker02:19
sdakeok02:19
inc0fails inside docker02:19
inc0duh02:19
inc0I blame mtu02:19
inc0yeah, it's mtu02:19
*** ssurana has joined #openstack-kolla02:28
*** unicell has joined #openstack-kolla02:29
*** ducttape_ has joined #openstack-kolla02:33
*** unicell has quit IRC02:34
*** unicell has joined #openstack-kolla02:35
*** shasha___ has quit IRC02:35
*** shasha_t_ has joined #openstack-kolla02:36
openstackgerritjunbo proposed openstack/kolla stable/ocata: Add netcat package in sahara-engine image  https://review.openstack.org/46244402:37
*** zhurong has joined #openstack-kolla02:38
*** goldyfruit has quit IRC02:47
*** unicell has quit IRC02:50
*** zhurong has quit IRC02:54
*** zhurong has joined #openstack-kolla02:55
inc0any centos people around?03:03
zhubingbing_sup guys03:05
*** salv-orlando has joined #openstack-kolla03:05
sbezverkinc0: what is going on?03:07
inc0funny thing03:07
inc0I have eth0 with my ip on03:07
inc0I do dhclient eth103:07
inc0and it locks me out03:07
inc0(I'm connecting via eth0...)03:07
sbezverkinc0: eth0 gets ip address via dhcp?03:08
inc0both of them yeah03:08
inc0but I just want to bring up eth1 and eth203:08
sbezverkhm looks like a bug then, you can always switch to use static on eth003:08
inc0yeah03:09
inc0I have no idea what's wrong ;)03:09
*** salv-orlando has quit IRC03:10
*** esmute has quit IRC03:10
sbezverkinc0: I think the safest option woulf be to use static ip to mgmt interface03:12
sbezverkok it is getting late here, bye gents, good night..03:13
inc0gn03:15
*** dave-mccowan has quit IRC03:16
*** gkadam has joined #openstack-kolla03:20
*** ducttape_ has quit IRC03:40
*** ducttape_ has joined #openstack-kolla03:42
*** unicell has joined #openstack-kolla03:47
*** georgem1 has quit IRC03:50
*** zhurong has quit IRC04:00
*** guoshan_ has quit IRC04:04
*** salv-orlando has joined #openstack-kolla04:06
*** daidv has joined #openstack-kolla04:07
*** salv-orlando has quit IRC04:11
*** ducttape_ has quit IRC04:16
sdakeinc0 did you get it sorted out04:16
sdakesup zhubingbing_04:17
*** unicell has quit IRC04:26
*** zhurong has joined #openstack-kolla04:32
masberhi, I don't know why kolla deploy fails fatal: [openstack-controller]: FAILED! => {"changed": false, "failed": true, "msg": "unable to connect to database, check login_user and login_password are correct or /var/lib/ansible/.my.cnf has the credentials. Exception message: (1045, \"Access denied for user 'root'@'openstack-controller' (using password: YES)\")"}04:35
masberI follow all the steps but obviously the password to database doesn't change to the right value?04:36
*** jascott1 has quit IRC04:36
*** caowei has quit IRC04:43
*** salv-orlando has joined #openstack-kolla04:45
*** jascott1 has joined #openstack-kolla04:49
*** esmute_ has joined #openstack-kolla04:52
sdakesup jascott104:52
sdakesup masber04:52
jascott1sdake hey04:53
jascott1hows it going?04:53
sdakegood04:53
sdakedid you happen to fix up the deploy guide?04:53
*** unicell has joined #openstack-kolla04:56
jascott1no but i have the branch created04:56
sdakebaby steps :)04:56
jascott1we just use the new canal RBAC or both?04:57
jascott1i need to check the gate script to see04:57
jascott1cause that goes into the patch, i am currently not using the canal RBAC and things are working so far04:58
*** britthouser10 has quit IRC05:00
*** britthouser has joined #openstack-kolla05:00
sdakecool05:01
sdakei think there are a few other changes05:01
masberso what can I do to generate the right password?05:08
sdakenot sure and headed to bed05:10
sdakenight all05:10
*** caowei has joined #openstack-kolla05:17
*** tovin07_ has joined #openstack-kolla05:27
*** unicell1 has joined #openstack-kolla05:41
*** unicell has quit IRC05:42
*** janki has joined #openstack-kolla05:44
*** tonanhngo has quit IRC05:48
*** jbadiapa has quit IRC06:01
*** salv-orlando has quit IRC06:10
*** pcaruana has joined #openstack-kolla06:11
*** guoshan has joined #openstack-kolla06:30
*** zhurong has quit IRC06:33
*** caowei has quit IRC06:34
*** caowei has joined #openstack-kolla06:34
*** zhurong has joined #openstack-kolla06:49
*** salv-orlando has joined #openstack-kolla07:07
openstackgerritjeck proposed openstack/kolla-ansible master: Remove /etc/fstab Swift references during cleanup-host  https://review.openstack.org/45680507:07
*** gfidente has joined #openstack-kolla07:08
*** shardy has joined #openstack-kolla07:08
*** jascott1 has quit IRC07:11
*** ssurana has quit IRC07:15
openstackgerritjeck proposed openstack/kolla-ansible master: Remove /etc/fstab Swift references during cleanup-host  https://review.openstack.org/45680507:19
openstackgerritjimmygc proposed openstack/kolla-ansible master: Add vmware support to ceilometer  https://review.openstack.org/46284207:20
*** athomas has joined #openstack-kolla07:20
openstackgerritjimmygc proposed openstack/kolla-ansible master: Add vSphere support to nova_compute  https://review.openstack.org/44952907:23
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Add lbaas support to vsphere by vmware-nsx plugin  https://review.openstack.org/46284407:24
*** manheim has joined #openstack-kolla07:31
*** lpetrut has joined #openstack-kolla07:35
*** egonzalez has joined #openstack-kolla07:37
tumblecan anyone tell me where I went wrong, when my kolla-ansible deploy tries to pull  kolla/centos-binary-fluentd:4.0.1 although this doesn't exist yet on docker hub? (4.0.0 is there)07:38
bjolomorning07:47
manheimhello07:47
japestinhotumble 4.0.1 images weren't on dockerhub yet07:47
manheimtry 4.0.0 tag07:47
japestinhotumble set 4.0.0 on globals.yml07:48
tumbleoh uhm, which key would that be? I don't see versions in the example that I copied and modified07:52
*** blallau has joined #openstack-kolla07:54
tumbleguess it's fluentd_tag, thanks guys, gonna try that07:56
*** dixiaoli has quit IRC07:56
*** dixiaoli has joined #openstack-kolla07:57
egonzaleztumble, openstack_release, currently have empty value and auto-discovered, set to 4.0.007:57
tumbleegonzalez, ok, ty :)07:57
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix heat ec2 keystone auth  https://review.openstack.org/44495308:06
*** Serlex has joined #openstack-kolla08:09
*** jascott1 has joined #openstack-kolla08:11
*** mgoddard has joined #openstack-kolla08:14
*** jascott1 has quit IRC08:16
*** nathharp has joined #openstack-kolla08:20
*** mgoddard has quit IRC08:23
openstackgerritMerged openstack/kolla stable/ocata: Add netcat package in sahara-engine image  https://review.openstack.org/46244408:23
*** zhubingbing_ has quit IRC08:24
*** mgoddard has joined #openstack-kolla08:28
*** zhubingbing has joined #openstack-kolla08:31
manheimhi, if I do kolla-deploy --tags cinder, it should only play cinder playbook, right?08:35
manheimthing is it ignores the --tags option and deploys all08:36
*** zhubingbing has quit IRC08:38
*** zhubingbing has joined #openstack-kolla08:39
*** lpetrut_ has joined #openstack-kolla08:39
*** mgoddard has quit IRC08:40
egonzalezmanheim, before cinder apply common role as is a dependency of all roles08:41
*** lpetrut has quit IRC08:42
*** mgoddard has joined #openstack-kolla08:45
manheimezolzalez, maybe this interests you, we have this https://cloudbase.it/v-magine/08:50
manheimi am currently implementing kolla in it08:50
manheiminstead of RDO08:50
manheimbasically it's an AIO with few clicks08:51
manheimif anyone wanna try kolla in a simple way...08:51
bjolomy prechecks fails on my network node "Please check the api_interface settings - interface bond0 is not active"08:53
bjolowhat does that mean? i dont have a dedicated api interface, just using default network_interface08:53
bjolonetwork inteface is very much active and working :)08:54
manheimyou'll need a different IP than NICs for that08:54
manheimbut in the same subnet08:54
manheimit will add that IP to the nic so HA proxy will work work with that08:55
bjoloi do have unused IPs for ha proxy08:55
manheimocata release?08:55
bjoloon the same CIDR as network_interface08:55
bjoloyes ocata08:56
*** salv-orl_ has joined #openstack-kolla08:56
manheimhmm, i remember vaguely i had this issue, please try to put that IP (original one, not for VIP) in /etc/hosts08:56
bjolo hosts file is fully populated on all nodes08:57
bjolook i dont have vip in hosts file, but not using fqdn in globals.yml. only IPs08:58
*** salv-orlando has quit IRC08:59
tumbleI'm a little confused about the use of the registry. I followed the instructions and used tools/start-registry, however, afaik this local registry doesn't need any credentials. If I set the credentials in globals.yml to foo/bar I'm good, but kolla images cannot be found because this registry obviously doesn't proxy through to hub08:59
bjoloi can add VIP and some name to hosts file and push out to all nodes and see if that works.08:59
tumblenow, if I set the docker hub as registry instead, then I cannot leave out the credentials in globals, because ansible doesn't like undefined vars08:59
bjolomy real issue is that the cloud does not deploy, so backtracking i found this issue in prechecks. dunno if that is related to the "real" issue09:00
pesteregonzalez: just created bugreport, can you check ? https://bugs.launchpad.net/kolla/+bug/168849609:02
openstackLaunchpad bug 1688496 in kolla "instance stuck at "booting from hard disk"" [Undecided,New]09:02
tumbleI simplify my question: why do I have to set docker_registry_password if all I want to do is pulling public images from docker hub? (not setting it results in error about undefined var)09:14
*** pbourke has quit IRC09:15
*** pbourke has joined #openstack-kolla09:16
*** iniazi has joined #openstack-kolla09:17
openstackgerritChen proposed openstack/kolla master: Link syntax error fix  https://review.openstack.org/46288109:20
egonzaleztumble, if using images from Dockerhub not need to set registry, registry is only needed if using your own build images09:22
egonzalezbjolo, can you paste ansible -m setup -i inventory <host_failing>09:23
tumbleegonzalez, right, that's what I thought. if I comment out the 4 docker_ keys in globals yaml though, the run (kolla-ansible pull) crashes, saying the password var is undefined09:23
tumbleegonzalez, what I did to hack around that is to add | default(omit) for password and username in docker_common_options, but I guess that's not how it's supposed to be^^09:24
egonzaleztumble, by default are commented in globals.yml09:25
tumbleegonzalez, right, that's how I run it at the moment, as can be seen here: http://dpaste.com/1RJDSQT but ansible doesn't tolerate unset variables and whenever docker_common_options is used (and it is used in many placess), it expects the password to be set09:28
tumbleare you guys running an old version of ansible which doesn't require variables to be set?09:28
tumbleI remember it was like that in 2.1 or maybe even 2.2 yet09:28
egonzaleztumble, at /etc/kolla/passwd there is docker password set09:30
egonzalezjust comment all other docker registry options and leave that pass set09:30
*** shasha_t_ has quit IRC09:36
tumbleit indeed works then. Unfortunately it crashes with http://dpaste.com/2Z8X3Y609:40
hrwmorning09:42
hrwegonzalez: thanks for +209:42
*** dixiaoli has quit IRC09:45
tumbleegonzalez, would you agree this is a bug? http://dpaste.com/2845B0F09:45
*** hieulq_ has joined #openstack-kolla09:46
tumbleyeah, looks like it https://bugs.launchpad.net/kolla/+bug/166805909:48
openstackLaunchpad bug 1668059 in kolla "Failed to Starting kolla-toolbox container" [Critical,Triaged]09:48
tumble:<09:48
egonzaleztumble, what docker and docker-py version are you using?09:50
egonzalezmanheim, awesome the cloudbase kolla deploy09:53
manheimyep, if anyone want to demo kolla, we can just point them to that09:53
manheimill tell wen everything is ready09:54
*** salv-orl_ has quit IRC09:55
*** zhurong has quit IRC09:56
*** tovin07_ has quit IRC09:58
*** hieulq_ has quit IRC10:01
*** matrohon has quit IRC10:04
*** matrohon has joined #openstack-kolla10:07
egonzalezpester, have you enabled designate?10:07
pesterno10:07
pesterthose options are default10:08
egonzalezoo right10:08
pesterso didn`t even touch them10:08
pesterfor now I`m trying to deploy with ubuntu instead of centos10:09
egonzalezpester, Cannot access storage file '/root/trusty-server-cloudimg-amd64-disk1.img' (as uid:42427, gid:42427): Permission denied10:09
*** ipsecguy_ has quit IRC10:09
pesteryes, my first try to boot KVM VM manually10:10
pesterVM in host machine works ok, but in nova_libvirt VM hangs10:10
egonzalezremove cpu_mode = none from /etc/kolla/nova-compute/nova.conf and restart nova_compute container10:11
*** guoshan has quit IRC10:12
*** matrohon has quit IRC10:15
*** caowei has quit IRC10:17
*** matrohon has joined #openstack-kolla10:19
pesterlet`s make question easy: when I run virt-install in host machine - everything ok, when I run virt-install inside nova_libvirt container VM hangs.10:19
pestermaybe libvirt or qemu bug, so I trying to install with ubuntu to get different packages10:19
tumbleegonzalez, local system (which executes kolla-ansible) is Debian, docker-py 1.10.6 - remote system where the image is pulled to is a  CentOS7, docker-py 1.10.6-1.el7, docker 1.12.610:39
tumbleand this CentOS docker produces this digest output which cannot be handled by the kolla_docker module10:40
egonzaleztumble, is the image really pulled into the host when running docker pull manually?10:44
egonzalezbecause digest is not part of the status message, and no status is output. this is the output of new pull and when already exists http://paste.openstack.org/show/608955/10:47
*** britthouser11 has joined #openstack-kolla10:48
*** britthouser has quit IRC10:49
tumbletrying10:53
*** ipsecguy has joined #openstack-kolla10:53
*** daidv has quit IRC10:54
*** ipsecguy has quit IRC10:56
*** ipsecguy has joined #openstack-kolla10:56
openstackgerritVladislav Belogrudov proposed openstack/kolla-ansible master: Fix iSCSI mounts for Cinder backup container  https://review.openstack.org/46291210:57
tumbleegonzalez, think this one shows it all http://dpaste.com/2QHPCN110:57
tumbleI wonder where this output difference comes from. This CentOS is freshly installed and Docker is installed from yum (epel-release I think)10:58
*** rwallner has joined #openstack-kolla10:59
*** rwallner has quit IRC11:03
tumblefun fact - on another box (also CentOS7) I have the package docker-latest instead of docker installed11:05
tumbleit comes with version 1.13.1 and prints this Status output11:05
tumbleI wanted to use this package in the first place, however, then the daemon also is called docker-latest and kolla-ansible isn't happy with that in the prechecks at least11:06
tumbleguess I'll try to find a way in the middle by installing docker differently11:06
*** jascott1 has joined #openstack-kolla11:14
*** dciabrin has quit IRC11:16
*** dciabrin has joined #openstack-kolla11:17
*** jascott1 has quit IRC11:19
bjoloegonzalez, will do shortly11:24
bjoloare we runing any docker in docker anymore (ocata)?11:24
*** rhallisey has joined #openstack-kolla11:32
*** shasha_t_ has joined #openstack-kolla11:37
tumbleegonzalez, installing docker with the unholy curl bash way makes it print the Status, so I can continue. I'll be back ;D11:39
*** shasha_t_ has quit IRC11:41
*** salv-orlando has joined #openstack-kolla11:48
pbourkeJeffrey4l: hey jeffrey, can you please check my reply to your comment on https://review.openstack.org/#/c/448654/11:48
*** jbadiapa has joined #openstack-kolla11:51
*** Serlex has quit IRC12:03
*** eanylin__ has quit IRC12:06
*** eanylin__ has joined #openstack-kolla12:07
*** eanylin__ has left #openstack-kolla12:08
*** eanylin has joined #openstack-kolla12:09
*** jbadiapa has quit IRC12:13
*** tvignaud_ has quit IRC12:14
*** jbadiapa has joined #openstack-kolla12:18
*** georgem1 has joined #openstack-kolla12:18
*** jtriley has joined #openstack-kolla12:18
*** nathharp has quit IRC12:20
*** rwellum has joined #openstack-kolla12:22
*** ducttape_ has joined #openstack-kolla12:23
*** salv-orlando has quit IRC12:24
*** tvignaud_ has joined #openstack-kolla12:27
*** jtriley has quit IRC12:28
*** schwicht has joined #openstack-kolla12:29
*** georgem1 has quit IRC12:33
*** schwicht has quit IRC12:33
*** skramaja has joined #openstack-kolla12:41
*** tvignaud_ has quit IRC12:41
pestermkdir12:42
*** ducttape_ has quit IRC12:46
*** rwallner has joined #openstack-kolla12:49
*** rwallner has quit IRC12:49
*** rwallner has joined #openstack-kolla12:49
*** Serlex has joined #openstack-kolla12:50
openstackgerritMerged openstack/kolla-ansible master: Fix iSCSI mounts for Cinder backup container  https://review.openstack.org/46291212:53
*** manheim_ has joined #openstack-kolla12:53
*** eanylin_ has joined #openstack-kolla12:54
*** lpetrut__ has joined #openstack-kolla12:54
*** imcsk8_ has joined #openstack-kolla12:54
*** georgem1 has joined #openstack-kolla12:55
*** jchhatbar has joined #openstack-kolla12:56
*** skramaja_ has joined #openstack-kolla12:56
*** ipsecguy_ has joined #openstack-kolla12:57
*** dave-mccowan has joined #openstack-kolla12:57
*** zhubingbing__ has joined #openstack-kolla12:57
*** tvignaud_ has joined #openstack-kolla12:57
*** unicell has joined #openstack-kolla12:58
*** jtriley has joined #openstack-kolla13:02
*** skramaja has quit IRC13:02
*** eanylin has quit IRC13:02
*** rhallisey has quit IRC13:02
*** ipsecguy has quit IRC13:02
*** lpetrut_ has quit IRC13:02
*** zhubingbing has quit IRC13:02
*** manheim has quit IRC13:02
*** athomas has quit IRC13:02
*** janki has quit IRC13:02
*** unicell1 has quit IRC13:02
*** imcsk8 has quit IRC13:02
*** goldyfruit has joined #openstack-kolla13:09
*** goldyfruit has quit IRC13:09
*** rhallisey has joined #openstack-kolla13:10
*** athomas has joined #openstack-kolla13:14
*** kristian__ has joined #openstack-kolla13:14
*** jascott1 has joined #openstack-kolla13:16
kristian__Hi, I'm getting this error while trying to do ansible prechecks13:16
kristian__ERROR! Unexpected Exception: 'utf8' codec can't decode byte 0xc2 in position 700: invalid continuation byte13:16
rwellumsbezverk: seeing a genconfig issue - have you seen this before? https://www.irccloud.com/pastebin/1keQMDIz/13:16
sbezverkrwellum: are you using kolla-ansible genconfig or the new one we use in the gate?13:18
rwellumThe former. Ah - is this something I missed in your change?13:18
sbezverkrwellum: please use new one and if you do not mind, update DG13:19
kristian__please may someone help me?13:19
rwellumsbezverk: ack will do.13:20
sbezverkhere is new command which needs to be used instead of kolla-ansible genconfig:13:20
sbezverkansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml13:20
*** jascott1 has quit IRC13:20
sbezverkkristian__: most of kolla ansible folks are either in transit or preparing for the travel.13:21
kristian__oh ok13:22
kristian__also found the issue13:22
*** ducttape_ has joined #openstack-kolla13:22
kristian__dunno how but when I put # in globals it threw an error13:22
sbezverkkristian__: if you found issu, please file a bug on launchpad13:22
kristian__but putting # into config?13:23
kristian__thats maybe an issue with nano13:23
georgem1sbezverk:I'm hitting the same issue as in https://bugs.launchpad.net/kolla/+bug/1537815 running tag 4.0.013:23
openstackLaunchpad bug 1537815 in kolla "horizon does not load the css properly" [Undecided,Fix released] - Assigned to Jeffrey Zhang (jeffrey4l)13:23
sbezverkgeorgem1: the fix is in master, you need to cherry pick it and push to ocata13:25
georgem1and then redeploy?13:26
*** athomas has quit IRC13:26
rwellumsbezverk: in that command, I don't have 'ansible/site.yml'13:26
*** athomas has joined #openstack-kolla13:26
*** ducttape_ has quit IRC13:26
kristian__rwellum: I had that same issue on my ubuntu box13:27
eanylin_rwellum: You need to do it under the kolla_kubernetes folder, it should work from there13:27
sbezverkgeorgem1: hm, it is an old fix, please check with Jeffrey4l13:27
kristian__make sure its pointing to that folder where its located13:27
sbezverkrwellum: I have ansible in kolla-kubernetes13:28
sbezverkand there is site.yml there13:28
rwellumthanks but that failed too:13:28
rwellumhttps://www.irccloud.com/pastebin/0sGtQedg/13:28
georgem1sbezverk: thanks13:28
rwellumsudo?13:28
sbezverksydo13:29
sbezverksudo13:29
eanylin_yes, sudo13:29
*** gkadam has quit IRC13:29
rwellumok13:29
*** gkadam has joined #openstack-kolla13:29
rwellumGot further but failed:  https://www.irccloud.com/pastebin/GWSBD9tY/13:31
eanylin_you ran anything with kolla-genconfig earlier? Might need to clean up stuff in your box in that case, I had to start from scratch to get clean run13:32
rwellumOh yeah probably!13:33
eanylin_yeah13:33
kristian__I'm getting this error while deploying kolla-ansible with cinder on cinder-backup step on ubuntu 16.0413:33
kristian__fatal: [localhost]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (most recent call last):\\n  File \"/tmp/ansible_0PRWyV/ansible_module_kolla_docker.py\", line 783, in main\\n    result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n  File \"/tmp/ansible_0PRWyV/ansible_module_kolla_docker.py\", line 585, in recreate_or_restart_container\\n    self.start_container()\\n  File \"/tmp/ansible_0PRWyV/ansi13:33
kristian__ble_module_kolla_docker.py\", line 610, in start_container\\n    self.dc.start(container=self.params.get(\\'name\\'))\\n  File \"/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py\", line 21, in wrapped\\n    return f(self, resource_id, *args, **kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/docker/api/container.py\", line 382, in start\\n    res = self._post_json(url, data=start_config)\\n  File \"/usr13:33
kristian__/local/lib/python2.7/dist-packages/docker/client.py\", line 198, in _post_json\\n    return self._post(url, data=json.dumps(data2), **kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py\", line 47, in inner\\n    return f(self, *args, **kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/docker/client.py\", line 135, in _post\\n    return self.post(url, **self._set_request_timeout(kwargs))\13:33
kristian__\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 535, in post\\n    return self.request(\\'POST\\', url, data=data, json=json, **kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 488, in request\\n    resp = self.send(prep, **send_kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 609, in send\\n    r = adapter.send(request, **13:33
kristian__kwargs)\\n  File \"/usr/local/lib/python2.7/dist-packages/requests/adapters.py\", line 499, in send\\n    raise ReadTimeout(e, request=request)\\nReadTimeout: UnixHTTPConnectionPool(host=\\'localhost\\', port=None): Read timed out. (read timeout=60)\\n'"}13:33
*** srwilkers has joined #openstack-kolla13:33
sbezverkrwellum: man, I guess you need to check with ansible experts13:34
pesterlinux13:35
egonzalezrwallner, that sounds like a jinja issue, is not finding 'equalto'13:36
rwallnershould have an auto forward to rwellum from my handle :)13:36
*** xinliang has quit IRC13:36
rwallnerany of you at openstack summit next week btw?13:37
egonzalezrwallner, sorry heheh, just wrote rw <tab> lol13:37
egonzalezim not going :(13:38
rwallnerno worries!13:38
*** srwilkers has quit IRC13:38
rwellumegonzalez: trying with a cleaner environment - although I am not sure how to clean all this up as it's a bit of a black box.13:39
rwellumrwallner: sorry!13:39
rwellumrwallner: I'm going13:39
*** japestinho has quit IRC13:40
rwallnerkeeps me engaged, dont sweat it. cool would love to catch up with anyone, a few folks from our team will be there13:40
*** shardy has quit IRC13:41
*** shardy has joined #openstack-kolla13:45
*** hachi has joined #openstack-kolla13:46
*** lucasxu has joined #openstack-kolla13:49
openstackgerritSam Betts proposed openstack/kolla-kubernetes master: Deploy TFTP with inspector DNSmasq instance  https://review.openstack.org/46294213:49
*** xinliang has joined #openstack-kolla13:50
*** goldyfruit has joined #openstack-kolla13:51
*** eaguilar has joined #openstack-kolla13:53
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999513:54
pesterkolla-ansible reconfigure is the same as kolla-ansible deploy ?13:56
*** jchhatbar has quit IRC13:56
*** eanylin_ has quit IRC13:57
*** iniazi has quit IRC13:58
*** lrensing has joined #openstack-kolla13:59
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix neutron-openvswitch-agent crash on multinode  https://review.openstack.org/46294914:01
egonzalezpester, for most services yes, a few still not migrated to new reconfiguration14:01
*** xinliang has quit IRC14:07
*** iniazi has joined #openstack-kolla14:07
*** xinliang has joined #openstack-kolla14:08
*** eanylin_ has joined #openstack-kolla14:09
*** xinliang has quit IRC14:14
*** jascott1 has joined #openstack-kolla14:17
*** eaguilar has quit IRC14:19
*** ducttape_ has joined #openstack-kolla14:19
*** jascott1 has quit IRC14:21
*** shardy_ has joined #openstack-kolla14:23
*** jtriley has quit IRC14:30
*** eaguilar has joined #openstack-kolla14:33
*** lpetrut__ has quit IRC14:40
*** lucasxu has quit IRC14:43
*** salv-orlando has joined #openstack-kolla14:53
kristian__Hi, I cannot see any css or js in the source of horizon dash installed from kolla-ansible14:55
georgem1same here14:56
*** salv-orl_ has joined #openstack-kolla14:56
georgem1it looks like https://bugs.launchpad.net/kolla/+bug/153781514:57
openstackLaunchpad bug 1537815 in kolla "horizon does not load the css properly" [Undecided,Fix released] - Assigned to Jeffrey Zhang (jeffrey4l)14:57
georgem1are you running ta 4.0.0 ?14:57
kristian__built ubuntu source 4.0.014:57
kristian__also the same in 4.0.114:57
georgem1I using ubuntu binary 4.0.014:58
kristian__I didn't have a good time with binary for ubuntu14:58
kristian__but if it works then I will try to rebuild it14:58
georgem1well, it doesn't14:59
georgem1I mean it has the same problem, no css or js14:59
kristian__but it worked approx 2 weeks ago on 4.0.014:59
*** lucasxu has joined #openstack-kolla15:00
*** salv-orlando has quit IRC15:00
georgem1but if I change "Alias /static /usr/share/openstack-dashboard/static" in apache to "Alias /static /usr/share/openstack-dashboard/openstack-dashboard/static" inside the horizon container, run the "manage.py compress --force" and then "kill -HUP 7" I get the openstack logo on the login page15:02
kristian__I will try it15:02
georgem1you can look in "/var/log/kolla/horizon/horizon-access.log15:03
georgem1to see the 404s15:03
kristian__the problem is that I have looked into the page source and I couldn't find any css and js links15:05
kolla-slack<portdirect> o/ mornin15:07
*** jtriley has joined #openstack-kolla15:11
*** lpetrut has joined #openstack-kolla15:15
*** eaguilar has quit IRC15:16
*** lrensing has quit IRC15:17
sbezverkportdirect: morning, any updates for ppt ;) ??15:18
*** manheim_ has quit IRC15:19
*** manheim has joined #openstack-kolla15:20
*** lrensing has joined #openstack-kolla15:20
*** manheim has quit IRC15:25
*** eaguilar has joined #openstack-kolla15:26
*** schwicht has joined #openstack-kolla15:27
inc0good morning15:27
*** lucasxu has quit IRC15:28
inc0kristian__: georgem1 hmm I saw that happening15:28
inc0you see images?15:28
kristian__I can see the images in the page source but 404 response15:29
inc0hmm, sounds like collect static didn't collect static15:29
kristian__currently rebuilding images to binary ubuntu15:29
*** lucasxu has joined #openstack-kolla15:29
inc0soo try to enable DEBUG15:31
kristian__on what?15:31
inc0you can do this by editing /etc/kolla/horizon/local.conf15:31
inc0(or however is horizon called)15:31
kristian__ok15:31
openstackgerritBrad P. Crochet proposed openstack/kolla master: Add mistral-event-engine image  https://review.openstack.org/46297215:31
inc0and restarting container15:31
*** lzyPower has joined #openstack-kolla15:32
*** Serlex has quit IRC15:32
*** lzyPower is now known as lazyPower15:32
*** lazyPower has quit IRC15:32
*** lazyPower has joined #openstack-kolla15:32
kristian__deploying it with debug on15:35
*** unicell1 has joined #openstack-kolla15:41
*** salv-orl_ has quit IRC15:42
*** unicell has quit IRC15:42
kristian__inc0: its deployed, found copying css and js files15:42
georgem1I redeployed 4.0.0 based on ubuntu binary and it looks good now15:42
*** blallau has quit IRC15:43
kristian__for me nothing15:44
kristian__http://cloud.dkristian.co/15:44
kristian__but now I can see the css15:44
kristian__so need to do some digging in the container15:45
kolla-slack<portdirect> @sbezverk just abou to get on that15:45
inc0try to run collectstatic15:45
kolla-slack<portdirect> @kfox1111 you about?15:45
inc0(just can't remember how to do this with apache;))15:46
inc0https://docs.openstack.org/developer/horizon/topics/install.html15:46
sbezverkportdirect: man, you really want to sqeez in the last door of last wagon ;)15:46
kristian__inc0: but in what dir in the container?15:46
portdirectsbezverk: I'll hang off the back15:46
portdirectsbezverk: sorry dude15:46
inc0yeah that's the piece I can't remember kristian__ ;)15:47
kristian__gonna run find command15:47
inc0find -name "manage"?;)15:47
kristian__find / -name 'manage.py'15:47
kristian__3 occurances15:48
kristian__/usr/share/openstack-dashboard/manage.py15:48
kristian__/usr/bin/manage.py15:48
kristian__/usr/lib/python2.7/dist-packages/django/conf/project_template/manage.py15:48
kristian__this is the destination for the /usr/bin/manage.py15:49
kristian__and 0 were copied15:49
kristian__the third one is django default and first 2 are for kolla but 0 copied15:50
kristian__static files work15:51
kristian__also login15:52
inc0cool15:52
inc0what helped?15:52
*** vhosakot has joined #openstack-kolla15:53
kristian__(/var/lib/openstack-dashboard/static) as an alias for static15:53
*** salv-orlando has joined #openstack-kolla15:54
*** kristia__ has joined #openstack-kolla15:55
kristia__here15:56
kristia__after deploying murano I got this15:56
kristia__cp: cannot create regular file '/usr/lib/python2.7/site-packages/openstack_dashboard/local/enabled/_50_dashboard_catalog.py': No such file or directory15:56
kristia__in horizon15:56
kristia__and cannot do anything in the container because its restarting15:57
kristia__inc0: have you seen it?15:58
*** kristian__ has quit IRC15:58
inc0no15:58
inc0try source build...15:58
kristia__ok15:58
kristia__let me upgrade to 4.0.115:59
*** kristia__ has quit IRC15:59
*** kristian__ has joined #openstack-kolla16:00
*** rwallner has quit IRC16:04
*** shasha_t_ has joined #openstack-kolla16:08
*** jascott1 has joined #openstack-kolla16:11
*** jascott1 has quit IRC16:12
*** matrohon has quit IRC16:13
*** zhubingbing__ has quit IRC16:13
*** zhubingbing_ has joined #openstack-kolla16:13
*** jascott1 has joined #openstack-kolla16:17
janemcant I use the external_vip_address for api access? getting these keystone errors "SSL error violation of protocol .."16:21
*** lrensing has quit IRC16:21
*** janki has joined #openstack-kolla16:21
*** lrensing has joined #openstack-kolla16:22
janemconfigured with tls enabled. Horizon working as expected16:22
*** gkadam has quit IRC16:22
*** lpetrut has quit IRC16:23
*** eaguilar has quit IRC16:24
kfox1111morning.16:25
kfox1111portdirect: ping16:25
*** kristian__ has quit IRC16:26
portdirectkfox1111: hey man, just send you some PM's :)16:27
portdirects/send/sent16:27
*** kristian__ has joined #openstack-kolla16:27
inc0janem: it should work16:31
janeminc0: do I have to configure keystone to use ssl? All i did was to setup external_vip and TLS in my globals.yml file.16:32
janeminc0: oh, and external_fqdn16:32
inc0yeah I think there is guide for TLS in docs16:33
inc0janem: https://docs.openstack.org/developer/kolla-ansible/advanced-configuration.html#tls-configuration16:34
janeminc0: hm, yeah I followed that, so the tls works for horizon. Everything seems in order with the config acording to the doc's.16:36
inc0try using openstack --debug project list16:38
*** rhallisey has quit IRC16:40
janeminc0: still getting "EOF occurred in violation of protocol (_ssl.c:590)"16:41
inc0ssl verification issue?16:42
*** kristian__ has quit IRC16:42
*** kristian__ has joined #openstack-kolla16:43
janemits a verified ssl certificate, all green and good in horizon. So I wouldn't think so(?)16:44
*** mgoddard has quit IRC16:45
*** shasha_t_ has quit IRC16:45
*** vhosakot has quit IRC16:53
*** rwallner has joined #openstack-kolla17:03
*** harlowja has quit IRC17:03
janeminc0: get the same erro when I specify "OS_CACERT" as well.17:06
inc0:/17:07
janeminc0: im using https://example.com:5000 should I be using port 35357? I did not open that to the public ip.17:11
*** unicell1 has quit IRC17:15
*** goldyfruit has quit IRC17:15
inc0well you shouldn't17:16
*** gfidente is now known as gfidente|afk17:16
*** eaguilar has joined #openstack-kolla17:18
rwellumHey inc017:21
inc0hey rwellum :) will you be in Boston?17:22
rwelluminc0: yes I will :)17:22
rwellumArrive Monday morning17:22
*** kristian__ has quit IRC17:29
rwelluminc0: you probably saw the gate change to move from kolla-ansible genconfig to "ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml" ?17:30
inc0I wrote it;)17:31
inc0so yeah;)17:31
rwellumGreat!17:31
rwellumExcept I've been stuck trying it with errors like this: https://www.irccloud.com/pastebin/Z6yGaX50/17:31
inc0well seems like a bug17:33
rwellumVery much ignorant of ansible - any way to debug? I found that a. I had to run this in kolla-ansible directory and b. use sudo17:34
inc0you shouldnt have to run it in ansible dir tho17:34
inc0kolla-kubernetes dir also has ansible17:34
inc0try that17:34
rwellumSorry my bad - I did17:35
inc0yeah whole point of this change was to remove kolla-ansible dep17:36
rwellumI did: "cd kolla-kubernetes; sudo ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml; cd .."17:38
rwellumJust to verify17:38
*** unicell has joined #openstack-kolla17:40
inc0looks good17:40
inc0so I guess we have a bug17:40
inc0http://jinja.pocoo.org/docs/2.9/templates/#equalto :(17:42
inc0pip freeze | grep jinja2?17:42
* jascott1 is scared cause that worked for him yesterday17:43
jascott1(the playbook)17:43
*** shasha_t_ has joined #openstack-kolla17:47
rwellumhttps://www.irccloud.com/pastebin/5zXds5kt/17:50
*** rhallisey has joined #openstack-kolla17:50
inc0:/17:51
rwellumThat good or bad? :)17:51
egonzalezin ansible we have a requirement for !=1.9.617:51
egonzalezdon't know if is related with this17:52
rwellumWell it is not 1.9.6 :)17:53
egonzalez2.9.6 sorry heheh17:54
rwellumjascott1: can you do 'pip freeze | grep -i jinja' on your working environment?17:54
jascott1rwellum hmm one sec17:55
egonzalezreally almost all 2.9* jinja version are banned17:55
egonzalezi have 2.8.117:56
rwellumegonzalez: this is just Centos7 - I'm assuming I just have the defaults.17:56
*** shasha_t_ has quit IRC17:56
jascott1Jinja2==2.9.617:57
jascott1rwellum you didnt also run genconfig?17:58
rwellumjascott1: at first I did, but when I realised that might be an issue I started again from a clean VM.17:58
openstackgerritMerged openstack/kolla-kubernetes master: Ensure that ironic-dnsmasq can find its IP address  https://review.openstack.org/46231017:59
* rwellum was googling how to downgrade jinja but now not sure that's the issue.17:59
*** lrensing has quit IRC17:59
jascott1rwellum heres my pip freeze http://paste.openstack.org/show/609021/18:00
egonzalezas far i can find in google, equalto was introduced in jinja 2.818:00
rwellumThanks jascott118:02
jascott1what os you on?18:02
jascott1(not that it should matter but who knows)18:02
rwellumegonzalez: what's weird is I was getting the same error earlier - but was complaining about cinder.18:02
rwellumCentos7 jascott118:02
egonzalezlet me try to genconfig18:03
jascott1ok cool. I have playbook working for ubuntu which is where that freeze came from but am working right now on centos so will see if I have similar problems18:03
*** manheim has joined #openstack-kolla18:04
rwellumjascott1: , egonzalez : just downgraded to 2.8.1 and it seems happier.18:07
*** eaguilar has quit IRC18:07
rwellumYup completed successfully.18:08
*** janki has quit IRC18:08
jascott1interesting18:08
*** manheim has quit IRC18:08
*** pcaruana has quit IRC18:10
rwellumOdd that it works for you for Ubuntu, but not me for Centos.18:11
*** tonanhngo has joined #openstack-kolla18:14
*** eaguilar has joined #openstack-kolla18:17
*** openstackgerrit has quit IRC18:18
esmute_Hi guys, quick question. I noticed that in the DG, it says to use canal for networking. Does that mean if i have a k8s with, for example, flannel or weave, it wont work?18:22
sdakeesmute_ that is just what the deployment guide uses - feel fre to use whatever cni you prefer18:22
rwellumCanal is used in the gate though - so we know it's working well.18:25
sbezverkrwellum: I really like this statement :)18:26
esmute_im asking because im not able to get the neutron-openvswitch-agent to run. It is stuck in `init`18:26
sbezverkesmute_: have you changed kubelet service parameters?18:26
esmute_yes.. i disabled cri18:27
sbezverkesmute_: it should have resolved the issue you were reporting yesterday, we saw it and that was confirmed fix..18:27
sbezverkby multiple people including myself :)18:28
esmute_ok let me make sure that the flag is being applied correcntly18:28
georgem1Is it normal to get "Error: ERROR: Missing required credential: roles ['heat_stack_owner']" when trying to start a heat stack on top of a freshly deployed kolla 4.0.0 ?18:28
sbezverkesmute_:  I am almost 100% positive there is something missing..18:28
*** lucasxu has quit IRC18:29
*** eaguilar has quit IRC18:30
sbezverkesmute_: on the host run ps -ef | grep kubelet18:30
sbezverkin the output you should see all flags are currently used18:31
sbezverkmake sure you see cri is disabled18:31
*** lucasxu has joined #openstack-kolla18:31
esmute_yeah i didnt have it for some reason.. ill added it and restart kubelet18:31
esmute_13173 ?        Ssl    0:11 /kubelet --kubeconfig=/etc/kubernetes/kubeconfig --require-kubeconfig --client-ca-file=/etc/kubernetes/ca.crt --anonymous-auth=false --cni-conf-dir=/etc/kubernetes/cni/net.d --network-plugin=cni --lock-file=/var/run/lock/kubelet.lock --exit-on-lock-contention --pod-manifest-path=/etc/kubernetes/manifests --allow-privileged --hostname-override=castle10.rook.com --node-labels=master=true --node-labels=node-role18:32
esmute_.kubernetes.io/master --cluster_dns=10.3.0.10 --cluster_domain=cluster.local --enable-cri=false18:32
esmute_do i have to run the deployment again or would restart kubelet with the cri-enable=false flag suffice?18:33
*** openstackgerrit has joined #openstack-kolla18:36
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL  https://review.openstack.org/46303618:36
rwellumsbezverk: yes I like your gate orientation - means I always have something very well tested to look at.18:36
esmute_sbezverk: my fault. The flag was not applied propertly.. now it works. the ovenvswitch-agent is running now. Thank you very much18:36
sbezverkesmute_: yeeaaahhh :)18:37
esmute_when i boot a nova instance, the instance is erroring... "Binding failed for port 4ad745b6-03ec-4f87-aaa9-7222431965e9, please check neutron logs for more information."18:37
esmute_perhaps i have to restart the whole deployment again18:37
sbezverkesmute_: you need to give some time18:37
sbezverkrun neutron agent-list18:37
sbezverkif one of agents show as down, that is the error you would see18:38
esmute_sbezverk: ahh ok .. I already tore down my cluster... i will start it again and report back :)18:38
sbezverkesmute_: ok18:38
*** salv-orlando has quit IRC18:41
rwellumesmute_: is this ubunut?18:42
rwellum*ubuntu*18:42
esmute_im using coreos18:42
rwellumOh ok18:42
esmute_and flannel18:42
rwellumWas just looking at the changes here: https://review.openstack.org/#/c/461527/30/tools/setup_kubernetes.sh18:42
*** jtriley_ has joined #openstack-kolla18:42
sbezverkrwellum: because we use 1.6.2, this workaround is no longer needed18:44
*** tonanhngo has quit IRC18:44
*** jtriley has quit IRC18:46
rwellumWhich part sbezverk ? "--pod-network-cidr 172.16.132.0/22 "18:47
*** georgem1 has left #openstack-kolla18:47
sbezverkrwellum: line 17 and 2918:47
*** jtriley_ has quit IRC18:47
sbezverkon the left side18:48
rwellumsbezverk: yes but what I meant is you're still doing it on line 27, RHS18:49
rwellumFor ubunut?18:50
rwellumugh - can't spell today18:50
sbezverkrwellum: here is the deal Ubuntu can use two types of cgroup driver, with centos it is easy, it is always systemd18:50
sbezverkbut in case of ubuntu we really need to get cgroup driver is currently used on this specific host and pass it to kubelet18:51
rwellumAh makes sense.18:51
sbezverkthat is why there is a slight difference between centos and ubuntu18:52
rwellumyup18:52
*** jtriley has joined #openstack-kolla18:52
*** lucasxu has quit IRC18:57
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix haproxy restart while genconfig  https://review.openstack.org/46304018:57
*** iniazi has quit IRC18:57
*** lucasxu has joined #openstack-kolla19:00
*** blallau has joined #openstack-kolla19:12
janeminc0: I figured it out, OS X openstack client issue. Thanks for the help!19:14
portdirectkfox1111: ping19:14
inc0janem: damn you apple!19:15
inc0;)19:15
inc0I'm glad it worked out19:15
janeminc0: hehe. I know.. docker to the rescue again! :)19:15
*** lrensing has joined #openstack-kolla19:19
openstackgerritSam Betts proposed openstack/kolla-kubernetes master: Deploy TFTP with inspector DNSmasq instance  https://review.openstack.org/46294219:31
*** gomarivera has joined #openstack-kolla19:31
*** lrensing has quit IRC19:37
*** eaguilar has joined #openstack-kolla19:42
esmute_sbezverk: The openvswitch-agent now is in running state. Thank you19:43
esmute_but when i boot a cirros image, the vm is building forever19:44
esmute_i tried to look at the nova-api, nova-compute and nova-scheduler log using kubectl logs, but didnt see anyhtign obvious19:44
*** harlowja has joined #openstack-kolla19:48
egonzalezinc0, reading through summit workshop, will people deploy ubuntu binary?19:49
inc0well I'll suggest source:P19:50
egonzalezatm, cinder api is broken for ubuntu binary19:50
inc0in fact I didn't build ubuntu-binary yet19:50
inc0oh joy19:50
egonzalezdont do it :)19:50
inc0yeah I mentioned that source is generally more stable19:50
inc0what do you think about guide?19:50
egonzalezhttps://bugs.launchpad.net/kolla/+bug/167675119:50
openstackLaunchpad bug 1676751 in kolla-ansible pike "cinder-api keeps restarting after the deployment" [Critical,In progress] - Assigned to Eduardo Gonzalez (egonzalez90)19:50
*** skramaja_ has quit IRC19:50
egonzalezhttps://review.openstack.org/#/c/457993/19:51
egonzalezguide looks good, is like the quickstart guide but easier to follow and understand19:51
inc0yeah I think we could use it as new quickstart later;)19:53
*** harlowja has quit IRC19:56
*** salv-orlando has joined #openstack-kolla19:57
*** shasha_t_ has joined #openstack-kolla19:57
*** shasha_t_ has quit IRC20:02
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL  https://review.openstack.org/46303620:04
*** ssurana has joined #openstack-kolla20:04
*** egonzalez has quit IRC20:09
Reepicheepinc0: I think it more complete then the quickstart the second day stuff as little as you have there seems to be virtually non existant in any of the current docs20:14
inc0Reepicheep: yeah, I guess I need to start a blog20:15
inc0and start writing this all down20:15
ReepicheepI don't think I have seen the "reconfigure" anyware other then your docs and a few mentions on IRC if I happen to be looking at the correct time20:16
*** shasha_t_ has joined #openstack-kolla20:16
*** lucasxu has quit IRC20:18
*** eaguilar has quit IRC20:18
*** eaguilar has joined #openstack-kolla20:20
*** lucasxu has joined #openstack-kolla20:21
inc0I'll write something up after summit20:21
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL  https://review.openstack.org/46303620:23
*** lucasxu has quit IRC20:27
Reepicheepinc0: is your globals file a .yml or a .yaml20:28
inc0yaml afair20:29
*** eaguilar has quit IRC20:32
Reepicheepmine are all .yml files which I started from the examples from /usr/share/kolla-ansible20:33
Reepicheepboth  globals.yml and passwords.yml20:34
ReepicheepI started with kolla-ansible 4.0.0 it may have been differnet before that20:34
Reepicheepinc0:  also what may not be extreamly clear is where the location of the inventory file is,  maybe I don't have to but I pretty much always define it with a -i <path_to_inventory_file>20:36
*** athomas has quit IRC20:38
inc0well we copy it to .20:40
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix log rotation issue on services  https://review.openstack.org/46305720:40
inc0I started with path to inventory but figured out it'll be easier to just copyapste commands20:40
jascott1rwellum i dont get your request wrt to my ps20:41
rwellumHi jascott1  - removing the '--enable-cri=false' part?20:42
jascott1oh since when is that not required?20:42
jascott1sincerely dont know about the change20:43
Reepicheepinc0:  I figured that out .. I assume that kolla-ansible looks for an all-in-one or multinode file in the current directory if it is not defined20:43
Reepicheepkeep in mind my perspective is from someone new to ansible20:43
inc0well -i multinode will simply point to ./multinode20:43
inc0in fact I'll switch multinode to ./multinode20:44
inc0will be clearer that it's a path to file20:44
Reepicheepyeah.. I was looking more at the day2.md where it is not defined at all20:44
inc0done:)20:46
*** jtriley has quit IRC20:47
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL  https://review.openstack.org/46303620:50
rwellumjascott1: sorry for delay - in a meeting here $$job. Yeah the reference I put in the review is the ps where sbezverk removed that.20:52
rwellumBut only for Centos20:52
jascott1Oh20:52
rwellumSeems Ubuntu still needs this.20:52
jascott1missed that part20:52
jascott1:(20:52
rwellumYeah - sorry.20:52
jascott1np working it20:54
*** blallau has quit IRC20:56
*** salv-orl_ has joined #openstack-kolla20:57
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL  https://review.openstack.org/46303620:58
rwellumjascott1: maybe I'm reading it wrong but I think the whole line can be removed - the whole sed command. You're just taking out the cri part?20:59
jascott1yeah that was my original question20:59
*** salv-orlando has quit IRC20:59
jascott1im pretty sure we need dynamic cgroup-driver21:00
rwellumAh - maybe we need to have sbezverk confirm - but I tested without that line and it worked fine.21:00
jascott1the sed is still there21:00
jascott1it might default to something that works?21:00
rwellumhttps://review.openstack.org/#/c/461527/30/tools/setup_kubernetes.sh - lines 17-18 completely removed?21:01
rwellumjascott1: ah because systemd is the default in Centos I believe - so sbezverk removed it there but kept it in ubuntu.21:04
sbezverkjascott1: yep that is correct21:04
rwellumBut the deployment guide does not do a great job differentiating between ubuntu and centos or other os's.21:06
rwellumThat's a bug I think.21:06
*** bmace has quit IRC21:09
*** bmace has joined #openstack-kolla21:10
Reepicheepinc0: I added a section to day2.md that mentions the need to run deploy again if new containers are needed by changes to the global.yaml file21:14
inc0thank you!21:14
ReepicheepI know it took me a long time to figure that out.21:15
Reepicheepremember I'm coming from the declaritive Puppet world, I'm used to just having "apply" ;)21:16
*** lrensing has joined #openstack-kolla21:16
inc0good change:) man we totally need to organize it into proper docs21:16
jascott1rwellum sbeverk I changed it but can change back for simplicity if it doesnt matter21:16
Reepicheepbut you have pulled in some terraform stuff so I get that stuff ;)21:16
inc0thank jascott1 for that:)21:17
Reepicheepjascott1: well done21:18
jascott1jascott1 thanks! i like terraform pretty well.. especially since you can make it output ansible inventory files :)21:18
Reepicheepinc0: you may have to correct my wording possibly around the --tags part if I'm incorrect.. that's curretly how I understand it21:19
inc0yeah, wording is a bit off21:19
inc0haproxy is one role within play21:20
inc0and playbook is a set of plays21:20
inc0that is less important, because we have just one big play21:20
inc0however correct word is role for haproxy21:20
inc0Reepicheep: https://github.com/inc0/kolla-ansible-workshop/blob/master/day2.md corrected it a bit21:21
Reepicheepinc0: thanks I knew when I was typing it that it didn't seem like it was the correct wording21:22
*** jrich523 is now known as BobsBrain21:22
ReepicheepI'm learning more ansible everyday21:22
inc0it's just glorified ssh in a loop21:23
*** BobsBrain is now known as jrich52321:23
jascott1there is something fun about watching the containers spin up and work it out21:24
jascott1is there anything to be done about nova-api-cell-create and its crashloop?21:25
jascott1i know it works out eventually but it would be great not freak people out with crash loop21:25
Reepicheepinc0:  yeah.. it's pretty simple commpared to the other automation platforms / frameworks I have used no need for fancy clients and servers21:26
*** ducttap__ has joined #openstack-kolla21:33
*** harlowja has joined #openstack-kolla21:34
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/46254821:34
*** ducttape_ has quit IRC21:34
*** egonzalez has joined #openstack-kolla21:39
*** rwallner has quit IRC21:40
*** lrensing has quit IRC21:47
*** ducttap__ has quit IRC22:04
*** Pavo has joined #openstack-kolla22:05
*** ducttape_ has joined #openstack-kolla22:13
jascott1i wonder what the theoretical minimum spinup time is22:18
*** salv-orl_ has quit IRC22:27
jascott1from mariadb to completion im getting ~13 min22:30
*** spiette has quit IRC22:33
*** gomarivera has quit IRC22:36
*** manheim has joined #openstack-kolla22:36
*** krtaylor has quit IRC22:39
*** ducttape_ has quit IRC22:45
sbezverkjascott1: way too much23:00
*** Pavo has quit IRC23:00
sbezverkour compute kit comes up for 12 minutes23:01
jascott1you are saying 1 min diff is way too much?23:01
*** manheim has quit IRC23:08
*** manheim has joined #openstack-kolla23:09
sbezverkjascott1: sorry I thought it took 13 minutes just to brong mariadb23:10
sbezverknot the whole openstack23:10
*** rwellum has quit IRC23:11
*** manheim has quit IRC23:14
jascott1ah gotcha23:14
jascott1i dont think 12 mins is terribly long time but since it is containers it seems if all images were local it could be made to load more quickly23:36
jascott1one confusing thing about terraform is the way it has different resource types for different providers.. how is that cloud agnostic?23:44
jascott1ideally i would define my master and workers etc and it use an adapter to make it happen23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!