| *** yingjun has joined #openstack-kolla | 00:01 | |
| *** Daviey_ has quit IRC | 00:11 | |
| *** guoshan has quit IRC | 00:15 | |
| *** Pavo has quit IRC | 00:23 | |
| *** eanylin__ has joined #openstack-kolla | 00:28 | |
| duonghq | has anybody arrived in Boston? | 00:36 |
|---|---|---|
| duonghq | sdake, will you join inc0's workshop? | 00:37 |
| *** eanylin__ has quit IRC | 00:38 | |
| *** eanylin__ has joined #openstack-kolla | 00:39 | |
| *** salv-orlando has joined #openstack-kolla | 00:55 | |
| *** salv-orlando has quit IRC | 00:59 | |
| *** dixiaoli has joined #openstack-kolla | 01:06 | |
| *** gianpietro has quit IRC | 01:08 | |
| *** guoshan has joined #openstack-kolla | 01:16 | |
| inc0 | duonghq: I'll be there Sunday afternoon | 01:18 |
| *** ssurana has joined #openstack-kolla | 01:18 | |
| *** ssurana has quit IRC | 01:19 | |
| inc0 | duonghq: https://github.com/inc0/kolla-ansible-workshop check this out | 01:19 |
| duonghq | inc0, roger | 01:19 |
| *** guoshan_ has joined #openstack-kolla | 01:19 | |
| *** guoshan has quit IRC | 01:19 | |
| inc0 | this is what we'll be doing basically | 01:20 |
| * duonghq reading | 01:20 | |
| *** dave-mccowan has joined #openstack-kolla | 01:21 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Remove keystone-paste.ini file in kolla https://review.openstack.org/462535 | 01:30 |
| *** zhurong has joined #openstack-kolla | 01:31 | |
| *** hrw has quit IRC | 01:31 | |
| *** hrw has joined #openstack-kolla | 01:33 | |
| *** zhurong has quit IRC | 01:50 | |
| *** ever has left #openstack-kolla | 01:55 | |
| *** salv-orlando has joined #openstack-kolla | 01:56 | |
| *** goldyfruit has joined #openstack-kolla | 01:58 | |
| *** Chenn has joined #openstack-kolla | 01:59 | |
| *** salv-orlando has quit IRC | 02:00 | |
| *** georgem1 has joined #openstack-kolla | 02:01 | |
| *** yingjun has quit IRC | 02:03 | |
| *** unicell has quit IRC | 02:03 | |
| *** salv-orlando has joined #openstack-kolla | 02:04 | |
| *** salv-orlando has quit IRC | 02:09 | |
| inc0 | hmm....can someone build stable/ocata centos source? | 02:11 |
| sdake | inc0 question - your lab requires 5 vms | 02:12 |
| inc0 | yeah | 02:12 |
| inc0 | it does | 02:12 |
| sdake | what kind of computer do you expect peple will run that on? | 02:12 |
| inc0 | I'm prepping env | 02:12 |
| inc0 | I have 50 strong nodes for vms | 02:12 |
| sdake | is that the 50 node cluster? | 02:13 |
| sdake | cool | 02:13 |
| inc0 | yeah | 02:13 |
| sdake | I was wonderign "where are people going to get 32gb laptops :) | 02:13 |
| inc0 | everyone is getting 5*8gig ram vms | 02:13 |
| sdake | 10/24 is your management network? | 02:14 |
| inc0 | this guide should be our quickstart;) I think it's simpler than what we have today | 02:14 |
| inc0 | it goes like this - every vm will have one shared net 10.0.0.0/16 | 02:14 |
| inc0 | and 2 nets private to env | 02:14 |
| inc0 | 10.1.0.0/24 and 10.1.1.0/24 | 02:15 |
| sdake | Every node will be hooked up to shared network 10.0.0.0/24 | 02:15 |
| sdake | if you share the management network you will need to configure keepalived appropriately | 02:15 |
| inc0 | 3 nets | 02:16 |
| inc0 | 1 shared and 2 private per person | 02:16 |
| inc0 | shared is for deploy | 02:16 |
| inc0 | 1 private is control andother is data | 02:16 |
| inc0 | so no l2 connectivity on between envs | 02:16 |
| inc0 | I was thinking of making one big but I figured that keepalived will bite us | 02:17 |
| sdake | it does work in a shared network | 02:17 |
| inc0 | also I'd need to add allowed-address-pair for vms and it would be hell | 02:17 |
| inc0 | if you chage router id | 02:17 |
| inc0 | I know | 02:17 |
| inc0 | but I want to keep guide simple | 02:17 |
| sdake | yup | 02:17 |
| inc0 | so try to minimize env-specific changes | 02:17 |
| sdake | sounds like you considered it already | 02:17 |
| inc0 | yeah | 02:17 |
| inc0 | I did | 02:17 |
| inc0 | sdake: can you build stable/ocata? | 02:18 |
| inc0 | influx repo times out for me | 02:18 |
| sdake | inc0 i am heading out to dinner now | 02:18 |
| inc0 | kk | 02:18 |
| sdake | inc0 when i get back I can | 02:18 |
| inc0 | nvm | 02:18 |
| inc0 | it seems to be something on my end | 02:19 |
| inc0 | it works outside of docker | 02:19 |
| sdake | ok | 02:19 |
| inc0 | fails inside docker | 02:19 |
| inc0 | duh | 02:19 |
| inc0 | I blame mtu | 02:19 |
| inc0 | yeah, it's mtu | 02:19 |
| *** ssurana has joined #openstack-kolla | 02:28 | |
| *** unicell has joined #openstack-kolla | 02:29 | |
| *** ducttape_ has joined #openstack-kolla | 02:33 | |
| *** unicell has quit IRC | 02:34 | |
| *** unicell has joined #openstack-kolla | 02:35 | |
| *** shasha___ has quit IRC | 02:35 | |
| *** shasha_t_ has joined #openstack-kolla | 02:36 | |
| openstackgerrit | junbo proposed openstack/kolla stable/ocata: Add netcat package in sahara-engine image https://review.openstack.org/462444 | 02:37 |
| *** zhurong has joined #openstack-kolla | 02:38 | |
| *** goldyfruit has quit IRC | 02:47 | |
| *** unicell has quit IRC | 02:50 | |
| *** zhurong has quit IRC | 02:54 | |
| *** zhurong has joined #openstack-kolla | 02:55 | |
| inc0 | any centos people around? | 03:03 |
| zhubingbing_ | sup guys | 03:05 |
| *** salv-orlando has joined #openstack-kolla | 03:05 | |
| sbezverk | inc0: what is going on? | 03:07 |
| inc0 | funny thing | 03:07 |
| inc0 | I have eth0 with my ip on | 03:07 |
| inc0 | I do dhclient eth1 | 03:07 |
| inc0 | and it locks me out | 03:07 |
| inc0 | (I'm connecting via eth0...) | 03:07 |
| sbezverk | inc0: eth0 gets ip address via dhcp? | 03:08 |
| inc0 | both of them yeah | 03:08 |
| inc0 | but I just want to bring up eth1 and eth2 | 03:08 |
| sbezverk | hm looks like a bug then, you can always switch to use static on eth0 | 03:08 |
| inc0 | yeah | 03:09 |
| inc0 | I have no idea what's wrong ;) | 03:09 |
| *** salv-orlando has quit IRC | 03:10 | |
| *** esmute has quit IRC | 03:10 | |
| sbezverk | inc0: I think the safest option woulf be to use static ip to mgmt interface | 03:12 |
| sbezverk | ok it is getting late here, bye gents, good night.. | 03:13 |
| inc0 | gn | 03:15 |
| *** dave-mccowan has quit IRC | 03:16 | |
| *** gkadam has joined #openstack-kolla | 03:20 | |
| *** ducttape_ has quit IRC | 03:40 | |
| *** ducttape_ has joined #openstack-kolla | 03:42 | |
| *** unicell has joined #openstack-kolla | 03:47 | |
| *** georgem1 has quit IRC | 03:50 | |
| *** zhurong has quit IRC | 04:00 | |
| *** guoshan_ has quit IRC | 04:04 | |
| *** salv-orlando has joined #openstack-kolla | 04:06 | |
| *** daidv has joined #openstack-kolla | 04:07 | |
| *** salv-orlando has quit IRC | 04:11 | |
| *** ducttape_ has quit IRC | 04:16 | |
| sdake | inc0 did you get it sorted out | 04:16 |
| sdake | sup zhubingbing_ | 04:17 |
| *** unicell has quit IRC | 04:26 | |
| *** zhurong has joined #openstack-kolla | 04:32 | |
| masber | hi, I don't know why kolla deploy fails fatal: [openstack-controller]: FAILED! => {"changed": false, "failed": true, "msg": "unable to connect to database, check login_user and login_password are correct or /var/lib/ansible/.my.cnf has the credentials. Exception message: (1045, \"Access denied for user 'root'@'openstack-controller' (using password: YES)\")"} | 04:35 |
| masber | I follow all the steps but obviously the password to database doesn't change to the right value? | 04:36 |
| *** jascott1 has quit IRC | 04:36 | |
| *** caowei has quit IRC | 04:43 | |
| *** salv-orlando has joined #openstack-kolla | 04:45 | |
| *** jascott1 has joined #openstack-kolla | 04:49 | |
| *** esmute_ has joined #openstack-kolla | 04:52 | |
| sdake | sup jascott1 | 04:52 |
| sdake | sup masber | 04:52 |
| jascott1 | sdake hey | 04:53 |
| jascott1 | hows it going? | 04:53 |
| sdake | good | 04:53 |
| sdake | did you happen to fix up the deploy guide? | 04:53 |
| *** unicell has joined #openstack-kolla | 04:56 | |
| jascott1 | no but i have the branch created | 04:56 |
| sdake | baby steps :) | 04:56 |
| jascott1 | we just use the new canal RBAC or both? | 04:57 |
| jascott1 | i need to check the gate script to see | 04:57 |
| jascott1 | cause that goes into the patch, i am currently not using the canal RBAC and things are working so far | 04:58 |
| *** britthouser10 has quit IRC | 05:00 | |
| *** britthouser has joined #openstack-kolla | 05:00 | |
| sdake | cool | 05:01 |
| sdake | i think there are a few other changes | 05:01 |
| masber | so what can I do to generate the right password? | 05:08 |
| sdake | not sure and headed to bed | 05:10 |
| sdake | night all | 05:10 |
| *** caowei has joined #openstack-kolla | 05:17 | |
| *** tovin07_ has joined #openstack-kolla | 05:27 | |
| *** unicell1 has joined #openstack-kolla | 05:41 | |
| *** unicell has quit IRC | 05:42 | |
| *** janki has joined #openstack-kolla | 05:44 | |
| *** tonanhngo has quit IRC | 05:48 | |
| *** jbadiapa has quit IRC | 06:01 | |
| *** salv-orlando has quit IRC | 06:10 | |
| *** pcaruana has joined #openstack-kolla | 06:11 | |
| *** guoshan has joined #openstack-kolla | 06:30 | |
| *** zhurong has quit IRC | 06:33 | |
| *** caowei has quit IRC | 06:34 | |
| *** caowei has joined #openstack-kolla | 06:34 | |
| *** zhurong has joined #openstack-kolla | 06:49 | |
| *** salv-orlando has joined #openstack-kolla | 07:07 | |
| openstackgerrit | jeck proposed openstack/kolla-ansible master: Remove /etc/fstab Swift references during cleanup-host https://review.openstack.org/456805 | 07:07 |
| *** gfidente has joined #openstack-kolla | 07:08 | |
| *** shardy has joined #openstack-kolla | 07:08 | |
| *** jascott1 has quit IRC | 07:11 | |
| *** ssurana has quit IRC | 07:15 | |
| openstackgerrit | jeck proposed openstack/kolla-ansible master: Remove /etc/fstab Swift references during cleanup-host https://review.openstack.org/456805 | 07:19 |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vmware support to ceilometer https://review.openstack.org/462842 | 07:20 |
| *** athomas has joined #openstack-kolla | 07:20 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add vSphere support to nova_compute https://review.openstack.org/449529 | 07:23 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add lbaas support to vsphere by vmware-nsx plugin https://review.openstack.org/462844 | 07:24 |
| *** manheim has joined #openstack-kolla | 07:31 | |
| *** lpetrut has joined #openstack-kolla | 07:35 | |
| *** egonzalez has joined #openstack-kolla | 07:37 | |
| tumble | can anyone tell me where I went wrong, when my kolla-ansible deploy tries to pull kolla/centos-binary-fluentd:4.0.1 although this doesn't exist yet on docker hub? (4.0.0 is there) | 07:38 |
| bjolo | morning | 07:47 |
| manheim | hello | 07:47 |
| japestinho | tumble 4.0.1 images weren't on dockerhub yet | 07:47 |
| manheim | try 4.0.0 tag | 07:47 |
| japestinho | tumble set 4.0.0 on globals.yml | 07:48 |
| tumble | oh uhm, which key would that be? I don't see versions in the example that I copied and modified | 07:52 |
| *** blallau has joined #openstack-kolla | 07:54 | |
| tumble | guess it's fluentd_tag, thanks guys, gonna try that | 07:56 |
| *** dixiaoli has quit IRC | 07:56 | |
| *** dixiaoli has joined #openstack-kolla | 07:57 | |
| egonzalez | tumble, openstack_release, currently have empty value and auto-discovered, set to 4.0.0 | 07:57 |
| tumble | egonzalez, ok, ty :) | 07:57 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Fix heat ec2 keystone auth https://review.openstack.org/444953 | 08:06 |
| *** Serlex has joined #openstack-kolla | 08:09 | |
| *** jascott1 has joined #openstack-kolla | 08:11 | |
| *** mgoddard has joined #openstack-kolla | 08:14 | |
| *** jascott1 has quit IRC | 08:16 | |
| *** nathharp has joined #openstack-kolla | 08:20 | |
| *** mgoddard has quit IRC | 08:23 | |
| openstackgerrit | Merged openstack/kolla stable/ocata: Add netcat package in sahara-engine image https://review.openstack.org/462444 | 08:23 |
| *** zhubingbing_ has quit IRC | 08:24 | |
| *** mgoddard has joined #openstack-kolla | 08:28 | |
| *** zhubingbing has joined #openstack-kolla | 08:31 | |
| manheim | hi, if I do kolla-deploy --tags cinder, it should only play cinder playbook, right? | 08:35 |
| manheim | thing is it ignores the --tags option and deploys all | 08:36 |
| *** zhubingbing has quit IRC | 08:38 | |
| *** zhubingbing has joined #openstack-kolla | 08:39 | |
| *** lpetrut_ has joined #openstack-kolla | 08:39 | |
| *** mgoddard has quit IRC | 08:40 | |
| egonzalez | manheim, before cinder apply common role as is a dependency of all roles | 08:41 |
| *** lpetrut has quit IRC | 08:42 | |
| *** mgoddard has joined #openstack-kolla | 08:45 | |
| manheim | ezolzalez, maybe this interests you, we have this https://cloudbase.it/v-magine/ | 08:50 |
| manheim | i am currently implementing kolla in it | 08:50 |
| manheim | instead of RDO | 08:50 |
| manheim | basically it's an AIO with few clicks | 08:51 |
| manheim | if anyone wanna try kolla in a simple way... | 08:51 |
| bjolo | my prechecks fails on my network node "Please check the api_interface settings - interface bond0 is not active" | 08:53 |
| bjolo | what does that mean? i dont have a dedicated api interface, just using default network_interface | 08:53 |
| bjolo | network inteface is very much active and working :) | 08:54 |
| manheim | you'll need a different IP than NICs for that | 08:54 |
| manheim | but in the same subnet | 08:54 |
| manheim | it will add that IP to the nic so HA proxy will work work with that | 08:55 |
| bjolo | i do have unused IPs for ha proxy | 08:55 |
| manheim | ocata release? | 08:55 |
| bjolo | on the same CIDR as network_interface | 08:55 |
| bjolo | yes ocata | 08:56 |
| *** salv-orl_ has joined #openstack-kolla | 08:56 | |
| manheim | hmm, i remember vaguely i had this issue, please try to put that IP (original one, not for VIP) in /etc/hosts | 08:56 |
| bjolo | hosts file is fully populated on all nodes | 08:57 |
| bjolo | ok i dont have vip in hosts file, but not using fqdn in globals.yml. only IPs | 08:58 |
| *** salv-orlando has quit IRC | 08:59 | |
| tumble | I'm a little confused about the use of the registry. I followed the instructions and used tools/start-registry, however, afaik this local registry doesn't need any credentials. If I set the credentials in globals.yml to foo/bar I'm good, but kolla images cannot be found because this registry obviously doesn't proxy through to hub | 08:59 |
| bjolo | i can add VIP and some name to hosts file and push out to all nodes and see if that works. | 08:59 |
| tumble | now, if I set the docker hub as registry instead, then I cannot leave out the credentials in globals, because ansible doesn't like undefined vars | 08:59 |
| bjolo | my real issue is that the cloud does not deploy, so backtracking i found this issue in prechecks. dunno if that is related to the "real" issue | 09:00 |
| pester | egonzalez: just created bugreport, can you check ? https://bugs.launchpad.net/kolla/+bug/1688496 | 09:02 |
| openstack | Launchpad bug 1688496 in kolla "instance stuck at "booting from hard disk"" [Undecided,New] | 09:02 |
| tumble | I simplify my question: why do I have to set docker_registry_password if all I want to do is pulling public images from docker hub? (not setting it results in error about undefined var) | 09:14 |
| *** pbourke has quit IRC | 09:15 | |
| *** pbourke has joined #openstack-kolla | 09:16 | |
| *** iniazi has joined #openstack-kolla | 09:17 | |
| openstackgerrit | Chen proposed openstack/kolla master: Link syntax error fix https://review.openstack.org/462881 | 09:20 |
| egonzalez | tumble, if using images from Dockerhub not need to set registry, registry is only needed if using your own build images | 09:22 |
| egonzalez | bjolo, can you paste ansible -m setup -i inventory <host_failing> | 09:23 |
| tumble | egonzalez, right, that's what I thought. if I comment out the 4 docker_ keys in globals yaml though, the run (kolla-ansible pull) crashes, saying the password var is undefined | 09:23 |
| tumble | egonzalez, what I did to hack around that is to add | default(omit) for password and username in docker_common_options, but I guess that's not how it's supposed to be^^ | 09:24 |
| egonzalez | tumble, by default are commented in globals.yml | 09:25 |
| tumble | egonzalez, right, that's how I run it at the moment, as can be seen here: http://dpaste.com/1RJDSQT but ansible doesn't tolerate unset variables and whenever docker_common_options is used (and it is used in many placess), it expects the password to be set | 09:28 |
| tumble | are you guys running an old version of ansible which doesn't require variables to be set? | 09:28 |
| tumble | I remember it was like that in 2.1 or maybe even 2.2 yet | 09:28 |
| egonzalez | tumble, at /etc/kolla/passwd there is docker password set | 09:30 |
| egonzalez | just comment all other docker registry options and leave that pass set | 09:30 |
| *** shasha_t_ has quit IRC | 09:36 | |
| tumble | it indeed works then. Unfortunately it crashes with http://dpaste.com/2Z8X3Y6 | 09:40 |
| hrw | morning | 09:42 |
| hrw | egonzalez: thanks for +2 | 09:42 |
| *** dixiaoli has quit IRC | 09:45 | |
| tumble | egonzalez, would you agree this is a bug? http://dpaste.com/2845B0F | 09:45 |
| *** hieulq_ has joined #openstack-kolla | 09:46 | |
| tumble | yeah, looks like it https://bugs.launchpad.net/kolla/+bug/1668059 | 09:48 |
| openstack | Launchpad bug 1668059 in kolla "Failed to Starting kolla-toolbox container" [Critical,Triaged] | 09:48 |
| tumble | :< | 09:48 |
| egonzalez | tumble, what docker and docker-py version are you using? | 09:50 |
| egonzalez | manheim, awesome the cloudbase kolla deploy | 09:53 |
| manheim | yep, if anyone want to demo kolla, we can just point them to that | 09:53 |
| manheim | ill tell wen everything is ready | 09:54 |
| *** salv-orl_ has quit IRC | 09:55 | |
| *** zhurong has quit IRC | 09:56 | |
| *** tovin07_ has quit IRC | 09:58 | |
| *** hieulq_ has quit IRC | 10:01 | |
| *** matrohon has quit IRC | 10:04 | |
| *** matrohon has joined #openstack-kolla | 10:07 | |
| egonzalez | pester, have you enabled designate? | 10:07 |
| pester | no | 10:07 |
| pester | those options are default | 10:08 |
| egonzalez | oo right | 10:08 |
| pester | so didn`t even touch them | 10:08 |
| pester | for now I`m trying to deploy with ubuntu instead of centos | 10:09 |
| egonzalez | pester, Cannot access storage file '/root/trusty-server-cloudimg-amd64-disk1.img' (as uid:42427, gid:42427): Permission denied | 10:09 |
| *** ipsecguy_ has quit IRC | 10:09 | |
| pester | yes, my first try to boot KVM VM manually | 10:10 |
| pester | VM in host machine works ok, but in nova_libvirt VM hangs | 10:10 |
| egonzalez | remove cpu_mode = none from /etc/kolla/nova-compute/nova.conf and restart nova_compute container | 10:11 |
| *** guoshan has quit IRC | 10:12 | |
| *** matrohon has quit IRC | 10:15 | |
| *** caowei has quit IRC | 10:17 | |
| *** matrohon has joined #openstack-kolla | 10:19 | |
| pester | let`s make question easy: when I run virt-install in host machine - everything ok, when I run virt-install inside nova_libvirt container VM hangs. | 10:19 |
| pester | maybe libvirt or qemu bug, so I trying to install with ubuntu to get different packages | 10:19 |
| tumble | egonzalez, local system (which executes kolla-ansible) is Debian, docker-py 1.10.6 - remote system where the image is pulled to is a CentOS7, docker-py 1.10.6-1.el7, docker 1.12.6 | 10:39 |
| tumble | and this CentOS docker produces this digest output which cannot be handled by the kolla_docker module | 10:40 |
| egonzalez | tumble, is the image really pulled into the host when running docker pull manually? | 10:44 |
| egonzalez | because digest is not part of the status message, and no status is output. this is the output of new pull and when already exists http://paste.openstack.org/show/608955/ | 10:47 |
| *** britthouser11 has joined #openstack-kolla | 10:48 | |
| *** britthouser has quit IRC | 10:49 | |
| tumble | trying | 10:53 |
| *** ipsecguy has joined #openstack-kolla | 10:53 | |
| *** daidv has quit IRC | 10:54 | |
| *** ipsecguy has quit IRC | 10:56 | |
| *** ipsecguy has joined #openstack-kolla | 10:56 | |
| openstackgerrit | Vladislav Belogrudov proposed openstack/kolla-ansible master: Fix iSCSI mounts for Cinder backup container https://review.openstack.org/462912 | 10:57 |
| tumble | egonzalez, think this one shows it all http://dpaste.com/2QHPCN1 | 10:57 |
| tumble | I wonder where this output difference comes from. This CentOS is freshly installed and Docker is installed from yum (epel-release I think) | 10:58 |
| *** rwallner has joined #openstack-kolla | 10:59 | |
| *** rwallner has quit IRC | 11:03 | |
| tumble | fun fact - on another box (also CentOS7) I have the package docker-latest instead of docker installed | 11:05 |
| tumble | it comes with version 1.13.1 and prints this Status output | 11:05 |
| tumble | I wanted to use this package in the first place, however, then the daemon also is called docker-latest and kolla-ansible isn't happy with that in the prechecks at least | 11:06 |
| tumble | guess I'll try to find a way in the middle by installing docker differently | 11:06 |
| *** jascott1 has joined #openstack-kolla | 11:14 | |
| *** dciabrin has quit IRC | 11:16 | |
| *** dciabrin has joined #openstack-kolla | 11:17 | |
| *** jascott1 has quit IRC | 11:19 | |
| bjolo | egonzalez, will do shortly | 11:24 |
| bjolo | are we runing any docker in docker anymore (ocata)? | 11:24 |
| *** rhallisey has joined #openstack-kolla | 11:32 | |
| *** shasha_t_ has joined #openstack-kolla | 11:37 | |
| tumble | egonzalez, installing docker with the unholy curl bash way makes it print the Status, so I can continue. I'll be back ;D | 11:39 |
| *** shasha_t_ has quit IRC | 11:41 | |
| *** salv-orlando has joined #openstack-kolla | 11:48 | |
| pbourke | Jeffrey4l: hey jeffrey, can you please check my reply to your comment on https://review.openstack.org/#/c/448654/ | 11:48 |
| *** jbadiapa has joined #openstack-kolla | 11:51 | |
| *** Serlex has quit IRC | 12:03 | |
| *** eanylin__ has quit IRC | 12:06 | |
| *** eanylin__ has joined #openstack-kolla | 12:07 | |
| *** eanylin__ has left #openstack-kolla | 12:08 | |
| *** eanylin has joined #openstack-kolla | 12:09 | |
| *** jbadiapa has quit IRC | 12:13 | |
| *** tvignaud_ has quit IRC | 12:14 | |
| *** jbadiapa has joined #openstack-kolla | 12:18 | |
| *** georgem1 has joined #openstack-kolla | 12:18 | |
| *** jtriley has joined #openstack-kolla | 12:18 | |
| *** nathharp has quit IRC | 12:20 | |
| *** rwellum has joined #openstack-kolla | 12:22 | |
| *** ducttape_ has joined #openstack-kolla | 12:23 | |
| *** salv-orlando has quit IRC | 12:24 | |
| *** tvignaud_ has joined #openstack-kolla | 12:27 | |
| *** jtriley has quit IRC | 12:28 | |
| *** schwicht has joined #openstack-kolla | 12:29 | |
| *** georgem1 has quit IRC | 12:33 | |
| *** schwicht has quit IRC | 12:33 | |
| *** skramaja has joined #openstack-kolla | 12:41 | |
| *** tvignaud_ has quit IRC | 12:41 | |
| pester | mkdir | 12:42 |
| *** ducttape_ has quit IRC | 12:46 | |
| *** rwallner has joined #openstack-kolla | 12:49 | |
| *** rwallner has quit IRC | 12:49 | |
| *** rwallner has joined #openstack-kolla | 12:49 | |
| *** Serlex has joined #openstack-kolla | 12:50 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix iSCSI mounts for Cinder backup container https://review.openstack.org/462912 | 12:53 |
| *** manheim_ has joined #openstack-kolla | 12:53 | |
| *** eanylin_ has joined #openstack-kolla | 12:54 | |
| *** lpetrut__ has joined #openstack-kolla | 12:54 | |
| *** imcsk8_ has joined #openstack-kolla | 12:54 | |
| *** georgem1 has joined #openstack-kolla | 12:55 | |
| *** jchhatbar has joined #openstack-kolla | 12:56 | |
| *** skramaja_ has joined #openstack-kolla | 12:56 | |
| *** ipsecguy_ has joined #openstack-kolla | 12:57 | |
| *** dave-mccowan has joined #openstack-kolla | 12:57 | |
| *** zhubingbing__ has joined #openstack-kolla | 12:57 | |
| *** tvignaud_ has joined #openstack-kolla | 12:57 | |
| *** unicell has joined #openstack-kolla | 12:58 | |
| *** jtriley has joined #openstack-kolla | 13:02 | |
| *** skramaja has quit IRC | 13:02 | |
| *** eanylin has quit IRC | 13:02 | |
| *** rhallisey has quit IRC | 13:02 | |
| *** ipsecguy has quit IRC | 13:02 | |
| *** lpetrut_ has quit IRC | 13:02 | |
| *** zhubingbing has quit IRC | 13:02 | |
| *** manheim has quit IRC | 13:02 | |
| *** athomas has quit IRC | 13:02 | |
| *** janki has quit IRC | 13:02 | |
| *** unicell1 has quit IRC | 13:02 | |
| *** imcsk8 has quit IRC | 13:02 | |
| *** goldyfruit has joined #openstack-kolla | 13:09 | |
| *** goldyfruit has quit IRC | 13:09 | |
| *** rhallisey has joined #openstack-kolla | 13:10 | |
| *** athomas has joined #openstack-kolla | 13:14 | |
| *** kristian__ has joined #openstack-kolla | 13:14 | |
| *** jascott1 has joined #openstack-kolla | 13:16 | |
| kristian__ | Hi, I'm getting this error while trying to do ansible prechecks | 13:16 |
| kristian__ | ERROR! Unexpected Exception: 'utf8' codec can't decode byte 0xc2 in position 700: invalid continuation byte | 13:16 |
| rwellum | sbezverk: seeing a genconfig issue - have you seen this before? https://www.irccloud.com/pastebin/1keQMDIz/ | 13:16 |
| sbezverk | rwellum: are you using kolla-ansible genconfig or the new one we use in the gate? | 13:18 |
| rwellum | The former. Ah - is this something I missed in your change? | 13:18 |
| sbezverk | rwellum: please use new one and if you do not mind, update DG | 13:19 |
| kristian__ | please may someone help me? | 13:19 |
| rwellum | sbezverk: ack will do. | 13:20 |
| sbezverk | here is new command which needs to be used instead of kolla-ansible genconfig: | 13:20 |
| sbezverk | ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml | 13:20 |
| *** jascott1 has quit IRC | 13:20 | |
| sbezverk | kristian__: most of kolla ansible folks are either in transit or preparing for the travel. | 13:21 |
| kristian__ | oh ok | 13:22 |
| kristian__ | also found the issue | 13:22 |
| *** ducttape_ has joined #openstack-kolla | 13:22 | |
| kristian__ | dunno how but when I put # in globals it threw an error | 13:22 |
| sbezverk | kristian__: if you found issu, please file a bug on launchpad | 13:22 |
| kristian__ | but putting # into config? | 13:23 |
| kristian__ | thats maybe an issue with nano | 13:23 |
| georgem1 | sbezverk:I'm hitting the same issue as in https://bugs.launchpad.net/kolla/+bug/1537815 running tag 4.0.0 | 13:23 |
| openstack | Launchpad bug 1537815 in kolla "horizon does not load the css properly" [Undecided,Fix released] - Assigned to Jeffrey Zhang (jeffrey4l) | 13:23 |
| sbezverk | georgem1: the fix is in master, you need to cherry pick it and push to ocata | 13:25 |
| georgem1 | and then redeploy? | 13:26 |
| *** athomas has quit IRC | 13:26 | |
| rwellum | sbezverk: in that command, I don't have 'ansible/site.yml' | 13:26 |
| *** athomas has joined #openstack-kolla | 13:26 | |
| *** ducttape_ has quit IRC | 13:26 | |
| kristian__ | rwellum: I had that same issue on my ubuntu box | 13:27 |
| eanylin_ | rwellum: You need to do it under the kolla_kubernetes folder, it should work from there | 13:27 |
| sbezverk | georgem1: hm, it is an old fix, please check with Jeffrey4l | 13:27 |
| kristian__ | make sure its pointing to that folder where its located | 13:27 |
| sbezverk | rwellum: I have ansible in kolla-kubernetes | 13:28 |
| sbezverk | and there is site.yml there | 13:28 |
| rwellum | thanks but that failed too: | 13:28 |
| rwellum | https://www.irccloud.com/pastebin/0sGtQedg/ | 13:28 |
| georgem1 | sbezverk: thanks | 13:28 |
| rwellum | sudo? | 13:28 |
| sbezverk | sydo | 13:29 |
| sbezverk | sudo | 13:29 |
| eanylin_ | yes, sudo | 13:29 |
| *** gkadam has quit IRC | 13:29 | |
| rwellum | ok | 13:29 |
| *** gkadam has joined #openstack-kolla | 13:29 | |
| rwellum | Got further but failed: https://www.irccloud.com/pastebin/GWSBD9tY/ | 13:31 |
| eanylin_ | you ran anything with kolla-genconfig earlier? Might need to clean up stuff in your box in that case, I had to start from scratch to get clean run | 13:32 |
| rwellum | Oh yeah probably! | 13:33 |
| eanylin_ | yeah | 13:33 |
| kristian__ | I'm getting this error while deploying kolla-ansible with cinder on cinder-backup step on ubuntu 16.04 | 13:33 |
| kristian__ | fatal: [localhost]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (most recent call last):\\n File \"/tmp/ansible_0PRWyV/ansible_module_kolla_docker.py\", line 783, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \"/tmp/ansible_0PRWyV/ansible_module_kolla_docker.py\", line 585, in recreate_or_restart_container\\n self.start_container()\\n File \"/tmp/ansible_0PRWyV/ansi | 13:33 |
| kristian__ | ble_module_kolla_docker.py\", line 610, in start_container\\n self.dc.start(container=self.params.get(\\'name\\'))\\n File \"/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py\", line 21, in wrapped\\n return f(self, resource_id, *args, **kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/docker/api/container.py\", line 382, in start\\n res = self._post_json(url, data=start_config)\\n File \"/usr | 13:33 |
| kristian__ | /local/lib/python2.7/dist-packages/docker/client.py\", line 198, in _post_json\\n return self._post(url, data=json.dumps(data2), **kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py\", line 47, in inner\\n return f(self, *args, **kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/docker/client.py\", line 135, in _post\\n return self.post(url, **self._set_request_timeout(kwargs))\ | 13:33 |
| kristian__ | \n File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 535, in post\\n return self.request(\\'POST\\', url, data=data, json=json, **kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 488, in request\\n resp = self.send(prep, **send_kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 609, in send\\n r = adapter.send(request, ** | 13:33 |
| kristian__ | kwargs)\\n File \"/usr/local/lib/python2.7/dist-packages/requests/adapters.py\", line 499, in send\\n raise ReadTimeout(e, request=request)\\nReadTimeout: UnixHTTPConnectionPool(host=\\'localhost\\', port=None): Read timed out. (read timeout=60)\\n'"} | 13:33 |
| *** srwilkers has joined #openstack-kolla | 13:33 | |
| sbezverk | rwellum: man, I guess you need to check with ansible experts | 13:34 |
| pester | linux | 13:35 |
| egonzalez | rwallner, that sounds like a jinja issue, is not finding 'equalto' | 13:36 |
| rwallner | should have an auto forward to rwellum from my handle :) | 13:36 |
| *** xinliang has quit IRC | 13:36 | |
| rwallner | any of you at openstack summit next week btw? | 13:37 |
| egonzalez | rwallner, sorry heheh, just wrote rw <tab> lol | 13:37 |
| egonzalez | im not going :( | 13:38 |
| rwallner | no worries! | 13:38 |
| *** srwilkers has quit IRC | 13:38 | |
| rwellum | egonzalez: trying with a cleaner environment - although I am not sure how to clean all this up as it's a bit of a black box. | 13:39 |
| rwellum | rwallner: sorry! | 13:39 |
| rwellum | rwallner: I'm going | 13:39 |
| *** japestinho has quit IRC | 13:40 | |
| rwallner | keeps me engaged, dont sweat it. cool would love to catch up with anyone, a few folks from our team will be there | 13:40 |
| *** shardy has quit IRC | 13:41 | |
| *** shardy has joined #openstack-kolla | 13:45 | |
| *** hachi has joined #openstack-kolla | 13:46 | |
| *** lucasxu has joined #openstack-kolla | 13:49 | |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Deploy TFTP with inspector DNSmasq instance https://review.openstack.org/462942 | 13:49 |
| *** xinliang has joined #openstack-kolla | 13:50 | |
| *** goldyfruit has joined #openstack-kolla | 13:51 | |
| *** eaguilar has joined #openstack-kolla | 13:53 | |
| openstackgerrit | Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 | 13:54 |
| pester | kolla-ansible reconfigure is the same as kolla-ansible deploy ? | 13:56 |
| *** jchhatbar has quit IRC | 13:56 | |
| *** eanylin_ has quit IRC | 13:57 | |
| *** iniazi has quit IRC | 13:58 | |
| *** lrensing has joined #openstack-kolla | 13:59 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Fix neutron-openvswitch-agent crash on multinode https://review.openstack.org/462949 | 14:01 |
| egonzalez | pester, for most services yes, a few still not migrated to new reconfiguration | 14:01 |
| *** xinliang has quit IRC | 14:07 | |
| *** iniazi has joined #openstack-kolla | 14:07 | |
| *** xinliang has joined #openstack-kolla | 14:08 | |
| *** eanylin_ has joined #openstack-kolla | 14:09 | |
| *** xinliang has quit IRC | 14:14 | |
| *** jascott1 has joined #openstack-kolla | 14:17 | |
| *** eaguilar has quit IRC | 14:19 | |
| *** ducttape_ has joined #openstack-kolla | 14:19 | |
| *** jascott1 has quit IRC | 14:21 | |
| *** shardy_ has joined #openstack-kolla | 14:23 | |
| *** jtriley has quit IRC | 14:30 | |
| *** eaguilar has joined #openstack-kolla | 14:33 | |
| *** lpetrut__ has quit IRC | 14:40 | |
| *** lucasxu has quit IRC | 14:43 | |
| *** salv-orlando has joined #openstack-kolla | 14:53 | |
| kristian__ | Hi, I cannot see any css or js in the source of horizon dash installed from kolla-ansible | 14:55 |
| georgem1 | same here | 14:56 |
| *** salv-orl_ has joined #openstack-kolla | 14:56 | |
| georgem1 | it looks like https://bugs.launchpad.net/kolla/+bug/1537815 | 14:57 |
| openstack | Launchpad bug 1537815 in kolla "horizon does not load the css properly" [Undecided,Fix released] - Assigned to Jeffrey Zhang (jeffrey4l) | 14:57 |
| georgem1 | are you running ta 4.0.0 ? | 14:57 |
| kristian__ | built ubuntu source 4.0.0 | 14:57 |
| kristian__ | also the same in 4.0.1 | 14:57 |
| georgem1 | I using ubuntu binary 4.0.0 | 14:58 |
| kristian__ | I didn't have a good time with binary for ubuntu | 14:58 |
| kristian__ | but if it works then I will try to rebuild it | 14:58 |
| georgem1 | well, it doesn't | 14:59 |
| georgem1 | I mean it has the same problem, no css or js | 14:59 |
| kristian__ | but it worked approx 2 weeks ago on 4.0.0 | 14:59 |
| *** lucasxu has joined #openstack-kolla | 15:00 | |
| *** salv-orlando has quit IRC | 15:00 | |
| georgem1 | but if I change "Alias /static /usr/share/openstack-dashboard/static" in apache to "Alias /static /usr/share/openstack-dashboard/openstack-dashboard/static" inside the horizon container, run the "manage.py compress --force" and then "kill -HUP 7" I get the openstack logo on the login page | 15:02 |
| kristian__ | I will try it | 15:02 |
| georgem1 | you can look in "/var/log/kolla/horizon/horizon-access.log | 15:03 |
| georgem1 | to see the 404s | 15:03 |
| kristian__ | the problem is that I have looked into the page source and I couldn't find any css and js links | 15:05 |
| kolla-slack | <portdirect> o/ mornin | 15:07 |
| *** jtriley has joined #openstack-kolla | 15:11 | |
| *** lpetrut has joined #openstack-kolla | 15:15 | |
| *** eaguilar has quit IRC | 15:16 | |
| *** lrensing has quit IRC | 15:17 | |
| sbezverk | portdirect: morning, any updates for ppt ;) ?? | 15:18 |
| *** manheim_ has quit IRC | 15:19 | |
| *** manheim has joined #openstack-kolla | 15:20 | |
| *** lrensing has joined #openstack-kolla | 15:20 | |
| *** manheim has quit IRC | 15:25 | |
| *** eaguilar has joined #openstack-kolla | 15:26 | |
| *** schwicht has joined #openstack-kolla | 15:27 | |
| inc0 | good morning | 15:27 |
| *** lucasxu has quit IRC | 15:28 | |
| inc0 | kristian__: georgem1 hmm I saw that happening | 15:28 |
| inc0 | you see images? | 15:28 |
| kristian__ | I can see the images in the page source but 404 response | 15:29 |
| inc0 | hmm, sounds like collect static didn't collect static | 15:29 |
| kristian__ | currently rebuilding images to binary ubuntu | 15:29 |
| *** lucasxu has joined #openstack-kolla | 15:29 | |
| inc0 | soo try to enable DEBUG | 15:31 |
| kristian__ | on what? | 15:31 |
| inc0 | you can do this by editing /etc/kolla/horizon/local.conf | 15:31 |
| inc0 | (or however is horizon called) | 15:31 |
| kristian__ | ok | 15:31 |
| openstackgerrit | Brad P. Crochet proposed openstack/kolla master: Add mistral-event-engine image https://review.openstack.org/462972 | 15:31 |
| inc0 | and restarting container | 15:31 |
| *** lzyPower has joined #openstack-kolla | 15:32 | |
| *** Serlex has quit IRC | 15:32 | |
| *** lzyPower is now known as lazyPower | 15:32 | |
| *** lazyPower has quit IRC | 15:32 | |
| *** lazyPower has joined #openstack-kolla | 15:32 | |
| kristian__ | deploying it with debug on | 15:35 |
| *** unicell1 has joined #openstack-kolla | 15:41 | |
| *** salv-orl_ has quit IRC | 15:42 | |
| *** unicell has quit IRC | 15:42 | |
| kristian__ | inc0: its deployed, found copying css and js files | 15:42 |
| georgem1 | I redeployed 4.0.0 based on ubuntu binary and it looks good now | 15:42 |
| *** blallau has quit IRC | 15:43 | |
| kristian__ | for me nothing | 15:44 |
| kristian__ | http://cloud.dkristian.co/ | 15:44 |
| kristian__ | but now I can see the css | 15:44 |
| kristian__ | so need to do some digging in the container | 15:45 |
| kolla-slack | <portdirect> @sbezverk just abou to get on that | 15:45 |
| inc0 | try to run collectstatic | 15:45 |
| kolla-slack | <portdirect> @kfox1111 you about? | 15:45 |
| inc0 | (just can't remember how to do this with apache;)) | 15:46 |
| inc0 | https://docs.openstack.org/developer/horizon/topics/install.html | 15:46 |
| sbezverk | portdirect: man, you really want to sqeez in the last door of last wagon ;) | 15:46 |
| kristian__ | inc0: but in what dir in the container? | 15:46 |
| portdirect | sbezverk: I'll hang off the back | 15:46 |
| portdirect | sbezverk: sorry dude | 15:46 |
| inc0 | yeah that's the piece I can't remember kristian__ ;) | 15:47 |
| kristian__ | gonna run find command | 15:47 |
| inc0 | find -name "manage"?;) | 15:47 |
| kristian__ | find / -name 'manage.py' | 15:47 |
| kristian__ | 3 occurances | 15:48 |
| kristian__ | /usr/share/openstack-dashboard/manage.py | 15:48 |
| kristian__ | /usr/bin/manage.py | 15:48 |
| kristian__ | /usr/lib/python2.7/dist-packages/django/conf/project_template/manage.py | 15:48 |
| kristian__ | this is the destination for the /usr/bin/manage.py | 15:49 |
| kristian__ | and 0 were copied | 15:49 |
| kristian__ | the third one is django default and first 2 are for kolla but 0 copied | 15:50 |
| kristian__ | static files work | 15:51 |
| kristian__ | also login | 15:52 |
| inc0 | cool | 15:52 |
| inc0 | what helped? | 15:52 |
| *** vhosakot has joined #openstack-kolla | 15:53 | |
| kristian__ | (/var/lib/openstack-dashboard/static) as an alias for static | 15:53 |
| *** salv-orlando has joined #openstack-kolla | 15:54 | |
| *** kristia__ has joined #openstack-kolla | 15:55 | |
| kristia__ | here | 15:56 |
| kristia__ | after deploying murano I got this | 15:56 |
| kristia__ | cp: cannot create regular file '/usr/lib/python2.7/site-packages/openstack_dashboard/local/enabled/_50_dashboard_catalog.py': No such file or directory | 15:56 |
| kristia__ | in horizon | 15:56 |
| kristia__ | and cannot do anything in the container because its restarting | 15:57 |
| kristia__ | inc0: have you seen it? | 15:58 |
| *** kristian__ has quit IRC | 15:58 | |
| inc0 | no | 15:58 |
| inc0 | try source build... | 15:58 |
| kristia__ | ok | 15:58 |
| kristia__ | let me upgrade to 4.0.1 | 15:59 |
| *** kristia__ has quit IRC | 15:59 | |
| *** kristian__ has joined #openstack-kolla | 16:00 | |
| *** rwallner has quit IRC | 16:04 | |
| *** shasha_t_ has joined #openstack-kolla | 16:08 | |
| *** jascott1 has joined #openstack-kolla | 16:11 | |
| *** jascott1 has quit IRC | 16:12 | |
| *** matrohon has quit IRC | 16:13 | |
| *** zhubingbing__ has quit IRC | 16:13 | |
| *** zhubingbing_ has joined #openstack-kolla | 16:13 | |
| *** jascott1 has joined #openstack-kolla | 16:17 | |
| janem | cant I use the external_vip_address for api access? getting these keystone errors "SSL error violation of protocol .." | 16:21 |
| *** lrensing has quit IRC | 16:21 | |
| *** janki has joined #openstack-kolla | 16:21 | |
| *** lrensing has joined #openstack-kolla | 16:22 | |
| janem | configured with tls enabled. Horizon working as expected | 16:22 |
| *** gkadam has quit IRC | 16:22 | |
| *** lpetrut has quit IRC | 16:23 | |
| *** eaguilar has quit IRC | 16:24 | |
| kfox1111 | morning. | 16:25 |
| kfox1111 | portdirect: ping | 16:25 |
| *** kristian__ has quit IRC | 16:26 | |
| portdirect | kfox1111: hey man, just send you some PM's :) | 16:27 |
| portdirect | s/send/sent | 16:27 |
| *** kristian__ has joined #openstack-kolla | 16:27 | |
| inc0 | janem: it should work | 16:31 |
| janem | inc0: do I have to configure keystone to use ssl? All i did was to setup external_vip and TLS in my globals.yml file. | 16:32 |
| janem | inc0: oh, and external_fqdn | 16:32 |
| inc0 | yeah I think there is guide for TLS in docs | 16:33 |
| inc0 | janem: https://docs.openstack.org/developer/kolla-ansible/advanced-configuration.html#tls-configuration | 16:34 |
| janem | inc0: hm, yeah I followed that, so the tls works for horizon. Everything seems in order with the config acording to the doc's. | 16:36 |
| inc0 | try using openstack --debug project list | 16:38 |
| *** rhallisey has quit IRC | 16:40 | |
| janem | inc0: still getting "EOF occurred in violation of protocol (_ssl.c:590)" | 16:41 |
| inc0 | ssl verification issue? | 16:42 |
| *** kristian__ has quit IRC | 16:42 | |
| *** kristian__ has joined #openstack-kolla | 16:43 | |
| janem | its a verified ssl certificate, all green and good in horizon. So I wouldn't think so(?) | 16:44 |
| *** mgoddard has quit IRC | 16:45 | |
| *** shasha_t_ has quit IRC | 16:45 | |
| *** vhosakot has quit IRC | 16:53 | |
| *** rwallner has joined #openstack-kolla | 17:03 | |
| *** harlowja has quit IRC | 17:03 | |
| janem | inc0: get the same erro when I specify "OS_CACERT" as well. | 17:06 |
| inc0 | :/ | 17:07 |
| janem | inc0: im using https://example.com:5000 should I be using port 35357? I did not open that to the public ip. | 17:11 |
| *** unicell1 has quit IRC | 17:15 | |
| *** goldyfruit has quit IRC | 17:15 | |
| inc0 | well you shouldn't | 17:16 |
| *** gfidente is now known as gfidente|afk | 17:16 | |
| *** eaguilar has joined #openstack-kolla | 17:18 | |
| rwellum | Hey inc0 | 17:21 |
| inc0 | hey rwellum :) will you be in Boston? | 17:22 |
| rwellum | inc0: yes I will :) | 17:22 |
| rwellum | Arrive Monday morning | 17:22 |
| *** kristian__ has quit IRC | 17:29 | |
| rwellum | inc0: you probably saw the gate change to move from kolla-ansible genconfig to "ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml" ? | 17:30 |
| inc0 | I wrote it;) | 17:31 |
| inc0 | so yeah;) | 17:31 |
| rwellum | Great! | 17:31 |
| rwellum | Except I've been stuck trying it with errors like this: https://www.irccloud.com/pastebin/Z6yGaX50/ | 17:31 |
| inc0 | well seems like a bug | 17:33 |
| rwellum | Very much ignorant of ansible - any way to debug? I found that a. I had to run this in kolla-ansible directory and b. use sudo | 17:34 |
| inc0 | you shouldnt have to run it in ansible dir tho | 17:34 |
| inc0 | kolla-kubernetes dir also has ansible | 17:34 |
| inc0 | try that | 17:34 |
| rwellum | Sorry my bad - I did | 17:35 |
| inc0 | yeah whole point of this change was to remove kolla-ansible dep | 17:36 |
| rwellum | I did: "cd kolla-kubernetes; sudo ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ansible/site.yml; cd .." | 17:38 |
| rwellum | Just to verify | 17:38 |
| *** unicell has joined #openstack-kolla | 17:40 | |
| inc0 | looks good | 17:40 |
| inc0 | so I guess we have a bug | 17:40 |
| inc0 | http://jinja.pocoo.org/docs/2.9/templates/#equalto :( | 17:42 |
| inc0 | pip freeze | grep jinja2? | 17:42 |
| * jascott1 is scared cause that worked for him yesterday | 17:43 | |
| jascott1 | (the playbook) | 17:43 |
| *** shasha_t_ has joined #openstack-kolla | 17:47 | |
| rwellum | https://www.irccloud.com/pastebin/5zXds5kt/ | 17:50 |
| *** rhallisey has joined #openstack-kolla | 17:50 | |
| inc0 | :/ | 17:51 |
| rwellum | That good or bad? :) | 17:51 |
| egonzalez | in ansible we have a requirement for !=1.9.6 | 17:51 |
| egonzalez | don't know if is related with this | 17:52 |
| rwellum | Well it is not 1.9.6 :) | 17:53 |
| egonzalez | 2.9.6 sorry heheh | 17:54 |
| rwellum | jascott1: can you do 'pip freeze | grep -i jinja' on your working environment? | 17:54 |
| jascott1 | rwellum hmm one sec | 17:55 |
| egonzalez | really almost all 2.9* jinja version are banned | 17:55 |
| egonzalez | i have 2.8.1 | 17:56 |
| rwellum | egonzalez: this is just Centos7 - I'm assuming I just have the defaults. | 17:56 |
| *** shasha_t_ has quit IRC | 17:56 | |
| jascott1 | Jinja2==2.9.6 | 17:57 |
| jascott1 | rwellum you didnt also run genconfig? | 17:58 |
| rwellum | jascott1: at first I did, but when I realised that might be an issue I started again from a clean VM. | 17:58 |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Ensure that ironic-dnsmasq can find its IP address https://review.openstack.org/462310 | 17:59 |
| * rwellum was googling how to downgrade jinja but now not sure that's the issue. | 17:59 | |
| *** lrensing has quit IRC | 17:59 | |
| jascott1 | rwellum heres my pip freeze http://paste.openstack.org/show/609021/ | 18:00 |
| egonzalez | as far i can find in google, equalto was introduced in jinja 2.8 | 18:00 |
| rwellum | Thanks jascott1 | 18:02 |
| jascott1 | what os you on? | 18:02 |
| jascott1 | (not that it should matter but who knows) | 18:02 |
| rwellum | egonzalez: what's weird is I was getting the same error earlier - but was complaining about cinder. | 18:02 |
| rwellum | Centos7 jascott1 | 18:02 |
| egonzalez | let me try to genconfig | 18:03 |
| jascott1 | ok cool. I have playbook working for ubuntu which is where that freeze came from but am working right now on centos so will see if I have similar problems | 18:03 |
| *** manheim has joined #openstack-kolla | 18:04 | |
| rwellum | jascott1: , egonzalez : just downgraded to 2.8.1 and it seems happier. | 18:07 |
| *** eaguilar has quit IRC | 18:07 | |
| rwellum | Yup completed successfully. | 18:08 |
| *** janki has quit IRC | 18:08 | |
| jascott1 | interesting | 18:08 |
| *** manheim has quit IRC | 18:08 | |
| *** pcaruana has quit IRC | 18:10 | |
| rwellum | Odd that it works for you for Ubuntu, but not me for Centos. | 18:11 |
| *** tonanhngo has joined #openstack-kolla | 18:14 | |
| *** eaguilar has joined #openstack-kolla | 18:17 | |
| *** openstackgerrit has quit IRC | 18:18 | |
| esmute_ | Hi guys, quick question. I noticed that in the DG, it says to use canal for networking. Does that mean if i have a k8s with, for example, flannel or weave, it wont work? | 18:22 |
| sdake | esmute_ that is just what the deployment guide uses - feel fre to use whatever cni you prefer | 18:22 |
| rwellum | Canal is used in the gate though - so we know it's working well. | 18:25 |
| sbezverk | rwellum: I really like this statement :) | 18:26 |
| esmute_ | im asking because im not able to get the neutron-openvswitch-agent to run. It is stuck in `init` | 18:26 |
| sbezverk | esmute_: have you changed kubelet service parameters? | 18:26 |
| esmute_ | yes.. i disabled cri | 18:27 |
| sbezverk | esmute_: it should have resolved the issue you were reporting yesterday, we saw it and that was confirmed fix.. | 18:27 |
| sbezverk | by multiple people including myself :) | 18:28 |
| esmute_ | ok let me make sure that the flag is being applied correcntly | 18:28 |
| georgem1 | Is it normal to get "Error: ERROR: Missing required credential: roles ['heat_stack_owner']" when trying to start a heat stack on top of a freshly deployed kolla 4.0.0 ? | 18:28 |
| sbezverk | esmute_: I am almost 100% positive there is something missing.. | 18:28 |
| *** lucasxu has quit IRC | 18:29 | |
| *** eaguilar has quit IRC | 18:30 | |
| sbezverk | esmute_: on the host run ps -ef | grep kubelet | 18:30 |
| sbezverk | in the output you should see all flags are currently used | 18:31 |
| sbezverk | make sure you see cri is disabled | 18:31 |
| *** lucasxu has joined #openstack-kolla | 18:31 | |
| esmute_ | yeah i didnt have it for some reason.. ill added it and restart kubelet | 18:31 |
| esmute_ | 13173 ? Ssl 0:11 /kubelet --kubeconfig=/etc/kubernetes/kubeconfig --require-kubeconfig --client-ca-file=/etc/kubernetes/ca.crt --anonymous-auth=false --cni-conf-dir=/etc/kubernetes/cni/net.d --network-plugin=cni --lock-file=/var/run/lock/kubelet.lock --exit-on-lock-contention --pod-manifest-path=/etc/kubernetes/manifests --allow-privileged --hostname-override=castle10.rook.com --node-labels=master=true --node-labels=node-role | 18:32 |
| esmute_ | .kubernetes.io/master --cluster_dns=10.3.0.10 --cluster_domain=cluster.local --enable-cri=false | 18:32 |
| esmute_ | do i have to run the deployment again or would restart kubelet with the cri-enable=false flag suffice? | 18:33 |
| *** openstackgerrit has joined #openstack-kolla | 18:36 | |
| openstackgerrit | Justin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL https://review.openstack.org/463036 | 18:36 |
| rwellum | sbezverk: yes I like your gate orientation - means I always have something very well tested to look at. | 18:36 |
| esmute_ | sbezverk: my fault. The flag was not applied propertly.. now it works. the ovenvswitch-agent is running now. Thank you very much | 18:36 |
| sbezverk | esmute_: yeeaaahhh :) | 18:37 |
| esmute_ | when i boot a nova instance, the instance is erroring... "Binding failed for port 4ad745b6-03ec-4f87-aaa9-7222431965e9, please check neutron logs for more information." | 18:37 |
| esmute_ | perhaps i have to restart the whole deployment again | 18:37 |
| sbezverk | esmute_: you need to give some time | 18:37 |
| sbezverk | run neutron agent-list | 18:37 |
| sbezverk | if one of agents show as down, that is the error you would see | 18:38 |
| esmute_ | sbezverk: ahh ok .. I already tore down my cluster... i will start it again and report back :) | 18:38 |
| sbezverk | esmute_: ok | 18:38 |
| *** salv-orlando has quit IRC | 18:41 | |
| rwellum | esmute_: is this ubunut? | 18:42 |
| rwellum | *ubuntu* | 18:42 |
| esmute_ | im using coreos | 18:42 |
| rwellum | Oh ok | 18:42 |
| esmute_ | and flannel | 18:42 |
| rwellum | Was just looking at the changes here: https://review.openstack.org/#/c/461527/30/tools/setup_kubernetes.sh | 18:42 |
| *** jtriley_ has joined #openstack-kolla | 18:42 | |
| sbezverk | rwellum: because we use 1.6.2, this workaround is no longer needed | 18:44 |
| *** tonanhngo has quit IRC | 18:44 | |
| *** jtriley has quit IRC | 18:46 | |
| rwellum | Which part sbezverk ? "--pod-network-cidr 172.16.132.0/22 " | 18:47 |
| *** georgem1 has left #openstack-kolla | 18:47 | |
| sbezverk | rwellum: line 17 and 29 | 18:47 |
| *** jtriley_ has quit IRC | 18:47 | |
| sbezverk | on the left side | 18:48 |
| rwellum | sbezverk: yes but what I meant is you're still doing it on line 27, RHS | 18:49 |
| rwellum | For ubunut? | 18:50 |
| rwellum | ugh - can't spell today | 18:50 |
| sbezverk | rwellum: here is the deal Ubuntu can use two types of cgroup driver, with centos it is easy, it is always systemd | 18:50 |
| sbezverk | but in case of ubuntu we really need to get cgroup driver is currently used on this specific host and pass it to kubelet | 18:51 |
| rwellum | Ah makes sense. | 18:51 |
| sbezverk | that is why there is a slight difference between centos and ubuntu | 18:52 |
| rwellum | yup | 18:52 |
| *** jtriley has joined #openstack-kolla | 18:52 | |
| *** lucasxu has quit IRC | 18:57 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Fix haproxy restart while genconfig https://review.openstack.org/463040 | 18:57 |
| *** iniazi has quit IRC | 18:57 | |
| *** lucasxu has joined #openstack-kolla | 19:00 | |
| *** blallau has joined #openstack-kolla | 19:12 | |
| janem | inc0: I figured it out, OS X openstack client issue. Thanks for the help! | 19:14 |
| portdirect | kfox1111: ping | 19:14 |
| inc0 | janem: damn you apple! | 19:15 |
| inc0 | ;) | 19:15 |
| inc0 | I'm glad it worked out | 19:15 |
| janem | inc0: hehe. I know.. docker to the rescue again! :) | 19:15 |
| *** lrensing has joined #openstack-kolla | 19:19 | |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Deploy TFTP with inspector DNSmasq instance https://review.openstack.org/462942 | 19:31 |
| *** gomarivera has joined #openstack-kolla | 19:31 | |
| *** lrensing has quit IRC | 19:37 | |
| *** eaguilar has joined #openstack-kolla | 19:42 | |
| esmute_ | sbezverk: The openvswitch-agent now is in running state. Thank you | 19:43 |
| esmute_ | but when i boot a cirros image, the vm is building forever | 19:44 |
| esmute_ | i tried to look at the nova-api, nova-compute and nova-scheduler log using kubectl logs, but didnt see anyhtign obvious | 19:44 |
| *** harlowja has joined #openstack-kolla | 19:48 | |
| egonzalez | inc0, reading through summit workshop, will people deploy ubuntu binary? | 19:49 |
| inc0 | well I'll suggest source:P | 19:50 |
| egonzalez | atm, cinder api is broken for ubuntu binary | 19:50 |
| inc0 | in fact I didn't build ubuntu-binary yet | 19:50 |
| inc0 | oh joy | 19:50 |
| egonzalez | dont do it :) | 19:50 |
| inc0 | yeah I mentioned that source is generally more stable | 19:50 |
| inc0 | what do you think about guide? | 19:50 |
| egonzalez | https://bugs.launchpad.net/kolla/+bug/1676751 | 19:50 |
| openstack | Launchpad bug 1676751 in kolla-ansible pike "cinder-api keeps restarting after the deployment" [Critical,In progress] - Assigned to Eduardo Gonzalez (egonzalez90) | 19:50 |
| *** skramaja_ has quit IRC | 19:50 | |
| egonzalez | https://review.openstack.org/#/c/457993/ | 19:51 |
| egonzalez | guide looks good, is like the quickstart guide but easier to follow and understand | 19:51 |
| inc0 | yeah I think we could use it as new quickstart later;) | 19:53 |
| *** harlowja has quit IRC | 19:56 | |
| *** salv-orlando has joined #openstack-kolla | 19:57 | |
| *** shasha_t_ has joined #openstack-kolla | 19:57 | |
| *** shasha_t_ has quit IRC | 20:02 | |
| openstackgerrit | Justin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL https://review.openstack.org/463036 | 20:04 |
| *** ssurana has joined #openstack-kolla | 20:04 | |
| *** egonzalez has quit IRC | 20:09 | |
| Reepicheep | inc0: I think it more complete then the quickstart the second day stuff as little as you have there seems to be virtually non existant in any of the current docs | 20:14 |
| inc0 | Reepicheep: yeah, I guess I need to start a blog | 20:15 |
| inc0 | and start writing this all down | 20:15 |
| Reepicheep | I don't think I have seen the "reconfigure" anyware other then your docs and a few mentions on IRC if I happen to be looking at the correct time | 20:16 |
| *** shasha_t_ has joined #openstack-kolla | 20:16 | |
| *** lucasxu has quit IRC | 20:18 | |
| *** eaguilar has quit IRC | 20:18 | |
| *** eaguilar has joined #openstack-kolla | 20:20 | |
| *** lucasxu has joined #openstack-kolla | 20:21 | |
| inc0 | I'll write something up after summit | 20:21 |
| openstackgerrit | Justin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL https://review.openstack.org/463036 | 20:23 |
| *** lucasxu has quit IRC | 20:27 | |
| Reepicheep | inc0: is your globals file a .yml or a .yaml | 20:28 |
| inc0 | yaml afair | 20:29 |
| *** eaguilar has quit IRC | 20:32 | |
| Reepicheep | mine are all .yml files which I started from the examples from /usr/share/kolla-ansible | 20:33 |
| Reepicheep | both globals.yml and passwords.yml | 20:34 |
| Reepicheep | I started with kolla-ansible 4.0.0 it may have been differnet before that | 20:34 |
| Reepicheep | inc0: also what may not be extreamly clear is where the location of the inventory file is, maybe I don't have to but I pretty much always define it with a -i <path_to_inventory_file> | 20:36 |
| *** athomas has quit IRC | 20:38 | |
| inc0 | well we copy it to . | 20:40 |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Fix log rotation issue on services https://review.openstack.org/463057 | 20:40 |
| inc0 | I started with path to inventory but figured out it'll be easier to just copyapste commands | 20:40 |
| jascott1 | rwellum i dont get your request wrt to my ps | 20:41 |
| rwellum | Hi jascott1 - removing the '--enable-cri=false' part? | 20:42 |
| jascott1 | oh since when is that not required? | 20:42 |
| jascott1 | sincerely dont know about the change | 20:43 |
| Reepicheep | inc0: I figured that out .. I assume that kolla-ansible looks for an all-in-one or multinode file in the current directory if it is not defined | 20:43 |
| Reepicheep | keep in mind my perspective is from someone new to ansible | 20:43 |
| inc0 | well -i multinode will simply point to ./multinode | 20:43 |
| inc0 | in fact I'll switch multinode to ./multinode | 20:44 |
| inc0 | will be clearer that it's a path to file | 20:44 |
| Reepicheep | yeah.. I was looking more at the day2.md where it is not defined at all | 20:44 |
| inc0 | done:) | 20:46 |
| *** jtriley has quit IRC | 20:47 | |
| openstackgerrit | Justin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL https://review.openstack.org/463036 | 20:50 |
| rwellum | jascott1: sorry for delay - in a meeting here $$job. Yeah the reference I put in the review is the ps where sbezverk removed that. | 20:52 |
| rwellum | But only for Centos | 20:52 |
| jascott1 | Oh | 20:52 |
| rwellum | Seems Ubuntu still needs this. | 20:52 |
| jascott1 | missed that part | 20:52 |
| jascott1 | :( | 20:52 |
| rwellum | Yeah - sorry. | 20:52 |
| jascott1 | np working it | 20:54 |
| *** blallau has quit IRC | 20:56 | |
| *** salv-orl_ has joined #openstack-kolla | 20:57 | |
| openstackgerrit | Justin Scott proposed openstack/kolla-kubernetes master: Update canal.yml URL https://review.openstack.org/463036 | 20:58 |
| rwellum | jascott1: maybe I'm reading it wrong but I think the whole line can be removed - the whole sed command. You're just taking out the cri part? | 20:59 |
| jascott1 | yeah that was my original question | 20:59 |
| *** salv-orlando has quit IRC | 20:59 | |
| jascott1 | im pretty sure we need dynamic cgroup-driver | 21:00 |
| rwellum | Ah - maybe we need to have sbezverk confirm - but I tested without that line and it worked fine. | 21:00 |
| jascott1 | the sed is still there | 21:00 |
| jascott1 | it might default to something that works? | 21:00 |
| rwellum | https://review.openstack.org/#/c/461527/30/tools/setup_kubernetes.sh - lines 17-18 completely removed? | 21:01 |
| rwellum | jascott1: ah because systemd is the default in Centos I believe - so sbezverk removed it there but kept it in ubuntu. | 21:04 |
| sbezverk | jascott1: yep that is correct | 21:04 |
| rwellum | But the deployment guide does not do a great job differentiating between ubuntu and centos or other os's. | 21:06 |
| rwellum | That's a bug I think. | 21:06 |
| *** bmace has quit IRC | 21:09 | |
| *** bmace has joined #openstack-kolla | 21:10 | |
| Reepicheep | inc0: I added a section to day2.md that mentions the need to run deploy again if new containers are needed by changes to the global.yaml file | 21:14 |
| inc0 | thank you! | 21:14 |
| Reepicheep | I know it took me a long time to figure that out. | 21:15 |
| Reepicheep | remember I'm coming from the declaritive Puppet world, I'm used to just having "apply" ;) | 21:16 |
| *** lrensing has joined #openstack-kolla | 21:16 | |
| inc0 | good change:) man we totally need to organize it into proper docs | 21:16 |
| jascott1 | rwellum sbeverk I changed it but can change back for simplicity if it doesnt matter | 21:16 |
| Reepicheep | but you have pulled in some terraform stuff so I get that stuff ;) | 21:16 |
| inc0 | thank jascott1 for that:) | 21:17 |
| Reepicheep | jascott1: well done | 21:18 |
| jascott1 | jascott1 thanks! i like terraform pretty well.. especially since you can make it output ansible inventory files :) | 21:18 |
| Reepicheep | inc0: you may have to correct my wording possibly around the --tags part if I'm incorrect.. that's curretly how I understand it | 21:19 |
| inc0 | yeah, wording is a bit off | 21:19 |
| inc0 | haproxy is one role within play | 21:20 |
| inc0 | and playbook is a set of plays | 21:20 |
| inc0 | that is less important, because we have just one big play | 21:20 |
| inc0 | however correct word is role for haproxy | 21:20 |
| inc0 | Reepicheep: https://github.com/inc0/kolla-ansible-workshop/blob/master/day2.md corrected it a bit | 21:21 |
| Reepicheep | inc0: thanks I knew when I was typing it that it didn't seem like it was the correct wording | 21:22 |
| *** jrich523 is now known as BobsBrain | 21:22 | |
| Reepicheep | I'm learning more ansible everyday | 21:22 |
| inc0 | it's just glorified ssh in a loop | 21:23 |
| *** BobsBrain is now known as jrich523 | 21:23 | |
| jascott1 | there is something fun about watching the containers spin up and work it out | 21:24 |
| jascott1 | is there anything to be done about nova-api-cell-create and its crashloop? | 21:25 |
| jascott1 | i know it works out eventually but it would be great not freak people out with crash loop | 21:25 |
| Reepicheep | inc0: yeah.. it's pretty simple commpared to the other automation platforms / frameworks I have used no need for fancy clients and servers | 21:26 |
| *** ducttap__ has joined #openstack-kolla | 21:33 | |
| *** harlowja has joined #openstack-kolla | 21:34 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements https://review.openstack.org/462548 | 21:34 |
| *** ducttape_ has quit IRC | 21:34 | |
| *** egonzalez has joined #openstack-kolla | 21:39 | |
| *** rwallner has quit IRC | 21:40 | |
| *** lrensing has quit IRC | 21:47 | |
| *** ducttap__ has quit IRC | 22:04 | |
| *** Pavo has joined #openstack-kolla | 22:05 | |
| *** ducttape_ has joined #openstack-kolla | 22:13 | |
| jascott1 | i wonder what the theoretical minimum spinup time is | 22:18 |
| *** salv-orl_ has quit IRC | 22:27 | |
| jascott1 | from mariadb to completion im getting ~13 min | 22:30 |
| *** spiette has quit IRC | 22:33 | |
| *** gomarivera has quit IRC | 22:36 | |
| *** manheim has joined #openstack-kolla | 22:36 | |
| *** krtaylor has quit IRC | 22:39 | |
| *** ducttape_ has quit IRC | 22:45 | |
| sbezverk | jascott1: way too much | 23:00 |
| *** Pavo has quit IRC | 23:00 | |
| sbezverk | our compute kit comes up for 12 minutes | 23:01 |
| jascott1 | you are saying 1 min diff is way too much? | 23:01 |
| *** manheim has quit IRC | 23:08 | |
| *** manheim has joined #openstack-kolla | 23:09 | |
| sbezverk | jascott1: sorry I thought it took 13 minutes just to brong mariadb | 23:10 |
| sbezverk | not the whole openstack | 23:10 |
| *** rwellum has quit IRC | 23:11 | |
| *** manheim has quit IRC | 23:14 | |
| jascott1 | ah gotcha | 23:14 |
| jascott1 | i dont think 12 mins is terribly long time but since it is containers it seems if all images were local it could be made to load more quickly | 23:36 |
| jascott1 | one confusing thing about terraform is the way it has different resource types for different providers.. how is that cloud agnostic? | 23:44 |
| jascott1 | ideally i would define my master and workers etc and it use an adapter to make it happen | 23:44 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!