| *** vhosakot has quit IRC | 00:01 | |
| *** yangyapeng has quit IRC | 00:13 | |
| *** yangyapeng has joined #openstack-kolla | 00:14 | |
| *** itlinux has quit IRC | 00:15 | |
| *** yangyapeng has quit IRC | 00:18 | |
| *** genek has joined #openstack-kolla | 00:20 | |
| *** genek has quit IRC | 00:25 | |
| *** chas has joined #openstack-kolla | 00:29 | |
| *** rhallisey has quit IRC | 00:33 | |
| *** chas has quit IRC | 00:34 | |
| *** yee37927 has quit IRC | 00:39 | |
| *** rhallisey has joined #openstack-kolla | 00:39 | |
| *** yee379 has joined #openstack-kolla | 00:39 | |
| *** zhurong has joined #openstack-kolla | 00:47 | |
| *** dave-mccowan has joined #openstack-kolla | 00:47 | |
| *** hrw has quit IRC | 00:49 | |
| *** hrw has joined #openstack-kolla | 00:51 | |
| *** gkadam has joined #openstack-kolla | 00:59 | |
| openstackgerrit | Heetae Ahn proposed openstack/kolla master: Add RHEL subscription registration https://review.openstack.org/495148 | 01:02 |
|---|---|---|
| *** kong has joined #openstack-kolla | 01:06 | |
| *** duonghq has joined #openstack-kolla | 01:18 | |
| *** yangyapeng has joined #openstack-kolla | 01:20 | |
| *** kevzha01 has joined #openstack-kolla | 01:20 | |
| *** tovin07_ has joined #openstack-kolla | 01:24 | |
| *** yangyape_ has joined #openstack-kolla | 01:25 | |
| *** yangyapeng has quit IRC | 01:25 | |
| *** jtriley has joined #openstack-kolla | 01:37 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix deploy-guide links https://review.openstack.org/507058 | 01:40 |
| *** dave-mccowan has quit IRC | 01:41 | |
| *** jtriley has quit IRC | 01:43 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Config my_ip to api_interface_address in cinder.conf https://review.openstack.org/507032 | 01:43 |
| *** dave-mccowan has joined #openstack-kolla | 01:45 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Support HiPE (High-Performance Erlang) in RabbitMQ role https://review.openstack.org/507394 | 01:46 |
| lxdong | What is the better way of using console,novnc or spice? It seems that there are some issues with novnc. | 01:47 |
| *** dardelean_ has joined #openstack-kolla | 01:49 | |
| *** itlinux has joined #openstack-kolla | 01:51 | |
| *** dardelean_ has quit IRC | 01:53 | |
| *** dave-mcc_ has joined #openstack-kolla | 02:05 | |
| *** unicell has quit IRC | 02:06 | |
| *** dave-mccowan has quit IRC | 02:07 | |
| *** itlinux has quit IRC | 02:07 | |
| *** itlinux has joined #openstack-kolla | 02:14 | |
| *** itlinux has quit IRC | 02:15 | |
| *** huanxie has joined #openstack-kolla | 02:16 | |
| *** krtaylor has joined #openstack-kolla | 02:20 | |
| lxdong | switching to spice virtual console from novnc results in can't load console | 02:27 |
| *** goldyfruit has joined #openstack-kolla | 02:29 | |
| *** chas has joined #openstack-kolla | 02:30 | |
| *** jtriley has joined #openstack-kolla | 02:30 | |
| *** unicell has joined #openstack-kolla | 02:31 | |
| openstackgerrit | Long Zhang proposed openstack/kolla-ansible master: Add supplement in high-availability.rst about cinder https://review.openstack.org/504880 | 02:31 |
| lxdong | I did reconfigure , does it require a re-deployment ? | 02:32 |
| *** itlinux has joined #openstack-kolla | 02:33 | |
| *** goldyfruit has quit IRC | 02:34 | |
| *** chas has quit IRC | 02:34 | |
| *** unicell has quit IRC | 02:35 | |
| *** daidv has joined #openstack-kolla | 02:36 | |
| *** dave-mcc_ has quit IRC | 02:38 | |
| *** itlinux has quit IRC | 02:52 | |
| spsurya | morning all | 02:57 |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: git package added for better automated dev environment https://review.openstack.org/507895 | 03:02 |
| *** janki has joined #openstack-kolla | 03:09 | |
| *** jamesbenson has joined #openstack-kolla | 03:12 | |
| *** jamesbenson has quit IRC | 03:16 | |
| openstackgerrit | wanghongxu proposed openstack/kolla-ansible master: set glance_api_version = 2 in cinder configure https://review.openstack.org/508037 | 03:22 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Install libvirt-clients for nova-libvirt image https://review.openstack.org/508046 | 03:53 |
| openstackgerrit | Tatsuma Matsuki proposed openstack/kolla-ansible master: Add fluentd enable option https://review.openstack.org/500712 | 04:07 |
| *** zhurong has quit IRC | 04:07 | |
| *** cocakolla has quit IRC | 04:10 | |
| *** yangyape_ has quit IRC | 04:22 | |
| *** yangyapeng has joined #openstack-kolla | 04:23 | |
| *** kornicameister has quit IRC | 04:24 | |
| *** itlinux has joined #openstack-kolla | 04:28 | |
| openstackgerrit | Tatsuma Matsuki proposed openstack/kolla-ansible master: Add fluentd enable option https://review.openstack.org/500712 | 04:38 |
| *** wanghongxu has joined #openstack-kolla | 04:39 | |
| *** huanxie has quit IRC | 04:40 | |
| *** lpetrut has joined #openstack-kolla | 04:46 | |
| *** rstarmer has joined #openstack-kolla | 04:47 | |
| *** itlinux has quit IRC | 04:48 | |
| *** mdnadeem has joined #openstack-kolla | 04:58 | |
| *** cocakolla has joined #openstack-kolla | 04:59 | |
| *** gkadam is now known as gkadam-brb | 05:03 | |
| *** huanxie has joined #openstack-kolla | 05:07 | |
| *** lpetrut has quit IRC | 05:08 | |
| *** cocakolla has quit IRC | 05:18 | |
| *** lpetrut has joined #openstack-kolla | 05:23 | |
| *** yangyape_ has joined #openstack-kolla | 05:29 | |
| *** yangyapeng has quit IRC | 05:29 | |
| *** yangyape_ has quit IRC | 05:31 | |
| *** yangyapeng has joined #openstack-kolla | 05:32 | |
| *** lpetrut has quit IRC | 05:47 | |
| *** dgonzalez has joined #openstack-kolla | 05:50 | |
| *** yangyapeng has quit IRC | 05:50 | |
| *** yangyape_ has joined #openstack-kolla | 05:50 | |
| *** mrunge_ is now known as mrunge | 06:00 | |
| *** erlon has quit IRC | 06:14 | |
| *** yangyape_ has quit IRC | 06:18 | |
| *** yangyapeng has joined #openstack-kolla | 06:19 | |
| *** pcaruana has joined #openstack-kolla | 06:19 | |
| *** coolsvap has joined #openstack-kolla | 06:20 | |
| *** mrunge has quit IRC | 06:22 | |
| *** yangyapeng has quit IRC | 06:23 | |
| *** mrunge has joined #openstack-kolla | 06:27 | |
| *** yangyapeng has joined #openstack-kolla | 06:29 | |
| duonghq | anybody got following error? 2017-09-28 13:27:12.355 7 ERROR neutron ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_vlan_allocations' doesn't exist") [SQL: u'SELECT ml2_vlan_allocations.physical_network AS ml2_vlan_allocations_physical_network, ml2_vlan_allocations.vlan_id AS ml2_vlan_allocations_vlan_id, ml2_vlan_allocations.allocated AS ml2_vlan_allocations_allocated \nFROM | 06:32 |
| duonghq | ml2_vlan_allocations'] | 06:32 |
| duonghq | I got it on both Pike and master | 06:33 |
| *** yangyapeng has quit IRC | 06:34 | |
| *** zhurong has joined #openstack-kolla | 06:38 | |
| *** serlex has joined #openstack-kolla | 06:45 | |
| *** jamesbenson has joined #openstack-kolla | 06:48 | |
| *** jamesbenson has quit IRC | 06:52 | |
| *** dciabrin has quit IRC | 06:58 | |
| *** yangyapeng has joined #openstack-kolla | 07:03 | |
| *** yangyapeng has quit IRC | 07:07 | |
| *** dardelean_ has joined #openstack-kolla | 07:08 | |
| *** dardelean_ has quit IRC | 07:13 | |
| *** rstarmer has quit IRC | 07:14 | |
| *** rstarmer has joined #openstack-kolla | 07:15 | |
| *** rstarmer has quit IRC | 07:15 | |
| *** rstarmer has joined #openstack-kolla | 07:16 | |
| *** rstarmer has quit IRC | 07:16 | |
| *** rstarmer has joined #openstack-kolla | 07:17 | |
| *** yangyapeng has joined #openstack-kolla | 07:17 | |
| *** rstarmer has quit IRC | 07:17 | |
| *** rstarmer has joined #openstack-kolla | 07:17 | |
| *** yangyapeng has quit IRC | 07:18 | |
| *** rstarmer has quit IRC | 07:18 | |
| *** yangyapeng has joined #openstack-kolla | 07:18 | |
| *** kevzha01 has quit IRC | 07:26 | |
| *** kevzha01 has joined #openstack-kolla | 07:26 | |
| *** shardy has joined #openstack-kolla | 07:29 | |
| *** yangyapeng has quit IRC | 07:29 | |
| *** yangyape_ has joined #openstack-kolla | 07:29 | |
| *** yangyape_ has quit IRC | 07:30 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: Add placement section to neutron.conf https://review.openstack.org/508075 | 07:30 |
| *** yangyapeng has joined #openstack-kolla | 07:30 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: Add service plugin segment to neutron https://review.openstack.org/508077 | 07:33 |
| *** dardelean has joined #openstack-kolla | 07:33 | |
| *** huanxie has quit IRC | 07:34 | |
| *** gfidente|afk is now known as gfidente | 07:34 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: Add placement section to neutron.conf https://review.openstack.org/508075 | 07:37 |
| *** genek has joined #openstack-kolla | 07:40 | |
| *** huanxie has joined #openstack-kolla | 07:41 | |
| *** egonzalez has joined #openstack-kolla | 07:50 | |
| *** xinliang has quit IRC | 07:51 | |
| openstackgerrit | Merged openstack/kolla-ansible master: git package added for better automated dev environment https://review.openstack.org/507895 | 07:55 |
| *** zhubingbing_ has joined #openstack-kolla | 08:01 | |
| *** dardelean_ has joined #openstack-kolla | 08:02 | |
| *** zhubingbing has quit IRC | 08:03 | |
| *** xinliang has joined #openstack-kolla | 08:05 | |
| *** xinliang has joined #openstack-kolla | 08:05 | |
| *** jmccarthy has joined #openstack-kolla | 08:08 | |
| *** lpetrut has joined #openstack-kolla | 08:16 | |
| jmccarthy | Am I missing something here ? If I exec into a container and print to stderr, that output doesn't show up in the kolla_logs volume, should it ? | 08:20 |
| egonzalez | jmccarthy, nope, stderr/stdout are in docker container logs, not in kolla logs | 08:23 |
| iniazi | yeah, you'd use docker logs CONTAINER to get at those logs, I think | 08:23 |
| iniazi | well atleast my docker inexperienced self would atleast | 08:24 |
| *** rmart04 has joined #openstack-kolla | 08:25 | |
| *** dciabrin has joined #openstack-kolla | 08:26 | |
| jmccarthy | Ah ok, but those are not centrally gathered though right ? (docker logs) | 08:27 |
| egonzalez | jmccarthy, nope, they could be centralized in fluentd (i think), other services can retrieve stats from docker as collectd | 08:28 |
| iniazi | egonzalez: is there a list of projects I shouldn't really be deploying with kolla-ansible 5.0.0? I'm stuck with nova-compute not deploying correctly, (getting "No compute node record for host ... COmputeHostNotFound_Remote", on each nova-compute container logs | 08:28 |
| jmccarthy | Ok for some reason I thought there was something in place to capture those already (beside 'docker logs') | 08:28 |
| iniazi | but two containers octavia-api and watcher-engine keep restarting | 08:29 |
| iniazi | watcher-engine is complaining about a table not found (apscheduler_jobs, i think) and octavia... haven't had a chance to look at that yet | 08:29 |
| egonzalez | iniazi, causes for that error: nova-compute not connecting to rabbitmq, placement-api not working as expected | 08:29 |
| egonzalez | iniazi, usually there is a first "No compute node record for host" warning during first startup, then should be a message of registered node | 08:30 |
| *** rmart04 has quit IRC | 08:30 | |
| egonzalez | there was a bug in nova related to something like that early pike iirc | 08:31 |
| iniazi | rabbit seems to be fine... although beam.smp seems to be using 10 to 20% cpu. (i think thats on one core though). let me look at placement. is there a dependency graph somewhere? | 08:31 |
| iniazi | the no compute node, its repeating every few seconds. | 08:32 |
| *** huanxie has quit IRC | 08:32 | |
| iniazi | going to google how to look at the rabbitmq queues & their health. | 08:32 |
| *** rmart04 has joined #openstack-kolla | 08:33 | |
| *** rmart04 has quit IRC | 08:33 | |
| *** chas has joined #openstack-kolla | 08:35 | |
| iniazi | placement-api logs are empty... well the api and api-access | 08:35 |
| *** genek has quit IRC | 08:37 | |
| egonzalez | iniazi, if you run nova service-list and nova hypervisor-list, returns something? | 08:40 |
| iniazi | oh yeah, forgot to say, service-list seems normal, but hypervisor list is empty | 08:41 |
| egonzalez | iniazi, is nova-compute binary in service-list? | 08:41 |
| egonzalez | if yes, rabbitmq is working good | 08:41 |
| iniazi | shows 5 nova-computes, status enabled/up updated just recently (and couple of scheduler, conductor and consoleauth) | 08:42 |
| egonzalez | can you check if cells are created: docker exec nova_api nova-manage cell_v2 list-cells --verbose , paste to paste.openstack.org (hide password here) | 08:43 |
| egonzalez | share whole nova-compute logs too | 08:44 |
| duonghq | egonzalez, have you ever get error which neutron database isn't init? (only database is created, but not table), I guess that db migrate is not run | 08:46 |
| egonzalez | duonghq, no as far i remember, have any non default service enabled in neutron? | 08:47 |
| duonghq | no | 08:47 |
| duonghq | I only use default configuration | 08:47 |
| duonghq | only disable heat and horizon | 08:47 |
| *** rmart04 has joined #openstack-kolla | 08:48 | |
| egonzalez | duonghq, is neutron not working at all, or only in some cases, eg: create a network with vlan fails but flat/vxlan works | 08:48 |
| pbourke | egonzalez: jmccarthy: note, we're referring to openstack service stderr | 08:49 |
| pbourke | not just printing to bash stderr in the container | 08:50 |
| duonghq | egonzalez, neutron-server cannot start | 08:50 |
| pbourke | from my understanding the service's stderr should go into the centralised logs | 08:50 |
| duonghq | due to neutron database is empty | 08:50 |
| egonzalez | duonghq, did the deploy run successfully completely? or failed in any step and had to rerun deploy again? | 08:50 |
| Zophar | Hey... just question... with kolla-ansible.... tls_external enabled (2 vip configured) and self generated certificate... the task "Creating default user role" fail with: | 08:51 |
| duonghq | egonzalez, yes, it success, | 08:51 |
| Zophar | fatal: [localhost]: FAILED! => {"attempts": 10, "changed": false, "failed": true, "msg": "SSL exception connecting to https://openstack.mydomain.com:5000: HTTPSConnectionPool(host='openstack.mydomain.com', port=5000): Max retries exceeded with url: / (Caused by SSLError(SSLError(\"bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')],)\",),))"} | 08:51 |
| duonghq | only a glitch is I must delete /etc/kolla/neutron on target nodes before deploy | 08:51 |
| duonghq | or the config is not deployed | 08:52 |
| iniazi | egonzalez, here is list_cells: https://pastebin.com/xqmMYict (passwords replaced) and here is the compute log.. the errors keep repeating in compute log, btw, just the first 400 or 500 lines hopefully there are no passwords in there. | 08:52 |
| iniazi | compute log: https://pastebin.com/JrNemCiX | 08:52 |
| egonzalez | inc0, can you try docker exec nova_api nova-manage cell_v2 discover_hosts --verbose and then check hypervisor-list after a few seconds | 08:53 |
| Zophar | It seems the "Creating default user role" task don't do the request on the admin endpoint but goes on the external one... and fail with tls handshake (Certification trust issue) | 08:53 |
| jmccarthy | pbourke, egonzalez: Does the service logging at level ERROR capture stderr ? I thought these were separate | 08:53 |
| iniazi | egonzalez: output of that command is roughly: Found 2 cell mappings. Skipping cell0 since it does not contain hosts, Getting compute nodes from cell: ... Found 0 unmapped computes in cell | 08:55 |
| egonzalez | iniazi, using external-ceph? | 08:56 |
| iniazi | hypervisor list empty (about 30 to 50 seconds later) | 08:56 |
| iniazi | egonzalez, yes external ceph, | 08:56 |
| egonzalez | there are some errors in compute log about missing ceph.conf | 08:56 |
| iniazi | oh yeah? i guess I missed that error. was concentrating on the no compute host found or whatever | 08:56 |
| iniazi | I had copied my kolla configs from 4.0.2. let me read the docs, maybe I missed something in the config. | 08:57 |
| iniazi | thanks | 08:58 |
| iniazi | or rather, I should say, I *probably* missed something in the docs. :) | 08:58 |
| *** genek has joined #openstack-kolla | 08:58 | |
| egonzalez | iniazi, that part is missing in the docs, only say copy ceph.conf for glance ,add the file in /etc/kolla/config/nova/ceph.conf with proper content and reconfigure :( | 08:59 |
| egonzalez | well, it is in the doc, but some way a bit hard to read | 09:00 |
| egonzalez | iniazi, as there are no compute registered yet, will need to run the "discover_hosts" command from before, once a host is registered, new hosts will be discovered automatically | 09:01 |
| iniazi | well, so if I put the config or whatever, I can run a reconfigure, will that register the hosts? | 09:02 |
| *** shardy has quit IRC | 09:03 | |
| egonzalez | iniazi, it would do during first deploy, but problem is we wait for the service to be in nova service-list and currently it is. maybe the discover_hosts is executed before nova-compute service is up after restart | 09:03 |
| *** genek has quit IRC | 09:04 | |
| *** genek has joined #openstack-kolla | 09:04 | |
| iniazi | I can just redeploy. going to destroy and redeploy. found a typo... nova_backend_ceph variable, I set it to 'ceph' instead of 'yes' | 09:04 |
| *** yangyapeng has quit IRC | 09:04 | |
| egonzalez | iniazi, another issue :) | 09:05 |
| iniazi | ok, thank you kindly. 2am, need to go to sleep.. have a meeting at 7am | 09:05 |
| iniazi | going to start a destroy & deploy | 09:05 |
| openstackgerrit | Pierre Hanselmann proposed openstack/kolla-kubernetes master: WSGI configuration missing directive https://review.openstack.org/508094 | 09:08 |
| *** yangyapeng has joined #openstack-kolla | 09:08 | |
| *** genek has quit IRC | 09:11 | |
| *** rmart04 has quit IRC | 09:12 | |
| *** genek has joined #openstack-kolla | 09:12 | |
| *** huanxie has joined #openstack-kolla | 09:16 | |
| *** genek has quit IRC | 09:17 | |
| *** genek has joined #openstack-kolla | 09:19 | |
| *** genek has quit IRC | 09:23 | |
| *** sambetts|afk is now known as sambetts | 09:24 | |
| *** kevzha01 has quit IRC | 09:27 | |
| *** duonghq has quit IRC | 09:28 | |
| *** gkadam-brb has quit IRC | 09:42 | |
| *** huanxie has quit IRC | 09:47 | |
| *** jamesbenson has joined #openstack-kolla | 09:56 | |
| *** huanxie has joined #openstack-kolla | 10:00 | |
| *** jamesbenson has quit IRC | 10:00 | |
| *** tovin07_ has quit IRC | 10:01 | |
| *** chas has quit IRC | 10:02 | |
| *** chas has joined #openstack-kolla | 10:02 | |
| *** yangyapeng has quit IRC | 10:02 | |
| *** yangyapeng has joined #openstack-kolla | 10:03 | |
| *** yangyapeng has quit IRC | 10:04 | |
| *** masber has quit IRC | 10:06 | |
| *** masber has joined #openstack-kolla | 10:07 | |
| *** chas has quit IRC | 10:07 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: Quickstart guide updated for better user experience https://review.openstack.org/508102 | 10:16 |
| *** janki has quit IRC | 10:20 | |
| *** zhurong has quit IRC | 10:27 | |
| *** janki has joined #openstack-kolla | 10:30 | |
| *** obre has quit IRC | 10:34 | |
| *** obre has joined #openstack-kolla | 10:34 | |
| dardelean_ | hei guys | 10:44 |
| *** chas has joined #openstack-kolla | 10:47 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: Quickstart guide updated for better user experience https://review.openstack.org/508102 | 11:04 |
| *** huanxie has quit IRC | 11:07 | |
| spsurya | dardelean_: sup | 11:07 |
| dardelean_ | good, working on a kolla project, so good :D | 11:08 |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: Quickstart guide updated for better user experience https://review.openstack.org/508102 | 11:18 |
| dardelean_ | haha just discovered this meme https://memegenerator.net/img/instances/500x/68135944/attends-openstack-summit-deploys-proprietary-networking.jpg | 11:18 |
| *** dasTor has joined #openstack-kolla | 11:18 | |
| *** dasTor_ has joined #openstack-kolla | 11:21 | |
| *** shardy has joined #openstack-kolla | 11:21 | |
| *** dasTor has quit IRC | 11:21 | |
| *** dasTor_ has quit IRC | 11:21 | |
| *** dasTor has joined #openstack-kolla | 11:22 | |
| *** wanghongxu has quit IRC | 11:23 | |
| *** dasTor has quit IRC | 11:23 | |
| *** dasTor has joined #openstack-kolla | 11:23 | |
| *** pbourke has quit IRC | 11:25 | |
| *** pbourke has joined #openstack-kolla | 11:25 | |
| *** ipsecguy_ is now known as ipsecguy | 11:28 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla master: Implement Almanach Docker images https://review.openstack.org/498938 | 11:36 |
| *** jaosorior_sick is now known as jaosorior | 11:41 | |
| *** ansmith has quit IRC | 11:42 | |
| *** dasTor has quit IRC | 11:44 | |
| *** ArminderSingh- has joined #openstack-kolla | 11:45 | |
| *** ArminderSingh has quit IRC | 11:45 | |
| *** Arminder has quit IRC | 11:45 | |
| *** Arminder has joined #openstack-kolla | 11:45 | |
| *** huanxie has joined #openstack-kolla | 11:46 | |
| openstackgerrit | caoyuan proposed openstack/kolla-ansible master: Update the "ocata" to "pike" for multinode.html https://review.openstack.org/507885 | 11:52 |
| *** lvdombrk has quit IRC | 11:54 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add service plugin segment to neutron https://review.openstack.org/508077 | 11:59 |
| *** chas has quit IRC | 12:02 | |
| *** dasTor has joined #openstack-kolla | 12:03 | |
| *** genek has joined #openstack-kolla | 12:07 | |
| *** genek has quit IRC | 12:12 | |
| *** iahmed has joined #openstack-kolla | 12:18 | |
| *** dasTor has quit IRC | 12:18 | |
| *** dougsz has joined #openstack-kolla | 12:18 | |
| *** mnasiadka has joined #openstack-kolla | 12:25 | |
| *** pcaruana has quit IRC | 12:31 | |
| *** iahmed has quit IRC | 12:34 | |
| *** huanxie has quit IRC | 12:47 | |
| *** ansmith has joined #openstack-kolla | 12:50 | |
| *** chas has joined #openstack-kolla | 12:53 | |
| *** erlon has joined #openstack-kolla | 12:53 | |
| *** chas has quit IRC | 12:54 | |
| *** chas has joined #openstack-kolla | 12:54 | |
| *** dave-mccowan has joined #openstack-kolla | 12:54 | |
| *** sean-k-mooney has joined #openstack-kolla | 13:00 | |
| *** pcaruana has joined #openstack-kolla | 13:00 | |
| *** jmccarthy has left #openstack-kolla | 13:10 | |
| *** huanxie has joined #openstack-kolla | 13:11 | |
| *** yangyapeng has joined #openstack-kolla | 13:15 | |
| *** genek has joined #openstack-kolla | 13:16 | |
| openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes master: Update init containers https://review.openstack.org/505761 | 13:24 |
| kfox1111 | morning. | 13:25 |
| *** jrist has quit IRC | 13:31 | |
| *** jaosorior has quit IRC | 13:34 | |
| *** jrist has joined #openstack-kolla | 13:35 | |
| *** serlex has quit IRC | 13:35 | |
| dardelean_ | hello | 13:37 |
| dardelean_ | is there a way for when I run kolla pull or bootstrap servers to skip one group of hosts from inv file, like hyperv ones? | 13:37 |
| *** serlex has joined #openstack-kolla | 13:39 | |
| *** serlex has left #openstack-kolla | 13:40 | |
| dardelean_ | like skip-tags but for hosts | 13:40 |
| *** goldyfruit has joined #openstack-kolla | 13:41 | |
| *** huanxie has quit IRC | 13:42 | |
| *** livelace2 has joined #openstack-kolla | 13:42 | |
| dardelean_ | it fails when i use --limit '!hyperv' | 13:46 |
| egonzalez | dardelean, maybe something here https://github.com/openstack/kolla-ansible/blob/master/ansible/kolla-host.yml#L34 | 13:53 |
| *** mnasiadka has quit IRC | 13:55 | |
| dardelean_ | my issues is that after I inset the hyperv hosts in the inventory file, if I do a pull or bootstrap, will fail on the hyperv nodes | 13:56 |
| egonzalez | dardelean, but hyperv group is not children of any other group, no task should be running over them if hyperv role is not being executed | 13:59 |
| dardelean_ | indeed | 14:00 |
| dardelean_ | for example, fails at prechecks at Checking the api_interface is present with "Please check the api_interface property - interface eth0 not found" | 14:04 |
| dardelean_ | only one for prechecks | 14:04 |
| dardelean_ | and for pull, https://paste.ubuntu.com/25633516/ | 14:06 |
| *** nrado has joined #openstack-kolla | 14:08 | |
| *** jaosorior has joined #openstack-kolla | 14:08 | |
| egonzalez | dardelean, just add an empty pull.yml in the role | 14:09 |
| egonzalez | same for prechecks and other tasks | 14:09 |
| *** nrado has left #openstack-kolla | 14:10 | |
| *** nrado has joined #openstack-kolla | 14:10 | |
| nrado | Hi there, is it possible to deploy horizon with the lbaas plugin (binary installation)? I'm still getting this error: | 14:11 |
| nrado | cp: cannot stat '/usr/lib/python2.7/site-packages/neutron_lbaas_dashboard/enabled/_1481_project_ng_loadbalancersv2_panel.py': No such file or directory | 14:11 |
| *** jrist has quit IRC | 14:17 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla master: Implement Almanach Docker images https://review.openstack.org/498938 | 14:17 |
| dardelean_ | egonzalez I see the relation now, thanks | 14:19 |
| dardelean_ | i should probably send a patch on this | 14:19 |
| dardelean_ | do you thing I should also open a bug req? I think not | 14:19 |
| egonzalez | dardelean, i think yes, will need backport to pike for make hyperv completely work | 14:20 |
| dardelean_ | sure thing | 14:20 |
| dardelean_ | i will also implement destroy and the rest | 14:21 |
| egonzalez | nrado, ubuntu/debian or centos/oraclelinux? | 14:23 |
| nrado | egonzalez: ubuntu | 14:23 |
| egonzalez | i see whats missing, python-neutron-lbaas-dashboard installed in horizon. my guess is that was in horizon main package before pike | 14:25 |
| egonzalez | nrado, ^^ | 14:25 |
| egonzalez | nrado, if is a dev env, can test installing directly in horizon container and see if that fixes your issue | 14:26 |
| nrado | I deployed ocata and here it's missing too | 14:27 |
| egonzalez | nrado, docker exec -ti -u root horizon apt-get install -y python-neutron-lbaas-dashboard , then restart horizon container | 14:27 |
| nrado | can give it a try | 14:27 |
| nrado | ok, thx | 14:27 |
| *** hongbin has joined #openstack-kolla | 14:35 | |
| *** dave-mccowan has quit IRC | 14:39 | |
| dardelean_ | egonzalez prechecks still fail with the same error "api_interface property - interface eth0 not found" | 14:39 |
| *** serlex has joined #openstack-kolla | 14:39 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla master: Add lbaas dashboard in horizon ubuntu binary https://review.openstack.org/508191 | 14:40 |
| -openstackstatus- NOTICE: The infra team is now taking Zuul v2 offline and bringing Zuul v3 online. Please see https://docs.openstack.org/infra/manual/zuulv3.html for more information, and ask us in #openstack-infra if you have any questions. | 14:42 | |
| *** kevzha01 has joined #openstack-kolla | 14:43 | |
| *** mdnadeem has quit IRC | 14:44 | |
| *** dave-mccowan has joined #openstack-kolla | 14:44 | |
| *** kevzha01_ has joined #openstack-kolla | 14:45 | |
| *** magicboiz has quit IRC | 14:47 | |
| *** kevzha01 has quit IRC | 14:48 | |
| openstackgerrit | Jianghua Wang proposed openstack/kolla-ansible master: XenAPI: support XenServer deployment. https://review.openstack.org/508196 | 14:57 |
| *** lrensing has joined #openstack-kolla | 14:58 | |
| *** jrist has joined #openstack-kolla | 14:59 | |
| egonzalez | Jeffrey4l, when we deprecate Newton? Other deploy tools will do in ~1 month | 15:01 |
| *** rstarmer has joined #openstack-kolla | 15:01 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla stable/newton: [DNM] test newton branch https://review.openstack.org/462024 | 15:02 |
| *** Zophar has quit IRC | 15:06 | |
| *** dave-mcc_ has joined #openstack-kolla | 15:07 | |
| *** jamesbenson has joined #openstack-kolla | 15:07 | |
| *** NikoHerEricsson has joined #openstack-kolla | 15:08 | |
| NikoHerEricsson | hey all, I have an issue following: https://docs.openstack.org/kolla-kubernetes/latest/deployment-guide.htmlwhen I do "kollakube res create configmap"I get jinja2.exceptions.UndefinedError: 'groups' is undefined | 15:09 |
| *** dave-mccowan has quit IRC | 15:09 | |
| NikoHerEricsson | check complete output here:https://pastebin.com/3W82SBJc | 15:09 |
| NikoHerEricsson | I am not even sure in which config I should look, kolla/global.yaml does not have any groups defined | 15:10 |
| *** jaosorior has quit IRC | 15:12 | |
| *** huanxie has joined #openstack-kolla | 15:15 | |
| *** shardy is now known as shardy_afk | 15:25 | |
| *** krtaylor__ has quit IRC | 15:34 | |
| *** jrist has quit IRC | 15:36 | |
| *** dardelean_ has quit IRC | 15:39 | |
| *** dardelean_ has joined #openstack-kolla | 15:40 | |
| jamesbenson | morning all | 15:42 |
| *** dardelean_ has quit IRC | 15:44 | |
| *** NikoHerEricsson has quit IRC | 15:44 | |
| *** nrado has quit IRC | 15:45 | |
| inc0 | good mornig | 15:45 |
| inc0 | morning even | 15:45 |
| *** yangyapeng has left #openstack-kolla | 15:45 | |
| kolla-slack | <britthouser> :wave: | 15:45 |
| inc0 | Britt, you must know that slack emojis don't work on irc;) | 15:46 |
| *** huanxie has quit IRC | 15:46 | |
| *** zhangfei has joined #openstack-kolla | 15:46 | |
| *** kevzha01_ has quit IRC | 15:47 | |
| kolla-slack | <britthouser> Yeah. :-) | 15:52 |
| kolla-slack | <britthouser> But they are well named, so message come across. | 15:52 |
| inc0 | :wave: | 15:53 |
| inc0 | does it work other way around? | 15:54 |
| openstackgerrit | Christopher Nipper proposed openstack/kolla-ansible master: Add support for Neutron SRIOV agent container https://review.openstack.org/487610 | 15:54 |
| kolla-slack | <britthouser> yup! | 15:55 |
| kolla-slack | <britthouser> or should I say, :thumbsup: | 15:56 |
| *** chas has quit IRC | 15:57 | |
| Jeffrey4l | egonzalez, iirc, release team will be drop newton branch automatically. | 15:57 |
| inc0 | hey Jeffrey4l I have quick question, did you experience issues with rabbitmq lately? | 15:57 |
| *** chas has joined #openstack-kolla | 15:58 | |
| Jeffrey4l | inc0, pike branch? i am not deploy it very often recently. | 15:58 |
| Jeffrey4l | inc0, what happens? | 15:58 |
| inc0 | well lot of people reported different issues that might boil down to rabbitmq | 15:58 |
| inc0 | that and fact that clusterer is now deprecated | 15:58 |
| *** egonzalez has quit IRC | 15:59 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Install libvirt-clients for nova-libvirt image https://review.openstack.org/508046 | 15:59 |
| kolla-slack | <egonzalez> Thanks Jeffrey4l | 15:59 |
| Jeffrey4l | np. | 16:00 |
| kolla-slack | <egonzalez> inc0 i had no issues with rabbit since months ago and using daily build images | 16:00 |
| *** sbezverk has quit IRC | 16:01 | |
| inc0 | ok, that's good to hear, we still need to remove clusterer but we might not be in crysis mode | 16:01 |
| *** chas has quit IRC | 16:02 | |
| *** zhangfei has quit IRC | 16:02 | |
| kolla-slack | <egonzalez> Always deploy in multinode, so cluster still working after all | 16:02 |
| *** rstarmer has quit IRC | 16:02 | |
| inc0 | we also deploy multinode on gates | 16:02 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Fix ci gate failure https://review.openstack.org/508211 | 16:03 |
| *** itlinux has joined #openstack-kolla | 16:04 | |
| *** krtaylor__ has joined #openstack-kolla | 16:04 | |
| *** jascott1 has joined #openstack-kolla | 16:06 | |
| *** nrado has joined #openstack-kolla | 16:06 | |
| *** ntpttr_laptop has joined #openstack-kolla | 16:07 | |
| *** jascott1_ has joined #openstack-kolla | 16:10 | |
| *** jascott1 has quit IRC | 16:10 | |
| *** kbyrne has quit IRC | 16:10 | |
| inc0 | pbourke around? | 16:10 |
| *** jrist has joined #openstack-kolla | 16:10 | |
| pbourke | inc0: hey, yeah just for a little bit | 16:10 |
| inc0 | so I'm working on devmode (copyting venv) | 16:11 |
| pbourke | ok | 16:11 |
| inc0 | I'm really close to get it working in a way that venv that you pip install stuff locally works in container | 16:11 |
| inc0 | but I'll need rsync in images probably:/ | 16:11 |
| inc0 | I'm thinking of having dedicated devenv openstack-base image tbh | 16:12 |
| *** kbyrne has joined #openstack-kolla | 16:12 | |
| inc0 | we could add all the dev libs there then | 16:12 |
| pbourke | why did we want to mount the virtualenv again | 16:13 |
| inc0 | well if someone wants to work on things like oslo | 16:13 |
| *** jascott1_ has quit IRC | 16:13 | |
| inc0 | or ironic-lib | 16:13 |
| inc0 | anything that is not a main service there | 16:13 |
| pbourke | ah yeah | 16:13 |
| pbourke | its just the setting up of that venv sounds painful | 16:14 |
| inc0 | you'd also be able to do things like install new pip library for testing purposes | 16:14 |
| inc0 | it's not horrible, but it has it's caveats | 16:14 |
| inc0 | would make dev much more streamlined tho | 16:14 |
| inc0 | you want to add new dep - just add it to requirements and pip install -e . | 16:15 |
| inc0 | no need to rebuild ever really | 16:15 |
| sean-k-mooney | o/ | 16:15 |
| *** itlinux has quit IRC | 16:15 | |
| pbourke | just wondering if we start to lose the benefits of the containers in this case | 16:15 |
| sean-k-mooney | are the ocata gates working upstream? | 16:15 |
| pbourke | you're half way towards devstack at that stage | 16:15 |
| pbourke | not saying its a bad idea, just unsure | 16:15 |
| sean-k-mooney | i think the centos gates should be breaking currently? | 16:15 |
| pbourke | sean-k-mooney: not even sure the master ones are working never mind ocata ;) | 16:16 |
| inc0 | pbourke: devstack is not bad for service you're actively working on | 16:16 |
| inc0 | it's bad for all other services | 16:16 |
| inc0 | and they stay the same with kolla | 16:16 |
| sean-k-mooney | pbourke: centos 7.4 is out and we pull centos latest | 16:16 |
| sean-k-mooney | 7.4 reved libvirt to 3.2 | 16:16 |
| inc0 | sean-k-mooney: well not latest, we pull centos:7 but effectively it's the sam | 16:16 |
| sean-k-mooney | ocatat can only work with up to 2.5 | 16:16 |
| inc0 | e | 16:16 |
| sean-k-mooney | inc0: 7 defaults to the lates 7.x tag which is now 7.4 | 16:17 |
| inc0 | right | 16:17 |
| *** jascott1 has joined #openstack-kolla | 16:17 | |
| *** jascott1 has quit IRC | 16:17 | |
| sean-k-mooney | i need to check with kolla upstream but in onps fork the libvirt container is breaking because the package manager is installing libvirt 3.2 now and the upperconstritnats are pinning libvirt python to a max of 2.5.0 | 16:18 |
| sean-k-mooney | i dont think they have modifyed this container in there fork so i am guessing we are broken by it oo | 16:19 |
| sean-k-mooney | *too | 16:19 |
| *** jascott1 has joined #openstack-kolla | 16:19 | |
| kolla-slack | <egonzalez> sean-k-mooney https://review.openstack.org/#/c/508211/ | 16:19 |
| sean-k-mooney | ill try and build it later but we might need to pin the libvirt version on stable ocata for centos to compensate for the new version shipt in centos 7.4 | 16:20 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Use kolla_internal_vip_address for glance_api servers https://review.openstack.org/494110 | 16:20 |
| kolla-slack | <egonzalez> But from what you are saying about upper-constraitns we have to pin centos version to 7.3 | 16:20 |
| kolla-slack | <egonzalez> Or libvirt | 16:20 |
| openstackgerrit | gongysh proposed openstack/kolla-ansible master: fix wrong keystone_authtoken settings https://review.openstack.org/508220 | 16:21 |
| sean-k-mooney | egonzalez yes the ocata upperconstaints pin libvirt-python to 2.5 and that can build when we pip install it if we have libvirt 3.2.0 installed | 16:21 |
| inc0 | pbourke: I'll keep experimenting | 16:22 |
| inc0 | just giving you heads up:) | 16:22 |
| pbourke | inc0: yeah sounds good :) | 16:22 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: fwaas is missing in l3 agent extension https://review.openstack.org/508221 | 16:22 |
| pbourke | inc0: im hestitant to make what we have more complicated but I agree the dependencies are an issue that needs to be looked at for serious dev | 16:22 |
| inc0 | deps, cli binaries | 16:23 |
| sean-k-mooney | egonzalez https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L184 | 16:23 |
| inc0 | being able to shuffle deps around without rebuilds | 16:23 |
| sean-k-mooney | inc0: pbourke the current devmod poc also binds the soucre into the wrong location. it should not put them under site-packages but instead under opt | 16:25 |
| *** ntpttr_laptop has quit IRC | 16:25 | |
| inc0 | well inside container it doesn't matter that much | 16:25 |
| sean-k-mooney | ideally in devmode i would like to see the config . json prepend a pip install -e <path to source> followed by the normal start command | 16:25 |
| inc0 | as long as python path works | 16:26 |
| inc0 | well so what you don't want to do is copy sources on every restart | 16:26 |
| inc0 | it's just long | 16:26 |
| sean-k-mooney | inc0: that directory is ment to be readonly though and you might get weird behavior | 16:26 |
| inc0 | what I'm working on is mounting venv+sources and rsync them to place | 16:26 |
| sean-k-mooney | inc0: correct but you want to update any requirement on every start | 16:27 |
| inc0 | so only changes will be coppier | 16:27 |
| jamesbenson | inc0 I think my issues that we talked about a few days ago were related to kernel things. I finally got around to testing it. Kolla 4&5 failed with low latency kernel, but when I put it back on normal kernel kolla4 seemed to pass. I'm testing now with kolla 5 | 16:27 |
| inc0 | no, you mount venv | 16:27 |
| inc0 | which means you install requyirements on host | 16:27 |
| jamesbenson | but ymmv | 16:27 |
| inc0 | and not ever run pip install in container | 16:27 |
| sean-k-mooney | inc0: installing anything on host is defeating the reason for devmode | 16:27 |
| sean-k-mooney | even in a venv | 16:27 |
| inc0 | not really imho | 16:28 |
| inc0 | I mean devs are familiar with venv | 16:28 |
| openstackgerrit | gongysh proposed openstack/kolla-ansible master: fix wrong keystone_authtoken settings https://review.openstack.org/508220 | 16:28 |
| sean-k-mooney | yes and many of us hate them me being one | 16:28 |
| inc0 | and venvs are easily disposable | 16:28 |
| inc0 | why? | 16:28 |
| sean-k-mooney | they mess up my environment | 16:28 |
| sean-k-mooney | i have had issue with using ideas with venvs also | 16:29 |
| *** itlinux has joined #openstack-kolla | 16:29 | |
| inc0 | well, having pip install in contanier will only make it worse | 16:29 |
| sean-k-mooney | pycharm has got better but in general i hate using venv except with tox | 16:29 |
| *** lpetrut has quit IRC | 16:30 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: fwaas is missing in l3 agent extension https://review.openstack.org/508221 | 16:30 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Implement neutron firewall v2 https://review.openstack.org/507716 | 16:30 |
| inc0 | ide's will get venv support much before "libs in container" support;) | 16:31 |
| *** pbourke has quit IRC | 16:32 | |
| inc0 | elegant thing about this solution si that you have your deps on host but that's just a dir | 16:32 |
| sean-k-mooney | pycharm will auto detech that a ven exist and ask if you want to use it if it finds it in the dir you open | 16:32 |
| inc0 | so ide's works, this is totally disposable and all runtime actually is in container | 16:32 |
| sean-k-mooney | so it not too bad i just never really want to have to activate a vnev manually | 16:33 |
| inc0 | right, you technically don't | 16:33 |
| sean-k-mooney | and if im using kolla for dev i dont want to have any openstack deps installed system wide | 16:33 |
| inc0 | well bindeps is a good point | 16:33 |
| sean-k-mooney | bindeps need to be in the container | 16:34 |
| inc0 | true | 16:34 |
| inc0 | but for example if you run pip install cryptography | 16:34 |
| sean-k-mooney | the only advantage to kolla-devmode over devstack is teh ease to get back to a clean system | 16:34 |
| inc0 | you need libcrypto | 16:35 |
| sean-k-mooney | yes | 16:35 |
| Jeffrey4l | hi sean-k-mooney , nova do not depends on python-libvirt from requirements project. now centos 7.4 has upgrade libvirt 3.2 we have to install python-libvirt from distro repo. | 16:35 |
| inc0 | well not only advantage, but big one, true | 16:35 |
| sean-k-mooney | Jeffrey4l: the nova libvirt container installs libvirt-python | 16:35 |
| inc0 | on the other hand, with local venv thingy you only do few libs system-wide and no running services at all | 16:36 |
| Jeffrey4l | i think i have remove that part. | 16:36 |
| sean-k-mooney | Jeffrey4l: the nova libvirt container nonlger builds on stable ocata because of the 7.4 release | 16:36 |
| inc0 | and only from service you're working on | 16:36 |
| sean-k-mooney | Jeffrey4l: well the other issue is didnt nova not work with 3.2 in ocata | 16:36 |
| sean-k-mooney | Jeffrey4l: was it 3.0 or 2.0 that chaged the file permision handeling | 16:37 |
| Jeffrey4l | sean-k-mooney, check this https://review.openstack.org/#/q/I0d7bf1576aaf24fc7c60f49923e37a6a1afe9a8e | 16:37 |
| inc0 | so question si if ease of having local venv (quick dep management, ide support for venvs, you can quickly run service locally vs in container) | 16:37 |
| inc0 | is worth tradeoff of having few system-wide deps | 16:37 |
| Jeffrey4l | sean-k-mooney, ocata + libvirt 3.2 works. | 16:38 |
| *** zhangfei has joined #openstack-kolla | 16:38 | |
| inc0 | so for example, if I'd develop heat | 16:38 |
| inc0 | most of the time I'd restart heat-engine container | 16:39 |
| inc0 | but let say I ran into bug I need my preferred debugger for (ipdb) | 16:39 |
| sean-k-mooney | Jeffrey4l: look like you missed that change to https://github.com/openstack/kolla/blob/stable/ocata/docker/nova/nova-libvirt/Dockerfile.j2 ? | 16:39 |
| inc0 | I can just stop container and run heat-engine locally with same config file as container would use | 16:39 |
| inc0 | and it'd just work | 16:39 |
| Jeffrey4l | sean-k-mooney, what i missed? | 16:40 |
| sean-k-mooney | well for somereason libvirt-python was bing installed in nova-libvirt and cause the build to fail. | 16:41 |
| sean-k-mooney | i need to check somting one second | 16:41 |
| Jeffrey4l | libvirt-python is not installed in nova-libvirt. it is installed in nova-compute only. | 16:41 |
| *** krtaylor__ has quit IRC | 16:41 | |
| *** ntpttr_laptop has joined #openstack-kolla | 16:41 | |
| sean-k-mooney | ya i know i was debuging a fork of kolla that i dont normally support yesterday and the centos 7.4 change is breaking it i was going to see if the same breakage is happeing upstream but did not have a chance too | 16:42 |
| Jeffrey4l | got. | 16:43 |
| sean-k-mooney | it may have been nova-compute instad of nova libvirt but compiling libvirt-pythong was causing a build failure | 16:43 |
| Jeffrey4l | yes. so that patch is needed. | 16:44 |
| Jeffrey4l | python-libvirt should be install from distro repo along with libvirt. | 16:44 |
| *** numans has quit IRC | 16:46 | |
| sean-k-mooney | Jeffrey4l: ya just checked it was nova compute cool | 16:47 |
| sean-k-mooney | ill remove my -1 and tell them to rebase to the head of stable/ocata | 16:47 |
| *** rwsu has joined #openstack-kolla | 16:47 | |
| Jeffrey4l | thanks a lot. | 16:47 |
| *** vhosakot has joined #openstack-kolla | 16:49 | |
| *** numans has joined #openstack-kolla | 16:49 | |
| *** ntpttr_laptop has quit IRC | 16:49 | |
| sean-k-mooney | Jeffrey4l: i should be thanking you one of my collegues spend a day and a half trying to figure out why it was broken | 16:50 |
| sean-k-mooney | we had narrowed it down to libvirt versions but had not fixed it yet | 16:50 |
| Jeffrey4l | ;) | 16:50 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Using folder rather than file when map files into container https://review.openstack.org/508234 | 16:53 |
| *** dougsz has quit IRC | 16:54 | |
| *** jascott1 has quit IRC | 16:57 | |
| *** jascott1 has joined #openstack-kolla | 16:57 | |
| sean-k-mooney | inc0: if you have to install anything system wide i personally would contiue to use devstack for dev | 16:58 |
| sean-k-mooney | or use kolla for dev the way i do today | 16:58 |
| sean-k-mooney | build container for git repos and exec into the container and modify the code | 16:59 |
| inc0 | hmm | 16:59 |
| inc0 | ok so pip installing inside container is what we want | 17:00 |
| *** jascott1 has quit IRC | 17:00 | |
| sean-k-mooney | inc0: since i mostly use nano for coding (or pycharm when i really need an ide) buiding for git repos and then doing docker exec -it <container> bash and editing the code is really easy | 17:01 |
| inc0 | yeah I was experimenting with having contianer with vim, tmux and stuff like that | 17:02 |
| inc0 | but tmux and containers are not great | 17:02 |
| sean-k-mooney | i just ahve to add a couple of extras packages like git,nano,git-reveiw and tox and im basically good to go | 17:02 |
| sean-k-mooney | well i still used docker to run the container so when i waned to run the c hage code i just exited and did docker restart | 17:02 |
| sean-k-mooney | logs are store the same way as normal and other then the fact i had modifed the contaienr it was identical to a normal kolla-deploy | 17:03 |
| *** jascott1 has joined #openstack-kolla | 17:03 | |
| inc0 | well runtime will work the same | 17:03 |
| sean-k-mooney | if i need to debug i just changed the command in the config.json to bash and manully ran the service with pdb | 17:04 |
| kfox1111 | inc0: https://review.openstack.org/#/c/505761/ | 17:04 |
| kfox1111 | we need that for 1.8 support. | 17:04 |
| kfox1111 | (1.8 is currently slated to land sometime today) | 17:04 |
| *** jascott1 has quit IRC | 17:06 | |
| *** jascott1 has joined #openstack-kolla | 17:07 | |
| kfox1111 | inc0: thx. | 17:13 |
| inc0 | I'd lie if I'd say I reviewed it thororughly... | 17:13 |
| inc0 | ;) | 17:13 |
| kfox1111 | :) | 17:14 |
| kfox1111 | it was basically just a json -> yaml conversion. | 17:14 |
| kfox1111 | and double checking the tests still pass. | 17:14 |
| *** serlex has quit IRC | 17:15 | |
| *** sambetts is now known as sambetts|afk | 17:17 | |
| *** numans has quit IRC | 17:26 | |
| *** jascott1 has quit IRC | 17:26 | |
| *** jascott1 has joined #openstack-kolla | 17:26 | |
| *** zhangfei has quit IRC | 17:27 | |
| *** retr0h has quit IRC | 17:28 | |
| *** retr0h has joined #openstack-kolla | 17:28 | |
| *** coolsvap has quit IRC | 17:29 | |
| *** numans has joined #openstack-kolla | 17:31 | |
| *** ntpttr_laptop has joined #openstack-kolla | 17:31 | |
| *** huanxie has joined #openstack-kolla | 17:32 | |
| *** lpetrut has joined #openstack-kolla | 17:46 | |
| *** itlinux has quit IRC | 17:51 | |
| *** itlinux has joined #openstack-kolla | 17:53 | |
| *** dardelean_ has joined #openstack-kolla | 17:54 | |
| *** livelace2 has quit IRC | 17:55 | |
| *** unicell has joined #openstack-kolla | 17:56 | |
| *** dardelean_ has quit IRC | 17:59 | |
| *** huanxie has quit IRC | 18:02 | |
| *** krtaylor__ has joined #openstack-kolla | 18:03 | |
| *** itlinux has quit IRC | 18:20 | |
| *** itlinux has joined #openstack-kolla | 18:36 | |
| *** ntpttr_laptop has quit IRC | 18:37 | |
| *** lrensing has quit IRC | 18:44 | |
| *** janki has quit IRC | 18:45 | |
| *** janki has joined #openstack-kolla | 18:48 | |
| *** ansmith has quit IRC | 18:59 | |
| *** kolla-slack has quit IRC | 19:00 | |
| *** kolla-slack has joined #openstack-kolla | 19:00 | |
| *** itlinux has quit IRC | 19:02 | |
| *** cocakolla has joined #openstack-kolla | 19:03 | |
| *** huanxie has joined #openstack-kolla | 19:05 | |
| *** ansmith has joined #openstack-kolla | 19:14 | |
| *** dardelean_ has joined #openstack-kolla | 19:18 | |
| *** itlinux has joined #openstack-kolla | 19:25 | |
| *** pcaruana has quit IRC | 19:31 | |
| *** huanxie has quit IRC | 19:35 | |
| *** cocakolla has quit IRC | 19:39 | |
| *** rhallisey has quit IRC | 19:41 | |
| *** cocakolla has joined #openstack-kolla | 19:48 | |
| *** cocakolla has quit IRC | 19:56 | |
| *** cocakolla has joined #openstack-kolla | 19:57 | |
| *** cocakolla has quit IRC | 19:57 | |
| *** huanxie has joined #openstack-kolla | 19:58 | |
| *** janki has quit IRC | 20:02 | |
| *** ansmith has quit IRC | 20:03 | |
| *** goldyfruit has quit IRC | 20:06 | |
| *** gfidente has quit IRC | 20:14 | |
| *** ansmith has joined #openstack-kolla | 20:15 | |
| *** lrensing has joined #openstack-kolla | 20:21 | |
| *** huanxie has quit IRC | 20:29 | |
| *** itlinux has quit IRC | 20:30 | |
| *** krtaylor__ has quit IRC | 20:30 | |
| *** ntpttr_laptop has joined #openstack-kolla | 20:31 | |
| *** itlinux has joined #openstack-kolla | 20:33 | |
| *** jamesbenson has quit IRC | 20:35 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Update init containers https://review.openstack.org/505761 | 20:38 |
| *** ansmith has quit IRC | 20:41 | |
| bkero | Hey all, I've been curious. Is there a recommended/supported docker version for kolla? | 20:46 |
| hawi | hi there. i do have question kolla-ansible ceph. i have nice random read, but random write is unbearably bad | 20:56 |
| *** jascott1 has quit IRC | 20:59 | |
| *** jascott1 has joined #openstack-kolla | 21:00 | |
| *** krtaylor__ has joined #openstack-kolla | 21:02 | |
| *** jascott1 has quit IRC | 21:04 | |
| *** jascott1 has joined #openstack-kolla | 21:04 | |
| *** jascott1 has quit IRC | 21:04 | |
| *** jascott1 has joined #openstack-kolla | 21:06 | |
| *** lpetrut has quit IRC | 21:14 | |
| inc0 | bkero: 1.12 is by far best tested | 21:24 |
| inc0 | hawi: well, nothing to do with kolla probably | 21:24 |
| bkero | inc0: Ok, thanks | 21:25 |
| inc0 | we don't add any overhead that I know of...I can't think of any that we might potentially add | 21:25 |
| inc0 | osd gets raw block devices | 21:25 |
| inc0 | and since read is fine, it's unlikely to be anything networking | 21:26 |
| hawi | it's something related to defaults that ceph has | 21:26 |
| inc0 | bkero: what you can check is that your journals are on fast disks | 21:26 |
| hawi | or calculates | 21:26 |
| *** itlinux has quit IRC | 21:26 | |
| inc0 | speed of journals will greatly affect write performance | 21:26 |
| inc0 | usually it's good practice to create journals on dedicated ssd disks | 21:27 |
| hawi | by default they are on same disk, i havent specified some specific one, i think | 21:27 |
| inc0 | https://docs.openstack.org/kolla-ansible/latest/reference/ceph-guide.html#using-an-external-journal-drive | 21:27 |
| inc0 | right, that might be affecting it | 21:27 |
| inc0 | even putting journal on similar disk, but dedicated should speed things up | 21:28 |
| hawi | yes, as heads cant be same time different places on spinning disk | 21:28 |
| hawi | so it might make things even worse, having it on same disk | 21:29 |
| *** reddydodda has joined #openstack-kolla | 21:29 | |
| inc0 | http://docs.ceph.com/docs/giant/rados/configuration/journal-ref/ | 21:29 |
| inc0 | yup, that might be it | 21:29 |
| hawi | i do have two vacant ssd disks, i can try to use them, i think it is safe to add them | 21:30 |
| inc0 | it will improve overall write performance | 21:30 |
| inc0 | since journal on ssd will buffer writes | 21:30 |
| inc0 | so if you have spikey writes, they'll land on ssd journal and spindle will catch up with them later | 21:31 |
| inc0 | if you feel adventorous you can setup journal and writeback cache | 21:32 |
| *** vhosakot has quit IRC | 21:35 | |
| *** itlinux has joined #openstack-kolla | 21:35 | |
| hawi | i have hade writeback cache, it didnt work for this setup | 21:35 |
| hawi | had even some troubles removing it :) | 21:35 |
| hawi | journal disk has to be mirrored, i guess | 21:37 |
| *** itlinux has quit IRC | 21:37 | |
| *** ansmith has joined #openstack-kolla | 21:39 | |
| hawi | how safe is to add them later to kolla-ansible deployment, is it possible just to create disklabel and do reconfigure for ceph? | 21:46 |
| inc0 | hawi: it'd have to be deploy and...I have no idea if you can add journals like that | 21:47 |
| inc0 | but you can try to do it manually | 21:48 |
| hawi | ok, i'll check, thanks | 21:55 |
| hawi | i'm pretty sure it will be good and working setup | 21:55 |
| *** jascott1 has quit IRC | 21:56 | |
| *** jascott1 has joined #openstack-kolla | 21:56 | |
| *** jascott1 has quit IRC | 21:57 | |
| *** jascott1 has joined #openstack-kolla | 21:57 | |
| *** rstarmer has joined #openstack-kolla | 21:59 | |
| *** jascott1 has quit IRC | 22:02 | |
| *** dardelean_ has quit IRC | 22:10 | |
| *** dardelean_ has joined #openstack-kolla | 22:12 | |
| sean-k-mooney | hawi to disable wright back cache you first need to make if flush to disk by makeing it a readonly cache | 22:13 |
| *** dardelean has quit IRC | 22:14 | |
| sean-k-mooney | then you have to remove the overly pool so new right go to the backing pool | 22:14 |
| sean-k-mooney | however you cannot do that if you are using erasure coded pools as the backing pool | 22:14 |
| sean-k-mooney | after that you can manually edit the cursh map to move the existing cache teir osd into the standared storage teir and used them after do a replance of the placement groups. | 22:15 |
| sean-k-mooney | that said that is not trival to do and i would not do it on production without a log fo testing | 22:16 |
| sean-k-mooney | oh miss read yo uhave already removed it never mind me. i think that is a sign i need to call it a day. | 22:17 |
| *** ntpttr_laptop has quit IRC | 22:20 | |
| *** nrado has quit IRC | 22:22 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: base: use new Linaro repo https://review.openstack.org/508340 | 22:31 |
| *** hrww has joined #openstack-kolla | 22:34 | |
| hrww | hey | 22:35 |
| hrww | https://review.openstack.org/#/c/508340/ changes location of Linaro repo used by Debian builds. Can someone take a look and give +2? I will also send it for stable/pike once it lands in master | 22:36 |
| sean-k-mooney | hrww: it looks like http://obs.linaro.org/ERP:/17.12/Debian_9/ is still live. does http://obs.linaro.org/ERP:/kolla/Debian_9/ have the same packages | 22:37 |
| hrww | sean-k-mooney: 17.12 is still there for compatibility with those who still use it | 22:38 |
| hrww | sean-k-mooney: ERP:kolla has all packages needed for kolla use and only those (so no new kernel for example) | 22:38 |
| sean-k-mooney | im not sure we can change the libvirt and and qemu version we use on the stable branch though | 22:38 |
| hrww | sean-k-mooney: we already use those versions in stable | 22:39 |
| sean-k-mooney | oh i miss read they are the same version | 22:39 |
| hrww | sean-k-mooney: libvirt 3.6.0 is the first one which give us fully working aarch64 ootb | 22:39 |
| sean-k-mooney | i taught you where going for 3.6 to 3.8 | 22:39 |
| hrww | good point. | 22:40 |
| hrww | will make ERP:kolla:pike too and keep just libvirt 3.6.0 and qemu 2.10-rc there so I can update ERP:kolla one to newer versions | 22:41 |
| sean-k-mooney | i see you have dpdk there does that mean you were able to ovs-dpdk working on arm | 22:41 |
| *** goldyfruit has joined #openstack-kolla | 22:41 | |
| sean-k-mooney | ya haveing a repo per stable branch would be best long run so you can maintainer a sable and hopefully security patched version for each release | 22:42 |
| sean-k-mooney | unfortunetly i do not have +2 rights on kolla but it make sense to me | 22:43 |
| hrww | sean-k-mooney: I got ovs-dpdk built today. colleage will look at it next week | 22:46 |
| *** reddydodda has quit IRC | 22:47 | |
| sean-k-mooney | cool the only arm hadware i have acesse to is a first gen rasbery pi so i have never had the hardware to deploy ovs-dpdk on arm | 22:48 |
| hrww | ;D | 22:49 |
| hrww | sean-k-mooney: we have proper arm64 servers ;D | 22:49 |
| sean-k-mooney | hrww: i would be interested to hear how you get on. | 22:49 |
| sean-k-mooney | yes unfortunetly they are rather hard to come by at the moment | 22:49 |
| sean-k-mooney | also i dont think intel would be too happy with me spending my capital budget on arm hardware so it would have to be in my home lab so price is also an issue haha | 22:50 |
| hrww | ;)) | 22:51 |
| *** ntpttr_laptop has joined #openstack-kolla | 22:56 | |
| * hrww off | 22:57 | |
| *** hrww has quit IRC | 22:57 | |
| *** masber has quit IRC | 23:02 | |
| *** hongbin has quit IRC | 23:07 | |
| *** lrensing has quit IRC | 23:07 | |
| *** rstarmer has quit IRC | 23:10 | |
| *** genek has quit IRC | 23:11 | |
| *** rstarmer has joined #openstack-kolla | 23:11 | |
| *** huanxie has joined #openstack-kolla | 23:24 | |
| *** itlinux has joined #openstack-kolla | 23:25 | |
| *** itlinux has quit IRC | 23:31 | |
| *** rstarmer has joined #openstack-kolla | 23:33 | |
| *** dardelean_ has quit IRC | 23:37 | |
| *** genek has joined #openstack-kolla | 23:40 | |
| *** rstarmer has quit IRC | 23:44 | |
| *** aagate has quit IRC | 23:48 | |
| *** dardelean_ has joined #openstack-kolla | 23:52 | |
| *** huanxie has quit IRC | 23:54 | |
| *** dardelean_ has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
