| *** WillCode has left #openstack-kolla | 00:20 | |
| *** k_mouza has joined #openstack-kolla | 00:43 | |
| *** k_mouza has quit IRC | 00:48 | |
| *** gregoryo has joined #openstack-kolla | 01:28 | |
| *** spsurya has joined #openstack-kolla | 01:29 | |
| *** eandersson has quit IRC | 01:36 | |
| *** cah_link has quit IRC | 04:53 | |
| *** radeks has joined #openstack-kolla | 05:25 | |
| *** ivve has joined #openstack-kolla | 05:29 | |
| *** Luzi has joined #openstack-kolla | 05:37 | |
| *** hamdyk has joined #openstack-kolla | 06:15 | |
| *** cah_link has joined #openstack-kolla | 06:22 | |
| *** jbadiapa has joined #openstack-kolla | 06:37 | |
| *** gfidente has joined #openstack-kolla | 06:56 | |
| *** luksky has joined #openstack-kolla | 07:12 | |
| *** egonzalez has joined #openstack-kolla | 07:19 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 07:38 |
|---|---|---|
| *** hamdyk has quit IRC | 07:39 | |
| *** hamdyk has joined #openstack-kolla | 07:39 | |
| *** hamdyk has quit IRC | 07:46 | |
| *** pcaruana has joined #openstack-kolla | 07:49 | |
| *** hamdyk has joined #openstack-kolla | 07:58 | |
| *** dougsz has joined #openstack-kolla | 08:04 | |
| *** nathharp has joined #openstack-kolla | 08:09 | |
| *** nathharp has quit IRC | 08:09 | |
| *** nathharp has joined #openstack-kolla | 08:10 | |
| *** dr_feelgood has joined #openstack-kolla | 08:10 | |
| *** k_mouza has joined #openstack-kolla | 08:14 | |
| *** gregoryo has quit IRC | 08:41 | |
| *** dr_feelgood has quit IRC | 08:53 | |
| *** andrein has joined #openstack-kolla | 08:54 | |
| *** jistr has quit IRC | 09:09 | |
| *** jistr has joined #openstack-kolla | 09:10 | |
| *** WillCode has joined #openstack-kolla | 09:22 | |
| WillCode | Good morning :-) Many thanks for the quick hints yesterday. I have deployed a multi node environment with Magnum and all went fine ! | 09:23 |
| mgoddard | morning all | 09:25 |
| mgoddard | henriqueof1: I think we would need more details on the failure | 09:25 |
| WillCode | But 2 little questions still exists: 1) How I could get root access to the docker containers ? A 'docker exec -it glance_api /bin/bash' points me to (glance-api)[glance@cloudbox001:/ but I could not switch to root account (do not know password) 2) If I add one service (f.e. Magnum) Horizon becomes unusable in some menu options. | 09:25 |
| WillCode | Thanks in advance ! | 09:25 |
| mgoddard | WillCode: docker exec -u root | 09:26 |
| WillCode | Arrrgh ! Thanks mgoddard | 09:27 |
| mnasiadka | horizon... try removing with docker stop horizon && docker rm horizon and redeploying | 09:28 |
| mnasiadka | or clearing web browser cookies and cache :) | 09:28 |
| WillCode | Thanks mnasiadka | 09:29 |
| WillCode | root access to container works ! :-) | 09:30 |
| openstackgerrit | Eddie Yen proposed openstack/kolla stable/rocky: Delete default gnocchi & aodh wsgi conf in Ubuntu binary https://review.opendev.org/679617 | 09:42 |
| openstackgerrit | Eddie Yen proposed openstack/kolla stable/rocky: Delete default gnocchi & aodh wsgi conf in Ubuntu binary https://review.opendev.org/679617 | 09:44 |
| *** dr_feelgood has joined #openstack-kolla | 09:47 | |
| *** dr_feelgood has quit IRC | 09:49 | |
| *** dr_feelgood has joined #openstack-kolla | 09:51 | |
| WillCode | Ok, I have learned a lot in the last 2 hours... :-) If I want to allow glance to upload images via www, I have to set serveral options in 'glance_api.conf' and Horizons 'local_settings' Now I have to restart glance_api and httpd The first I got managed with 'docker rerstart glance_api' But whre do I find the httpd service ??? | 09:58 |
| WillCode | I have searched the network ports with "docker inspect" on all running containers, but could not find any 80 or 443 | 09:59 |
| WillCode | Or could I set the options directly in "globals.yml" and re-deploy ?? | 10:00 |
| mnasiadka | WillCode: check "OpenStack Service Configuration in Kolla" here https://docs.openstack.org/kolla-ansible/latest/admin/advanced-configuration.html# | 10:02 |
| WillCode | ---> "Kolla will look for a file in /etc/kolla/config/<< service name >>/<< config file >>" --> WOW ! Thanks | 10:04 |
| WillCode | Great community. Nice guys. | 10:04 |
| mnasiadka | ugh | 10:09 |
| mnasiadka | mgoddard: seems we have some problems in the CI connecting to trunk.rdoproject.org... | 10:09 |
| mnasiadka | trunk.rdoproject.org:443; Connection timed out | 10:09 |
| mnasiadka | https://ae2197746e23c7b714c7-0b8936c820696cdb6c8467dc1e642b32.ssl.cf1.rackcdn.com/675614/44/check/kolla-ansible-centos-source/9651d29/ara-report/ | 10:09 |
| mgoddard | mnasiadka: :( | 10:12 |
| mgoddard | do we not have mirrors? | 10:12 |
| mnasiadka | well, maybe we do - but we download the repo file directly from trunk.rdo | 10:12 |
| mgoddard | right | 10:13 |
| mgoddard | works on my laptop, maybe it was a temporary issue? | 10:13 |
| mnasiadka | well, had it once, did a recheck and it's there again | 10:14 |
| mnasiadka | seems like a Rackspace issue | 10:14 |
| *** nathharp_ has joined #openstack-kolla | 10:15 | |
| *** nathharp_ has quit IRC | 10:17 | |
| *** nathharp has quit IRC | 10:18 | |
| *** nathharp has joined #openstack-kolla | 10:18 | |
| *** nathharp has joined #openstack-kolla | 10:23 | |
| *** nathharp has quit IRC | 10:25 | |
| *** nathharp has joined #openstack-kolla | 10:41 | |
| openstackgerrit | Ondrej Duchon proposed openstack/kolla-ansible master: Corrected notificaions for auditing. https://review.opendev.org/678544 | 10:47 |
| *** jovial[m] has quit IRC | 11:08 | |
| *** dougsz has quit IRC | 11:11 | |
| hrw | morning | 11:12 |
| *** andrein has quit IRC | 11:21 | |
| mgoddard | morning hrw | 11:24 |
| *** dougsz has joined #openstack-kolla | 11:30 | |
| *** WillCode has left #openstack-kolla | 12:00 | |
| *** FlorianFa has joined #openstack-kolla | 12:10 | |
| henriqueof1 | mgoddard: About the deploy error, only thing I changed was adding config files to /etc/kolla/config dir and after the error show up I removed then but the error persisted, not sure if it is related. | 12:15 |
| henriqueof1 | It always fails on the 'Restart cinder-backup container' step. | 12:16 |
| henriqueof1 | Only clue I have about the error is "'unicode object' has no attribute 'changed'". | 12:16 |
| henriqueof1 | What detail do you need? | 12:16 |
| *** priteau has joined #openstack-kolla | 12:23 | |
| *** andrein has joined #openstack-kolla | 12:25 | |
| *** ondrejduchon has joined #openstack-kolla | 12:27 | |
| *** luksky has quit IRC | 12:28 | |
| mgoddard | henriqueof1: a copy of the ansible output from the failing task would be good | 12:31 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Set my_ip in ironic.conf https://review.opendev.org/679631 | 12:38 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Set my_ip in ironic.conf https://review.opendev.org/679632 | 12:39 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Use secure websocket for nova serial console proxy when TLS enabled https://review.opendev.org/679633 | 12:39 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Use secure websocket for nova serial console proxy when TLS enabled https://review.opendev.org/679637 | 12:42 |
| openstackgerrit | Ondrej Duchon proposed openstack/kolla-ansible master: Corrected notificaions for auditing. https://review.opendev.org/678544 | 12:42 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Use net_default_mac in ansible/roles/ironic/templates/ironic_pxe_uefi.default.j2 https://review.opendev.org/679638 | 12:44 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Use net_default_mac in ansible/roles/ironic/templates/ironic_pxe_uefi.default.j2 https://review.opendev.org/679639 | 12:44 |
| henriqueof1 | mgoddard: There you go: https://pastebin.com/ff5Fr6f7 | 12:46 |
| mgoddard | henriqueof1: thanks | 12:47 |
| mgoddard | henriqueof1: are you sure that log is from stein? | 12:49 |
| henriqueof1 | Yup, I git clone stable stein on July 26. | 12:50 |
| mgoddard | henriqueof1: I can't see reference to policy_overwriting | 12:51 |
| henriqueof1 | I think I'll clone latest version and use same inventory/globals file, do you think it can mess my deployment? | 12:52 |
| mgoddard | henriqueof1: are you using external ceph? | 12:52 |
| henriqueof1 | mgoddard: Not using ceph, for wxternal sotrage I am using Dell iSCSI. | 12:53 |
| henriqueof1 | About policy overwriting: https://pastebin.com/sUPExVLc | 12:54 |
| mgoddard | henriqueof1: it's not obvious to me what the problem is. I would add some 'debug' tasks to check the value of thos variables | 13:00 |
| mgoddard | henriqueof1: but something looks weird to me - the conditional in ansible/roles/cinder/handlers/main.yml for cinder backup references a variable called policy_overwriting but your error message does not | 13:01 |
| henriqueof1 | mgoddard: I changed the 'ansible/roles/cinder/handlers/main.yml' file after the error appeared, removed some unused coditials like ceph one, will revert back and re-run to show you the error with original files. | 13:05 |
| mgoddard | ok | 13:05 |
| mgoddard | I would add some debug tasks though | 13:05 |
| *** luksky has joined #openstack-kolla | 13:13 | |
| henriqueof1 | mgoddard: https://pastebin.com/pK3JLm6t | 13:15 |
| henriqueof1 | Original files, same error. :( | 13:15 |
| mgoddard | henriqueof1: right, I think you need to do some debugging locally | 13:16 |
| henriqueof1 | Any chances it is related to inventory files? I changed it heavily too. | 13:16 |
| mgoddard | henriqueof1: it could be, I don't know | 13:16 |
| henriqueof1 | mgoddard: Okay, thanks for your time. :) | 13:17 |
| ondrejduchon | Hello, I just posted bug report https://bugs.launchpad.net/kolla-ansible/+bug/1842317 concerning usage of FluentFormatter and FluentHandler for logging. What approach would you suggest? | 13:27 |
| openstack | Launchpad bug 1842317 in kolla-ansible "Use FluentFormatter and FluentHandler for logging" [Undecided,New] | 13:27 |
| *** Luzi has quit IRC | 13:32 | |
| mgoddard | dougsz: ^ | 13:33 |
| dougsz | ondrejduchon: The idea is for all services to output logs directly to fluentd? | 13:43 |
| dougsz | Can you still continue to write them locally from the service? I know you could do it via Fluentd | 13:44 |
| henriqueof1 | I set enable_cinder_backup to no on globals.yml and used deploy but the container still there, any way to remove it? | 13:47 |
| mgoddard | henriqueof1: not currently - you'll need a manual docker stop cinder_backup; docker rm cinder_backup | 13:50 |
| *** cah_link has quit IRC | 14:02 | |
| *** KeithMnemonic has joined #openstack-kolla | 14:03 | |
| ondrejduchon | dougsz: I was thinking to use custom config, where you will specify which way you want to log. Directly to fluent, or writing into file or both. The advantage of using direct way into fluent is full context (username, request ID..) | 14:05 |
| dougsz | ondrejduchon: If you did both, would the service do the writing to file like it does at the moment? | 14:10 |
| dougsz | A lot of the logs do have those fields - do you have any examples of when more information is sent when logging directly to Fluentd? | 14:11 |
| *** nathharp_ has joined #openstack-kolla | 14:13 | |
| *** nathharp_ has quit IRC | 14:15 | |
| *** nathharp has quit IRC | 14:15 | |
| *** nathharp has joined #openstack-kolla | 14:21 | |
| ondrejduchon | dougsz: Yes, you can define format and render it to be same as now. | 14:26 |
| ondrejduchon | I am sending you JSON from neutron as a example | 14:26 |
| ondrejduchon | https://pastebin.com/sECYAPRY | 14:27 |
| *** k_mouza has quit IRC | 14:30 | |
| *** k_mouza_ has joined #openstack-kolla | 14:30 | |
| *** hamdyk has quit IRC | 14:32 | |
| k_mouza_ | good afternoon guys! Quick one if anyone can help me please. I want to pass some extra environment variables, only in magnum containers. Defining these under docker_common_options, in group_vars/all.yml, applies the changes (at least) on all the common containers as well (fluentd, cron, kolla_toolbox) | 14:37 |
| dougsz | ondrejduchon: Do you have a diff of how that output compares to the log message written to file? | 14:42 |
| *** dr_feelgood has quit IRC | 14:53 | |
| ondrejduchon | dougsz: https://pastebin.com/JKXrh5J9 Btw also there is a exception as one object (string array) for better analysis | 14:56 |
| *** cah_link has joined #openstack-kolla | 14:58 | |
| dougsz | ondrejduchon: Thanks, it looks useful. The other nice thing is that it could simplify the existing Fluentd config because everything is already extracted. | 15:02 |
| dougsz | I suppose creating a patch to add support for one service could be a nice way of getting the ball rolling? | 15:03 |
| *** mixor has joined #openstack-kolla | 15:03 | |
| dougsz | We are also in the process of upgrading Fluentd to the latest stable release, mnasiadka has been doing some good work on that. | 15:04 |
| *** cah_link has quit IRC | 15:05 | |
| mgoddard | ondrejduchon: why do we get two timestamps? | 15:06 |
| *** priteau has quit IRC | 15:09 | |
| ondrejduchon | mgoddard: timestamp with @ is when it was accepted by fluent, the other timestamp is when exception was thrown. | 15:10 |
| *** egonzalez has quit IRC | 15:17 | |
| mgoddard | k_mouza_: we don't have a way to do that currently | 15:20 |
| *** mgoddard has quit IRC | 15:41 | |
| *** mgoddard has joined #openstack-kolla | 15:43 | |
| *** luksky has quit IRC | 15:45 | |
| *** zbr is now known as zbr|ooo | 15:52 | |
| *** ondrejduchon has quit IRC | 16:08 | |
| *** nathharp_ has joined #openstack-kolla | 16:10 | |
| *** nathharp has quit IRC | 16:14 | |
| *** nathharp_ has quit IRC | 16:15 | |
| *** luksky has joined #openstack-kolla | 16:29 | |
| *** jonaspaulo has joined #openstack-kolla | 16:35 | |
| *** k_mouza_ has quit IRC | 16:42 | |
| *** spsurya has quit IRC | 16:44 | |
| *** andrein has quit IRC | 16:53 | |
| openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Remove Heat environment file disabling deprecated plugins https://review.opendev.org/674867 | 17:14 |
| *** KeithMnemonic1 has joined #openstack-kolla | 17:27 | |
| *** KeithMnemonic1 has quit IRC | 17:27 | |
| *** KeithMnemonic has quit IRC | 17:31 | |
| *** mgoddard has quit IRC | 17:32 | |
| *** mgoddard has joined #openstack-kolla | 17:35 | |
| *** mgoddard has quit IRC | 17:40 | |
| *** andrein has joined #openstack-kolla | 17:43 | |
| *** zbr|ooo is now known as zbr | 17:53 | |
| *** mgoddard has joined #openstack-kolla | 17:53 | |
| *** gfidente is now known as gfidente|afk | 18:05 | |
| *** dougsz has quit IRC | 18:11 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix Zun Docker remote API host https://review.opendev.org/678276 | 18:14 |
| *** pcaruana has quit IRC | 18:19 | |
| *** pcaruana has joined #openstack-kolla | 18:19 | |
| *** iniazi has quit IRC | 18:48 | |
| *** logan- has quit IRC | 19:59 | |
| *** gfidente|afk has quit IRC | 20:02 | |
| *** logan- has joined #openstack-kolla | 20:02 | |
| *** gfidente has joined #openstack-kolla | 20:02 | |
| *** gfidente has quit IRC | 20:14 | |
| openstackgerrit | Manuel Rodriguez proposed openstack/kolla-ansible master: Add support to enable l3 port-forwarding plugin https://review.opendev.org/679678 | 20:31 |
| *** pcaruana has quit IRC | 20:36 | |
| *** dougsz has joined #openstack-kolla | 20:48 | |
| *** dougsz has quit IRC | 20:53 | |
| *** mixor has quit IRC | 21:02 | |
| *** gfidente has joined #openstack-kolla | 21:04 | |
| *** gfidente is now known as gfidente|afk | 21:17 | |
| *** ivve has quit IRC | 22:06 | |
| *** ivve has joined #openstack-kolla | 22:07 | |
| *** andrein has quit IRC | 22:13 | |
| *** ivve has quit IRC | 22:17 | |
| *** gfidente|afk has quit IRC | 22:18 | |
| *** andrein has joined #openstack-kolla | 22:23 | |
| *** jonaspaulo has quit IRC | 22:43 | |
| *** luksky has quit IRC | 22:48 | |
| *** owalsh has quit IRC | 23:43 | |
| *** owalsh has joined #openstack-kolla | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!