| *** zhanglong has joined #openstack-kolla | 00:25 | |
| *** zhanglong has quit IRC | 00:32 | |
| *** zhanglong has joined #openstack-kolla | 00:42 | |
| *** brinzhang has joined #openstack-kolla | 00:51 | |
| *** suryasingh has joined #openstack-kolla | 01:06 | |
| *** ladrua has quit IRC | 02:24 | |
| *** brinzhang_ has joined #openstack-kolla | 02:34 | |
| *** brinzhang has quit IRC | 02:37 | |
| *** rphillips has quit IRC | 03:01 | |
| *** rphillips has joined #openstack-kolla | 03:01 | |
| *** brinzhang0 has joined #openstack-kolla | 03:04 | |
| *** brinzhang_ has quit IRC | 03:07 | |
| *** ladrua has joined #openstack-kolla | 03:09 | |
| *** ricolin has joined #openstack-kolla | 03:31 | |
| *** dking has quit IRC | 03:56 | |
| *** zhanglong has quit IRC | 04:27 | |
| *** e0ne has joined #openstack-kolla | 04:32 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-kolla | 04:33 | |
| *** e0ne has quit IRC | 04:37 | |
| *** skramaja has joined #openstack-kolla | 04:46 | |
| *** e0ne has joined #openstack-kolla | 04:52 | |
| *** e0ne has quit IRC | 04:56 | |
| *** brinzhang_ has joined #openstack-kolla | 05:04 | |
| *** brinzhang0 has quit IRC | 05:06 | |
| *** bsanjeewa has joined #openstack-kolla | 05:09 | |
| *** bsanjeewa_ has joined #openstack-kolla | 05:10 | |
| *** e0ne has joined #openstack-kolla | 05:11 | |
| *** bsanjeewa has quit IRC | 05:12 | |
| *** bsanjeewa_ has quit IRC | 05:14 | |
| *** e0ne has quit IRC | 05:16 | |
| *** abdysn has joined #openstack-kolla | 05:26 | |
| *** jbadiapa has joined #openstack-kolla | 05:28 | |
| *** zhanglong has joined #openstack-kolla | 05:28 | |
| *** e0ne has joined #openstack-kolla | 05:28 | |
| *** e0ne has quit IRC | 05:33 | |
| *** brinzhang0 has joined #openstack-kolla | 05:54 | |
| *** brinzhang_ has quit IRC | 05:57 | |
| *** cah_link has joined #openstack-kolla | 06:21 | |
| *** nikparasyr has joined #openstack-kolla | 06:22 | |
| *** zhanglong has quit IRC | 06:37 | |
| *** zhanglong has joined #openstack-kolla | 06:40 | |
| *** happyhemant has joined #openstack-kolla | 06:40 | |
| *** vishalmanchanda has joined #openstack-kolla | 06:49 | |
| *** zijlboot has joined #openstack-kolla | 06:51 | |
| *** born2bake has joined #openstack-kolla | 06:54 | |
| *** dciabrin has joined #openstack-kolla | 07:14 | |
| *** e0ne has joined #openstack-kolla | 07:14 | |
| *** bengates has joined #openstack-kolla | 07:16 | |
| *** rphillips has quit IRC | 07:22 | |
| *** rphillips has joined #openstack-kolla | 07:25 | |
| *** zhanglong has quit IRC | 07:28 | |
| *** zhanglong has joined #openstack-kolla | 07:30 | |
| *** zhanglong has quit IRC | 08:00 | |
| *** k_mouza has joined #openstack-kolla | 08:03 | |
| *** brinzhang_ has joined #openstack-kolla | 08:04 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Deprecate kolla_internal_address variable https://review.opendev.org/720338 | 08:04 |
|---|---|---|
| *** Fl1nt has joined #openstack-kolla | 08:05 | |
| Fl1nt | Hi everyone! | 08:05 |
| *** brinzhang0 has quit IRC | 08:07 | |
| *** zhanglong has joined #openstack-kolla | 08:13 | |
| *** rphillips has quit IRC | 08:21 | |
| *** rphillips has joined #openstack-kolla | 08:22 | |
| *** Ash_Rhost has joined #openstack-kolla | 08:24 | |
| Ash_Rhost | Question for those who have used kolla-ansible mysql backup/restore. Is there anyway to define in the globals.yml a shared NFS mount for your nodes for the /backups directory in the docker image to be redirected to the afore mentioned NFS share? I'm trying to make it a single step and not have to do a docker cp if possible. | 08:26 |
| Ash_Rhost | we want to use a netapp share for safeguard of the backups | 08:27 |
| Ash_Rhost | I dug into the kolla ansible source and I couldn't find a method but I might have missed something so hoping there's a way. | 08:28 |
| openstackgerrit | Bartosz Bezak proposed openstack/kolla-ansible master: Add support to use bifrost-deploy behind proxy https://review.opendev.org/746329 | 08:29 |
| *** kevko__ has joined #openstack-kolla | 08:32 | |
| *** kevko_ has joined #openstack-kolla | 08:34 | |
| *** kevko__ has quit IRC | 08:34 | |
| *** k_mouza has quit IRC | 08:41 | |
| Fl1nt | @Ash_Rhost, hey | 08:43 |
| Fl1nt | should be doable by modifying the way k-a use the CTRL01 as the backup host. | 08:44 |
| Ash_Rhost | can it be done without patching anything or will it require modification outside of globals.yml? | 08:44 |
| Ash_Rhost | I mean I could likely hack the source for mariadb:/backup to use a variable substitution. | 08:45 |
| Fl1nt | if you have a look at it: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/mariadb/tasks/backup.yml | 08:45 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add support for custom Aodh configuration https://review.opendev.org/746459 | 08:45 |
| *** k_mouza has joined #openstack-kolla | 08:45 | |
| Fl1nt | you can adapt the volume binding | 08:45 |
| Fl1nt | @Ash_Rhost, would you be ok to propose a patch for that? I think that being able to send the backup to an external storage would it be NFS/CEPH/SWIFT would be a huge benefit. | 08:47 |
| Ash_Rhost | Yea, let me play around and see what I can do. It may have to wait until after my project is done. I have 2 weeks to make a viable solution so for short term likely doing the docker cp method | 08:48 |
| Ash_Rhost | just glad to see it wasn't my imagination in that it wasn't already there and that I was on the right track ;) | 08:48 |
| Fl1nt | sure no rush, everyone is pretty much on vacation for now ^^ | 08:48 |
| Ash_Rhost | - "mariadb_backup:/backup" is the beasty that would need the {{ mariadb_backup_mount }} right? | 08:49 |
| Fl1nt | TBN: as the docker backup DB to the /backup that is linked to you host, you can easily bind mount the host path | 08:49 |
| Fl1nt | yep | 08:49 |
| Ash_Rhost | ok, groovy. Should be a quick hack so I'll play around | 08:49 |
| Fl1nt | excellent! | 08:50 |
| *** happyhemant has quit IRC | 08:50 | |
| Ash_Rhost | thanks for the confirmation. | 08:50 |
| *** gfidente has joined #openstack-kolla | 08:50 | |
| Fl1nt | sure no problems! Glad it helped ^^ | 08:50 |
| *** zhanglong has quit IRC | 08:52 | |
| *** zhanglong has joined #openstack-kolla | 08:54 | |
| Ash_Rhost | Oh Flint, one more thing.. Is there an 'easy' way to identify what node is currently the master for the backups? I was just going to run it against all anyway incase one of the nodes are down for maintenance during a backup, but automating autodetection would be great | 08:56 |
| Fl1nt | it's always CTRL01 | 08:56 |
| Fl1nt | well, actually | 08:56 |
| Ash_Rhost | *grin* | 08:56 |
| Fl1nt | not really | 08:56 |
| Fl1nt | it's always, the first node of your inventory list for mariadbbackups | 08:57 |
| Ash_Rhost | ok, so always lowest demoninator at the time of the backup | 08:57 |
| Fl1nt | so if you comment your first controller because it's under maintenance, it will be CTRL02 etc | 08:57 |
| Ash_Rhost | and it uses alphanumeric for calculation? | 08:57 |
| Fl1nt | no it just use the array position within the ansible group | 08:57 |
| Ash_Rhost | oh, so howver it's listed in the inventory, gotcha | 08:58 |
| Ash_Rhost | makes it quite simple to scrape that file then, thanks | 08:58 |
| Fl1nt | @Ash_Rhost, exact answer is: https://github.com/openstack/kolla-ansible/blob/516658f489a77ad51c0ad0dc5473a64fc2d0850b/ansible/roles/mariadb/defaults/main.yml#L111 | 08:59 |
| Fl1nt | so it depends on how you splitted and built your infrastructure, but usually, SQL is on CTRL so I told you CTRL. | 09:00 |
| *** stackedsax has quit IRC | 09:09 | |
| *** r3ap3r has quit IRC | 09:11 | |
| *** r3ap3r has joined #openstack-kolla | 09:14 | |
| *** stackedsax has joined #openstack-kolla | 09:17 | |
| *** stingrayza has joined #openstack-kolla | 09:23 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Support setting ethtool options on network interfaces https://review.opendev.org/746465 | 09:25 |
| *** Ash_Rhost has quit IRC | 09:27 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/ussuri: Set endpoint type variables to publicURL in public-openrc.sh https://review.opendev.org/746042 | 09:29 |
| *** shyamb has joined #openstack-kolla | 09:30 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Set endpoint type variables to publicURL in public-openrc.sh https://review.opendev.org/746468 | 09:30 |
| *** shyamb has quit IRC | 09:41 | |
| *** shyamb has joined #openstack-kolla | 09:45 | |
| shyamb | Hi | 09:52 |
| *** shyamb has quit IRC | 09:53 | |
| *** shyamb has joined #openstack-kolla | 09:53 | |
| shyamb | Hi | 09:53 |
| shyamb | In nova_api container which is running with 'nova' user, whic user copies files from "/var/lib/kolla/confi_files" to /etc/nova directory? | 09:54 |
| shyamb | Is it root or nova with sudo? | 09:54 |
| *** gfidente has quit IRC | 09:56 | |
| *** eliaswimmer has joined #openstack-kolla | 09:58 | |
| *** Luzi has joined #openstack-kolla | 09:59 | |
| *** jopdorp has joined #openstack-kolla | 10:00 | |
| shyamb | mgoddard: ^^ let me know if you have any thoughts on my doubt above | 10:01 |
| *** gfidente has joined #openstack-kolla | 10:02 | |
| *** maharg101 has joined #openstack-kolla | 10:02 | |
| *** brinzhang_ has quit IRC | 10:04 | |
| *** brinzhang_ has joined #openstack-kolla | 10:04 | |
| *** brinzhang_ has quit IRC | 10:06 | |
| *** brinzhang_ has joined #openstack-kolla | 10:06 | |
| *** k_mouza has quit IRC | 10:10 | |
| Fl1nt | @shyamb, it's the dumb-init user, so should be root | 10:11 |
| *** k_mouza has joined #openstack-kolla | 10:12 | |
| openstackgerrit | Bartosz Bezak proposed openstack/kayobe master: Make pip_index_url variable conditional https://review.opendev.org/746325 | 10:16 |
| *** jopdorp has quit IRC | 10:27 | |
| mgoddard | shyamb: sudo | 10:30 |
| mgoddard | shyamb: see docker/base/start.sh in kolla | 10:31 |
| shyamb | mgoddard: Okay thanks | 10:32 |
| shyamb | Fl1nt: thank you | 10:37 |
| *** priteau has joined #openstack-kolla | 10:41 | |
| *** jopdorp has joined #openstack-kolla | 10:41 | |
| *** ricolin has quit IRC | 10:41 | |
| *** jopdorp has quit IRC | 10:49 | |
| *** jopdorp has joined #openstack-kolla | 10:50 | |
| *** k_mouza has quit IRC | 10:52 | |
| *** k_mouza has joined #openstack-kolla | 10:55 | |
| *** ewimmer_ has joined #openstack-kolla | 10:56 | |
| *** eliaswimmer has quit IRC | 10:59 | |
| shyamb | mgoddard: We are creating a new service in openstack | 11:00 |
| shyamb | What minimum permissions we need to provide in sudoers file? | 11:01 |
| shyamb | service will be running with let's say "xyz" user | 11:01 |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: add releasenote for octavia configuration https://review.opendev.org/746404 | 11:03 |
| mgoddard | shyamb: you shouldn't need additional sudoers config | 11:03 |
| shyamb | okay | 11:05 |
| shyamb | so, kolla takes care of that | 11:05 |
| shyamb | I think we are not building our container with kolla | 11:06 |
| shyamb | that's why we are facing these permissions issue | 11:06 |
| shyamb | mgoddard: thanks | 11:06 |
| shyamb | I need to check docs on how we can build our containers with kolla | 11:06 |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: update octavia doc https://review.opendev.org/746409 | 11:15 |
| *** happyhemant has joined #openstack-kolla | 11:25 | |
| *** brinzhang0 has joined #openstack-kolla | 11:34 | |
| *** weshay_ is now known as weshay|ruck | 11:36 | |
| *** brinzhang_ has quit IRC | 11:37 | |
| shyamb | mgoddard: Does this sudoers file gets used during binary container deployment? https://github.com/openstack/kolla/blob/master/docker/cinder/cinder-base/cinder_sudoers | 11:38 |
| shyamb | This has virtual env path, which does not exists on binary container | 11:38 |
| shyamb | I need to create same file for my service | 11:38 |
| shyamb | that's why I am concerned | 11:39 |
| *** ewimmer_ has quit IRC | 11:44 | |
| *** wuchunyang has joined #openstack-kolla | 11:49 | |
| *** wuchunyang has quit IRC | 11:52 | |
| *** wuchunyang has joined #openstack-kolla | 11:52 | |
| *** wuchunyang has quit IRC | 11:54 | |
| *** wuchunyang has joined #openstack-kolla | 11:54 | |
| openstackgerrit | wu.chunyang proposed openstack/kolla master: [doc]remove sensu from README https://review.opendev.org/746488 | 11:55 |
| *** wuchunyang has quit IRC | 11:56 | |
| *** k_mouza has quit IRC | 11:57 | |
| *** wuchunyang has joined #openstack-kolla | 11:57 | |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: update octavia doc https://review.opendev.org/746409 | 11:59 |
| *** wuchunyang has quit IRC | 12:00 | |
| shyamb | yoctozepto: Do we need this file for binary containers ?https://github.com/openstack/kolla/blob/90adc2b851461828b5051be373640911c795fc5a/docker/glance/glance-base/glance_sudoers | 12:00 |
| shyamb | We are creating a new service container - third party. For that we needed this information | 12:01 |
| shyamb | Where this sudoers file getting used for binary container? | 12:01 |
| *** ricolin has joined #openstack-kolla | 12:06 | |
| mgoddard | shyamb: binary packages normally provide their own sudoers config | 12:12 |
| shyamb | Okay I got it. For ex. This one - "/etc/sudoers.d/glance" | 12:13 |
| *** brinzhang_ has joined #openstack-kolla | 12:14 | |
| shyamb | mgoddard: thanks | 12:14 |
| *** brinzhang0 has quit IRC | 12:17 | |
| *** zhanglong has quit IRC | 12:29 | |
| *** gfidente has quit IRC | 12:36 | |
| *** shyamb has quit IRC | 12:39 | |
| *** dave-mccowan has joined #openstack-kolla | 12:40 | |
| *** gfidente has joined #openstack-kolla | 12:56 | |
| *** ewimmer_ has joined #openstack-kolla | 13:00 | |
| *** Chensa has joined #openstack-kolla | 13:09 | |
| Chensa | hi guys! is this a place where I can ask a question about kolla-openstack? | 13:10 |
| openstackgerrit | Bartosz Bezak proposed openstack/kayobe master: Make pip_index_url variable conditional https://review.opendev.org/746325 | 13:18 |
| *** Luzi has quit IRC | 13:26 | |
| *** wuchunyang has joined #openstack-kolla | 13:28 | |
| *** brinzhang0 has joined #openstack-kolla | 13:33 | |
| *** brinzhang0 has quit IRC | 13:35 | |
| *** brinzhang0 has joined #openstack-kolla | 13:35 | |
| *** cah_link has quit IRC | 13:36 | |
| *** brinzhang_ has quit IRC | 13:36 | |
| Fl1nt | @Chensa, yep | 13:41 |
| openstackgerrit | Merged openstack/kolla master: [doc]remove sensu from README https://review.opendev.org/746488 | 13:56 |
| *** k_mouza has joined #openstack-kolla | 13:57 | |
| *** k_mouza has quit IRC | 14:02 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Update release note for httpd keep alive https://review.opendev.org/746512 | 14:06 |
| *** abdysn has quit IRC | 14:14 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Fix ownership and permissions of admin-openrc.sh https://review.opendev.org/745071 | 14:15 |
| *** brinzhang has joined #openstack-kolla | 14:25 | |
| *** brinzhang0 has quit IRC | 14:27 | |
| *** k_mouza has joined #openstack-kolla | 14:27 | |
| *** gfidente has quit IRC | 14:33 | |
| *** brinzhang_ has joined #openstack-kolla | 14:34 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Support setting ethtool options on network interfaces https://review.opendev.org/746465 | 14:35 |
| *** ChenSa9 has joined #openstack-kolla | 14:35 | |
| *** brinzhang has quit IRC | 14:37 | |
| Chensa | I am deploying openstack with centos and kolla-toolbox is not deploying which causes problems for the mariadb instance | 14:39 |
| *** ewimmer_ has quit IRC | 14:39 | |
| *** ewimmer_ has joined #openstack-kolla | 14:40 | |
| Chensa | couldn't find any info about this kolla-toolbox or why would this happen | 14:40 |
| Chensa | after replacing OS to ubuntu I managed to deploy openstack, but It seems like it should work with centos | 14:42 |
| Chensa | also, rhel 8 reports that the ansible_distribution variable is "RedHat" and and kolla is always referencing "RHEL" which also break the installation process when deploying with rhel | 14:43 |
| *** gfidente has joined #openstack-kolla | 14:46 | |
| *** kevko_ has quit IRC | 14:51 | |
| *** kevko has joined #openstack-kolla | 14:52 | |
| kevko | hi guys, does someone from you facing from time to time error "Remote disconnected without response." when keep-alive turned ON ? | 14:53 |
| kevko | i know where is problem ..i'm just curious if someone from you guys tried to solve a problem ..as it is hard to replicate and it is intermittent | 14:55 |
| *** brinzhang0 has joined #openstack-kolla | 15:04 | |
| *** brinzhang_ has quit IRC | 15:06 | |
| *** dking has joined #openstack-kolla | 15:11 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Deprecate kolla_internal_address variable https://review.opendev.org/720338 | 15:17 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add support to use bifrost-deploy behind proxy https://review.opendev.org/746329 | 15:17 |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Add missing mistral services log files https://review.opendev.org/746412 | 15:17 |
| Fl1nt | @Chensa, Kolla-toolbox is used to operate actions such as setting the MariaDB cluster, add new services to the openstack catalog etc, basically, if you don't get it, you're screwed. Which version of CentOS do you use? and which version of kolla? | 15:31 |
| Fl1nt | @kevko, I've got keepalive turned on but don't get this issue, what's your question? | 15:32 |
| Fl1nt | TBN, Openstack structure (MariaDB/Keepalived/RabbitMQ) is highly sensitive to the underlying network design and quality, so don't flip that part away, it's crucial. | 15:33 |
| *** happyhemant has quit IRC | 15:35 | |
| *** bengates has quit IRC | 15:35 | |
| *** bengates has joined #openstack-kolla | 15:36 | |
| *** bengates has quit IRC | 15:41 | |
| Chensa | Fl1nt CentOS 8.2 and the latest version of kolla, do you know which ansible role is responsible for ensuring kolla-toolbox exists? I couldn't find it.. | 15:41 |
| Fl1nt | kolla-toolbox have it's own role | 15:42 |
| Fl1nt | look at your kolla containers build, you may have a build issue if Kolla-toolbox isn't working properly | 15:42 |
| Chensa | where should i see the containers build? | 15:43 |
| Chensa | I know of a kolla-built util that is installed with kolla-ansible, is that the one? | 15:44 |
| Chensa | when running kolla-build --base centos this is the error that it reports :Errors during downloading metadata for repository 'AppStream': | 15:47 |
| *** ladrua has quit IRC | 15:48 | |
| Chensa | also, I tried deploying many times after running destroy --include-images and it is always reproduced so I think that it affects all centOS deployments | 15:49 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Add missing mistral services log files https://review.opendev.org/746411 | 15:54 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Add missing mistral services log files https://review.opendev.org/746410 | 15:54 |
| openstackgerrit | Merged openstack/kolla stable/train: Updated TGTD to N for centos8 https://review.opendev.org/746368 | 15:54 |
| openstackgerrit | Merged openstack/kolla stable/ussuri: Updated TGTD to N for centos8 https://review.opendev.org/746367 | 15:54 |
| kevko | Fl1nt: sorry, wasn't here ..but now I am ..can we disscuss littlebit ? | 15:55 |
| kevko | Fl1nt: i will explain | 15:55 |
| Fl1nt | sure go ahead | 15:55 |
| kevko | Fl1nt: well, firstly we have seen issue on NON-kolla-ansible based Openstack deployment , API endpoint hosted by Apache and mod-wsgi with keepalived turned on | 15:56 |
| kevko | Fl1nt: point is that openstack using python-requests and python-requests are using urllib3 for keepalive connection | 15:57 |
| *** priteau has quit IRC | 15:57 | |
| kevko | Fl1nt: issue started to appear when requests are going to use urrlib3 connection pool, start to send a data , but in this moment apache sent connection close ... | 15:58 |
| Fl1nt | hold on, are you talking about keepalived? | 15:58 |
| kevko | Fl1nt: yes :) | 15:58 |
| Fl1nt | ok, go ahead | 15:58 |
| *** skramaja has quit IRC | 15:59 | |
| kevko | Fl1nt: well, that's all, situation described above is ending by exception Remote Disconnect without response | 15:59 |
| *** zijlboot has quit IRC | 15:59 | |
| Fl1nt | ok, but what's the relationship between keepalived and apache/python ? | 15:59 |
| Fl1nt | keepalived is tighted to haproxy not apache | 16:00 |
| kevko | Fl1nt: As I noted above , firstly we've seen this issue on NON-kolla-ansible deployment ..so ..instead of haproxy we used to use apache2 | 16:01 |
| kevko | Fl1nt: that's the reason why I asked here in kolla community | 16:01 |
| kevko | Fl1nt: but technically it is issue about keepalive .. it doesn't matter what http server is used I mean | 16:02 |
| Fl1nt | hold on, there is something that I've a hard time to understand, you replaced haproxy by apache on your keepalived instance on a openstack deployment ? | 16:02 |
| Fl1nt | there is nothing related to keepalived in here, keepalived isn't based on python | 16:03 |
| kevko | Fl1nt: Not keepalived , http keep-alive | 16:03 |
| Fl1nt | I asked you about: "<Fl1nt> hold on, are you talking about keepalived?" | 16:03 |
| Fl1nt | you told me yes ^^ | 16:03 |
| kevko | Fl1nt: sorry for mystification | 16:04 |
| Fl1nt | no problems | 16:04 |
| kevko | Fl1nt: bad eyes :/ | 16:04 |
| Fl1nt | so | 16:04 |
| Fl1nt | apache mod_wsgi isn't managing http keep-alive requests correctly that's right? | 16:04 |
| kevko | Fl1nt: well, I can't say this , normally when you have keep-alive connection , you are communicating through this channel, or sending some data to have keep-alive connection opened ? correct ? | 16:05 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Standardize use and construction of endpoint URLs https://review.opendev.org/652157 | 16:06 |
| kevko | Fl1nt: if apache2 ( or whatever server you using) don't have any connection to channel in some specified timeout ( for apache it is 5 seconds) , server will close connection .. correct ? | 16:06 |
| Fl1nt | when using keepalive pulses, your service is just sending a packet that let the other side service to know that it shouldn't close the channel (TCP/Whatever) depending on your layer of implementation. | 16:06 |
| Fl1nt | it won't close the connection per see, it will put it in EMPTY_WAIT then WAIT_CLOSE then close it | 16:07 |
| kevko | Fl1nt: correct | 16:07 |
| kevko | Fl1nt: problem is that python-requests is going to use connection from connectionpool of urllib3 library, going to use this connection, but in same moment this connection expired and server correctly sent a close | 16:08 |
| *** gfidente has quit IRC | 16:08 | |
| Fl1nt | yeah, that can happen if people using urllib3 or requests don't use the stream=True argument to maintain the keepalive connection. | 16:09 |
| kevko | Fl1nt: I want to fix this .. so I created some bugs and pull request for urllib3 above .. | 16:09 |
| kevko | Fl1nt: https://github.com/urllib3/urllib3/pull/1911 | 16:10 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Add support to use bifrost-deploy behind proxy https://review.opendev.org/746557 | 16:10 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Add support to use bifrost-deploy behind proxy https://review.opendev.org/746558 | 16:10 |
| kevko | Fl1nt: in pull request is also referenced some other issues of other users .. | 16:10 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Add support to use bifrost-deploy behind proxy https://review.opendev.org/746559 | 16:10 |
| kevko | Fl1nt: test how to reproduce -> original reported bug by me -> https://bugs.python.org/issue41345 | 16:11 |
| Fl1nt | ok, this works: http://paste.openstack.org/show/796892/ | 16:13 |
| Fl1nt | it will fix your issue, and let you know why it's likely not an urllib3/requests related issue. | 16:13 |
| *** gfidente has joined #openstack-kolla | 16:13 | |
| kevko | Fl1nt: don't think so | 16:15 |
| Fl1nt | I think the main issue is the server closing the connection after you send requests but before responding. | 16:15 |
| kevko | Fl1nt: yeah, but in python http client library is this behaviour implemented .. | 16:15 |
| kevko | Fl1nt: urllib3 just not catching exception | 16:15 |
| kevko | Fl1nt: they implemented it in -> https://hg.python.org/cpython/rev/eba80326ba53 | 16:16 |
| *** Chensa has quit IRC | 16:16 | |
| Fl1nt | Yes, you're right, the issue seems to be the client not catching the aborted connection, and so exceptions not implemented correctly. | 16:17 |
| Fl1nt | meh, hold on, this revision is 5 years old @kevko | 16:18 |
| kevko | Fl1nt: yes ! and no reaction from urrlib3 :( | 16:19 |
| Fl1nt | you mean, they didn't implemented it yet? | 16:19 |
| kevko | Fl1nt: yes, check my pull request -> https://github.com/urllib3/urllib3/pull/1911/files | 16:20 |
| kevko | Fl1nt: i've tested , it is working ..instead of this weird exception after patch urrlib3 raise exception and requests raise exception max tries exceptions ( as requests has only 1) | 16:21 |
| Fl1nt | hum... it's weird as fuck, are you sure they didn't implemented it elsewhere ? | 16:21 |
| kevko | Fl1nt: yes, I'm sure | 16:21 |
| Fl1nt | Oo I'm kind of astonished that no one actually complained about that before. | 16:22 |
| kevko | Fl1nt: well, check google and try to find -> "remote closed connection without response" :D | 16:23 |
| kevko | Fl1nt: or better Remote end closed connection without response | 16:23 |
| Fl1nt | no, I mean, sure there is tons of Google pages about that, but I'm quite surprised that no one complained before in here because of services crashing on such issue. | 16:24 |
| kevko | Fl1nt: well, we also didn't have a problem with this, started to have problem with this if we trying to deploy quite big "deployments" of heat stacks ... | 16:25 |
| *** wuchunyang has quit IRC | 16:26 | |
| Fl1nt | ah ah ah yeah ok, see the issue. | 16:27 |
| *** gfidente has quit IRC | 16:28 | |
| Fl1nt | if it can help I've commented on your issue just to get some activities on it and maybe raise awarness to the urllib3 team. | 16:28 |
| kevko | Fl1nt: that will be nice from you, thank you ... I just wanted to ask you guys if you saw this issue before | 16:30 |
| Fl1nt | I may have seen it but it's been over a year that I don't use heat anymore ^^ | 16:30 |
| Fl1nt | so I can't remember ^^ | 16:31 |
| Fl1nt | but it's a pretty important issue as it would help to further strangthen Openstack services connectivity. | 16:32 |
| Fl1nt | strengthen actually ^^ | 16:32 |
| kevko | Fl1nt: agree | 16:36 |
| *** k_mouza has quit IRC | 16:37 | |
| *** brinzhang_ has joined #openstack-kolla | 16:38 | |
| *** brinzhang0 has quit IRC | 16:42 | |
| *** jonaspaulo has joined #openstack-kolla | 16:43 | |
| *** jopdorp has quit IRC | 16:52 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Add cinder auth config to nova-cell nova.conf.j2 https://review.opendev.org/746039 | 17:10 |
| *** kevko has quit IRC | 17:25 | |
| *** nikparasyr has left #openstack-kolla | 17:28 | |
| openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Standardize use and construction of endpoint URLs https://review.opendev.org/652157 | 17:28 |
| *** brinzhang0 has joined #openstack-kolla | 17:37 | |
| *** vishalmanchanda has quit IRC | 17:37 | |
| *** kevko has joined #openstack-kolla | 17:38 | |
| *** brinzhang_ has quit IRC | 17:40 | |
| openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Standardize use and construction of endpoint URLs https://review.opendev.org/652157 | 17:42 |
| *** wuchunyang has joined #openstack-kolla | 18:04 | |
| *** wuchunyang has quit IRC | 18:05 | |
| openstackgerrit | Bartosz Bezak proposed openstack/kayobe master: Make pip_index_url variable conditional https://review.opendev.org/746325 | 18:30 |
| *** e0ne has quit IRC | 18:48 | |
| *** kevko has quit IRC | 19:01 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Deploy neutron-mlnx-agent and neutron-eswitchd containers https://review.opendev.org/742627 | 19:02 |
| *** e0ne has joined #openstack-kolla | 19:03 | |
| *** e0ne has quit IRC | 19:03 | |
| *** jopdorp has joined #openstack-kolla | 19:08 | |
| *** jbadiapa has quit IRC | 19:21 | |
| *** e0ne has joined #openstack-kolla | 19:29 | |
| *** ladrua has joined #openstack-kolla | 19:56 | |
| *** cah_link has joined #openstack-kolla | 19:57 | |
| openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Fix ownership and permissions of admin-openrc.sh https://review.opendev.org/745071 | 20:31 |
| *** cah_link has quit IRC | 20:36 | |
| *** Fl1nt has quit IRC | 20:39 | |
| *** e0ne has quit IRC | 21:14 | |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting Ironic API https://review.opendev.org/746606 | 21:28 |
| *** e0ne has joined #openstack-kolla | 21:31 | |
| *** e0ne has quit IRC | 21:37 | |
| *** brinzhang_ has joined #openstack-kolla | 21:44 | |
| *** brinzhang0 has quit IRC | 21:47 | |
| *** jonaspaulo has quit IRC | 22:01 | |
| *** wuchunyang has joined #openstack-kolla | 22:06 | |
| *** wuchunyang has quit IRC | 22:07 | |
| *** also_stingrayza has joined #openstack-kolla | 22:07 | |
| *** mgoddard has quit IRC | 22:10 | |
| *** stingrayza has quit IRC | 22:11 | |
| *** mgoddard has joined #openstack-kolla | 22:18 | |
| *** born2bake has quit IRC | 22:18 | |
| openstackgerrit | Yaakov Selkowitz proposed openstack/kolla master: ironic-pxe: add syslinux-tftpboot on ppc64le https://review.opendev.org/746611 | 22:29 |
| openstackgerrit | Yaakov Selkowitz proposed openstack/kolla master: ironic-pxe: RHEL/CentOS: install AArch64 modules on all GRUB architectures https://review.opendev.org/746612 | 22:29 |
| *** brinzhang0 has joined #openstack-kolla | 23:09 | |
| *** brinzhang_ has quit IRC | 23:12 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!