| *** jistr has quit IRC | 00:07 | |
| *** jistr has joined #openstack-kolla | 00:08 | |
| *** ivve has quit IRC | 00:16 | |
| *** dpawlik has joined #openstack-kolla | 00:23 | |
| *** dpawlik has quit IRC | 00:28 | |
| *** xinliang has joined #openstack-kolla | 01:39 | |
| *** xinliang has quit IRC | 03:50 | |
| *** msalo has joined #openstack-kolla | 03:58 | |
| *** msalo has quit IRC | 04:02 | |
| *** negronjl has quit IRC | 04:17 | |
| *** negronjl has joined #openstack-kolla | 04:19 | |
| *** dpawlik has joined #openstack-kolla | 04:25 | |
| *** dpawlik has quit IRC | 04:29 | |
| *** igordc has quit IRC | 04:34 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 05:28 |
|---|---|---|
| *** msalo has joined #openstack-kolla | 05:35 | |
| osmanlicilegi | morning | 05:36 |
| *** msalo has quit IRC | 05:40 | |
| *** sri_ has joined #openstack-kolla | 05:44 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 05:56 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Build images with healthcheck scripts for core services https://review.opendev.org/676128 | 05:57 |
| *** zhanglong has joined #openstack-kolla | 06:22 | |
| *** dpawlik has joined #openstack-kolla | 06:26 | |
| *** dpawlik has quit IRC | 06:30 | |
| *** tonythomas has quit IRC | 06:37 | |
| *** msalo has joined #openstack-kolla | 06:43 | |
| *** msalo has quit IRC | 06:51 | |
| *** msalo has joined #openstack-kolla | 06:58 | |
| yoctozepto | morning | 06:58 |
| hrw | morning | 06:59 |
| hrw | osmanlicilegi: https://review.opendev.org/#/c/696182/ blocks your rmq transition. | 07:00 |
| patchbot | patch 696182 - tripleo-common - Update template overrides for rabbitmq - 4 patch sets | 07:00 |
| *** dpawlik has joined #openstack-kolla | 07:00 | |
| *** msalo has quit IRC | 07:03 | |
| osmanlicilegi | hrw: tripleo is not agile as kolla | 07:08 |
| hrw | osmanlicilegi: not surprised - your patch broke rdo-centos8 jobs | 07:09 |
| yoctozepto | osmanlicilegi: yeah, we are so scrum-ish and kanban-ish :p | 07:10 |
| yoctozepto | hrw: I am not sure how that was supposed to break their jobs | 07:12 |
| hrw | yoctozepto: not looked into failed ones | 07:12 |
| yoctozepto | I mean we just remove another possible entry | 07:12 |
| yoctozepto | maybe recheck | 07:12 |
| * hrw -> rebuilding libvirt 4.3.0 | 07:12 | |
| osmanlicilegi | imho, rhel8 jobs should be non-voting | 07:13 |
| yoctozepto | http://logs.rdoproject.org/82/696182/4/openstack-check/tripleo-rhel-8-buildimage-overcloud-full/b633ed1/logs/script_build-err.log | 07:14 |
| yoctozepto | pretty useless | 07:14 |
| yoctozepto | http://logs.rdoproject.org/82/696182/4/openstack-check/tripleo-rhel-8-buildimage-overcloud-full/b633ed1/overcloud-full.log | 07:14 |
| yoctozepto | 2019-11-29 08:34:31.248 | > Error: Unable to find a match: ndisc6 | 07:15 |
| yoctozepto | they b0rken | 07:15 |
| osmanlicilegi | :| | 07:16 |
| osmanlicilegi | openstack with tripleo is like a world without sun | 07:18 |
| osmanlicilegi | and I think we'll also need to get https://review.opendev.org/#/c/695847/ patched too | 07:19 |
| patchbot | patch 695847 - tripleo-common - Cleanup template overrides for rabbitmq - 8 patch sets | 07:19 |
| yoctozepto | osmanlicilegi: irrelevant | 07:20 |
| yoctozepto | they can remove more than necessary for the time being | 07:21 |
| mnasiadka | morning | 07:25 |
| mnasiadka | osmanlicilegi: I see you're also a tripleo fan? | 07:25 |
| osmanlicilegi | yoctozepto: for https://review.opendev.org/#/c/689870/ what you mean by "general json config customization"? is there an alternative for docker_config? | 07:26 |
| patchbot | patch 689870 - kolla-ansible - [docker] Added a new flag docker_disable_default_n... - 9 patch sets | 07:26 |
| osmanlicilegi | mnasiadka: so so. when I need some adventure in my life, I send patches to tripleo :] | 07:27 |
| mnasiadka | osmanlicilegi: You're the brave one I see... | 07:27 |
| mnasiadka | osmanlicilegi: I wouldn't touch tripleo even if somebody forced me to... | 07:28 |
| hrw | you complain about tripleo... but have you ever tried to debug devstack? | 07:29 |
| osmanlicilegi | why you need dev? I always work on production \m/ o_O \m/ | 07:31 |
| osmanlicilegi | oh, you're running prod with devstack? o_O | 07:32 |
| hrw | osmanlicilegi: expecting something from devstack? insane. | 07:32 |
| *** msalo has joined #openstack-kolla | 07:34 | |
| osmanlicilegi | it might be my next adventure, prod with devstack. better than powering off rack when you need to wake up. | 07:34 |
| yoctozepto | osmanlicilegi: more worrying is the backport to train :D | 07:38 |
| *** msalo has quit IRC | 07:38 | |
| mnasiadka | hrw: customers don't run devstack in production, and when you try to update two rpm packages in devstack you don't cause outage to a big telco provider :) | 07:39 |
| *** msalo has joined #openstack-kolla | 07:40 | |
| *** msalo has quit IRC | 07:41 | |
| *** msalo has joined #openstack-kolla | 07:44 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 07:44 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 07:47 |
| *** jbadiapa has joined #openstack-kolla | 07:48 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 07:49 |
| *** calbers has quit IRC | 07:50 | |
| *** Blinkiz9 has joined #openstack-kolla | 07:50 | |
| *** calbers has joined #openstack-kolla | 07:51 | |
| *** Blinkiz has quit IRC | 07:51 | |
| *** Blinkiz9 has quit IRC | 07:51 | |
| *** Blinkiz has joined #openstack-kolla | 07:52 | |
| *** Blinkiz has quit IRC | 07:53 | |
| *** Blinkiz has joined #openstack-kolla | 07:53 | |
| yoctozepto | mnasiadka: does devstack support multinode nowadays? | 07:59 |
| dirtwash | where do I find or edit something under kolla to adjust values in linuxbridge_agent.ini ? | 07:59 |
| mnasiadka | yoctozepto: just laughing :) | 07:59 |
| yoctozepto | mnasiadka: I know, was curious whether they started creating dev environs for more real-life scenarios than aio :-) | 08:00 |
| mnasiadka | yoctozepto: I think there is multinode devstack job... | 08:00 |
| yoctozepto | dirtwash: ml2_conf.ini pre-Ussuri, linuxbridge_agent.ini since Ussuri | 08:00 |
| yoctozepto | in the usual /etc/kolla/config/neutron/... | 08:01 |
| dirtwash | there's no config dir | 08:01 |
| mnasiadka | you need to create it | 08:01 |
| dirtwash | do I gotta download some templates from git or where do I evne get the configs from | 08:01 |
| mnasiadka | this is not tripleo, you don't need to download templates :) | 08:01 |
| mnasiadka | dirtwash: https://docs.openstack.org/kolla-ansible/latest/admin/advanced-configuration.html#openstack-service-configuration-in-kolla | 08:02 |
| dirtwash | i'll try | 08:03 |
| dirtwash | openstack docs lack kolla information and kolla docs lack depth of openstack docs | 08:04 |
| dirtwash | too much information spread apart, hard to find 'the next step' | 08:04 |
| *** msalo has quit IRC | 08:04 | |
| dirtwash | (item=01-syslog) => {"ansible_loop_var": "item", "changed": false, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: 'ansible.vars.hostvars.HostVarsVars object' has no attribute u'ansible_priv'"} | 08:06 |
| dirtwash | somehow I always end up with this fluentd syslog related error | 08:06 |
| dirtwash | not even sure how to debug this | 08:07 |
| yoctozepto | dirtwash: weird error, what version is that? | 08:10 |
| dirtwash | ansible version? | 08:11 |
| hrw | bug to solve today: libvirtError: internal error: Socket 4096 can't be handled (max socket is 4095) | 08:11 |
| hrw | Error polling connection 'qemu:///system': internal error: Socket 5418 can't be handled (max socket is 4095) | 08:11 |
| dirtwash | yoctozepto: 2.5.1 | 08:11 |
| yoctozepto | dirtwash: kolla-ansible :-) | 08:11 |
| yoctozepto | hrw: already assuming it's going to take all the day? :-) | 08:12 |
| hrw | yoctozepto: ba! | 08:12 |
| yoctozepto | hrw: is it from a rebuilt libvirt/qemu? | 08:12 |
| dirtwash | is there a version flag for kolla to figure it out or something | 08:12 |
| dirtwash | collegue set it up | 08:12 |
| dirtwash | dont see one in help | 08:13 |
| mnasiadka | pip freeze | grep kolla | 08:14 |
| dirtwash | ah kolla-ansible 8.0.1 | 08:14 |
| dirtwash | didnt know its pip install | 08:14 |
| mnasiadka | so it's stein | 08:15 |
| yoctozepto | mnasiadka: Sherlock Holmes! | 08:16 |
| dirtwash | I adjust the custom config line in globalas and added the 2 files I need for provider network, that's all I changed | 08:16 |
| dirtwash | not sure how it relates to fluentd | 08:16 |
| yoctozepto | dirtwash: no idea really, we don't have ansible_priv being used, whatever that would be | 08:16 |
| openstackgerrit | Hamdy Khader proposed openstack/kolla master: Add Networking-MLNX to Neutron-Base packages https://review.opendev.org/689110 | 08:16 |
| mnasiadka | yoctozepto: shhh, Dr Watson | 08:17 |
| yoctozepto | mnasiadka: ;D | 08:17 |
| dirtwash | yoctozepto: priv is the interfacename I defined | 08:17 |
| *** tonythomas has joined #openstack-kolla | 08:17 | |
| yoctozepto | dirtwash: does this interface exist? | 08:17 |
| dirtwash | yea | 08:17 |
| yoctozepto | on the target machine | 08:17 |
| dirtwash | its in use | 08:17 |
| yoctozepto | then no idea, it says it does not exist so | 08:18 |
| dirtwash | defined in linuxbridge_agent.ini if it matters, but yea its the LAN interface | 08:18 |
| dirtwash | well but it does because thats how kolla connects to the nodes..otherwise whole deployment wouldnt have worked, its also defined as network_interface for Neutron | 08:18 |
| dirtwash | and that worked fine | 08:19 |
| mnasiadka | well, the line that probably causes that is https://github.com/openstack/kolla-ansible/blob/f743810543a5edb738f07de2d91614a4617268ed/ansible/roles/common/templates/conf/input/01-syslog.conf.j2#L4 | 08:21 |
| mnasiadka | so it can't resolve {{ api_interface_address }} | 08:21 |
| yoctozepto | dirtwash: but is it there on the *target* nodes, the deployment node is irrelevant unless it's your only target | 08:21 |
| mnasiadka | but then everything else fails :) | 08:21 |
| yoctozepto | if you deploy from A | 08:22 |
| yoctozepto | and have B, C, D in inventory | 08:22 |
| *** skramaja has joined #openstack-kolla | 08:22 | |
| dirtwash | yoctozepto: yea thats what I just said, its the default interface on all 3 nodes (test setup) | 08:22 |
| yoctozepto | then you should ensure B, C, D have this interface instead of A | 08:22 |
| dirtwash | what ya mean instead of A | 08:23 |
| dirtwash | there's only 3 nodes, deployment node is not part of the setup after all | 08:23 |
| yoctozepto | dirtwash: that's fine | 08:23 |
| mnasiadka | and the priv interface is available on those three nodes? or on the deployment node? | 08:23 |
| yoctozepto | but the error means there is no such interface named 'priv' on at least one of those nodes | 08:24 |
| dirtwash | its the default interface so yes it is..oterhwise I wouldnt have an existing openstack setup | 08:24 |
| dirtwash | priv=default LAN interface | 08:24 |
| dirtwash | thats how kolla connects to the nodes | 08:24 |
| yoctozepto | dirtwash: there is no such thing as a default interface :-) | 08:24 |
| dirtwash | thats how it all communicates with each other | 08:24 |
| mnasiadka | dirtwash: well, something is wrong with that interface now - because your kolla-ansible run fails at common role (fluentd) | 08:24 |
| dirtwash | yoctozepto: the network_interface in globals | 08:24 |
| mnasiadka | dirtwash: and if it fails there, it won't continue at all. | 08:25 |
| mnasiadka | (or at least shouldn't) | 08:25 |
| dirtwash | neutron networking options: network_interface: "priv" | 08:25 |
| dirtwash | worked fine so far | 08:25 |
| yoctozepto | dirtwash: it's not which kolla will use to connect | 08:25 |
| mnasiadka | dirtwash: do you have that error for all 3 nodes? or just one? | 08:25 |
| yoctozepto | but which kolla will use to setup targets to offer their api services | 08:25 |
| dirtwash | oh its localhost, im confused | 08:26 |
| dirtwash | why would it want that interface | 08:26 |
| yoctozepto | dirtwash: are you using the proper inventory? :D | 08:26 |
| dirtwash | apparently not | 08:27 |
| dirtwash | how do I run reconfigure with multinode file | 08:27 |
| dirtwash | ah now | 08:27 |
| * dirtwash facepalms | 08:27 | |
| dirtwash | curious is that an ansible thing that you sometimes can not use -i | 08:28 |
| dirtwash | *dont have to | 08:28 |
| dirtwash | well thanks for the help, lets see how far I get | 08:28 |
| dirtwash | I hope reconfigure is approbiate if I wanted it to change the neutron configs? | 08:29 |
| *** msalo has joined #openstack-kolla | 08:29 | |
| mnasiadka | yoctozepto: is there something I start looking into to help with releasing k-a Train? | 08:30 |
| yoctozepto | mnasiadka: ones I marked with RP+1 atm | 08:30 |
| yoctozepto | dirtwash: yeah, reconfigure is just right | 08:31 |
| yoctozepto | deploy would work as nice too, just rechecking some bootstraps more | 08:31 |
| mnasiadka | yoctozepto: any other bugs not covered by some patches? | 08:31 |
| yoctozepto | mnasiadka: I have coordination W-1 and plan to fix it today, otherwise it's all in launchpad | 08:31 |
| yoctozepto | kolla waits for rmq | 08:32 |
| yoctozepto | so tripleo | 08:32 |
| *** msalo has quit IRC | 08:36 | |
| mnasiadka | yoctozepto: so you say I can focus on reviewing changes and working on ceph-ansible CI, OVN and Docker healthchecks for Ussuri? ;) | 08:36 |
| yoctozepto | mnasiadka: https://bugs.launchpad.net/kolla-ansible/+bug/1847050 awaits | 08:37 |
| openstack | Launchpad bug 1847050 in kolla-ansible "CI: masakari-instancemonitor reports an error" [Medium,Triaged] - Assigned to Gaëtan Trellu (goldyfruit) | 08:37 |
| * mnasiadka no masakari | 08:38 | |
| mnasiadka | ;) | 08:38 |
| * yoctozepto no hate no drama | 08:38 | |
| yoctozepto | ;D | 08:38 |
| mnasiadka | this project name always resembles me of some massacre | 08:38 |
| yoctozepto | masakra i... | 08:38 |
| mnasiadka | taa | 08:38 |
| mnasiadka | :) | 08:38 |
| yoctozepto | jeszcze masarnia | 08:38 |
| yoctozepto | https://mistrzowie.org/714581 | 08:39 |
| *** mrunge_ is now known as mrunge | 08:41 | |
| *** rpittau|afk is now known as rpittau | 08:43 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 08:44 |
| yoctozepto | mnasiadka: how are your new changes going? | 08:46 |
| mnasiadka | yoctozepto: slowly, Docker healthchecks for core services should be ok to review soon, OVN - I got a bit sidetracked by RDO because they bumped OVS/OVN to 2.12 in Train/master, so OVN changed paths :D | 08:47 |
| yoctozepto | mnasiadka: ah, that soap opera | 08:48 |
| mnasiadka | yoctozepto: and trying to adapt the ceph-ansible CI so everything is in tests/* | 08:48 |
| yoctozepto | all righty | 08:48 |
| *** ivve has joined #openstack-kolla | 08:51 | |
| yoctozepto | osmanlicilegi: I missed your question | 08:53 |
| yoctozepto | the answer is a question: is not it enough to use the json docker config override? | 08:53 |
| yoctozepto | the docker_config variable I presume | 08:53 |
| yoctozepto | sorry, docker_custom_config | 08:54 |
| yoctozepto | we might want to better document it instead | 08:55 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 08:57 |
| *** msalo has joined #openstack-kolla | 09:03 | |
| *** dougsz has joined #openstack-kolla | 09:03 | |
| *** gfidente has joined #openstack-kolla | 09:04 | |
| osmanlicilegi | yoctozepto: got it. will give it a try | 09:05 |
| mnasiadka | yoctozepto, hrw: https://review.opendev.org/#/c/694453/ - can you look into that? I guess now OVN is broken in stable/train if anybody is using those images | 09:18 |
| patchbot | patch 694453 - kolla (stable/train) - Use ovn-ctl script to start OVN ovsdb-servers - 1 patch set | 09:18 |
| *** dpawlik has quit IRC | 09:34 | |
| hrw | omg... looks like rocky patches will flow... | 09:34 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 09:38 |
| *** dasp has quit IRC | 09:42 | |
| *** dasp has joined #openstack-kolla | 09:43 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/rocky: base/debian: install udev/systemd from backports https://review.opendev.org/697041 | 09:53 |
| hrw | please review | 09:54 |
| *** k_mouza has joined #openstack-kolla | 09:58 | |
| *** msalo has quit IRC | 10:00 | |
| *** msalo has joined #openstack-kolla | 10:01 | |
| *** dpawlik has joined #openstack-kolla | 10:02 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 10:04 |
| *** dpawlik has quit IRC | 10:07 | |
| *** pcaruana has joined #openstack-kolla | 10:08 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 10:10 |
| yoctozepto | mnasiadka: done | 10:13 |
| yoctozepto | hrw: done | 10:15 |
| *** msalo has quit IRC | 10:16 | |
| hrw | so far no other rocky changes ;D | 10:20 |
| openstackgerrit | Merged openstack/kolla-ansible master: [Train] Fix Tacker config for the local Glance store https://review.opendev.org/695804 | 10:21 |
| openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Use <project>_install_type instead of kolla_install_type https://review.opendev.org/696876 | 10:21 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: [Train] Fix Tacker config for the local Glance store https://review.opendev.org/697048 | 10:22 |
| yoctozepto | mnasiadka: https://review.opendev.org/697048 bp | 10:22 |
| patchbot | patch 697048 - kolla-ansible (stable/train) - [Train] Fix Tacker config for the local Glance store - 1 patch set | 10:22 |
| *** msalo has joined #openstack-kolla | 10:23 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 10:26 |
| *** dpawlik has joined #openstack-kolla | 10:29 | |
| *** dmellado has quit IRC | 10:33 | |
| *** dmellado has joined #openstack-kolla | 10:35 | |
| *** dpawlik has quit IRC | 10:46 | |
| *** hjensas has quit IRC | 10:54 | |
| *** rgogunskiy has joined #openstack-kolla | 10:58 | |
| *** hjensas has joined #openstack-kolla | 10:59 | |
| *** zhanglong has quit IRC | 10:59 | |
| *** hjensas has quit IRC | 11:01 | |
| *** dpawlik has joined #openstack-kolla | 11:02 | |
| *** dpawlik has quit IRC | 11:06 | |
| *** dpawlik has joined #openstack-kolla | 11:10 | |
| *** rpittau is now known as rpittau|bbl | 11:18 | |
| *** hjensas has joined #openstack-kolla | 11:19 | |
| *** msalo_ has joined #openstack-kolla | 11:24 | |
| *** msalo__ has joined #openstack-kolla | 11:25 | |
| *** msalo has quit IRC | 11:25 | |
| *** msalo has joined #openstack-kolla | 11:26 | |
| *** msalo_ has quit IRC | 11:29 | |
| *** msalo__ has quit IRC | 11:29 | |
| *** dpawlik has quit IRC | 11:32 | |
| *** dpawlik has joined #openstack-kolla | 11:36 | |
| *** msalo_ has joined #openstack-kolla | 11:42 | |
| *** msalo_ has quit IRC | 11:44 | |
| *** jbadiapa has quit IRC | 11:44 | |
| *** msalo_ has joined #openstack-kolla | 11:45 | |
| *** msalo has quit IRC | 11:46 | |
| *** zbr_ has quit IRC | 11:55 | |
| *** zbr has joined #openstack-kolla | 11:57 | |
| *** msalo_ has quit IRC | 12:06 | |
| *** msalo has joined #openstack-kolla | 12:06 | |
| *** kplant has joined #openstack-kolla | 12:16 | |
| *** msalo has quit IRC | 12:24 | |
| *** kplant has quit IRC | 12:32 | |
| *** kplant has joined #openstack-kolla | 12:32 | |
| mnasiadka | yoctozepto: any idea why the ceph jobs in this change always fail with keystone 500? https://zuul.opendev.org/t/openstack/build/538cfdbceca44f62b8f538b41cb6c0c5/log/primary/logs/ansible/deploy#136680 | 12:32 |
| *** msalo has joined #openstack-kolla | 12:33 | |
| mnasiadka | hmm, at least healthcheck shows it right - it's unhealthy :) | 12:34 |
| mnasiadka | https://zuul.opendev.org/t/openstack/build/538cfdbceca44f62b8f538b41cb6c0c5/log/primary/logs/system_logs/docker-info.txt.gz#204 | 12:34 |
| mnasiadka | although there's one healthy on secondary2, why haproxy doesn't exclude the other two from the backend... hmm | 12:35 |
| *** msalo has quit IRC | 12:38 | |
| *** chrizl has joined #openstack-kolla | 12:43 | |
| yoctozepto | mnasiadka: load? no idea really | 12:47 |
| yoctozepto | it's just coming back again and again | 12:48 |
| mnasiadka | hmm, we're not copying the httpd/apache2 logs at all, only the wsgi ones | 12:48 |
| yoctozepto | most likely keystone because it is ubiquitous | 12:48 |
| yoctozepto | every other service uses it and even periodically | 12:49 |
| *** msalo has joined #openstack-kolla | 12:49 | |
| mnasiadka | yoctozepto: we could at least use http protocol instead of tcp :D | 12:50 |
| mnasiadka | (in haproxy) | 12:51 |
| yoctozepto | mnasiadka: don't we? | 12:51 |
| *** msalo has quit IRC | 12:54 | |
| *** msalo has joined #openstack-kolla | 12:55 | |
| mnasiadka | yoctozepto: well, in theory it's http, but it;s weird - if keystone gives 500 even to a simple curl - it should be removed from the pool, right? | 12:55 |
| yoctozepto | mnasiadka: if you run http checks | 12:56 |
| yoctozepto | we probably don't | 12:56 |
| yoctozepto | but does it anyhow? | 12:56 |
| yoctozepto | I think it probably does nice for / but not for something else | 12:56 |
| mnasiadka | yoctozepto: https://zuul.opendev.org/t/openstack/build/538cfdbceca44f62b8f538b41cb6c0c5/log/primary/logs/system_logs/docker-info.txt.gz#8530 | 12:57 |
| mnasiadka | response for simple curl http://api_interface_address:keystone_port | 12:58 |
| mnasiadka | :) | 12:58 |
| yoctozepto | return: can only `return' from a function or sourced script woot | 12:58 |
| yoctozepto | mnasiadka: weird indeed | 12:58 |
| yoctozepto | then what's wrong with that keystone | 12:58 |
| mnasiadka | that's why I would like to see the main httpd logs | 12:59 |
| mnasiadka | let me fire off a change... | 12:59 |
| yoctozepto | mnasiadka: you have them, no? | 13:03 |
| mnasiadka | yoctozepto: only the wsgi ones, the rest we dump in /var/log/apache2 and forget | 13:03 |
| yoctozepto | hmm | 13:03 |
| mnasiadka | well, VirtualHost ones | 13:03 |
| yoctozepto | I think I saw access logs | 13:04 |
| yoctozepto | maybe not for keystone... | 13:04 |
| yoctozepto | https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_538/676389/39/check/kolla-ansible-ubuntu-source-ceph/538cfdb/primary/logs/kolla/keystone/keystone-apache-public-error.txt.gz | 13:05 |
| yoctozepto | 2019-12-03 08:54:11.518017 oslo_config.cfg.ArgsAlreadyParsedError: arguments already parsed: cannot register CLI option | 13:05 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 13:05 |
| mnasiadka | yoctozepto: yep, these are per virtualhost logs, but not the ,,global'' ones for apache | 13:07 |
| mnasiadka | probably they won't add a lot, but still I don't like we miss them | 13:07 |
| yoctozepto | mnasiadka: ah, right, I missed that | 13:07 |
| *** msalo has quit IRC | 13:11 | |
| *** dasp has quit IRC | 13:12 | |
| *** dasp has joined #openstack-kolla | 13:12 | |
| *** ktibi has joined #openstack-kolla | 13:12 | |
| *** msalo has joined #openstack-kolla | 13:20 | |
| *** schwicht has joined #openstack-kolla | 13:24 | |
| *** skramaja is now known as skramaja|afk | 13:24 | |
| *** msalo has quit IRC | 13:24 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Set Apache to log to /var/log/kolla https://review.opendev.org/697087 | 13:28 |
| *** msalo has joined #openstack-kolla | 13:29 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Install etcd3gw to fix Ubuntu binary tooz coordination https://review.opendev.org/697088 | 13:29 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 13:38 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Default to etcd3gw driver for etcd-based coordination https://review.opendev.org/694476 | 13:45 |
| *** rpittau|bbl is now known as rpittau | 13:46 | |
| *** schwicht has quit IRC | 13:49 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Test Zun with Cinder LVM backend (iSCSI) https://review.opendev.org/689660 | 13:49 |
| *** Tengu is now known as SchroedinTengu | 14:02 | |
| *** schwicht has joined #openstack-kolla | 14:09 | |
| stingrayza | hey folks o/ | 14:15 |
| *** vmixor has joined #openstack-kolla | 14:17 | |
| *** SchroedinTengu is now known as Tengu | 14:18 | |
| *** Statscowski has joined #openstack-kolla | 14:23 | |
| Statscowski | hi! we created an lets encrypt certificate and wrote its path into "kolla_internal_fqdn_cert". However, kolla-ansible failes to deploy with "Failed to validate the SSL certificate for 212.63.156.10:9200. Make sure your managed systems have a valid CA certificate installed. You can use validate_certs=False if you do n | 14:26 |
| Statscowski | is unsafe and not recommended. Paths checked for this platform: /etc/ssl/certs, /etc/pki/ca-trust/extracted/pem, /etc/pki/tls/certs, /usr/share/ca-certificates/cacert.org, /etc/ansible." anyone got an idea why? | 14:26 |
| *** sri_ has quit IRC | 14:30 | |
| *** pcaruana has quit IRC | 14:33 | |
| *** munimeha1 has joined #openstack-kolla | 14:53 | |
| *** skramaja|afk has quit IRC | 14:53 | |
| *** igordc has joined #openstack-kolla | 14:57 | |
| openstackgerrit | Merged openstack/kolla stable/train: Use ovn-ctl script to start OVN ovsdb-servers https://review.opendev.org/694453 | 15:00 |
| *** pcaruana has joined #openstack-kolla | 15:04 | |
| *** ktibi has quit IRC | 15:12 | |
| *** rgogunskiy has quit IRC | 15:12 | |
| *** igordc has quit IRC | 15:17 | |
| *** igordc has joined #openstack-kolla | 15:25 | |
| *** igordc has quit IRC | 15:30 | |
| *** msalo has quit IRC | 15:41 | |
| generalfuzz | Statscowski: where does deployment fail? | 15:42 |
| Statscowski | generalfuzz: hello. it failes at KibanaTASK [kibana : Wait for kibana to register in elasticsearch] ******************************************************************************************************************************** | 15:49 |
| Statscowski | FAILED - RETRYING: Wait for kibana to register in elasticsearch (20 retries left). It then failes with failed to validate the ssl certificate | 15:49 |
| *** msalo has joined #openstack-kolla | 15:56 | |
| Statscowski | same thing happens with self signed certificate (generated with kolla-ansible certificates), btw | 16:01 |
| *** ivve has quit IRC | 16:15 | |
| *** msalo has quit IRC | 16:19 | |
| *** dave-mccowan has joined #openstack-kolla | 16:19 | |
| *** dpawlik has quit IRC | 16:27 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/rocky: build: remove link to failed log before creating https://review.opendev.org/697131 | 16:35 |
| *** chrizl has quit IRC | 16:37 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/rocky: debian: install more things from backports https://review.opendev.org/697041 | 16:41 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 16:46 |
| *** hamzy has quit IRC | 16:53 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Test Senlin https://review.opendev.org/697136 | 16:55 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Test Senlin https://review.opendev.org/697136 | 16:56 |
| yoctozepto | mnasiadka: let it test :-) ^ | 16:57 |
| mnasiadka | nice | 16:57 |
| yoctozepto | mnasiadka: the downside is all new tests conflict with each other | 16:57 |
| mnasiadka | conflict? :) | 16:58 |
| yoctozepto | so it's a pita to merge them all | 16:58 |
| yoctozepto | mnasiadka: git-wise | 16:58 |
| yoctozepto | as you modify the same files | 16:58 |
| mnasiadka | yeah, true | 16:58 |
| *** jschlueter has quit IRC | 17:05 | |
| *** jschlueter has joined #openstack-kolla | 17:06 | |
| *** rpittau is now known as rpittau|afk | 17:12 | |
| *** gfidente is now known as gfidente|afk | 17:26 | |
| *** jonaspaulo has joined #openstack-kolla | 17:38 | |
| *** rgogunskiy has joined #openstack-kolla | 17:55 | |
| *** rgogunskiy has quit IRC | 17:59 | |
| *** k_mouza has quit IRC | 18:00 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Set Apache to log to /var/log/kolla https://review.opendev.org/697087 | 18:02 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Set Apache to log to /var/log/kolla https://review.opendev.org/697087 | 18:07 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 18:10 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: ovn-base: Create /run/ovn in extend_start.sh https://review.opendev.org/697148 | 18:15 |
| *** igordc has joined #openstack-kolla | 18:15 | |
| *** k_mouza has joined #openstack-kolla | 18:30 | |
| *** k_mouza has quit IRC | 18:36 | |
| *** tonythomas has quit IRC | 18:50 | |
| openstackgerrit | Viktor Michalek proposed openstack/kolla master: Vitrage: build images for Debian https://review.opendev.org/695931 | 18:54 |
| *** k_mouza has joined #openstack-kolla | 18:56 | |
| *** hamzy has joined #openstack-kolla | 18:59 | |
| *** gmann is now known as gmann_afk | 19:00 | |
| *** hjensas has quit IRC | 19:08 | |
| *** ivve has joined #openstack-kolla | 19:28 | |
| *** dpawlik has joined #openstack-kolla | 19:37 | |
| *** dpawlik has quit IRC | 19:42 | |
| *** msalo has joined #openstack-kolla | 19:43 | |
| *** msalo has quit IRC | 19:46 | |
| *** oncall-pokemon has joined #openstack-kolla | 19:48 | |
| *** iniazi_ has joined #openstack-kolla | 19:53 | |
| *** iniazi has quit IRC | 19:57 | |
| *** msalo has joined #openstack-kolla | 20:16 | |
| *** msalo has quit IRC | 20:19 | |
| *** msalo has joined #openstack-kolla | 20:20 | |
| oncall-pokemon | Hi, I'm getting the folloing error doing kolla-ansible deploy https://pastebin.com/KSDFj7Ed | 20:24 |
| oncall-pokemon | does anybody have an ideas? | 20:24 |
| *** gmann_afk is now known as gmann | 20:25 | |
| rouk | oncall-pokemon: whats your inventory? looks like a busted inventory/missing groups | 20:30 |
| oncall-pokemon | i can double check that. | 20:31 |
| oncall-pokemon | also is there a sample inventory/globals that's just openstack-core? this seems like so many features | 20:31 |
| kplant | yeah k/k-a support a lot of features | 20:33 |
| kplant | honestly if you follow the quickstart, it _will_ work | 20:33 |
| kplant | it's one of the few quickstarts that actually work | 20:33 |
| rouk | id work from the provider inventory and globals | 20:34 |
| rouk | most of the weird stuff is off by default, even if its mentioned in inventory, and yes, quickstart good | 20:34 |
| oncall-pokemon | thanks | 20:35 |
| *** vesper11 has quit IRC | 20:49 | |
| *** vesper11 has joined #openstack-kolla | 20:51 | |
| *** dougsz has quit IRC | 20:52 | |
| openstackgerrit | Merged openstack/kolla master: Added senlin-conductor and senlin-health-manager https://review.opendev.org/692948 | 20:52 |
| kplant | exit | 20:58 |
| *** kplant has quit IRC | 20:58 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/rocky: debian: install more things from backports https://review.opendev.org/697041 | 21:46 |
| *** rgogunskiy has joined #openstack-kolla | 21:55 | |
| *** rgogunskiy has quit IRC | 22:00 | |
| *** hjensas has joined #openstack-kolla | 22:03 | |
| *** pcaruana has quit IRC | 22:06 | |
| *** msalo has quit IRC | 22:13 | |
| *** msalo has joined #openstack-kolla | 22:13 | |
| *** msalo has quit IRC | 22:20 | |
| *** munimeha1 has quit IRC | 22:43 | |
| *** vmixor has quit IRC | 22:47 | |
| *** msalo has joined #openstack-kolla | 22:54 | |
| *** k_mouza has quit IRC | 23:01 | |
| *** hamzy has quit IRC | 23:06 | |
| *** jonaspaulo has quit IRC | 23:10 | |
| *** hjensas has quit IRC | 23:13 | |
| *** hjensas has joined #openstack-kolla | 23:15 | |
| *** k_mouza has joined #openstack-kolla | 23:23 | |
| *** k_mouza has quit IRC | 23:23 | |
| *** msalo has quit IRC | 23:30 | |
| *** msalo has joined #openstack-kolla | 23:35 | |
| *** dpawlik has joined #openstack-kolla | 23:39 | |
| *** msalo has quit IRC | 23:40 | |
| *** dpawlik has quit IRC | 23:43 | |
| *** calbers has quit IRC | 23:44 | |
| *** ivve has quit IRC | 23:47 | |
| *** calbers has joined #openstack-kolla | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!