| *** BjoernT has quit IRC | 00:02 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/stein: Add retry for backup get_url task https://review.opendev.org/658683 | 00:23 |
|---|---|---|
| *** gyee has quit IRC | 00:36 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create stable/stein: Drop Suse 42.3 support https://review.opendev.org/658687 | 00:59 |
| *** d34dh0r53 has joined #openstack-ansible | 01:00 | |
| openstackgerrit | Xuan Yandong proposed openstack/ansible-config_template master: Change the author-email openstack-dev to openstack-discuss https://review.opendev.org/659402 | 01:19 |
| *** partlycloudy has joined #openstack-ansible | 01:36 | |
| *** nicolasbock has quit IRC | 01:36 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/stein: Remove keystone directory on source installs https://review.opendev.org/658377 | 01:37 |
| *** gshippey has quit IRC | 01:38 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Add integrated coverage https://review.opendev.org/658396 | 01:47 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Clarify supported SUSE versions https://review.opendev.org/659018 | 01:47 |
| *** BjoernT has joined #openstack-ansible | 02:00 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Add /v2 to mistral api endpoint. https://review.opendev.org/659276 | 02:11 |
| *** BjoernT has quit IRC | 02:17 | |
| *** BjoernT has joined #openstack-ansible | 02:20 | |
| *** dhellmann has quit IRC | 02:23 | |
| *** dhellmann has joined #openstack-ansible | 02:23 | |
| *** BjoernT has quit IRC | 02:35 | |
| *** fnpanic has quit IRC | 02:37 | |
| *** kplant has quit IRC | 02:42 | |
| *** oyrogerg has joined #openstack-ansible | 03:06 | |
| *** joshualyle has quit IRC | 03:06 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Document bootstrap host failure on leap 15 https://review.opendev.org/659229 | 03:08 |
| openstackgerrit | Merged openstack/openstack-ansible master: Bump nova pin after placement removal https://review.opendev.org/658208 | 03:08 |
| openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible-os_neutron master: Update neutron_bgp_speaker_driver https://review.opendev.org/659428 | 03:39 |
| openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible-os_neutron master: Update neutron_bgp_speaker_driver https://review.opendev.org/659428 | 03:41 |
| *** radeks_ has joined #openstack-ansible | 03:50 | |
| *** udesale has joined #openstack-ansible | 03:53 | |
| *** oyrogerg has quit IRC | 04:12 | |
| *** oyrogerg has joined #openstack-ansible | 04:17 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Fix systemd-journal-remote socket dependency https://review.opendev.org/659433 | 04:22 |
| *** radeks_ has quit IRC | 04:40 | |
| *** oyrogerg has quit IRC | 04:44 | |
| *** oyrogerg has joined #openstack-ansible | 04:50 | |
| *** _d34dh0r53_ has joined #openstack-ansible | 04:55 | |
| *** jsquare has quit IRC | 05:06 | |
| *** jsquare has joined #openstack-ansible | 05:07 | |
| *** _d34dh0r53_ has quit IRC | 05:08 | |
| *** shyamb has joined #openstack-ansible | 05:08 | |
| *** cloudkiller has joined #openstack-ansible | 05:11 | |
| *** _d34dh0r53_ has joined #openstack-ansible | 05:11 | |
| *** shyamb has quit IRC | 05:35 | |
| *** shyamb has joined #openstack-ansible | 05:41 | |
| *** ivve has quit IRC | 05:41 | |
| *** hamzy has quit IRC | 05:44 | |
| *** gkadam has quit IRC | 05:49 | |
| *** jbadiapa has joined #openstack-ansible | 05:49 | |
| *** gkadam has joined #openstack-ansible | 05:51 | |
| *** radeks_ has joined #openstack-ansible | 06:03 | |
| *** radeks_ has quit IRC | 06:04 | |
| *** radeks_ has joined #openstack-ansible | 06:04 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-os_barbican master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659444 | 06:05 |
| *** udesale has quit IRC | 06:05 | |
| *** udesale has joined #openstack-ansible | 06:06 | |
| *** shyam89 has joined #openstack-ansible | 06:07 | |
| *** shyamb has quit IRC | 06:07 | |
| *** oyrogerg has quit IRC | 06:16 | |
| *** hamzy has joined #openstack-ansible | 06:21 | |
| *** cshen has joined #openstack-ansible | 06:24 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-lxc_hosts master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659447 | 06:28 |
| *** shyam89 has quit IRC | 06:29 | |
| *** pmannidi has joined #openstack-ansible | 06:34 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/658731 | 06:36 |
| *** shyamb has joined #openstack-ansible | 06:40 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-os_keystone master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659450 | 06:42 |
| *** udesale has quit IRC | 06:51 | |
| *** udesale has joined #openstack-ansible | 06:52 | |
| *** ivve has joined #openstack-ansible | 06:58 | |
| *** arbrandes has quit IRC | 07:00 | |
| *** arbrandes has joined #openstack-ansible | 07:01 | |
| *** udesale has quit IRC | 07:02 | |
| *** starborn has joined #openstack-ansible | 07:03 | |
| *** openstackgerrit has quit IRC | 07:03 | |
| *** udesale has joined #openstack-ansible | 07:03 | |
| *** pcaruana has joined #openstack-ansible | 07:13 | |
| *** L_SR has joined #openstack-ansible | 07:17 | |
| *** kopecmartin|off is now known as kopecmartin | 07:18 | |
| *** openstackgerrit has joined #openstack-ansible | 07:19 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-os_nova master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659468 | 07:19 |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-galera_client master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659471 | 07:24 |
| *** udesale has quit IRC | 07:36 | |
| *** itandops has quit IRC | 07:37 | |
| *** udesale has joined #openstack-ansible | 07:37 | |
| *** aedc has joined #openstack-ansible | 07:40 | |
| *** tosky has joined #openstack-ansible | 07:48 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-os_aodh master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659481 | 07:51 |
| *** CeeMac has joined #openstack-ansible | 07:52 | |
| *** gkadam has quit IRC | 07:55 | |
| *** shyamb has quit IRC | 08:01 | |
| *** fnpanic has joined #openstack-ansible | 08:04 | |
| fnpanic | good morning | 08:05 |
| fnpanic | ceemac: around? | 08:10 |
| fnpanic | oonedeadpunk: ping | 08:10 |
| *** aedc has quit IRC | 08:10 | |
| *** DanyC has joined #openstack-ansible | 08:12 | |
| *** DanyC has quit IRC | 08:12 | |
| *** DanyC has joined #openstack-ansible | 08:13 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-openstack_hosts master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659491 | 08:19 |
| *** DanyC has quit IRC | 08:19 | |
| CeeMac | morning fnpanic | 08:21 |
| CeeMac | hows it going? | 08:22 |
| *** miloa has joined #openstack-ansible | 08:24 | |
| miloa | Morning | 08:24 |
| *** starborn has quit IRC | 08:29 | |
| openstackgerrit | zhangboye proposed openstack/openstack-ansible-galera_server master: Cap sphinx for py2 to match global requirements https://review.opendev.org/659492 | 08:31 |
| *** starborn has joined #openstack-ansible | 08:33 | |
| miloa | I am using osa rocky tag: 18.1.5, install_method: distro, OS : CentOS. Is it possible to rerun setup-infrastructure.yml ? I've got an error on second run : repo_server : Gather variables for each operating system : FAILED! => {"msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"}. | 08:34 |
| fnpanic | ceemac: food | 08:38 |
| fnpanic | s/f/g/g | 08:38 |
| fnpanic | quick question | 08:38 |
| fnpanic | do you still have remote for your image upload in horizon? | 08:38 |
| fnpanic | miloa: hi | 08:39 |
| CeeMac | fnpanic, i do | 08:39 |
| fnpanic | i guess this is on the utiltiy container | 08:39 |
| *** aedc has joined #openstack-ansible | 08:39 | |
| miloa | fnpanic: hi :) | 08:39 |
| fnpanic | right? | 08:39 |
| fnpanic | i have seen this message before | 08:40 |
| *** DanyC has joined #openstack-ansible | 08:40 | |
| fnpanic | ceemac: i changed my cors setting and then i can use direct thanks to noonedeadpunk | 08:42 |
| evrardjp | that sounds like there is a problem for fact gathering | 08:42 |
| evrardjp | miloa: ^ | 08:42 |
| CeeMac | fnpanic, nice! | 08:42 |
| evrardjp | are all the containers fine and reachable? Is the fact cache stale? | 08:43 |
| fnpanic | CeeMac: do you see a progress bar on upload or just a spinner at the submit button? | 08:43 |
| CeeMac | fnpanic, i can't remember tbh. I'd need to switch it back and try again. | 08:44 |
| *** gkadam has joined #openstack-ansible | 08:45 | |
| CeeMac | I'm in the middle of prepping for a prod rollout, once I've got that done I'll revisit some of these issues in my dev environment | 08:45 |
| miloa | evrarjp: when i run "ansible -m setup controller-002_repo_container-xxxx" I get the facts | 08:45 |
| fnpanic | ceemac: k thanks | 08:47 |
| miloa | evrardjp: how can i check if the fact cache stale? | 08:48 |
| CeeMac | fnpanic, sure | 08:48 |
| *** shyamb has joined #openstack-ansible | 08:55 | |
| *** hamzaachi has joined #openstack-ansible | 08:56 | |
| jrosser | miloa: you are doing install_method=distro? it doesnt look like the repo_server should be involved in that case https://github.com/openstack/openstack-ansible/blob/stable/rocky/playbooks/setup-infrastructure.yml#L17-L18 | 09:05 |
| *** starborn has quit IRC | 09:08 | |
| *** PTO has joined #openstack-ansible | 09:08 | |
| *** jsquare has quit IRC | 09:10 | |
| *** jsquare has joined #openstack-ansible | 09:12 | |
| evrardjp | miloa: isn't this documented? | 09:14 |
| evrardjp | https://docs.openstack.org/openstack-ansible/latest/admin/troubleshooting.html#cached-ansible-facts-issues | 09:16 |
| evrardjp | you need to run a playbook to store said facts, not only ad-hoc commands | 09:17 |
| jrosser | hmm fatal: unable to access 'https://opendev.org/openstack/keystone/': gnutls_handshake() failed: The TLS connection was non-properly terminated | 09:20 |
| jrosser | ^ is that a known this? | 09:20 |
| jrosser | *thing | 09:20 |
| PTO | I need some advice. I have broken my openstack pike cluster. I have added three new controller nodes following the scaling guide, and then remove the three old ones. Everything seems to work, except all instances are stuck in SCHEDULE or BUILD. How to proceed? | 09:26 |
| miloa | jrosser: yes I amm using install_method=distro, ans in my openstack_user_config.yml I've got repo-infra_hosts section. I will comment/remove it and try again thanks. | 09:29 |
| jrosser | right - so as you can see in setup-infrastructure it shouldnt even be running the repo server playbooks? | 09:29 |
| fnpanic | PTO: hi. What does work? when you say everything seems to work? | 09:30 |
| miloa | evrardjp: thanks for the doc link :) I was sticked to the deployment doc and did not see it :) | 09:31 |
| PTO | All services are up, openstack cli list images, neutron agents, flavors etc. Everything seems up. The only problem is i cant launch instances or edit them | 09:31 |
| *** rgogunskiy has joined #openstack-ansible | 09:31 | |
| evrardjp | miloa: operations docs are very nice :) | 09:32 |
| evrardjp | they need some more content though :) | 09:32 |
| *** sc has joined #openstack-ansible | 09:34 | |
| *** starborn has joined #openstack-ansible | 09:37 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Remove Xenial support and CI jobs https://review.opendev.org/650588 | 09:42 |
| L_SR | evrardjp: Hello! still stuck at setup_openstack.yaml. I have noticed that when running os-keystone-install.yaml after just created the container I get the following error: https://pastebin.com/fTxd8yB7 nevertheless, running it a second time skips the aforementioned error but instead shows this: http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2019-05-15.log.html#t2019-05-15T16:30:52 Any idea? | 09:47 |
| L_SR | evrardjp: I have also checked the network configuration, which seems to be ok: https://imgur.com/huWQicd | 09:54 |
| L_SR | Any help is greatly appreciated, guys! Thanks in advance | 09:54 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/rocky: Use block/rescue for image pre-stage https://review.opendev.org/659360 | 10:01 |
| *** pmannidi has quit IRC | 10:05 | |
| *** tosky has quit IRC | 10:10 | |
| *** shyamb has quit IRC | 10:10 | |
| *** tosky has joined #openstack-ansible | 10:11 | |
| noonedeadpunk | mornings everyone | 10:20 |
| *** shyamb has joined #openstack-ansible | 10:21 | |
| _janno | I have two containers failig which are missing /openstack/venvs/utility-19.1.0.dev53/bin/python | 10:26 |
| _janno | one is a keystone container and the other one is a glance one | 10:27 |
| *** pcaruana has quit IRC | 10:27 | |
| _janno | That they are looking for /openstack/venvs/_utility_-... seems wrong for me | 10:28 |
| _janno | The glance one has a python in /openstack/venvs/glance-19.1.0.dev53/ and the keystone in /openstack/venvs/keystone-19.1.0.dev53/ | 10:29 |
| *** shyamb has quit IRC | 10:40 | |
| *** shyamb has joined #openstack-ansible | 10:41 | |
| noonedeadpunk | folks, what do you think regarding that? https://review.opendev.org/#/c/658679/3 | 10:43 |
| *** luksky has joined #openstack-ansible | 10:52 | |
| *** shyamb has quit IRC | 10:55 | |
| evrardjp | L_SR: I don;t know what you did, but it seems your environment is broken. Your secrets don't match the db | 10:56 |
| evrardjp | Is that a prod environment? | 10:56 |
| evrardjp | could you just tear everything down, and start from scratch? | 10:56 |
| evrardjp | _janno: what do you mean? | 10:57 |
| *** nicolasbock has joined #openstack-ansible | 10:57 | |
| evrardjp | _janno: the utility container is there for convenience | 10:57 |
| evrardjp | it's venv too | 10:57 |
| L_SR | evrardjp: weird. Going to focus on that now. Thanks for taking a look | 10:59 |
| evrardjp | L_SR: just had a quick glance | 10:59 |
| evrardjp | that's what I would do at least | 11:00 |
| *** strattao has joined #openstack-ansible | 11:00 | |
| evrardjp | noonedeadpunk: done | 11:00 |
| L_SR | evrardjp: I have a running deployment using branch 19.0.0 (as in https://docs.openstack.org/project-deploy-guide/openstack-ansible/stein/deploymenthost.html). I will try deploying with it and see if I get similar errors | 11:01 |
| evrardjp | ok | 11:06 |
| *** shyamb has joined #openstack-ansible | 11:11 | |
| *** udesale has quit IRC | 11:15 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: [redhat] Update variables to be version agnostic https://review.opendev.org/658253 | 11:20 |
| *** aedc has quit IRC | 11:24 | |
| _janno | evrardjp: well, nevermind, I think the problem was that someone accidentally had uncommented the following line | 11:32 |
| _janno | #openstack_service_setup_host_python_interpreter: "/openstack/venvs/utility-{{ openstack_release }}/b│ | 11:32 |
| _janno | in/python" | 11:32 |
| evrardjp | :) | 11:33 |
| evrardjp | that could explain if you're setting up a different interpreter :) | 11:33 |
| _janno | but I am still wondering why there hadn't been any issues with the other containers | 11:34 |
| *** pcaruana has joined #openstack-ansible | 11:37 | |
| L_SR | evrardjp: after destroying and re-creating the keystone container, it still fails at checking the current state of the Keystone DB: https://pastebin.com/jpktA3Zm | 11:41 |
| *** shyamb has quit IRC | 11:43 | |
| *** shyam89 has joined #openstack-ansible | 11:43 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Prepare OSA release for Stein https://review.opendev.org/656595 | 11:57 |
| mgariepy | is the aria2c stuff for centos been merged in rocky ? | 11:59 |
| mgariepy | http://logs.openstack.org/99/659299/1/check/openstack-ansible-functional-centos-7/5417270/job-output.txt.gz#_2019-05-15_14_42_16_077023 | 11:59 |
| *** aedc has joined #openstack-ansible | 12:14 | |
| *** cshen has quit IRC | 12:20 | |
| *** joshualyle has joined #openstack-ansible | 12:24 | |
| *** cshen has joined #openstack-ansible | 12:28 | |
| noonedeadpunk | logan-: I also was thinking about "content" but in this case we should either add task to read source file and place it as content, or force delpoyers to put raw content inside variable, which is pretty new experience. And overrides are more handy and people get used to them imo | 12:33 |
| *** shyam89 has quit IRC | 12:35 | |
| *** shyamb has joined #openstack-ansible | 12:35 | |
| *** PTO has quit IRC | 12:36 | |
| *** shyamb has quit IRC | 12:42 | |
| evrardjp | noonedeadpunk: alternatively, just provide the override and template it as ini or pass the whole file ? | 12:44 |
| noonedeadpunk | you mean to do template with absolute path, when it's provided? | 12:46 |
| *** shyamb has joined #openstack-ansible | 12:47 | |
| noonedeadpunk | yep, that's probably an option. don't know why, I just like overrides, as they can be passed to the needed format, and you provide them with nice-looking yaml:) | 12:47 |
| *** ansmith has quit IRC | 12:48 | |
| noonedeadpunk | so, you also suggest to replace override with source file, provided by deployer here https://review.opendev.org/#/c/658679/ ? | 12:49 |
| noonedeadpunk | I can probably put -W as it's not too late | 12:49 |
| *** shyamb has quit IRC | 12:51 | |
| evrardjp | we can merge it as is | 12:53 |
| evrardjp | if you want to improve in a later patch you can | 12:53 |
| evrardjp | but indeed I see no point of having an empty thing we override with content of the deployer :) It's not worth not merging this though | 12:54 |
| evrardjp | good news is that stein thing merged | 12:55 |
| evrardjp | I believe we can have the first stein release then :) | 12:55 |
| noonedeadpunk | Just I afaik the only project we had that allowed to place user configs was ceilometer, and even it not the case now | 12:56 |
| noonedeadpunk | That's great news! | 12:56 |
| evrardjp | you mean upload files from deployer's userspace? | 12:56 |
| evrardjp | I think it's the case if you want to upload your certificates and other stuff? | 12:56 |
| *** shyamb has joined #openstack-ansible | 12:57 | |
| noonedeadpunk | oh, yeah, that's the case. | 12:57 |
| evrardjp | :) | 13:00 |
| evrardjp | I think it's fine to "just upload a file" to destination, and avoids mangling/editing files live. | 13:01 |
| evrardjp | You're "only" exposed to ansible/rsync bugs, not the config_templates ones on top :D | 13:01 |
| *** udesale has joined #openstack-ansible | 13:02 | |
| noonedeadpunk | Yep, probably you're right. Than there's no reason to merge this in current state. | 13:02 |
| noonedeadpunk | I'll better update it to upload deployer provided config file | 13:02 |
| evrardjp | I think the patch is not incorrect, else I would have voted negatively :) | 13:03 |
| noonedeadpunk | *to allow depployer to upload config | 13:03 |
| evrardjp | I think you can add a patch on top | 13:03 |
| noonedeadpunk | I'd love to get it already for stein, and then it would be harder to backport:) | 13:03 |
| evrardjp | oh fair :) | 13:03 |
| evrardjp | one vs two patches :) | 13:04 |
| noonedeadpunk | some features are available from queens and it's high time we added them | 13:04 |
| evrardjp | noonedeadpunk: thanks for biting the bullet | 13:04 |
| evrardjp | noonedeadpunk: https://review.opendev.org/#/c/659119/ If we merge this, the whole branch to use the integrated for blazar would work | 13:09 |
| evrardjp | I don't ensure the fact blazar is _actually_ working, but at least it passes functional testing | 13:09 |
| *** ianychoi has joined #openstack-ansible | 13:26 | |
| logan- | noonedeadpunk: yeah I wouldn’t change how you did it. It’s different, but clever, and it’s | 13:28 |
| logan- | the only way you can pass structured data rather than a flat file ;) | 13:28 |
| * logan- googles what blazar is | 13:29 | |
| noonedeadpunk | now I really don't know what to do - either to replace this with just custom config file or leave as is. tough choice | 13:31 |
| noonedeadpunk | ok, let it be then?.. | 13:32 |
| *** gkadam has quit IRC | 13:33 | |
| logan- | If you change anything, have deploy specify content not src imo, that way the override can still be used without creating another separate config file. content can still accept a separate file with a lookup if someone is so determined. | 13:34 |
| logan- | But yep feel free to leave it, voted accordingly :p | 13:34 |
| admin0 | if I have multiple cinder types, how do I set one as default ? | 13:34 |
| *** sreejithp has joined #openstack-ansible | 13:34 | |
| logan- | If it works for you it’s progress from where it was before and it won’t break anyone else :) | 13:34 |
| logan- | admin0: there is a cinder config var you can set in overrides to specify the default backend | 13:35 |
| admin0 | ok .. so its from the config | 13:35 |
| admin0 | i thought some command | 13:35 |
| logan- | Yea it’s config for sure | 13:36 |
| logan- | I don’t remember the var though and I’m on mobile | 13:37 |
| evrardjp | logan-: haha it's not that blazar catches my eyes, is just that I want to finish this matrix: https://docs.google.com/spreadsheets/d/1coiPHGqaIKNgCGYsNhEgzswqwp4wedm2XoBCN9WMosY/edit#gid=752070695 | 13:37 |
| noonedeadpunk | logan-: actually, there's no point in override when you're placing the full content... but yep, I probably can move this " " content to a variable, that a deployer could provide a file with a lookup instead | 13:37 |
| noonedeadpunk | great idea | 13:38 |
| *** shyamb has quit IRC | 13:38 | |
| evrardjp | far too complex imo: just copy the damn file :p | 13:38 |
| evrardjp | hahaha | 13:38 |
| logan- | noonedeadpunk: I’ve thought about testing that glance feature for years. Have you tried it? Does it work well? | 13:40 |
| noonedeadpunk | I'm in progress:) I need to place a metadata to all user uploaded images, so had to use it. | 13:42 |
| evrardjp | folks, how long should we wait for releasing stein? I suppose we can wait a few days (until monday for example) to see how it goes? | 13:45 |
| evrardjp | I think we can do it today if we want to rush it, but at this point there is no rush I think | 13:45 |
| guilhermesp | morning! I've been out with some headaches regarding openstack upgrades hahahah btw, did we start the migration script for placement? | 13:46 |
| guilhermesp | i think this could be a point to consider to release stein? | 13:46 |
| L_SR | evrardjp: i think i'm starting to show frustration xD. I have pinpointed the problem to os-keystone-install. Even if I regenerate the secrets, or simply erase everything and retry, the setup-openstack always fails in the same Task: keystone_db_setup.yml. Where can I get Keystone logs? I see none at container's /var/log or in venv directory | 13:47 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Add ability to place glance-image-import.conf https://review.opendev.org/658679 | 13:47 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Add ability to place glance-image-import.conf https://review.opendev.org/658679 | 13:48 |
| evrardjp | L_SR: sorry you go through that. The problem is not the secret generation, is the fact that you still have a db with old secrets :) | 13:48 |
| evrardjp | how do you erase everything? | 13:49 |
| L_SR | evrardjp: lxc-container-destroy | 13:49 |
| evrardjp | L_SR: you can find the logs on the host | 13:49 |
| evrardjp | L_SR: I think out of safety we don't destroy the data? Can't remember | 13:49 |
| L_SR | evrardjp: it prompts the user if you want to erase container contents. Am I wrong assuming this erases the DB too? | 13:50 |
| evrardjp | I suppose in that case we delete it too I guess :) | 13:50 |
| evrardjp | L_SR: I guess it would be simpler if we had a log of the complete run since the last lxc-container-destroy | 13:51 |
| L_SR | evrardjp: what log could be useful? | 13:52 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/stein: Use the 'real' name for the LXC image https://review.opendev.org/658774 | 13:52 |
| evrardjp | I mean the full ansible log | 13:52 |
| evrardjp | at some point we need the bazooka approach :) | 13:52 |
| L_SR | evrardjp: ok. Will attempt a destroy again and get the complete log | 13:53 |
| L_SR | evrardjp: bazooka it is :) | 13:53 |
| evrardjp | L_SR: I think it's wise... Having all the details in one place will be good | 13:53 |
| CeeMac | L_SR, is keystone logging to journalctl perchance? | 13:53 |
| evrardjp | By providing a deploy log, we can compare to our gates, and with the /etc/openstack_deploy (no need to share the secrets) we would have a full view | 13:54 |
| L_SR | evrardjp: ok | 13:54 |
| L_SR | CeeMac: sorry for being such a newbie: how can I check? | 13:54 |
| evrardjp | CeeMac: I think the problem is the db sync -- on the error log I saw it was a problem connecting to DB | 13:54 |
| admin0 | setting up default_volume_type: in variables did nothing .. i think its config override | 13:54 |
| admin0 | just confirming before i do | 13:54 |
| evrardjp | Therefore I suggested checking if the db is correct and networking/haproxy is correct. | 13:54 |
| evrardjp | CeeMac: if you could help L_SR that would be most welcomed :) | 13:55 |
| *** mgariepy has quit IRC | 13:55 | |
| evrardjp | I am sad ppl arrive to a frustrating experience, this is not the usual OSA experience:( | 13:55 |
| L_SR | evrardjp: the db sync error is bypassed by specifying login_unix_socket: /var/run/mysqld/mysqld.sock, which I believe is xenial's socket to the db | 13:55 |
| evrardjp | There is no need to bypass things :) | 13:56 |
| CeeMac | L_SR, from within the keystone container, journalctl -xe | 13:56 |
| *** pcaruana has quit IRC | 13:56 | |
| L_SR | evrardjp: I love OSA! I have a 6 node setup in the lab, worked like a charm. But his time, with a very reduced setup, is giving me this strange problem with Keystone | 13:56 |
| admin0 | my bad | 13:57 |
| L_SR | CeeMac: yes, I can see Keystone logs. Some are these: https://pastebin.com/mw7Px0fi seemed to be related to mysql connection | 14:00 |
| noonedeadpunk | instantly regret about decision to change patch | 14:01 |
| CeeMac | L_SR, journalctl -xe | grep -i 'error\|warn' | 14:01 |
| CeeMac | might narrow it down | 14:01 |
| evrardjp | noonedeadpunk: :) | 14:01 |
| evrardjp | L_SR: sorry to insist, but have you double checked the networking/LBing? | 14:02 |
| L_SR | CeeMac: https://pastebin.com/eM4BV7vZ | 14:02 |
| *** cshen has quit IRC | 14:02 | |
| CeeMac | line 35, could do with page right to see the rest of the detail | 14:02 |
| evrardjp | and then trying to hit the LB on its internal interface with the credentials you have in secrets? | 14:02 |
| *** mgariepy has joined #openstack-ansible | 14:03 | |
| CeeMac | L_SR, nvm, second paste has it | 14:03 |
| L_SR | evrardjp: I will check next | 14:03 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Add ability to place glance-image-import.conf https://review.opendev.org/658679 | 14:04 |
| CeeMac | it does look networky | 14:05 |
| L_SR | CeeMac: shall I remove the login_unix_socket: /var/run/mysqld/mysqld.sock from keystone_db_setup.yml? | 14:05 |
| CeeMac | have you checked the haproxy status to see if the backend is up? | 14:05 |
| CeeMac | hatop -s /var/run/haproxy.stat | 14:05 |
| CeeMac | L_SR, I'd probably avoid ripping things out until you have a better idea of the root cause, might be a nightmare to fix them back in if need be | 14:06 |
| L_SR | CeeMac: haproxy has some services OPEN and DOWN | 14:07 |
| CeeMac | can you paste the ones related to galera? | 14:08 |
| L_SR | CeeMac: these are related to galera: https://pastebin.com/wGH3HD9y | 14:09 |
| CeeMac | L_SR, might be worth checking the galera cluster node and cluster status | 14:09 |
| CeeMac | ansible galera_container -m shell -a "cat /var/lib/mysql/grastate.dat" (from deployment node) | 14:09 |
| CeeMac | ansible galera_container -m shell -a "mysql -h 127.0.0.1 -e 'show status like \"%wsrep_cluster_%\";'" | 14:09 |
| CeeMac | L_SR, OK, so it looks up at least from the LB point of view | 14:10 |
| noonedeadpunk | so I ended up with adding new task https://review.opendev.org/658679 and not really sure if it's ok, or I really should rollback to the 3-rd patch set | 14:10 |
| L_SR | CeeMac: both checks on Galera yielded SUCCESS | 14:10 |
| CeeMac | hmm | 14:10 |
| CeeMac | ok, can you ping the LB IP from the keystone container? | 14:10 |
| CeeMac | the internal VIP I mean | 14:11 |
| L_SR | CeeMac: galera-related checks: https://pastebin.com/CqbXNqFM | 14:11 |
| noonedeadpunk | choosing options is the harderst part for me:( | 14:12 |
| L_SR | CeeMac: the internal vip from lb is reachable from the keystone container https://pastebin.com/DPyV8Gia | 14:13 |
| L_SR | CeeMac: the external too | 14:13 |
| L_SR | CeeMac: this is the error itself for os-keystone-instal or setup-openstack https://pastebin.com/JipDS07d | 14:15 |
| *** cshen has joined #openstack-ansible | 14:16 | |
| L_SR | CeeMac: should I lxc-container-destroy and redeploy in order to get a complete log? | 14:17 |
| CeeMac | L_SR, how many nodes do you have? | 14:19 |
| mgariepy | anyone use keystone as a SP currently to authenticate against an idp ? | 14:19 |
| L_SR | CeeMac: 3. 1 infra1, 1 compute1, 1 storage | 14:20 |
| CeeMac | k | 14:20 |
| *** cshen has quit IRC | 14:21 | |
| CeeMac | not sure if "ttyname failed: Inappropriate ioctl for device" is relevant | 14:22 |
| CeeMac | i seem to recall seeing that once before myself | 14:22 |
| L_SR | CeeMac: it keeps showing in several tasks | 14:22 |
| CeeMac | do they all fail or some succeed? | 14:22 |
| L_SR | CeeMac: redeploying now | 14:22 |
| *** cshen has joined #openstack-ansible | 14:22 | |
| CeeMac | k | 14:23 |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Add SUSE and CentOS support to blazar https://review.opendev.org/659119 | 14:24 |
| *** cloudkiller is now known as blah23 | 14:27 | |
| *** blah23 is now known as cloudnull|afk | 14:27 | |
| *** rgogunskiy has quit IRC | 14:29 | |
| *** rgogunskiy has joined #openstack-ansible | 14:30 | |
| *** cloudnull|afk is now known as cloudnull | 14:31 | |
| *** rgogunskiy has quit IRC | 14:31 | |
| *** starborn has quit IRC | 14:31 | |
| *** rgogunskiy has joined #openstack-ansible | 14:32 | |
| *** hamzaachi_ has joined #openstack-ansible | 14:33 | |
| *** hamzaachi has quit IRC | 14:35 | |
| *** d34dh0r53 has quit IRC | 14:36 | |
| *** d34dh0r53 has joined #openstack-ansible | 14:37 | |
| *** hamzaachi_ has quit IRC | 14:37 | |
| *** pcaruana has joined #openstack-ansible | 14:37 | |
| *** rgogunskiy has quit IRC | 14:39 | |
| *** rgogunskiy has joined #openstack-ansible | 14:40 | |
| *** d34dh0r53 is now known as Guest28904 | 14:41 | |
| *** rgogunskiy has quit IRC | 14:44 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_neutron master: Remove name2int https://review.opendev.org/656761 | 14:48 |
| *** hamzaachi_ has joined #openstack-ansible | 14:49 | |
| *** cshen has quit IRC | 15:00 | |
| *** miloa has quit IRC | 15:02 | |
| *** devx has quit IRC | 15:03 | |
| *** devx has joined #openstack-ansible | 15:04 | |
| *** ivve has quit IRC | 15:13 | |
| CeeMac | any telemetry gurus in the house? | 15:16 |
| *** luksky has quit IRC | 15:19 | |
| *** qsrmvt has joined #openstack-ansible | 15:20 | |
| L_SR | CeeMac evrardjp: redeployment log https://www.dropbox.com/s/ou2bnogwb22joge/ansible.log?dl=0 | 15:20 |
| qsrmvt | Hello. I'm having some difficulty finding the hardening role... it seems to not be on Galaxy any more? Or maybe it changed names? | 15:20 |
| mgariepy | https://github.com/openstack/ansible-hardening | 15:21 |
| mgariepy | qsrmvt, ^^ | 15:21 |
| qsrmvt | Yeah I know where it is on GitHub | 15:21 |
| qsrmvt | I would have sworn it used to be on Galaxy as well | 15:21 |
| qsrmvt | Well, before I go adding a submodule or somesuch... any idea how well it works against Ubuntu 18.04.2 LTS? Last I saw it was working for 16.04, but no mention past that (again, might have missed something) | 15:23 |
| CeeMac | qsrmvt, it ran fine against my env on 18.04.1 | 15:25 |
| qsrmvt | Awesome, thanks | 15:25 |
| qsrmvt | That's what I was hoping :) | 15:25 |
| L_SR | CeeMac evrardjp: setup-openstack log with increased verbosity showing the failure at keystone: https://pastebin.com/yk7x94Ae | 15:25 |
| CeeMac | couldn't get 18.0.4.2 install iso working, kept looping after network setup for some reason | 15:25 |
| * CeeMac shrugs | 15:27 | |
| logan- | question for people who have done skip level upgrades, mgariepy cloudnull jmccrory... can upgrade control plane 1 version at a time and then jump computes from ex. P->R (meaning nova-compute would never start up in Q, but all other services would | 15:27 |
| mgariepy | when i did Kilo > newton one it was only a question of upgading the db anyway. | 15:28 |
| mgariepy | but having done it once, i would not do it again ;) it's easier to keep up to date haha :) | 15:29 |
| CeeMac | L_SR, are you just running the keystone playbook or running everything from scratch? I forget how far you got before this | 15:30 |
| logan- | mgariepy: thanks | 15:31 |
| L_SR | CeeMac , in this last case I'm running everything from scratch | 15:31 |
| mgariepy | isn't the new release of OS supposed to be able to upgrade the DB direcly from P to R > | 15:31 |
| mgariepy | ? | 15:31 |
| L_SR | CeeMac evrardjp: user variables: https://pastebin.com/5jEHvhSn openstack user config: https://pastebin.com/Sz6Q8xXX | 15:32 |
| logan- | not sure, that would be great though | 15:32 |
| mgariepy | https://github.com/openstack/openstack-ansible-ops/tree/master/leap-upgrades | 15:33 |
| mgariepy | i used that back in the days. | 15:34 |
| mgariepy | but i had a few release to upgrade. | 15:34 |
| mgariepy | logan-, you probably can do a quick test from P > R upgrade, maybe some config in OSA needs to be taken from Q, not too sure about it but just for an aio it would be too long to do a quick test. | 15:36 |
| CeeMac | L_SR, nothing jumping out at me from your config files | 15:36 |
| *** qsrmvt has left #openstack-ansible | 15:36 | |
| logan- | yeah i'll give that a shot. even if i only have to run migrations in Q that would not be too hard | 15:37 |
| *** _d34dh0r53_ is now known as d34dh0r53 | 15:38 | |
| *** macza has joined #openstack-ansible | 15:39 | |
| L_SR | CeeMac evrardjp: keystone journal from the container: https://pastebin.com/ZSZEkzXG | 15:39 |
| CeeMac | L_SR, your secrets file is populated yes? (sorry, jucst covering bases) | 15:40 |
| L_SR | CeeMac, sure, via ./scripts/pw-token-gen.py --file /etc/openstack_deploy/user_secrets.yml | 15:40 |
| CeeMac | just checking :) | 15:41 |
| L_SR | :) | 15:41 |
| CeeMac | thought it could be auth issue rather than network issue :) | 15:41 |
| L_SR | I think I got the network setup just right, in fact it is the same as in my other deployment. nevertheless, the keystone journal makes me wonder if something is wrong, though | 15:42 |
| CeeMac | yeah, connection errors are so vague | 15:42 |
| L_SR | Well, must investigate more i guess | 15:43 |
| CeeMac | do you have debug enabled in keystone.conf | 15:44 |
| CeeMac | or maybe set debug true in your user variables | 15:45 |
| evrardjp | CeeMac: it's weeird, the first like I see is a problem with ERROR! the playbook: setup-infrastructure.yml could not be found | 15:45 |
| CeeMac | i saw that | 15:45 |
| CeeMac | then it runs it anyway | 15:45 |
| CeeMac | i presume you're running the playbook from the playbooks directory.... | 15:45 |
| CeeMac | (obvs) | 15:45 |
| evrardjp | sorry it was not for CeeMac but L_SR :) | 15:46 |
| CeeMac | sorry also, i didn't check the sender just the message. its almost 17:00 my brain is mostly off now :) | 15:46 |
| evrardjp | it's almost 6pm for me, my brain is definitely off | 15:47 |
| evrardjp | :p | 15:47 |
| CeeMac | haha yeah | 15:47 |
| *** rgogunskiy has joined #openstack-ansible | 15:47 | |
| *** rgogunskiy has quit IRC | 15:47 | |
| evrardjp | 2019-05-16 14:23:52,327 p=5942 u=root | [WARNING]: Could not match supplied host pattern, ignoring: repo_masters | 15:47 |
| evrardjp | makes me wonder | 15:47 |
| evrardjp | there must be a problem with inventory or something | 15:47 |
| *** rgogunskiy has joined #openstack-ansible | 15:47 | |
| *** pcaruana has quit IRC | 15:47 | |
| CeeMac | theres an error connecting for the requirements file as well | 15:48 |
| evrardjp | that's very weird | 15:48 |
| *** itandops has joined #openstack-ansible | 15:48 | |
| evrardjp | L_SR: did you checkout the latest stable version of the code, then re-ran bootstrap-ansible ? | 15:48 |
| CeeMac | repo-infra_hosts is set in o_u_c | 15:48 |
| *** L_SR_2 has joined #openstack-ansible | 15:48 | |
| evrardjp | I think the healthcheck playbooks should help here | 15:49 |
| evrardjp | for debugging | 15:49 |
| evrardjp | L_SR: after doing the steps above, I would go to playbooks folder, and run | 15:50 |
| evrardjp | openstack-ansible healthcheck-hosts.yml | 15:50 |
| L_SR_2 | evrardjp CeeMac would do that when I get access to the deployment host again :). Thanks for your insights so far | 15:51 |
| L_SR_2 | Won’t promise I would not bother you guys again tomorrow | 15:53 |
| CeeMac | evrardjp, should repo_masters show up as a group in the dynamic inventroy? | 15:53 |
| evrardjp | L_SR_2: I am just doing this on my part time, it's not my job currently :) | 15:53 |
| evrardjp | So I am not promising I would be there too :p | 15:53 |
| evrardjp | CeeMac: I believe it would | 15:53 |
| CeeMac | i don't see it on my deployment host | 15:54 |
| L_SR_2 | evrardjp :) | 15:54 |
| evrardjp | CeeMac: sorry I meant repo_all | 15:54 |
| evrardjp | CeeMac: let me rephrase, repo_all should always be empty. Because the group is always defined: https://github.com/openstack/openstack-ansible/blob/96852cfcc9f4db948489d750dd116d2b0a51ceff/inventory/inventory.ini | 15:54 |
| evrardjp | should always at least* be empty | 15:55 |
| evrardjp | in other words, always defined | 15:55 |
| evrardjp | not unknown by the inventory | 15:55 |
| CeeMac | repo_masters would link to a skel then ? | 15:55 |
| evrardjp | the masters thing is dynamic | 15:55 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/cf776e29a383fb7779858068369d3dfc4794141c/playbooks/repo-build.yml#L24-L41 | 15:56 |
| evrardjp | CeeMac: I am a little outdated on how this works in master branch though | 15:56 |
| evrardjp | I suppose it's kinda the same | 15:56 |
| CeeMac | you're probably more clued up than me in that respect :p | 15:57 |
| *** itandops has quit IRC | 15:58 | |
| *** L_SR_2 has quit IRC | 15:58 | |
| CeeMac | ah, ok. so its taking the repo_all group, and dynamically populating the repo_servers_* into repo_masters | 15:58 |
| evrardjp | yes, no need to build on all nodes, just build on master of each distro/arch then for the rest, sync | 15:59 |
| CeeMac | ok, so if it can't find that, then something basic has gone wrong? | 16:00 |
| evrardjp | what do you mean? | 16:00 |
| CeeMac | ^ [WARNING]: Could not match supplied host pattern, ignoring: repo_masters | 16:01 |
| evrardjp | if it doesn't do repo build that sounds weird, on branches like Queens/Rocky :) | 16:01 |
| evrardjp | yes | 16:01 |
| *** kopecmartin is now known as kopecmartin|off | 16:01 | |
| CeeMac | just checking i was understanding that correctly :) | 16:01 |
| evrardjp | I would totally check the inventory if things are okay | 16:01 |
| CeeMac | yeah | 16:01 |
| evrardjp | we have a tool, inventory manage, but you can now also use ansible-inventory to check the /etc/openstack_deploy/inventory.json | 16:02 |
| CeeMac | L_SR, repo-infra_all would be a good one to check | 16:02 |
| CeeMac | oh, i didn't know about the ansible way, is that documented? | 16:02 |
| CeeMac | i always use the scripts/inventory-manage.py | 16:03 |
| CeeMac | L_SR, in lieu of the ansible-inventory way, you could use 'scripts/inventory-manage.py -G | grep repo' from /opt/openstack-ansible to validate the inventory is correct | 16:05 |
| CeeMac | anyway, i'm out. catch you all tomorrow :) | 16:07 |
| *** hamzaachi_ has quit IRC | 16:07 | |
| CeeMac | one last observation | 16:09 |
| CeeMac | 2019-05-16 15:10:37,903 p=19351 u=root | fatal: [infra1_keystone_container-041e69d2 -> 172.10.10.26]: FAILED! => {"changed": false, "msg": "unable to connect to database, check login_user and login_password are correct or /root/.my.cnf has the credentials. Exception message: (2013, \"Lost connection to MySQL server at 'reading initial communication packet', system error: 0\")"} | 16:09 |
| CeeMac | still looks like authentication issue? | 16:09 |
| CeeMac | hmm, sorry probably should have pasted that | 16:10 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Use the dynamic aio scenario https://review.opendev.org/658433 | 16:13 |
| jrosser | M | 16:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Use the dynamic aio scenario https://review.opendev.org/658443 | 16:19 |
| *** luksky has joined #openstack-ansible | 16:21 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Use the dynamic aio scenario https://review.opendev.org/658435 | 16:22 |
| *** aedc has quit IRC | 16:38 | |
| *** rgogunskiy has quit IRC | 16:47 | |
| *** rgogunskiy has joined #openstack-ansible | 16:48 | |
| *** KeithMnemonic has joined #openstack-ansible | 17:01 | |
| jrosser | L_SR: the tasks that are failing, are they ones which are delegated to the deploy host? | 17:01 |
| jrosser | 172.10.10.26 <- is that your deploy host, and separate from your 3 Openstack nodes? | 17:02 |
| *** joshualyle has quit IRC | 17:03 | |
| *** ivve has joined #openstack-ansible | 17:16 | |
| *** bline has joined #openstack-ansible | 17:18 | |
| *** aedc has joined #openstack-ansible | 17:19 | |
| *** DanyC has quit IRC | 17:22 | |
| *** aedc has quit IRC | 17:28 | |
| -openstackstatus- NOTICE: Gerrit is being restarted to add gitweb links back to Gerrit. Sorry for the noise. | 17:35 | |
| *** electrofelix has quit IRC | 17:38 | |
| *** pcaruana has joined #openstack-ansible | 17:39 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Use the dynamic aio scenario https://review.opendev.org/658406 | 17:41 |
| *** Weifan has joined #openstack-ansible | 17:43 | |
| *** udesale has quit IRC | 17:46 | |
| *** DanyC has joined #openstack-ansible | 17:53 | |
| *** tuxjohnson has joined #openstack-ansible | 17:57 | |
| *** DanyC has quit IRC | 17:58 | |
| *** nicolasbock has quit IRC | 18:02 | |
| tuxjohnson | Can anyone what I may have done wrong that would cause my glance_api_servers in /etc/cinder/cinder.conf to have "http://localhost" instead of the correct "http://x.x.x.x.1:9292". My /etc/nova/nova.conf file api_servers entry is correct. In looking at the OSA templates, both the nova.conf and cinder.conf use "glance_service_internalurl"... so I amy trying to understand what happened to the cinder.conf file. | 18:07 |
| *** CeeMac has quit IRC | 18:08 | |
| openstackgerrit | Antony Messerli proposed openstack/openstack-ansible-galera_server stable/queens: Use newer percona-release package https://review.opendev.org/659633 | 18:11 |
| mgariepy | odyssey4me, are you around ? | 18:12 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-tests master: Use copy-links when collecting logs https://review.opendev.org/659635 | 18:13 |
| *** joshualyle has joined #openstack-ansible | 18:13 | |
| mgariepy | anyone have info on : https://bugs.launchpad.net/openstack-ansible/+bug/1808543 | 18:14 |
| openstack | Launchpad bug 1808543 in openstack-ansible "Keystone Federation cannot complete SP node setup on stable/rocky" [Undecided,Confirmed] - Assigned to Jesse Pretorius (jesse-pretorius) | 18:14 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Use integrated repo scenario for Calico job https://review.opendev.org/645834 | 18:14 |
| *** ianychoi has quit IRC | 18:15 | |
| *** joshualyle has quit IRC | 18:15 | |
| *** itandops has joined #openstack-ansible | 18:15 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Use the dynamic aio scenario https://review.opendev.org/658434 | 18:15 |
| *** joshualyle has joined #openstack-ansible | 18:22 | |
| *** cshen has joined #openstack-ansible | 18:39 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Use the dynamic aio scenario https://review.opendev.org/658431 | 18:41 |
| *** trident has quit IRC | 18:51 | |
| *** trident has joined #openstack-ansible | 18:52 | |
| *** cshen has quit IRC | 18:56 | |
| *** d34dh0r53 has left #openstack-ansible | 19:00 | |
| *** d34dh0r53 has joined #openstack-ansible | 19:00 | |
| *** cshen has joined #openstack-ansible | 19:04 | |
| *** cshen has quit IRC | 19:09 | |
| *** nicolasbock has joined #openstack-ansible | 19:23 | |
| *** Weifan has quit IRC | 19:26 | |
| *** PTO has joined #openstack-ansible | 19:31 | |
| PTO | I have added new controller nodes to my cluster, and nothing works. I think its because the nova cells tranport url for rabbit is wrong. How can I change this? | 19:33 |
| PTO | When i run nova-manage cell_v2 update_cell... i get the error The specified transport_url and/or database_connection combination already exists for another cell with uuid b58c374f-79dc-483a-bc5d-2388ec4418d7. | 19:35 |
| PTO | All mysql endpoints are the same. How can this be fixed? | 19:35 |
| *** pcaruana has quit IRC | 19:52 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Remove LBaaS v2 plugin https://review.opendev.org/659654 | 19:54 |
| *** radeks_ has quit IRC | 19:58 | |
| *** joshualyle has quit IRC | 20:01 | |
| *** Weifan has joined #openstack-ansible | 20:02 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Update ansible to 2.8.0 https://review.opendev.org/659656 | 20:06 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.8.0 https://review.opendev.org/659658 | 20:08 |
| *** PTO has quit IRC | 20:09 | |
| *** Weifan has quit IRC | 20:19 | |
| jsquare | on a new install, we are facing a strange issue, /opt/container-setup.sh fails, "timeout 90 $RHT_PKG_MGR check-update" returns exit code 100 because there are packages available for update, is this normal? | 20:28 |
| *** Weifan has joined #openstack-ansible | 20:30 | |
| *** kmadac has quit IRC | 20:35 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Remove Neutron LBaaS v2 support https://review.opendev.org/659660 | 20:37 |
| *** dave-mccowan has joined #openstack-ansible | 20:39 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Remove Neutron LBaaS v2 support https://review.opendev.org/659660 | 20:39 |
| *** tuxjohnson has quit IRC | 20:46 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_zun master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659661 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_tempest master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659662 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_nova master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659663 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_monasca-agent master: Remove Neutron LBaaS from monitored services https://review.opendev.org/659664 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_manila master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659665 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_magnum master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659666 | 20:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_ironic master: Remove Neutron LBaaS from test inventory https://review.opendev.org/659667 | 20:49 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.8.0 https://review.opendev.org/659658 | 20:56 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Remove use of 'private' for include_role for ansible 2.8 https://review.opendev.org/659669 | 20:56 |
| *** trident has quit IRC | 20:59 | |
| openstackgerrit | Antony Messerli proposed openstack/openstack-ansible-ops master: Fix test_repo directory name https://review.opendev.org/659670 | 20:59 |
| *** trident has joined #openstack-ansible | 21:00 | |
| *** DanyC has joined #openstack-ansible | 21:01 | |
| *** aludwar has joined #openstack-ansible | 21:11 | |
| *** joshualyle has joined #openstack-ansible | 21:32 | |
| jrosser | wierd http://logs.openstack.org/56/659656/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/7a3ea9d/logs/ara-report/result/bdadc188-805c-4299-99c8-61af082c88c8/ | 21:33 |
| *** joshualyle has quit IRC | 21:36 | |
| logan- | yep, i hit that downstream earlier today testing the 2.8 rc with that role | 21:40 |
| logan- | on a much older tag, so I was hoping if i bumped to master it would work :) | 21:40 |
| logan- | apparently not | 21:40 |
| jrosser | I tried locally downgrading to 2.7 and it still did it | 21:41 |
| logan- | ..what | 21:41 |
| logan- | lol | 21:41 |
| jrosser | yes indeed, either my downgrade is bogus or the actual issue is in an ansible dep that’s been upgraded with 2.8 | 21:42 |
| logan- | thats odd | 21:42 |
| logan- | yeah | 21:42 |
| logan- | did jinja release today also? | 21:42 |
| jrosser | But really I need to check that in a clean vm to be sure, that’s on my laptop so there could be any amount of cruft | 21:43 |
| logan- | nope does not appear so (re jinja) | 21:43 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Remove LBaaS v2 plugin https://review.opendev.org/659654 | 21:45 |
| *** tosky has quit IRC | 21:59 | |
| openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible-os_keystone master: Execute the keystone db setup earlier in the process https://review.opendev.org/659676 | 22:02 |
| *** sreejithp has quit IRC | 22:06 | |
| *** hamzaachi has joined #openstack-ansible | 22:15 | |
| *** kplant has joined #openstack-ansible | 22:17 | |
| *** itandops has quit IRC | 22:19 | |
| *** itandops has joined #openstack-ansible | 22:19 | |
| *** joshualyle has joined #openstack-ansible | 22:23 | |
| *** joshualyle has quit IRC | 22:27 | |
| *** strattao has quit IRC | 22:29 | |
| *** itandops has quit IRC | 22:35 | |
| *** macza has quit IRC | 22:57 | |
| *** tuxjohnson has joined #openstack-ansible | 23:00 | |
| *** luksky has quit IRC | 23:04 | |
| *** DanyC has quit IRC | 23:21 | |
| *** hamzaachi has quit IRC | 23:33 | |
| logan- | should we just make this ovn centos job non voting? http://logs.openstack.org/54/659654/2/check/openstack-ansible-ovn-centos-7/188fd48/logs/ara-report/result/1a778bb9-8e26-4447-8013-a678c1a0db41/ | 23:35 |
| logan- | https://review.opendev.org/#/c/659654/ unblocks the os_neutron gate except for this job | 23:36 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Remove LBaaS v2 plugin https://review.opendev.org/659654 | 23:42 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Use integrated repo scenario for Calico job https://review.opendev.org/645834 | 23:43 |
| logan- | ^ ovn centos 7 job non voting to unblock the neutron gate, fyi in case anyone is maintaining it | 23:43 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Remove LBaaS v2 plugin https://review.opendev.org/659654 | 23:46 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Use integrated repo scenario for Calico job https://review.opendev.org/645834 | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!