| *** ahosam has quit IRC | 00:03 | |
| *** d34dh0r53 has quit IRC | 00:14 | |
| *** cloudnull has quit IRC | 00:14 | |
| *** DanyC has quit IRC | 00:42 | |
| *** nurdie has joined #openstack-ansible | 00:55 | |
| *** gyee has quit IRC | 00:58 | |
| *** nurdie has quit IRC | 01:00 | |
| *** spsurya has quit IRC | 02:03 | |
| *** cloudnull has joined #openstack-ansible | 02:54 | |
| *** d34dh0r53 has joined #openstack-ansible | 02:55 | |
| *** goldyfruit has joined #openstack-ansible | 04:54 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:33 | |
| *** shyamb has joined #openstack-ansible | 06:23 | |
| *** nurdie has joined #openstack-ansible | 06:47 | |
| *** nurdie has quit IRC | 06:51 | |
| *** ahosam has joined #openstack-ansible | 07:09 | |
| *** shyamb has quit IRC | 07:17 | |
| *** shyamb has joined #openstack-ansible | 07:19 | |
| *** shyamb has quit IRC | 07:31 | |
| *** ansmith_ has joined #openstack-ansible | 07:44 | |
| *** ansmith has quit IRC | 07:47 | |
| *** cshen has joined #openstack-ansible | 07:53 | |
| *** shyamb has joined #openstack-ansible | 08:01 | |
| *** shyamb has quit IRC | 08:05 | |
| *** ArchiFleKs has joined #openstack-ansible | 08:12 | |
| *** yesudian has joined #openstack-ansible | 08:22 | |
| *** yesudian has quit IRC | 08:28 | |
| *** shyamb has joined #openstack-ansible | 08:30 | |
| *** tosky has joined #openstack-ansible | 08:34 | |
| *** pcaruana has joined #openstack-ansible | 08:35 | |
| *** rpittau|afk is now known as rpittau | 08:41 | |
| *** shyam89 has joined #openstack-ansible | 08:52 | |
| *** shyamb has quit IRC | 08:52 | |
| outerrim | Hi & Good morning! I'm currently stuck deploying magnum with osa. While tring to create a cluster, magnum conductor fails with: | 09:09 |
|---|---|---|
| outerrim | 2020-01-03 09:04:48.955 5250 WARNING magnum.drivers.heat.template_def [req-f04760e6-a63a-4920-878e-6a875c2bfde2 - - - - -] stack does not have output_key api_address | 09:10 |
| outerrim | 2020-01-03 09:04:48.956 5250 WARNING magnum.drivers.heat.template_def [req-f04760e6-a63a-4920-878e-6a875c2bfde2 - - - - -] stack does not have output_key kube_masters | 09:10 |
| outerrim | 2020-01-03 09:04:48.974 5250 ERROR magnum.drivers.heat.driver [req-f04760e6-a63a-4920-878e-6a875c2bfde2 - - - - -] Nodegroup error, stack status: CREATE_FAILED, stack_id: fac9d49c-9248-48f7-97c9-a2a294c33c76, reason: Resource CREATE failed: AuthorizationFailure: resources.kube_masters.resources[0].resources.kube-master: Authorization failed. | 09:10 |
| outerrim | Any idea? | 09:10 |
| jrosser | outerrim: i'd guess thats more to do with some combination of the cluster template settings / k8s version / fedora image version / ..... / rather than anything specific to the OSA deployment of magnum | 10:17 |
| jrosser | you might get better advice in #openstack-containers for things directly about magnum | 10:22 |
| jrosser | and there will be more folks aound here for OSA things next week i think | 10:22 |
| *** shyam89 has quit IRC | 10:34 | |
| *** sakharkar has quit IRC | 10:59 | |
| *** sakharkar has joined #openstack-ansible | 11:02 | |
| noonedeadpunk | outerrim: what osa release do you run? | 11:03 |
| noonedeadpunk | as in train we might have failed magnum api because of misconfigured uwsgi | 11:04 |
| noonedeadpunk | and before train you probably might need to manually bump magnum version, but not so sure about that | 11:05 |
| *** shyamb has joined #openstack-ansible | 11:06 | |
| *** DanyC has joined #openstack-ansible | 11:15 | |
| outerrim | @noonedeadpunk: using osa 20.0.0. Already fixed the uwsgi problem manually, please see: | 11:45 |
| outerrim | https://bugs.launchpad.net/openstack-ansible/+bug/1858034/comments/2 | 11:45 |
| openstack | Launchpad bug 1858034 in openstack-ansible "Magnum fails with "ModuleNotFoundError: No module named 'encodings'"" [Undecided,New] | 11:45 |
| *** shyamb has quit IRC | 11:45 | |
| outerrim | Also changed 'insecure = True' because the certificate config is missing. | 11:46 |
| outerrim | The above error is the next I'm currently struggling with. | 11:46 |
| outerrim | Forget about adding the missing /etc/magnum/keystone_auth_default_policy.json file. | 11:48 |
| outerrim | Use the example one here. | 11:48 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_magnum master: Fix magnum-api wsgi name https://review.opendev.org/699726 | 11:49 |
| noonedeadpunk | hm, that's interesting. guilhermesp have you faced with smth like this? | 11:52 |
| outerrim | review 699726: Looks that for most of my problems there is already a fix implemented ;-) | 11:55 |
| jrosser | outerrim: noonedeadpunk also see that magnum have already gone 9.0.0 -> 9.1.0 and 9.2.0 release is currently proposed | 11:58 |
| jrosser | from what i've seen there are some fairly big changes there even on the stable branch | 11:58 |
| *** cshen has quit IRC | 11:58 | |
| *** DanyC has quit IRC | 12:00 | |
| noonedeadpunk | In train bump https://review.opendev.org/#/c/700749/2 we have the latest magnum sha... | 12:08 |
| noonedeadpunk | wondering if https://opendev.org/openstack/magnum/commit/57479b18d29a2d738955bc5bb599805bb8f4aceb may be related thing | 12:09 |
| noonedeadpunk | jrosser: btw, I think I got py3 for centos7 working at least for core roles https://review.opendev.org/#/q/topic:osa_py3_centos+(status:open+OR+status:merged) | 12:12 |
| *** cshen has joined #openstack-ansible | 12:12 | |
| noonedeadpunk | but I expect issues with masakari at least | 12:12 |
| jrosser | i think theres a lot moving with magnum even on the stable branches | 12:13 |
| jrosser | nice work woth centos there | 12:14 |
| outerrim | Do you think it makes sense to cherry-pick https://review.opendev.org/#/c/700749/2 and try to re-run everything? | 12:21 |
| jrosser | what makes me suspicious about this https://opendev.org/openstack/magnum/commit/57479b18d29a2d738955bc5bb599805bb8f4aceb is that the encoding of the user_data seems to be updated more widely than just for the proxy parts | 12:25 |
| *** DanyC has joined #openstack-ansible | 12:25 | |
| jrosser | so that patch changes more than what is described in the commit message | 12:25 |
| *** shyamb has joined #openstack-ansible | 12:27 | |
| noonedeadpunk | hm... I think you're right... | 12:27 |
| jrosser | single quotes inside double quotes is always a bad sign..... | 12:28 |
| jrosser | outerrim: the advice to see if guilhermesp has any tips is good, maybe wait for him to be around as i'm fairly sure he's done a deployment of a recent version on magnum | 12:30 |
| *** DanyC has quit IRC | 12:48 | |
| *** DanyC has joined #openstack-ansible | 13:05 | |
| *** DanyC has quit IRC | 13:10 | |
| *** DanyC has joined #openstack-ansible | 13:13 | |
| *** shyamb has quit IRC | 13:21 | |
| *** DanyC has quit IRC | 13:44 | |
| *** gokhani has quit IRC | 13:57 | |
| cjloader | morning | 14:24 |
| guilhermesp | outerrim: what does the heat logs says? | 14:40 |
| guilhermesp | i don't have fresh memories of the error right now tbh. But would be interesting to see what heat says and how your cluster template is defined | 14:41 |
| *** nurdie has joined #openstack-ansible | 15:37 | |
| *** DanyC has joined #openstack-ansible | 15:46 | |
| outerrim | @guilhermesp: Uups, looks that there is also some authentication problems. Pastet the logs from heat of a 'openstack coe cluster create ... | 15:50 |
| outerrim | http://paste.openstack.org/show/788039/ | 15:51 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_masakari master: Use py3 for CentOS https://review.opendev.org/701036 | 15:53 |
| outerrim | Installed heat also with OSA. Is there a need for a special configuration here? | 15:53 |
| noonedeadpunk | indeed, " Domain admin client authentication failed: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication." | 15:55 |
| noonedeadpunk | Has heat installation finished without errors? | 15:55 |
| noonedeadpunk | wondering if it's related to our usage of service_setup.yml... | 15:56 |
| *** cshen has quit IRC | 15:56 | |
| outerrim | Yes - no problems during installation. | 15:58 |
| noonedeadpunk | so I can suggest that smth may be wrong with users defenition here https://opendev.org/openstack/openstack-ansible-os_heat/src/branch/master/tasks/heat_service_setup.yml#L51-L72 | 16:02 |
| noonedeadpunk | this part is new in train | 16:02 |
| noonedeadpunk | but right now I don't have ability to test this out one more time.... | 16:03 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_heat stable/train: Noop change https://review.opendev.org/701038 | 16:04 |
| noonedeadpunk | so let's check what ci will say... | 16:04 |
| noonedeadpunk | cores, can we merge bumps? https://review.opendev.org/#/q/topic:bump_osa+status:open | 16:06 |
| noonedeadpunk | rocky needs this revert https://review.opendev.org/#/c/700925/ - I tried to workaround it for half of the day, but due to ours build-repo wasn't able to make it work | 16:08 |
| *** ahosam has quit IRC | 16:09 | |
| *** shyamb has joined #openstack-ansible | 16:13 | |
| *** shyamb has quit IRC | 16:46 | |
| *** gyee has joined #openstack-ansible | 17:03 | |
| *** rpittau is now known as rpittau|afk | 17:18 | |
| *** nurdie_ has joined #openstack-ansible | 17:31 | |
| *** DanyC has quit IRC | 17:32 | |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-ansible | 17:33 | |
| *** nurdie has quit IRC | 17:35 | |
| *** nurdie_ has quit IRC | 17:37 | |
| *** DanyC has joined #openstack-ansible | 17:37 | |
| *** DanyC has quit IRC | 17:38 | |
| *** hwoarang has quit IRC | 17:49 | |
| *** hwoarang has joined #openstack-ansible | 17:50 | |
| df_sbr | I'm running into a strange issue when running "openstack-ansible setup-infrastructure.yml". When the containers start to install and connect to the internal-vip, 2/3 of them get a connection refused response. Digging into this, on the infra hosts, they can ping the IP, but it appears to be pinging on the local host and not the actual host that currently holds the VIP. If I reboot the infra hosts, then I am able | 17:51 |
| df_sbr | to ping and connect to the host that currently owns the IP address. I just ran through an install yesterday where this didn't happen. I've tried a few times and have gotten mixed results. I'm on Ubuntu 18.04. | 17:51 |
| *** DanyC has joined #openstack-ansible | 18:13 | |
| *** DanyC has quit IRC | 18:18 | |
| jrosser | df_sbr: have you made sure that your internal-vip address is defined in 'used_ips'? | 18:21 |
| jrosser | would be worth checking that the dynamic inventory has not allocated it to something | 18:21 |
| jrosser | and then if thats all ok look at whats happening in the keepalived logs | 18:22 |
| *** DanyC has joined #openstack-ansible | 18:54 | |
| *** nurdie has joined #openstack-ansible | 18:55 | |
| *** DanyC has quit IRC | 18:59 | |
| *** nurdie_ has joined #openstack-ansible | 19:02 | |
| *** nurdie has quit IRC | 19:06 | |
| *** nurdie_ has quit IRC | 19:07 | |
| df_sbr | I've added the ip to 'used_ips' and I'm re-running the setup now. | 19:32 |
| *** ahosam has joined #openstack-ansible | 19:34 | |
| *** ansmith has joined #openstack-ansible | 19:46 | |
| *** ansmith_ has quit IRC | 19:48 | |
| *** dave-mccowan has quit IRC | 19:52 | |
| *** dave-mccowan has joined #openstack-ansible | 20:12 | |
| noonedeadpunk | I think you might need to drop existing used ips, as they're cahced and won't be updated | 20:25 |
| df_sbr | I started fresh from nothing. So far, so good. | 20:31 |
| openstackgerrit | Merged openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/700714 | 20:33 |
| *** tosky has quit IRC | 20:48 | |
| *** sshnaidm has joined #openstack-ansible | 21:28 | |
| *** DanyC has joined #openstack-ansible | 22:43 | |
| *** DanyC has quit IRC | 22:48 | |
| *** tosky has joined #openstack-ansible | 22:54 | |
| *** pcaruana has quit IRC | 22:59 | |
| *** DanyC has joined #openstack-ansible | 23:11 | |
| *** gyee has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!