| *** hongbin has quit IRC | 00:12 | |
| *** openstackgerrit has joined #openstack-containers | 00:51 | |
| openstackgerrit | Lingxian Kong proposed openstack/magnum master: Add load balancer hook for cluster pre-deletion https://review.openstack.org/620761 | 00:51 |
|---|---|---|
| *** jakeyip has quit IRC | 01:31 | |
| *** jakeyip has joined #openstack-containers | 01:35 | |
| *** ricolin has joined #openstack-containers | 02:21 | |
| *** hongbin has joined #openstack-containers | 02:28 | |
| *** ramishra has joined #openstack-containers | 02:53 | |
| *** rcernin has quit IRC | 02:58 | |
| *** ramishra has quit IRC | 03:04 | |
| *** ramishra has joined #openstack-containers | 03:06 | |
| *** rcernin has joined #openstack-containers | 03:38 | |
| *** chhagarw has joined #openstack-containers | 04:15 | |
| *** hongbin has quit IRC | 04:34 | |
| *** dave-mccowan has quit IRC | 04:34 | |
| *** dave-mccowan has joined #openstack-containers | 04:35 | |
| *** dave-mccowan has quit IRC | 04:49 | |
| *** udesale has joined #openstack-containers | 05:06 | |
| *** janki has joined #openstack-containers | 05:09 | |
| *** ykarel|away has joined #openstack-containers | 05:20 | |
| *** jackivanov has joined #openstack-containers | 05:49 | |
| *** ykarel|away has quit IRC | 06:02 | |
| *** ykarel|away has joined #openstack-containers | 06:16 | |
| *** ykarel|away is now known as ykarel|lunch | 06:20 | |
| *** Namrata has joined #openstack-containers | 06:27 | |
| *** mkrai has joined #openstack-containers | 06:28 | |
| Namrata | Hi folks, I am trying to create a kubernetes cluster which gets FAILED and I can see kube_masters in CREATE_FAILED state and I cant reach to the master node vm . | 06:29 |
| Namrata | how can I debug the actual failure | 06:29 |
| Namrata | strigazi: | 06:35 |
| Namrata | strigazi: can you help me with this | 06:35 |
| openstackgerrit | Jake Yip proposed openstack/magnum-tempest-plugin master: Add option for kubernetes coe https://review.openstack.org/601889 | 07:15 |
| *** shrasool has quit IRC | 07:18 | |
| jakeyip | Namrata, what does `openstack coe cluster show` says? Also, is the VM created OK? | 07:23 |
| jakeyip | the VM name is <cluster_name>-xxxx-master-0 , or you can trace via the heat stack | 07:23 |
| *** rcernin has quit IRC | 07:35 | |
| Namrata | jakeyip: `openstack coe cluster show` gives status `CREATE_FAILED` reason timeout and I can see the creation aborted at enable_promethus_monitoring_deployment | 07:42 |
| Namrata | jakeyip: openstack server list shows vm but I cant ssh into it and when I ping it says host unreachable | 07:43 |
| *** ykarel|lunch is now known as ykarel | 08:31 | |
| *** dims has quit IRC | 08:32 | |
| *** dims has joined #openstack-containers | 08:33 | |
| *** ttsiouts has joined #openstack-containers | 08:34 | |
| *** ttsiouts has quit IRC | 08:36 | |
| *** ttsiouts has joined #openstack-containers | 08:37 | |
| *** ttsiouts has quit IRC | 08:41 | |
| *** pcaruana has joined #openstack-containers | 08:48 | |
| *** ricolin has quit IRC | 09:07 | |
| jakeyip | Namrata: VM is state ACTIVE? | 09:08 |
| *** ttsiouts has joined #openstack-containers | 09:09 | |
| Namrata | jakeyip yes it is in ACTIVE state | 09:09 |
| jakeyip | Namrata: ok. what's your template like? on mine, with floating_ip_enabled = true and external_network_id = <floating>, I am able to ping. | 09:14 |
| kevko | Namrata: i know what is you issue | 09:15 |
| Namrata | kevko I am not sure but is it realted to https://bugs.launchpad.net/magnum/+bug/1744362 | 09:15 |
| openstack | Launchpad bug 1744362 in Magnum "heat-container-agent fails to communicate with Keystone." [Medium,Confirmed] | 09:15 |
| kevko | Namrata: you have to set label cert_manager_api=true when creating k8s cluster | 09:16 |
| kevko | i have another issue with magnum ...some scripts are not injected to instance | 09:17 |
| kevko | Namrata: your problem i was trying to solve for 4 days :D so i know what i am talking about :D | 09:17 |
| kevko | Namrata: try it | 09:18 |
| kevko | maybe it should be set by default ..but i am not sure .. | 09:18 |
| Namrata | kevko this label should be added in template or while cluter creation | 09:25 |
| Namrata | *cluster | 09:25 |
| kevko | Namrata: i was adding while creating cluster ... | 09:25 |
| Namrata | okay | 09:25 |
| kevko | Namrata: but, i think you can add also to template ... (didn't try ) | 09:26 |
| kevko | Namrata: can you please help me with my problem if you will have a time ? | 09:26 |
| Namrata | kevko I am newbie to this I am not sure I can help you | 09:33 |
| Namrata | and that label dosent work for me | 09:33 |
| kevko | Namrata: really ? | 09:36 |
| kevko | Namrata: hmm, in which step are you stuck now ? | 09:37 |
| *** kaiokmo has quit IRC | 09:38 | |
| *** DimGR has joined #openstack-containers | 09:40 | |
| openstackgerrit | Lingxian Kong proposed openstack/magnum master: Add load balancer hook for cluster pre-deletion https://review.openstack.org/620761 | 09:41 |
| *** shrasool has joined #openstack-containers | 09:44 | |
| *** jchhatbar has joined #openstack-containers | 10:02 | |
| *** janki has quit IRC | 10:05 | |
| *** ttsiouts has quit IRC | 10:05 | |
| *** ttsiouts has joined #openstack-containers | 10:05 | |
| *** ttsiouts has quit IRC | 10:08 | |
| *** ttsiouts has joined #openstack-containers | 10:08 | |
| kevko | guys, can you someone help me with magnum ? i have issues with softwaredeployment ...some scripts are not injected into instance .. | 10:18 |
| *** shrasool has quit IRC | 10:24 | |
| *** udesale has quit IRC | 10:27 | |
| *** sayalilunkad has quit IRC | 10:33 | |
| *** jchhatba_ has joined #openstack-containers | 10:37 | |
| *** lpetrut has joined #openstack-containers | 10:38 | |
| *** jchhatbar has quit IRC | 10:39 | |
| jakeyip | what's the problem kevko? | 10:40 |
| *** sayalilunkad has joined #openstack-containers | 11:12 | |
| *** ttsiouts has quit IRC | 11:24 | |
| *** ttsiouts has joined #openstack-containers | 11:24 | |
| *** jchhatbar has joined #openstack-containers | 11:30 | |
| *** ttsiouts has quit IRC | 11:32 | |
| *** jchhatba_ has quit IRC | 11:33 | |
| *** salmankhan has joined #openstack-containers | 11:35 | |
| kevko | jakeyip: some scripts are not executed | 11:38 |
| kevko | jakeyip: in log i have spam of this -> waiting for CA to be made available for certificate manager api | 11:38 |
| kevko | jakeyip: because script which is writing echo -e "$CA_KEY" > /etc/kubernetes/certs/ca.key i don't know why is not executed ...any advice ? | 11:39 |
| *** mkrai has quit IRC | 11:40 | |
| *** jchhatbar has quit IRC | 11:43 | |
| jakeyip | hm what's your cert_manager_type ? | 11:49 |
| kevko | jakeyip: barbican | 11:50 |
| kevko | jakeyip: i have all filled in /etc/sysconfig/heat-params , also CA_KEY ... and when i log into instance and manually echo CA_KEY to /etc/kubernetes/certs/ca.key ...everything after that is OK and cluster deployed ... | 11:51 |
| jakeyip | ok, I had similar problem before but using x509. check cloud-init-output and cloud-init and see if you can spot the part-xxx script tha fails | 11:52 |
| kevko | jakeyip: it is not problem with cert manager ..problem is that script in /var/lib/heat-config/heat-config-script/ is not executed | 11:52 |
| kevko | jakeyip: no, all parts script ran without issue | 11:52 |
| kevko | jakeyip: log from cloud-init.log http://paste.openstack.org/show/736394/ | 11:53 |
| kevko | jakeyip: but it is without issue only because i manually echoed CA_KEY into path above ... | 11:54 |
| kevko | jakeyip: without my manually action i have spam in log >> waiting for CA to be made available for certificate manager api >>>> /var/lib/cloud/instance/scripts/part-014 | 11:55 |
| kevko | jakeyip: in that script is that comment -> # if the certificate manager api is enabled, wait for the ca key to be handled # by the heat container agent (required for the controller-manager) | 11:55 |
| kevko | jakeyip: so if i understand correctly ..heat-container-agent should execute scripts in path /var/lib/heat-config/heat-config-script/ .... there is also script with echo CA_KEY ...i don't know why ..but this step is missing | 11:56 |
| *** ttsiouts has joined #openstack-containers | 11:58 | |
| kevko | jakeyip: how can i debug this behaviour ? | 11:59 |
| jakeyip | so CA_KEY is already populated in /etc/sysconfig/heat-params and CERT_MANAGER_API is True ? | 12:02 |
| kevko | jakeyip: yes, of course | 12:03 |
| kevko | jakeyip: in ps of instance i can see this >> http://paste.openstack.org/show/736396/ | 12:04 |
| kevko | jakeyip: as u can see part-014 is running in infinity loop | 12:05 |
| jakeyip | hmm why is it sleeping in /var/lib/heat-config/heat-config-script/b58e667a-6bfe-4b04-9686-ff27a896981 | 12:05 |
| kevko | jakeyip: paste-014 is this -> http://paste.openstack.org/show/736397/ | 12:05 |
| *** dav_id has joined #openstack-containers | 12:12 | |
| *** salmankhan1 has joined #openstack-containers | 12:16 | |
| *** salmankhan has quit IRC | 12:16 | |
| *** salmankhan1 is now known as salmankhan | 12:16 | |
| dav_id | Hi, in OSA Queens 17.1.2 i try to deploy wiht Magnum, a kubernetes Cluster, but in the Magnum Heat Template, there is a false auth_url in the Template: auth_url = https://public-ip:5000 in /etc/sysconfig/heat-params should be auth_url = https://public-ip:5000/v3 . | 12:20 |
| dav_id | At the end /v3 is missing, is it a known Bug or any way to override it? | 12:20 |
| dav_id | I try to solve it since yesterday, help would be very appreciated. | 12:21 |
| kevko | dav_id: i think this value is taken from magnum.conf , isn't it ? | 12:21 |
| dav_id | i can show you my magnum conf, it look simular to other configs, like in cinder.conf | 12:22 |
| kevko | dav_id: show, use paste.openstack.org please | 12:22 |
| dav_id | Of course, thats my magnum.conf http://paste.openstack.org/show/736398/ | 12:25 |
| *** dodo_o has joined #openstack-containers | 12:28 | |
| kevko | dav_id: did you mean /etc/os-collect-config.con ? , because i don't have auth_url in /etc/sysconfig/heat-params | 12:29 |
| *** ttsiouts has quit IRC | 12:30 | |
| *** ttsiouts has joined #openstack-containers | 12:31 | |
| *** ttsiouts has quit IRC | 12:32 | |
| *** ttsiouts has joined #openstack-containers | 12:32 | |
| dav_id | Here you can have a look at /etc/sysconfig/heat-params http://paste.openstack.org/show/736400/ | 12:34 |
| dav_id | In there under AUTH_URL="https://10.10.90.10:5000" the /v3 is missing, cousing the issue, i have changed i manually, after that i works fine. But don't konw where to override it, maybe in magnum.conf? | 12:35 |
| *** Nel1x has joined #openstack-containers | 12:38 | |
| kevko | dav_id: set your auth_uri to /v3 format | 12:43 |
| kevko | dav_id: all auth_uri in your magnum config ..not auth_url ..but auth_uri | 12:43 |
| dav_id | But auth_uri in my mangum config is already at /v3: auth_uri = http://10.10.90.9:5000/v3 | 12:45 |
| dav_id | the auth_url is without /v3: auth_url = http://10.10.90.9:5000 | 12:45 |
| jakeyip | looks similar to mine. another thing to check will be endpoint announced by catalog `openstack catalog list` | 12:47 |
| kevko | dav_id: add [clients_keystone] section with auth_uri | 12:48 |
| kevko | jakeyip: what about my problem ? :) | 12:48 |
| jakeyip | kevko: I had replied with question about sleep? | 12:49 |
| kevko | jakeyip: oh sorry , didn't see | 12:50 |
| kevko | jakeyip: echo "Waiting for Kubernetes API..." | 12:51 |
| jakeyip | hmm, don't think k8s can start if it's still waiting for ca info...? wonder if it's some ordering bug... | 12:54 |
| kevko | jakeyip: for me it sound already as a bug | 12:55 |
| jakeyip | can't debug on my side, sorry, I'm not doing cert_maanger_api | 12:55 |
| *** Namrata has quit IRC | 12:55 | |
| jakeyip | guessing the heat script to populate the ca.key sound go first, then cloud-init can continue, then rest of heat-scripts ? | 12:56 |
| kevko | jakeyip: only issue is that script which is echoeing CA_KEY to /etc/kubernetes/certs/ca.key is not executed | 12:56 |
| kevko | jakeyip: yes ! exactly | 12:56 |
| kevko | jakeyip: but i don't have big knowledge of things ..i am greping greping greping ..see logs ..but don't know hot to make some "order" of scripts .... :/ | 12:57 |
| kevko | jakeyip: btw, i'm using rocky version | 12:57 |
| kevko | jakeyip: stable | 12:57 |
| jakeyip | I guess a good start will be start tracing the ps that eventually launches the heat-config/ scripts, e.g. /var/lib/heat-config/hooks/script | 13:02 |
| kevko | jakeyip: yes, agree, now i'm creating new cluster | 13:03 |
| kevko | jakeyip: if you are interested , i can give you access to instance :) | 13:04 |
| kevko | jakeyip: or my openstack | 13:04 |
| kevko | jakeyip: it is only dev .. | 13:04 |
| jakeyip | I'll have to pass for now, it's past midnight here | 13:05 |
| jakeyip | zzz time :) | 13:05 |
| kevko | jakeyip: :D | 13:05 |
| kevko | jakeyip: i was wondering why noone is here always :D | 13:05 |
| jakeyip | :) good luck. I will look into it a bit more when I can... | 13:05 |
| kevko | jakeyip: thank you for your time :) | 13:06 |
| jakeyip | now worries | 13:06 |
| dodo_o | kevko: dav_id went to a meeting, i'll take over. :) setting [clients_keystone] auth_url to https://10.10.90.10:5000/v3 did not change the parameters that are deployed to the kube-master. this causes the part-011 script to fail, which creates the server.crt | 13:12 |
| kevko | dodo_o: i said auth_uri :) | 13:13 |
| kevko | dodo_o: no auth_url | 13:13 |
| dodo_o | kevko: uh.. thats what i meant. it's right in the config :) | 13:14 |
| *** kaiokmo has joined #openstack-containers | 13:31 | |
| kevko | dodo_o: your colleguage sent the config .. http://paste.openstack.org/show/736398/ and it isn't | 13:34 |
| *** shrasool has joined #openstack-containers | 13:34 | |
| *** janki has joined #openstack-containers | 13:35 | |
| dodo_o | kevko: correct, but I just added [clients_keystone] auth_uri = https://10.10.90.10:5000/v3 to magnum.conf and tried to create a new kubernetes cluster | 13:36 |
| *** salmankhan has quit IRC | 13:36 | |
| kevko | dodo_o: did you restart ? | 13:36 |
| dodo_o | kevko: yes, of course | 13:37 |
| *** ttsiouts has quit IRC | 13:37 | |
| *** dav_id has quit IRC | 13:37 | |
| *** shrasool has quit IRC | 13:38 | |
| kevko | dodo_o: hmm , so don't know , maybe tcpdump and see what do you have in catalog ? | 13:39 |
| kevko | dodo_o: maybe this will help ? https://review.openstack.org/#/c/615916/1/templates/heat.conf.j2 | 13:40 |
| *** shrasool has joined #openstack-containers | 13:50 | |
| dodo_o | kevko: that sounds promising. i'll give it a try. | 13:50 |
| dodo_o | kevko: thanks a lot :) | 13:51 |
| kevko | dodo_o: but i really don't know if it will help ...which version are u using now ? | 13:51 |
| dodo_o | kevko: we're currently on osa 17.1.2, so all the URIs in heat.conf are set to the internal ip. | 13:58 |
| kevko | osa ? | 13:58 |
| kevko | what is osa .. | 13:58 |
| dodo_o | kevko: openstack ansible :) | 14:00 |
| *** zul has quit IRC | 14:00 | |
| *** salmankhan has joined #openstack-containers | 14:04 | |
| kevko | dodo_o: oh, nice ...our company will release our own deployment in some time | 14:05 |
| kevko | dodo_o: salt :) | 14:05 |
| *** zul has joined #openstack-containers | 14:16 | |
| kevko | guys ..do anyone now ..how to change the order of running deployment software ? | 14:27 |
| *** ttsiouts has joined #openstack-containers | 14:30 | |
| *** ttsiouts has quit IRC | 14:47 | |
| *** ttsiouts has joined #openstack-containers | 14:48 | |
| *** ttsiouts has quit IRC | 14:48 | |
| *** ttsiouts has joined #openstack-containers | 14:49 | |
| *** udesale has joined #openstack-containers | 14:58 | |
| *** lpetrut has quit IRC | 14:58 | |
| *** hongbin has joined #openstack-containers | 15:05 | |
| *** ricolin has joined #openstack-containers | 15:10 | |
| *** ykarel is now known as ykarel|away | 15:11 | |
| *** ykarel|away has quit IRC | 15:15 | |
| *** zul has quit IRC | 15:18 | |
| *** udesale has quit IRC | 15:29 | |
| *** udesale has joined #openstack-containers | 15:29 | |
| *** ykarel|away has joined #openstack-containers | 15:32 | |
| *** ttsiouts has quit IRC | 15:32 | |
| *** ttsiouts has joined #openstack-containers | 15:33 | |
| *** ykarel|away is now known as ykarel | 15:34 | |
| *** shrasool has quit IRC | 15:36 | |
| *** ttsiouts has quit IRC | 15:37 | |
| *** itlinux has quit IRC | 15:38 | |
| *** ramishra has quit IRC | 15:39 | |
| *** ttsiouts has joined #openstack-containers | 15:52 | |
| *** munimeha1 has joined #openstack-containers | 15:53 | |
| *** udesale has quit IRC | 16:20 | |
| *** janki has quit IRC | 16:24 | |
| *** ricolin has quit IRC | 16:26 | |
| *** ykarel is now known as ykarel|away | 16:33 | |
| *** ttsiouts has quit IRC | 16:51 | |
| *** ttsiouts has joined #openstack-containers | 16:52 | |
| *** itlinux has joined #openstack-containers | 16:54 | |
| *** ttsiouts has quit IRC | 16:56 | |
| *** ykarel|away has quit IRC | 17:53 | |
| *** salmankhan has quit IRC | 18:16 | |
| *** chhagarw has quit IRC | 18:53 | |
| *** lpetrut has joined #openstack-containers | 18:58 | |
| *** chhagarw has joined #openstack-containers | 19:06 | |
| *** shrasool has joined #openstack-containers | 19:26 | |
| *** chhagarw has quit IRC | 19:48 | |
| *** shrasool has quit IRC | 19:48 | |
| *** shrasool has joined #openstack-containers | 19:49 | |
| *** shrasool has quit IRC | 19:51 | |
| *** itlinux has quit IRC | 19:56 | |
| *** kevko_ has joined #openstack-containers | 19:59 | |
| kevko_ | hi guys , found bug in magnum 7.0.2 | 20:00 |
| kevko_ | heat-container-agent with tag rocky-stable not working | 20:00 |
| kevko_ | heat-container-agent with tag rawhide is working | 20:00 |
| *** kevko_ has quit IRC | 20:06 | |
| *** shrasool has joined #openstack-containers | 20:18 | |
| *** shrasool has quit IRC | 20:19 | |
| *** kevko_ has joined #openstack-containers | 20:35 | |
| kevko_ | strigazi: hi, strigazi ... could you please fix heat-container-agent:rocky-stable ? it is not working with magnum in 7.0.2, rawhide is working | 20:36 |
| *** kevko_ has quit IRC | 20:44 | |
| flwang | kevko: what's the issue? | 20:59 |
| flwang | we can't just update the image only when somebody says it's not working, we need to know the root cause and fix it | 21:00 |
| flwang | rowhide has a multi region bug, we can't just rallback, we need to fix issue | 21:00 |
| *** kevko_ has joined #openstack-containers | 21:01 | |
| kevko_ | hi, is someone here online ? :) | 21:01 |
| *** ivve has quit IRC | 21:01 | |
| flwang | kevko_: what's the your problem in heat-container-agent? | 21:08 |
| kevko_ | flwang: it is not running scripts | 21:08 |
| kevko_ | flwang: rawhide is running OK | 21:08 |
| *** hongbin_ has joined #openstack-containers | 21:09 | |
| kevko_ | flwang: i can give you a log from both | 21:09 |
| flwang | we can't rollback to rowhide | 21:09 |
| *** hongbin_ has quit IRC | 21:09 | |
| flwang | version 'rowhide' has a multi region bug | 21:09 |
| *** hongbin has quit IRC | 21:10 | |
| flwang | i suggest using x509 as the cert manager and try again, i think there could be a bug of integration with barbican | 21:10 |
| *** hongbin has joined #openstack-containers | 21:10 | |
| flwang | kevko_: ^ | 21:12 |
| kevko_ | flwang: oh, ..so i should try with x509 and it should work ? | 21:13 |
| kevko_ | flwang: but if i remember correct ..it was ok with certs and keys inside the instance | 21:14 |
| flwang | kevko_: it should, but i will continually testing the barbican case and will fix any issue if there is | 21:14 |
| flwang | kevko_: it definitely should work, but I don't have barbican env now, so i can't help reproduce | 21:15 |
| flwang | so for now, it's better that you just change the cert manager type and let's narrow the problem scope | 21:15 |
| flwang | if x509 works for you, then we know barbican case has bug | 21:15 |
| flwang | does that make sense for you? | 21:15 |
| kevko_ | flwang: yes | 21:17 |
| kevko_ | flwang: i can give you access to my test dev if you want :) | 21:17 |
| flwang | kevko_: let's try x509 first, if it still doesn't work, then i'm happy to debug your instance | 21:18 |
| flwang | kevko_: just curious, are you going to deploy magnum in your prod? | 21:19 |
| kevko_ | flwang: yes , we want | 21:19 |
| kevko_ | flwang: i'm also debian maintainer for openstack packages in debian | 21:19 |
| kevko_ | flwang: so i'm creating working packages for debian :) | 21:19 |
| flwang | cool | 21:19 |
| flwang | is your env public cloud or private? | 21:20 |
| kevko_ | flwang: public | 21:20 |
| flwang | cool | 21:20 |
| flwang | we (catalyst cloud) have deployed stable rocky on our prod, and it just works | 21:21 |
| kevko_ | flwang: btw, i provided fix for python3 compatibility | 21:21 |
| kevko_ | flwang: https://review.openstack.org/#/c/618756/ | 21:21 |
| flwang | but we don't have barbican, so that's why i'm not sure if there is a bug | 21:21 |
| flwang | kevko_: oh, i saw that patch, but i haven't got time to test, thank you for the contribution | 21:22 |
| flwang | i'm adding it to my list | 21:22 |
| kevko_ | flwang: catalyst ? i was near your place in market place ...or i was on some talk maybe ...don't remember ..in Berlin .. | 21:23 |
| kevko_ | flwang: debian is using only python3 version of all projects | 21:23 |
| flwang | we don't have booth at Berlin, so you should be in our session at Berlin | 21:24 |
| kevko_ | flwang: we switched during the queens | 21:24 |
| flwang | kevko_: got | 21:24 |
| kevko_ | flwang: Failed to create certificates for Cluster: 01e0b8e8-dbcd-4263-9aed-6eb064d13269 | 21:26 |
| flwang | can you pls show me the log of cloud-init-output.log | 21:27 |
| *** kevko__ has joined #openstack-containers | 21:31 | |
| kevko__ | flwang: do i need to do something more than switch config in magnum.conf ? | 21:32 |
| *** kevko_ has quit IRC | 21:32 | |
| kevko__ | flwang: i have still --label cert_manager_api=true , should i turn off this ? ...sorry ..my knowledge of magnum is not still good ... :) just starting | 21:32 |
| flwang | kevko__: just remove the label, i assume default it's false | 21:34 |
| flwang | or set it as Flase | 21:34 |
| kevko__ | flwang: actually , what is it ? | 21:34 |
| kevko__ | flwang: i was unable to build cluster without it ... found in this papermail ... let me provide | 21:35 |
| kevko__ | flwang: http://lists.openstack.org/pipermail/openstack-dev/2018-August/133721.html | 21:35 |
| flwang | i don't know joe's env, but we don't use it by default, and by default it's false | 21:37 |
| flwang | so let's try set it false or remove it | 21:37 |
| kevko__ | flwang: ok | 21:39 |
| kevko__ | flwang: i've created two cluster ..without and with label ..so will see | 21:39 |
| kevko__ | flwang: will let you know when it will be completed/failed ... | 21:40 |
| flwang | thanks | 21:41 |
| kevko__ | flwang: to which time you will be here ? | 21:42 |
| flwang | now it's 10:42AM for me | 21:43 |
| flwang | i should be available in next 1 hour | 21:43 |
| kevko__ | flwang: for me it is 10:42 PM :) | 21:43 |
| kevko__ | flwang: ok, my env is nested openstack in openstack | 21:44 |
| kevko__ | flwang: and currently my colleguage is doing some upgrade ... | 21:44 |
| kevko__ | flwang: so maybe it will take some time | 21:44 |
| kevko__ | flwang: give me 15 minutes .. i have to move to another place | 21:44 |
| *** kevko__ has quit IRC | 21:45 | |
| flwang | no rush, man | 21:46 |
| flwang | I'm based in NZ | 21:47 |
| *** rcernin has joined #openstack-containers | 21:57 | |
| *** kevko_ has joined #openstack-containers | 22:15 | |
| kevko_ | flwang: i'm back | 22:15 |
| flwang | yes | 22:16 |
| kevko_ | flwang: failed to create certificates | 22:17 |
| kevko_ | flwang: let me check magnum log | 22:17 |
| kevko_ | flwang: http://paste.openstack.org/show/736451/ | 22:19 |
| flwang | has the stack/master been created? | 22:20 |
| kevko_ | flwang: i can't see heat stack | 22:21 |
| kevko_ | flwang: so, i think this will be also **maybe** python3 related bug | 22:22 |
| kevko_ | flwang: it is failing somewhere on the way towards heat .. | 22:22 |
| kevko_ | flwang: let me write some debug messages in a code | 22:22 |
| flwang | can you run openstack coe cluster show <id> to see the failed reason? | 22:23 |
| kevko_ | flwang: failed to create certificates for Cluster: [ ID of cluster ] | 22:25 |
| flwang | can you see any error in condutor? | 22:26 |
| kevko_ | flwang: yes , as i said ..it is python3 issue | 22:29 |
| kevko_ | flwang: bytes vs string ..python2 vs python3 | 22:29 |
| flwang | ok, then hot fix it and try again? | 22:29 |
| kevko_ | flwang: ValueError: A string is required in field certificate, not a bytes | 22:30 |
| kevko_ | flwang: yes ..going to do .. | 22:30 |
| kevko_ | flwang: but ..as i said ..now my colleguage upgrading openstack above my openstack ..so i'm loosing my connection ..because of virt routers migrating ..process of migrating neutron run now ...but i'm working via spice console :D :D :D | 22:31 |
| flwang | no rush | 22:32 |
| kevko_ | flwang: maybe it will be better if i will chat you tomorrow ... you are leaving in a while , aren't you ? | 22:50 |
| kevko_ | flwang: now i don't have good connection into instance | 22:51 |
| flwang | ok | 22:55 |
| flwang | see you next Monday :) | 22:55 |
| kevko_ | flwang: next monday ? | 22:57 |
| kevko_ | flwang: ok then :) | 22:57 |
| kevko_ | flwang: i will be here tomorrow also, who can i contact with python3 issues ? | 22:57 |
| flwang | if it's confirmed your patch works, then we can merge it | 22:58 |
| jakeyip | where are you based kevko_ ? | 23:06 |
| kevko_ | jakeyip: czech republic :) , but working all the time :) | 23:06 |
| kevko_ | jakeyip: from morning to morning :) | 23:06 |
| jakeyip | kevko_: Hi from AU over here :) | 23:06 |
| *** lpetrut has quit IRC | 23:07 | |
| kevko_ | jakeyip: did you mean australia ? :) | 23:07 |
| jakeyip | kevko_: yes | 23:07 |
| kevko_ | jakeyip: oh, nice :) | 23:07 |
| kevko_ | jakeyip: but I am originally from Slovakia :) | 23:07 |
| jakeyip | nice :) hope we can meet up at one of the summits one day | 23:10 |
| kevko_ | jakeyip: i was in Berlin now :) | 23:13 |
| kevko_ | jakeyip: as I am debian maintainer also for Openstack, maybe i will be in Brazilia on DebConf ..so maybe there ..if you will be there guys | 23:14 |
| jakeyip | ha don't think... my travel privs doesn't extend that far :P | 23:22 |
| kevko_ | jakeyip: have you been in berlin ? | 23:26 |
| jakeyip | yeah I did go to Berlin | 23:39 |
| *** munimeha1 has quit IRC | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!