Thursday, 2019-10-24

*** sapd1 has joined #openstack-containers00:08
*** sapd1 has quit IRC00:16
openstackgerritMerged openstack/magnum stable/train: heat-agent: Check if scripts exists  https://review.opendev.org/69076001:38
openstackgerritMerged openstack/magnum master: k8s_fedora: Add use_podman label  https://review.opendev.org/69005301:38
openstackgerritMerged openstack/magnum master: Use v1.15.0 as default octavia_ingress_controller_tag  https://review.opendev.org/68972201:38
*** spsurya has joined #openstack-containers01:59
*** ricolin has joined #openstack-containers02:12
*** ykarel has joined #openstack-containers03:11
*** mrdoug has joined #openstack-containers03:49
*** ykarel has quit IRC03:54
*** mrdoug has quit IRC03:55
*** mrdoug has joined #openstack-containers03:55
*** ykarel has joined #openstack-containers04:15
*** jerryz has quit IRC04:20
*** udesale has joined #openstack-containers04:38
openstackgerritcaoyuan proposed openstack/magnum master: tox: Keeping going with docs  https://review.opendev.org/69080305:35
openstackgerritcaoyuan proposed openstack/magnum-ui master: tox: Keeping going with docs  https://review.opendev.org/69080805:49
openstackgerritcaoyuan proposed openstack/magnum-tempest-plugin master: tox: Keeping going with docs  https://review.opendev.org/69081005:51
*** udesale has quit IRC06:01
*** udesale has joined #openstack-containers06:10
*** ykarel is now known as ykarel|afk06:15
brtknrhttps://review.opendev.org/#/c/690764/ This one too flwang1 :) morning btw06:23
*** pcaruana has joined #openstack-containers06:41
*** mrdoug has quit IRC07:06
*** mrdoug has joined #openstack-containers07:07
*** ttsiouts has joined #openstack-containers07:15
openstackgerritcaoyuan proposed openstack/magnum master: tox: Keeping going with docs  https://review.opendev.org/69080307:18
*** ttsiouts has quit IRC07:26
*** ttsiouts has joined #openstack-containers07:26
*** ttsiouts has quit IRC07:31
*** ykarel|afk is now known as ykarel07:31
*** trident has quit IRC07:46
*** mrdoug has quit IRC07:48
*** mrdoug has joined #openstack-containers07:49
*** trident has joined #openstack-containers07:51
*** ttsiouts has joined #openstack-containers07:57
openstackgerritMerged openstack/magnum master: No new NGs for clusters without an api_address  https://review.opendev.org/68840008:29
openstackgerritBharat Kunwar proposed openstack/magnum stable/train: No new NGs for clusters without an api_address  https://review.opendev.org/69087808:30
*** ykarel is now known as ykarel|lunch08:31
openstackgerritSpyros Trigazis proposed openstack/magnum master: coreos: Use heat params for heat-agent image  https://review.opendev.org/69001108:34
brtknrstrigazi: we need this https://review.opendev.org/#/c/690760 on train because of the reboot issue08:44
openstackgerritSpyros Trigazis proposed openstack/magnum stable/train: k8s_fedora: Add use_podman label  https://review.opendev.org/69088208:46
openstackgerritSpyros Trigazis proposed openstack/magnum stable/train: [fedora-atomic][k8s] Support operating system upgrade  https://review.opendev.org/69088308:47
openstackgerritSpyros Trigazis proposed openstack/magnum stable/train: k8s_fedora: Add use_podman label  https://review.opendev.org/69088208:50
*** ykarel|lunch is now known as ykarel09:25
openstackgerritMerged openstack/magnum stable/train: Failed state was ignored for default ngs  https://review.opendev.org/69076409:29
*** mrdoug has quit IRC09:46
openstackgerritMerged openstack/magnum master: Docker volume size from nodegroups  https://review.opendev.org/68787910:06
*** udesale has quit IRC10:19
*** ttsiouts has quit IRC10:20
*** ttsiouts has joined #openstack-containers10:21
*** ttsiouts has quit IRC10:25
openstackgerritMerged openstack/magnum master: coreos: Use heat params for heat-agent image  https://review.opendev.org/69001110:31
*** ykarel_ has joined #openstack-containers10:40
*** ykarel has quit IRC10:43
openstackgerritMerged openstack/magnum stable/train: No new NGs for clusters without an api_address  https://review.opendev.org/69087810:44
*** udesale has joined #openstack-containers10:44
*** ykarel_ is now known as ykarel10:45
*** ttsiouts has joined #openstack-containers11:06
*** ttsiouts has quit IRC11:18
*** ttsiouts has joined #openstack-containers11:19
*** ttsiouts_ has joined #openstack-containers11:23
*** ttsiouts has quit IRC11:23
*** janki has joined #openstack-containers11:44
*** dave-mccowan has joined #openstack-containers11:55
*** dave-mccowan has quit IRC12:00
*** ykarel is now known as ykarel|afk12:15
*** iokiwi has quit IRC12:51
*** goldyfruit has joined #openstack-containers13:00
*** ykarel|afk is now known as ykarel13:02
*** ttsiouts_ has quit IRC13:11
*** ttsiouts has joined #openstack-containers13:12
*** janki has quit IRC13:13
*** ttsiouts has quit IRC13:16
*** ttsiouts has joined #openstack-containers13:18
openstackgerritTheodoros Tsioutsias proposed openstack/magnum stable/train: Docker volume size from nodegroups  https://review.opendev.org/69097313:19
*** ykarel is now known as ykarel|afk13:29
*** spsurya has quit IRC13:29
*** ykarel|afk is now known as ykarel13:48
*** ykarel has quit IRC14:18
*** mrdoug has joined #openstack-containers14:19
*** pcaruana has quit IRC14:19
*** ykarel has joined #openstack-containers14:20
*** mrdoug has quit IRC14:38
*** mrdoug has joined #openstack-containers14:39
*** jmlowe has quit IRC14:44
*** mrdoug has quit IRC14:48
*** mrdoug has joined #openstack-containers14:55
*** mrdoug has quit IRC14:58
*** mrdoug has joined #openstack-containers15:00
*** jmlowe has joined #openstack-containers15:00
*** gouthamr_ is now known as gouthamr15:01
*** yolanda has quit IRC15:03
*** yolanda has joined #openstack-containers15:11
*** mrdoug has quit IRC15:14
*** mrdoug has joined #openstack-containers15:40
*** mrdoug has quit IRC15:40
*** mrdoug has joined #openstack-containers15:50
*** ykarel is now known as ykarel|away15:53
*** goldyfruit has quit IRC15:54
*** ttsiouts has quit IRC15:54
*** ttsiouts has joined #openstack-containers15:55
*** mrdoug has quit IRC15:55
*** goldyfruit has joined #openstack-containers15:56
*** ttsiouts has quit IRC15:59
brtknrstrigazi: Have you seen this before? Error from server: no preferred addresses found; known addresses: []16:03
brtknrboth calico and flannel are doing this... in stein 8.1.016:09
brtknrI am guessing its a symptom of something else16:09
*** ianychoi has joined #openstack-containers16:21
*** jmlowe has quit IRC16:29
*** ykarel|away has quit IRC16:33
*** spiette has quit IRC16:52
*** spiette has joined #openstack-containers16:55
*** udesale has quit IRC17:13
*** henriqueof has joined #openstack-containers17:25
henriqueofJust to make sure: If I update the cluster so it have more worker nodes there is no risk of losing data, right?17:25
brtknrhenriqueof henriqueof henriqueof: not normally17:28
henriqueofWell, just got an update failed messag.17:35
henriqueofEverything seems to be working but I don't know what to do now.17:36
henriqueofI requested more nodes but it failed with not enough memory resources, but I have other servers with tons of free memory.17:36
henriqueofNow I can't call update naymore, any sugestions?17:38
*** jerryz has joined #openstack-containers17:48
*** jmlowe has joined #openstack-containers17:48
henriqueofAnyone can help? How can I revert a failed update to a cluster?17:53
*** ricolin has quit IRC17:55
*** jmlowe has quit IRC19:41
goldyfruithenriqueof, update into the database ?19:43
henriqueofgoldyfruit: Thanks for taking the time to reply! I sent the update command again via CLI, looks like the problem happens just when using Horizon.19:44
henriqueofIt worked. :)19:44
goldyfruitCool!19:52
*** jmlowe has joined #openstack-containers19:54
*** goldyfruit_ has joined #openstack-containers19:57
*** goldyfruit has quit IRC19:59
*** iokiwi has joined #openstack-containers20:08
*** colby_ has joined #openstack-containers20:12
*** KeithMnemonic has quit IRC20:41
*** KeithMnemonic has joined #openstack-containers20:52
brtknrflwang: you there?21:03
flwangbrtknr: yes21:04
brtknri need some help debugging a cluster spawned using 8.1.0 tag21:04
brtknrit is probably a more general question21:04
brtknrbut what are the reasons nodes in a cluster may not have InternalIP or ExternalIP21:05
brtknrflwang: ^21:05
brtknrneither*21:05
flwang8.1.0 is stein?21:06
flwangthen i think it's related to those patches we backport recently21:06
flwangwe're using stein without trouble so far21:06
flwangfor example, we have backport patches from 1...N, then swith to N/2  to try to reproduce21:07
flwangthen N/4 or 3N/421:07
flwangyou will be able to find the patch which is causing problem21:08
brtknrflwang: 8.1.0 is working for us in 3 different sites but failed at one site21:10
brtknrflwang: the weird thing about the site where its failing is that the when i do kubectl get nodes -o wide, i do not see any InternalIP21:11
brtknrthis fails for both flannel and calico21:11
flwangthat sounds familiar for me21:12
flwangbut if it works for your 3 sites, then the best person to debug it is you :)21:13
flwangyou may have to figure out the difference between your regions/sites21:13
brtknrflwang: yes, thats what im trying to do :)21:14
brtknrflwang: just saw this in the heat-container-agent log: raise exceptions.EndpointNotFound(msg)\nkeystoneauth1.exceptions.catalog.EndpointNotFound: publicURL endpoint for orchestration service in None region not found21:21
flwanglooks like a config issue21:22
flwangcheck your magnum conf and heat conf21:22
brtknrflwang: thanks21:24
flwangnp21:25
brtknrflwang: looks like we are almost ready to cut a release21:27
flwangbrtknr: yes, thank you very much21:28
flwangwe can't finish this release without you, brtknr21:29
brtknrflwang: haha that is not 100% true but thank you :)21:30
flwangi'm 100% sure it's true :)21:30
brtknrflwang: we need this: https://review.opendev.org/#/c/690973/121:32
brtknrflwang: i wonder what we are going to do in the next cycle21:32
openstackgerritMerged openstack/magnum stable/train: [fedora-atomic][k8s] Support operating system upgrade  https://review.opendev.org/69088321:33
flwangbrtknr: one big feature i'd like to support is resizing master and containerized master21:33
flwangtwo features, sorry, haha21:33
brtknrresizing number of masters?21:34
flwangyes21:34
flwangand we do need polish the fedora coreos driver as well21:35
brtknrhmm strangely i thought we could already do that!21:35
flwangbrtknr: we can't at this moment21:35
brtknrresize master21:35
flwangyou can try and i hope i'm wrong21:36
brtknrsounds like21:36
brtknra good thing to have anyway21:36
flwangcontainerized master nodes - managed master nodes by a root k8s cluster is the most exciting feature i'd like to introduce in U21:36
brtknrflwang: i will need to try and get a better sense for in what way it would be containerised :)21:38
*** goldyfruit_ has quit IRC21:38
brtknrarent we already running master node services in containers? what do you actually mean? im sure ive misunderstood it21:38
flwangrunning k8s components as pods in another "root" k8s cluster21:39
flwangso user don't have to worry about the master nodes, and only pay for the work nodes21:39
flwangdoes that make sense?21:39
flwangas you can see on GKE, EKS, etc21:39
brtknrahhh... master node as a service kind of thing?21:40
flwangnot really21:40
flwangthat means as a user, you can choose to create a fully managed k8s cluster, or a "full" k8s cluster21:41
flwangwhen it's fully managed, user can't see the master nodes21:41
brtknrflwang: that makes sense21:41
flwangall etcd, kube-apiserver, kube-scheduler, etc are manged as pod in another "root" k8s cluster, user can't see it21:42
flwangbecause the root k8s cluster is managed by the cloud provider21:42
flwangjust like the amphor node of octavia lb21:42
flwangfor  a full k8s cluster, you can get what you can get now, both master and worker nodes21:43
flwangthat's important for public clouds21:43
brtknrok so it would be like having a master node in another project?21:43
flwangbecause we need to lower the cost21:43
brtknror would a single master node manage multiple clusters?21:43
flwangbrtknr: no21:43
flwangfor that case, think your master as an app running on another k8s cluster21:44
openstackgerritMerged openstack/magnum stable/train: k8s_fedora: Add use_podman label  https://review.opendev.org/69088221:48
*** rcernin has quit IRC22:03
*** goldyfruit has joined #openstack-containers22:03
*** rcernin has joined #openstack-containers23:13
*** mrdoug has joined #openstack-containers23:13
*** mrdoug has quit IRC23:19
*** henriqueof has quit IRC23:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!