Thursday, 2019-09-12

*** iokiwi has quit IRC00:11
*** goldyfruit_ has joined #openstack-containers00:12
*** henriqueof has joined #openstack-containers00:45
*** henriqueof1 has quit IRC00:46
*** ivve has quit IRC00:47
*** ricolin has joined #openstack-containers00:48
*** henriqueof1 has joined #openstack-containers00:56
*** henriqueof has quit IRC00:57
*** henriqueof1 has quit IRC01:05
*** henriqueof has joined #openstack-containers01:05
*** pcaruana has quit IRC01:09
*** ykarel|away has joined #openstack-containers03:13
jakeyipflwang:  wondering if you are around?03:25
openstackgerritJake Yip proposed openstack/magnum master: Return default quota from API  https://review.opendev.org/67378203:30
flwangjakeyip: what's up?03:57
flwangjakeyip: pls send me an email if it's urgent, flwang at catalyst.net.nz03:57
*** KeithMnemonic has quit IRC04:04
*** ykarel|away is now known as ykarel04:06
*** sapd1_x has joined #openstack-containers04:23
*** trungnv has joined #openstack-containers04:24
*** ricolin has quit IRC04:27
jakeyipflwang:  nothing important, wanted to ask you if an update to https://review.opendev.org/673782 is ok since it's already workflow +1. but I've already gone and done it04:29
*** udesale has joined #openstack-containers04:31
*** pcaruana has joined #openstack-containers04:32
*** dave-mccowan has quit IRC04:57
*** pcaruana has quit IRC04:58
*** sapd1_x has quit IRC05:13
*** ykarel has quit IRC05:27
*** ramishra has joined #openstack-containers05:31
*** ykarel has joined #openstack-containers05:40
*** pcaruana has joined #openstack-containers06:08
*** pcaruana has quit IRC06:41
*** ricolin has joined #openstack-containers06:41
*** ricolin has quit IRC06:59
*** arbrandes has quit IRC07:00
*** arbrandes has joined #openstack-containers07:01
*** ivve has joined #openstack-containers07:07
*** spsurya has joined #openstack-containers07:07
*** pcaruana has joined #openstack-containers07:11
*** trident has quit IRC07:15
*** ykarel is now known as ykarel|lunch07:15
*** ricolin has joined #openstack-containers07:18
*** trident has joined #openstack-containers07:24
*** trident has quit IRC07:28
*** ttsiouts has joined #openstack-containers07:37
*** trident has joined #openstack-containers07:37
*** ykarel|lunch is now known as ykarel08:09
*** ykarel is now known as ykarel|meeting08:14
*** yolanda has quit IRC08:16
*** threestrands has quit IRC08:16
*** ykarel has joined #openstack-containers08:18
*** ykarel|meeting has quit IRC08:19
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-9: Driver for nodegroup operations  https://review.opendev.org/66709008:32
*** yolanda has joined #openstack-containers08:39
*** sapd1 has quit IRC08:44
brtknrandrein: hi andrein, your question in the kolla channel... which version of k8s are you trying to deploy?08:50
brtknri gather you are on stein08:50
brtknrandrein: am i correct in understanding you are attempting to use calico plugin?08:50
*** udesale has quit IRC09:04
*** udesale has joined #openstack-containers09:07
*** FlorianFa has quit IRC09:13
*** lpetrut has joined #openstack-containers09:16
*** rcernin has quit IRC09:16
*** lpetrut has quit IRC09:23
*** lpetrut has joined #openstack-containers09:24
*** ricolin has quit IRC09:37
openstackgerritBharat Kunwar proposed openstack/magnum master: [fedora atomic k8s] Add boot from volume support  https://review.opendev.org/62173409:38
*** ykarel_ has joined #openstack-containers09:39
*** ykarel has quit IRC09:40
*** udesale has quit IRC09:49
*** udesale has joined #openstack-containers09:50
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-9: Driver for nodegroup operations  https://review.opendev.org/66709009:52
*** ttsiouts has quit IRC10:13
*** ttsiouts has joined #openstack-containers10:13
*** lpetrut has quit IRC10:17
*** ttsiouts has quit IRC10:17
*** lpetrut has joined #openstack-containers10:19
*** ykarel_ is now known as ykarel10:24
openstackgerritBharat Kunwar proposed openstack/magnum master: [fedora atomic k8s] Add boot from volume support  https://review.opendev.org/62173410:33
*** sapd1_x has joined #openstack-containers10:56
*** ykarel is now known as ykarel|afk10:59
*** ykarel|afk is now known as ykarel11:08
*** ttsiouts has joined #openstack-containers11:19
*** ttsiouts has quit IRC11:23
*** ttsiouts has joined #openstack-containers11:23
*** ykarel is now known as ykarel|afk11:45
*** ttsiouts has quit IRC11:47
*** ttsiouts has joined #openstack-containers12:03
andreinbrtknr: both kolla and flannel were giving me issues. In the end,  it was a trust issue:  https://storyboard.openstack.org/#!/story/200653112:08
andreinI finally got it working last night on f28 with calico12:09
andreinboth *calico* and flannel, sorry12:11
brtknrandrein: ah cool, are you going to post a patch to kolla-ansible or shall I do it? we hit the same issue so we make this True on our project config12:13
brtknrI agree, magnum is unusable without this12:13
*** goldyfruit_ has quit IRC12:16
andreinbrtknr: I can write the patch (always wanted to do it :)12:16
andreinthere's this ticket though: https://bugs.launchpad.net/kolla-ansible/+bug/184244912:16
openstackLaunchpad bug 1842449 in kolla-ansible "Magnum "enable_cluster_user_trust" documentation" [Undecided,New]12:16
andreinmaybe mgoddard has some input?12:17
brtknrmgoddard: is it time to revisit this? we ought to make this True as clusters are not functional without it12:18
mgoddardandrein: it was the same issue?12:18
brtknryeah12:18
mgoddardisn't that an issue for magnum generally?12:18
andreinmgoddard: it's the same issue. noxoid on the #openstack-kolla pointed me towards it. I don't know if it affects other COEs, we're only interested in kubernetes.12:19
*** ykarel|afk is now known as ykarel12:23
mgoddardandrein: I just spoke to brtknr (he's sitting next to me)12:24
mgoddardandrein: he's going to look into it, but I think we need to change the default in magnum as it seems to be a bad default12:25
mgoddardandrein: we could also change it in kolla-ansible during the transition12:25
andreinok, can I contribute this?12:26
mgoddardandrein: sync up with brtknr12:33
brtknrstrigazi: any reason why cluster_user_trust is False by default but True in devstack...12:34
brtknrstrigazi: should we maybe change this to True in magnum? given that clusters fail to start without it12:35
andreinbrtknr: according to https://kubernetes.io/docs/concepts/cluster-administration/cloud-providers/#global The trust should be optional. We could just skip the check for TRUST_ID at https://opendev.org/openstack/magnum/src/branch/stable/stein/magnum/drivers/common/templates/kubernetes/fragments/write-kube-os-config.sh#L712:40
andreinand leave the default to False12:43
brtknrttsiouts: hey, you there?12:49
ttsioutsbrtknr: yeap. Hi!12:49
brtknri just tried to do coe cluster show k8s-cluster, but i get `'Cluster' object has no attribute 'nodegroups' (HTTP 500) (Request-ID: req-f360fbcd-9e54-42b8-9421-6d36177bf16a)`12:50
brtknrdo you get the same?12:50
brtknri am using your latest changes12:50
brtknrttsiouts: ^12:50
ttsioutsbrtknr: did you execute: magnum-db-manage upgrade12:51
ttsioutsbrtknr: and restart the services?12:51
brtknryes i did those12:51
brtknrttsiouts: create ng and show ng works12:52
brtknrbut  cluster show... no12:52
ttsioutsbrtknr: hmmm.. show is working for me...12:53
ttsioutsbrtknr: could you please share the api  and cond logs?12:53
brtknrttsiouts: i created the cluster using master branch but created ng using your change... maybe that has something to do with it...12:54
ttsioutshmm12:54
ttsioutsbrtknr: let me try to reproduce12:54
brtknrhttps://seashells.io/p/ptDfMTSe12:56
brtknrmy logs12:56
brtknrthe relevant cluster is k8s-calico-cutoff12:57
*** jmlowe has quit IRC13:03
ttsioutsbrtknr: I tried what you said:13:14
ttsioutsbrtknr: - created a cluster with master13:14
ttsioutsbrtknr: upgraded the db13:14
ttsioutsbrtknr: added a nodegroup with my changes13:14
ttsioutsbrtknr: and cluster show is working13:15
ttsioutsbrtknr: also in the logs you shared I cannot find the crash13:15
ttsioutsbrtknr: in these logs the cluster k8s-calico-cutoff has not even reached CREATE_COMPLETE. The last line of the log file says the cluster was still in CREATE_IN_PROGRESS13:16
ttsioutsalso I uploaded changes twice today13:19
ttsioutsbrtknr: are you sure that you are using the latest?13:19
*** jmlowe has joined #openstack-containers13:24
*** jmlowe has quit IRC13:25
*** asettle has joined #openstack-containers13:28
asettleflwang or strigazi - either of you able to put this review on your list? https://review.opendev.org/#/c/677986/ It's some link fixes for rocky, so not the height of importance. But superrr would appreciate it for some downstream fixes :D13:29
*** pcaruana has quit IRC13:30
*** jmlowe has joined #openstack-containers13:36
*** ricolin has joined #openstack-containers13:39
brtknrasettle: ^^ ive added some comments13:48
brtknrttsiouts: lemme retry13:48
asettleThanks brtknr :)13:48
brtknrttsiouts: another thing I did was rebase to master... would that have made a difference?13:50
ttsioutsbrtknr: hmmm.. maybe13:50
ttsioutsbrtknr: I can retry also13:50
openstackgerritAlexandra Settle proposed openstack/magnum stable/rocky: Fixing broken links  https://review.opendev.org/67798613:50
asettlebrtknr, changes made :) thanks!13:51
brtknrasettle: another thing, we don't normally merge changes to stable branches13:51
brtknrplease create your change agaist the master branch13:51
asettlebrtknr, you need backports? Greedily, I only need it for rocky. But I'm happy to do it for master and backport.13:51
brtknrand backport13:52
*** KeithMnemonic has joined #openstack-containers13:53
*** goldyfruit_ has joined #openstack-containers13:53
*** goldyfruit_ has quit IRC13:54
*** dave-mccowan has joined #openstack-containers13:54
brtknrasettle: thanks :)13:55
*** goldyfruit has joined #openstack-containers13:56
openstackgerritAlexandra Settle proposed openstack/magnum master: Fixing broken links  https://review.opendev.org/68175413:58
asettlebrtknr, all yours :)13:58
*** ykarel is now known as ykarel|afk13:59
brtknrasettle: sorry i have some more comments... it looks like you accidentally removed some useful documentation14:02
asettlebrtknr, the dev gate stuff? No, that was on purpose.14:02
brtknrhttps://review.opendev.org/#/c/681754/1/doc/source/user/index.rst14:03
brtknrthis stuff14:03
asettleOh the index stuff, damn - that was an accident14:03
asettleAccidentally smashed two PRs :p14:03
asettleI'll fix that one14:03
asettleBut the dev gate? it doesn't exist anymore.14:03
asettledevstack*14:03
brtknrasettle: ah okay thanks for the explanation14:04
brtknrttsiouts: is it working for you ... with cluster created on master followed by cluster show with your patch rebased to master?14:08
*** pcaruana has joined #openstack-containers14:08
*** goldyfruit_ has joined #openstack-containers14:09
*** goldyfruit has quit IRC14:12
openstackgerritAlexandra Settle proposed openstack/magnum master: Fixing broken links  https://review.opendev.org/68175414:12
asettlebrtknr, better now: https://review.opendev.org/#/c/681754/2/doc/source/user/index.rst sorry about that14:12
asettleDid not refresh, which is odd14:12
ttsioutsbrtknr: cluster is still being created.14:13
goldyfruit_brtknr, o/14:15
goldyfruit_brtknr, so, have you been able to deploy a k8s 1.15 with Fedora Atomic 29 successfully ?14:15
goldyfruit_(I'm back from vacations, and congrats on the core role!)14:15
brtknrgoldyfruit_: thanks :)14:18
brtknryes, if you deploy from master, k8s 1.15 is working with both flannel and calico plugins14:18
goldyfruit_brtknr, that is a great new14:19
goldyfruit_I'll update one of our env with master14:19
goldyfruit_and seee14:19
brtknrttsiouts: hmm i cant replicate the issue this time14:24
brtknrits working for me too14:24
brtknrttsiouts: i will reset the db and try again14:25
ttsioutsbrtknr: I am adding some tests and I will rebase the changes today also.14:25
brtknrttsiouts: cool14:26
ttsioutsbrtknr: I just tested the code rebased on current master14:26
ttsioutslooks like it's working for now14:26
*** henriqueof1 has joined #openstack-containers14:27
ttsioutsbrtknr: creating a nodegroup at the moment14:27
brtknrttsiouts: yes, it ought to, the only change since last time has been support for k8s 1.1514:27
brtknronly major*14:27
openstackgerritAlexandra Settle proposed openstack/magnum master: Fixing broken links  https://review.opendev.org/68175414:29
*** henriqueof has quit IRC14:30
brtknrttsiouts: i have been throwing everything at your nodegroup changes... seems pretty solid so far14:31
brtknrttsiouts: even deleted the nodegroup and that ran pretty smoothly14:31
ttsioutsbrtknr: cool14:32
brtknrttsiouts: although the nodegroup appears to disappear from openstack coe nodegroup list before it disappears from kubectl get nodes14:32
ttsioutsbrtknr: the nodegroup will disappear as soon as the stack gets deleted14:33
ttsioutsbrtknr: seems that kubernetes catches up a bit later14:34
brtknrttsiouts: thats cool, not a major issue14:35
ttsioutsbrtknr: now I am working on giving priority to the deletion of NGs stacks14:36
ttsioutsbrtknr: there might be a race condition14:36
brtknrttsiouts: can you describe the race condition?14:37
ttsioutsbrtknr: if heat tries to delete the cluster stack before an NG stack delete fails14:37
brtknrttsiouts: hmm i see14:37
ttsioutsbrtknr: since NG stacks use the security group described in the cluster stack14:38
ttsioutsbrtknr: among other things14:38
ttsioutsbrtknr: it's not usual but can happen14:38
ttsioutsbrtknr: shouldn't be really difficult to manage14:39
brtknrhow are you planning to fix this?14:40
*** dave-mccowan has quit IRC14:41
ttsioutsbrtknr: I think, waiting for the deletion of the other stacks before deleting the cluster stack seems the only clear solution14:42
ttsioutsbrtknr: might make the cluster deletion slower though14:42
ttsioutss/clear/easy ^^14:43
*** ykarel|afk is now known as ykarel|away14:48
*** ykarel|away has quit IRC14:53
*** pcaruana has quit IRC14:57
*** jmlowe has quit IRC15:01
*** jmlowe has joined #openstack-containers15:04
ttsioutsbrtknr: keep in mind that NG update API is not used for changing the node-count15:05
ttsioutsbrtknr: scale up/down should be done through the resize API15:05
*** spsurya has quit IRC15:16
*** guimaluf has quit IRC15:21
*** lpetrut has quit IRC15:25
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-6: Add new fields to nodegroup objects  https://review.opendev.org/66708815:30
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-7: Adapt parameter and output mappings  https://review.opendev.org/66708915:30
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-8: APIs for nodegroup CRUD operations  https://review.opendev.org/64779215:30
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: [WIP] ng-9: Driver for nodegroup operations  https://review.opendev.org/66709015:30
ttsioutsbrtknr: rebased ^^15:31
*** ykarel has joined #openstack-containers15:37
*** sapd1_x has quit IRC15:41
*** ivve has quit IRC15:52
brtknrttsiouts: thanks15:56
openstackgerritTheodoros Tsioutsias proposed openstack/python-magnumclient master: Add nodegroup CRUD commands  https://review.opendev.org/64779316:00
*** ttsiouts has quit IRC16:01
*** ykarel is now known as ykarel|away16:02
*** ttsiouts has joined #openstack-containers16:02
*** dave-mccowan has joined #openstack-containers16:03
*** ricolin has quit IRC16:03
*** ricolin has joined #openstack-containers16:04
*** ricolin has quit IRC16:05
*** ttsiouts has quit IRC16:06
*** jmlowe has quit IRC16:15
*** kgz has quit IRC16:31
*** goldyfruit_ has quit IRC16:32
*** udesale has quit IRC16:32
*** dave-mccowan has quit IRC16:34
*** dave-mccowan has joined #openstack-containers16:38
*** kgz has joined #openstack-containers16:47
*** goldyfruit_ has joined #openstack-containers16:48
*** ykarel|away has quit IRC17:19
*** ykarel|away has joined #openstack-containers17:19
*** ivve has joined #openstack-containers17:31
*** itlinux has joined #openstack-containers17:35
*** pcaruana has joined #openstack-containers17:58
*** jmlowe has joined #openstack-containers18:41
*** ykarel|away has quit IRC19:18
*** itlinux is now known as itlinux-away19:22
*** itlinux-away is now known as itlinux19:24
*** itlinux is now known as itlinux-away19:24
*** itlinux-away is now known as itlinux19:24
*** itlinux is now known as itlinux-away19:24
*** itlinux-away is now known as itlinux19:26
*** itlinux is now known as itlinux-away19:26
*** itlinux-away is now known as itlinux19:27
*** itlinux is now known as itlinux-away19:27
*** itlinux-away is now known as itlinux19:31
*** itlinux is now known as itlinux-away19:31
*** itlinux-away is now known as itlinux19:32
*** itlinux is now known as itlinux-away19:32
*** itlinux-away is now known as itlinux19:34
*** itlinux is now known as itlinux-away19:34
*** itlinux-away is now known as itlinux19:43
*** itlinux is now known as itlinux-away19:43
*** itlinux-away is now known as itlinux19:51
*** itlinux is now known as itlinux-away19:51
*** goldyfruit_ has quit IRC19:52
*** goldyfruit has joined #openstack-containers19:52
*** itlinux-away is now known as itlinux19:55
*** itlinux is now known as itlinux-away19:55
*** itlinux-away is now known as itlinux19:55
*** itlinux is now known as itlinux-away19:56
*** itlinux-away is now known as itlinux19:59
*** itlinux is now known as itlinux-away19:59
*** itlinux-away is now known as itlinux20:02
*** itlinux is now known as itlinux-away20:02
*** itlinux-away is now known as itlinux20:02
*** itlinux is now known as itlinux-away20:03
*** itlinux-away is now known as itlinux20:04
*** itlinux is now known as itlinux-away20:04
*** itlinux-away is now known as itlinux20:06
*** itlinux is now known as itlinux-away20:07
*** itlinux-away is now known as itlinux20:13
*** itlinux is now known as itlinux-away20:13
*** itlinux-away is now known as itlinux20:18
*** itlinux is now known as itlinux-away20:18
*** itlinux-away is now known as itlinux20:20
*** itlinux is now known as itlinux-away20:20
*** itlinux-away is now known as itlinux20:21
*** itlinux is now known as itlinux-away20:21
*** itlinux-away is now known as itlinux20:21
*** itlinux is now known as itlinux-away20:21
*** itlinux-away is now known as itlinux20:23
*** itlinux is now known as itlinux-away20:23
*** itlinux-away is now known as itlinux20:23
*** itlinux is now known as itlinux-away20:23
*** itlinux-away is now known as itlinux20:27
*** itlinux is now known as itlinux-away20:27
*** lpetrut has joined #openstack-containers20:30
openstackgerritBharat Kunwar proposed openstack/magnum master: Fix cluster deployment when cluster_user_trust=False  https://review.opendev.org/68192220:30
*** itlinux-away is now known as itlinux20:31
*** itlinux is now known as itlinux-away20:31
*** itlinux-away is now known as itlinux20:32
*** itlinux is now known as itlinux-away20:32
*** pcaruana has quit IRC20:32
*** itlinux-away is now known as itlinux20:33
*** itlinux is now known as itlinux-away20:33
*** itlinux-away is now known as itlinux20:33
*** itlinux is now known as itlinux-away20:33
*** itlinux-away is now known as itlinux20:36
*** itlinux is now known as itlinux-away20:36
*** trident has quit IRC20:39
*** itlinux-away is now known as itlinux20:45
*** itlinux is now known as itlinux-away20:45
*** lpetrut has quit IRC20:46
openstackgerritBharat Kunwar proposed openstack/magnum master: Fix cluster deployment when cluster_user_trust=False  https://review.opendev.org/68192220:50
openstackgerritBharat Kunwar proposed openstack/magnum master: Fix cluster deployment when cluster_user_trust=False  https://review.opendev.org/68192220:50
*** trident has joined #openstack-containers20:51
*** itlinux-away is now known as itlinux20:54
*** itlinux is now known as itlinux-away20:54
*** itlinux-away is now known as itlinux20:54
*** itlinux is now known as itlinux-away20:55
*** itlinux-away is now known as itlinux20:55
*** itlinux is now known as itlinux-away20:55
*** itlinux-away is now known as itlinux21:01
*** itlinux is now known as itlinux-away21:01
*** itlinux-away is now known as itlinux21:03
*** itlinux is now known as itlinux-away21:03
*** itlinux-away is now known as itlinux21:03
*** itlinux is now known as itlinux-away21:03
*** itlinux-away is now known as itlinux21:03
*** ramishra has quit IRC21:23
*** henriqueof1 has quit IRC21:31
*** henriqueof has joined #openstack-containers21:40
flwangbrtknr: can i get your bless on this one https://review.opendev.org/#/c/680545/ ?21:48
openstackgerritFeilong Wang proposed openstack/magnum master: [fedora-atomic][k8s][security] More strict security group rules  https://review.opendev.org/67579921:51
brtknrflwang: done :)22:02
brtknrflwang: btw just discovered that deploying the cluster when cluster_user_trust=False doesnt work22:03
brtknrwell, andrein did...22:03
brtknrwe havent notices this behaviour because in devstack, cluster_user_trust=True but default magnum settings are False due to the CVE22:04
openstackgerritMerged openstack/magnum master: Update flannel_backend in user guide  https://review.opendev.org/68054522:12
*** rcernin has joined #openstack-containers22:19
*** ivve has quit IRC22:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!