Thursday, 2018-07-26

*** rcernin has joined #openstack-containers00:03
*** itlinux has quit IRC00:17
*** livelace2 has quit IRC00:24
*** livelace2 has joined #openstack-containers00:24
*** flwang has quit IRC00:30
*** flwang has joined #openstack-containers00:43
*** ricolin has joined #openstack-containers00:45
*** ricolin has quit IRC00:46
*** hongbin has joined #openstack-containers01:16
*** dtruong_ has quit IRC01:20
*** openstackgerrit has joined #openstack-containers02:07
openstackgerritMerged openstack/magnum-ui master: Add release notes for Rocky  https://review.openstack.org/58563502:07
*** itlinux has joined #openstack-containers02:11
*** armaan has quit IRC02:13
*** itlinux has quit IRC02:15
*** ricolin has joined #openstack-containers02:31
*** openstack has joined #openstack-containers02:49
*** ChanServ sets mode: +o openstack02:49
*** hongbin has quit IRC02:56
*** vijaykc4 has joined #openstack-containers03:02
*** dave-mcc_ has quit IRC03:02
*** jmlowe has joined #openstack-containers03:06
openstackgerritFeilong Wang proposed openstack/magnum master: Create /etc/kubernetes/manifests on k8s master  https://review.openstack.org/58593503:11
flwang1strigazi: I have created story https://storyboard.openstack.org/#!/story/2003103 to track our work to fix v1.11.x03:11
*** jmlowe has quit IRC03:13
*** ramishra has joined #openstack-containers03:15
*** vijaykc4 has quit IRC03:38
*** udesale has joined #openstack-containers03:48
*** lpetrut has joined #openstack-containers03:53
*** vijaykc4 has joined #openstack-containers03:57
*** itlinux has joined #openstack-containers03:58
*** lpetrut has quit IRC04:03
*** dtruong_ has joined #openstack-containers04:06
*** janki has joined #openstack-containers04:11
*** itlinux has quit IRC04:11
*** mdnadeem has joined #openstack-containers04:17
*** mjura has joined #openstack-containers04:40
*** ykarel|away has joined #openstack-containers04:47
*** spsurya_ has quit IRC04:48
*** spsurya_ has joined #openstack-containers04:49
*** armaan has joined #openstack-containers04:57
*** armaan has quit IRC05:01
*** spsurya_ is now known as spsurya05:07
*** flwang1 has quit IRC05:50
*** vijaykc4 has quit IRC06:01
*** udesale has quit IRC06:04
*** udesale has joined #openstack-containers06:04
*** flwang1 has joined #openstack-containers06:36
*** serlex has joined #openstack-containers06:41
*** mgoddard has joined #openstack-containers06:41
*** flwang1 has quit IRC06:49
*** mgoddard has quit IRC06:50
*** ispp has joined #openstack-containers07:06
*** flwang1 has joined #openstack-containers07:10
*** flwang1 has quit IRC07:17
*** flwang1 has joined #openstack-containers07:17
*** vijaykc4 has joined #openstack-containers07:23
*** pcaruana has joined #openstack-containers07:25
*** mgoddard has joined #openstack-containers07:31
*** AlexeyAbashkin has joined #openstack-containers07:33
*** vijaykc4 has quit IRC07:37
*** ispp has quit IRC07:40
*** mjura has quit IRC07:58
*** mjura has joined #openstack-containers07:58
*** flwang1 has quit IRC07:58
*** ispp has joined #openstack-containers08:05
strigaziflwang: I was writing a story about this but I was still collecting data. Didn't want an empty one08:10
strigaziflwang: thanks I'll update it08:10
*** vijaykc4 has joined #openstack-containers08:11
*** Bhujay has joined #openstack-containers08:14
*** armaan has joined #openstack-containers08:19
*** Bhujay has quit IRC08:37
*** Bhujay has joined #openstack-containers08:37
*** ykarel|away has quit IRC08:38
*** ykarel| has joined #openstack-containers08:38
*** udesale_ has joined #openstack-containers08:44
*** janki has quit IRC08:45
*** udesale has quit IRC08:46
strigaziflwang: you there?08:49
*** cbrumm has quit IRC09:01
*** jkuei has quit IRC09:01
*** schaney has quit IRC09:01
*** dtruong_ has quit IRC09:02
*** digitaljim has quit IRC09:02
*** ispp has quit IRC09:10
*** salmankhan has joined #openstack-containers09:12
*** armaan has quit IRC09:22
*** armaan has joined #openstack-containers09:23
*** Bhujay has quit IRC09:30
*** Bhujay has joined #openstack-containers09:30
*** Bhujay has quit IRC09:48
*** Bhujay has joined #openstack-containers09:48
*** armaan has quit IRC09:50
*** armaan has joined #openstack-containers09:51
*** Bhujay has quit IRC09:51
*** Bhujay has joined #openstack-containers09:52
*** Bhujay has quit IRC09:54
*** Bhujay has joined #openstack-containers09:55
*** Bhujay has quit IRC09:57
*** Bhujay has joined #openstack-containers09:58
*** armaan has quit IRC10:01
*** armaan has joined #openstack-containers10:02
*** janki has joined #openstack-containers10:06
*** udesale__ has joined #openstack-containers10:08
*** jkuei has joined #openstack-containers10:09
*** schaney has joined #openstack-containers10:10
*** dtruong_ has joined #openstack-containers10:10
*** udesale_ has quit IRC10:10
*** imdigitaljim has joined #openstack-containers10:10
*** cbrumm has joined #openstack-containers10:12
*** Bhujay has quit IRC10:22
*** Bhujay has joined #openstack-containers10:23
*** ispp has joined #openstack-containers10:24
*** armaan has quit IRC10:50
*** armaan has joined #openstack-containers10:50
*** vijaykc4 has quit IRC10:53
*** Bhujay has quit IRC10:56
*** Bhujay has joined #openstack-containers10:57
*** Bhujay has quit IRC10:57
*** flwang1 has joined #openstack-containers10:58
*** Bhujay has joined #openstack-containers10:58
*** linkmark has joined #openstack-containers10:58
flwang1strigazi: around to discuss the v1.11.x issues?10:58
*** Bhujay has quit IRC10:59
*** Bhujay has joined #openstack-containers10:59
*** rcernin has quit IRC11:04
*** vijaykc4 has joined #openstack-containers11:08
*** dave-mccowan has joined #openstack-containers11:08
*** Bhujay has quit IRC11:11
*** Bhujay has joined #openstack-containers11:11
*** vijaykc4 has quit IRC11:12
*** vijaykc4 has joined #openstack-containers11:12
*** udesale__ has quit IRC11:25
*** Bhujay has quit IRC11:27
*** Bhujay has joined #openstack-containers11:27
*** Bhujay has quit IRC11:33
*** Bhujay has joined #openstack-containers11:38
*** ispp has quit IRC11:48
*** ispp has joined #openstack-containers11:48
*** flwang1 has quit IRC11:50
*** flwang1 has joined #openstack-containers11:51
strigaziflwang: sorry, I'm now11:53
*** Bhujay has quit IRC12:00
*** armaan has quit IRC12:03
*** armaan has joined #openstack-containers12:04
*** armaan has quit IRC12:07
*** armaan has joined #openstack-containers12:08
*** armaan has quit IRC12:11
*** armaan has joined #openstack-containers12:12
*** vijaykc4 has quit IRC12:14
*** vijaykc4 has joined #openstack-containers12:16
*** armaan has quit IRC12:27
*** armaan has joined #openstack-containers12:27
*** mdnadeem has quit IRC12:34
*** armaan has quit IRC12:35
*** armaan has joined #openstack-containers12:36
*** openstackgerrit has quit IRC12:36
*** vijaykc4 has quit IRC12:39
*** armaan has quit IRC12:46
*** armaan has joined #openstack-containers12:46
*** armaan has quit IRC13:00
*** ykarel| has quit IRC13:01
*** ykarel| has joined #openstack-containers13:03
*** armaan has joined #openstack-containers13:05
*** armaan has quit IRC13:08
*** ykarel| has quit IRC13:12
*** jmlowe has joined #openstack-containers13:20
*** ispp has quit IRC13:21
*** vijaykc4 has joined #openstack-containers13:34
*** ispp has joined #openstack-containers13:35
*** vijaykc4 has quit IRC13:37
*** markguz has joined #openstack-containers13:45
*** Bhujay has joined #openstack-containers13:47
*** Bhujay has quit IRC13:47
*** jmlowe has quit IRC13:47
*** hongbin has joined #openstack-containers13:52
*** ispp has quit IRC13:58
*** ispp has joined #openstack-containers13:58
*** jmlowe has joined #openstack-containers14:00
*** armaan has joined #openstack-containers14:09
*** jmlowe has quit IRC14:09
*** armaan has quit IRC14:20
*** hongbin has quit IRC14:46
*** janki has quit IRC15:15
*** vijaykc4 has joined #openstack-containers15:33
*** ispp has quit IRC15:36
*** pcaruana has quit IRC15:38
*** livelace2 has quit IRC15:44
*** hongbin has joined #openstack-containers15:49
*** vijaykc4 has quit IRC15:55
*** ykarel| has joined #openstack-containers15:57
*** itlinux has joined #openstack-containers16:01
*** AlexeyAbashkin has quit IRC16:10
*** ykarel| has quit IRC16:18
*** ricolin has quit IRC16:27
*** ykarel| has joined #openstack-containers16:30
*** ykarel| has quit IRC16:42
imdigitaljimo/16:51
*** markguz has quit IRC17:03
*** salmankhan has quit IRC17:15
*** serlex has quit IRC17:16
*** markguz has joined #openstack-containers17:55
*** markguz is now known as markguz_17:55
markguz_flwang: updated heat and magnum to stable/queens, rest of the stack is still at pike.  Now I'm getting errors about (Anti)Affinity servergroups not being supported.18:17
flwang1markguz_: don't you support server group in your env?18:24
markguz_flwang1: i guess i never configured it18:24
markguz_it's not a public cloud so the need never arose18:25
flwang1ok, i may have to propose a patch to make it configurable18:25
flwang1the background is, https://review.openstack.org/#/c/527946/18:25
markguz_flwang1: i'm guessing it's not trivial to just enable servergroups?18:25
flwang1by default magnum will try to deploy nodes on different compute host to get better HA18:25
flwang1what's your nova version?18:26
markguz_flwang1: pike18:26
flwang1markguz_: that's ok18:26
flwang1that's a very old feature in nova actually18:28
flwang1but I can't remember if it needs to be enabled/configured in nova, can you pls show me the log in your conductor18:29
markguz_flwang1: nova conductor or magnum conductor?18:31
flwang1markguz_: sorry, magnum18:31
markguz_flwang1: http://paste.openstack.org/show/726705/18:32
markguz_flwang1: i don't have any server groups configured.18:33
flwang1markguz_: that's ok. magnum will create server group automatically and set the policy18:33
markguz_flwang1: so why is it failing then?18:34
flwang1markguz_: i'm thinking and checking18:34
flwang1markguz_: can you please check if you have ServerGroupAffinityFilter in your nova.conf18:35
markguz_i do18:35
markguz_flwang1: does it need to be in every nova conf or just the scheduler18:36
flwang1you should have ServerGroupAntiAffinityFilter and ServerGroupAffinityFilter18:36
flwang1i think only nova schedule's conf is enough, but better to have it in all conf18:37
markguz_flwang1: i do18:37
flwang1so you have the two filters?18:38
markguz_flwang1: yes18:39
flwang1hmm...18:39
markguz_first thing i did when i saw the error18:39
flwang1you mean you added it or you found it's there when you checked it?18:40
markguz_no i added it the first time i got the error, restarted the scheduler and tried again.18:41
flwang1markguz_: mind trying restart all nova services?18:41
markguz_flwang1: on the controller or everywhere?18:41
flwang1because it's a 400 error, so for me, it's most like an error thrown by nova-api18:41
flwang1at least nova-api18:42
flwang1i don't think nova-compute needs restart18:42
flwang1given it's a 400 error, so you can try to restart nova-api, and try again in magnum18:42
*** mgoddard has quit IRC18:45
markguz_flwang1: now i'm getting "No Valid Host Found"18:50
markguz_which is strange because there's plenty of "valid" hosts18:50
flwang1can you boot an instance from nova directly?18:50
markguz_before setting the affinity filters i was. I'll check if it still works now18:51
markguz_flwang1: nope. seems broken now18:53
flwang1can you pls check the nova-scheduler log?18:54
flwang1it will explain why there is 0 valid host18:55
markguz_oh wait. i think i see why it's b0rked.  placement api is b0rked18:57
flwang1ah18:58
flwang1try restart placement api?18:59
flwang1and check its log before restart18:59
markguz_flwang1: because I was pip installing things i b0rked the oslo.db version ... should have used virtualenvs..19:06
markguz_anyway. fixed it19:06
markguz_trying again19:06
flwang1i hope it's just a dev env.......19:07
*** ianychoi_ has joined #openstack-containers19:15
markguz_flwang1: nope, it's live. but it's not for paying customers, it's a private stack for a bunch of developers19:16
markguz_flwang1: so they can stand a little disruption19:16
flwang1markguz_: i mean at least for the one you're changing/playing, it SHOULD be a testing/dev env, instead of your 'prod'19:17
*** pcaruana has joined #openstack-containers19:17
markguz_flwang1: i don't have one. no resources for it.19:17
*** ianychoi has quit IRC19:18
flwang1ah, fair enough19:21
flwang1any progress?19:21
markguz_yeah. it creates the master19:22
markguz_but fails on the first minion19:22
markguz_flwang1: no valid host when trying to create minion19:24
flwang1but master created?19:25
markguz_yups19:25
flwang1how many computes you have?19:25
markguz_about 2519:25
flwang1you probably need to check scheduler log19:25
markguz_yeah19:25
flwang1to see why the minion one failed19:26
flwang1at least, we're making progress19:26
markguz_yeah. I'll debug that later. need to do some other non openstack things now19:26
flwang1i'm going to take breakfast and driving to office19:26
flwang1you can reach me after 1.5 hour if you want19:26
flwang1good luck19:27
markguz_flwang1: sure thanks for your help. Seriously. you've been awesome.19:28
markguz_flwang1: also fyi. THe master booted with the fedora-atomic-27 image. so i guess it was something to do with the pike version not liking it19:31
flwang1markguz_: you're welcome, thanks for the feedback for magnum19:32
flwang1for pike, we recommend f2619:32
*** pcaruana has quit IRC19:45
*** flwang1 has quit IRC19:51
*** jmlowe has joined #openstack-containers20:02
*** flwang1 has joined #openstack-containers21:11
*** markguz has joined #openstack-containers21:30
*** markguz has quit IRC21:34
*** jmlowe has quit IRC21:43
markguz_flwang1: it's all working now. Deployed a working 2 node 1 master k8s cluster with Fed Atomic 27. works great!21:44
markguz_flwang1: thanks again21:44
*** itlinux has quit IRC21:47
*** markguz_ is now known as markguz21:51
*** rcernin has joined #openstack-containers22:19
flwang1markguz: no problem22:20
*** itlinux has joined #openstack-containers22:41
*** hongbin has quit IRC23:00
*** itlinux has quit IRC23:16
*** itlinux has joined #openstack-containers23:43
*** itlinux has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!