Thursday, 2016-09-08

openstackgerritHui Kang proposed openstack/kolla: Add etcd ansible role  https://review.openstack.org/36466200:11
*** yingjun has joined #openstack-kolla00:11
*** zhurong has quit IRC00:12
*** yingjun has quit IRC00:14
*** yingjun has joined #openstack-kolla00:16
*** tonanhngo has quit IRC00:20
*** harlowja has joined #openstack-kolla00:29
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021800:31
*** zhubingbing has joined #openstack-kolla00:31
*** diogogmt has joined #openstack-kolla00:35
*** zhubingbing has quit IRC00:36
*** duonghq has joined #openstack-kolla00:40
*** ssurana1 has quit IRC00:58
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457300:58
*** inc0 has joined #openstack-kolla00:59
*** unicell has quit IRC01:00
*** tonanhngo has joined #openstack-kolla01:01
*** zhubingbing_ has joined #openstack-kolla01:04
*** tonanhngo has quit IRC01:06
inc0Jeffrey4l_, ping01:06
inc0ubuntu upgrades of ceph seems working01:06
inc0vm is alive, disk is there01:06
inc0all seems good01:07
Jeffrey4l_cool. i will test the centos today.01:07
openstackgerritJeffrey Zhang proposed openstack/kolla: Using CI mirror host  https://review.openstack.org/36572101:07
inc0kk, remove -2 if it works, we should be good01:08
inc0thanks:)01:08
Jeffrey4l_inc0, OK>01:08
*** banix has quit IRC01:08
*** huikang_ has joined #openstack-kolla01:10
*** inc0 has quit IRC01:10
*** huikang has quit IRC01:11
*** zhurong has joined #openstack-kolla01:14
*** tonanhngo has joined #openstack-kolla01:16
*** tonanhngo has quit IRC01:20
*** fguillot has quit IRC01:21
*** salv-orlando has joined #openstack-kolla01:23
*** salv-orlando has quit IRC01:26
mtaylor22Jeffrey4l_: testing now.01:26
mtaylor22sorry, ran out of time yesterday01:26
Jeffrey4l_mtaylor22, cool. thanks :)01:26
mtaylor22just rebuilding the docker images to include dumb init01:27
Jeffrey4l_yep.01:27
mtaylor22also might want to ask you a few questions a bit later01:28
mtaylor22ill ping you when ready etc :)01:28
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251501:28
Jeffrey4l_ok.01:28
*** huikang_ has quit IRC01:29
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644701:29
*** fguillot has joined #openstack-kolla01:30
*** caowei has joined #openstack-kolla01:30
*** wuhg has joined #openstack-kolla01:31
Jeffrey4l_mtaylor22, what do u think about Ross's explanation? https://bugs.launchpad.net/kolla/+bug/1616268/comments/801:32
openstackLaunchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed]01:32
*** sdake has joined #openstack-kolla01:32
sdakeyo01:32
sdakeyo01:33
mtaylor22sup01:33
Jeffrey4l_morning sdake01:33
sdakeafternoon actually01:33
sdake6pm01:33
Jeffrey4l_9:30 am here :)01:33
mtaylor22Jeffrey4l_: Ross sits next to me, so its hard for me to think of it from a different perspective (ie. fresh mind)01:33
duonghqmorning/afternoon01:34
mtaylor2211:33am here (Sydney)01:34
mtaylor22but i do understand what he pointed out01:34
Jeffrey4l_OK.01:34
mtaylor22I couldn't figure out which container was holding onto the namespace, i mean lsof doesn't identify which particular container owns the namespace fd01:35
mtaylor22and i couldn't find it in /proc either (ownership wise)01:35
*** fguillot_ has joined #openstack-kolla01:35
*** fguillot has quit IRC01:35
mtaylor22just rebuilding neutron containers atm too.01:36
*** tonanhngo has joined #openstack-kolla01:36
Jeffrey4l_mtaylor22, i think it may be te dnsmasq process http://paste.openstack.org/show/568805/01:36
mtaylor22I will read in a few mins, just gotta deal with a customer issue.01:37
*** tonanhngo has quit IRC01:40
*** openstack has joined #openstack-kolla01:42
*** Pavo has quit IRC01:43
sdakeJeffrey4l_ what is your email address again please01:52
sdakejeffrey.zhang@99cloud.net01:53
sdake?01:53
*** huikang has joined #openstack-kolla02:06
Jeffrey4l_that's OK.02:10
Jeffrey4l_or  zhang.lei.fly@gmail.com   sdake02:10
*** huikang has quit IRC02:11
*** tonanhngo has joined #openstack-kolla02:15
*** tonanhngo has quit IRC02:20
sdakeJeffrey4l_ check your inbox02:27
sdakenot to be forwarded02:27
sdake@ cloud9902:27
*** tonanhngo has joined #openstack-kolla02:28
Jeffrey4l_sdake, received02:28
*** tonanhngo has quit IRC02:32
*** salv-orlando has joined #openstack-kolla02:33
openstackgerritSteven Dake proposed openstack/kolla: Turn off bindep  https://review.openstack.org/36705302:37
openstackgerritSteven Dake proposed openstack/kolla: Turn off bindep  https://review.openstack.org/36705402:37
*** tonanhngo has joined #openstack-kolla02:43
*** salv-orlando has quit IRC02:43
*** yuanying has quit IRC02:47
*** tonanhngo has quit IRC02:47
*** Pavo has joined #openstack-kolla02:47
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the deprecated kolla-build group name  https://review.openstack.org/36705602:48
*** fguillot_ has quit IRC02:50
*** Pavo has quit IRC02:51
*** tonanhngo has joined #openstack-kolla02:54
duonghqsdake: the docker-engine is installed in which test file?02:55
duonghqI search around but does not see it02:56
duonghqfor the gate02:56
*** daneyon has joined #openstack-kolla02:56
*** Pavo has joined #openstack-kolla02:58
duonghqsdake: seen02:58
duonghqthanks02:59
*** tonanhngo has quit IRC02:59
sdakeback03:00
sdakewhats up duonghq03:00
*** huikang has joined #openstack-kolla03:00
*** daneyon has quit IRC03:00
duonghqseem that when the bootstrap-servers is up and running, the setup_*.sh can simpler than current03:00
duonghqjust call bootstrap-servers and it do many jobs03:01
duonghqlike install docker...03:01
sdakeduonghq roger03:03
sdakeyou mean in the gate03:03
*** Pavo has quit IRC03:03
duonghqyeah, the gate, I want to move as many as posible jobs to "baremetal" role03:03
*** tonanhngo has joined #openstack-kolla03:04
*** huikang has quit IRC03:04
*** tonanhngo has quit IRC03:08
sdakewfm03:09
sdakemake sure they have bug ids03:09
sdakeall gate changes should be backported if possible03:10
sdakei think this one is not possible03:10
*** huikang has joined #openstack-kolla03:10
duonghqsdake: there is some mismatch between gate and bootstrap-server, i.e the docker version03:12
duonghqthe root cause of my idea is I want to add kolla user beforce deploy is played03:13
duonghqbut bootstrap-server lock docker version, and it's conflict with setup_Debian03:14
duonghqfor downgrade package, apt need pass --allow-downgrade03:14
duonghqbut Ansible cannot do it03:14
duonghqof course, backport baremetal is not a good idea03:15
*** tonanhngo has joined #openstack-kolla03:16
duonghqsdake: do you have any idea with minimum tradeoff?03:19
*** tonanhngo has quit IRC03:20
*** mtaylor22 has quit IRC03:26
*** mtaylor22 has joined #openstack-kolla03:27
sdakeduonghq i'd say at this point to leave it alone03:27
*** mtaylor22 has joined #openstack-kolla03:28
sdakeand we can test the baremetal role in the gate in ocata03:28
duonghqso, for bp become-role, which direction should I take? modify setup_* to add kolla user or remove docker portion in setup script and call baremetal role03:29
duonghqgive that become bp is in ocata too03:30
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021803:36
*** salv-orlando has joined #openstack-kolla03:42
*** tonanhngo has joined #openstack-kolla03:44
*** tonanhngo has quit IRC03:49
*** salv-orlando has quit IRC03:49
*** yuanying has joined #openstack-kolla03:51
*** tonanhngo has joined #openstack-kolla03:57
*** tonanhngo has quit IRC03:59
*** jgriffith is now known as jgriffith_away04:00
*** tonanhngo has joined #openstack-kolla04:06
*** ssurana has joined #openstack-kolla04:06
sdakeduonghq make something up - and submit it :)04:09
duonghqsdake roger04:09
sdakeduonghq this project is way too busy for me to make every decision04:10
sdakei shouldn't realisticlaly have to make any decisions :)04:10
sdakebut pragmatically sometimes I have to resolve conflict04:10
sdakewhich could be considered a form of decision making04:10
*** tonanhngo has quit IRC04:11
sdakeI prefer the decision making be done by the core review team (of which I am member)04:11
sdakedoes that add clarity?04:11
duonghqsdake: understand04:11
*** tonanhngo has joined #openstack-kolla04:12
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853904:14
*** senk has joined #openstack-kolla04:25
openstackgerritHui Kang proposed openstack/kolla: Add etcd ansible role  https://review.openstack.org/36466204:26
*** harlowja_at_home has joined #openstack-kolla04:29
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the deprecated kolla-build group name  https://review.openstack.org/36705604:30
bdacaI have a question about bug https://bugs.launchpad.net/kolla/+bug/1620374 - I'd like to fix it but i'm quite new around and don't really know the patterns. It needs new dedicated rabbitmq server for murano. We have role to install rabbitmq. Easiest: just include the role providing some vars like name, user, password etc. Is this OK or do we have any pattern like 'one component - separate role' or something?04:33
openstackLaunchpad bug 1620374 in kolla "Murano needs dedicated rabbitmq" [Undecided,New]04:33
*** hieulq has quit IRC04:35
*** hieulq has joined #openstack-kolla04:35
openstackgerritHui Kang proposed openstack/kolla: Add etcd ansible role  https://review.openstack.org/36466204:40
*** fragatina has joined #openstack-kolla04:41
*** fragatina has quit IRC04:45
*** salv-orlando has joined #openstack-kolla04:52
mtaylor22Jeffrey4l_: hmm regrading the dnsmasq defunct procs04:52
mtaylor22i don't see any relation04:52
mtaylor22i did however, see defunct processes in l3 agent container04:53
mtaylor22restarting the container removed the defunct pids, however it didn't release any namespaces04:53
mtaylor22I can't really say which container is holding onto stale namespaces. I can only remove them if all the Neutron container are stopped.04:54
mtaylor22balls.04:54
mtaylor22sorry, neutron and openvswitch containers stopped -> removal of stale namespaces = ok04:55
mtaylor22ie.  docker ps -a | egrep '(neutron|openvswitch)' | awk '{print$1}' | xargs docker stop/start04:55
*** sdake has quit IRC04:56
*** senk has quit IRC04:57
*** salv-orl_ has joined #openstack-kolla04:59
*** salv-orlando has quit IRC04:59
*** salv-orlando has joined #openstack-kolla05:00
*** sdake has joined #openstack-kolla05:00
*** Jeffrey4l__ has joined #openstack-kolla05:00
*** huikang has quit IRC05:01
*** Jeffrey4l_ has quit IRC05:03
*** frzn_ has joined #openstack-kolla05:06
*** mtaylor22 has quit IRC05:06
*** frzn_ is now known as mtaylor2205:10
sdakeJeffrey4l__ ping re liberty gate failure05:12
sdakehttps://review.openstack.org/#/c/367054/05:12
*** unicell has joined #openstack-kolla05:13
sdakeJeffrey4l__ i recently tested liberty and it works well05:13
sdakei recall we had this gate failure in master at one point05:13
sdakeand it was fixed05:13
sdakei just dont know how05:13
*** unicell has quit IRC05:16
*** unicell has joined #openstack-kolla05:16
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853905:20
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853905:21
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (2)  https://review.openstack.org/35903105:22
*** unicell1 has joined #openstack-kolla05:22
*** unicell has quit IRC05:23
openstackgerritSteven Dake proposed openstack/kolla: Turn off bindep  https://review.openstack.org/36705305:25
*** msimonin has joined #openstack-kolla05:25
*** phuongnh has joined #openstack-kolla05:29
*** msimonin has quit IRC05:30
*** senk has joined #openstack-kolla05:31
*** daneyon has joined #openstack-kolla05:38
mtaylor22Jeffrey4l__: no go.05:41
mtaylor22testing the actual patch now05:42
*** daneyon has quit IRC05:43
mtaylor22(i was investigating what was holding into the namespaces)05:45
*** harlowja_at_home has quit IRC05:46
sdakeJeffrey4l__ you alive05:49
mtaylor22must be dead05:49
mtaylor22:P05:49
mtaylor22sdake: do you actually sleep?05:49
mtaylor22or do you do something like uberman sleep schedule?05:50
sdakemtaylor22 during this time, I usually get about 2 4 hour naps a day05:51
sdakeor 2 3 hour naps a day05:51
sdakenot ideal but has to be done05:51
mtaylor22interesting..05:51
*** fragatina has joined #openstack-kolla05:52
sdakethats one way to put it05:53
mtaylor22lol05:53
mtaylor22well, goodluck with that. I'd probably die if i were in your shoes.05:54
mtaylor22><05:54
*** sdake_ has joined #openstack-kolla05:56
*** fragatina has quit IRC05:56
*** sdake has quit IRC05:58
*** egonzalez90 has joined #openstack-kolla06:02
*** senk has quit IRC06:02
egonzalez90morning guys06:04
duonghqmorning egonzalez9006:04
mtaylor22hello!06:06
bdacahi06:07
*** senk has joined #openstack-kolla06:07
egonzalez90zhubingbing_ ping06:08
zhubingbing_hi06:09
zhubingbing_here06:09
*** unicell has joined #openstack-kolla06:10
*** unicell1 has quit IRC06:13
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644706:22
*** unicell1 has joined #openstack-kolla06:24
*** unicell has quit IRC06:24
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (last)  https://review.openstack.org/35909606:26
*** duonghq has quit IRC06:28
openstackgerritZhou Ya proposed openstack/kolla: add CentOS's docker config file in multinode.rst  https://review.openstack.org/36712006:42
*** berendt has joined #openstack-kolla06:47
berendtmorning06:47
egonzalez90morning berendt06:48
*** duonghq has joined #openstack-kolla06:53
*** salv-orlando has quit IRC06:54
zhubingbing_moring06:56
zhubingbing_morning06:56
mtaylor22Jeffrey4l__: https://bugs.launchpad.net/kolla/+bug/1616268 -- see notes if/when you're alive06:59
openstackLaunchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed]06:59
egonzalez90zhubingbing_, rally code is finished?06:59
egonzalez90https://blueprints.launchpad.net/kolla/+spec/rally-role06:59
zhubingbing_ye06:59
zhubingbing_yes06:59
zhubingbing_i can‘t change it06:59
*** Jeffrey4l__ has quit IRC07:00
berendtzhubingbing_ egonzalez90 changed to implemented07:00
zhubingbing_ok07:00
zhubingbing_thanks07:00
egonzalez90also, gnocchi is done right?07:01
*** ssurana has quit IRC07:01
egonzalez90or is something missing?07:01
zhubingbing_yes07:02
*** Jeffrey4l__ has joined #openstack-kolla07:02
berendtit does not have upgrade instructions07:02
Jeffrey4l__mtaylor22, sdake_ alive07:03
Jeffrey4l__sdake_, liberty gate failure all the time. and i haven't fixed it. no idea why the rabbitmq crash all the time.07:03
egonzalez90and barbican containers already merged https://blueprints.launchpad.net/kolla/+spec/barbican-containers07:03
sdake_Jeffrey4l__ i have an idea as to why07:03
sdake_we are not using centos packaged version of rabbitmq07:03
openstackgerritChristian Berendt proposed openstack/kolla: Add empty upgrade file to gnocchi role  https://review.openstack.org/36713207:03
Jeffrey4l__sdake_, maybe. need some test about this.07:04
berendtegonzalez90 barbican set to implemented07:04
berendtthe container bp07:05
sdake_Jeffrey4l__ i am working on it07:05
Jeffrey4l__cool07:05
egonzalez90thanks berendt07:05
zhubingbing_gnocchi 、aodh、rally、sahara、 barbican 、infuxdb、grafana07:05
zhubingbing_thanks07:05
zhubingbing_sdake  infuxdb gate it be ok,https://review.openstack.org/#/c/346449/07:06
*** matrohon has joined #openstack-kolla07:08
openstackgerritMerged openstack/kolla: Fix keytone options in all.yml/globals.yml  https://review.openstack.org/36595007:09
openstackgerritMerged openstack/kolla: Remove the deprecated kolla-build group name  https://review.openstack.org/36705607:10
sdake_zhubingbing_ too late to review atm07:10
zhubingbing_ok you should have rest07:11
*** tonanhngo has quit IRC07:19
*** jrich523 has quit IRC07:26
*** daneyon has joined #openstack-kolla07:27
*** jrich523 has joined #openstack-kolla07:28
*** daneyon has quit IRC07:31
*** openstackgerrit has quit IRC07:33
*** openstackgerrit has joined #openstack-kolla07:34
*** egonzalez90 has quit IRC07:35
openstackgerritSteven Dake proposed openstack/kolla: Liberty is now on 1.1.3 prerelease  https://review.openstack.org/33463707:40
openstackgerritSteven Dake proposed openstack/kolla: DONOTMERGE Use RabbitMQ 3.6.2 to attempt fixing liberty gate  https://review.openstack.org/36715107:40
*** msimonin has joined #openstack-kolla07:42
*** neilus has quit IRC07:53
*** neilus has joined #openstack-kolla07:53
*** salv-orlando has joined #openstack-kolla07:59
openstackgerritJeffrey Zhang proposed openstack/kolla: DO_NOT_MERGE: Use better URL for China  https://review.openstack.org/36716208:00
*** athomas has joined #openstack-kolla08:01
*** salv-orlando has quit IRC08:01
*** egonzalez90 has joined #openstack-kolla08:07
mtaylor22Jeffrey4l__: you there?08:16
mtaylor22or.. sdake_?08:17
sdake_mtaylor22 Jeffrey4l__ is working on your issue08:17
sdake_if it involves the netns thing08:17
mtaylor22just gotta pm you quickly sdake_08:17
sdake_wound me08:17
*** sdake_ is now known as sdake08:17
duonghqsdake: thought you went to bed?08:18
*** tonanhngo has joined #openstack-kolla08:20
*** Jeffrey4l__ has quit IRC08:20
sdakeduonghq i can sleep when im dead08:21
*** tonanhngo has quit IRC08:21
zhubingbing_ ==08:22
duonghqhow many naps do you take per day sdake?08:22
sdake2 or 3 during release time08:23
sdakedepending on fatigue levels08:23
*** salv-orlando has joined #openstack-kolla08:23
zhubingbing_How many hours do you sleep a day ?08:23
duonghqrelease time come right after osic is really bad, huh?08:23
sdakebrutal during osic got about 3-4 hours of sleep a day08:26
sdakeduring last 10 days or so of osic that is08:26
*** shardy has joined #openstack-kolla08:26
sdakehey shardy08:27
*** salv-orl_ has joined #openstack-kolla08:30
sdakepretty sure rabbitmq is out to get me08:30
sdakehttps://hub.docker.com/search/?isAutomated=0&isOfficial=0&page=1&pullCount=0&q=kolla%2F&starCount=008:32
sdake10k pulls on centos binary toolbox08:33
*** salv-orlando has quit IRC08:33
*** mtaylor22 has quit IRC08:33
*** tonanhngo has joined #openstack-kolla08:43
*** tonanhngo has quit IRC08:45
*** kproskurin has joined #openstack-kolla08:46
*** kproskurin has quit IRC08:47
berendtdoes anybody now why we need grafana for the performance monitoring stack? is it nos possible to do the same with TICK?08:50
*** kproskurin has joined #openstack-kolla08:51
berendtwe already have TI and could add C08:51
sdakeberendt the discussion on this was tick was fine08:56
sdakebut tig was implemented08:56
sdakemy take is the I is a problem08:56
sdakebecause the HA is proprietary08:56
sdakeso we need to either find a replacement for the I08:56
sdakeor move on from it08:56
berendtbut then TICK is the wrong stack08:56
sdakeyou missed my last sentence ;)08:57
berendtyes :)08:57
*** harleyren has joined #openstack-kolla08:57
berendtbut maybe we should decide this prior to rc1.. at the moment the performance stack is scheduled for rc108:57
berendtfrom my POV it makes no sense to introduce TIG when we will remove it in the future08:58
sdakei think there are replacements for I08:58
sdakeanyway - it is being marked as tech preview08:59
sdakewhich is a euphamism for "use at your own risk"08:59
berendtdo we have some place where we document technical preview, prodcution ready, stuff like this?08:59
sdakerelease notes and foundation marketing09:00
sdaketech preview is rare09:00
sdakeat this point only BMAAS is tech preview in kolla09:00
sdakeand kolla-kubernetes of course hasn't released 1.0.009:00
duonghqwhy we need setup brtfs in setup_node for gate/09:03
sdakeduonghq its fast and reliable09:04
sdakeduonghq and consistently works across centos and ubuntu09:04
sdakewhereas overlayfs does not09:04
sdakeand lvm device mapper - don't even get me started on that one09:05
openstackgerritdupengfei proposed openstack/kolla-kubernetes: The script modifying nova.conf has a few bugs     Delete unnecessary and wrong crudini scripts for modifing nova.conf     Modify connection_uri value.  https://review.openstack.org/36722509:05
duonghqso the most important point is it is the (nearly) only solution for cross distro? fix me if I wrong09:05
sdakeduonghq for debuntian we recommend aufs for centos/rhel we recommend btrfs09:05
sdakeoverlayfs will get there09:05
sdakebut the rpm ovl plugin has problems buliding09:06
sdakeoverlayfs imo is the best solution long term09:06
sdakenow that we are using xenial we coud almost use overlayfs09:06
sdakebut the ovl plugin for  rpm is a pile of garb09:06
sdakein other words, it doesn't work correctly09:06
sdakewhich only matters if you build09:07
sdakedeploy on overlayfs is fine09:07
sdakealthough red hat says overlay eats babies09:07
sdakeand with their kernel, they could be right09:07
sdakexenial kernel (modern kernel.org) doesn't eat babies09:07
sdakecomon zuul09:08
sdakegive me a green gate09:08
sdakeso I can ptfo09:08
duonghqsdake: which ps?09:08
sdakehttps://review.openstack.org/#/c/367151/09:08
sdakethis one needs to finish ci first: https://review.openstack.org/#/c/334637/09:10
duonghqis it ok before 1.1.3?09:11
sdakehttp://logs.openstack.org/51/367151/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/92322c0/console.html#_2016-09-08_08_09_43_79195609:11
sdakeno09:11
sdakei wonder i fthats that epmd bug i "fixed"09:11
sdakesweet09:13
sdakei just figured out why liberty gate is bust09:13
duonghqso why?09:13
*** prithiv has joined #openstack-kolla09:15
*** daneyon has joined #openstack-kolla09:15
*** Jeffrey4l__ has joined #openstack-kolla09:17
*** daneyon has quit IRC09:20
sdakeJeffrey4l__ pretty sure i sorted out why liberty is busted09:24
sdakeEP M FOXTROT D09:24
sdakesomeone really needs to rewrit ethat pile o crap09:25
Jeffrey4l__rabbitmq issue?09:25
Jeffrey4l__upgrade rabbitmq works?09:25
openstackgerritSteven Dake proposed openstack/kolla: DONOTMERGE Use RabbitMQ 3.6.2 to attempt fixing liberty gate  https://review.openstack.org/36715109:26
openstackgerritSteven Dake proposed openstack/kolla: Liberty is now on 1.1.3 prerelease  https://review.openstack.org/33463709:26
openstackgerritSteven Dake proposed openstack/kolla: WHISKY TANGO FOXTROT  https://review.openstack.org/36723909:26
sdakeno idea09:26
sdakewhen EPMD is bound to an address is fails09:26
sdakethe backport that was done was incorrect09:26
sdakeit was correct to mitaka09:26
sdakebut not correct to liberty09:26
sdakesuspect collisions on the patch set09:26
sdakesee the WTF patch Jeffrey4l__09:27
*** mbound has joined #openstack-kolla09:30
sdakehttps://bugzilla.redhat.com/show_bug.cgi?id=131080809:32
openstackbugzilla.redhat.com bug 1310808 in erlang "Erlang Port Mapper crashes at startup if IPv6 disabled completely" [Unspecified,Closed: errata] - Assigned to jeckersb09:32
Jeffrey4l__yep. weird09:33
sdakehttps://github.com/openstack/kolla/blob/master/tools/setup_RedHat.sh#L6609:33
sdakenot particularlly09:33
sdakethis is why we need to be on delorean rather then http github urls09:34
Jeffrey4l__how about try to remove the disable ipv6?09:35
sdakewell i've got to think that was done for a reason ;)09:35
sdakegit blame ftw09:35
sdakecommit 6adb5c0aa5a5947bdeeb03b03cba29af30902d2f09:36
sdakevery detailed commit message09:36
sdakewith absolutely nothing about ipv6 ;)09:37
sdakewhy did rabbitmq end up winning in openstack09:37
sdakeJeffrey4l__ ^^09:38
Jeffrey4l__no better candidate ?09:38
sdakedefine better09:38
Jeffrey4l__just a guess.09:39
sdakegood guess if you define whats better about rabbitmq :)09:39
openstackgerritdupengfei proposed openstack/kolla-kubernetes: Neutron endpoint are wrong value..  https://review.openstack.org/36724609:39
openstackgerritMd Nadeem proposed openstack/kolla: Test: make enforce_type=True in CONF.set_override  https://review.openstack.org/36681809:39
Jeffrey4l__sdake, kafka seems hot recently.09:39
sdakeyes but on topic of rabbitmq, why better?09:40
Jeffrey4l__faster? maybe. no idea about this.09:40
sdakeits not about performance09:41
sdakewhat is rabbitmq's greatest attribute09:41
openstackgerritMd Nadeem proposed openstack/kolla: Test: make enforce_type=True in CONF.set_override  https://review.openstack.org/36681809:41
Jeffrey4l__but rabbitmq community was more stronger09:41
sdakeit certainly isnt' thae fact its written in erlang09:41
sdakeding ding ;009:42
Jeffrey4l__so rabbitmq win :)09:42
sdakezuul rocks09:43
sdakeif only our gate jobs didn't take 1 hour to run09:43
sdakei would be fast asleep already09:43
sdakeso the correct course of action here is to test out 3.6.2 in master09:43
sdakeand if that works09:43
sdakebackport it09:44
Jeffrey4l__centos+binary seem has some issue. no idea why it takes so long.09:44
sdakeJeffrey4l__ it has to do with the version of erlang being used09:44
sdakeepmd is an erlang c program which - is painful to read09:44
sdakeit makes my eyes bleed09:44
sdakeoh you mean to build09:45
sdakei think that hs to do with the lack of mirrors09:45
Jeffrey4l__i mean the time of deploy in gate.09:45
Jeffrey4l__i notice reconfigure is slow in centos+binary. but not sure it is common.09:46
sdakeya thats odd09:46
sdakeit should really make no difference09:46
sdakei would expect centos to be faster, atleast then ubuntu 14.0409:47
sdakemore modern toolchain09:47
sdakexenial probably faster then centos09:47
Jeffrey4l__deploy and reconfigure stage should be the same.09:47
sdakereconfigure slow on centos + source?09:48
sdakereconfigure is going to be slower without the dumb_init patches09:48
sdake15 second docker timout09:48
sdakebefore it pulls the trigger on a kill -909:49
Jeffrey4l__reconfigure on centos+binary is slow.09:50
Jeffrey4l__we have dumb-init in all case now. no mater binary and source.09:50
prithivHi. Can someone take a look at https://review.openstack.org/#/c/366082/ please.09:59
sdakeJeffrey4l__ what about centos+source?10:00
Jeffrey4l__sdake, centos+binary is slower than centos+source.10:00
Jeffrey4l__sdake, hmm. wait. let me check this detailed.10:01
sdakecentos+source is pristine10:01
Jeffrey4l__hmm. checked several jobs. the centos+source is slower than centos+binary10:02
*** zhurong has quit IRC10:02
*** duonghq has left #openstack-kolla10:03
sdakeyes i would epxect that10:03
zhubingbing_- -10:03
sdakecentous+source doesn't produce precompiled pyc fils10:03
sdakecentos that is10:03
sdakean dpyo files10:03
zhubingbing_source+cents gate have 1h35m10:03
zhubingbing_it is too long10:04
sdakeJeffrey4l__ can you ack: https://review.openstack.org/#/c/367053/10:04
*** harleyren has quit IRC10:05
*** jmccarthy has quit IRC10:05
Jeffrey4l__sdake, can u explain more about this ? no idea about this. :)10:06
*** jmccarthy has joined #openstack-kolla10:06
sdakebindep.txt is for specifing binary dependencies of various operating systems10:07
sdakethe gate intalls a whole bunch by default10:07
Jeffrey4l__yep10:07
sdakewe dodnt need any except libffi-devel10:07
sdakewhich I think is needed by openstackclient10:07
sdakebut i am not sure if it that or ansible that requires it10:07
sdakeso it speeds up the gate since less stuff has to be installed10:08
Jeffrey4l__which command will trigger this? pip install ?10:08
sdakezuul10:08
sdakeanyway its a backport - already merged in master ;)10:08
Jeffrey4l__got. just want to learn what's it. no idea about this at all.10:09
Jeffrey4l__+w ed10:09
*** zhubingbing_ has quit IRC10:10
sdakeJeffrey4l__ : http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-09-07.log.html#t2016-09-07T00:07:3910:11
sdakeall you wanted to know and more :)10:11
openstackgerritMerged openstack/kolla: Turn off bindep  https://review.openstack.org/36705310:12
openstackgerritChristian Berendt proposed openstack/kolla: WIP - Support HiPE (High-Performance Erlang) in RabbitMQ image  https://review.openstack.org/36726210:13
Jeffrey4l__got. thanks.10:15
*** yingjun has quit IRC10:18
openstackgerritMick Thomspon proposed openstack/kolla: Added serial option to site.yml.  https://review.openstack.org/36726410:20
Jeffrey4l__prithiv, reviewed.10:21
*** egonzalez90 has quit IRC10:24
openstackgerritSteven Dake proposed openstack/kolla: DNM : Test of gating with delorean rabbitmq  https://review.openstack.org/36726910:26
sdakeJeffrey4l__ do yu have any idea what .ez is?10:27
Jeffrey4l__no..10:27
openstackgerritdupengfei proposed openstack/kolla-kubernetes: Support nova_consoleauth and nova_novncproxy     Right now, nova_consoleauth and nova_novncproxy can't be deployed by kolla-kubernetes. This feature is to implement it.     I create 2 pods which kind is PetSet.  https://review.openstack.org/36727010:27
Jeffrey4l__like a rabbitmq plugin10:27
Jeffrey4l__ok. it is.10:28
sdakeya is it compressed or something10:28
Jeffrey4l__sdake, https://github.com/rabbitmq/rabbitmq-clusterer10:29
*** phuongnh has quit IRC10:30
openstackgerritSteven Dake proposed openstack/kolla: DNM : Test of gating with delorean rabbitmq  https://review.openstack.org/36726910:36
openstackgerritSteven Dake proposed openstack/kolla: DONOTMERGE Use RabbitMQ 3.6.2 to attempt fixing liberty gate  https://review.openstack.org/36715110:43
sdakethanks Jeffrey4l__10:44
*** harleyren has joined #openstack-kolla10:45
Jeffrey4l__np10:45
*** caowei has quit IRC10:47
openstackgerritMick Thomspon proposed openstack/kolla: Added serial option to site.yml.  https://review.openstack.org/36726410:48
openstackgerritVladislav Belogrudov proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556710:52
sdakeplease liberty work10:55
sdakeso i can go to bed10:55
sdakeJeffrey4l__ the reson you dont see liberty failing not in the gate is you have ipv6 turned on10:55
sdakepbourke as well10:55
pbourkesdake: what you need me to do?10:56
sdakepbourke nothing - just passing along information10:56
openstackgerritVladislav Belogrudov proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556710:57
*** zhubingbing has joined #openstack-kolla11:00
sdakezhubingbing if you want to do something helpful beyond what yu hae already dne, we need bitrot jobs in the gates for stable branches11:01
sdakezhubingbing note i hae no idea wht a bitrot job i11:01
sdakes11:01
zhubingbingok11:01
sdakehttp://github.com/openstack-infra/project-config11:01
sdakei suspect grep will turn up something11:01
openstackgerritMick Thomspon proposed openstack/kolla: Added serial option to site.yml.  https://review.openstack.org/36726411:02
sdakepbourke actually you may be interestd in having a look at https://review.openstack.org/36726911:03
pbourkelooks good11:04
openstackgerritVladislav Belogrudov proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556711:04
sdakeis serial 30% not sufficient?11:05
zhubingbingnow gate is not stable ?11:05
openstackgerritVladislav Belogrudov proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556711:05
sdakezhubingbing only liberty gaate not stable11:05
sdakemaster rock solid11:05
zhubingbingok11:05
openstackgerritMerged openstack/kolla: Correct Murano keystone_authtoken option name  https://review.openstack.org/36680111:05
sdakei think because of a failed backport11:05
zhubingbingi can help to do something?11:05
sdakezhubingbing bitrot jobs would hep there11:06
sdakei'm not quite sure what it does11:06
zhubingbingok11:07
*** b_bezak has joined #openstack-kolla11:07
sdakegate so fast: https://review.openstack.org/#/c/366801/11:08
sdakedon' get it11:08
zhubingbingyes11:08
zhubingbingso fast11:08
zhubingbingI'm going to get to know the project first.11:11
zhubingbinghttp://github.com/openstack-infra/project-config11:11
sdakezhubingbing grep for bitrot11:12
sdakezhubingbing its some type of gate i think11:12
zhubingbingbitrot ?11:12
sdakerather gate job11:12
zhubingbingok11:12
sdakegrep -r bitrot11:12
sdaketypically what i do with project config is make a best attempt11:13
sdakeand ajeager sets me straight :)11:13
*** tonanhngo has joined #openstack-kolla11:13
zhubingbingsure11:13
bdacaanyone here who use manila?11:15
*** tonanhngo has quit IRC11:15
sdakebdaca mlima does11:15
sdakebut he isn't here11:15
bdacathanks sdake :)11:15
sdakeso i guess that is not the answer you were looking for :)11:15
bdacait is better than nothing :D11:16
bdacaI suppose you don't know why manila has no config in haproxy?11:17
sdakeno idea11:17
sdakepbourke do you know how to decompess ez files?11:17
pbourkeno11:17
sdake(rabbitmq stuff)11:17
zhubingbingjenkins/jobs/python-bitrot-jobs.yaml:    name: python-liberty-bitrot-jobs ? sdake  this is ?11:17
sdakecan you thorw me a bone and google for it - been up going on 20 hours11:17
sdakeortunately i am refreshed from not woring all weekend and monday as well thanks to labor day11:18
sdakethat the one11:18
*** harleyren has quit IRC11:18
sdakezhubingbing ^11:18
sdakesomehow hae to tie that into ci11:19
sdakezhubingbing grep should show you how11:19
sdakeneed to release z streams shortly11:20
sdakebehind schedule on that11:20
zhubingbingI don't know how to test Ci's kolla11:20
sdakecan't really do that with a  busted liberty gate11:20
sdakezhubingbing git checkout stable/liberty11:20
sdakevi loc11:20
zhubingbingok11:20
sdakeadd some junk11:20
sdakegit commit -a11:20
sdakegit review11:20
sdakethis will test the gate11:20
zhubingbinggood11:20
zhubingbingyes i know11:20
*** coolsvap is now known as _coolsvap_11:21
openstackgerritMd Nadeem proposed openstack/kolla: Correct Ironic keystone_authtoken option name  https://review.openstack.org/36729711:22
*** salv-orl_ has quit IRC11:22
sdakezhubingbing when tht gets done you will see the gate is failing11:23
zhubingbingok11:23
sdakei am fairly certain it is related to rabbitmq11:23
sdakei will fix the gate11:23
sdakebut the bitrot jobs i think nag us when smoething is broken11:23
zhubingbingadd some junk ? anything?11:24
sdakeya anything11:24
sdakemake sure its proper shell syntax11:24
sdakeor modiy a text file or something11:24
sdakeit just needs to be a commit11:24
sean-k-mooneyzhubingbing: just add a new line or a comment and commit then push for review11:24
sdakepbourke all I see is this: http://zuul.openstack.org/11:25
openstackgerritzhubingbing proposed openstack/kolla: test gate  https://review.openstack.org/36729811:25
zhubingbingok11:25
sdakelots of red for that rabbitmq version change11:25
openstackgerritMick Thomspon proposed openstack/kolla: Added serial option to site.yml.  https://review.openstack.org/36726411:26
zhubingbingok11:27
sean-k-mooneysdake: pbourke  are there any knonw issuse with deploying ceph and ceph backed glance/cinder currently on master by the way?11:27
pbourkesean-k-mooney: not that Ive heard of11:27
sdakesean-k-mooney worked during osic  testing11:28
pbourkeyeah11:28
sean-k-mooneypbourke: ok i tried it yesterday and got http://paste.openstack.org/show/568394/ from the cinder-volumn service11:28
pbourkesdake: will have to wait till jenkins reports back on that change, I couldnt be bothered spinning up telnet11:28
sean-k-mooneypbourke: ceph iteslf seems to be fine but it could be due to my config.11:29
sdakepbourke ;)11:29
sdakepbourke i really preferred the stateul transaction log of jenkins better to telnet11:29
sdakehope zuul brings that back11:29
sean-k-mooneysdake: you can see the logs in the ui11:30
sean-k-mooneyi mean browser11:30
sdakesean-k-mooney zuul lets you loook at the job as it is running11:30
sean-k-mooneyjust change telnet to http11:30
pbourkei thought they got rid of that11:31
sean-k-mooneysdake: yes if you change the telnet url to http it renders in the browser11:31
sean-k-mooneyor at least it did last month11:31
sdakejenkins hs been removed some time ago11:31
sdakeso http is long gone11:31
sdakeafaik11:31
sean-k-mooneycan you link to the review in question11:31
sean-k-mooneyor give me the id of the job?11:32
sdakehttps://review.openstack.org/#/c/367151/11:32
*** tonanhngo has joined #openstack-kolla11:32
sdakejenkins didn't scale11:32
sean-k-mooneyso http://158.69.65.68:19885/ is to one of the running jobs11:33
sean-k-mooneyit was telnet://158.69.65.68:19885/11:33
*** tonanhngo has quit IRC11:34
sean-k-mooneyi thinkthat was for gate-kolla-dsvm-deploy-centos-binary-centos-7-nv11:34
*** mliima has joined #openstack-kolla11:34
sean-k-mooneyif you scoll down to the bottom of the page it will contine to print as the logs come in11:34
sdakeya runningjob11:35
sdakei want to see jobs that failed11:35
sdaketo short circuit the wait time so i can run anothe rgo11:35
sean-k-mooneywell that is already uploaded http://logs.openstack.org/51/367151/3/check/gate-kolla-dsvm-build-ubuntu-binary-ubuntu-trusty-nv/88fdd3b/11:35
sdakeit is entirely possible I am crazy in wanting such a thing :)11:36
sean-k-mooneywhen they fail it upload the log for that job before it release the vm so you dont need the entire set of jobs to be finished to view the logs11:36
*** fragatina has joined #openstack-kolla11:36
*** fragatina has quit IRC11:41
sdakefyi for those interested in .ez:11:41
sdake[sdake@minime-03 rabbitmq]$ curl -o suck.ez http://www.rabbitmq.com/community-plugins/v3.6.x/rabbitmq_clusterer-3.6.x-667f92b0.ez | unzip -l11:41
zhubingbing:)11:42
sdakepbourke do you remember the libvirt 2.x change at the last minute lat cycyle ;)11:43
sdakeher ewe go again11:43
openstackgerritPaul Bourke proposed openstack/kolla: Allow mysql to be used as a database for Ceilometer  https://review.openstack.org/36066911:43
pbourkesdake: umm11:44
pbourkenot sure I do!11:44
sdakeya you mde it owrk on centos11:44
mliimamorning guys11:46
sdakemliima someone ws looingfor you related to manila11:46
sdakeand good morning to ya11:46
mliimahmm11:47
mliimayou remember who it was? sdake11:47
sdakebdaca11:48
mliimabdaca, ping11:48
openstackgerritPaul Bourke proposed openstack/kolla: Allow use of database for Horizon sessions  https://review.openstack.org/35979411:50
*** tonanhngo has joined #openstack-kolla11:52
*** tonanhngo has quit IRC11:55
*** rhallisey has joined #openstack-kolla11:57
*** daneyon has joined #openstack-kolla11:57
*** dwalsh_ has joined #openstack-kolla11:58
*** dwalsh has joined #openstack-kolla11:58
openstackgerritMerged openstack/kolla: Keepalived leaves VIP on the host in case of accidental removal.  https://review.openstack.org/36408512:00
pbourkemliima: i believe we should not be merging features till the 15h12:02
*** daneyon has quit IRC12:02
pbourke*15th12:02
mliimaoh12:02
pbourkesdake: ^12:02
mliimaok12:02
pbourketrivialfixes and bug fixes are ok I think12:03
sdakeas long as its not a backport bug - no need for bug ids12:03
mliimaok pbourke :)12:04
openstackgerritMerged openstack/kolla: Add empty upgrade file to gnocchi role  https://review.openstack.org/36713212:05
openstackgerritMerged openstack/kolla: add CentOS's docker config file in multinode.rst  https://review.openstack.org/36712012:08
zhubingbingping Paul Bourke12:14
zhubingbingwhy give me -212:14
zhubingbinghttps://review.openstack.org/#/c/346449/12:14
openstackgerritSteven Dake proposed openstack/kolla: DONOTMERGE Use RabbitMQ 3.6.2 to attempt fixing liberty gate  https://review.openstack.org/36715112:15
sdakewhy was _ invented12:15
sdakenothing but truble12:15
zhubingbingping  pbourke12:16
sdakedo you know how much argument went into defining the ascii character set12:16
sdakethink of cloud battle12:16
zhubingbing- -12:16
sdakezhubingbing if yu dont want to get wrapped around the bitrot axle its not critical at present12:17
sdakezhubingbing i think gnocchi integration with the various things needs love12:17
sdakebut i am not sure12:17
*** tonanhngo has joined #openstack-kolla12:18
zhubingbingyes12:18
*** tonanhngo has quit IRC12:19
zhubingbingi will integration for ceilometer and cloudkiity12:19
sdake39k of code in msater12:20
sdakecode base growing12:20
*** msimonin has quit IRC12:20
*** wuhg has quit IRC12:21
zhubingbingSdake, I would like to ask the next infuxdb and gafana is not a merge ?12:21
zhubingbingI've already finished t12:22
openstackgerritSteven Dake proposed openstack/kolla: loc fails with recent removal of heat dev env  https://review.openstack.org/36732912:22
sdakenobrainer review above ^^12:22
zhubingbing- -12:23
zhubingbing……=_=12:24
sdakezhubingbing would you mind translating - - for me :)12:24
sdakesay quck query zhubingbing12:24
zhubingbingnot mind12:24
sdakehow did you learn the code base so fast12:24
zhubingbingso fast12:25
*** msimonin has joined #openstack-kolla12:25
sdakeyes you leaned it vey qucklly12:25
sdakelearned12:25
sdakequickly12:25
sdakekeyboard not inbest of shape ;)12:25
zhubingbingI learn everything quickly.12:25
zhubingbing^^12:26
zhubingbingsdake, I can do a lot of things, but it's not very deep.12:28
sdakeunderstand12:28
zhubingbingdepth need time12:29
berendtpbourke why have you -2 the influxdb review? we have https://blueprints.launchpad.net/kolla/+spec/performance-monitoring wit a target on rc112:29
sdakewe have 55 services in containers12:29
sdakezhubingbing right12:29
zhubingbingyes12:29
bdacamliima, are you here?12:30
zhubingbingi have already finished it12:30
bdacasorry, was afk12:30
mliimahi bdaca :)12:30
bdacahello :)12:30
zhubingbinginfluxdb  and telegraf , grafana12:30
zhubingbingtoday i can finish all12:30
bdacaJust one question: any purpose why manila-api binds to :::, not to specific address?12:31
sdakemliima if that is the case, that needs to be fixed -  its a security problem12:31
sdakesurprised nobody  found that in the reviews12:31
berendtmliima can you open a bug report plesae12:32
sdakebdaca should open bug report if possible12:32
sdakemliima can fix12:32
bdacaI will12:32
mliimayes12:32
mliima:)12:32
sdakebdaca if opening a bug report is too hard, mliima can handle it12:32
sdakewe need a tirage bot12:33
sdakeanyone know how to et that up12:33
bdacaI can open bug report12:33
bdacai found config option which should be set too12:33
sdakeits built into openstack12:33
bdacajust thought that there is some specific reason why this is done that way12:34
sdakebdaca we bind all api endpoints to specific ip addresses12:34
sdakebdaca if its not done that way, its a security defect12:34
bdacaI agree12:35
sdakesince nobody should be deploying master, it doesn't have much impact12:35
sdakeuntil we tag 3.0.012:35
bdacaOK, I have to go now, bye12:35
*** bdaca has quit IRC12:35
sdakemliima you may want to just file that bug12:36
sdaketo get the ball rolling12:36
sdakeor fix it s a trivialfix12:36
mliimaok12:36
sdakeprobably dont neeed the ebug ovrehead tbh12:37
sdakeuntil afte rc1 - ater rc1, *all* changes need bug ids12:37
openstackgerritSteven Dake proposed openstack/kolla: DNM : Test of gating with delorean rabbitmq  https://review.openstack.org/36726912:38
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: gating with delorean rabbitmq  https://review.openstack.org/36726912:43
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726912:44
sdakepbourke inc0 nice job on the customizations design12:45
sdakei prefer it to the dsl i invented12:45
sdakeI think over time we will need to refine it12:45
sdakeyour welcome for me finding a bunch of cats to do the work ;)12:46
sdakeand thank you for beating the reviews into submission and fixing the dangling problems12:46
sdakeis everything done re customization?12:46
sdakepbourke ^12:46
sdakeinc0 isn't here12:46
openstackgerritMerged openstack/kolla-kubernetes: Fail nova-compute init container always  https://review.openstack.org/36438712:47
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726912:49
*** rhallisey has quit IRC12:52
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726912:55
zhubingbingsdake12:55
sdakeshoot12:55
zhubingbingcan you review barbican12:55
sdakeyou hae to be kidding ;)12:56
sdakei just spent 5 hours sorting out _ vs - and .xz vs .ez12:56
sdakein no shape to provide a useful review12:56
zhubingbing- -12:56
sdakebut your wish is my commnd when I awake and warm up :)12:56
zhubingbingok thanks12:56
sdakei can take a quick scan though if you like now12:56
sdakewhile i wait for the gates to churn12:56
sdakelink pls12:57
*** shardy is now known as shardy_mtg12:57
zhubingbingYou should have a good night's sleep.12:57
sdakenot going to bed until gate passess green12:57
sdakemay be on a 36 hour bender here12:57
sdakeneed to release liberty asap12:58
zhubingbinghttps://review.openstack.org/#/c/367298/12:58
zhubingbingtest gate  is  failed12:59
sdakezhubingbing yes i know12:59
sdakezhubingbing i am working on fixing this exact problem12:59
sdakewe dont tag unless atleast hte gate is green12:59
sdakefor the main mielstone of 3.0.0 we do alot of manual testing as well13:00
sdakewe can fix that by improving the gate13:00
zhubingbingyes13:00
sdakezhubingbing after 3.0.0 is done, i think the way you learn - you would be very helpful improving the gating13:00
sdakeif tht is somethig nyou have interest in13:00
sdakeuntil then we arein firefight mode fixing bugs and finishing rc113:01
zhubingbingI don't know how to learn this.13:01
sdakezhubingbing fortunately i have documented it :)13:01
zhubingbinggood13:01
zhubingbinggive me13:01
sdakezhubingbing https://etherpad.openstack.org/p/kolla-newton-summit-kolla-gate-walkthru13:02
sdakebookmark it13:02
sdakesome of the links are off13:02
zhubingbingiok13:02
sdakewe had a 3 hour session on it13:02
sdakemay repeat it at thissummit13:03
sdakebut it should give ou a general idea13:03
zhubingbingi'm going to learn this document.13:04
*** zhurong has joined #openstack-kolla13:04
sdakezhubingbing do later13:05
sdakebookmark for now13:05
sdakeimo :)13:05
sdakedo whateveryou like13:05
sdakebut we need high bug fixx rate and high blueprint fix rate13:06
sdakezhubingbing re barbican - need links plz13:06
zhubingbingok13:07
zhubingbingi have recheck barbican13:07
sdakeping me ink13:07
sdakei'll review anyway13:07
sdakerather link me link13:07
sdakezhubingbing fwiw - recommend bookmarking this: https://wiki.openstack.org/wiki/Design_Summit/Newton/Etherpads#Kolla13:08
sdakeif you plan to make it  to summit, it will help to have the context13:08
*** jheroux has joined #openstack-kolla13:09
zhubingbingok13:09
mliimabdaca ping?13:10
sdakemliima he had to go13:12
*** shardy_mtg is now known as shardy13:14
*** b_bezak has quit IRC13:16
openstackgerritzhubingbing proposed openstack/kolla: Added telegraf role  https://review.openstack.org/34644813:19
*** sdake_ has joined #openstack-kolla13:20
*** sdake has quit IRC13:22
*** salv-orlando has joined #openstack-kolla13:34
*** b_bezak has joined #openstack-kolla13:39
*** mbound_ has joined #openstack-kolla13:39
*** mbound has quit IRC13:41
*** salv-orlando has quit IRC13:42
mliimasdake13:48
*** fguillot has joined #openstack-kolla13:48
mliimabdaca was right, we have a bug13:48
mliimahttps://github.com/openstack/manila/blob/5abf1a23/manila/service.py#L56-L61 sdake13:50
*** Administrator_ has joined #openstack-kolla13:51
*** neilus has quit IRC13:52
*** tonanhngo has joined #openstack-kolla13:53
openstackgerritMerged openstack/kolla: Improve script to check used source versions  https://review.openstack.org/35264013:53
*** tonanhngo has quit IRC13:53
mliimaWe have two ways to fix it. The first one is just add an explanation about it in http://docs.openstack.org/developer/kolla/manila-guide.html13:53
*** zhugaoxiao has quit IRC13:54
mliimathe second one is add osapi_share_listen in globals.yml13:54
mliimai preffer add it in manila guide13:55
mliimasdake?13:55
*** egonzalez90 has joined #openstack-kolla13:56
openstackgerritzhubingbing proposed openstack/kolla: Added grafana role  https://review.openstack.org/34645013:57
*** huikang has joined #openstack-kolla13:57
*** diogogmt_ has joined #openstack-kolla13:58
openstackgerritzhubingbing proposed openstack/kolla: Added telegraf role  https://review.openstack.org/34644813:58
*** diogogmt has quit IRC14:00
*** diogogmt_ is now known as diogogmt14:00
sdake_mliima thoe are both wrong14:01
openstackgerritMerged openstack/kolla-kubernetes: Neutron endpoint are wrong value..  https://review.openstack.org/36724614:01
sdake_take a look at: https://github.com/openstack/kolla/blob/master/ansible/roles/nova/templates/nova.conf.j2#L1514:02
openstackgerritWaldemar Znoinski proposed openstack/kolla: Non-default database port documentation.  https://review.openstack.org/36631514:03
sdake_api_interface is our default listen port14:03
sdake_for api services14:03
sdake_sorry listen ip adddress14:03
openstackgerritMerged openstack/kolla: Fix lost parameter --remote in generated start_ovsdb_server.sh  https://review.openstack.org/36202714:04
mliimaok sdake_ :)14:04
*** mrjk has quit IRC14:06
openstackgerritMerged openstack/kolla: Added influxdb role  https://review.openstack.org/34644914:06
openstackgerritWaldemar Znoinski proposed openstack/kolla: Non-default database port documentation.  https://review.openstack.org/36631514:06
*** nihilifer has joined #openstack-kolla14:08
*** _coolsvap_ is now known as coolsvap14:09
*** sdake has joined #openstack-kolla14:10
zhubingbingsdake you don't go to sleep ?14:11
*** sdake_ has quit IRC14:12
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608214:12
*** harleyren has joined #openstack-kolla14:14
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726914:14
*** papacz has quit IRC14:14
*** tonanhngo has joined #openstack-kolla14:15
*** papacz has joined #openstack-kolla14:15
*** zhurong has quit IRC14:16
*** tonanhngo has quit IRC14:16
*** zhurong has joined #openstack-kolla14:17
openstackgerritMauricio Lima proposed openstack/kolla: Fix manila-api binds to :::  https://review.openstack.org/36741314:17
*** huikang has quit IRC14:20
*** huikang has joined #openstack-kolla14:21
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457314:22
openstackgerritMauricio Lima proposed openstack/kolla: Add Checking free port for Manila API  https://review.openstack.org/36741614:22
*** msimonin has quit IRC14:23
*** msimonin has joined #openstack-kolla14:23
*** msimonin has quit IRC14:23
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608214:23
*** mrjk has joined #openstack-kolla14:24
*** huikang has quit IRC14:25
mliimadone sdake :)14:26
openstackgerritPrithiv proposed openstack/kolla: Add Networking-SFC roles in ansible  https://review.openstack.org/34684214:32
*** tonanhngo has joined #openstack-kolla14:33
*** tonanhngo has quit IRC14:34
*** janki has joined #openstack-kolla14:37
*** kproskurin has quit IRC14:37
*** tonanhngo has joined #openstack-kolla14:39
*** daneyon has joined #openstack-kolla14:40
*** salv-orlando has joined #openstack-kolla14:40
*** prithiv has quit IRC14:43
*** michauds has joined #openstack-kolla14:43
*** daneyon has quit IRC14:45
*** prithiv has joined #openstack-kolla14:50
*** b_bezak has quit IRC14:56
*** rhallisey has joined #openstack-kolla14:56
*** yingjun has joined #openstack-kolla14:58
*** inc0 has joined #openstack-kolla14:59
inc0good morning14:59
sean-k-mooney0/ inc014:59
inc0zhubingbing, https://review.openstack.org/#/c/366230/ centos is there and it should work15:00
inc0I just didn't test centos upgrade yet15:00
inc0Jeffrey4l__ was meant to do it;)15:00
zhubingbinghi15:01
zhubingbinghere15:01
zhubingbingok15:01
zhubingbingi will change +115:01
zhubingbinginco, i thanks we should test for cents upgrade15:03
zhubingbingif you have free time15:03
inc0issue is I don't have handy centos environment15:09
*** zhurong has quit IRC15:09
inc0I'll try to set it up tho15:09
wznoinskhi all et cores15:14
wznoinskI need opinions to get https://review.openstack.org/#/c/366315 in one direction (as it is) or apply Paul's suggestion please15:15
*** prithiv1 has joined #openstack-kolla15:17
*** dwalsh_ has quit IRC15:17
*** prithiv has quit IRC15:18
*** mbound_ has quit IRC15:18
*** sdake_ has joined #openstack-kolla15:21
*** sdake has quit IRC15:22
inc0wznoinsk, I see what's an issue15:28
inc0database != mariadb15:28
inc0we have many databases15:28
inc0mongo, memchached and so on15:29
pbourkewznoinsk: inc0: I understand you're just closing the bug, but it was created because someone stuck a docimpact into a patch15:29
inc0so what you could do is: "To specify port of services you can use << service name >>_port variable. For example mariadb_port: 330615:29
pbourke^^15:30
inc0well pbourke it is a proper bug;) regardless how it was created. I think this use case is worth documenting. Just let's be strict with our nomenclature15:30
wznoinskinc0: sure, I like Paul's suggestion, just wanted to have some other cores opinions15:30
inc0fair enough'15:31
inc0but please - I really don't like "database_port";)15:31
inc0it's mariadb port15:31
*** kproskurin has joined #openstack-kolla15:32
wznoinskthe only reason I went that route is because there was a dtabase_user there already15:32
openstackgerritPrithiv proposed openstack/kolla: Add Networking-SFC roles in ansible  https://review.openstack.org/34684215:32
openstackgerritcaoyuan proposed openstack/kolla: Update the command to restart the docker  https://review.openstack.org/36746515:33
wznoinskI'm good with either approach (document in advanced configs or not, can change database to mariadb port too), I can add a generic non-default port advanced config info as a separate patchset, I don't have a hard opinion here, will follow what you guys think is best here15:34
inc0it's cool, thanks for patchset15:35
*** harleyren has quit IRC15:36
*** prithiv1 has quit IRC15:36
*** matrohon has quit IRC15:37
*** mgoddard_ has joined #openstack-kolla15:37
*** neilus has joined #openstack-kolla15:39
*** lrensing_ has joined #openstack-kolla15:39
*** egonzalez90 has quit IRC15:40
*** mgoddard has quit IRC15:40
*** vhosakot has joined #openstack-kolla15:42
*** mgoddard_ has quit IRC15:44
*** prithiv has joined #openstack-kolla15:45
openstackgerritMauricio Lima proposed openstack/kolla: Fix manila-api binds to ::  https://review.openstack.org/36741315:45
mliimapbourke, ping15:46
mliimacurrently manila api binds to ::, and not to specific address.15:47
Jeffrey4l__hi inc0 i am working on it. Will report u the result later today.15:47
inc0kk15:47
inc0thank you!15:47
pbourkemliima: hi15:48
mliimacurrently manila api binds to ::, and not to specific address. pbourke15:49
pbourkemliima: :: == 0.0.0.0 ?15:49
mliimayes15:49
pbourkeI see, thanks15:49
*** jgriffith_away is now known as jgriffith15:53
openstackgerritMerged openstack/kolla: Update the command to restart the docker  https://review.openstack.org/36746515:54
*** janki has quit IRC15:56
*** janki has joined #openstack-kolla15:58
*** mgoddard has joined #openstack-kolla15:58
openstackgerritMerged openstack/kolla: loc fails with recent removal of heat dev env  https://review.openstack.org/36732915:59
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Check for service name in resource name  https://review.openstack.org/36698316:05
*** prithiv has quit IRC16:05
*** fguillot has quit IRC16:07
*** bdaca has joined #openstack-kolla16:07
*** fguillot has joined #openstack-kolla16:08
*** edi_ has joined #openstack-kolla16:10
*** fguillot has quit IRC16:11
pbourkecan I get some eyes on https://review.openstack.org/#/c/366878/16:18
pbourkeits one of those ones that will be hard to keep up to date16:19
*** mbound has joined #openstack-kolla16:19
*** unicell has joined #openstack-kolla16:23
*** mbound has quit IRC16:24
*** unicell1 has quit IRC16:25
openstackgerritPaul Bourke proposed openstack/kolla: Add header blocks to all Dockerfiles  https://review.openstack.org/36687816:27
*** daneyon has joined #openstack-kolla16:28
*** janki has quit IRC16:28
*** daneyon has quit IRC16:32
*** tonanhngo has quit IRC16:33
*** tonanhngo has joined #openstack-kolla16:34
*** fragatina has joined #openstack-kolla16:37
*** fguillot has joined #openstack-kolla16:37
*** tonanhngo has quit IRC16:38
*** fguillot has quit IRC16:40
*** fragatina has quit IRC16:41
*** zhubingbing has quit IRC16:41
mliimahey cool guys, i need some reviews here https://review.openstack.org/#/c/367413/16:44
*** neilus has quit IRC16:44
bdacaThanks mliima for handling this :)16:47
*** 5EXABBIK0 has joined #openstack-kolla16:48
mliimabdaca, :)16:49
*** fguillot has joined #openstack-kolla16:49
*** fguillot has quit IRC16:52
*** neilus has joined #openstack-kolla16:52
*** fguillot has joined #openstack-kolla16:54
*** neilus has quit IRC16:56
*** jheroux has quit IRC16:57
sdake_carry on carry on16:58
sdake_because nothing really matters16:58
inc0sdake_ today with a nihilist mood I see17:01
*** unicell has quit IRC17:01
*** 5EXABBIK0 has quit IRC17:02
*** vhosakot has quit IRC17:03
*** neilus has joined #openstack-kolla17:07
*** vhosakot has joined #openstack-kolla17:08
*** fguillot_ has joined #openstack-kolla17:14
bdacatoo late, my time has come? ;)17:14
*** fguillot_ has quit IRC17:15
openstackgerritOpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements  https://review.openstack.org/36753717:18
openstackgerritBartłomiej Daca proposed openstack/kolla: Adding manila endpoints to HAProxy  https://review.openstack.org/36753817:20
*** huikang has joined #openstack-kolla17:25
Jeffrey4l__inc0, https://review.openstack.org/#/c/366230/8 this is tested. it works on CentOS. But there are some nit.17:27
*** unicell has joined #openstack-kolla17:28
inc0kk will fix in a bit17:30
*** michauds has quit IRC17:30
openstackgerritMerged openstack/kolla: Fix manila-api binds to ::  https://review.openstack.org/36741317:33
*** ssurana has joined #openstack-kolla17:37
*** mrjk has quit IRC17:41
*** Jeffrey4l__ has left #openstack-kolla17:42
*** Jeffrey4l__ has joined #openstack-kolla17:42
Jeffrey4l__inc0, sdake_ pbourke please review this https://review.openstack.org/#/c/345751/17:42
Jeffrey4l__this is required when using ceilometer.17:42
Jeffrey4l__currently, there is no ha in mongodb and it may loss data.17:44
mliimaJeffrey4l__, https://review.openstack.org/#/c/366247/ :)17:45
*** yingjun has quit IRC17:49
Jeffrey4l__mliima, done17:51
sdake_inc0 3 hours of sleep will do that to you17:51
*** tonanhngo has joined #openstack-kolla17:51
*** tonanhngo has quit IRC17:54
*** LamT_ has joined #openstack-kolla17:54
*** tonanhngo has joined #openstack-kolla17:55
sdake_jeffrey4l_ irensing- hs informed me that mongodb has no credentials!17:58
sdake_true or false?17:58
*** mrjk has joined #openstack-kolla17:58
lrensing_from the vmtp code it doesn't appear to use credentials17:58
lrensing_https://github.com/openstack/vmtp/blob/master/vmtp/pns_mongo.py#L3317:59
lrensing_so, i'm not sure how to handle bootstrapping mongodb17:59
*** fragatina has joined #openstack-kolla18:01
*** neilus has quit IRC18:01
inc0lrensing_, we can always use this https://github.com/dcramer/mangodb18:03
*** egonzalez90 has joined #openstack-kolla18:13
openstackgerritEduardo Gonzalez proposed openstack/kolla: Add Senlin Ansible role  https://review.openstack.org/33972518:15
*** mrjk has quit IRC18:20
*** athomas has quit IRC18:21
*** fguillot_ has joined #openstack-kolla18:25
*** fguillot_ has quit IRC18:26
*** sdake_ is now known as sdake18:27
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Host Labels  https://review.openstack.org/36574118:28
openstackgerritBartłomiej Daca proposed openstack/kolla: Fix manila-api binds to ::  https://review.openstack.org/36756618:29
bdacamliima: I forwarded your changes to stable/mitaka18:30
mliimaok bdaca18:30
*** lrensing_ has quit IRC18:31
*** mrjk has joined #openstack-kolla18:32
*** michauds has joined #openstack-kolla18:33
*** huikang has quit IRC18:36
*** huikang has joined #openstack-kolla18:36
*** fguillot_ has joined #openstack-kolla18:36
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup patch  https://review.openstack.org/36645018:37
*** fguillot_ has quit IRC18:39
*** huikang has quit IRC18:41
*** huikang has joined #openstack-kolla18:41
*** Jeffrey4l__ has quit IRC18:42
*** mgoddard has quit IRC18:43
*** dmsimard is now known as dmsimard|afk18:45
*** david-lyle has quit IRC18:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Host Labels  https://review.openstack.org/36574118:53
*** david-lyle has joined #openstack-kolla18:53
*** Jeffrey4l__ has joined #openstack-kolla18:54
sdakeinco: A database that operates at CLOUD SCALE18:55
sdakeinc0 that is18:55
inc0sdake, did you look at license of it?18:57
inc0or code?;)18:57
sdakeno18:57
inc0take a look18:57
sdakegood thing its notdonate $1 to everyone smarter the nyou18:58
sdakei'd be fucked :)18:58
*** vhosakot_ has joined #openstack-kolla19:00
*** mbound has joined #openstack-kolla19:00
inc0nah, it's "someone";)19:02
*** vhosakot has quit IRC19:03
*** salv-orlando has quit IRC19:06
sdakeinc0 since you roll with ubuntu19:07
sdakewhich version of rabbitmq does cloudarchive carry?19:07
*** vhosakot_ has quit IRC19:08
*** vbel has quit IRC19:08
*** vbel has joined #openstack-kolla19:08
inc0for us? let me check19:08
inc0 3.5.7-1  for xenial19:08
sdakeno19:08
sdakethat is installed from git19:08
sdakewhat aboutcloud archive19:09
sdakerather installed ffrom rabbitmq.org19:09
*** lrensing_ has joined #openstack-kolla19:09
sdakelrensing_ getting dave's iput on vmtp19:10
sdakebuthe is in a meeting atm19:10
lrensing_np19:10
lrensing_i think i dc'd from irc19:10
lrensing_hope i didnt miss anything19:10
*** daneyon has joined #openstack-kolla19:10
sdakeinc0 this review: https://review.openstack.org/#/c/367269/19:11
*** vhosakot has joined #openstack-kolla19:12
sdakeliberty isbusted because of pulling rabbitmq from rabbitmq.com and turning off ipv6 netowrking in the gate jobs19:12
*** eaguilar has joined #openstack-kolla19:14
*** daneyon has quit IRC19:15
sdakeinc019:21
sdakeinc019:21
sdakeinc019:21
sdakeinc019:21
sdakecome to your computer pls :)19:21
*** coolsvap has quit IRC19:22
*** Pavo has joined #openstack-kolla19:23
inc0hmm19:24
inc0let me take a look19:24
inc0btw link you've added is for clusterer19:25
inc0which is plugin19:25
*** egonzalez90 has quit IRC19:27
inc0sdake, so what is the issue? I mean, you're bumping up rabbimq version19:28
sdakei jjust explained the issue19:29
inc0can you lock version to 3.5.7 in centos?19:29
inc0and install if from repos?19:29
openstackgerritMerged openstack/kolla-kubernetes: Host Labels  https://review.openstack.org/36574119:29
sdakethere is no repo version of 3.5.719:29
inc0hence the http install19:29
sdakecan you tell me if the repos for uca have 2.6 or later?19:29
inc03.5.7 is repo version of UCA19:29
sdakeweak19:29
sdakeok19:29
sdakei'll sort it out19:30
inc0what you did in your patch is to change version in centos19:30
inc0and ubuntu stayed the same19:30
sdakei know - i looked at the gate logs19:30
inc0we need to figure out single version for rabbitmq, or we're in world of pain19:30
sdakefor centos, we need to use what comes from the cloud sig19:30
inc0what we could do is to add rabbitmq repo fro ubuntu19:31
sdakerabbitmq's  implementation is a pile eof crap19:31
inc0and try to install 3.5.719:31
inc03.6*19:31
sdakei'll just make he plugin conditional19:31
sdakeproblem solve19:31
sdaked19:31
sdake3.5.7 relies on old version of erlang which craters epmd if ipv6 is turned off in the system19:32
inc0no if you make plugin conditional you're throwing our ha away19:32
inc0also this is in build phase19:32
sdakeplease explain how19:32
inc0plugin is meant to do rabbitmq cluster19:33
sdakewe support all centos or all ubuntu19:33
sdakeya for centos install 3.6.x plugin for ubuntu install 3.5 plugin19:33
inc0our configs are built around this plugin19:33
sbezverkkfox1111: it looks like there is an issue with using sed in init container with multiple escape19:33
sdakethe configs are the same19:33
inc0you really want to have 2 distinct versions at same time19:33
inc0?19:33
sbezverkkfox1111: I opened an issue with kubernetes folks19:33
inc0let's fix it correctly and find out how can we install 3.6+ on ubuntu19:34
sdakenot particularly but i don't want to pull rom rabbitmq.com19:34
*** Pavo has quit IRC19:34
sdakerabbitmq.com epmd craters with same bug19:34
sdakecloud sig has fixed it but not pushed their patches upstream19:34
inc0btw how exactly to reproduce it?19:35
*** mgoddard has joined #openstack-kolla19:36
sdaketurn off ipv6 in gate job on ubuntu19:36
inc0question, why is it turned off in centos?19:36
sdakeno idea sam left a  huge commit log but didnt explain the ipv6 change19:37
sdake(via git blame)19:37
inc0in centos gate?19:38
sdakeyup19:38
inc0can we try to turn it on?19:38
sdakethat doesn't solve the problem19:38
inc0because I know for a fact that there will be gates working solely on ipv6519:38
sdakebecause if an operator turns it off, epmd segfaults19:39
inc0ok, but we need to disect problem19:39
sdakeipv65 - more address space then starts in the universse ;)19:39
sdakei already disected it19:39
inc0but your solution isn't good one.19:39
inc0we can't have 2 versions of rabbitmq19:39
sdakeyou are incorrect19:39
inc0especially with different y19:39
sdakewe already do in liberty19:39
inc0well, we shouldn't have then19:40
inc0I'd rather put epmd as requirement19:40
inc0and upgrade rabbitmq properly in O19:40
inc0or try to squeeze it in N, but that's gonna be hard19:41
sdakeepmd can't be set as a requirement19:41
*** Pavo has joined #openstack-kolla19:41
sdakei'll own this one19:41
inc0as it's one of hardest upgrades in our code19:41
inc0why can't we have epmd as requirement?19:42
sdakeits built into eerlang19:42
inc0ok, so why would you want to turn it off?19:42
inc0I mean, if you want to run rabbitmq19:43
sdakei am not turning it off19:43
sdakei am using a working version threof19:43
sdakeepmd is required by erlang19:43
sdakeepmd is written in c19:43
sdakethe code is a pile of crap19:43
inc0ahh19:44
inc0well19:44
inc0we might say that we require ipv6 to not be turned off19:44
inc0that's what I meant, sorry for confussion19:44
inc0and upgrade rabbitmq in following cycle19:44
sdakeit is turned off for a rason19:44
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Checks to start reducing Technical Debt  https://review.openstack.org/36580519:44
sdakeif yu read the launchpad bug trackers19:44
sdakeepmd with ipv6 doesnt' work19:45
sdakeepmd with ipv6 turned off doesn't work19:45
sdakeits basicallybroken19:45
sdakethe problem is in erlang, not rabbitmq19:45
inc0ok, so we need to upgrade rabbit asap?19:45
sdakeerlang is a dep of rabbitmq19:45
sdakeright19:45
sdakebefore 3.0.019:45
inc0how does people even survive with it then?19:45
sdakeand all across the zstreams19:45
sdakethey are running hacked versions19:46
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583619:47
inc0you're saying that deloeran have a hacked version of rabbitmq?19:48
inc0so, which version of erlang is correct?19:49
*** sdake_ has joined #openstack-kolla19:50
*** Jeffrey4l__ has quit IRC19:50
*** bdaca has quit IRC19:52
*** sdake has quit IRC19:52
sdake_inc0 this is why rabbitmq was crashing for ages on centos19:52
sdake_in the gate only19:52
sdake_and nobody could figure it  out19:52
* sdake_ figured it out19:52
inc0ok, so you want to upgrade rabbitmq to 3.6.5, cool, which version of erlang should we use?19:53
sdake_3.6.219:54
*** dmsimard|afk is now known as dmsimard19:54
inc0ok, 3.6.2, we can download this from github always19:55
*** Pavo has quit IRC19:55
*** eaguilar has quit IRC19:56
sdake_its not rabbitmq, its erlang19:57
sdake_i have a strong strong desiret o get rid of http downloads in the codebase19:57
sdake_they make the gate flakey19:57
*** Pavo has joined #openstack-kolla19:58
inc0but not 3 days before rc1, that's my issue19:59
sdake_going to merge after rc1- then test - then test backports -then backport19:59
inc0we need to validate upgrade and such19:59
sdake_i understand19:59
sdake_i have it under control20:00
inc0so let's go back a bit...erlang doesn't have version 3.6.220:00
inc0min version of erlang for rabbitmq is 1720:00
sdake_holy christ dude20:01
sdake_3.5 uses eerlang 1620:01
sdake_3.6 uses 18 iirc20:01
inc0ok, I was asking for elrang version needed20:01
*** pbourke has quit IRC20:04
*** pbourke has joined #openstack-kolla20:04
inc0so erlang in xenial seems to be 18+20:04
inc0so issue you're referring to shouldn't appear there20:04
inc0can you pin erlang in centos to 18+20:05
inc0?20:05
sdake_not with rabbitmq 3.5.720:05
sdake_dep handling  doesn't work that way20:05
sdake_in centos20:05
inc0let me check how exactly it builds in our containers20:05
*** Pavo has quit IRC20:06
openstackgerritMerged openstack/kolla-kubernetes: Checks to start reducing Technical Debt  https://review.openstack.org/36580520:07
sdake_if you wnat to help don't second guess me :)20:08
openstackgerritMerged openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583620:08
inc0so in xenial we have erlang 1:18.3-dfsg-1ubuntu320:09
inc0along with 3.5.7 rabbitmq20:09
inc0can we do the same for centos?20:09
sdake_no20:09
sdake_i just anwered that questsion20:09
*** tonanhngo has quit IRC20:10
inc0if you pin version of rabbitmq to 3.5.7 in centos, and have erlang 18 in repos, it still will install older version?20:11
sdake_rabbitmq is compiled against erlang20:15
sdake_in ubuntu its compiled against 18 in centos against 1620:15
sdake_so no that doesns't work for the3rd time20:16
*** mgoddard has quit IRC20:16
*** Pavo has joined #openstack-kolla20:16
sdake_we want to use what the distros distribute - it has the widesst testing versus some rpm on rabbitmq.com20:17
sdake_even if it means different versions20:17
sdake_the reason I care is  simple - we can't release our zstreams with broken gates20:17
sdake_and liberty is broekn20:18
inc0yeah, but if our versions are that much different20:18
*** salv-orlando has joined #openstack-kolla20:18
inc0between ubuntu and centos20:18
inc0we'll be in debugging hell if somethign goes wrong20:18
sdake_versions are going to be  the same on all centos20:18
sdake_and sameon al ubuntu branches20:19
inc0yes, but our deployment code is same between centos and ubuntu20:19
inc0so if something changes in this place20:19
inc0we're fucked20:19
inc0well, not that fucked as we can make tasks for centos and ubuntu20:20
inc0but still, ugly20:20
sdake_wonder what this it20:20
sdake_https://hub.docker.com/r/rancher/kolla-base/tags/20:20
inc0interesting20:21
*** salv-orlando has quit IRC20:22
sdake_will be nice to get into technical work20:27
sdake_inc0 woudl you mind pullling that container down and seeing what is inside20:27
sdake_curiosu if its kolla in a box20:27
sdake_the positive of all of  this is we can fix the wildcard bind to epmd20:29
sdake_which we had to use to workaround htis problem in the first place20:29
*** salv-orlando has joined #openstack-kolla20:33
inc0sdake_, it does seem to be kolla in a boc20:34
sdake_sweet20:34
sdake_hows it look20:34
sdake_rancher = job opportunity :)20:34
inc0has a wrong ansible version << sadface >>20:35
sdake_serious?20:35
inc01.9.620:35
sdake_mitaka uses 1.9.620:35
inc0we test kolla on 1.9.420:35
sdake_ya but 1.9.6 works20:35
inc0ok20:36
inc0hopefully, well, it's 1.9.6 so nto that bad20:36
inc0you'd still need to run it with docker access for build and somehow add inventory to this thing20:37
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup patch  https://review.openstack.org/36645020:37
inc0I wonder if rancher guys would help us customize dockerfile a bit20:37
*** tonanhngo has joined #openstack-kolla20:41
*** tonanhngo has quit IRC20:42
*** tonanhngo has joined #openstack-kolla20:42
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457320:45
*** Pavo has joined #openstack-kolla20:48
*** absubram has joined #openstack-kolla20:48
*** shardy has quit IRC20:49
*** fguillot_ has joined #openstack-kolla20:56
*** edi_ has quit IRC20:58
*** harlowja_ has joined #openstack-kolla20:59
*** fguillot_ has quit IRC20:59
*** harlowja has quit IRC21:00
*** huikang has quit IRC21:02
*** neilus has joined #openstack-kolla21:03
*** fguillot_ has joined #openstack-kolla21:03
*** huikang has joined #openstack-kolla21:03
*** lrensing_ has quit IRC21:05
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix missing Exception around exception string  https://review.openstack.org/36763021:07
*** huikang has quit IRC21:07
*** neilus has quit IRC21:08
*** fguillot_ has quit IRC21:13
*** Pavo has quit IRC21:16
*** fguillot_ has joined #openstack-kolla21:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457321:16
*** williamcaban has quit IRC21:17
*** Pavo has joined #openstack-kolla21:17
*** Pavo has quit IRC21:18
*** dwalsh has quit IRC21:18
*** williamcaban has joined #openstack-kolla21:18
*** Pavo has joined #openstack-kolla21:22
*** lyncos has joined #openstack-kolla21:23
*** williamcaban has quit IRC21:24
openstackgerritMerged openstack/kolla-kubernetes: Fix missing Exception around exception string  https://review.openstack.org/36763021:26
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457321:27
*** huikang has joined #openstack-kolla21:32
*** fguillot_ is now known as fguillot_afk21:36
*** fguillot_afk has quit IRC21:37
*** huikang has quit IRC21:37
openstackgerritMerged openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457321:41
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup patch  https://review.openstack.org/36645021:43
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726921:49
*** fguillot_ has joined #openstack-kolla21:50
sdake_why does our build code print out two lines of debug per output21:53
* sdake_ shakes fists21:53
*** vhosakot has quit IRC21:53
*** eaguilar has joined #openstack-kolla22:02
openstackgerritMerged openstack/kolla-kubernetes: Cleanup patch  https://review.openstack.org/36645022:02
*** fguillot_ has quit IRC22:06
*** mbound has quit IRC22:08
*** neilus has joined #openstack-kolla22:11
*** michauds has quit IRC22:14
*** absubram has quit IRC22:15
*** neilus has quit IRC22:16
*** harlowja has joined #openstack-kolla22:18
sdake_inc0 ping22:22
*** harlowja_ has quit IRC22:22
inc0here22:23
inc0wassup sdake_22:24
*** neilus has joined #openstack-kolla22:30
*** ntpttr has quit IRC22:31
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Kube Glance bootstrap cleanup  https://review.openstack.org/36768122:31
*** ntpttr has joined #openstack-kolla22:31
openstackgerritSteven Dake proposed openstack/kolla: NOT READY FOR MERGE: Use delorean rabbitmq  https://review.openstack.org/36726922:32
*** sdake has joined #openstack-kolla22:34
inc0sdake your code will break on rhel, oraclelinux and fedora22:34
*** neilus has quit IRC22:34
sdakeclearly22:34
sdakeand debian22:35
*** sdake_ has quit IRC22:36
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Kube Glance bootstrap cleanup  https://review.openstack.org/36768122:37
sdakeinc0 any ideas to solve22:46
*** rhallisey has quit IRC22:51
*** sdake has quit IRC22:59
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Kube Glance bootstrap cleanup  https://review.openstack.org/36768123:02
*** williamcaban has joined #openstack-kolla23:07
*** williamcaban has quit IRC23:12
*** kproskurin has left #openstack-kolla23:18
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Kube Glance bootstrap cleanup  https://review.openstack.org/36768123:22
*** ntpttr has quit IRC23:23
*** ntpttr has joined #openstack-kolla23:28
*** mtaylor22 has joined #openstack-kolla23:40
*** fguillot has quit IRC23:41
*** daneyon has joined #openstack-kolla23:41
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup resource and resource-template  https://review.openstack.org/36643723:44
*** daneyon has quit IRC23:46
*** zhurong has joined #openstack-kolla23:46
*** fguillot has joined #openstack-kolla23:47
*** dcwangmit01 has quit IRC23:53
*** dcwangmit01 has joined #openstack-kolla23:53
*** zhurong has quit IRC23:56
*** fguillot has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!