Tuesday, 2016-09-20

*** neilus has quit IRC00:00
*** zhurong has quit IRC00:04
openstackgerritKevin Fox proposed openstack/kolla: Allow genconfig to work with kolla-kubernetes and ceph  https://review.openstack.org/37281100:04
*** duonghq has joined #openstack-kolla00:21
*** jtriley has joined #openstack-kolla00:30
*** huikang has joined #openstack-kolla00:34
*** bjolof__ has joined #openstack-kolla00:41
*** bjolo__ has joined #openstack-kolla00:41
*** bjolo has quit IRC00:41
*** bjolo_ has quit IRC00:44
openstackgerritzhongshengping proposed openstack/kolla: Deprecate old auth parameters of ironic in nova.conf  https://review.openstack.org/37230600:44
*** caowei has joined #openstack-kolla01:02
*** phuongnh has joined #openstack-kolla01:05
*** zhurong has joined #openstack-kolla01:12
*** zhubingbing has joined #openstack-kolla01:17
*** Marcellin__ has quit IRC01:17
*** gfhellma has quit IRC01:20
*** rstarmer has joined #openstack-kolla01:25
duonghqsdake: so we deprecate both fedora and debian support?01:25
duonghq(just to confirm)01:25
openstackgerritdupengfei proposed openstack/kolla: Support shared path for glance images and nova instances disk  https://review.openstack.org/37242001:32
*** huikang has quit IRC01:35
*** huikang has joined #openstack-kolla01:35
openstackgerritdupengfei proposed openstack/kolla: Fix keystone,database,memcache for k8s.  https://review.openstack.org/37208901:38
openstackgerritcaoyuan proposed openstack/kolla: Remove the redundant command when deployment  https://review.openstack.org/37160801:39
*** huikang has quit IRC01:39
*** salv-orl_ has joined #openstack-kolla01:42
*** neilus has joined #openstack-kolla01:43
*** salv-orlando has quit IRC01:45
*** fguillot has quit IRC01:46
openstackgerritcaoyuan proposed openstack/kolla: Remove the redundant command when deployment  https://review.openstack.org/37160801:47
*** neilus has quit IRC01:48
sdakeduonghq there are seprate votes for each since they are seprate distributions01:52
sdakeduonghq depends on the voting of the core reviewer team01:52
duonghqsdake: but current trending is going to remove those?01:53
*** signed8bit has joined #openstack-kolla01:54
*** signed8bit has quit IRC01:54
duonghqwonder if I misunderstand01:54
*** rstarmer has quit IRC02:00
*** rstarmer has joined #openstack-kolla02:05
*** unicell has quit IRC02:05
*** sdake has quit IRC02:06
*** sdake has joined #openstack-kolla02:06
*** schwicht has quit IRC02:08
sdakeduonghq i can't predict votes - votes require a mjaority pproval02:08
duonghqroger sdake02:11
*** schwicht has joined #openstack-kolla02:12
*** rstarmer has quit IRC02:12
*** sdake has quit IRC02:18
*** lulei has quit IRC02:21
*** rstarmer has joined #openstack-kolla02:24
*** daneyon has joined #openstack-kolla02:25
*** rstarmer has quit IRC02:29
*** rstarmer has joined #openstack-kolla02:29
*** daneyon has quit IRC02:29
openstackgerritWei Cao proposed openstack/kolla: Delete extra spaces in baremetal install.yml  https://review.openstack.org/37284202:32
*** neilus has joined #openstack-kolla02:38
*** dave-mccowan has quit IRC02:41
*** huikang has joined #openstack-kolla02:41
*** neilus has quit IRC02:44
*** schwicht has quit IRC02:54
*** huikang has quit IRC02:57
*** williamcaban has joined #openstack-kolla03:03
*** david-lyle has quit IRC03:03
*** williamcaban has quit IRC03:07
*** huikang has joined #openstack-kolla03:08
*** coolsvap has joined #openstack-kolla03:22
*** tonanhngo has joined #openstack-kolla03:35
*** unicell has joined #openstack-kolla03:39
*** tonanhngo has quit IRC03:39
*** tonanhngo has joined #openstack-kolla03:45
*** daneyon has joined #openstack-kolla04:13
zhubingbingevery boys04:15
*** daneyon has quit IRC04:18
*** bdaca has joined #openstack-kolla04:18
bdacamorning04:18
openstackgerritMerged openstack/kolla: Update EPEL version in base  https://review.openstack.org/37279704:24
bjolof__morning04:25
*** neilus has joined #openstack-kolla04:26
bjolof__http://paste.openstack.org/show/581647/04:27
bjolof__about the same time for reconfigure as before. Seems like TLS did not have anything to do with it04:27
openstackgerritJeffrey Zhang proposed openstack/kolla: Mark include-footer and include-header deprecated for removal  https://review.openstack.org/37288004:28
openstackgerritMerged openstack/kolla: Fix using rhel as a base build image  https://review.openstack.org/37257004:28
Jeffrey4l_bjolof__, reconfiguration run in serial, i.e. reconfigure 30% node at one time. so it is slow.04:29
bjolof__i have asked before, but i do it again. Is anyone doing any active testing on minimal/docker host os's. i.e. coreos, ranchos, atomic, etc?04:30
Jeffrey4l_no idea04:30
*** neilus has quit IRC04:30
bjolof__Jeffrey4l_, ok, but still why should a reconfigure take 92min?04:31
Jeffrey4l_it shouldn't. we need some optimize in the future.04:31
Jeffrey4l_a trick method is: if you know which configuration is change, you can use `--tag` parameter.04:32
Jeffrey4l_like `kolla-ansible reconfigure -t neutron`04:32
Jeffrey4l_bjolof__, ^04:33
Jeffrey4l_how many node are you deploying?04:33
bjolof__3 net, 3 cont, 48 compute04:33
openstackgerritMerged openstack/kolla: Install extra packages for gnocchi using setuptools extra feature  https://review.openstack.org/37252904:34
Jeffrey4l_ok. did u use a high ansible fork parameter? it may make the task faster.04:35
Jeffrey4l_But reconfigure is not idea for sure.04:35
bjolof__3004:35
*** v1k0d3n has quit IRC04:35
Jeffrey4l_idea/ideal04:36
*** Jeffrey4l_ is now known as Jeffrey4l04:36
bjolof__Jeffrey4l_, we had a discussion here a couple of hours ago (sdake, inc0) they asked me to rerun the deploy, and reconfigure and report in04:36
Jeffrey4lok.04:37
*** zhurong has quit IRC04:43
*** bjolof__ has quit IRC04:45
*** sdake has joined #openstack-kolla04:46
*** tonanhngo has quit IRC04:50
*** tonanhngo has joined #openstack-kolla04:51
*** williamcaban has joined #openstack-kolla04:51
*** williamcaban has quit IRC04:56
*** huikang has quit IRC04:57
openstackgerritJeffrey Zhang proposed openstack/kolla: Change Mariadb default character set to utf8  https://review.openstack.org/37186905:04
*** jroll has quit IRC05:09
*** jroll has joined #openstack-kolla05:09
*** jroll has quit IRC05:09
*** jroll has joined #openstack-kolla05:09
*** aswadr_ has joined #openstack-kolla05:29
*** neilus has joined #openstack-kolla05:35
*** zhurong has joined #openstack-kolla05:35
*** hieulq has quit IRC05:36
*** phuongnh has quit IRC05:37
*** duonghq has quit IRC05:38
*** phuongnh has joined #openstack-kolla05:38
*** neilus has quit IRC05:40
openstackgerritdupengfei proposed openstack/kolla: Support shared path for glance images and nova instances disk  https://review.openstack.org/37242005:43
*** jtriley has quit IRC05:46
*** zhurong has quit IRC05:47
*** zhurong has joined #openstack-kolla05:47
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove no-cache option in build.py  https://review.openstack.org/37290105:48
*** msimonin has joined #openstack-kolla05:51
*** hieulq has joined #openstack-kolla05:51
sdakeJeffrey4l on the no-cache removal05:53
Jeffrey4lsdake, yep05:53
sdakecan you explain the reasoning05:53
Jeffrey4lwe have two option about this now: --cache and --no-cache05:54
Jeffrey4lit is historical issue.05:54
Jeffrey4lbefore we using oslo.config, we have --no-cache parameter.05:55
sdakewhat does --cache do?05:55
Jeffrey4lafter we start using oslo.config, we add --cache parameter.05:55
Jeffrey4lthe root cause for this change is: oslo.config support automatically negative option for boolean type.05:56
*** msimonin has quit IRC05:56
Jeffrey4lif we still use --no-cache parameter in oslo.config, it will gernerate a option named --nono-cache  automatically.05:56
Jeffrey4ltherefore, we moved to --cache and --nocache will be generated automatically.05:57
Jeffrey4land marked --no-cache deprecated for removal .05:57
Jeffrey4lsdake, ^05:57
Jeffrey4lthis is done in newton cycle.05:57
Jeffrey4lso i think it is time to remove it.05:57
Jeffrey4lsorry, this is done in mitaka cycle.05:58
Jeffrey4lsdake, ^^05:58
*** senk has joined #openstack-kolla06:00
Jeffrey4lmake sense?06:03
sdakesorry was busy06:03
sdakelet me read06:03
Jeffrey4lnp06:04
sdakeok sounds good06:04
sdakemy amp fuse blew, and thank god nothing was damaged06:04
sdakeeen jerking around with that for the elast 5 hours06:04
Jeffrey4lneed a better one :)06:06
*** egonzalez90 has joined #openstack-kolla06:07
egonzalez90morning06:10
*** shardy has joined #openstack-kolla06:12
sdakea better fuse? agree06:13
sdakemy amp is chinese made06:13
sdakeits pretty much top of the line for the price point06:13
sdakeline magnetic06:13
sdakehey egonzalez9006:13
openstackgerritMerged openstack/kolla: Add pulling ceilometer-collector image  https://review.openstack.org/37272706:14
zhubingbingping huikang06:16
*** rstarmer has quit IRC06:17
sdakezhubingbing - this morning berendt mentioned barbicana no workey06:19
sdakezhubingbing the implication here is it wasn't tested06:19
zhubingbingok06:19
sdakecan you dig into testing it and making it work properly?06:19
zhubingbingyes06:19
zhubingbingi testing it to working06:19
sdakein additin there is a problem that the default config uses a non-ha file-backed store06:20
sdakeit needs to be ha06:20
zhubingbinghmm06:20
zhubingbingsureļ¼Œ  i will contact berendt06:20
*** rstarmer has joined #openstack-kolla06:21
*** jtriley has joined #openstack-kolla06:25
sdakesouns good06:25
sdakemight research the ha thing06:25
sdakeand the file backed storage06:25
zhubingbingok06:26
zhubingbingbarbican ha ?06:26
zhubingbingyour mean is barbican ha?06:26
zhubingbingi see06:27
*** huhaoran has joined #openstack-kolla06:28
*** jtriley has quit IRC06:30
*** senk has quit IRC06:31
sdakei mean can ou run the barbican server on 3 nodes and it not implode06:36
sdakeand wor kif one o the nodes fail06:36
sdakework if06:36
*** duonghq has joined #openstack-kolla06:37
*** tonanhngo has quit IRC06:39
*** tonanhngo has joined #openstack-kolla06:39
*** williamcaban has joined #openstack-kolla06:39
openstackgerritMd Nadeem proposed openstack/kolla: Remove all bytcode & objectcode  before running tox  https://review.openstack.org/37294406:41
*** unicell1 has joined #openstack-kolla06:43
*** tonanhngo has quit IRC06:43
*** unicell has quit IRC06:43
*** williamcaban has quit IRC06:44
*** bjolo__ is now known as bjolo06:53
bjolomorning06:53
duonghqmorning bjolo06:53
bjolonew day, new builds, new issues to resolve06:54
bjolosdake, did you see my post above about deploy and reconfigure?06:54
sdakeno my alptop was closed s i was out to dinne with my son06:55
sdakewhat wer the results?06:55
bjoloabout the same06:55
sdakewith tls disaled?06:55
bjolohttp://paste.openstack.org/show/58164706:55
sdakeok fair enough -its not tls06:56
sdaketheory disproved06:56
sdakeJeffrey4l - re reconfigure06:56
sdakebjolo is running into some odd behavior with nova06:56
bjoloyes tls disabled06:57
Jeffrey4lyep06:57
sdakeJeffrey4l can you fill me in on what problems you are aware of with reconfigure?06:57
bjolono changes what so ever between deploy and reconfiure06:57
sdakebjolo roger - thts the data point i wanted06:57
sdakeJeffrey4l see bjolo's paste06:58
Jeffrey4l1. more task is running.   2. we run task in serial, which will increase the running time.06:58
sdakeexpnd on 106:58
Jeffrey4l1. more tasks are ran in reconfigure06:58
sdakeall tasks are run in serial?06:58
Jeffrey4lyep.06:58
sdakewhy the performanee regresoin from 2.0.2 to master?06:59
Jeffrey4lissue 2 is more serious.06:59
sdakebjolo Jeffrey4l is the real expert on reconfigure06:59
Jeffrey4lre from 2.0.2 to master, is it? any test result for this?06:59
sdakethe rest of us ust shoot in the dark06:59
sdakeJeffrey4l - manjeeets ran deploy then reconfigure backt o back07:00
sdakeand reconfigure was about 5% slower07:00
sdakethen 200% slower07:00
sdakehe had a 64 ndoe cluster07:00
Jeffrey4ldo u mean:  5% slower on 2.0.2 and 200 slower on master?07:00
sdakevs deploy07:00
sdakeyes07:00
Jeffrey4lsdake, serial do not work on 2.0.2 .07:01
sdake200%07:01
Jeffrey4lwe use serial in wrong.07:01
sdakeserial broken on ansible 1.9.4?07:01
Jeffrey4lon master, we move ther serial key word from tasks to playbooks.07:01
Jeffrey4lwe use serial in wrong. do not mater 1.9 or 2007:02
Jeffrey4l2.007:02
sdakeso this change makes serial work07:02
Jeffrey4lyes.07:02
Jeffrey4lbut it become slower.07:02
sdakeand serial results in dramatic performance impactin a negative way07:02
*** duonghq has quit IRC07:02
sdakebjolo does that answer your quetion07:03
*** bjolo_ has joined #openstack-kolla07:03
Jeffrey4lcould u paste the /tmp/reconfigure and /tmp/deploy file out?07:03
sdakebjolo _ does that answer your question07:03
Jeffrey4lbjolo, ^^07:03
sdakeJeffrey4l bjolo is the one running the tests07:03
Jeffrey4lyep.07:03
sdakeJeffrey4l he seemed  to notice that nova took 5 minutes per task to run07:03
sdakewith 48 compute nodes07:04
sdakethatsort of make sense to me07:04
sdakebut not entirely07:04
Jeffrey4lsdake, i am thinking do we really need serial when reconfiguration?07:04
sdakeJeffrey4l i am not sure07:04
sdakeyour the rocket scientist behind reconfigure - you tell me07:04
Jeffrey4lhmm. this is related to the reconfiguration impact in openstack.07:05
sdakelets reframe the questoin this way - what does serial get us with reconfigure07:05
Jeffrey4lif you accept nova-api service is down in few seconds, so you may not need serial at all.07:05
Jeffrey4lthe same with upgrade.07:05
sdakeso serial buys us full uptime during reconfigure and upgrades07:06
sdakemaximum uptime ;)07:06
sdakeI have a pair of boxers with that printed on it ;)07:06
Jeffrey4lit is.07:07
sdakesome swag from some conference07:07
sdakecan serial be conditional07:07
Jeffrey4lbut in some case, we may not need that. and should run the reconfigure/upgrade as fast as possible.07:07
Jeffrey4lyep.07:07
sdakei.e. run-with-serial=true or run-with-serial=flase07:08
sdakeand let the operators decide on the tradeoff07:08
Jeffrey4lsdake, check this implementation https://review.openstack.org/37186607:08
Jeffrey4lit is merged recently.07:08
Jeffrey4lwe can export the serial parameter to a shell script.07:09
Jeffrey4l(check the kolla-ansible script changes )07:09
*** neilus has joined #openstack-kolla07:09
Jeffrey4lbjolo, could u try reconfigure with the latest code and remove the serial=30% in kolla-ansible?07:10
sdakeJeffrey4l where is the serial % overeride in your patch?07:12
Jeffrey4lsdake, we need change the script07:12
Jeffrey4lhttps://review.openstack.org/#/c/371866/2/tools/kolla-ansible07:12
Jeffrey4lexport the -e serial=30% to be the script options.07:12
sdakei see for upgrade and reconfgiure its set to 30%07:12
sdakeso i think the short answer is it isnt configurable07:13
*** msimonin has joined #openstack-kolla07:13
Jeffrey4lso if we want support reconfigure/upgrade without serial, we need change the kolla-ansible script.07:13
*** neilus has quit IRC07:14
openstackgerritzhubingbing proposed openstack/kolla: add etcd reconfigure file  https://review.openstack.org/37296807:14
*** matrohon has joined #openstack-kolla07:15
sdakeJeffrey4l i think we want to give opertors a choice07:15
Jeffrey4lcool i think so :)07:15
Jeffrey4li will push a PS to implement this.07:15
sdakewfm07:15
sdakeget into bjolo 's hans if he is willing to apply to his tree and test it out07:16
sdakeand see if it satisfies him07:16
sdakebjolo what we are talking about here is a tradeoff07:16
sdakeperformance vs maximum availability07:16
sdakecan't have both07:16
sdakehave to pick which one you prefer07:17
sdakeJeffrey4l push some docs with teh change07:17
sdakei'll clean em up if needed07:17
Jeffrey4lok.07:17
sdake(the docs part)07:17
Jeffrey4lnp. thanks.07:18
*** shardy has quit IRC07:19
*** jtriley has joined #openstack-kolla07:19
sdaketwo victories in one day07:19
sdakei'd call that earning some leep07:20
sdakenight all :)07:20
Jeffrey4lgood night :)07:20
bjolo_gnight sdake07:20
bdacagood night sdake :)07:21
Jeffrey4lbjolo_, did u see my talk with sdake ?07:21
bjolo_reading right now07:22
Jeffrey4lbjolo_, 1. could u paster you /tmp/deploy and /tmp/reconfiguration file out?   2. could u try re-run reconfiguration without serial ( need change the one script )07:22
Jeffrey4lthanks.07:22
*** senk has joined #openstack-kolla07:23
*** jtriley has quit IRC07:24
*** msimonin has quit IRC07:25
*** msimonin has joined #openstack-kolla07:27
*** mickt has quit IRC07:30
bjolo_in a meeting07:30
bjolo_give me a few07:30
bjolo_http://paste.openstack.org/show/581715/07:31
bjolo_http://paste.openstack.org/show/581716/07:31
bjolo_i had two nodes that failed on the deploy, but should not make any difference07:32
Jeffrey4lgot.07:32
bjolo_one thing that gets me with reconfigure is that it does not seem to "fail fast" i.e. skip TASK for services that are not running/deployed07:32
bjolo_i.e. reconfigure spend several minutes on vpnaas07:33
bjolo_i dont run vpnaas07:33
bjolo_not enabled07:33
Jeffrey4lok.07:33
Jeffrey4lyou paste is not complemented.07:33
bjolo_?07:33
Jeffrey4lit is only 1300 lines.07:33
bjolo_ok could be too long07:33
Jeffrey4lI think there will be more.07:34
Jeffrey4lcould u sent it to me?07:34
bjolo_i used lodgeit.py07:34
bjolo_sure07:34
Jeffrey4lok.07:34
bjolo_whats your email07:34
Jeffrey4lzhang.lei.fly@gmail.com bjolo_07:34
Jeffrey4l bjolo_ there is another tool which can anlysis the playbooks running time. https://ara.readthedocs.io/en/latest/07:37
Jeffrey4lthe usage is easy.07:37
bjolo_cool tnx, you read my mind :)07:38
Jeffrey4lit will be helpful to generate a ara report for deploy and reconfiguration if u can.07:38
bjolo_was just about to ask if there was a way to get ansible to print timestamps etc07:38
Jeffrey4lbjolo_, ara is more powerful07:39
Jeffrey4lhere is a example http://logs.openstack.org/01/372901/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/ccb924c/logs/playbook_reports/07:39
bjolo_cool07:40
*** salv-orlando has joined #openstack-kolla07:42
*** salv-orl_ has quit IRC07:44
egonzalez90Jeffrey4l, thanks for the resource :)07:45
*** zhurong has quit IRC07:55
bjoloJeffrey4l, ara installed07:55
bjolorunning a reconfigure now07:55
openstackgerritzhubingbing proposed openstack/kolla: add etcd reconfigure content  https://review.openstack.org/37296807:55
bjolobut now on to my real problem. Enable TLS does not work for me. On horizon login page i get "Unable to establish connection to keystone endpoint."07:56
bjoloTLS worked in 2.0.2. same certificate, inventory and globals file07:56
*** athomas has joined #openstack-kolla08:00
*** zhurong has joined #openstack-kolla08:13
*** jtriley has joined #openstack-kolla08:13
*** Serlex has joined #openstack-kolla08:13
*** berendt has joined #openstack-kolla08:17
*** jtriley has quit IRC08:19
zhubingbingping berendt08:21
berendthello zhubingbing08:21
zhubingbinghave you free time?08:21
zhubingbingwe talk about barbican /?08:21
berendtyes of course08:22
*** gfidente has joined #openstack-kolla08:24
*** bradjones has quit IRC08:33
*** bradjones has joined #openstack-kolla08:36
*** bradjones has quit IRC08:36
*** bradjones has joined #openstack-kolla08:36
*** v1k0d3n has joined #openstack-kolla08:37
*** v1k0d3n has quit IRC08:42
*** rstarmer has quit IRC08:47
dupengfei_Hello, english speakers, who can help me to translate this message:" OpenFlow Agent (ofagent) Mechanism driver is deprecated in favor of OpenvSwitch mechanism driver with ā€œnativeā€ of_interface in the Mitaka release and will be removed in the next release. "08:57
dupengfei_thanks08:57
*** dupengfei_ has quit IRC08:57
*** dupengfei_ has joined #openstack-kolla08:57
dupengfei_Hello, english speakers, who can help me to translate this message:" OpenFlow Agent (ofagent) Mechanism driver is deprecated in favor of OpenvSwitch mechanism driver with ā€œnativeā€ of_interface in the Mitaka release and will be removed in the next release.08:57
*** neilus has joined #openstack-kolla08:58
dupengfei_Is native is deprecated or reserved?08:58
*** neilus has quit IRC09:02
*** ajpower has quit IRC09:02
*** ajpower has joined #openstack-kolla09:03
openstackgerritLi Yingjun proposed openstack/kolla: Fix murano auth issue  https://review.openstack.org/37227909:05
*** duonghq has joined #openstack-kolla09:05
*** dwalsh has joined #openstack-kolla09:06
*** jtriley has joined #openstack-kolla09:07
*** ajpower has quit IRC09:10
bdacadupengfei_: I understand this as: OpenFlow Agent (ofagent) Mechanism driver will be removed in the next release, so use OpenvSwitch mechanism driver with ļæ½nativeļæ½ of_interface09:10
dupengfei_bdaca: thanks09:12
*** jtriley has quit IRC09:12
*** jmccarthy has quit IRC09:15
*** jmccarthy has joined #openstack-kolla09:15
*** ajpower has joined #openstack-kolla09:29
*** prithiv has joined #openstack-kolla09:33
prithivhi. anyone facing issue with template-override option when building images09:36
*** dwalsh has quit IRC09:36
openstackgerritWaldemar Znoinski proposed openstack/kolla: map /dev from the host inside the ironic-conductor  https://review.openstack.org/37211909:37
openstackgerritWaldemar Znoinski proposed openstack/kolla: use ironic_conductor volume for conductor's /var/lib/ironic  https://review.openstack.org/37211809:37
*** daneyon has joined #openstack-kolla09:38
openstackgerritzhubingbing proposed openstack/kolla: add etcd reconfigure content  https://review.openstack.org/37296809:40
*** daneyon has quit IRC09:43
*** bdaca has quit IRC09:47
openstackgerritMerged openstack/kolla: Repair swift reconfiguration  https://review.openstack.org/37263109:47
openstackgerritMerged openstack/kolla: Set ownership of barbican configuration files to barbican  https://review.openstack.org/37270509:48
bjoloJeffrey4l, reconfigure completed. how do you want the ara log?09:48
*** prithiv has quit IRC09:50
*** bdaca has joined #openstack-kolla09:50
*** shardy has joined #openstack-kolla09:53
*** prithiv has joined #openstack-kolla09:58
*** prithiv has quit IRC09:58
*** jtriley has joined #openstack-kolla10:02
*** zhurong has quit IRC10:03
*** phuongnh has quit IRC10:05
*** jtriley has quit IRC10:07
bjololatest reconfigure took 106min. Nova part took about 70min of that10:08
*** williamcaban has joined #openstack-kolla10:16
pbourkebjolo: how many nodes is that?10:18
Jeffrey4lbjolo, wow. could u send me the result?10:18
bjolo54 hosts. 3 network, 3 controller, 48 compute10:19
bjoloall machines are highend10:19
bjolocompute BL460 G8, dual E5-2690v2, 192GB ram, 10Gb10:20
bjolosingle nic10:20
Jeffrey4lthere must be some bug in nova.10:20
*** williamcaban has quit IRC10:20
bjolonetwork, controllers: HP DL360 G7, dual xeon 5690, 92 GB memory, SSD, 2x10Gb lacp bond10:21
bjolokolla master is a virtual machine on vmware, but it has 8Gb memory, 8 cores (host cpu is xeon 5675), 1gb nic but host has 2x1010:22
*** tyrola has joined #openstack-kolla10:23
*** duonghq has left #openstack-kolla10:23
openstackgerritChristian Berendt proposed openstack/kolla: Improve index of docs  https://review.openstack.org/37313610:24
openstackgerritChristian Berendt proposed openstack/kolla: Improve index of docs  https://review.openstack.org/37313610:26
*** williamcaban has joined #openstack-kolla10:26
openstackgerritChristian Berendt proposed openstack/kolla: Improve index of docs  https://review.openstack.org/37313610:28
*** ntpttr has quit IRC10:31
bjoloJeffrey4l, whats your email again. i mail you the generated ara log10:34
*** williamcaban has quit IRC10:35
*** tyrola has quit IRC10:37
*** ntpttr has joined #openstack-kolla10:39
coolsvapbjolo: its zhang.lei.fly@gmail.com10:39
bjolotnx coolsvap10:39
pbourkeit should not take anywhere near that long10:40
*** neilus has joined #openstack-kolla10:46
*** tyrola has joined #openstack-kolla10:47
*** rhallisey has joined #openstack-kolla10:47
*** tonanhngo has joined #openstack-kolla10:47
*** eaguilar has joined #openstack-kolla10:49
*** neilus has quit IRC10:50
*** tonanhngo has quit IRC10:51
*** tyrola has quit IRC10:54
*** jtriley has joined #openstack-kolla10:56
pbourkebjolo: any idea which step is taking the majority of the time? e.g. docker restart, contacting the nodes, something else?10:59
Jeffrey4lsorry a little busy.11:00
Jeffrey4lya, that's my mail. bjolo11:00
*** jtriley has quit IRC11:01
Jeffrey4lGot it. thanks.11:01
*** zhubingbing has quit IRC11:04
bjolopbourke, no idea really. seem like it goes in circles (could be the serial approach)11:05
*** ccesario has joined #openstack-kolla11:06
openstackgerritMd Nadeem proposed openstack/kolla: Test: make enforce_type=True in CONF.set_override  https://review.openstack.org/36681811:07
*** schwicht has joined #openstack-kolla11:08
*** tyrola has joined #openstack-kolla11:20
openstackgerritJiri Stransky proposed openstack/kolla: Fix base CentOS repository keys  https://review.openstack.org/37319011:27
*** mliima has joined #openstack-kolla11:29
*** schwicht has quit IRC11:32
*** tyrola has quit IRC11:32
*** tyrola has joined #openstack-kolla11:33
*** tyrola has quit IRC11:33
*** huhaoran has quit IRC11:33
*** huhaoran has joined #openstack-kolla11:33
mliimamorning guys11:35
Jeffrey4lbjolo, do you tried disable the serial during the reconfiguration/11:35
bjolonot yet11:35
Jeffrey4li think it is the serial cause this issue.11:35
Jeffrey4lok.11:36
*** caowei has quit IRC11:36
bjolodid you have a patch for that?11:36
Jeffrey4llet me push a PS to disable the PS.11:36
Jeffrey4lno yet. wait 1 sec11:36
bjolocool11:36
bjoloim troubleshooting TLS right now11:36
bjolodoes not work for me11:36
Jeffrey4lok.11:37
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: disable serial in reconfiguration and ugprade  https://review.openstack.org/37319911:37
*** huhaoran has quit IRC11:37
Jeffrey4lbjolo, check above PS. I disable serial in it ^^11:37
*** huhaoran has joined #openstack-kolla11:37
bjolocool11:38
bjolowill run that later11:38
bjoloactually i can run it now11:39
bjoloneed to work on the ceph storage anyway11:39
bjolocontext switching11:39
Jeffrey4lOK. thanks.11:40
*** Menthos has joined #openstack-kolla11:40
*** neilus has joined #openstack-kolla11:41
MenthosHey everyone11:42
MenthosI'm struggling to deploy with kolla on machines that have a single NIC (with a veth + bridge)11:42
Jeffrey4li predict that the reconfigure will be finished in 25 minute.11:42
MenthosIs there some doc somewhere on how to do this?11:43
bjolook its away11:43
bjoloMenthos, i use vlan interfaces. Does your switch support that? think that would be easier to do11:43
Menthosbjolo: Probably not, I have very few control on network equipment11:44
Jeffrey4lMenthos, single node? or multi node?11:45
Menthosmulti node.11:45
*** eaguilar has quit IRC11:46
MenthosActually it might be yes to bjolo since I use a vlan (it is provided by a particular API of the platform, I have no direct access to the switch). I am not sure what you mean by "vlan interface"11:46
Jeffrey4lMenthos, how about vxlan?11:46
*** neilus has quit IRC11:46
Jeffrey4leth0 -> eth0.10   then eth0.10 used for api internal and eth0 use for neutron_external_network_interface11:47
MenthosJeffrey4l: that's not supported by the infrastructure I use11:47
Jeffrey4lMenthos, what' neutron typo will u use?11:47
Jeffrey4ltopological, i means.11:48
Jeffrey4lonly one flat network? or vlan? or vxlan?11:48
Menthosonly one flat network11:48
Jeffrey4lhmm. that's hard :(11:49
*** jtriley has joined #openstack-kolla11:50
MenthosTo be fair, this is not production, I'm just deploying a small OS with  compute to measure energy consumption.11:50
MenthosSo any network topology works for me.11:51
MenthosI'm just looking for the shortest path to deployment :-)11:51
Jeffrey4li think you can try vxlan first( at least you can test everything except ssh into the vm directly )11:51
Jeffrey4lif so, you can create a dummy interface and set the neutron_external_interface to that dummy interface( it is useless actually )11:52
*** v1k0d3n has joined #openstack-kolla11:52
*** dwalsh has joined #openstack-kolla11:52
MenthosAt first glance, it will be difficult because I have no control over the network. The way it works is I request a vlan from a API, and in return I get a range of IPs that I can use.11:53
MenthosBut what you're saying should work with any vlan, shouldn't it?11:53
*** zhurong has joined #openstack-kolla11:53
Jeffrey4li am saying use vxlan.11:54
Jeffrey4lif you can not touch the switcher or get vlan range by api. it is impossible to use vlan.11:54
*** coolsvap is now known as coolsvap_11:55
MenthosA dummy interface assigned to neutron_external_interface will not work with a regular vlan?11:55
*** coolsvap_ has quit IRC11:55
*** jtriley has quit IRC11:55
*** coolsvap_ has joined #openstack-kolla11:55
Jeffrey4lyes. vlan package can not be out from the phsically node.11:55
*** jtriley has joined #openstack-kolla11:55
Jeffrey4lvlan packets11:55
*** v1k0d3n has quit IRC11:57
mliimaJeffrey4l, which version you use to deploy kolla?11:58
Jeffrey4lmliima, master?11:58
mliima:/11:58
mliimaso the rabbitmq container is working fine?11:58
MenthosJeffrey4l: okay thanks, I'll look into it11:58
Jeffrey4lmliima, i am develop :)11:58
Jeffrey4lmliima, no.. i hit rabbitmq today.11:58
mliimaok Jeffrey4l11:59
Jeffrey4lchecking the root cause.11:59
Jeffrey4lmliima, what error message you got?11:59
mliimanp Jeffrey4l11:59
*** dave-mccowan has joined #openstack-kolla11:59
mliimai don't remember12:00
Jeffrey4lOK.12:00
mliimathe container wasn't uping12:00
*** jtriley has quit IRC12:00
Jeffrey4lmliima, i will appreciate if you can provide docker logs rabbitmq12:00
openstackgerritcaoyuan proposed openstack/kolla: Delete the unnecessary space  https://review.openstack.org/37321812:01
*** srwilkers has joined #openstack-kolla12:01
mliimawait12:01
*** bdaca has quit IRC12:02
*** dwalsh has quit IRC12:02
mliimaJeffrey4l, docker images -> http://paste.openstack.org/show/581145/12:03
mliimaJeffrey4l, docker logs rabbitmq -> http://paste.openstack.org/show/581150/12:03
Jeffrey4lGot. thanks12:04
*** rstarmer has joined #openstack-kolla12:04
*** srwilkers_ has joined #openstack-kolla12:04
mliimaJeffrey4l, http://paste.openstack.org/show/582227/12:05
mliimadocker run 10.102.20.225:4000/kolla/ubuntu-source-rabbitmq:3.0.0 dpkg -l | grep rabbitmq ^^12:05
Jeffrey4lgot. thanks a lot.12:05
Jeffrey4l:)12:05
openstackgerritcaoyuan proposed openstack/kolla: Add "---" into bootstrap_service.yml  https://review.openstack.org/37322212:07
*** rstarmer has quit IRC12:07
*** schwicht has joined #openstack-kolla12:14
*** williamcaban has joined #openstack-kolla12:15
openstackgerritMerged openstack/kolla: Change Mariadb default character set to utf8  https://review.openstack.org/37186912:15
openstackgerritChristian Berendt proposed openstack/kolla: Document that YAML data files should start with three dashes  https://review.openstack.org/37323212:17
openstackgerritMerged openstack/kolla: Allow genconfig to work with kolla-kubernetes and ceph  https://review.openstack.org/37281112:17
*** dupengfei_ has quit IRC12:19
openstackgerritMd Nadeem proposed openstack/kolla: Add support to use pdb with tox  https://review.openstack.org/37323312:19
*** dupengfei_ has joined #openstack-kolla12:19
*** williamcaban has quit IRC12:20
*** shardy is now known as shardy_lunch12:20
*** daneyon has joined #openstack-kolla12:20
bjolook Jeffrey4l looks like it will take more than 25min :(12:22
*** srwilkers has quit IRC12:22
bjoloJeffrey4l, hanging on this one12:22
bjoloTASK [nova : Remove the nova libvirt, ssh, conductor, api, consoleauth and scheduler containers action=remove_container, name={{ item[0]['name'] }}] ***12:22
openstackgerritMd Nadeem proposed openstack/kolla: Add support to use pdb with tox  https://review.openstack.org/37323312:22
bjolohave about 20 ansible threads consuming a lot of CPU, but the output is not moving12:23
*** matrohon has quit IRC12:23
*** schwicht has quit IRC12:23
bjolook now its moving again, but point is that 40 min intor the run and just started with nova tasks. Probably looking at a quite long runtime even w/o serial12:24
bjolobut lets see the numbers first :)12:24
*** daneyon has quit IRC12:25
bjoloso have anyone done a successful multinode multinetwork TLS deployment?12:25
openstackgerritMerged openstack/kolla: Fix Keystone CADF notifications  https://review.openstack.org/37273812:26
openstackgerritMerged openstack/kolla: fix horizon fernet container  https://review.openstack.org/37273012:26
openstackgerritMerged openstack/kolla: Deprecate old auth parameters of ironic in nova.conf  https://review.openstack.org/37230612:26
openstackgerritMerged openstack/kolla: run_once Checking mongodb backend for ceilometer  https://review.openstack.org/37270912:26
openstackgerritMerged openstack/kolla: Install cinder related package for glance  https://review.openstack.org/37256112:27
openstackgerritWaldemar Znoinski proposed openstack/kolla: use ironic_conductor volume for conductor's /var/lib/ironic  https://review.openstack.org/37211812:28
*** caowei has joined #openstack-kolla12:29
*** ayoung has quit IRC12:30
*** srwilkers has joined #openstack-kolla12:30
*** schwicht has joined #openstack-kolla12:32
openstackgerritWaldemar Znoinski proposed openstack/kolla: map /dev from the host inside the ironic-conductor  https://review.openstack.org/37211912:34
berendtbjolo TLS for external HAProxy?12:35
mliimaJeffrey4l, i'm using master branch with 3.0.0 tag for images12:36
mliimashould i use the latest tag?12:36
bjolono normal haproxy12:37
*** matrohon has joined #openstack-kolla12:38
bjoloonly thing i get in the log [Tue Sep 20 09:55:06.933287 2016] [:error] [pid 32] Unable to establish connection to https://foglight.mydoman.net:5000/v3/auth/tokens12:43
bjolohorizon.log12:43
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: basic ceph deployment support  https://review.openstack.org/37325612:44
*** shardy_lunch is now known as shardy12:50
*** huhaoran has quit IRC12:52
*** schwicht has quit IRC12:53
*** rstarmer has joined #openstack-kolla12:53
*** david-lyle has joined #openstack-kolla12:56
*** eaguilar has joined #openstack-kolla12:57
Jeffrey4lbjolo, OK.13:04
Jeffrey4lwhat's the total times it takes?13:04
bjolostill runing13:05
bjolostarted 1:25h ago13:05
Jeffrey4lhmm..13:05
*** mliima_ has joined #openstack-kolla13:09
*** mliima has quit IRC13:10
*** dwalsh has joined #openstack-kolla13:10
*** schwicht has joined #openstack-kolla13:12
*** eaguilar has quit IRC13:13
*** mliima__ has joined #openstack-kolla13:13
*** mgoddard__ has joined #openstack-kolla13:13
*** mliima_ has quit IRC13:16
*** mgoddard_ has quit IRC13:17
*** sdake has quit IRC13:17
bjoloreal    97m29.464s13:20
bjolouser    533m41.462s13:20
bjolosys     29m9.598s13:20
bjoloJeffrey4l, want me to generate a new ara log for you?13:20
Jeffrey4lbjolo, ya. it seems the result is the same.13:21
Jeffrey4lbjolo, are u sure u are using my PS?13:21
bjolo[root@eseldlx1042 tools]# cat kolla-ansible | grep -e reconfigure -e upgrade13:23
bjolo    reconfigure         Reconfigure OpenStack service13:23
bjolo    upgrade             Upgrades existing OpenStack Environment13:23
bjolo(upgrade)13:23
bjolo        EXTRA_OPTS="$EXTRA_OPTS -e action=upgrade"13:23
bjolo(reconfigure)13:23
bjolo        EXTRA_OPTS="$EXTRA_OPTS -e action=reconfigure"13:23
bjolono serial13:23
bjolo[root@eseldlx1042 tools]# time ./kolla-ansible -i /etc/kolla/foglight reconfigure13:24
Jeffrey4lbjolo, could u show me the site.yml file? it is located in ansible/site.yml13:24
*** dwalsh has quit IRC13:24
bjolohttp://paste.openstack.org/show/58224413:24
Jeffrey4lok. seems it is correct.13:25
Jeffrey4lbjolo, please send me the ara result. thanks. :)_13:26
bjoloreport running, will take a while13:26
Jeffrey4lOK>13:26
bjolobe advised, reconfigure had some fails in the end due to me shutting down horizon and keystone on 2 nodes. im troubleshooting tls issue13:27
Jeffrey4lbjolo, it expect to failed. when the container is down, we can not check whether the configuration is the latest.13:29
bjoloJeffrey4l, is there a way i can add debug flag to a container? i.e. i want to get more output in the horizon logs13:29
bjolotls works fine on command line, but not in horizon13:29
Jeffrey4lbjolo, what kind of debug log?13:29
*** neilus has joined #openstack-kolla13:30
*** zhubingbing has joined #openstack-kolla13:30
berendtis there a way to modify the delivered paste files without providing paste templates?13:30
berendtI would like to fix https://bugs.launchpad.net/kolla/+bug/158774713:31
openstackLaunchpad bug 1587747 in kolla "Keystone: admin_token_auth middleware should be removed from paste ini file" [Low,Confirmed]13:31
bjoloJeffrey4l, any type of debug from horizon13:31
Jeffrey4lyou can get the horizon log in /var/lib/docker/volumes/kolla_log13:31
Jeffrey4lbjolo, ^13:31
bjoloim looking there, but i dont get much helpful13:32
bjolo [Tue Sep 20 09:55:06.933287 2016] [:error] [pid 32] Unable to establish connection to https://foglight.mydoman.net:5000/v3/auth/tokens13:32
bjolothats it13:32
*** neilus has quit IRC13:34
bjoloin the horizon container, i can ping and curl it. of course auth denied but13:34
*** openstackstatus has joined #openstack-kolla13:36
*** ChanServ sets mode: +v openstackstatus13:36
Jeffrey4lUnable to establish connection means can not reach. how can not curl it?13:37
bjoloproper curl -i -H.... authenticates fine when run inside the horizon container13:37
bjoloso why the heck isnt horizon finding it!?13:38
Jeffrey4lbjolo, i think you can run manage.py runserver in horizon container, and start the horizon in another port. the you can got the detailed logs.13:39
bjolook13:40
bjolowhats the whole string?13:40
Jeffrey4lrunserver?13:41
Jeffrey4lhmm. it won't work. the https is forward by haproxy.13:41
Jeffrey4lbjolo, or try change this loglevel to info/debug here https://github.com/openstack/kolla/blob/master/ansible/roles/horizon/templates/horizon.conf.j2#L513:42
*** salv-orl_ has joined #openstack-kolla13:42
*** gfidente has quit IRC13:42
-openstackstatus- NOTICE: OpenStack Infra now has a Twitter bot, follow it at https://twitter.com/openstackinfra13:43
*** salv-orlando has quit IRC13:45
*** jtriley has joined #openstack-kolla13:45
*** tonanhngo has joined #openstack-kolla13:48
*** sdake has joined #openstack-kolla13:49
*** dwalsh has joined #openstack-kolla13:51
*** tonanhngo has quit IRC13:53
*** mgoddard__ has quit IRC13:56
*** mgoddard has joined #openstack-kolla13:57
*** tonanhngo has joined #openstack-kolla14:01
*** huikang has joined #openstack-kolla14:01
bjolook opened a bug on this14:01
bjolohttps://bugs.launchpad.net/kolla/+bug/162564814:01
openstackLaunchpad bug 1625648 in kolla "horizon login fails with TLS enabled" [Undecided,New]14:01
*** bjolo is now known as bjolo_afk14:02
openstackgerritMd Nadeem proposed openstack/kolla: Add support to use pdb with tox  https://review.openstack.org/37323314:04
openstackgerritMd Nadeem proposed openstack/kolla: Add support to use pdb with tox  https://review.openstack.org/37323314:05
sdakecoolsvap_ thanks for bringing up benedikt's contributions14:06
sdakeme was asleep at the wheel on that one14:06
* sdake was..14:06
*** tonanhngo has quit IRC14:06
*** bjolo_ has quit IRC14:07
*** lamt has joined #openstack-kolla14:07
*** daneyon has joined #openstack-kolla14:08
*** sdake_ has joined #openstack-kolla14:09
*** sdake has quit IRC14:11
*** inc0 has joined #openstack-kolla14:12
*** daneyon has quit IRC14:13
*** ayoung has joined #openstack-kolla14:15
*** tonanhngo has joined #openstack-kolla14:20
*** bdaca has joined #openstack-kolla14:24
*** fguillot has joined #openstack-kolla14:24
inc0good morning14:24
*** gfidente has joined #openstack-kolla14:25
*** gfidente has joined #openstack-kolla14:25
berendthave we already implemented credential encryption for keystone?14:31
bdacainc0: do you have something against backporting https://bugs.launchpad.net/kolla/+bug/1623463 to mitaka?14:35
openstackLaunchpad bug 1623463 in kolla "Kolla should support deploying Neutron in DVR mode" [Undecided,Fix released] - Assigned to Paul Bourke (pauldbourke)14:35
inc0bdaca, well, I don't think it's bug for one thing14:36
inc0also I'm not quite sure anyone with right mind would use DVR in Mitaka14:36
bdaca:D my boss asked me to try this on mitaka :D14:38
openstackgerritChristian Berendt proposed openstack/kolla: Use keystone-paste.ini template for keystone  https://review.openstack.org/37337914:39
bdacaI will probably give it a try on my dev env, just wondered if any1 will have any use of it if I do it14:41
openstackgerritChristian Berendt proposed openstack/kolla: Allow a custom haproxy configuration file  https://review.openstack.org/36895914:42
berendtbdaca if you tried DVR please write a report :)14:43
openstackgerritChristian Berendt proposed openstack/kolla: Allow a custom keepalived configuration file  https://review.openstack.org/36895614:43
bdacaI am planning this at the begining of october, I will inform you about the results :)14:44
*** senk has quit IRC14:47
*** kong has quit IRC14:51
inc0bdaca, what you can do is to try to install mitaka with kolla-newton14:53
inc0I think I'm going to write some blogpost about it, we get lots of questions like that14:54
inc0but I wouldn't bet my money of it working really well14:54
bdacayeah, I have thought about this, in kolla-newton there are some features I'd like to test and use...14:56
mliima__guys, running kolla-ansible deploy14:56
mliima__i'm freezed here TASK [keystone : Creating admin project, user, role, service, and endpoint] ****14:57
mliima__master branch14:57
openstackgerritChristian Berendt proposed openstack/kolla: Add fwaas_driver.ini file to neutron-vpnaas-agent container  https://review.openstack.org/37339615:00
*** eaguilar has joined #openstack-kolla15:01
*** mgoddard has quit IRC15:01
*** mgoddard has joined #openstack-kolla15:02
berendtinc0 works well, i am doing this15:04
*** lrensing has joined #openstack-kolla15:05
openstackgerritMerged openstack/kolla-kubernetes: Document more stuff  https://review.openstack.org/37114815:06
*** egonzalez90 has quit IRC15:08
inc0berendt, building source containers with mitaka code?15:09
berendtinc0 yes15:09
*** caowei has quit IRC15:10
inc0we keep getting this question, maybe do a little writeup how to do it with big red "not supported, you're on your own"15:10
berendtit is pretty easy, you only have to use a kolla-build.conf using mitaka sources...15:11
berendtthe most important part is to set openstack-base to https://github.com/openstack/requirements/tarball/stable/mitaka15:11
inc0yeah, it's the working part that I'm concerned about;)15:11
*** zhurong has quit IRC15:11
berendtbut it is working pretty good15:11
berendtbut i should mention that i only work with mature services, i think it is not a good idea to use e.g. stable/mitaka barbican or cloudkitty15:12
*** Menthos has quit IRC15:13
inc0yeah, I don't have any idea what won't work, but it's not super tested, that's my point15:13
inc0and if something breaks, we may not fix it15:14
berendtconfirmed, we should not support it15:14
inc0but it's a use-case people want, so I guess we should help15:14
berendtit is enough to support the stable branch with stable release15:14
inc0berendt, might writing some doc part?15:14
berendtyes i can do this but no in this week15:15
inc0with big red, "only for brave souls"15:15
berendtinc0 please open a bug report and assign it to me15:15
inc0will do15:15
inc0thanks15:15
inc0berendt, https://bugs.launchpad.net/kolla/+bug/162568215:18
openstackLaunchpad bug 1625682 in kolla "doc for deploying mitaka with newton kolla" [Wishlist,Confirmed] - Assigned to Christian Berendt (berendt)15:18
*** neilus has joined #openstack-kolla15:18
*** pbourke has quit IRC15:18
*** pbourke has joined #openstack-kolla15:18
*** vhosakot has joined #openstack-kolla15:19
jmccarthyHi folks !15:20
jmccarthyOk got an ansible question relating to commit 423e3f3fdf07f40b46fed1125076880660d14c53 in master15:20
jmccarthyMy question is how can the haproxy task that deals with it's template/configuration run correctly, when some of the facts it needs to populate ips for services may not be known ?15:21
*** egonzalez90 has joined #openstack-kolla15:22
pbourkeJeffrey4l: ^15:22
*** neilus has quit IRC15:22
pbourkeI think it was your commit :)15:22
inc0jmccarthy, so I'm not 100% sure about this, but I think this doesn't affect facts15:22
inc0just which nodes will be evaluated for task run15:22
pbourkehaproxy.cfg needs the ips from all nodes15:22
inc0yeah, but they already exists in tasks15:23
*** tonanhngo has quit IRC15:23
inc0facts*15:23
pbourkefacts are only discovered for hosts in that play15:23
jmccarthyinc0: Hmm ok I'm getting ansible throwing a wobbler when it tries to copy template over tho it seems15:23
inc0yes, but there are tasks in common role that runs before15:23
jmccarthyFor upgrade too ?15:23
inc0so facts are getting populated15:23
Jeffrey4lpbourke, ok. checking15:24
*** williamcaban has joined #openstack-kolla15:24
Jeffrey4ljmccarthy, you need run haproxy role.15:24
pbourkeJeffrey4l: Im thinking without this entry https://github.com/openstack/kolla/blob/master/ansible/site.yml#L2-L715:25
jmccarthyJeffrey41: Run it how ? It is being attempted when I do upgrade ?15:26
pbourkeJeffrey4l: we would need all hosts in the haproxy role, right?15:26
Jeffrey4lpbourke, no.15:26
Jeffrey4lwhen we want add ceilometer-api to haproxy, just `enable_ceilomter: yes` and run haproxy again,15:27
*** msimonin has quit IRC15:27
Jeffrey4lit will re-generate haproxy.cfg file with ceilometer-api related setting.15:27
pbourkeJeffrey4l: the question is more how does for example, does it know this fact https://github.com/openstack/kolla/blob/master/ansible/roles/haproxy/templates/haproxy.cfg.j2#L42-L4415:28
jmccarthyJeffrey41: Hmm ok yea I have enable_haproxy and some others set to yes, but that doesn't seem to be enuf ?15:28
pbourkeJeffrey4l: when the haproxy role is set to only run on the haproxy node15:28
Jeffrey4lpbourke, the groups is a magic group  in ansible. it will all groups from inventory file.15:28
openstackgerritEduardo Gonzalez proposed openstack/kolla: Fix senlin api bind host  https://review.openstack.org/37342415:28
Jeffrey4lno matter what the - hosts is in site.yml file15:28
pbourkeso its fetched facts from all nodes in the inventory regardless?15:28
*** williamcaban has quit IRC15:29
Jeffrey4lpbourke, yep.15:29
Jeffrey4ljmccarthy, what issue did you hit?15:29
Jeffrey4lpbourke, http://docs.ansible.com/ansible/playbooks_variables.html#magic-variables-and-how-to-access-information-about-other-hosts15:30
Jeffrey4lcheck this15:30
*** kangh_ has joined #openstack-kolla15:35
openstackgerritEduardo Gonzalez proposed openstack/kolla: Fix temtest missing spaces  https://review.openstack.org/37343115:36
*** vhosakot has quit IRC15:36
*** berendt has quit IRC15:37
openstackgerritEduardo Gonzalez proposed openstack/kolla: Fix tempest missing spaces  https://review.openstack.org/37343115:37
*** huikang has quit IRC15:38
jmccarthyI was getting error during config at 'Copying over haproxy.cfg' about cryptic "AnsibleUndefinedVariable: 'dict object' has no attribute u'ansible_bond0'"15:39
inc0ahh this issue, hmm15:39
Jeffrey4ljmccarthy, are u sure you have bond0 interface in the nodes?15:40
inc0ok, that makes sense, maybe it didnt propagate facts15:40
jmccarthyinc0: :) ! Yup15:40
inc0jmccarthy, try to revert this commit and rerun15:40
jmccarthyJeffrey41: 100% positive, the ip each node is ssh'd to is on a bond0 100%15:40
inc0if it helps, we need to do this upstream15:40
Jeffrey4ljmccarthy, how about try ansible -m setup for that node. did u get the ansible_bond0?15:41
inc0alternatively we can run this task on all nodes before we do anything http://docs.ansible.com/ansible/setup_module.html15:41
jmccarthyJeffrey41: Yep, it's there alrighty15:41
Jeffrey4lhmm.15:42
jmccarthyinc0: Had heard me going on about this one before :P15:42
jmccarthyinc0: If I make sure all the hosts are back in to haproxy (like prior version) then it works altho pbourke may have hit it with does it know this fact https://github.com/openstack/kolla/blob/master/ansible/roles/haproxy/templates/haproxy.cfg.j2#L42-L4415:44
*** tonanhngo has joined #openstack-kolla15:44
inc0well, yeah15:45
inc0I'd say better solution would be this:15:45
jmccarthyI'd not revert just yet :) I need to be a bit clearer on this15:45
inc0https://github.com/openstack/kolla/blob/master/ansible/roles/baremetal/tasks/pre-install.yml#L715:45
inc0on all nodes15:45
*** matrohon has quit IRC15:46
inc0jmccarthy, so reason it might have passed testing is that most of us (devs) are running haproxy on same node as apis15:47
*** eaguilar_ has joined #openstack-kolla15:52
*** eaguilar has quit IRC15:54
*** vhosakot has joined #openstack-kolla15:54
*** ntpttr_ has joined #openstack-kolla15:56
*** Marcellin__ has joined #openstack-kolla15:58
*** Serlex has quit IRC15:59
*** jheroux has joined #openstack-kolla16:02
bdacaHas anyone any experience in using glusterFS as cinder backend in kolla?16:09
*** senk has joined #openstack-kolla16:12
*** vhosakot has quit IRC16:13
*** dwalsh has quit IRC16:15
*** eaguilar_ has quit IRC16:19
*** Menthos has joined #openstack-kolla16:24
*** Menthos has quit IRC16:24
*** eaguilar has joined #openstack-kolla16:24
*** vhosakot has joined #openstack-kolla16:27
*** eaguilar has quit IRC16:29
*** eaguilar has joined #openstack-kolla16:29
openstackgerritPaul Bourke proposed openstack/kolla: Allow operators to provision multiple physical networks  https://review.openstack.org/37345516:35
*** dwalsh has joined #openstack-kolla16:37
*** eaguilar has quit IRC16:40
*** unicell1 has quit IRC16:42
*** bjolo_ has joined #openstack-kolla16:43
*** vhosakot has quit IRC16:43
inc0pbourke, technically we should -2 this16:44
*** vhosakot has joined #openstack-kolla16:44
inc0before we branch newton16:44
inc0because it is kinda feature16:44
inc0but you could publish a bug for it...16:44
*** gfhellma has joined #openstack-kolla16:45
*** senk__ has joined #openstack-kolla16:45
*** senk has quit IRC16:45
*** unicell has joined #openstack-kolla16:50
bjolo_good evening16:51
*** vhosakot has quit IRC16:51
jmccarthyJeffrey41: Ok just wondering, what is this do not merge ? https://review.openstack.org/#/c/373199/1/tools/kolla-ansible16:52
jmccarthyI see merged changes where serial is in site.yml, so then would that be global or per service ?16:53
*** vhosakot has joined #openstack-kolla16:54
*** jtriley has quit IRC16:55
bdacagood evening bjolo_16:56
*** mgoddard has quit IRC16:56
*** mgoddard_ has joined #openstack-kolla16:56
*** strigazi is now known as strigazi_AFK16:59
*** strigazi_AFK is now known as strigazi16:59
*** strigazi is now known as strigazi_AFK16:59
*** tonanhngo has quit IRC17:01
*** bjolof__ has joined #openstack-kolla17:01
*** bjolo_ has quit IRC17:01
*** inc0 has quit IRC17:02
*** inc0 has joined #openstack-kolla17:03
inc0sdake_, https://review.openstack.org/#/c/373455/117:05
sdake_inc0 what would ou like me to do with that review17:06
sdake_a link with no context is not helpful ;)17:06
sdake_nm i got context17:07
sdake_moment17:07
*** jtriley has joined #openstack-kolla17:07
sdake_inc0 enjoy17:11
*** unicell has quit IRC17:11
inc0yeah, tha'ts my thought too17:12
inc0pbourke, ^17:12
inc0brb17:12
*** eaguilar has joined #openstack-kolla17:13
*** inc0 has quit IRC17:15
*** Satya_ has joined #openstack-kolla17:17
Satya_Hi everyone17:17
Satya_did anyone checked "https://bugs.launchpad.net/kolla/+bug/1625622"17:17
openstackLaunchpad bug 1625622 in kolla "external ceph integration fails" [Undecided,Confirmed] - Assigned to Satya Sanjibani Routray (satroutr)17:17
Satya_if we can decide the priority i will push the fix of it17:18
*** williamcaban has joined #openstack-kolla17:22
sbezverkakwasnie: ping17:26
*** tonanhngo has joined #openstack-kolla17:28
*** dwalsh has quit IRC17:32
*** unicell has joined #openstack-kolla17:44
*** daneyon has joined #openstack-kolla17:45
sdake_Satya_ triaging now moment17:46
Satya_sure17:46
Satya_please let me know once triage is done17:46
Satya_i will push the fix17:46
sdake_Satya_ triage completed17:46
*** tonanhngo has quit IRC17:47
Satya_Thanks pushing the fix for review in a moment17:47
bjolof__pbourke, i really like the multiple external networks (change 373455) :)17:50
*** daneyon has quit IRC17:50
*** zhubingbing has quit IRC17:51
*** zhubingbing has joined #openstack-kolla17:55
*** tonanhngo has joined #openstack-kolla18:00
sdake_good news everyone - my expensive amp was protected by a 59 cent fuse18:00
sdake_thank god for fuses18:00
bjolof__Satya_, about the ceph bug, it is high priority for me if that makes any difference :)18:00
bjolof__sdake_, good :)18:00
sdake_bjolof__ its marked critical at present18:00
sdake_it affects the entire system18:00
Satya_yes i am pushing the fix in sometime...18:01
sdake_bjolof__ did you and Jeffrey4l come to a conclusion on the reconfigure problem?18:01
bjolof__sdake_, not yet18:01
bjolof__it is not serial18:01
sdake_so the serial theory is shot down?18:01
bjolof__i have done two reconfigures today, with and w/o serial. both took about the same time18:01
bjolof__96 and 102 min (or something like that)18:02
sdake_96 without serial?18:02
bjolof__yes18:02
sdake_i was really hopeful tht would fix theproblem18:02
*** eaguilar_ has joined #openstack-kolla18:02
*** eaguilar has quit IRC18:04
bjolof__anywhere i can paste a 21MB tar file?18:05
*** shardy has quit IRC18:05
*** williamcaban has quit IRC18:06
*** berendt has joined #openstack-kolla18:07
*** williamcaban has joined #openstack-kolla18:12
*** athomas has quit IRC18:14
*** senk__ has quit IRC18:14
*** Pavo has quit IRC18:16
*** vhosakot has quit IRC18:19
*** aswadr_ has quit IRC18:22
Satya_it will sdake :)18:24
*** zhubingbing has quit IRC18:25
sdake_bjolof__ google drive or box comes to mind18:30
*** srwilkers_ has quit IRC18:41
dave-mccowanrhallisey hi ryan18:44
rhalliseydave-mccowan, hey dave18:44
dave-mccowanhave you built kolla images with rhel lately?18:44
rhalliseynot lately no18:45
rhalliseyI saw there was a bug somewhere though18:45
dave-mccowani patched common/config.py to add 'rhel' as an option in rh_base.  not sure what tag to use.  should it work with the default config, or do i need to configure cutom repos to build with the rhel?18:46
*** williamcaban has quit IRC18:49
*** sdake_ is now known as sdake18:50
sdakedave-mccowan there are instructions in the documenation for buildingwith rhel18:50
sdakelast time I tested them they worked18:51
rhalliseydave-mccowan, I think it was rhos with base rhel18:51
rhalliseyI don't think there was anything special needed18:51
dave-mccowanthe instructions fail right away, 'rhel' is a valid choice for -b:  https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L2118:54
*** gfidente has quit IRC18:55
dave-mccowanah.. there was a commit yesterday.18:55
dave-mccowanbut, i still get this error:18:57
dave-mccowanERROR:kolla.image.build.base:Tag 7 not found in repository docker.io/library/rhel18:57
*** eaguilar_ has quit IRC18:58
*** gfidente has joined #openstack-kolla19:00
mliima__sdake, how do you build your containers (exact command typed)?19:00
mliima__i'm working on rc1 and the rabbitmq container still restarting19:01
*** eaguilar has joined #openstack-kolla19:01
*** vhosakot has joined #openstack-kolla19:02
*** jpeeler has quit IRC19:03
*** mewald has joined #openstack-kolla19:06
sdake./build.py --registry 192.168.1.103:4000 --type source --push19:06
sdakei also run19:06
sdake./build.py --registry 192.168.1.103:4000 --push (to run through centos binary)19:06
sdakemliima__ lets dig into your restarting problem more thouroughly - rather then guessing at the caue19:07
sdakebecause if its an actual bug its critical19:07
mliima__sdake, https://bugs.launchpad.net/kolla/+bug/162426319:07
openstackLaunchpad bug 1624263 in kolla "Adding a new RabbitMQ node to an existing cluster" [Medium,Confirmed]19:07
sdakear you adding a new node?19:08
sdakeI thought you started fresh19:08
mliima__no no19:08
mliima__sdake,are you  working on which version?19:10
sdakemliima__ can you be a king and try the suggested workaround19:10
sdakemasster latest19:10
mliima__oh god19:10
sdakemliima__ sup?19:10
mliima__master latest is working for you?19:11
sdakeit did yesterday and the day before19:12
sdakei haven't tried today19:12
sdakeno time yet19:12
*** huikang has joined #openstack-kolla19:12
sdakeand have hairs to cut at 3pm so may not get to it until later19:12
mliima__np sdake19:12
mliima__i think that the problem can be my environment19:12
mliima__:/19:12
mliima__i ran tools/diag19:13
mliima__http://paste.openstack.org/show/582309/19:13
*** vhosakot has quit IRC19:14
dave-mccowansdake rhallisey could you try to build one container? tools/build.py -b rhel -i ./rhel-include keystone   (if it works for you, then i know it's my environment, at least) :-)19:16
*** eaguilar has quit IRC19:17
*** gfhellma has quit IRC19:25
sdakemliima__ definatey environmental problem19:26
sdakekolla rc1 i an installed package19:26
sdakepip uninstalal kolla19:26
sdakei was pretty sure we have been through this ;)19:26
sdakedeeveloeprs work from master git, operators work from pypi packaging19:26
sdakeits all in th edocs19:26
bjolof__how much logging do you guys see in /var/lib/docker/volumes/kolla_logs/_data/haproxy/haproxy.log?19:28
*** eaguilar has joined #openstack-kolla19:29
bjolof__this is all i got in my haproxy log http://paste.openstack.org/show/582310/19:30
mliima__sdake,19:31
mliima__works19:31
mliima__haha19:31
mliima__enviroment problem19:31
sdakemliima__ ya - points at a larger problem19:31
sdakeand that is perhaps upgrades are broken19:31
sdakeor perhaps they are not19:31
mliima__well19:32
mliima__it works19:32
sdakethat theory needs to be validated19:32
mliima__i'm happy19:32
mliima__kolla is good19:32
mliima__i love kolla19:32
mliima__i love all19:32
sdakeupgrade from 2.0.2 to 3.0.0 is what I mean19:32
sdakewe like you too mliima__ :)19:32
mliima__:)19:32
*** tonanhngo has quit IRC19:42
*** salv-orlando has joined #openstack-kolla19:42
bjolof__anyone check their haproxy log if they actually see any traffic logging_19:44
bjolof__?19:44
*** salv-orl_ has quit IRC19:45
Satya_Hi sdake19:47
sdakeSatya_ sup19:47
sdakebjolof__ traffic logging?19:47
sdakeIdidn't know we had such a  feature ;)19:47
Satya_i getting a error while doing the git review19:47
sdakeSatya_ which error19:47
sdakeSatya_ i can help you through it19:48
sdakebrb ,checking battery19:48
*** tonanhngo has joined #openstack-kolla19:48
Satya_http://pastebin.com/dXTmDqFy19:48
bjolof__i dont know haproxy logging that well, its kinda advanced ... but looking at the haproxy config and the documentation we should see a lot more compared to what i have in my logs19:49
bjolof__im trying to troubleshoot why my horizon TLS logins just die silently. i.e. horizon logs that it can not connect to keystone.19:50
bjolof__keystone logs shows nothing, they are blank19:50
*** bdaca has quit IRC19:51
bjolof__and haproxy does not seem to log properly. i.e. from what i understand we should se more in the logfiles19:51
sdakebjolof__ - dave-mccowan expert on this stuff19:51
bjolof__https://bugs.launchpad.net/kolla/+bug/162564819:51
openstackLaunchpad bug 1625648 in kolla "horizon login fails with TLS enabled" [Undecided,New]19:51
*** gfhellma has joined #openstack-kolla19:51
sdakefwiw that worked for me last time i tried it19:52
bjolof__the culprit is haproxy afai can tell right now19:53
sdakeSatya_ your config is messed up19:53
sdakeSatya_ i can help you correct it around 5pm pst19:53
Satya_i guess without -s its going to work :P19:53
sdakeSatya_ i have things happening now - so can't hae a live webex debug sesssion of your setup19:53
Satya_NP19:53
sdakeits not goingto work ou mean?19:53
sdakeSatya_ is this your first commit to openstack19:54
Satya_nope19:54
Satya_usually i do commit to nova19:54
Satya_first time to kolla19:54
Satya_but its different VM which i am using now19:54
berendtis it not possible to use ADD/COPY when using the footer blocks with template override functionality?19:55
Satya_To ssh://satya@review.openstack.org:29418/openstack/kolla.git  ! [remote rejected] HEAD -> refs/publish/master (invalid committer)19:55
Satya_:(19:55
*** srwilkers has quit IRC19:59
*** huikang has quit IRC19:59
*** huikang has joined #openstack-kolla20:00
sdakeSatya_ does the different vm have your same ssh keys?20:00
sdakeand same login ids?20:00
sdakeand same git information?20:00
Satya_nope20:00
Satya_my previous VM gone corrupt20:00
sdakedid you register the different ssh key with gerrit?20:00
Satya_i added the sshkey tough20:01
Satya_yes20:01
sdakesam elogin id?20:01
Satya_yes20:01
sdakei'd recommend deleting your invalid key20:01
sdake(in gerrit)20:01
sdakewhat about permsissions on .ssh20:02
sdakethey should be 70020:02
sdakeand permissions on all files in .ssh should be 60020:02
*** huikang has quit IRC20:05
Satya_sdake git the problem20:06
Satya_[root@dhcp-blr-ptp-mercury-l4-10-177-161-116 kolla]# git config --global user.name "satya" [root@dhcp-blr-ptp-mercury-l4-10-177-161-116 kolla]# git config --global user.email "engg.sanj@gmail.com" [root@dhcp-blr-ptp-mercury-l4-10-177-161-116 kolla]# git review remote: Processing changes: refs: 1, done remote: remote: ERROR:  In commit ae3122faa75c24a37f6bf6177e46069a5933929b remote: ERROR:  committer email address root@dhcp-b20:07
Satya_http://paste.openstack.org/show/582311/20:07
*** huikang has joined #openstack-kolla20:07
sdakehuikang can you do me a solid20:07
sdakehuikang i have a bunch of personal errands to run today20:08
sdakehuikang and not sure i can get to this tomorrow20:08
sdakehttps://review.openstack.org/#/c/366948/120:08
*** eaguilar has quit IRC20:10
sdakeSatya_ don't run as user root20:10
sdakerun as your rela user20:10
sdakewhatever matches your gerrit id20:11
sdakeand learn to use sudo when appropriate would be my recommendation :)20:11
Satya_:)20:11
Satya_sure20:11
sdakei know its hard20:11
sdakei went through this transition i thinking about 6-7 yearsago20:11
sdakeand it was a real struggle or me20:11
sdakebut the benefits outweigh the costs20:11
sdakehuikang what i'd ask is if you could validate latest version of docker-py works with kolla20:14
sdakehuikang if you can't or dont want to do so, let me know20:14
*** huikang has quit IRC20:17
*** matrohon has joined #openstack-kolla20:17
*** huikang has joined #openstack-kolla20:17
*** eaguilar has joined #openstack-kolla20:18
*** lrensing has quit IRC20:21
*** huikang has quit IRC20:22
*** daneyon has joined #openstack-kolla20:28
*** mewald has quit IRC20:28
*** neilus has joined #openstack-kolla20:30
*** mewald has joined #openstack-kolla20:32
*** daneyon has quit IRC20:33
*** jtriley has quit IRC20:33
manjeetso/20:33
*** Jeffrey4l has quit IRC20:35
*** mewald1 has joined #openstack-kolla20:39
*** mewald has quit IRC20:39
*** kangh_ has quit IRC20:43
*** huikang has joined #openstack-kolla20:44
*** berendt has quit IRC20:48
*** huikang has quit IRC20:49
openstackgerritsatya proposed openstack/kolla: ceph-* the wild card is not work for json. added the support for the configurable keyring file in the all.yml, and called the variable under the json files.  https://review.openstack.org/37352520:50
sdakesup manjeets20:51
manjeetsoh sorry I accidently typed in that message to check my irc because i was unable to post on other20:51
Satya_https://review.openstack.org/37352520:51
manjeetssorry if it disturbed any one20:51
sdakeall good mn20:53
sdakemanjeets20:53
*** jamesdenton has quit IRC20:55
*** LamT_ has joined #openstack-kolla20:55
*** inc0 has joined #openstack-kolla20:55
*** ccesario has quit IRC20:57
*** mewald1 has quit IRC21:03
*** gfidente has quit IRC21:05
*** lamt has quit IRC21:05
*** inc0 has quit IRC21:08
*** matrohon has quit IRC21:15
Satya_hi21:19
*** jheroux has quit IRC21:20
*** schwicht has quit IRC21:25
*** salv-orlando has quit IRC21:26
*** salv-orlando has joined #openstack-kolla21:26
*** jamesdenton has joined #openstack-kolla21:26
*** eaguilar has quit IRC21:28
*** jtriley has joined #openstack-kolla21:28
sdakewirehead_ can I get an ack/nack if ou will be ready to go tomorrow with a dryrun21:29
sdakesbezverk has chimed in21:29
*** vhosakot has joined #openstack-kolla21:33
wirehead_I thought I did.21:36
wirehead_sdake:21:36
sdakewirehead_ oh there was an email thread perhaps i missed it21:36
sdake(it being your response)21:36
sdakeyour answer was21:36
sdake?21:36
wirehead_+1 slidedeck.21:37
sdakeroger sounds like a go for launch21:37
wirehead_I got cornered by a one-person angry OpenStack mob last Thursday in the SJ office.21:37
*** huikang has joined #openstack-kolla21:40
huikangping sdake21:40
*** gfhellma has quit IRC21:40
sdakehuikang - need to depart in t-2 minutes for haircut21:41
huikangI was away from my compute and missed all you meessage21:41
sdakehuikang what can I do for you fine sir21:41
huikangjust saw them right now21:41
sdakeroger21:41
*** kong has joined #openstack-kolla21:41
huikangdo you still want to do those?21:41
sdakethe tessting?   yes its required21:41
sdakeif youcan't do it i'll get to it when i can21:42
huikangOk, I will test later21:42
sdakedeploy/reconfigure/upgrade operations with latest docker-py21:42
sdakei gave em a 2 day timer21:42
huikangsure21:42
huikangno problem21:42
sdakecool thanks for the assistance21:42
huikangnp21:42
huikangenjoy your hair cut21:43
*** schwicht has joined #openstack-kolla21:43
*** schwicht has quit IRC21:46
*** schwicht has joined #openstack-kolla21:46
*** williamcaban has joined #openstack-kolla21:50
*** wznoinsk has quit IRC21:50
*** williamcaban has quit IRC21:54
*** lamt has joined #openstack-kolla21:56
*** schwicht has quit IRC21:59
*** schwicht has joined #openstack-kolla22:00
*** wznoinsk has joined #openstack-kolla22:02
*** huikang has quit IRC22:05
*** huikang has joined #openstack-kolla22:05
*** huikang has quit IRC22:10
*** vhosakot has quit IRC22:17
*** daneyon has joined #openstack-kolla22:21
*** rstarmer has quit IRC22:22
*** jtriley has quit IRC22:24
*** neilus has quit IRC22:25
*** daneyon has quit IRC22:26
*** Satya_ has quit IRC22:26
*** schwicht has quit IRC22:28
*** tonanhngo has quit IRC22:28
*** gfhellma has joined #openstack-kolla22:34
*** gfhellma has quit IRC22:48
*** schwicht has joined #openstack-kolla22:55
*** schwicht has quit IRC22:56
*** rstarmer has joined #openstack-kolla22:57
*** neilus has joined #openstack-kolla22:57
*** schwicht has joined #openstack-kolla22:58
kfox1111is the ceph guide still accurite?22:59
*** neilus has quit IRC23:01
*** rstarmer has quit IRC23:01
*** jtriley has joined #openstack-kolla23:05
kfox1111I'm trying to understand how kolla's ansible playbooks work.23:09
kfox1111it looks like it fires up 3 mon containers in parallel with a bootstrap, each overwrites the delegate_host to its own hostname?23:10
kfox1111then a subsequent task execs into that one host and pulls the keys and pushes them back to all the containers that need keys?23:10
*** awiddersheim has joined #openstack-kolla23:13
openstackgerritAndrew Widdersheim proposed openstack/kolla: Revert "Add common role to Ansible site file"  https://review.openstack.org/37355723:19
*** daneyon has joined #openstack-kolla23:22
*** huikang has joined #openstack-kolla23:23
*** daneyon has quit IRC23:27
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: basic ceph deployment support  https://review.openstack.org/37325623:29
*** schwicht has quit IRC23:31
*** eaguilar has joined #openstack-kolla23:32
*** jtriley has quit IRC23:36
*** schwicht has joined #openstack-kolla23:38
*** williamcaban has joined #openstack-kolla23:38
*** jtriley has joined #openstack-kolla23:43
*** williamcaban has quit IRC23:43
*** tonanhngo has joined #openstack-kolla23:52
*** neilus has joined #openstack-kolla23:54
*** tonanhngo has quit IRC23:56
*** schwicht_at_work has joined #openstack-kolla23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!