Sunday, 2017-08-06

*** thorst has joined #openstack-ansible00:25
*** thorst has quit IRC00:30
*** thorst has joined #openstack-ansible00:37
*** thorst has quit IRC00:48
*** thorst has joined #openstack-ansible00:49
*** thorst has quit IRC00:49
*** markvoelker has joined #openstack-ansible01:18
*** markvoelker has quit IRC01:53
*** schwicht has quit IRC02:25
*** thorst has joined #openstack-ansible02:25
*** thorst has quit IRC02:30
*** markvoelker has joined #openstack-ansible02:49
openstackgerritLogan V proposed openstack/openstack-ansible master: [WIP] Run munin on gate node  https://review.openstack.org/49100503:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097603:11
*** markvoelker has quit IRC03:11
*** goldenfri has quit IRC03:14
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097603:14
openstackgerritLogan V proposed openstack/openstack-ansible-galera_server master: [WIP] Allow external restart handler orchestration  https://review.openstack.org/49121103:27
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097603:28
openstackgerritLogan V proposed openstack/openstack-ansible master: [WIP] Implement galera restarts in playbook  https://review.openstack.org/49121203:30
logan-might be an interesting pattern if it works ^03:31
logan-quite a bit of task duplication though :/03:32
SamYaplelogan-: you can actually do quite a bit of galera restarts (including full cluster power outage recovery) *without* SST, just doing IST03:33
SamYapleits a bit tough to get right though03:33
logan-gotcha03:34
logan-maybe you could give the role some better restarting capabilities :)03:35
logan-its definitely one of them that needs some fixups currently03:36
openstackgerritLogan V proposed openstack/openstack-ansible master: Add the ansible-ceph-defaults role  https://review.openstack.org/49047603:43
SamYaplelogan-: im about to do all the galera cleverness for the new job in saltstack. might be able to help03:44
SamYaplei need to update kolla to do the same stuff too which should be very similiar to the needed OSA code03:44
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097603:45
cloudnulllogan-: cool!03:51
logan-ansible could really benefit from a pre_handlers/post_handlers playbook feature03:53
logan-to inject handlers before/after the role/tasks lists03:53
SamYaplethat would be cool03:54
logan-https://github.com/ansible/ansible/issues/2781304:03
dmsimardlogan-: the two OSA jobs in ARA are super unstable right now :(04:05
dmsimardconsidering making them non-voting for a while04:05
logan-hmm04:06
logan-what's up04:06
dmsimardeither it's the repository stuff mhayden added recently or it's because OSIC is out04:06
logan-i have seen an uptick in build timeouts since osic left04:06
dmsimardlogan-: just look at this review just for updating a git review.. https://review.openstack.org/#/c/491029/04:06
dmsimardlogan-: either one of the two OSA job timeouts, but I've also seen a pyopenssl issue with bindep on the centos one04:07
dmsimardit sucks because there's like 50% chance of failure, twice (when doing recheck is has 50% of failing in check, 50% of failing in gate..)04:07
dmsimardand I have this large tree of patches to land04:07
logan-yuck04:10
logan-lots of centos timeouts in there04:10
dmsimardI've seen Ubuntu time out as well04:10
dmsimardbut yeah it's mostly centos04:11
logan-http://logs.openstack.org/29/491029/1/check/gate-ara-integration-openstack-ansible-func-ubuntu-xenial/8d344bb/console.html#_2017-08-06_03_07_20_941422 ubuntu takes like 30 seconds to install pip packages here04:14
logan-http://logs.openstack.org/29/491029/1/gate/gate-ara-integration-openstack-ansible-func-centos-7/d302dba/console.html#_2017-08-06_01_36_37_204727 centos takes 3 minutes04:15
logan-:/04:15
dmsimardone is rax ord, other is rax dfw04:15
dmsimardnot sure if it makes a difference04:16
logan-right04:16
dmsimardgoing to bed for now, hopefully some -infra cores can make the jobs non-voting so I can start landing stuff while we figure out what is the actual issue04:16
logan-yeah04:16
dmsimardthese jobs used to finish in like under 20 minutes04:16
logan-wow04:17
logan-:(04:17
dmsimardok, maybe not, but not so much04:17
dmsimardexamples https://review.openstack.org/#/c/485862/ https://review.openstack.org/#/c/486361/04:18
logan-yeah looking thru ubuntu in that review it passes every time around 27-30 it looks like. i wouldnt doubt it used to push ~20 on osic04:18
dmsimardit looks like that centos job did get close to the ~1hr timeout04:18
dmsimardmaybe the timeout needs to be increased to 90 minutes04:18
logan-fwiw osa has been hitting more timeouts than i usually see today also. https://review.openstack.org/#/c/491195/  increasing your timeout is reasonably likely to get things moving id think.04:21
*** thorst has joined #openstack-ansible04:27
*** thorst has quit IRC04:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701704:32
cloudnullsads -- https://twitter.com/cloudnull/status/893569974844968964 --04:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097604:40
*** woodard has joined #openstack-ansible05:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701705:06
*** woodard has quit IRC05:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097605:12
*** tholiv has joined #openstack-ansible05:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701705:15
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver  https://review.openstack.org/47701705:22
*** tholiv has quit IRC05:24
*** tholiv has joined #openstack-ansible05:26
SamYaplecloudnull: https://review.openstack.org/#/c/491196/ :(05:41
*** woodard has joined #openstack-ansible06:04
openstackgerritLogan V proposed openstack/openstack-ansible master: Run ARA only if enabled  https://review.openstack.org/49122506:05
*** woodard has quit IRC06:08
*** thorst has joined #openstack-ansible06:28
*** thorst has quit IRC06:33
*** pcaruana has joined #openstack-ansible06:58
*** woodard has joined #openstack-ansible07:04
*** woodard has quit IRC07:09
*** tholiv has quit IRC07:16
*** tholiv has joined #openstack-ansible07:17
*** tholiv has quit IRC07:17
*** tholiv has joined #openstack-ansible07:18
*** tholiv has quit IRC07:19
*** tholiv has joined #openstack-ansible07:19
*** tholiv has quit IRC07:20
*** tholiv has joined #openstack-ansible07:21
*** sxc731 has joined #openstack-ansible07:25
*** tholiv has quit IRC07:26
*** arif-ali has quit IRC07:43
*** tholiv has joined #openstack-ansible07:58
*** perniciouscaffei has quit IRC08:02
*** woodard has joined #openstack-ansible08:05
*** woodard has quit IRC08:10
*** arif-ali has joined #openstack-ansible08:10
*** cshen has joined #openstack-ansible08:28
*** thorst has joined #openstack-ansible08:29
*** thorst has quit IRC08:34
*** tholiv has quit IRC08:38
*** tholiv has joined #openstack-ansible08:39
*** tholiv has quit IRC08:44
*** sxc731 has quit IRC08:59
*** woodard has joined #openstack-ansible09:06
*** woodard has quit IRC09:10
*** cshen has quit IRC09:43
*** cshen has joined #openstack-ansible09:44
*** cshen has quit IRC09:45
*** cshen has joined #openstack-ansible10:06
*** chhavi has joined #openstack-ansible10:09
*** cshen has quit IRC10:15
*** thorst has joined #openstack-ansible10:30
*** thorst has quit IRC10:34
*** chhavi has quit IRC10:56
*** woodard has joined #openstack-ansible11:07
*** woodard has quit IRC11:13
TahvokI'm inverstigating the reason of slow hoziron, and I've found this error on each login: Attempted scope to domain Default failed, will attemptto scope to another domain.11:15
TahvokThe domain name however is correct11:15
TahvokWhat could be the reason?11:16
*** drifterza has joined #openstack-ansible11:41
*** thorst has joined #openstack-ansible11:41
*** thorst has quit IRC11:42
*** yolanda has quit IRC11:42
*** schwicht has joined #openstack-ansible11:45
*** http_GK1wmSU has joined #openstack-ansible12:06
*** http_GK1wmSU has left #openstack-ansible12:07
*** chhavi has joined #openstack-ansible12:42
*** woodard has joined #openstack-ansible13:10
TahvokIs it possible to add ceph_client int openstack ceph client role? https://github.com/openstack/openstack-ansible-ceph_client/blob/master/tasks/main.yml13:11
TahvokThis is good in cases when ceph is already deployed, and we do not wish to install it with openstack ansible.13:12
TahvokWe only need the client on compute nodes13:12
*** woodard has quit IRC13:14
*** thorst has joined #openstack-ansible13:20
*** thorst has quit IRC13:21
*** schwicht has quit IRC13:45
*** schwicht has joined #openstack-ansible13:56
*** schwicht has quit IRC14:18
*** armaan has joined #openstack-ansible14:21
*** thorst has joined #openstack-ansible14:26
*** thorst has quit IRC14:31
openstackgerritLogan V proposed openstack/openstack-ansible master: Add the ansible-ceph-defaults role  https://review.openstack.org/49047614:42
logan-Tahvok: there are examples in https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml for configuring ceph_client14:56
logan-basically set your services up to use ceph, and then provide a ceph_mons list14:56
Tahvoklogan-: providing ceph_mons list will try to install ceph: https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/app-ceph.html#14:57
TahvokOr am I speaking of different variable here?14:57
logan-No adding ceph_mons to user variables will allow ceph_client to configure the services to use ceph. It won't actually install ceph on those mons, but it will connect to them over ssh to read/create cephx keychains and ceph.conf15:01
dmsimardlogan-: btw https://review.openstack.org/#/c/491247/15:07
*** woodard has joined #openstack-ansible15:11
logan-neat :)15:14
*** woodard has quit IRC15:16
*** lvdombrkr has quit IRC15:22
*** thorst has joined #openstack-ansible15:27
*** armaan has quit IRC15:29
*** armaan has joined #openstack-ansible15:30
*** thorst has quit IRC15:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097615:41
cloudnullSamYaple: yup. it was a sad day.15:41
cloudnullSamYaple: https://review.openstack.org/#/c/491031/15:42
*** chhavi has quit IRC15:46
*** mw_ has quit IRC15:48
*** schwicht has joined #openstack-ansible15:49
*** cshen has joined #openstack-ansible15:59
*** woodard has joined #openstack-ansible16:13
*** woodard has quit IRC16:17
*** cshen has quit IRC16:21
*** cshen has joined #openstack-ansible16:21
*** thorst has joined #openstack-ansible16:28
*** thorst has quit IRC16:34
*** cshen has quit IRC16:37
*** ranger6 has joined #openstack-ansible16:42
*** cshen has joined #openstack-ansible16:45
*** armaan_ has joined #openstack-ansible16:48
*** armaan has quit IRC16:48
*** ranger6 has left #openstack-ansible16:50
*** cshen has quit IRC17:06
*** woodard has joined #openstack-ansible17:13
*** woodard has quit IRC17:17
*** woodard has joined #openstack-ansible18:14
*** cshen has joined #openstack-ansible18:18
*** woodard has quit IRC18:19
*** cshen has quit IRC18:29
*** thorst has joined #openstack-ansible18:30
*** thorst has quit IRC18:35
*** perniciouscaffei has joined #openstack-ansible18:58
*** homerp_ has joined #openstack-ansible19:03
*** coolj_ has joined #openstack-ansible19:04
*** phschwartz_ has joined #openstack-ansible19:04
*** mfisch` has joined #openstack-ansible19:04
*** cloudkiller has joined #openstack-ansible19:05
*** sdake_ has joined #openstack-ansible19:06
*** asettle_ has joined #openstack-ansible19:06
*** phschwartz has quit IRC19:07
*** cloudnull has quit IRC19:07
*** timsim has quit IRC19:07
*** _nwonknu has quit IRC19:07
*** sdake has quit IRC19:07
*** asettle has quit IRC19:07
*** fdegir has quit IRC19:07
*** serverascode has quit IRC19:07
*** homerp has quit IRC19:07
*** coolj has quit IRC19:07
*** mfisch has quit IRC19:07
*** berendt has quit IRC19:07
*** cloudkiller is now known as cloudnull19:07
*** luzC has quit IRC19:09
*** dankolbrs has quit IRC19:10
*** luzC has joined #openstack-ansible19:11
*** hybridpollo has joined #openstack-ansible19:12
*** armaan_ has quit IRC19:12
*** drifterza has quit IRC19:12
*** dankolbrs has joined #openstack-ansible19:12
*** nwonknu has joined #openstack-ansible19:13
*** csmart has quit IRC19:16
*** evrardjp[m] has quit IRC19:16
*** timsim has joined #openstack-ansible19:18
*** fdegir has joined #openstack-ansible19:18
*** serverascode has joined #openstack-ansible19:18
*** berendt has joined #openstack-ansible19:18
*** serverascode has quit IRC19:19
*** armaan has joined #openstack-ansible19:19
*** madorn has quit IRC19:21
*** serverascode has joined #openstack-ansible19:21
*** madorn has joined #openstack-ansible19:24
*** hybridpollo has quit IRC19:37
*** hybridpollo has joined #openstack-ansible19:37
*** phealy has quit IRC19:48
*** cshen has joined #openstack-ansible19:50
*** schwicht has quit IRC19:53
*** woodard has joined #openstack-ansible20:16
*** woodard has quit IRC20:20
*** thorst has joined #openstack-ansible20:31
*** thorst has quit IRC20:35
*** cshen has quit IRC20:37
*** cshen has joined #openstack-ansible20:38
*** agrebennikov has joined #openstack-ansible21:16
*** hybridpollo has quit IRC21:16
*** hybridpollo has joined #openstack-ansible21:16
*** woodard has joined #openstack-ansible21:17
*** csmart has joined #openstack-ansible21:17
*** evrardjp[m] has joined #openstack-ansible21:17
*** agrebennikov has quit IRC21:20
*** armaan has quit IRC21:20
*** woodard has quit IRC21:21
*** cshen has quit IRC21:55
*** woodard has joined #openstack-ansible22:17
*** woodard has quit IRC22:22
*** thorst has joined #openstack-ansible22:32
*** thorst has quit IRC22:37
*** asura has quit IRC22:48
*** asura has joined #openstack-ansible22:53
*** woodard has joined #openstack-ansible23:18
*** woodard has quit IRC23:22

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!