Saturday, 2018-12-15

*** _alastor_ has joined #openstack-infra00:00
*** woojay has quit IRC00:05
*** yamamoto has joined #openstack-infra00:13
*** bobh has joined #openstack-infra00:15
clarkbthis ansible bug seems to exist in 2.5 and 2.6 as well00:18
*** bobh has quit IRC00:18
clarkband is present on tip of devel00:20
*** sthussey has quit IRC00:21
*** yamamoto has quit IRC00:22
*** yamamoto has joined #openstack-infra00:22
clarkbat this point I think I'm just waiting to confirm that logstash apache is running again then I'm calling it a week00:22
*** wolverineav has quit IRC00:25
*** wolverineav has joined #openstack-infra00:26
*** wolverineav has quit IRC00:27
*** wolverineav has joined #openstack-infra00:27
*** betherly has joined #openstack-infra00:27
*** wolverineav has quit IRC00:30
*** betherly has quit IRC00:32
*** wolverineav has joined #openstack-infra00:34
*** jento has joined #openstack-infra00:35
*** Swami has quit IRC00:38
*** gyee has quit IRC00:39
*** _alastor_ has quit IRC00:45
*** yamamoto has quit IRC01:15
fungigreat work!01:15
*** yamamoto has joined #openstack-infra01:15
clarkbchange will merge shortly and we are currently 20 minutes from puppet run01:17
openstackgerritMerged openstack-infra/puppet-kibana master: Use full lookup path for serveradmin in template  https://review.openstack.org/62537401:22
fungithere you fo01:22
fungier, you go01:22
clarkbnow just ~12 minutes away from applying01:25
*** betherly has joined #openstack-infra01:30
*** betherly has quit IRC01:34
*** wolverineav has quit IRC01:36
clarkbbah the way we update modules is at the very beginning of the run so I actually have to wait another half hour01:38
fungior check on it some other time when you don't have a friday evening to enjoy01:39
fungior i can keep an eye on it for you, as i'm a boring old fuddy-duddy anyway01:40
fungithis _is_ my exciting friday night01:40
clarkbits fine I mostly want to see if this fixes it and if not maybe emergency file it and edit the vhost01:40
*** hwoarang has quit IRC01:41
*** eernst has quit IRC01:41
*** hwoarang has joined #openstack-infra01:43
*** mrsoul has joined #openstack-infra02:03
clarkbitworks! http://logstash.openstack.org/#/dashboard/file/logstash.json02:08
*** hwoarang has quit IRC02:10
*** hwoarang has joined #openstack-infra02:11
*** betherly has joined #openstack-infra02:12
*** haleyb has quit IRC02:14
*** betherly has quit IRC02:17
*** persia has quit IRC02:24
*** persia has joined #openstack-infra02:24
*** dayou has quit IRC02:39
*** dayou has joined #openstack-infra02:40
*** gagehugo has joined #openstack-infra02:44
*** yamamoto has quit IRC02:47
*** yamamoto has joined #openstack-infra02:50
*** wolverineav has joined #openstack-infra02:51
*** yamamoto has quit IRC02:51
*** dklyle has joined #openstack-infra02:54
*** hwoarang has quit IRC02:56
*** wolverineav has quit IRC02:56
*** hwoarang has joined #openstack-infra02:57
*** apetrich has quit IRC03:16
*** ramishra has quit IRC03:31
*** yamamoto has joined #openstack-infra03:32
*** ykarel|away has joined #openstack-infra03:34
*** betherly has joined #openstack-infra03:36
*** betherly has quit IRC03:40
*** dklyle has quit IRC03:42
*** bhavikdbavishi has joined #openstack-infra03:44
*** yamamoto has quit IRC03:44
*** ykarel|away has quit IRC03:50
*** ykarel has joined #openstack-infra03:52
*** jamesmcarthur has joined #openstack-infra03:52
*** sean-k-mooney has quit IRC03:57
*** jamesmcarthur has quit IRC03:58
*** sean-k-mooney has joined #openstack-infra04:04
*** ykarel has quit IRC04:07
*** ykarel has joined #openstack-infra04:13
*** yamamoto has joined #openstack-infra04:18
*** agopi has quit IRC04:23
*** agopi has joined #openstack-infra04:27
*** bj_lyk has joined #openstack-infra04:44
*** bhavikdbavishi has quit IRC04:47
*** rh-jelabarre has quit IRC04:49
*** Bhujay has joined #openstack-infra04:52
*** Bhujay has quit IRC04:53
*** psachin has joined #openstack-infra04:53
*** Bhujay has joined #openstack-infra04:53
*** Bhujay has quit IRC04:54
*** Bhujay has joined #openstack-infra04:55
*** Bhujay has quit IRC04:56
*** Bhujay has joined #openstack-infra04:56
*** ykarel has quit IRC05:08
*** bhavikdbavishi has joined #openstack-infra05:13
*** prometheanfire has quit IRC05:15
*** bhavikdbavishi has quit IRC05:18
*** agopi has quit IRC05:19
*** prometheanfire has joined #openstack-infra05:23
*** betherly has joined #openstack-infra05:30
*** prometheanfire has quit IRC05:33
*** betherly has quit IRC05:35
*** yamamoto has quit IRC05:36
*** yamamoto has joined #openstack-infra05:36
*** dklyle has joined #openstack-infra05:37
*** lpetrut has joined #openstack-infra05:38
*** ramishra has joined #openstack-infra05:39
*** prometheanfire has joined #openstack-infra05:40
*** yamamoto has quit IRC05:41
*** bhavikdbavishi has joined #openstack-infra05:52
*** yamamoto has joined #openstack-infra05:53
*** jamesmcarthur has joined #openstack-infra05:58
*** betherly has joined #openstack-infra06:02
*** ykarel has joined #openstack-infra06:02
*** jamesmcarthur has quit IRC06:04
*** bhavikdbavishi has quit IRC06:04
*** betherly has quit IRC06:07
*** bhavikdbavishi has joined #openstack-infra06:08
*** yamamoto has quit IRC06:09
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/62514906:10
*** ykarel has quit IRC06:13
*** yamamoto has joined #openstack-infra06:14
*** dklyle has quit IRC06:19
*** lpetrut has quit IRC06:20
*** bj_lyk has quit IRC06:23
*** bj_lyk has joined #openstack-infra06:24
*** agopi has joined #openstack-infra06:27
*** ykarel has joined #openstack-infra06:30
*** ykarel has quit IRC06:34
*** Bhujay has quit IRC06:41
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider  https://review.openstack.org/57066706:41
*** yamamoto has quit IRC06:43
*** hwoarang has quit IRC06:47
*** yboaron_ has joined #openstack-infra06:48
*** hwoarang has joined #openstack-infra06:49
*** agopi has quit IRC06:54
*** betherly has joined #openstack-infra06:54
*** betherly has quit IRC06:59
*** lpetrut has joined #openstack-infra07:00
*** agopi has joined #openstack-infra07:01
*** agopi has quit IRC07:02
*** agopi has joined #openstack-infra07:03
*** lpetrut has quit IRC07:04
*** agopi has quit IRC07:11
*** dklyle has joined #openstack-infra07:12
*** agopi has joined #openstack-infra07:15
*** ramishra has quit IRC07:17
*** agopi has quit IRC07:22
*** dklyle has quit IRC07:23
*** yamamoto has joined #openstack-infra07:23
*** bhavikdbavishi has quit IRC07:35
openstackgerritmelissaml proposed openstack-infra/storyboard-webclient master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62538807:52
*** pcaruana has joined #openstack-infra08:00
openstackgerritmelissaml proposed openstack-infra/system-config master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62538908:02
openstackgerritmelissaml proposed openstack-dev/pbr master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62539008:09
*** yamamoto has quit IRC08:17
*** wolverineav has joined #openstack-infra08:17
*** yamamoto has joined #openstack-infra08:17
*** wolverineav has quit IRC08:22
*** imacdonn has quit IRC08:24
*** imacdonn has joined #openstack-infra08:25
*** slaweq has joined #openstack-infra08:32
*** yamamoto has quit IRC08:35
*** agopi has joined #openstack-infra08:35
*** bhavikdbavishi has joined #openstack-infra08:36
*** yboaron_ has quit IRC08:37
*** yamamoto has joined #openstack-infra08:37
*** yamamoto has quit IRC08:43
*** yamamoto has joined #openstack-infra08:44
*** slaweq has quit IRC08:44
*** yamamoto has quit IRC08:45
*** yamamoto has joined #openstack-infra08:52
*** yamamoto has quit IRC08:52
*** Bhujay has joined #openstack-infra09:00
*** e0ne has joined #openstack-infra09:02
openstackgerritOpenStack Proposal Bot proposed openstack-infra/storyboard master: Imported Translations from Zanata  https://review.openstack.org/62539309:03
*** agopi has quit IRC09:06
*** e0ne has quit IRC09:06
*** e0ne has joined #openstack-infra09:14
*** yamamoto has joined #openstack-infra09:16
*** e0ne has quit IRC09:19
*** yamamoto has quit IRC09:21
*** ramishra has joined #openstack-infra09:26
*** bhavikdbavishi has quit IRC09:30
*** e0ne has joined #openstack-infra09:39
*** e0ne has quit IRC09:41
*** yamamoto has joined #openstack-infra09:50
ssbarnea|roverI seen some unexplained POST_FAILUREs since yesterday does anyone knows what happened?10:05
*** pbourke has quit IRC10:31
*** pbourke has joined #openstack-infra10:33
*** agopi has joined #openstack-infra10:38
*** jtomasek has joined #openstack-infra10:39
*** jtomasek has quit IRC10:40
*** e0ne has joined #openstack-infra10:49
*** e0ne has quit IRC10:53
*** bhavikdbavishi has joined #openstack-infra10:58
*** Bhujay has quit IRC11:01
*** yamamoto has quit IRC11:02
*** jbadiapa has quit IRC11:16
*** yamamoto has joined #openstack-infra11:25
*** smarcet has joined #openstack-infra11:25
*** yamamoto has quit IRC11:25
*** bhavikdbavishi has quit IRC11:34
*** agopi has quit IRC11:43
*** agopi has joined #openstack-infra11:46
*** yamamoto has joined #openstack-infra11:50
*** yamamoto has quit IRC11:50
*** wolverineav has joined #openstack-infra11:54
*** dkehn has quit IRC11:54
*** wolverineav has quit IRC11:58
*** yamamoto has joined #openstack-infra11:59
*** smarcet has quit IRC12:14
*** bhavikdbavishi has joined #openstack-infra12:20
*** smarcet has joined #openstack-infra12:22
*** dkehn has joined #openstack-infra12:23
*** smarcet has quit IRC12:30
*** yboaron_ has joined #openstack-infra12:31
*** yboaron_ has quit IRC12:35
*** Bhujay has joined #openstack-infra12:39
*** ykarel has joined #openstack-infra12:41
*** tosky has joined #openstack-infra12:45
*** ykarel has quit IRC13:06
*** efried has joined #openstack-infra13:26
*** bhavikdbavishi has quit IRC13:28
fungissbarnea|rover: and no logs?13:53
ssbarnea|roverfungi: yep.13:54
fungilogs volume has plenty of space still, and nothing in dmesg to indicate fs write errors there13:56
*** Bhujay has quit IRC13:59
fungii don't see any indication any of the executors is unhealthy grafana.openstack.org/d/T6vSHcSik/zuul-status13:59
*** Bhujay has joined #openstack-infra13:59
fungier, http://grafana.openstack.org/d/T6vSHcSik/zuul-status13:59
*** Bhujay has quit IRC14:00
*** Bhujay has joined #openstack-infra14:01
*** Bhujay has quit IRC14:02
*** Bhujay has joined #openstack-infra14:02
*** Bhujay has quit IRC14:03
*** Bhujay has joined #openstack-infra14:04
*** Bhujay has quit IRC14:05
*** Bhujay has joined #openstack-infra14:05
*** bj_lyk has quit IRC14:06
*** hwoarang has quit IRC14:18
*** hwoarang has joined #openstack-infra14:18
*** betherly has joined #openstack-infra14:20
*** betherly has quit IRC14:24
*** ssbarnea|rover has quit IRC14:28
*** ssbarnea|rover has joined #openstack-infra14:30
*** efried has quit IRC14:32
*** bobh has joined #openstack-infra14:35
*** betherly has joined #openstack-infra14:50
*** slaweq has joined #openstack-infra14:50
*** betherly has quit IRC14:55
*** hwoarang has quit IRC14:57
*** ykarel has joined #openstack-infra15:00
*** hwoarang has joined #openstack-infra15:01
*** slaweq has quit IRC15:04
*** agopi has quit IRC15:08
*** Bhujay has quit IRC15:13
*** hwoarang has quit IRC15:17
*** hwoarang has joined #openstack-infra15:18
*** bobh has quit IRC15:24
*** yamamoto has quit IRC15:34
*** bhavikdbavishi has joined #openstack-infra15:40
scasi was able to avoid terrible ideas. once it came to me where that compatibility needed to come in, it made short work out of things without any egregious overrides like admin force-pushes, or anything in the realm of janky15:50
scasmy exciting friday night was chasing down where some super vague error message was throwing errors, with seemingly random edits to get all angles of testing working consistently15:56
*** bhavikdbavishi has quit IRC15:58
*** betherly has joined #openstack-infra16:00
*** betherly has quit IRC16:05
*** ramishra has quit IRC16:09
*** yamamoto has joined #openstack-infra16:11
*** tosky has quit IRC16:33
*** ykarel has quit IRC16:34
*** bhavikdbavishi has joined #openstack-infra16:34
*** betherly has joined #openstack-infra16:40
*** betherly has quit IRC16:45
*** bhavikdbavishi has quit IRC16:46
*** notmyname has quit IRC16:46
*** notmyname has joined #openstack-infra16:47
*** betherly has joined #openstack-infra17:00
*** jamesmcarthur has joined #openstack-infra17:01
*** betherly has quit IRC17:05
*** agopi has joined #openstack-infra17:13
*** betherly has joined #openstack-infra17:20
*** e0ne has joined #openstack-infra17:22
*** betherly has quit IRC17:25
*** jamesmcarthur has quit IRC17:33
*** e0ne has quit IRC17:38
*** e0ne has joined #openstack-infra17:39
*** e0ne has quit IRC17:40
*** betherly has joined #openstack-infra17:41
*** psachin has quit IRC17:43
*** betherly has quit IRC17:45
fungissbarnea|rover: still not spotting any post_failure results (checked all the failing changes currently being tested too), so whatever it was hopefully was short-lived. best guess is we had connectivity issues in/to rax-dfw where most of our control plane resides17:46
clarkbif you have job uuids you can grep for them in the executor logs17:58
fungiyeah, i'm not worried enough to spend time digging those out of the scheduler log17:59
fungiif it's not still going on even with utilization ramping up18:00
*** betherly has joined #openstack-infra18:01
*** betherly has quit IRC18:05
*** yboaron_ has joined #openstack-infra18:06
*** yboaron_ has quit IRC18:08
*** yboaron_ has joined #openstack-infra18:09
*** yboaron_ has quit IRC18:17
*** markvoelker has joined #openstack-infra18:36
*** betherly has joined #openstack-infra18:41
*** markvoelker has quit IRC18:41
*** betherly has quit IRC18:45
*** betherly has joined #openstack-infra19:01
*** betherly has quit IRC19:06
*** lbragstad has joined #openstack-infra19:32
*** jamesmcarthur has joined #openstack-infra19:34
*** slaweq has joined #openstack-infra19:34
*** jamesmcarthur has quit IRC19:38
*** yboaron_ has joined #openstack-infra19:39
*** betherly has joined #openstack-infra19:41
*** rossella_s has quit IRC19:44
*** yboaron_ has quit IRC19:44
*** betherly has quit IRC19:46
*** hongbin has joined #openstack-infra19:55
*** markvoelker has joined #openstack-infra20:37
*** betherly has joined #openstack-infra21:01
*** betherly has quit IRC21:06
*** betherly has joined #openstack-infra21:21
*** betherly has quit IRC21:26
*** betherly has joined #openstack-infra21:41
*** betherly has quit IRC21:46
*** wolverineav has joined #openstack-infra21:48
*** dpawlik has joined #openstack-infra21:56
*** lbragstad has quit IRC21:58
*** dpawlik has quit IRC21:59
*** betherly has joined #openstack-infra22:01
*** betherly has quit IRC22:06
*** dpawlik has joined #openstack-infra22:15
*** dpawlik has quit IRC22:19
*** agopi has quit IRC22:23
*** wolverineav has quit IRC22:34
*** crank has joined #openstack-infra23:01
*** betherly has joined #openstack-infra23:02
*** crank has joined #openstack-infra23:04
*** betherly has quit IRC23:06
*** wolverineav has joined #openstack-infra23:40
*** wolverineav has quit IRC23:45
*** crank has quit IRC23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!