Friday, 2017-06-09

*** gildub has joined #rdo		00:05
rdogerrit	rdo-trunk created rdoinfo master: Bump rdoinfo pike-uc tags to latest upper-constraints https://review.rdoproject.org/r/7034	00:05
*** vnogin has joined #rdo		00:12
*** Son_Goku has quit IRC		00:21
*** toure is now known as toure\|gone		00:26
*** Son_Goku has joined #rdo		00:28
*** hamzy has joined #rdo		00:28
*** Son_Goku has quit IRC		00:28
*** gszasz has quit IRC		00:43
*** yfried has joined #rdo		00:47
*** egafford has quit IRC		00:53
*** julim has joined #rdo		00:53
*** egafford1 has joined #rdo		00:53
*** dsneddon has quit IRC		00:53
*** number80 has joined #rdo		01:00
*** limao has joined #rdo		01:09
*** dsneddon has joined #rdo		01:09
*** yfried has quit IRC		01:12
*** limao has quit IRC		01:20
*** limao has joined #rdo		01:22
*** vnogin has quit IRC		01:26
*** fzdarsky_ has joined #rdo		01:27
*** amuller has quit IRC		01:28
*** fzdarsky\|afk has quit IRC		01:31
*** paragan has joined #rdo		01:51
*** paragan has joined #rdo		01:51
*** rlandy has quit IRC		01:54
*** dneary has joined #rdo		01:54
*** jhershbe has joined #rdo		02:08
*** flindet has joined #rdo		02:12
*** gvrangan has joined #rdo		02:17
*** limao has quit IRC		02:24
*** limao has joined #rdo		02:25
*** jhershbe has quit IRC		02:29
*** egafford1 has quit IRC		02:42
*** egafford has joined #rdo		02:42
*** egafford has quit IRC		02:42
*** egafford1 has joined #rdo		02:42
*** egafford1 has quit IRC		02:43
*** egafford has joined #rdo		02:43
*** egafford1 has joined #rdo		02:43
*** egafford1 has quit IRC		02:44
*** egafford has joined #rdo		02:44
*** egafford has quit IRC		02:45
*** egafford1 has joined #rdo		02:45
*** egafford has joined #rdo		02:45
*** egafford1 has quit IRC		02:45
*** egafford has quit IRC		02:46
*** egafford has joined #rdo		02:46
*** egafford has quit IRC		02:46
*** egafford1 has joined #rdo		02:46
*** egafford1 has quit IRC		02:47
*** egafford has joined #rdo		02:47
*** egafford has quit IRC		02:47
*** egafford has joined #rdo		02:48
*** egafford has quit IRC		02:48
*** egafford has joined #rdo		02:48
*** egafford has quit IRC		02:48
*** egafford1 has joined #rdo		02:48
*** egafford has joined #rdo		02:49
*** egafford1 has quit IRC		02:49
*** egafford has quit IRC		02:49
*** egafford1 has joined #rdo		02:50
*** egafford1 has quit IRC		02:50
*** egafford has joined #rdo		02:50
*** egafford has joined #rdo		02:51
*** egafford has quit IRC		02:51
*** egafford has joined #rdo		02:51
*** egafford has quit IRC		02:52
*** egafford1 has joined #rdo		02:52
*** egafford1 has quit IRC		02:52
*** egafford has joined #rdo		02:52
*** egafford has quit IRC		02:53
*** egafford has joined #rdo		02:53
*** egafford has quit IRC		02:53
*** egafford1 has joined #rdo		02:53
*** egafford1 has quit IRC		02:54
*** egafford has joined #rdo		02:54
*** egafford has quit IRC		02:55
*** egafford1 has joined #rdo		02:55
*** egafford1 has quit IRC		02:55
*** egafford has joined #rdo		02:55
*** egafford has quit IRC		02:56
*** egafford1 has joined #rdo		02:56
*** egafford1 has quit IRC		02:57
*** egafford has joined #rdo		02:57
*** gvrangan has quit IRC		02:57
*** egafford has quit IRC		02:57
*** egafford1 has joined #rdo		02:57
*** gvrangan has joined #rdo		02:58
*** egafford has joined #rdo		02:58
*** egafford1 has joined #rdo		02:58
*** egafford has quit IRC		02:58
*** egafford1 has quit IRC		02:59
*** egafford has joined #rdo		02:59
*** egafford1 has joined #rdo		03:00
*** egafford1 has quit IRC		03:00
*** egafford has joined #rdo		03:00
*** egafford1 has joined #rdo		03:01
*** egafford has joined #rdo		03:02
*** egafford1 has quit IRC		03:02
*** egafford has quit IRC		03:02
*** egafford1 has joined #rdo		03:02
*** egafford1 has quit IRC		03:03
*** egafford has joined #rdo		03:03
*** crossbuilder_ has joined #rdo		03:03
*** egafford has quit IRC		03:03
*** egafford1 has joined #rdo		03:04
*** egafford1 has quit IRC		03:04
*** egafford has joined #rdo		03:04
*** crossbuilder has quit IRC		03:04
*** egafford has quit IRC		03:05
*** egafford1 has joined #rdo		03:05
*** Son_Goku has joined #rdo		03:05
*** egafford has joined #rdo		03:05
*** egafford1 has quit IRC		03:06
*** egafford has joined #rdo		03:06
*** egafford has quit IRC		03:06
*** egafford1 has joined #rdo		03:06
*** egafford has joined #rdo		03:07
*** egafford has quit IRC		03:07
*** egafford1 has joined #rdo		03:07
*** egafford1 has quit IRC		03:08
*** egafford has joined #rdo		03:08
*** gvrangan has quit IRC		03:08
*** egafford has quit IRC		03:08
*** egafford1 has joined #rdo		03:08
*** egafford1 has quit IRC		03:09
*** egafford has joined #rdo		03:09
*** egafford has quit IRC		03:10
*** egafford has joined #rdo		03:10
*** gvrangan has joined #rdo		03:10
*** egafford has quit IRC		03:11
*** egafford1 has joined #rdo		03:11
*** egafford1 has quit IRC		03:11
*** egafford has joined #rdo		03:11
*** egafford has quit IRC		03:12
*** egafford1 has joined #rdo		03:12
*** egafford1 has quit IRC		03:12
*** egafford has joined #rdo		03:12
*** flindet has quit IRC		03:12
*** egafford has quit IRC		03:13
*** egafford1 has joined #rdo		03:13
*** egafford1 has quit IRC		03:14
*** egafford has joined #rdo		03:14
*** egafford has quit IRC		03:15
*** egafford1 has joined #rdo		03:15
*** egafford1 has quit IRC		03:15
*** egafford has joined #rdo		03:15
*** egafford has quit IRC		03:16
*** egafford1 has joined #rdo		03:16
*** egafford1 has quit IRC		03:17
*** egafford has joined #rdo		03:17
*** egafford has quit IRC		03:17
*** gvrangan has quit IRC		03:17
*** egafford1 has joined #rdo		03:17
*** egafford1 has quit IRC		03:18
*** egafford has joined #rdo		03:18
*** Jack_Iv has joined #rdo		03:18
*** egafford has quit IRC		03:18
*** egafford1 has joined #rdo		03:18
*** egafford1 has quit IRC		03:19
*** egafford has joined #rdo		03:19
*** egafford1 has joined #rdo		03:20
*** egafford has joined #rdo		03:20
*** gvrangan has joined #rdo		03:20
*** egafford has quit IRC		03:21
*** egafford has joined #rdo		03:21
*** egafford has quit IRC		03:21
*** egafford1 has joined #rdo		03:21
*** egafford1 has quit IRC		03:22
*** egafford has joined #rdo		03:22
*** egafford has quit IRC		03:22
*** egafford has joined #rdo		03:22
*** Jack_Iv has quit IRC		03:23
*** egafford has quit IRC		03:23
*** egafford1 has joined #rdo		03:23
*** egafford1 has quit IRC		03:23
*** egafford has joined #rdo		03:23
*** egafford1 has joined #rdo		03:24
*** egafford has joined #rdo		03:25
*** egafford has quit IRC		03:25
*** egafford has joined #rdo		03:25
*** egafford1 has joined #rdo		03:26
*** egafford has quit IRC		03:26
*** egafford1 has quit IRC		03:26
*** egafford has joined #rdo		03:26
*** jcoufal has joined #rdo		03:26
*** egafford has quit IRC		03:27
*** egafford1 has joined #rdo		03:27
*** egafford1 has quit IRC		03:27
*** egafford has joined #rdo		03:27
*** egafford1 has joined #rdo		03:28
*** egafford has quit IRC		03:28
*** egafford1 has quit IRC		03:28
*** egafford has joined #rdo		03:28
*** egafford has quit IRC		03:29
*** limao has quit IRC		03:29
*** egafford1 has joined #rdo		03:29
*** egafford1 has quit IRC		03:30
*** egafford has joined #rdo		03:30
*** limao has joined #rdo		03:30
*** gvrangan has quit IRC		03:30
*** egafford has quit IRC		03:30
*** egafford1 has joined #rdo		03:30
*** egafford1 has quit IRC		03:31
*** egafford has joined #rdo		03:31
*** julim has quit IRC		03:31
*** egafford has quit IRC		03:31
*** egafford1 has joined #rdo		03:31
*** egafford1 has quit IRC		03:32
*** egafford has joined #rdo		03:32
*** egafford1 has joined #rdo		03:32
*** egafford has quit IRC		03:33
*** egafford1 has quit IRC		03:33
*** egafford has joined #rdo		03:33
*** egafford has quit IRC		03:33
*** egafford1 has joined #rdo		03:34
*** limao has quit IRC		03:34
*** egafford has joined #rdo		03:34
*** egafford1 has quit IRC		03:34
*** limao has joined #rdo		03:35
*** egafford has quit IRC		03:35
*** egafford has joined #rdo		03:35
*** egafford has quit IRC		03:35
*** egafford1 has joined #rdo		03:35
*** egafford1 has quit IRC		03:36
*** egafford has joined #rdo		03:36
*** egafford1 has joined #rdo		03:36
*** egafford has quit IRC		03:36
*** limao has quit IRC		03:37
*** egafford1 has quit IRC		03:37
*** egafford has joined #rdo		03:37
*** egafford has quit IRC		03:37
*** egafford has joined #rdo		03:37
*** imcleod has joined #rdo		03:38
*** egafford has quit IRC		03:38
*** egafford has joined #rdo		03:38
*** gkadam has joined #rdo		03:38
*** egafford has quit IRC		03:38
*** egafford1 has joined #rdo		03:38
*** anilvenkata has joined #rdo		03:39
*** egafford1 has quit IRC		03:39
*** egafford has joined #rdo		03:39
*** egafford1 has joined #rdo		03:40
*** egafford has joined #rdo		03:40
*** egafford1 has quit IRC		03:40
*** egafford has quit IRC		03:41
*** egafford1 has joined #rdo		03:41
*** gvrangan has joined #rdo		03:41
*** egafford1 has quit IRC		03:41
*** egafford has joined #rdo		03:41
*** egafford has quit IRC		03:42
*** egafford1 has joined #rdo		03:42
*** egafford has joined #rdo		03:42
*** egafford1 has quit IRC		03:42
*** egafford1 has joined #rdo		03:43
*** egafford has quit IRC		03:43
*** egafford has joined #rdo		03:44
*** egafford1 has quit IRC		03:44
*** egafford1 has joined #rdo		03:44
*** egafford has quit IRC		03:45
*** egafford1 has quit IRC		03:45
*** egafford2 has joined #rdo		03:45
*** egafford2 has quit IRC		03:45
*** egafford has joined #rdo		03:45
*** egafford1 has joined #rdo		03:46
*** egafford has quit IRC		03:46
*** egafford1 has quit IRC		03:46
*** egafford has joined #rdo		03:46
*** egafford has quit IRC		03:47
*** egafford1 has joined #rdo		03:47
*** Son_Goku has quit IRC		03:47
*** egafford1 has quit IRC		03:47
*** egafford has joined #rdo		03:48
*** egafford has quit IRC		03:48
*** egafford1 has joined #rdo		03:48
*** egafford1 has quit IRC		03:48
*** egafford has joined #rdo		03:49
*** egafford1 has joined #rdo		03:49
*** egafford has quit IRC		03:49
*** egafford1 has quit IRC		03:50
*** egafford has joined #rdo		03:50
*** egafford has quit IRC		03:50
*** egafford1 has joined #rdo		03:50
*** egafford1 has quit IRC		03:51
*** egafford has joined #rdo		03:51
*** egafford has quit IRC		03:51
*** egafford1 has joined #rdo		03:51
*** egafford1 has quit IRC		03:52
*** egafford has joined #rdo		03:52
*** gvrangan has quit IRC		03:52
*** egafford1 has joined #rdo		03:53
*** egafford1 has quit IRC		03:53
*** egafford2 has joined #rdo		03:53
*** egafford has quit IRC		03:53
*** egafford2 has quit IRC		03:53
*** egafford has joined #rdo		03:53
*** egafford1 has joined #rdo		03:54
*** egafford1 has quit IRC		03:55
*** egafford has joined #rdo		03:55
*** egafford has quit IRC		03:55
*** egafford1 has joined #rdo		03:55
*** egafford has joined #rdo		03:56
*** egafford has quit IRC		03:56
*** egafford1 has joined #rdo		03:56
*** egafford has joined #rdo		03:57
*** egafford has quit IRC		03:57
*** egafford1 has joined #rdo		03:57
*** egafford1 has quit IRC		03:58
*** egafford has joined #rdo		03:58
*** egafford has quit IRC		03:58
*** egafford has joined #rdo		03:59
*** julim has joined #rdo		03:59
*** julim has quit IRC		03:59
*** egafford has quit IRC		03:59
*** egafford1 has joined #rdo		03:59
*** egafford1 has quit IRC		04:00
*** egafford has joined #rdo		04:00
*** egafford1 has joined #rdo		04:00
*** egafford has quit IRC		04:00
*** egafford has joined #rdo		04:01
*** egafford1 has quit IRC		04:02
*** egafford1 has joined #rdo		04:02
*** egafford has quit IRC		04:02
*** paragan has quit IRC		04:02
*** egafford1 has quit IRC		04:02
*** egafford has joined #rdo		04:02
*** egafford has quit IRC		04:03
*** egafford1 has joined #rdo		04:03
*** egafford1 has quit IRC		04:03
*** egafford has joined #rdo		04:03
*** egafford1 has joined #rdo		04:04
*** egafford has quit IRC		04:04
*** egafford1 has quit IRC		04:05
*** egafford has joined #rdo		04:05
*** egafford1 has joined #rdo		04:05
*** egafford has quit IRC		04:05
*** egafford1 has quit IRC		04:06
*** egafford has joined #rdo		04:06
*** egafford has quit IRC		04:06
*** egafford1 has joined #rdo		04:06
*** imcleod has quit IRC		04:07
*** egafford1 has quit IRC		04:07
*** egafford has joined #rdo		04:07
*** egafford has quit IRC		04:07
*** egafford1 has joined #rdo		04:07
*** egafford has joined #rdo		04:08
*** egafford has quit IRC		04:08
*** egafford1 has joined #rdo		04:09
*** egafford1 has quit IRC		04:09
*** egafford has joined #rdo		04:09
*** egafford has quit IRC		04:10
*** egafford has joined #rdo		04:10
*** egafford has quit IRC		04:10
*** egafford has joined #rdo		04:11
*** egafford has quit IRC		04:11
*** egafford1 has joined #rdo		04:11
*** egafford has joined #rdo		04:12
*** egafford1 has quit IRC		04:12
*** egafford has quit IRC		04:12
*** egafford1 has joined #rdo		04:12
*** egafford has joined #rdo		04:13
*** egafford has quit IRC		04:13
*** egafford1 has joined #rdo		04:13
*** egafford has joined #rdo		04:14
*** paragan has joined #rdo		04:14
*** egafford has quit IRC		04:15
*** egafford has joined #rdo		04:15
*** egafford has quit IRC		04:15
*** egafford1 has joined #rdo		04:15
*** egafford1 has quit IRC		04:16
*** egafford has joined #rdo		04:16
*** egafford has quit IRC		04:16
*** egafford1 has joined #rdo		04:16
*** egafford1 has quit IRC		04:17
*** egafford has joined #rdo		04:17
*** egafford has quit IRC		04:17
*** egafford1 has joined #rdo		04:17
*** egafford has joined #rdo		04:18
*** egafford1 has joined #rdo		04:19
*** egafford has quit IRC		04:19
*** egafford1 has quit IRC		04:19
*** egafford has joined #rdo		04:19
*** links has joined #rdo		04:19
*** egafford has quit IRC		04:20
*** egafford1 has joined #rdo		04:20
*** jcoufal has quit IRC		04:20
*** egafford1 has quit IRC		04:20
*** egafford has joined #rdo		04:20
*** egafford has quit IRC		04:21
*** egafford1 has joined #rdo		04:21
*** egafford1 has quit IRC		04:21
*** egafford has joined #rdo		04:21
*** egafford has quit IRC		04:22
*** egafford has joined #rdo		04:22
*** egafford has quit IRC		04:22
*** egafford has joined #rdo		04:23
*** egafford1 has joined #rdo		04:23
*** imcleod has joined #rdo		04:23
*** egafford1 has quit IRC		04:23
*** egafford has joined #rdo		04:24
*** egafford has quit IRC		04:24
*** egafford1 has joined #rdo		04:24
*** egafford has joined #rdo		04:25
*** egafford has quit IRC		04:25
*** egafford1 has joined #rdo		04:25
*** egafford1 has quit IRC		04:26
*** egafford has joined #rdo		04:26
*** egafford has quit IRC		04:27
*** egafford1 has joined #rdo		04:27
*** egafford1 has quit IRC		04:27
*** egafford has joined #rdo		04:27
*** egafford has quit IRC		04:28
*** egafford1 has joined #rdo		04:28
*** egafford1 has quit IRC		04:28
*** egafford has joined #rdo		04:29
*** egafford has quit IRC		04:29
*** egafford1 has joined #rdo		04:29
*** egafford has joined #rdo		04:30
*** egafford1 has quit IRC		04:30
*** egafford has quit IRC		04:30
*** egafford1 has joined #rdo		04:30
*** egafford1 has quit IRC		04:31
*** egafford has joined #rdo		04:31
*** egafford has quit IRC		04:31
*** egafford has joined #rdo		04:31
*** egafford has quit IRC		04:32
*** egafford has joined #rdo		04:32
*** egafford has joined #rdo		04:33
*** egafford has quit IRC		04:33
*** egafford1 has joined #rdo		04:33
*** imcleod has quit IRC		04:34
*** egafford1 has quit IRC		04:34
*** egafford has joined #rdo		04:34
*** egafford has quit IRC		04:35
*** egafford1 has joined #rdo		04:35
*** egafford1 has quit IRC		04:36
*** sasha21 has quit IRC		04:36
*** egafford has joined #rdo		04:36
*** egafford has quit IRC		04:36
*** egafford1 has joined #rdo		04:36
*** egafford1 has quit IRC		04:37
*** egafford has joined #rdo		04:37
*** egafford has quit IRC		04:37
*** egafford1 has joined #rdo		04:37
*** egafford1 has quit IRC		04:38
*** egafford has joined #rdo		04:38
*** egafford has quit IRC		04:38
*** egafford1 has joined #rdo		04:38
*** egafford1 has quit IRC		04:39
*** egafford has joined #rdo		04:39
*** egafford has quit IRC		04:39
*** egafford has joined #rdo		04:40
*** egafford1 has joined #rdo		04:40
*** egafford1 has quit IRC		04:41
*** egafford has joined #rdo		04:41
*** egafford1 has joined #rdo		04:41
*** egafford1 has quit IRC		04:42
*** egafford has joined #rdo		04:42
*** janki has joined #rdo		04:42
*** egafford has quit IRC		04:42
*** egafford1 has joined #rdo		04:43
*** egafford has joined #rdo		04:43
*** egafford has quit IRC		04:43
*** egafford1 has joined #rdo		04:44
*** egafford1 has quit IRC		04:44
*** egafford has joined #rdo		04:44
*** egafford has quit IRC		04:45
*** egafford1 has joined #rdo		04:45
*** egafford1 has quit IRC		04:45
*** egafford has joined #rdo		04:45
*** egafford has quit IRC		04:46
*** egafford1 has joined #rdo		04:46
*** egafford has joined #rdo		04:46
*** egafford has quit IRC		04:47
*** egafford has joined #rdo		04:47
*** egafford has quit IRC		04:47
*** egafford1 has joined #rdo		04:47
*** egafford1 has quit IRC		04:48
*** egafford has joined #rdo		04:48
*** egafford has quit IRC		04:49
*** egafford1 has joined #rdo		04:49
*** egafford1 has quit IRC		04:49
*** egafford has joined #rdo		04:49
*** egafford has quit IRC		04:50
*** egafford1 has joined #rdo		04:50
*** egafford1 has quit IRC		04:50
*** egafford has joined #rdo		04:50
*** egafford1 has joined #rdo		04:51
*** egafford1 has quit IRC		04:51
*** egafford has joined #rdo		04:51
*** egafford has quit IRC		04:52
*** egafford1 has joined #rdo		04:52
*** egafford has joined #rdo		04:52
*** egafford has quit IRC		04:53
*** egafford1 has joined #rdo		04:53
*** egafford1 has quit IRC		04:53
*** egafford has joined #rdo		04:54
*** egafford1 has joined #rdo		04:54
*** egafford1 has quit IRC		04:55
*** egafford has joined #rdo		04:55
*** Jack_Iv has joined #rdo		04:55
*** egafford has quit IRC		04:55
*** egafford1 has joined #rdo		04:55
*** egafford1 has quit IRC		04:56
*** egafford has joined #rdo		04:56
*** egafford has quit IRC		04:56
*** egafford1 has joined #rdo		04:56
*** egafford1 has quit IRC		04:57
*** egafford has joined #rdo		04:57
*** egafford has quit IRC		04:57
*** egafford1 has joined #rdo		04:57
*** egafford1 has quit IRC		04:58
*** egafford has joined #rdo		04:58
*** egafford1 has joined #rdo		04:59
*** egafford1 has quit IRC		04:59
*** egafford has joined #rdo		04:59
*** egafford has quit IRC		05:00
*** egafford1 has joined #rdo		05:00
*** egafford1 has quit IRC		05:00
*** egafford has joined #rdo		05:00
*** egafford has quit IRC		05:01
*** egafford has joined #rdo		05:01
*** egafford has joined #rdo		05:01
*** egafford has quit IRC		05:02
*** egafford1 has joined #rdo		05:02
*** egafford1 has quit IRC		05:02
*** egafford has joined #rdo		05:02
*** egafford1 has joined #rdo		05:03
*** egafford has quit IRC		05:03
*** egafford1 has quit IRC		05:03
*** egafford has joined #rdo		05:04
*** limao has joined #rdo		05:04
*** egafford has quit IRC		05:04
*** egafford1 has joined #rdo		05:04
*** egafford has joined #rdo		05:05
*** egafford1 has joined #rdo		05:05
*** egafford has quit IRC		05:05
*** egafford1 has quit IRC		05:06
*** ohochman has left #rdo		05:06
*** egafford has joined #rdo		05:06
*** Humbedooh has quit IRC		05:06
*** Humbedooh has joined #rdo		05:06
*** egafford has quit IRC		05:06
*** egafford1 has joined #rdo		05:06
*** ykarel has joined #rdo		05:07
*** egafford1 has quit IRC		05:07
*** Humbedooh has quit IRC		05:07
*** Humbedooh has joined #rdo		05:07
*** egafford has joined #rdo		05:07
*** egafford has quit IRC		05:07
*** egafford1 has joined #rdo		05:07
*** egafford1 has quit IRC		05:08
*** egafford has joined #rdo		05:08
*** egafford has quit IRC		05:09
*** egafford1 has joined #rdo		05:09
*** egafford1 has quit IRC		05:09
*** egafford has joined #rdo		05:09
*** egafford has quit IRC		05:10
*** egafford1 has joined #rdo		05:10
*** links has quit IRC		05:10
*** egafford1 has quit IRC		05:10
*** egafford has joined #rdo		05:10
*** egafford has quit IRC		05:11
*** egafford has joined #rdo		05:11
*** udesale has joined #rdo		05:11
*** egafford has quit IRC		05:11
*** egafford1 has joined #rdo		05:11
*** egafford1 has quit IRC		05:12
*** prateek has joined #rdo		05:12
*** egafford has joined #rdo		05:12
*** egafford has joined #rdo		05:13
*** egafford1 has joined #rdo		05:13
*** egafford1 has quit IRC		05:14
*** egafford has joined #rdo		05:14
*** dneary has quit IRC		05:14
*** egafford has quit IRC		05:14
*** egafford has joined #rdo		05:14
*** egafford has quit IRC		05:15
*** egafford1 has joined #rdo		05:15
*** egafford has joined #rdo		05:16
*** egafford1 has quit IRC		05:16
*** egafford2 has joined #rdo		05:16
*** egafford has joined #rdo		05:16
*** egafford2 has quit IRC		05:16
*** egafford1 has joined #rdo		05:17
*** egafford has quit IRC		05:17
*** egafford1 has quit IRC		05:18
*** egafford has joined #rdo		05:18
*** egafford1 has joined #rdo		05:19
*** egafford has joined #rdo		05:19
*** egafford has quit IRC		05:20
*** egafford1 has joined #rdo		05:20
*** egafford1 has quit IRC		05:20
*** egafford has joined #rdo		05:20
*** egafford1 has joined #rdo		05:21
*** egafford has joined #rdo		05:21
*** egafford1 has joined #rdo		05:22
*** egafford has quit IRC		05:22
*** egafford1 has quit IRC		05:22
*** egafford has joined #rdo		05:22
*** dsneddon has quit IRC		05:22
*** egafford has quit IRC		05:23
*** egafford1 has joined #rdo		05:23
*** egafford1 has quit IRC		05:23
*** egafford has joined #rdo		05:24
*** egafford has quit IRC		05:24
*** egafford has joined #rdo		05:24
*** egafford has quit IRC		05:25
*** egafford has joined #rdo		05:25
*** links has joined #rdo		05:25
*** egafford has quit IRC		05:25
*** egafford has joined #rdo		05:25
*** egafford has quit IRC		05:26
*** egafford has joined #rdo		05:26
*** egafford has quit IRC		05:26
*** egafford1 has joined #rdo		05:26
*** egafford1 has quit IRC		05:27
*** egafford has joined #rdo		05:27
*** egafford has quit IRC		05:27
*** egafford1 has joined #rdo		05:28
*** egafford has joined #rdo		05:28
*** egafford1 has quit IRC		05:28
*** ratailor has joined #rdo		05:28
*** egafford has quit IRC		05:28
*** egafford has joined #rdo		05:29
*** egafford has quit IRC		05:29
*** egafford1 has joined #rdo		05:29
*** flg has joined #rdo		05:30
*** egafford1 has quit IRC		05:30
*** egafford has joined #rdo		05:30
*** egafford1 has joined #rdo		05:30
*** egafford has joined #rdo		05:31
*** egafford1 has joined #rdo		05:31
*** Jack_Iv has quit IRC		05:31
*** Amita has quit IRC		05:32
*** egafford1 has quit IRC		05:32
*** Jack_Iv has joined #rdo		05:32
*** egafford has joined #rdo		05:32
*** egafford has quit IRC		05:33
*** egafford has joined #rdo		05:33
*** mosulica has joined #rdo		05:33
*** egafford has quit IRC		05:33
*** egafford1 has joined #rdo		05:33
*** egafford1 has quit IRC		05:34
*** egafford has joined #rdo		05:34
*** egafford1 has joined #rdo		05:34
*** egafford has quit IRC		05:34
*** egafford1 has quit IRC		05:35
*** egafford has joined #rdo		05:35
*** egafford has quit IRC		05:35
*** egafford1 has joined #rdo		05:35
*** egafford1 has quit IRC		05:36
*** egafford has joined #rdo		05:36
*** Jack_Iv has quit IRC		05:36
*** egafford has quit IRC		05:36
*** egafford has joined #rdo		05:36
*** egafford has quit IRC		05:37
*** egafford has joined #rdo		05:37
*** egafford1 has joined #rdo		05:37
*** egafford has quit IRC		05:37
*** egafford has joined #rdo		05:38
*** egafford1 has quit IRC		05:38
*** egafford1 has joined #rdo		05:39
*** egafford has quit IRC		05:39
*** egafford1 has quit IRC		05:39
*** egafford has joined #rdo		05:39
*** egafford has quit IRC		05:40
*** egafford has joined #rdo		05:40
*** egafford has quit IRC		05:40
*** egafford1 has joined #rdo		05:40
*** pgadiya has joined #rdo		05:41
*** egafford1 has quit IRC		05:41
*** egafford has joined #rdo		05:41
*** egafford has quit IRC		05:41
*** egafford1 has joined #rdo		05:41
*** egafford1 has quit IRC		05:42
*** egafford has joined #rdo		05:42
*** egafford has quit IRC		05:43
*** egafford1 has joined #rdo		05:43
*** egafford has joined #rdo		05:43
*** egafford1 has quit IRC		05:43
*** egafford has quit IRC		05:43
*** egafford1 has joined #rdo		05:44
*** pgadiya has quit IRC		05:44
*** egafford1 has quit IRC		05:44
*** egafford has joined #rdo		05:44
*** egafford has quit IRC		05:45
*** egafford has joined #rdo		05:45
*** richm has quit IRC		05:45
*** egafford has quit IRC		05:45
*** egafford1 has joined #rdo		05:45
*** egafford1 has quit IRC		05:46
*** egafford has joined #rdo		05:46
*** egafford1 has joined #rdo		05:46
*** egafford1 has quit IRC		05:47
*** egafford has joined #rdo		05:47
*** egafford1 has joined #rdo		05:48
*** egafford has quit IRC		05:48
*** egafford1 has quit IRC		05:48
*** egafford has joined #rdo		05:48
*** cshastri has joined #rdo		05:48
*** egafford1 has joined #rdo		05:49
*** egafford has quit IRC		05:49
*** egafford has joined #rdo		05:50
*** egafford1 has quit IRC		05:50
*** egafford has quit IRC		05:50
*** egafford1 has joined #rdo		05:50
*** iranzo has joined #rdo		05:51
*** iranzo has quit IRC		05:51
*** iranzo has joined #rdo		05:51
*** egafford has joined #rdo		05:51
*** egafford has quit IRC		05:52
*** egafford2 has joined #rdo		05:52
*** egafford2 has quit IRC		05:52
*** egafford1 has quit IRC		05:53
*** egafford has joined #rdo		05:53
*** egafford1 has joined #rdo		05:53
*** egafford1 has quit IRC		05:53
*** egafford has joined #rdo		05:54
*** egafford has quit IRC		05:54
*** egafford1 has joined #rdo		05:54
*** egafford1 has quit IRC		05:55
*** egafford has joined #rdo		05:55
*** egafford has quit IRC		05:55
*** egafford1 has joined #rdo		05:55
*** egafford has joined #rdo		05:56
*** egafford1 has quit IRC		05:56
*** egafford1 has joined #rdo		05:56
*** egafford has quit IRC		05:56
*** liangbo has joined #rdo		05:56
*** egafford1 has quit IRC		05:57
*** egafford has joined #rdo		05:57
*** egafford has quit IRC		05:57
*** egafford1 has joined #rdo		05:57
*** egafford1 has quit IRC		05:58
*** egafford has joined #rdo		05:58
*** Amita has joined #rdo		05:58
*** egafford has quit IRC		05:58
*** egafford has joined #rdo		05:59
*** sbulage has joined #rdo		05:59
*** egafford has quit IRC		05:59
*** egafford1 has joined #rdo		05:59
*** egafford1 has quit IRC		06:00
*** egafford has joined #rdo		06:00
*** egafford has quit IRC		06:00
*** egafford1 has joined #rdo		06:00
*** egafford1 has quit IRC		06:01
*** egafford has joined #rdo		06:01
*** egafford1 has joined #rdo		06:01
*** egafford1 has quit IRC		06:02
*** egafford has joined #rdo		06:02
*** egafford has quit IRC		06:02
*** egafford1 has joined #rdo		06:02
*** egafford1 has quit IRC		06:03
*** egafford has joined #rdo		06:03
*** egafford1 has joined #rdo		06:04
*** egafford1 has quit IRC		06:04
*** egafford has joined #rdo		06:04
*** egafford1 has joined #rdo		06:05
*** egafford has quit IRC		06:05
*** egafford has joined #rdo		06:05
*** egafford1 has quit IRC		06:05
*** egafford has quit IRC		06:06
*** egafford1 has joined #rdo		06:06
*** egafford1 has quit IRC		06:06
*** egafford has joined #rdo		06:06
*** pgadiya has joined #rdo		06:07
*** egafford has quit IRC		06:07
*** egafford1 has joined #rdo		06:07
*** limao has quit IRC		06:07
*** egafford1 has quit IRC		06:07
*** egafford has joined #rdo		06:07
*** limao has joined #rdo		06:08
*** egafford has quit IRC		06:08
*** egafford1 has joined #rdo		06:08
*** egafford has joined #rdo		06:09
*** egafford1 has quit IRC		06:09
*** egafford1 has joined #rdo		06:09
*** egafford has quit IRC		06:09
*** egafford1 has quit IRC		06:10
*** egafford has joined #rdo		06:10
*** limao has quit IRC		06:10
*** limao has joined #rdo		06:10
*** egafford has quit IRC		06:10
*** egafford has joined #rdo		06:10
*** Amita has quit IRC		06:11
*** egafford has quit IRC		06:11
*** egafford1 has joined #rdo		06:11
*** egafford1 has quit IRC		06:11
*** egafford has joined #rdo		06:11
*** egafford1 has joined #rdo		06:12
*** egafford has quit IRC		06:12
*** egafford1 has quit IRC		06:13
*** egafford has joined #rdo		06:13
*** Amita has joined #rdo		06:13
*** egafford has quit IRC		06:13
*** egafford1 has joined #rdo		06:13
*** egafford has joined #rdo		06:14
*** egafford1 has quit IRC		06:14
*** egafford has quit IRC		06:14
*** egafford1 has joined #rdo		06:14
*** egafford has joined #rdo		06:15
EmilienM	hello	06:15
EmilienM	amoralej\|off: ping me when you're on	06:15
*** egafford has quit IRC		06:15
*** egafford1 has joined #rdo		06:15
*** egafford1 has quit IRC		06:16
*** egafford has joined #rdo		06:16
*** egafford has quit IRC		06:16
*** egafford has joined #rdo		06:16
*** sbonazzo has joined #rdo		06:17
*** egafford has quit IRC		06:17
*** egafford1 has joined #rdo		06:17
*** egafford1 has quit IRC		06:17
*** egafford has joined #rdo		06:17
*** egafford has quit IRC		06:18
*** egafford has joined #rdo		06:18
*** jaosorior has joined #rdo		06:18
*** egafford has quit IRC		06:18
*** egafford has joined #rdo		06:19
number80	EmilienM: is there anything I can help you with meanwhile?	06:19
*** egafford1 has joined #rdo		06:19
*** egafford has joined #rdo		06:20
*** egafford1 has quit IRC		06:20
rdogerrit	hguemar proposed config master: Remove references to rdopkg in sanity-check exclusions https://review.rdoproject.org/r/7003	06:20
*** egafford has quit IRC		06:20
*** egafford has joined #rdo		06:20
*** egafford has quit IRC		06:21
*** egafford1 has joined #rdo		06:21
EmilienM	number80: I want to rollback python-neutron-lib from 1.7.0 to 1.6.0	06:21
EmilienM	number80: in order to try promotion jobs again	06:21
*** egafford1 has quit IRC		06:21
*** egafford has joined #rdo		06:21
EmilienM	number80: we downgraded neutron but it's still failing	06:21
EmilienM	I think it can also be neutron-lib	06:22
*** egafford has quit IRC		06:22
*** egafford has joined #rdo		06:22
number80	EmilienM: then, we just need to change pin in rdoinfo?	06:22
*** egafford has quit IRC		06:22
*** egafford has joined #rdo		06:22
*** egafford1 has joined #rdo		06:23
*** egafford has quit IRC		06:23
number80	or DLRN still requires manual cleaning in database for that?	06:23
* number80 has no access to that		06:23
*** egafford1 has quit IRC		06:24
*** egafford has joined #rdo		06:24
mandre	tdasilva: awesome! thanks a lot for your input	06:24
*** egafford has quit IRC		06:24
*** egafford has joined #rdo		06:24
EmilienM	number80: afik yes but not sure	06:24
EmilienM	number80: that's why I'm waiting for amoralej\|off or jpena\|off to be on	06:25
*** egafford has quit IRC		06:25
*** egafford1 has joined #rdo		06:25
*** jprovazn has joined #rdo		06:25
*** egafford1 has quit IRC		06:25
*** karthiks has quit IRC		06:25
*** egafford has joined #rdo		06:25
*** gildub has quit IRC		06:25
*** egafford has quit IRC		06:26
*** egafford1 has joined #rdo		06:26
*** egafford1 has quit IRC		06:26
*** egafford has joined #rdo		06:27
*** egafford has quit IRC		06:27
*** egafford1 has joined #rdo		06:27
*** egafford1 has quit IRC		06:27
*** egafford has joined #rdo		06:27
EmilienM	number80: in fact, there is another suggestion in https://trello.com/c/rzu8vhiU/133-cixlp1696094tripleociproa-neutron-server-create-subnet-times-out	06:28
*** jbadiapa_ has quit IRC		06:28
*** egafford has quit IRC		06:28
EmilienM	number80: to downgrade python2-pyroute	06:28
*** egafford1 has joined #rdo		06:28
*** karthiks has joined #rdo		06:28
*** egafford1 has quit IRC		06:29
*** egafford has joined #rdo		06:29
*** egafford has quit IRC		06:29
*** egafford1 has joined #rdo		06:29
*** egafford1 has quit IRC		06:30
*** egafford has joined #rdo		06:30
*** egafford has quit IRC		06:30
*** egafford1 has joined #rdo		06:30
*** egafford1 has quit IRC		06:31
rdogerrit	Merged openstack/vitrage-distgit ocata-rdo: Update to 1.5.2 https://review.rdoproject.org/r/7031	06:31
*** egafford has joined #rdo		06:31
*** egafford has quit IRC		06:31
*** egafford1 has joined #rdo		06:31
*** egafford1 has quit IRC		06:32
*** egafford has joined #rdo		06:32
*** egafford has quit IRC		06:32
*** egafford1 has joined #rdo		06:32
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	06:33
rdogerrit	hguemar created config master: Add reposync for openstack-infra/project-config https://review.rdoproject.org/r/7035	06:33
*** egafford1 has quit IRC		06:33
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	06:33
rdogerrit	hguemar proposed config master: Add reposync for openstack-infra/project-config https://review.rdoproject.org/r/7035	06:33
*** egafford has joined #rdo		06:33
*** egafford has quit IRC		06:34
*** egafford1 has joined #rdo		06:34
*** egafford1 has quit IRC		06:34
*** egafford has joined #rdo		06:34
*** ltomasbo\|away is now known as ltomasbo		06:35
*** egafford has quit IRC		06:35
*** jparrill has joined #rdo		06:35
*** egafford has joined #rdo		06:35
*** egafford has quit IRC		06:35
*** egafford1 has joined #rdo		06:35
*** smeyer has joined #rdo		06:36
*** egafford has joined #rdo		06:36
*** egafford1 has quit IRC		06:36
*** Jack_Iv has joined #rdo		06:37
*** egafford has quit IRC		06:37
*** egafford1 has joined #rdo		06:37
*** egafford1 has quit IRC		06:37
*** egafford has joined #rdo		06:37
*** egafford has quit IRC		06:38
*** egafford has joined #rdo		06:38
*** egafford has quit IRC		06:38
*** egafford has joined #rdo		06:39
*** egafford has quit IRC		06:39
*** egafford1 has joined #rdo		06:39
*** emalikov has joined #rdo		06:40
*** egafford1 has quit IRC		06:40
*** egafford has joined #rdo		06:40
*** egafford has quit IRC		06:40
*** egafford has joined #rdo		06:40
*** egafford has quit IRC		06:41
*** egafford1 has joined #rdo		06:41
*** egafford1 has quit IRC		06:41
*** egafford has joined #rdo		06:41
*** egafford has quit IRC		06:42
*** egafford has joined #rdo		06:42
*** florianf has joined #rdo		06:42
*** egafford has quit IRC		06:42
*** egafford1 has joined #rdo		06:42
*** egafford1 has quit IRC		06:43
*** egafford has joined #rdo		06:43
rdogerrit	hguemar created rdoinfo master: Add openstack-infra/project-config https://review.rdoproject.org/r/7036	06:43
*** egafford has quit IRC		06:44
*** egafford1 has joined #rdo		06:44
*** egafford1 has quit IRC		06:44
*** egafford has joined #rdo		06:44
*** egafford has quit IRC		06:45
*** egafford has joined #rdo		06:45
*** egafford has quit IRC		06:45
*** egafford1 has joined #rdo		06:45
*** sbulage has quit IRC		06:45
rdogerrit	hguemar proposed rdoinfo master: Add openstack-infra/project-config https://review.rdoproject.org/r/7036	06:46
*** egafford1 has quit IRC		06:46
*** egafford has joined #rdo		06:46
*** Caterpillar has joined #rdo		06:46
*** egafford has quit IRC		06:46
*** egafford has joined #rdo		06:47
*** egafford has quit IRC		06:47
*** egafford has joined #rdo		06:47
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	06:47
*** egafford has quit IRC		06:47
*** egafford1 has joined #rdo		06:47
*** egafford1 has quit IRC		06:48
*** egafford has joined #rdo		06:48
*** dgurtner has joined #rdo		06:48
*** dgurtner has joined #rdo		06:48
*** egafford has quit IRC		06:49
*** egafford1 has joined #rdo		06:49
*** egafford1 has quit IRC		06:49
*** egafford has joined #rdo		06:49
*** egafford has quit IRC		06:50
*** egafford1 has joined #rdo		06:50
*** egafford1 has quit IRC		06:50
*** egafford has joined #rdo		06:50
*** egafford1 has joined #rdo		06:51
*** egafford has quit IRC		06:51
*** bogdando has joined #rdo		06:51
*** egafford1 has quit IRC		06:51
*** egafford has joined #rdo		06:51
*** egafford has quit IRC		06:52
*** aufi has joined #rdo		06:52
*** egafford1 has joined #rdo		06:52
mandre	tdasilva, jschlueter: this should reflect the latest discussion about swift-object-expirer in kolla image, https://review.openstack.org/472540	06:52
*** egafford1 has quit IRC		06:53
*** tesseract has joined #rdo		06:53
*** egafford has joined #rdo		06:53
*** egafford has quit IRC		06:53
*** egafford1 has joined #rdo		06:53
*** egafford1 has quit IRC		06:54
*** egafford has joined #rdo		06:54
chandankumar	amoralej\|off: jpena\|off number80 \o/	06:54
*** egafford has quit IRC		06:54
*** egafford1 has joined #rdo		06:54
rdogerrit	Merged openstack/gnocchi-distgit ocata-rdo: Update gnocchi project url https://review.rdoproject.org/r/7022	06:54
number80	o/	06:54
*** egafford1 has quit IRC		06:55
*** egafford has joined #rdo		06:55
*** gszasz has joined #rdo		06:55
*** egafford has quit IRC		06:55
*** egafford has joined #rdo		06:55
*** egafford has quit IRC		06:56
*** egafford1 has joined #rdo		06:56
*** shardy has joined #rdo		06:56
*** egafford1 has quit IRC		06:56
*** egafford has joined #rdo		06:56
*** egafford has quit IRC		06:57
*** egafford1 has joined #rdo		06:57
*** egafford1 has quit IRC		06:57
*** egafford has joined #rdo		06:57
*** egafford has quit IRC		06:58
*** egafford1 has joined #rdo		06:58
*** egafford1 has quit IRC		06:59
*** egafford has joined #rdo		06:59
*** egafford has quit IRC		06:59
*** egafford1 has joined #rdo		06:59
*** egafford1 has quit IRC		07:00
*** egafford has joined #rdo		07:00
*** egafford has quit IRC		07:00
*** egafford1 has joined #rdo		07:00
*** sbulage has joined #rdo		07:01
*** egafford1 has quit IRC		07:01
*** egafford has joined #rdo		07:01
*** egafford has quit IRC		07:01
*** egafford1 has joined #rdo		07:01
*** egafford1 has quit IRC		07:02
*** egafford has joined #rdo		07:02
*** jackNemrod has joined #rdo		07:02
*** egafford has quit IRC		07:02
*** pgadiya has quit IRC		07:02
*** egafford1 has joined #rdo		07:02
*** egafford1 has quit IRC		07:03
*** egafford has joined #rdo		07:03
*** egafford has quit IRC		07:04
*** egafford1 has joined #rdo		07:04
*** egafford has joined #rdo		07:04
*** egafford1 has quit IRC		07:04
*** egafford has quit IRC		07:05
*** egafford has joined #rdo		07:05
*** egafford has quit IRC		07:05
*** pcaruana has joined #rdo		07:05
*** egafford1 has joined #rdo		07:05
*** egafford1 has quit IRC		07:06
*** egafford has joined #rdo		07:06
*** egafford has quit IRC		07:06
*** egafford1 has joined #rdo		07:06
*** egafford1 has quit IRC		07:07
*** egafford has joined #rdo		07:07
*** amoralej\|off is now known as amoralej		07:07
*** higgins has quit IRC		07:07
amoralej	ping emilienM	07:07
*** egafford has quit IRC		07:07
amoralej	EmilienM	07:07
EmilienM	amoralej: hey	07:07
*** egafford1 has joined #rdo		07:08
*** apevec has joined #rdo		07:08
*** apevec has quit IRC		07:08
*** apevec has joined #rdo		07:08
*** egafford1 has quit IRC		07:08
*** egafford has joined #rdo		07:08
amoralej	EmilienM, i think the best option is to hold a test environment in openstack infra	07:08
amoralej	and there we can test whatever we want	07:08
EmilienM	amoralej: it's not easy	07:08
amoralej	previous neutron-lib	07:08
*** sbulage has quit IRC		07:08
EmilienM	infra folks aren't awake now	07:08
amoralej	EmilienM why	07:08
amoralej	mmm	07:08
*** egafford has quit IRC		07:09
amoralej	are all in US zone?	07:09
*** egafford1 has joined #rdo		07:09
*** links has quit IRC		07:09
*** egafford1 has quit IRC		07:09
*** egafford has joined #rdo		07:09
EmilienM	yep	07:09
EmilienM	infra-root at least	07:09
*** rcernin has joined #rdo		07:09
*** egafford has quit IRC		07:10
*** egafford1 has joined #rdo		07:10
apevec	amoralej, so we don't have local reproducer?	07:10
amoralej	do you know if trown\|outtypewww had any luck reproducing it win tro-cloud?	07:10
*** egafford1 has quit IRC		07:10
*** egafford has joined #rdo		07:10
apevec	amoralej, last I saw, he did not	07:10
amoralej	apevec, no, i need to patch tripleo-ci to not destroy the environment and hold the nodepool node	07:11
amoralej	we need someone from infra	07:11
*** egafford has quit IRC		07:11
*** egafford1 has joined #rdo		07:11
apevec	amoralej, what about changing oooq job to match tripleoci env?	07:11
apevec	oooq ovb we can run on rdocloud, there is devmode, right?	07:11
*** egafford1 has quit IRC		07:11
*** egafford has joined #rdo		07:11
*** sbulage has joined #rdo		07:11
amoralej	yes	07:11
*** egafford has quit IRC		07:12
*** egafford has joined #rdo		07:12
amoralej	let me try to figure out how to do it	07:12
*** egafford has quit IRC		07:12
*** egafford1 has joined #rdo		07:13
*** higgins has joined #rdo		07:13
*** egafford1 has quit IRC		07:13
*** egafford has joined #rdo		07:13
amoralej	but i could spend 4 hours and not reproduce it... that's why i think getting a env in tripleoci is the better option	07:14
*** egafford has quit IRC		07:14
*** egafford1 has joined #rdo		07:14
*** egafford1 has quit IRC		07:14
*** egafford has joined #rdo		07:14
*** egafford has quit IRC		07:15
*** egafford1 has joined #rdo		07:15
EmilienM	amoralej: I agree it would help	07:15
*** egafford1 has quit IRC		07:15
*** egafford has joined #rdo		07:15
EmilienM	amoralej: can't we try to downgrade neutron-lib and python2-pyroute quickly? and run the jobs? we could have results in ~2h30	07:16
*** egafford has quit IRC		07:16
*** egafford has joined #rdo		07:16
EmilienM	by then infra folks will be awake probably, and we could work on holding environments	07:16
EmilienM	I'm afk 20 min from now.	07:16
*** egafford has quit IRC		07:16
*** egafford has joined #rdo		07:17
*** egafford has quit IRC		07:17
*** egafford1 has joined #rdo		07:17
*** ihrachys has quit IRC		07:17
*** egafford1 has quit IRC		07:17
*** egafford has joined #rdo		07:18
*** egafford has quit IRC		07:18
*** egafford1 has joined #rdo		07:18
amoralej	EmilienM, apevec, i'm going to prepare a test repo in trunk.rdoproject.org	07:18
*** pgadiya has joined #rdo		07:18
amoralej	manually	07:18
*** egafford1 has quit IRC		07:19
amoralej	and modify https://review.openstack.org/#/c/471361/5/scripts/tripleo.sh to use it	07:19
*** egafford has joined #rdo		07:19
amoralej	with previous pyroute and neutron-lib	07:19
*** jackNemrod has quit IRC		07:19
amoralej	apevec, ^ wdyt?	07:19
*** egafford has quit IRC		07:19
*** egafford1 has joined #rdo		07:19
*** egafford has joined #rdo		07:20
*** egafford1 has joined #rdo		07:20
*** egafford has quit IRC		07:20
*** egafford1 has quit IRC		07:21
*** egafford has joined #rdo		07:21
*** egafford has quit IRC		07:21
*** egafford1 has joined #rdo		07:21
apevec	amoralej, you would need yum prio to get older versions	07:22
*** egafford has joined #rdo		07:22
apevec	don't want to introduce Epoch...	07:22
*** egafford has quit IRC		07:23
*** egafford1 has joined #rdo		07:23
*** egafford1 has quit IRC		07:23
*** egafford has joined #rdo		07:23
amoralej	apevec, not	07:23
amoralej	i'll create a new repo in a directory test-neutron	07:23
amoralej	and replace packages	07:23
amoralej	and do createrepo	07:23
*** egafford has quit IRC		07:24
*** egafford1 has joined #rdo		07:24
*** egafford1 has quit IRC		07:24
*** egafford has joined #rdo		07:24
*** links has joined #rdo		07:24
*** egafford1 has joined #rdo		07:25
*** egafford has quit IRC		07:25
*** egafford1 has quit IRC		07:25
*** egafford has joined #rdo		07:25
*** egafford1 has joined #rdo		07:26
*** egafford has quit IRC		07:26
*** egafford1 has quit IRC		07:27
*** egafford has joined #rdo		07:27
*** egafford has quit IRC		07:28
*** egafford1 has joined #rdo		07:28
*** _bsurfer_ has joined #rdo		07:28
*** egafford1 has quit IRC		07:28
*** egafford has joined #rdo		07:28
*** egafford has quit IRC		07:29
*** egafford1 has joined #rdo		07:29
*** egafford1 has quit IRC		07:29
*** egafford has joined #rdo		07:29
*** jpena\|off is now known as jpena		07:30
*** egafford has quit IRC		07:30
*** egafford1 has joined #rdo		07:30
*** egafford1 has quit IRC		07:30
*** egafford has joined #rdo		07:30
EmilienM	amoralej: it's an excellent idea	07:30
*** egafford has quit IRC		07:31
*** egafford1 has joined #rdo		07:31
jpena	good morning	07:31
*** egafford1 has quit IRC		07:31
*** egafford has joined #rdo		07:31
*** jackNemrod has joined #rdo		07:32
*** egafford has quit IRC		07:32
*** egafford1 has joined #rdo		07:33
*** milan has quit IRC		07:33
*** egafford1 has quit IRC		07:33
*** egafford has joined #rdo		07:33
*** egafford has quit IRC		07:34
*** egafford1 has joined #rdo		07:34
*** egafford1 has quit IRC		07:34
*** egafford has joined #rdo		07:34
*** number80 has quit IRC		07:34
*** egafford has quit IRC		07:35
*** egafford1 has joined #rdo		07:35
*** jackNemrod_ has joined #rdo		07:35
*** egafford1 has quit IRC		07:35
*** egafford has joined #rdo		07:35
*** egafford has quit IRC		07:36
*** egafford has joined #rdo		07:36
*** jackNemrod has quit IRC		07:36
*** jackNemrod_ is now known as jackNemrod		07:36
*** egafford has quit IRC		07:36
rdogerrit	Merged config master: Remove references to rdopkg in sanity-check exclusions https://review.rdoproject.org/r/7003	07:36
*** egafford1 has joined #rdo		07:36
*** egafford1 has quit IRC		07:37
*** egafford has joined #rdo		07:37
*** number80 has joined #rdo		07:37
*** egafford has quit IRC		07:37
*** egafford1 has joined #rdo		07:38
*** egafford1 has quit IRC		07:38
*** egafford has joined #rdo		07:38
*** egafford1 has joined #rdo		07:39
*** egafford has quit IRC		07:39
*** tumble has quit IRC		07:39
*** egafford1 has quit IRC		07:39
*** egafford has joined #rdo		07:39
*** egafford has quit IRC		07:40
*** egafford1 has joined #rdo		07:40
*** egafford1 has quit IRC		07:40
*** egafford has joined #rdo		07:40
*** egafford has quit IRC		07:41
*** egafford has joined #rdo		07:41
*** egonzalez has joined #rdo		07:41
*** egafford has quit IRC		07:41
*** egafford1 has joined #rdo		07:41
*** anshulbehl has joined #rdo		07:42
*** egafford1 has quit IRC		07:42
*** egafford has joined #rdo		07:42
*** egafford has quit IRC		07:42
*** egafford has joined #rdo		07:43
*** egafford1 has joined #rdo		07:43
*** egafford has quit IRC		07:43
*** egafford1 has quit IRC		07:44
*** egafford has joined #rdo		07:44
*** egafford has quit IRC		07:44
*** egafford1 has joined #rdo		07:44
*** egafford1 has quit IRC		07:45
*** egafford has joined #rdo		07:45
*** egafford has quit IRC		07:45
*** egafford1 has joined #rdo		07:45
*** jlibosva has joined #rdo		07:46
*** egafford1 has quit IRC		07:46
*** egafford has joined #rdo		07:46
*** egafford has quit IRC		07:46
*** egafford1 has joined #rdo		07:46
*** egafford1 has quit IRC		07:47
*** egafford has joined #rdo		07:47
*** karimb has joined #rdo		07:47
*** egafford has quit IRC		07:47
*** egafford has joined #rdo		07:48
*** egafford has quit IRC		07:48
*** egafford1 has joined #rdo		07:48
*** egafford1 has quit IRC		07:49
*** egafford has joined #rdo		07:49
*** cylopez has joined #rdo		07:49
*** egafford has quit IRC		07:49
*** egafford1 has joined #rdo		07:49
*** egafford1 has quit IRC		07:50
*** egafford has joined #rdo		07:50
*** egafford has quit IRC		07:50
*** egafford1 has joined #rdo		07:50
*** egafford1 has quit IRC		07:51
*** egafford has joined #rdo		07:51
*** mandre is now known as mandre\|away		07:51
*** egafford1 has joined #rdo		07:51
*** egafford has quit IRC		07:51
*** egafford1 has quit IRC		07:52
*** egafford has joined #rdo		07:52
*** egafford has quit IRC		07:52
*** egafford has joined #rdo		07:53
*** egafford has quit IRC		07:53
*** egafford1 has joined #rdo		07:53
*** egafford1 has quit IRC		07:54
*** egafford has joined #rdo		07:54
*** egafford has quit IRC		07:54
*** egafford1 has joined #rdo		07:54
*** egafford1 has quit IRC		07:55
*** egafford has joined #rdo		07:55
*** jpich has joined #rdo		07:55
*** egafford has quit IRC		07:55
*** egafford has joined #rdo		07:55
*** egafford has quit IRC		07:56
*** egafford1 has joined #rdo		07:56
*** egafford1 has quit IRC		07:56
*** egafford has joined #rdo		07:56
*** egafford has quit IRC		07:57
*** egafford1 has joined #rdo		07:57
*** Jack_Iv has quit IRC		07:57
*** egafford1 has quit IRC		07:57
*** egafford has joined #rdo		07:58
*** egafford has quit IRC		07:58
*** egafford1 has joined #rdo		07:58
*** egafford1 has quit IRC		07:59
*** egafford has joined #rdo		07:59
*** egafford has quit IRC		07:59
*** egafford has joined #rdo		07:59
*** Son_Goku has joined #rdo		08:00
*** egafford has quit IRC		08:00
*** egafford1 has joined #rdo		08:00
*** egafford1 has quit IRC		08:00
*** egafford has joined #rdo		08:00
*** egafford has quit IRC		08:01
*** egafford1 has joined #rdo		08:01
*** egafford1 has quit IRC		08:01
*** egafford has joined #rdo		08:01
*** limao has quit IRC		08:02
*** egafford has quit IRC		08:02
*** egafford1 has joined #rdo		08:02
*** egafford1 has quit IRC		08:02
*** egafford has joined #rdo		08:03
*** mfedosin has joined #rdo		08:03
*** egafford has quit IRC		08:03
*** egafford1 has joined #rdo		08:03
*** egafford1 has quit IRC		08:04
amoralej	EmilienM, apevec, running	08:04
*** egafford has joined #rdo		08:04
*** egafford has quit IRC		08:04
EmilienM	amoralej: yeah	08:04
*** egafford1 has joined #rdo		08:04
amoralej	https://review.openstack.org/#/c/471361	08:04
*** limao has joined #rdo		08:04
EmilienM	it's already in experimental pipeline	08:05
EmilienM	gate-tripleo-ci-centos-7-ovb-ha is queued though	08:05
EmilienM	I'll kill some other jobs to trigger it	08:05
*** jbadiapa_ has joined #rdo		08:05
amoralej	nonha started so the queue must be short...	08:05
*** egafford1 has quit IRC		08:05
*** egafford has joined #rdo		08:05
amoralej	going for a coffe	08:05
*** egafford has quit IRC		08:06
*** egafford1 has joined #rdo		08:06
*** egafford1 has quit IRC		08:06
*** egafford has joined #rdo		08:06
*** mcornea has joined #rdo		08:07
*** egafford has quit IRC		08:07
*** egafford1 has joined #rdo		08:07
EmilienM	amoralej: yeah it started	08:07
*** egafford1 has quit IRC		08:07
*** egafford has joined #rdo		08:08
*** cylopez has quit IRC		08:09
*** egafford has quit IRC		08:09
*** egafford1 has joined #rdo		08:09
*** egafford1 has quit IRC		08:09
*** egafford has joined #rdo		08:09
*** egafford has quit IRC		08:10
*** egafford1 has joined #rdo		08:10
*** egafford1 has quit IRC		08:10
*** egafford has joined #rdo		08:10
*** egafford1 has joined #rdo		08:11
*** lucas-afk is now known as lucasagomes		08:11
*** egafford1 has quit IRC		08:11
*** egafford has joined #rdo		08:12
*** egafford has quit IRC		08:12
*** egafford1 has joined #rdo		08:12
rdogerrit	Matthias Runge created config master: Add more packages to build automatically https://review.rdoproject.org/r/7037	08:12
*** egafford has joined #rdo		08:13
*** egafford1 has quit IRC		08:13
*** egafford has quit IRC		08:13
*** egafford1 has joined #rdo		08:13
*** egafford1 has quit IRC		08:14
*** egafford has joined #rdo		08:14
*** egafford1 has joined #rdo		08:14
*** egafford has quit IRC		08:14
*** Son_Goku has quit IRC		08:14
*** egafford has joined #rdo		08:15
*** egafford1 has quit IRC		08:15
*** dbecker has joined #rdo		08:15
*** egafford has quit IRC		08:15
*** egafford has joined #rdo		08:15
*** egafford has quit IRC		08:16
*** egafford1 has joined #rdo		08:16
*** egafford1 has quit IRC		08:16
*** egafford has joined #rdo		08:17
*** egafford has quit IRC		08:17
*** egafford1 has joined #rdo		08:17
*** egafford1 has quit IRC		08:17
*** egafford has joined #rdo		08:18
*** egafford has quit IRC		08:18
*** egafford1 has joined #rdo		08:18
*** egafford1 has quit IRC		08:19
*** egafford has joined #rdo		08:19
*** iranzo_ has joined #rdo		08:19
*** egafford has quit IRC		08:19
*** egafford1 has joined #rdo		08:19
*** iranzo has quit IRC		08:19
*** egafford1 has quit IRC		08:20
*** egafford has joined #rdo		08:20
*** iranzo_ is now known as iranzo		08:20
*** egafford has quit IRC		08:20
*** egafford1 has joined #rdo		08:20
*** qwerty has joined #rdo		08:21
*** egafford1 has quit IRC		08:21
*** egafford has joined #rdo		08:21
*** egafford has quit IRC		08:21
*** egafford1 has joined #rdo		08:21
*** egafford1 has quit IRC		08:22
*** egafford has joined #rdo		08:22
*** egafford has quit IRC		08:23
*** egafford1 has joined #rdo		08:23
*** egafford1 has quit IRC		08:23
*** egafford has joined #rdo		08:23
*** egafford has quit IRC		08:24
*** egafford1 has joined #rdo		08:24
*** egafford1 has quit IRC		08:24
*** egafford has joined #rdo		08:24
*** egafford has quit IRC		08:25
*** egafford1 has joined #rdo		08:25
*** egafford has joined #rdo		08:25
*** egafford1 has quit IRC		08:25
*** panda\|off is now known as panda		08:26
*** pgadiya has quit IRC		08:26
*** egafford has quit IRC		08:26
*** egafford1 has joined #rdo		08:26
*** dbecker has quit IRC		08:26
*** egafford has joined #rdo		08:27
*** egafford1 has quit IRC		08:27
*** egafford1 has joined #rdo		08:28
*** egafford has quit IRC		08:28
*** egafford has joined #rdo		08:28
*** egafford1 has quit IRC		08:28
*** dgurtner has quit IRC		08:28
*** egafford has quit IRC		08:29
*** egafford1 has joined #rdo		08:29
*** egafford1 has quit IRC		08:29
*** dgurtner has joined #rdo		08:29
*** dgurtner has joined #rdo		08:29
*** egafford has joined #rdo		08:29
*** egafford has quit IRC		08:30
*** egafford1 has joined #rdo		08:30
*** egafford1 has quit IRC		08:30
*** egafford has joined #rdo		08:30
*** egafford has quit IRC		08:31
*** egafford has joined #rdo		08:31
*** egafford has quit IRC		08:32
*** egafford1 has joined #rdo		08:32
*** egafford1 has quit IRC		08:33
*** egafford has joined #rdo		08:33
*** egafford1 has joined #rdo		08:35
*** egafford1 has quit IRC		08:35
*** egafford has quit IRC		08:35
*** egafford2 has joined #rdo		08:35
*** fragatina has joined #rdo		08:35
*** egafford2 has quit IRC		08:35
*** egafford has joined #rdo		08:35
*** egafford has quit IRC		08:36
*** egafford1 has joined #rdo		08:36
*** _bsurfer_ has quit IRC		08:36
*** egafford1 has quit IRC		08:36
*** egafford has joined #rdo		08:37
*** egafford1 has joined #rdo		08:37
*** egafford has quit IRC		08:37
*** egafford has joined #rdo		08:38
*** egafford has quit IRC		08:38
*** egafford1 has quit IRC		08:38
*** egafford2 has joined #rdo		08:38
*** qwerty has quit IRC		08:38
*** egafford2 has quit IRC		08:39
*** egafford has joined #rdo		08:39
*** cylopez has joined #rdo		08:39
*** egafford has quit IRC		08:39
*** egafford1 has joined #rdo		08:39
*** egafford has joined #rdo		08:40
*** egafford1 has quit IRC		08:40
*** egafford has quit IRC		08:40
*** egafford1 has joined #rdo		08:40
*** fragatina has quit IRC		08:40
*** qwerty has joined #rdo		08:41
*** egafford1 has quit IRC		08:41
*** egafford has joined #rdo		08:41
*** fragatina has joined #rdo		08:41
*** egafford has quit IRC		08:41
*** egafford1 has joined #rdo		08:41
*** egafford1 has quit IRC		08:42
*** egallen has joined #rdo		08:42
*** egafford has joined #rdo		08:42
*** egafford1 has joined #rdo		08:43
*** egafford has quit IRC		08:43
*** zoli\|gone is now known as zoli		08:43
*** egafford1 has quit IRC		08:43
*** egafford has joined #rdo		08:43
*** egafford has quit IRC		08:44
*** egafford1 has joined #rdo		08:44
*** egafford1 has quit IRC		08:44
*** egafford has joined #rdo		08:44
*** egafford1 has joined #rdo		08:45
*** egafford has quit IRC		08:45
*** egafford1 has quit IRC		08:45
*** egafford has joined #rdo		08:45
*** egafford has quit IRC		08:46
*** egafford1 has joined #rdo		08:46
*** tosky has joined #rdo		08:46
*** derekh has joined #rdo		08:47
*** egafford has joined #rdo		08:47
*** egafford2 has joined #rdo		08:47
*** egafford1 has quit IRC		08:47
*** _bsurfer_ has joined #rdo		08:47
*** egafford2 has quit IRC		08:47
*** egafford has joined #rdo		08:48
amoralej	apevec, EmilienM, i'm analysing logs and i've realized that in glance every request that send a notification (create a image, etc...) takes exactly ~60 seconds	08:48
*** egafford has quit IRC		08:48
amoralej	i think it's not a neutron problem	08:48
*** egafford1 has joined #rdo		08:48
amoralej	although some change in neutron may have make it more sensitive to it	08:48
*** dtantsur\|sick is now known as dtantsur		08:48
EmilienM	amoralej: maybe 2 problems	08:48
amoralej	messaging heartbeat timeout is 60 seconds	08:48
amoralej	nop	08:49
*** egafford1 has quit IRC		08:49
*** egafford has joined #rdo		08:49
EmilienM	ah so messaging would be so busy that neutron wouldn't have time	08:49
amoralej	EmilienM, the timeout in the subnet-create is because it sends two messages	08:49
*** egafford1 has joined #rdo		08:49
*** egafford has quit IRC		08:49
amoralej	no, i think there is some weird network problem	08:50
*** egafford has joined #rdo		08:50
*** egafford1 has quit IRC		08:50
amoralej	in the oooq-ha jobs it doesn't happen	08:50
*** egafford has quit IRC		08:50
*** egafford1 has joined #rdo		08:50
EmilienM	amoralej: maybe https://github.com/openstack/glance/commit/8f9353d232d8541958e6e0363e7ac8618d5317b0 ?	08:51
*** egafford1 has quit IRC		08:51
*** egafford has joined #rdo		08:51
amoralej	EmilienM, glance takes 60 seconds to send a message. neutron takes 60 seconds to send a message	08:51
amoralej	maybe the problem is not in glance nor neutron	08:51
*** egafford has quit IRC		08:51
*** egafford1 has joined #rdo		08:51
EmilienM	oslo.messaging?	08:52
amoralej	yes, i was thinking in that	08:52
EmilienM	sileht: do you have a moment?	08:52
amoralej	we bumped from 5.24.1 to 5.24.2	08:52
sileht	EmilienM, sure	08:52
*** egafford1 has quit IRC		08:52
*** egafford has joined #rdo		08:52
amoralej	but i don't see anyt suspictius change	08:52
*** egafford has quit IRC		08:53
EmilienM	sileht: we're debugging the same problem since days	08:53
*** egafford1 has joined #rdo		08:53
EmilienM	sileht: which is blocking promotion	08:53
amoralej	in fact, glance has been taking that long before we noticed the issue in neutron	08:53
*** egafford1 has quit IRC		08:53
EmilienM	amoralej: maybe related to https://github.com/redhat-openstack/rdoinfo/commit/44e0a03d1cf696a1ef80bd1dc4a9e9003e9d547a	08:53
amoralej	maybe something in neutron uncovered an underlying problem	08:53
*** egafford has joined #rdo		08:53
amoralej	no, i checked	08:53
amoralej	we are using the right version	08:53
EmilienM	sileht: https://bugs.launchpad.net/tripleo/+bug/1696094	08:53
openstack	Launchpad bug 1696094 in tripleo "CI: ovb-ha promotion job fails with 504 gateway timeout, neutron-server create-subnet timing out" [Critical,Triaged]	08:53
amoralej	5.24.2	08:53
*** egafford has quit IRC		08:54
amoralej	or you mean that we may need 5.25.0?	08:54
*** egafford has joined #rdo		08:54
EmilienM	amoralej: yeah maybe?	08:54
EmilienM	let me look what openstack deploys	08:54
amoralej	the problem is that mistral doesn't work	08:54
amoralej	mmmm	08:54
amoralej	i don't know if it's fixed	08:54
amoralej	that's why we had to revert	08:54
d0ugal	What's broken with Mistral?	08:54
d0ugal	Can I help?	08:54
amoralej	mistral + oslo.messaging > 5.25.0	08:55
EmilienM	oslo.messaging>=5.24.2,!=5.25.0 # Apache-2.0	08:55
d0ugal	aha, gotcha	08:55
*** egafford has quit IRC		08:55
d0ugal	We are waiting for oslo.messaging release	08:55
*** egafford has joined #rdo		08:55
amoralej	there has been a new 5.26.0	08:55
d0ugal	because fixing in Mistral is going to be very hard	08:55
amoralej	but it was still failing d0ugal	08:55
*** egafford has quit IRC		08:55
d0ugal	amoralej: 5.26.0 is the one that broke Mistral AFAIK	08:55
*** egafford1 has joined #rdo		08:55
*** qwerty has quit IRC		08:55
*** Poornima_K has joined #rdo		08:56
d0ugal	so an older oslo.messaging should work	08:56
amoralej	5.25 broke it	08:56
*** Poornima_K has quit IRC		08:56
*** egafford1 has quit IRC		08:56
amoralej	yeah, that's what we did d0ugal	08:56
*** egafford has joined #rdo		08:56
EmilienM	we have 5.24.2 in RDO now, right?	08:56
amoralej	but we were thinking if we are missing some fix which is in newer releases	08:56
amoralej	yes	08:56
EmilienM	should we try 5.24.1?	08:56
*** liangbo has quit IRC		08:56
EmilienM	or try out the latest commit	08:56
d0ugal	Right, 5.26.0 doesn't have the fix we need	08:56
*** egafford has quit IRC		08:56
d0ugal	AFAIK it isn't even merged yet :(	08:56
d0ugal	https://review.openstack.org/#/c/469806/	08:57
*** egafford1 has joined #rdo		08:57
*** nstrug has joined #rdo		08:57
*** egafford1 has quit IRC		08:57
amoralej	EmilienM, let's see how current test goes	08:57
*** egafford has joined #rdo		08:57
*** egafford has quit IRC		08:58
*** egafford has joined #rdo		08:58
*** egafford has quit IRC		08:58
*** egafford1 has joined #rdo		08:58
*** egafford1 has quit IRC		08:59
*** egafford has joined #rdo		08:59
*** egafford has quit IRC		08:59
*** egafford1 has joined #rdo		08:59
EmilienM	sileht: if you want to see logs: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/17a5be4/console.html#_2017-06-09_08_25_04_079953	09:00
*** egafford1 has quit IRC		09:00
*** egafford has joined #rdo		09:00
*** dalvarezs is now known as dalvarez		09:00
EmilienM	sileht: the error in neutron: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/17a5be4/logs/controller-0-tripleo-ci-a-foo/var/log/neutron/server.txt.gz#_2017-06-09_08_25_04_981	09:00
*** egafford has quit IRC		09:00
*** egafford has joined #rdo		09:00
amoralej	sileht, summary, it seems that every time a service need to send a notification, it takes exactly 60 seconds	09:01
*** egafford has quit IRC		09:01
*** egafford1 has joined #rdo		09:01
amoralej	we've seen it in glance and neutron	09:01
amoralej	neutron subnet-create fails because it sends 2 notifications and timeout is 120 seconds	09:01
*** egafford1 has quit IRC		09:01
EmilienM	do we have 60 in config?	09:01
*** egafford has joined #rdo		09:01
amoralej	rabbit heartbit timeout is 60 seconds	09:02
EmilienM	#rpc_queue_expiration = 60	09:02
*** egafford has quit IRC		09:02
sileht	what the eventlet version ?	09:02
*** egafford has joined #rdo		09:02
EmilienM	#pool_stale = 60	09:02
*** egafford has quit IRC		09:03
EmilienM	python2-eventlet-0.20.1-1.el7.noarch	09:03
EmilienM	sileht: ^	09:03
*** egafford has joined #rdo		09:03
*** egafford1 has joined #rdo		09:03
*** egafford has quit IRC		09:03
mrunge	what's the story with paunch currently?	09:04
*** egafford1 has quit IRC		09:04
*** egafford has joined #rdo		09:04
mrunge	I've been hit by python-pip not available, while trying to deploy a containerized deployment	09:04
*** egafford has quit IRC		09:04
*** egafford has joined #rdo		09:04
mrunge	https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-steps.j2#L144	09:04
*** egafford has quit IRC		09:05
*** egafford1 has joined #rdo		09:05
amoralej	EmilienM, sileht, an interesting fact is that oooq-ha works fine	09:05
*** egafford1 has quit IRC		09:05
amoralej	and has exactly the same package versions	09:05
amoralej	http://logs.openstack.org/85/471485/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/c58a23b/	09:05
*** sbulage has quit IRC		09:05
*** egafford has joined #rdo		09:05
sileht	what oooq is ? /me tripleo newbie	09:06
*** egafford has quit IRC		09:06
*** egafford1 has joined #rdo		09:06
amoralej	tripleo-quickstart	09:06
amoralej	we run tripleo jobs with two different frameworks	09:06
*** egafford1 has quit IRC		09:06
*** egafford has joined #rdo		09:07
*** egafford has quit IRC		09:07
EmilienM	amoralej: with the EXACT same packages?	09:07
*** egafford1 has joined #rdo		09:07
EmilienM	have we compared really?	09:07
amoralej	same pyroute2, neutron-lib, eventlet, etc...	09:08
*** egafford1 has quit IRC		09:08
*** egafford has joined #rdo		09:08
amoralej	probably some different packages because it's a differnt hash	09:08
amoralej	EmilienM, i can use the same exact repo	09:08
EmilienM	the problem is if we promote now, and we break ovb-oooq-ha, we're doomed	09:08
EmilienM	unpromote is hard AFIK	09:08
*** limao has quit IRC		09:08
*** egafford1 has joined #rdo		09:09
*** egafford has quit IRC		09:09
*** egafford1 has quit IRC		09:09
*** egafford has joined #rdo		09:09
*** egafford has quit IRC		09:10
*** egafford1 has joined #rdo		09:10
*** egafford1 has quit IRC		09:10
*** egafford has joined #rdo		09:10
amoralej	EmilienM, i think https://review.openstack.org/#/c/471485/ is working fine	09:10
amoralej	we can set a repo there	09:11
*** egafford has quit IRC		09:11
*** egafford1 has joined #rdo		09:11
*** egafford1 has quit IRC		09:12
*** egafford has joined #rdo		09:12
EmilienM	amoralej: it's failing on scenario001, let me check	09:12
*** egafford has quit IRC		09:12
*** egafford1 has joined #rdo		09:12
amoralej	EmilienM, i'm checking gate-tripleo-ci-centos-7-ovb-ha-oooq job	09:12
*** egafford1 has quit IRC		09:13
*** egafford has joined #rdo		09:13
EmilienM	on pingtest: http://logs.openstack.org/85/471485/5/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/ab9a204/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-06-08_11_04_41	09:13
amoralej	heat	09:13
*** egafford has quit IRC		09:13
*** egafford1 has joined #rdo		09:13
*** mcornea has quit IRC		09:13
*** limao has joined #rdo		09:13
amoralej	but note that network-create and subnet-create took seconds	09:13
*** limao has quit IRC		09:14
*** mcornea has joined #rdo		09:14
EmilienM	yeah	09:14
EmilienM	mhh	09:14
EmilienM	if we do that, we might break scenario001	09:14
EmilienM	can we recheck?	09:14
*** limao has joined #rdo		09:14
*** egafford has joined #rdo		09:14
EmilienM	I'm going to test this repo on other scenarios too	09:15
amoralej	but with consistent or with the neutron-test repo?	09:15
amoralej	what would be better?	09:15
*** egafford1 has quit IRC		09:15
*** egafford1 has joined #rdo		09:15
amoralej	maybe we can use the temporary repo to ensure we are using exactly the same packages	09:15
*** egafford1 has quit IRC		09:15
*** egafford2 has joined #rdo		09:15
*** egafford has quit IRC		09:15
EmilienM	amoralej: see https://review.openstack.org/#/c/461000/	09:16
*** limao has quit IRC		09:16
*** egafford2 has quit IRC		09:16
*** egafford has joined #rdo		09:16
EmilienM	amoralej: +1 for temp repo	09:16
EmilienM	we'll need an easy way to test rollback in CI	09:16
*** egafford has quit IRC		09:16
rdogerrit	Yatin Karel created rdo-infra/ci-config master: Delete Floating IP when destroying VM https://review.rdoproject.org/r/7038	09:17
*** egafford has joined #rdo		09:17
EmilienM	amoralej: I need to drop off now, to catch a train and I'm supposed to be on PTO but i'll be back online in 1h	09:17
jpena	apevec: I've found a funny issue when bootstrapping the workers in the staging dlrn instance in RDO Cloud	09:17
*** sbulage has joined #rdo		09:17
*** egafford1 has joined #rdo		09:18
*** egafford has quit IRC		09:18
*** fzdarsky_ is now known as fzdarsky		09:18
*** egafford1 has quit IRC		09:18
*** egafford has joined #rdo		09:18
*** egafford1 has joined #rdo		09:19
*** egafford has quit IRC		09:19
*** egafford1 has quit IRC		09:19
*** egafford has joined #rdo		09:19
*** egafford has quit IRC		09:20
*** egafford has joined #rdo		09:20
*** ltomasbo is now known as ltomasbo\|away		09:20
*** egafford has quit IRC		09:20
*** egafford1 has joined #rdo		09:21
*** egafford has joined #rdo		09:21
*** egafford1 has quit IRC		09:21
*** egafford has quit IRC		09:22
*** egafford1 has joined #rdo		09:22
*** ltomasbo\|away is now known as ltomasbo		09:22
*** egafford1 has quit IRC		09:22
*** egafford has joined #rdo		09:22
*** Son_Goku has joined #rdo		09:22
*** egafford1 has joined #rdo		09:23
*** egafford has quit IRC		09:23
*** mandre\|away is now known as mandre		09:23
*** egafford1 has quit IRC		09:24
*** egafford has joined #rdo		09:24
*** egafford has quit IRC		09:24
*** egafford1 has joined #rdo		09:25
*** egafford has joined #rdo		09:25
*** egafford1 has quit IRC		09:25
*** egafford has quit IRC		09:25
*** egafford1 has joined #rdo		09:25
*** egafford1 has quit IRC		09:26
*** egafford has joined #rdo		09:26
*** egafford has quit IRC		09:26
*** egafford1 has joined #rdo		09:27
*** egafford1 has quit IRC		09:27
*** egafford has joined #rdo		09:27
*** dgurtner has quit IRC		09:27
*** qwerty has joined #rdo		09:27
*** egafford has quit IRC		09:28
*** egafford has joined #rdo		09:28
*** egafford has quit IRC		09:28
*** cylopez has quit IRC		09:28
*** egafford has joined #rdo		09:28
*** florianf has quit IRC		09:28
*** egafford has quit IRC		09:29
*** egafford1 has joined #rdo		09:29
*** dbecker has joined #rdo		09:29
*** egafford1 has quit IRC		09:29
*** egafford has joined #rdo		09:29
number80	jpena, amoralej: please review https://review.rdoproject.org/r/#/c/7038/	09:30
*** egafford has quit IRC		09:30
*** egafford1 has joined #rdo		09:30
*** egafford1 has quit IRC		09:30
*** egafford has joined #rdo		09:30
*** egafford has quit IRC		09:31
*** egafford1 has joined #rdo		09:31
*** egafford1 has quit IRC		09:31
*** egafford has joined #rdo		09:31
*** egafford has quit IRC		09:32
*** egafford1 has joined #rdo		09:32
rdogerrit	Merged rdo-infra/ci-config master: Delete Floating IP when destroying VM https://review.rdoproject.org/r/7038	09:32
*** egafford1 has quit IRC		09:33
*** egafford has joined #rdo		09:33
*** qwerty has quit IRC		09:33
*** egafford has quit IRC		09:33
*** egafford has joined #rdo		09:33
*** cylopez has joined #rdo		09:33
mandre	cschwede: hi! do you think we can close https://bugzilla.redhat.com/show_bug.cgi?id=1382921?	09:34
openstack	bugzilla.redhat.com bug 1382921 in openstack-swift "swift-object-expirer packaged in wrong package" [High,New] - Assigned to tshefi	09:34
*** egafford has quit IRC		09:34
*** egafford1 has joined #rdo		09:34
cschwede	mandre: Hi! Yes, I think so. I'll close it right now	09:34
*** egafford1 has quit IRC		09:35
*** egafford has joined #rdo		09:35
*** zoli is now known as zoli\|lunch		09:35
*** egafford has quit IRC		09:35
*** egafford1 has joined #rdo		09:35
mandre	cschwede: perfect, thanks! one kolla reviewer asked for the resolution of the bug before merging a comment cleanup in the dockerfile	09:36
*** Son_Goku has quit IRC		09:36
*** egafford1 has quit IRC		09:36
*** egafford has joined #rdo		09:36
*** egafford has quit IRC		09:37
*** egafford has joined #rdo		09:37
cschwede	mandre: ah, ok - i was already wondering where the interest the last two days came from :)	09:37
*** egafford has quit IRC		09:37
*** egafford1 has joined #rdo		09:37
*** egafford1 has quit IRC		09:38
*** egafford has joined #rdo		09:38
*** egafford1 has joined #rdo		09:38
*** egafford has quit IRC		09:38
*** egafford has joined #rdo		09:39
*** egafford1 has quit IRC		09:39
mandre	cschwede: I think it all started with jschlueter wondering why they build a swift-object-expirer downstream while we're not using the image upstream, and why we used swift-proxy instead	09:39
*** egafford has quit IRC		09:39
*** egafford has joined #rdo		09:40
*** milan has joined #rdo		09:40
*** egafford has quit IRC		09:40
*** egafford1 has joined #rdo		09:40
*** egafford has joined #rdo		09:41
*** egafford1 has quit IRC		09:41
*** egafford has quit IRC		09:41
*** egafford1 has joined #rdo		09:42
apevec	jpena, what was the fun in bootstraping dlnr?	09:42
*** egafford1 has quit IRC		09:42
*** egafford has joined #rdo		09:42
apevec	dlrn!	09:42
*** egafford has quit IRC		09:43
*** egafford has joined #rdo		09:43
apevec	egafford, I think we'll kick you off the channel, you're bouncing a lot, sorry!	09:43
jpena	apevec: python-keystoneclient fails to build. The issue is that the current tagged version (3.10.0) is way too old, and it needs some later fixes to cope with some requirement updates	09:43
*** karthiks is now known as karthiks_afk		09:43
*** egafford has quit IRC		09:43
jpena	the last release dates back to Ocata. I thought there should have been some Pike release :-?	09:43
*** egafford has joined #rdo		09:43
*** florianf has joined #rdo		09:44
*** egafford has quit IRC		09:44
*** egafford has joined #rdo		09:44
apevec	hmm upstream u-c has 3.10.0	09:44
*** egafford1 has joined #rdo		09:44
*** egafford has quit IRC		09:44
*** egafford1 has quit IRC		09:45
*** egafford has joined #rdo		09:45
jpena	apevec: I've reproduced it outside dlrn. Just git clone, git checkout 3.10.0 and tox -epy27 fails	09:45
apevec	official deadline for final releases of client libs is pike3, but waiting that long is bad	09:45
jpena	I'm asking at #openstack-keystone, but no response so far	09:45
*** egafford has quit IRC		09:45
*** jackNemrod has quit IRC		09:45
*** egafford has joined #rdo		09:45
apevec	but indeed there's no keystoneclient release on https://releases.openstack.org/pike/	09:46
*** egafford has quit IRC		09:46
*** egafford has joined #rdo		09:46
chandankumar	amoralej: apevec number80 can we get these merged https://softwarefactory-project.io/r/8473 and https://softwarefactory-project.io/r/8139	09:46
apevec	jpena, raise it on openstack-dev with [release][keystone] tags and CC dhellmann	09:46
*** egafford has quit IRC		09:46
jpena	apevec: ack	09:47
*** egafford1 has joined #rdo		09:47
* number80 looks		09:47
*** egafford1 has quit IRC		09:47
*** egafford has joined #rdo		09:47
*** egafford has quit IRC		09:48
*** egafford has joined #rdo		09:48
*** egafford1 has joined #rdo		09:48
*** egafford has quit IRC		09:48
*** egafford1 has quit IRC		09:49
*** egafford has joined #rdo		09:49
*** vnogin has joined #rdo		09:49
*** egafford has quit IRC		09:49
*** egafford has joined #rdo		09:49
*** egafford has quit IRC		09:50
*** egafford has joined #rdo		09:50
*** jprovazn has quit IRC		09:50
number80	chandankumar: merging the doc change as there's no disagreement and current doc is pointing to an incorrect url, babel change needs second opinion	09:50
*** egafford has quit IRC		09:50
*** egafford1 has joined #rdo		09:50
*** athomas has joined #rdo		09:51
*** links has quit IRC		09:51
*** egafford1 has quit IRC		09:51
*** egafford has joined #rdo		09:51
*** egafford has quit IRC		09:51
*** egafford has joined #rdo		09:52
chandankumar	number80: apevec i will be not available after 05:30 P.M. (IST), need to catch Bus for Pune.	09:52
apevec	ack	09:52
*** egafford1 has joined #rdo		09:52
*** egafford has quit IRC		09:52
*** egafford has joined #rdo		09:53
*** egafford1 has quit IRC		09:53
number80	chandankumar: Enjoy your week-end then :)	09:53
EmilienM	apevec: kick doesn't work, I had to ban (from #tripleo)	09:53
*** egafford has quit IRC		09:53
*** egafford1 has joined #rdo		09:53
EmilienM	amoralej: back online, any news?	09:53
*** vnogin has quit IRC		09:54
*** egafford1 has quit IRC		09:54
*** egafford has joined #rdo		09:54
*** mosulica has quit IRC		09:54
*** egafford has quit IRC		09:54
*** egafford1 has joined #rdo		09:54
*** egafford1 has quit IRC		09:55
*** egafford has joined #rdo		09:55
EmilienM	amoralej: did you change the repo on https://review.openstack.org/#/c/471485/ to use the custom repo?	09:55
*** _bsurfer_ has quit IRC		09:55
*** egafford has quit IRC		09:55
EmilienM	I did recheck on https://review.openstack.org/#/c/461000/ to also test all scenarios	09:55
amoralej	EmilienM, yes	09:55
*** egafford has joined #rdo		09:55
amoralej	to use the temp repo	09:55
EmilienM	ok	09:56
sfbender	Merged DLRN master: Update references to git repo and Gerrit https://softwarefactory-project.io/r/8139	09:56
*** egafford has quit IRC		09:56
*** egafford1 has joined #rdo		09:56
*** itamarjp has quit IRC		09:56
*** egafford1 has quit IRC		09:56
*** egafford has joined #rdo		09:57
*** egafford has quit IRC		09:57
*** egafford1 has joined #rdo		09:57
*** mosulica has joined #rdo		09:58
*** egafford1 has quit IRC		09:58
*** egafford has joined #rdo		09:58
*** jackNemrod has joined #rdo		09:58
*** itamarjp has joined #rdo		09:58
*** itamarjp has joined #rdo		09:58
*** egafford has quit IRC		09:58
*** egafford1 has joined #rdo		09:58
*** _bsurfer_ has joined #rdo		09:58
amoralej	EmilienM, before 21 may we don't have logs for overcloud nodes in periodic jobs, do you know where was that changed?	09:58
*** egafford1 has quit IRC		09:59
*** egafford has joined #rdo		09:59
EmilienM	amoralej: no idea	09:59
*** egafford has quit IRC		09:59
*** egafford has joined #rdo		09:59
*** egafford has quit IRC		10:00
*** egafford1 has joined #rdo		10:00
*** egafford1 has quit IRC		10:00
*** egafford has joined #rdo		10:00
*** egafford has quit IRC		10:01
*** egafford1 has joined #rdo		10:01
*** vnogin has joined #rdo		10:01
*** egafford1 has quit IRC		10:02
apevec	amoralej, shouldn't logs be kept for 30 days at least?	10:02
*** egafford has joined #rdo		10:02
amoralej	we have logs, but not for overcloud nodes	10:02
amoralej	only for undercloud	10:02
*** egafford has quit IRC		10:02
*** egafford1 has joined #rdo		10:02
apevec	so ci config change?	10:02
amoralej	yes, but i can't find it	10:02
*** links has joined #rdo		10:02
*** egafford1 has quit IRC		10:03
amoralej	and i was guessing if something more changed	10:03
*** egafford has joined #rdo		10:03
*** egafford has quit IRC		10:03
*** egafford has joined #rdo		10:03
*** egafford1 has joined #rdo		10:04
*** egafford has quit IRC		10:04
*** egafford1 has quit IRC		10:04
*** egafford has joined #rdo		10:04
*** egafford has quit IRC		10:05
*** egafford1 has joined #rdo		10:05
*** egafford has joined #rdo		10:06
*** egafford1 has quit IRC		10:06
EmilienM	amoralej: now you're mentioning it, I think it's a bug Sagi fixed	10:06
*** egafford has quit IRC		10:06
EmilienM	let me look	10:07
*** egafford has joined #rdo		10:07
apevec	amoralej, imho downgrades won't help, this really must be ci config diff	10:07
*** egafford has quit IRC		10:07
*** egafford1 has joined #rdo		10:07
*** egafford1 has quit IRC		10:08
*** egafford has joined #rdo		10:08
*** egafford has quit IRC		10:08
*** egafford1 has joined #rdo		10:08
*** egafford1 has quit IRC		10:09
amoralej	apevec, i agree, i think it's environment issue	10:09
*** egafford has joined #rdo		10:09
*** egafford1 has joined #rdo		10:10
*** egafford has quit IRC		10:10
*** egafford1 has quit IRC		10:10
*** egafford has joined #rdo		10:10
*** egafford has quit IRC		10:11
*** egafford1 has joined #rdo		10:11
*** nstrug_ has joined #rdo		10:11
*** egafford1 has quit IRC		10:11
*** egafford has joined #rdo		10:12
*** egafford has quit IRC		10:12
*** egafford1 has joined #rdo		10:12
*** egafford1 has quit IRC		10:13
*** egafford has joined #rdo		10:13
*** egafford has quit IRC		10:13
*** egafford has joined #rdo		10:13
*** ChanServ sets mode: +o apevec		10:14
*** egafford has quit IRC		10:14
*** egafford has joined #rdo		10:14
*** apevec sets mode: +b !egafford@*.hsd1.ma.comcast.net		10:14
*** wolverineav has joined #rdo		10:14
sfbender	Javier Peña proposed DLRN master: Create static web page with commits in the build queue https://softwarefactory-project.io/r/8472	10:14
apevec	sorry Elise!	10:14
*** egafford has quit IRC		10:14
*** sbulage has quit IRC		10:15
*** nstrug has quit IRC		10:15
chandankumar	jpena: https://review.rdoproject.org/r/#/c/6962/	10:18
jpena	apevec: are you ok with ykarel's explanation in ^^?	10:19
apevec	yes, removed my -1	10:20
apevec	is common_desc macro what is used in other Fedora packages?	10:21
jpena	ok, merging	10:21
apevec	I looked at python guidelines example, but there is copy/paste	10:21
apevec	iirc some packages did use a macro but forgot which name	10:22
* chandankumar needs to investigate at description part there might be a better solution.		10:22
apevec	(doesn't really matter just for OCD)	10:22
apevec	chandankumar, yeah too bad %{description} is not working	10:22
rdogerrit	Javier Peña proposed config master: Ensure there is no master branch in distgit repos https://review.rdoproject.org/r/6857	10:25
amoralej	EmilienM, apevec, i'm comparing with the last job that didn't take 6 minutes to upload glance image, which is another symptom of the same issue	10:26
amoralej	we bumped eventlet....	10:26
apevec	damn	10:27
apevec	...eventlet	10:27
amoralej	i'm testing with previous eventlet	10:27
*** nstrug__ has joined #rdo		10:27
apevec	but that's in u-c right?	10:27
apevec	how come it works upstream and other jobs?!	10:27
*** Son_Goku has joined #rdo		10:27
*** sbulage has joined #rdo		10:28
sfbender	Merged DLRN master: Remove babel support from DLRN https://softwarefactory-project.io/r/8473	10:28
rdogerrit	Merged openstack/os-traits-distgit rpm-master: Reuse Description across sub packages https://review.rdoproject.org/r/6962	10:28
amoralej	apevec, there may be a mix of differences in env configuration that may be impacted by some new package	10:29
amoralej	it's rare but....	10:29
*** Son_Goku has quit IRC		10:29
*** vnogin has quit IRC		10:29
*** nstrug_ has quit IRC		10:30
*** pkovar has joined #rdo		10:30
*** mosulica has quit IRC		10:31
*** vnogin has joined #rdo		10:31
*** jackNemrod has quit IRC		10:32
*** jackNemrod has joined #rdo		10:32
*** richm has joined #rdo		10:34
*** Caterpillar2 has joined #rdo		10:35
*** mosulica has joined #rdo		10:35
*** Caterpillar has quit IRC		10:39
*** nstrug_ has joined #rdo		10:42
*** pgadiya has joined #rdo		10:43
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	10:44
rdogerrit	hguemar proposed config master: Add reposync for openstack-infra/project-config https://review.rdoproject.org/r/7035	10:44
rdogerrit	hguemar created config master: rdoinfo-DLRN-check: retrieve repositories namespace from rdoinfo https://review.rdoproject.org/r/7039	10:44
*** nstrug__ has quit IRC		10:45
number80	amoralej: can you review https://review.rdoproject.org/r/#/c/7039/ ? It is required to fix CI job in https://review.rdoproject.org/r/#/c/7036/	10:48
*** paragan has quit IRC		10:48
*** zoli\|lunch is now known as zoli		10:50
amoralej	number80, so why we do need project-config?	10:51
amoralej	to sync elements?	10:51
apevec	amoralej, yes, to run upstream jobs in rdo infra	10:52
number80	amoralej: exactly	10:52
number80	feel free to comment, the whole thing is a WIP	10:53
amoralej	what does mean "run upstream jobs in rdo infra"?	10:53
apevec	amoralej, this is so we can run periodic more frequently	10:53
number80	amoralej: we want to run TripleO CI jobs in the same environment in RDO infra	10:53
apevec	we are restricted to daily in upstream infra	10:53
chandankumar	amoralej: better to write "run OpenStack jobs in RDO infra"	10:53
* number80 will fix the commit message since it's not clear enough		10:53
apevec	chandankumar, for now focus is on ooo upstream jobs in rdo infra	10:54
amoralej	so, iiuc, we want to trigger periodic jobs for promotion from review.r.o instead of upstream?	10:54
rdogerrit	hguemar proposed rdoinfo master: Add openstack-infra/project-config https://review.rdoproject.org/r/7036	10:54
apevec	amoralej, yes	10:55
apevec	like we do for puppet promotion	10:55
amoralej	only oooq based?	10:55
apevec	whatever upstream defines	10:55
apevec	in the future, yes, all we be oooq based	10:55
chandankumar	ooo == openstack on openstack ~= openstack on Openshift (in future)	10:55
apevec	point it is we run them as-is	10:56
number80	openstack on openshift on openstack	10:56
amoralej	ok, got it	10:56
apevec	chandankumar, ^ it was called sendwitch at summit	10:56
apevec	sendwich	10:56
apevec	sandwich	10:56
apevec	man I can't type today	10:56
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	10:57
tosky	OoOoO	10:59
*** jkilpatr has joined #rdo		10:59
*** julim has joined #rdo		11:00
*** owlbot has quit IRC		11:01
*** lucasagomes is now known as lucas-hungry		11:05
*** cylopez has quit IRC		11:06
*** paragan has joined #rdo		11:07
*** karimb has quit IRC		11:07
*** owlbot has joined #rdo		11:08
* number80 will go for a run		11:09
*** dbecker has quit IRC		11:10
*** egafford has joined #rdo		11:12
*** egafford has quit IRC		11:12
EmilienM	amoralej: ack, thx for the update	11:14
*** egafford1 has joined #rdo		11:14
*** egafford1 has quit IRC		11:15
*** egafford has joined #rdo		11:15
*** karimb has joined #rdo		11:15
*** egafford has quit IRC		11:15
*** Son_Goku has joined #rdo		11:15
*** egafford1 has joined #rdo		11:16
*** egafford has joined #rdo		11:17
*** egafford1 has quit IRC		11:17
*** egafford has quit IRC		11:18
*** vnogin has quit IRC		11:18
hamzy	I see the following error http://paste.openstack.org/show/612078/ . It seems to dowload 581 packages and then hit a wall with rdo-packages/patrole-distgit. What query is dlrn doing to get patrole in the list?	11:21
*** vnogin has joined #rdo		11:21
jpena	hamzy: dlrn is using the information from rdoinfo to fetch all repos, but patrole is still under review and the repo is not created. You need to specify some tag in projects.ini to filter-our packages under-review	11:23
jpena	hamzy: which release are you trying to build packages for?	11:23
hamzy	jpena, for master	11:23
jpena	hamzy: ok, then set tags=pike-uc in projects.ini	11:23
*** egafford has joined #rdo		11:24
*** egafford has quit IRC		11:25
*** egafford has joined #rdo		11:25
hamzy	jpena, thanks! rerunning dlrn now...	11:25
*** egafford has quit IRC		11:26
jpena	hamzy: you may have trouble building python-keystoneclient, see http://lists.openstack.org/pipermail/openstack-dev/2017-June/118128.html	11:26
*** vnogin has quit IRC		11:27
*** egafford has joined #rdo		11:27
*** egafford has quit IRC		11:27
hamzy	jpena, hrm, okay... is there a bypass? or just wait until it is fixed?	11:28
jpena	hamzy: if I don't get a quick response I can propose a patch to the keystoneclient spec	11:28
* hamzy nods		11:29
*** jprovazn has joined #rdo		11:33
*** vnogin has joined #rdo		11:33
*** ccamacho is now known as ccamacho\|lunch		11:33
*** pgadiya has quit IRC		11:38
hamzy	looks like I won't be getting that far as it is trying to build for x86_64 on a ppc64le machine... :(	11:38
*** nstrug_ has quit IRC		11:38
hamzy	at least it is skipping sending notify emails :)	11:38
jpena	hamzy: ok, I think I know how to fix that. Just a sec	11:38
jpena	tbh, I never tried DLRN outside x86_64 architectures, this might be a good moment to prepare some patches	11:39
*** vnogin has quit IRC		11:39
hamzy	well I'm volunteering to be your guinea pig	11:40
*** cylopez has joined #rdo		11:40
jpena	hamzy: edit scripts/centos.cfg, it is a mock configuration file, and there are some hardcoded references to x86_64	11:40
*** anshulbehl has quit IRC		11:41
hamzy	sed -i -e 's/x86_64/ppc64le/' scripts/centos.cfg	11:41
jpena	that might work	11:42
jpena	it will also use https://trunk.rdoproject.org/centos7/delorean-deps.repo for dependencies. Some repos will probably need a different URL	11:43
jpena	the easiest way to fix that is:	11:46
jpena	1- Edit projects.ini, and set a different value for baseurl (that should be the URL where your builder will be serving packages)	11:46
jpena	2- at $baseurl/delorean-deps.repo, create a file with the adapted contents	11:46
hamzy	that are locally built by hand?	11:48
jpena	hamzy: there's a lot of packages there. Since the current file uses $basearch, it won't go to the right url. But almost every package is noarch, so you may reuse the x86_64 or aarch64 URLs as a started	11:50
jpena	s/started/starter/	11:50
apevec	amoralej, test-eventlet repos is failing a lot...	11:51
apevec	ovb-ha-oooq failed	11:51
apevec	neutron-server failed to start during UC install	11:53
amoralej	apevec, no prob	11:53
amoralej	failure in oooq is expected	11:53
amoralej	because of the depends-on patch	11:53
amoralej	it's not using the temporary repo	11:53
apevec	ah	11:53
chandankumar	good night guys, time to leave, see you on monday :-)	11:53
*** noslzzp has joined #rdo		11:54
amoralej	apevec, job to follow telnet://66.187.229.45:19885	11:54
apevec	what is all downgraded in test-evetlet and what is the base repo?	11:54
apevec	might be good to give an overview as a comment in DNM review	11:54
apevec	amoralej, in case we find eventlet is causing issues, what do we do?	11:58
amoralej	apevec, it's consistent repo + eventlet-0.18.4, i'll add a comment	11:58
*** vnogin has joined #rdo		11:58
amoralej	apevec.... i dunno, but let's first check if it helps	11:59
apevec	if it is really the issue, we'll need revert in upstream u-c	11:59
amoralej	anyway i want to get access to the test environment	11:59
amoralej	as soon as pabelanger is online i'll try to get access into it	11:59
*** _bsurfer_ has quit IRC		12:00
*** imcsk8 has quit IRC		12:03
apevec	amoralej, check on #openstack-infra if anyone else is around	12:03
*** jayg\|g0n3 is now known as jayg		12:04
*** yfried has joined #rdo		12:05
*** lucas-hungry is now known as lucasagomes		12:05
*** shardy has quit IRC		12:08
*** imcsk8 has joined #rdo		12:11
*** trown\|outtypewww is now known as trown		12:12
*** jackNemrod_ has joined #rdo		12:13
*** jcoufal has joined #rdo		12:13
apevec	pradk, in https://review.openstack.org/471485 OC deploy fails gnocchi-db-sync - any suggestions where to look further?	12:14
*** ratailor has quit IRC		12:14
apevec	this is for ci blocker, trying "consistent' + downgrades for neutron (but unrelated to gnocchi)	12:15
*** jackNemrod has quit IRC		12:15
*** jackNemrod_ is now known as jackNemrod		12:15
apevec	Gnocchi version is fresh build from today openstack-gnocchi-4.0.0-0.20170609065552.4e8089e	12:15
*** shardy has joined #rdo		12:17
pradk	apevec, looking	12:23
*** yfried has quit IRC		12:24
pradk	apevec, i dont see logs for upgrade.. but thats a new flag added in gnocchi 4 .. is the packaging up2date ?	12:25
pradk	perhaps we need a promotion?	12:25
pradk	lemme check the version its using	12:25
apevec	this is to unblock promoation ...	12:25
*** hrw has quit IRC		12:25
*** rlandy has joined #rdo		12:25
apevec	gnocchi listed in rpms was built today	12:25
*** eck` is now known as eck`gone		12:26
apevec	see NVR above	12:26
apevec	what's missing ?	12:26
pradk	yea that should work.. https://review.openstack.org/#/c/471334/ is what merged recently	12:26
pradk	the ci passed for this one hmm	12:26
*** hrw has joined #rdo		12:27
apevec	amoralej, ^ we might have version mixup in OC ?	12:27
*** jpena is now known as jpena\|lunch		12:28
amoralej	apevec, i'm going for lunch	12:28
apevec	me too	12:28
amoralej	but we have consistent with reverts	12:29
pradk	oh thats for ocata?	12:29
*** amoralej is now known as amoralej\|lunch		12:29
pradk	yea this should be pike only change	12:29
apevec	no it's master	12:29
pradk	ok	12:29
apevec	THT in http://logs.openstack.org/85/471485/6/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/7b14dc9/logs/rpm-qa.txt.gz is also fresh openstack-tripleo-heat-templates-7.0.0-0.20170609060204.753d0f9	12:29
apevec	but that's on UC ?	12:30
apevec	where can you check OC image?	12:30
*** noslzzp has quit IRC		12:30
*** morazi has joined #rdo		12:30
pradk	so how is gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet different from gate-tripleo-ci-centos-7-scenario001-multinode-oooq job	12:31
pradk	does -puppet job have anything different?	12:31
pradk	apevec, the overcloud would be subnode-2 i think	12:31
*** noslzzp has joined #rdo		12:31
*** julim_ has joined #rdo		12:32
*** julim has quit IRC		12:33
apevec	in check gate job was runing with current-tripleo repo this is with latest rdo trunk snapshot	12:33
EmilienM	pradk: no it's the same job	12:35
EmilienM	pradk: the name is different because one is running when you patch some files in tripleo	12:35
EmilienM	another is running every time	12:35
pradk	hmm	12:35
EmilienM	it's a zuul v2.5 thing	12:36
EmilienM	-puppet jobs run in puppet CI and also oooq CI	12:36
EmilienM	while gate-tripleo-ci-centos-7-scenario001-multinode-oooq only runs in tripleo ci when touching some files (telemetry files in that case)	12:36
EmilienM	we can't run gate-tripleo-ci-centos-7-scenario001-multinode-oooq in puppet CI because of the file rules	12:36
EmilienM	it's a zuul v2.5 limitation, again	12:36
*** jaosorior has quit IRC		12:37
EmilienM	apevec, amoralej\|lunch : what is the progress so far? still testing old version of eventlet?	12:39
pradk	hmm ok	12:39
pradk	weird that one passes while the -puppet one fails	12:39
pradk	lemme check if something new got into the latest packages	12:40
apevec	EmilienM, old eventlet still running	12:40
apevec	step3	12:40
*** trown is now known as trown\|afk		12:40
EmilienM	ok	12:41
EmilienM	pradk: what logs say?	12:42
*** _bsurfer_ has joined #rdo		12:42
*** shardy has quit IRC		12:43
*** Amita has quit IRC		12:44
pradk	apevec, i think i know why	12:48
apevec	please tell us!	12:48
pradk	they renamed the argument upstream recently and looks like it just got into the packaging	12:48
apevec	which upstream?	12:48
*** links has quit IRC		12:48
pradk	gnocchi upstream ... s/num-storage-sacks/sack-number/	12:49
*** dustins has joined #rdo		12:49
pradk	lemme push a patch one sec	12:49
*** ccamacho\|lunch is now known as ccamacho		12:49
apevec	EmilienM, ^ fun never ends :)	12:49
apevec	so now gnocchi does not run any ooo jobs?	12:49
apevec	in their gate	12:49
*** ohochman has joined #rdo		12:50
apevec	topic for the call in 10min I guess	12:50
pradk	did we ever?	12:50
*** ohochman has left #rdo		12:50
*** jmelvin has joined #rdo		12:51
pradk	apevec, k patch on its way .. just running tests now	12:52
pradk	this might be due to the packaging mismatch and timing the change got in	12:52
pradk	when it was merged it was old arg in packaging .. since the new rebuild today we picked up the change	12:53
*** julim_ has quit IRC		12:54
*** shardy has joined #rdo		12:56
pradk	apevec, EmilienM, https://review.openstack.org/#/c/472663/ this should do it	12:57
*** limao has joined #rdo		12:57
*** ihrachys has joined #rdo		12:59
*** sasha2 has joined #rdo		12:59
*** vnogin has quit IRC		12:59
*** limao_ has joined #rdo		13:01
*** amuller has joined #rdo		13:01
*** limao has quit IRC		13:02
*** kgiusti has joined #rdo		13:03
EmilienM	pradk: just that?	13:03
pradk	yep	13:03
EmilienM	+2	13:03
apevec	now, that will fail CI right?	13:03
pradk	it was renamed and packaging just picked it	13:03
apevec	b/c we have older gnocchi in current-tripleo ...	13:04
pradk	oh i suppose hmm	13:04
pradk	lets wait and see	13:04
apevec	so we'll need some logic to work with both in THT	13:05
pradk	alternately we can revert the original patch .. do promo and merge this one	13:05
*** _bsurfer has joined #rdo		13:06
*** dhill_ has joined #rdo		13:06
*** haleyb_ has quit IRC		13:07
*** sterdnotshaken has joined #rdo		13:07
*** sterdnotshaken has quit IRC		13:07
*** haleyb_ has joined #rdo		13:07
*** Goneri has joined #rdo		13:07
apevec	pradk, yeah, I commented with some options in review, please add this one	13:08
*** limao_ has quit IRC		13:08
pradk	i dont want to add additional logic for a arg that doesnt exist anymore	13:08
*** _bsurfer_ has quit IRC		13:09
*** limao has joined #rdo		13:09
*** limao has quit IRC		13:10
*** julim has joined #rdo		13:10
apevec	pradk, but also, make upstream understand CLI is kind of "API" so needs deprecations/backward compat too!	13:10
*** imcleod has joined #rdo		13:10
*** limao has joined #rdo		13:10
pradk	yea agree, this should have been handled more carefully upgrade	13:11
pradk	but for now to get us out of this rut .. i say we revert original patch and merge this new one back after promotion with new args	13:11
pradk	apevec, EmilienM, wdyt ?	13:11
apevec	pradk, ack	13:12
apevec	let's do that	13:12
apevec	otherwise we don't have candidate for promotion	13:12
pradk	revert: https://review.openstack.org/#/c/472673/	13:12
pradk	EmilienM, can you merge this revert	13:13
pradk	once promotion is done, we can merge the new one	13:13
apevec	pradk, he is now really afk, let's get support on #tripleo	13:13
EmilienM	Done	13:15
apevec	so you're cheating	13:15
pradk	thx i +w'ed .. once this merges lets try promotion again	13:16
pradk	mean while i'll redo the new patch	13:16
*** noslzzp has quit IRC		13:16
*** julim has quit IRC		13:16
pradk	afk for a bit	13:17
apevec	that was only a side show for promotion :)	13:17
apevec	but yes, it would block it next, once current neutron/rpc issue is resolved	13:18
*** dustins_ has joined #rdo		13:18
*** noslzzp has joined #rdo		13:19
*** dustins has quit IRC		13:19
*** dustins_ is now known as dustins		13:20
*** jcoufal_ has joined #rdo		13:23
*** limao has quit IRC		13:24
*** vnogin has joined #rdo		13:24
*** limao has joined #rdo		13:25
*** jcoufal has quit IRC		13:27
*** toure\|gone is now known as toure		13:27
*** haleyb_ has quit IRC		13:28
apevec	so older eventlet did not help	13:28
apevec	amoralej\|lunch, ^ 504 gateway timeout in neutronclient	13:29
apevec	also nonha failed	13:29
*** gszasz has quit IRC		13:29
openstackgerrit	Pavel Gluschak (scsnow) proposed openstack/packstack master: neutron: don't generate manifests for excluded hosts https://review.openstack.org/472679	13:30
apevec	amoralej\|lunch, next suspect oslo.msg ?	13:31
*** eck`gone is now known as eck`		13:31
openstackgerrit	Pavel Gluschak (scsnow) proposed openstack/packstack master: neutron: don't generate manifests for excluded hosts https://review.openstack.org/472679	13:31
*** haleyb_ has joined #rdo		13:32
*** limao has quit IRC		13:36
*** lkoranda has quit IRC		13:37
*** limao has joined #rdo		13:37
*** trown\|afk is now known as trown		13:37
*** amoralej\|lunch is now known as amoralej		13:38
*** jpena\|lunch is now known as jpena		13:38
amoralej	apevec, i think we need to hold a server and investigate	13:38
apevec	amoralej, did you get hold of pabelanger ?	13:39
*** imcleod has quit IRC		13:40
amoralej	no, i'll launch another one after talking to pabelanger	13:41
apevec	amoralej, so which repo combination are you chasing now?	13:42
apevec	not sure that eventlet upgrade is useful path	13:43
apevec	I'd focus on oslo.msg, there was one unmerged patch mentioned by d0ugal ...	13:43
amoralej	apevec, to be honest, now i don't care in what to use in the job. the important thing is to get access to the environment	13:44
amoralej	so we can test everything	13:44
apevec	ack	13:44
*** dneary has joined #rdo		13:45
*** janki has quit IRC		13:47
amoralej	apevec, yeah that patch in oslo.msg looks fine i can test installing it with pip once i can access	13:48
*** jcoufal_ has quit IRC		13:48
number80	jpena: are you fine with abandoning https://review.rdoproject.org/r/#/c/6915/ ? (FTBFS review that has no activity since June,1 and CI is green)	13:49
*** eaguilar has joined #rdo		13:50
*** jcoufal has joined #rdo		13:50
number80	RFC in https://review.rdoproject.org/r/#/c/7036/ (where to put configuration for sync-only repo)	13:50
*** chlong has joined #rdo		13:51
jpena	number80: no, it is still failing in master-head, and the upstream bug has not been solved. It is passing CI because the dependency repo used there is centos7-master instead of centos7-master-head	13:51
*** kaka is now known as hexo		13:52
amoralej	apevec, in the last run we increase debug level of amqp in neutron and there are a lot of timeouts	13:52
amoralej	like heartbeat_tick : for connection e6175840dbd04a5384134f34f35c95b5: Timeout: Timeout while waiting on RPC response - topic: "<unknown>", RPC method: "<unknown>" info: "<unknown>" heartbeat_tick /usr/lib/python2.7/site-packages/amqp/connection.py:656	13:52
amoralej	EmilienM, ^	13:52
number80	jpena: ack	13:52
number80	I'll set a comment to bump it	13:53
number80	lhinds: friendly reminder about https://review.rdoproject.org/r/#/c/5839/8 :)	13:53
*** limao has quit IRC		13:54
*** limao has joined #rdo		13:55
*** jaosorior has joined #rdo		13:56
*** ratailor has joined #rdo		13:56
*** sbulage has quit IRC		13:57
*** dtrainor has joined #rdo		13:57
*** pnavarro has joined #rdo		13:59
*** jcoufal has quit IRC		13:59
*** noslzzp_ has joined #rdo		14:00
*** noslzzp has quit IRC		14:01
*** athomas has quit IRC		14:03
number80	mfedosin: btw, projects for both glareclient and glare have been created, you could submit your spec files there so we can move on with reviews	14:04
mfedosin	number80: awesome! I will do it	14:05
mfedosin	thank you :)	14:05
*** limao has quit IRC		14:06
*** limao has joined #rdo		14:07
*** jcoufal has joined #rdo		14:07
amoralej	btw apevec, my revert of eventlet in temporary repo didn't work... it used new one	14:09
*** jprovazn has quit IRC		14:09
number80	mfedosin: :)	14:11
*** limao has quit IRC		14:13
*** eaguilar_ has joined #rdo		14:15
*** jcoufal has quit IRC		14:15
*** jcoufal has joined #rdo		14:15
*** tesseract has quit IRC		14:16
*** eaguilar has quit IRC		14:17
*** noslzzp_ has quit IRC		14:17
*** panda is now known as panda\|bbl		14:19
hamzy	jpena, I am getting an error "Received exception Error in build_rpm_wrapper for openstack-tempest: HTTP Error 404: Not Found" with openstack-tempest. I tried passing in --verbose-mock with no luck. running mock from the cmd line works. the paste is at http://paste.openstack.org/show/612138/	14:22
*** fragatina has quit IRC		14:22
*** tesseract has joined #rdo		14:23
*** anilvenkata has quit IRC		14:24
hamzy	oops, the first line of that paste should have --verbose-mock... I cut and paste from a little too far back	14:24
jpena	hamzy: that looks like an issue with one of the dependency repos. Did you create a new delorean-deps.repo file elsewhere?	14:24
hamzy	yes	14:24
apevec	amoralej, how come, is it in repo with prio=1 ??	14:24
amoralej	yes it is	14:24
amoralej	i'm not sure	14:25
*** ykarel has quit IRC		14:25
hamzy	jpena, let me create another test centos.cfg with the delorean-deps.repo inside of the mock cfg	14:25
*** gkadam_ has joined #rdo		14:26
*** gkadam has quit IRC		14:26
jpena	hamzy: just curious, what is the baseurl value in your projects.ini file? If it's the default one, you'll have trouble	14:26
hamzy	jpena, baseurl=http://127.0.0.1/openstack-pike/	14:27
rbowen	So, is anybody working on docs today?	14:27
hamzy	which I did a createrepo on with nothing in it	14:27
jpena	rbowen: I'm trying to	14:28
rbowen	Awesome	14:29
jpena	hamzy: ok, so what do you have at http://127.0.0.1/openstack-pike/delorean-deps.repo?	14:29
rbowen	Can someone with Ceilometer-fu have a look at https://www.rdoproject.org/install/ceilometerquickstart/ when you have a chance?	14:29
rbowen	In particular, is it still correct? Relevant? Helpful?	14:29
*** cshastri has quit IRC		14:30
*** gkadam_ has quit IRC		14:31
*** prateek has quit IRC		14:31
*** flindet has joined #rdo		14:33
apevec	amoralej, maybe it was in base image?	14:34
apevec	amoralej, did you get access to upstream nodes?	14:34
*** dgurtner has joined #rdo		14:35
*** dgurtner has joined #rdo		14:35
amoralej	now gerrit is down	14:35
apevec	man...	14:35
amoralej	and it's not triggering jobs	14:35
amoralej	i'll try to build an env in rdo-cloud in the meanwhile	14:35
apevec	r/o gerrit works	14:36
apevec	but leaving comment hangs	14:36
apevec	amoralej, what would be the steps? Can you put them in the card https://trello.com/c/AJe0jbbX/176-tripleo-ci-neutron-server-create-subnet-timing-out ?	14:37
*** vnogin has quit IRC		14:40
hamzy	jpena, grrr... it looks like delorean-deps.repo was one directory up in the web server... sorry about that... it seems that the --verbose-mock wasn't taking effect (although I see it now for this run)	14:44
hamzy	and it looks like I need to bootstrap this build somehow...	14:44
hamzy	--order should build the package with the least dependencies, right?	14:45
jpena	hamzy: --order computes the build order for all packages, and starts with the one that doesn't depend on anyone else	14:46
hamzy	and that is openstack-tempest?	14:47
hamzy	which needed 12 python- packages	14:47
hamzy	I'll try mockchain building them locally	14:48
*** Son_Goku has quit IRC		14:49
rdogerrit	hguemar proposed config master: (WIP)Nodepool: Import CentoS 7 image elements from openstack-infra https://review.rdoproject.org/r/6997	14:50
*** jbadiapa_ has quit IRC		14:51
number80	jpena, amoralej: got tricked by zsh that natively handles multi-lines string in variables	14:51
* number80 can't bear bash as interactive shell		14:51
karimb	number80 fish is great	14:52
*** egonzalez has quit IRC		14:52
*** yfried has joined #rdo		14:52
number80	karimb: never really tried it, I'm happy with zsh that has fast completion and syntaxic coloring	14:53
*** bnemec is now known as beekneemech		14:55
*** jpena is now known as jpena\|off		14:56
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted now to clear an issue arising from an unanticipated SSH API connection flood		14:58
*** jpena\|off is now known as jpena		14:58
*** ratailor has quit IRC		15:00
*** mosulica has quit IRC		15:01
*** smeyer has quit IRC		15:02
*** emalikov has quit IRC		15:05
*** rcernin has quit IRC		15:08
*** jaosorior has quit IRC		15:09
*** jackNemrod has quit IRC		15:11
*** jackNemrod has joined #rdo		15:11
*** yfried has quit IRC		15:13
apevec	lhinds, did you find a Fedora sponsor for you? https://bugzilla.redhat.com/show_bug.cgi?id=1452649#c14	15:17
openstack	bugzilla.redhat.com bug 1452649 in Package Review "Review Request: python-exabgp - Package review request for ExaBGP spec" [Medium,New] - Assigned to rjones	15:17
*** dtantsur is now known as dtantsur\|afk		15:19
*** iswid has joined #rdo		15:19
*** jbadiapa has joined #rdo		15:21
fultonj	apevec: regarding https://review.rdoproject.org/r/#/c/6809/ , does it just need the Upstream-Id to merge and then, assuming DLRN-rpmbuild passes, then it can merge ?	15:23
apevec	hm it still failed even w/ upstream-id	15:25
apevec	fultonj, so it needs to be coordianted otherwise we'll get failures in trunk builds...	15:26
apevec	lemme look at last ci result	15:26
fultonj	apevec: the upstream review depends on a few upstream changes that also have not merged	15:27
apevec	ah build worked, but Requires: ceph-ansible is not available...	15:27
apevec	so we need to first resolve adding Ceph repo to RDO buildsroots	15:27
apevec	last time we discussed that ~ Mitaka, it was agreed not to add it	15:28
apevec	since Ceph is optional	15:28
apevec	and not all users need it	15:28
apevec	flaper87, maybe we can revisit that now, do you want to raise it on rdo-list?	15:28
fultonj	jschlueter: ^ fyi	15:29
*** cylopez has left #rdo		15:29
*** Goneri has quit IRC		15:29
apevec	oops sorry flaper87	15:30
apevec	fultonj, ^ :)	15:30
apevec	but you got that	15:30
apevec	too many f* :)	15:30
fultonj	apevec: ok	15:30
fultonj	apevec: thanks	15:30
*** sterdnotshaken has joined #rdo		15:32
apevec	fultonj, actually I already commented about that in the review	15:32
apevec	https://review.rdoproject.org/r/#/c/6809/3/openstack-tripleo-common.spec@112	15:32
fultonj	apevec: yes you did	15:32
apevec	fultonj, just to explain what Upstream-Id: does - it triggers login in DLRN to checkout that review from review.openstack.org	15:33
jpena	pradk: I guess https://www.rdoproject.org/install/ceilometerquickstart/ is quite outdated, do you think it's worth updating or should it be removed?	15:33
apevec	fultonj, so we can confirm spec change works with not yet merged changes upstream	15:33
pradk	jpena, yes i'm repling to the email as we speak :)	15:33
jpena	awesome :D	15:33
apevec	oh yes, it's last of docs days today!	15:34
fultonj	apevec: glad the build works	15:34
fultonj	i guess we need enough consent about including this pacakge in rdo	15:34
fultonj	apevec: the package exists but it's a matter of if we want to use it right?	15:35
*** jackNemrod has quit IRC		15:35
apevec	no just package, but whole Ceph repo	15:35
apevec	and we actually have one more use case now,	15:35
apevec	to get librados2 on ppc64le	15:35
apevec	number80, ^	15:36
apevec	fultonj, so if you start that discussion, we can pile on more reasons to do it :)	15:36
number80	yep, there's also another lib from ceph to rebuild	15:36
jpena	btw, speaking of the docs. misc, we need to migrate the server to RDO Cloud soon	15:36
number80	librdbd1	15:36
apevec	jpena, website is on OS1 ?	15:36
jpena	apevec: yep	15:37
apevec	oh yes, that's coming down soon	15:37
fultonj	ok, i will kick of an email on the list. thanks apevec !	15:37
* number80 browsing last 10 min logs		15:37
rdogerrit	Merged openstack/heat-distgit mitaka-rdo: Don't set server URLs to localhost in heat-dist.conf https://review.rdoproject.org/r/6941	15:39
apevec	amoralej, ^ is that worth respining mitaka?	15:40
apevec	(low prio)	15:40
amoralej	apevec, i have it in my task list	15:41
apevec	number80, mitaka is efectively EOL so let's not merge any more changes on mitaka-rdo	15:41
amoralej	we did some progress but validation is still failing	15:41
trown	amoralej: so I think I have a patch which will fix the kind of major issue with ovb devmode, trying again to setup an environment with master consistent	15:42
*** dgurtner has quit IRC		15:42
amoralej	trown, nice!	15:42
apevec	amoralej, yeah, after unbreaking master ...	15:42
*** jcoufal_ has joined #rdo		15:43
apevec	trown, let me know how to test, which patch # is it?	15:43
amoralej	apevec, btw, it seems that even with https://review.openstack.org/#/c/471361/ , jobs in experimental pipeline use the consistent repo	15:43
amoralej	not the one in the patch	15:43
*** rpioso has joined #rdo		15:43
number80	apevec: did we close repositories? Well, I'll just abandon existing reviews then	15:44
*** dgurtner has joined #rdo		15:44
*** dgurtner has joined #rdo		15:44
apevec	amoralej, so that env var is ignored?	15:44
apevec	but wait, consistent or current-tripleo ?	15:44
apevec	b/c that's the default, not "consistent" ?	15:44
apevec	number80, not yet, we were trying to get clean CI promotion on mitaka-testing first	15:45
number80	apevec: ack	15:45
apevec	then push last update	15:45
apevec	then move to vault.c.o	15:45
apevec	(first time to test that procedure!)	15:45
*** jcoufal has quit IRC		15:45
apevec	amoralej, is there some other place where repo url is set for the CI job?	15:46
amoralej	maybe there is something that makes to use consistent for job periodic-....	15:47
*** jlibosva has quit IRC		15:51
*** jpich has quit IRC		15:53
*** egonzalez has joined #rdo		15:54
apevec	amoralej, oh right, that's probably set in job definition?	15:56
amoralej	somethink like that...	15:56
apevec	weshay, ^ do you know about periodic*	15:56
* weshay reads		15:56
apevec	amoralej, re. messaging expert, that would be sileht	15:57
amoralej	ok	15:57
apevec	amoralej, can you link him to logs where timeouts happen	15:57
*** jparrill has quit IRC		15:57
amoralej	didn't i?	15:57
apevec	and list which version of relevant pkgs	15:57
weshay	the repourl should only live in config/release files	15:57
amoralej	in the trello board, imean	15:57
*** jparrill has joined #rdo		15:57
weshay	is this in reference to a job running in rdo or tripleo	15:57
weshay	because there is a nuance to that	15:58
amoralej	tripleo	15:58
*** jcoufal has joined #rdo		15:58
amoralej	weshay, experimental pipeline jobs in https://review.openstack.org/#/c/471361	15:58
apevec	weshay, it's old sytle tripleo ovb-ha	15:58
amoralej	i expected them to use the repo in the patch	15:58
amoralej	https://review.openstack.org/#/c/471361/9/scripts/tripleo.sh	15:58
weshay	looking	16:00
*** jcoufal_ has quit IRC		16:00
*** jpena is now known as jpena\|away		16:01
*** jbadiapa has quit IRC		16:01
*** pblaho has quit IRC		16:02
*** amoralej is now known as amoralej\|brb		16:02
*** lucasagomes is now known as lucas-afk		16:02
weshay	ya.. amoralej\|brb the repo you specified is not the one in the logs of the jobs.. for sure	16:03
*** jparrill has quit IRC		16:06
weshay	amoralej\|brb, http://logs.openstack.org/61/471361/7/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/c38bb4e/console.html#_2017-06-09_11_00_37_138158	16:06
*** tosky has quit IRC		16:06
*** fultonj has quit IRC		16:07
*** fultonj has joined #rdo		16:09
*** jparrill has joined #rdo		16:09
weshay	DELOREAN_REPO_URL="https://trunk.rdoproject.org/centos7/test-eventlet/"	16:09
weshay	amoralej\|brb, can you set it like that?	16:09
weshay	the value is already passed at that point afaict	16:10
*** vnogin has joined #rdo		16:11
*** jcoufal_ has joined #rdo		16:11
*** jcoufal has quit IRC		16:13
*** noslzzp has joined #rdo		16:13
*** jcoufal__ has joined #rdo		16:13
apevec	right, it set before running the script	16:15
mnaser	hm, newton using ovsdb_interface and of_interface set to native doesn't work with selinux at teh moment?	16:15
apevec	it's*	16:15
*** vnogin has quit IRC		16:15
*** jcoufal_ has quit IRC		16:15
apevec	mnaser, which openstack-selinux NVR ?	16:15
apevec	try with latest http://cbs.centos.org/koji/buildinfo?buildID=17328	16:16
mnaser	apevec Source RPM : openstack-selinux-0.7.13-2.el7.src.rpm	16:17
apevec	yeah, that's latest released, try above candidate build	16:17
apevec	it's now in trunk repo too	16:18
mnaser	apevec sure one sec	16:18
mnaser	apevec fyi -- this is how i found out that i couldn't use it -- https://github.com/openstack/puppet-neutron/blob/master/spec/acceptance/basic_neutron_spec.rb#L71-L77	16:19
apevec	hmm, that comment is 11months old, would be nice instead of "Current" to have actual NVR ...	16:21
mnaser	apevec looks like it started up successfully, let me try booting a vm	16:24
mnaser	apevec gets the +1 from me.. works great now	16:26
*** eaguilar_ has quit IRC		16:26
mnaser	im trying to think of a way to deploy that rpm specifically with puppet now until that gets promoted to release	16:26
mnaser	(thinking out loud) if i remember correctly, yum has a way of saying get this package only from this repo, so ill add common-candidate and point it to openstack-selinux only	16:29
*** sbonazzo has quit IRC		16:29
*** mcornea has quit IRC		16:30
apevec	mnaser, you cannot use full path like in yum install http://cbs.centos.org/kojifiles/packages/openstack-selinux/0.8.7/1.el7/noarch/openstack-selinux-0.8.7-1.el7.noarch.rpm ?	16:32
*** ltomasbo is now known as ltomasbo\|away		16:32
*** tesseract has quit IRC		16:32
apevec	ah puppet...	16:32
mnaser	apevec i think in puppet i can do this: package { 'openstack-selinux': provider => 'rpm'; source => 'http://cbs.centos.org/kojifiles/packages/openstack-selinux/0.8.7/1.el7/noarch/openstack-selinux-0.8.7-1.el7.noarch.rpm' }	16:32
mnaser	which will get me going until this gets released	16:32
*** fultonj has quit IRC		16:33
*** zoli is now known as zoli\|gone		16:33
*** pcaruana has quit IRC		16:34
mnaser	apevec well, got it into our puppet code but it would probably be nice for that to be released because by default, newton doesn't work with selinux on rdo based on that ^ :<	16:39
*** marrusl has quit IRC		16:40
*** fultonj has joined #rdo		16:41
*** dsneddon has joined #rdo		16:44
*** rcernin has joined #rdo		16:45
*** jwb has joined #rdo		16:47
*** milan has quit IRC		16:48
*** jmelvin has quit IRC		16:49
*** tvignaud has quit IRC		16:49
*** fultonj has quit IRC		16:50
*** _bsurfer has quit IRC		16:50
*** sterdnotshaken has quit IRC		16:51
apevec	yes, we'll get it into release pipeline next week, focus this week is to unblock master...	16:51
mnaser	np :)	16:52
apevec	amoralej\|brb, I'll put Wes' suggestion in https://review.openstack.org/471361	16:52
*** fultonj has joined #rdo		16:52
apevec	or should I leave current PS to completion?	16:52
apevec	btw is this sleep https://review.openstack.org/#/c/471361/9/scripts/tripleo.sh@1137 time to grab the node by infra?	16:53
*** derekh has quit IRC		16:59
*** paragan has quit IRC		17:00
*** bogdando has quit IRC		17:03
*** anilvenkata has joined #rdo		17:05
*** tvignaud has joined #rdo		17:06
*** sterdnotshaken has joined #rdo		17:08
*** Lokesh_Jain_ has quit IRC		17:08
*** iswid has quit IRC		17:11
*** pblaho has joined #rdo		17:14
*** iniazi_ has quit IRC		17:16
*** dgurtner has quit IRC		17:17
*** jparrill has quit IRC		17:18
*** pkovar has quit IRC		17:18
*** noslzzp has quit IRC		17:19
*** amoralej\|brb is now known as amoralej		17:20
amoralej	apevec, don't add a new PS please	17:20
*** jpena\|away is now known as jpena		17:22
amoralej	apevec, the sleep is to keep the entire environment	17:22
amoralej	and don't destroy the overlay	17:22
amoralej	overcloud i mean	17:22
*** jpena is now known as jpena\|off		17:23
*** udesale has quit IRC		17:24
apevec	ok	17:24
*** anilvenkata has quit IRC		17:25
amoralej	apevec, btw, deployment is already done	17:25
ihrachys	apevec, do we have anyone from messaging experts looking at rpc thingy?	17:26
apevec	we had sileht here earlier but looks like we lost him for today	17:28
apevec	eck`, ^ maybe you can chime in on https://trello.com/c/AJe0jbbX/176-tripleo-ci-neutron-server-create-subnet-timing-out ?	17:28
apevec	flaper87, ^ who else is working/knows about oslo.messaging ?	17:29
flaper87	apevec: sileht dhellmann eck` kgiusti and myself	17:30
amoralej	ihrachys, apevec, the environment is ready	17:31
amoralej	my plan was to use the upload image test to troubleshoot	17:31
apevec	good idea	17:32
apevec	that will show notification timeouts	17:32
apevec	just take some small image :)	17:32
amoralej	i want to see if stopping two of the glance servers	17:32
amoralej	even creating a empty image will take a minute	17:32
amoralej	if i can reproduce with a single glance-api instance running, it'd be easier	17:32
apevec	ok	17:32
amoralej	and then start trying things	17:33
apevec	so now you have all from consistent ? Which hash exactly?	17:33
apevec	also deps are all latest, no downgrades?	17:33
amoralej	ae/c1/aec10099431d75ff7c5d9cc2eab464b40ae66f73_1c6d6691	17:33
amoralej	latest	17:33
amoralej	apevec, i can add public keys at authorized_keys, but we should work coordinate d	17:34
*** trown is now known as trown\|lunch		17:34
*** iniazi has joined #rdo		17:37
*** Goneri has joined #rdo		17:39
*** nsasherr has quit IRC		17:43
*** prad_ has joined #rdo		17:43
*** prateek has joined #rdo		17:50
*** iranzo has quit IRC		17:52
*** prateek_ has joined #rdo		17:54
*** prateek has quit IRC		17:57
*** noslzzp has joined #rdo		17:58
*** aufi has quit IRC		18:00
amoralej	apevec, i lost my env :(((((	18:01
apevec	crap	18:06
apevec	pabelanger, ^ what happened ?	18:07
amoralej	i know	18:07
amoralej	probably the script is started with a timeout	18:07
*** eaguilar has joined #rdo		18:07
amoralej	but i discovered something in the meanwhile	18:07
amoralej	dns resolution was not working fine in overcloud servers	18:08
apevec	...	18:08
pabelanger	apevec: nothing, nodepool is still holding the node	18:08
amoralej	it works in undercloud, but not in overcloud	18:08
pabelanger	we have no controll over the OVB nodes	18:08
apevec	so it is one of the env diff for OC !	18:08
amoralej	pabelanger, my fault, i didn't hold the ovb nodes properly	18:08
amoralej	in fact	18:08
amoralej	after the first request to glance it seems it works ok	18:09
amoralej	but i restart it and first request is again slow	18:09
amoralej	and then it's ok	18:09
apevec	hmm, why is that?	18:09
amoralej	maybe first connection tries to resolve something?	18:09
amoralej	and about resolution, maybe some incorrect routes?	18:09
amoralej	i understand it should resolve	18:10
pabelanger	what are you using for a dns server?	18:10
amoralej	10.1.8.10	18:10
apevec	but would that explain RPC timeouts ? It was happening for each RPC wasn't it?	18:10
amoralej	8.8.8.8	18:10
amoralej	pabelanger, i have the same ones for overcloud and undercloud	18:11
pabelanger	ya, you don't want to rely on google, they will rate limit you	18:11
amoralej	is that right?	18:11
pabelanger	yes	18:11
amoralej	first one is 10.1.8.10	18:11
pabelanger	we run unbound servers on all images because if this	18:11
pabelanger	I do not know what 10.1.8.10 is	18:11
apevec	amoralej, please add findings in the trello card	18:11
apevec	what would be next step now?	18:11
* apevec looks at hostname-map.yaml		18:11
pabelanger	what you should use is the unbound server on node we launch in nodepool, pipe DNS requests via it. Or configure your own unbound servers	18:11
pabelanger	we also by pass cloud DNS server for this reason too, since we have no control over them	18:12
amoralej	pabelanger, i guess it's not feasible to launch a new ovb deployment from the hold undercloud, right?	18:12
pabelanger	not sure	18:13
pabelanger	Isn't there a way you can reproduce a job run?	18:13
pabelanger	eg: in devstack we have reproduce.sh, does that not work on tripleo?	18:14
*** mfedosin has quit IRC		18:14
prad_	apevec, the revert is merged, did you try a promotion?	18:14
pabelanger	http://logs.openstack.org/37/472737/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/ded12ae/logs/reproduce.sh for example	18:14
apevec	prad_, we're still debuggin ovb-ha	18:14
prad_	gotcha	18:15
*** _bsurfer has joined #rdo		18:15
apevec	pabelanger, there is some WIP in oooq to prepare reproducer using what oooq calls "devmode"	18:16
apevec	but this is legacy tripleoci job	18:16
apevec	so no, there isn't :(	18:16
*** trown\|lunch is now known as trown		18:18
*** _bsurfer has quit IRC		18:24
amoralej	i'd say we could re-run the scripts but we don't have credentials, must be injectec somehow	18:24
*** Amita has joined #rdo		18:32
amoralej	apevec, i added notes in https://etherpad.openstack.org/p/tripleo-ha-neutron-subnet-create-timeout	18:39
amoralej	apevec, i'll be back in 1 hour or so	18:40
*** amoralej is now known as amoralej\|off		18:40
*** sterdnotshaken has joined #rdo		18:40
*** sterdnotshaken has quit IRC		18:45
*** florianf has quit IRC		18:46
*** fultonj has quit IRC		18:51
*** fultonj has joined #rdo		18:52
*** egallen has quit IRC		18:53
*** jcoufal__ has quit IRC		18:53
*** mfedosin has joined #rdo		18:58
*** noslzzp has quit IRC		19:05
*** eaguilar has quit IRC		19:06
*** sterdnotshaken has joined #rdo		19:09
*** vnogin has joined #rdo		19:11
*** sterdnotshaken has quit IRC		19:13
*** vnogin has quit IRC		19:19
*** morazi has quit IRC		19:20
*** sterdnotshaken has joined #rdo		19:24
*** prateek_ has quit IRC		19:28
*** vnogin has joined #rdo		19:28
*** [1]rpioso has joined #rdo		19:31
*** [2]rpioso has joined #rdo		19:33
*** [1]rpioso has quit IRC		19:33
*** fzdarsky has quit IRC		19:33
*** rpioso has quit IRC		19:35
*** [2]rpioso is now known as rpioso		19:35
*** racedo has joined #rdo		19:35
*** amoralej\|off is now known as amoralej		19:36
*** karimb has quit IRC		19:38
*** vnogin has quit IRC		19:42
*** egonzalez has quit IRC		19:47
*** vnogin has joined #rdo		19:48
*** eck` is now known as eck`gone		19:50
*** prad_ has quit IRC		19:52
*** Amita has quit IRC		19:53
amoralej	apevec, i'm trying to reproduce the issue in trown's environment by missconfiguring dns	19:54
amoralej	apevec, EmilienM, reproduced!!!! \o/	19:56
*** racedo has quit IRC		19:57
*** vnogin has quit IRC		20:00
amoralej	apevec, EmilienM, the problem is mixing bad dns configuration (dns servers are not reacheable from overcloud in tripleoci jobs) and eventlet-0.20.1	20:00
amoralej	in nonha, there is only one rabbit server, and it takes 20 secs to timeout on each call, that's why in nonha worked, it was slow but not enough to timeout	20:01
amoralej	and in oooq jobs i bet overcloud servers can reach DNS servers	20:01
amoralej	trown ^ if you are curious	20:02
trown	nice find	20:06
*** morazi has joined #rdo		20:06
*** panda\|bbl is now known as panda		20:07
*** dciabrin has quit IRC		20:09
*** vnogin has joined #rdo		20:09
*** mfedosin has quit IRC		20:10
*** stanchan has quit IRC		20:10
*** paramite has quit IRC		20:15
apevec	amoralej++ man is da man!	20:17
apevec	but W.T.F.	20:17
apevec	and what changed dns config after Mar 21 ?	20:18
apevec	err May 21	20:18
apevec	amoralej, you're adding notes in the card?	20:18
amoralej	i'm preparing it	20:19
amoralej	yes	20:19
apevec	cool, thanks	20:19
amoralej	apevec, no, eventlet changed	20:19
amoralej	for some reason	20:19
amoralej	the first run after the eventlet update passed	20:19
amoralej	note that only the first call on each server is slow	20:20
apevec	so bad config + evenlet update	20:20
amoralej	yeah	20:20
amoralej	each server, i mean each process on each server	20:20
amoralej	apevec https://github.com/eventlet/eventlet/issues/416	20:21
apevec	nice	20:23
*** jayg is now known as jayg\|g0n3		20:24
amoralej	apevec, i'm going to test 0.21.0 with pip, it's not in global requirements yet, but just for testing	20:26
apevec	but this issue is not fixed	20:26
amoralej	apevec, ihrachys pointed me to https://github.com/eventlet/eventlet/commit/503aed1310b5e4a2fad9f5a0909663636a4e8752	20:27
apevec	hmm that was commited in Feb ?	20:28
apevec	and issue was reported 11 days ago	20:28
*** rbowen has quit IRC		20:30
*** vnogin has quit IRC		20:30
*** [2]rpioso has joined #rdo		20:31
amoralej	apevec, can join in #openstack-neutron	20:31
ihrachys	apevec, blocking bad eventlet https://review.openstack.org/472798	20:32
ihrachys	amoralej, can you write up the final findings in the LP bug?	20:32
amoralej	sure	20:32
amoralej	but let me do some more tests	20:32
amoralej	0.21.0 seems to be weird	20:32
amoralej	it takes 33 secs to do a call	20:32
*** rpioso has quit IRC		20:33
*** [2]rpioso is now known as rpioso		20:33
amoralej	ihrachys, ^	20:33
amoralej	maybe it's not fully fixed	20:33
ihrachys	amoralej, 0.21.0 has some other issues	20:34
ihrachys	that's why it's blocked in g-r too	20:34
ihrachys	so we need 0.20.0	20:34
amoralej	oh, sorry, i missread it	20:34
*** vnogin has joined #rdo		20:35
amoralej	ihrachys, eventlet bump was required as dependency of new pymysql to support TLS	20:35
amoralej	apevec, ^	20:35
amoralej	i hope 0.20.0 to be enouth	20:35
amoralej	enough	20:35
ihrachys	amoralej, which bump	20:35
ihrachys	oh from .18 to .20?	20:36
amoralej	eventlet	20:36
amoralej	yes	20:36
ihrachys	I don't think .1 should have features	20:36
amoralej	hopefully...	20:36
ihrachys	(unless they do it the way you shouldn't do it; aka everyone does it)	20:36
amoralej	:D	20:36
ihrachys	amoralej, while we figure out upstream solution, we still need to package 0.20.0 for RDO. he's going to take care?	20:37
amoralej	ihrachys, with 0.20.0 it takes 30 secs	20:38
amoralej	apevec, ^	20:39
ihrachys	hm	20:40
ihrachys	so better but still a problem?	20:40
rdogerrit	rdo-trunk created openstack/pankoclient-distgit rpm-master: python-pankoclient: failed to build 5cf6011 https://review.rdoproject.org/r/7040	20:42
amoralej	yeah	20:42
ihrachys	in 20.1 i see resolve() function still doing resolver then hosts file	20:42
ihrachys	sorry 20.0	20:42
ihrachys	ah wait, wrong function	20:43
*** trozet has quit IRC		20:46
amoralej	ihrachys, 0.19.0 seems to work fine, it takes 2 seconds	20:50
ihrachys	interesting	20:50
* ihrachys reads diff		20:50
*** jbadiapa has joined #rdo		20:52
*** dneary has quit IRC		20:53
*** sterdnotshaken1 has joined #rdo		20:54
*** sterdnotshaken has quit IRC		20:54
ihrachys	ah I see why 30 secs now	20:56
ihrachys	in 0.20.0, we do resolve for each addr type without raising on first failure	20:57
ihrachys	in 0.19.0, if INET6 raises, we don't proceed for INET	20:57
ihrachys	hence half the time	20:57
ihrachys	still no explanation why 0.19.0 returns right away but 0.20.0 goes through timeout	20:59
amoralej	i'll add the info to the LP	20:59
*** Goneri has quit IRC		21:01
*** trozet has joined #rdo		21:04
ihrachys	oh I get it	21:05
ihrachys	quoting the commit message	21:05
ihrachys	Note that if the host can be resolved using /etc/hosts but only to one	21:05
ihrachys	of the two address families, we still attempt to contact the external	21:05
ihrachys	nameserver to resolve it in the other family.	21:05
ihrachys	I presume we don't have ipv6 entries in hosts files	21:05
amoralej	nop	21:05
ihrachys	hence 30 secs	21:05
ihrachys	with 0.20.0	21:05
ihrachys	so actually looks like the best deal is 0.19.0 :)	21:06
ihrachys	do we need 0.20.x exactly?	21:06
amoralej	oh, crap	21:06
amoralej	i dunno	21:06
*** trown is now known as trown\|outtypewww		21:06
ihrachys	hehe	21:06
amoralej	we need to check with jaosorior	21:06
amoralej	who has been working in the TLS stuff	21:06
ihrachys	this is the diff between last 0.18.x and 0.19: https://paste.fedoraproject.org/paste/BeoGM7RuDASUbCrq~rtnuV5M1UNdIGYhyRLivL9gydE=/	21:08
amoralej	ihrachys, https://github.com/PyMySQL/PyMySQL/issues/567	21:08
ihrachys	"green.urllib2: missing patched ssl module"	21:08
*** dustins has quit IRC		21:08
ihrachys	also "ssl: IMPORTANT DoS FIX do_handshake_connect=False in server accept(); Thanks to Garth Mollett"	21:08
amoralej	it'd be nice if that's what is needed	21:09
amoralej	we could move to 0.19.0	21:09
ihrachys	yeah if that's what we need only, it's in 0.18.4 already	21:09
ihrachys	ah wait maybe not	21:10
amoralej	ihrachys, it seems what is needed is https://github.com/eventlet/eventlet/commit/8e92d15d266b78720d4cc780cd2878377dcf7775	21:10
amoralej	which is in 0.20.0	21:10
ihrachys	nah first release including it is 0.20.0 :(	21:10
amoralej	that is the fix mentioned in the issue	21:10
ihrachys	yeah	21:10
amoralej	well, 0.20.0 is better that 0.20.1	21:11
amoralej	exactly 0.20.1 is double worst tat 0.20.0 :)	21:11
ihrachys	so... we need 0.20.0 because tls; 0.20.0 locks resolution for 30 secs; this is fixed in 0.21.0 but it has broken monotonic timer	21:11
ihrachys	tire fire	21:11
ihrachys	aka eventlet	21:11
amoralej	:)	21:12
ihrachys	we probably need 0.20.2 :)	21:12
amoralej	well i need to leave now, it's pretty late here	21:12
amoralej	could they create a fix release with that?	21:12
*** pblaho has quit IRC		21:12
amoralej	that'd be awsome	21:12
amoralej	awesome	21:13
amoralej	but i don't think so...	21:13
*** shardy has quit IRC		21:13
ihrachys	amoralej, maybe. but it's extensive backporting	21:14
ihrachys	I think Matthew talks to them re new 0.20.x	21:14
ihrachys	we'll see	21:14
amoralej	ok, we'll continue on monday	21:15
amoralej	ihrachys, have a nice weekend	21:15
ihrachys	amoralej, thanks, you too, you are awesome	21:16
*** trozet has quit IRC		21:18
*** amoralej is now known as amoralej\|off		21:21
*** Caterpillar2 is now known as Caterpillar		21:22
*** sasha2 has quit IRC		21:24
*** amuller has quit IRC		21:25
ihrachys	amoralej\|off, hmmm, wait, 0.21.x is also 30 secs?	21:26
ihrachys	ah right, it tries for ipv6	21:27
ihrachys	so we need entries in hosts file for it too	21:27
*** jkilpatr has quit IRC		21:28
ihrachys	I wonder what writes to /etc/hosts	21:28
*** panda is now known as panda\|off		21:30
apevec	ihrachys, could we just patch that order as a quickfix and rebuild 0.20.1 ?	21:49
apevec	adding ipv6 entries in hosts file could be workaround in tripeloci...	21:49
apevec	b/c reverting in buildlogs.centos.org where we currently host deps repo won't be easy	21:51
ihrachys	apevec, yeah, I posted re ipv6 entries in trello but what would you put there?	21:51
ihrachys	afaik tripleo doesn't deploy on ipv6	21:51
ihrachys	and putting fake addresses there is unsafe too	21:51
apevec	hmm right	21:51
ihrachys	because who knows how result of getaddrinfo would be used	21:52
ihrachys	I would try a backport yes	21:52
ihrachys	I beleive it's under your control right?	21:52
ihrachys	we don't have a repo	21:52
ihrachys	for eventlet	21:52
apevec	lemme create one, I'll fork fedora we have rebuilt in CBS	21:53
ihrachys	+	21:53
apevec	ihrachys, what is your funny github id again?	21:54
ihrachys	booxter	21:55
*** limao has joined #rdo		21:56
ihrachys	funny? well it's a lot better than svinota (author of pyroute2)	21:56
ihrachys	fyi svinota is like a derogatory 'huge pig' in Russian	21:56
ihrachys	the author is Russian I think so... :)	21:56
apevec	that fits Slavic sense of humor :)	21:57
*** chlong has quit IRC		21:58
apevec	ihrachys, distgit is https://github.com/rdo-common/python-eventlet	21:59
apevec	common-rdo branch	21:59
apevec	invite sent to you	21:59
apevec	this is 0.20.1 we have	21:59
*** limao_ has joined #rdo		21:59
apevec	patch there is leftover for prev version	21:59
apevec	it wasn't removed after rebase	22:00
ihrachys	ok will have a look	22:00
ihrachys	PR rights?	22:00
*** limao has quit IRC		22:00
ihrachys	sorry I mean "PRs right?"	22:01
apevec	hmm just a sec	22:01
apevec	ihrachys, accept invitation and you should have r/w i.e. push right	22:02
apevec	ihrachys, about your patch for oslo.msg, is it still worth to try it?	22:05
*** limao_ has quit IRC		22:06
*** limao has joined #rdo		22:07
ihrachys	apevec, and push? you are brave	22:07
ihrachys	apevec, it's worth to confirm that's what happens	22:07
apevec	it's won't trigger automated builds :)	22:07
ihrachys	not as smth to land	22:07
ihrachys	well 0.20.1 is beyond repairment anyway	22:08
apevec	ihrachys, I don't have access to amoralej's reproducer	22:08
apevec	is it?	22:08
apevec	just to change order?	22:08
ihrachys	so it won't help tripleo-ci to pass anyway	22:08
apevec	to try hosts first	22:08
ihrachys	thing is 0.20.1 always talks to resolver before /etc/hosts	22:08
ihrachys	oh well	22:08
apevec	so let's patch that	22:08
ihrachys	it will help in that it will do it for ipv4 only	22:08
ihrachys	so yeah	22:08
apevec	and rebuild 0.20.1-2	22:09
ihrachys	now that I think about it, we can check in gate	22:09
ihrachys	I am on patching the package	22:09
apevec	which review?	22:09
ihrachys	not sure how to test if it builds after I have smth	22:09
apevec	eventlet ?	22:10
apevec	you can try scratch build	22:10
ihrachys	apevec, I was thinking about spinning a depends-on patch for tripleo-ci pulling the oslo.messaging hack, but then tripleo-ci will still use released library	22:10
apevec	ihrachys, hmm right	22:10
apevec	so we need a temp repo with patched rpm	22:11
apevec	but also, tripleoci takes 2.5 h ...	22:11
ihrachys	doing mockbuild	22:11
ihrachys	apevec, not worth it, it won't be a fix anyway	22:11
apevec	think we can have bare min reproducer locally, now that we understand the bottleneck	22:12
apevec	just try resolving fake hostname ?	22:12
apevec	via eventlet	22:12
ihrachys	yeah, have an entry in /etc/hosts but break dns and then resolve the name	22:12
apevec	do you have 1liner?	22:13
ihrachys	not really	22:13
ihrachys	I complete the package and leave for today, so will need to wait ;)	22:13
*** vnogin has quit IRC		22:14
*** wolverineav has quit IRC		22:14
*** wolverin_ has joined #rdo		22:14
ihrachys	apevec, hm should I use master or common-rdo branch?	22:15
*** Caterpillar has quit IRC		22:15
apevec	common-rdo please	22:15
apevec	"dns resolve eventlet" -> first 3 google hits: breaks, not respecting /etc/hosts, broken ...	22:17
ihrachys	apevec, https://github.com/rdo-common/python-eventlet/pull/1	22:17
*** limao_ has joined #rdo		22:18
apevec	ihrachys, thanks, CBS build coming	22:18
ihrachys	\o/	22:18
*** rcernin has quit IRC		22:19
ihrachys	note it's PR, you should merge it	22:19
ihrachys	ok I see you did. I will drop off now. thanks for staying so late.	22:19
apevec	thank you!	22:19
*** limao__ has joined #rdo		22:19
*** limao has quit IRC		22:21
*** ohochman has joined #rdo		22:21
*** limao_ has quit IRC		22:22
*** itamarjp has quit IRC		22:25
*** ihrachys has quit IRC		22:25
*** itamarjp has joined #rdo		22:25
*** itamarjp has joined #rdo		22:25
*** tennis has quit IRC		22:28
*** limao__ has quit IRC		22:29
*** limao has joined #rdo		22:30
*** limao has quit IRC		22:30
*** limao has joined #rdo		22:31
EmilienM	apevec: hey, I'm back	22:31
apevec	oh man we can't get rid of you...	22:32
EmilienM	can I have a tl;dr?	22:32
apevec	tl;dr eventlet--	22:32
apevec	see https://trello.com/c/AJe0jbbX/176-tripleo-ci-neutron-server-create-subnet-timing-out for more	22:32
EmilienM	ok	22:32
apevec	I'm now sanity check 0.20.1-2 with Ihar's backport	22:32
EmilienM	wow this one was tough	22:33
apevec	but it is also ci config issue	22:33
apevec	OC networking is obviously misconfigured in tripleoci	22:33
apevec	looks like it's correct in oooq	22:34
EmilienM	weird	22:34
EmilienM	we might poke beekneemech on this thing	22:34
EmilienM	beekneemech: you still around?	22:34
EmilienM	really nice work from ihar and amoralej	22:37
apevec	indeed!	22:37
apevec	trouble is that this eventlet update was sitting for a month in pending repo and amoralej did all the tests incl. oooq I think	22:38
apevec	but we missed old tripleoci	22:38
EmilienM	apevec: can we make sure to write all details in the trello card about what needs to be changed in TripleO CI, though I'm not sure it's worth it, since we're switching jobs into oooq, even in promotion pipeline	22:40
apevec	yeah	22:40
EmilienM	though I'm curious the diff between oooq and ooo-ci -- I want to make sure we don't loose coverage in oooq	22:41
apevec	EmilienM, ++ that !	22:41
apevec	there is definitely diff in OC deploy env between ovb-ha tripleoci vs oooq	22:41
apevec	that needs to be looked at by tripeloci squad	22:42
*** tennis has joined #rdo		22:42
*** pnavarro has quit IRC		22:42
*** limao has quit IRC		22:42
EmilienM	apevec: I commented	22:43
apevec	ok I have 2line reproducer	22:43
*** limao has joined #rdo		22:43
apevec	oops I killed my dns for testing and trello is gone :)	22:44
*** rlandy has quit IRC		22:47
EmilienM	I'm out, good night	22:49
*** limao has quit IRC		22:52
*** limao has joined #rdo		22:53
apevec	eventlet 0.20.1-2 passed my sanity check, pushing it to pike-testing	22:58
amoralej\|off	apevec, if still around i can add your keys to the environment i'm using to reproduce	22:59
apevec	amoralej\|off, why are you still around :)	23:00
amoralej\|off	:)	23:00
apevec	amoralej\|off, you still keep that env?	23:00
apevec	will infra not get mad?	23:00
amoralej\|off	i saw some activity in the trello card	23:00
amoralej\|off	it's not that one	23:00
amoralej\|off	i'm using the one that trown\|outtypewww built	23:00
amoralej\|off	with oooq	23:00
apevec	what is your env ?	23:00
apevec	ah cool	23:00
amoralej\|off	in rdo-cloud	23:00
*** amoralej\|off is now known as amoralej		23:00
amoralej	i already returned the one in infra	23:01
amoralej	once i realized of the dns failure, it's easy to reproduce even in an allinone	23:01
amoralej	apevec, do you want me to trigger weirdo on new package?	23:02
amoralej	on pike-testing	23:02
apevec	amoralej, yes, it's in pike-candidate now	23:02
apevec	it will take some time to reach buildlogs...	23:02
apevec	now that's interesing, on f25, I cannot reproduce the issue with fedora build of 0.20.1	23:04
apevec	but it does reproduce when I install 0.20.1-1 from CBS	23:05
apevec	weird	23:05
apevec	anyway, 0.20.1-2 works	23:05
*** sterdnotshaken1 has quit IRC		23:05
apevec	amoralej, hopefully, in the morning will see promotion :)	23:05
amoralej	are we consistent?	23:06
amoralej	i didn't check	23:06
apevec	well we have recent consistent	23:06
apevec	and it's == current	23:06
apevec	so we are	23:06
rdogerrit	Alfredo Moralejo proposed rdoinfo master: [DNM] success test case for auto tagging https://review.rdoproject.org/r/6486	23:07
amoralej	^ will run weirdo with new eventlet	23:07
amoralej	in experimental	23:07
apevec	we could also unpin neutron now I think	23:07
apevec	https://review.rdoproject.org/r/7033	23:07
apevec	yes/no ?	23:08
apevec	oh nice!	23:08
apevec	re. deps.yml thing	23:08
*** kgiusti has left #rdo		23:09
amoralej	yeah	23:09
amoralej	apevec, the job to watch is weirdo-update-buildsys-tags , no the gate-weirdo-*	23:09
amoralej	i din't wait for ihar's vote...	23:10
*** toure is now known as toure\|gone		23:10
apevec	Ihar is off for today, and so am I now, I'll check in the moring	23:12
apevec	amoralej, enjoy w/e!	23:12
*** apevec has quit IRC		23:12
amoralej	ops, we broke weirdo jobs....	23:13
*** limao has quit IRC		23:13
*** limao has joined #rdo		23:14
rdogerrit	Alfredo Moralejo created rdo-infra/ci-config master: Replace tabs by spaces https://review.rdoproject.org/r/7041	23:15
rdogerrit	Merged rdo-infra/ci-config master: Replace tabs by spaces https://review.rdoproject.org/r/7041	23:18
*** gregwork has quit IRC		23:23
*** gregwork_ has joined #rdo		23:24
rdogerrit	Alfredo Moralejo proposed rdoinfo master: [DNM] success test case for auto tagging https://review.rdoproject.org/r/6486	23:29
rdogerrit	Merged rdoinfo master: Revert "Pin Neutron to last-known-good-enough OVB HA result" https://review.rdoproject.org/r/7033	23:32
*** limao has quit IRC		23:35
*** rpioso has quit IRC		23:36
*** wolverin_ has quit IRC		23:36
*** wolverineav has joined #rdo		23:36
*** percevalbot has quit IRC		23:39
*** limao has joined #rdo		23:39
*** wolverineav has quit IRC		23:42
*** bandini has quit IRC		23:42
*** bandini has joined #rdo		23:42
*** percevalbot` has joined #rdo		23:42
*** eaguilar has joined #rdo		23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!