Tuesday, 2020-02-18

*** errr has quit IRC00:00
*** errr has joined #openstack-ansible00:04
*** errr has joined #openstack-ansible00:05
*** errr has quit IRC00:06
*** errr has joined #openstack-ansible00:08
*** errr has joined #openstack-ansible00:10
*** ahosam has quit IRC00:11
*** errr has quit IRC00:11
*** Matias has joined #openstack-ansible00:40
*** Matias has left #openstack-ansible00:42
*** errr has joined #openstack-ansible01:00
*** errr has joined #openstack-ansible01:05
*** errr has joined #openstack-ansible01:09
*** errr has quit IRC01:10
*** errr has joined #openstack-ansible01:12
*** errr has quit IRC01:13
*** errr has joined #openstack-ansible01:14
*** errr has quit IRC01:15
*** errr has joined #openstack-ansible01:17
*** errr has joined #openstack-ansible01:19
*** errr has joined #openstack-ansible01:20
*** errr has quit IRC01:21
*** errr has joined #openstack-ansible01:22
*** errr has joined #openstack-ansible01:25
*** errr has joined #openstack-ansible01:26
*** errr has quit IRC01:27
*** errr has joined #openstack-ansible01:28
*** errr has quit IRC01:29
*** jbadiapa has quit IRC01:29
*** errr has joined #openstack-ansible01:31
*** dave-mccowan has quit IRC01:32
*** errr has joined #openstack-ansible01:33
*** errr has quit IRC01:34
*** errr has joined #openstack-ansible01:35
*** errr has quit IRC01:36
*** errr has joined #openstack-ansible01:38
*** errr has quit IRC01:39
*** errr has joined #openstack-ansible01:40
*** errr has quit IRC01:41
*** errr has joined #openstack-ansible01:42
*** errr has quit IRC01:44
*** errr has joined #openstack-ansible01:45
*** errr has quit IRC01:45
*** errr has joined #openstack-ansible01:49
*** errr has joined #openstack-ansible01:51
*** errr has quit IRC01:53
*** errr has joined #openstack-ansible01:54
*** errr has quit IRC01:55
*** errr has joined #openstack-ansible01:56
*** errr has joined #openstack-ansible02:00
*** errr has joined #openstack-ansible02:03
*** errr has quit IRC02:04
*** errr has joined #openstack-ansible02:05
*** errr has quit IRC02:06
*** errr has joined #openstack-ansible02:07
*** errr has quit IRC02:08
*** errr has joined #openstack-ansible02:10
*** errr has quit IRC02:10
*** errr has joined #openstack-ansible02:12
*** errr has quit IRC02:13
*** errr has joined #openstack-ansible02:14
*** errr has quit IRC02:15
*** errr has joined #openstack-ansible02:19
*** errr has joined #openstack-ansible02:22
*** errr has joined #openstack-ansible02:23
*** errr has quit IRC02:24
*** errr has joined #openstack-ansible02:26
*** errr has quit IRC02:27
*** errr has joined #openstack-ansible02:28
*** errr has quit IRC02:29
*** errr has joined #openstack-ansible02:30
*** errr has quit IRC02:31
*** errr has joined #openstack-ansible02:33
*** errr has joined #openstack-ansible02:36
*** errr has quit IRC02:37
*** errr has joined #openstack-ansible02:38
*** errr has quit IRC02:39
*** errr has joined #openstack-ansible02:40
*** errr has quit IRC02:41
*** errr has joined #openstack-ansible02:43
*** errr has joined #openstack-ansible02:45
*** errr has joined #openstack-ansible02:49
*** errr has quit IRC02:50
*** errr has joined #openstack-ansible02:51
*** errr has quit IRC02:52
*** errr has joined #openstack-ansible02:54
*** errr has quit IRC02:55
*** errr has joined #openstack-ansible02:56
*** errr has quit IRC02:57
*** errr has joined #openstack-ansible02:58
*** errr has joined #openstack-ansible02:59
*** errr has quit IRC03:00
*** errr has joined #openstack-ansible03:02
*** errr has quit IRC03:02
*** errr has joined #openstack-ansible03:12
*** errr has quit IRC03:13
*** errr has joined #openstack-ansible03:27
*** errr has joined #openstack-ansible03:30
*** errr has quit IRC03:31
*** errr has joined #openstack-ansible03:32
*** errr has quit IRC03:33
*** errr has joined #openstack-ansible03:35
*** errr has joined #openstack-ansible03:37
*** errr has joined #openstack-ansible03:39
*** errr has quit IRC03:40
*** errr has joined #openstack-ansible03:42
*** errr has quit IRC03:43
*** errr has joined #openstack-ansible03:45
*** errr has joined #openstack-ansible03:47
*** errr has quit IRC03:48
*** errr has joined #openstack-ansible03:49
*** errr has quit IRC03:50
*** errr has joined #openstack-ansible03:51
*** errr has quit IRC03:52
*** errr has joined #openstack-ansible03:54
*** errr has quit IRC03:55
*** Neurognostic has joined #openstack-ansible03:55
*** errr has joined #openstack-ansible03:57
*** errr has joined #openstack-ansible03:58
*** errr has quit IRC03:58
*** errr has joined #openstack-ansible03:59
*** errr has quit IRC03:59
*** errr has joined #openstack-ansible04:01
*** errr has quit IRC04:01
*** errr has joined #openstack-ansible04:02
*** errr has quit IRC04:03
*** errr has joined #openstack-ansible04:04
*** errr has quit IRC04:05
*** errr has joined #openstack-ansible04:06
*** errr has quit IRC04:07
*** errr has joined #openstack-ansible04:07
*** errr has joined #openstack-ansible04:10
*** udesale has joined #openstack-ansible04:10
*** errr has quit IRC04:10
*** errr has joined #openstack-ansible04:12
*** errr has joined #openstack-ansible04:16
*** errr has quit IRC04:17
*** errr has joined #openstack-ansible04:18
*** errr has quit IRC04:19
*** errr has joined #openstack-ansible04:20
*** errr has quit IRC04:21
*** errr has joined #openstack-ansible04:23
*** errr has quit IRC04:24
*** errr has joined #openstack-ansible04:25
*** errr has quit IRC04:26
*** errr has joined #openstack-ansible04:28
*** errr has quit IRC04:29
*** errr has joined #openstack-ansible04:30
*** errr has quit IRC04:31
*** errr has joined #openstack-ansible04:33
*** errr has quit IRC04:34
*** errr has joined #openstack-ansible04:35
*** errr has quit IRC04:36
*** errr has joined #openstack-ansible04:37
*** errr has joined #openstack-ansible04:42
*** redrobot has quit IRC04:43
*** errr has joined #openstack-ansible04:44
*** errr has quit IRC04:45
*** errr has joined #openstack-ansible04:46
*** errr has quit IRC04:47
*** errr has joined #openstack-ansible04:49
*** errr has quit IRC04:49
*** errr has joined #openstack-ansible04:51
*** errr has joined #openstack-ansible04:59
*** errr has quit IRC05:00
*** errr has joined #openstack-ansible05:01
*** errr has quit IRC05:02
*** errr has joined #openstack-ansible05:03
*** errr has quit IRC05:04
*** errr has joined #openstack-ansible05:06
*** errr has joined #openstack-ansible05:10
*** shyamb has joined #openstack-ansible05:11
*** errr has quit IRC05:11
*** shyamb has quit IRC05:12
*** shyamb has joined #openstack-ansible05:12
*** errr has joined #openstack-ansible05:12
*** errr has quit IRC05:13
*** errr has joined #openstack-ansible05:15
*** errr has quit IRC05:17
*** errr has joined #openstack-ansible05:18
*** dave-mccowan has joined #openstack-ansible05:18
*** errr has quit IRC05:19
*** errr has joined #openstack-ansible05:20
*** errr has quit IRC05:21
*** errr has joined #openstack-ansible05:23
*** errr has quit IRC05:24
*** errr has joined #openstack-ansible05:25
*** errr has quit IRC05:26
*** errr has joined #openstack-ansible05:27
*** errr has quit IRC05:28
*** errr has joined #openstack-ansible05:30
*** errr has joined #openstack-ansible05:32
*** errr has quit IRC05:33
*** evrardjp has quit IRC05:34
*** errr has joined #openstack-ansible05:34
*** evrardjp has joined #openstack-ansible05:34
*** errr has quit IRC05:35
*** errr has joined #openstack-ansible05:36
*** errr has quit IRC05:36
*** errr has joined #openstack-ansible05:38
*** shyamb has quit IRC05:39
*** errr has quit IRC05:39
*** errr has joined #openstack-ansible05:40
*** errr has quit IRC05:41
*** errr has joined #openstack-ansible05:43
*** Neurognostic has quit IRC05:43
*** errr has quit IRC05:44
*** errr has joined #openstack-ansible05:45
*** errr has quit IRC05:46
*** errr has joined #openstack-ansible05:47
*** errr has quit IRC05:49
*** udesale_ has joined #openstack-ansible05:51
*** udesale has quit IRC05:52
*** errr has joined #openstack-ansible05:53
*** errr has joined #openstack-ansible05:55
*** errr has quit IRC05:56
*** errr has joined #openstack-ansible05:58
*** errr has quit IRC05:59
*** errr has joined #openstack-ansible06:00
*** errr has quit IRC06:01
*** raukadah is now known as chandankumar06:02
*** errr has joined #openstack-ansible06:02
*** errr has quit IRC06:03
*** errr has joined #openstack-ansible06:05
*** errr has quit IRC06:06
*** errr has joined #openstack-ansible06:06
*** shyamb has joined #openstack-ansible06:07
*** errr has quit IRC06:07
*** errr has joined #openstack-ansible06:09
*** errr has quit IRC06:09
*** errr has joined #openstack-ansible06:11
*** errr has quit IRC06:12
*** errr has joined #openstack-ansible06:13
*** rgogunskiy has joined #openstack-ansible06:14
*** errr has quit IRC06:14
*** errr has joined #openstack-ansible06:18
*** errr has joined #openstack-ansible06:20
*** errr has quit IRC06:21
*** errr has joined #openstack-ansible06:22
*** elenalindq has joined #openstack-ansible06:23
*** errr has quit IRC06:23
*** errr has joined #openstack-ansible06:24
*** errr has quit IRC06:25
*** errr has joined #openstack-ansible06:27
*** redrobot has joined #openstack-ansible06:27
*** errr has quit IRC06:27
*** errr has joined #openstack-ansible06:29
*** errr has quit IRC06:30
*** errr has joined #openstack-ansible06:31
*** errr has quit IRC06:32
*** errr has joined #openstack-ansible06:34
*** errr has joined #openstack-ansible06:35
*** errr has quit IRC06:36
*** errr has joined #openstack-ansible06:37
*** errr has quit IRC06:38
*** errr has joined #openstack-ansible06:39
*** errr has quit IRC06:40
*** errr has joined #openstack-ansible06:42
*** errr has quit IRC06:42
*** errr has joined #openstack-ansible06:47
*** shyamb has quit IRC06:47
*** errr has quit IRC06:48
*** errr has joined #openstack-ansible06:49
*** errr has quit IRC06:50
*** errr has joined #openstack-ansible06:52
*** errr has quit IRC06:52
*** errr has joined #openstack-ansible06:54
*** errr has quit IRC06:55
*** errr has joined #openstack-ansible06:56
*** errr has quit IRC06:57
*** errr has joined #openstack-ansible06:59
*** errr has quit IRC07:00
*** errr has joined #openstack-ansible07:01
*** errr has quit IRC07:01
*** sluna has quit IRC07:02
*** errr has joined #openstack-ansible07:02
*** sluna has joined #openstack-ansible07:02
*** rgogunskiy has quit IRC07:02
*** errr has quit IRC07:03
*** errr has joined #openstack-ansible07:04
*** shyamb has joined #openstack-ansible07:05
*** errr has quit IRC07:05
*** errr has joined #openstack-ansible07:06
*** errr has quit IRC07:07
*** errr has joined #openstack-ansible07:07
*** errr has quit IRC07:08
jannoI just added a new compute according to https://docs.openstack.org/openstack-ansible/stein/admin/scale-environment.html#add-a-compute-host to our cluster07:08
*** rgogunskiy has joined #openstack-ansible07:09
jannobut it is not recognized as hypervisor by openstack07:09
*** errr has joined #openstack-ansible07:10
*** errr has quit IRC07:11
*** errr has joined #openstack-ansible07:12
*** errr has quit IRC07:13
*** errr has joined #openstack-ansible07:14
*** rgogunskiy has quit IRC07:15
*** bhyrted has quit IRC07:15
*** errr has quit IRC07:15
*** miloa has joined #openstack-ansible07:16
*** errr has joined #openstack-ansible07:17
*** errr has quit IRC07:17
*** errr has joined #openstack-ansible07:19
*** errr has quit IRC07:20
*** errr has joined #openstack-ansible07:21
*** errr has quit IRC07:22
*** errr has joined #openstack-ansible07:24
*** errr has quit IRC07:25
*** errr has joined #openstack-ansible07:26
*** errr has joined #openstack-ansible07:28
*** errr has quit IRC07:29
*** rgogunskiy has joined #openstack-ansible07:34
*** errr has joined #openstack-ansible07:52
*** errr has quit IRC07:52
*** errr has joined #openstack-ansible07:53
*** errr has quit IRC07:54
*** shyamb has quit IRC07:55
*** errr has joined #openstack-ansible07:55
*** errr has quit IRC07:56
*** rpittau|afk is now known as rpittau07:58
*** errr has joined #openstack-ansible07:58
*** errr has quit IRC07:59
*** errr has joined #openstack-ansible08:01
*** errr has quit IRC08:02
*** errr has joined #openstack-ansible08:03
*** errr has quit IRC08:03
*** errr has joined #openstack-ansible08:04
*** errr has quit IRC08:05
*** errr has joined #openstack-ansible08:06
*** errr has quit IRC08:07
*** errr has joined #openstack-ansible08:08
*** errr has quit IRC08:10
*** errr has joined #openstack-ansible08:11
*** errr has quit IRC08:12
*** errr has joined #openstack-ansible08:13
*** errr has quit IRC08:13
*** errr has joined #openstack-ansible08:14
*** errr has quit IRC08:15
*** errr has joined #openstack-ansible08:17
*** errr has quit IRC08:17
*** errr has joined #openstack-ansible08:18
*** errr has quit IRC08:18
*** errr has joined #openstack-ansible08:20
*** errr has quit IRC08:21
*** errr has joined #openstack-ansible08:22
*** errr has quit IRC08:23
*** errr has joined #openstack-ansible08:24
*** errr has quit IRC08:25
*** johanssone has quit IRC08:28
*** errr has joined #openstack-ansible08:29
*** pcaruana has joined #openstack-ansible08:29
*** errr has quit IRC08:30
*** errr has joined #openstack-ansible08:31
*** errr has quit IRC08:32
*** johanssone has joined #openstack-ansible08:32
*** tosky has joined #openstack-ansible08:32
*** errr has joined #openstack-ansible08:33
*** errr has quit IRC08:34
*** errr has joined #openstack-ansible08:36
*** errr has quit IRC08:37
*** errr has joined #openstack-ansible08:38
*** errr has quit IRC08:38
*** errr has joined #openstack-ansible08:39
*** errr has quit IRC08:40
*** errr has joined #openstack-ansible08:41
*** errr has quit IRC08:42
*** cshen has joined #openstack-ansible08:43
*** errr has joined #openstack-ansible08:44
*** errr has quit IRC08:45
*** errr has joined #openstack-ansible08:46
*** errr has quit IRC08:47
*** errr has joined #openstack-ansible08:51
*** errr has quit IRC08:52
*** shyamb has joined #openstack-ansible08:53
*** rgogunskiy has quit IRC08:56
*** errr has joined #openstack-ansible08:56
*** errr has quit IRC08:57
*** errr has joined #openstack-ansible08:59
*** errr has quit IRC09:00
*** errr has joined #openstack-ansible09:02
*** rgogunskiy has joined #openstack-ansible09:02
*** errr has quit IRC09:03
*** errr has joined #openstack-ansible09:04
*** errr has quit IRC09:06
*** errr has joined #openstack-ansible09:08
*** errr has quit IRC09:08
*** errr has joined #openstack-ansible09:10
*** errr has quit IRC09:11
*** errr has joined #openstack-ansible09:12
*** errr has quit IRC09:14
*** errr has joined #openstack-ansible09:15
*** rgogunskiy has quit IRC09:15
*** errr has quit IRC09:16
*** errr has joined #openstack-ansible09:17
*** errr has quit IRC09:17
*** errr has joined #openstack-ansible09:18
*** errr has quit IRC09:19
*** errr has joined #openstack-ansible09:20
*** errr has quit IRC09:21
*** errr has joined #openstack-ansible09:23
*** errr has quit IRC09:23
*** rgogunskiy has joined #openstack-ansible09:23
*** errr has joined #openstack-ansible09:25
*** errr has quit IRC09:26
*** errr has joined #openstack-ansible09:27
*** errr has quit IRC09:28
*** errr has joined #openstack-ansible09:29
*** pcaruana has quit IRC09:30
*** errr has quit IRC09:30
*** errr has joined #openstack-ansible09:32
*** errr has quit IRC09:32
*** errr has joined #openstack-ansible09:33
*** errr has quit IRC09:34
*** errr has joined #openstack-ansible09:35
*** errr has quit IRC09:35
*** errr has joined #openstack-ansible09:36
*** errr has quit IRC09:37
*** errr has joined #openstack-ansible09:38
*** errr has quit IRC09:39
*** errr has joined #openstack-ansible09:41
*** errr has quit IRC09:42
*** shyamb has quit IRC09:42
*** shyam89 has joined #openstack-ansible09:42
*** errr has joined #openstack-ansible09:43
*** errr has quit IRC09:44
*** errr has joined #openstack-ansible09:44
*** errr has quit IRC09:45
*** errr has joined #openstack-ansible09:48
*** errr has quit IRC09:48
*** errr has joined #openstack-ansible09:50
*** errr has quit IRC09:51
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Exposed Kibana elastic endpoint  https://review.opendev.org/70695009:53
*** shyam89 has quit IRC09:53
*** errr has joined #openstack-ansible09:53
*** errr has quit IRC09:54
*** errr has joined #openstack-ansible09:55
*** errr has quit IRC09:56
*** shyamb has joined #openstack-ansible09:57
*** errr has joined #openstack-ansible09:57
*** errr has quit IRC09:58
*** sshnaidm|afk is now known as sshnaidm09:59
*** errr has joined #openstack-ansible10:00
*** errr has quit IRC10:01
*** errr has joined #openstack-ansible10:02
*** errr has quit IRC10:02
*** errr has joined #openstack-ansible10:06
*** errr has quit IRC10:07
*** errr has joined #openstack-ansible10:09
*** shyamb has quit IRC10:09
*** errr has quit IRC10:09
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Exposed beat logging levels  https://review.opendev.org/70766110:11
*** errr has joined #openstack-ansible10:11
*** rgogunskiy has quit IRC10:11
*** errr has quit IRC10:12
*** rgogunskiy has joined #openstack-ansible10:12
*** rgogunskiy has quit IRC10:17
*** shyamb has joined #openstack-ansible10:17
*** errr has joined #openstack-ansible10:27
*** pcaruana has joined #openstack-ansible10:28
*** errr has quit IRC10:28
*** errr has joined #openstack-ansible10:29
*** errr has joined #openstack-ansible10:30
*** errr has quit IRC10:31
*** errr has joined #openstack-ansible10:32
*** errr has quit IRC10:33
*** errr has joined #openstack-ansible10:35
*** errr has quit IRC10:36
*** errr has joined #openstack-ansible10:37
*** errr has quit IRC10:37
*** errr has joined #openstack-ansible10:38
*** errr has quit IRC10:39
*** errr has joined #openstack-ansible10:41
*** errr has quit IRC10:42
*** errr has joined #openstack-ansible10:43
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Optional subdivision of elastic-logstash group  https://review.opendev.org/70784910:44
*** errr has quit IRC10:44
*** pcaruana has quit IRC10:45
*** errr has joined #openstack-ansible10:46
*** errr has quit IRC10:46
*** errr has joined #openstack-ansible10:48
*** errr has quit IRC10:49
*** errr has joined #openstack-ansible10:50
*** errr has quit IRC10:51
*** shyamb has quit IRC10:51
*** errr has joined #openstack-ansible10:52
*** errr has quit IRC10:53
*** shyamb has joined #openstack-ansible10:55
*** pcaruana has joined #openstack-ansible10:55
*** errr has joined #openstack-ansible10:55
*** errr has quit IRC10:56
*** udesale_ has quit IRC10:57
*** errr has joined #openstack-ansible10:58
*** errr has quit IRC10:58
*** errr has joined #openstack-ansible11:00
*** errr has quit IRC11:00
*** errr has joined #openstack-ansible11:01
*** errr has joined #openstack-ansible11:03
*** errr has quit IRC11:03
*** errr has joined #openstack-ansible11:04
*** errr has quit IRC11:05
*** rgogunskiy has joined #openstack-ansible11:06
*** errr has joined #openstack-ansible11:07
*** errr has joined #openstack-ansible11:09
*** errr has quit IRC11:10
*** errr has joined #openstack-ansible11:11
*** errr has quit IRC11:12
*** errr has joined #openstack-ansible11:14
*** errr has quit IRC11:14
*** errr has joined #openstack-ansible11:16
*** shyam89 has joined #openstack-ansible11:16
*** errr has joined #openstack-ansible11:17
*** shyamb has quit IRC11:17
*** bhyrted has joined #openstack-ansible11:17
bhyrtedTASK [os_octavia : Drop octavia Config(s)] ************************************************************************************************************************************************************************************************************************************11:17
bhyrtedfatal: [infra1_octavia_server_container-601acf9d]: FAILED! => {"msg": "No first item, sequence was empty."}11:17
bhyrtedanyone faced with such error?11:17
*** errr has quit IRC11:18
*** errr has joined #openstack-ansible11:19
*** errr has quit IRC11:20
*** errr has joined #openstack-ansible11:22
*** errr has quit IRC11:22
*** errr has joined #openstack-ansible11:24
*** errr has quit IRC11:25
*** errr has joined #openstack-ansible11:26
*** errr has quit IRC11:27
*** errr has joined #openstack-ansible11:29
*** errr has quit IRC11:29
*** errr has joined #openstack-ansible11:31
*** errr has quit IRC11:32
*** errr has joined #openstack-ansible11:33
*** errr has quit IRC11:34
*** errr has joined #openstack-ansible11:36
*** errr has quit IRC11:37
*** errr has joined #openstack-ansible11:38
*** errr has quit IRC11:39
*** errr has joined #openstack-ansible11:40
*** errr has quit IRC11:41
*** errr has joined #openstack-ansible11:43
*** errr has quit IRC11:43
*** errr has joined #openstack-ansible11:45
*** andrewbonney has joined #openstack-ansible11:45
*** errr has quit IRC11:46
*** errr has joined #openstack-ansible11:48
*** errr has joined #openstack-ansible11:50
*** errr has joined #openstack-ansible11:51
*** errr has quit IRC11:52
*** errr has joined #openstack-ansible11:53
jrosserbhyrted: that task is trying to create the octavia config file with a template11:54
*** errr has quit IRC11:54
jrosserso likley something in the template is failing, and if it's talking about a 'sequence' then i'd first be looking at any 'for' loops in the template11:55
*** errr has joined #openstack-ansible11:56
bhyrtedthanks will look into that ;-)11:56
*** errr has quit IRC11:57
*** errr has joined #openstack-ansible11:58
*** errr has quit IRC11:59
*** errr has joined #openstack-ansible12:00
*** errr has quit IRC12:02
*** errr has joined #openstack-ansible12:03
*** errr has joined #openstack-ansible12:06
*** errr has quit IRC12:06
*** rpittau is now known as rpittau|bbl12:07
*** errr has joined #openstack-ansible12:08
*** errr has quit IRC12:09
*** errr has joined #openstack-ansible12:10
*** errr has quit IRC12:10
*** errr has joined #openstack-ansible12:12
*** errr has quit IRC12:12
*** errr has joined #openstack-ansible12:16
*** errr has quit IRC12:17
*** errr has joined #openstack-ansible12:18
*** errr has quit IRC12:19
*** errr has joined #openstack-ansible12:20
*** errr has quit IRC12:21
*** errr has joined #openstack-ansible12:22
*** errr has quit IRC12:23
*** errr has joined #openstack-ansible12:24
*** errr has quit IRC12:25
*** errr has joined #openstack-ansible12:26
*** errr has quit IRC12:27
*** ansmith has quit IRC12:27
*** errr has joined #openstack-ansible12:29
*** shyam89 has quit IRC12:29
*** errr has quit IRC12:29
*** errr has joined #openstack-ansible12:31
*** rgogunskiy has quit IRC12:32
*** errr has quit IRC12:32
*** rgogunskiy has joined #openstack-ansible12:32
*** errr has joined #openstack-ansible12:33
*** errr has quit IRC12:34
*** errr has joined #openstack-ansible12:36
*** errr has quit IRC12:36
*** errr has joined #openstack-ansible12:37
*** errr has quit IRC12:37
*** errr has joined #openstack-ansible12:37
*** errr has joined #openstack-ansible12:38
*** errr has quit IRC12:39
*** errr has joined #openstack-ansible12:41
*** errr has quit IRC12:42
*** errr has joined #openstack-ansible12:43
*** errr has quit IRC12:44
*** errr has joined #openstack-ansible12:45
*** errr has quit IRC12:47
*** errr has joined #openstack-ansible12:48
*** errr has quit IRC12:49
*** errr has joined #openstack-ansible12:51
*** errr has quit IRC12:52
*** errr has joined #openstack-ansible12:53
*** errr has quit IRC12:54
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Stop haproxy service on standalone network nodes  https://review.opendev.org/70837812:54
*** errr has joined #openstack-ansible12:56
*** janno has quit IRC12:57
*** janno has joined #openstack-ansible12:59
*** rh-jelabarre has joined #openstack-ansible13:02
*** rpittau|bbl is now known as rpittau13:06
*** errr has joined #openstack-ansible13:08
*** cshen_ has joined #openstack-ansible13:09
*** errr has quit IRC13:09
*** errr has joined #openstack-ansible13:11
*** errr has quit IRC13:12
*** cshen has quit IRC13:12
*** errr has joined #openstack-ansible13:13
*** errr has quit IRC13:14
*** ansmith has joined #openstack-ansible13:14
*** errr has joined #openstack-ansible13:15
*** errr has quit IRC13:16
*** rgogunskiy has quit IRC13:19
*** errr has joined #openstack-ansible13:19
*** errr has quit IRC13:20
*** errr has joined #openstack-ansible13:21
*** rgogunskiy has joined #openstack-ansible13:23
*** errr has quit IRC13:23
*** errr has joined #openstack-ansible13:24
*** errr has quit IRC13:25
*** errr has joined #openstack-ansible13:27
*** errr has quit IRC13:27
*** errr has joined #openstack-ansible13:28
*** errr has quit IRC13:28
*** rgogunskiy has quit IRC13:29
*** errr has joined #openstack-ansible13:30
*** errr has quit IRC13:31
*** errr has joined #openstack-ansible13:32
*** errr has quit IRC13:32
*** errr has joined #openstack-ansible13:38
*** errr has quit IRC13:38
*** errr has joined #openstack-ansible13:39
*** errr has quit IRC13:39
*** jbadiapa has joined #openstack-ansible13:41
*** errr has joined #openstack-ansible13:41
*** errr has quit IRC13:42
*** errr has joined #openstack-ansible13:43
*** errr has quit IRC13:44
*** errr has joined #openstack-ansible13:46
*** errr has joined #openstack-ansible13:47
*** errr has quit IRC13:47
*** errr has joined #openstack-ansible13:49
*** errr has quit IRC13:50
*** errr has joined #openstack-ansible13:51
*** errr has quit IRC13:52
*** errr has joined #openstack-ansible13:56
*** miloa has quit IRC13:56
*** errr has quit IRC13:56
*** errr has joined #openstack-ansible13:58
*** errr has quit IRC13:59
*** errr has joined #openstack-ansible14:00
*** errr has quit IRC14:01
*** udesale has joined #openstack-ansible14:02
*** errr has joined #openstack-ansible14:03
*** errr has quit IRC14:04
*** errr has joined #openstack-ansible14:05
*** errr has quit IRC14:06
*** errr has joined #openstack-ansible14:06
*** errr has quit IRC14:07
*** errr has joined #openstack-ansible14:09
*** errr has quit IRC14:10
*** errr has joined #openstack-ansible14:11
*** errr has quit IRC14:12
*** errr has joined #openstack-ansible14:12
*** errr has quit IRC14:13
*** pcaruana has quit IRC14:14
*** errr has joined #openstack-ansible14:15
*** errr has quit IRC14:15
*** errr has joined #openstack-ansible14:16
*** errr has quit IRC14:16
*** CeeMac has joined #openstack-ansible14:17
*** errr has joined #openstack-ansible14:18
*** rgogunskiy has joined #openstack-ansible14:18
*** errr has quit IRC14:19
*** errr has joined #openstack-ansible14:20
*** errr has quit IRC14:22
*** errr has joined #openstack-ansible14:23
*** errr has quit IRC14:23
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add compute node deployment script  https://review.opendev.org/70649114:26
*** owalsh_ is now known as owalsh14:26
*** errr has joined #openstack-ansible14:27
*** errr has quit IRC14:28
*** errr has joined #openstack-ansible14:29
*** errr has quit IRC14:30
*** errr has joined #openstack-ansible14:32
*** errr has quit IRC14:32
*** errr has joined #openstack-ansible14:34
*** errr has quit IRC14:35
*** errr has joined #openstack-ansible14:36
*** errr has quit IRC14:37
*** errr has joined #openstack-ansible14:41
*** udesale has quit IRC14:41
*** errr has quit IRC14:41
*** zigo has quit IRC14:42
*** errr has joined #openstack-ansible14:43
*** errr has quit IRC14:44
*** errr has joined #openstack-ansible14:45
*** errr has quit IRC14:46
*** johanssone has quit IRC15:02
*** pcaruana has joined #openstack-ansible15:03
*** ysastri has joined #openstack-ansible15:07
*** johanssone has joined #openstack-ansible15:08
*** errr has joined #openstack-ansible15:12
*** errr has quit IRC15:14
*** spatel has joined #openstack-ansible15:27
*** errr has joined #openstack-ansible15:27
*** errr has quit IRC15:28
*** errr has joined #openstack-ansible15:35
*** errr has quit IRC15:36
*** errr has joined #openstack-ansible15:38
openstackgerritErik Berg proposed openstack/openstack-ansible stable/rocky: prefer distro packages on rocky/bionic  https://review.opendev.org/70842015:38
*** errr has quit IRC15:38
openstackgerritErik Berg proposed openstack/openstack-ansible stable/rocky: prefer ceph distro packages on rocky/bionic  https://review.opendev.org/70842015:39
*** errr has joined #openstack-ansible15:40
*** errr has quit IRC15:41
*** rgogunskiy has quit IRC15:41
*** macz_ has joined #openstack-ansible15:42
*** errr has joined #openstack-ansible15:51
*** udesale has joined #openstack-ansible15:51
*** errr has quit IRC15:52
*** pcaruana has quit IRC15:53
*** errr has joined #openstack-ansible15:53
*** errr has quit IRC15:54
*** goldenfri has joined #openstack-ansible15:54
*** errr has joined #openstack-ansible15:55
*** pcaruana has joined #openstack-ansible15:55
*** errr has quit IRC15:56
*** errr has joined #openstack-ansible15:58
*** errr has quit IRC15:58
*** pcaruana has quit IRC15:58
*** spatel has quit IRC15:58
*** errr has joined #openstack-ansible15:59
*** errr has quit IRC15:59
*** DanyC has joined #openstack-ansible15:59
*** pcaruana has joined #openstack-ansible16:00
noonedeadpunk#startmeeting openstack_ansible_meeting16:00
openstackMeeting started Tue Feb 18 16:00:28 2020 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
noonedeadpunk#topic office hours16:00
*** chandankumar is now known as raukadah16:00
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:00
*** errr has joined #openstack-ansible16:01
*** errr has quit IRC16:02
*** errr has joined #openstack-ansible16:03
*** errr has joined #openstack-ansible16:04
*** errr has quit IRC16:04
*** errr has joined #openstack-ansible16:05
*** rpittau is now known as rpittau|afk16:06
*** errr has joined #openstack-ansible16:06
*** udesale_ has joined #openstack-ansible16:06
jrossero/ hello16:06
*** errr has quit IRC16:07
*** zigo has joined #openstack-ansible16:07
*** udesale has quit IRC16:07
*** errr has joined #openstack-ansible16:08
*** errr has quit IRC16:09
rh-jelabarreo/ quiet day here too16:10
*** errr has joined #openstack-ansible16:11
*** errr has quit IRC16:11
*** gshippey has joined #openstack-ansible16:12
*** errr has joined #openstack-ansible16:13
*** errr has quit IRC16:14
*** errr has joined #openstack-ansible16:15
*** errr has quit IRC16:16
*** errr has joined #openstack-ansible16:16
*** udesale_ has quit IRC16:17
*** errr has quit IRC16:17
*** errr has joined #openstack-ansible16:19
*** errr has quit IRC16:19
*** errr has joined #openstack-ansible16:21
*** errr has quit IRC16:21
*** errr has joined #openstack-ansible16:22
*** errr has quit IRC16:23
*** udesale has joined #openstack-ansible16:23
*** errr has joined #openstack-ansible16:24
*** errr has quit IRC16:25
*** errr has joined #openstack-ansible16:27
*** errr has quit IRC16:27
*** errr has joined #openstack-ansible16:29
*** errr has quit IRC16:30
noonedeadpunkso I think we still got rocky CI blocked?16:30
noonedeadpunkand failure of https://zuul.opendev.org/t/openstack/build/54b33893ade3472a93d50634b11e3cf9 looks like some infra mirroring thing to me or dunno...16:31
*** errr has joined #openstack-ansible16:31
*** errr has quit IRC16:32
*** errr has joined #openstack-ansible16:34
noonedeadpunkand looks like s->t placement migration fails again for some reason... Will investigate this16:34
*** errr has quit IRC16:34
*** errr has joined #openstack-ansible16:36
*** pcaruana has quit IRC16:36
*** errr has quit IRC16:36
*** errr has joined #openstack-ansible16:37
*** errr has quit IRC16:37
*** errr has joined #openstack-ansible16:38
*** errr has quit IRC16:38
jrosserthe wheel mirroring has changed to only keep the built wheels rather than also the deps needed to build the wheels16:38
jrosserbut also i don't see pypiserver here http://mirror.ord.rax.opendev.org/pypi/simple/16:39
jrosseroh hold on http://mirror.ord.rax.opendev.org/pypi/simple/pypiserver/16:39
*** errr has joined #openstack-ansible16:39
noonedeadpunkyes, but it's present on regular pypi servers...16:39
*** errr has quit IRC16:40
jrosserperhaps rocky was needing things from the infra wheel build that really should have been coming from pypi16:40
*** errr has joined #openstack-ansible16:41
jrosseroh no more of this too https://zuul.opendev.org/t/openstack/build/4e373011fb8a4391abaf67c7419d333e/log/job-output.txt#747816:42
*** errr has quit IRC16:42
noonedeadpunkhm....16:43
jrossermaybe we really do need this https://review.opendev.org/#/c/707480/16:43
noonedeadpunkactually one day we will defenitely will need this...16:44
*** errr has joined #openstack-ansible16:44
noonedeadpunkjrosser: I think that these ovs/ovn are not from integrated repo actually16:44
*** errr has quit IRC16:44
noonedeadpunkso they don't have things "fixed"....16:45
jrosserthats right16:45
jrosserso two possible answers - fix up the detection of virtualenv 20.0.x16:46
jrosseror run your pre playbook to sanitise the host16:46
*** errr has joined #openstack-ansible16:46
*** errr has quit IRC16:47
*** errr has joined #openstack-ansible16:49
*** errr has quit IRC16:50
noonedeadpunkI'm pretty sure that version detection should be fixed anyway16:50
noonedeadpunkas as soon as u-c will use it - we will need to detect it anyway16:51
jrosseragreed - i think it needs an actual host to try it on unless you can see a silly mistake i've made16:51
*** errr has joined #openstack-ansible16:52
*** errr has quit IRC16:53
jrosserwhats odd is that there is no stdout here https://0d247c5bc0ff94da84d3-a78684670ee4a896edf3201953ce53e3.ssl.cf1.rackcdn.com/707480/3/check/openstack-ansible-deploy-aio_metal-centos-7/a1c534b/logs/ara-report/result/09789714-0379-4ee8-8167-2bdd0e27bea9/16:54
*** errr has joined #openstack-ansible16:55
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add compute node deployment script  https://review.opendev.org/70649116:55
*** errr has quit IRC16:55
*** errr has joined #openstack-ansible16:57
*** DanyC has quit IRC16:57
*** errr has quit IRC16:57
*** spatel has joined #openstack-ansible16:57
*** udesale_ has joined #openstack-ansible16:58
*** errr has joined #openstack-ansible16:58
*** errr has quit IRC16:59
*** udesale has quit IRC16:59
*** gyee has joined #openstack-ansible17:00
*** errr has joined #openstack-ansible17:00
*** errr has quit IRC17:01
Adri2000hello17:03
*** errr has joined #openstack-ansible17:03
*** errr has quit IRC17:04
Adri2000anyone knows the reason haproxdy is configured with stickyness? should not be necessary for openstack api endpoints, should it?17:04
noonedeadpunk#endmeeting17:04
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://bit.ly/2SAcGAn"17:04
openstackMeeting ended Tue Feb 18 17:04:36 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:04
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-02-18-16.00.html17:04
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-02-18-16.00.txt17:04
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-02-18-16.00.log.html17:04
*** errr has joined #openstack-ansible17:05
*** errr has quit IRC17:06
*** errr has joined #openstack-ansible17:08
*** errr has quit IRC17:08
evrardjpAdri2000: it's not necessary for most cases, but it happened to me in the past I had to do it. I can't remember if I used my haproxy role I had back then, or modified OSA to accept this. Do you have a specific case in mind?17:10
*** errr has joined #openstack-ansible17:10
evrardjpand hello jrosser noonedeadpunk :)17:10
noonedeadpunko/ evrardjp17:10
jrosserhello evrardjp17:10
*** errr has quit IRC17:10
evrardjpsorry to interrupt you for chitchat17:10
evrardjpanyone going to the next event in Vancouver?17:11
noonedeadpunkI think this was nothing to interrupt :p17:11
* noonedeadpunk apparently is not17:11
* noonedeadpunk will be in Berlin for sure though :p17:12
evrardjpI am not going to the Ansible community event in Europe either.17:12
*** udesale_ has quit IRC17:12
evrardjpI should explain why I said either... I am not sure I will go to Berlin :/17:13
evrardjpI will try though, as it's nearby17:13
noonedeadpunkoh, that's sad:(17:13
evrardjpnoonedeadpunk: how is the release cadence going?17:13
noonedeadpunktough....17:13
evrardjpI realise that we might need to update this very ugly code17:13
evrardjpsorry to hear that17:14
*** udesale has joined #openstack-ansible17:14
noonedeadpunkbe have borken things here and there17:14
evrardjpis that due to py3?17:14
Adri2000evrardjp: I'm looking at how to stop a controller (for hardware maintenance) properly with really minimal impact to users, so putting the haproxy backends in maintenance mode beofre shutting down the controller. but it looks like because of this stickiness I should first use "drain" then "maint"?17:14
*** errr has joined #openstack-ansible17:14
noonedeadpunkyeah, py3 brought unpleasant stuff17:14
noonedeadpunkand now this virtualenv thing17:15
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Use service_facts to check haproxy existence  https://review.opendev.org/70846017:15
*** cshen_ has quit IRC17:15
*** errr has quit IRC17:15
noonedeadpunkSo like trying to repare stuff before something else will break17:15
noonedeadpunkevrardjp: I was thinking about visiting ansible europe event but decided not to go at the last moment...17:16
evrardjpAdri2000: yeah sending drain to the socket is good, but don't run an ansible play on it, as if there is any kind of remote chance of a change of config, that drain will go away17:16
*** errr has joined #openstack-ansible17:17
evrardjpjust saying that if you're doing that in the case of an upgrade ;p17:17
noonedeadpunkAnd Vancouver is too far, too expensive and I need extra visa ....17:17
*** errr has quit IRC17:17
evrardjpAdri2000: if you do things serially, is that really a big problem?17:18
evrardjpI mean how large is that cloud ? :p17:18
*** spatel has quit IRC17:18
evrardjpnoonedeadpunk: virtualenv?17:18
*** spatel has joined #openstack-ansible17:18
evrardjpI am sorry I am not aware of this issue, as you have seen, I am pretty much not able to follow the scrollback :/17:19
*** errr has joined #openstack-ansible17:19
evrardjpnoonedeadpunk: visas are a pain !17:19
noonedeadpunkyeah.... So it has been discovered that we use virtualenv isntalled in infra images, which is the latest one instead of system one which we were expecting...17:19
noonedeadpunk(there are a bunch of other pip packages as well)17:20
*** errr has quit IRC17:20
noonedeadpunkbut virtualenv changed output...17:20
noonedeadpunkand behaviour17:20
evrardjpYeah17:21
evrardjpthat part I know :p17:21
evrardjpI didn't realise we were leveraging non system virtualenvs though17:21
evrardjpDid you start by changing the zuul pre-jobs to remove those things, to rely on OS packages only?17:21
*** errr has joined #openstack-ansible17:21
evrardjpor did you adapt to the new world, and move everything from sources again?17:22
evrardjpdamn it's a never ending cycle :p17:22
noonedeadpunkyep, that's exactly what I did, but we just realized that not everything uses integrated tests yet...17:22
evrardjpI think I had a google doc for this :p17:22
*** errr has quit IRC17:22
noonedeadpunk(I mean dropping pre-installed stuff in pre-gate)17:22
evrardjpoh17:23
noonedeadpunkhttps://review.opendev.org/#/c/707212/1917:23
noonedeadpunkbtw, we were installing virtualenv inside virtualenv all that time :p17:23
Adri2000evrardjp: not an upgrade, just some maintenance to do on the hardware, will do it serially indeed, and will do the drain just in case :)17:24
*** errr has joined #openstack-ansible17:24
evrardjpAdri2000: you should probably share your experience into doing this, because afaik everyone does its own way, and maybe we should do better.17:24
*** errr has quit IRC17:24
evrardjpI think the community is ready nowadays to have these kind of plays to do minimum maintainances into osa-ops17:25
evrardjpI can totally imagine one that takes a serial argument, and runs the socat commands to drain things17:25
noonedeadpunkyeah, agree...17:26
*** errr has joined #openstack-ansible17:26
evrardjpthis was something I intended to have in the OSA cli I have started but didn't get the traction. A series of toolings with awareness of osa plays17:26
evrardjpmeh I am old :p17:26
*** errr has quit IRC17:27
noonedeadpunkI like that idea but not sure we have enough hands/time for this nowadays...17:27
*** udesale has quit IRC17:27
*** ysastri has quit IRC17:27
evrardjpthat was exactly the problem by then17:28
evrardjpit's not worth trying a new thing if we don't have enough manpower on the rest.17:28
evrardjpWell, that was what I said back then: Better focus on what we do best :)17:28
*** ansmith has quit IRC17:28
*** ansmith has joined #openstack-ansible17:29
Adri2000evrardjp: true, I'll need some automation to do that, let's see what I can come up with :)17:29
*** errr has joined #openstack-ansible17:30
*** errr has quit IRC17:31
*** errr has joined #openstack-ansible17:33
*** DanyC has joined #openstack-ansible17:34
*** errr has quit IRC17:34
*** spatel has quit IRC17:34
*** evrardjp has quit IRC17:34
*** evrardjp has joined #openstack-ansible17:34
*** errr has joined #openstack-ansible17:36
*** errr has quit IRC17:36
*** errr has joined #openstack-ansible17:38
*** errr has quit IRC17:38
*** errr has joined #openstack-ansible17:39
*** errr has quit IRC17:40
*** errr has joined #openstack-ansible17:41
*** errr has joined #openstack-ansible17:43
*** errr has quit IRC17:45
*** errr has joined #openstack-ansible17:46
*** DanyC has quit IRC17:46
*** errr has quit IRC17:47
*** errr has joined #openstack-ansible17:49
*** spatel has joined #openstack-ansible17:49
*** errr has quit IRC17:50
*** errr has joined #openstack-ansible17:51
*** errr has quit IRC17:52
*** errr has joined #openstack-ansible17:53
*** errr has quit IRC17:54
*** errr has joined #openstack-ansible17:54
*** errr has quit IRC17:55
*** weifan has joined #openstack-ansible17:55
*** errr has joined #openstack-ansible17:57
*** DanyC has joined #openstack-ansible17:58
*** errr has quit IRC17:58
*** errr has joined #openstack-ansible17:59
*** errr has quit IRC18:00
*** errr has joined #openstack-ansible18:01
*** errr has quit IRC18:02
*** DanyC has quit IRC18:03
*** weifan has quit IRC18:05
*** weifan has joined #openstack-ansible18:08
spateljamesdenton: hey18:10
spatelDo you know which NIC support dual NUMA sriov ?18:10
spatelcurrent Intel NIC i have only attached to numa018:11
jamesdentonhey spatel. The motherboard would determine that, not the NIC18:12
jamesdentonyou would need two nics, each one in a PCI slot served by a different numa18:12
spatelDo i need two physical nic?18:13
*** weifan has quit IRC18:13
jamesdentonYou have G8s?18:13
jamesdentonDL360e's right?18:13
spatelI have Gen9 blades now18:13
spatelI bought 200 gen9 blades recently and looking for dual PCI numa feature18:13
jamesdentonok ok. You will want to check the quickspecs or some other docs to verify the architecture18:14
*** weifan has joined #openstack-ansible18:14
spatelThat is what i am trying to find out that who provide dual PCI numa? CPU / NIC or Motherboard18:14
jamesdentonbut yeah, you would typically have 1x NIC on CPU0 with NUMA0 and 1x NIC on CPU1 with NUMA1, for G9. the numa conversation varies wildly with different archs (i.e. AMD)18:15
spatelI thought it was NIC feature to attach with two numa node ( Mellanox does that)18:15
jamesdentonI am only aware of the PCI slot being tied to a particular NUMA. Maybe there is other arch i'm not aware of18:15
spateljamesdenton: This is my Gen9 blades lstopo output - http://paste.openstack.org/show/789718/18:16
jrosserjamesdenton: https://www.mellanox.com/products/ethernet-adapters/socket-direct18:17
jamesdentonhey that's cheating18:17
jamesdentonlol18:17
jamesdentongood to know, thanks jrosser18:18
jrossereven though those exist I’ve stuck totally to uniprocessor computes to avoid all things numa18:18
spateljrosser: you just put nail on it..18:18
*** weifan has quit IRC18:18
*** errr has joined #openstack-ansible18:19
jamesdentonspatel which Intel NICs are you using now?18:20
*** errr has quit IRC18:20
jrossertbh I’d be surprised if those dual slot nic “just work”, I have no idea what confusion nova will have with that18:21
jamesdenton*with appropriate OFED drivers18:21
jamesdenton</cringe>18:21
*** errr has joined #openstack-ansible18:21
*** errr has quit IRC18:22
*** errr has joined #openstack-ansible18:24
spateljamesdenton: let me get nic info.. hold on18:24
*** errr has quit IRC18:25
-spatel- 06:00.0 Ethernet controller: Intel Corporation 82599 10 Gigabit Dual Port Backplane Connection (rev 01)18:25
-spatel- Subsystem: Hewlett-Packard Company Ethernet 10Gb 2-port 560FLB Adapter18:25
jamesdentoncool thanks18:26
*** errr has joined #openstack-ansible18:26
spatelSRIOV is not fun man!!!18:27
*** errr has quit IRC18:27
jamesdenton"it's complicated"18:27
jamesdentonare you having issues with your new setup?18:27
spatellast 2 weeks i am running some benchmark test on erlang because we are getting very bad performance :(18:27
spatelWe have launch new application on Erlang MongooesIM and getting very very poor performance on openstack VM18:28
*** errr has joined #openstack-ansible18:28
*** ansmith_ has joined #openstack-ansible18:29
spatelif i run same application on bare metal i get 100% result but if i run on single VM with all CPU allocate like bigiron i get very bad performance18:29
*** errr has quit IRC18:29
jamesdentoneven with sriov?18:29
spatelyes18:30
spatelIf i pin down all my erlang scheduler to NUMA0 CPU then i get good performance18:31
*** errr has joined #openstack-ansible18:31
spatelbut if i run on both numa0 and numa1 i get worst performance18:31
*** ansmith has quit IRC18:31
*** errr has quit IRC18:32
spateljamesdenton: this is my virtual machine CPUTopology - http://paste.openstack.org/show/789720/18:32
spatellook like something going on with QPI (not trying to understand its network or memory access issue)18:33
*** errr has joined #openstack-ansible18:33
jamesdentonwell, if you are using cores from numa1 and the NIC is on numa0, you cross the qpi and take a hit18:33
*** errr has quit IRC18:34
jamesdentonyour G8s would've had similar issues, as the PCI slot(s) were tied to numa018:34
spatelYes i understand but i should get 10% hit.. not 50% performance off right?18:34
*** tosky has quit IRC18:35
spateljamesdenton: if you are right then why bare metal not having same issue?18:35
spatelbare metal also has num0 and numa1 and PCI connected to numa0 right?18:35
*** errr has joined #openstack-ansible18:35
jrosseris this lots of network traffic?18:36
jrosserinterrupts are radically different in a vm vs. metal so that may be a factor18:36
*** errr has quit IRC18:36
spatelwe are running in cluster and not lots of data but 40kpps18:36
spatel40k packet per second18:36
spatelwe have 4 erlang nodes in cluster18:37
spatelthey send txt mesg to each other but they are very tiny18:38
jamesdentoncan you send the output of "cat /proc/net/softnet_stat"18:38
*** errr has joined #openstack-ansible18:38
spatelvm or metal?18:38
jamesdentonjust curious18:38
jamesdentonboth?18:38
spatelcurrently i am not running any load18:38
jamesdentonthats ok18:38
jamesdentonas long as you haven't rebooted since your tests18:38
spatellet me send it.. hold on18:38
*** errr has quit IRC18:39
*** errr has joined #openstack-ansible18:40
*** errr has quit IRC18:41
spateljamesdenton: here you go both output in single file - http://paste.openstack.org/show/789721/18:42
*** errr has joined #openstack-ansible18:42
jamesdentonthank you.18:42
*** errr has quit IRC18:43
*** errr has joined #openstack-ansible18:43
*** errr has quit IRC18:44
jamesdentonsorry, spatel. Not really sure what to say there. you tried pinning vCPUs?18:45
jamesdentoncentos? what driver version?18:46
spatelI am always running CPU ping with vcpu_pin_set to isolate vCPU with pCPU18:46
*** errr has joined #openstack-ansible18:46
spatels/ping/pin18:46
spatelCentOS 7.318:46
spatelKernel 3.10.0-514.el7.x86_6418:47
*** errr has quit IRC18:47
jamesdentonand ixgbe / ixgbe_vf?18:47
jamesdentonixgbevf, rather18:47
-spatel- [root@lab-vxlab-010101-903 ~]# ethtool -i ens418:47
-spatel- driver: ixgbevf18:47
-spatel- version: 2.12.1-k-rh7.318:47
*** errr has joined #openstack-ansible18:48
*** errr has quit IRC18:49
jamesdentonmight be worth trying an updated kernel on host and VM, if you can. that's all fairly old18:50
spateljamesdenton: i will try that, no harm in that18:50
*** errr has joined #openstack-ansible18:50
spatelwhy L2/L3 cash looks different in vm vs bare metal ?18:51
*** errr has quit IRC18:51
spatelin lscpu output they are different, i thought CPU always fully exposed to VM without any change18:52
*** errr has joined #openstack-ansible18:53
spateljamesdenton: check this out - http://paste.openstack.org/show/789722/18:53
*** errr has quit IRC18:53
spateldo you think my openstack hiding some critical CPU info ?18:53
*** errr has joined #openstack-ansible18:54
spatelcheck L2/L3 cache info and "Flags: " ?18:54
*** errr has quit IRC18:55
*** errr has joined #openstack-ansible18:56
spateljamesdenton: ^18:56
*** errr has quit IRC18:57
*** errr has joined #openstack-ansible18:58
*** errr has quit IRC18:59
*** errr has joined #openstack-ansible19:01
*** errr has quit IRC19:01
*** errr has joined #openstack-ansible19:02
*** errr has quit IRC19:03
spatelDo you think disable hyperthreading with help19:03
*** errr has joined #openstack-ansible19:04
*** weshay|ruck has joined #openstack-ansible19:05
*** errr has quit IRC19:05
jamesdentoni see the same cache info on mine. Not really sure what's expected.19:05
jamesdentonflags could vary based on nova config IIRC19:06
*** errr has joined #openstack-ansible19:06
*** errr has quit IRC19:07
*** errr has joined #openstack-ansible19:09
*** errr has quit IRC19:09
*** errr has joined #openstack-ansible19:11
*** errr has quit IRC19:12
openstackgerritErik Berg proposed openstack/openstack-ansible stable/train: Fix idempotency for os-lxc-container-setup.yml  https://review.opendev.org/70849319:12
*** errr has joined #openstack-ansible19:13
*** errr has quit IRC19:14
*** errr has joined #openstack-ansible19:18
*** errr has quit IRC19:18
*** errr has joined #openstack-ansible19:20
*** errr has quit IRC19:20
*** errr has joined #openstack-ansible19:21
*** errr has joined #openstack-ansible19:22
*** errr has quit IRC19:23
*** errr has joined #openstack-ansible19:24
*** errr has quit IRC19:25
*** errr has joined #openstack-ansible19:27
*** errr has quit IRC19:27
spateljamesdenton: so you can see same L2/L3 cache in VM and bare metal?19:27
spatelwhat CPU model are you using?19:28
*** errr has joined #openstack-ansible19:29
jamesdentonspatel http://paste.openstack.org/show/789726/19:30
*** errr has quit IRC19:30
spateljamesdenton: that is very interesting19:30
jamesdentoni'm not sure what it means, if anything19:31
spatelhost vs VM (L2/L3 cache)19:31
*** errr has joined #openstack-ansible19:31
spatelwhy kvm changed that value?19:31
jamesdentonno, i know. but the differences (whether it is actually bogus or not)19:31
spatelalso what kernel are you running?19:32
*** errr has quit IRC19:32
spatelin my "lspcu" i can't see Flags:  but in yours its there19:32
jamesdenton4.15.0-66-generic19:32
*** errr has joined #openstack-ansible19:34
*** errr has quit IRC19:34
spateloh god you are ahead of me..19:34
*** errr has joined #openstack-ansible19:36
spateljamesdenton: what version of KVM are you running?19:37
*** errr has quit IRC19:37
*** errr has joined #openstack-ansible19:38
jamesdentonQEMU emulator version 4.0.0 (Debian 1:4.0+dfsg-0ubuntu9.2~cloud0)19:38
*** errr has quit IRC19:39
*** errr has joined #openstack-ansible19:41
*** errr has quit IRC19:42
spatelThanks19:43
*** errr has joined #openstack-ansible19:43
spatelI am running qemu-kvm-ev-2.12.0-33.1.el7_7.4.x86_6419:43
*** errr has quit IRC19:44
*** errr has joined #openstack-ansible19:45
*** errr has quit IRC19:46
*** elenalindq has quit IRC19:48
*** errr has joined #openstack-ansible19:48
*** errr has quit IRC19:48
redrobotHello ansible friends!  I was wondering what the process is to get a new ansible role release.  Looking for a new release of https://opendev.org/openstack/ansible-role-atos-hsm specifically.19:49
*** ansmith_ has quit IRC19:50
*** errr has joined #openstack-ansible19:50
*** errr has quit IRC19:51
*** errr has joined #openstack-ansible19:52
*** errr has quit IRC19:53
*** errr has joined #openstack-ansible19:55
*** ansmith_ has joined #openstack-ansible19:55
*** errr has quit IRC19:55
*** errr has joined #openstack-ansible19:57
*** errr has quit IRC19:58
*** errr has joined #openstack-ansible19:59
*** elenalindq has joined #openstack-ansible20:03
*** errr has joined #openstack-ansible20:05
*** errr has quit IRC20:06
*** errr has joined #openstack-ansible20:08
*** errr has quit IRC20:09
*** elenalindq has quit IRC20:09
*** errr has joined #openstack-ansible20:10
*** errr has quit IRC20:10
*** errr has joined #openstack-ansible20:12
*** errr has quit IRC20:12
*** errr has joined #openstack-ansible20:14
*** errr has quit IRC20:15
*** errr has joined #openstack-ansible20:16
*** errr has quit IRC20:17
*** errr has joined #openstack-ansible20:18
*** errr has quit IRC20:19
*** errr has joined #openstack-ansible20:23
*** errr has quit IRC20:24
*** errr has joined #openstack-ansible20:26
*** errr has quit IRC20:27
*** errr has joined #openstack-ansible20:28
*** errr has quit IRC20:29
*** errr has joined #openstack-ansible20:31
*** errr has quit IRC20:32
*** errr has joined #openstack-ansible20:33
*** errr has quit IRC20:34
*** errr has joined #openstack-ansible20:35
*** errr has quit IRC20:36
*** errr has joined #openstack-ansible20:38
*** errr has quit IRC20:38
*** errr has joined #openstack-ansible20:40
*** errr has quit IRC20:41
*** errr has joined #openstack-ansible20:42
*** errr has quit IRC20:43
*** errr has joined #openstack-ansible20:45
*** andrewbonney has quit IRC20:45
*** errr has quit IRC20:46
*** errr has joined #openstack-ansible20:47
*** errr has quit IRC20:48
*** errr has joined #openstack-ansible20:51
*** errr has quit IRC20:52
*** errr has joined #openstack-ansible20:54
*** errr has quit IRC20:54
*** errr has joined #openstack-ansible20:56
*** errr has quit IRC20:57
*** errr has joined #openstack-ansible20:58
*** errr has quit IRC20:59
*** errr has joined #openstack-ansible20:59
*** errr has quit IRC21:00
*** errr has joined #openstack-ansible21:02
*** errr has quit IRC21:03
*** errr has joined #openstack-ansible21:05
*** errr has quit IRC21:05
*** errr has joined #openstack-ansible21:07
*** errr has quit IRC21:07
*** errr has joined #openstack-ansible21:08
*** errr has quit IRC21:09
*** errr has joined #openstack-ansible21:11
*** errr has quit IRC21:11
*** errr has joined #openstack-ansible21:13
*** errr has quit IRC21:14
*** errr has joined #openstack-ansible21:15
*** errr has quit IRC21:16
*** errr has joined #openstack-ansible21:18
*** errr has quit IRC21:18
*** errr has joined #openstack-ansible21:20
*** errr has quit IRC21:21
*** errr has joined #openstack-ansible21:22
*** errr has quit IRC21:23
*** errr has joined #openstack-ansible21:24
*** errr has quit IRC21:25
*** errr has joined #openstack-ansible21:27
*** errr has quit IRC21:28
*** errr has joined #openstack-ansible21:29
*** errr has quit IRC21:30
*** errr has joined #openstack-ansible21:33
*** errr has quit IRC21:35
*** errr has joined #openstack-ansible21:36
*** errr has quit IRC21:36
*** errr has joined #openstack-ansible21:38
*** ansmith_ has quit IRC21:38
*** errr has quit IRC21:39
*** errr has joined #openstack-ansible21:40
*** errr has quit IRC21:41
*** errr has joined #openstack-ansible21:43
*** errr has quit IRC21:43
*** errr has joined #openstack-ansible21:44
*** errr has quit IRC21:45
*** errr has joined #openstack-ansible21:46
*** errr has quit IRC21:47
*** errr has joined #openstack-ansible21:49
*** errr has quit IRC21:49
*** errr has joined #openstack-ansible21:51
*** errr has quit IRC21:51
*** errr has joined #openstack-ansible21:52
*** errr has quit IRC21:53
*** errr has joined #openstack-ansible21:54
*** errr has quit IRC21:55
*** errr has joined #openstack-ansible21:57
*** errr has quit IRC21:58
*** errr has joined #openstack-ansible21:59
*** errr has quit IRC22:01
*** errr has joined #openstack-ansible22:02
*** errr has quit IRC22:03
*** errr has joined #openstack-ansible22:05
*** errr has quit IRC22:05
*** errr has joined #openstack-ansible22:07
*** errr has quit IRC22:07
*** errr has joined #openstack-ansible22:11
*** errr has quit IRC22:12
*** errr has joined #openstack-ansible22:14
*** errr has quit IRC22:14
*** rh-jelabarre has quit IRC22:14
*** errr has joined #openstack-ansible22:16
*** errr has quit IRC22:17
bjoerntI just noticed post 19.0.10 upgrade virtualenv reports the version differently breaking python_venv_build22:18
*** errr has joined #openstack-ansible22:18
*** errr has quit IRC22:19
*** errr has joined #openstack-ansible22:21
*** errr has quit IRC22:22
*** errr has joined #openstack-ansible22:23
*** errr has quit IRC22:24
*** jbadiapa has quit IRC22:41
*** errr has joined #openstack-ansible22:49
*** errr has quit IRC22:50
*** cmart has joined #openstack-ansible22:55
*** dave-mccowan has quit IRC22:55
*** dave-mccowan has joined #openstack-ansible22:59
*** errr has joined #openstack-ansible23:04
*** errr has quit IRC23:05
*** errr has joined #openstack-ansible23:07
*** errr has quit IRC23:08
*** errr has joined #openstack-ansible23:09
*** errr has quit IRC23:10
*** errr has joined #openstack-ansible23:11
*** errr has quit IRC23:12
*** errr has joined #openstack-ansible23:14
*** errr has quit IRC23:14
*** errr has joined #openstack-ansible23:18
*** errr has quit IRC23:19
*** errr has joined #openstack-ansible23:20
*** errr has quit IRC23:21
*** errr has joined #openstack-ansible23:22
*** errr has quit IRC23:23
*** errr has joined #openstack-ansible23:25
*** errr has quit IRC23:26
*** spatel has quit IRC23:27
*** errr has joined #openstack-ansible23:27
*** errr has quit IRC23:28
*** errr has joined #openstack-ansible23:33
*** errr has quit IRC23:34
*** errr has joined #openstack-ansible23:35
*** errr has quit IRC23:36
*** bhyrted has quit IRC23:38
*** errr has joined #openstack-ansible23:38
*** bhyrted has joined #openstack-ansible23:38
*** errr has quit IRC23:39
*** errr has joined #openstack-ansible23:40
*** errr has quit IRC23:41
*** mathlin has quit IRC23:41
*** errr has joined #openstack-ansible23:42
*** errr has joined #openstack-ansible23:43
*** errr has quit IRC23:45
*** errr has joined #openstack-ansible23:46
*** errr has quit IRC23:47
*** errr has joined #openstack-ansible23:48
*** errr has quit IRC23:49
*** errr has joined #openstack-ansible23:50
*** errr has quit IRC23:52
*** errr has joined #openstack-ansible23:53
*** errr has quit IRC23:54
*** errr has joined #openstack-ansible23:55
*** errr has quit IRC23:56
*** errr has joined #openstack-ansible23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!