Tuesday, 2015-12-15

*** salv-orl_ has joined #openstack-qa00:02
*** salv-orlando has quit IRC00:05
*** Swami_ has quit IRC00:10
*** Swami_ has joined #openstack-qa00:10
*** salv-orl_ has quit IRC00:11
*** dimtruck is now known as zz_dimtruck00:23
*** rbrndt has quit IRC00:24
*** rossella_s has quit IRC00:30
*** rossella_s has joined #openstack-qa00:30
anteayamtreinish: you still around?00:35
anteayain this image: http://i.imgur.com/bt8lUZM.png00:35
anteayayou have a drop down menu entitled group information by:00:36
anteayaI am here: http://status.openstack.org/openstack-health/#/00:36
anteayaI fail to see/find the drop down menu entitiled group information by:00:36
anteayaI would like to see/find it00:37
timothyb89anteaya: that has not yet been merged, see https://review.openstack.org/#/c/240453/00:37
*** yottatsa has joined #openstack-qa00:38
anteayaharumph00:38
anteayaokay thank you for sharing that with me00:39
anteayago go go00:39
timothyb89anteaya: with any luck it should be merged tomorrow or Wednesday00:39
*** eil397 has quit IRC00:39
anteayayay!00:40
*** Swami_ has quit IRC00:40
anteayathank you00:40
*** Swami_ has joined #openstack-qa00:40
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Filter bugs based on regex  https://review.openstack.org/25763300:48
mtreinishanteaya: yeah what timothyb89 said, that's why I shared a screenshot instead of a link :)00:49
anteayayou tease you00:51
anteayayou were fishing for reviews of the code, weren't you00:51
anteayaI want to see that view now00:51
*** yottatsa has quit IRC00:51
anteayagrump grump grump00:51
*** ccneill has quit IRC00:51
mtreinishanteaya: I wasn't. It was actually to have evidence to back up my anti-stable branch rant to jgriffith00:51
mtreinishanteaya: just blame jgriffith for not believing me :)00:51
anteayaah00:52
anteayaha ha ha00:52
anteayaokay I can do that too00:52
anteayait was a good rant00:52
anteayaand short I must say00:52
anteayaand I do like that feature00:52
*** hichihara has joined #openstack-qa00:52
*** yottatsa has joined #openstack-qa00:53
*** yottatsa has quit IRC00:54
*** hoangcx has joined #openstack-qa00:54
*** hoangcx has left #openstack-qa00:54
*** markvoelker has joined #openstack-qa00:56
*** pvaneck has quit IRC00:58
openstackgerritJim Rollenhagen proposed openstack-infra/devstack-gate: Bump ironic timeout way up  https://review.openstack.org/25763700:59
jroll^ this should help with ironic gate timeouts some, while we work on the real issue01:00
*** markvoelker has quit IRC01:01
*** jasonsb has quit IRC01:01
*** ajmiller has quit IRC01:02
*** jacky_zhang has joined #openstack-qa01:02
*** jacky_zhang has quit IRC01:04
*** openstack has joined #openstack-qa01:08
*** coghog has quit IRC01:21
*** yangyapeng has joined #openstack-qa01:23
openstackrecheckConsole logs not available after 13:25s for gate-devstack-unit-tests 256469,1,48bac9801:24
openstackgerritSwaminathan Vasudevan proposed openstack/tempest: Add external gateway to dvr before scheduling with dvr_snat agent  https://review.openstack.org/25755701:24
*** nic1 has quit IRC01:28
*** yangyapeng has quit IRC01:30
openstackgerritSwaminathan Vasudevan proposed openstack/tempest: Add external gateway to dvr before scheduling with dvr_snat agent  https://review.openstack.org/25755701:32
*** zz_dimtruck is now known as dimtruck01:34
*** Swami_ has quit IRC01:36
*** markvoelker has joined #openstack-qa01:37
*** yamamoto has joined #openstack-qa01:42
openstackgerritFelixLi proposed openstack/tempest: Splitting clients into client groups in manager.py  https://review.openstack.org/25416001:51
*** yamamoto has quit IRC01:52
*** yamamoto has joined #openstack-qa01:52
*** yamamoto has quit IRC01:56
*** mtanino has quit IRC02:00
openstackrecheckopenstack/nova change: https://review.openstack.org/247719 failed because of: gate-tempest-dsvm-full-ceph: https://bugs.launchpad.net/bugs/146425902:05
openstackLaunchpad bug 1464259 in Cinder "Volumes tests fails often with rbd backend" [High,Triaged] - Assigned to Jon Bernard (jbernard)02:05
*** russellb has quit IRC02:07
*** eil397 has joined #openstack-qa02:08
*** russellb has joined #openstack-qa02:09
*** hichihara has quit IRC02:14
*** salv-orlando has joined #openstack-qa02:15
*** jasonsb has joined #openstack-qa02:16
*** mtreinish has quit IRC02:20
*** mtreinish has joined #openstack-qa02:20
*** jasonsb has quit IRC02:21
*** salv-orlando has quit IRC02:22
*** tochi_ has joined #openstack-qa02:23
*** tochi has quit IRC02:23
*** asselin has joined #openstack-qa02:27
openstackgerritMaho Koshiya proposed openstack/tempest: Add tests of port_id and fixed_ips in the attach interfaces nova API  https://review.openstack.org/25725502:28
*** asselin__ has quit IRC02:30
*** salv-orlando has joined #openstack-qa02:31
openstackgerritJacky_lei_zhang proposed openstack/tempest: Add Available params link in volume_backups_client  https://review.openstack.org/25765202:32
*** salv-orlando has quit IRC02:35
zackfCan I re-check a specific test in an openstack gate that failed due to ssh timeout?02:37
zackfOr do i have to re-submit a gerrit review?02:37
clarkbzackf: leave a comment of `recheck` on the change02:37
zackf@clarkb  so if only the gate-grenade-dsvm-multinode failed, i just comment "recheck" and it will only re-run that one?02:38
zackfOr will it run through everything again?02:38
clarkbit will rerun all tests02:38
zackfah ok.02:39
clarkbwe dont want to lock in test results02:39
zackfThanks, i'll do that now02:39
zackfYeah that makes sense.02:39
clarkbit will only make things flakier if that happens02:39
*** Wei_Liu_ has joined #openstack-qa02:40
zackfYeah true, i just didn't want to wait02:41
zackfhaha02:41
zackfMakes perfect sense02:41
zackfthanks for the tip clarkb02:41
zackfsorry clarkb one last question02:43
zackfHow long does it take for to re-run the tests after I comment?02:43
clarkbdepends on queue lengths and what jobs run02:43
clarkbusually at least an hour02:44
zackfok02:44
clarkbyou can check at http://status.openstack.org/zuul/02:44
zackfperfect02:44
zackfthanks much clarkb02:44
openstackgerritJacky_lei_zhang proposed openstack/tempest: Add docstrings to volume_extensions_client  https://review.openstack.org/25765502:47
*** bochi-michael has joined #openstack-qa02:48
*** jecarey has joined #openstack-qa02:48
gmannmtreinish: Thanks for that. some inline comments on https://review.openstack.org/#/c/257493/  for failure02:50
*** dpaterson has joined #openstack-qa02:51
*** dimtruck is now known as zz_dimtruck02:51
*** jecarey has quit IRC02:53
*** Liuqing has joined #openstack-qa02:53
openstackgerritMerged openstack/qa-specs: Change CLI related to config  https://review.openstack.org/25218002:53
*** yamamoto has joined #openstack-qa02:54
openstackrecheckopenstack/glance_store change: https://review.openstack.org/256479 failed gate-tempest-dsvm-full-ceph-src-glance_store in the gate queue with an unrecognized error02:54
openstackgerritMatthew Treinish proposed openstack/qa-specs: Move tempest external plugin spec to implemented  https://review.openstack.org/25765802:55
*** woodster_ has quit IRC02:56
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add different_host test on multiple nodes  https://review.openstack.org/25766003:04
*** yamahata has quit IRC03:05
*** jasonsb has joined #openstack-qa03:11
*** hichihara has joined #openstack-qa03:14
openstackgerritMatthew Treinish proposed openstack/tempest: Fix and improve server personality tests  https://review.openstack.org/25749303:16
*** davideagnello has quit IRC03:17
*** dpaterson has quit IRC03:19
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make create_image use **kwargs  https://review.openstack.org/25131003:19
*** yangyapeng has joined #openstack-qa03:25
*** tochi_ has quit IRC03:32
*** bkopilov has quit IRC03:33
*** ngoracke has joined #openstack-qa03:39
*** david-lyle has quit IRC03:50
*** markvoelker has quit IRC03:52
*** david-lyle has joined #openstack-qa03:58
*** krotscheck is now known as krotscheck_vaca04:00
*** david-lyle has quit IRC04:01
*** david-lyle has joined #openstack-qa04:02
*** hichihara has quit IRC04:03
*** tochi has joined #openstack-qa04:03
*** eil397 has quit IRC04:12
*** boris-42_ has quit IRC04:13
*** ngoracke has quit IRC04:19
*** davideagnello has joined #openstack-qa04:19
*** yamahata has joined #openstack-qa04:19
*** davideagnello has quit IRC04:24
*** openstackstatus has quit IRC04:24
*** openstack has joined #openstack-qa04:25
*** openstackstatus has joined #openstack-qa04:26
*** ChanServ sets mode: +v openstackstatus04:26
*** salv-orl_ has joined #openstack-qa04:37
*** salv-orl_ has quit IRC04:41
zackfWould anyone be able to provide feedback on this ? https://review.openstack.org/#/c/178561/04:44
*** piyush_ has joined #openstack-qa04:52
*** markvoelker has joined #openstack-qa04:53
*** markvoelker has quit IRC04:57
*** bkopilov has joined #openstack-qa04:59
*** sabeen1 has joined #openstack-qa05:00
*** sabeen3 has quit IRC05:01
*** coghog has joined #openstack-qa05:03
*** jecarey has joined #openstack-qa05:08
*** jecarey has quit IRC05:13
*** jacky_zhang has joined #openstack-qa05:23
*** gamado_ has joined #openstack-qa05:25
*** Liuqing has quit IRC05:28
*** binbincong has quit IRC05:30
*** binbincong_ has quit IRC05:30
*** salv-orlando has joined #openstack-qa05:37
*** salv-orlando has quit IRC05:40
*** neeti has joined #openstack-qa05:40
*** dims has quit IRC05:41
*** jrcloud has joined #openstack-qa05:52
*** zackf has quit IRC05:55
*** binbincong has joined #openstack-qa05:57
*** binbincong_ has joined #openstack-qa05:57
openstackrecheckopenstack/nova change: https://review.openstack.org/255975 failed because of: gate-grenade-dsvm-multinode: unrecognized error, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/144658306:01
openstackLaunchpad bug 1446583 in oslo.service "services no longer reliably stop in stable/liberty / master" [Critical,Fix released] - Assigned to Marian Horban (mhorban)06:01
openstackgerritYongfeng Du proposed openstack-dev/grenade: Destroy Nova resource before Neutron  https://review.openstack.org/24075906:09
openstackgerritAndrea Frittoli proposed openstack/tempest-lib: Debugging lp1524717  https://review.openstack.org/25745306:10
*** davideagnello has joined #openstack-qa06:20
openstackgerritPiyush Pathak proposed openstack/tempest: Make v2 update_role use **kwargs & doc string  https://review.openstack.org/25732606:21
*** coghog has quit IRC06:23
*** davideagnello has quit IRC06:25
openstackrecheckopenstack/nova change: https://review.openstack.org/256590 failed because of: gate-grenade-dsvm-multinode: https://bugs.launchpad.net/bugs/1313168, gate-tempest-dsvm-full-ceph: https://bugs.launchpad.net/bugs/146425906:25
openstackLaunchpad bug 1313168 in OpenStack-Gate "paramiko ValueError: Unable to compute factors p and q from exponent d" [Medium,Triaged]06:25
openstackLaunchpad bug 1464259 in Cinder "Volumes tests fails often with rbd backend" [High,Triaged] - Assigned to Jon Bernard (jbernard)06:25
*** jacky_zhang has quit IRC06:31
piyush_Hi Ghanshyam:06:32
*** shausy has joined #openstack-qa06:35
*** vgridnev has joined #openstack-qa06:37
*** sabeen1 has quit IRC06:50
openstackgerritPiyush Pathak proposed openstack/tempest: Make v3 update_user_password use **kwargs  https://review.openstack.org/25341906:50
*** markvoelker has joined #openstack-qa06:54
*** itzikb has joined #openstack-qa06:54
*** SridharG has joined #openstack-qa06:55
*** dims has joined #openstack-qa06:56
*** markvoelker has quit IRC06:58
*** oomichi has joined #openstack-qa06:59
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Remove the ec2 api tests from tempest  https://review.openstack.org/22273707:07
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: [WIP] Nuke EC2 API  https://review.openstack.org/23258007:07
*** binbincong_ has quit IRC07:08
*** binbincong has quit IRC07:08
*** Wei_Liu_ has quit IRC07:08
*** _nadya_ has joined #openstack-qa07:13
*** gamado has joined #openstack-qa07:20
*** Wei_Liu_ has joined #openstack-qa07:21
*** jacky_zhang has joined #openstack-qa07:21
*** gamado has quit IRC07:21
*** binbincong_ has joined #openstack-qa07:21
*** binbincong has joined #openstack-qa07:21
*** asselin__ has joined #openstack-qa07:22
*** asselin has quit IRC07:23
*** jecarey has joined #openstack-qa07:24
piyush_Hi andreaf:07:25
*** dims has quit IRC07:26
*** jecarey has quit IRC07:28
dmelladomorning everyone ;)07:30
dmelladoandreaf: could you please check https://review.openstack.org/#/c/248170/ once that it finish the recheck?07:31
dmelladoit has only minor changes so it should be good, thanks!07:31
*** Thelo has joined #openstack-qa07:31
TheloHi all, does anyone have a clean tutorial of how to configure tempest?07:31
openstackrecheckConsole logs not available after 13:40s for gate-grenade-dsvm 257677,2,da5281d07:34
dmelladoThelo: it depends on what do you want to do with tempest, if it's just launching the test on a devstack, there's a comprehensive guide upstream ;)07:36
TheloI have a multinode deployment and I want to download tempest then configure it so that I can run tempest on this deployment07:36
openstackgerritJacky_lei_zhang proposed openstack/tempest: Make volume_qos_client use **kwargs  https://review.openstack.org/25770907:41
openstackgerritJacky_lei_zhang proposed openstack/tempest: Make volume_qos_client use **kwargs  https://review.openstack.org/25770907:42
*** dims_ has joined #openstack-qa07:45
openstackgerritSwaminathan Vasudevan proposed openstack/tempest: Add external gateway to dvr before scheduling with dvr_snat agent  https://review.openstack.org/25755707:46
openstackrecheckConsole logs not available after 13:30s for gate-tempest-dsvm-neutron-full 193135,30,b5fe14107:48
*** _nadya_ has quit IRC07:51
*** jaypipes has joined #openstack-qa07:53
*** ChanServ sets mode: +o jaypipes07:53
*** safchain has joined #openstack-qa07:58
*** dims_ has quit IRC08:01
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-neutron-full-non-isolated 257660,1,f9d380508:01
*** vgridnev has quit IRC08:07
*** dims_ has joined #openstack-qa08:09
*** lezbar has quit IRC08:13
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron subnetpools client  https://review.openstack.org/25772408:14
openstackrecheckConsole logs not available after 13:26s for gate-tempest-dsvm-full-ceph 257687,1,e4d780d08:15
*** agireud has joined #openstack-qa08:17
*** davideagnello has joined #openstack-qa08:20
gmannandreaf: i replied on https://review.openstack.org/#/c/242346/08:22
gmannandreaf: please check08:22
*** vgridnev has joined #openstack-qa08:23
*** agireud has quit IRC08:24
*** davideagnello has quit IRC08:25
*** yamahata has quit IRC08:26
openstackrecheckConsole logs not available after 13:27s for gate-grenade-dsvm 153038,37,9e18f9d08:28
*** rossella_s has quit IRC08:30
openstackgerritGhanshyam Mann proposed openstack/tempest: Make v1 create_image & update_image use **kwargs  https://review.openstack.org/25227708:30
*** rossella_s has joined #openstack-qa08:31
*** maht has joined #openstack-qa08:31
*** agireud has joined #openstack-qa08:31
*** ifarkas has joined #openstack-qa08:34
*** shardy has joined #openstack-qa08:37
*** _nadya_ has joined #openstack-qa08:39
*** dims_ has quit IRC08:41
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-ceilometer-mysql-neutron-full 255005,2,ce201c308:43
*** jlanoux has joined #openstack-qa08:43
openstackgerritPiyush Pathak proposed openstack/tempest: Make v2 for identity_client functions use **kwargs  https://review.openstack.org/25521008:46
*** luqas has joined #openstack-qa08:51
*** markvoelker has joined #openstack-qa08:55
*** vgridnev has quit IRC08:55
openstackgerritAkihiro Motoki proposed openstack-dev/devstack: Move horizon config and start to appropriate phase in stack.sh  https://review.openstack.org/25774408:55
openstackrecheckConsole logs not available after 13:36s for gate-tempest-dsvm-neutron-full 256273,7,25d6ed508:56
openstackgerritGhanshyam Mann proposed openstack/tempest: Make v1 list_images use **kwargs & doc string update  https://review.openstack.org/25229108:58
*** markvoelker has quit IRC08:59
*** shuquan has joined #openstack-qa09:01
*** shausy has quit IRC09:08
*** shausy has joined #openstack-qa09:09
openstackgerritGhanshyam Mann proposed openstack/tempest: Make volume volume_client to use **kwargs  https://review.openstack.org/25627109:10
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full-ceph-src-os-brick 253352,2,d43ffb609:10
openstackgerritGhanshyam Mann proposed openstack/tempest: Make volume snapshots_client to use **kwargs  https://review.openstack.org/25622709:10
*** drptbl has joined #openstack-qa09:13
openstackgerritPiyush Pathak proposed openstack/tempest: Make add_dhcp_agent_to_network  use **kwargs  https://review.openstack.org/25583909:16
*** tochi has quit IRC09:17
*** salv-orlando has joined #openstack-qa09:19
openstackgerritZack Feldstein proposed openstack/tempest: Fix password not strong enough failures  https://review.openstack.org/17856109:20
*** shuquan has quit IRC09:20
*** dims has joined #openstack-qa09:21
openstackgerritPiyush Pathak proposed openstack/tempest: Make add_dhcp_agent_to_network  use **kwargs  https://review.openstack.org/25583909:21
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-large-ops 257693,1,fea28ce09:23
andreafpiyush_ : hi, what's up?09:29
andreafdmellado: ok, will do09:29
andreafgmann: sure, checking in a minute09:30
*** aopincar has joined #openstack-qa09:30
*** piyush_ has quit IRC09:33
*** SridharG has left #openstack-qa09:35
andreafgmann: +A09:35
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron agents client  https://review.openstack.org/25776409:36
openstackrecheckConsole logs not available after 13:31s for gate-tempest-dsvm-full-ceph 257692,2,a713d0a09:37
*** shausy has quit IRC09:37
*** sree has joined #openstack-qa09:38
gmannandreaf: Thanks09:38
*** shausy has joined #openstack-qa09:38
andreafdmellado: btw, I started working on debugging those object store API test failures https://review.openstack.org/#/q/status:open+branch:master+topic:bug/1524717,n,z09:38
gmannandreaf: also have look into other microvesion patches - https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/api-microversions-testing-support,n,z09:39
gmannandreaf: devstack one is on gate,09:39
dmelladoandreaf: great, I'll take a look too!09:39
gmannandreaf: hope we can merged others soon :)09:39
dmelladoandreaf: did you find anything already?09:41
andreafdmellado: no, not yet - the problem is that I need to get some debug statement into tempest-lib, and I need a new experimental job to be able to pick them up09:43
*** openstackgerrit has quit IRC09:47
*** openstackgerrit has joined #openstack-qa09:47
*** e0ne has joined #openstack-qa09:48
*** cdent has joined #openstack-qa09:49
*** jecarey has joined #openstack-qa09:49
*** agireud has quit IRC09:49
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-neutron-src-tempest-lib 255815,5,9d11b5409:51
*** agireud has joined #openstack-qa09:52
*** SridharG has joined #openstack-qa09:52
*** jecarey has quit IRC09:53
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron quotas client  https://review.openstack.org/25778409:56
openstackgerritVitaly Gridnev proposed openstack/tempest: [sahara] adding new plugin versions to sahara tempest tests  https://review.openstack.org/25596809:58
*** sshnaidm has joined #openstack-qa09:59
*** e0ne has quit IRC09:59
*** agireud has quit IRC09:59
*** e0ne has joined #openstack-qa10:00
*** davideagnello has joined #openstack-qa10:00
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron agents client  https://review.openstack.org/25776410:00
*** jacky_zhang has quit IRC10:00
*** aix has joined #openstack-qa10:01
*** dtantsur|afk is now known as dtantsur10:02
*** _nadya_ has quit IRC10:03
*** _nadya_ has joined #openstack-qa10:04
openstackrecheckConsole logs not available after 13:26s for gate-tempest-dsvm-ironic-agent_ssh 253419,3,7fcad9910:04
*** vgridnev has joined #openstack-qa10:05
openstackgerritPiyush Pathak proposed openstack/tempest: Identity groups Negative Test case  https://review.openstack.org/24296510:05
andreafsdague: I fxed the CI issue on https://review.openstack.org/#/c/257448/3, I had missed updating tempest-jobs.yaml - if you have a chance to re-review10:06
*** agireud has joined #openstack-qa10:09
*** sree has quit IRC10:10
*** sree has joined #openstack-qa10:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add different_host test on multiple nodes  https://review.openstack.org/25766010:11
*** sree has quit IRC10:15
openstackrecheckConsole logs not available after 13:24s for gate-tempest-pep8 257709,2,d6a12c410:18
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[m-z] use **kwargs  https://review.openstack.org/25513810:19
*** [1]Thelo has joined #openstack-qa10:21
*** agireud has quit IRC10:22
*** Thelo has quit IRC10:23
*** [1]Thelo is now known as Thelo10:23
*** aix has quit IRC10:26
*** aix has joined #openstack-qa10:28
*** agireud has joined #openstack-qa10:28
*** SlickNik has quit IRC10:29
*** openstackgerrit has quit IRC10:32
*** openstackgerrit has joined #openstack-qa10:32
*** agireud has quit IRC10:34
*** SlickNik has joined #openstack-qa10:35
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344410:43
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-nova-wsgi-full 252283,27,368745710:45
*** agireud has joined #openstack-qa10:48
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - DO NOT REVIEW  https://review.openstack.org/25747110:49
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add different_host test on multiple nodes  https://review.openstack.org/25766010:50
*** yangyapeng has quit IRC10:52
*** markvoelker has joined #openstack-qa10:55
*** tosky has joined #openstack-qa10:56
*** aysyd has joined #openstack-qa10:58
openstackrecheckConsole logs not available after 13:28s for gate-horizon-pep8 223554,8,fb08db410:59
*** markvoelker has quit IRC11:00
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add different_host test on multiple nodes  https://review.openstack.org/25766011:02
*** bochi-michael has quit IRC11:04
*** bochi-michael has joined #openstack-qa11:05
*** aysyd has quit IRC11:05
*** aysyd has joined #openstack-qa11:08
openstackrecheckConsole logs not available after 13:24s for gate-grenade-dsvm-multinode 256271,2,46c8b1511:13
openstackgerritAtsushi SAKAI proposed openstack-dev/devstack: Add sleep time measurement  https://review.openstack.org/25459111:13
*** dims has quit IRC11:15
*** lucas-dinner is now known as lucasagomes11:18
*** ig0r_ has quit IRC11:20
*** salv-orlando has quit IRC11:22
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - DO NOT REVIEW  https://review.openstack.org/25747111:22
*** salv-orlando has joined #openstack-qa11:22
*** bochi-michael has quit IRC11:24
openstackrecheckConsole logs not available after 13:24s for gate-nova-python27 257692,3,4512bad11:26
dmelladoandreaf: ping re manager in the call to super11:27
dmelladoI was basically mimicking what was done for other clients and didn't such call11:27
dmelladoi.e. SnapshotService11:28
*** sree has joined #openstack-qa11:28
andreafdmellado: oh, ok, I missed that - uhm that's odd11:28
*** jlanoux_ has joined #openstack-qa11:28
dmelladothat's why I left it in that way11:28
dmelladoam I missing something?11:28
dmelladowould the patch be ok for you then?11:29
andreafdmellado: uhm, no I think that's me seeing things11:29
andreafdmellado: let me recheck, it11:29
dmelladosure11:29
dmelladothanks!11:30
*** jlanoux has quit IRC11:31
andreafdmellado: +A - I'm not sure what I saw in the code when I checked earlier, but it looks good to me now11:33
dmelladoandreaf: thanks, no worries!11:33
dmelladoI was just checking it locally and it looked strange to me11:33
dmelladoI'll follow-up with the series of patches after this, so if anything needs to be modified we could track it11:34
*** gszasz has joined #openstack-qa11:34
dmelladothanks for all your help trough the patch!11:34
*** jaypipes has quit IRC11:35
*** gfidente has joined #openstack-qa11:35
*** gfidente has quit IRC11:35
*** gfidente has joined #openstack-qa11:35
andreafdmellado np, thank you11:36
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-ironic-agent_ssh 257724,1,ba98dd511:40
*** yamamoto has quit IRC11:42
*** yamamoto has joined #openstack-qa11:44
*** obutenko has joined #openstack-qa11:48
*** SlickNik has quit IRC11:50
*** yamamoto has quit IRC11:51
*** yamamoto has joined #openstack-qa11:51
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-ironic-agent_ssh 178561,18,c8a3b0111:54
*** SlickNik has joined #openstack-qa11:54
*** mattoliverau has quit IRC11:55
*** matt6434 has joined #openstack-qa11:56
*** jaypipes has joined #openstack-qa11:57
*** ChanServ sets mode: +o jaypipes11:57
*** jlanoux has joined #openstack-qa12:01
*** jlanoux_ has quit IRC12:02
*** salv-orl_ has joined #openstack-qa12:03
*** jaypipes has quit IRC12:03
*** salv-orlando has quit IRC12:06
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add debugging info for test_baremetal_basic_ops  https://review.openstack.org/25786312:07
openstackrecheckConsole logs not available after 13:24s for gate-horizon-npm-run-lint 253398,6,602bae312:08
*** Liuqing has joined #openstack-qa12:09
*** yamamoto has quit IRC12:14
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron agents client  https://review.openstack.org/25776412:14
*** binbincong has quit IRC12:15
*** binbincong_ has quit IRC12:16
*** sree_ has joined #openstack-qa12:19
*** sree_ is now known as Guest9131312:19
openstackrecheckConsole logs not available after 13:46s for gate-tempest-dsvm-full-ceph 256035,2,e7e25fb12:22
*** sree has quit IRC12:22
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron quotas client  https://review.openstack.org/25778412:24
openstackgerritAndrea Frittoli proposed openstack/tempest-lib: Debugging lp1524717  https://review.openstack.org/25745312:24
openstackgerritAndrea Frittoli proposed openstack/tempest: Test change to debug lp1524717.  https://review.openstack.org/25581512:26
andreafgmann: are you still around?12:30
*** rossella_s has quit IRC12:30
ylobankovjlanoux: Hi. Could you please check my comment in https://review.openstack.org/#/c/253444/ ?12:30
*** rossella_s has joined #openstack-qa12:31
Wei_Liu_ylobankov: Hi, thanks for your comments, and I have a new patch in https://review.openstack.org/#/c/255725/, please take a look. Thanks12:33
*** davideagnello has quit IRC12:34
*** binbincong has joined #openstack-qa12:35
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-full 257784,1,fe1d7dc12:36
*** binbincong_ has joined #openstack-qa12:36
*** yfried has quit IRC12:36
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron subnetpools client  https://review.openstack.org/25772412:37
*** dims has joined #openstack-qa12:39
*** yfried has joined #openstack-qa12:41
*** markvoelker has joined #openstack-qa12:41
*** markvoelker has quit IRC12:46
*** salv-orl_ has quit IRC12:46
*** salv-orlando has joined #openstack-qa12:46
openstackgerritMerged openstack-dev/devstack: remove generic extras.d support  https://review.openstack.org/25294412:47
openstackrecheckConsole logs not available after 13:26s for gate-tempest-dsvm-neutron-full-kilo 257764,2,cdb39f612:49
*** Guest91313 has quit IRC12:49
*** sree has joined #openstack-qa12:50
*** salv-orlando has quit IRC12:51
*** dims has quit IRC12:51
openstackgerritMerged openstack-dev/devstack: Add compute microversions configuration on tempest  https://review.openstack.org/24724612:51
jlanouxHi ylobankov. Yep, good catch!12:53
*** sree has quit IRC12:54
*** yamamoto has joined #openstack-qa12:54
openstackgerritMerged openstack/tempest: Rename references to compute security groups client  https://review.openstack.org/25605012:55
*** sayali_ has quit IRC12:56
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344412:56
*** sayali has joined #openstack-qa12:58
*** weshay_xchat has joined #openstack-qa12:59
*** weshay_xchat is now known as weshay12:59
openstackgerritMerged openstack-infra/devstack-gate: Fix grenade on OVH with nova net  https://review.openstack.org/25753712:59
*** sree has joined #openstack-qa12:59
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344413:00
*** jlanoux has quit IRC13:02
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-ironic-agent_ssh 255839,3,23f2a8f13:02
*** oomichi has quit IRC13:03
*** sree has quit IRC13:04
*** Wei_Liu_ has quit IRC13:04
*** markvoelker has joined #openstack-qa13:04
*** jlanoux has joined #openstack-qa13:05
*** bkopilov has quit IRC13:07
*** mkoderer_ has quit IRC13:11
*** mkoderer has joined #openstack-qa13:13
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589813:14
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron-full 257326,4,86495d913:17
*** sayali has quit IRC13:18
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact Repository API to separate endpoint in devstack installation  https://review.openstack.org/25788813:18
*** sayali has joined #openstack-qa13:20
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788813:20
openstackgerritPiyush Pathak proposed openstack/tempest: Make 3 functions in network_client use **kwargs  https://review.openstack.org/25789213:20
*** zz_dimtruck is now known as dimtruck13:23
*** sayali has quit IRC13:26
*** sayali has joined #openstack-qa13:28
openstackrecheckConsole logs not available after 13:29s for gate-nova-python34 202617,26,e7e281e13:30
*** sayali has quit IRC13:30
*** sayali has joined #openstack-qa13:32
*** sayali has quit IRC13:33
*** e0ne has quit IRC13:34
*** sayali has joined #openstack-qa13:35
*** e0ne has joined #openstack-qa13:35
*** sayali has quit IRC13:40
ylobankovGuys, anybody knows what happened with stackalytics metrics for Tempest? http://stackalytics.com/?module=tempest Review count is too small for contributors.13:41
*** yamamoto has quit IRC13:41
*** sayali has joined #openstack-qa13:42
*** aopincar has quit IRC13:42
*** dimtruck is now known as zz_dimtruck13:46
*** shausy has quit IRC13:47
*** aix has quit IRC13:52
*** regXboi has joined #openstack-qa13:54
*** mwagner_lap has quit IRC13:54
*** hichihara has joined #openstack-qa13:55
*** yamamoto has joined #openstack-qa13:56
*** yamahata has joined #openstack-qa13:58
*** sayali has quit IRC13:59
*** ngoracke has joined #openstack-qa14:00
*** cdent_ has joined #openstack-qa14:00
*** rcernin has joined #openstack-qa14:02
*** cdent has quit IRC14:02
*** cdent_ is now known as cdent14:02
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788814:02
*** amotoki has joined #openstack-qa14:03
*** neeti has quit IRC14:03
*** dkranz has joined #openstack-qa14:04
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788814:04
*** aix has joined #openstack-qa14:05
*** aysyd has quit IRC14:06
*** aysyd has joined #openstack-qa14:06
openstackrecheckConsole logs not available after 13:27s for gate-tempest-dsvm-neutron-full-non-isolated 257660,4,6d5307914:10
*** sayali has joined #openstack-qa14:11
*** e0ne has quit IRC14:12
*** SlickNik has quit IRC14:14
*** shuquan has joined #openstack-qa14:15
*** shuquan has quit IRC14:19
*** rbak has joined #openstack-qa14:19
*** artom_ has joined #openstack-qa14:20
*** jecarey has joined #openstack-qa14:23
*** SlickNik has joined #openstack-qa14:23
openstackrecheckConsole logs not available after 13:23s for gate-horizon-npm-run-test 232234,5,3002cbe14:23
*** edmondsw has joined #openstack-qa14:24
*** sayali has quit IRC14:24
*** sayali has joined #openstack-qa14:27
*** rbrndt has joined #openstack-qa14:28
*** edmondsw has quit IRC14:28
*** sayali has quit IRC14:32
*** dims has joined #openstack-qa14:34
*** rbrndt has quit IRC14:35
*** mwagner_lap has joined #openstack-qa14:35
*** sayali has joined #openstack-qa14:36
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-neutron-full 257724,2,a8b2c2514:37
*** bkopilov has joined #openstack-qa14:40
*** zz_dimtruck is now known as dimtruck14:41
*** ChuckC has joined #openstack-qa14:41
*** mriedem has joined #openstack-qa14:43
*** ChuckC has quit IRC14:45
*** ChuckC has joined #openstack-qa14:46
*** krtaylor has quit IRC14:46
*** malini has joined #openstack-qa14:48
*** gamado_ has quit IRC14:49
*** sayali has quit IRC14:50
*** SridharG has quit IRC14:51
*** Liuqing has quit IRC14:52
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-full 257087,2,975e65114:55
*** Liuqing has joined #openstack-qa14:55
*** lucasagomes is now known as lucas-hungry14:56
*** alex_xu has quit IRC14:58
*** dims has quit IRC15:00
*** alex_xu has joined #openstack-qa15:04
openstackrecheckConsole logs not available after 13:35s for gate-nova-python27 153038,39,f3f190315:08
*** aix has quit IRC15:09
*** pglass has joined #openstack-qa15:09
*** aix has joined #openstack-qa15:09
openstackgerritEran Kuris proposed openstack/tempest: Fixed the comments of port security group test  https://review.openstack.org/25790715:11
*** boris-42_ has joined #openstack-qa15:12
*** e0ne has joined #openstack-qa15:12
openstackgerritAndrea Frittoli proposed openstack/tempest: Test change to debug lp1524717  https://review.openstack.org/25581515:17
openstackrecheckConsole logs not available after 13:29s for gate-grenade-dsvm-multinode 255044,6,1b44fbd15:22
andreafmtreinish: btw, the tempest-src job with preprov creds landed, e.g.: https://jenkins03.openstack.org/job/gate-tempest-dsvm-test-accounts-src-tempest-lib/15:22
jlvillalmtreinish, Hi. On os-testr, how do you set the directory to run the tests in? Hopefully easy question. I'll start searching docs :)15:24
*** ajmiller has joined #openstack-qa15:24
mtreinishjlvillal: oh, I actually don't think I added an equiv to testr's --here option15:25
mtreinishso it's just the cwd15:25
mtreinishandreaf: cool15:25
jlvillalmtreinish, Ah, good to know. Thanks!15:25
jlvillalmtreinish, Trying to run the functional tests, which are different directory15:25
jrcloudHello, I have a changeset that passed all gate tests, I had to update the commit message alone and the one of the gate tests failed , do i have to do a recheck?15:25
*** bnemec has quit IRC15:25
dmelladojrcloud: I guess so15:26
jrcloudugh15:26
jrcloudok15:26
*** vgridnev has quit IRC15:26
dmelladogood luck fighting the gates ;)15:26
*** gszasz has quit IRC15:26
mtreinishjlvillal: well it's the same .testr.conf right?15:26
jrcloudsheesh15:26
jrcloudlol15:26
dmelladoI'm well aware that it could be tough sometimes...15:26
*** jrcloud is now known as zackf15:26
jlvillalmtreinish, Ah!  .testr.conf! Now I remember.15:26
jlvillalLooking15:26
*** tosky has quit IRC15:27
dmelladojlvillal: maybe you're looking for this: i.e. OS_TEST_PATH=./tempest/tests testr run --parallel15:27
dmellado?15:27
*** ChuckC has quit IRC15:27
*** gszasz has joined #openstack-qa15:27
dmelladomtreinish: I don't know if the OS_TEST_PATH works also for ostestr, would it work too?15:27
jlvillaldmellado, Kind of. thanks.15:27
jlvillalmtreinish, dmellado I think I got it figured out15:27
mtreinishdmellado: it would, that's a hack I came up with to fudge with the discovery path15:27
mtreinishdmellado: it's all env vars in the .testr.conf file15:28
*** tosky has joined #openstack-qa15:28
dmelladomtreinish: I see, thanks!15:28
mtreinishdmellado: if it doesn't work it's a bug :)15:28
dmelladojlvillal: what did you want to do exactly?15:28
jlvillaldmellado, I was fixing this patch: https://review.openstack.org/#/c/257899/15:31
mtreinishjlvillal: heh, that commit msg looks familiar :)15:32
*** bnemec has joined #openstack-qa15:32
*** mtanino has joined #openstack-qa15:32
jlvillalmtreinish, :D15:32
openstackgerritBrant Knudson proposed openstack-dev/devstack: Keystone support deploy in uwsgi  https://review.openstack.org/25757115:34
dmelladojlvillal: glad you could make it work ;)15:35
jlvillaldmellado, Thanks for the help15:35
openstackrecheckConsole logs not available after 13:29s for gate-tempest-dsvm-neutron-full 257764,3,8c3882c15:35
dmelladonp!15:35
jlvillalmtreinish, And thanks too!15:36
mtreinishjlvillal: let me know if it doesn't work. I could see there potentially being an issue with the env vars not being passed through to the subprocess in ostestr15:37
mtreinishI think it works, but it's been a while since I tested it15:37
jlvillalmtreinish, My test showed it working.15:37
*** Liuqing has quit IRC15:37
jlvillalIt did run the functional tests when I tested it. for -efunctional15:37
jlvillalAnd unit tests for -epy2715:37
mtreinishok, cool15:37
*** Liuqing has joined #openstack-qa15:39
*** lucas-hungry is now known as lucasagomes15:40
*** gszasz has quit IRC15:45
*** gszasz has joined #openstack-qa15:45
*** oomichi has joined #openstack-qa15:45
andreafmtreinish: have you seen my comment on https://review.openstack.org/#/c/173581/15:45
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Skip test_baremetal_server_ops  https://review.openstack.org/25796715:46
oomichimtreinish: andreaf: ^^^15:46
oomichimtreinish: andreaf: now ironic gate job fails very many times on tempest gate, and hard to merge tempest patches15:47
mtreinishandreaf: actually I didn't see it, we can drop it I guess15:47
mtreinishalthough tbh I thought we wrote it to a logs dir but I guess not :)15:47
mtreinishoomichi: hmm that means ironic isn't testing anything useful in those jobs :(15:48
mtreinishjroll, jlvillal: ^^^ are you ok with oomichi's patch?15:48
oomichimtreinish: yeah, that is basic test for ironic15:48
mtreinishoomichi: I think that's the wrong bug number in the commit msg: https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-331/+bug/139300915:48
openstackLaunchpad bug 1431753 in nvidia-graphics-drivers-340-updates (Ubuntu) "duplicate for #1393009 Nvidia binary driver FTBS due to DKMS layer violation" [High,Fix released] - Assigned to Alberto Milone (albertomilone)15:48
jlvillalmtreinish, I had proposed something similar15:49
* jlvillal goes looks15:49
oomichimtreinish: oops, will update it soon15:49
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-ceilometer-mysql-neutron-full 254596,4,601a70615:49
jlvillaljroll oomichi, mtreinish https://review.openstack.org/#/c/241790/15:49
mtreinishoomichi: heh, well it is baremetal so maybe it is the nvidia driver :)15:50
mtreinishjlvillal: oh, from a month ago (and when I was on vacation) that's why it didn't ring any bells :)15:50
mtreinishjlvillal: oomichi's patch is skipping the baremetal scenario test though15:51
oomichijlvillal: that is different test from I am facing now15:51
jlvillalmtreinish, Actually I don't think we want that patch15:51
jrollmtreinish: oomichi: no, I'm not okay with that at all. if we're blocking you, we should make the job non-voting, or better yet get this landed which I believe should stop the bleeding (but am not 100% sure) https://review.openstack.org/#/c/257637/15:51
jlvillaloomichi, We have another plan I think.15:51
jrollmtreinish: oomichi: also skipping baremetal basic ops, I don't believe will skip the actual test that's failing (use nova with ironic driver), the baremetal basic ops thing is just testing ironic api which is working fine15:52
mtreinishjroll: it has a pretty high failure rate actually: http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_baremetal_basic_ops.BaremetalBasicOps.test_baremetal_server_ops15:52
oomichijlvillal: what kind of plan?15:52
jrollmtreinish: oh, maybe that is the thing that runs nova15:53
jlvillaloomichi, What jroll is talking about15:53
mtreinish42% failure isn't very good :(15:53
jrollmtreinish: then https://review.openstack.org/#/c/257637/ and/or make that non-voting on tempest, don't make our gate useless against ironic changes as well15:53
jrollmtreinish: it's f'ing horrible and I'm working hard on fixing it15:53
mtreinishjroll: no I think your right the baremetal scenario uses the ironic api iirc15:53
oomichijroll: are you facing this problem on ironic gate?15:54
jrolloomichi: yes...15:54
mtreinishnope it looks like it uses nova: https://github.com/openstack/tempest/blob/master/tempest/scenario/test_baremetal_basic_ops.py15:55
jrollmtreinish: tempest.scenario.test_baremetal_basic_ops.BaremetalBasicOps.test_baremetal_server_ops is indeed the thing that actually boots instances, I was wrong15:55
mtreinishjroll: I'm fine making it nv on tempest for the time being I guess15:56
mtreinishwhile you work through the problem15:56
jrollmtreinish: yeah, but the same approvers have +2 access on dsg, where I think 257637 will help reduce failures15:57
jrollso maybe both? :)15:57
mtreinishjroll: I'm not sure the per test timeout in tempest defaults to 500sec15:57
jrollmtreinish: so I should add a 600 for that config as well?15:58
mtreinishso if you have tempest sit there for 600sec waiting on ironic the timeout fixture will fail the test15:58
*** rcernin has quit IRC15:58
mtreinishjroll: yeah, but it's an env var to testr: https://github.com/openstack/tempest/blob/master/.testr.conf#L415:58
jrollright, ok15:58
jrollcan you leave a note on the patch and I'll dig?15:59
mtreinishjroll: done16:00
jrollthanks16:00
*** amotoki has quit IRC16:01
*** sabeen1 has joined #openstack-qa16:01
oomichijroll: best way is that ironic tests are migrated from tempest to ironic with external plugin. yuiko is doing that and I hear the implementation is done on ironic side16:02
openstackrecheckConsole logs not available after 13:28s for gate-grenade-dsvm-multinode 252836,3,05aa80e16:03
jrolloomichi: yep, I'm aware16:03
*** devananda has quit IRC16:05
*** hichihara has quit IRC16:06
*** dtantsur is now known as dtantsur|afk16:06
*** oomichi has quit IRC16:07
*** devananda has joined #openstack-qa16:08
*** itzikb has quit IRC16:08
andreafoomichi, mtreinish, gmann: I was thinking that we could split the client manager in one that takes only the 5 default params as input to __init__, allows setting other parameters via helpers methods, and initialises the clients via functool.partial at __init__ time, and only actually initialises them once they are used - that would allow having a client manager that can be moved to tempest-lib, and eventually16:12
andreaf stop carrying long lists of clients around16:12
andreafwhat do you think?16:12
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 193135,31,319babe16:16
*** krtaylor has joined #openstack-qa16:17
mtreinishandreaf: that sounds like a good idea, but I'm having a hard time visualizing it. Maybe a wip patch would help me see it in my head16:18
andreafeven though I guess it the manager might need some more work before it's ready to migrate to tempest-lib16:19
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for requests 2.9.0 ssl failure bug 1526413  https://review.openstack.org/25798916:19
openstackbug 1526413 in OpenStack Compute (nova) "test_app_using_ipv6_and_ssl fails with requests 2.9.0" [Critical,Confirmed] https://launchpad.net/bugs/152641316:19
mriedemmtreinish: ^16:19
andreafmtreinish: yes I'm kind of visualising it, but I better try put it in code, before I find out I missed something :P16:19
andreafmtreinish: ok I'll prepare something16:20
mtreinishmriedem: those damn square brackets :)16:21
mtreinishandreaf: ok cool16:21
*** ccneill has joined #openstack-qa16:21
*** yamamoto has quit IRC16:25
openstackgerritDavid Paterson proposed openstack/tempest: Migrate tempest-account-generator to new cliff cli framework  https://review.openstack.org/25242816:26
dmelladomtreinish: jroll about the tempest external plugin, what's the current status with neutron?16:26
dmelladois someone tackling that?16:26
*** yamamoto has joined #openstack-qa16:26
jrolldmellado: I have no idea about neutron things16:26
dmelladothanks anyway jroll16:27
dmelladomaybe mtreinish or andreaf would know16:27
jroll:)16:27
*** yamahata has quit IRC16:27
*** gmmaha has joined #openstack-qa16:28
gmmahamtreinish: quick question here for you? Is there a way we can make testr store the subunit stream logs to file against keeping it in memory?16:29
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-full 256273,9,ffd565716:29
*** rossella_s has quit IRC16:30
gmmahawe are teying to move swift to use os-testr for functests and we are seeing our in_process tests fail because of the machine running out of memory and the testr process being killed by the kernel16:30
*** rossella_s has joined #openstack-qa16:31
*** davideagnello has joined #openstack-qa16:31
*** sabeen3 has joined #openstack-qa16:33
openstackgerritDavid Paterson proposed openstack/tempest: Migrate verify-tempest-config to new cliff cli framework  https://review.openstack.org/24724016:34
*** sabeen1 has quit IRC16:35
*** davideagnello has quit IRC16:36
openstackgerritDavid Paterson proposed openstack/tempest: Migrate verify-tempest-config to new cliff cli framework  https://review.openstack.org/24724016:36
*** ccneill has quit IRC16:36
openstackgerritDavid Paterson proposed openstack/tempest: Migrate tempest-account-generator to new cliff cli framework  https://review.openstack.org/25242816:37
*** ccneill has joined #openstack-qa16:37
*** yamamoto has quit IRC16:39
bknudsonI'm a little confused about what's going on with the postgres / mod_wsgi devstack gate job -- do other projects support running in mod_wsgi?16:42
bknudsonother than keystone?16:42
mtreinishbknudson: there are other projects that support running with mod_wsgi besides keystone16:43
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-full 255815,6,d3977a716:43
mtreinishbut iirc the only one we gate with mod_wsgi on is keystone16:43
*** ifarkas has quit IRC16:44
bknudsonThere's a gate-tempest-dsvm-nova-wsgi-full but that's in experimental16:44
bknudsonthe tempest-dsvm-postgres-full job sets ENABLE_HTTPD_MOD_WSGI_SERVICES=False ... but maybe it's only keystone that checks that in devstack?16:45
bknudsonah, yep, only lib/keystone looks at ENABLE_HTTPD_MOD_WSGI_SERVICES/16:46
jlvillalgmmaha, http://docs.openstack.org/developer/os-testr/ostestr.html16:46
jlvillalgmmaha, But I don't see anything about how to store the logs to the file instead of memory :(16:46
jlvillalgmmaha, That is probably a mtreinish question16:46
gmmahajlvillal: thanks. digging a little more to see what i can do with command line otions :916:47
mtreinishgmmaha: the swift tests really log that much to consume all the free ram?16:47
gmmahamtreinish: unfortunately yes. when we run the in_process style of tests :(16:48
gmmahawhere the swift servers arent run as a daemon and writes out to syslog16:48
mtreinishgmmaha: so I would configure the logger to write to files and don't attach the logs to the subunit stream16:48
*** luqas has quit IRC16:49
openstackgerritJim Rollenhagen proposed openstack-infra/devstack-gate: Bump ironic timeout way up  https://review.openstack.org/25763716:49
*** Liuqing has quit IRC16:49
gmmahathe swift loggers just output to stdout. which i believe is what the subunit stream captures and stores.. leading to mem fill up16:49
*** luqas has joined #openstack-qa16:49
mtreinishthe subunit stream will be in memory because that's how testr communicates with the workers and what gets passed to the output filter subunit-trace in ostestr16:49
gmmahai am trying it out where i am disabling the logger completely or write to a tmpfile16:49
mtreinishgmmaha: yes, but the loggers are configurable. So just configure them to write to a file16:50
gmmahamtreinish: yup.. exploring options and i think thats the easiest now16:50
gmmahathanks for the info and time. :)16:51
gmmahaatleast now i wont chase somethign i cannot do16:51
openstackgerritMerged openstack-infra/elastic-recheck: Add query for requests 2.9.0 ssl failure bug 1526413  https://review.openstack.org/25798916:52
openstackbug 1526413 in OpenStack Compute (nova) "test_app_using_ipv6_and_ssl fails with requests 2.9.0" [Critical,In progress] https://launchpad.net/bugs/1526413 - Assigned to Matt Riedemann (mriedem)16:52
*** yamahata has joined #openstack-qa16:53
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-neutron-full-kilo 253444,13,0f6192a16:56
*** david-lyle has quit IRC17:02
*** SridharG has joined #openstack-qa17:04
*** drptbl has quit IRC17:05
*** jlanoux has quit IRC17:05
*** openstackrecheck has quit IRC17:08
*** openstackrecheck has joined #openstack-qa17:08
*** nic has joined #openstack-qa17:10
*** malini has quit IRC17:11
*** david-lyle has joined #openstack-qa17:12
*** raies has joined #openstack-qa17:13
*** davideagnello has joined #openstack-qa17:14
*** e0ne has quit IRC17:19
*** sshnaidm has quit IRC17:21
*** dkranz has quit IRC17:23
*** vgridnev has joined #openstack-qa17:25
*** davideagnello has quit IRC17:29
*** malini has joined #openstack-qa17:31
openstackrecheckConsole logs not available after 13:32s for gate-tempest-dsvm-full 252488,16,832fcfd17:31
*** _nadya_ has quit IRC17:32
sc68calmriedem: looks like we need to re-review https://review.openstack.org/#/c/254610/317:37
sc68calmriedem: since it just popped up again in another run and people scratch their heads17:38
mriedemsc68cal: is it always the same test? is there nothing we can log in neutron in this case (info+ level logging) that we can reliably use to track this failure?17:39
mriedemthe query as written is too generic17:39
sc68calmriedem: no, it does not appear to be the same test17:39
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Filter bugs shown in graphs based on regex  https://review.openstack.org/25763317:40
*** markvoelker_ has joined #openstack-qa17:40
sc68calmriedem: i'm all ears for suggestions on how to make it less generic - but the only thing that i've seen in common is it's just the LB job that gets bit by the bug17:41
*** markvoelker has quit IRC17:41
sc68calbut the test that actually fails is random - it might be something racy that is being triggered17:41
mriedemis there some part of the neutron linuxbridge agent that could be detecting a problem here?17:41
mriedemsc68cal: basically, neutron needs better logging for this17:41
mriedeminfo/warning that something isn't right17:42
mriedemwhich correlates with this failure17:42
*** Swami_ has joined #openstack-qa17:43
*** zackf has quit IRC17:44
*** Guest72290 has joined #openstack-qa17:45
*** zackf has joined #openstack-qa17:45
asselin_mriedem, mtreinish sdague I know you guys are really busy, but if you can, it would be nice to get reviews on these changes. We're using them in production internally. I'm happy to answer any questinos or change stuff around. https://review.openstack.org/#/q/owner:%22Ramy+Asselin+%253Cramy.asselin%2540hpe.com%253E%22+status:open+project:openstack-infra/elastic-recheck,n,z17:45
openstackrecheckConsole logs not available after 13:29s for gate-grenade-dsvm-multinode 255815,7,033e6f417:45
sc68calmriedem: I've looked for anything in q-svc and q-l3 related to the failure in tempest, but I don't think we emit any logging info for a floating IP address pool being filled up17:45
*** markvoelker_ has quit IRC17:47
openstackgerritMichael Turek proposed openstack/tempest: Remove hard-coded DEPLOYWAIT timeout from Baremetal Scenario  https://review.openstack.org/25802717:48
*** markvoelker has joined #openstack-qa17:49
*** malini has quit IRC17:49
openstackgerritJohn Warren proposed openstack/tempest: Split out Neutron security groups client  https://review.openstack.org/25803017:54
*** malini has joined #openstack-qa17:55
*** ccneill has quit IRC17:56
*** ccneill has joined #openstack-qa17:56
*** maht has quit IRC17:57
*** maht has joined #openstack-qa17:57
*** vgridnev has quit IRC17:58
*** dkranz has joined #openstack-qa18:00
*** e0ne has joined #openstack-qa18:04
*** dwalleck has joined #openstack-qa18:10
mriedemsc68cal: but you could add that logging right?18:15
*** pglass has quit IRC18:16
sc68calmriedem: honestly I don't know. It could take a lot of bike shedding18:19
sc68calmriedem: let me poke and see and report back by tomorrow18:19
mriedembikeshedding in openstack? that's half the fun.18:19
openstackrecheckConsole logs not available after 13:23s for gate-nova-python27 223890,6,7b1868f18:26
*** gfidente is now known as gfidente|afk18:26
*** armax has quit IRC18:29
*** maht has quit IRC18:29
*** salv-orlando has joined #openstack-qa18:31
openstackgerritMichael Turek proposed openstack-dev/devstack: Set deploywait_timeout via localrc option  https://review.openstack.org/25807918:35
openstackrecheckConsole logs not available after 13:24s for experimental-tempest-dsvm-neutron-full-dibtest 255815,7,81c358518:39
*** binbincong_ has quit IRC18:40
*** binbincong_ has joined #openstack-qa18:41
*** Guest73233 is now known as mgagne18:42
*** mgagne is now known as Guest7643418:42
openstackgerritMerged openstack/tempest: Add run_stress to cliff-based cli framework  https://review.openstack.org/24039918:43
*** sabeen3 has quit IRC18:43
raieshow to install devstack icehouse ?18:44
openstackgerritOpenStack Proposal Bot proposed openstack/tempest: Updated from global requirements  https://review.openstack.org/25653418:45
*** dims has joined #openstack-qa18:45
*** malini has quit IRC18:45
*** dwalleck has quit IRC18:45
*** harlowja_ has quit IRC18:49
*** harlowja has joined #openstack-qa18:50
openstackgerritMerged openstack/tempest: Add compute client base class for microversion support  https://review.openstack.org/24234618:51
*** hitalia has joined #openstack-qa18:51
openstackgerritOpenStack Proposal Bot proposed openstack/tempest: Updated from global requirements  https://review.openstack.org/25653418:52
*** tosky has quit IRC18:56
*** aix has quit IRC18:59
*** malini has joined #openstack-qa19:00
*** raies has quit IRC19:01
*** jesusaur is now known as jesusaurus19:01
*** _nadya_ has joined #openstack-qa19:04
*** grafuls__ has joined #openstack-qa19:05
*** gszasz_ has joined #openstack-qa19:05
*** armax has joined #openstack-qa19:06
*** dtantsur|afk has quit IRC19:06
*** nic has quit IRC19:07
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788819:07
*** grafuls_ has quit IRC19:08
*** gszasz has quit IRC19:09
*** eil397 has joined #openstack-qa19:09
*** nic has joined #openstack-qa19:09
openstackgerritLiron Kuchlani proposed openstack/tempest: 'List volume type' comment has fixed  https://review.openstack.org/25811419:10
*** grafuls__ has quit IRC19:13
*** gszasz_ has quit IRC19:13
*** dtantsur has joined #openstack-qa19:13
sc68calmtreinish: so I'm hunting down https://bugs.launchpad.net/neutron/+bug/1523638 - and it appears that tempest is deleting the instance, but then trying to do a call to list its ports19:13
openstackLaunchpad bug 1523638 in neutron "tempest fails with No IPv4 addresses found" [High,Confirmed]19:13
openstackrecheckConsole logs not available after 13:23s for gate-nova-python27 202605,27,7689fb019:14
openstackrecheckopenstack/nova change: https://review.openstack.org/255975 failed because of: gate-tempest-dsvm-full-ceph: https://bugs.launchpad.net/bugs/146425919:14
openstackLaunchpad bug 1464259 in Cinder "Volumes tests fails often with rbd backend" [High,Triaged] - Assigned to Jon Bernard (jbernard)19:14
sc68calmtreinish: looks like it's during the run cleanup phase of the tempest test19:16
*** pvaneck has joined #openstack-qa19:19
*** jrcloud has joined #openstack-qa19:20
*** pglass has joined #openstack-qa19:21
*** zackf has quit IRC19:22
*** shardy is now known as shardy_afk19:23
*** vgridnev has joined #openstack-qa19:24
*** jrcloud is now known as zackf19:24
*** grafuls__ has joined #openstack-qa19:25
*** gszasz_ has joined #openstack-qa19:27
openstackrecheckConsole logs not available after 13:27s for gate-nova-python27 240271,5,ad1bdc119:28
*** davideagnello has joined #openstack-qa19:29
*** gfidente|afk has quit IRC19:30
*** sabeen has joined #openstack-qa19:30
*** sabeen3 has joined #openstack-qa19:32
*** openstackgerrit has quit IRC19:32
*** openstackgerrit has joined #openstack-qa19:32
*** davideagnello has quit IRC19:34
*** e0ne has quit IRC19:34
*** e0ne_ has joined #openstack-qa19:35
*** dwalleck has joined #openstack-qa19:35
*** sabeen has quit IRC19:35
*** salv-orlando has quit IRC19:37
*** dwalleck has quit IRC19:40
*** dwalleck has joined #openstack-qa19:40
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788819:41
*** e0ne_ has quit IRC19:42
openstackrecheckConsole logs not available after 13:22s for gate-nova-python27 227278,21,3d36a9219:42
openstackgerritMerged openstack/tempest: Split out keystone tenant client  https://review.openstack.org/24817019:44
*** _nadya_ has quit IRC19:48
mtreinishsc68cal: cleanup should only be run after a test finishes executing19:49
mtreinishsc68cal: without looking at the code in question I could see that someone is using a class/instance variable for something that should be local to a method19:50
mtreinishand the async deletes are leaking/racing with a test19:50
*** _nadya_ has joined #openstack-qa19:50
sc68calmtreinish: yes that was my suspicion19:51
mtreinishbut that's just a random guess without actually reading those links :)19:51
*** hitalia has quit IRC19:52
*** dwalleck has quit IRC19:54
*** vgridnev has quit IRC19:55
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-full-ceph 246505,4,a681c8b19:56
openstackgerritBrant Knudson proposed openstack-dev/devstack: Use path-mounted keystone when running in httpd  https://review.openstack.org/19389419:57
*** miqui has joined #openstack-qa19:59
*** hitalia has joined #openstack-qa19:59
bknudsonwhat's verify-tempest-config ? Is the output saved?20:01
mtreinishbknudson: it does a sanity check against openstack apis of a tempest config and outputs when things are different (it'll also let you generate a new config using a partial one with creds and an auth url)20:03
mtreinishbknudson: any output would likely be in the tempest log file20:03
mtreinishthe devstack usage just queries the api to make sure things like available services are correct20:03
mtreinishbut doesn't act on it if it's not :)20:04
*** dimtruck is now known as zz_dimtruck20:04
openstackgerritAlexey Galkin proposed openstack-dev/devstack: Add Glance Artifact API in devstack installation  https://review.openstack.org/25788820:04
bknudsonyep, I see the error in the tempest log20:04
*** pglass has quit IRC20:05
*** pglass has joined #openstack-qa20:06
*** pglbutt has joined #openstack-qa20:06
openstackgerritMerged openstack/tempest: Remove unused add_sample()  https://review.openstack.org/25500520:07
*** zz_dimtruck is now known as dimtruck20:07
openstackrecheckConsole logs not available after 13:34s for gate-tempest-dsvm-nova-wsgi-full 252283,30,f0d49cb20:10
*** pglass has quit IRC20:10
*** e0ne has joined #openstack-qa20:13
openstackgerritJohn Warren proposed openstack/tempest: Split out Neutron security groups client  https://review.openstack.org/25803020:13
*** hitalia has quit IRC20:14
*** e0ne_ has joined #openstack-qa20:15
*** rockyg has joined #openstack-qa20:15
*** e0ne has quit IRC20:16
*** lucasagomes is now known as lucas-dinner20:17
*** [1]Thelo has joined #openstack-qa20:21
*** gszasz_ has quit IRC20:21
*** hitalia has joined #openstack-qa20:23
*** Thelo has quit IRC20:23
*** [1]Thelo is now known as Thelo20:23
*** _nadya_ has quit IRC20:28
*** rockyg has quit IRC20:29
bknudsonlooks like tempest is converting uri = http://127.0.0.1:5000/v2.0/ to http://127.0.0.1/v2.0/v2.0/tenants somewhere?20:29
*** rockyg has joined #openstack-qa20:30
bknudsondo you know where that might happen?20:30
sdaguebknudson: example?20:30
bknudsonsdague: http://logs.openstack.org/94/193894/4/check/gate-tempest-dsvm-full/a7680b2/logs/tempest.txt.gz#_2015-12-14_21_05_53_92720:30
bknudsonthat's the log that's showing the odd request line20:31
bknudsonthe conf looks as I would expect: http://logs.openstack.org/94/193894/4/check/gate-tempest-dsvm-full/a7680b2/logs/tempest_conf.txt.gz20:31
mtreinishbknudson: what do you put in the service catalog?20:33
sdaguebknudson: it may be assumptions on parsing the service catalog20:33
sdaguegiven that it's all been convention up to this point20:33
bknudsonI am proposing a change to the service catalog entry, it'll have like http://hostname/identity/v2.020:34
bknudsonwhereas it would have had http://hostname:5000/v2.020:34
bknudsonso if you could point to the service catalog handling that would help.20:34
bknudsonI don't know if it's in tempest-lib or tempest20:35
mtreinishbknudson: it's buried somewhere in her: https://github.com/openstack/tempest-lib/blob/master/tempest_lib/common/rest_client.py#L4520:36
mtreinish*here20:36
mtreinishit's likely actually in auth.py now that I think about it20:36
*** yfried has quit IRC20:38
bknudsonok, I think I'm finding stuff.20:38
bknudsonthanks20:38
*** aysyd has quit IRC20:38
*** SridharG has quit IRC20:39
*** dwalleck has joined #openstack-qa20:40
*** gmmaha has left #openstack-qa20:42
*** rockyg has quit IRC20:44
openstackgerritMatthew Treinish proposed openstack/tempest: Fix and improve server personality tests  https://review.openstack.org/25749320:45
*** malini has quit IRC20:45
mtreinishmriedem: any thoughts on: https://review.openstack.org/#/c/256892/20:46
mtreinishsince that's one of your favorite tests20:46
*** rockyg has joined #openstack-qa20:46
mriedemwell i was going to say that would break the cells job, but we skip that whole test class for cells https://github.com/openstack/nova/blob/master/devstack/tempest-dsvm-cells-rc#L8220:47
mriedemso that's not a problem20:47
*** matt6434 is now known as mattoliverau20:48
mtreinishmriedem: heh, yeah I was gonna say the operations it performs aren't really any different. It just logs into the guests now20:48
mtreinishoh, you meant because you filter on job names20:48
mtreinishnm20:48
mriedemmtreinish: -1 with comments in the thing20:50
mriedemi'm ok with the rename, but not the wait_until=ACTIVE and ssh stuff20:50
mriedemthe current race is a pain in my butt, but we're getting a handle on it20:52
*** yfried has joined #openstack-qa20:52
mtreinishmriedem: I'm not sure the fact that it exposes a race by accident is a reason not to make it a more thorough test.20:53
mtreinishmriedem: my opinion of the test as it is now is it's more of an api test because it doesn't actually use anything it's making20:53
mtreinishwhich is why I tried to make it like an end user workflow20:53
mtreinishI guess I can make it a rename and move to the volume api tests20:54
*** miqui has quit IRC20:55
*** dwalleck has quit IRC20:55
mriedemmtreinish: yes and no i guess, it does use stuff it's making20:56
mriedembehind the scenes really20:56
mriedemthe image snapshot has the volume snapshot info, which then triggers the boot from volume on the 2nd instance20:56
mtreinishmriedem: not in the way a user would. It makes a server boot from volume, snapshots it and then boots from the snapshot20:56
mriedemeven though tempest isn't telling it to boot from volume specifically20:56
mtreinishyeah, but it's just testing the api does the right thing, not interacting with those resources20:57
mriedemwell, those are user actions right?20:57
mriedemit's a lot more than the api20:57
mriedemit's also that nova is orchestrating the boot from volume snapshot on the 2nd instance20:57
mriedemwhich is actually the race it exposed20:58
mtreinishmriedem: sure, but isn't that whether nova's api is working correctly20:58
mtreinishyour testing nova's snapshot stuff is creating the images correctly so it boots from volume from snapshot20:58
*** krtaylor has quit IRC20:58
mriedemso is the only disctinction for scenario tests that you can ssh into the guest?20:59
*** e0ne_ has quit IRC20:59
mriedemi don't really care where this test lives,20:59
mtreinishno, ssh can be used for api tests too. Like to verify something gets passed to guest from nova20:59
mriedembut i wouldn't want to add wait_until=ACTIVE before the 2nd server delete20:59
mtreinishthe scenario tests are supposed to mimic end user action workflows20:59
mriedemthe immediate delete while the 2nd server is building is a user action too20:59
mriedemas in,20:59
mriedem'oops, i didn't want this, delete'21:00
mtreinishsure, but that's not the intent of the test is21:00
mtreinishit21:00
mriedemyeah21:00
mriedemanyway, i don't care where it lives21:00
mtreinishit's an artifact of the way it was written21:00
mtreinishand it happens to be exposing interesting races21:00
*** rockyg has quit IRC21:01
mtreinishthat's what I'm getting at, if that's an interaction you care about we should make it an explicit test21:01
sdagueso this isn't always a fail21:03
sdaguehowever this seems troubling21:03
sdaguehttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22Invalid%20volume:%20Volume%20still%20has%201%20dependent%20snapshots%5C%2221:03
openstackgerritDimitry Ushakov proposed openstack-infra/devstack-gate: Update README and move ~/workspace-cache after project setup  https://review.openstack.org/25814821:05
mtreinishsdague: looking at the code from that warning, the test issues a delete and then wait loops on it. So i'm guess tempest is issuing the first delete too soon21:07
mtreinishbut everything works out in the end21:07
sdaguemtreinish: can we query before that delete?21:08
mtreinishsdague: is that something we can query for? I'm not exactly sure what the state we need to check for before the delete21:08
mtreinishsdague: mriedem was just bitching about me trying to make that test case more deterministic so he's the one to ask :)21:09
openstackgerritgordon chung proposed openstack-dev/devstack: ensure devstack uses correct branch  https://review.openstack.org/25814921:09
mriedemsdague: i have the patch for that21:10
mriedemhttps://review.openstack.org/#/c/258118/21:10
openstackgerritgordon chung proposed openstack-dev/devstack: ensure devstack uses correct branch  https://review.openstack.org/25815021:10
*** ajmiller has quit IRC21:11
mriedemsdague: feel free to approve :)21:11
*** krtaylor has joined #openstack-qa21:12
mriedemif that doesn't fix it, we might have to look at changes in cinder or in tempest21:14
*** pglbutt has quit IRC21:14
*** pglass has joined #openstack-qa21:14
*** jecarey has quit IRC21:14
*** jecarey has joined #openstack-qa21:15
sdagueok, well +2, but I'd like to see test results21:15
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 247240,6,30a0a3321:16
*** ajmiller has joined #openstack-qa21:16
*** erlon has quit IRC21:16
*** jecarey has quit IRC21:19
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 252428,3,97306ee21:29
openstackrecheckopenstack/nova change: https://review.openstack.org/231076 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/135557321:29
openstackLaunchpad bug 1355573 in grenade "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]21:29
openstackgerritOpenStack Proposal Bot proposed openstack/tempest: Updated from global requirements  https://review.openstack.org/25653421:30
*** e0ne has joined #openstack-qa21:30
*** davideagnello has joined #openstack-qa21:31
*** Guest76434 is now known as mgagne21:33
*** mgagne is now known as Guest16021:34
*** Guest160 has quit IRC21:34
*** Guest160 has joined #openstack-qa21:34
*** Guest160 is now known as mgagne21:35
*** davideagnello has quit IRC21:35
*** mwagner_lap has quit IRC21:36
*** davideagnello has joined #openstack-qa21:39
openstackrecheckConsole logs not available after 13:24s for gate-nova-python27 229574,9,b7a92d421:44
*** gszasz has joined #openstack-qa21:57
*** david-lyle has quit IRC21:58
*** Swami_ has quit IRC22:00
*** david-lyle has joined #openstack-qa22:00
zackfany core reviewers mind taking a look at this? https://review.openstack.org/#/c/178561/22:00
*** regXboi has quit IRC22:02
*** cdent has quit IRC22:05
sdaguemtreinish: why do we always use floating ips for verification on tempest connectivity?22:06
mtreinishsdague: likely because that's how devstack is configuring tempest22:07
mtreinishit should be configurable to just use a fixed network, although all the networking options are like a maze, so I'm not sure how off the top of my head22:08
mtreinishI might have put it in the tempest config doc22:08
mtreinishhttp://docs.openstack.org/developer/tempest/configuration.html#networking22:08
sdaguehmmm... it's set as fixed in what I'm seeing22:08
*** Swami_ has joined #openstack-qa22:08
mtreinishthe tests could also just be ignoring it too for all I know...22:09
mtreinishjlanoux and andreaf have been working on a spec for like a year to unify all of that22:09
mtreinishit's still not done :(22:09
sdaguebecause I kind of wonder if our failure rate is really something about floating ips22:10
openstackgerritMerged openstack/tempest: Make v3 update_user_password use **kwargs  https://review.openstack.org/25341922:11
*** sabeen3 has quit IRC22:12
mtreinishsdague: so for the scenario tests it looks like it looks at: https://github.com/openstack/tempest/blob/master/tempest/config.py#L68422:12
sdagueI see nothing in the boot pattern runs that should be hitting floating ip22:13
sdaguebased on our config22:13
mtreinishand determines whether it needs to be makign a floating ip22:13
openstackrecheckConsole logs not available after 13:33s for gate-nova-python27 257344,7,8e7863c22:13
sdagueoh, so that's interesting, it defaults to floating22:13
*** dkranz has quit IRC22:14
openstackgerritMerged openstack-infra/devstack-gate: Remove grenade from PROJECTS list  https://review.openstack.org/23450822:15
*** rcernin has joined #openstack-qa22:16
openstackgerritMerged openstack-infra/devstack-gate: Remove clients from default PROJECTS list  https://review.openstack.org/23450922:16
openstackrecheckopenstack/horizon change: https://review.openstack.org/242700 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/135557322:16
openstackLaunchpad bug 1355573 in grenade "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]22:17
openstackgerritSean Dague proposed openstack-dev/devstack: set the validation path to fixed for n-net  https://review.openstack.org/25816622:17
*** itzikb has joined #openstack-qa22:17
sdaguemtreinish: it looks like it was one way for compute and defaulting the other way for scenario22:17
mtreinishsdague: yeah looking at the code there is a duplicated option in nova section too. I think there is a patch up to consolidate them22:17
mtreinishyeah: https://review.openstack.org/#/c/253444/1322:18
sdagueyeh, I'm tempted to just see if that will help22:18
*** hitalia has quit IRC22:21
mtreinishsdague: heh I did a little grepping I don't see anything that uses the compute section option anymore22:21
sdagueyeh, that might be the case22:21
sdagueI am really curious if floating ips are basically fundamentally problematic here22:21
mtreinishthat's been my biggest complaint with the implementation of the ssh-auth-strategy bp is that the deprecation path was not correctly done22:22
*** mwagner_lap has joined #openstack-qa22:22
mtreinishand it's been taking so long to implement it just made everything more confusing22:22
*** hitalia has joined #openstack-qa22:22
mtreinishthey might be, it adds extra complexity where it's not really needed22:22
sdagueyeh, well lets see what that devstack patch looks like, because the volumes are a lot more fail of late I think22:23
*** shardy_afk has quit IRC22:23
sdaguemtreinish: this is my 2nd most grinded on patch recently - https://review.openstack.org/#/c/25646922:25
sdagueafter the extras.d one22:25
*** gszasz has quit IRC22:26
mtreinishsdague: heh, it's stable/kilo too so you've got that going against you there22:26
mtreinishbut you've still got a few days worth of rechecks until you catch up to the extras.d one22:26
mtreinishsdague: is that running the ironic job with like a 50% failure rate right now22:27
mtreinishoh, its nonvoting on kilo22:27
*** salv-orlando has joined #openstack-qa22:29
*** e0ne has quit IRC22:32
*** dwalleck has joined #openstack-qa22:33
*** dwalleck has quit IRC22:34
openstackrecheckConsole logs not available after 13:37s for gate-keystone-python34 257458,2,84b095a22:34
*** dwalleck has joined #openstack-qa22:35
*** davideagnello has quit IRC22:36
*** davideagnello has joined #openstack-qa22:37
*** dimtruck is now known as zz_dimtruck22:41
*** mriedem is now known as mriedem_away22:44
openstackgerritZack Feldstein proposed openstack/tempest: Fix password not strong enough failures  https://review.openstack.org/17856122:46
openstackrecheckConsole logs not available after 13:23s for gate-nova-python27 257943,2,271af0822:48
sdagueit's non voting everywhere I thought22:49
sdaguebecause it got to such a high failure rate22:49
mtreinishsdague: there is an ironic voting job on tempest and it's been blocking things up22:51
mtreinishI've been complaining to jroll about it since this morning :)22:51
jrollmtreinish: I said go ahead and make it non-voting if you'd like22:51
mtreinishjroll: I said I was fine with you doing that :)22:52
jrollmtreinish: sigh22:52
mtreinishhehe22:52
mtreinishwell, I'm getting towards the end of my day anyway so it doesn't effect me too much right now22:53
jrollmtreinish: 25817922:53
sdague+222:55
mtreinishjroll: thanks22:55
*** dstanek has quit IRC22:56
andreafmtreinish: yeah, I think the main problem has been the time is taking to get that done :( we had some many partly honoured settings that it wasn't really possible I think to have a clear deprecation path - or it would have been possible if we implemented that in a month time or so22:56
jrollsdague: while we're talking about how terrible everything is can I get your eyes on https://review.openstack.org/#/c/257637/22:56
*** dstanek has joined #openstack-qa22:56
sdaguejroll: isn't there a scaling factor in tempest of that test?22:57
jrollsdague: elaborate?22:57
sdaguejroll: hold one sec, let me look at code22:58
sdagueoh, tempest doesn't have the scaling factor that nova has22:59
*** dustins is now known as dustins|out22:59
sdaguehttps://github.com/openstack/nova/blob/82b1181102c42817cf360de05e16e93ada5b3ee7/nova/test.py#L172 - is probably worth bringing into tempest23:00
sdaguemtreinish: thoughts?23:00
mtreinishsdague: so slow tests can adjust the timeout fixture23:00
mtreinishI'm fine with that23:00
sdaguehttps://github.com/openstack/nova/blob/82b1181102c42817cf360de05e16e93ada5b3ee7/nova/tests/fixtures.py#L16923:00
sdagueyeh, basically they can declare a multiplier23:01
*** david-lyle has quit IRC23:01
sdaguethen you don't need a bunch of weird timeouts, it's the base on, plus the multiplier23:01
sdaguejroll: so if you think https://review.openstack.org/#/c/257637/ will stop gap you there, I think that's fine23:01
mtreinishsdague: you should push that into upstream fixtures. It seems like a generally useful option to have23:01
*** david-lyle has joined #openstack-qa23:01
sdaguemtreinish: yeh, that one is probably worth getting into upstream fixtures23:02
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-full-ceph-src-glance_store 258089,1,111622e23:02
*** pglass has quit IRC23:02
*** jecarey has joined #openstack-qa23:02
sdaguehonestly, it was collected pattern in just trying to organize the nova code that was all inline23:02
jrollsdague: I think it should, but it's hard to tell. if it doesn't, I think most of that change is still useful23:02
jrolland if it doesn't, my next plan is to find a bunch of bare metal to run tempest on or something because this is getting absurd23:03
*** rfolco has joined #openstack-qa23:03
sdagueok, I'm +2 on it23:03
jrollthank you23:03
sdagueif I get a window, I'll get this scaling factor into tempest and then we can use that instead23:03
sdaguebut don't want to hold you up on that23:03
jrollyeah, that sounds nice23:04
*** dstanek has quit IRC23:06
*** jecarey has quit IRC23:06
*** Swami__ has joined #openstack-qa23:07
*** dstanek has joined #openstack-qa23:07
*** zhangjn has joined #openstack-qa23:07
*** zhangjn has quit IRC23:09
*** Swami_ has quit IRC23:09
*** dwalleck has quit IRC23:09
*** dwalleck has joined #openstack-qa23:10
*** krtaylor has quit IRC23:10
openstackgerritAndrea Frittoli proposed openstack/tempest: Test change to debug lp1524717  https://review.openstack.org/25581523:14
*** dwalleck has quit IRC23:15
openstackrecheckConsole logs not available after 13:25s for gate-nova-python27 245678,21,a2f724c23:15
*** dwalleck has joined #openstack-qa23:15
*** dwalleck has quit IRC23:17
mtreinishandreaf: well it would have been good to make the options upfront with the oslo deprecation set23:19
mtreinishso when we added the new validation optiosn they were used internally from the start23:19
mtreinishbut whatever, that ship has sailed, and the patch fixing it is up at least23:19
mtreinishalthough it needs a rebase23:20
*** rcernin has quit IRC23:20
andreafmtreinish: doh23:21
*** e0ne has joined #openstack-qa23:21
*** krtaylor has joined #openstack-qa23:22
*** salv-orlando has quit IRC23:23
openstackgerritDavid Paterson proposed openstack/tempest: Migrate verify-tempest-config to new cliff cli framework  https://review.openstack.org/24724023:24
*** hichihara has joined #openstack-qa23:28
openstackrecheckConsole logs not available after 13:29s for gate-nova-python27 250738,11,052cc8923:29
*** stevebaker has quit IRC23:30
*** stevebaker has joined #openstack-qa23:31
*** david-lyle_ has joined #openstack-qa23:33
openstackgerritDavid Paterson proposed openstack/tempest: Migrate tempest-account-generator to new cliff cli framework  https://review.openstack.org/25242823:33
*** rfolco has quit IRC23:36
*** david-lyle has quit IRC23:36
*** safchain has quit IRC23:38
*** tochi has joined #openstack-qa23:39
openstackrecheckConsole logs not available after 13:22s for gate-nova-python27 253087,4,d68a3fe23:42
*** oomichi has joined #openstack-qa23:47
*** itzikb has quit IRC23:47
oomichimtreinish: hi, are you still there?23:47
oomichimtreinish: you said yesterday ironic gate failure ratio is 43%, how to get the ratio? from health-check dashboard?23:48
gmannandreaf: nice idea about Manager things, I think thats part of https://review.openstack.org/#/c/92804/ ?23:50
mtreinishoomichi: yeah from the health dashboard23:51
mtreinishit was a 43% failure rate for the baremetal scenario test in the gate queue23:51
mtreinishoomichi: http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_baremetal_basic_ops.BaremetalBasicOps.test_baremetal_server_ops23:51
oomichimtreinish: really useful ! :)23:52
oomichimtreinish: nice work on that ;)23:53
mtreinishheh, yeah it's come a long way since ft collins a couple months ago :)23:53
*** jasonsb has quit IRC23:55
openstackrecheckConsole logs not available after 13:27s for gate-nova-python27 247585,10,936f43a23:56
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Add different_host test on multiple nodes  https://review.openstack.org/25766023:57
*** jasonsb has joined #openstack-qa23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!