*** rhsu has joined #openstack-qa | 00:02 | |
openstackrecheck | openstack/heat change: https://review.openstack.org/81678 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error | 00:04 |
---|---|---|
*** yamahata__ has quit IRC | 00:09 | |
*** mestery has joined #openstack-qa | 00:18 | |
openstackgerrit | Christopher Yeoh proposed a change to openstack/tempest: Test current tenant not added to private flavor https://review.openstack.org/81551 | 00:24 |
*** matsuhashi has joined #openstack-qa | 00:25 | |
*** rhsu has quit IRC | 00:32 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check show_hypervisor attributes of Nova V2/V3 API https://review.openstack.org/81194 | 00:33 |
*** mestery has quit IRC | 00:38 | |
*** zhikunliu has joined #openstack-qa | 00:48 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify Nova create & get Floating IP attributes https://review.openstack.org/80527 | 00:51 |
openstackgerrit | Brant Knudson proposed a change to openstack/tempest: Add test for keystone-manage db_version https://review.openstack.org/82309 | 00:51 |
*** arosen1 has quit IRC | 01:00 | |
*** mestery has joined #openstack-qa | 01:11 | |
*** yamahata has joined #openstack-qa | 01:14 | |
*** mestery has quit IRC | 01:18 | |
*** arosen1 has joined #openstack-qa | 01:18 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify "get a server" API response attributes https://review.openstack.org/80175 | 01:19 |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify list Image attributes through Nova V2 API https://review.openstack.org/78908 | 01:30 |
*** nosnos has joined #openstack-qa | 01:36 | |
*** mestery has joined #openstack-qa | 01:37 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add "delete the volume-attached server" tests https://review.openstack.org/75288 | 01:38 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Disable other suspend/resume tests if not supported https://review.openstack.org/82410 | 01:38 |
*** mestery has quit IRC | 01:43 | |
*** mestery has joined #openstack-qa | 01:54 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check detail list Images attributes of Nova V2 API https://review.openstack.org/80911 | 01:56 |
*** mriedem has quit IRC | 01:56 | |
*** arosen1 has quit IRC | 01:59 | |
*** mestery has quit IRC | 02:00 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check show_hypervisor attributes of Nova V2/V3 API https://review.openstack.org/81194 | 02:01 |
*** mriedem has joined #openstack-qa | 02:07 | |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Disable other suspend/resume tests if not supported https://review.openstack.org/82410 | 02:09 |
*** arosen1 has joined #openstack-qa | 02:10 | |
*** adalbas has joined #openstack-qa | 02:12 | |
*** shwetaap has joined #openstack-qa | 02:21 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify the response status of create delete Image https://review.openstack.org/81687 | 02:21 |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate image metadata attributes of Nova APIs https://review.openstack.org/81699 | 02:29 |
*** mriedem has quit IRC | 02:30 | |
openstackgerrit | Eiichi Aikawa proposed a change to openstack/tempest: Verify "get version" API response attributes https://review.openstack.org/80936 | 02:34 |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check attributes of image meta item Nova APIs https://review.openstack.org/81748 | 02:35 |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Use OS::Nova::Server for NeutronResourcesTestJSON https://review.openstack.org/82393 | 02:37 |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Fail a test if stack delete failed https://review.openstack.org/82392 | 02:37 |
*** mestery has joined #openstack-qa | 02:41 | |
*** bknudson has quit IRC | 02:45 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate get keypair attributes of Nova V2/V3 API https://review.openstack.org/80919 | 02:55 |
*** matsuhashi has quit IRC | 02:55 | |
*** adalbas has quit IRC | 03:03 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate list_keypair attribute of Nova V2/V3 APIs https://review.openstack.org/80924 | 03:05 |
*** mestery has quit IRC | 03:18 | |
*** matsuhashi has joined #openstack-qa | 03:21 | |
*** arosen1 has quit IRC | 03:22 | |
*** nati_ueno has joined #openstack-qa | 03:23 | |
*** arosen1 has joined #openstack-qa | 03:25 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check list & search hypervisor attributes of Nova https://review.openstack.org/81442 | 03:27 |
*** arosen1 has quit IRC | 03:28 | |
*** arosen1 has joined #openstack-qa | 03:29 | |
*** arosen2 has joined #openstack-qa | 03:30 | |
*** arosen1 has quit IRC | 03:33 | |
*** ekarlso has quit IRC | 03:48 | |
*** ekarlso has joined #openstack-qa | 03:48 | |
*** shwetaap has quit IRC | 03:54 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check hypervisor statistics attributes of Nova API https://review.openstack.org/81465 | 03:57 |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify hypervisor uptime attributes of Nova API https://review.openstack.org/81476 | 04:06 |
*** Akshik has joined #openstack-qa | 04:21 | |
*** shwetaap has joined #openstack-qa | 04:25 | |
*** shwetaap has quit IRC | 04:31 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify list_hypervisors_detail Nova V2/V3 API https://review.openstack.org/81219 | 04:35 |
openstackgerrit | Christopher Yeoh proposed a change to openstack/qa-specs: Add a template for design specifications https://review.openstack.org/81979 | 04:42 |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate get keypair attributes of Nova V2/V3 API https://review.openstack.org/80919 | 04:45 |
*** mestery has joined #openstack-qa | 04:46 | |
*** nati_ueno has quit IRC | 04:46 | |
*** nati_ueno has joined #openstack-qa | 04:47 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate list_keypair attribute of Nova V2/V3 APIs https://review.openstack.org/80924 | 04:51 |
*** nati_ueno has quit IRC | 04:51 | |
*** nati_ueno has joined #openstack-qa | 04:52 | |
*** shwetaap has joined #openstack-qa | 04:57 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate hypervisors_servers Nova V2/V3 API https://review.openstack.org/81222 | 05:03 |
*** shwetaap has quit IRC | 05:04 | |
raies | afazekas: hi can you please suggest API documents for /tempest/tempest/api/data_processing, /tempest/tempest/api/database, /tempest/tempest/api/orchestration, /tempest/tempest/api/queuing and /tempest/tempest/api/telemetry | 05:04 |
*** yfried has quit IRC | 05:11 | |
openstackgerrit | Eiichi Aikawa proposed a change to openstack/tempest: Verify certificate API response attributes https://review.openstack.org/81477 | 05:14 |
*** chandankumar has quit IRC | 05:14 | |
*** mestery has quit IRC | 05:14 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check attach-detach FIP & get FIP pool attributes https://review.openstack.org/80531 | 05:16 |
*** nosnos_ has joined #openstack-qa | 05:16 | |
*** nosnos has quit IRC | 05:19 | |
raies | anyone else on my last question to afazekas ?? ^^ | 05:19 |
*** Akshik has quit IRC | 05:20 | |
*** Madan has joined #openstack-qa | 05:20 | |
*** Akshik has joined #openstack-qa | 05:20 | |
*** chandan_kumar has joined #openstack-qa | 05:25 | |
*** Akshik_ has joined #openstack-qa | 05:25 | |
*** Akshik has quit IRC | 05:26 | |
*** GMann_ has joined #openstack-qa | 05:29 | |
*** GMann has quit IRC | 05:29 | |
*** GMann_ has quit IRC | 05:30 | |
*** shwetaap has joined #openstack-qa | 05:30 | |
*** GMann has joined #openstack-qa | 05:30 | |
*** Akshik_ has quit IRC | 05:33 | |
openstackgerrit | Christopher Yeoh proposed a change to openstack/tempest: Test current tenant not added to private flavor https://review.openstack.org/81551 | 05:34 |
*** Akshik has joined #openstack-qa | 05:35 | |
*** shwetaap has quit IRC | 05:36 | |
*** Aimon has quit IRC | 05:40 | |
*** Akshik has quit IRC | 05:41 | |
*** Akshik has joined #openstack-qa | 05:46 | |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: Stop volume leaking https://review.openstack.org/82427 | 05:51 |
*** Akshik has quit IRC | 05:53 | |
*** Akshik_ has joined #openstack-qa | 05:54 | |
*** Akshik_ has quit IRC | 05:57 | |
*** Akshik_ has joined #openstack-qa | 05:57 | |
*** matsuhas_ has joined #openstack-qa | 06:00 | |
*** matsuhashi has quit IRC | 06:01 | |
*** shwetaap has joined #openstack-qa | 06:03 | |
*** rdekel has joined #openstack-qa | 06:09 | |
*** shwetaap has quit IRC | 06:10 | |
*** mestery has joined #openstack-qa | 06:13 | |
*** mestery has quit IRC | 06:13 | |
openstackgerrit | nayna-patel proposed a change to openstack/tempest: Adds more verification in list alarms https://review.openstack.org/79942 | 06:13 |
*** mestery has joined #openstack-qa | 06:14 | |
*** nati_ueno has quit IRC | 06:14 | |
*** mestery_ has joined #openstack-qa | 06:15 | |
*** mestery has quit IRC | 06:15 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify the list volume attributes of Nova APIs https://review.openstack.org/78950 | 06:15 |
*** nosnos has joined #openstack-qa | 06:19 | |
*** mestery_ has quit IRC | 06:20 | |
*** nosnos_ has quit IRC | 06:22 | |
openstackgerrit | Eiichi Aikawa proposed a change to openstack/tempest: Verify tenant usages API response attributes https://review.openstack.org/81766 | 06:26 |
*** psharma has joined #openstack-qa | 06:28 | |
*** arosen2 has quit IRC | 06:31 | |
*** matsuhas_ has quit IRC | 06:31 | |
*** matsuhashi has joined #openstack-qa | 06:31 | |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: Stop leaking in images tests https://review.openstack.org/82436 | 06:31 |
*** saju_m has joined #openstack-qa | 06:35 | |
*** shwetaap has joined #openstack-qa | 06:36 | |
*** obondarev has joined #openstack-qa | 06:36 | |
*** amotoki has joined #openstack-qa | 06:41 | |
*** shwetaap has quit IRC | 06:42 | |
*** smurashov has joined #openstack-qa | 06:51 | |
*** jamielennox is now known as jamielennox|away | 06:51 | |
*** saju_m has quit IRC | 06:59 | |
*** shwetaap has joined #openstack-qa | 07:09 | |
*** saju_m has joined #openstack-qa | 07:12 | |
*** dkorn has joined #openstack-qa | 07:12 | |
openstackgerrit | xu-haiwei proposed a change to openstack/tempest: Verify the response attributes of 'list_aggregates' https://review.openstack.org/81483 | 07:14 |
*** shwetaap has quit IRC | 07:15 | |
*** enikanorov__ has joined #openstack-qa | 07:15 | |
*** saju_m has quit IRC | 07:17 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify get flavor attributes of Nova V2/V3 APIs https://review.openstack.org/80543 | 07:17 |
*** saju_m has joined #openstack-qa | 07:18 | |
*** kmartin has joined #openstack-qa | 07:18 | |
*** Akshik__ has joined #openstack-qa | 07:19 | |
*** dkorn has quit IRC | 07:19 | |
*** KurtMartin has quit IRC | 07:19 | |
*** Akshik_ has quit IRC | 07:19 | |
*** enikanorov has quit IRC | 07:20 | |
openstackgerrit | Sergey Murashov proposed a change to openstack/tempest: Add opportunity to directly update headers https://review.openstack.org/82083 | 07:21 |
*** saju_m has quit IRC | 07:22 | |
*** Akshik__ has quit IRC | 07:23 | |
*** saju_m has joined #openstack-qa | 07:24 | |
*** Akshik has joined #openstack-qa | 07:24 | |
*** saju_m has quit IRC | 07:30 | |
*** saju_m has joined #openstack-qa | 07:32 | |
*** dkorn has joined #openstack-qa | 07:33 | |
*** Akshik has quit IRC | 07:36 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Validate for list flavor attributes of V2/V3 APIs https://review.openstack.org/78527 | 07:38 |
*** yrabl has joined #openstack-qa | 07:40 | |
*** shwetaap has joined #openstack-qa | 07:41 | |
*** jlibosva has joined #openstack-qa | 07:44 | |
*** tkammer has joined #openstack-qa | 07:44 | |
*** shwetaap has quit IRC | 07:48 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Verify detail_list flavor attributes of V2/V3 APIs https://review.openstack.org/80548 | 07:50 |
afazekas | raies: I do not have any better source than the source of the projects including the clients and unit tests and api spec, and project page, and the openstack usual global API documentation pages | 07:52 |
*** Akshik has joined #openstack-qa | 07:56 | |
*** ylobankov has joined #openstack-qa | 08:04 | |
openstackgerrit | Zhang Gong proposed a change to openstack/tempest: Add Keystone role and service test cases https://review.openstack.org/74950 | 08:08 |
openstackgerrit | Zhang Gong proposed a change to openstack/tempest: Add Keystone role and service test cases https://review.openstack.org/74950 | 08:12 |
*** shwetaap has joined #openstack-qa | 08:14 | |
*** shwetaap has quit IRC | 08:21 | |
*** jpich has joined #openstack-qa | 08:21 | |
*** yrabl has quit IRC | 08:25 | |
*** yrabl has joined #openstack-qa | 08:29 | |
*** afazekas has quit IRC | 08:32 | |
*** afazekas has joined #openstack-qa | 08:33 | |
*** luqas has joined #openstack-qa | 08:33 | |
*** Akshik has quit IRC | 08:36 | |
*** shwetaap has joined #openstack-qa | 08:47 | |
*** Akshik has joined #openstack-qa | 08:48 | |
openstackgerrit | A change was merged to openstack/tempest: Verify list Image attributes through Nova V2 API https://review.openstack.org/78908 | 08:52 |
*** shwetaap has quit IRC | 08:53 | |
openstackgerrit | xu-haiwei proposed a change to openstack/tempest: Verify the response attributes of 'list_aggregates' https://review.openstack.org/81483 | 08:55 |
*** ilyashakhat has quit IRC | 08:55 | |
*** safchain has joined #openstack-qa | 08:57 | |
*** jlibosva has quit IRC | 08:58 | |
*** jordanP has joined #openstack-qa | 08:59 | |
*** rossella_s has joined #openstack-qa | 08:59 | |
*** jlibosva has joined #openstack-qa | 09:00 | |
*** GMann has quit IRC | 09:01 | |
*** tkammer has quit IRC | 09:04 | |
*** yassine has joined #openstack-qa | 09:05 | |
Akshik | Are there any Citrix CPBM like tool for OpenStack | 09:10 |
*** mkollaro has joined #openstack-qa | 09:11 | |
*** jlibosva has quit IRC | 09:13 | |
*** jlibosva has joined #openstack-qa | 09:14 | |
*** vponomaryov has joined #openstack-qa | 09:15 | |
*** shwetaap has joined #openstack-qa | 09:20 | |
*** jordanP has quit IRC | 09:20 | |
*** ilyashakhat has joined #openstack-qa | 09:20 | |
*** tkammer has joined #openstack-qa | 09:21 | |
*** shwetaap has quit IRC | 09:26 | |
*** Akshik has quit IRC | 09:30 | |
*** tkammer has quit IRC | 09:40 | |
*** shwetaap has joined #openstack-qa | 09:52 | |
*** tkammer has joined #openstack-qa | 09:56 | |
*** shwetaap has quit IRC | 09:59 | |
*** luqas has quit IRC | 10:01 | |
openstackgerrit | Longgeek proposed a change to openstack-dev/devstack: Add swift user executes the command authority mkfs.xfs. https://review.openstack.org/82459 | 10:01 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: add quotas tests https://review.openstack.org/82461 | 10:06 |
*** zhikunliu has quit IRC | 10:12 | |
*** Akshik has joined #openstack-qa | 10:16 | |
*** jordanP has joined #openstack-qa | 10:17 | |
openstackgerrit | Julien Leloup proposed a change to openstack/tempest: Stress Test for server availability through SSH https://review.openstack.org/74067 | 10:20 |
*** Akshik has quit IRC | 10:23 | |
*** mkoderer has joined #openstack-qa | 10:23 | |
*** Akshik has joined #openstack-qa | 10:24 | |
*** shwetaap has joined #openstack-qa | 10:25 | |
*** shwetaap has quit IRC | 10:32 | |
*** matsuhashi has quit IRC | 10:33 | |
*** tosky has joined #openstack-qa | 10:34 | |
openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: Check create/delete keypair attribute of Nova APIs https://review.openstack.org/82464 | 10:35 |
*** matsuhas_ has joined #openstack-qa | 10:35 | |
*** luqas has joined #openstack-qa | 10:39 | |
*** yamahata has quit IRC | 10:43 | |
*** jordanP has quit IRC | 10:45 | |
*** GMann has joined #openstack-qa | 10:48 | |
openstackgerrit | Christopher Yeoh proposed a change to openstack-dev/devstack: Adds the ability to set GUEST_INTERFACE_DEFAULT https://review.openstack.org/82470 | 10:50 |
*** yassine has quit IRC | 10:52 | |
openstackgerrit | Christopher Yeoh proposed a change to openstack-dev/devstack: Adds ability to set the base image name https://review.openstack.org/82472 | 10:54 |
*** mkollaro has quit IRC | 10:56 | |
*** matsuhas_ has quit IRC | 11:07 | |
openstackrecheck | Console logs not available after 14:38s for gate-heat-pep8 82458,1,ece7327 | 11:11 |
openstackgerrit | Bob Ball proposed a change to openstack-dev/devstack: XenAPI: Find location for XenAPI plugins https://review.openstack.org/81849 | 11:16 |
*** rdekel has quit IRC | 11:18 | |
*** mkollaro has joined #openstack-qa | 11:19 | |
*** jasondotstar has quit IRC | 11:20 | |
*** Akshik has quit IRC | 11:22 | |
*** Akshik_ has joined #openstack-qa | 11:23 | |
*** nosnos has quit IRC | 11:23 | |
*** shwetaap has joined #openstack-qa | 11:28 | |
*** Akshik_ has quit IRC | 11:28 | |
*** chandankumar_ has joined #openstack-qa | 11:29 | |
*** dkranz has quit IRC | 11:30 | |
*** shwetaap has quit IRC | 11:35 | |
*** salv-orlando has quit IRC | 11:37 | |
openstackgerrit | enikanorov proposed a change to openstack/tempest: unskip load balancer basic scenario test https://review.openstack.org/82480 | 11:42 |
*** weshay has joined #openstack-qa | 11:46 | |
*** matsuhashi has joined #openstack-qa | 11:53 | |
*** nosnos has joined #openstack-qa | 11:54 | |
*** safchain has quit IRC | 11:59 | |
*** ianw- has joined #openstack-qa | 12:01 | |
*** ianw has quit IRC | 12:01 | |
*** shwetaap has joined #openstack-qa | 12:01 | |
*** jamielenz has joined #openstack-qa | 12:01 | |
*** ianw- is now known as ianw | 12:01 | |
*** jamielennox|away has quit IRC | 12:03 | |
*** rfolco has joined #openstack-qa | 12:05 | |
*** yassine has joined #openstack-qa | 12:05 | |
*** shwetaap has quit IRC | 12:08 | |
*** salv-orlando has joined #openstack-qa | 12:11 | |
*** chandankumar_ has quit IRC | 12:13 | |
*** matsuhashi has quit IRC | 12:14 | |
*** yassine has quit IRC | 12:15 | |
*** matsuhas_ has joined #openstack-qa | 12:17 | |
*** yassine has joined #openstack-qa | 12:17 | |
*** aysyd has joined #openstack-qa | 12:19 | |
*** dkranz has joined #openstack-qa | 12:22 | |
*** salv-orlando_ has joined #openstack-qa | 12:25 | |
*** GMann has quit IRC | 12:28 | |
*** salv-orlando has quit IRC | 12:28 | |
*** salv-orlando_ is now known as salv-orlando | 12:28 | |
openstackgerrit | nayna-patel proposed a change to openstack/tempest: Adds more testcases to test_telemetry_alarming_api https://review.openstack.org/82491 | 12:31 |
*** jasondotstar has joined #openstack-qa | 12:32 | |
*** adalbas has joined #openstack-qa | 12:37 | |
sdague | dkranz: once you're active, let me know, I want to talk about the logging diet | 12:48 |
*** salv-orlando has quit IRC | 12:49 | |
openstackgerrit | A change was merged to openstack/tempest: Stop volume leaking https://review.openstack.org/82427 | 12:52 |
*** mriedem has joined #openstack-qa | 12:54 | |
openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: Use OVERRIDE_ZUUL_BRANCH as ZUUL_BRANCH when defined https://review.openstack.org/82496 | 13:00 |
*** shwetaap has joined #openstack-qa | 13:02 | |
*** jordanP has joined #openstack-qa | 13:02 | |
*** yassine has quit IRC | 13:08 | |
*** mwagner_lap has quit IRC | 13:09 | |
*** Madan has quit IRC | 13:12 | |
*** matsuhas_ has quit IRC | 13:12 | |
*** matsuhashi has joined #openstack-qa | 13:13 | |
openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: Support for upgrading neutron https://review.openstack.org/58695 | 13:13 |
openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: Use OVERRIDE_ZUUL_BRANCH as ZUUL_BRANCH when defined https://review.openstack.org/82496 | 13:17 |
*** matsuhashi has quit IRC | 13:17 | |
*** psharma has quit IRC | 13:20 | |
*** yassine has joined #openstack-qa | 13:21 | |
*** rustlebee is now known as russellb | 13:23 | |
*** nosnos has quit IRC | 13:24 | |
*** nosnos has joined #openstack-qa | 13:25 | |
*** safchain has joined #openstack-qa | 13:26 | |
*** jordanP has quit IRC | 13:29 | |
*** nosnos has quit IRC | 13:29 | |
*** aysyd has quit IRC | 13:32 | |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Renew token before expiry time https://review.openstack.org/82046 | 13:34 |
openstackrecheck | openstack/nova change: https://review.openstack.org/81365 failed gate-tempest-dsvm-neutron-heat-slow in the gate queue with an unrecognized error | 13:34 |
dkranz | sdague: ok, now is good | 13:36 |
*** andreaf has joined #openstack-qa | 13:36 | |
sdague | dkranz: so... have you looked at our logs recently? especially when running in parallel? :) | 13:38 |
dkranz | sdague: Yes | 13:39 |
sdague | they are so undecypherable to be basically useless | 13:39 |
dkranz | sdague: agreed | 13:39 |
sdague | which is why I think that we need to purge way back | 13:39 |
*** jgrimm has quit IRC | 13:39 | |
sdague | and I think that the only time we may want to bring back header and body dump is on error | 13:39 |
sdague | because in the base case, they are basically useless noise | 13:40 |
dkranz | sdague: I understand but have used the other stuff for debugging | 13:40 |
dkranz | sdague: What if we had a second log file to capture detailed request/response? | 13:40 |
dkranz | sdague: Or make it a config option based on verbose? | 13:41 |
sdague | where have you used it? | 13:41 |
dkranz | sdague: The main use case is where I want to see what the test is doing | 13:41 |
dkranz | sdague: So I can localize a small test for what is failing | 13:41 |
dkranz | sdague: outside of tempest | 13:41 |
dkranz | sdague: I have actually done this quite a bit | 13:42 |
sdague | so that's basically a printf case, and I don't think we should have that in the base case | 13:42 |
dkranz | sdague: That's why I suggest a verbose option or logging verbose to a different file | 13:42 |
*** salv-orlando has joined #openstack-qa | 13:43 | |
dkranz | sdague: It is not needed in gate jobs I agree | 13:43 |
sdague | well, what I actually think this brings us back to is the DEBUG2 question | 13:43 |
dkranz | sdague: Perhaps so | 13:43 |
dkranz | sdague: But don't we already have a verbose flag? | 13:43 |
sdague | there are a lot of folks that are instrumenting code not at a DEBUG level but at a tracing level | 13:43 |
*** jasondotstar has quit IRC | 13:43 | |
*** markmcclain has joined #openstack-qa | 13:44 | |
dkranz | sdague: Is there a problem with having a conf flag that determines whether the request body/headers is included? | 13:45 |
sdague | dkranz: so there is probably a right way to do this with python logging, but I'm not going to be able to look at that in the next 2 weeks. | 13:48 |
dkranz | sdague: Sure | 13:48 |
sdague | but the log levels in tempest should be useful for running tempest | 13:48 |
sdague | and not changing them for a case which is unrelated, seems weird | 13:49 |
openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: Support for upgrading neutron https://review.openstack.org/58695 | 13:49 |
dkranz | sdague: I don't disagree with that but we are talking about which parts of the request should be shown | 13:49 |
sdague | yes | 13:50 |
dkranz | sdague: which is really in the eye of the beholder | 13:50 |
dkranz | sdague: which is why I think the easiest thing at least for now is to just have a flag rather than completely deleting the full output code | 13:51 |
dkranz | sdague: I thought your main point was to make it one line for atomicity | 13:51 |
dkranz | sdague: which is good | 13:51 |
sdague | dkranz: and to decrease the output | 13:51 |
sdague | because currently we're running at 2.1 MB compressed in the gate | 13:52 |
sdague | which is unacceptably large | 13:52 |
sdague | we legitimately have to dump content as well | 13:52 |
dkranz | sdague: Yes, and all I am saying is that is the "tempest in the gate" use case which is not the only one | 13:52 |
dkranz | sdague: If I were running tempest as "refstack" or whatever I probably want all the output | 13:52 |
sdague | dkranz: why? | 13:52 |
dkranz | sdague: So I can better see what is going on | 13:53 |
sdague | you would want all the content on pass? | 13:53 |
dkranz | sdague: What if there is a problem with one call that calls another to screw up? | 13:53 |
dkranz | causes | 13:53 |
sdague | then you dig in in that case | 13:53 |
sdague | it's insane to leave everything on tracing all the time because some time in the future something might be weird | 13:53 |
dkranz | sdague: But then I can't see what the previous calls actually were right before the problem | 13:54 |
dkranz | sdague: I am only suggesting an option to keep the current level of verbosity | 13:54 |
*** yamahata has joined #openstack-qa | 13:54 | |
sdague | which I believe is an insane detail level for anything other than test development | 13:54 |
sdague | I believe the current level of verbosity is incorrect, and I'd like to change that | 13:55 |
dkranz | sdague: Even if that were the case, should people have to rehack-in the current code to do test development? | 13:55 |
dkranz | sdague: I'm talking about leaving two lines of code plus the config option | 13:55 |
dkranz | sdague: I'm fine with changing the verbosity in the gate jobs | 13:56 |
sdague | if we are supporting the test case development angle than that should be done, and specify a small number of tests by name that you want traced | 13:56 |
*** rossella_s has quit IRC | 13:56 | |
dkranz | sdague: Which is really the same as having DEBUG2 or whatever | 13:57 |
sdague | correct | 13:57 |
dkranz | sdague: Yes, but that is more work | 13:57 |
dkranz | sdague: There are lots of ways we could improve things but we are not going to at least in the short run | 13:57 |
dkranz | sdague: Do you want me to add a flag? | 13:58 |
*** nosnos has joined #openstack-qa | 13:58 | |
*** matsuhashi has joined #openstack-qa | 13:59 | |
dkranz | sdague: I can fix this up after you merge your change if you prefer. | 13:59 |
openstackgerrit | Dolph Mathews proposed a change to openstack-infra/elastic-recheck: provide more specific feedback to query authors https://review.openstack.org/81891 | 13:59 |
*** nosnos has quit IRC | 14:00 | |
*** nosnos has joined #openstack-qa | 14:01 | |
sdague | I'm trying to think about the case you are trying to support | 14:01 |
*** aysyd has joined #openstack-qa | 14:01 | |
sdague | which I think is vaguely dubious, but lets think about it | 14:01 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Renew token before expiry time https://review.openstack.org/82046 | 14:02 |
sdague | so what if we had a trace_tests config | 14:03 |
dkranz | sdague: ok. I am just trying to separate the concerns of "log file is too big" and "multiline output is bad for parallel" | 14:03 |
sdague | sure | 14:03 |
*** tkammer has quit IRC | 14:04 | |
sdague | so multiline output is useless is a pretty important thing, so the format on the tracing lines needs to be a single line that includes the request url | 14:04 |
sdague | anyway, back to the tracing config | 14:04 |
dkranz | sdague: agreed | 14:04 |
sdague | https://review.openstack.org/#/c/81654/7/tempest/common/rest_client.py | 14:04 |
sdague | if we had a trace_tests conf variable that matched against those variables | 14:05 |
dkranz | sdague: that's really useful, had not seen it | 14:05 |
sdague | how would you feel about that | 14:05 |
sdague | yeh, there is a reason I want this patch series in :) | 14:05 |
openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer's health monitor https://review.openstack.org/59729 | 14:05 |
openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer's session persistence https://review.openstack.org/62662 | 14:05 |
*** nosnos has quit IRC | 14:05 | |
dkranz | sdague: that seems reasonable. And 'all' would be kind of like what we have now but with single-line | 14:06 |
sdague | http://logs.openstack.org/78/81778/3/check/check-tempest-dsvm-full/eb43125/logs/tempest.txt.gz#_2014-03-24_07_58_48_220 is what it looks like afterwards | 14:06 |
sdague | sure | 14:07 |
dkranz | sdague: Sounds good to me | 14:07 |
sdague | ok, let me figure out how to get there | 14:07 |
openstackgerrit | A change was merged to openstack/tempest: Verify Nova create & get Floating IP attributes https://review.openstack.org/80527 | 14:07 |
dkranz | sdague: great thanks | 14:08 |
sdague | part of the problem is right now log_requests is called in 6 places | 14:08 |
sdague | because there is way less normalization | 14:08 |
*** salv-orlando_ has joined #openstack-qa | 14:08 | |
sdague | than there should be | 14:08 |
*** rossella_s has joined #openstack-qa | 14:08 | |
*** aysyd has quit IRC | 14:09 | |
sdague | dkranz: so do you care if this is not available in the identity clients until they get remerged? | 14:09 |
sdague | that would be easiest, because then it could stack up on the top of the series | 14:09 |
*** salv-orlando has quit IRC | 14:10 | |
*** salv-orlando_ is now known as salv-orlando | 14:10 | |
*** jasondotstar has joined #openstack-qa | 14:10 | |
*** nosnos has joined #openstack-qa | 14:11 | |
dkranz | sdague: No problem | 14:11 |
*** jordanP has joined #openstack-qa | 14:12 | |
dkranz | sdague: I'll review all the patches as soon as you are ready | 14:12 |
*** nosnos has quit IRC | 14:14 | |
*** krtaylor has quit IRC | 14:15 | |
*** adalbas has quit IRC | 14:16 | |
*** matsuhashi has quit IRC | 14:16 | |
*** Aimon has joined #openstack-qa | 14:17 | |
*** rwsu has joined #openstack-qa | 14:17 | |
*** bill_az_ has joined #openstack-qa | 14:18 | |
*** tkammer has joined #openstack-qa | 14:19 | |
*** jgrimm has joined #openstack-qa | 14:21 | |
*** aysyd has joined #openstack-qa | 14:22 | |
*** bill_az__ has joined #openstack-qa | 14:22 | |
*** bill_az_ has quit IRC | 14:23 | |
*** yassine has quit IRC | 14:25 | |
*** aysyd has quit IRC | 14:27 | |
*** tkammer has quit IRC | 14:28 | |
*** otherwiseguy has joined #openstack-qa | 14:30 | |
*** adalbas has joined #openstack-qa | 14:31 | |
*** matsuhashi has joined #openstack-qa | 14:32 | |
openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: Support for upgrading neutron https://review.openstack.org/58695 | 14:32 |
*** devvesa has joined #openstack-qa | 14:33 | |
*** yrabl has quit IRC | 14:35 | |
*** yassine has joined #openstack-qa | 14:37 | |
*** dkorn1 has joined #openstack-qa | 14:38 | |
*** dkorn has quit IRC | 14:39 | |
*** saju_m has quit IRC | 14:39 | |
*** tkammer has joined #openstack-qa | 14:40 | |
sdague | hmmm... is there no way to specify structure in the oslo.config comments? | 14:42 |
*** mwagner_lap has joined #openstack-qa | 14:43 | |
*** krtaylor has joined #openstack-qa | 14:44 | |
*** malini_afk is now known as malini | 14:44 | |
openstackgerrit | Sean Dague proposed a change to openstack/tempest: add trace_requests option to debug section https://review.openstack.org/82517 | 14:44 |
sdague | dkranz: how about that | 14:44 |
mtreinish | sdague: you mean in the sample config output? | 14:45 |
sdague | mtreinish: yeh | 14:46 |
dkranz | sdague: looking... | 14:46 |
sdague | I was trying to be extra specific with this trace option | 14:46 |
sdague | but it seems to scramble all the formatting | 14:46 |
mtreinish | I don't think it does that well because it messes with line wraps. But I really haven't looked at it much. | 14:46 |
mtreinish | yeah that's ugly | 14:47 |
*** dims has quit IRC | 14:47 | |
openstackgerrit | afazekas proposed a change to openstack/tempest: Fix test_verify_created_server_ephemeral_disk https://review.openstack.org/80622 | 14:47 |
mtreinish | sdague: http://git.openstack.org/cgit/openstack/oslo-incubator/tree/openstack/common/config/generator.py#n244 | 14:48 |
sdague | yeh, so I think that's beyond our ability to fix | 14:49 |
*** atiwari has joined #openstack-qa | 14:51 | |
dkranz | sdague: That looks reasonable. Would have to run locally to see how it looks but I'm ok with pushing it through and then fixing if there are issues. | 14:52 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add sahara to list of clients for T102 https://review.openstack.org/82519 | 14:52 |
sdague | dkranz: cool | 14:52 |
sdague | so does that mean you will put a +A on the base patch so we can merge the stack? | 14:53 |
*** salv-orlando_ has joined #openstack-qa | 14:57 | |
*** salv-orlando has quit IRC | 14:58 | |
*** salv-orlando_ is now known as salv-orlando | 14:58 | |
*** Aimon has quit IRC | 14:58 | |
*** Aimon has joined #openstack-qa | 14:59 | |
*** kgriffs_afk is now known as kgriffs | 15:00 | |
*** dims has joined #openstack-qa | 15:00 | |
dkranz | sdague: I think so | 15:01 |
dkranz | sdague: I'll look at that now | 15:01 |
sdague | great | 15:01 |
*** dhellmann_ is now known as dhellmann | 15:05 | |
*** dkorn1 has quit IRC | 15:07 | |
openstackgerrit | afazekas proposed a change to openstack/tempest: Fix test_verify_created_server_ephemeral_disk https://review.openstack.org/80622 | 15:07 |
mtreinish | sdague: I just remembered that we have a second set of log methods in the glance_http client: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/common/glance_http.py#n148 | 15:07 |
mtreinish | did you want to update things there too? | 15:07 |
*** salv-orlando has quit IRC | 15:07 | |
mtreinish | it's not like it's called very much though | 15:08 |
sdague | honestly, I want to get all this stuff merged :) | 15:08 |
sdague | into one path | 15:08 |
sdague | I think that's when we clean up all the edge cases | 15:08 |
sdague | because we really need to not have this many different base clients | 15:09 |
*** salv-orlando has joined #openstack-qa | 15:09 | |
mtreinish | There isn't a way to integrate the glance one with the regular one short of rewriting the base one to use a different http library | 15:10 |
mtreinish | but you should be able to reuse the logging methods in glance_http | 15:10 |
mtreinish | and drop what's there now | 15:10 |
openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: Use OVERRIDE_ZUUL_BRANCH as ZUUL_BRANCH when defined https://review.openstack.org/82496 | 15:13 |
*** dkorn has joined #openstack-qa | 15:14 | |
mriedem | mtreinish: i suppose you want to see the follow on patch first huh https://review.openstack.org/#/c/82410/ | 15:17 |
mriedem | it's also pause_available | 15:17 |
*** mwagner_lap has quit IRC | 15:17 | |
mtreinish | mriedem: the order doesn't really matter because the bug was there first | 15:18 |
*** salv-orlando has quit IRC | 15:19 | |
*** beekneemech is now known as bnemec | 15:20 | |
openstackgerrit | A change was merged to openstack/tempest: Move to the python-saharaclient https://review.openstack.org/81085 | 15:21 |
*** salv-orlando has joined #openstack-qa | 15:21 | |
mriedem | mtreinish: so are you ok with me cleaning up my patch for the new getattr on CONF in the class definition and then later patches to cleanup the same for suspend/pause/resize? | 15:21 |
mriedem | i want to know what i'm committing to :) | 15:22 |
*** BobBall has left #openstack-qa | 15:25 | |
*** matsuhashi has quit IRC | 15:25 | |
*** nati_ueno has joined #openstack-qa | 15:26 | |
openstackgerrit | afazekas proposed a change to openstack-dev/devstack: Add LIO target / iscsi_helper support to cinder https://review.openstack.org/77630 | 15:26 |
mtreinish | mriedem: yeah do the right thing in your patch | 15:26 |
mtreinish | and then another patch that fixes the incorrect usage of CONF wherever for whatever options | 15:27 |
*** mwagner_lap has joined #openstack-qa | 15:27 | |
*** matsuhas_ has joined #openstack-qa | 15:28 | |
mriedem | mtreinish: ok, will do | 15:29 |
mriedem | mtreinish: side topic, does tempest support multi-host environment testing, like for availability zones? | 15:31 |
mriedem | i didn't think it did but wanted to check | 15:32 |
*** matsuhas_ has quit IRC | 15:33 | |
mtreinish | mriedem: it should | 15:33 |
mtreinish | but we don't test it in the gate so there are no guarentees | 15:33 |
mtreinish | and there are a very small number of tests that actually take advantage of it | 15:34 |
mriedem | mtreinish: ok, we had some people that wanted to upstream some tests for multi-host with availablity zones but they said they couldn't do that in tempest | 15:34 |
mtreinish | they can't upstream it unless they ci it | 15:34 |
mriedem | which they aren't going to do so ok | 15:34 |
mtreinish | because we can't test multi-host in the gate right now | 15:35 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Use auth data to fill credentials https://review.openstack.org/82111 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Define V3 Credentials https://review.openstack.org/81872 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Get credential IDs from Credentials class https://review.openstack.org/80246 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials (part1) https://review.openstack.org/77594 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials (part2) https://review.openstack.org/82112 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Access credential fields as attributes https://review.openstack.org/82113 | 15:37 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Defines a Credentials class https://review.openstack.org/74387 | 15:37 |
openstackgerrit | Martin Pavlásek proposed a change to openstack/tempest: Added test of default domain in Keystone https://review.openstack.org/31782 | 15:38 |
*** dkorn has quit IRC | 15:40 | |
afazekas | dkranz, sdague: I have doubts we really want and can to default to non uec image. 1. The uec image boot skips lot of bios related code, so it is faster (The kernel and initrd load into the VM's memory, bios does needs to search for a boot dev). 2: We need to download and bundle an uec image for running all ec2 test.. | 15:42 |
*** sthaha has quit IRC | 15:44 | |
*** andreaf2 has joined #openstack-qa | 15:44 | |
*** andreaf has quit IRC | 15:45 | |
openstackgerrit | afazekas proposed a change to openstack/tempest: ssh instance validation add options for Neutron https://review.openstack.org/80620 | 16:03 |
openstackgerrit | afazekas proposed a change to openstack/tempest: Enable instance validation with the server_actions v2 https://review.openstack.org/81834 | 16:03 |
*** afazekas_ has joined #openstack-qa | 16:04 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 16:04 |
openstackrecheck | openstack/neutron change: https://review.openstack.org/78854 failed gate-neutron-python26 in the gate queue with an unrecognized error | 16:04 |
mtreinish | jeblair: ^^^ I finally got around to adding the sphinx support to the qa-specs repo like we talked about last week | 16:05 |
*** afazekas has quit IRC | 16:06 | |
jeblair | mtreinish: awesome! hopefully russellb will love that and adopt it in nova-specs | 16:06 |
jeblair | mtreinish: that should let us do cool things like publish to docs-draft, etc | 16:06 |
russellb | mtreinish: jeblair cool | 16:08 |
russellb | guess i should give it a shot and see what happens | 16:08 |
*** sahumada has quit IRC | 16:08 | |
*** Aimon has quit IRC | 16:09 | |
*** asselin has joined #openstack-qa | 16:12 | |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move suspend_available class variable into skip decorators https://review.openstack.org/82534 | 16:18 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move pause_available class variable into skip decorators We shouldn't do a getattr on CONF in the class definition. It will cause import errors if there isn't a config file. Just use CONF.compute_feature_enabled.pause in the skip decorator. https://review.openstack.org/82535 | 16:18 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move resize_available class variable into skip decorators We shouldn't do a getattr on CONF in the class definition. It will cause import errors if there isn't a config file. Just use CONF.compute_feature_enabled.resize in the skip decorator. https://review.openstack.org/82536 | 16:18 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move run_ssh class variable into skip decorators We shouldn't do a getattr on CONF in the class definition. It will cause import errors if there isn't a config file. Just use CONF.compute.run_ssh in the skip decorator. https://review.openstack.org/82537 | 16:18 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Disable other suspend/resume tests if not supported https://review.openstack.org/82410 | 16:18 |
mriedem | damnit | 16:18 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move pause_available class variable into skip decorators https://review.openstack.org/82535 | 16:19 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move run_ssh class variable into skip decorators https://review.openstack.org/82537 | 16:19 |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Move resize_available class variable into skip decorators https://review.openstack.org/82536 | 16:19 |
mriedem | mtreinish: dumped ^ | 16:19 |
*** devvesa has quit IRC | 16:29 | |
*** nati_ueno has quit IRC | 16:35 | |
*** otherwiseguy has quit IRC | 16:36 | |
*** jasondotstar has quit IRC | 16:39 | |
*** Aimon has joined #openstack-qa | 16:40 | |
openstackgerrit | Akihiro Motoki proposed a change to openstack-infra/elastic-recheck: Add query for bug 1296825 https://review.openstack.org/82546 | 16:45 |
*** tkammer has quit IRC | 16:45 | |
*** safchain has quit IRC | 16:46 | |
*** otherwiseguy has joined #openstack-qa | 16:48 | |
*** harlowja has joined #openstack-qa | 16:49 | |
*** jlibosva has quit IRC | 16:52 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 16:53 |
*** mmaglana has joined #openstack-qa | 16:53 | |
*** jpich has quit IRC | 16:53 | |
*** sc68cal_ is now known as sc68cal | 16:59 | |
openstackrecheck | Console logs not available after 13:23s for gate-tempest-docs 81872,2,5b89c80 | 17:02 |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 17:02 |
*** devvesa has joined #openstack-qa | 17:03 | |
openstackgerrit | Sean Dague proposed a change to openstack/tempest: add trace_requests option to debug section https://review.openstack.org/82517 | 17:04 |
sdague | oh pep8, how I loath thee | 17:04 |
sdague | :) | 17:04 |
mtreinish | sdague: I thought your fancy emacs stuff meant you were never supposed to have indent issues... | 17:06 |
sdague | yeh, I had to turn a thing off the other day because it's interacting poorly with remote systems | 17:07 |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 17:07 |
sdague | I haven't debugged it yet | 17:07 |
sdague | mtreinish: how is that going to interact with spec files once we add them? | 17:08 |
sdague | because if the answer is we have to patch them into the index, that's just going to be merge conflict hell | 17:09 |
mtreinish | sdague: you just need to add it to the index, so there is a link from the main page | 17:09 |
sdague | mtreinish: right, so I don't think that's an option | 17:09 |
*** markmcclain has quit IRC | 17:09 | |
mtreinish | but they should get docified regardless | 17:09 |
*** markmcclain has joined #openstack-qa | 17:09 | |
mtreinish | there just won't be a link from the main page | 17:09 |
sdague | we need to be able to discover and add them dynamically | 17:09 |
sdague | is there a way we can put the boilerplate outside of the specs dir so it doesn't get in the way, then pull it in dynamically? | 17:10 |
sdague | mordred: any ideas here? | 17:10 |
*** jpich has joined #openstack-qa | 17:10 | |
mtreinish | I'm not sure let me read up on toctree to see if there is a way | 17:11 |
sdague | like if docs/source/specs -> ../../specs | 17:11 |
sdague | and we used the docs source convention in the boilerplating | 17:11 |
sdague | like in other projects | 17:11 |
mtreinish | sdague: you can do it with wildcards I think | 17:11 |
mtreinish | so for example implemented/* | 17:11 |
mtreinish | will pick up all the rsts in that dir and put them in alphabetical order | 17:12 |
mtreinish | let me add that | 17:12 |
sdague | right, but I want it at the top level too | 17:12 |
sdague | and, honestly, I think moving the conf.py out of specs is cleaner | 17:12 |
mtreinish | yeah it does that too | 17:12 |
mtreinish | sdague: it needs to be in the root source dir | 17:13 |
sdague | well what about the directory symlink idea | 17:13 |
mtreinish | yeah that should work let me give it a try | 17:14 |
openstackgerrit | afazekas proposed a change to openstack-dev/devstack: Add LIO target / iscsi_helper support to cinder https://review.openstack.org/77630 | 17:14 |
sdague | mostly I want the normal interaction with the files from someone submitting to not have to deal with any of the sphinx wrappers, because I expect it will confuse them more | 17:15 |
openstackgerrit | A change was merged to openstack/tempest: simplify rest_client logging https://review.openstack.org/81620 | 17:16 |
openstackrecheck | Console logs not available after 13:24s for gate-python-ceilometerclient-python27 80256,5,198150b | 17:16 |
*** nati_ueno has joined #openstack-qa | 17:17 | |
openstackgerrit | A change was merged to openstack/tempest: add _find_caller to the request log https://review.openstack.org/81654 | 17:17 |
openstackgerrit | A change was merged to openstack/tempest: add request timing https://review.openstack.org/81778 | 17:17 |
openstackgerrit | A change was merged to openstack-dev/devstack: XenAPI: Cirros images must always boot as PV. https://review.openstack.org/81497 | 17:17 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/qa-specs: add bp:multi-keystone-api-version-tests https://review.openstack.org/81294 | 17:18 |
mtreinish | sdague: ^^^ your log stuff just merged! | 17:19 |
sdague | yay | 17:19 |
sdague | I think the cli patch is still missing another +2 | 17:19 |
mtreinish | still this should make clarkb happy now | 17:20 |
sdague | dkranz: should approve that so then his trace patch can go in | 17:20 |
sdague | yep | 17:20 |
mtreinish | it saves how much log space? | 17:20 |
sdague | it removes about 1.2 MB per run IIRC | 17:20 |
sdague | compressed | 17:20 |
sdague | so about 60% of the tempest log | 17:20 |
dkranz | sdague: I'll look now | 17:20 |
mtreinish | cool | 17:20 |
sdague | mtreinish: did you look at the trace patch by the way? | 17:21 |
*** yassine has quit IRC | 17:21 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 17:22 |
mtreinish | sdague: ^^^ that should do everything the right way | 17:22 |
mtreinish | sdague: no not yet | 17:23 |
*** rhsu has joined #openstack-qa | 17:23 | |
mtreinish | sdague: I tested it, it will dynamically picks up .rsts in both dirs | 17:23 |
russellb | mtreinish: so how do you generate the specs | 17:25 |
russellb | oh you just pushed another rev, let's see what you changed ... | 17:25 |
mtreinish | russellb: it will pick up rsts automatically in the specifed dirs in the index.rst | 17:25 |
mtreinish | so it should be seemless for people pushing things | 17:25 |
russellb | i meant like ... | 17:26 |
russellb | $ tox -evenv python setup.py build_sphinx | 17:26 |
russellb | ? | 17:26 |
mtreinish | oh yeah, that should work. Although I haven't been testing it with tox | 17:27 |
russellb | doc/source/ | 17:27 |
mtreinish | i've just been doing it without the venv so python setup.py build_sphinx | 17:27 |
russellb | by convention? | 17:27 |
mtreinish | yeah the build dir has to doc/build so the jenkins slave scripts will know where the stuff is | 17:27 |
russellb | k | 17:27 |
mtreinish | russellb: actually it probably makes sense to add a tox job to build the specs | 17:30 |
mtreinish | let me add that now | 17:30 |
russellb | k | 17:30 |
russellb | wondering why it's telling me build_sphinx is invalid ... | 17:30 |
*** bada has joined #openstack-qa | 17:31 | |
*** mkoderer has quit IRC | 17:31 | |
mordred | russellb: do you have sphinx and pbr installed? | 17:31 |
* russellb checks | 17:31 | |
russellb | i was missing sphinx :) | 17:32 |
mordred | :) | 17:32 |
*** leakypipes is now known as jaypipes | 17:33 | |
*** flashgordon is now known as jogo | 17:34 | |
mtreinish | russellb: heh, oslosphinx doesn't require sphinx I guess I should add it to the list in specs repo | 17:35 |
openstackgerrit | Matthew Treinish proposed a change to openstack/qa-specs: Add sphinx support to qa-specs repo https://review.openstack.org/82531 | 17:37 |
mtreinish | russellb: ^^^ that adds tox -ebuild_specs | 17:37 |
mriedem | sdague: jogo: mtreinish: didn't we recently remove the blanket query for 'Build timed out (after x minutes)'? | 17:41 |
mriedem | http://logs.openstack.org/54/78854/6/gate/gate-neutron-python26/02adbc4/console.html#_2014-03-24_16_02_22_941 | 17:41 |
*** luqas has quit IRC | 17:41 | |
mriedem | with the intent of tracking new specific bugs by job or something? | 17:41 |
mtreinish | mriedem: yeah I think we removed it, it really isn't a good query | 17:42 |
mtreinish | I mean that one was from a unit test and before it was for tracking tempest I think | 17:42 |
mriedem | mtreinish: https://review.openstack.org/#/c/80424/ | 17:44 |
mriedem | that's the one | 17:44 |
*** aysyd has joined #openstack-qa | 17:45 | |
russellb | mtreinish: https://review.openstack.org/82564 | 17:46 |
mtreinish | mriedem: heh, well you just saw it... | 17:46 |
mtreinish | russellb: cool | 17:47 |
mriedem | i just went digging | 17:47 |
mriedem | mtreinish: i wanted to give amotoki a reference for my -1 | 17:47 |
mtreinish | mriedem: oh I was refering your comment on the review | 17:48 |
mtreinish | russellb: are you moving all the specs into doc/source? | 17:49 |
russellb | mtreinish: yeah | 17:51 |
russellb | mtreinish: i still like having a juno dir in there though | 17:52 |
mtreinish | russellb: I just symlinked it I thought it was easier that way | 17:52 |
russellb | hmmm | 17:52 |
russellb | OK, that works too | 17:52 |
russellb | i'll move it | 17:52 |
*** kgriffs is now known as kgriffs_afk | 17:53 | |
russellb | mtreinish: pushed an update | 17:53 |
*** otherwiseguy has quit IRC | 17:53 | |
russellb | mtreinish: figure we need to match as best we can | 17:54 |
russellb | re: the juno dir, logic is that i think specs should have to be re-approved every release | 17:54 |
russellb | because things change, and if it slips, it should get re-evaluated | 17:54 |
*** jordanP has quit IRC | 17:55 | |
mtreinish | russellb: yeah matching things is probably for the best, maybe we should eventually work it into a cookiecutter thing | 17:55 |
russellb | yes that'd be good | 17:56 |
mtreinish | russellb: sdague and I were arguing about the release dir thing at one point. I think we compromised on just putting a targetted milestone in the spec itself | 17:56 |
mtreinish | and tracking things that slip in lp | 17:56 |
russellb | targeted milestone seems too detailed | 17:56 |
russellb | because we're not going to re-review if it slips a milestone | 17:56 |
mtreinish | not targetted sorry what it's proposed for | 17:57 |
sdague | russellb: I actually think this is one of the areas where differences seem natural | 17:57 |
sdague | and I'm not convinced different projects need to have the same ideas on releases, because not all programs have releases | 17:57 |
russellb | fair | 17:57 |
openstackgerrit | Tushar Kalra proposed a change to openstack/tempest: Some keystone V3 API tests throw incorrect errors https://review.openstack.org/81949 | 17:58 |
openstackgerrit | Solly Ross proposed a change to openstack-dev/devstack: Fix broken if statement in lib/tls on ZSH https://review.openstack.org/81337 | 18:01 |
openstackgerrit | Solly Ross proposed a change to openstack-dev/devstack: Fix broken if statement in lib/tls on ZSH https://review.openstack.org/81337 | 18:05 |
*** salv-orlando has quit IRC | 18:06 | |
*** markmcclain has quit IRC | 18:09 | |
*** zul has quit IRC | 18:13 | |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Get credential IDs from Credentials class https://review.openstack.org/80246 | 18:15 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials (part2) https://review.openstack.org/82112 | 18:15 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Access credential fields as attributes https://review.openstack.org/82113 | 18:15 |
*** zul has joined #openstack-qa | 18:16 | |
*** andreaf2 has quit IRC | 18:23 | |
*** morganfainberg_Z is now known as morganfainberg | 18:24 | |
mordred | sdague, russellb: I agree - although as per my email, I mainly want to make sure that once a spec is approved, that it'll have at least some content at a consisntent URL location from that point on | 18:24 |
sdague | mordred: so I still think we believe that to be the launchpad url at this point | 18:26 |
russellb | sdague: agreed | 18:26 |
sdague | launchpad remains the entry point | 18:26 |
sdague | which is why this starts with create a stub blueprint in launchpad, then interate on the review, which posts review links back to the blueprint (building links as it goes) | 18:27 |
*** mestery has joined #openstack-qa | 18:27 | |
mordred | right | 18:29 |
*** mestery has quit IRC | 18:29 | |
mordred | but what I'm saying is that the links added to the blueprint should probably remain valid | 18:29 |
sdague | mordred: so for instance - https://blueprints.launchpad.net/tempest/+spec/rest-clients-return-obj | 18:30 |
sdague | the whiteboard links, are all gerrit, autogenerated | 18:30 |
mordred | or else you'll need to, if you move the spec to an implemented dir, go back to the blueprint in lp and update the link to teh spec | 18:30 |
sdague | so those are always valid | 18:30 |
sdague | I don't actually think there is a concern about volitility of the detailed specification url | 18:30 |
mordred | you're not thinking of using the "set the url for this specification" feature then? | 18:30 |
sdague | or shouldn't be | 18:30 |
sdague | mordred: no, you will, but I believe that is fair game to change over time | 18:31 |
mordred | because it seems that if we publish the generated sphinx to a url | 18:31 |
sdague | if that makes sense | 18:31 |
sdague | mordred: right, well that's one of the reasons I didn't want to do that :) | 18:31 |
sdague | because I don't see the url structure of this as idempotent | 18:31 |
mordred | why not just keep the published location a thing that doesn't need to change? | 18:31 |
sdague | there is no need | 18:31 |
sdague | because why do we need to? | 18:32 |
mordred | because it's less work to? | 18:32 |
mordred | and a much simpler workflow? | 18:32 |
sdague | maybe | 18:32 |
sdague | but maybe not | 18:32 |
mordred | you don't have to submit another commit to the repo to move the spec | 18:32 |
mordred | you don't have to go update the lp blueprint | 18:32 |
sdague | especially if it means you get overwhelmed with lots of files in one directory and can't sort them out in the git repo | 18:32 |
sdague | this is one of those areas where I explicitly don't want to set policy up front | 18:33 |
mordred | sure | 18:33 |
mordred | I'm not saying set policy on that in stone | 18:33 |
sdague | because I'll be honest, if I stare at a directory of > 30 things, it's causing me too much mental overload to figure out which I care about right now. | 18:33 |
mordred | I'm just saying, think about the experience if the spec url location in the blueprint was a piece of data that remained valid | 18:33 |
mordred | now, that can remain valid by updating it on spec moves | 18:34 |
sdague | so over time all sorts of better organization and bucketting might be in order | 18:34 |
mordred | sure | 18:34 |
mordred | I believe once again we went to impl details without first addressing the goal - we do that a lot lately | 18:34 |
sdague | hmmm... maybe we have different goals in mind? | 18:35 |
sdague | because I see all the bits about stable urls to be completely orthoginal to any of my goals | 18:35 |
*** mkollaro has quit IRC | 18:36 | |
sdague | maybe if I step back and explain an issue that we had in qa | 18:37 |
*** devvesa has quit IRC | 18:37 | |
sdague | recently, then we can figure out where the goals intersect | 18:37 |
*** aysyd has quit IRC | 18:37 | |
mordred | kk | 18:38 |
*** rms_13 has quit IRC | 18:38 | |
sdague | so, recently we ran into the issue that we had some reviews coming in to add more behind our debug_enabled flag | 18:40 |
sdague | which is basically a cheat today that is "tempest is running on the same box, run a bunch of dump commands when you fail neutron" | 18:40 |
sdague | and that's already pretty unclean today | 18:40 |
sdague | so I -2ed all that | 18:40 |
sdague | and said, we need to really rethink this | 18:41 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration remove unused invalid_template_url https://review.openstack.org/82575 | 18:41 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration add resource limit API test https://review.openstack.org/82576 | 18:41 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration: add API tests for list query arguments https://review.openstack.org/82577 | 18:41 |
sdague | because it's a weird feature that doesn't work for anyone but the gate, and before jamming more stuff in there, we need to rethink this at a high level | 18:41 |
sdague | and I need a place to do that | 18:41 |
sdague | and the mailing list has not historically worked for us | 18:41 |
sdague | so a document that we can drive something towards overall design sanity so we can do this right, is what I want | 18:42 |
mordred | yes. that all makes sense to me | 18:42 |
sdague | once we are there, the final document is actually the least of the interesting artifacts | 18:42 |
sdague | is the process of producing it that's the important part | 18:43 |
sdague | all the questions that get asked, answered, history kept | 18:43 |
mordred | right. so to me, the final document is important | 18:43 |
mordred | mainly because I want to be able to explain to people how to discover the set of things that are in work (look at the list of blueprints) | 18:44 |
mordred | and once they're there, to be able to drill down to the detailed description of what that thing is | 18:44 |
mordred | so however it's accomplished, I think what I'm trying to say is that I'd like for there to be an unbroken path from a blueprint to the associated spec | 18:44 |
sdague | right, but that's why to the outside world, that's the blueprint | 18:45 |
mordred | right | 18:45 |
mordred | I agree | 18:45 |
sdague | and we decide either the summary copies over, or even possibly the whole thing. We link to the detailed version somewhere, but if that detailed link changes, that doesn't seem to be so much of a deal breaker | 18:46 |
mordred | I just want to make sure that when the outside world goes to a blueprint, it doesn't get a broken link to a previous thing | 18:46 |
sdague | sure | 18:46 |
mordred | nope - if the detailed link changes, that's fine - I just want to make sure that the coupling is good | 18:46 |
sdague | honestly, that's one of the reasons originally there was talk that this would be a full copy / paste | 18:47 |
sdague | because then you didn't care about the link | 18:47 |
mordred | yah - but to jeblair's point in email - these specs could quite easily have non-text in them | 18:47 |
mordred | like diagrams | 18:47 |
mordred | which could make things easier to communicate over | 18:48 |
mtreinish | russellb: how does this look?: https://github.com/mtreinish/specs-cookiecutter | 18:48 |
mtreinish | I'm sure I missed something | 18:48 |
sdague | mordred: so sure. But honestly, but we don't have diagram support today :) | 18:49 |
mordred | we do in sphinx :) | 18:50 |
sdague | yeh, but not in our existing process | 18:50 |
sdague | I don't actually want to solve all the things our existing process or lack there of can't solve. I want to solve review. | 18:50 |
sdague | or at least make progress on it | 18:50 |
*** aysyd has joined #openstack-qa | 18:51 | |
mordred | yah. I'm fine with that | 18:51 |
sdague | because if by the end of the cycle we had that, no diagrams, nothing else special, we'd be in *such* a better possition than we are today | 18:51 |
mordred | I think I'm saying, I thnk the experience of actually having a spec link in the blueprint would be nice and would be 0 more work than the current thing | 18:51 |
sdague | where someone spends 4 months implementing a blueprint, shows up late in the cycle with first code, and we say "wait, *this* is how you were going to do it" | 18:51 |
sdague | and -2 | 18:52 |
sdague | because that, it's a real problem we face today | 18:52 |
sdague | that is pissing everyone off | 18:52 |
sdague | we are effectively doing design review at patch iteration 20 on a code review | 18:53 |
sdague | because it took them 20 iterations to get past all the simple -1s of bad style, no tests, etct | 18:53 |
mordred | yah. I support those goals | 18:53 |
sdague | so the goal being that at patch iteration 1, the design was actually signed off of, so then we're mostly doing functional review | 18:54 |
mordred | yup | 18:54 |
mordred | I think nothing I'm saying is in conflict with that | 18:54 |
sdague | I agree | 18:55 |
sdague | I think it's just scope | 18:55 |
*** mrodden has joined #openstack-qa | 18:55 | |
*** afazekas_ has quit IRC | 18:57 | |
*** mrodden1 has joined #openstack-qa | 18:57 | |
openstackgerrit | Arx Cruz proposed a change to openstack-infra/devstack-gate: Correcting the right path to mysql log in Fedora 19 https://review.openstack.org/79967 | 18:58 |
*** rhsu has quit IRC | 18:59 | |
*** mrodden has quit IRC | 19:00 | |
*** harlowja has quit IRC | 19:01 | |
*** rhsu has joined #openstack-qa | 19:02 | |
*** harlowja has joined #openstack-qa | 19:03 | |
stevebaker | sdague: hi | 19:06 |
sdague | stevebaker: yo | 19:06 |
*** otherwiseguy has joined #openstack-qa | 19:06 | |
*** yfried has joined #openstack-qa | 19:07 | |
sdague | stevebaker: you have a moment to explain OS::Heat::HARestarter to me, and the basic flow where that would be testable? What mechanism is it using to detect the instance isn't there? | 19:07 |
stevebaker | sdague: it would normally be triggered by an alarm based on ceilometer or cloudwatch metrics | 19:10 |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Use OS::Nova::Server for NeutronResourcesTestJSON https://review.openstack.org/82393 | 19:10 |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Fail a test if stack delete failed https://review.openstack.org/82392 | 19:10 |
stevebaker | sdague: here is an example http://git.openstack.org/cgit/openstack/heat-templates/tree/cfn/F17/WordPress_Single_Instance_With_HA.yaml | 19:12 |
sdague | yeh, I've been reading that template, and still trying to get my head around it | 19:12 |
sdague | there is a lot of context in these templates | 19:13 |
stevebaker | sdague: but actually I think HARestarter has enough issues that we should deprecate it | 19:13 |
sdague | ok | 19:14 |
sdague | so how would I use heat to ensure that a vm was up, and restart it if it wasn't? | 19:14 |
sdague | if that's deprecated | 19:14 |
stevebaker | sdague: in the next cycle there will be more work on stack convergence operations, so heat will introspect the infrastructure and perform the required operations to bring it back in line with the expected state | 19:17 |
sdague | ok, well how about with the code that exists now? | 19:17 |
*** malini is now known as malini_afk | 19:18 | |
*** kgriffs_afk is now known as kgriffs | 19:21 | |
stevebaker | sdague: there may be an alternative resource to HARestarter, I'd like to see an approach based on stack updates rather than brute-force recreating resources. It probably is still worth writing a test for it. It might be easiest to start with my autoscaling test and get the alarm to trigger a restart instead of a scaling action https://review.openstack.org/#/c/44967/ | 19:21 |
sdague | stevebaker: ok, I'll play with the autoscale case | 19:22 |
*** jpich has quit IRC | 19:23 | |
stevebaker | sdague: you could replace the scaling group with a single OS::Nova::Server, just to simplify things | 19:23 |
sdague | ok, I guess I misunderstood then, I thought this was baked in features with heat | 19:26 |
openstackgerrit | Tushar Kalra proposed a change to openstack/tempest: Some keystone V3 API tests throw incorrect errors https://review.openstack.org/81949 | 19:26 |
sdague | the WordPress_Single_Instance_With_HA.yaml seems to be mostly about running inside the guests to determine something is wrong, but I was more interested in the case of the node goes away, because we're design for fail infra, and we want to have something ensure an instance is up | 19:27 |
sdague | even if brute force | 19:27 |
*** tosky has quit IRC | 19:30 | |
stevebaker | sdague: one approach is to send a periodic metric from the instance, and have an alarm rule which triggers if the frequency of pings isn't enough | 19:33 |
sdague | stevebaker: is there an example of that somewhere? | 19:33 |
sdague | or a close enough example | 19:33 |
sdague | trying to wrap by head around the HOT templates, however it's a really wide DSL without that many examples | 19:34 |
sdague | so I end up off in the weeds a lot | 19:34 |
stevebaker | sdague: yeah, sorry about that | 19:35 |
stevebaker | sdague: http://git.openstack.org/cgit/openstack/heat-templates/tree/cfn/F17/WordPress_Single_Instance_With_IHA.template <-- its the heartbeat | 19:35 |
sdague | right from 110 -> 124 | 19:36 |
sdague | however, where is the actual command it's calling out to to do that heartbeat | 19:36 |
sdague | I'm trying to do the logic trace so I can get enough context to build these up myself | 19:38 |
stevebaker | sdague: cfn-push-stats, lines 158-160. But I would recommend doing the python equivalent, see put_metric_data in https://review.openstack.org/#/c/44967/3/tempest/scenario/orchestration/test_autoscaling.yaml (I'll find out what the heartbeat metric data is) | 19:41 |
stevebaker | sdague: I would guess a heartbeat call is this http://paste.openstack.org/show/74181/ | 19:44 |
*** yrabl has joined #openstack-qa | 19:44 | |
sdague | ok, cool. I got to run for the moment, but I'll try to digest this all, and come up with something handy. | 19:45 |
stevebaker | sdague: ok, cool | 19:46 |
stevebaker | sdague: just for tracking, I'll assign https://bugs.launchpad.net/heat/+bug/1271994 to you | 19:46 |
sdague | stevebaker: sounds good | 19:46 |
*** mestery has joined #openstack-qa | 19:47 | |
openstackgerrit | Paul Van Eck proposed a change to openstack/tempest: Add tests for nova floating IP Heat resources https://review.openstack.org/82282 | 19:49 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Cleanup sahara cli tests https://review.openstack.org/81819 | 19:52 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add sahara edp cli commands tests https://review.openstack.org/81820 | 19:53 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/devstack-gate: Don't enable savanna service for sahara https://review.openstack.org/81058 | 19:54 |
openstackgerrit | A change was merged to openstack/tempest: don't log cli output on success https://review.openstack.org/81926 | 20:02 |
openstackgerrit | A change was merged to openstack-dev/devstack: heat add HEAT_DEFERRED_AUTH option https://review.openstack.org/80002 | 20:03 |
openstackgerrit | Paul Van Eck proposed a change to openstack/tempest: Add tests for nova floating IP Heat resources https://review.openstack.org/82282 | 20:05 |
*** yrabl has quit IRC | 20:08 | |
openstackgerrit | A change was merged to openstack-dev/devstack: Fix typo in setting neutron to notify nova about port change https://review.openstack.org/82132 | 20:08 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-dev/devstack: Improve log level conf for Savanna https://review.openstack.org/78677 | 20:11 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-dev/devstack: Improve log level conf for Sahara https://review.openstack.org/78677 | 20:13 |
openstackgerrit | A change was merged to openstack-dev/devstack: Remove any lib/baremetal usage for ironic deploy https://review.openstack.org/80958 | 20:21 |
*** harlowja_ has joined #openstack-qa | 20:27 | |
*** mwagner_lap has quit IRC | 20:31 | |
*** harlowja has quit IRC | 20:31 | |
*** marun has quit IRC | 20:32 | |
openstackgerrit | Tushar Kalra proposed a change to openstack/tempest: Typo in tempest.conf.sample https://review.openstack.org/82599 | 20:37 |
*** marun has joined #openstack-qa | 20:40 | |
sdague | dkranz: you still about, I had a question on the negative test generation | 20:45 |
dkranz | sdague: Sure | 20:45 |
sdague | so while I was diving to scrub out debug logs, that was a ripe target | 20:45 |
sdague | however, a question occurred to me | 20:45 |
sdague | do we generate a seed or something that will let us run exactly the same auto generated negative test values on reproduction runs? | 20:46 |
sdague | because that didn't jump out at me | 20:46 |
dkranz | sdague: The generation is not random | 20:46 |
sdague | the generation is the full space now? | 20:46 |
dkranz | sdague: No, it has a simple algorithm to choose which cases to run | 20:47 |
dkranz | sdague: It does a bogus test for each resource and for each element of a dictionary | 20:47 |
sdague | will that scale as we go up? | 20:47 |
dkranz | sdague: Keeping the others constant | 20:47 |
*** markmcclain has joined #openstack-qa | 20:47 | |
dkranz | sdague: I don't think there is a scale issue | 20:47 |
dkranz | sdague: The number of tests goes as the number of "parameters" in each api | 20:47 |
sdague | dkranz: right, but that's kind of huge, right? | 20:48 |
dkranz | sdague: Of course we could add more combinations | 20:48 |
dkranz | sdague: If you mean, does this scale in the gate? Then I would say no. | 20:48 |
sdague | dkranz: that's what I mean | 20:49 |
dkranz | sdague: But neither does a full positive tests | 20:49 |
sdague | given fixed time, does it scale | 20:49 |
sdague | and if not, what's the mitigation | 20:49 |
*** markmcclain1 has joined #openstack-qa | 20:49 | |
dkranz | sdague: We seem to be moving towards claims of complete coverage for tempest | 20:49 |
*** markmcclain1 has quit IRC | 20:49 | |
sdague | and as long as we could reproduce we could pick the params at random | 20:49 |
*** salv-orlando has joined #openstack-qa | 20:49 | |
dkranz | sdague: Yes, we could do that. | 20:49 |
dkranz | sdague: That is moving towards "gate as smoke test" which IMO we are moving towards with no other option | 20:50 |
sdague | dkranz: agreed | 20:50 |
*** markmcclain1 has joined #openstack-qa | 20:50 | |
*** markmcclain1 has quit IRC | 20:50 | |
dkranz | sdague: So yes, if we had a budget we could adjust the negative gen pretty easily to meet it | 20:50 |
sdague | well, if we pick at random we can gate in fixed time, have some state file written out so that on failure you could try to reproduce | 20:51 |
sdague | and be able to grind on longer tests out of band | 20:51 |
*** rossella_s has quit IRC | 20:51 | |
dkranz | sdague: I don't like the idea of differing run sets in each gate job | 20:51 |
*** markmcclain has quit IRC | 20:51 | |
dkranz | sdague: Or is that not what you meant? | 20:51 |
sdague | dkranz: it is, at least for negative testing | 20:52 |
dkranz | sdague: Each test name contains the parameters that were made bogus | 20:52 |
sdague | dkranz: right, but we want the actual values as well | 20:52 |
dkranz | sdague: I would prefer to run a fixed "smoke" set, then do all nightly | 20:52 |
sdague | so think of it this way | 20:52 |
dkranz | sdague: Which is really what we do now without the all nightly part | 20:52 |
dkranz | sdague: go ahead | 20:53 |
*** mrodden1 is now known as mrodden | 20:53 | |
sdague | to land a nova change you have to pass tempest full 6 times at ones | 20:53 |
sdague | once | 20:53 |
sdague | so if we randomized the negative space | 20:53 |
sdague | we could actually get 6 times the coveragish | 20:53 |
sdague | because that stuff isn't supposed to go deep | 20:53 |
sdague | I think a devstack change right now is running devstack gate 16 times in check | 20:53 |
dkranz | sdague: Sure, but I still don't think we want random but more of a partition | 20:53 |
dkranz | sdague: Each job could have a defined partition | 20:54 |
sdague | ok, that's fair, doing the partitioning is just hard, because the job mix changes on all the jobs | 20:54 |
sdague | whereas random would tend to cover the space | 20:54 |
dkranz | sdague: Yeah, but on the other hand it is much easier to deal with if something fails | 20:55 |
sdague | and as long as a failing run is reproducable | 20:55 |
sdague | dkranz: I'm suspicious of manual partitioning, because in my experience every time we've done it we massively miss something | 20:55 |
*** markmcclain has joined #openstack-qa | 20:55 | |
sdague | and create a giant hole for 6 weeks | 20:55 |
dkranz | sdague: That is a problem with random though. | 20:56 |
dkranz | sdague: You can create mini-holes that we don't understand | 20:56 |
*** mlavalle has joined #openstack-qa | 20:56 | |
sdague | you can understand them if we state dump the parameter space and collect it up | 20:56 |
dkranz | sdague: I think with a little more thought we can come up with something that satisfies both objectives | 20:56 |
sdague | sure | 20:56 |
*** mlavalle has quit IRC | 20:57 | |
dkranz | sdague: I had assumed that we would go with the "smoke" model but you have a fair point | 20:57 |
*** mlavalle has joined #openstack-qa | 20:57 | |
sdague | I think on the positive side the smoke model might be more appropriate | 20:57 |
sdague | because we have some very specific function that we consider unbreakable | 20:57 |
sdague | but then the rest of this we need to start making calls | 20:58 |
dkranz | sdague: Right, but if you look at some of the new swift tests | 20:58 |
dkranz | sdague: they are expanding the query matrix | 20:58 |
dkranz | sdague: Which gives you something like the negative case | 20:58 |
dkranz | sdague: And we really should have that for the dict payloads as well but don't | 20:58 |
dkranz | sdague: So I am not sure "full positive" is that different | 20:58 |
sdague | sure | 20:59 |
dkranz | sdague: This is the conversation we started to have right at the end in Hong Kong | 20:59 |
sdague | yep | 20:59 |
dkranz | sdague: We need to nail it this time, one way or another | 20:59 |
sdague | agreed | 20:59 |
dkranz | sdague: How about we think about it some more and put it on the agenda for Thursday? | 21:00 |
sdague | honestly, I think this is probably a conversation for the list, because there is no way we are getting all the right people in a room in atlanta | 21:00 |
sdague | yep, sounds good | 21:00 |
dkranz | sdague: ok, great. If I come up with as straw proposal I'll send it to the ml and you can do the same. | 21:00 |
sdague | sure | 21:00 |
dkranz | sdague: So in Atlanta we should be ratifying something that has been already well discussed | 21:01 |
dkranz | sdague: On another subject, do you now how to debug an import failure in 'testr list-tests'? | 21:02 |
dkranz | know | 21:02 |
dkranz | sdague: It drives me nuts because when I import the thing it complains about into the interpreter: no error | 21:02 |
dkranz | sdague: Getting no stacktrace really sucks | 21:02 |
*** Sukhdev has joined #openstack-qa | 21:03 | |
sdague | honestly, I usually run nose | 21:04 |
sdague | to figure that out | 21:04 |
russellb | sdague: mtreinish how long do you think you guys will wait until you start accepting specs to qa-specs? | 21:04 |
sdague | russellb: we wanted to do a couple weeks of getting the ones by the active community members in and through to generate some examples | 21:04 |
sdague | so my guess was announcing it for general purpose use in 2 - 3 weeks | 21:05 |
russellb | makes sense | 21:05 |
russellb | i'm afraid we'll have to open nova-specs as soon as the RC is cut | 21:05 |
russellb | hopefully we can get out all structural changes before that | 21:05 |
dkranz | sdague: nose? Hah! | 21:05 |
sdague | we've kind of kept it cloaked for now because tempest launchpad is a wreck anyway, and barely used, so no one is crashing down the gate right now | 21:05 |
russellb | heh | 21:05 |
russellb | sphinx for nova-specs is merged | 21:06 |
sdague | I do get the urgency is different on nova | 21:06 |
russellb | let me know if you guys come up with any significant structural differences that we should sync on | 21:06 |
sdague | honestly, the only other thing you might care about is my ghetto rst style checker | 21:06 |
*** mlavalle has left #openstack-qa | 21:06 | |
openstackgerrit | Adam Gandelman proposed a change to openstack-dev/devstack: Ironic: Use HOST_IP instead of SERVICE_HOST https://review.openstack.org/82604 | 21:07 |
dkranz | sdague: So nose gives me the answer pronto. | 21:07 |
sdague | dkranz: yeh, it's a hugh testr usability issue | 21:07 |
dkranz | sdague: Is there a bug on this? | 21:07 |
russellb | sdague: yes, though i was wondering if we can just use sphinx for that | 21:07 |
sdague | I think lifeless said there were upstream fixes | 21:07 |
*** afazekas has joined #openstack-qa | 21:07 | |
sdague | russellb: as far as I can tell, no | 21:07 |
russellb | sdague: a job that fails on warnings/errors from sphinx or whatever | 21:07 |
russellb | well boo | 21:07 |
sdague | so you can fail on bad rst | 21:07 |
dkranz | sdague: It would be really great to get those in. | 21:08 |
lifeless | sdague: there is. | 21:08 |
sdague | but I want 80 column wrap | 21:08 |
russellb | ah | 21:08 |
sdague | and must end in .rst file | 21:08 |
russellb | so above and beyond | 21:08 |
lifeless | sdague: it will get a release when the pbr work goes in, because I'm moving to git but I need pbr to support the release process. | 21:08 |
sdague | russellb: yeh, exactly | 21:08 |
russellb | cool makes sense | 21:08 |
sdague | lifeless: coolio | 21:08 |
sdague | lifeless: ok, that explains all the pbr hacking :) | 21:08 |
sdague | I did look at the column thing, sphinx doesn't care | 21:09 |
sdague | but reviewing things that don't 80 column wrap in gerrit is a bear some times | 21:09 |
russellb | agreed | 21:10 |
*** mlavalle has joined #openstack-qa | 21:10 | |
*** ruhe has left #openstack-qa | 21:10 | |
sdague | the new process might handle the .rst issue, I don't know | 21:10 |
sdague | I was going to restack on top of mtreinish's patch and figure that out | 21:10 |
mtreinish | sdague: well with if the .rst file extension isn't there sphinx won't pick it up | 21:13 |
sdague | mtreinish: right, so we still need it then | 21:14 |
sdague | to explicitly fail people | 21:14 |
*** andreaf has joined #openstack-qa | 21:15 | |
*** dkranz has quit IRC | 21:23 | |
*** rossella_ has joined #openstack-qa | 21:29 | |
*** jamielenz is now known as jamielennox | 21:33 | |
*** HenryG has quit IRC | 21:33 | |
openstackgerrit | A change was merged to openstack/tempest: Verify attributes through Nova list flavor-access API https://review.openstack.org/80135 | 21:44 |
*** mriedem has quit IRC | 21:46 | |
*** nati_ueno has quit IRC | 21:47 | |
*** nati_ueno has joined #openstack-qa | 21:48 | |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Use OS::Nova::Server for NeutronResourcesTestJSON https://review.openstack.org/82393 | 21:51 |
openstackgerrit | Steve Baker proposed a change to openstack/tempest: Fail a test if stack delete failed https://review.openstack.org/82392 | 21:51 |
openstackgerrit | Armando Migliaccio proposed a change to openstack/tempest: Honor suspend/pause config switches in scenario tests https://review.openstack.org/82566 | 21:53 |
*** mestery has quit IRC | 21:55 | |
*** dims has quit IRC | 21:56 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/81697 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error | 22:00 |
openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1295876 https://review.openstack.org/82245 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Use auth data to fill credentials https://review.openstack.org/82111 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Define V3 Credentials https://review.openstack.org/81872 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Get credential IDs from Credentials class https://review.openstack.org/80246 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials (part1) https://review.openstack.org/77594 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials (part2) https://review.openstack.org/82112 | 22:03 |
openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Access credential fields as attributes https://review.openstack.org/82113 | 22:03 |
*** mestery has joined #openstack-qa | 22:04 | |
*** mestery has quit IRC | 22:06 | |
*** salv-orlando has quit IRC | 22:09 | |
*** dims_ has joined #openstack-qa | 22:13 | |
adam_g | sdague, so about ironic + tempest, got a min? | 22:14 |
sdague | otp, maybe in about 30 mins | 22:15 |
adam_g | sdague, k | 22:16 |
*** Sukhdev has quit IRC | 22:18 | |
openstackgerrit | Joe Gordon proposed a change to openstack-dev/devstack: Set up cgroups for libvirt https://review.openstack.org/82630 | 22:21 |
*** markmcclain has quit IRC | 22:23 | |
*** andreaf has quit IRC | 22:33 | |
*** afazekas has quit IRC | 22:42 | |
openstackgerrit | Sabari proposed a change to openstack-dev/devstack: VMware: Use multiline for cluster_name opt https://review.openstack.org/82648 | 22:51 |
*** afazekas has joined #openstack-qa | 22:54 | |
*** kgriffs is now known as kgriffs_afk | 22:55 | |
*** rhsu1 has joined #openstack-qa | 22:58 | |
*** salv-orlando has joined #openstack-qa | 23:00 | |
*** rhsu has quit IRC | 23:00 | |
*** salv-orlando_ has joined #openstack-qa | 23:01 | |
sdague | adam_g: hey, I've got a few minutes now | 23:03 |
*** salv-orlando has quit IRC | 23:04 | |
*** salv-orlando_ is now known as salv-orlando | 23:04 | |
openstackgerrit | Joe Gordon proposed a change to openstack-dev/devstack: Set up cgroups for libvirt https://review.openstack.org/82630 | 23:05 |
adam_g | sdague, cool. so we'd like to have a voting tempest job as part of the ironic gate.. that would run the current ironic API CRUD tests it runs, plus a new functional scenario test | 23:06 |
sdague | adam_g: ok, great | 23:06 |
adam_g | sdague, trying to find the easiest way to define such a limited run. would it be to add a new tox target? | 23:06 |
sdague | so, actually, use the REGEX | 23:07 |
adam_g | the current job runs tempest, and gives us results similar to http://logs.openstack.org/23/81123/4/check/check-tempest-dsvm-virtual-ironic/5705b2d/logs/testr_results.html.gz | 23:07 |
adam_g | ^ those failures mostly to be expected, touching compute features not supported AFAICS | 23:07 |
sdague | adam_g: https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L333 | 23:07 |
adam_g | sdague, ah! | 23:07 |
sdague | you can specify a custom regex for devstack-gate | 23:08 |
adam_g | nice | 23:08 |
sdague | and only those tempest tests will be run | 23:08 |
adam_g | i was distracted by things like testenv:heat-slow in tempest's tox.ini | 23:08 |
sdague | yep | 23:08 |
sdague | that's a relatively new feature primarily created for 3rd party testing | 23:08 |
sdague | but I think it's exactly what yuo want | 23:08 |
adam_g | sounds like it | 23:08 |
adam_g | great | 23:09 |
adam_g | scenario test is here, will flip it from WIP to review this week https://review.openstack.org/#/c/81958/ | 23:09 |
sdague | cool | 23:10 |
*** aysyd has quit IRC | 23:11 | |
*** salv-orlando_ has joined #openstack-qa | 23:14 | |
*** salv-orlando has quit IRC | 23:17 | |
*** salv-orlando_ is now known as salv-orlando | 23:17 | |
openstackgerrit | A change was merged to openstack-dev/devstack: Fix broken if statement in lib/tls on ZSH https://review.openstack.org/81337 | 23:21 |
*** shwetaap has quit IRC | 23:26 | |
openstackgerrit | Tushar Kalra proposed a change to openstack/tempest: Typo in config.py https://review.openstack.org/82599 | 23:35 |
*** GMann has joined #openstack-qa | 23:38 | |
openstackgerrit | Edgar Magana proposed a change to openstack/tempest: Add test for subnet gateway IPv4 and IPv6 https://review.openstack.org/67312 | 23:38 |
*** salv-orlando has quit IRC | 23:38 | |
*** yamahata has quit IRC | 23:39 | |
*** afazekas has quit IRC | 23:40 | |
*** atiwari has quit IRC | 23:46 | |
*** mriedem has joined #openstack-qa | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!