| opendevreview | Soniya Murlidhar Vyas proposed openinfra/python-tempestconf master: Add multistore image option https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 | 14:13 |
|---|---|---|
| opendevreview | Soniya Murlidhar Vyas proposed openinfra/python-tempestconf master: Add multistore image option https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 | 14:23 |
| zigo | Hi there! One quick question: is it that it used to be that the refstack list contained test_name[id-2394872(smoke)] and now it's test_name[id-2394872,smoke] instead or something ? | 14:32 |
| zigo | I'm seeing inconsistencies that leads to not found tests I believe... | 14:32 |
| opendevreview | Soniya Murlidhar Vyas proposed openinfra/python-tempestconf master: Add multistore image option https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 | 14:39 |
| opendevreview | Soniya Murlidhar Vyas proposed openinfra/python-tempestconf master: Add multistore image option https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 | 14:48 |
| zigo | FYI, the part which I'm wondering about is here: https://opendev.org/openinfra/refstack-client/src/branch/master/refstack_client/list_parser.py#L142 | 16:08 |
| zigo | Shouldn't the parser search for "," rather than "(" ? | 16:08 |
| kopecmartin | hi zigo , i'll check the format if it is/ should be [()] or [,] .. | 16:17 |
| kopecmartin | what tests it says you're missing? | 16:17 |
| zigo | kopecmartin: When I do: "stestr list", I get something like this: | 16:19 |
| zigo | neutron_tempest_plugin.vpnaas.api.test_vpnaas.VPNaaSTestJSON.test_create_update_delete_ike_policy[id-d9ecb858-7136-4ef5-abba-325c84c57d78,smoke] | 16:19 |
| zigo | When when I run refstack-client, I get many warnings like this one: | 16:19 |
| zigo | 2022-01-10 14:05:53,295 refstack_client.list_parser:147 WARNING Test tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status not found in Tempest list. | 16:19 |
| zigo | kopecmartin: Here's the full list: | 16:22 |
| zigo | https://paste.opendev.org/show/812002/ | 16:22 |
| zigo | Some are probably legitimately not in tempest, though some are ! | 16:22 |
| zigo | some are present, but not found, probably because of that wrong parsing. | 16:22 |
| zigo | kopecmartin: Your thoughts? | 16:22 |
| kopecmartin | I think the missing tests you see are just old names of the ones which are in tempest now, tests change name sometime .. but let me check your log | 16:26 |
| kopecmartin | we are about to modify the print logic in refstack-client , so that it doesn't print those old test names by default - https://review.opendev.org/c/openinfra/refstack-client/+/821325 | 16:27 |
| kopecmartin | f.e. this test (which is printed as missing) | 16:29 |
| kopecmartin | tempest.api.volume.test_volumes_negative.VolumesV2NegativeTest.test_update_volume_with_empty_volume_id | 16:30 |
| kopecmartin | https://opendev.org/openinfra/interop/src/branch/master/guidelines/2021.11.json#L3099 | 16:30 |
| kopecmartin | that's an alias of tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id | 16:30 |
| zigo | kopecmartin: Ok, so basically, I do not need to worry, right? :) | 16:34 |
| zigo | kopecmartin: FYI, I have just pushed python-tempestconf and refstack-client to Debian unstable. We run a packaged version. I'd love to have these tagged with proper semver versionning. Do you think this could be done? | 16:34 |
| zigo | Best would be if a new version was tagged at the same time as the OpenStack releases... | 16:35 |
| kopecmartin | zigo: yes, no worries :) | 16:37 |
| kopecmartin | yeah, we can release whenever we need it , right now we don't have any specific schedule for the releases as there isn't a huge traffic in those projects, we release based on the changes which were merged since a prior release | 16:37 |
| zigo | kopecmartin: But refstack-client has no tags... | 16:38 |
| kopecmartin | oh, that's right, i mistaken it for refstack project | 16:40 |
| zigo | I don't use refstack, but just refstack-client + tempest (all packaged). | 16:40 |
| zigo | Had to add these 2 patches by the way: https://salsa.debian.org/openstack-team/clients/refstack-client/-/tree/debian/xena/debian/patches | 16:42 |
| zigo | Not sure if I could upstream some of this ... :/ | 16:42 |
| zigo | Anyway, thanks a lot for all your precious replies! | 16:45 |
| kopecmartin | so you modified refstack-client so that it runs with packaged tempest instead of the one cloned during refstack-client's installation? | 16:45 |
| zigo | Yeah ! :P | 16:46 |
| zigo | No venv involved. | 16:46 |
| zigo | apt-get install refstack-client ... | 16:47 |
| kopecmartin | you also packaged it? | 16:49 |
| kopecmartin | hm, the workflow always has been, you clone refstack-client and it'll download the tempest version needed to pass the tests | 16:50 |
| kopecmartin | refstack-client always had just one version (master) which was expected to work on all stable releases | 16:50 |
| kopecmartin | to be honest it's becoming harder to find a tempest version which works on all the stable releases | 16:51 |
| kopecmartin | however, we can't to that change from one day to another | 16:52 |
| kopecmartin | it's something we should definitely discuss with the Interop group though | 16:52 |
| zigo | The issue is just releasing in Debian. If you do a new tag, then that's a sign for me I should do a package update. | 16:57 |
| zigo | Also, I'm integrating this with OCI [1] https://salsa.debian.org/openstack-team/debian/openstack-cluster-installer | 16:58 |
| zigo | The goal is, someone just installs a new OpenStack cluster with OCI, and can directly submit the results in an easy way. | 16:58 |
| kopecmartin | zigo: I'll add tagging refstack-client topic to our agenda , we have team meetings every Thursday if you wanna join - https://etherpad.opendev.org/p/interop | 17:37 |
| opendevreview | Martin Kopec proposed openinfra/refstack master: DNM - testing https://review.opendev.org/c/openinfra/refstack/+/824066 | 21:35 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!