| *** Rockyg has quit IRC | 01:53 | |
| *** rmart04 has joined #refstack | 07:36 | |
| *** openstackstatus has quit IRC | 09:44 | |
| *** openstack has joined #refstack | 09:47 | |
| *** openstackstatus has quit IRC | 10:13 | |
| *** openstack has joined #refstack | 10:16 | |
| *** edmondsw has joined #refstack | 12:09 | |
| ekhugen | thanks catherineD for the information on the patch | 12:42 |
|---|---|---|
| *** openstackstatus has quit IRC | 12:43 | |
| *** openstack has joined #refstack | 12:46 | |
| *** rmart04 has quit IRC | 15:25 | |
| catherineD | ekhugen: you mentioned about a fix in tempest ... pls let me know the commit id .. it may be a good time to upgrade refstack default tempest to a newer one . | 15:34 |
| *** pilgrimstack has quit IRC | 16:04 | |
| ekhugen | catherineD I put this in a few days ago, it helped my server_actions tests to pass https://review.openstack.org/#/c/384719/1 | 16:25 |
| ekhugen | oops sorry, final change was https://review.openstack.org/#/c/384719/ | 16:25 |
| catherineD | OK I will look into upgrading refstack-client default tempest version to this commit ... thanks for letting us know ... | 16:27 |
| catherineD | The default tempest in refstack-client just to let users know that the RefStack team has run tests and know that it works per out knowledge .... | 16:28 |
| catherineD | our thinking is that the test should be able to run with this tempest version or any version beyond that .. | 16:29 |
| ekhugen | okay, thanks | 16:29 |
| ekhugen | is there any plans to start tagging tempest tests as being in refstack, so when a test is affected, it's easy to tell there's a refstack hit as well? | 16:30 |
| catherineD | of course, running newer tempest version may expose or discover issues and that is what we need to know and deal with | 16:30 |
| catherineD | ekhugen: that is a good suggestion that we (refstack/tempest) team should consider ... so far, what we have done is not very systematically ... the tempest team has been sensitive to our tests by notifying us .. but a systematic way like tagging would be better .. | 16:32 |
| ekhugen | catherineD I'd be happy to work on a tagging blueprint, maybe it's something we could discuss at summit? | 16:33 |
| catherineD | you can see that https://review.openstack.org/#/c/382653/ is submiited by Ken'ichi Ohmichi who is the Tempest PTL ... | 16:34 |
| catherineD | ekhugen: that would be great ... | 16:34 |
| catherineD | I guess that would be a Tempest BP? | 16:35 |
| ekhugen | yes, it would have to be | 16:35 |
| catherineD | that is great ... do inform us on the work session time if the Tempest team decide to discuss that at the summit | 16:36 |
| ekhugen | okay, I'll propose it over in openstack-qa and see what they think | 16:37 |
| catherineD | while you are here let me give some info about a couple way that DefCore/RefStack handles the changes in Tempest | 16:37 |
| catherineD | after a Guideline is approved (currently 2016.01 and 2016.08) | 16:38 |
| catherineD | for tests that either removed or skipped (due to newly discovered bug in Tempest), DefCore/RefStack will flag these test (that means that they do not need to pass) | 16:39 |
| ekhugen | that makes sense | 16:40 |
| catherineD | for tests that have name changes (new names due to path changes or whatever other reasons ), we will deal with that by adding the new name as aliases .. | 16:40 |
| ekhugen | ah okay | 16:41 |
| catherineD | we will keep both new/old names as aliases to cover users testing with the default tempest that refstack define earlier (old name) and for user running with current tempest (new name) | 16:42 |
| catherineD | so if users run the test with a list of must-pass test file , it is very important that the aliases names will be included in the test list. | 16:43 |
| ekhugen | right | 16:44 |
| catherineD | RefStack will displace message of the test not found in Tempest ... those are the aliases of new or old name depending on the Tempest version run | 16:44 |
| ekhugen | ah, yep, I've seen those | 16:44 |
| catherineD | here is how to get the test-lsit with aliases and skip flagged tests http://192.168.56.103:8000/v1/guidelines/2016.08/tests?target=platform&type=required&alias=true&flag=false | 16:45 |
| *** rmart04 has joined #refstack | 16:46 | |
| ekhugen | right, I have been running with the 2016.01 guidelines and skipping the flagged tests | 16:46 |
| ekhugen | I put my results out publicly yesterday | 16:46 |
| ekhugen | https://refstack.openstack.org/#/results/08f69f77-a573-496f-b263-e83cf10a578f | 16:47 |
| catherineD | so the default display will show 2016.08 ... but if you have uploaded the data to RefStack with key ... you can pin the data to 2016.01 | 16:48 |
| ekhugen | oh thanks! | 16:49 |
| ekhugen | I missed that when I first put them up | 16:49 |
| catherineD | slide 13 on this shows how to pin the results https://docs.google.com/presentation/d/1CoegiPzVp8G4VLdrOYTX9ZI_E-PTRx0gWVpuF9ElKRU/edit#slide=id.g85e96ad23_0_20 | 16:50 |
| ekhugen | thanks! | 16:51 |
| catherineD | ekhugen: np ... we may disable uploading anonymously in the near future ... since those data has no owner and hard to manage ... in fact those data is owned by Foundation but it is very hard for them to manage everyone else's data | 16:51 |
| catherineD | actually slide 14 not 13 | 16:52 |
| ekhugen | oh I always upload with my key | 16:53 |
| *** rmart04_ has joined #refstack | 16:54 | |
| *** rmart04 has quit IRC | 16:57 | |
| *** rmart04_ is now known as rmart04 | 16:57 | |
| catherineD | ekhugen: that is good .. | 17:10 |
| *** rmart04 has quit IRC | 17:15 | |
| *** sslypushenko_ has joined #refstack | 18:44 | |
| *** sslypushenko has quit IRC | 18:51 | |
| *** sslypushenko_ is now known as sslypushenko | 18:52 | |
| *** edmondsw has quit IRC | 18:54 | |
| *** edmondsw has joined #refstack | 19:19 | |
| *** Rockyg has joined #refstack | 19:35 | |
| *** luzC has quit IRC | 20:03 | |
| *** luzC has joined #refstack | 20:03 | |
| *** luzC- has joined #refstack | 20:24 | |
| *** luzC has quit IRC | 20:24 | |
| *** luzC- is now known as luzC | 20:25 | |
| *** edmondsw has quit IRC | 21:26 | |
| *** xinliang has quit IRC | 21:30 | |
| *** xinliang has joined #refstack | 21:42 | |
| *** mgagne_ is now known as mgagne | 23:12 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!