You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Some tests may need to be run several times with exactly the same combination of parameters to gather additional results and produce statistics. This is particularly useful for tests results that aren't stable or to get an average with performance runs. The paths and all the meta-data will be the same for each run, except some fields that will be used to distinguish results that are coming from the same run.
For example, we could have an "iteration" field for this which would be automatically incremented every time an identical data set is being sent.
Here's a typical scenario with first the data being sent to the API:
Then the data stored in the database would add "iteration": 1 to the first entry and "iteration": 2 to the second one. One issue with this is that the client can't determine the iteration value when submitting the data, so the data read back from the API is not the same as what was sent.
Another approach is to not implement anything, several nodes with the same parent and same path and same attributes can be retrieved with a query as a list. So the default approach for now would be to see whether the existing data model can already cope with this or if we need some additional features. This should become more apparent when trying to use the data to compute stats or detect performance regressions etc.
The text was updated successfully, but these errors were encountered:
Some tests may need to be run several times with exactly the same combination of parameters to gather additional results and produce statistics. This is particularly useful for tests results that aren't stable or to get an average with performance runs. The paths and all the meta-data will be the same for each run, except some fields that will be used to distinguish results that are coming from the same run.
For example, we could have an "iteration" field for this which would be automatically incremented every time an identical data set is being sent.
Here's a typical scenario with first the data being sent to the API:
Then the data stored in the database would add
"iteration": 1
to the first entry and"iteration": 2
to the second one. One issue with this is that the client can't determine the iteration value when submitting the data, so the data read back from the API is not the same as what was sent.Another approach is to not implement anything, several nodes with the same parent and same path and same attributes can be retrieved with a query as a list. So the default approach for now would be to see whether the existing data model can already cope with this or if we need some additional features. This should become more apparent when trying to use the data to compute stats or detect performance regressions etc.
The text was updated successfully, but these errors were encountered: