Test Environment for Accumulating Cumulative Metric Data

1. A computer-implemented method to generate cumulative metric data for a test in a test environment, the method comprising: specifying, from within the test environment, a plurality of test elements within an iterations part of the test, the plurality of test elements including: a first test element being a simulation model having a block property, the simulation model executed from within a second environment that is separate from the test environment, and a second test element that is not a simulation model, the second test element being executable; generating, from within the test environment, at least one test condition for the test, the at least one test condition specifying a number of values for the block property of the simulation model; specifying at least one metric setting for the simulation model; defining a test variable within the test environment; mapping, from within the test environment, the at least one metric setting of the simulation model to the test variable; running, by a computer, the test from within the test environment such that the simulation model is executed within the second environment for a plurality of iterations based on the number of block property values specified in the at least one test condition, and the second test element is executed for the plurality of iterations; generating, during each iteration of the simulation model, metric data based on the at least one metric setting for the simulation model, the metric data generated within the second environment; assigning the metric data generated in the second environment to the test variable of the test environment as a result of the mapping of the at least one metric setting of the simulation model to the test variable so that the metric data from the iterations of the simulation model is accumulated; and providing access to the accumulated metric data from within the test environment.

2. A computer-readable medium comprising software, which when executed by a computer system causes the computer system to perform operations in a computing environment to generate a test in a test environment, the operations comprising: specifying, from within the test environment, a plurality of test elements within an iterations part of the test, the plurality of test elements including: a first test element being a simulation model having a block property, the model executed from within a second environment that is separate from the test environment, and a second test element that is not a simulation model, the second test element being executable; generating, from within the test environment, at least one test condition for the test, the at least one test condition specifying a number of values for the block property of the simulation model; specifying at least one metric setting for the simulation model; defining a test variable within the test environment; mapping, from within the test environment, the at least one metric setting of the simulation model to the test variable; running, by a computer, the test from within the test environment such that the simulation model is executed within the second environment for a plurality of iterations based on the number of block property values specified in the at least one test condition, and the second test element is executed for the plurality of iterations; generating, during each iteration of the simulation model, metric data based on the at least one metric setting for the simulation model, the metric data generated within the second environment; assigning the metric data generated in the second environment to the test variable of the test environment as a result of the mapping of the at least one metric setting of the simulation model to the test variable so that the metric data from the iterations of the simulation model is accumulated; and providing access to the accumulated metric data from within the test environment.

3. A system to generate a test in a test environment, the system comprising: means for specifying, from with the test environment, a plurality of test elements for the test, the plurality of test elements including: a first test element being a simulation model having a block property, the simulation model executed from within a second environment that is separate from the test environment, and a second test element that is not a simulation model, the second test element being executable; means for generating, from within the test environment, at least one test condition for the test, the at least one test condition specifying a number of values for the block property of the simulation model; means for specifying at least one metric setting for the simulation model; means for defining a test variable within the test environment; means for mapping, from within the test environment, the at least one metric setting of the simulation model to the test variable; means for running the test from within the test environment such that the simulation model is executed within the second environment for a plurality of iterations based on the number of block property values specified in the at least one test condition, and the second test element is executed for the plurality of iterations; means for generating, during each iteration of the simulation model, metric data based on the at least one metric setting for the simulation model, the metric data generated within the second environment; means for assigning the metric data generated in the second environment to the test variable of the test environment as a result of the mapping of the at least one metric setting of the simulation model to the test variable so that the metric data from the iterations of the simulation model is accumulated; and means for providing access to the accumulated metric data from within the test environment.

4. The method as in claim 1 , wherein the at least one test condition includes a starting value, an ending value, and an incrementing step value for the block property of the simulation model.

5. The method as in claim 1 , wherein the at least one metric setting is provided by the test environment.

6. The method as in claim 1 , wherein the at least one metric setting is provided by the simulation model.

7. The method as in claim 1 , wherein the at least one metric setting is provided by a user.

8. The method as in claim 1 , further comprising: designating a portion of the simulation model for which the metric data is to be generated.

9. The method as in claim 1 , further comprising: designating that the metric data is to be generated for all of the simulation model.

10. The method as in claim 1 , wherein the mapping comprises: designating a coverage path for the simulation model.

11. The method as in claim 1 , wherein the at least one metric setting is selected from a group consisting of: model coverage, code coverage, memory usage, parameter statistics, decision coverage, condition coverage, modified condition-decision coverage (MC/DC), look-up table coverage, signal range coverage, and cyclomatic complexity coverage.

12. The method as in claim 1 , wherein the simulation model is generated with a matrix-based mathematical programming language, a graphical modeling environment, a graphical language, a text-based language, or a text-based modeling language.

13. The computer-readable medium as in claim 2 , wherein the at least one test condition includes a starting value, an ending value, and an incrementing step value for the block property of the simulation model.

14. The computer-readable medium as in claim 2 , wherein the at least one metric setting is provided by the test environment.

15. The computer-readable medium as in claim 2 , wherein the at least one metric setting is provided by the simulation model.

16. The computer-readable medium as in claim 2 , wherein the at least one metric setting is provided by a user.

17. The computer-readable medium as in claim 2 , wherein the operations further comprise: designating a portion of the simulation model for which the metric data is to be generated.

18. The computer-readable medium as in claim 2 , wherein the operations further comprise: designating that the metric data is to be generated for all of the simulation model.

19. The computer-readable medium as in claim 2 , wherein the operations further comprise: designating a coverage path for the simulation model.

20. The computer-readable medium as in claim 2 , wherein the at least one metric setting is selected from a group consisting of: model coverage, code coverage, memory usage, parameter statistics, decision coverage, condition coverage, modified condition-decision coverage (MC/DC), look-up table coverage, signal range coverage, and cyclomatic complexity coverage.

21. The computer-readable medium as in claim 2 , wherein the simulation model is generated with a matrix-based mathematical programming language, a graphical modeling environment, a graphical language, a text-based language, or a text-based modeling language.