Tab “Test report”

../../../../_images/trace.check_GUI_Testreport.png

The tab “Test report”

The tab test report always shows the latest test report.

On the left side there is the “package tree”. It provides a quick survey of the overall result of an analysis (top level “test drives” in red means “FAILED”, see below).

In addition, the utilized records and the actual evaluation of the trace analysis are shown.

After a click at trace analysis, the above-mentioned test report presents itself in the following columns:

  • Result:

    This column contains the evaluation of each element of the trace analysis. Exactly four evaluations are possible:

  • “SUCCESS” (green trace steps, positive evaluation, specification was met),

  • “FAILED” (red trace steps, negative evaluation, specification was violated),

  • “NONE (gray trace steps, no evaluation),

  • “ERROR” (dark red elements concerned, an error occurred during execution).

    • Name:

      Name of the element concerned.

  • Generic signals:

    Signals used in each trace step.

  • Parameters

    Parameters and their values used in each trace step.

  • Description:

    Description of the element concerned.

Some elements (particularly the trace steps) contain additional information details. Those details can be made visible by clicking on the plus symbol in the first column or double-clicking on the respective line.

Above the test report a number of further functions are available in a symbol bar (from left to right):

../../../../_images/ToolbarTestreport.png
  • Copy active row / Copy all rows:

    By the first option the contents of the currently selected test report line are copied to clipboard. That may be helpful for better evaluation of longer texts or Python objects.

    The second button copies to clipboard all lines of the test report being displayed, so that they can be used in other programs.

  • Search text:

    Putting in a search text and hitting <enter> makes trace.check jump to the first location in a test report where the search text occurs. The two arrows on the right of the input field allow jumping to the last or the next result of the search.

  • Filter for display:

    The filter for display serves to determine the steps to be shown. So the test report can be filtered freely and be processed as required. It is possible, for example, to make appear only the failed steps.

    The selected filters are OR-connected. If filter conditions should be AND-connected or other criteria defined that can be done by clicking on the button itself or on the entry Configure display filters of its menu.

    Filter settings are stored in “settings” and can so be used for all packages. Those settings can be reached also via the menu Options ‣ Settings ‣ Report filters.

    As second option the button menu offers a slider to change the amount of details shown for an report entry. The slider entries can be changed in their order individually. By moving the slider all listed entries under the current selection are not shown.

    Info

    By using the button Filter for display two separate working filters can be configured. The first one determines if an report entry will be displayed. The second one determines which details will be shown for an displayed report entry.

  • Expand filter Expand all:

    The expand filter serves to determine the trace steps to be expanded. The filters used are the same as with the filter for display. Therefore, additional filters should be determined in the filter settings. A click on the button image can be used to expand all report entries.

  • Collapse all:

    A click on this button collapses all report entries. The currently active expand filter will be deactivated.

  • Open report directory:

    A click on this button opens the Windows explorer with the test report directory. At the top level there is always the displayed test report database (report.trf). A sub-folder exists for each executed package that contains the (possibly copied) records. There may be still further directories containing generated test reports, maybe in text or HTML format.

  • Delete report directory:

    This button serves to delete the current test report with all the recordings that may exist.

  • Generate different test reports:

    Target formats can be set up by means of the buttons HTML, TXT. This makes it possible to generate a user-defined test report with the utilization of filters. At present the output formats text and HTML are available which can be configured in the text configuration editor at tab Report.

Report Viewer

For evaluating generated test reports outside of trace.check, the standalone “Report Viewer” is included in the installation package of trace.check and can be opened by means of the start menu.