Setup Agent-based multimedia processing¶

The multimedia settings configure test steps that use ecu.test agent for image processing during test execution, for example to determine touch coordinates from a prompt. The selected model must support image input.

The settings are used by:

• Reading and comparing images

• Agentic Multimedia

• Touch input

Open Options ‣ Settings ‣ ecu.test agent ‣ Multimedia settings.

Model request parameterization¶

The effective model request parameterization is initially displayed as read-only YAML. Select Edit to change it.

The edit dialog contains:

Model

Select a model from the available models or enter a model name. Use the refresh button to retrieve the available models from the configured service.

Override (editable YAML)

Enter only the values that should override their defaults. The content is validated while you edit it, and only valid settings can be saved.

Effective Preview (read only)

Shows the resulting configuration after applying defaults and overrides.

Use Import to load an override from a YAML file and Export to save the current override. Imported YAML must be valid and include request.model.

Supported YAML fields¶

request.model

Model used for Agent-based multimedia processing.

request.temperature

Sampling temperature from 0.0 to 1.0. Lower values produce more deterministic results. Higher values increase variation but can make coordinate-sensitive results less consistent.

imagePreprocessing.resizeEnabled

Enables automatic downscaling before an image is sent to the model. This can reduce latency and token use. It also allows ecu.test to scale returned coordinates back to the original image size.

imagePreprocessing.maxEdgeLength

Maximum image edge length in pixels, from 128 to 16384, when automatic resizing is enabled.

resultPostProcessing.relativeCoordsEnabled

Enables conversion of coordinates returned relative to a model-specific reference size.

resultPostProcessing.relativeCoordsScale

Reference edge length from 10 to 16384 used for relative coordinates. For example, use 1000 when the model returns coordinates in the range from 0 to 1000.

modelInstructions

Ordered list of text files containing additional model instructions. Relative paths are resolved against the workspace; absolute paths are used directly. Every entry must be a non-empty path to an existing file.

Example¶

request:
  model: gpt-4.1-mini
  temperature: 0.2
imagePreprocessing:
  resizeEnabled: true
  maxEdgeLength: 1200
resultPostProcessing:
 relativeCoordsEnabled: false
 relativeCoordsScale: 1000
modelInstructions: [instructions/modelInstructions.md, instructions/projectRules.md]

Multimedia cache¶

Agent-based multimedia results can be cached for reuse during test execution. Select Delete Multimedia Cache to remove all cached results. Subsequent executions request new results from the Agent service.