Interactive Input Recorder

The Interactive Input Recorder captures touch input actions directly from a live preview and transfers them into the parameters of a touch input test step. To capture entire workflows, the input recorder can also create image read test steps with expectations. Created test steps are inserted in the package currently open in the editor, directly behind the currently selected test step. If no test step is selected, insertion follows the editor’s current default insertion position.

The dialog is available in the context menu of the media access image nodes and is especially useful for quickly defining start and target coordinates.

  • Snapshot reads a single frame.

  • Live snapshot refreshes the preview automatically. The refresh rate can be configured between 100 and 5000 ms. Changes are applied with Enter or when leaving the input field.

  • Refresh triggers a manual refresh at any time.

Interactive gestures

Your mouse gesture is translated automatically into the corresponding touch action:

  • Short click -> Tap

  • Long press -> Hold

  • Drag -> Swipe

  • Long press and drag -> Hold and Swipe

  • Hold Shift and click repeatedly -> Multi-Tap

The set of executable actions depends on the action types supported by the current mapping and tool.

Reading an area

Holding Ctrl and dragging the mouse in the preview will select an image area for an Image Read test step. This area will be stored as a screenshot and can be used as reference for evaluation.

Holding Ctrl and clicking in the preview creates an Image Read test step without evaluation at the clicked position.

Feedback in the dialog

The Last interaction area shows feedback about the last action, user hints, and error messages.

Further information