A chroma-based Video Segmentation Ground-truth

Content


>Foreground script 1

"Dancing cha-cha-cha"

>Foreground script 2

"Exhausted runner"

>Foreground script 3

"Dangerous race"

>Foreground script 4

"Thirsty man"

>Foreground script 5

"Hot day"

>Foreground script 6

"Ingravity"

>Foreground script 7

"Teddy bear"

>Foreground script 8

"Bad manners"

>Foreground script 9

"Playing tennis"

>Foreground script 10

"Playing alone"

>Foreground script 11

"Running over"

This section presents, via the left menu, every designed script along with frame thumbnails and low resolution video previews of the final sequences available in the ground-truth. Final sequences along with their ground-truth masks are available in high resolution format (uncompressed 720x576) under request for research purposes (see the "Ground-truth downloading" section).

Sequences are organized according to foreground scripts, so that for each foreground story-line a number sequences can be found depending on the background and camera motion used for composition. An inticator of the segmentation complexity, according to each of the critical factors considered to design the sequences (see below), is shown:

The critical factor entails low segmentation complexity

The critical factor entails medium segmentation complexity

The critical factor entails high segmentation complexity

Overall, the critical factors considered in our work can be divided into:

A) Critical factors regarding foreground characteristics

  • Object textural complexity: The more homogenous are the objects, the higher becomes this factor.

  • Object structure: The less rigid (i.e. different moving parts can be distinguished) are the objects, the higher becomes this factor.

  • Uncovered extent: The more often objects change their visual appearance (as a result of rotation, clothes being taken off and so on), the higher becomes this factor.

  • Object size: The more the area covered by the objects approaches the frame area (i.e. object covers the most of the background), the higher becomes this factor.

  • Largest velocity difference: The larger is the difference in velocity between the slowest and the fastest object, the higher becomes this factor.

  • Complex interactions: The more common are object intersecting trajectories or split and merge processes, the higher becomes this factor.

B) Critical factors regarding background or final scene characteristics

  • Foreground apparent velocity: The more different is object velocity respect to camera velocity (thus entailing too fast or too slow object velocities being perceived), the higher is this factor.

  • Background textural complexity: The more homogenous is the background area, the higher becomes this factor.

  • Background multimodality: The more multimodal the backgroun is (i.e., involving dynamic changes), the higher becomes this factor.

  • Camera motion scheme: The less uniform is camera motion, the higher is this factor: static cameras are considered low complexity, uniform moving cameras medium complexity and high complexity is related to jerky cameras.