People Detection benchmark repository

Evaluation procedure


In order to have your method reported in the "Results" section, please follow these steps:

  • Download videos to your computer from the Change Detection dataset 2012 page here.

  • Run your algorithm on each video and put the resulting detection results in the "results" folder (there must be 1 plain text file each video). Only one set of tuning parameters should be used for all videos. The zipped "results" folder must contain the results for every video sequence of one (or more) category. Each video must include all the processed frames, from in000001.png to the last frame. The results must follow the following format, ex: ACF Caltech office sequence results:

"path/office/in000001.jpg"; (x_detection1, y_detection1, w_detection1, h_detection1):score_detection1, (x_detection2, y_detection2, w_detection2, h_detection2):score_detection2, ................, (x_detectionN, y_detectionN, w_detectionN, h_detectionN):score_detectionN;

"path/office/in000002.jpg"; (x_detection1, y_detection1, w_detection1, h_detection1):score_detection1, (x_detection2, y_detection2, w_detection2, h_detection2):score_detection2, ................, (x_detectionN, y_detectionN, w_detectionN, h_detectionN):score_detectionN;

......

"path/office/in002050.jpg"; (x_detection1, y_detection1, w_detection1, h_detection1):score_detection1, (x_detection2, y_detection2, w_detection2, h_detection2):score_detection2, ................, (x_detectionN, y_detectionN, w_detectionN, h_detectionN):score_detectionN;

  • When ready to submit results, zip the "results" folder and upload it below. Note: We only support zip files (rar, gzip, gz, 7z or other compression formats are not supported). The results folder MUST have the following structure results.zip. Please don't put other folders in the zip file! The name of your resulting files must comply to the following standard : "videoname.idl", ex: "office.idl", "pedestrians.idl", etc.

  • Send an e-mail to pdbm-l@uam.es with the subject "PDbm evaluation submission", indicating your contact information (Name, email, University or Company, etc), method description (Name, parameters, processing time, etc). If you have any question, please contact us.