WP1: Infrastructure and datasets

This work package aims at the initial establishment and maintenance of a development framework for the remaining work packages.

T1.1: Infrastructure update and maintenance (M1-M16)

Arrangement and configuration of the available equipment, and the acquisition of complementary equipment, for establishing the necessary infrastructure to meet the objectives of the project (storage, communication, and computing infrastructures).

T1.2: Design and generation of datasets (M5-M20)

Support to other tasks for generating test data and defining evaluation methodologies. It includes the selection of appropriate datasets (sequences and associated ground-truth from the state-of-the-art) and their generation (required nuew dataset geopositioned), as well as the research, selection, and proposal of evaluation metrics and benchmarks.

Milestones:

• M1.1 Acquisition of required hardware for WP2 and WP3 (T1.1, M6)
• M1.2 Generation of datasets for WP2 (T1.2, M12)
• M1.3 Update of required hardware for WP2 (T1.1, M16)
• M1.2 Generation of datasets for case studies in T3.3 (T1.2, M20)

Deliverables:

• D1.1 System infrastructure (M12 and updates every 8 months if required)
• D1.2 Evaluation frameworks: datasets, metrics, and benchmarks (M12 and updates every 8 months if required)

WP.2: Street elements catalogue technologies

To develop the necessary technology to automatize the generation and update of a street elements catalogue using Computer Vision. This workpackage makes use of the dataset generated in WP1.

T2.1: Urban elements localization (M1-M24)

To explore strategies to localize the street elements in urban scenarios. In this direction, we propose to use a geopositioned video camera in conjunction with computer vision object detection algorithms.

T2.2: Urban elements re-identification (M1-M24)

To develop mechanisms to maintain updated the street elements catalogue over time. In this direction, we propose: (1) exploring different visual representations, classification, or higher semantic abstractions of the urban elements in order to enrich the generation and completeness of the street elements catalogue; (2) exploring computer vision based object re-identification alternatives.

T2.3: Incremental/Continual learning (M1-M24)

To explore strategies to adapt continuously to new additional elements, both new instances of elements already presented in the catalogue and completely new categories. In this direction, we propose three different continual lifelong learning alternatives: incremental domain learning, incremental class learning and incremental task learning.

Milestones:

• M2.1 First version of urban elements localization algorithms (T2.1, M12)
• M2.2 First version of urban elements re-identification algorithms (T2.2, M12)
• M2.3 First version of incremental/continual learning algorithms (T2.3 M12)
• M2.5 Final version of urban elements localization algorithms (T2.1, M24)
• M2.6 Final version of urban elements re-identification algorithms (T2.2, M24)
• M2.7 Final version incremental/continual learning algorithms (T2.3, M24)

Deliverables:

• D2 Technologies for low availability of annotated data (M12 and M24)

WP.3: Management, dissemination and uses cases

To coordinate the project activities, follow-up progress, the dissemination, define the final uses cases (to be defined with the help of the Observing Partner) and develop technology transfer initiatives. This workpackage makes use of the results from WP1 and WP2.

T3.1 Management (M1-M24)

This task has the following activities: monthly follow up of Project progress and achievements, workplan milestones and outcomes deadlines control, workplan updates, corrective actions, and administrative issues.

T3.2 Communication & Dissemination (M1-M24)

This task coordinates the communication of the project advances to the Observing Partner and general public. A web site will include a description of the project, status, advances, and announcements, as well as the periodic information updates (e.g., SEGA-CV Newsletters). In addition, this task also coordinates the compilation and internal publication of intermediate results, in order to have a clear plan for dissemination based on a commitment for bi-monthly reports’ updates that will constitute seeds for publications, as well as the analysis of target journals and conferences for the different works in progress. It will also coordinate the dissemination of results via Research Reports, GitHub software repositories and generated datasets, to be made available at the project’s web page, via links to open repositories. This task also handles the Data Management plan.

T3.3 Use cases and technology transfer (M15-M24)

Using WP2 outcomes, use cases will be defined with the help and recommendations of the Observing Partner (as described in section 4.3). Information meetings will be held with the Observing Partner, open to other companies and interested parties, will be held in the form of Industry Days.

Milestones:

• M3.1 Web page (T3.2, M1)
• M3.2 Initial results and issues for the use cases (T3.4, M16)

Deliverables:

• D3.1 Data management plan (M8)
• D3.2 Results report (M8 and updates every 8 months)

Last update 01/12/2022