Difference between revisions of "Datasets"

From RoCKIn Wiki
Jump to: navigation, search
 
Line 1: Line 1:
[[File:Optitrack-Peccioli01.jpg|thumb|Part of the 12-camera motion capture (MoCap) system used at the [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/camp2015.php RoCKIn Camp 2015]]]
+
[[File:Optitrack-Peccioli01.jpg|thumb|Part of the 12-camera motion capture (MoCap) system used at the [http://rockinrobotchallenge.eu/camp2015.php RoCKIn Camp 2015]]]
One of the key elements of RoCKIn is [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/benchmarking.php benchmarking].
+
One of the key elements of RoCKIn is [http://rockinrobotchallenge.eu/benchmarking.php benchmarking].
  
 
During RoCKIn competitions and events, several datasets have been collected to be redistributed to the Robotics community for further analysis and understanding about the task level and functional level performance of robotics systems.
 
During RoCKIn competitions and events, several datasets have been collected to be redistributed to the Robotics community for further analysis and understanding about the task level and functional level performance of robotics systems.
  
 
==Motion capture logs==
 
==Motion capture logs==
[[File:Optitrack-Toulouse.jpg|thumb|The 6-camera MoCap system used for the FBM1 at [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2014.php RoCKIn Competition 2014]. Below the cameras, the table and the objects used for the benchmark.]]
+
[[File:Optitrack-Toulouse.jpg|thumb|The 6-camera MoCap system used for the FBM1 at [http://rockinrobotchallenge.eu/rockin2014.php RoCKIn Competition 2014]. Below the cameras, the table and the objects used for the benchmark.]]
[[File:Optitrack-Peccioli02.jpg|thumb|Another view of the MoCap system of [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/camp2015.php Camp 2015].]]
+
[[File:Optitrack-Peccioli02.jpg|thumb|Another view of the MoCap system of [http://rockinrobotchallenge.eu/camp2015.php Camp 2015].]]
[[File:Toulouse-PCs.jpg|thumb|Some of the computers used to produce, collect, process and log MoCap data at the [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2014.php 2014 Competition].]]
+
[[File:Toulouse-PCs.jpg|thumb|Some of the computers used to produce, collect, process and log MoCap data at the [http://rockinrobotchallenge.eu/rockin2014.php 2014 Competition].]]
  
 
Motion capture (MoCap) logs comprise very accurate ground truth pose data, generated with a specialized system. These data should be especially useful to the teams who participated to the RoCKIn Competitions. In fact, they allow the teams to check their robot's own pose estimate against the ground truth, which should lead to a better understanding of the performance of the robot and make possible improvements easier.
 
Motion capture (MoCap) logs comprise very accurate ground truth pose data, generated with a specialized system. These data should be especially useful to the teams who participated to the RoCKIn Competitions. In fact, they allow the teams to check their robot's own pose estimate against the ground truth, which should lead to a better understanding of the performance of the robot and make possible improvements easier.
Line 13: Line 13:
 
In a nutshell, the RoCKIn MoCap system includes one or more commercial MoCap rigs and a customized interface towards ROS. Each MoCap rig is composed of several specialized infrared cameras and a proprietary software package. The ROS interface collects the data streamed by the MoCap rigs, extracts pose data and publishes them as messages on ROS topics. Finally, these messages are recorded in bagfiles for subsequent analysis and distribution. For simplicity of management, every hour the current bagfile is closed and a new one is started: therefore each logfile covers a hour-long period of time (or less).
 
In a nutshell, the RoCKIn MoCap system includes one or more commercial MoCap rigs and a customized interface towards ROS. Each MoCap rig is composed of several specialized infrared cameras and a proprietary software package. The ROS interface collects the data streamed by the MoCap rigs, extracts pose data and publishes them as messages on ROS topics. Finally, these messages are recorded in bagfiles for subsequent analysis and distribution. For simplicity of management, every hour the current bagfile is closed and a new one is started: therefore each logfile covers a hour-long period of time (or less).
  
More information about the RoCKIn MoCap setup is provided by [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin_d2.1.7.pdf Deliverable D2.1.7].
+
More information about the RoCKIn MoCap setup is provided by [http://rockinrobotchallenge.eu/rockin_d2.1.7.pdf Deliverable D2.1.7].
  
 
===Toulouse 2014===
 
===Toulouse 2014===
  
The [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2014.php RoCKIn Competition 2014] took place in Toulouse (France). The RoCKIn MoCap system at Toulouse comprised three separate rigs: one for the RoCKIn@Home TBM testbed, one for the RoCKIn@Work TBM testbed, and one for the area dedicated to FBM1, which was used for both @Home and @Work.
+
The [http://rockinrobotchallenge.eu/rockin2014.php RoCKIn Competition 2014] took place in Toulouse (France). The RoCKIn MoCap system at Toulouse comprised three separate rigs: one for the RoCKIn@Home TBM testbed, one for the RoCKIn@Work TBM testbed, and one for the area dedicated to FBM1, which was used for both @Home and @Work.
  
 
Here are the links to the datasets collected at Toulouse:
 
Here are the links to the datasets collected at Toulouse:
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/GT@Home/ RoCKIn@Home ground truth logs]
+
* [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/GT@Home/ RoCKIn@Home ground truth logs]
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/GT@Work/ RoCKIn@Work ground truth logs]
+
* [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/GT@Work/ RoCKIn@Work ground truth logs]
  
 
===Peccioli 2015===
 
===Peccioli 2015===
  
[http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/camp2015.php RoCKIn Camp 2015] was held in Peccioli (Tuscany region, Italy). In Peccioli, the RoCKIn MoCap system was composed of a single rig, used for both RoCKIn@Home and the Functionality Benchmarks (which took place in the @Home testbed).
+
[http://rockinrobotchallenge.eu/camp2015.php RoCKIn Camp 2015] was held in Peccioli (Tuscany region, Italy). In Peccioli, the RoCKIn MoCap system was composed of a single rig, used for both RoCKIn@Home and the Functionality Benchmarks (which took place in the @Home testbed).
  
 
These are the links to the datasets collected at Peccioli:
 
These are the links to the datasets collected at Peccioli:
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/GT@Home RoCKIn@Home ground truth logs]
+
* [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/GT@Home RoCKIn@Home ground truth logs]
  
 
===Lisbon 2015===
 
===Lisbon 2015===
  
The [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2015.php RoCKIn Competition 2015] took place in Lisbon (Portugal). The RoCKIn MoCap system at Lisbon comprised two separate rigs: one for the RoCKIn@Home TBMs and FBMs, one for the RoCKIn@Work TBMs and FBMs.
+
The [http://rockinrobotchallenge.eu/rockin2015.php RoCKIn Competition 2015] took place in Lisbon (Portugal). The RoCKIn MoCap system at Lisbon comprised two separate rigs: one for the RoCKIn@Home TBMs and FBMs, one for the RoCKIn@Work TBMs and FBMs.
  
 
Here are the links to MoCap datasets collected at Lisbon:
 
Here are the links to MoCap datasets collected at Lisbon:
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/GT@Home RoCKIn@Home ground truth logs]
+
* [http://rockinrobotchallenge.eu/uploads/GT@Home RoCKIn@Home ground truth logs]
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/GT@Work RoCKIn@Work ground truth logs]
+
* [http://rockinrobotchallenge.eu/uploads/GT@Work RoCKIn@Work ground truth logs]
  
 
Datasets have been collected from the robots while executing the benchmarks in the form of bag files:
 
Datasets have been collected from the robots while executing the benchmarks in the form of bag files:
 
* RoCKIn@Home robot logs
 
* RoCKIn@Home robot logs
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Home/TBM1 RoCKIn@Home TBM1 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Home/TBM1 RoCKIn@Home TBM1 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Home/TBM2 RoCKIn@Home TBM2 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Home/TBM2 RoCKIn@Home TBM2 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Home/TBM3 RoCKIn@Home TBM3 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Home/TBM3 RoCKIn@Home TBM3 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Home/FBM1 RoCKIn@Home FBM1 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Home/FBM1 RoCKIn@Home FBM1 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Home/FBM2 RoCKIn@Home FBM2 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Home/FBM2 RoCKIn@Home FBM2 robot logs]
 
* RoCKIn@Work robot logs
 
* RoCKIn@Work robot logs
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/TBM1 RoCKIn@Work TBM1 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/TBM1 RoCKIn@Work TBM1 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/TBM2 RoCKIn@Work TBM2 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/TBM2 RoCKIn@Work TBM2 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/TBM3 RoCKIn@Work TBM3 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/TBM3 RoCKIn@Work TBM3 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/FBM1 RoCKIn@Work FBM1 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/FBM1 RoCKIn@Work FBM1 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/FBM2 RoCKIn@Work FBM2 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/FBM2 RoCKIn@Work FBM2 robot logs]
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Robot@Work/FBM3 RoCKIn@Work FBM3 robot logs]
+
** [http://rockinrobotchallenge.eu/uploads/Robot@Work/FBM3 RoCKIn@Work FBM3 robot logs]
  
 
For the association of MoCap bags, Ground Truth, and the corresponding Robot bags please refer to the following files.
 
For the association of MoCap bags, Ground Truth, and the corresponding Robot bags please refer to the following files.
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Associations/bags_overlaps_tbmh.txt RoCKIn@Home TBM associations]
+
* [http://rockinrobotchallenge.eu/uploads/Associations/bags_overlaps_tbmh.txt RoCKIn@Home TBM associations]
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Associations/bags_overlaps_fbmh.txt RoCKIn@Home FBM associations]
+
* [http://rockinrobotchallenge.eu/uploads/Associations/bags_overlaps_fbmh.txt RoCKIn@Home FBM associations]
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Associations/bags_overlaps_tbmw.txt RoCKIn@Work TBM associations]
+
* [http://rockinrobotchallenge.eu/uploads/Associations/bags_overlaps_tbmw.txt RoCKIn@Work TBM associations]
* [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/uploads/Associations/bags_overlaps_fbmw.txt RoCKIn@Work FBM associations]
+
* [http://rockinrobotchallenge.eu/uploads/Associations/bags_overlaps_fbmw.txt RoCKIn@Work FBM associations]
  
 
==Functional Benchmarks data==
 
==Functional Benchmarks data==
Line 68: Line 68:
  
 
* '''Toulouse 2014''': dataset collected during RoCKIn 2014 competition in Toulouse
 
* '''Toulouse 2014''': dataset collected during RoCKIn 2014 competition in Toulouse
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_01.zip fbmh1_dataset_01]: complete dataset extracted from the Homer team bag ''FBMH1_20141129_homer_02.bag''; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_01.zip fbmh1_dataset_01]: complete dataset extracted from the Homer team bag ''FBMH1_20141129_homer_02.bag''; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_02.zip fbmh1_dataset_02]: complete dataset extracted from the Homer team bag ''FBMH1_20141130_homer_04.bag''; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_02.zip fbmh1_dataset_02]: complete dataset extracted from the Homer team bag ''FBMH1_20141130_homer_04.bag''; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_03.zip fbmh1_dataset_03]: dataset extracted from the Homer team bag ''FBMH1_20141129_homer_03.bag''; it contains PCD images, RGB images, RGB camera calibration and depth camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_03.zip fbmh1_dataset_03]: dataset extracted from the Homer team bag ''FBMH1_20141129_homer_03.bag''; it contains PCD images, RGB images, RGB camera calibration and depth camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_04.zip fbmh1_dataset_04]: dataset extracted from the Pumas team logs ''FBMH1_20141128_pumas_01''; it contains GT and RGB images.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_04.zip fbmh1_dataset_04]: dataset extracted from the Pumas team logs ''FBMH1_20141128_pumas_01''; it contains GT and RGB images.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_05.zip fbmh1_dataset_05]: dataset extracted from the Pumas team logs ''FBMH1_20141129_pumas_02''; it contains GT and RGB images.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Toulouse_2014/FBM1H/fbmh1_dataset_05.zip fbmh1_dataset_05]: dataset extracted from the Pumas team logs ''FBMH1_20141129_pumas_02''; it contains GT and RGB images.
  
 
* '''Peccioli 2015''': dataset collected during RoCKIn Camp 2015 held in Peccioli
 
* '''Peccioli 2015''': dataset collected during RoCKIn Camp 2015 held in Peccioli
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_06.zip fbmh1_dataset_06]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212233_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_06.zip fbmh1_dataset_06]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212233_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_07.zip fbmh1_dataset_07]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212301_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_07.zip fbmh1_dataset_07]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212301_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_08.zip fbmh1_dataset_08]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212306_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_08.zip fbmh1_dataset_08]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212306_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_09.zip fbmh1_dataset_09]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212303_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_09.zip fbmh1_dataset_09]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212303_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_10.zip fbmh1_dataset_10]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212253_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_10.zip fbmh1_dataset_10]: dataset extracted from the RoCKIn team bag ''FBMH1_201503212253_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_11.zip fbmh1_dataset_11]: dataset extracted from the RoCKIn team bag ''FBMW1_201503220914_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBM1H/fbmh1_dataset_11.zip fbmh1_dataset_11]: dataset extracted from the RoCKIn team bag ''FBMW1_201503220914_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
  
 
* '''Lisbon 2015''': dataset to be published after the competition ...
 
* '''Lisbon 2015''': dataset to be published after the competition ...
Line 89: Line 89:
  
 
* '''Peccioli 2015''': dataset collected during RoCKIn Camp 2015 held in Peccioli
 
* '''Peccioli 2015''': dataset collected during RoCKIn Camp 2015 held in Peccioli
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBMW1/fbmw1_dataset_01.zip fbmw1_dataset_01]: this is a dataset extracted from the RoCKIn team bag ''FBMW1_201503212338_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBMW1/fbmw1_dataset_01.zip fbmw1_dataset_01]: this is a dataset extracted from the RoCKIn team bag ''FBMW1_201503212338_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
** [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/Peccioli_2015/FBMW1/fbmw1_dataset_02.zip fbmw1_dataset_02]: this is a dataset extracted from the RoCKIn team bag ''FBMW1_201503220001_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
+
** [http://rockinrobotchallenge.eu/pydio/data/files/Peccioli_2015/FBMW1/fbmw1_dataset_02.zip fbmw1_dataset_02]: this is a dataset extracted from the RoCKIn team bag ''FBMW1_201503220001_RoCKIn''; it contains GT, PCD images, RGB images, and RGB camera calibration.
  
 
* '''Lisbon 2015''': dataset to be published after the competition ...
 
* '''Lisbon 2015''': dataset to be published after the competition ...
Line 101: Line 101:
  
 
The dataset has been collected in different moments, both inside the scope of the RoCKIn project (e.g., at the camps and competitions) or outside of it (e.g., at Robocup 2013).  
 
The dataset has been collected in different moments, both inside the scope of the RoCKIn project (e.g., at the camps and competitions) or outside of it (e.g., at Robocup 2013).  
<span style="color:#FF0000">The updated complete dataset can be [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/pydio/data/files/rockin_audiofiles1.2.zip downloaded here]</span>. The .zip file contains four directories, each representing a portion of the dataset. Each directory contains all the audio files, plus two file called ''transcriptions'' and ''interpretations'', where each file name is associated with the corresponding transcription and interpretation repsectively. Moreover, an additional directory called ''xml'' is added to each data set directory. It contains the .xml files with morpho-syntactic analysis and interpretations as defined in the HuRIC data set (see [http://wiki-rockinrobotchallenge.isr.tecnico.ulisboa.pt/index.php?title=FBM3_-_%E2%80%9CSpeech_Understanding%E2%80%9D the Rockin Wiki here] for further information).
+
<span style="color:#FF0000">The updated complete dataset can be [http://rockinrobotchallenge.eu/pydio/data/files/rockin_audiofiles1.2.zip downloaded here]</span>. The .zip file contains four directories, each representing a portion of the dataset. Each directory contains all the audio files, plus two file called ''transcriptions'' and ''interpretations'', where each file name is associated with the corresponding transcription and interpretation repsectively. Moreover, an additional directory called ''xml'' is added to each data set directory. It contains the .xml files with morpho-syntactic analysis and interpretations as defined in the HuRIC data set (see [http://thewiki.rockinrobotchallenge.eu/index.php?title=FBM3_-_%E2%80%9CSpeech_Understanding%E2%80%9D the Rockin Wiki here] for further information).
  
* The '''Robocup''' directory contains the audio files that have been gathered during the Robocup 2013 in Eindhoven. Such dataset has been provided to the participants in the  [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2014.php RoCKIn@Home Competition 2014] as a benchmarking resource to train and test the systems for the Functional Benchmark #3.
+
* The '''Robocup''' directory contains the audio files that have been gathered during the Robocup 2013 in Eindhoven. Such dataset has been provided to the participants in the  [http://rockinrobotchallenge.eu/rockin2014.php RoCKIn@Home Competition 2014] as a benchmarking resource to train and test the systems for the Functional Benchmark #3.
* The '''Rockin1''' directory contains the audio files that have been recorded to be used for the Functional Benchmark #3 of the [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/rockin2014.php RoCKIn@Home Competition 2014].
+
* The '''Rockin1''' directory contains the audio files that have been recorded to be used for the Functional Benchmark #3 of the [http://rockinrobotchallenge.eu/rockin2014.php RoCKIn@Home Competition 2014].
* The '''Rockin2''' directory contains audio files that have been collected during the [http://rockinrobotchallenge.isr.tecnico.ulisboa.pt/camp2015.php RoCKIn Camp 2015], with simluated interactions between users and robots in the "Casa Domotica" environment at the [http://www.echord.eu/facilities-rifs/the-peccioli-rif/ Service Robotics and Ambient Assisted Living Lab] in Peccioli (Italy).
+
* The '''Rockin2''' directory contains audio files that have been collected during the [http://rockinrobotchallenge.eu/camp2015.php RoCKIn Camp 2015], with simluated interactions between users and robots in the "Casa Domotica" environment at the [http://www.echord.eu/facilities-rifs/the-peccioli-rif/ Service Robotics and Ambient Assisted Living Lab] in Peccioli (Italy).
 
* The '''Rockin2014_Toulouse''' directory contains the audio files that have been recorded by the microphone systems of the robots participating in the FBM3, during the live part of the benchmark. Some humans uttered a list of commands, reproduced with a loud speaker. Robots had to use their microphones to capture the audio and to analyse it.
 
* The '''Rockin2014_Toulouse''' directory contains the audio files that have been recorded by the microphone systems of the robots participating in the FBM3, during the live part of the benchmark. Some humans uttered a list of commands, reproduced with a loud speaker. Robots had to use their microphones to capture the audio and to analyse it.

Latest revision as of 11:13, 22 December 2016

Part of the 12-camera motion capture (MoCap) system used at the RoCKIn Camp 2015

One of the key elements of RoCKIn is benchmarking.

During RoCKIn competitions and events, several datasets have been collected to be redistributed to the Robotics community for further analysis and understanding about the task level and functional level performance of robotics systems.

Motion capture logs

The 6-camera MoCap system used for the FBM1 at RoCKIn Competition 2014. Below the cameras, the table and the objects used for the benchmark.
Another view of the MoCap system of Camp 2015.
Some of the computers used to produce, collect, process and log MoCap data at the 2014 Competition.

Motion capture (MoCap) logs comprise very accurate ground truth pose data, generated with a specialized system. These data should be especially useful to the teams who participated to the RoCKIn Competitions. In fact, they allow the teams to check their robot's own pose estimate against the ground truth, which should lead to a better understanding of the performance of the robot and make possible improvements easier.

In a nutshell, the RoCKIn MoCap system includes one or more commercial MoCap rigs and a customized interface towards ROS. Each MoCap rig is composed of several specialized infrared cameras and a proprietary software package. The ROS interface collects the data streamed by the MoCap rigs, extracts pose data and publishes them as messages on ROS topics. Finally, these messages are recorded in bagfiles for subsequent analysis and distribution. For simplicity of management, every hour the current bagfile is closed and a new one is started: therefore each logfile covers a hour-long period of time (or less).

More information about the RoCKIn MoCap setup is provided by Deliverable D2.1.7.

Toulouse 2014

The RoCKIn Competition 2014 took place in Toulouse (France). The RoCKIn MoCap system at Toulouse comprised three separate rigs: one for the RoCKIn@Home TBM testbed, one for the RoCKIn@Work TBM testbed, and one for the area dedicated to FBM1, which was used for both @Home and @Work.

Here are the links to the datasets collected at Toulouse:

Peccioli 2015

RoCKIn Camp 2015 was held in Peccioli (Tuscany region, Italy). In Peccioli, the RoCKIn MoCap system was composed of a single rig, used for both RoCKIn@Home and the Functionality Benchmarks (which took place in the @Home testbed).

These are the links to the datasets collected at Peccioli:

Lisbon 2015

The RoCKIn Competition 2015 took place in Lisbon (Portugal). The RoCKIn MoCap system at Lisbon comprised two separate rigs: one for the RoCKIn@Home TBMs and FBMs, one for the RoCKIn@Work TBMs and FBMs.

Here are the links to MoCap datasets collected at Lisbon:

Datasets have been collected from the robots while executing the benchmarks in the form of bag files:

For the association of MoCap bags, Ground Truth, and the corresponding Robot bags please refer to the following files.

Functional Benchmarks data

Functional benchmarks, both in RoCKIn@Home and RoCKIn@Work, are used to evaluate specific skills of the robots in a repeatable and controlled manner. To foster research progress in acquiring those skills we share here the data collected from the robots during the different RoCKIn events so to let other teams to prepare and learn from other experiences.

FBM1@Home: Object Perception

The following datasets have been collected for the Object Perception Functional Benchmark during the competition. They have been extracted from the ROS bags collected by the robots and from the logs provided by the teams that have participated to the benchmark.

  • Toulouse 2014: dataset collected during RoCKIn 2014 competition in Toulouse
    • fbmh1_dataset_01: complete dataset extracted from the Homer team bag FBMH1_20141129_homer_02.bag; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
    • fbmh1_dataset_02: complete dataset extracted from the Homer team bag FBMH1_20141130_homer_04.bag; it contains GT, PCD images, RGB images, RGB camera calibration and depth camera calibration.
    • fbmh1_dataset_03: dataset extracted from the Homer team bag FBMH1_20141129_homer_03.bag; it contains PCD images, RGB images, RGB camera calibration and depth camera calibration.
    • fbmh1_dataset_04: dataset extracted from the Pumas team logs FBMH1_20141128_pumas_01; it contains GT and RGB images.
    • fbmh1_dataset_05: dataset extracted from the Pumas team logs FBMH1_20141129_pumas_02; it contains GT and RGB images.
  • Peccioli 2015: dataset collected during RoCKIn Camp 2015 held in Peccioli
    • fbmh1_dataset_06: dataset extracted from the RoCKIn team bag FBMH1_201503212233_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmh1_dataset_07: dataset extracted from the RoCKIn team bag FBMH1_201503212301_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmh1_dataset_08: dataset extracted from the RoCKIn team bag FBMH1_201503212306_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmh1_dataset_09: dataset extracted from the RoCKIn team bag FBMH1_201503212303_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmh1_dataset_10: dataset extracted from the RoCKIn team bag FBMH1_201503212253_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmh1_dataset_11: dataset extracted from the RoCKIn team bag FBMW1_201503220914_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
  • Lisbon 2015: dataset to be published after the competition ...

FBM1@Work: Object Perception

The following datasets have been collected for the Object Perception Functional Benchmark during the RoCKIn eventsThey have been extracted from the ROS bags collected by the robots in the @Home testbed using the RoCKin@Work objects.

  • Peccioli 2015: dataset collected during RoCKIn Camp 2015 held in Peccioli
    • fbmw1_dataset_01: this is a dataset extracted from the RoCKIn team bag FBMW1_201503212338_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
    • fbmw1_dataset_02: this is a dataset extracted from the RoCKIn team bag FBMW1_201503220001_RoCKIn; it contains GT, PCD images, RGB images, and RGB camera calibration.
  • Lisbon 2015: dataset to be published after the competition ...

FBM3@Home: Speech Understanding

The Spoken Language Understanding Dataset is a resource that has been gathered to provide data for the Spoken Language Understanding task, specifically for the Functional Benchmark #3 in the @Home track of the RoCKIn Competitions. It is basically composed by audio files representing possible commands given to a robot in a house servicing scenario. Each audio file is paired with its correct transcription. Moreover, a semantic representation of the action expressed in the command has been also provided, according to the formalism described in the @Home Rulebook. This resources can be thus used for different purposes, ranging from Speech Recognition to Natural Language Processing.

NEW - UPDATED DATA SETS AVAILABLE

The dataset has been collected in different moments, both inside the scope of the RoCKIn project (e.g., at the camps and competitions) or outside of it (e.g., at Robocup 2013). The updated complete dataset can be downloaded here. The .zip file contains four directories, each representing a portion of the dataset. Each directory contains all the audio files, plus two file called transcriptions and interpretations, where each file name is associated with the corresponding transcription and interpretation repsectively. Moreover, an additional directory called xml is added to each data set directory. It contains the .xml files with morpho-syntactic analysis and interpretations as defined in the HuRIC data set (see the Rockin Wiki here for further information).

  • The Robocup directory contains the audio files that have been gathered during the Robocup 2013 in Eindhoven. Such dataset has been provided to the participants in the RoCKIn@Home Competition 2014 as a benchmarking resource to train and test the systems for the Functional Benchmark #3.
  • The Rockin1 directory contains the audio files that have been recorded to be used for the Functional Benchmark #3 of the RoCKIn@Home Competition 2014.
  • The Rockin2 directory contains audio files that have been collected during the RoCKIn Camp 2015, with simluated interactions between users and robots in the "Casa Domotica" environment at the Service Robotics and Ambient Assisted Living Lab in Peccioli (Italy).
  • The Rockin2014_Toulouse directory contains the audio files that have been recorded by the microphone systems of the robots participating in the FBM3, during the live part of the benchmark. Some humans uttered a list of commands, reproduced with a loud speaker. Robots had to use their microphones to capture the audio and to analyse it.