BerlinMOD

BerlinMOD is a benchmark for spatio-temporal database management sytems (STDBMS). It is intended as a tool for both

1. comparing different implementation details of STDBMS, as moving object data types, index structures, and spatio-temporal operators;
2. comparing the performance of different STDBMS.

BerlinMOD primarily measures the performance on queries employing moving point data. Moving point data are sampled from simulated cars driving on the street network of the german capital Berlin in a representative way. The simulation models the behavier of workers commuting between their homes and work places, and additional trips in their leisure time. Normally, the sampled data is mapped to the street network, but it is also possible to disturb the data. In generating the benchmark data, BerlinMOD relies on real spatial data on the roads of the german capital Berlin, imported from the tool bbbike (http://bbbike.de) written by Slaven Rezic, who gave us kind permission to use his data for scientific purposes. The data is generated using not a dedicated data generator program, but a script for the extensible Secondo DBMS. This makes BerlinMOD flexible, as you can easily modify the benchmark to your own needs. Of course it is possible to export the generated data to use it in your favourite DBMS.

We have also generated the benchmark data for different scale factors. The different datasets and their characteristics are given in Table 1, that also provides links to download the data in CSV and ESRI shape file format.

After unzipping one of the files into the secondo/bin/BerlinMOD directory, the file contents can be imported into an open Secondo database by executing the suitable script for CSV or SHAPE.

Another pregenerated BerlinMOD dataset can be downloaded here (8.6 GB). It consists of 750,000 trajectories in geographic coordinates with corresponding street names and elevation data. After unpacking the file into your local secondo/bin directory, you can import the data into an existing Secondo database via the command restore Trips from Trips.

The benchmark uses two different forms of representation for the created movements: the object based (one position history per vehicle, a concatenation of all the vehicle's movements during the observation period) and the trip based approach (one position history per trip and vehicle). For each of these representations, the benchmark provides 17 range-style queries (called BerlinMOD/R), and 9 nearest-neighbours queries (called BerlinMOD/NN). The queries deal with predicates on standard data, but mainly with spatial, temporal, and spatio-temporal predicates.

An article on BerlinMOD has been published 2009 in the VLDB Journal:

The original article is available at Springer Link. You may also download a technical report (revised version) describing BerlinMOD.

This depends on your intentions:

You want to benchmark your system...

Just download the pregenerated BerlinMOD data.

You want to compare your system against Secondo...

Download Secondo, the BerlinMOD base data files and the BerlinMOD script files.

You want to use the generator to create your own data...

Download Secondo, the BerlinMOD script files, and probably the BerlinMOD data files.

The mentioned elements are all available for free download here:

1. For pregenerated BerlinMOD data, see Table 1.
2. A working version of the Secondo 3.X DBMS, e.g. using the Secondo Appliance on a virtual machine
3. The base data files:
   • streets.data
   • homeRegions.data
   • workRegions.data
4. The generator and benchmark scripts for Secondo version 3.0 or
   The generator and benchmark scripts for Secondo version 3.1 and 3.2 or
   The data, generator, and benchmark script for Secondo version 3.4 (includes base data files)
   The data, generator, and benchmark script for Secondo version 4.1 (includes base data files)

You want to benchmark your DBMS or just use the data...

Unpack the downloaded data and import it into your system (the data format description may be useful). You can look up the benchmark queries from one of our articles and translate the queries into your query language.

You want to compare your system against Secondo...

Install Secondo on your test platform. Set up the BerlinMOD data generator to export the data to your preferred data format. Then start the data generator. Import the created data into your system and translate the benchmark queries. You can execute the benchmark object builder and query scripts on the same Secondo system.

You want to use the generator to create your own data...

Install Secondo and read our article to learn about the parameters and input files used. Then you can adapt the data generator to your needs.

After installing Secondo (project website), copy the base data files streets.data, homeRegions.data, workRegions.data to your Secondo binary directory. Extract the generator and benchmark scripts into your Secondo binary directory. You may now set up the data generator according to your wishes. For further details, please confer with our article. Change to your Secondo binary directory and type SecondoTTYNT -i BerlinMOD_DataGenerator.SEC to generate the benchmark data.

You can also create the benchmark data, create all database objects (including indexes) for running the benchmark on the Secondo DBMS and run all benchmark queries by calling: SecondoTTYNT -i BerlinMOD_Complete.SEC
By default, a scale factor of 0.05 is used in these scripts.

Further information and instruction is contained in the script files and within the technical report.

Here, the BerlinMOD data and the BerlinMOD/R query set were used to assess different representation variants for moving object data. The Secondo command scripts used for the experiments are available as a zip archieve. The archieve contains a file ReadMe.txt with further instructions. The scripts transform the BerlinMOD data into several different representation modes, and create the according index structures required within the BerlinMOD/R query scripts. This example may inspire you to use BerlinMOD and Secondo as a test bed for your own experiments in MODB research. There is also a paper discussing 5 example queries from these scripts, and a technical report describing the experiments and their results.

• BerlinMOD/R query scripts.
• BerlinMOD/R query plan discussion.
• Revised Technical Report.

This paper proposes an elegant way to formulate Spatiotemporal Pattern queries. Some experiments were done in order to establish first efficiency results. The BerlinMod data generator was used to create moving object data for 50,0000, 100,000, 200,000, and 300,000 cars over one day used in the tests.

• The article via Springer Link.
• The according Technical Report (revised version).
• A Secondo Plugin with the implementation.
• Instructions on how to repeat the experiments.

BerlinMOD data was used for experiments comparing a new R*-tree index access method supporting k-NN-queries on moving objects with two other methods using the TB-tree index. The BerlinMOD data generator was set up to create the "Cars" test data set: 2,000 cars moving on 1 day.

• The article via Springer Link.
• The according Technical Report.

We would appreciate your comments on BerlinMOD. Please contact us: secondo@fernuni-hagen.de, christian.duentgen@fernuni-hagen.de.

Last modification: 2011-09-20 by Thomas Behr .