DDOT Data Warehouse
Description
Development of a data warehouse to collect mulitmodal transporation information.
Status
Planned
Timeframe
Medium
Geographic Scope
Service Scope
Stakeholders
DDOT Infrastructure Project Management Administration
DDOT Policy, Planning and Sustainability Administration
DDOT Progressive Transportation Services Administration
DDOT Transportation Operations Administration
DDOT Urban Forestry Administration
DDPW - District Department of Public Works
HSEMA - Homeland Security Emergency Management Agency
Inventory
DDOT Infrastructure Project Management Administration
DDOT On-Street Parking Equipment
DDOT Street and Bridge Maintenance
DDOT Traffic Services Field Maintenance
Services
AD2-1 - ITS Data Warehouse - DDOT Data Warehouse
AD2-2 - ITS Data Warehouse - This market package includes all the data collection and management capabilities provided by the ITS Data Mart, and adds the functionality and interface definitions that allow collection of data from multiple agencies and data sources spanning across moda
Functional Areas
- The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The center shall be able to produce sample products of the data available.
- The center shall collect emergency service data, emergency vehicle management data, emergency vehicle data, sensor and surveillance data, threat data, and incident data.
- The center shall receive and respond to requests from ITS Archives for either a catalog of the emergency management data or for the data itself.
Government Reporting Systems Support
- The center shall provide data from an ITS archive to federal, state, or local government reporting systems.
- The center shall provide the applicable meta-data for any ITS archived data to satisfy government reporting system requests. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection o
- The center shall provide the capability to format data from an ITS archive suitable for input into government reports.
- The center shall provide the capability to select data from an ITS archive for use in government reports.
- The center shall support requests for ITS archived data from Government Reporting Systems.
- The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The center shall be able to produce sample products of the data available.
- The center shall collect traveler information data, such as parking lot data, rideshare data, road network use data, vehicle probe data, and other data from traveler information system operations.
- The center shall collect traveler requests, confirmations, and payment transaction data for traveler services provided.
- The center shall receive and respond to requests from ITS Archives for either a catalog of the traveler information data or for the data itself.
- For archive data requiring financial payment, the center shall process the financial requests and manage an interface to a Financial Institution.
- The center shall collect data to be archived from one or more data sources.
- The center shall include capabilities for archive to archive coordination.
- The center shall include capabilities for error notification on the incoming archived data.
- The center shall include capabilities for performing quality checks on the incoming archived data.
- The center shall perform quality checks on received data.
- The center shall provide the capability to execute methods on the incoming data such as cleansing, summarizations, aggregations, or transformations applied to the data before it is stored in the archive.
- The center shall respond to requests from the administrator interface function to maintain the archive data.
- The center shall store the archived data in a focused repository that is suited to a particular set of ITS data users.
- The center shall support a broad range of archived data management implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large-scale data warehouses that collect, integrate, and summari
- When data or a catalog of data is received from the archive, the center shall generate the requested data product for the users systems.
- The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The center shall be able to produce sample products of the data available.
- The center shall collect maintenance and construction data (such as field equipment status, infrastructure status, maintenance and construction activity data) gathered from roadway, traffic, and other maintenance and construction sources.
- The center shall provide data to Asset Management to be used in updating the status of assets in the inventory.
- The center shall receive and respond to requests from ITS Archives for either a catalog of the maintenance and construction data or for the data itself.
- For archive analysis and data mining products requiring financial payment the center shall process the financial requests and manage an interface to a Financial Institution.
- The center shall provide the capability to perform activities such as data mining, data fusion, summarizations, aggregations, and recreation from archive data. This may include multidimensional analysis, selective summarization and expansion of data deta
- The center shall receive the user’s systems requests and develop the request to retrieve the data from the archive.
- The center shall respond to users systems requests for a catalog of the archived data analysis products available.
- The center shall support the interface with Archive Data User Systems for requests for analysis of the archive data.
- The parking element shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The parking element shall be able to produce sample products of the data available.
- The parking element shall collect parking management data including lot usage and charging information.
- The parking element shall receive and respond to requests from ITS Archives for either a catalog of the parking management data or for the data itself.
- The field element shall collect sensor status and sensor faults from roadside equipment and send it along with the recorded data to a center for archival.
- The field element shall collect traffic, road, and environmental conditions information.
- The field element shall include the sensors and supporting roadside devices that sense, collect, and send traffic, road, and environmental conditions information to a center for archival.
Traffic and Roadside Data Archival
- The center shall collect environmental sensor information that from roadside devices.
- The center shall collect traffic sensor information from roadside devices.
- The center shall manage the collection of archive data directly from collection equipment located at the roadside.
- The center shall record the status about the imported traffic and roadside data.
- The center shall respond to requests from the Archive Data Administer to input the parameters that control the collection process.
- The center shall send the request for data and control parameters to the field equipment where the information is collected and returned.
- The center shall use the status information to adjust the collection of traffic and roadside data.
- The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The center shall be able to produce sample products of the data available.
- The center shall collect traffic management data such as operational data, event logs, etc.
- The center shall receive and respond to requests from ITS Archives for either a catalog of the traffic data or for the data itself.
- The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
- The center shall be able to produce sample products of the data available.
- The center shall collect transit management data such as transit fares and passenger use, transit services, paratransit operations, transit vehicle maintenance data, etc.
- The center shall receive and respond to requests from ITS Archives for either a catalog of the transit data or for the data itself.
Interfaces
Standards
| SDO | Document ID | Title | Type |
|---|---|---|---|
| AASHTO/ITE/NEMA | View List | NTCIP Center-to-Center Standards Group | Group |
| AASHTO/ITE/NEMA | View List | NTCIP Center-to-Field Standards Group | Group |
| SAE | View List | Advanced Traveler Information Systems (ATIS) General Use Standards Group | Group |
| AASHTO/ITE | ITE TMDD | Traffic Management Data Dictionary (TMDD) and Message Sets for External Traffic Management Center Communications (MS/ETMCC) | Message/Data |
| AASHTO/ITE/NEMA | NTCIP 1201 | Global Object Definitions | Message/Data |
| AASHTO/ITE/NEMA | NTCIP 1204 | Object Definitions for Environmental Sensor Stations (ESS) | Message/Data |
| AASHTO/ITE/NEMA | NTCIP 1206 | Object Definitions for Data Collection and Monitoring (DCM) Devices | Message/Data |
| AASHTO/ITE/NEMA | NTCIP 1209 | Data Element Definitions for Transportation Sensor Systems (TSS) | Message/Data |
| ASTM | ASTM E2468-05 | Standard Practice for Metadata to Support Archived Data Management Systems | Other |
| ASTM | ASTM E2665-08 | Standard Specifications for Archiving ITS-Generated Traffic Monitoring Data | Message/Data |
Operational Concepts
| Stakeholder | Roles and Responsibilities |
|---|