ITS Element: DDOT Data Warehouse

Send Your Comments

Description: This element represents a planned data warehouse capability that would archive data from all aspects of DDOT operations.
Status: Planned
Stakeholder: DDOT Policy, Planning and Sustainability Administration
Mapping: Archived Data Management Subsystem
Other Archives

Interfaces:

Archived Data User Systems
Bicycle Parking Management System
DC Data Archive
DDOE Air Quality Division
DDOT Infrastructure Project Management Administration
DDOT On-Street Parking Equipment
DDOT Parking Operations
DDOT PTSA
DDOT SIOD Division
DDOT Street and Bridge Maintenance
DDOT Streetlights Operations
DDOT TMC
DDOT Traffic Count Stations
DDOT Traffic Services Field Maintenance
DDOT Urban Forestry
DPW Dispatch
HSEMA Center
MWCOG TPB Database
RITIS
Market Packages: AD2 - ITS Data Warehouse -
AD2 - ITS Data Warehouse - DDOT Data Warehouse
AD3 - ITS Virtual Data Warehouse - DDOT Data Warehouse
AD3 - ITS Virtual Data Warehouse - RITIS
AD3 - ITS Virtual Data Warehouse - MWCOG
ATMS16 - Parking Facility Management - Bike Stations
ATMS17 - Regional Parking Management - Coordination with DDOT
Functional Requirements:

ITS Data Repository

  • The center shall collect data to be archived from one or more data sources.
  • The center shall collect data catalogs from one or more data sources. A catalog describes the data contained in the collection of archived data and may include descriptions of the schema or structure of the data, a description of the contents of the data; e.g., time range of entries, number of entries; or a sample of the data (e. g. a thumbnail).
  • The center shall store the archived data in a focused repository that is suited to a particular set of ITS data users.
  • The center shall include capabilities for performing quality checks on the incoming archived data.
  • The center shall include capabilities for error notification on the incoming archived data.
  • The center shall include capabilities for archive to archive coordination.
  • The center shall support a broad range of archived data management implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large-scale data warehouses that collect, integrate, and summarize transportation data from multiple sources and serve a broad array of users within a region.
  • The center shall perform quality checks on received data.
  • The center shall provide the capability to execute methods on the incoming data such as cleansing, summarizations, aggregations, or transformations applied to the data before it is stored in the archive.
  • The center shall respond to requests from the administrator interface function to maintain the archive data.
  • When data or a catalog of data is received from the archive, the center shall generate the requested data product for the users systems.
  • For archive data requiring financial payment, the center shall process the financial requests and manage an interface to a Financial Institution.

Government Reporting Systems Support

  • The center shall provide data from an ITS archive to federal, state, or local government reporting systems.
  • The center shall provide the capability to select data from an ITS archive for use in government reports.
  • The center shall provide the capability to format data from an ITS archive suitable for input into government reports.
  • The center shall support requests for ITS archived data from Government Reporting Systems.
  • The center shall provide the applicable meta-data for any ITS archived data to satisfy government reporting system requests. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.

On-Line Analysis and Mining

  • The center shall support the interface with Archive Data User Systems for requests for analysis of the archive data.
  • The center shall provide the capability to perform activities such as data mining, data fusion, summarizations, aggregations, and recreation from archive data. This may include multidimensional analysis, selective summarization and expansion of data details, and many other advanced analysis services.
  • The center shall receive the user’s systems requests and develop the request to retrieve the data from the archive.
  • The center shall respond to users systems requests for a catalog of the archived data analysis products available.
  • For archive analysis and data mining products requiring financial payment the center shall process the financial requests and manage an interface to a Financial Institution.

Virtual Data Warehouse Services

  • The center shall provide capabilities to access "in-place" data from geographically dispersed archives. These capabilities may include analysis, data fusion, or data mining.
  • The center shall coordinate information exchange with a local data warehouse.
  • The center shall provide the specialized publishing, directory services, and transaction management functions associated with coordinating remote archives.
  • The center shall support the collection of archived data from other archives on an as-needed basis. (This minimizes the need to duplicate the comprehensive set of data from the remote archives in the local data warehouse.)
  • The center shall use data collected from different archives to build a set of global schema including the data archive definitions for the local archive plus any archives known to the local archive.
  • The center shall provide the local archived data schema to other archive systems.

Traffic and Roadside Data Archival

  • The center shall manage the collection of archive data directly from collection equipment located at the roadside.
  • The center shall collect traffic sensor information from roadside devices.
  • The center shall collect environmental sensor information that from roadside devices.
  • The center shall respond to requests from the Archive Data Administer to input the parameters that control the collection process.
  • The center shall send the request for data and control parameters to the field equipment where the information is collected and returned.
  • The center shall record the status about the imported traffic and roadside data.
  • The center shall use the status information to adjust the collection of traffic and roadside data.

Last updated: 06-10-11