Mohawk Valley Regional ITS Architecture

Archive Warehouse

Send Your Comments

Description

Project to develop a transportation data archive warehouse for the region.

Status

Planned

Timeframe

Medium Term

Geographic Scope

Mohawk Valley

Service Scope

Stakeholders

HOCTS

Inventory

Archived Data User Systems

CENTRO Transit Operations Center

Government Reporting Systems

HOCTS MPO Data Collection and Reporting System

Local Transit Operators Systems

NYSDOT Region 2 TOC

NYSDOT Statewide Transportation Information Coordination Center (STICC)

NYSDOT Traffic Count Stations

Services

AD2-3 - ITS Data Warehouse - MPO

Functional Areas

Government Reporting Systems Support

• The center shall provide data from an ITS archive to federal, state, or local government reporting systems.
• The center shall provide the applicable meta-data for any ITS archived data to satisfy government reporting system requests. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection o
• The center shall provide the capability to format data from an ITS archive suitable for input into government reports.
• The center shall provide the capability to select data from an ITS archive for use in government reports.
• The center shall support requests for ITS archived data from Government Reporting Systems.

ITS Data Repository

• For archive data requiring financial payment, the center shall process the financial requests and manage an interface to a Financial Institution.
• The center shall collect data catalogs from one or more data sources. A catalog describes the data contained in the collection of archived data and may include descriptions of the schema or structure of the data, a description of the contents of the data
• The center shall collect data to be archived from one or more data sources.
• The center shall include capabilities for archive to archive coordination.
• The center shall include capabilities for error notification on the incoming archived data.
• The center shall include capabilities for performing quality checks on the incoming archived data.
• The center shall perform quality checks on received data.
• The center shall provide the capability to execute methods on the incoming data such as cleansing, summarizations, aggregations, or transformations applied to the data before it is stored in the archive.
• The center shall respond to requests from the administrator interface function to maintain the archive data.
• The center shall store the archived data in a focused repository that is suited to a particular set of ITS data users.
• The center shall support a broad range of archived data management implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large-scale data warehouses that collect, integrate, and summari
• When data or a catalog of data is received from the archive, the center shall generate the requested data product for the users systems.

On-Line Analysis and Mining

• For archive analysis and data mining products requiring financial payment the center shall process the financial requests and manage an interface to a Financial Institution.
• The center shall provide the capability to perform activities such as data mining, data fusion, summarizations, aggregations, and recreation from archive data. This may include multidimensional analysis, selective summarization and expansion of data deta
• The center shall receive the user’s systems requests and develop the request to retrieve the data from the archive.
• The center shall respond to users systems requests for a catalog of the archived data analysis products available.
• The center shall support the interface with Archive Data User Systems for requests for analysis of the archive data.

Roadway Data Collection

• The field element shall collect sensor status and sensor faults from roadside equipment and send it along with the recorded data to a center for archival.
• The field element shall collect traffic, road, and environmental conditions information.
• The field element shall include the sensors and supporting roadside devices that sense, collect, and send traffic, road, and environmental conditions information to a center for archival.

Traffic and Roadside Data Archival

• The center shall collect environmental sensor information that from roadside devices.
• The center shall collect traffic sensor information from roadside devices.
• The center shall manage the collection of archive data directly from collection equipment located at the roadside.
• The center shall record the status about the imported traffic and roadside data.
• The center shall respond to requests from the Archive Data Administer to input the parameters that control the collection process.
• The center shall send the request for data and control parameters to the field equipment where the information is collected and returned.
• The center shall use the status information to adjust the collection of traffic and roadside data.

Traffic Data Collection

• The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
• The center shall be able to produce sample products of the data available.
• The center shall collect traffic management data such as operational data, event logs, etc.
• The center shall receive and respond to requests from ITS Archives for either a catalog of the traffic data or for the data itself.

Transit Data Collection

• The center shall assign quality control metrics and meta-data to be stored along with the data. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.
• The center shall be able to produce sample products of the data available.
• The center shall collect transit management data such as transit fares and passenger use, transit services, paratransit operations, transit vehicle maintenance data, etc.
• The center shall receive and respond to requests from ITS Archives for either a catalog of the transit data or for the data itself.

Interfaces

Source	Architecture Flows	Destination
Archived Data User Systems	archived data product requests	HOCTS MPO Data Collection and Reporting System
CENTRO Transit Operations Center	transit archive data	HOCTS MPO Data Collection and Reporting System
Government Reporting Systems	government reporting data receipt	HOCTS MPO Data Collection and Reporting System
HOCTS MPO Data Collection and Reporting System	archived data products	Archived Data User Systems
HOCTS MPO Data Collection and Reporting System	archive requests	CENTRO Transit Operations Center
HOCTS MPO Data Collection and Reporting System	archive status	CENTRO Transit Operations Center
HOCTS MPO Data Collection and Reporting System	government reporting system data	Government Reporting Systems
HOCTS MPO Data Collection and Reporting System	archive requests	Local Transit Operators Systems
HOCTS MPO Data Collection and Reporting System	archive status	Local Transit Operators Systems
HOCTS MPO Data Collection and Reporting System	archive requests	NYSDOT Region 2 TOC
HOCTS MPO Data Collection and Reporting System	archive status	NYSDOT Region 2 TOC
HOCTS MPO Data Collection and Reporting System	archive requests	NYSDOT Statewide Transportation Information Coordination Center (STICC)
HOCTS MPO Data Collection and Reporting System	archive status	NYSDOT Statewide Transportation Information Coordination Center (STICC)
Local Transit Operators Systems	transit archive data	HOCTS MPO Data Collection and Reporting System
NYSDOT Region 2 TOC	transit archive data	HOCTS MPO Data Collection and Reporting System
NYSDOT Statewide Transportation Information Coordination Center (STICC)	transit archive data	HOCTS MPO Data Collection and Reporting System
NYSDOT Traffic Count Stations	roadside archive data	HOCTS MPO Data Collection and Reporting System

Standards

SDO	Document ID	Title	Type
AASHTO/ITE/NEMA	View List	NTCIP Center-to-Center Standards Group	Group
AASHTO/ITE/NEMA	View List	NTCIP Center-to-Field Standards Group	Group
AASHTO/ITE	ITE TMDD	Traffic Management Data Dictionary (TMDD) and Message Sets for External Traffic Management Center Communications (MS/ETMCC)	Message/Data
AASHTO/ITE/NEMA	NTCIP 1201	Global Object Definitions	Message/Data
AASHTO/ITE/NEMA	NTCIP 1204	Object Definitions for Environmental Sensor Stations (ESS)	Message/Data
AASHTO/ITE/NEMA	NTCIP 1206	Object Definitions for Data Collection and Monitoring (DCM) Devices	Message/Data
AASHTO/ITE/NEMA	NTCIP 1209	Data Element Definitions for Transportation Sensor Systems (TSS)	Message/Data
ASTM	ASTM E2468-05	Standard Practice for Metadata to Support Archived Data Management Systems	Other
ASTM	ASTM WK7604	Standard Specifications for Archiving ITS-Generated Traffic Monitoring Data	Message/Data

Operational Concepts

Stakeholder	Roles and Responsibilities
HOCTS
	Collect and archive traffic information from traffic sensors, including traffic volumes, speeds and occupancy.
	Collect and archive transit information, such as transit fare information, passenger information, transit services, transit vehicle maintenance data, etc.