ihee ppres0998

Smart and Secure Data Access for

On-Site Highway Maintenance and Construction

Intelligent Cooperative Intelligent Cooperative

Data Acquisition and IdentificationData Acquisition and Identification

Dr. Martin Dudziak

Parikh Advanced Systems, Inc.

September, 1998

04/13/23 Parikh Advanced Systems, Inc. 2

Presentation OutlinePresentation Outline

System and Enterprise Issues

IDEA (Intelligent Data Entry and Acquisition) Architecture

Practical Implementation Scenario


Data Collection and Currency is more than a

Network and Systems Performance Issue


Enterprise-Level Premises and Constraints

Field-based operations and management vs. Centralized control structures

Integration of Computer Technology with Nuts-and-Bolts Technology

Must be oriented to more than the IT-proficient users of the departments and divisions


“I need a hands-free PC for this job”“This is not the belt-pack wearable PC I used last

week but it will do”“This job needs pictures and video and all we have

is this serial-port camera interface”“I’m going to be in the field for all day and need a

longer-life extra battery”“I can’t be bothered with a display panel; where’s

the headset?”

Platform Independence and Versatility


Full-power for computing and communicationDesktop capabilities for not much more $Speech interface that fits EverymanDisplays that fit the task - headset, flat-panel,

flexi-wrapExpandable and modular

Hands-free and Wearable - Why?


Two Exemplary Products

MENTIS

ViA II


Speech, Paper Notes, Sketches, and Vision

Security and Simplicity of the SmartCard

Assisted Intelligence & Intelligent Assistance

3 Areas of Integration and Improvement


Generic Inventory-Oriented Data Collection

Location-Indexed Image/Loc Recs

Van-based Video

Recording

Extra-vehicular Video/StillRecording

Interactive ID/Condition

Resolution System

Maintenance Database Entries


Early Version of IDEA -- Projected IDAAT Work Flow

Field (Mobile) Base Station

Field Collection Units RDBMS DATA SERVER


Projected IDAAT Data Flow (cont.)


GIS, Inventory, Maintenance, Financial, Planning

Databases and Decision Support Systems

Field (Mobile) Collection UnitData Cards


IDAAT Network Overview

IDAATBase Station

Asset Counting Unit (BarCode)

MaintenanceTraining

Workstation

Body-Wearable

PC

Asset Inventory

Unit (PDA)

Asset Counting Unit MagStrip

Reader

Portable GPS Field

Unit

Relational/Object-Oriented

Data Server

CAD/MapPublishing Server

GIS, Spatial, Address Data

Resources

Local/manual connectivity

Pen-based Portable Digital

Notepad

High-speed LAN/WAN (ATM) Network

In the Field

In Regional and Central Offices


Land-Line

IDAAT Base Station Architecture

Pentium Workstation(Desktop Minitower)64 MB RAM, 5 GB disk, CDROM, modem, spare Bays, 2 serial ports)

Dial-Up ModemConnectivity

Direct Network

Wireless

PCMCIA(PC Card)Reader or equivalent

PDA Docking Station or equivalent

Magstrip/Barcode Reader Docking Port

Video Board with Camera Port(s)

Standard PCI/O Ports and Devices

UPS power backup for mobile (vehicle-based) operations


PDA/HPC Connectivity and Data Transfer


Cradle/Docking Station withstandard Synchronization software

Internet or LAN connectivity

PC Card or Docking Station connectivity

PC Card exchange orinternet connectivity


Base Station to Network Connectivity


District network, sharing of incidentand asset status multimedia data

Central data server(s) linkingto IDAAT and other central systemswith GIS and full asset data acquisitiondata sets collected in the field

Financial and accounting system,providing task and timekeeping data


Intelligent Data Entry and Acquisition (IDEA)

Asset-Targeted Image/Loc recs

Van-based Recording Extra-vehicular

Recording

AutomatedAsset ID and

Condition Assessment

Interactive ID/Condition

Resolution

IDAAT Database Entry

Rejections

Acceptances

Resolutions


IDEA System Architecture and Interfaces

GPSTracking

Body-wearable

PC

LinearRef Data

Video/Still Cam

VoiceInput

Instrumentation VanDocking Station

IDAAT Data CollectionPost- Processing

Wireless Internet


IDEA in Action - Collection

Target Acquisition and IdentificationImage/video (optional)GPS location (automatic)Asset characterizationNotepad sketches (optional)Voice input (optional)


Integrated Maintenance Management System and Databases

(typically Oracle 8 on RS/6000 or similar platform)

District Field Office

PC(Base Station)

Card ReaderWORKCARD

1

2Task dataset loaded onto WorkCard in Base Station PC

Wearable PC with CardReader

built-in or as plug-in

WORKCARD

3

In-field data collection process; data processed on PC and stored on WORKCARD

4Work completed and WORKCARD time-stamped and ready for upload through BASE station

5

Voice input

Internet access

Camera or video

Keyboardinput

GPSWORKCARD

6WorkCard returned to Base Station PC for upload

Intelligent Data Entry and Acquisition System


NTriplicate and the Digital Pad


From Pad to Form to Database

File View Navigate Scan Options HelpNtriplicate Form Scanner – Rayzer’s Red Cross Blood Bank Drive

245

*8/12/98, 3:29:10PM: TR12 form with 13of 14 fields processed*TR10 form with 22of 22 fields processed*TR12 form with 14of 14 fields processed

Report Pane

Open Form (Notebook)Open Pad

Upload Form (Notebook)

Upload Pad

Exit

Transferring form 5 of 24 forms tohttp://www.redcross.org/bloodbank/

CANCEL

Preliminary NTriplicate Form Scanner User Interface


IDEA Internal Data Model

PTR (Primary Transaction Record)FIELD VALUEUnique key alphanumeric stringUser-ID alphanumeric stringTCR Field List alphanumeric string; field pointers

separated by delimitersJobstart date/timeJobend date/timeoptional other task-defining fields (optional)

TCR (Transaction Content Record)FIELD VALUE CONTENTPTR key alphanumeric string pointer to the associated PTR recordfile list linked list; e.g. (see below) (link/field ID + file pointer + locator in file) --- link/field1 text memo in MEMO.XXX, loc 001 --- link/field2 still photo in PHOTO1.YYY --- link/field3 text memo in MEMO.XXX, loc 002 --- link/field4 sketch in DRAW01.ZZZ --- link/field (n) video clip in VID01.XXX


IDEA On-Board Intelligent Processing

Assimilation and NormalizationFeature Extraction - Building the

Representation SetClassification - Matching ExamplesResolution - Interaction by the ExpertDatabase Entry and QA/QC


Adaptive Pattern Recognition - Like Humans Do It

Beginning of recognition process Later stage of recognition process


Another Example - Cutting Through the Noise

Beginning of recognition process Later stage of recognition process


Other Aspects of Asset Identification, Assessment, and Planning ...


Extending IDAAT and the IDEA Modelto Many Highway Engineering Problems

Non-Destructive Testing Bridges and Metal Structures Tanks and Containers Hard-to-reach, Hard-to-inspect Structures

Traffic Incident / Density Planning and Emergency Response

Motorist Safety and SecurityEmergency Weather Response


One Interesting New Technology for NDT, One More Plug-In for the IDEA System

Magneto-Optic Defect Inspection and Imaging Easy to use Safe and “hassle-free” Images, not abstract data (e.g., ultrasonics) Can be automated Relatively inexpensive Easy training, interpretation


Magnetic Imaging for Stress and Defect Detection in Bridges and Poles

Anomaly/Occlusion

Microcracks


More Images Pertaining to Highway Structure Safety

Crack hidden by ice

Surface

Interior


And A Few More Still...

Soft Steel with artificially created

gouges and pits

Soft Steel with artificially created pit defects


Acknowledgements

Ray Reaux, PARIKH NTriplicate architecture and development

Ray Lindquist, PARIKH Enterprise information technology analysis

Dan Widner, VDOT GIS Systems Engineering

Robin Bresley, VDOT ICAS Project Manager

Murali Rao, VDOT IMMP Technology Manager

ihee ppres0998

Documents

projected idaat data

base station pcworkca

lan connectivity

pdahpc connectivity

handsfree pc

internet connectivity

idea system architecture

base3station pc