Kno.e.sis’ collaborations/projects with AFRL

Kno.e.sis’ collaborations/projects with AFRL

Amit ShethLexisNexis Ohio Eminent Scholar; Director, Kno.e.sis Center

• A Vision for Basic & Fundamental Research

• Sample Current Research in Collaboration with/funded by AFRL

• A Vision for Basic & Fundamental Research

• Sample Current Research in Collaboration with/funded by AFRL

“..Integrate biological and cognitive

technologies to optimize and protect the

Airman's capabilities to Fly, Fight, and Win in

Air, Space, and Cyberspace.”

If one hopes to achieve a full understanding of a system as complicated as a nervous system, a

developing embryo, a set of metabolic pathways, a bottle of gas, or even a large computer program,

then one must be prepared to contemplate different kinds of explanation at different levels of

description that are linked, at least in principle, into a cohesive whole, even if linking the levels in

complete detail is impractical. (Marr 1982, p. 20).

Biochemistry

Molecular Biology

Cellular biology

Anatomy, Physiology

Neuroscienc

e

Cognitive Science,

Psychology

Health & Performance

Data and Facts

Knowledge and

Understanding

Human Performan

ce

ACATATGGGTACTATTTACT

ATTCATGGGTACTATTTAT

GGCATATGGCGTACTATTC

TAATCCTATATCCGTCTAAT

CTATTTACTATTATCTATTA

CTATACCTTTTGGGGAAAA

AAATTCTATACCGTCTAAT

CCTATAAATCAAGCCG

Comp Sc & Engg Human CC

…to improve the understanding of

fundamental cognitive processes

required for human performance in

virtual Environments.

… to develop and demonstrate interface

technologies that revolutionize human-

human and human-machine

collaboration

… decision support/adaptive

automation to maximize an

operator’s information

processing and decision

effectiveness

Collaborative

visualization

Metabolomics

Toxicology

Ontologies

Domain Models

Knowledge driven

search/browsing

Data annotation

Scientific workflow

Molecular modeling

Biomolecular

Human

create and deliver relevant

biotechnology & nanotechnology

solutions for the battlefield

airmen and the integrated joint services

mission.

Metabolomics: Exposure to Toxic AgentsMetabolomics: Exposure to Toxic Agents

• Determine whether exposure has occurred• Including low-dose exposure

• Predict downstream outcome• Organ/system toxicity vs.

recovery• Using easily deployable tests

• Blood, urine, etc.

• Determine whether exposure has occurred• Including low-dose exposure

• Predict downstream outcome• Organ/system toxicity vs.

recovery• Using easily deployable tests

• Blood, urine, etc.

• Dr. Michael Raymer, CSE. WSU

• Dr. Nick Reo, Boonshoft School of Medicine, WSU

• Dr. Nick DelRaso, 711 Human Effectiveness Wing, USAF

Exp

osur

e R

espo

nse

Pre-dose 48 hours 96 hours

AcuteExposure

Response Biomarkers

Toxicity Biomarkers

GenesProteinsMetabolites

Vehi

cle

Res

pons

e

Pre-vehicle 48 hours 96 hours

Vehicle Biomarkers

Treatment

Control

Funded by AFRLSix-camera images Image mosaic

Image registration and mosaicking

Ardy Goshtasby: Intelligent Systems Labs

Lab

Ontology supported Knowledge Discovery in the field of Human Performance and Cognition

Ontology supported Knowledge Discovery in the field of Human Performance and Cognition

WSU: C. Thomas, P. Mendes, D. Cameron, A. Sheth, TK PrasadThanks: C. Ramakrishnan

AFRL: V. Chan (Dr. Schlager)

WSU: C. Thomas, P. Mendes, D. Cameron, A. Sheth, TK PrasadThanks: C. Ramakrishnan

AFRL: V. Chan (Dr. Schlager)

Ontology supported Knowledge Discovery in Human Performance and Cognition Ontology supported Knowledge Discovery in Human Performance and Cognition

Enable exploration, analysis, and integration of available knowledge, to discover and synthesize new knowledge using Semantic Web

Technologies

Enable exploration, analysis, and integration of available knowledge, to discover and synthesize new knowledge using Semantic Web

Technologies

Domain model generation from public, up-to-date

resources such as Medline and Wikipedia

estrogen

An excessive endogenous or

exogenous stimulation

modified_entity1composite_entity1

modified_entity2

adenomatous hyperplasia

endometrium

hasModifier

hasPart

induces

hasPart

hasPart

hasModifier

hasPart

Identification of entities and relationships in

Pubmed (and mapping them to ontology)

Semantic Browsing mediated by extracted

knowledge

Magnesium -> isa -> Calcium Channel Blocker -> prevents -> Migraine

Knowledge Discovery enabled by text

extraction, ontology-based formalization,

and graph-based search

Increased Human Performance

using Collaborative

Visualization

Collaborative visualization environment:• Visualization environment enhanced with several input

feeds including video streams (video conference, UAV, …)• Utilization of 3D audio in correspondence with input feed• Different visualization systems connected via network• Content exchangeable by participants via dragging/shoving

overVisualization of:• Medical data• Training scenarios• Surveillance data• Textual data (transcribed

audio, intelligence databases, …)

Increased human performance:

• Highly interactive system• Intuitive exchange of

information among participants

• Assistance in decision making

Key Personnel:Thomas Wischgoll (WSU), Brian Simpson (711 HPW/RHCB), Robert Gilkey (WSU)

Other relevant projects (partial list)Other relevant projects (partial list)

Semantics and Services enabled Problem Solving Environment for Tcruzi: services computing, data/text mining, knowledge discovery [UGA, Stanford, CCHMC]

MIDAS: Medical Information in Disasters Access and Analysis System [UCI]

Situational Awareness: Trust in Sensor Web & Semantic Sensor Web Citizen Sensors – human-in-the-loop sensing combined

with machine sensing Sense Making – understanding and improving discourse on

Social Media [Cognitive Sc., IBM, Microsoft] Cloud computing – interoperablility [IBM]

Semantics and Services enabled Problem Solving Environment for Tcruzi: services computing, data/text mining, knowledge discovery [UGA, Stanford, CCHMC]

MIDAS: Medical Information in Disasters Access and Analysis System [UCI]

Situational Awareness: Trust in Sensor Web & Semantic Sensor Web Citizen Sensors – human-in-the-loop sensing combined

with machine sensing Sense Making – understanding and improving discourse on

Social Media [Cognitive Sc., IBM, Microsoft] Cloud computing – interoperablility [IBM]

http://knoesis.orghttp://knoesis.org