Windows Workflows Activities that Talk and IM with OCS 2007 R2

Vishwa RanjanProgram ManagementMicrosoft

Albert KooimanProduct ManagementMicrosoftSession Code: UNC325

Agenda

Microsoft and Speech TechnologyIntroduction to UCMA 2.0UCMA 2.0 Workflow

Introduction ScenariosComponent hierarchyUC CapabilitiesDemo & Code

OCS 2007 R2, Speech ServerConversational Grammar BuilderDemo & Code

Microsoft and Speech Technology

Warning!!Satisfaction Alert

Speech Server (2007) supports Speech Recognition in:

North American EnglishAmerican SpanishCanadian FrenchUK EnglishGerman

And beta previewsPortuguese (Brazil, Portugal)

And 12 TTS Languages

OCS 2007 R2 UCMA12 languages ASR plus TTS

OCS ‘14’26 languages

Languages available Speech Server (2007) vs. OCS 2007 R2 vs. OCS '14'Language Country/Region Speech Server (2007) ASR Speech Server (2007) TTS OCS 2007 R2 ASR OCS 2007 R2 TTS OCS “14”

Chinese (Mandarin) China Available (RealSpeak 4.0) Available Available (MS) Planned Chinese (Traditional) Taiwan , Singapore Available (RealSpeak 4.0) Available Available (MS) Planned English United Kingdom Available Available (RealSpeak 4.0) Available Available (MS) Planned English United States Available Available (RealSpeak 4.0) Available Available (MS) PlannedFrench Canada Available Available (RealSpeak 4.0) Available Available (MS) PlannedFrench France Available (RealSpeak 4.0) Available Available (MS) PlannedGerman Germany Available Available (RealSpeak 4.0) Available Available (MS) Planned Italian Italy Available (RealSpeak 4.0) Available Available (MS) PlannedJapanese Japan Available (RealSpeak 4.0) Available Available (MS) PlannedKorean Korea Available (RealSpeak 4.0) Available Available (MS) Planned Portuguese Brazil Beta Available (RealSpeak 4.0) Available Available (MS) PlannedSpanish Americas Available (RealSpeak 4.0) Available Available (MS) PlannedSpanish Spain Available (RealSpeak 4.0) Planned Portuguese Portugal Beta On request PlannedEnglish Australia Available (RealSpeak 4.0) PlannedEnglish Canada Planned English India Planned Spanish Catalan PlannedChinese (Cantonese) South China/Hong Kong Planned Norwegian (Bokmal) Norway PlannedSwedish Sweden, Finland PlannedFinnish Finland PlannedDanish Denmark PlannedDutch Netherlands On request PlannedPolish Poland PlannedRussian Russia Planned

Research

Technologies Automatic Speech Recognitionand Conversational UnderstandingSpeech SynthesisDeep language supportSignal processing like noise filteringSpeech Application Programming InterfacesAudio Search

Microsoft’s Investments in Speech

Founded in 1993Leading scientists and engineersCode bases of Carnegie Mellon and CambridgeOver 188 patents since 1993

Taking Speech to the MainstreamWindows VistaMicrosoft AutoMicrosoft Voice CommandMicrosoft Streets and Trips Microsoft AutorouteMicrosoft MapPoint

Live Search 411 (1-800-CALL-411)Live Search for MobileTellme MobileTellme Voice Services (1-800-555-TELL)

Microsoft Exchange Server 2007Unified MessagingMicrosoft Exchange Server 2010 BetaUnified Messaging (Voice Mail Preview)Microsoft Office Communications Server 2007Speech Server (2007) Tellme Business SolutionsMicrosoft Response Point

SAPI 5.3.NET 3.0 and up(System.Speech namespace)Unified Communications Managed API

Server-side Speech Roadmap*

Speech Server 2004

Speech Server 2004 R2

Speech Server (2007)

Exchange 2007 UM

Speech Server (2007) OCS 2007 R2 UCMA 2.0

OCS ‘14’ UCMA 3.0

OCS ‘13’

OCS 2007 Speech Server (2007)

‘OCS14’

E’14’ SP1

OCS ‘12’

‘E12’

Exchange 2010 UM

Speech Server (2007)+

*Subject to Change

Exchange 2010 SP1 UM

Speech Server (2007)+

E’15’ UM

UCMA 3.0

E’15’

E’14’

OCS 2007 R2: Speech Server & UCMA

VoIP GatewayPBX/IP PBX

VoIP Gateway

PSTN

Windows Server OCS Standard Server SQL ServerLogging

OCS Mediation Server

SQL ServerLogging

Speech Server (2007)Web Server

VoIP GatewayPBX/IP PBX

VoIP Gateway

PSTN

OCS 2007 R2 UCMA 2.0

Speech Server (2007)

UC Managed API 2.0Workflow Activities

New in UCMA 2.0Collaboration

IM or AudioVideo CallConferencingPresence publication and subscription

SpeechSpeech Synthesis (TTS)Automatic Speech Recognition

WorkflowSimple Call ControlQuery PresenceIM DialogSpeech Dialog

UCMA 1.0SIP SignalingText IM

UCMA 2.0 Workflow Activities Target Use Cases

Adds UC features to WFIM and Speech modalitiesPresence information

Use CasesContextual Collaboration

Presence Based RoutingBusiness Process Communications

Alerts and NotificationsSurveys

Anywhere Information AccessAutomated Agents

IM based Query/Response BotsVoice based Query/Response Bots

UCMA 2.0 Workflow Basics

Built on Windows Workflow Foundation

UCMA Workflow leverages many of WF features e.g.: ActivitiesDesigner SurfaceRules Engine Runtime services etc.

UCMA 2.0 Core and Microsoft SpeechAbstracts a subset of UCMA 2.0 Core SDK functionalityCombines them with MS Speech functionalities like TTS and ASR to provide dialog components

Visual Studio 2008Requires .NET 3.5 SP1

High Level ViewHost Process

.NET 3.5 SP1 Windows Workflow Foundation (WF)

Base Activity Library and Framework Runtime Engine Runtime Services

Custom Activity Libraries

An Activity

A Workflow

Custom Runtime Services

UCMA 2.0 UC Workflow

UCWorkflowActivities

“Call” Control

Statement

Question Answer

Commands

Events

Query Presence

Student HelplineUCMA 2.0 Workflow in action

demo

InfrastructureUCMA Workflow Runtime Services

CommunicationsWorkflowRuntimeServiceEnables

Interaction with non-workflow API (UCMA Core & Microsoft.Speech)Passing data/objects between host and workflow

TrackingDataWorkflowRuntimeServiceTrack specific data during execution of the workflow instance that can be transferred to human agent

Student HelplineCode Walkthrough

demo

Speech Server (2007)

Speech Server (2007): IVR PlatformMicrosoft’s IVR Platform

Can be deployed stand-aloneUse Cases

Full fledged IVR applicationsInbound applicationsOutbound applications

Statistical Language Model supportSupports:

Speech Server Workflow ActivitiesVoiceXML 2.1SALT 1.0

Visual Studio 2005 only.NET 2.0

Tested Telephony integration:Audiocodes gatewaysDialogic gateways

Operations, Administration & Maintenance (OA&M)

MMCWMIMOM Pack

Speech Debugging and TuningLogging and Reporting

Business Analytics Tools (OLAP cubes)SQL Server Reporting Services support

Speech Server (2007)

Speech Server Runtime Service

SALT Browser VXML 2.1 Browser Speech Server Windows Workflow

Engine

Speech Server Managed API

Prompt Engine ASR TTS

ApplicationsLogging & Reporting

Operations, Administrati

on &

Maintenance

Infrastructure

Speech Tools

Visual Studio 2005

Support

Data Mining Tools

Speech Debugger Soft Phone

Applications Applications

TelephonyInterfaces

Speech Server Windows Workflow

Activities

Can be deployed Stand-aloneVisual Studio 2005 onlySupports:

Speech Server Workflow ActivitiesVoiceXML 2.1SALT 1.0Telephony integration tested against

Audiocodes gatewaysDialogic gateways

OA&MMMCWMIMOM Pack

Speech Debugging and TuningLogging and Reporting

Business Analytics Tools (OLAP cubes)SQL Server Reporting Services support

Speech Server (2007)

Speech Server Runtime Service

SALT Browser VXML 2.1 Browser

Speech Server Windows Workflow Engine

Speech Server Managed API

Prompt Engine

ASR TTS

ApplicationsLogging & Reporting

Operations,

Administration

& Maintenan

ce Infrastruct

ure

Speech Tools

Visual Studio 2005

Support

Data Mining Tools

Speech Debugger Soft Phone

Applications Applications

TelephonyInterfaces

Speech Server Windows Workflow

Activities

Deployment requires OCS 2007 R2 or higherVisual Studio 2008Supports:

Windows Workflow (.NET 3.5 SP1)UC Open Interop Program

Need to write your ownApplication Host / ServicePrompt EngineLogging & Management ReportingApplication Provisioning Application Reporting

Planned:VoiceXML 2.1 Speech Tools

Using UCMA for Speech Applications

VXML 2.1 Browser .NET 3.5 SP1 Windows Workflow Engine

Unified Communications Managed API 2.0

Prompt Engine

ASR TTS

Logging & Reporting

Operations, Administrati

on &

Maintenance Infrastructur

e

Speech Tools

Visual Studio 2008

Support

Data Mining Tools

Visual StudioDebuggingcombined

with Communicat

or

Applications Applications

Application Runtime Service

OCS 2007 R2

TelephonyInterface

only

UCMA Core API UCMA Speech API

Unified Communications Windows Workflow

Activities

Speech Server to UCMA Migration

Separate by design:1. Dialog flow

Managed codeWindows WorkflowVoiceXML 2.1

2. Business LogicManaged CodeJavaScript (typical with VXML)

3. Back-end IntegrationManaged Code

4. Speech Resource Files GrammarsLexiconsEtc.

Student HelplineConversational Grammar Builder

demo

question & answer

Resources

Visit the Microsoft Unified Communications Developer Portalhttp://msdn.microsoft.com/uc

Visit the Microsoft Office Communications Developer Portalhttp://msdn.microsoft.com/ocdev

Visit the Microsoft Exchange Developer Centerhttp://msdn.microsoft.com/exchange

Join the UC Developer Community and Sign-up for the Dev Sandbox!http://gotuc.net

Download the Exchange 2010 EWS Managed API 1.0Exchange Web Services Managed API 1.0

Get the Book!

Intro to UCOverview of all UC APIsOC Automation API

Embedding Contextual CollabUCMA Workflow API

Building a UC-enabled WF AppUCMA Core API

Publishing Custom PresenceSetup of OCS EnvironmentDebugging UC Applications

Resources

UNC201 - Lap around Release 2 of the Microsoft Unified Communications Platform

UNC301 - Adding Communication to Your Applications with Microsoft Office Communicator 2007 R2

UNC322 - Building Communication Services with the UCMA 2.0 and Microsoft Office Communications Server 2007 R2

UNC 325 - Windows Workflows Activities That Talk and IM with Microsoft Office Communications Server 2007 R2

UNC324 - What's New in Exchange Web Services in Microsoft Exchange Server 2010

UNC401 - Building Rich Calendaring Experiences with Exchange Web Services

www.microsoft.com/teched

Sessions On-Demand & Community

http://microsoft.com/technet

Resources for IT Professionals

http://microsoft.com/msdn

Resources for Developers

www.microsoft.com/learningMicrosoft Certification and Training Resources

www.microsoft.com/learning

Microsoft Certification & Training Resources

Resources

Complete an evaluation on CommNet and enter to win!

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS,

IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.