sp24 - using the content enrichment web service with sharepoint server 2013 search

Using the Content Enrichment Web Service with SharePoint Server 2013 SearchSezai KomurAustralia, GMT+8

April 16th /17th, 2014

• 3 x SharePoint Server MVP

• Working with SharePoint since 2004

• Perth SharePoint User Group

• SharePoint Search!

Sezai KomurSharePoint Solutions ArchitectNEC AustraliaPerth,Western Australia

Contact

@sezai sharepointsezai@gmail.comhttp://www.linkedin.com/in/sezaikomur

SP24 Search SessionsSession

Time (GMT) Time (EST) Title Level Speaker Twitter Handle

#SP24S090 5:00 1:00Using the Content Enrichment Web Service with SharePoint Server 2013 Search

Technical - Advanced

Sezai Komur - NEC Australia

@sezai

#SP24S021 6:00 2:002013 Search, Display Templates, Query Rules, Result Types

Technical - Beginner

Omer Zubair - CSC

@Omer_Zubair

#SP24S047 8:00 4:00Real-life experience building search-driven applications for product-centric sites

Technical - Advanced

Marius Constantinescu - blue-infinity SA

@c_marius

#SP24S032 10:00 6:00Custom Indexing Connectors - How to integrate external system into your SharePoint Enterprise Search

Technical - Advanced

Heinrich Ulbricht - Communardo Software GmbH

@h_ulbricht

#SP24S083 11:00 7:00Search First Migration with SharePoint 2013 – Benefits / Disadvantages

Technical - Intermediate

Max Melcher - Alegri International Service GmbH

@maxmelcher

#SP24S034 14:00 10:00The Search Immaturity Cycle, and How to Create a Search Strategy

Business - Intermediate

Jeff Fried - BA Insight

@jefffried

#SP24S009 16:00 12:0010 Things to Know about Search in SP2013 and Office 365

Business - Beginner

Agnes Molnar - Search Explained

@molnaragnes

#SP24S019 18:00 14:00 Search Topology and OptimizationTechnical - Advanced

Mike Maadarani - MCM Consulting

@mikemaadarani

#SP24S050 22:00 18:00Search Driven Application Development in SharePoint 2013

Technical - Intermediate

Matt Youngstrom - Magenic

@spguru

Agenda What is the Content Enrichment Web Service (CEWS)? CEWS Architecture in Search Configure Search to use a CEWS CEWS Development Demo: Write crawled data to a file Demo: Write crawled data to a DB Demo: Send data back to be stored in the index Farm Topology Demo: Error handling and logging

What is the Content Enrichment Web Service?

Have never heard of it.

Most technical people who work with SharePoint

It’s *new*

• Microsoft acquires FAST for $US 1.2B

• FAST ESP has a configurable and extensible ‘processing pipeline’

• FAST Search for SharePoint 2010 had a ‘Pipeline Extensibility Stage’

• SharePoint 2013 Search is based on FAST

It is only available On-Premise SharePoint

Server 2013 EnterpriseFor Now?

SharePoint Server 2013 Search Architecture

SharePoint Server 2013 Search Architecture

So how does it work?

• Develop and deploy a custom service.

• Configure a Search Service Application using PowerShell to call the service to pass it crawled data.

• The service ‘processes’ the data and can return new Managed Properties back to ‘enrich content’ in the search index.

Demo

Build a Basic CEWS

Develop a WCF Service

Develop a WCF Service

Get-SPEnterpriseSearchServiceApplication

Get-SPEnterpriseSearchContentEnrichmentConfiguration

Remove-SPEnterpriseSearchContentEnrichmentConfiguration

New-SPEnterpriseSearchContentEnrichmentConfiguration

Update properties

Set-SPEnterpriseSearchContentEnrichmentConfiguration

Configure Search to Use the Web Service

Demo

Write Crawled Data to a Database

Demo

Geocoding – Sending data back!

I’ve sent back Managed Properties!Using this ‘enriched’ dataYou can build custom search applications!

With Latitude/LongitudeIntegrate a Map UI into Search to Show results on a map.

Demo

Using Enriched Data in a Search

Other Ideas? OCR Images and Video Transcribe Audio/Video Sentiment analysis, metadata extraction, advanced entity extraction

Send to and retrieve data from other enterprise systems

Fixup and cleanse managed property data based on business rules

Filter and alert for specific content

Farm Topology Considerations

Farm Topology

Farm Topology Option 1

Configure to run against ‘localhost’Web service call traffic is localDeploy the web service to each crawl component server.

Farm Topology Option 2

Deploy the web service to OTHER servers.Don’t even need SharePoint!

Dependency on Microsoft.Office.Server.Search.ContentProcessingEnrichment.dll

Demo

Error Logging and Crawl Health Reports

Resources Worth Checking OutRichard diZerega - Advanced Content Enrichment in SharePoint 2013 Search

http://blogs.msdn.com/b/richard_dizeregas_blog/archive/2013/06/19/advanced-content-enrichment-in-sharepoint-2013-search.aspx

How to: Use the Content Enrichment web service callout for SharePoint Server

http://msdn.microsoft.com/en-us/library/office/jj163982(v=office.15).aspx

Custom content processing with the Content Enrichment web service callout

http://msdn.microsoft.com/en-us/library/office/jj163968(v=office.15).aspx

Customize the SharePoint 2013 search experience with a Content Enrichment web service

http://blogs.msdn.com/b/sharepointdev/archive/2012/11/13/customize-the-sharepoint-2013-search-experience-with-a-content-enrichment-web-service.aspx

Content enrichment service scaling and aggregation

http://blogs.msdn.com/b/sharepointdev/archive/2012/11/21/content-enrichment-service-scaling-and-aggregation.aspx

SP24 Search SessionsSession

Time (GMT)

Time (EST) Title Level Speaker Twitter Handle

#SP24S090 5:00 1:00Using the Content Enrichment Web Service with SharePoint Server 2013 Search

Technical - Advanced

Sezai Komur - NEC Australia

@sezai

#SP24S021 6:00 2:002013 Search, Display Templates, Query Rules, Result Types

Technical - Beginner

Omer Zubair - CSC

@Omer_Zubair

#SP24S047 8:00 4:00Real-life experience building search-driven applications for product-centric sites

Technical - Advanced

Marius Constantinescu - blue-infinity SA

@c_marius

#SP24S032 10:00 6:00Custom Indexing Connectors - How to integrate external system into your SharePoint Enterprise Search

Technical - Advanced

Heinrich Ulbricht - Communardo Software GmbH

@h_ulbricht

#SP24S083 11:00 7:00Search First Migration with SharePoint 2013 – Benefits / Disadvantages

Technical - Intermediate

Max Melcher - Alegri International Service GmbH

@maxmelcher

#SP24S034 14:00 10:00The Search Immaturity Cycle, and How to Create a Search Strategy

Business - Intermediate

Jeff Fried - BA Insight

@jefffried

#SP24S009 16:00 12:0010 Things to Know about Search in SP2013 and Office 365

Business - Beginner

Agnes Molnar - Search Explained

@molnaragnes

#SP24S019 18:00 14:00 Search Topology and OptimizationTechnical - Advanced

Mike Maadarani - MCM Consulting

@mikemaadarani

#SP24S050 22:00 18:00Search Driven Application Development in SharePoint 2013

Technical - Intermediate

Matt Youngstrom - Magenic

@spguru

...the anchor will pick some of them up!

Questions?Post your questions in the chat...

Thank you!