dsp group smartvoice solution for teams conf speaker

June 2021

2 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Agenda

• What’s Teams

• DSPG SmartVoice solutions for Teams Conf Speaker

• DSPG Algo Audio Tuning

3 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Microsoft Teams is Toolbox developed by Microsoft for team collaboration, communications like chats & meetings, running in PCs or tablets or mobiles.

4 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams toolbox runs in PC or Mobile is so-called Teams client

• Microsoft defined many categories of devices which may co-work with Teams client to facilitate & enhance performance & efficiency.

• These device categories are:

- Conferencing Monitor

- Headsets

- Microsoft Teams Rooms

- Speakerphones (Conf Speaker)

- USB Camera

- Others

5 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Why does Teams certification so important for device?

- Microsoft Teams represents almost the highest quality requirements

- A pass to commercial business market

- Higher retail price than non Teams certificated

6 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Conference Monitor

7 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Headsets

8 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Teams Rooms

9 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Speakerphones

10 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – USB Cameras

11 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• All Teams devices with Teams logo must be certificated by Microsoft lab or authorized labs

• PAL Acoustic Lab in DongGuan(东莞)

12 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams certification program has strict requirements on different aspects of device

13 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams Audio Specification defines performance index in different aspects in different rooms

- Reverberant Room

• Send path tests

• Receive path Echo path

- ANECHOIC ROOM

• Send path tests

• Receive path

• Echo path

14 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• In audio part Teams apply “Microsoft Teams Audio Test Specification”

• This specification defines all requirements on audio related items.

15 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• In audio part Teams apply “Microsoft Teams Audio Test Specification”

• This specification defines all requirements on audio related items.

16 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Audio specification is the most tough part for Teams certification

• DSPG provide total audio solution for customer to pass audio specification

- DSP chips for low & high end solution (2mic & 4 or more mic)

- Turnkey algo including BF, AEC, NR, EQ, AGC etc

- Acoustic design guide

- Support for tuning including pre-test in DSPG Teams lab

17 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Low-Power AI/ML, Always-on Voice

Control with AI/NN Engine• Up to 8 MLs with DSPSense / nNetLite• TensorFlow Lite support• Lowest power consumption• 2-4 mics• 1,2, or 3 WWEs• 2-3 mics Voice Processing• Voice/Sound Detection, Voice Buffering

High performance AI/ML, Far-field Voice Control & Voice Call & Awareness Detection

• More than 10 MLs• TensorFlow Lite• 2-8 mics• 1,2, or 3 WWEs• 2-8 mics Voice Processing• Up to 1.5GHZ DSP Processing Power

DBMD5,DBMD5P

DSPG SmartVoice Solutions for Teams Conf Speaker

DBMD2

Low-Power AI/ML, Always-on Voice

Control / Voice Call with Enhancements• Up to 4 MLs with DSPSense• 2 mics• 1, 2 or 3 WWEs• 1-2 mics Voice Processing• Voice/Sound Detection, Voice Buffering• 2mics Voice call with WNR

DBM10L

DBMD7P,DBMD9

DBMD7-2DBMD7-4DBMD7-8

18 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Low-end solution based on DBMD10L/DBMD2 (typical 2 mic)

• Mid-end solution based on DBMD7-2 (typical 2 mic)

• High-end solution based on DBMD7-4/DBMD7-8 (typical 4~8 mic)

19 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Typical System Scheme

- DSPG HDClear multi-mic algorithms voice call SDK

• Reference RTOS driver for SoC

• DSP FW

• Tuning toolkit

Bluetooth/USB SoC

DSP

TDM (I2S)

PA

Voice Processing

SPI/UART/IIC

AEC

Audio

A/D MICGPIO

20 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Procedure for integrating DSPG into customer project

- SW integration. Integrate DSPG RTOS-based c driver into MCU

• DSP FW & tuning parameters are stored in MCU, driver will load it into DSP after power on

- HW integration. DSPG provide reference HW design to customers

• DSPG could provide support for schematics & layout review

• Acoustic design guide during customer ID design.

- Audio tuning

• Tuning toolkit

• Tuning support from DSPG or distributors

• Pre-certification by DSPG (conditional)

21 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• SmartVoice SDK release

22 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• HW ref design

23 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG Audio Processing Algo

• DSPG ASRP

• Input 16/48Khz 16 bits

• Output 16/48Khz 16bits

AEC

Acoustic Echo Cancellation

BF

Adaptive Beam Forming & Noise

Cancellation

MicrophonesM

(up to 8)M

VAD

Voice Activity Detect

or

BPF

BF Post Filter

1

VAD Indications

Tx ASRP

Output

Multi Speak

ers

Speakers Referenc

esR

(up to 7)

Rx SpeakersR

Control Signals

VC PF

VC Post Filter

AGC

EQU

DRC

Tx VCP

Output

Audio Enhancem

ents

24 | Private and Confidential. Copyright DSP Group, 2018. All rights reserved.

• Modules open for tuning

- AEC

- DRC

- EQU

- VCPF

- etc

DSPG Audio Processing Algo

25 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Tuning

• DSPG EQ Filter design

26 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Tuning

27 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

D10L EVB

DSPG MIC ARRAY

SPEAKER

Far-end speaker is 70dBC measured @1mNear-end speaker is 75dBC measured @1m and 1m front of the mic arrayNoise/Music speaker is 64dBC measured @1m and 1m side of the mic array at 90degree

EVB : DBMD10L EVBMic array: DSPG mic array (2mic in used)Speaker : general speakerASRP version : v392x

28 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

29 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• AEC (2MIC)

• MIC RAW DATA

• AEC OUTPUT

30 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• NR (2MIC)

• NOISE ONLY

• SPEECH ONLY

• NR OUTPUT

31 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• DOUBLE TALK (2MIC)

• MIC RAW DATA

• FAR-END REF

• DOUBLE TALK OUTPUT