dsp group smartvoice solution for teams conf speaker

32
June 2021

Upload: others

Post on 04-Apr-2022

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DSP Group SmartVoice solution for Teams Conf Speaker

June 2021

Page 2: DSP Group SmartVoice solution for Teams Conf Speaker

2 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Agenda

• What’s Teams

• DSPG SmartVoice solutions for Teams Conf Speaker

• DSPG Algo Audio Tuning

Page 3: DSP Group SmartVoice solution for Teams Conf Speaker

3 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Microsoft Teams is Toolbox developed by Microsoft for team collaboration, communications like chats & meetings, running in PCs or tablets or mobiles.

Page 4: DSP Group SmartVoice solution for Teams Conf Speaker

4 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams toolbox runs in PC or Mobile is so-called Teams client

• Microsoft defined many categories of devices which may co-work with Teams client to facilitate & enhance performance & efficiency.

• These device categories are:

- Conferencing Monitor

- Headsets

- Microsoft Teams Rooms

- Speakerphones (Conf Speaker)

- USB Camera

- Others

Page 5: DSP Group SmartVoice solution for Teams Conf Speaker

5 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Why does Teams certification so important for device?

- Microsoft Teams represents almost the highest quality requirements

- A pass to commercial business market

- Higher retail price than non Teams certificated

Page 6: DSP Group SmartVoice solution for Teams Conf Speaker

6 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Conference Monitor

Page 7: DSP Group SmartVoice solution for Teams Conf Speaker

7 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Headsets

Page 8: DSP Group SmartVoice solution for Teams Conf Speaker

8 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Teams Rooms

Page 9: DSP Group SmartVoice solution for Teams Conf Speaker

9 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – Speakerphones

Page 10: DSP Group SmartVoice solution for Teams Conf Speaker

10 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams – USB Cameras

Page 11: DSP Group SmartVoice solution for Teams Conf Speaker

11 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• All Teams devices with Teams logo must be certificated by Microsoft lab or authorized labs

• PAL Acoustic Lab in DongGuan(东莞)

Page 12: DSP Group SmartVoice solution for Teams Conf Speaker

12 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams certification program has strict requirements on different aspects of device

Page 13: DSP Group SmartVoice solution for Teams Conf Speaker

13 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• Teams Audio Specification defines performance index in different aspects in different rooms

- Reverberant Room

• Send path tests

• Receive path Echo path

- ANECHOIC ROOM

• Send path tests

• Receive path

• Echo path

Page 14: DSP Group SmartVoice solution for Teams Conf Speaker

14 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• In audio part Teams apply “Microsoft Teams Audio Test Specification”

• This specification defines all requirements on audio related items.

Page 15: DSP Group SmartVoice solution for Teams Conf Speaker

15 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

What’s Teams

• In audio part Teams apply “Microsoft Teams Audio Test Specification”

• This specification defines all requirements on audio related items.

Page 16: DSP Group SmartVoice solution for Teams Conf Speaker

16 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Audio specification is the most tough part for Teams certification

• DSPG provide total audio solution for customer to pass audio specification

- DSP chips for low & high end solution (2mic & 4 or more mic)

- Turnkey algo including BF, AEC, NR, EQ, AGC etc

- Acoustic design guide

- Support for tuning including pre-test in DSPG Teams lab

Page 17: DSP Group SmartVoice solution for Teams Conf Speaker

17 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Low-Power AI/ML, Always-on Voice

Control with AI/NN Engine• Up to 8 MLs with DSPSense / nNetLite• TensorFlow Lite support• Lowest power consumption• 2-4 mics• 1,2, or 3 WWEs• 2-3 mics Voice Processing• Voice/Sound Detection, Voice Buffering

High performance AI/ML, Far-field Voice Control & Voice Call & Awareness Detection

• More than 10 MLs• TensorFlow Lite• 2-8 mics• 1,2, or 3 WWEs• 2-8 mics Voice Processing• Up to 1.5GHZ DSP Processing Power

DBMD5,DBMD5P

DSPG SmartVoice Solutions for Teams Conf Speaker

DBMD2

Low-Power AI/ML, Always-on Voice

Control / Voice Call with Enhancements• Up to 4 MLs with DSPSense• 2 mics• 1, 2 or 3 WWEs• 1-2 mics Voice Processing• Voice/Sound Detection, Voice Buffering• 2mics Voice call with WNR

DBM10L

DBMD7P,DBMD9

DBMD7-2DBMD7-4DBMD7-8

Page 18: DSP Group SmartVoice solution for Teams Conf Speaker

18 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Low-end solution based on DBMD10L/DBMD2 (typical 2 mic)

• Mid-end solution based on DBMD7-2 (typical 2 mic)

• High-end solution based on DBMD7-4/DBMD7-8 (typical 4~8 mic)

Page 19: DSP Group SmartVoice solution for Teams Conf Speaker

19 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Typical System Scheme

- DSPG HDClear multi-mic algorithms voice call SDK

• Reference RTOS driver for SoC

• DSP FW

• Tuning toolkit

Bluetooth/USB SoC

DSP

TDM (I2S)

PA

Voice Processing

SPI/UART/IIC

AEC

Audio

A/D MICGPIO

Page 20: DSP Group SmartVoice solution for Teams Conf Speaker

20 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• Procedure for integrating DSPG into customer project

- SW integration. Integrate DSPG RTOS-based c driver into MCU

• DSP FW & tuning parameters are stored in MCU, driver will load it into DSP after power on

- HW integration. DSPG provide reference HW design to customers

• DSPG could provide support for schematics & layout review

• Acoustic design guide during customer ID design.

- Audio tuning

• Tuning toolkit

• Tuning support from DSPG or distributors

• Pre-certification by DSPG (conditional)

Page 21: DSP Group SmartVoice solution for Teams Conf Speaker

21 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• SmartVoice SDK release

Page 22: DSP Group SmartVoice solution for Teams Conf Speaker

22 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG SmartVoice Solutions for Teams Conf Speaker

• HW ref design

Page 23: DSP Group SmartVoice solution for Teams Conf Speaker

23 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

DSPG Audio Processing Algo

• DSPG ASRP

• Input 16/48Khz 16 bits

• Output 16/48Khz 16bits

AEC

Acoustic Echo Cancellation

BF

Adaptive Beam Forming & Noise

Cancellation

MicrophonesM

(up to 8)M

VAD

Voice Activity Detect

or

BPF

BF Post Filter

1

VAD Indications

Tx ASRP

Output

Multi Speak

ers

Speakers Referenc

esR

(up to 7)

Rx SpeakersR

Control Signals

VC PF

VC Post Filter

AGC

EQU

DRC

Tx VCP

Output

Audio Enhancem

ents

Page 24: DSP Group SmartVoice solution for Teams Conf Speaker

24 | Private and Confidential. Copyright DSP Group, 2018. All rights reserved.

• Modules open for tuning

- AEC

- DRC

- EQU

- VCPF

- etc

DSPG Audio Processing Algo

Page 25: DSP Group SmartVoice solution for Teams Conf Speaker

25 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Tuning

• DSPG EQ Filter design

Page 26: DSP Group SmartVoice solution for Teams Conf Speaker

26 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Tuning

Page 27: DSP Group SmartVoice solution for Teams Conf Speaker

27 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

D10L EVB

DSPG MIC ARRAY

SPEAKER

Far-end speaker is 70dBC measured @1mNear-end speaker is 75dBC measured @1m and 1m front of the mic arrayNoise/Music speaker is 64dBC measured @1m and 1m side of the mic array at 90degree

EVB : DBMD10L EVBMic array: DSPG mic array (2mic in used)Speaker : general speakerASRP version : v392x

Page 28: DSP Group SmartVoice solution for Teams Conf Speaker

28 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

Page 29: DSP Group SmartVoice solution for Teams Conf Speaker

29 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• AEC (2MIC)

• MIC RAW DATA

• AEC OUTPUT

Page 30: DSP Group SmartVoice solution for Teams Conf Speaker

30 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• NR (2MIC)

• NOISE ONLY

• SPEECH ONLY

• NR OUTPUT

Page 31: DSP Group SmartVoice solution for Teams Conf Speaker

31 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.

Audio Processing Performance Test

• DOUBLE TALK (2MIC)

• MIC RAW DATA

• FAR-END REF

• DOUBLE TALK OUTPUT

Page 32: DSP Group SmartVoice solution for Teams Conf Speaker