dsp group smartvoice solution for teams conf speaker
TRANSCRIPT
![Page 1: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/1.jpg)
June 2021
![Page 2: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/2.jpg)
2 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Agenda
• What’s Teams
• DSPG SmartVoice solutions for Teams Conf Speaker
• DSPG Algo Audio Tuning
![Page 3: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/3.jpg)
3 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• Microsoft Teams is Toolbox developed by Microsoft for team collaboration, communications like chats & meetings, running in PCs or tablets or mobiles.
![Page 4: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/4.jpg)
4 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• Teams toolbox runs in PC or Mobile is so-called Teams client
• Microsoft defined many categories of devices which may co-work with Teams client to facilitate & enhance performance & efficiency.
• These device categories are:
- Conferencing Monitor
- Headsets
- Microsoft Teams Rooms
- Speakerphones (Conf Speaker)
- USB Camera
- Others
![Page 5: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/5.jpg)
5 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• Why does Teams certification so important for device?
- Microsoft Teams represents almost the highest quality requirements
- A pass to commercial business market
- Higher retail price than non Teams certificated
![Page 6: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/6.jpg)
6 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams – Conference Monitor
![Page 7: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/7.jpg)
7 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams – Headsets
![Page 8: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/8.jpg)
8 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams – Teams Rooms
![Page 9: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/9.jpg)
9 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams – Speakerphones
![Page 10: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/10.jpg)
10 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams – USB Cameras
![Page 11: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/11.jpg)
11 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• All Teams devices with Teams logo must be certificated by Microsoft lab or authorized labs
• PAL Acoustic Lab in DongGuan(东莞)
![Page 12: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/12.jpg)
12 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• Teams certification program has strict requirements on different aspects of device
![Page 13: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/13.jpg)
13 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• Teams Audio Specification defines performance index in different aspects in different rooms
- Reverberant Room
• Send path tests
• Receive path Echo path
- ANECHOIC ROOM
• Send path tests
• Receive path
• Echo path
![Page 14: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/14.jpg)
14 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• In audio part Teams apply “Microsoft Teams Audio Test Specification”
• This specification defines all requirements on audio related items.
![Page 15: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/15.jpg)
15 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
What’s Teams
• In audio part Teams apply “Microsoft Teams Audio Test Specification”
• This specification defines all requirements on audio related items.
![Page 16: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/16.jpg)
16 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• Audio specification is the most tough part for Teams certification
• DSPG provide total audio solution for customer to pass audio specification
- DSP chips for low & high end solution (2mic & 4 or more mic)
- Turnkey algo including BF, AEC, NR, EQ, AGC etc
- Acoustic design guide
- Support for tuning including pre-test in DSPG Teams lab
![Page 17: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/17.jpg)
17 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Low-Power AI/ML, Always-on Voice
Control with AI/NN Engine• Up to 8 MLs with DSPSense / nNetLite• TensorFlow Lite support• Lowest power consumption• 2-4 mics• 1,2, or 3 WWEs• 2-3 mics Voice Processing• Voice/Sound Detection, Voice Buffering
High performance AI/ML, Far-field Voice Control & Voice Call & Awareness Detection
• More than 10 MLs• TensorFlow Lite• 2-8 mics• 1,2, or 3 WWEs• 2-8 mics Voice Processing• Up to 1.5GHZ DSP Processing Power
DBMD5,DBMD5P
DSPG SmartVoice Solutions for Teams Conf Speaker
DBMD2
Low-Power AI/ML, Always-on Voice
Control / Voice Call with Enhancements• Up to 4 MLs with DSPSense• 2 mics• 1, 2 or 3 WWEs• 1-2 mics Voice Processing• Voice/Sound Detection, Voice Buffering• 2mics Voice call with WNR
DBM10L
DBMD7P,DBMD9
DBMD7-2DBMD7-4DBMD7-8
![Page 18: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/18.jpg)
18 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• Low-end solution based on DBMD10L/DBMD2 (typical 2 mic)
• Mid-end solution based on DBMD7-2 (typical 2 mic)
• High-end solution based on DBMD7-4/DBMD7-8 (typical 4~8 mic)
![Page 19: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/19.jpg)
19 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• Typical System Scheme
- DSPG HDClear multi-mic algorithms voice call SDK
• Reference RTOS driver for SoC
• DSP FW
• Tuning toolkit
Bluetooth/USB SoC
DSP
TDM (I2S)
PA
Voice Processing
SPI/UART/IIC
AEC
Audio
A/D MICGPIO
![Page 20: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/20.jpg)
20 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• Procedure for integrating DSPG into customer project
- SW integration. Integrate DSPG RTOS-based c driver into MCU
• DSP FW & tuning parameters are stored in MCU, driver will load it into DSP after power on
- HW integration. DSPG provide reference HW design to customers
• DSPG could provide support for schematics & layout review
• Acoustic design guide during customer ID design.
- Audio tuning
• Tuning toolkit
• Tuning support from DSPG or distributors
• Pre-certification by DSPG (conditional)
![Page 21: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/21.jpg)
21 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• SmartVoice SDK release
![Page 22: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/22.jpg)
22 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG SmartVoice Solutions for Teams Conf Speaker
• HW ref design
![Page 23: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/23.jpg)
23 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
DSPG Audio Processing Algo
• DSPG ASRP
• Input 16/48Khz 16 bits
• Output 16/48Khz 16bits
AEC
Acoustic Echo Cancellation
BF
Adaptive Beam Forming & Noise
Cancellation
MicrophonesM
(up to 8)M
VAD
Voice Activity Detect
or
BPF
BF Post Filter
1
VAD Indications
Tx ASRP
Output
Multi Speak
ers
Speakers Referenc
esR
(up to 7)
Rx SpeakersR
Control Signals
VC PF
VC Post Filter
AGC
EQU
DRC
Tx VCP
Output
Audio Enhancem
ents
![Page 24: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/24.jpg)
24 | Private and Confidential. Copyright DSP Group, 2018. All rights reserved.
• Modules open for tuning
- AEC
- DRC
- EQU
- VCPF
- etc
DSPG Audio Processing Algo
![Page 25: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/25.jpg)
25 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Tuning
• DSPG EQ Filter design
![Page 26: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/26.jpg)
26 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Tuning
![Page 27: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/27.jpg)
27 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Processing Performance Test
D10L EVB
DSPG MIC ARRAY
SPEAKER
Far-end speaker is 70dBC measured @1mNear-end speaker is 75dBC measured @1m and 1m front of the mic arrayNoise/Music speaker is 64dBC measured @1m and 1m side of the mic array at 90degree
EVB : DBMD10L EVBMic array: DSPG mic array (2mic in used)Speaker : general speakerASRP version : v392x
![Page 28: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/28.jpg)
28 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Processing Performance Test
![Page 29: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/29.jpg)
29 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Processing Performance Test
• AEC (2MIC)
• MIC RAW DATA
• AEC OUTPUT
![Page 30: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/30.jpg)
30 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Processing Performance Test
• NR (2MIC)
• NOISE ONLY
• SPEECH ONLY
• NR OUTPUT
![Page 31: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/31.jpg)
31 | CONFIDENTIAL Copyright DSP Group, 2020. All rights reserved.
Audio Processing Performance Test
• DOUBLE TALK (2MIC)
• MIC RAW DATA
• FAR-END REF
• DOUBLE TALK OUTPUT
![Page 32: DSP Group SmartVoice solution for Teams Conf Speaker](https://reader030.vdocument.in/reader030/viewer/2022040517/624a54ef2596a83cba3d0f21/html5/thumbnails/32.jpg)