realtek audio codec introduction and demo (microsoft ... · pdf filerealtek audio codec ......
TRANSCRIPT
August, 2015
Realtek Audio Codec Introduction and Demo (Microsoft Cortana Workshop)
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -1-
Milestone with Microsoft Partner
Design Notice and Flow for Cortana Application
Approach of Microphone Effect
Demonstration
Q & A
Outline
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -2-
Milestone with Microsoft Partner
Over 90% Lync/Skype/Unified certified projects for laptop/tablet/AiO adopted in Realtek audio solutions
2010 ~ NOW
2015/May Realtek HD audio is the worldwide NO.1 Win10 certified device/driver
2015/Q2 ~ NOW Exceed 100 projects with Cortana Premium Level tuned by Realtek (Win10 launched in 2015/July/E)
Professional tuning tools & solutions
for audio-related certification
Convenient global technical support, audio laboratories built
not only in Taiwan but China
Sufficient Over 4 ETSI Room
and anechoic chamber for tuning resources
(gradually building more )
+ + =
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• Careful mechanical integration of the microphone is important and is a common source of failure. Following the principle: for microphone, as far as possible from noise; for speaker, as close as possible to the user’s mouth
-3-
Key component select & design is microphone and
its placement
• microphone & speaker placement / codec and recording algorithm implementation • complete system pre-test for Cortana • setting microphone tuned volume/gain in Win10 system register
Design Flow
• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline
Design Notice and Flow for Cortana
Key Recommendation
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline
Key Recommendation
-4-
Design Notice and Flow for Cortana
Microphone Selection
• Signal to Noise Ratio 61 dB for Standard 63 dB for Premium • Sensitivity Max Level: <= -20dBFS Min Level: <= -55dBFS (100 ~ 8,000 Hz)
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline
Key Recommendation
-5-
Design Notice and Flow for Cortana
Acoustic Design
(For Microphone) • Sealing well for
Airtight • Leakage not to be introduced
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline
Key Recommendation
-6-
Design Notice and Flow for Cortana
Mechanical Integration
• Speaker and MIC are not in the same chamber
• Leakage not to be introduced (speaker isolation) • Consideration for
resonance issue
GOOD BAD
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• Careful mechanical integration of the microphone is important and is a common source of failure. Following the principle: for microphone, as far as possible from noise; for speaker, as close as possible to the user’s mouth
Key component select & design is microphone and
its placement
-7-
Design Notice and Flow for Cortana
DIRECT PATH is the key
> >
For Microphone
For Speaker
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
• microphone & speaker placement / codec and recording algorithm implementation • complete system pre-test for Cortana • setting microphone tuned volume/gain in Win10 system register
Design Flow
-8-
Design Notice and Flow for Cortana
Before mechanical & component placement fixing
Checking…
*SPK & MIC relative position
*SPK heading direction
*SPK aperture ratio
*Effective Isolation to avoid interference in the same chamber
Before audio driver fixing
Checking…
* Detail tuning MIC effect parameter
* Confirm the best MIC gain value after Realtek pre-test
Before system driver fixing
Checking…
* Implement MIC gain setting by customers themselves or Realtek driver
Cortana Application
Ready Send a complete system to Realtek
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
Approach of Microphone Effect
-9-
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
Free microphone placement for either Landscape or
Portrait mode
User friendly GUI (scenario term)
More natural sound quality
Improvement for VR test (SEVT, Lync/Skype Unified)
Valueable features attached (Keystroke Removal, FFP)
-10-
The Goals of Microphone Effect
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -11- -11-
Uni-Directional Mode
• Enhance the Clarity of the voice During the VoIP or even the Voice Command
- Remove Internet Stream Echo
- Reduce keystroke noise
- Directional Recording
- Environment Noise Reduction
- Natural Target Voice
Disabled
Enabled
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -12- -12-
• Free moving when Multi-user conduct the conference
- Remove Internet Stream Echo
- Recording from all Angles
w/ same volume level
- Reduce keystroke noise
- Environment Noise Reduction
- Far Field Pickup (FFP) Record
Omni-Directional Mode
5m
0.5m 5m
Disabled
Enabled
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -13- -13-
• Used for video and music recording, not for VoIP
- Stereo recording with independent
Noise Suppression for L and R Channel
- Higher sampling rate
(44.1kHz/48kHz) record
High Quality Record with NS
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -14-
Controls in GUI
All Off Uni-Directional Omni-Directional
Enhance Voice Recognition High Quality Record Echo Cancel Off
Echo Cancel On
Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp
Thank You!
-15-