ntt research and development 2013 review of activities … · · 2013-10-03by using cloud foundry...
TRANSCRIPT
Innovation for Next Value Service NTT Research and Development 2013 Review of Activities
Contents
Innovation for Next Value Service
Cloud/Security
Cloud platform
Contents
S-1 S-2
Open-source development tool set for software-defined networking Scalable Network for Large-Scale Datacenter with “Ryu” The open PaaS Cloud Foundry for application developers and providers Be Agile and Flexible with Cloud Foundry
S-3 S-4 S-5
Log analysis engines for global SIEM platforms Detecting Security Threats and Creating Intelligences Cyber attack monitoring system Constant Monitoring and Visualization of Cyber Attacks Secure computation system Enables Safe Statistical Analysis of Confidential Data
Security infrastructure
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-1
Open-source development tool set for software-defined networking
Scalable Network for Large-Scale Datacenter with “Ryu”
Cloud/Security
Cloud platform
■ Provides open-source software in a quick, flexible, and low-cost way.
■ Includes a software development kit for SDN-based application. ■ Includes a vendor-free network controller that supports the
OpenFlow Protocol. It is a logically centralized controller for managing network devices.
■ Includes a development platform for network applications. ■ Provides developer tools and useful libraries, such as a fault
diagnosis library, for its own OpenFlow applications.
Features
Application Scenarios
NTT Group Global Advantage The “Ryu” package is expected to make a significant contribution to worldwide cloud business with its open-source SDN controller, while enhancing partnerships with the Open Networking Foundation (ONF) and network venders supporting OpenFlow.
A new network architecture called Software-defined Networking (SDN) enables construction of a scalable network for a large-scale datacenter. The architecture avoids data centralization cased by tree topology and thus achieves high capacity. “Ryu” is a tool set we have developed for such networks in cloud computing that avoids the need to rely on any one particular networking equipment unit.
Datacenter network
Rack
General-purpose library
Logical network controller
OpenFlow processor
Firewall
OpenFlow
SDN-based Applications
SDN controller
Load balancing
Network isolation …
Virtual machine
…
Flexible resource allocation
Logical network controlled by software
Virtual machine
Network capacity
enlargement ■ Supporting traffic engineering in a datacenter to achieve large-
scale cloud service. ■ Allocating virtual machines flexibly by network isolation to make
the utmost use of the available datacenter resources.
- Ryu OSS site: http://osrg.github.io/ryu/
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-2
The open PaaS Cloud Foundry for application developers and providers
Be Agile and Flexible with Cloud Foundry
Cloud/Security
Cloud platform
■ It takes half a week to install and configure middleware. By using Cloud Foundry PaaS, application developer can focus on development.
■ Cloud Foundry can support many languages and frameworks and services shown in the figure.
■ No vendor lock-in: When service developers use Cloud Foundry based PaaS services, all such service are compatible with each other, and users can run their services with less risk.
■ Flexible Configuration: The system of Cloud Foundry consists of several components, and users can set up their environment by choosing the necessary combination and number of components for their needs.
■ During development, cost is reduced by reducing the man-hours necessary to set up both hardware and middleware for the services.
■ For an application service provider, PaaS services simplefy large scale development and require a smaller initial investment.
Features
Application Scenarios
NTT Group Global Advantage Cloud Foundry is very promising PaaS software that has many good features. It enables us to develop applications easily, quickly, and more flexibly at lower costs. NTT R&D is continuously developing its own PaaS software by adding original features to Cloud Foundry.
Cloud Foundry is open source PaaS (Platform as a Service) software. Application developers can use a large amount of middleware, such as programing language, its frameworks, and database services, without installation and configuration. Application providers can easily and quickly change their service capacity depending on the business.
Open PaaS Cloud Foundry
Java Spring
Scala
Ruby Rails
JavaScript node
PostgreSQL
RabbitMQ
Redis
MongoDB
MySQL
CLOUDS PUBLIC PRIVATE MICRO
Application developers (DEPLOY)
Application service providers
(SCALE/Control)
- This exhibition is presented by NTT and NTT Communications. NTT Communications will provide Cloudn PaaS service for developers in Mar. 2013. Cloud Foundry is a trade mark of the VMWare, Inc.
「Cloudn PaaS」 http://www.ntt.com/cloudn/data/paas.html
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-3
Log analysis engines for global SIEM platforms
Detecting Security Threats and Creating Intelligences
Cloud/Security
Security infrastructure
■ Analyzes long-term time series logs to promptly find evidence of unblocked attacks (e.g., information leakage, targeted attacks, etc.).
■ Detects unknown malicious sites by analyzing co-occurrence, which is a characteristic of connecting patterns observed in malware-infected machines. Our engine provides optimized blacklists to individual customers after analyzing their log data.
■ Supports security information analysis by automatically extracting security related information from a large amount of social information (e.g., Twitter data, news articles, etc.). The security related information is used to detect evidence of attacks.
■ Operating in a MSS platform which is developed for global customers. ■ Enhancing security operations for enterprise/in-company networks. ■ Promoting efficiency of public monitoring operations of CSIRT
(Computer Security Incident Response Team) activities.
*1 SIEM: Security Information and Event Management *2 SOC: Security Operation Center *3 SIGINT: Signal Intelligence *4 HUMINT: Human Intelligence
Features
Application Scenarios
NTT Group Global Advantage We plan to deploy our engines in the Global MSS Platform developed by operating company. The platform will provide a managed security service to customers in Asia, Europe, and the US. We will also apply our engines in CSIRT activities.
To improve security operations for/by whole NTT Groups, we have developed log analysis engines that can detect evidence of unblocked security threats and provide additional knowledge (e.g., unknown malicious sites and security related information) to an intelligence database. Our engines will be applied in a MSS (Managed Security Service) which uses SIEM platform and in other security operation activities.
Log storage
Basic analysis engine
Trove (Advanced SIGINT*3
analysis engine)
Normalization
Acquisition
Network Security appliance Server/Client
Customer portal/Dashboard
Security intelligence
Customers SOC*2 operator
Alert/Log etc. Alert/Log etc. Packet data/Flow Data/ Alert/Log etc.
SIEM*1 platform
Sagacitas (Advanced
HUMINT*4 analysis engine)
Jubatus
Log management platform
News etc.
- This technology is a joint R&D work with NTT Communications Corporation.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-4
Cyber attack monitoring system
Constant Monitoring and Visualization of Cyber Attacks
Security infrastructure
■ Visualization of data observed on computers such as decoy systems (honeypots) gathering malware infection attacks or malware dynamic analysis systems, as well as data observed on networks such as spam mail or Denial of Service (DoS) attacks.
■ Cross-sectional monitoring of various kinds of cyber attacks from multiple perspectives, especially focusing on NTT Lab’s blacklist information, such as “attack-source IP addresses” and “malicious URLs”, which infect users.
■ Real-time visualization of latest malware infection attacks by collaborating with “RELIEF”, NTT Lab’s blacklist providing system.
■ Grasp an accurate picture of diversified cyber attacks ■ Precisely identify attacks causing specific threats and anomalies ■ Promptly begin response for latest cyber attacks
- This technology is a joint R&D work with NTT Communications Corporation (contact: [email protected])
Features
Application Scenarios
NTT Group Global Advantage The blacklist provided by “RELIEF” for malware countermeasures is being used by security businesses in North America, Europe, and Asia, via the global managed security service platform deployed by operating companies.
Realize visualization of cyber attacks, which enable the cross-sectional monitoring of incidents observed on computers and networks, to counter emerging threats that are becoming difficult to monitor as they continue to diversify on a daily basis. The information identified by monitoring can be utilized for countermeasures, such as alert notification or as the base information for attack filtering.
NTT R&D
Operators in user
environment
Cloud environment Protection appliances
User network
Cross-sectional monitoring of various types of cyber attacks to identify origins of attacks
Filter configuration Alert
notification
“RELIEF” Blacklist for Malware
Countermeasure
Service providing systems, etc.
Blacklist information for malware countermeasure
Gather spam mail and DoS attack
information
Malware dynamic analysis
Decoy systems (Honeypots)
Analysis of gathered information
Operators at operating companies
Service providing environment at
operating companies
Internet
Malware detection, gathering, and analysis
Cloud/Security NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-5
Secure computation system
Enables Safe Statistical Analysis of Confidential Data
Cloud/Security
Security infrastructure
■ The system enables data to be secret-shared and analyzed without reconstruction. There is no need for anyone to observe raw data.
■ The system achieves data confidentiality and availability through secret sharing technology. The data are distributed in a secure form that does not give away an information about the data.
■ The system can perform arithmetic operations, estimate basic statistical parameters such as average, variance and median, and statistical methods used in medical research, such as the t-test and Kaplan-Meier method.
■ Making secondary use (e.g., clinical studies, gene analysis) of patients’ health data in the medical field.
■ Performing marketing analysis of information about users’ assets the finance field.
- Since February 2012 we have been conducting a collaborative experiment with Japan Adult Leukemia Study Group (JALSG). It was verified that the secure computation system we have developed could analyze clinically epidemiologic data in a fast and practical manner.
Features
Application Scenarios
NTT Group Global Advantage NTT Corporation leads the world in the implementation of secure computation systems. It achieves world-leading performance in both fundamental operations such as multiplication and advanced ones through our original secure algorithms.
Secure computation is a technology that enables one to perform statistical analyses with secure data management for both data providers and operators. The secure computation system enables data to be secretly shared and statistically analyzed with no reconstruction, thereby enabling secure utilizations of highly confidential data such as clinical data with less information security compromise risk.
Secret Sharing (Secure data storing)
Secure Computation (Secure data analysis)
?
?
?
Distribute confidential data through secret sharing on several servers
Analyze secret-shared data with no reconstruction
Data files Analysis results
Clouds
World-leading performance
NTT Research and Development 2013 Review of Activities
Contents
Innovation for Next Value Service
User experience
Open and seamless usage environment
Contents
Personalized service
User interface
Services utilizing the cloud
S-6 S-7
Information division/cooperation technology applicable to HTML5 Contents Follow User Situation Changes Millimeter-wave (60-GHz band) non-contact high-speed transmission systems Instantaneous Transfer of High-Volume Content at a Touch
S-8 S-9 S-10 S-11 S-12
Statistical machine translation between English and Japanese with accurate word order Robust Statistical Machine Translation for Japanese Real-time robust media search technology on smartphones Viewing Information Related to Audio/Video in front of You Visual/video synchronizing AR based on mobile video watermark technology Dancing Synchronized with Video on Your Tablet: Visual SyncAR Automatic speech recognition for mobile/smart devices High-Quality Voice Input Interface Interactive live video encoding and streaming Viewing Live Video While Freely Selecting the Area to View
Contents S-13 S-14
A new method to read dynamic text on tablet PCs Reading Digital Text as if It Were Spoken Words ICT service design technology Designing User Experience for ICT Services
A service architecture enabling new real-time communication experiences When an Image is Taken with a Camera, ( ゚д゚)?? Changes into (゚∀゚)!! Healthcare platform for cooperation between medical and nursing care with Continua-based mHealth system Secure Healthcare ICT Solutions for Super-Aging Society
S-15 S-16
Contents
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-6
Information division/cooperation technology applicable to HTML5
Contents Follow User Situation Changes
User experience
Open and seamless usage environment
■ The user can continue to use a service seamlessly, even if the devices used are changed, as long as there is an HTML5 browser.
■ The content providers have only to complete content within a web page, meaning they can focus on content production without having to consciously develop and test synchronization and communication among devices.
■ Because our technology manages relationships and conditions among elements and devices, service providers can distribute loads on portal servers when providing coordinated service among devices.
■ Providing video delivery service that can be watched in a “My Style” manner
■ Providing SNS or file sharing service among family members ■ Providing remote collaborative games
Features
Application Scenarios
NTT Group Global Advantage Because this technique is built on the basis of the global standard HTML5 specification, it is easy to expand it to services overseas. It is also effective in increasing the differences in content delivery services NTT provides overseas.
We propose a technology to divide/allocate web content elements among devices in accordance with user situation changes. The demo will show you how the elements are freely transferred among smartphones, tablet devices, and television sets when user situations are changed. Users can configure their systems in a “My Style” manner that suits their preferences and the devices they want to use.
Web server
By oneself, one device
By oneself, multi devices
×
Related information
Captions
Signs
Captions
Captions
Related information
Web page
Captions
Signs Related information
Achieve device cooperation without server-side programs.
Device state management and synchronization traffic is not generated.
Related information
Signs
Information division/ cooperation technology
Together, separately
Seamless
Seamless Seamless
Synchronization
Synchronization
Synchronization
Together, multi devices
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
High-speed transfer by using highly integrated millimeter-wave module
S-7
今年度から「グローバルアピールポイント」枠を設けます。 3行程度まで。フォントサイズ(12point)、フォント種の変更は不可です。
NTT Group Global Advantage The 60-GHz band is maintained as a global unlicensed band, which enables this system to be developed globally. NTT has contributed to standardization activities of 60-GHz wireless communication systems standards.
■ Enabling smartphone and tablet PC users to download content such as films and magazines merely by touching their portable devices to a Kiosk terminal in a public area.
■ Enabling users to use their portable devices to upload their personal data files to social networking services or online storage services.
Content distribution
Network
Network Terminal
(Smart phones or tablet PCs)
Feature #2
Feature #3 User authentication
Features
Application Scenarios
Instantaneous Transfer of High-volume Content at a Touch
Millimeter-wave (60-GHz band) non-contact high-speed transmission systems
This service uses wireless communications over a 60-GHz unlicensed band to enables instantaneous high-volume content transfer. Users of smart phones or tablet PCs can make use of this feature for high-speed uploads and downloads. High-speed transfer is enabled by using highly integrated millimeter-wave modules developed by NTT.
■ Feature #1: It takes more than a minute to download one DVD (4.7GB) with conventional wireless systems. This service, however, will download it in 10 seconds, which is an acceptable waiting time for web browsing.
■ Feature #2: We are developing new fast user authentication and content management functions in order to enable uploading/ downloading from remote locations.
■ Feature #3: We are planning to integrate a fast-authentication ID chip into a millimeter-wave module presently being developed.
Hospital
Medical information
Home visits Doctor’s rounds
Takeout
HGW/ Home media server
HDD video recorder
Digital signage/ Kiosk terminal
Contents holders
Enterprise Home
Train station/Airport/ Convenience store
Public area
Home network
Museum/Exhibit hall
User authentication
Exhibit information
Gate
Digital signage
User experience
Open and seamless usage environment
Feature #1
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-8
Statistical machine translation between English and Japanese with accurate word order
Robust Statistical Machine Translation for Japanese
User experience
Personalized service
■ Provides accurate English from/to Japanese translation intermediated by “Japanese-ordered English”, based on Japanese grammatical characteristics.
■ Enables users to readily develop a translation engine with their own translation rules specific to their use, using bilingual texts in target domains.
■ Works better than conventional rule-based machine translation in English-to-Japanese patent translation.
■ Searching over Japanese patents in English ■ Providing cross-lingual communication support with a translation
engine tuned for user’s own use
Features
Application Scenarios
NTT Group Global Advantage This new translation framework significantly improves performance in translating between English and Japanese and will help to overcome the communication barriers between different languages.
Statistical machine translation is a promising machine translation technology without complex hand-crafted translation rules. However, it does not work so well for translation between English and Japanese due to their large difference in word order. This technology provides accurate English from/to Japanese translation with precise word reordering based on Japanese grammatical characteristics.
Fig. 2 is a sectional view of the device shown in Fig. 1.
Fig. 2 は Fig. 1 in shown device of sectional view is.
図2は図1に示す装置 の断面図である。
Bilingual text (newspaper)
device shown in Fig . 1 図 1 に 示す 装置
Fig . 1 in shown device
modifiers precede modifyees
Bilingual text (patent)
Reorder words based on modifer-modifyee
relationship
(modifier-modifyee relationship)
Translation rules (newspaper)
Translation rules (patent)
Translation rules (Company X)
Conventional statistical machine translation English Japanese
Ja-ordered English
Learn rules from translation patterns
Fig. 2 is a sectional view of the device shown in Fig. 1.
図2は図1に示す装置 の断面図である。
Translation engine Use rules
En→Ja Ja→En
Accurate translation with correct word order
Fig. 2 is the device shown in Fig. 1 of a sectional view.
Typical error with wrong word order
Bilingual text (Company X)
modifiers precede modifyees
Task-specific translation rules
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-9
Real-time robust media search technology on smartphones
Viewing Information Related to Audio/Video in front of You
User experience
Personalized service
■ A segment length of a few seconds to ten seconds is sufficient for a search key.
■ The technology is robust against noise, occlusion, and editing. ■ It is not necessary to embed information in the media contents. ■ Real-time database registration enables searching for live
broadcasts. ■ The database size and accuracy can be configured to suit the
user’s requirements. ■ A search engine can be implemented on a smartphone. This
enables a server-less media search system for the small database.
■ Searching for information using an audio/video segment captured by a smartphone.
■ Synchronizing an advertisement system to broadcast video, music, or commercial messages.
■ Collaboration with digital signage on a street corner.
Features
Application Scenarios
NTT Group Global Advantage The RMS technology has world’s top level search performance and high reliability. It has been widely used in many commercial services not only in Japan, but also in the US and China.
Robust Media Search (RMS) is a core technology for audio and video search. It searches a database using an audio/video signal captured by a smartphone. The captured signal is used as a search key instead of text keywords. This technology is applicable to various kinds of content navigation systems including content-based media search and advertisements synchronized to media data.
Application example
Audio Video
Search server
RMS platform
Feature extraction server
Feature database
(1) Capturing audio and video
(2) Feature extraction and search request
(3) Search results (4) Related information
Content database
Music and video
Broadcast
Feature data and related information
Outline of feature extraction Audio
Audio feature data
Freq
uenc
y
Time
... ...
Video Video feature data
7
7
7
7 7 1
1
1 1 1
1 1
1 2
2
2 2 3 3
3
4 4
9 9
9
9
7
0 4 4 3
1 1 3 4
1 1 0
0 1
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
Amu Hikary ヒカリ ・ アミュ
Title: Shining Days
Try and buy: http://amu.jp/
S-10
Visual/video synchronizing AR based on mobile video watermark technology
Dancing Synchronized with Video on Your Tablet: Visual SyncAR
User experience
Personalized service
■ Fast synchronization: Playback timing is estimated by detecting watermark ID that varies scene by scene using mobile video watermark technology, which enables fast detection of watermarks even through a tablet/smartphone.
■ Trick play support: Displays synchronized information or CGs even if the video is rewound or replayed.
■ AR overlay: CG or other information is overlaid in a position on the screen following the camera motion using a function that quickly detects the screen area, even when it is captured sideways or from far away.
■ Video entertainment services such as TV programs, music clips, etc.
■ Personalized information services for digital signage, in which specific information is overlaid for individual viewers, e.g., a foreigner or hearing-impaired person.
Features
Application Scenarios
NTT Group Global Advantage NTT has developed the world’s first video-synchronizing AR technology. This enables new visual experiences that combine video with other information.
Visual SyncAR, a novel AR (Augmented Reality*1) technology, displays various kinds of information in synchronization with video timing and visual position using an embedded digital watermark*2. This technology enables new visual experiences such as 3D characters that dance to artists’ video clips when they are viewed through the camera of tablets or smartphones.
*1 Augmented Reality: technology that allows computer generated virtual scenes to be combined with real scenes in a composite view in order to augment the real scene with additional information. *2 Digital watermark: technology in which information such as a logo or ID number is embedded into original video media with minimal perceptual degradation.
Digital watermark is embedded in video
content. The watermark is detected quickly
from captured video.
Computer Graphic (CG) or text is overlaid on scene in synchronization with the
video timing and position.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-11
Automatic speech recognition for mobile/smart devices
High-Quality Voice Input Interface
User experience
Personalized service
■ Feature #1: Speech enhancement technology: Our innovative technique accurately detects speech input while suppressing noise in a noisy environment.
■ Feature #2: Language processing: Our recent advances include reinforcement of language modeling for spontaneous utterances, which improves recognition accuracy, and language processing, which enables us to make a more intelligent speech application.
■ Feature #3: Discriminative training: Speech recognition is negatively affected by device dependency on microphone characteristics and noise. To overcome this problem, discriminative training for the speech recognition models is effective.
■ Voice input interface as a text input method for mobile and smart devices.
■ Speech document retrieval, speech agent, speech command, etc.
Features
Application Scenarios
NTT Group Global Advantage Using the state-of-the-art speech enhancement and automatic speech recognition technologies, NTT provides a user friendly voice input interface, which performs accurately in a wider area than ever before.
Our automatic speech recognition technology provides a voice input interface for mobile and smart devices that performs accurately even in noisy places. This is possible due to our recent progress in speech enhancement and language processing technologies. Our voice input interface can be easily accessible through a client API communicating with a recognition server on a cloud platform.
Speech
Reduce recognition errors by modeling conversational words, such as fillers, accurately
Application Speech recognition server
Text Speech recognition engine
VoiceRex
(noise) n e x t s t e p (noise)
Detect speeches accurately
Noise suppression
/a/ /o/
Increase the discrimination ability of feature distributions and decrease recognition errors
Feature #3: Discriminative training
○○○ △△△ ◇◇◇
Ah..○○○. da da .. △△△.
◇◇◇ yeah
(noise)
n e x t s t e p (noise) Feature #1: Speech enhancement technology
Feature #2: Language processing
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-12
Interactive live video encoding and streaming
Viewing Live Video While Freely Selecting the Area to View
■ Viewing while freely selecting and zooming in on enjoyable parts through intuitive Android tablet manipulation.
■ Viewing while freely selecting between one high resolution video camera and panoramic video cameras.
■ High-quality live streaming within a limited network bandwidth by delivering user-selected video segments.
■ Distributed computing using connected PC cluster to enable real-time tile segmentation and encoding.
■ Providing high-quality live streaming for live events such as concerts or sports events.
■ Providing high-quality live streaming for school events such as stage plays or sports events.
Features
Application Scenarios
With our interactive video system, users can view high-resolution video images of the stage area or freely select and zoom in on an area of interest. They can also enjoy more realistic viewing by changing the view angle of panoramic video cameras located in the auditorium, passages, and elsewhere. This interactive live viewing gives users a highly realistic feeling of actually being at the event site.
User A Event site
User B
Cloud Network Network
Stage
High resolution video camera
Auditorium
Passage
Panoramic video cameras
Distributed computing enabling real-time tile segmentation and encoding
Encoding cluster
Live streaming
server
High-quality live streaming within a limited bandwidth
FTTH +
Wi-Fi /
LTE
Scrolling by flick manipulation
Viewing while freely switching camera
Viewing while freely selecting and zooming in on enjoyable parts
User experience
Personalized service
NTT Group Global Advantage The compressed live video stream is formed in accordance with H.264 Annex H. NTT contributes to standardization of the next-generation video compression standard HEVC.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
Transmitting/receiving trailing position data Text data
Trailing position
Control letters’ color
[Feature #1] Text display using User’s trailing behavior
[Feature #2] Manipulating reading expression
Text appears only in the location trailed by the user
Manipulating time course settings of dynamic color changes leads to various reading impressions.
Sharp and hard impressions
Soft and warm impressions
Time
A A A A A
A A A A A
[Feature #3] Reading with multiple persons on a wireless network.
Communicating trailing position data wirelessly provides text display synchronized with other users’ behavior.
User1 User2
Measurement of reading expression between different time course settings (42 observers in total, Maruya et al., 2012)
Rat
ing
scor
e
7 6 5 4 3 2 1
Soft Warm
Static display
Static display
Har
d
← →
Soft
Time course setting Novel type text Explanation type text
Col
d ←
→
War
m
S-13
A new method to read dynamic text on tablet PCs
Reading Digital Text as if It Were Spoken Words
User experience
User interface
■ Feature #1: When users touch the screen, text appears gradually in the touched place and gradually fades out. Users can read the text in an active and voluntary manner through their trailing behavior.
■ Feature #2: Various reading impressions can be generated by manipulating the temporal course of changes in the contrast of letters.
■ Feature #3: Communicating finger position data wirelessly provides text display synchronized with other users’ behavior.
■ Communicating private messages that only the user can read ■ Displaying decorative text effects to express delicate and subtle
nuances ■ Creating novel types of interactive literature or reproducing
existing literature ■ Providing education materials to support dyslexic children and
adults with reading difficulties
- A part of this study was done in collaboration with Dr. Hideyuki Ando (Osaka University) and Dr. Miki Uetsuki (Hakodate Junior College)
Features
Application Scenarios
NTT Group Global Advantage The proposed method is a novel way to show digital text. It uses trailing behavior to create a text display that provides deep interaction between persons and text contents, regardless of the users’ language.
We propose a new method for using a tablet PC to display digital text, in which the contrast of displayed letters is changed dynamically in response to users’ trailing behavior. The dynamic and interactive text display provides deeper and richer impressions than those given by a static text display used in conventional software.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-14
ICT service design technology
Designing User Experience for ICT Services
User experience
User interface
■ We extracted design tips that enhance UX by analyzing web site screens and application screens.
■ We categorized the design tips on the basis of human information processing mechanisms that cognitive science and marketing science revealed.
■ We described the design tips by taking the NTT Group’s philosophy and brand image into consideration.
■ We proposed a practical handbook that contains various examples that help designers to understand and implement the design tips.
■ The handbook encourages service planners to try to understand what is going on in users’ minds to help them design innovative ICT services.
■ The handbook also helps service developers to design and revise GUIs of web sites and applications.
Features
Application Scenarios
NTT Group Global Advantage We analyzed web sites including those of top-brand companies and telephone companies to extract design tips. The analysis process is based on human information processing mechanisms that were revealed by the developments in cognitive science.
We propose a novel handbook for designing GUIs that enhances User Experience (UX) of Web services and applications. We extracted design tips by researching NTT Group’s brand image and analyzing GUIs on the basis of human information processing mechanisms. Using these tips results in increased usage, reduced operational failures, and improved customer impressions.
Cool
Luxurious Smart
Cute
Novel
Delicious
Consistent
Safety & Security
Confidence
Approval
Honest Friendly
Clear
Simple
Extracted impressions
3. Architecture & Interaction
ex. The objective should be understood within 5 sec. ex. There should be as few steps as possible.
1. Appearances
ex. Layouts of UI components should be simple and consistent ex. Variety of font types should be selected carefully
2. Text Information
ex. Sentences should be short ex. References should be clarified
Well refined
Quickly understood
Easily handled
Extracting the impressions That affect images
Over 155 applications and 510 web sites’ GUIs analyzed!!
・・・ more than 20 impressions
Researching reports, CSRs, philosophies
3
on the basis of the human information processing mechanisms
Extracting key designing tips
Researching NTT’s image
1
Analyzing web sites designs & applications
2
Using design tips results in increased of usage, reduced of operational failures, and
improved of user impressions
The handbook can be utilized for screen
design
Drawing up a handbook
contains 33 design tips
4
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
■ You can instantly obtain information on what you are looking at but have no idea what it is by taking an image of it with a camera.
■ An advanced image recognition technology frees you from worry about how to take an image.
■ Your (mobile) device needs no special advanced sensors or capabilities, only very common image capture, transmission, and display capabilities.
S-15 When an Image is Taken with a Camera, ( ゚д゚)?? Changes into (゚∀゚)!!
Features
We are developing a service that allows users to easily get answers to their questions. The examples below are for a “concierge-like” service that advises about objects, people, and scenes you take images of with a camera. The advice comes from multiple simultaneous real-time image/knowledge queries made on a cloud.
A service architecture enabling new real-time communication experiences User experience
Services utilizing the cloud
- Some results obtained through the cooperation of Fraunhofer FOKUS are included.
Image Recognition
She is Rola.
Cloud
It is a “Piranha Pizza Cutter.” A video clip for the shrine is found.
Knowledge Search
It tastes similar to the “Shaaekine” I drank yesterday.
宝歓神社 宝歓神社は十二神を
祀り、古代から重要
な地位を占めてきま
した。
また宝歓神社の建造
物は平成0年に国か
ら重要文化財の指定
を受けています。
宝歓神社は十二神を
祀り、古代から重要
な地位を占めてきま
した。
また宝歓神社の建造
物は平成0年に国か
ら重要文化財の指定
を受けています。
NTT Group Global Advantage This research is being done in cooperation with Fraunhofer FOKUS in Berlin. NTT and FOKUS are developing an architecture to control and carry out media processing for real-time communication (e.g., multi-party video conference) over a cloud in a flexible and efficient manner.
■ Finding the name of a person and/or object at which you are looking.
■ Getting shopping advices. ■ Making inquiries without speaking in places where silence must
be kept.
Application Scenarios
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-16
Healthcare platform for cooperation between medical and nursing care with Continua-based mHealth system
Secure Healthcare ICT Solutions for Super-Aging Society
User experience
Services utilizing the cloud
■ Providing regional clinical pathways between medical providers and home care support providers.
■ Ensuring continued medical service and health care in disaster areas. ■ Providing health check services to developing countries deficient
in medical resources.
Features
Application Scenarios
NTT Group Global Advantage NTT delivers ICT solutions for healthcare to the world and improves Continua-based mHealth system so that it can spread in developing countries, utilizing its practical experience in doing experiments and beginning businesses.
Hopes are being expressed that integrating and utilizing personal healthcare information will help to solve the crisis Japan’s health insurance system is facing. With this in mind, we have developed an electronic health record (EHR) platform for handling high-security medical data and a personal health record (PHR) platform for handling daily health data. These platforms make it possible to securely distribute healthcare information among medical institutions and homes.
Personalized medical and health service based on various pieces of information
Daily health check for nursing care
Steps Weight
Blood pressure
OpenID
NTT Cloud
PHR platform
Authentication server
Data exchange
Data upload
ID exchange Authentication exchange
Access control Access log record
Healthcare provider
Medical and health information
Health data
Prescription
Medical checkup
Treatment
Feature #3
Smartphone
Continua WAN-IF
Continua HRN-IF
Home
Feature #1
Home care support provider Other home
care support providers
mHealth
EHR platform Feature #2
Clinic
Treatment Module
Module
Hospital
Medical checkup
Module
Pharmacy
Prescription Module
SAML/ID-WSF Portal
Integration and utilization of personal information
Module
Exchange gateway
SOA Platform
Module
■ Feature #1: Comprehensive utilization of medical and health information through an EHR platform based on SAML*1/IDWSF*2 and a PHR platform based on OpenID*3.
■ Feature #2: Secure utilization of healthcare information under access control and access log records, and flexible organization of regional clinical pathways by using SOA platform framework*4.
■ Feature #3: Mobile device utilization enabling easy and convenient measurement, uploading, and use of health data (mHealth) that conforms to industrial standards (Continua WAN-IF*5 and HRN-IF*6).
*1 Standard for exchanging identification and authentication, established by OASIS. *2 Standard for distributing attribute information, established by Liberty Alliance. *3 Standard for exchanging authentication, established by OpenID Foundation. *4 Intra-mart (a product of NTT DATA INTRAMART CORPORATION) is used. *5 Interface between application hosting devices and PHR. *6 Interface between PHRs.
Health data
Patient Patient Doctor
NTT Research and Development 2013 Review of Activities
Contents
Innovation for Next Value Service
BigData
Machine learning/Data analysis
Contents
Data collection
Contents
S-17 S-18
Technique to estimate personal profiles from users' words What Type of Person Tweeted? Large-scale data mining Efficiently Discover Hidden “Relationships” in Big Data
S-19 S-20 S-21
Virtual sensor construction technique for participatory sensing environments Consolidate Participants' Sensing Data for Ease of Use Ultra-small, ultra-low power wireless sensor nodes with energy harvester Gather Events from Things Distributed over Surroundings Passive-type device information aggregation system Visualizing Device Information in Home and Office
S-22
Scalable distributed computing framework for real-time analysis of big data Smarter & Instant Analysis of This Huge Surging Present: Jubatus
Data processing infrastructure
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-17
Technique to estimate personal profiles from users’ words
What Type of Person Tweeted?
■ Marketing analysis of desired segments using big data acquired from many users on the web by selecting personal profiles is possible.
■ Estimating personal profiles based on machine learning method using characteristic words of each profile.
■ Gender words: “Korean boom”, “Bath” → Woman. “lunch” → Man
■ Occupation words: “Company”, “business tour” → Office worker. “husband”, “lunch bag” → Housewife
■ Marketing analysis service: analysis of desired user segments from big data on the web.
■ Word-of-mouth analysis service: obtain word-of-mouth information from similar users.
Features
Application Scenarios
We developed a technique for estimating personal profile information, such as gender, age, place of residence, civil status, and occupation, from daily messages posted by users. This technique is able to analyze the attribute distribution of who tweeted about a product and to analyze word-of-mouth of desired user segments.
Distribution of personal profiles
Personal profile estimation
Office worker 20’s
Woman Married
Kanto
Office worker 30’s
Woman Single
Kinki
Housewife 30’s
Woman Married
Kyushu
Tweets about “Bags from Company ABC”
Occupation Gender
Office worker Word-of-mouth
Housewife
- Appealing design - Suitable size
- Heavy - Too small
Woman Man Student
Housewife
Office worker
BigData
Machine learning/ Data analysis
NTT Group Global Advantage NTT developed a technique for estimating what type of person tweets information. The technique supports Intelligent big data Analysis.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-18
Large-scale data mining
Efficiently Discover Hidden “Relationships” in Big Data
BigData
Machine learning/ Data analysis
■ Our graph mining algorithms achieve the fastest speed in the world (more than 10 times faster than existing algorithms).
■ The algorithms handle large-scale graphs with hundreds of millions of nodes with a single PC server.
■ The supported graph mining algorithms are clustering and top-k Personalized PageRank.
■ The algorithms are implemented as a library of two general-purpose programming languages; Java and JavaScript.
■ The library is available as a plug-in in graph analysis tool “Gephi”.
■ Applicable for community discovery, user or content recommendation in social graphs, such as SNS and twitter, and in web page search.
■ Useful in general graph analysis made by Gephi.
Features
Application Scenarios
NTT Group Global Advantage NTT has developed graph mining algorithms achieving the fastest speed in the world. Improving the speed of graph mining makes it possible to be applied for large-scale data, so called big data.
We have developed efficient graph mining algorithms for analyzing large-scale graph data such as social graphs. Graph mining is to discover hidden relationships in graphs by analyzing the structure of the graphs. We achieve high-speed graph mining for large-scale data such as clustering, Personalized PageRank, and graph diameter analysis.
Clustering
Graph mining library
Top-k Personalized PageRank
Various graph data
Social graph (Facebook, Twitter)
Web pages
Applications
API - Java - JavaScript
Efficient algorithms
- Graph analysis made by Gephi - Community discovery and recommendations
Implemented in general-purpose programming languages
Discover closely connected groups
Discover important nodes
Node
Edge
Baseball community
Influencer
Soccer community
Social graph
Social graph
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-19
Virtual sensor construction technique for participatory sensing environments
Consolidate Participants’ Sensing Data for Ease of Use
BigData
Data collection
■ Feature #1: Sensing data collected in a participatory sensing environment tends to be noisy due to the use of low accuracy sensors or a mix of sensors with diverse accuracy. To solve this problem, the proposed method expands the sensed regions while preserving their spatio-temporal patterns. This method achieves statistical estimation of the population means of sensor data in each region.
■ Feature #2: In participatory sensing environments, the sensors and sensing area depend on users. Therefore, data as a whole is unevenly distributed and incomplete. To solve this problem, the proposed method estimates the missing data and enhances the data coverage ratio by using the local correlation with heterogeneous sensor data.
■ Visualizing congestion in towns, roads, or transportation means. ■ Navigating appropriate routes for kids, elderly people, or people
with pets or baby buggies. ■ Issuing alerts not to go into areas where allergens may exist.
Features
Application Scenarios
NTT Group Global Advantage For participatory sensing, which is attracting global attention, NTT is among the first to focus on data defectiveness and start research and development of reliable virtual sensor construction technique.
It is expected that sharing data many users have collected using their devices will enable grasping of various situations around the world. This type of data sharing achieves participatory sensing. In line with this approach, we propose a virtual sensor construction technique that enhances sensor data quality by consolidating it, thus creating the illusion that reliable sensors exist everywhere.
Virtual Sensor Construction Technique
Acceleration
Temperature Navigate a route by which a baby buggy can easily
move
Alerting persons to allergens and asthma causes
Virtual Sensor Recommending walking routes to protect dogs
from paw burns on asphalt roads
Changes in barometric pressure
High temperatures on asphalt roads
Bumpy roads
Feature #2
Estimating missing data by using its correlation with heterogeneous sensor data
Statistically estimating population means of sensor data by expanding sensed regions while preserving their spatio-temporal patterns
Barometric pressure
Participatory Sensing Feature #1
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
Conventional
S-20
Ultra-small, ultra-low power wireless sensor nodes with energy harvester
Gather Events from Things Distributed over Surroundings
BigData
Data collection
■ Feature #1: The energy harvester enables us to avoid concerns about battery life and cost.
■ Feature #2: The ultra-small wireless sensor nodes can be combined with raw materials for clothes or facilities.
■ Feature #3: These two features are realized by pulse modulation with intermittent driving RF circuits, electrically small antennas constructed with RF circuit design in mind, and three dimensional integration using small-size printed circuit boards.
■ Monitoring the condition of concrete structures. ■ Providing routine services such as health care, home security,
electricity monitoring, agriculture support, or human activity support.
■ Storing all data, distributing it anywhere, and learning phenomena to forecast future events of minor consequences.
Features
Application Scenarios
NTT Group Global Advantage In a sensor network market expected to grow in scale to several trillion yen, these wireless sensor nodes feature ultra-low power and ultra-small size and enables 10-meter transmission in line-of-sight conditions with a millimeter-size energy harvester. These features make the development of new applications possible.
A wireless sensor network’s ability to gather and analyze trivial information can lead to new services. Our concept is to make wireless sensor nodes (WSNs) ultra-small and drive them with ultra-low energy generated by ambient sources. The fabricated WSNs can be mounted on small things like plants or screw threads without hampering their volumes even though the things have no power source.
Wireless sensor nodes
Gather Transmit Analyze
Optical/3G/4G networks
Servers
Sensor Network with Ultra-Small Wireless Sensor Nodes
5 mm
Wireless IC
Antenna
Solar battery
Vibration sensor
Capacitor
Ultra-small wireless sensor node
Network
Feature #3
Feature #1, 2
Power consumption Proposed
Time Quick start-up circuit and pulse modulation with intermittent driving RF circuits can reduce total power consumption.
5 mm
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
S-21
Passive-type device information aggregation system
Visualizing Device Information in Home and Office
■ This system can be used to help operators who receive customers’ inquiries from ICT support service. The operators can effectively answer the inquiries by using device information in the customers’ environment, which had been clarified through oral consultation.
Features
Application Scenarios
NTT Group Global Advantage The device information aggregation module is implemented as a bundle for the OSGi platform. Because this implementation is based on the standard, it can be applied to various service gateway appliances.
Aggregate device information from the information on the network
Passive-type information
Information aggregation server
Help desk
“Television has been connected to network.”
Service provider’s server
http header information has been acquired.
SNMP information has been acquired. Web access
We have enhanced the range of device information aggregation from devices installed in the office and home by a system that involves the following two types of techniques: active-type aggregation, which aggregates device information based on explicit demands, and passive-type aggregation, which aggregates the information by capturing the messages exchanged among devices. We have also developed a function that visualizes the device state based on the aggregated data and a data management function.
“Print this file!”
“Sure! But there is little ink left.”
“There is little ink left.”
aggregation
BigData
Data collection
■ In addition to the demand response information aggregation (active-type) technique, our proposed system can aggregate information from devices, whose information could not be aggregated with the active-type technique by capturing the information on the network.
■ The operator can view the model number and configurations obtained from aggregated device information.
■ This system’s architecture can store large-scale data to provide services to a large number of customers. This system enables developers to develop new applications based on the large-scale stored data.
NTT Research and Development 2013 Review of Activities
Copyright © 2013 NTT. All Rights Reserved.
<Contact>[email protected]
■ Providing real-time analysis for fraud detection, natural disaster forecasting, marketing and making predictions relevant to the stock market, health risks, life sciences, etc.
■ Feature #1: Real-time analysis: High-speed analysis without data accumulation, e.g., complete outlier detection of handwritten images, with 120,000 feature points, within one second.
■ Feature #2: High scalability: Scales linearly with the number of commodity servers (up to 100 servers), e.g., 14.9 times for 16 servers.
■ Feature #3: Profound analysis: Able to deploy sophisticated algorithms such as machine learning algorithms, e.g., Its accuracy rate in handwritten image outlier detection is over 90% in batched processing.
S-22 Smarter & Instant Analysis of This Huge Surging Present: Jubatus
Features
Jubatus is a scalable distributed framework for profound real-time analysis. An accuracy rate of 90% in batch processing was achieved with four times faster (within one second) than batch processing for anomaly detection in handwritten characters. Through our open innovations, we incubate many applications such as “real-time marketing” and “smart management of social infrastructure”.
- This technology is collaborative work with Preferred Infrastructure Inc. and with the OSS (Open Source Software) community. http://jubat.us
今年度から「グローバルアピールポイント」枠を設けます。 3行程度まで。フォントサイズ(12point)、フォント種の変更は不可です。
Scalable distributed computing framework for real-time analysis of big data Data processing
infrastructure
BigData
Public & Science
Industry Legacy
Climate, Security cameras, Medical imaging, …
Manufacturing, Customers, Sales, Accounting, ...
System Data Logs, Messages, Web analytics, Spam lists, ...
Environment Biz/Gov./Social
CRM
SCM
ERP/BI
2 Real-Time Analysis 1 Big Data Stream 3 Smart Action
Supported Analysis Engine (Feature #3) Classification : classify data to multi-group Regression : estimate output from input Statistics : estimate entropy of input Recom- mendation
: recommend similar data; estimate unknown attributes
Graph mining : graph shortest-paths, calculate centrality
Anomaly detection
: detect outliers from given data
NEW
Competition
- Twitter categorizing - Spam mail judgment - Stock market
predictions - Sensor monitoring - Search advertising - Influencer analysis - Traffic analysis etc. …
Feature #1 Real-time Batch
Simple
High-speed Less accurate
OSS Sophisticated NTT Group Global Advantage
NTT aims at the popularization of Jubatus-related technologies and business, so as to contribute to big data information processing, through world-wide open innovations.
Features
Application Scenarios
Feature #3: Profound
NTT Research and Development 2013 Review of Activities