adding hmito your application and ... - renesas electronics
TRANSCRIPT
© 2016 Renesas Electronics Corporation. All rights reserved.
ADDING HMI TO YOUR APPLICATION AND INNOVATING YOUR DISPLAY
Lake Garda7-8 April 2016
© 2016 Renesas Electronics Corporation. All rights reserved.
AGENDA
Page 2
HMI with Synergy
The Hardware
HMI with Synergy
The Software
SSP & GUIX Studio
© 2016 Renesas Electronics Corporation. All rights reserved. Page 3
Synergy Family HMI Capabilities
Technology
Capacitive Touch Sensing Unit
Graphics LCD Controller
2D Drawing Engine
JPEG Codec
Parallel Data Capture
Segment LCD Controller
Built-In HMI Features
© 2016 Renesas Electronics Corporation. All rights reserved. Page 4
Synergy Family HMI Hardware
S7DK : Development kit
480 x 272 TFT with Resistive Touch Screen
S7PE-HMI : Product Example
800 x 480 TFT with Capacitive Touch Screen
S3DK : Development kit
Seg LCD
© 2016 Renesas Electronics Corporation. All rights reserved. Page 5
Synergy MCU S7 Series
Code Flash (4 MB)Data Flash (64 KB)
SRAM (640 KB)Flash CacheSecurity MPU
Memory Mirror Function
Memory
12-Bit A/D Converter x2 (25 ch.)
12-Bit D/A Converter x2High-Speed Analog
Comparator x6PGA x6
Temperature Sensor
DMA Controller (8 ch.)Data Transfer Controller
Event Link ControllerLow Power Modes
Switching Regulator
ECC in SRAM
Analog Timing & Control HMI
Connectivity System & Power Mgmt Safety Security& Encryption
General PWM Timer 32-bitEnhanced High Resolution x4
Asynchronous General Purpose Timer x2
General PWM Timer 32-bit Enhanced x4
WDT
Capacitive Touch Sensing Unit (18 ch.)
Graphics LCD Controller2D Drawing Engine
JPEG CodecParallel Data Capture
Ethernet MAC Controller x2Ethernet DMA ControllerEthernet PTP Controller
CAN x2 SDHI/MMC x2USBHS USBFS
Serial Communications Interfacex10
QSPI SPI x2IIC x3 SSI x2
Sampling Rate ConverterExternal Memory Bus
Multiple ClocksPort Function Select
RTCSysTick
SRAM Parity Error CheckFlash Area Protection
ADC DiagnosticsClock Frequency Accuracy
Measurement CircuitCRC Calculator
Data Operation CircuitPort Output Enable for GPT
IWDT
128-bit Unique IDTRNG
AES (128/192/256)3DES/ARC4
RSA/DSASHA1/SHA224/SHA256
240-MHz ARM® Cortex®-M4 CPU
IrDA Interface
General PWM Timer 32-bit x6
FPU | MPU | NVIC | ETM | JTAG | SWD | Boundary Scan
GHASH
© 2016 Renesas Electronics Corporation. All rights reserved. Page 6
HMI Hardware Considerations: Frame Buffer Memory
Draw Buffer
LCD Buffer
* Often 32 bpp
QVGA320x24016bpp
WQVGA480x27216bpp
VGA640x48016bpp*
WVGA800x48016bpp*
SVGA800x60016bpp*
WSVGA1024x600
16bpp*
XGA1024x768
16bpp*
WXGA1280x800
16bpp*
HD 7201280x720
16bpp*
WSXGA1680x1050
32bpp
HD 10801920x1080
32bpp
0.1MB 0.2MB 0.6MB 0.7MB 0.9MB 1.2MB 1.5MB 1.8MB 2.0MB 6.7MB 7.9MB
DoubleBuffer
SingleBuffer
0.3MB 0.5MB 1.2MB 1.5MB 1.8MB 2.3MB 3.0MB 3.5MB 3.9MB 13.5MB 15.8MB
© 2016 Renesas Electronics Corporation. All rights reserved. Page 7
HMI Hardware Considerations: Internal Buses
The framebuffer is the bitmap source that the LCD controller is constantly pulling from.
Bus Contention: The CPU and LCD controller both fighting for access to RAM.
Split bus and RAM architecture exist to overcome this
CPURAM
LCD Cntr TFT
FB
System Bus
Video Bus
Enhanced MCU System
Architecture
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy HMI Hardware - Busses
Page 8
ICode bus
CM4
Code flashmemory
DCode bus
SRAMHS
DMAC/DTC
EDMACJPEG
SRAM0 SRAM1External bus cont.
System bus
DMA bus
ETHER bus
GPX bus
QSPI Interface
Memory Bus 1 Memory Bus 2
Memory Bus 3
Memory Bus 4 Memory Bus 5
CS Area
SDRAM Area QSPI Area
GLCDC DRW
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy HMI Hardware - GLCDC
Page 9
Background:Overall TimingBackgroundColor
Graphics Layers:Two independent layersAlpha BlendedWVGA on each at 60Hz
Output Control:DitheringContrastBrightnessGammaTFT Signals
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy HMI Hardware - JPEG
Page 10
RE
AD
WR
ITE
Read RasterEncode
Write to JPEG
Read JPEGDecode
Write to RasterWVGA 32bpp < 20ms
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy HMI Hardware - DRW
Page 11
Raster Functions
Fill
Copy
Stretch BitBLT
Rotate and Scale
Alpha Blending
Vector Functions
Lines
Polygons
Circles and Ellipses
Quadratic Curves
2D Texture Mapping
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy HMI Software and Middleware
Page 12
Synergy Software Package (SSP)
Board Support Package (BSP)
FileX® USBX™ GUIX™ Functional LibrariesNetX™ and NetX™ Duo
CMSIS DSP
Captouch
Host Stack
Host Controller
Device Stack
Device Controller
ThreadX® RTOS
Memory Management
Message Queue
Inter-process and Inter-thread
Communication
Advanced Scheduler
Very Fast Performance and
Low Footprint
Complete Flash Management with
Wear Leveling
FAT12/16/32, exFAT, SD,
microSD, CF, and MemoryStick
Host Classes(Storage, CDC)
Device Classes(Storage, Audio,
HID, Printer, Hub)
GUIX Studio
Run Time Library
Canvas
Drawing
Screen
System
Widget
Window
FTP
TFTP
Telnet
PPP
SMTP
POP3
HTTP
DNS
SNMP
SNTP
NAT
TCP
IPv4/v6
UDP
ICMP
IGMP
ARP
RARP
DHCP Widget
Application Framework
Audio
Console
JPEG
SPI
I2C
UART
Messaging
Touch Panel
External IRQ
Thread Monitor
Power Profile
Security & Encryption
Hardware Abstraction Layer (HAL) Drivers
USBHS
USBFS
CAN
SDHI
QSPI
SPI
SSI
RTC
Ethernet MAC Controller
Serial Comm. Interface
IrDA Interface
Security & Encryption
Clock Management
Timing &Control
Graphics LCD Controller
2D Drawing Engine
JPEG Codec
Parallel Data Capture Unit
ADC12
ADC14
DAC8
Timer
© 2016 Renesas Electronics Corporation. All rights reserved.
Renesas Synergy Software Development Tools
Page 13
© 2016 Renesas Electronics Corporation. All rights reserved.
Graphic Design
Page 14
Many graphic frameworks only focus on displaying the images you give it, not magically crating
them from scratch
Graphic designers use powerful and complicated graphics tools to create the impressive buttons,
widgets and backgrounds we see today
For your product, you should hire a graphic artist
© 2016 Renesas Electronics Corporation. All rights reserved.
Graphic Design
Page 15
This is what your product will look like if hire a graphics artist
This is what your product will look like if you let an engineer design it
© 2016 Renesas Electronics Corporation. All rights reserved.
Synergy Family GUI Tools - GUIX™ Studio
Page 17
■ Develop using GUIX Studio on a PC and
integrate with application executable
WYSIWYG screen design environment
Import graphics from PNG or JPG files
Customize default colors & styles used by GUIX widgets
Multiple resource themes with font generation tool
Automatically generates C code compatible
with GUIX runtime library
■ Integrate with GUIX Runtime Library
■ Download end application to hardware GUIX Studio to Application
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX Studio™
Page 18
Desktop application program used to quickly and easily create GUIX applications
▪ Drag-and-drop WYSIWYG GUI design and resource editing tool
▪ Incorporate any number of fonts, images, strings and other assets seamlessly
▪ Graphically describe UI appearance and function
▪ Automatic code generation
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX Studio™
Page 19
Multi-language support
String table generation
XLIFF string file import and export
Fully Unicode capable using UTF8 string encoding
TrueType font conversion
Renders true type fonts to compressed, optimized GX_FONT format which produces fast boot times and fast character rendering.
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX Studio™
Page 20
Multiple Display Support
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX Studio™ Widgets
Page 21
Windows
Buttons
Sliders
Check Boxes
Text Strings
Indicators
Containers
Menus
Gauges
© 2016 Renesas Electronics Corporation. All rights reserved.
Widgets
Page 22
Define
Define reference name and logical ID name for every widget and parent
window
Customize
Customize the size, position, and general appearance of any widget
Modify
Modify the default settings for border type, fill color, font, etc...
Add Event Handler
Define custom event handlers and drawing functions to fully customize the
operation and appearance of any and all UI components
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX™ Touch Input Event Types
Page 23
Driver-defined
pen_down
pen_up
pen_drag
Generated Internally
flick_left, flick_right, flick_up, flick_down, zoom_in, and zoom_out
Based on time and speed criteria.
The user or device driver writer can add additional event types for other gestures.
The touch input driver encodes the event type and position into the TOUCH event data
structure, and pushes this event into the GUIX event queue.
Event routing, input captures, etc., are taken care of by GUIX.
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX™
Page 24
A run-time library for creation of embedded system graphical user interfaces
High-performance graphical drawing library
Complete windowing support
Multiple displays with different resolutions
Multilingual application support
Graphic file conversion
Small footprint
Full source code
Royalty-free
© 2016 Renesas Electronics Corporation. All rights reserved.
GUIX™ Runtime Library
Page 25
GUIX™ Example - Medical
Package