adding hmito your application and ... - renesas electronics

26
© 2016 Renesas Electronics Corporation. All rights reserved. ADDING HMI TO YOUR APPLICATION AND INNOVATING YOUR DISPLAY Lake Garda 7-8 April 2016

Upload: others

Post on 20-Mar-2022

0 views

Category:

Documents


0 download

TRANSCRIPT

© 2016 Renesas Electronics Corporation. All rights reserved.

ADDING HMI TO YOUR APPLICATION AND INNOVATING YOUR DISPLAY

Lake Garda7-8 April 2016

© 2016 Renesas Electronics Corporation. All rights reserved.

AGENDA

Page 2

HMI with Synergy

The Hardware

HMI with Synergy

The Software

SSP & GUIX Studio

© 2016 Renesas Electronics Corporation. All rights reserved. Page 3

Synergy Family HMI Capabilities

Technology

Capacitive Touch Sensing Unit

Graphics LCD Controller

2D Drawing Engine

JPEG Codec

Parallel Data Capture

Segment LCD Controller

Built-In HMI Features

© 2016 Renesas Electronics Corporation. All rights reserved. Page 4

Synergy Family HMI Hardware

S7DK : Development kit

480 x 272 TFT with Resistive Touch Screen

S7PE-HMI : Product Example

800 x 480 TFT with Capacitive Touch Screen

S3DK : Development kit

Seg LCD

© 2016 Renesas Electronics Corporation. All rights reserved. Page 5

Synergy MCU S7 Series

Code Flash (4 MB)Data Flash (64 KB)

SRAM (640 KB)Flash CacheSecurity MPU

Memory Mirror Function

Memory

12-Bit A/D Converter x2 (25 ch.)

12-Bit D/A Converter x2High-Speed Analog

Comparator x6PGA x6

Temperature Sensor

DMA Controller (8 ch.)Data Transfer Controller

Event Link ControllerLow Power Modes

Switching Regulator

ECC in SRAM

Analog Timing & Control HMI

Connectivity System & Power Mgmt Safety Security& Encryption

General PWM Timer 32-bitEnhanced High Resolution x4

Asynchronous General Purpose Timer x2

General PWM Timer 32-bit Enhanced x4

WDT

Capacitive Touch Sensing Unit (18 ch.)

Graphics LCD Controller2D Drawing Engine

JPEG CodecParallel Data Capture

Ethernet MAC Controller x2Ethernet DMA ControllerEthernet PTP Controller

CAN x2 SDHI/MMC x2USBHS USBFS

Serial Communications Interfacex10

QSPI SPI x2IIC x3 SSI x2

Sampling Rate ConverterExternal Memory Bus

Multiple ClocksPort Function Select

RTCSysTick

SRAM Parity Error CheckFlash Area Protection

ADC DiagnosticsClock Frequency Accuracy

Measurement CircuitCRC Calculator

Data Operation CircuitPort Output Enable for GPT

IWDT

128-bit Unique IDTRNG

AES (128/192/256)3DES/ARC4

RSA/DSASHA1/SHA224/SHA256

240-MHz ARM® Cortex®-M4 CPU

IrDA Interface

General PWM Timer 32-bit x6

FPU | MPU | NVIC | ETM | JTAG | SWD | Boundary Scan

GHASH

© 2016 Renesas Electronics Corporation. All rights reserved. Page 6

HMI Hardware Considerations: Frame Buffer Memory

Draw Buffer

LCD Buffer

* Often 32 bpp

QVGA320x24016bpp

WQVGA480x27216bpp

VGA640x48016bpp*

WVGA800x48016bpp*

SVGA800x60016bpp*

WSVGA1024x600

16bpp*

XGA1024x768

16bpp*

WXGA1280x800

16bpp*

HD 7201280x720

16bpp*

WSXGA1680x1050

32bpp

HD 10801920x1080

32bpp

0.1MB 0.2MB 0.6MB 0.7MB 0.9MB 1.2MB 1.5MB 1.8MB 2.0MB 6.7MB 7.9MB

DoubleBuffer

SingleBuffer

0.3MB 0.5MB 1.2MB 1.5MB 1.8MB 2.3MB 3.0MB 3.5MB 3.9MB 13.5MB 15.8MB

© 2016 Renesas Electronics Corporation. All rights reserved. Page 7

HMI Hardware Considerations: Internal Buses

The framebuffer is the bitmap source that the LCD controller is constantly pulling from.

Bus Contention: The CPU and LCD controller both fighting for access to RAM.

Split bus and RAM architecture exist to overcome this

CPURAM

LCD Cntr TFT

FB

System Bus

Video Bus

Enhanced MCU System

Architecture

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy HMI Hardware - Busses

Page 8

ICode bus

CM4

Code flashmemory

DCode bus

SRAMHS

DMAC/DTC

EDMACJPEG

SRAM0 SRAM1External bus cont.

System bus

DMA bus

ETHER bus

GPX bus

QSPI Interface

Memory Bus 1 Memory Bus 2

Memory Bus 3

Memory Bus 4 Memory Bus 5

CS Area

SDRAM Area QSPI Area

GLCDC DRW

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy HMI Hardware - GLCDC

Page 9

Background:Overall TimingBackgroundColor

Graphics Layers:Two independent layersAlpha BlendedWVGA on each at 60Hz

Output Control:DitheringContrastBrightnessGammaTFT Signals

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy HMI Hardware - JPEG

Page 10

RE

AD

WR

ITE

Read RasterEncode

Write to JPEG

Read JPEGDecode

Write to RasterWVGA 32bpp < 20ms

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy HMI Hardware - DRW

Page 11

Raster Functions

Fill

Copy

Stretch BitBLT

Rotate and Scale

Alpha Blending

Vector Functions

Lines

Polygons

Circles and Ellipses

Quadratic Curves

2D Texture Mapping

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy HMI Software and Middleware

Page 12

Synergy Software Package (SSP)

Board Support Package (BSP)

FileX® USBX™ GUIX™ Functional LibrariesNetX™ and NetX™ Duo

CMSIS DSP

Captouch

Host Stack

Host Controller

Device Stack

Device Controller

ThreadX® RTOS

Memory Management

Message Queue

Inter-process and Inter-thread

Communication

Advanced Scheduler

Very Fast Performance and

Low Footprint

Complete Flash Management with

Wear Leveling

FAT12/16/32, exFAT, SD,

microSD, CF, and MemoryStick

Host Classes(Storage, CDC)

Device Classes(Storage, Audio,

HID, Printer, Hub)

GUIX Studio

Run Time Library

Canvas

Drawing

Screen

System

Widget

Window

FTP

TFTP

Telnet

PPP

SMTP

POP3

HTTP

DNS

SNMP

SNTP

NAT

TCP

IPv4/v6

UDP

ICMP

IGMP

ARP

RARP

DHCP Widget

Application Framework

Audio

Console

JPEG

SPI

I2C

UART

Messaging

Touch Panel

External IRQ

Thread Monitor

Power Profile

Security & Encryption

Hardware Abstraction Layer (HAL) Drivers

USBHS

USBFS

CAN

SDHI

QSPI

SPI

SSI

RTC

Ethernet MAC Controller

Serial Comm. Interface

IrDA Interface

Security & Encryption

Clock Management

Timing &Control

Graphics LCD Controller

2D Drawing Engine

JPEG Codec

Parallel Data Capture Unit

ADC12

ADC14

DAC8

Timer

© 2016 Renesas Electronics Corporation. All rights reserved.

Renesas Synergy Software Development Tools

Page 13

© 2016 Renesas Electronics Corporation. All rights reserved.

Graphic Design

Page 14

Many graphic frameworks only focus on displaying the images you give it, not magically crating

them from scratch

Graphic designers use powerful and complicated graphics tools to create the impressive buttons,

widgets and backgrounds we see today

For your product, you should hire a graphic artist

© 2016 Renesas Electronics Corporation. All rights reserved.

Graphic Design

Page 15

This is what your product will look like if hire a graphics artist

This is what your product will look like if you let an engineer design it

© 2016 Renesas Electronics Corporation. All rights reserved.

Graphic Design to Application

Page 16

© 2016 Renesas Electronics Corporation. All rights reserved.

Synergy Family GUI Tools - GUIX™ Studio

Page 17

■ Develop using GUIX Studio on a PC and

integrate with application executable

WYSIWYG screen design environment

Import graphics from PNG or JPG files

Customize default colors & styles used by GUIX widgets

Multiple resource themes with font generation tool

Automatically generates C code compatible

with GUIX runtime library

■ Integrate with GUIX Runtime Library

■ Download end application to hardware GUIX Studio to Application

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX Studio™

Page 18

Desktop application program used to quickly and easily create GUIX applications

▪ Drag-and-drop WYSIWYG GUI design and resource editing tool

▪ Incorporate any number of fonts, images, strings and other assets seamlessly

▪ Graphically describe UI appearance and function

▪ Automatic code generation

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX Studio™

Page 19

Multi-language support

String table generation

XLIFF string file import and export

Fully Unicode capable using UTF8 string encoding

TrueType font conversion

Renders true type fonts to compressed, optimized GX_FONT format which produces fast boot times and fast character rendering.

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX Studio™

Page 20

Multiple Display Support

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX Studio™ Widgets

Page 21

Windows

Buttons

Sliders

Check Boxes

Text Strings

Indicators

Containers

Menus

Gauges

© 2016 Renesas Electronics Corporation. All rights reserved.

Widgets

Page 22

Define

Define reference name and logical ID name for every widget and parent

window

Customize

Customize the size, position, and general appearance of any widget

Modify

Modify the default settings for border type, fill color, font, etc...

Add Event Handler

Define custom event handlers and drawing functions to fully customize the

operation and appearance of any and all UI components

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX™ Touch Input Event Types

Page 23

Driver-defined

pen_down

pen_up

pen_drag

Generated Internally

flick_left, flick_right, flick_up, flick_down, zoom_in, and zoom_out

Based on time and speed criteria.

The user or device driver writer can add additional event types for other gestures.

The touch input driver encodes the event type and position into the TOUCH event data

structure, and pushes this event into the GUIX event queue.

Event routing, input captures, etc., are taken care of by GUIX.

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX™

Page 24

A run-time library for creation of embedded system graphical user interfaces

High-performance graphical drawing library

Complete windowing support

Multiple displays with different resolutions

Multilingual application support

Graphic file conversion

Small footprint

Full source code

Royalty-free

© 2016 Renesas Electronics Corporation. All rights reserved.

GUIX™ Runtime Library

Page 25

GUIX™ Example - Medical

Package

© 2016 Renesas Electronics Corporation. All rights reserved. Page 26

THANK YOU FOR YOUR ATTENTION

PLEASE REMEMBER TO COMPLETE THE FEEDBACK

SURVEY IN YOUR SMARTPHONE APP